Exploring The Effects of Data Volume and Transfer-Language Choice on Transfer Learning with Application to Polish

Electronics  ·  2026

Juuso Eronen; Zhenzhen Liu; Michal Ptaszynski; Karol Nowakowski; Fumito Masui;

HIGHLIGHT

Transfer learning offers a practical way to improve neural machine translation in low-resource settings, but its effectiveness depends on both the choice of transfer language and the amount of target-language data available for adaptation. In this study, we examine these factors specifically for Polish–English translation using mBART.

RELATED

Papers      Patents     Grants     Venues     Experts    Cite    Share    Save

ABSTRACT

Transfer learning offers a practical way to improve neural machine translation in low-resource settings, but its effectiveness depends on both the choice of transfer language and the amount of target-language data available for adaptation. In this study, we examine these factors specifically for Polish–English translation using mBART. We evaluate Czech, Russian, and German as parent languages and extend the analysis with a combined Slavic parent model trained on Czech and Russian. The models are compared across 0-shot, 10-shot, 100-shot, 1k-shot, and 10k-shot settings. Within this Polish–English mBART setting, Czech provides the strongest zero-shot performance, while Russian and German improve substantially as Polish fine-tuning data increases and achieve the strongest results at higher shot levels. The paper therefore analyzes selected transfer-language configurations rather than a formally measured similarity variable. The results suggest that, in this setup, transfer-language choice matters most when no Polish supervision is available, whereas larger amounts of Polish data can compensate for weaker initial transfer alignment.

 Paraphrase     Questionfy     Wikify     Simplify     Summarize