Leveraging The Cross-Domain & Cross-Linguistic Corpus for Low Resource NMT: A Case Study On Bhili-Hindi-English Parallel Corpus

ARXIV  ·  2025

Pooja Singh; Shashwat Bhardwaj; Vaibhav Sharma; Sandeep Kumar;

HIGHLIGHT

Comprehensive evaluation demonstrates that thefine-tuned NLLB-200 distilled 600M variant model outperforms others,highlighting the potential of multilingual models in low resource scenarios.Furthermore, we investigated the generative translation capabilities ofmultilingual LLMs on BHEPC using in-context learning, assessing performanceunder cross-domain generalization and quantifying distributional divergence.This work bridges a critical resource gap and promotes inclusive naturallanguage processing technologies for low-resource and marginalized languagesglobally.

RELATED

Papers      Patents     Grants     Venues     Experts    Cite    Share    Save

ABSTRACT

The linguistic diversity of India poses significant machine translationchallenges, especially for underrepresented tribal languages like Bhili, whichlack high-quality linguistic resources. This paper addresses the gap byintroducing Bhili-Hindi-English Parallel Corpus (BHEPC), the first and largestparallel corpus worldwide comprising 110,000 meticulously curated sentencesacross Bhili, Hindi, and English. The corpus was created with the assistance ofexpert human translators. BHEPC spans critical domains such as education,administration, and news, establishing a valuable benchmark for research in lowresource machine translation. To establish a comprehensive Bhili MachineTranslation benchmark, we evaluated a wide range of proprietary and open-sourceMultilingual Large Language Models (MLLMs) on bidirectional translation tasksbetween English/Hindi and Bhili. Comprehensive evaluation demonstrates that thefine-tuned NLLB-200 distilled 600M variant model outperforms others,highlighting the potential of multilingual models in low resource scenarios.Furthermore, we investigated the generative translation capabilities ofmultilingual LLMs on BHEPC using in-context learning, assessing performanceunder cross-domain generalization and quantifying distributional divergence.This work bridges a critical resource gap and promotes inclusive naturallanguage processing technologies for low-resource and marginalized languagesglobally.

 Paraphrase     Questionfy     Wikify     Simplify     Summarize

Download