Zero-Shot Document-Level Biomedical Relation Extraction Via Scenario-based Prompt Design in Two-Stage with LLM

ARXIV  ·  2025

Lei Zhao; Ling Kang; Quan Guo;

HIGHLIGHT

To enhance the effectiveness ofprompt, we propose a five-part template structure and a scenario-based promptdesign principles, along with evaluation method to systematically assess theprompts.

RELATED

Papers      Patents     Grants     Venues     Experts    Cite    Share    Save

ABSTRACT

With the advent of artificial intelligence (AI), many researchers areattempting to extract structured information from document-level biomedicalliterature by fine-tuning large language models (LLMs). However, they facesignificant challenges such as the need for expensive hardware, likehigh-performance GPUs and the high labor costs associated with annotatingtraining datasets, especially in biomedical realm. Recent research on LLMs,such as GPT-4 and Llama3, has shown promising performance in zero-shotsettings, inspiring us to explore a novel approach to achieve the same resultsfrom unannotated full documents using general LLMs with lower hardware andlabor costs. Our approach combines two major stages: named entity recognition(NER) and relation extraction (RE). NER identifies chemical, disease and geneentities from the document with synonym and hypernym extraction using an LLMwith a crafted prompt. RE extracts relations between entities based onpredefined relation schemas and prompts. To enhance the effectiveness ofprompt, we propose a five-part template structure and a scenario-based promptdesign principles, along with evaluation method to systematically assess theprompts. Finally, we evaluated our approach against fine-tuning and pre-trainedmodels on two biomedical datasets: ChemDisGene and CDR. The experimentalresults indicate that our proposed method can achieve comparable accuracylevels to fine-tuning and pre-trained models but with reduced human andhardware expenses.

 Paraphrase     Questionfy     Wikify     Simplify     Summarize

Download