Biomedical Entity Linking with Triple-aware Pre-Training

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearch

Authors

The large-scale analysis of scientific and technical documents is crucial for extracting structured knowledge from unstructured text. A key challenge in this process is linking biomedical entities, as these entities are sparsely distributed and often underrepresented in the training data of large language models (LLM). At the same time, those LLMs are not aware of high level semantic connection between different biomedical entities, which are useful in identifying similar concepts in different textual contexts. To cope with aforementioned problems, some recent works focused on injecting knowledge graph information into LLMs. However, former methods either ignore the relational knowledge of the entities or lead to catastrophic forgetting. Therefore, we propose a novel framework to pre-train the powerful generative LLM by a corpus synthesized from a KG. In the evaluations we are unable to confirm the benefit of including synonym, description or relational information. This work-in-progress highlights key challenges and invites further discussion on leveraging semantic information for LLm performance and on scientific document processing.
Original languageEnglish
Title of host publicationSemantic Technologies and Deep Learning Models for Scientific, Technical and Legal Data 2025
EditorsRima Dessi, Joy Jeenu, Danilo Dessi, Francesco Osborne, Hidir Aras
Number of pages8
Place of PublicationAachen
PublisherCEUR-WS
Publication date16.06.2025
DOIs
Publication statusPublished - 16.06.2025
EventThird International Workshop on Semantic Technologies and Deep Learning Models for Scientific, Technical and Legal Data - SemTech4STLD 2025 - Portoroz, Slovenia
Duration: 01.06.202501.06.2025
Conference number: 3

    Research areas

  • Entity Linking, cientific data, Deep Learning, Semantic information
  • Informatics

Recently viewed

Publications

  1. Anwendungsprogrammierung mit Embedded-SQL
  2. Methods in Writing Process Research
  3. Non-destructive transmissive inductive thickness sensor for IoT applications
  4. Composing with the terra fluida of interaction: new paths for CCO research as relational practice
  5. Doing statistics, enacting the nation
  6. Investigating Factors on R estorative Sleep Quality and its Relationship with Personal Work Performance - An Analysis of Diary Data
  7. Experimental Investigation of Efficiency and Deposit Process Temperature During Multi-Layer Friction Surfacing
  8. Secondary task as a measure of cognitive load
  9. The State of Multimedia Mass-Balance Modeling in Environmental science and decision-making
  10. Predicting recurrent chat contact in a psychological intervention for the youth using natural language processing
  11. Media Review: Extrapolations - A View from OS4F
  12. Combining Model Predictive and Adaptive Control for an Atomic Force Microscope Piezo-Scanner-Cantilever System
  13. Material system analysis
  14. The use of pseudo-causal narratives in EU policies
  15. Motivation for the Continuation of Work
  16. An optimal minimum phase approximating PD regulator for robust control of a throttle plate
  17. Agile Portfolio Management Patterns
  18. Investigating quality raters' performance using interface evaluation methods
  19. Introduction
  20. Enhancing the structural diversity between forest patches — A concept and real-world experiment to study biodiversity, multifunctionality and forest resilience across spatial scales
  21. Operation B
  22. Investigating the Promotional Effect of Green Signals in Sponsored Search Advertising Using Bayesian Parameter Estimation
  23. New Communications Technology in the Context of Interactive Sound Art
  24. A holistic view on security and collaboration in safe space
  25. On the Epistemology of Computer Simulation
  26. Behavior of microstructure and mechanical properties in the stir zone of friction stir welded ME21 magnesium alloy
  27. Empirical Studies with Micro-Data from Official Statistics in Germany