Conference Paper Published

PEMRC: A Positive Enhanced Machine Reading Comprehension Method for Few-Shot Named Entity Recognition in Biomedical Domain

Dong, Y., Li, D., Gu, J., Qian, L.*, & Zhou, G. (2024). PEMRC: A Positive Enhanced Machine Reading Comprehension Method for Few-Shot Named Entity Recognition in Biomedical Domain. In H. Xu, Q. Chen, H. Lin, F. Wu, L. Liu, B. Tang, T. Hao, & Z. Huang (Eds.), Health Information Processing: 9th China Health Information Processing Conference, CHIP 2023, Proceedings, 22-35. Springer.

DOI: https://doi.org/10.1007/978-981-99-9864-7_2

Abstract

In this paper, we propose a simple and effective few-shot named entity recognition (NER) method for biomedical domain, called PEMRC (Positive Enhanced Machine Reading Comprehension). PEMRC is based on the idea of using machine reading comprehension reading comprehension (MRC) framework to perfome few-shot NER and fully exploit the prior knowledge implied in the label information. On one hand, we design three different query templates to better induce knowledge from pre-trained language models (PLMs). On the other hand, we design a positive enhanced loss function to improve the model’s accuracy in identifying the start and end positions of entities under low-resources scenarios. Extensive experimental results on eight benchmark datasets in biomedical domain show that PEMRC significantly improves the performance of few-shot NER.

Keywords

Biomedical Domain, Few-shot Named Entity Recognition, Machine Reading Comprehension