Skip to main content
Start main content

Conference Paper Published

Rearch

Employing Glyphic Information for Chinese Event Extraction with Vision-Language Model

Bao, X., Gu, J.*, Wang, Z.*, Qiang, M., & Huang, C.-R. (2024). Employing Glyphic Information for Chinese Event Extraction with Vision-Language Model. In Findings of the Association for Computational Linguistics: EMNLP 2024, 1068-1080.
 
DOI:  https://doi.org/10.18653/v1/2024.findings-emnlp.982

 

Abstract

As a complex task that requires rich information input, features from various aspects have been utilized in event extraction. However, most of the previous works ignored the value of glyph, which could contain enriched semantic information and can not be fully expressed by the pre-trained embedding in hieroglyphic languages like Chinese. We argue that, compared with combining the sophisticated textual features, glyphic information from visual modality could provide us with extra and straight semantic information in extracting events. Motivated by this, we propose a glyphic multi-modal Chinese event extraction model with hieroglyphic images to capture the intra- and inter-character morphological structure from the sequence. Extensive experiments build a new state-of-the-art performance in the ACE2005 Chinese and KBP Eval 2017 dataset, which underscores the effectiveness of our proposed glyphic event extraction model, and more importantly, the glyphic feature can be obtained at nearly zero cost. Code and data can be found at https://github.com/HoraceXIaoyiBao/GlyphicVLM-for-ChineseEE.

 
 

 

 






Your browser is not the latest version. If you continue to browse our website, Some pages may not function properly.

You are recommended to upgrade to a newer version or switch to a different browser. A list of the web browsers that we support can be found here