Focusing on potential named entities during active label acquisition

Warning The system is temporarily closed to updates for reporting purpose.

Şapcı, Ali Osman Berk and Kemik, Hasan and Yeniterzi, Reyyan and Taştan, Öznur (2023) Focusing on potential named entities during active label acquisition. Natural Language Engineering . ISSN 1351-3249 (Print) 1469-8110 (Online) Published Online First https://dx.doi.org/10.1017/S1351324923000165

Warning
There is a more recent version of this item available.
Full text not available from this repository. (Request a copy)

Abstract

Named entity recognition (NER) aims to identify mentions of named entities in an unstructured text and classify them into predefined named entity classes. While deep learning-based pre-trained language models help to achieve good predictive performances in NER, many domain-specific NER applications still call for a substantial amount of labeled data. Active learning (AL), a general framework for the label acquisition problem, has been used for NER tasks to minimize the annotation cost without sacrificing model performance. However, the heavily imbalanced class distribution of tokens introduces challenges in designing effective AL querying methods for NER. We propose several AL sentence query evaluation functions that pay more attention to potential positive tokens and evaluate these proposed functions with both sentence-based and token-based cost evaluation strategies. We also propose a better data-driven normalization approach to penalize sentences that are too long or too short. Our experiments on three datasets from different domains reveal that the proposed approach reduces the number of annotated tokens while achieving better or comparable prediction performance with conventional methods.
Item Type: Article
Uncontrolled Keywords: Active learning; Annotation cost; Named entity recognition; Semi-supervised clustering
Divisions: Faculty of Engineering and Natural Sciences
Depositing User: Reyyan Yeniterzi
Date Deposited: 07 Aug 2023 12:30
Last Modified: 07 Aug 2023 12:30
URI: https://research.sabanciuniv.edu/id/eprint/47404

Available Versions of this Item

Actions (login required)

View Item
View Item