Evaluating ChatGPT's ability to detect hate speech in Turkish tweets

Dehghan, Somaiyeh and Yanıkoğlu, Berrin (2024) Evaluating ChatGPT's ability to detect hate speech in Turkish tweets. In: 7th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2024, St. Julian's

Full text not available from this repository. (Request a copy)

Abstract

ChatGPT, developed by OpenAI, has made a significant impact on the world, mainly on how people interact with technology. In this study, we evaluate ChatGPT's ability to detect hate speech in Turkish tweets and measure its strength using zero- and few-shot paradigms and compare the results to the supervised fine-tuning BERT model. On evaluations with the SIU2023-NST dataset, ChatGPT achieved 65.81% accuracy in detecting hate speech for the few-shot setting, while BERT with supervised fine-tuning achieved 82.22% accuracy. This results supports previous findings that show that, despite its much smaller size, BERT is more suitable for natural language classifications tasks such as hate speech detection.
Item Type: Papers in Conference Proceedings
Divisions: Center of Excellence in Data Analytics
Faculty of Engineering and Natural Sciences
Depositing User: Berrin Yanıkoğlu
Date Deposited: 11 Jun 2024 15:37
Last Modified: 11 Jun 2024 15:37
URI: https://research.sabanciuniv.edu/id/eprint/49326

Actions (login required)

View Item
View Item