Dehghan, Somaiyeh and Yanıkoğlu, Berrin (2024) Evaluating ChatGPT's ability to detect hate speech in Turkish tweets. In: 7th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2024, St. Julian's
Full text not available from this repository. (Request a copy)Abstract
ChatGPT, developed by OpenAI, has made a significant impact on the world, mainly on how people interact with technology. In this study, we evaluate ChatGPT's ability to detect hate speech in Turkish tweets and measure its strength using zero- and few-shot paradigms and compare the results to the supervised fine-tuning BERT model. On evaluations with the SIU2023-NST dataset, ChatGPT achieved 65.81% accuracy in detecting hate speech for the few-shot setting, while BERT with supervised fine-tuning achieved 82.22% accuracy. This results supports previous findings that show that, despite its much smaller size, BERT is more suitable for natural language classifications tasks such as hate speech detection.
Item Type: | Papers in Conference Proceedings |
---|---|
Divisions: | Center of Excellence in Data Analytics Faculty of Engineering and Natural Sciences |
Depositing User: | Berrin Yanıkoğlu |
Date Deposited: | 11 Jun 2024 15:37 |
Last Modified: | 11 Jun 2024 15:37 |
URI: | https://research.sabanciuniv.edu/id/eprint/49326 |