“While social media offers freedom of self-expression, abusive language carry significant negative social impact. Driven by the importance of the issue, research in the automated detection of abusive language has witnessed growth and improvement. However, these detection models display a reliance on strongly indicative keywords, such as slurs and profanity. This means that they can falsely (1a) miss abuse without such keywords or (1b) flag nonabuse with such keywords, and that (2) they perform poorly on unseen data. Despite the recognition of these problems, gaps and inconsistencies remain in the literature. In this study, we analyse the impact of keywords from dataset construction to model behaviour in detail, with a focus on how models make mistakes on (1a) and (1b), and how (1a) and (1b) interact with (2). Through the analysis, we provide suggestions for future research to address all three problems.”
Hidden behind the obvious: misleading keywords and implicitly abusive language on social media (arXiv)
Categories:
Related Post
Defining and identifying hate motives: bias indicators for the Australian context (CRIS)Defining and identifying hate motives: bias indicators for the Australian context (CRIS)
“This report is structured in two parts: in Part 1, we introduce and discuss the concept of bias indicators, including their uses, benefits, and risks. In Part 2, we present
Using Transfer-based Language Models to Detect Hateful and Offensive Language Online (Proceedings of the Fourth Workshop on Online Abuse and Harms)Using Transfer-based Language Models to Detect Hateful and Offensive Language Online (Proceedings of the Fourth Workshop on Online Abuse and Harms)
“The results indicate that the attention-based models profoundly confuse hate speech with offensive and normal language. However, the pre-trained models outperform state-of-the-art results in terms of accurately predicting the hateful
Offline and Online Gender-Based Violence: Extremism Risk Assessment Tools and the Rise of the Incel Rebellion (GNET Research)Offline and Online Gender-Based Violence: Extremism Risk Assessment Tools and the Rise of the Incel Rebellion (GNET Research)
“In recent years, there have been increasing instances of online hate and gender-based violence against women. Reports of involuntary celibate (incel)-inspired violence are prevalent and have become dominant in popular