Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Models (arXiv)

Memory features are increasingly used by commercial LLMs to provide tailored replies depending on user information, such as demographics. However, little is known about the consequences of this customization, particularly in delicate areas like hate speech. In order to detect hate speech, this study assesses cutting-edge LLMs in a variety of personalization situations, such as those involving multiple languages and country-specific identities. The findings indicate that model behavior is significantly impacted by customisation. We adjust the models by punishing incorrect classifications across contexts in order to mitigate the ensuing biases. In both individualized and non-individualized contexts, the modified models exhibit improved performance.

https://arxiv.org/abs/2505.02252