The Art of Embedding Fusion: Optimizing Hate Speech Detection (arXiv)

In this work, we shed light on various combination techniques for several PLMs and comprehensively analyze their effectiveness. Our findings show that combining embeddings leads to slight improvements but at a high computational cost and the choice of combination has marginal effect on the final outcome.

https://arxiv.org/abs/2306.14939