Webersinke, Nicolas; Kraus, Mathias; Bingler, Julia; … - 2022
Over the recent years, large pretrained language models (LM) have revolutionized the field of natural language processing (NLP). However, while pretraining on general language has been shown to work very well for common language, it has been observed that niche language poses problems. In...