Domain Classification with Natural Language Processing

by András Aponyi

19/08/2021

A tutorial on automatic domain classification with NLP: from data preprocessing to the training and evaluation of an artificial neural network.

domain-classification-with-natural-language-processing

Author

András Aponyi

NLP Research Analyst at TAUS with a background in linguistics and natural language processing. My mission is to follow the latest trends in NLP and use them to enrich the TAUS data toolkit.

Data for AI

TAUS Data Sale to Boost Multilingual LLMs

by Anne-Maj van der Meer

11/03/2024

Purchase TAUS's exclusive data collection, featuring close to 7.4 billion words, covering 483 language pairs, now available at discounts exceeding 95% of the original value.

Data for AI

Transforming Translations: The Crucial Role of Language Data in the Age of Large Language Models and Generative AI

by Anne-Maj van der Meer

09/11/2023

Explore the crucial role of language data in training and fine-tuning LLMs and GenAI, ensuring high-quality, context-aware translations, fostering the symbiosis of human and machine in the localization sector.

Data for AI

Domain Adaptation: Types and Methods

by Anne-Maj van der Meer

19/12/2022

Domain adaptation approaches can be categorized into three categories according to the level of supervision used during the training process.