icons-social-media-facebook-circleicons-social-media-twitter-circleicons-social-media-linked-in-circle
What is Training Data?
icons-action-calendar4 Oct 2021
2 minute read
A brief definition of what training data is.

A machine learning algorithm uses data to learn and make decisions. The algorithm develops confidence in its decisions by understanding the underlying patterns, relationships, and structures within a training dataset. The higher quality the training data is, the better the algorithm will perform. So what is training data exactly? 

Training data, also referred to as a training set or learning set, is an input dataset used to train a machine learning model. These models use training data to learn and refine rules to make predictions on unseen data points. The volume of training data feeding into a model is often large, enabling algorithms to predict more accurate labels. Oftentimes, a training set consists of about 70-80% of your entire dataset. The structure of a training set consists of rows and columns, where one row is one observation, and one column is one feature. Features are also referred to as attributes, and they are extremely important to the outcome of a machine learning algorithm. For example, if we wanted to build a model that predicts the weather, some applicable features would be temperature, cloud coverage, and humidity. The values for each feature would be one observation, or row, in the dataset. 

It’s common and often necessary to have some sort of human involvement when using training data for a machine learning model. The training data must fit the business and model requirements. The data needs to be scrubbed and analyzed before it can be used in the model, otherwise, the quality of the predictions will be negatively impacted. Training Data illustration

 

Author
husna-sayedi

Husna is a data scientist and has studied Mathematical Sciences at University of California, Santa Barbara. She also holds her master’s degree in Engineering, Data Science from University of California Riverside. She has experience in machine learning, data analytics, statistics, and big data. She enjoys technical writing when she is not working and is currently responsible for the data science-related content at TAUS.

Related Articles
icons-action-calendar3 Mar 2022

The AI scene of the 2010s was shaped by breakthroughs in vision-enabled technologies, from advanced image searches to computer vision systems for medical image analysis or for detecting defective parts in manufacturing and assembly. The 2020s, however, are foreseen to be all about natural language technologies and language-based AI tasks. NLP, NLG, NLQ, NLU… The list of abbreviations starting with NL (Natural Language) seems to grow each day. Regardless of the technology domain, it’s observed that natural language technologies will be in a field-shaping position in a variety of areas from business intelligence and healthcare to fintech.

icons-action-calendar3 Jan 2022

Bilingual, NLP-driven word clouds are now available in TAUS Data Marketplace. In this article, we discuss what word clouds are and what they can tell us about the contents of a document containing bilingual text data.

icons-action-calendar2 Dec 2021

This is the third article in my series on Translation Economics of the 2020s. In the first article published in Multilingual, I sketched the evolution of the translation industry driven by technological breakthroughs from an economic perspective. In the second article, Reconfiguring the Translation Ecosystem, I laid out the emerging new business models and ended with the observation that new smarter models still need to be invented. This is where I will now pick up the thread and introduce you to the next logical translation solution. I call it: Data-Enhanced Machine Translation.