icons-social-media-facebook-circleicons-social-media-twitter-circleicons-social-media-linked-in-circle
TAUS Publishes TAUS DeMT™ Evaluation Report 2022
icons-action-calendar8 Jun 2022
2 minute read
The TAUS DEMT™️ Evaluation Report 2022 looks at the performance of DEMT™️ in comparison to to other major MT engines

Amsterdam,  June 8, 2022  TAUS, a leading provider of human-powered language data for AI solutions, has published the TAUS DeMT™ Evaluation Report 2022. The report compares TAUS DeMT™ performance against available major machine translation engines in 8 language pairs for the eCommerce domain, 18 language pairs for the Medical/Pharma domain, and 4 language pairs for the Financial domain. This report’s findings are based on Polyglot Technology LLC’s independent analysis to benchmark the machine translation quality of DeMT™ relative to other major online machine translation providers.

TAUS DeMT™offers an end-to-end solution to those who wish to produce customized MT output for their specific domains and language pairs, without the hassle of going through the actual MT training process. Users can simply drop the file they would like to machine translate and select the datasets that they wish to be used in their customization. In the background, our technology selects the best-performing MT engine for the given source content and processes it by feeding the selected training dataset into the engine to produce a highly customized output. The translated file is then directly sent to the user’s inbox.

Key Takeaways

  • TAUS DeMT™ improved the BLEU score over the non-customized online machine translation systems for all language pairs. 
  • TAUS DeMT™ improves the BLEU score over the worst performing non-customized online machine translation service:
    • by more than 10 points, or 25% on average 
    • by more than 5 BLEU points at a minimum
  • TAUS DeMT™ improves the BLEU score over the best performing non-customized online machine translation service: 
    • by more than 5 BLEU points, or 11% on average 
    • by more than one BLEU point at a minimum
  • These are significant improvements that demonstrate the superiority of TAUS DeMT™ for the Ecommerce, Medical/Pharma and Financial domains over non-customized online machine translation services.
  • The baseline engines continuously keep improving themselves, yet TAUS DeMT™ continues to provide improved scores on each one through the power of careful selection and curation of training and test datasets.

The full report can be found here.

 

About TAUS

TAUS was founded in 2005 as a think tank with a mission to automate and innovate translation. Ideas transformed into actions. TAUS became the language data network offering the largest industry-shared repository of data, deep know-how in language engineering and a network of HLP contributors of data around the globe. Our mission today is to empower global enterprises and their service and technology providers with data solutions that help them to communicate in all languages, faster, better and more efficiently.

 

About Polyglot Technology

Polyglot Technology LLC helps customers succeed with machine translation by enabling them to make best use of data available to them, by assessing machine translation quality independent from MT vendors, and by advising customers on how to best integrate the technology with people and processes.

 

Author
şölen-aslan

Şölen is the Head of Digital Marketing at TAUS where she leads digital growth strategies with a focus on generating compelling results via search engine optimization, effective inbound content and social media with over seven years of experience in related fields. She holds BAs in Translation Studies and Brand Communication from Istanbul University in addition to an MA in European Studies: Identity and Integration from the University of Amsterdam. After gaining experience as a transcreator for marketing content, she worked in business development for a mobile app and content marketing before joining TAUS in 2017. She believes in keeping up with modern digital trends and the power of engaging content. She also writes regularly for the TAUS Blog/Reports and manages several social media accounts she created on topics of personal interest with over 100K followers.

Related Articles
icons-action-calendar8 Jun 2022

AMSTERDAM, June 8, 2022 TAUS, a leading provider of human-powered language data for AI solutions, announced today that it has been listed as a Representative Vendor in the Gartner Market Guide for AI-Enabled Translation Services 2022 report. 

icons-action-calendar16 Feb 2022

Amsterdam, February 16, 2022 - TAUS, the one-stop language data shop, is pleased to announce that TAUS data products and data services are now available to users of Amazon Translate on the AWS Marketplace. This first step marks the beginning of continuous collaboration between TAUS and Amazon Translate. As of today, AWS customers can review and buy 30 bilingual corpora in the Ecommerce, Medical/pharmaceutical and Finance domains. The languages available are as follows:

icons-action-calendar19 Jan 2022

Amsterdam, January 19, 2022 - TAUS, the one-stop language data shop established through deep knowledge of the language industry, globally sourced community talent, and in-house NLP expertise, launches a new service: Data-Enhanced Machine Translation (DEMT) on their Data Marketplace