Skyline Dublin file

8 June 2016, Dublin (Ireland) hosted by Microsoft


Flow and overview of the program

Six topics have been selected: four in the morning and two in the afternoon. For each topic there will be a presentation by the session leader. There are also discussants assigned to each topic who will share a perspective or an opinion and raise relevant questions after the presentation. The presentation and the panel discussion are followed by a Q&A with the audience. After the six topics have been covered it is time for breakout discussions. The delegates can ‘vote with their feet’ as they walk towards the different rooms and tables where the discussions take place. At the end of the day the discussion leaders will report back to the plenary the conclusions and recommendations from their group discussion.

Who should attend and why?

In this workshop, we will see that high quality is not always as important as we think and that, very often, we evaluate quality without even knowing it. We will explore the relationship between KPIs and quality and we suggest ways to evaluate and benchmark MT engines based on real life use cases. The Translation QE Summit is recommended to buyers of translation in different industries and government and non-government organizations (director level and vendor/quality management functions), and to small and large language service providers (CEO, director and quality management functions).

Objectives of the QE Summit

The objectives of the QE Summit are to lay out strategies, raise awareness of industry dynamics and where possible agree to share and take collaborative actions. Participants will discuss relevant topics, recommend best practices and outline collaboration plans between industry and academia. The breakout sessions will provide opportunity for networking and interaction. You can watch a recording of Jaap van der Meer, TAUS founder and director, sharing the big picture view on translation quality at the TAUS Quality Evaluation Summit in March 2013.



Please click on the names of the hosts and presenters to view the presentation slides

Wednesday, June 8

Welcome and introductions

9:00 / Welcome by Vincent Gadani (Microsoft) & Jaap van der Meer (TAUS)

9:10 / Opening talk: Quality Evaluation at the EU by Angelika Vaasa (European Parliament) & Ingemar Strandvik (European Commission)

9:40 / Topic 1: Shall we Become Transparent about Quality?

The translation industry remains fragmented. Even today in our disintermediated era there are multiple participants in the same translation/localization workflow. Each participant (from the buyer through MLVs, SLVs down to the translator) has information that is not shared up or down the stream. Translation quality and productivity data is extremely useful to ensure efficiency and credibility in our industry. Still, this type of information remains a secret or gets lost in the labyrinth of translation processes because the tools are lacking within companies to unlock this data. Why don't we finally become transparent about the figures? About our own quality and productivity? An increasing number of buyers and their vendors, vendors and their translators have decided to collaborate on improving quality and productivity offering each other full transparency with mutual benefit. Let's hear their story!

Session leader: Antonio Tejada (Capita)

PanelistsAnna Kennedy (Chillistore Technologies), Kirill Soloviev (ContentQuo), Jeremy Clutton (Lingo24)

10:20 / Topic 2: Creative Content and Quality Testing in Mobile Applications

In this session, the challenges of localizing and evaluating creative content will be discussed. There is a pressing need to ensure quality even for marketing, game, hospitality, multimedia and mobile content just to name a few. One of the aims of the session is to define what’s relevant to QE for content that might have a short life cycle or low visibility within the product versus aspects of user experience that might be more critical. Speakers will discuss the role of traditional linguistic and functional quality testing versus new approaches that focus on areas that users might consider more important. How to balance quality - as we currently define it - with real expectations set by users, keeping in mind that user expectations might touch a variety of product areas and not include linguistic quality at all?

Session leaderMargarita Núñez-González (Simultrans)

Panelists: Suzanne Marie Frank (Vistatec), Orly González Kahn (Google)

11:00 / Refreshment Break

11:30 / Topic 3: TAUS Quality Dashboard: Use Cases and Integrations

TAUS DQF and the Quality Dashboard provide various methods to monitor productivity and efficiency and to ensure the right quality is delivered. Users can track their own productivity, conduct evaluations and benchmark the results against industry averages. The tools help establish return-on-investment and benchmark performance enabling users to take informed decisions. To ensure evaluation results are reliable it is vital that best practices are applied. The aim of this session is to discuss best practices on using TAUS DQF and to analyze different use cases.

Session leader: María Azqueta (Seprotec)

Panelists: Nigel Watson (SDL), Daniel Brockmann (SDL), Alessandro Cattelan (Translated)

12:10 / Topic 4: Automatic and Semi-automatic Evaluation Techniques

Obtaining valuable insights into quality and productivity with no or minimum human effort is one of the challenges TAUS has been trying to address in the past five years. One TAUS initiative in this direction is the development of the TAUS Efficiency Score. This score is based on translator productivity and edit distance but can be extended with additional data points such as error types assigned during review, MT confidence scores, TM match percentages or keystrokes and mouse clicks. In today's translation software, many of these data points are available ready to be harvested and analyzed. Some data types need special functions or plug-ins to become meaningful for the user. How can we make more efficient use of the available data? Can we save time on review and quality evaluation and still provide the right level of quality? What are best practices for accelerating the review process by sampling and content profiling techniques?

Session leader: Ruben de la Fuente (PayPal)

Panelists: Maribel Rodriguez (Moravia), Dragos Munteanu (SDL), Gábor Bessenyei (MorphoLogic Localisation Ltd.)

12:50 / Lunch

14:00 / Topic 5:  Machine Translation Quality - Are We There Yet?

MT providers claim that (customized) MT "helps you translate more words and grow your business". It "boosts productivity". And it can even "increase revenues" or "optimize customer service and support". What is the reality? Is MT improving or did we reach a plateau? Speakers at last year's QE Summit agreed: one of the main problems in the translation industry today is the lack of benchmarking. The output of MT engines cannot be compared to industry averages or standards because these are not yet available. Automated scores are meaningless outside the “laboratory”. At the same time, buyers of translation services are increasingly interested in translated content of different quality levels. They also want to know how the different engines are performing on different content types and in different language pairs. How do we know? Can we predict the output quality? Shouldn’t MT providers become more transparent to help buyers of these technologies make informed decisions?

Session leader: Dag Schmidtke (Microsoft)

Panelists: John Tinsley (Iconic), Olga Beregovaya (Welocalize), Olga Pospelova (eBay)

14:40 / Topic 6: Towards an Enterprise Aggregated Solution for DQF

In this session, we will discuss an alternative solution to the current DQF API in which translated data segments remain on enterprise servers. TAUS is planning on providing an open specification of methods to facilitate the aggregation of data on the enterprise side. The benefit of this solution is that the actual translated segments and other sensitive data are not shared. This is more economic and it makes DQF more attractive to enterprises that are restricted in their sharing of data with a third party. Participants will be invited to share their thoughts and provide feedback on this new solution.

Session leaderVincent Gadani (Microsoft)

Panelists: Fred Tuinstra (Lionbridge), Paola Valli (TAUS)

15:20 / Refreshment Break

Breakout sessions

During the sessions, throughout the day, attendees can write on a flip chart the topics or questions they like to discuss in the breakout sessions. After the last panel discussion they decide which breakout session they will join.

15:50 / Breakout discussions

Discussion leaders will coach the groups to review and analyze the questions and steer towards conclusions and recommendations. 

16:50 / Revert to plenary session

Each of the six groups will report back to all attendees what their conclusions are and will also make recommendations for possible collaborative industry actions. 

17:30 / Adjourn  



Olga Beregovaya | Welocalize

Olga BeregovayaOlga Beregovaya is a vice president at Welocalize. Prior to that, Olga was president of PROMT Americas, responsible for MT strategy and development. Olga has over 15 years of leadership experience in localization, expert knowledge of enterprise globalization and Machine Translation systems development. She holds a B.A. (Hons) in Linguistics from St. Petersburg University and an M.A. in Linguistics from the University of California, Berkeley. She has a unique combination of client and vendor-side experience.

Gábor Bessenyei | MorphoLogic Localisation

Gábor BessenyeiGábor Bessenyei is the CEO of MorphoLogic Localisation. He started his career in 1994 at Dynasoft, the Hungarian reselling partner of SAP, as a translator of the SAP R/3 release 2.2. In 1997, he went to the newly established subsidiary of SAP Hungary where as a translation coordinator, IT manager and member of the board he was responsible for the Hungarian language versions of SAP products and internal IT. In 2001 he founded MorphoLogic Localisation, a software localization and language technology company.

Gábor has always been fascinated by languages and technology. He is one of the creators of Globalese, a Moses-based statistical machine translation system, which was developed with the aim to integrate MT into the translation process, bringing benefits to all players in the translation ecosystem.

Daniel Brockmann | SDL

Daniel BrockmannDaniel Brockmann is Director of Product Management at SDL. Daniel’s team product-manages a wide range of applications for translators, project managers and terminologists: the translation productivity environment SDL Trados Studio, the terminology management suite SDL MultiTerm, the collaboration solution SDL Studio GroupShare as well as SDL's AppStore platform. His team also feeds into providing translation productivity and terminology capabilities in SDL's cloud-based platform, SDL Language Cloud.

Alessandro Cattelan | Translated

Alessandro CattelanAlessandro Cattelan is the Director of Localization Operations at Translated where he oversees all translation and localization operations, especially focusing on quality monitoring and improvement, constant analysis and improvement of existing processes, and the design and implementation of technical solutions. He is the product manager of the MateCat translation tool and is responsible for defining software requirements specifications and user experience. He graduated summa cum laude in Translation at the University of Trieste (Italy).

Ruben de la Fuente | PayPal

Ruben de la Fuente joined PayPal in 2008 as a Spanish language specialist. He is currently a machine translation specialist for PayPal. Rueben has been involved in the localization industry since 2001 in various roles including translator, editor and project manager. He has a great passion for both languages and technology so feels at home in places where these two disciplines meet. Ruben holds a BA in translation from the University of Granada.

Orly González | Google

Orly GonzálezOrly González Kahn is a Senior Language Specialist at Google, where she manages the shape and quality of Latin American Spanish. She holds a BA in Modern Language and Literatures from the UNAM and an MA in Translation from El Colegio de México. Orly has published work about the history of translation in the Hispanic world and about literary self-­translation.

Anna Kennedy | Chillistore

Anna KennedyI have dedicated the past 25 years of blood, sweat and tears to the localization industry and enjoyed every minute of it. I am Operations Director and co-founder at Chillistore Technologies, an innovative, Lean and Agile Localization Services company. I am also a co-founder of Scrum Ireland ( and a Certified SAFe Agilist. My passion for Agile led me to implement our very own Lean & Agile methodology for the management of Localization Services at Chillistore, which has the working principles of Transparency, Flexibility & Collaboration at its core.

Dragos Munteanu | SDL

Dragos MunteanuDragos Munteanu is Director of Research and Development for Machine Translation at SDL. Dragos is currently managing the end-to-end development life cycle of SDL’s Statistical Machine Translation Products, with a focus on continuous translation quality improvement via innovation in algorithms and advancement in scalability. Dragos has extensive knowledge in Statistical Machine Translation, Machine Learning, and Natural Language Processing. He has 10+ years of experience in the translation industry with significant contributions as both scientist and product manager. Dragos has a Ph.D. in Computer Science from the University of Southern California, and an MBA from the University of California Los Angeles.

Margarita Núñez-González | Simultrans

Margarita serves as SimulTrans’ Director responsible for European sales. She travels frequently throughout Europe, advising clients on best practices in the industry and helping them successfully localize their products for a global market. Margarita has spent over 20 years in the localization industry. She is passionate about customer service, process efficiencies and problem resolution and has a particularly interest in tools and technologies, digital marketing, and training & development of new sales people. She contributes to the Localisation Resource Centre as part of the panel to select a winner of the best thesis award in an area relevant to internationalization and localization. Margarita is involved with the Professional Women’s Network and Women in Localization. A native of Spain, Margarita speaks Spanish, Galician, and English fluently and is additionally familiar with Italian and Portuguese.

Maribel Rodríguez | Moravia

Maribel Rodríguez is a Development and Deployment Manager in the Language Technology Group at Moravia. She’s a 16-year Localization industry veteran, having helped to define and develop the practice of Linguistic QA Automation over the last 8 years. As a champion for the concept of “quality at all stages,” Maribel has a passion for maximizing the use of QA automation throughout the entire content lifecycle. Maribel is PMP certified and is a Lean Six Sigma Black Belt.

Kirill Soloviev | ContentQuo

Kirill SolovievKirill Soloviev is the co-founder & Head of Product at ContentQuo, an Eastern European technology startup on a mission to help translation buyers and their translation vendors collaborate transparently on delivering high-impact, revenue-driving multilingual content to their ultimate end users and readers. Kirill has a diverse 13+ year background in the Localization industry across buyer, vendor, and freelance positions. Before the startup, he’s been serving as a Global Director of Localization at Acronis, a leading independent software vendor in the data protection & disaster recovery space, as well as a number of other localization management and software engineering roles. Kirill also acts as a TAUS representative, advising localization departments and LSPs on how to implement efficient Localization Quality Management strategies in their organizations.

Ingemar Strandvik | European Commission

Ingemar StrandvikIngemar Strandvik is a quality manager at the European Commission's Directorate-General for Translation, where he formerly worked as a translator and language coordinator. Before joining the Commission, he worked as a state-authorized legal translator and court interpreter in Sweden. He also has a background as lexicographer and university teacher in specialised translation. Apart from studies in Linguistics, Philology and Translation, he has a degree in Court interpretation and a Master's degree in EU Law.

Antonio Tejada | Capita TI

Antonio TejadaAntonio joined the Localization industry in 1992, after having studied Translation and Interpreting at the University of Granada in Spain. Although his early involvement within the industry was as a language specialist, he soon moved on to the Management side of things, and has helped to define the current localization model of some of today’s key market players. Antonio has combined a wealth of experience in the industry with his Management and Leadership capabilities, and is now Head of Localisation Solutions for High Tech and Software at Capita Translation and Interpreting (Capita TI). In the late 90’s, Antonio was also involved in the early stages of MT application and evaluation within the localization workflow for Spanish. Since joining Capita TI in 2013, Antonio has been working closely with the Language Technology Team to define a strategic market position around the evaluation and customization of Capita TI’s MT workflows. In his little spare time, Antonio enjoys following his two sons around the basketball court as their number one supporter.

John Tinsley | Iconic Translation Machines

John TinsleyJohn Tinsley is the CEO and Co-Founder of Iconic Translation Machines. He is an expert in machine translation (MT) technology, a field in which he holds a PhD from Dublin City University. The foundations of Iconic are built on methods that John pioneered over almost a decade of research and development. Prior to founding Iconic, he worked on consulting and development of MT technology for multinational clients across a variety of industries. John also acts as an expert consultant with the European Commission, providing guidance on language technology initiatives.

Angelika Vaasa | European Parliament

Angelika VaasaAngelika Vaasa works at the Directorate-General for Translation of the European Parliament as a quality manager. Her small team is responsible for the development and maintenance of the Quality Policy of the DG Translation. On the one hand, it involves agreeing on quality assurance and control principles with 24 linguistic entities (a challenge!) and, on the other hand, handling and analysing any feedback on the quality of translations. Before taking up the position of the quality manager, Angelika worked as translator, interpreter and trainer. She has degrees in linguistics, interpretation, teacher training and EU Law.

Nigel Watson | SDL

Nigel WatsonWith over 19 years of experience in the localisation industry, Nigel leads a consulting team advising and supporting customers with their strategies for international expansion. Nigel’s extensive knowledge in latest localisation software, services, processes and integration has been instrumental in choosing the most effective language solutions for our customers.


Microsoft Ireland

European Product Development Centre 2 (EPDC2)

South County Business Park, Leopardstown

Dublin 18


Registration for the TAUS QE Summit in Dublin is now open. Cost for registration is €700 for non-members and €350 for TAUS members. We advise you to register as early as possible.

Note that 23% VAT is required on all registrations. For more information see the Irish tax site.

Hotel recommendations

Recommendable hotels in the area of the Microsoft facilities: 

Bewley's Hotel Leopardstown

Address: Central Park, Leopardstown, Dublin 18

T: +353 (0)1 293 5000 | F: +353 (0)1 293 5099 | Email: This email address is being protected from spambots. You need JavaScript enabled to view it.

Bewley’s Hotel Leopardstown is serviced by Aircoach, which runs from Dublin Airport every 20 minutes. Tickets can be purchased on the coach.

Buswells Hotel

Address: 23-25 Molesworth Street, Dublin 2

T: 01 295 8900 | Email: This email address is being protected from spambots. You need JavaScript enabled to view it.

Buswells Hotel is also serviced by Aircoach, which runs from Dublin Airport every 20 minutes. Tickets can be purchased on the coach.

Recommendable hotels in Dublin city center:

The Westin Dublin

Address: College Green, Westmoreland Street, Dublin 2

T: +353 (0)1 645 1000

Click here to find directions from various locations to the Westin Dublin.

The Westbury Hotel Dublin

Address: Grafton Street, Dublin 2 

T: +353 (0) 1 679 1122 | Email: This email address is being protected from spambots. You need JavaScript enabled to view it.

Click here to find directions from various locations to the Westbury Hotel Dublin.

The Shelbourne Dublin

Address: 27 St Stephen's Green · Dublin, 2

T: 353-1-6634500

Click here to find directions from various locations to the Shelbourne Dublin.



“Thanks for organizing such a great QE Summit. I really enjoyed everything I saw and made some great contacts that I think can be very helpful.”

Roisin Twomey, Microsoft

Just wanted to say that I enjoyed very much the conference.”

Maribel Rodríguez Molina, Lionbridge

“I really enjoyed the workshop and meeting known & new faces, thanks for inviting me along!

Lena Marg, Welocalize