Technical AI Quality Coordinator
Job Purpose
The Technical AI Quality Coordinator is an integral part of our Data Services team, blending a strong Quality Assurance background with practical scripting and automation skills. In this role, quality is your primary compass—you will help define our quality strategy, design technical testing frameworks, and evaluate the output quality of our distributed workforce.
You will play a key role in ensuring top-notch data integrity across AI annotation, RLHF (Reinforcement Learning from Human Feedback), and model evaluation pipelines through a combination of data analysis, light coding, and programmatic quality design.
About Generate
We help our customers Generate better content, at scale
Job Overview
Key Responsibilities
- Support quality assurance across AI data projects by improving processes, automating quality checks, and monitoring data accuracy.
- Develop and maintain testing frameworks, evaluation datasets, and quality metrics to ensure consistent project outcomes.
- Investigate quality issues, identify root causes, and implement corrective actions to improve performance.Help establish and maintain quality standards, frameworks, and auditing processes across projects.
- Monitor contributor and team performance, providing insights and recommendations to drive quality improvements.
- Partner with cross-functional teams including Data Engineering, AI Engineering, and Solutions teams to embed quality controls and reporting into workflows.
- Track key quality and performance metrics, identify risks, and support continuous improvement initiatives.
- Stay informed on AI industry trends and contribute ideas to enhance quality programs and best practices.
Skills & Experience
- 3+ years of experience in Quality Assurance, Data Quality, or AI Operations.
- Working knowledge of Python and SQL for data analysis, reporting, and automation.
- Experience supporting AI/ML data projects, including data annotation, evaluation, or training data programs.
- Strong analytical skills with the ability to identify quality issues, trends, and opportunities for improvement.
- Excellent English communication skills and experience collaborating with global, cross-functional teams.
Nice to Have
- Degree in Data Analytics, Computer Science, Statistics, Linguistics, Psychology, or a related field.
- Experience with reporting and visualization tools such as Power BI, Tableau, or Looker.
- Familiarity with remote or crowdsourced workforce management.
Life at RWS
Life at RWS - If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood, then you’ll love life at RWS.
Our purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career.
In return, we expect all our people to live by the values that unite us: to partner, putting clients fist and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients.
RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
RWS Values
Get the 3Ps right – Partner, Pioneer, Progress – and we´ll Deliver together as RWS.
Recruitment Agencies: RWS Holdings PLC does not accept agency resumes. Please do not forward any unsolicited resumes to any RWS employees. Any unsolicited resume received will be treated as the property of RWS and Terms & Conditions associated with the use of such resume will be considered null and void.
Originally posted on