Back to all positions

AI Test Engineer

Remote Full-time Now Hiring
About AscendionAscendion is a leader in AI-Native platform driven software engineering company that underwrites outcomes, helping businesses innovate faster, smarter, and with greater impact. We partner with Global 2000 clients across North America, UK, Europe, and APAC to solve complex challenges in data, experience design, software product engineering, and workforce transformation. Powered by expert engineers, thousands of AI agents, and our Engineering to the Power of AI™ (EngineeringAI) method, we deliver measurable outcomes that build trust, unlock value, and accelerate growth. Learn more at ascendion.comAscendion | Engineering to elevate life We have a culture built on opportunity, inclusion, and a spirit of partnership. Come, change the world with us:·        Build the coolest tech for world’s leading brands·        Solve complex problems – and learn new skills·        Experience the power of transforming digital engineering for Fortune 500 clients·        Master your craft with leading training programs and hands-on experience Experience a community of change makers!Join a culture of high-performing innovators with endless ideas and a passion for tech. Our culture is the fabric of our company, and it is what makes us unique and diverse. The way we share ideas, learning, experiences, successes, and joy allows everyone to be their best at Ascendion. AI Test EngineerKey Responsibilities:Must have: ·        Experience of testing AI applications·        Experience of test automations and tools, e.g. Tosca, Python, Selenium·        Strong knowledge & use of QA methodologies e.g. Agile, Waterfall, DevOps, BDD for functional test activities.·        Proven experience as a Quality Assurance Engineer, with a significant focus on testing Artificial Intelligence and Machine Learning products.·        Agentic AI Agent testing and validation.·        Strong knowledge of Responsible AI principles and practices, including experience in testing for fairness, bias detection, explainability, privacy, and security in AI systems.·        Familiarity with Agentic AI concepts and architectures.·        Experience in working with teams in DevSecOps·        In-depth knowledge of test toolsets and development languages including C#, Java·        Solid understanding and practical experience in testing Generative AI (GenAI) Solutions, including evaluating model outputs, prompt engineering, and understanding the nuances of generative models.·        Understanding of DevOps pipeline i.e. change, release & deployment processes·        Experience in conducting UAT, defect reporting & triage and preparing QA metrics·        Understanding across multiple disciplines of test, e.g. functional, integration, performance, compatibility·        ISTQB Foundation Level certificate (or equivalent experience)·        Test management tool expertise (such as Atlassian Jira, Azure DevOps etc.)·        Strong written, verbal and presentation skills·        Professional and confident with a strong drive & enthusiasm to multi-task.·        Acute attention to detail. Location: Remote Want to change the world? Let us know.Tell us about your experiences, education, and ambitions. Bring your knowledge, unique viewpoint, and creativity to the table. Let’s talk!

Requires AI/ML, GenAI, agentic AI, automation, QA methodology, DevSecOps, testing tools, C# and Java experience, plus ISTQB Foundation certification or equivalent.

Key Responsibilities

  • testing AI applications
  • validating AI agents
  • preparing QA metrics

Skills & Tools

Tosca, Python, Selenium, C#, Java, Atlassian Jira, Azure DevOps

Job Details

  • Category: Quality Assurance
  • Seniority: Mid Level
  • Commitment: Full Time
  • Workplace: Remote — United States
  • Languages: English

About Ascendion

An AI-native software engineering company that helps businesses solve complex technology challenges and accelerate growth. — Industry: Information Technology