Overview
Senior QA Engineer role at EXL. EXL is a global data and AI company offering services and solutions to reinvent client business models and unlock growth with speed. EXL harnesses data, AI, and industry knowledge to transform businesses across industries, including insurance, healthcare, banking and financial services, media and retail. EXL was founded in 1999 and has headquarters in New York with thousands of employees worldwide. For more information, visit www.exlservice.com.
EXL Digital is looking for an experienced Lead QA Engineer with experience in AI solutions to join the team. We seek a highly skilled Senior QA Engineer to define, implement, and automate comprehensive testing strategies for AI-powered solutions, with a focus on Generative AI applications. This role requires expertise in traditional software testing combined with specialized knowledge of AI/ML testing methodologies, including testing non-deterministic systems, model outputs, and AI agent behaviors.
Responsibilities
* Design and implement comprehensive testing frameworks for Generative AI applications, LLM-based systems, and AI agent workflows
* Develop automated testing strategies for AI model outputs including accuracy, relevance, bias detection, and safety validation
* Execute manual and automated testing of platform UI components, user interfaces, and AI-powered conversational systems
* Create and maintain comprehensive API test suites for REST/GraphQL endpoints, MCP servers, and AI service integrations
* Design and execute end-to-end process flow testing for complex AI workflows, agent orchestration, and multi-system integrations
* Build and maintain CI/CD testing pipelines with automated regression testing for both platform features and AI model behaviors
* Establish quality metrics and testing protocols for AI guardrails, safety mechanisms, and ethical AI compliance
* Perform load and performance testing for AI inference, model serving, real-time applications, and platform scalability
* Develop testing strategies for AI model evaluation including A/B testing frameworks, model comparison, and deployment validation
* Collaborate with engineering teams to establish quality gates, testing standards, and integrate QA into development workflows
Qualifications
* 7+ years of QA engineering experience with at least 2 years focused on AI/ML or complex platform applications
* Expert knowledge of automated testing frameworks (Selenium, Playwright, etc.) and CI/CD integration
* Proven experience testing APIs (REST, GraphQL) using tools like Postman, REST Assured, and custom automation frameworks
* Experience with Generative AI applications testing including LLMs, chatbots, AI agents, and prompt-based systems
* Knowledge of AI/ML evaluation metrics and testing methodologies for non-deterministic systems and model outputs
* Advanced experience with AWS and cloud-based application testing, including AI/ML services and infrastructure
* Strong understanding of performance testing tools (JMeter, Locust, Artillery) for both traditional applications and AI workloads
* Experience with manual testing methodologies including exploratory testing, usability testing, and cross-platform validation
* Experience with agile methodologies and collaborative development practices in fast-paced environments
* Bachelor's degree in Computer Science, Engineering, or related field with strong foundation in software testing principles
Benefits
* A competitive salary with a generous bonus, private healthcare, life assurance at 4x your annual salary, income protection insurance, and a rewarding pension
* EXL offers professional and personal development opportunities, including online courses, seminars, and workshops to enhance skills
* Equal Opportunity Employer; EXL is committed to diversity and does not discriminate based on race, religion, color, national origin, sex, sexual orientation, age, or disability
* Flexible hybrid working model to support a balanced, collaborative culture
To be considered for this role, you must already be eligible to work in the Republic of Ireland.
Additional
Location: Dublin, County Dublin, Ireland. Other job postings and dates listed are for informational purposes and do not pertain to the Senior QA Engineer role.
#J-18808-Ljbffr