Our client, a leading digital innovation company, is seeking a Senior QA Engineer to lead quality assurance for AI-powered solutions, with a focus on Generative AI and complex platform applications. This is an exciting opportunity to define testing strategies for cutting-edge AI systems in a collaborative, agile environment.
What You’ll Do
Design and implement comprehensive testing frameworks for Generative AI applications, LLM-based systems, and AI agent workflows
Develop automated testing strategies for AI model outputs, including accuracy, relevance, bias detection, and safety validation
Execute manual and automated testing of platform UI, conversational AI, and multi-system integrations
Create and maintain API test suites for REST/GraphQL endpoints and AI service integrations
Build and maintain CI/CD testing pipelines with automated regression testing for platform features and AI model behavior
Establish quality metrics, guardrails, and ethical AI compliance protocols
Perform load and performance testing for AI inference, model serving, and real-time applications
Collaborate with engineering teams to integrate QA into development workflows and enforce quality standards
Tech Stack
Automation & Testing: Selenium, Playwright, Postman, REST Assured, custom frameworks
Programming: Python, JavaScript/TypeScript
Cloud & AI: AWS, AI/ML services and infrastructure
Performance Testing: JMeter, Locust, Artillery
Methodologies: Agile, CI/CD, exploratory & usability testing, cross-platform validation
Requirements
5+ years QA experience, with 2+ years focused on AI/ML or complex platforms
Strong automated testing and CI/CD experience
Experience testing APIs, UI, and AI-driven systems
Knowledge of Generative AI applications, LLMs, AI agents, and prompt-based systems
Understanding of AI/ML evaluation metrics and testing methodologies for non-deterministic outputs
Bachelor’s degree in Computer Science, Engineering, or related field
#J-18808-Ljbffr