Our client, a leading digital innovation company, is seeking a Senior QA Engineer to lead quality assurance for AI-powered solutions, with a focus on Generative AI and complex platform applications. This is an exciting opportunity to define testing strategies for cutting-edge AI systems in a collaborative, agile environment.
What You’ll Do
* Design and implement comprehensive testing frameworks for Generative AI applications, LLM-based systems, and AI agent workflows
* Develop automated testing strategies for AI model outputs, including accuracy, relevance, bias detection, and safety validation
* Execute manual and automated testing of platform UI, conversational AI, and multi-system integrations
* Create and maintain API test suites for REST/GraphQL endpoints and AI service integrations
* Build and maintain CI/CD testing pipelines with automated regression testing for platform features and AI model behavior
* Establish quality metrics, guardrails, and ethical AI compliance protocols
* Perform load and performance testing for AI inference, model serving, and real-time applications
* Collaborate with engineering teams to integrate QA into development workflows and enforce quality standards
Tech Stack
* Automation & Testing: Selenium, Playwright, Postman, REST Assured, custom frameworks
* Programming: Python, JavaScript/TypeScript
* Cloud & AI: AWS, AI/ML services and infrastructure
* Performance Testing: JMeter, Locust, Artillery
* Methodologies: Agile, CI/CD, exploratory & usability testing, cross-platform validation
Requirements
* 5+ years QA experience, with 2+ years focused on AI/ML or complex platforms
* Strong automated testing and CI/CD experience
* Experience testing APIs, UI, and AI-driven systems
* Knowledge of Generative AI applications, LLMs, AI agents, and prompt-based systems
* Understanding of AI/ML evaluation metrics and testing methodologies for non-deterministic outputs
* Bachelor’s degree in Computer Science, Engineering, or related field
#J-18808-Ljbffr