About the Role
As a Software Quality Assurance Engineer (Software Development Engineer in Test, SDET) on the AI Commerce team, you will be a coder at heart, driving quality through automation, engineering best practices, and an understanding of AI systems. You will architect, develop, and maintain automated test solutions for complex, AI-driven products and platforms. Working closely with software engineers, data scientists, product managers, and architects, you will embed quality, security, and performance into every stage of the software lifecycle.
Responsibilities
* Develop and maintain automated test frameworks for web, API, and system-level testing.
* Create reusable test scripts for regression, integration, and end-to-end workflows.
* Drive CI/CD pipeline integration of automated tests.
* Validate AI-driven features for accuracy, fairness, and transparency.
* Conduct load, stress, and endurance testing to ensure system performance under varying conditions.
* Define performance benchmarks and reporting metrics.
* Integrate security testing into QA processes (e.g., vulnerability scanning, penetration testing).
* Validate compliance with security and audit standards such as SOX, ISO 27001, GDPR, and OWASP best practices.
* Collaborate with security teams to remediate identified risks.
* Assess usability of AI-powered systems, ensuring intuitive and accessible user experiences.
* Contribute to building responsible AI testing methodologies within QA processes.
* Analyze bottlenecks, resource leaks, and latency issues in collaboration with engineering teams.
* Work closely with cross-functional teams across Ireland and global offices.
* Document test cases, defects, and quality metrics in tracking systems (e.g., JIRA).
* Provide QA status reports and recommendations for process improvements.
* API Security Testing: Validate headers, schemas, and authentication flows.
* Participate and assist PR reviews that flag OWASP Top Ten issues or other application security vulnerabilities.
* Expected to coordinate remediation with developers and report progress.
Qualifications
* Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
* 5+ years of experience in software QA or test automation roles.
Required Skills
* Experience with Python and the Python ecosystem.
* Strong expertise in automation tools (e.g., Playwright, Robot Framework, etc).
* Hands-on experience with performance testing tools (e.g., Locust, Grafana k6, Gatling etc).
* Understanding of LLMs and agentic AI architectures, including methods for evaluating model outputs, prompt engineering, and safety validation.
* Familiarity with security testing tools (e.g. OWASP ZAP, Bandit, Burp Suite, Nessus).
* Knowledge of CI/CD (DevOps Pipelines, ArgoCD etc) and cloud environments ie. Azure (Preferred), AWS, GCP.
* Excellent problem-solving, debugging, and analytical skills.
* Strong communication skills and ability to collaborate across teams.