Software Quality Engineer Role at Red Hat's InstructLab
Job Summary
Red Hat's Global Engineering team is seeking an experienced quality engineer to join our newly formed InstructLab team. This role involves contributing directly to Red Hat's rapidly growing AI/ML family of products.
* Developing test strategies and frameworks, designing and implementing automated tests, creating and carrying out test plans, and maintaining and enhancing test frameworks.
* Participating in standard quality practices design reviews, automated testing, and productization for major product features and bug fixes.
* Considering novel ways for testing non-deterministic systems and code, as well as paying close attention to potential sources of bias that may be introduced during model build and training.
The Ideal Candidate
We are looking for a highly collaborative individual with a passion for working on complex projects in an open organization where contributions are valued and expected from all levels.
Responsibilities
* Monitor and participate in upstream AI/ML communities, evaluating new AI/ML-related technologies in the space and considering potential integrations and collaborations upstream._
* Conduct new feature research and design test cases with emphasis on model performance, scalability, automation, and bias reduction._
* Design, develop, and maintain automation frameworks, scripts, and performance benchmarking tools with Python for testing and implementation._
* Run technical initiatives that grow, improve, and scale our existing processes._
* Contribute to the development of the open-source projects that comprise Red Hat's AI family of products._
Requirements
* 3+ years of experience as a Software Quality Engineer, Software Engineer, or similar roles (5+ years of experience for Senior Software Quality Engineer).
* Experience scripting and creating automation in Python and Bash.
* Experience with AI and Machine Learning platforms, tools, and frameworks, such as: PyTorch, LLaMA.cpp, vLLM, fsdp, deepspeed, Tensorflow and Kubeflow.
* Experience creating automation for GitHub, using GitHub Actions or related continuous integration tools.
* Experience with hardware accelerators, such as GPU, CUDA, and ROCm.
* Ability to quickly learn and use new tools and technologies.
About Red Hat
Red Hat is the world's leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies.