Company
QT Technologies Ireland Limited
Job Area
Engineering Group > Software Engineering
General Summary
About the Role
We are seeking a highly experienced Principal or Director Software Engineer to lead the design, development, and deployment of next-generation AI accelerator software systems for Datacenters.
This role combines deep technical expertise with strong leadership capabilities to guide a mid-sized engineering team focused on high-performance AI workloads, model serving infrastructure, and scalable distributed systems.
You will play a critical role in building software that powers large-scale LLM inference and fine-tuning type workloads, optimizing performance across NPU/accelerators, and delivering production-grade AI infrastructure.
Key Responsibilities
Technical Leadership:
Architect and deliver scalable, high-performance AI model serving platforms for CSP and Neo-Cloud deployments.
Lead development of software stacks for AI accelerators in Datacenter environments.
Drive innovations in LLM inference optimization, including dynamic batching, scheduling, memory management, and latency reduction over high-speed networks such as RoCE, ESUN, and UAL.
Grow an existing team into new areas for the site with adoption and optimization of frameworks such as PyTorch, SGLang, vLLM, and Triton Inference Server.
Design robust, production-ready systems for distributed inference and fine-tuning workloads.
Team Leadership:
Lead, mentor, and continue growing a mid-sized team (20+ engineers).
Establish engineering best practices in performance, reliability, and scalability.
Collaborate cross-functionally with hardware, research, and platform teams.
Own technical roadmap and execution strategy aligned with business goals.
System Design & Infrastructure:
Build and maintain systems leveraging Linux runtimes and PyTorch for Linux and Windows, including orchestration and deployment of AI services.
Optimize Linux-based systems for high-throughput compute workloads.
Develop low-level system optimizations and integrations for NPU/custom accelerators.
Ensure high availability, fault tolerance, and observability of AI systems in production.
Required Qualifications
15+ years of software engineering experience, with at least 5–8 years in a leadership role.
Experience working in companies that have matrixed organizations spanning multiple geographic regions.
Expertise in C/C++ and Python with strong system-level programming experience.
Experience with PyTorch and modern machine-learning frameworks.
Proven experience building or scaling LLM-based systems or AI model-serving platforms.
Hands-on experience with:
Execution runtimes for AI accelerators (such as CUDA/ROCm).
Kubernetes.
Triton Inference Server.
SGLang, vLLM or similar LLM serving frameworks.
Strong understanding of:
Distributed systems.
High-performance computing.
NPU/accelerator programming environments.
Experience working in Linux environments at performance-critical levels.
Preferred Qualifications
Experience with custom AI accelerators/ASICs/GPUs in a datacenter setting.
Experience with large-scale production systems serving millions of requests.
Experience with current AI LLM models/architectures.
Contributions to open-source AI infrastructure projects.
Knowledge of networking, high-speed interconnects such as GPU Direct, ESUN, UAL, RoCE and/or RDMA.
Familiarity with performance profiling tools and optimization techniques.
Leadership Profile
Hands-on leader who can dive deep technically when needed.
Ability to strongly collaborate with leads in other sites/geo's.
Strategic thinker with a track record of delivering complex systems end-to-end.
Strong communicator capable of aligning teams and stakeholders with an emphasis on end customer experience.
Passionate about building high-performing engineering cultures.
Location
Cork, Ireland – a major economic engine in Europe offering an excellent quality of life and a gateway to international transport through Cork airport.
Equal Opportunity
We are an Equal Opportunity employer; all qualified applicants will receive consideration without regard to race, colour, religion, sexual orientation, gender identity, national origin, disability, veteran status, or any protected classification.
Benefits
Salary, stock and performance-related bonus.
Maternity/Paternity leave.
Employee stock purchase scheme.
Matching pension scheme.
Education assistance.
Relocation and immigration support (if needed).
Life, medical, income and travel insurance.
Subsidised memberships for physical and mental well-being.
Bicycle purchase scheme.
Employee run clubs, including running, football, chess, badminton and many more.
Minimum Qualifications
Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 8+ years of software engineering experience.
Master's degree in Engineering, Information Systems, Computer Science, or related field and 7+ years of software engineering experience.
PhD in Engineering, Information Systems, Computer Science, or related field and 6+ years of software engineering experience.
4+ years of work experience with programming languages such as C, C++, Java, Python, etc.
#J-*****-Ljbffr