General SummaryWe are seeking a highly experienced Principal or Director Software Engineer to lead the design, development, and deployment of next‑generation AI accelerator software systems for data centres. This role combines deep technical expertise with strong leadership capabilities to guide a mid‑sized engineering team focused on high‑performance AI workloads, model serving infrastructure, and scalable distributed systems.Key ResponsibilitiesTechnical LeadershipArchitect and deliver scalable, high‑performance AI model serving platforms for Cloud Service Providers (CSP) and Neo‑Cloud deployments.Lead development of software stacks for AI accelerators in data‑centre environments.Drive innovations in LLM inference optimization, including dynamic batching, scheduling, memory management, and latency reduction over high‑speed networks such as RoCE, ESUN & UAL.Grow an existing team into new areas with adoption and optimization of frameworks such as PyTorch, SGLang, vLLM, and Triton Inference Server.Design robust, production‑ready systems for distributed inference and fine‑tuning workloads.Team LeadershipLead, mentor, and continue growing a mid‑sized team (20+ engineers).Establish engineering best practices in performance, reliability, and scalability.Collaborate cross‑functionally with hardware, research, and platform teams.Own the technical roadmap and execution strategy aligned with business goals.System Design & InfrastructureBuild and maintain systems leveraging Linux runtimes and PyTorch for Linux and Windows, including orchestration and deployment of AI services.Optimize Linux‑based systems for high‑throughput compute workloads.Develop low‑level system optimizations and integrations for NPU/custom accelerators.Ensure high availability, fault tolerance, and observability of AI systems in production.Required Qualifications5‑10 years of software engineering experience with 5‑8 years in a leadership role.Experience working in matrixed organizations spanning multiple geographic regions.Expertise in C/C++ and Python with strong system‑level programming experience.Experience with PyTorch and modern machine learning frameworks.Proven experience building or scaling LLM‑based systems or AI model serving platforms.Hands‑on experience with execution runtimes for AI accelerators (such as CUDA/ROCm), Kubernetes, Triton Inference Server, SGLang, vLLM or similar LLM serving frameworks.Strong understanding of distributed systems, high‑performance computing, and NPU/accelerator programming environments.Experience working in Linux environments at performance‑critical levels.Preferred QualificationsExperience with custom AI accelerators / ASICs / GPUs in a data‑centre setting.Experience with large‑scale production systems serving millions of requests.Experience with current AI LLM models/architectures and contributions to open‑source AI infrastructure projects.Knowledge of networking, high‑speed interconnects such as GPU Direct, ESUN, UAL, RoCE and/or RDMA.Familiarity with performance profiling tools and optimization techniques.Leadership ProfileHands‑on leader who can dive deep technically when needed.Ability to strongly collaborate with leads in other sites/geo’s.Strategic thinker with a track record of delivering complex systems end‑to‑end.Strong communicator capable of aligning teams and stakeholders with an emphasis on end‑customer experience.Passionate about building high‑performing engineering cultures.Minimum QualificationsBachelor's degree in Engineering, Information Systems, Computer Science or related field and 8+ years of software engineering experience.Master's degree in Engineering, Information Systems, Computer Science or related field and 7+ years of software engineering experience.PhD in Engineering, Information Systems, Computer Science or related field and 6+ years of software engineering experience.4+ years of work experience with programming languages such as C, C++, Java, Python, etc.What’s on OfferSalary, stock and performance‑related bonusMaternity/Paternity LeaveEmployee stock purchase schemeMatching pension schemeEducation assistanceRelocation and immigration support (if needed)Life, medical, income and travel insuranceSubsidised memberships for physical and mental well‑beingBicycle purchase schemeEmployee‑run clubs including running, football, chess, badminton and many moreEqual OpportunitiesWe are an Equal Opportunity employer; all qualified applicants will receive consideration for employment without regard to race, colour, religion, sexual orientation, gender identity, national origin, disability, veteran status, or any protected classification.Location: Cork, Ireland.
#J-18808-Ljbffr