What is the opportunity?
The AI Centre of Excellence (CoE) is the Bank's powerhouse for safe, responsible and scalable AI adoption. It sets the vision, standards and governance that shape how AI is built and deployed across the organisation, while providing the platforms, expertise and partnership needed to turn ideas into high value outcomes. This role establishes a critical new capability focused on AI trustworthiness and performance. It defines how AI model outputs are tested, monitored and governed across the Bank, from accuracy, bias to hallucination and explainability. The opportunity is to shape responsible AI standards in practice, influence regulatory alignment, and build a scalable evaluation framework that underpins confidence in AI driven decision making across the organisation.
In this role, you will:
Own and operationalize the AI model evaluation framework across all archetypes, covering accuracy, bias, hallucination, explainability, robustness, ethical compliance and guardrail thresholds.
Lead end to end evaluation processes from pathfinder through production, developing quantitative and qualitative testing methodologies for generative AI, classical ML and decisioning models.
Handle LLMOps monitoring, including performance dashboards, drift detection, degradation alerts and retraining triggers, ensuring outputs feed into 1LOD and 2LOD risk assessments, regulatory submissions and model risk documentation.
Produce governance ready evaluation reporting, contribute to the AI risk taxonomy and maintain alignment with evolving regulatory expectations and industry standards.
Build organisational capability through guidance, tooling and knowledge sharing, while applying evaluation frameworks to third party AI systems and vendor models.
What will make you stand out?
Deep expertise in AI/ML model evaluation and monitoring including generative AI, LLMs and MLOps/LLMOps practices such as drift detection and lifecycle management.
Strong grounding in responsible AI principles (bias, explainability, fairness, ethics) and experience developing quantitative and qualitative evaluation frameworks.
Solid understanding of financial services AI regulation (EBA model risk guidelines, EU AI Act) with the ability to translate complex model behaviour into clear, actionable insights for non-technical partners.
Excellent analytical, communication and collaboration skills, with experience partnering across risk, delivery and technology teams; financial services experience highly desirable.
Commitment to responsible innovation, ethical standards and continuous professional development.
Essential Qualifications
There are no specific qualifications or minimum educational requirements needed for this role.
Key Competencies
Customer Focused - Leader
Better together - Leader
Be Decisive - Leader
Take Ownership - Leader
Manage Risk - Leader
More about the team
Working at the intersection of innovation and control, the CoE ensures the Bank can unlock meaningful business impact from AI while upholding the highest expectations of ethics, risk management and regulatory compliance. It's where pioneering capability meets focused execution enabling the Bank to harness AI with confidence, clarity and ambition.
This is a hybrid role, based primarily in Dublin. We typically ask colleagues to spend a minimum of 8 days per month working in-person to support teamwork and connection. Specific arrangements will be confirmed by your recruiter to ensure they meet the needs of the role and team.
Inclusion and Equality
We're on a continuous journey to build an inclusive and diverse workplace. We welcome applications from people of all backgrounds, lived experience, abilities and perspectives. We provide reasonable accommodations at every stage of our recruitment process for disabilities, neurodivergence or medical conditions. If you require an accommodation please complete this form and one of our recruitment team members will be in touch via email. Any information provided will be treated as confidential within the recruitment team and used only for the purpose of determining and providing appropriate accommodations for the application and recruitment process.
Our Benefits
Competitive pay package
Premium pension contribution
Pay reviews & profit-share scheme
Financial wellbeing coaches
Excellent healthcare contributions
23 days annual leave
Flexible leave: buy or sell your days
6 months paid maternity leave
Fertility and surrogacy policies
Working parent and carer supports
Support for professional qualifications
Award‑winning career framework
Clear pathways for development and progression
#J-18808-Ljbffr