What is the opportunity?
Join our Data Solutions Data Platform Engineering team during an exciting time as we implement Bank of Ireland's new cloud-based data platform.
As a Senior Data Platform Engineer, you will help design, implement, and manage Infrastructure as Code (IaC) for our data pipeline ecosystem on the cloud, working with agile teams to engineer high-quality solutions for our data platforms.
We foster a collaborative environment with a learning culture, where your experience will guide future development, drive automation, and introduce new engineering patterns and frameworks.
In this role, you will:
1. Design, develop, and manage our Infrastructure as Code ecosystem underpinning our cloud-based data platform.
2. Enable CI/CD pipelines to build complex data flows and processes.
3. Support monitoring and telemetry for data pipelines and APIs, identify issues, and implement solutions.
4. Implement and manage security tools and best practices to ensure a secure environment compliant with security policies.
5. Advocate for automation, maintain metrics, logs, and reports.
6. Continuously improve system architecture to support growth and technological advancements.
7. Stay updated with advancements and best practices in Data and Cloud Platforms and related technologies.
8. Ensure engineering teams follow platform engineering standards, drive improvements, and mentor less experienced team members.
What will make you stand out?
We seek an enthusiastic engineer with a growth mindset who values collaboration. You are proactive, aiming for outcomes while enhancing processes, team knowledge, and tooling.
You have a proven track record managing IaC and DevOps for cloud data platforms, with 5+ years in an agile technical environment. Deep technical knowledge of cloud technologies and architecture, preferably AWS, is essential.
Key technical skills required:
1. Experience with administration and configuration of data platforms like Cloudera CDP, Databricks, Snowflake in the cloud.
2. Strong experience with Kafka ecosystem, including brokers, connect, Zookeeper, and Apache Nifi.
3. Proficiency in managing Cloudera clusters for high availability and performance.
4. Extensive knowledge of Big Data technologies: Kafka, Hive, Spark, HBase, PySpark.
5. Strong understanding of security concepts and tools: IAM, encryption, security groups.
6. Experience with AWS services: S3, EC2, EKS, ELK, IAM, VPC, EBS, KMS.
* Proficiency in scripting languages such as Python.
Additional skills that would be advantageous:
1. Hands-on experience with IaC tools like Terraform or Ansible.
2. Experience with DevOps tools: Jenkins, GIT, Bitbucket, Puppet, Chef, Docker, Kubernetes.
3. Experience with monitoring and logging tools like Splunk, Grafana, ELK stack, or CloudWatch.
Essential qualifications:
There are no specific educational requirements for this role.
About the team:
Our Data Solutions Engineering team provides services for the Group's Operational Data Store, Enterprise Data Warehouse, and Data Lake, supporting digital, customer, regulatory, and transformation initiatives.
Why work with us?
We prioritize work-life balance with flexible working, 23 days of annual leave, and excellent pension contributions. We support diverse family needs with policies like paid maternity leave, fertility, and surrogacy support. Employee wellbeing is a priority, with assistance programs, WebDoctor, financial coaching, and opportunities for professional growth.
#J-18808-Ljbffr