Lead Data Engineer – Dublin, Ireland (Hybrid)
We are looking for a
Lead Data Engineer
to join a dynamic team building advanced data platforms for financial crime detection. You will design and implement scalable
Databricks + AWS
data solutions, lead a team of engineers, and deliver high-quality, governed pipelines.
Key Responsibilities:
* Build and optimise
Spark / PySpark pipelines
(Batch + Streaming) on Databricks
* Define lakehouse architecture (Bronze/Silver/Gold), schema governance, and data quality standards
* Design secure AWS data infrastructure (S3, Glue, Lake Formation, Lambda, Step Functions)
* Orchestrate workflows using
Airflow, Databricks Workflows, Step Functions
* Mentor engineers, lead code reviews, and drive CI/CD best practices
What We're Looking For:
* 10+ years in data engineering with
Databricks, Spark, Python, SQL
* Strong AWS experience and knowledge of data governance/lineage tools
* Hands-on with data orchestration and cloud data platforms
* Excellent leadership and stakeholder collaboration skills
Duration:
12 months (possible extension)
Location:
Dublin, Ireland