Lead Data Engineer – Dublin, Ireland (Hybrid)We are looking for a Lead Data Engineerto join a dynamic team building advanced data platforms for financial crime detection.
You will design and implement scalable Databricks + AWSdata solutions, lead a team of engineers, and deliver high-quality, governed pipelines.
Key Responsibilities: Build and optimise Spark / Py Spark pipelines (Batch + Streaming) on Databricks Define lakehouse architecture (Bronze/Silver/Gold), schema governance, and data quality standards Design secure AWS data infrastructure (S3, Glue, Lake Formation, Lambda, Step Functions)Orchestrate workflows using Airflow, Databricks Workflows, Step Functions Mentor engineers, lead code reviews, and drive CI/CD best practices What We're Looking For:10+ years in data engineering with Databricks, Spark, Python, SQLStrong AWS experience and knowledge of data governance/lineage tools Hands-on with data orchestration and cloud data platforms Excellent leadership and stakeholder collaboration skills Duration:12 months (possible extension)Location: Dublin, Ireland