About the job My client is seeking a Senior Data Engineer with 5+ years' experience to join their Cork team on a 9-month contract. This role is ideal for someone who thrives on building scalable data solutions and making an immediate impact. Responsibilities: Develop and manage modern data platforms using Databricks (Spark, Delta Lake, MLflow) and AWS services (S3, Glue, Lambda) to deliver reliable, high-performance pipelines. Design and implement ETL/ELT frameworks for batch and real-time processing, incorporating CI/CD and infrastructure automation (Terraform or CloudFormation). Tune Spark jobs and optimise workflows for performance, cost-efficiency, and observability with tools like Datadog or CloudWatch. Ensure security, governance, and compliance standards are applied across data workflows (IAM, GDPR, ISO). Collaborate with data engineers and cross-functional teams to drive technical excellence and deliver solutions rapidly. Skills & Experience: Bachelor's or Master's degree in Computer Science, Engineering, or a related field, with 5+ years in data engineering. Hands-on experience with Databricks and AWS services (S3, Glue, Lambda, Step Functions) and deep Spark expertise. Proficiency in Python (PySpark), Scala, SQL, and experience in data modeling, warehousing, and integration. Strong experience with infrastructure-as-code (Terraform/CloudFormation) and modern CI/CD pipelines. Excellent communication skills, able to quickly understand requirements and deliver actionable solutions. For more information, reach out today!