Data Engineer Contract Dublin City Location: Dublin City (Hybrid) Type: Day Rate Contract Duration: 6 Months Initially Start: ASAP Sector: Data Innovation / Io T We are partnering with a global innovation group in search of an experienced Data Engineer to join their dynamic data team on a 6-month contract (with strong potential to extend).
This organisation is at the forefront of leveraging data across Io T, infrastructure, telecommunications, and mobility domains to build transformative digital products.
As part of a growing data science and engineering team, you will be instrumental in shaping scalable data pipelines, implementing best-in-class Dev Ops practices, and working with large, diverse datasets particularly Io T-related sources.
Key Responsibilities: Collaborate with data scientists and engineers to design, build, and maintain high-quality data pipelines using Spark and Databricks.
Implement Dev Ops principles using Git, automated testing, and CI/CD pipelines.
Contribute ideas for new product development and data-driven innovation across various business verticals.
Build and optimise ETL/ELT processes for structured and unstructured data.
Required Experience: 3+ years working with Databricks or similar platforms.
3+ years of experience building pipelines with Spark and developing in Python.
Strong SQL and data modelling expertise, including complex queries and warehouse design.
Solid understanding of cloud infrastructure and data warehousing.
Demonstrated experience working with Io T datasets (23 years minimum).
Nice to Have: Experience with Azure Data Factory, Azure Storage, or Azure Dev Ops.
Familiarity with Delta Lake, Databricks Unity Catalog, or Workflows.
Exposure to unstructured data formats such as free text, images, or video.
Background in data visualisation tools like Tableau or Power BI.
Knowledge of machine learning concepts and collaboration with data science teams.