Job Overview:
We are seeking a seasoned data engineer to collaborate with our team onsite in Dublin. The ideal candidate will have hands-on experience with DBT, Databricks, and PostgreSQL, as well as expertise in designing and building efficient data pipelines, orchestration, and data reconciliation.
Key Responsibilities:
* Create data pipelines using Databricks, Spark, and DBT
* Streamline data tasks in Azure Data Factory for ingestion and processing
* Develop Docker images for applications and deploy them on Azure
* Design and build high-quality processes for cleaning and standardizing data
* Develop data tests using DBT test
* Troubleshoot production issues in Azure Environment
* Tune and optimize data processes
Requirements:
* Hands-on experience with DBT SQL models development
* Developing processes in Spark/Databricks
* Writing complex SQL queries/PostgreSQL or other RDBMS
* Building ETL/data pipelines in Azure and Amazon AWS
* Related/complementary open-source software platforms and languages (e.g., Scala, Python, Java, Linux)
* Azure Data Factory/Airflow
* Terraform/GitHub Actions
* Snowflake or other large OLAP databases
* Previous experience with Relational Databases (RDBMS) & Non-Relational Database
* Analytical and problem-solving experience applied to a Big Data environment and Distributed Processing
* Experience working in projects with agile/scrum methodologies
* Exposure to DevOps methodology
* Data warehousing principles (e.g., Kimball, Inmon, Data Vault), architecture and its implementation in large environments
About the Role:
* This is an opportunity to work with a dynamic team
* We offer a collaborative environment that encourages innovation and creativity
* Professional growth and development opportunities
* A competitive salary and benefits package
What We Offer:
* A collaborative and dynamic work environment
* Opportunities for professional growth and development
* A competitive salary and benefits package
How to Apply:
1. Please submit your application through our website
2. We look forward to hearing from you