Role: Data engineer- 100% Remote
Location: Cork, Ireland (Candidate must be based in Ireland)
Contract- 6 Months - view to extend
We are seeking a
Mid-Level Data Engineer
with strong foundational experience in building, optimizing, and maintaining scalable data pipelines. The ideal candidate will have hands-on expertise in
Python
,
SQL
, and experience or familiarity with
Databricks
.
You will work closely with cross-functional teams to support data-driven initiatives, including AI-related development, analytics, and CRM-based projects.
Key Responsibilities
* Design, build, and maintain scalable
ETL/ELT pipelines
and data workflows.
* Work with
Python
and
SQL
to process, transform, and analyze large datasets.
* Collaborate with developers, Product Owners, and DBAs to deliver high-quality data solutions.
* Support projects related to
AI and Generative AI
, enabling data availability, quality, and model training.
* Develop and optimize data models, ensuring strong performance and reliability.
* Work within
Databricks
(or similar Spark-based environments) to build distributed data processing solutions.
* Integrate data from multiple systems, including CRM platforms like
Dynamics 365
and other CRM tools.
* Implement best practices for data quality, governance, and security.
* Troubleshoot data issues and ensure the accuracy, consistency, and availability of datasets.
* Participate in code reviews, documentation, and continuous improvement of data engineering processes.
Required Skills & Experience
* 3–4 years of experience
in Data Engineering or a related field.
* Strong programming skills in
Python
, including data-processing libraries.
* Advanced proficiency in
SQL
(writing complex queries, performance tuning, troubleshooting).
* Experience with
Databricks
or other Spark-based platforms (preferred but not mandatory).
* Experience building ETL/ELT pipelines and working with analytical/operational databases.
* Understanding of cloud data environments (Azure preferred, others acceptable).
* Familiarity with CRM systems; experience with
Dynamics 365
is an advantage.
* Solid understanding of data modelling, warehousing, and workflow orchestration tools.
* Ability to work in cross-functional teams and communicate clearly with technical and non-technical stakeholders.