PLEASE ONLY APPLY IF YOU HAVE 6+ YEARS EXPERIENCE Job Title: Data Engineer Job Description We are seeking a Data Engineer to join our growing SME Data Team.
This role is perfect for someone with a solid background in data engineering who is eager to expand their skills across modern big data tools and cloud platforms.
You will work alongside talented engineers to build scalable data pipelines, contribute to platform modernization, and support business-critical data solutions.
Responsibilities Build, maintain and optimise batch and streaming data pipelines using Spark (PySpark/Scala).
Contribute to the migration and modernization of on-prem Hadoop workloads to Databricks Cloud.
Develop and support ETL/ELT processes leveraging Hive, Impala, HDFS, and Airflow.
Implement data ingestion, transformation, and quality checks using tools like Delta Lake, SQL Warehouses, and DLT.
Collaborate with senior engineers and leads to design data solutions that are scalable and maintainable.
Work with version control and CI/CD processes.
Support troubleshooting, performance tuning, and documentation of data workflows and systems.
Essential Skills Strong coding skills in Python or Scala.
Solid understanding of distributed data processing.
Hands-on EXPERIENCE with data engineering in Spark and Hadoop ecosystems (HDFS, Hive, Impala).
Working knowledge of Airflow or similar orchestration tools.
Exposure to cloud platforms (preferably Databricks on AWS) including S3, Delta Tables, and DLT.
Familiarity with SQL performance tuning and large-scale data processing techniques.
EXPERIENCE with version control and CI/CD workflows.
Exposure to Databricks SQL Warehouses and Unity Catalog.
EXPERIENCE in data quality, validation, or testing frameworks.
Understanding of data governance, lineage, or security practices in enterprise environments.
Why Work Here?
Our company is a global technology leader in the payments industry, dedicated to building a sustainable world that unlocks priceless possibilities for all.
We foster a culture driven by our decency quotient, promoting an inclusive and innovative environment where employees can thrive and realise their greatest potential.
Work Environment This is a hands-on engineering role offering opportunities to collaborate, learn, and grow in a technically rich environment.
You will work in a dynamic team using state-of-the-art technologies and platforms to deliver impactful data solutions.
Our work environment supports flexibility and encourages continuous professional development.
Location Dublin, Ireland Rate/Salary - EUR Daily Trading as TEKsystems.
Allegis Group Limited.
Level 1, The Chase, Carmanhall Road, Sandyford, Dublin 18, Ireland.
No. ******.
TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group").
Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands.