Role: Senior Data Engineer
Location: Dublin, Ireland
Full time Employment
Tech Stack:
Programming language: Java/Scala/Python
Data processing framework: SparkBigData Hadoop
Frameworks: Hive, impala, oozie, airflow, HdfsAny cloud provider experience. Services like S3, Athena, EMR, Redshift, Glue, Lambda etc..
Data & AI platform: Databricks
Role and Responsibilities:
* Build, optimize and maintain ETL pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark).
* Collaborate with teams to ensure efficient and reliable data processing.
* Perform data modelling, quality checks, and system performance tuning.
* Contribute to modernization efforts, including potential cloud or Databricks integration.