Role: Senior Data Engineer Location: Dublin, Ireland (2 to 3days Onsite)Full time Employment Tech Stack: Programming language: Java/Scala/Python Data processing framework: Spark Big Data Hadoop Frameworks: Hive, impala, oozie, airflow, Hdfs Any cloud provider experience.
Services like S3, Athena, EMR, Redshift, Glue, Lambda etc..
Data & AI platform: Databricks Role and Responsibilities: Build, optimize and maintain ETL pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark).
Collaborate with teams to ensure efficient and reliable data processing.
Perform data modelling, quality checks, and system performance tuning.
Contribute to modernization efforts, including potential cloud or Databricks integration.