Join to apply for the Principal Data Engineer New role at Cpl Technology - Tech Recruitment Experts17 hours ago Be among the first 25 applicantsJoin to apply for the Principal Data Engineer New role at Cpl Technology - Tech Recruitment ExpertsGet AI-powered advice on this job and more exclusive features.Superb opportunity for a leader within the Data Engineering space. In the role you’ll lead a team of data engineers building scalable, secure, and high-performance data solutions on Databricks and AWS. You’ll architect modern data platforms, guide implementation, and ensure best-in-class engineering practices across a global enterprise.ResponsibilitiesArchitect and manage Databricks-based Lakehouse platforms (Delta Lake, Spark, MLflow)Integrate with AWS services including S3, Glue, Lambda, and Step FunctionsDesign and optimize scalable ETL/ELT pipelines using Spark (Python/Scala)Automate infrastructure with Terraform or CloudFormationEnsure robust performance tuning of Spark jobs and cluster configurationsImplement strong security governance using IAM, VPC, and Unity CatalogLead a high-performing engineering team through Agile delivery cyclesSkillsData Engineering expertise and proven Leadership skillsExtensive Databricks experience in production environmentsAdvanced AWS knowledge: S3, Glue, Lambda, VPC, IAM, EMRStrong coding skills in Python (PySpark), Scala, and SQLExpertise in CI/CD pipelines, Git-based workflows, and automated testingFamiliarity with data modeling and warehousing (e.g., Redshift, Postgres)Proficient in orchestration and workflow tools (e.g., Airflow, Step Functions)Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionInformation TechnologyIndustriesIT Services and IT ConsultingReferrals increase your chances of interviewing at Cpl Technology - Tech Recruitment Experts by 2xSign in to set job alerts for “Data Engineer” roles.Dublin, County Dublin, Ireland 2 weeks agoDublin, County Dublin, Ireland 2 weeks agoDublin, County Dublin, Ireland 3 weeks agoDublin, County Dublin, Ireland 5 days agoDublin, County Dublin, Ireland 2 weeks agoDublin, County Dublin, Ireland 2 weeks agoDublin, County Dublin, Ireland 1 week agoDublin, County Dublin, Ireland €94,993.00-€94,993.00 3 weeks agoDublin, County Dublin, Ireland 10 hours agoDublin, County Dublin, Ireland 8 hours agoDublin, County Dublin, Ireland 5 hours agoDublin, County Dublin, Ireland 4 weeks agoDublin, County Dublin, Ireland 1 week agoDublin, County Dublin, Ireland 2 weeks agoDublin, County Dublin, Ireland 1 month agoDublin, County Dublin, Ireland 2 weeks agoDublin, County Dublin, Ireland 6 days agoDublin, County Dublin, Ireland 6 days agoDublin, County Dublin, Ireland 6 days agoDublin, County Dublin, Ireland €70,000.00-€80,000.00 3 weeks agoDublin, County Dublin, Ireland 1 week agoDublin, County Dublin, Ireland 7 hours agoSoftware Engineer III, Network Traffic EngineeringDublin, County Dublin, Ireland 6 days agoDublin, County Dublin, Ireland 1 week agoJunior Machine Learning Platform Engineer (Remote - Ireland)Dublin, County Dublin, Ireland 1 week agoDublin, County Dublin, Ireland 7 hours agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr