Job Description
We are seeking an experienced Data Engineering Lead to join our team. In this role, you will be responsible for designing, developing, and maintaining data pipelines in Azure for ingesting, transforming, and loading data from various sources into centralized data lakes.
Your Responsibilities
* Design, develop, and maintain efficient data pipelines to support business needs.
* Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
* Implement knowledge of modern data processing principles to streamline data import/transformation processes.
* Ensure the efficiency and reliability of data ingestion and processing.
* Work closely with stakeholders to define and enforce data governance standards and policies.
* Maintain high-quality documentation of data engineering processes and system configurations.
Requirements
To succeed in this role, you will need:
* A Bachelor's Degree level qualification in a computer or IT related subject.
* 10+ years of overall IT industry experience.
* 8+ years of overall Bigdata data pipeline experience.
* 8+ years of experience as a Data Engineer, with a focus on designing and implementing data solutions on the Azure Databricks.
* 8+ years of experience on cloud-based development including Azure Services, Azure Devops, Kubernetes, Docker.
* Strong experience in data engineering, including data pipeline development, ETL/ELT processes, and data modeling.
* Strong proficiency in SQL and experience with programming languages such as Scala, Java.
* Experience with globally distributed log & event processing systems with data mesh and data federation as the architectural core is highly desirable.
Benefits
We offer a collaborative environment where technology skills and innovation are valued. Our benefits package includes generous medical care, insurance, and savings plans, as well as flexible work programs and access to employee networks.
About Us
We are a global organization driving the company's digital transformation and expanding business capabilities using industry best practices and advanced technologies.