Job Description
As a Data Engineering Lead, you will be responsible for designing, developing, and maintaining data pipelines in Azure for ingesting, transforming, and loading data from various sources into centralized data lakes. You will ensure data quality and integrity throughout the process.
Key Responsibilities include:
* Designing efficient data models and database schemas that support the storage and retrieval of structured and unstructured data.
* Implementing ELT/ETL processes to ensure data quality, consistency, and reliability.
* Developing transformation processes to clean, aggregate, and enrich raw data, ensuring it is in the appropriate format for downstream analysis and consumption.
* Integrating data from diverse sources to provide a unified view of information.