Job Overview
We are seeking an experienced Data Engineer Lead to design, develop and maintain data pipelines in Azure for ingesting, transforming, and loading data from various sources into centralized Azure data lakes. The ideal candidate will have strong technical expertise in data engineering principles, database management, and programming skills.
Key Responsibilities
* Design, develop, and maintain data pipelines in Azure for ingesting, transforming, and loading data from various sources into centralized Azure data lakes.
* Collaborate with cross-functional teams, including analysts, software engineers, and operations teams to ensure the availability, reliability, and integrity of data for various business needs.
* Develop transformation processes to clean, aggregate, and enrich raw data, ensuring it is in the appropriate format for downstream analysis and consumption.
* Implement efficient ELT/ETL processes to ensure data quality, consistency, and reliability.
Required Skills and Qualifications
* Hands-on experience with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL Database, etc.
* Strong experience in data engineering, including data pipeline development, ETL/ELT processes, and data modeling.
* Strong proficiency in SQL and experience with programming languages such as Scala, or Java.
* In-depth knowledge of SQL and experience with relational and non-relational databases such as Snowflake, SQLServer, Oracle.
Benefits
We offer a competitive benefits package that includes medical care, insurance, and savings plans. We also provide flexible Work Programs to help you match your needs.
Others
We value diversity and inclusion in our workplace and strive to create an environment where everyone can thrive. If you are looking for a challenging role that allows you to grow your technical skills and make a real impact, we encourage you to apply.