Job Overview
About the Role
We are seeking a highly skilled Azure Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Data Factory (ADF) and Databricks.
Key Responsibilities:
* Monitor and troubleshoot ADF pipelines and Databricks notebooks/jobs in production.
* Develop expertise in cloud solutions, specifically in Azure.
* Create complex interface process development skills.
* Analyze pipeline failures, spark job issues, data mismatches, cluster timeouts, resource unavailability and latency bottlenecks.
Required Skills & Qualifications:
To be successful in this role you should have the following skills:
'Strong hands-on experience with Azure Data Factory (ADF), including pipeline orchestration linked services integration runtimes.'
bstylefontweightBold28Experience*'in running debugging notebooks, clusters, Spark - task - logs .'