Job Specification:
Seeking an Experienced Senior Data Engineer to build, optimise and operationalise data solutions on Azure Data Lakehouse using Databricks, ADF and Delta Lake.
* Develop, code, deploy and maintain Databricks notebooks, jobs and pipelines
* Build and optimise scalable ETL/ELT workflows using Databricks, ADF and Delta Lake
* Ensure high-quality, reliable and reusable datasets and data models
Key Responsibilities
Data Platform Delivery
* Work hands-on across ADLS, ADF, Databricks and related Azure services to support end-to-end data processing
* Implement automated testing, version control, orchestration and CI/CD deployment for Databricks and pipelines
* Collaborate with analytics and BI teams to deliver trusted data for insights and reporting
Ai & Data Science Support
* Enable model development, feature engineering and ML workflows running on Databricks
* Support deployment and scaling of AI/ML workloads across the platform
Governance, Security & Quality
* Apply strong data governance practices including data quality, lineage, metadata and access control
* Ensure compliance with security and performance standards across the cloud data environment
Collaboration & Leadership
* Provide technical leadership on complex data engineering topics
* Support the evolution of the organisation's data strategy
* Act as a mentor and subject matter expert for modern data engineering practices