12+ years of experience in ETL / Data Testing / Data Quality, including team leadership.
Strong experience with Azure Databricks and Azure Data Factory.
Expert-level Python for automation frameworks and validation utilities.
Strong Py Spark expertise for validating large-scale transformations and datasets.
Advanced SQL skills for reconciliation and issue analysis.
Experience defining and enforcing data quality standards at scale.
Define and govern ETL testing standards, automation strategy, and best practices.
Design and standardize Python- and Py Spark-based automation frameworks.
Establish validation approaches for ADF and Databricks pipelines.
Define data quality rules for analytics-ready datasets (completeness, consistency, volume, schema).
Review and approve test plans, automation design, and execution results.
Lead and mentor ETL testing engineers; conduct code reviews for automation assets.
Define and track data quality metrics and test effectiveness KPIs.
Coordinate testing across multiple releases and delivery teams.
Act as the escalation point for critical data quality or release issues.
Collaborate with Data Engineering and Dev Ops teams to integrate testing into Azure Dev Ops CI/CD.
Skills: ETL Testing Python Pyspark Azure Data factory Azure Data Bricks SQL