Key Role:
A superb opportunity exists for a Data Quality Specialist to design and implement automated testing frameworks across Databricks-based data platforms within a modern data environment.
Main Responsibilities:
* Develop automated testing for Databricks notebooks, Delta Lake tables, and structured streaming pipelines.
* Build and maintain test frameworks for ETL/ELT processes, data transformations, and ingestion workflows.
* Implement automated validation for Delta Live Tables, Unity Catalog, and Spark performance testing.
* Design and execute data quality test strategies, reconciliation processes, and performance benchmarks.
* Create monitoring frameworks, test dashboards, and quality metrics for reporting and continuous improvement.