Job Title: Data Solutions Architect
">
We are seeking a highly skilled Data Solutions Architect to join our Data Analytics team on a fixed term contract. As a key member of the team, you will be responsible for designing and implementing data solutions using cloud-based platforms such as Microsoft Azure and Databricks.
">
Your main responsibilities will include:
1. Designing scalable, efficient, and secure data pipelines while meeting the needs of both technical and business stakeholders.
2. Collaborating with cross-functional teams to understand data requirements and design & develop cloud-based solutions that support real-time and batch data processing, advanced analytics, and machine learning workflows.
3. Implementing ELT processes to integrate data from various sources into the CDP and ensuring data quality checks, monitoring systems, and alerts for pipeline health.
4. Managing and optimizing data workloads in the data platform, ensuring performance, cost-efficiency, resiliency, and security.
5. Collaborating with data scientists, analysts, and other engineers to understand data needs and deliver optimal solutions from ingestion through to visualisation.
">
Required Skills and Qualifications:
">
* 5+ years of experience in data engineering with at least 3 years in Azure Cloud.
* Strong experience in Microsoft Azure, including Azure Data Factory, Azure SQL Database, Azure Storage, Azure Key Vault, Function & Logic Apps, Cost Analysis, and other related Azure cloud services.
* Experience with Databricks, including data engineering, data processing, and analytics development.
* Strong understanding of performance optimization best practices & data governance frameworks (e.g., Databricks Unity Catalog).
* Strong knowledge of ETL/ELT processes, data modeling, data warehousing concepts, and medalion architecture.
* Proficiency in Python programming language.
* Expertise in PySpark, SQL, and experience working with large-scale datasets.
* Knowledge of CI/CD DevOps practices and tools (Git, Azure DevOps).
* Experience working with Agile methods of delivery.
* Cloud infrastructure provisioning using Terraform Infrastructure as Code (IaC), desirable.
">
Benefits:
">
* Opportunity to work with cutting-edge technologies.
* Collaborative and dynamic work environment.
* Ongoing training and professional development opportunities.
">
Others:
">
You will be required to have excellent problem-solving and analytical skills, strong communication skills, and the ability to collaborate with business and technical teams. You will also need to be able to manage multiple tasks in a fast-paced environment and have a solid understanding of data governance, security protocols, and compliance standards.