Databricks Platform Engineer (Consultant)
Location: Dublin, Ireland (On-site/Hybrid) – 4 days per week.
Term: 12 Month+ contract.
Pay range: $110/hr - $140/hr (US dollars).
The Opportunity
Our client is seeking a high-caliber Databricks Platform Engineer / Resident Solutions Architect (RSA) to join a high-profile engagement in Dublin. You will be embedded directly within the customer’s Chief Data Office (CDO), acting as a technical cornerstone for their enterprise Center of Excellence (COE).
This is not just a delivery role; you will be a Trusted Advisor to senior leadership, shaping the architectural roadmap and ensuring the successful implementation of large-scale data patterns across the organization.
Key Responsibilities
Strategic Advisory: Lead architecture and implementation best-practice discussions across multiple COE workstreams.
Architectural Design: Design and implement secure, scalable, and well-architected Lakehouse patterns that bridge the gap between business requirements and technical execution.
Engineering Excellence: Build, optimize, and productionize high-performance Databricks pipelines.
Mentorship: Evangelize CI/CD best practices and modern data engineering standards within the customer’s internal teams.
Technical Skillset & Requirements
1. Multi-Cloud Architecture
Proven experience designing enterprise-grade solutions across both Azure and AWS.
Deep understanding of cloud security, networking, and identity management within a data context.
2. Databricks & Spark Expertise
Mastery of the Databricks ecosystem, including Delta Lake, Unity Catalog, and Workflows/Jobs.
Expert-level Spark skills for both Batch and Streaming (Structured Streaming) workloads.
Hands-on experience with Lakehouse optimization (Liquid clustering, Z-Order, Predictive Optimization).
3. Software Engineering Rigor
Strong background in CI/CD (Azure DevOps, GitHub Actions, or Jenkins) applied to data engineering.
Proficiency in Python and/or Scala, with a focus on writing modular, testable, and reusable code.
Professional Profile
Dublin-Based: This role requires a local presence in Dublin to facilitate direct collaboration with the CDO and COE teams.
Leadership Presence: Ability to command a room of stakeholders and distill complex technical concepts into actionable strategic advice.
Experience: Previous experience in a Resident Solutions Architect or Lead Consultant role is highly preferred.
#J-18808-Ljbffr