Hybrid Remote, 2 days a week, onsite in Dublin City center.
We are seeking a Data Engineer with extensive Snowflake expertise, alongside strong experience in Azure Data Factory and SQL Server. You will design and maintain robust data pipelines, optimize Snowflake data architecture, and ensure secure, high-quality data integration and provisioning across our enterprise platforms.
Key Responsibilities
* Develop and maintain ETL/ELT pipelines:
Build robust and scalable data pipelines using Snowflake and related Azure cloud services. Ingest, load, and transform large complex data sets with SQL transformations at the heart of the solution. Build out parameterized pipelines, dataflows, and data orchestration within Snowflake.
* Collaborate with cross-functional teams:
Work closely with business analysts, architects, and integration specialists to translate business requirements into robust technical solutions.
* Optimize data architecture:
Contribute to the design and maintenance of scalable, high-performance data models and storage structures in Snowflake, supporting both operational and analytical workloads.
* Implement data governance and security:
Apply best practices for access control, data masking, and auditing within Snowflake to ensure compliance and data protection.
* Monitor and troubleshoot pipelines:
Use ADF and Snowflake diagnostic tools to monitor, troubleshoot, and optimize data pipeline performance.
* Document data flows and integration patterns:
Maintain clear documentation of data integration processes, transformation logic, and data provisioning workflows.
* Mentor and support junior team members:
Provide guidance and coaching to less experienced engineers in Snowflake, Azure, and data integration best practices.
Requirements
* Snowflake Expertise: Strong experience in data integration and provisioning, schema design, and data warehousing on Snowflake.
* SQL Server: Strong experience in data integration and provisioning, schema design, and data warehousing on SQL Server.
* Azure Data Factory (ADF): Proficient in building and managing ETL/ELT pipelines, including parameterization, error handling, and pipeline orchestration.
* Data Modeling: Strong understanding of conceptual, logical, and physical data models, especially as applied to Snowflake.
* SQL & Scripting: Advanced SQL skills for data extraction, transformation, and performance tuning in high-volume data processing environments (Snowflake preferred).
* Testing & Automation: Experience with end-to-end testing of data pipelines and automation of data validation processes.
* Documentation & Collaboration: Ability to document data flows, transformation logic, and integration patterns. Strong communication skills for cross-functional collaboration.
* Certification: Snowflake, Azure Data Engineer, or related cloud data engineering certification is highly desirable.
* Problem-solving: Excellent analytical and troubleshooting skills, with a collaborative approach to team-based problem-solving.
Skills
Snowflake ADF Data Factory Azure Azure Data
#J-18808-Ljbffr