Data Engineer
We are seeking an experienced data engineer to join our team.
Job Summary:
* Design, build and test end-to-end data pipelines including data ingestion, integration, curation, and transformation.
* Develop and deploy scalable data pipelines and ETL processes on cloud-based infrastructure using Azure, Snowflake, DBT, Airflow, and Cosmos DB.
* Optimize data pipeline performance, query optimization, resource management, and scaling strategies.
Key Responsibilities:
* Experience in micro-services architecture and understanding of Cloud Computing is highly desirable.
* Strong hands-on experience in troubleshooting Devops pipelines and Azure services.
* Experience with DBT (Data Build Tool) for data modelling and transformation and Apache Airflow for workflow orchestration and scheduling.
* Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero copy clone, time travel, and re-clustering Snowflake data.
About Our Opportunity:
We offer a collaborative environment where technology skills and innovation are valued. We're looking for top technical talent to deliver creative technology solutions that drive business growth.