Senior Data Engineer Position
The Senior Data Engineer role involves designing, developing, and maintaining scalable data solutions across both legacy and modern cloud platforms. This position requires deep expertise in cloud-based data warehousing, strong hands-on skills in Python and ETL pipeline development, and the ability to work in dynamic agile environments.
Key Responsibilities:
* Design and develop robust ETL/ELT processes including pipelines for extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from diverse sources
* Deliver across the full agile lifecycle including design, coding, testing, and deployment of iterative data solutions
* Collaborate with cross-functional teams to ensure data quality, integrity, availability, and auditability
Qualifications & Experience:
* Minimum 10 years' experience in data engineering with a strong focus on cloud data platforms
* Deep expertise in Snowflake including cloud-based data warehousing, ELT/ETL pipeline development, and performance tuning
* Strong proficiency in Python for scripting, automation, and data pipeline development
* Hands-on experience with AWS e.g. data lakes, Glue, S3, Redshift, and exposure to Azure data services
* Practical experience using Terraform or similar IaC tools for provisioning and managing cloud infrastructure
* Proficiency in working with JSON, XML, and other semi-structured data
* Work with messaging and queuing systems e.g. SQS, SNS to support event-driven data flows
* Familiarity with streaming data platforms e.g. Kafka, Kinesis is an advantage
* Strong background in Git-based workflows, branching strategies, pull requests, CI/CD pipelines
* Excellent verbal and written English communication skills
Skills & Competencies:
* Strong analytical and problem-solving skills
* Ability to design scalable, reliable, and high-performance data solutions
* Clear communicator capable of presenting complex technical concepts to varied audiences
* Excellent documentation and technical writing skills
* Strong understanding of infrastructure automation and best practices in cloud resource management
* Proactive, adaptable, and able to deliver results in fast-paced environments