We are seeking an experienced Data Engineer to join our team and contribute to the development of our data pipeline architecture.
The successful candidate will have extensive experience as an ETL Developer or similar data engineering role, with hands-on experience with AWS Glue running spark/scala and advanced SQL experience including complex queries, data manipulation, and optimization.
Key responsibilities include designing and developing ETL processes to extract source data and perform data analysis/analytics operations, optimizing workflows, orchestration, and code for maximum performance efficiency, and utilizing security best practices to ensure data and application security.
The ideal candidate will have a strong understanding of data structure and database concepts, as well as experience with Relational Databases (RDBMS) and Non-Relational Databases. They will also have practical experience of developing solutions hosting within key major cloud providers such as Azure, AWS and Google Cloud.