The Data Engineer will join a team developing a world-class data platform to support our customers, products, researchers, and back-office teams.
You'll join a team of Data Engineering and QA specialists empowered to define ways of working that work best for all.
You'll be adding features, developing data pipelines, automating the ETL of complex data and designing and configuring platform solutions that support a wide variety of applications.
You'll have the freedom to learn from a team of highly experienced data specialists and to produce innovative solutions in response to unique challenges and help us use data to make work more human.
**The skills you will bring:** You have exceptional coding and design skills, particularly in Python and preferably, Spark.
Knowledge of Java is beneficial.You've worked with large data volumes, including processing, transforming, and transporting large-scale data.Ideally, 3+ years of experience.You have hands-on experience with AWS services like Data Pipelines, EMR, Glue, Redshift, S3 etc.or other equivalent services.Experience with IAC, terraform is strongly preferred.You have knowledge of dbt, HBase, Apache Spark, Spark streaming, Kafka, Scala, and similar technology stacks.You have some familiarity with data warehouse concepts such as star schema and data de-normalizing patterns.
Successfully built scalable, data-centric systems with minimal guidance, demonstrating strong problem-solving and autonomous development skills.
#J-*****-Ljbffr