Senior Data Engineer
We are seeking a highly skilled and experienced Senior Data Engineer to join our organization. As a Senior Data Engineer, you will play a key role in developing and maintaining data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system.
About the Role:
The successful candidate will be responsible for integrating data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
* Integrate data from multiple sources and systems to create a unified and reliable data foundation for analysis and reporting.
* Develop data transformation routines to clean, normalize, and aggregate data.
* Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
* Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
* Implement data governance in line with industry standards.
* Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionizing analytic pipelines.
* Monitor data pipelines and data systems to detect and resolve issues promptly.
Requirements:
* Bachelor's Degree (or higher) in Database Management, Information Technology, Computer Science or similar or equivalent experience.
* Proven experience designing data solutions, including data modelling.
* Proven Data Engineering experience.
* Hands-on experience in data processing using PySpark and SQL.
* Experience with orchestration tools like Azure Data Factory or Airflow.
* Experience with Azure Databricks.
* Fluent in SQL, including advanced functions and window operations.
* Demonstrated experience with DevOps tools and CI/CD pipelines.
* Experience applying data governance controls in regulated environments.
* Well versed in Python regarding data manipulation, cleaning, transforming, and analyzing structured data to support our data-driven initiatives.
Preferred Qualifications:
* A motivated self-starter who excels at managing their own tasks and takes ownership.
* Experience working in projects with agile/scrum methodologies.
* Experience with Snowflake.
* Familiarity with production quality ML and/or AI model development and deployment.
What We Offer:
* A competitive salary range: 80,000 - 110,000 EUR per year.
* A comprehensive benefits package.
* Flexible work arrangements and opportunities for career growth and professional development.