Job Description
Data Engineer Lead
We are seeking a skilled Data Engineer to lead our data engineering efforts and develop innovative solutions to drive business growth. The ideal candidate will have a strong background in data engineering principles, database management, and programming skills. He or she will be responsible for designing, developing, and maintaining data pipelines, ensuring data quality and integrity throughout the process.
Key Responsibilities:
* Design and develop data pipelines to ingest, transform, and load data from various sources into centralized data lakes.
* Implement efficient ETL/ELT processes to ensure data quality, consistency, and reliability.
* Develop transformation processes to clean, aggregate, and enrich raw data, ensuring it is in the appropriate format for downstream analysis and consumption.
* Integrate data from diverse sources to provide a unified view of information.
* Design and implement efficient data models and database schemas that support the storage and retrieval of structured and unstructured data.
* Optimize data storage and access for performance and scalability.
Required Skills and Qualifications
Data Engineering Principles
* Strong experience in data engineering, including data pipeline development, ETL/ELT processes, and data modeling.
* Hands-on experience with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL Database, etc.
* Proficiency in SQL and experience with programming languages such as Scala, Java, and Python.
Database Management
* In-depth knowledge of relational and non-relational databases such as Snowflake, SQLServer, Oracle.
* Experience with database design, implementation, and optimization.
Programming Skills
* Strong proficiency in programming languages such as Scala, Java, and Python.
* Experience with cloud-based development tools such as Azure DevOps, Kubernetes, and Docker.
Benefits
State Street offers a competitive compensation package, comprehensive benefits program, and opportunities for career growth and professional development. We also offer flexible work arrangements, paid time off, and employee recognition programs.
Others
We truly believe in the power of diversity and inclusion. State Street is an equal opportunity employer committed to creating a workplace where everyone feels valued, respected, and empowered to contribute their best work. We warmly welcome candidates from diverse backgrounds, experiences, and perspectives. We are committed to providing a safe and inclusive environment for all employees, clients, and partners.