Job Title: Data Engineer
This is a hands-on Data Engineer position in State Street Global Technology Services. We are looking for a candidate with good knowledge of Bigdata technology and strong development experience with Databricks. You will help to migrate existing on-prem applications to cloud (Azure preferred), create and maintain new data applications relying on experience and judgment to plan and accomplish goals while working with other globally situated team members.
Responsibilities:
* Design & develop custom high throughput and configurable frameworks/libraries.
* Drive change through collaboration, influence, and demonstration of POCs.
* Be responsible for all aspects of the software development lifecycle, including design, coding, integration testing, deployment, and documentation.
* Work collaboratively within an agile project team.
* Follow best practices and coding standards.
* Grow your personal skillset.
Requirements:
* Experience performing data analysis and data exploration.
* Experience working in an agile delivery environment.
* Hands-on development experience in Java is a big plus.
* Exposure/understanding of DevOps best practices and CI/CD (i.e., Jenkins).
* Experience working in a multi-developer environment using version control (i.e., Git).
* Strong knowledge of Databricks SQL/Scala - Data engineering pipeline.
* Strong experience in Unix, Python, and complex SQL.
* Strong critical thinking, communication, and problem-solving skills.
* Strong hands-on experience in troubleshooting DevOps pipelines and Azure services.
Education & Qualifications:
* Bachelor's Degree level qualification in a computer or IT-related subject.
* 5+ years of overall Bigdata data pipeline experience.
* 5+ years of Databricks hands-on experience.
* 5+ years of experience in cloud-based development including Azure Services, Azure DevOps, Kubernetes, Docker.
* Experience with Snowflake is a plus.
About Us:
We truly believe our employees' diverse backgrounds, experiences, and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity, and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader.