Job Description
Our client is seeking a Senior Data Engineer to design and develop scalable applications to process and analyze large datasets.
The ideal candidate will have a passion for working with large structured and unstructured datasets, and a desire to unlock the potential of data using cutting-edge tools and cloud technologies.
Responsibilities
* Design and develop scalable applications to process and analyze large datasets.
* Rapidly prototype and deploy solutions that support investment research and data analysis.
* Build custom data pipelines for extracting, transforming, and loading data from diverse sources such as REST APIs, RDBMS, Oracle, and cloud storage (e.g., S3).
* Leverage Python (and libraries like Pandas, Numpy, or Spark) to handle data processing and analytics tasks.
* Develop and maintain web applications using Angular or React, focusing on single-page application (SPA) architecture.
* Utilize object-oriented programming principles to build robust and maintainable codebases.
* Contribute to cloud migration efforts and participate in application deployment in AWS.
* Write and maintain scripts in both Linux and Windows environments.
* Participate in on-call rotations, ensuring system reliability and quick resolution of issues.
Requirements
* 10+ years of experience in enterprise software development.
* Strong programming skills in Python, with experience in data processing and analytics.
* Proven experience in developing custom ETL/data pipelines and working with relational databases (SQL, PL/SQL, Oracle).
* Solid understanding of object-oriented programming and software design patterns.
* Experience building web applications using Angular or React (SPA architecture).
* Familiarity with cloud platforms, particularly AWS, and experience with cloud migration is an advantage.
* Exposure to CI/CD tools and cloud-native development practices.
* Proficiency in scripting for Linux and Windows environments.
* Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
* Strong problem-solving skills and the ability to manage multiple priorities.
* Excellent communication and teamwork abilities, with experience leading technical initiatives.