Job Description
\
As a Data Engineer, you will play a vital role in designing and developing data processing systems to ensure maximum performance efficiency. The ideal candidate will have hands-on experience with API development, knowledge of data structures and database concepts, and experience working with various data storage systems.
\
Key Responsibilities:
\
\
* Collaborate with subject matter experts to design and develop workflows that support automation objectives
\
* Design and develop processes to exchange data with external systems and components for ETL programs and front-end presentation layer
\
* Optimize workflows, orchestration, and code for maximum performance efficiency
\
* Apply security best practices to ensure data and application security
\
* Design and prototype conceptual and logical data models and flowcharts
\
* Develop data monitoring models for pipelines
\
* Write technical documentation for the developed solutions
\
* Participate in the development of high-quality software solutions using the latest technologies and methodologies
\
About You:
\
\
* Hold a Bachelor's degree or higher in Computer Science, Information Technology, or related field, or possess extensive experience as a Data Integration Engineer
\
* Have extensive experience as a Data Integration engineer or similar Data Engineering role
\
* Be proficient in API development using Java, Python, potentially Node.js
\
* Have knowledge of data structures and database concepts
\
* Have experience working with data processing and SQL databases
\
* Have advanced SQL experience
\
* Have experience working with Relational Databases (RDBMS) and Non-Relational Databases
\
* Have experience in implementing ETL applications, data warehousing/data modeling principles, architecture, and implementation in large environments
\
* Have working knowledge of public clouds like Azure, AWS, Google Cloud and developing applications on Linux environments
\
* Have experience with agile/Scrum methodologies
\
* Have practical experience in developing solutions hosted within key major cloud providers such as Azure, AWS, and Google Cloud
\
* Have experience working with Airflow in implementing data pipeline orchestrations, Airflow operators, and hooks
\
* Have experience working with Kubernetes and Docker, designing, implementing, and running data applications
\
* Have experience working in data warehouses
\
* Have experience with Apache Kafka
\
* Have knowledge of DevOps tools and practices
\
* Have experience of Agile development methodology
\
* Have experience of Kimball, Data Vault
\
* Have experience of Data Build Tool