Lead Data Infrastructure Developer
As a key member of our data infrastructure team, you will be responsible for designing and implementing scalable data pipelines that drive business growth. This is an opportunity to leverage your technical expertise in Spark and Databricks to build high-quality data solutions.
Key Responsibilities:
* Collaborate with cross-functional teams to design, develop, and maintain efficient data architectures.
* Implement Dev Ops best practices using automated testing and CI/CD pipelines to ensure seamless deployment.
* Contribute innovative ideas for new product development and data-driven decision-making across various business areas.
* Develop and optimize ETL/ELT processes for structured and unstructured data sources.
Requirements:
* 3+ years of experience working with cloud-based platforms and big data technologies.
* Proven track record of building scalable data pipelines using Spark and developing in Python.
* Strong understanding of data modeling, SQL, and warehouse design principles.
* Solid knowledge of cloud infrastructure and data warehousing concepts.
* Demonstrated experience working with IoT datasets and related technologies.