The Vehicle Data Engineering team is seeking a Senior Software Engineer with a proven track record building large scale data streaming platforms. The ideal candidate will play a crucial role in developing and maintaining data-related systems comprising high throughput data streams, data curation and data storage / file system architectures, data security and governance, as well as inline inferencing and AI algorithms.
What will you do:
* Develop a scalable data platform to support continuing increases in data volume and complexity.
* Develop data pipelines to ingest, process, and curate large volumes of data using Akka or similar technologies.
* Support the infrastructure required for optimal ingestion, transformation, and loading of data.
* Collaborate with data scientists and analysts to support the needs of advanced ML development.
* Design and implement rigorous data validation, governance, and quality checks to uphold data integrity.
* Mentor & Support junior engineers by providing guidance, coaching and educational opportunities.
#J-18808-Ljbffr