Senior Data Engineer Position
We are looking for a Senior Data Engineer with over 5 years of expertise in Ruby or Python, a strong understanding of AI-focused development, and extensive experience working with AWS, Docker, GitHub Actions, and CI/CD pipelines.
The selected candidate will be responsible for designing and implementing scalable data architectures, handling large-scale data ingestion and ETL pipelines, and ensuring best practices in data processing, database design, and system architecture.
* Design and implement scalable data architectures using Ruby or Python, ensuring high performance and maintainability.
* Develop and manage ETL pipelines and large-scale data ingestion workflows.
* Ensure efficient data transformation, cleaning, and storage using best practices.
* Optimize and maintain PostgreSQL databases, ensuring scalability, performance tuning, and indexing strategies for high-volume workloads.
* Handle high-throughput data processing and design solutions for real-time and batch data workflows.
* Develop and manage CI/CD pipelines, GitHub Actions, and workflows to streamline deployments.
* Design and implement integration and unit testing to ensure system reliability.
* Leverage AWS services to build cloud-native applications.
* Write clean, efficient, and well-documented code, following industry best practices.
* Collaborate with AI, DevOps, and frontend teams to deliver robust and efficient solutions.
* Drive best practices in system design, microservices architecture, and API development.