Overview
Senior Data Scheduling Infra Developer at eBay. You will design, develop, and operate a high‑performant distributed Data+AI job scheduling and execution engine based on Apache Airflow. You will customize, enhance, and extend Airflow to meet eBay’s specific needs and may collaborate with the open‑source community, potentially contributing to the Airflow codebase.
Responsibilities
* Analyze, customize, and enhance Apache Airflow's source code to develop new features and improve existing functionalities and performance.
* Collaborate with the Apache Airflow community to contribute patches, propose enhancements, and resolve issues.
* Implement best practices for Airflow architecture, including security, scalability, and performance optimization.
* Develop and optimize complex Airflow DAGs and Operators for data processing and orchestration.
* Stay updated with the latest trends and advancements in Airflow and related technologies.
Qualifications
* Bachelor's degree in Computer Science, Information Technology, or related field. Advanced degree preferred.
* 5+ years of experience in software development, with a strong focus on Python.
* 2+ years of hands‑on experience with Apache Airflow, including DAG and Operator development.
* Strong understanding of cloud platforms and containerization technologies (Docker, Kubernetes).
* Experience with CI/CD tools and practices.
* Excellent problem‑solving skills and ability to work independently on complex technical challenges.
* Strong communication skills and ability to work collaboratively in a global team environment.
Preferred Qualifications
* Deep understanding of Apache Airflow architecture and internals, with proven experience in customizing its source code.
* Experience as a contributor or committer to the Apache Airflow project or similar open‑source projects.
* Excellent communication skills and ability to collaborate effectively with internal teams and the open‑source community.
* Experience with big data technologies such as Hadoop, Spark, Kafka, Flink.
Legal and Privacy
eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, disability, or other legally protected status. If you need accommodation, please contact talent@ebay.com. View our accessibility statement to learn more about eBay's commitment to digital accessibility for people with disabilities.
The eBay Jobs website uses cookies to enhance your experience. By continuing to browse the site, you agree to our use of cookies. View our Privacy Center for more information.
#J-18808-Ljbffr