Dublin, County Dublin, Ireland Software and Services
Description
We are looking for a Senior Data Platform Engineer to build out services and ingestion related to a knowledge graph.
This knowledge graph aims to unify insights on data processing—job telemetry, SLA expectation and attainment, data quality, infra incidents—using job lineage to build a comprehensive and predictive view of data processing 'health' across all of Apple Services data engineering.
You'll apply your expertise in data systems to design, build, and support ingestion services to feed and manage data in the knowledge graph (a graph db), and be a part of coming up with new ways to classify and represent data via agentic workflows, to increase the insight available from the graph.
We believe graph-based insights can be used to power operational excellence, by capture production issues, driving analysis, guiding resolution of issues and enabling proactive avoidance of future incidents.
You'll work alongside a Dublin based team of data and other software engineers committed to bringing the knowledge graph to life.
You will have a tremendous amount of individual responsibility and influence over the direction of this critical service for years to come.
Additionally, you will have the chance to interact with various other teams, each with unique skill sets and operating in different time zones.
Minimum Qualifications
Experience designing and developing data services and/or data platforms
Experience with containerisation and orchestration (e.g., Kubernetes and Apache Airflow )
Experienced in SQL, relational databases, NoSQL databases and ORM tooling
Experience with Apache Spark and Kafka
Preferred Qualifications
Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or equivalent professional experience.
Experience with a graph database (eg ArrangoDB, Neo4j, TigerGraph) and/or graph ontology
Experience with Python and/or Scala
A learning attitude to continuously improve the self, team, and the organisation
Loves fast-paced environment and learning/leveraging new technologies
#J-18808-Ljbffr