Senior Data Infrastructure Specialist
This role focuses on designing, building, and leading data engineering initiatives to drive business outcomes.
Main Responsibilities:
* Develop strategic data infrastructure solutions and standards for the organization.
* Audit and optimize existing pipelines (ETL/ELT) for improved performance, scalability, and security.
* Integrate diverse data sources, establish fault-tolerant systems, and implement CI/CD best practices.
* Leverage big data technologies (Hadoop, Spark, Kafka) to analyze large datasets and ensure data quality.
* Maintain pipeline performance, troubleshoot issues, and implement observability and alerting systems.
* Enhance team efficiency using GenAI solutions and document systems according to governance policies.
* Mentor junior engineers in data infrastructure development and innovation.
The ideal candidate should possess:
* Proficiency in Python, Java, or Scala programming languages.
* Strong SQL skills with experience in relational databases.
* Knowledge of NoSQL databases and big data technologies.
* Skills in data modeling and schema design.
* Familiarity with industry regulatory requirements (CFR Part 11, GxP, CSA).
* Experience with cloud platforms related to AI/GenAI.
* Expertise in stream processing (Kafka, Flink) and cloud certifications.