Join to apply for the Senior Data Engineer role at Optum
Join to apply for the Senior Data Engineer role at Optum
Get AI-powered advice on this job and more exclusive features.
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start Caring. Connecting. Growing together.
As a Senior Data Engineer you will be working on developing and maintaining data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake. Ensure the smooth flow of data from source systems to destination systems while adhering to data quality and integrity standards. In addition to having impact on a great team, you'll also discover the career opportunities you'd expect from an Industry Leader.
Schedule: Full-time position with standard working hours of Monday - Friday, standard business hours.
Careers with Optum offer flexible work arrangements and individuals who live and work in the Republic of Ireland will have the opportunity to split their monthly work hours between our Dublin or Letterkenny office and telecommuting from a home-based office in a hybrid work model.
Primary Responsibilities
* Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake. Ensure the smooth flow of data from source systems to destination systems while adhering to data quality and integrity standards
* Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting
* Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks
* Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines
* Implement data governance in line with company standards
* Partner with Data Analytics, Data Science and Product leaders to design best practices and standards for developing and productionalizing data pipelines
* Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Snowflake, others)
* Monitoring and Support: Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability
You will be rewarded and recognised for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role, as well as providing development for other roles you may be interested in.
Required Qualifications
* Extensive experience designing data solutions including data modeling (Knowledge on Data Vault is a plus)
* Well versed in Python(Programming, packaging, unit-testing), in fulfilling multiple general-purpose use-cases, and not limited to developing data APIs and pipelines
* Experience with Apache Spark and related Big Data stack and technologies
* Hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles
* Experience orchestrating data pipelines using technologies like ADF, Airflow, etc
* Experience working with batch data, knowing the strengths and weaknesses
* Experience building data pipelines on Azure/ Databricks, following best practices in Cloud deployments
* Knowledge of working with Hadoop ecosystem
* Fluent in SQL (any flavor), with experience using Window functions and more advanced features
* Understanding of DevOps tools, Git workflow and building CI/CD pipelines
* Ability to work with business and technical audiences on business requirement meetings, technical white boarding exercises, and SQL coding/debugging sessions
* Experience supporting big data pipelines and optimizing them
* Experience applying data governance controls within a highly regulated environment
Preferred Qualifications
* Bachelor’s Degree (or higher) in Database Management, Information Technology, Computer Science or similar
* Proven Data Engineering experience
* Experience working in projects with agile/scrum methodologies.
* Data modelling skills - Understanding of Medallion Architecture and Data-Vault2
* Familiar with Azure Databricks and/or Snowflake
* Experience working with real-time, knowing the strengths and weaknesses.
* Experience with shell scripting
* Familiarity with production quality ML and/or AI model development and deployment
* Familiarity with de-identification/masking of data
Please note you must currently be eligible to work and remain indefinitely without any restrictions in the country to which you are making an application. Proof will be required to support your application.
All telecommuters will be required to adhere to the UnitedHealth Group’s Telecommuter Policy.
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalised groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes — an enterprise priority reflected in our mission.
Diversity creates a healthier atmosphere: Optum is an Equal Employment Opportunity employer and all qualified applicants will receive consideration for employment without regard to gender, civil status, family status, sexual orientation, disability, religion, age, race, and membership of the Traveller community, or any other characteristic protected by law. Optum is a drug-free workplace. 2023 Optum Services (Ireland) Limited. All rights reserved.
#RPO
Referrals increase your chances of interviewing at Optum by 2x
Sign in to set job alerts for “Senior Data Engineer” roles.
Dublin, County Dublin, Ireland 2 days ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 1 month ago
Dublin, County Dublin, Ireland 3 months ago
Dublin, County Dublin, Ireland 2 days ago
Dublin, County Dublin, Ireland 3 weeks ago
Python Backend Junior Software Engineer - Remote 4 days a week (Europe)
Dublin, County Dublin, Ireland $30,000.00-$40,000.00 3 weeks ago
Dublin, County Dublin, Ireland 8 months ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 3 weeks ago
Dublin, County Dublin, Ireland 3 weeks ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 2 weeks ago
Dublin, County Dublin, Ireland 1 month ago
Dublin, County Dublin, Ireland 5 days ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 2 years ago
Dublin, County Dublin, Ireland 4 weeks ago
Dublin, County Dublin, Ireland 2 months ago
Frontend software engineer (React) - Europe Remote
Dublin, County Dublin, Ireland $35,000.00-$40,000.00 6 days ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 4 days ago
Dublin, County Dublin, Ireland 2 weeks ago
Software Engineer, Developer Infrastructure
Dublin, County Dublin, Ireland 2 weeks ago
Dublin, County Dublin, Ireland 2 months ago
Dublin, County Dublin, Ireland 3 days ago
Dublin, County Dublin, Ireland 1 month ago
Dublin, County Dublin, Ireland 2 weeks ago
Dublin, County Dublin, Ireland 1 week ago
Dublin, County Dublin, Ireland 2 days ago
Software Engineer, Java - Websites Experience
Dublin, County Dublin, Ireland 5 days ago
Dublin, County Dublin, Ireland 3 months ago
Dublin, County Dublin, Ireland 22 hours ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr