Overview 8 West Consulting is one of the country's largest software development organisations.
Formerly named DeCare Systems Ireland, the company has been operating successfully in Cork city since 1998.
8 West Consulting employ a wide range of technologies including Mobile (iOS, Android, Windows), Java SE/Java EE (WebLogic, WebSphere, Spring, Akka, Hibernate, GWT, etc.), Microsoft .
NET (ASP.NET, C#, etc.), JavaScript (AngularJS, JQuery, dojo, etc.), various database management systems (MongoDB, Oracle, SQL Server, MySql, etc.).
8 West Consulting provides consultancy and leading-edge software solutions for a wide variety of US, EU and UK based clients in the insurance, healthcare, retail and public sector markets.For more on 8 West Consulting visit our website SummaryThe Senior Data Engineer is responsible for designing, developing, and maintaining scalable data solutions across both legacy and modern cloud platforms.
The role requires deep expertise in cloud-based data warehousing, strong hands-on skills in Python and ETL pipeline development, and the ability to work in dynamic, agile environments.
The successful candidate must demonstrate excellent verbal and written English communication skills and be able to collaborate effectively with stakeholders across the business.Key Responsibilities· Design, develop, and maintain robust ETL/ELT processes, including pipelines for extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from diverse sources· Develop, enhance, and maintain ETL solutions using SSIS and cloud-based data platforms· Deliver across the full agile lifecycle, including design, coding, testing, and deployment of iterative data solutions· Collaborate with cross-functional teams to ensure data quality, integrity, availability, and auditabilityQualifications & Experience · Minimum 10 years' experience in data engineering with a strong focus on cloud data platforms· Deep expertise in Snowflake, including cloud-based data warehousing, ELT/ETL pipeline development, and performance tuning· Demonstrated experience building and maintaining ETL processes, ideally using SSIS and Snowflake· Strong proficiency in Python for scripting, automation, and data pipeline development· Hands-on experience with AWS (e.g., data lakes, Glue, S3, Redshift) and exposure to Azure data services· Practical experience using Terraform (or similar IaC tools) for provisioning and managing cloud infrastructure· Proficiency in working with JSON, XML, and other semi-structured data· Work with messaging and queuing systems (e.g., SQS, SNS) to support event-driven data flows· Familiarity with streaming data platforms (e.g., Kafka, Kinesis) is an advantage· Strong background in Git-based workflows (branching strategies, pull requests, CI/CD pipelines)· Excellent verbal and written English communication skills Skills & Competencies
• Strong analytical and problem-solving skills.
• Ability to design scalable, reliable, and high-performance data solutions.
• Clear communicator, capable of presenting complex technical concepts to varied audiences.
• Excellent documentation and technical writing skills.
• Strong understanding of infrastructure automation and best practices in cloud resource management.
• Proactive, adaptable, and able to deliver results in fast-paced environments.
[Please note this is a daily rate contract position]