Senior Data Engineer - 6 month rate contract
€ per day - Dublin (remote)
Key Responsibilities
·Maintain/develop data pipelines required for the extraction, transformation, cleaning, pre-processing, aggregation and loading of data from a wide variety of data sources using Python, SQL, DBT, and other data technologies
·Design, implement,test and maintain data pipelines/ new features based on stakeholders' requirements
·Develop/maintain scalable, available, quality assured analytical building blocks/datasets by close coordination with data analysts
·Optimize/ maintain workflows/ scripts on present data warehouses and presentETL
·Design / develop / maintain components of data processing frameworks
·Build and maintain data quality and durability tracking mechanisms to provide visibility into and address inevitable changes in data ingestion, processing, and storage
·Collaborate with stakeholders to define data requirements and objectives.
·Translate technical designs into business appropriate representations and analyse business needs and requirements ensuring implementation of data services directly correlates to the strategy and growth of the business
·Address questions from downstream data consumers through appropriate channels
·Create data tools for analytics and BI teams that assist them in building and optimizing our product into an innovative industryleader
·Stay up to date with data engineering best practices, patterns, evaluate and analyze new technologies, capabilities, open-source software in context of our data strategy to ensure we are adapting our own core technologies to stay ahead of the industry
·Contribute to Analytics engineering process
Required Qualifications
5+ Years Relevant Work Experience
BA / BS in Data Science, Computer Science, Statistics, Mathematics, or a related field
Built processes supporting data transformation, data structures, metadata, dependency, data quality, and workloadmanagement
Experience with Snowflake, Hands-on experience with Snowflake utilities, Snow SQL, Snow Pipe. Must have worked on Snowflake Cost optimization scenarios.
Overall solid programming skills, able to write modular, maintainable code, preferably Python & SQL
Have experience with workflow management solutions like Airflow
Have experience on Data transformations tools like DBT
Experience working with Git
Experience working with big data environment, like, Hive, Spark and Presto
Ready to work flexible hours
Preferred Requirements
Experience supporting Support, Customer Success,
DAG Airflows
Knowledge of natural language processing (NLP) and computer vision techniques.
Familiarity with version control systems (e.g., Git).
Snowflake
DBT
Working knowledge of Power BI
AWS environment, for example S3, Lambda, Glue, Cloud watch
Basic understanding of Salesforce
Experience working with remote teams spread across multiple time-zones
Have a hunger to learn and the ability to operate in a self-guided manner
For more info please contact Michael on 01 /
#LI-MF7