DataEngineer(Databricks)Ireland(Hybrid) Start:ASAP ContractType:Day-rate Location:Limerick/Hybrid WerelookingforaskilledDataEngineertojoinaforward-thinkingtechteamonaday-ratecontractbasedinLimerick(hybridmodel).IfyoureexperiencedwithDatabricks,ApacheSpark,andbuildingscalabledatapipelinesinacloudenvironmentthiscouldbeagreatfit. KeyResponsibilities Design,build,andmaintainrobustandscalabledatapipelinesusingDatabricksandApacheSpark. Collaboratecloselywithdataanalystsanddatascientiststodeliverhigh-quality,fit-for-purposedatasolutions. OptimiseandenhanceexistingETLprocessesforimprovedperformanceandreliability. Implementandenforcedatavalidationandtestingprotocolstoensuredataintegrityandquality. Workwithbigdatatoolsandframeworkstomanage,process,andtransformlarge-scaledatasets. Supportdatamodelingeffortsandcontributetothedesignofdatawarehousesandanalyticalenvironments. Monitor,troubleshoot,andresolveperformanceissuesindatapipelinesandrelatedinfrastructure. Contributetocodereviewsandupholdbestpracticesindataengineeringstandardsandgovernance. Createandmaintaincleardocumentationofdataworkflows,architecture,andoperationalprocedures. Stayinformedonemergingtechnologiesandindustrytrendsrelevanttodataengineering. Promoteinnovationandcontinuousimprovementwithintheteam. Experience 3+yearsofhands-onexperienceindataengineeringorasimilarrole. ProvenexpertisewithDatabricksandApacheSparkfordistributeddataprocessing. StrongprogrammingandscriptingskillsinSQL,Python,and/orScala. SolidunderstandingofETLprocesses,datamodeling,anddatawarehousingconcepts. Familiaritywithcloudplatforms,preferablyAzure. Knowledgeofdatagovernance,dataqualityframeworks,andbestpractices. Stronganalyticalthinkingandattentiontodetail. Excellentcommunicationskillswiththeabilitytocollaborateeffectivelyacrossteams.