Transact Campus is transforming the student experience through credential-driven privileges and innovative payments. Our enterprise-class cloud platform powers every aspect of campus life, delivering data-driven insights and frictionless experiences for students and institutions alike.As part of our dedicated data engineering, reporting and analytics team, you will be immersed in a fast-paced, agile environment where we use both novel and established technologies in innovative ways. We're looking for someone who is passionate about data engineering, thrives in collaborative environments, and is excited by the opportunity to work on cutting-edge data and analytics solutions.We're a fun, hard-working, and solution-oriented team that values creativity, ownership, and continuous learning. You will be working with people who care deeply about building high-quality software and solving meaningful problems.Location: Limerick City, Ireland– Hybrid working with at least 3 days a week on site, during probationary period, to ensure a solid level of support while onboarding.Position ResponsibilitiesWork in a dedicated data reporting and analytics team building a world-class data platform to produce data-driven insights for Transact Campus and our clientsAnalyze, interpret and orchestrate complex data across disparate sources comprising unstructured, semi-structured and structured datasets in streaming and batch modesDesign and develop real-time data pipelines using the latest Databricks and Delta Lake Azure cloud technologiesCollaborate with data consumers (reporting, analysis, or data science) to provide metrics that meet their needsContribute to standards for data producers streaming data into the LakehouseTest commercial software products using both manual and automated testing processesSupport the application lifecycle during QA, UAT, and post-release phasesComply with and contribute to consistent development guidelines (coding, change control, build, versioning)Participate in peer code reviewsRequired SkillsBachelor's degree in Computer Science, IT or related field OR equivalent related work experience – preferably with a focus on Data Analytics5+ years of experience in software enterprise-level Data EngineeringExpertise in big data workloadsExperience with data lakes and scale-out processingRelational database design and best practicesHands-on experience designing and developing Spark data pipelinesStrong SQL and Python skillsUnderstanding of cloud-based big data workloadsExperience with ETL/ELT patterns, preferably using Databricks jobsExcellent technical documentation skillsExperience with data lakes (HDFS, Azure Data Lake or AWS S3)Experience with source code management systems such as Git/TFS/SVNExperience working in Agile teams (Scrum, XP, Kanban)Ability to present ideas and insights to business stakeholdersFluency in written and spoken EnglishPreferred SkillsGood understanding of Azure Data Services (Azure Databricks, Azure Data Factory, Azure Data Lake Gen 2)Experience with Databricks Delta Lake, Delta Sharing, and Delta Live TablesExperience with Spark Structured StreamingExperience with NoSQL databasesExperience with Infrastructure as Code technologies such as Terraform or ARMExperience in Data Science and ML methodologiesExperience with Azure services for streaming data (EventHub, EventGrid)Understanding of Data strategy including Data Governance and Data managementWhy Join UsWork with cutting-edge data technologies and platformsCollaborative and supportive work environmentOngoing professional development and training opportunitiesHybrid working modelRegular social, sporting, and community eventsBenefits including; Private Health Insurance, Dental Insurance, Matched Pension Contribution, 25 Days Annual LeaveThis job description is not designed to contain a comprehensive listing of activities, duties, or responsibilities that are required. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities at any time.Transact Campus Inc. is an equal employment opportunity employer and considers qualified applicants for employment without regard to race, gender, age, color, religion, national origin, marital status, disability, sexual orientation, protected military/veteran status, or any other protected factor.