Senior Data Engineer – Daily Rate Contract
We are seeking a Senior Data Engineer to join our dynamic team of Software Engineers as part of our Security Innovation program. If you’re passionate about building scalable data solutions, leveraging AI and Machine Learning to combat financial fraud, and working with cutting-edge technologies, this opportunity is for you.
What You’ll Do:
* Develop and maintain high-performance data pipelines to support business intelligence, analytics, and AI-driven applications.
* Assemble and process large, complex data sets to meet both functional and non-functional business needs.
* Design and implement process improvements to optimize data flow, automate workflows, and enhance scalability.
* Build robust infrastructure for data extraction, transformation, and loading (ETL) using modern cloud-based solutions.
* Work closely with Software Engineers, Data Scientists, and Architects to ensure seamless data integration and optimal performance.
* Take ownership of clarifying requirements and proposing scalable solutions before implementation.
What You Bring:
* Strong expertise in SQL and experience working with relational and NoSQL databases (e.g., Postgres, Oracle, CosmosDB).
* Experience with batch-oriented data pipelines and maintaining historical datasets.
* Hands-on experience with big data frameworks such as Hadoop, Spark, Hive, or Cloudera.
* Proficiency in cloud services (preferably AWS) and experience working with Snowflake or similar data warehousing solutions.
* Strong understanding of distributed data processing, message queuing, and stream processing (e.g., Kafka, Storm, Spark Streaming).
* Solid programming skills in Java, Python, or similar object-oriented languages.
* Experience with CI/CD, containerization (Docker), and workflow management tools.
* Strong problem-solving skills with the ability to analyze and extract value from large datasets.
* Comfortable working in an Agile environment (Scrum, SAFe) and collaborating across cross-functional teams.
#J-18808-Ljbffr