Data Lakehouse Engineer at N Consulting Ltd Location: Warsaw (Poland)Job Summary:We are seeking a skilled AWS Data Lake Engineer to design, build, and maintain scalable data lake solutions on AWS. The ideal candidate will have strong experience in cloud-based data engineering, big data processing, and modern data architecture.Key Responsibilities:Design and develop data lake solutions using AWS services such as IAM, Lambda, EKS, S3, EMR, and MWAABuild and optimize data pipelines using Python and PySparkImplement and manage Apache Iceberg tables for efficient data storage and queryingDevelop and maintain CI/CD pipelines and infrastructure using TerraformEnsure data quality, security, and governance across the platformOrchestrate workflows and automate data processing tasksRequired Skills:Strong experience with AWS data services and cloud architectureProficiency in Python and PySparkHands-on experience with Apache IcebergExperience with CI/CD tools and Infrastructure as Code (Terraform)Knowledge of data quality, data security, and workflow orchestration
#J-18808-Ljbffr