Job Title: AWS Data Engineer
Job Location: Remote
Onboarding: In-person onboarding required in NJ or San Jose, CA
Job Duration: Full Time
Role Overview
Seeking a hands-on Data Engineer with strong expertise in Spark-based data platforms, Apache Iceberg, and AWS Data Lake technologies. The role will focus on large-scale Delta-to-Iceberg migration initiatives and implementation of fine-grained governance controls in enterprise data lake environments.
Key Responsibilities
· Design and execute Delta Lake to Apache Iceberg migration strategies.
· Develop and optimize Spark/PySpark data processing pipelines.
· Implement Fine-Grained Access Control (FGAC) capabilities.
· Configure and manage Row-Level Security (RLS) and Column-Level Security (CLS).
· Work with AWS Lake Formation to enable governed data access.
· Analyse Iceberg internals and optimize table performance.
· Support data governance, security, and compliance initiatives.
· Troubleshoot and resolve data platform performance issues.
Required Skills
· Data Engineering experience.
· Strong hands-on experience in Apache Spark / PySpark.
· Deep knowledge of Apache Iceberg internals.
· Experience with Delta-to-Iceberg migration at scale.
· Strong AWS Data Lake experience.
· Hands-on AWS Lake Formation expertise.
· Experience implementing FGAC controls.
· Strong understanding of RLS and CLS concepts.
· Strong SQL and data modelling skills.
· Experience working in enterprise data governance environments.
· Familiarity with GDC.
Preferred Skills
· AWS S3
· Data Lake architecture
· Performance tuning
· Infrastructure automation and CI/CD
· Metadata and governance frameworks
AWS Data Engineer1AWS,Migration,Pyspark,Datalake,ICEBREGN/AFull TImeUnited States
Never miss an opportunity! Create an alert based on the job you applied for.
