Role : Data Engineer (AWS SME) - Delta to Iceberg Migration & FGAC
Seeking a hands-on Data Engineer with strong expertise in Spark-based data platforms, Apache Iceberg, and AWS Data Lake technologies. The role will focus on large-scale Delta-to-Iceberg migration initiatives and implementation of fine-grained governance controls in enterprise data lake environments.
· Design and execute Delta Lake to Apache Iceberg migration strategies.
· Develop and optimize Spark/PySpark data processing pipelines.
· Implement Fine-Grained Access Control (FGAC) capabilities.
· Configure and manage Row-Level Security (RLS) and Column-Level Security (CLS).
· Work with AWS Lake Formation to enable governed data access.
· Analyse Iceberg internals and optimize table performance.
· Support data governance, security, and compliance initiatives.
· Troubleshoot and resolve data platform performance issues.
· Data Engineering experience.
· Strong hands-on experience in Apache Spark / PySpark.
· Deep knowledge of Apache Iceberg internals.
· Experience with Delta-to-Iceberg migration at scale.
· Strong AWS Data Lake experience.
· Hands-on AWS Lake Formation expertise.
· Experience implementing FGAC controls.
· Strong understanding of RLS and CLS concepts.
· Strong SQL and data modelling skills.
· Experience working in enterprise data governance environments.
· Infrastructure automation and CI/CD
· Metadata and governance frameworks
Data Engineer ( Delta to Iceberg Migration & FGAC)1SQL,AWS,Migration,Apache Spark,Data Modelling,Iceberg,GDCN/AFull TImeUnited States
Never miss an opportunity! Create an alert based on the job you applied for.
