Apply Now

Sr Data Software Engineer - Remote - W2 Only

• Posted 1 hour ago • Updated 9 minutes ago

Contract W2

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Python
Redshift
S3
EMR
Athena
data lake stack
Glue Data Catalog

Summary

Title: Senior Data Software Engineer

Location: USA - Remote.(EST)

W2 Position

Note: The strongest candidates are likely to come from organizations with mature AWS data lake ecosystems, such as large financial services, healthcare, retail, or cloud-native technology companies that have recently adopted Apache Iceberg for their data platform modernization efforts.

Must-have skills: Hands-on data engineer with strong Python skills and experience building large-scale Apache Spark pipelines on AWS. Deep platform fluency across the modern data lake stack,S3, Glue Data Catalog, Athena, EMR, and Redshift, with a focus on reliable ingestion, transformation, and validation at scale.

Project: The client has a central data platform built on AWS Glue Data Catalog. They've developed a fine-grained data access control (FGAC) system that is now being adopted across various data-producing teams. As part of this adoption, each application team must review their data pipelines to identify queries affected by the new access controls and modify the queries they own accordingly.

Delta-to-Iceberg Migration

Design and build a migration feature/framework to convert tables from Delta Lake format to Apache Iceberg at scale.
Leverage deep understanding of Iceberg internals (metadata layers, manifests, snapshots, partitioning, schema evolution) to ensure correct and efficient migration
Validate data integrity, schema fidelity, and partitioning strategy parity between source Delta tables and migrated Iceberg tables
Optimize migration processes for performance and reliability across large volumes of tables and data
Identify and resolve edge cases, compatibility issues, or performance bottlenecks during migration at scale

FGAC (Fine-Grained Access Control)

Ensure Row-Level Security (RLS) and Column-Level Security (CLS) policies are correctly preserved or re-implemented on migrated Iceberg tables
Integrate migration workflows with AWS Lake Formation to maintain governance and access control continuity
Collaborate with security/governance teams to validate that FGAC policies enforce correctly post-migration
Support GDC (Global Data Catalog / Governed Data Catalog) integration to ensure migrated tables remain properly cataloged and governed
Build validation/reconciliation tooling to confirm access control parity between pre- and post-migration states

General Responsibilities

Document migration architecture, access control mapping logic, and operational runbooks
Collaborate with data platform, governance, and security teams throughout the migration lifecycle
Monitor and troubleshoot production issues related to migrated tables and access enforcement
Contribute to best practices and reusable tooling for future Delta-to-Iceberg migration phases

Required Qualifications

Strong, hands-on knowledge of Apache Iceberg internals (table format, metadata management, snapshots, partitioning, schema evolution)
Proven experience performing Delta-to-Iceberg migrations at scale
Experience with AWS Lake Formation for access control and data governance
Practical experience implementing or preserving Row-Level Security (RLS) and Column-Level Security (CLS)
Experience with GDC (Global/Governed Data Catalog) or equivalent data cataloging/governance systems
Solid understanding of distributed data processing and large-scale data migration challenges
Strong SQL skills and experience with table format internals (Delta Lake, Iceberg, or similar)

Preferred Qualifications

Experience with Spark for large-scale data processing and migration tooling
Familiarity with AWS data platform services (S3, Glue, Athena)
Experience with data governance frameworks and compliance-driven access control requirements
Prior experience building reusable migration frameworks or tooling for table format conversions
Scripting/automation experience (Python, Scala) for migration validation and tooling

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91091604
Position Id: 2026-4814
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer (Iceberg Migration)

Remote

•

Today

Sr. Data Engineer ( Delta-to-Iceberg Migration) Remote 12+ Months Must Have skills: Hands-on data engineer with strong Python skills and experience building large scale Apache Spark pipelines on AWS. Deep platform fluency across the modern data lake stack,S3, Glue Data Catalog, Athena, EMR, and Redshift, with a focus on reliable ingestion, transformation, and validation at scale. Project: The client has a central data platform built on AWS Glue Data Catalog. They've developed a fine-grained dat

Easy Apply

Contract

Depends on Experience

Req:: Sr ETL Data Engineer _ Remote _ W2 Only

No location provided

•

Today

Hi, Greetings of the day! We are hiring for the below position Role: Sr Data Engineer -3635 Location: Remote Duration: 5+ months Would prefer someone in the Pacific, Mountain, or Central time zone in that order, if possible. Working hours: 9 am - 6 pm, can adjust About the Team & the Role The Core Data team builds and scales the data platform and analytics capabilities that power decision-making across client locations. Within Core Data, the Vehicle Catalog team owns the vehicle domain - ing

Easy Apply

Contract

Data Migration Development Lead (AWS) - St. Louis, MO - Only W2 - (JK)

St. Louis, Missouri

•

19d ago

We are seeking a Data Migration Development Leadto drive the design, development, and delivery of large-scale data migration solutions using the AWS platform. This role combines hands-on technical leadership with responsibility for migration architecture, data engineering, quality assurance, and production cutover execution. Key Responsibilities Lead end-to-end data migration design, development, and implementation.Build scalable ETL/ELT and migration frameworks using AWS services.Design data e

Easy Apply

Contract

Depends on Experience

AWS Data Engineer

Hybrid in Baltimore, Maryland

•

6d ago

Role: Data EngineerLocation: Baltimore City, MD (Hybrid)Duration: 12+ months project with 1 one-year renewal option Job Description:Hands-On Data Pipeline Development Design, code, and deploy ETL/ELT pipelines across bronze, silver, and gold layers of the Data Lakehouse.Build ingestion pipelines for structured (SQL), semi-structured (JSON, XML), and unstructured data using PySpark/Python programming language using AWS Glue or EMR.Implement incremental loads, deduplication, error handling, and da

Easy Apply

Contract

$70 - $75

Search all similar jobs