McLean, Virginia
•
Today
6+ years of hands-on data engineering experience in enterprise environments. Strong expertise in PySpark building distributed data processing pipelines at scale. Hands-on experience writing PySpark code to read data from S3 Parquet/Delta files, perform transformations, and handle large datasets. Proven experience in performance tuning of PySpark jobs when reading and processing very large datasets. Experience implementing deduplication logic in PySpark for high-volume data pipelines. Deep hands-
Easy Apply
Contract
Depends on Experience

