McLean, Virginia
•
Yesterday
Sr Data Engineer Mclean, VA Need Local Long Term Contract Design & Build Scalable Data Pipelines using PySpark for large-scale batch and streaming data processing. Develop PySpark Solutions write production-grade PySpark code to read data from S3 (Parquet/Delta files), perform complex transformations, and process large-scale datasets efficiently. Implement Deduplication Logic design and implement robust deduplication strategies for large datasets using PySpark. Performance Tuning (PySpark) opti
Easy Apply
Contract
Depends on Experience



