Data Engineer PySpark, Snowflake & AWS - McLean, VA

McLean, VA, US • Posted 11 hours ago • Updated 11 hours ago
Contract W2
Contract Independent
12 Months
On-site
Depends on Experience
Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

  • Pyspark
  • Snowflake
  • AWS
  • Mortgage

Summary

  • 6+ years of hands-on data engineering experience in enterprise environments.
  • Strong expertise in PySpark building distributed data processing pipelines at scale.
  • Hands-on experience writing PySpark code to read data from S3 Parquet/Delta files, perform transformations, and handle large datasets.
  • Proven experience in performance tuning of PySpark jobs when reading and processing very large datasets.
  • Experience implementing deduplication logic in PySpark for high-volume data pipelines.
  • Deep hands-on experience with Snowflake data modeling, SnowSQL, Snowpipe, Streams, Tasks, and role-based access.
  • Hands-on experience creating Snowflake Iceberg Tables for open table format and lakehouse use cases.
  • Experience building Snowflake Dynamic Tables and Materialized Views for incremental data processing and query acceleration.
  • Strong Snowflake performance tuning skills clustering keys, micro-partition pruning, query profiling, warehouse right-sizing, caching strategies, and cost optimization.
  • Proven AWS experience S3, Glue, EMR, Lambda, IAM, Step Functions, CloudWatch, and Redshift.
  • Advanced SQL skills complex joins, subqueries, window functions, CTEs, and performance tuning.
  • Strong Python programming skills beyond PySpark for utilities, automation, and orchestration.
  • Experience with orchestration tools Airflow, AWS Step Functions, or equivalent.
  • Solid understanding of data warehousing, ELT/ETL patterns, data lakes, and lakehouse architectures.
  • Excellent communication skills able to articulate technical decisions to both engineers and business stakeholders.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91069917
  • Position Id: 9022170
  • Posted 11 hours ago
Contact the job poster
AJ

Avinash Jaiswal

Recruiter @ KE Staffing
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

McLean, Virginia

Today

Easy Apply

Contract

Depends on Experience

McLean, Virginia

Today

Easy Apply

Contract

50 - 60

Bethesda, Maryland

Today

Full-time

Chantilly, Virginia

Today

Full-time

Search all similar jobs