Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
PySpark
AWS
ETL
Job Details
Job Description:
Role: Data Engineer
Location: Dallas, TX or Malvern, PA (Hybrid)
Technical Skills
- Hands-on experience with PySpark, AWS EMR, AWS Glue, IAM, and CloudFormation.
- Proficient in AWS services.
Responsibilities
- Design and develop ETL pipelines using PySpark, AWS EMR, and AWS Glue for large-scale data processing.
- Optimize Spark jobs for performance, scalability, and cost efficiency in cloud environments.
- Perform data transformations, cleansing, and enrichment to ensure high data quality.
- Monitor, troubleshoot, and enhance ETL workflows for improved reliability and efficiency.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.