Overview
On Site
$70+
Contract - W2
Contract - Independent
100% Travel
Skills
Spark
PySpark
Python
AWS
Amazon Redshift
Amazon S3
Amazon Web Services
Analytics
Apache Spark
Cloud Computing
SQL
Scripting
Jenkins
Git
Data Processing
Data Modeling
Data Manipulation
Data Warehouse
Data Engineer
CI/CD
Job Details
Job Title: Data Engineer Location: Houston, TX or Wilmington, DE (Onsite Interview) Duration: Long-Term Contract
Job Description:
We are seeking an experienced Data Engineer with strong expertise in Spark, PySpark, Python, and AWS to design, build, and optimize large-scale data pipelines. The ideal candidate will have hands-on experience in data transformation, performance tuning, and implementing scalable data solutions in a cloud environment.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Spark and PySpark.
- Build and optimize ETL workflows for large-scale data processing and analytics.
- Implement and manage data solutions on AWS (S3, Glue, EMR, Redshift, Lambda, etc.).
- Collaborate with data analysts, scientists, and business stakeholders to understand data requirements.
- Ensure data quality, consistency, and integrity across multiple sources and systems.
- Develop reusable frameworks and automation scripts using Python.
- Monitor and optimize the performance of data processing jobs.
- Implement best practices for data security, governance, and compliance.
Required Skills & Qualifications:
- 8+ years of experience as a Data Engineer or in a similar role.
- Strong expertise in Spark and PySpark for distributed data processing.
- Proficiency in Python for data manipulation and automation.
- Hands-on experience with AWS data services (S3, Glue, Redshift, EMR, Lambda, Athena, etc.).
- Strong understanding of data warehousing concepts, ETL design, and data modeling.
- Experience with SQL and performance tuning for large datasets.
- Knowledge of CI/CD and version control (Git, Jenkins) preferred.
- Excellent problem-solving, debugging, and communication skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.