Big Data Engineer

• Posted 14 hours ago • Updated 2 hours ago
Contract W2
On-site
USD39 - USD44/hr
Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

  • Big Data Engineer

Summary

job summary:

The contractor will be responsible for supporting and maintaining the data pipeline platform that powers performance reporting data staging capabilities. Key responsibilities include:


Manage and maintain Amazon Redshift consumer cluster infrastructure, ensuring platform stability, performance, scalability, and operational reliability.


Design, develop, enhance, and support data pipelines built using PySpark and AWS Glue to ingest, transform, and deliver data across the platform.


Monitor, troubleshoot, and optimize ETL/ELT workflows, data processing jobs, and cloud infrastructure to meet service level expectations.


Perform data analysis, root cause investigation, and data validation activities to identify and resolve data quality, performance, and operational issues.


Collaborate with product, engineering, and business teams to support data integration, reporting, and modernization initiatives.


Implement engineering best practices related to automation, monitoring, performance tuning, and cloud-native data processing.


Support production releases, incident resolution, and continuous improvement of the AWS-based data platform.





location: Malvern, Pennsylvania

job type: Contract

salary: $39.38 - 44.38 per hour

work hours: 8am to 5pm

education: Bachelors



responsibilities:

Responsibilities


  • The contractor will be responsible for supporting and maintaining the data pipeline platform that powers performance reporting data staging capabilities. Key responsibilities include:
  • Manage and maintain Amazon Redshift consumer cluster infrastructure, ensuring platform stability, performance, scalability, and operational reliability.
  • Design, develop, enhance, and support data pipelines built using PySpark and AWS Glue to ingest, transform, and deliver data across the platform.
  • Monitor, troubleshoot, and optimize ETL/ELT workflows, data processing jobs, and cloud infrastructure to meet service level expectations.
  • Perform data analysis, root cause investigation, and data validation activities to identify and resolve data quality, performance, and operational issues.
  • Collaborate with product, engineering, and business teams to support data integration, reporting, and modernization initiatives.
  • Implement engineering best practices related to automation, monitoring, performance tuning, and cloud-native data processing.
  • Support production releases, incident resolution, and continuous improvement of the AWS-based data platform.




qualifications:

AWS Glue, PySpark, Amazon Redshift, SQL, data pipeline development, cloud data engineering, data analysis, troubleshooting, and operational support.




Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.


Any consideration of a background check would be an individualized assessment based on the applicant or employee's specific record and the duties and requirements of the specific job.



Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: cxsapwma1
  • Position Id: 1339322
  • Posted 14 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Philadelphia, Pennsylvania

10d ago

Easy Apply

Contract

Depends on Experience

New York, New York

Today

Easy Apply

Contract, Third Party

55 - 65

St. Louis, Missouri

Today

Easy Apply

Full-time, Part-time, Contract, Third Party

Hybrid in Needham, Massachusetts

10d ago

Easy Apply

Contract

$60 - $70

Search all similar jobs