Big Data Engineer

Randstad Digital is hiring and we're looking for someone like YOU to join our team! If you are seeking a new opportunity, looking to grow in your career, or you know someone who is - we want to hear from you! Take a look at the below opportunity, or feel free to visit to view and apply.

Job Description:

We are seeking a highly skilled Data Engineer with hands-on experience designing, building, and maintaining scalable data pipelines using modern big data technologies. The ideal candidate will have a strong foundation in data modeling, automation, and cloud integration, along with a working knowledge of job scheduling tools and business intelligence platforms.

This role involves end-to-end data pipeline development-from data ingestion and transformation to integration with downstream analytics platforms. You'll work closely with cross-functional teams to ensure data is clean, reliable, and available for business insights and reporting.

Key Responsibilities:

• Design and develop scalable and efficient data pipelines using the big data stack (Hadoop, Hive, PySpark, Python)
• Model and structure data for optimal storage, performance, and access across systems
• Automate workflows and data transformation processes using Autosys, Spark, and scripting tools
• Integrate data services with Amazon S3, ensuring proper storage, security, and accessibility
• Build and maintain database schemas and models (e.g., MySQL or similar relational DBs)
• Collaborate with BI teams to support reporting using Power BI and Dremio
• Utilize Unix/shell scripting for automation and job management
• Support and maintain CI/CD pipelines for data engineering workflows
• Troubleshoot data quality, performance, and pipeline issues proactively
• Stay current with emerging tools, techniques, and best practices in data engineering
• Exposure to Google Cloud Platform Cloud Data Engineering and financial services is a plus

Required Qualifications:

• Minimum 4 years of hands-on experience in data engineering
• Strong experience with Hadoop, Hive, PySpark, and Python
• Proficient in working with AWS S3 for data storage and integration
• Experience with Autosys job scheduling and automation
• Solid understanding of data modeling and database design
• Working knowledge of Power BI, Dremio, and Unix/shell scripting
• Experience with CI/CD pipelines and DevOps practices
• Strong analytical and troubleshooting skills

• Exposure to Google Cloud Platform (Google Cloud Platform) in a data engineering context
• Background or familiarity with the financial services industry

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.