Senior Bigdata Engineer

Hybrid in Malvern, PA, US • Posted 10 hours ago • Updated 6 hours ago
Contract Independent
Contract W2
12 Months
No Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • Big Data
  • Amazon S3
  • Amazon Web Services
  • Analytics
  • Apache Hadoop
  • Apache Spark
  • Extract
  • Transform
  • Load
  • GitHub
  • JIRA
  • Optimization
  • Python
  • Real-time
  • Cloud Computing
  • Data Lake
  • Data Quality
  • Data Science

Summary

Big Data Engineer responsible for building data pipelines, data lake/warehouse solutions, and cloud-based ETL systems for Vanguard analytics platforms.


Core Responsibilities

  • Build & maintain ETL / ELT pipelines
  • Work on data ingestion from sources like GitHub, Jira, APIs
  • Develop data lake / warehouse solutions
  • Handle batch + real-time data processing
  • Collaborate with data science / analytics teams
  • Ensure data quality, transformation, and optimization

Typical work includes transforming raw data into analytics-ready datasets.


Required Skills

  • Strong in Python / Scala / SQL
  • Hands-on with Big Data stack: Hadoop, Spark, Kafka
  • Cloud experience (AWS S3, Lambda, Glue, EventBridge)
  • Data warehousing / lake concepts
  • Experience with distributed syste
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10299481
  • Position Id: 9035908
  • Posted 10 hours ago
Contact the job poster
Kishan Mishra

Kishan Mishra

IT Lead Recruiter @ McKinsol Consulting Inc
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Malvern, Pennsylvania

7d ago

Easy Apply

Full-time

110,000 - 120,000

Burlington, New Jersey

Today

Contract

USD 100,000.00 - 110,000.00 per year

Remote

Yesterday

Easy Apply

Contract, Third Party

Depends on Experience

Pennsylvania

Today

Full-time

USD39 - USD44

Search all similar jobs