Apply Now

Redshift / PySpark Developer

Hybrid in Philadelphia, PA, US • Posted 6 hours ago • Updated 6 hours ago

Contract W2

12 Months

On-site

Depends on Experience

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Amazon Redshift
Amazon S3
Amazon Web Services
Analytical Skill
Apache Spark
Big Data
Cloud Computing
Data Engineering
Data Modeling
Data Processing
Data Quality
Data Warehouse
Distributed Computing
ELT
Electronic Health Record (EHR)
Extract
Transform
Load
Git
Management
Orchestration
Problem Solving
PySpark
Python
SQL
Version Control
Workflow
Scalability
Regulatory Compliance
Query Optimization
Conflict Resolution
Performance Tuning
Continuous Integration

Summary

10+ years of experience in Data Engineering, Big Data, and Cloud Data Warehouse development within enterprise environments.
Strong expertise in Amazon Redshift, PySpark, SQL, and Python for designing, developing, and optimizing scalable data processing solutions.
Develop and maintain high-performance ETL/ELT pipelines using PySpark to process large-scale structured and unstructured datasets.
Design, optimize, and manage Redshift data warehouses, including schema design, query tuning, performance optimization, and data modeling.
Build scalable data ingestion, transformation, and integration pipelines from multiple data sources using AWS cloud services.
Collaborate with business analysts, data scientists, and cross-functional teams to translate business requirements into efficient data engineering solutions.
Ensure data quality, governance, security, and compliance while implementing best practices for monitoring, logging, and troubleshooting data pipelines.
Optimize Spark jobs, Redshift workloads, and SQL queries to improve processing efficiency, scalability, and overall system performance.
Experience with AWS services such as S3, Glue, Lambda, EMR, IAM, and Airflow or other workflow orchestration tools is highly preferred.
Strong understanding of Data Warehousing, ETL/ELT, distributed computing, CI/CD, version control (Git), and Agile methodologies with excellent analytical and problem-solving skills.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90868495
Position Id: 9016084
Posted 6 hours ago

Contact the job poster

Venkata S Murthy

Recruiter @ P2PSoftTek Inc

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Philadelphia, Pennsylvania

•

25d ago

We are seeking an experienced Data Engineer to design, build, and optimize scalable data platforms that support analytics, reporting, and data-driven decision-making across the organization. This role will partner closely with Product, Analytics, Data Science, and Engineering teams to develop reliable, high-performance data solutions and drive best practices in modern data engineering. Key Responsibilities Design and maintain scalable ELT/ETL pipelines using SQL, Python, dbt, and cloud-native te

Easy Apply

Contract, Third Party

Depends on Experience

Senior Data Engineer Role

Hybrid in Malvern, Pennsylvania

•

3d ago

Senior Data Engineer Role Location: Malvern,PA 12 Months+ Contract MUST HAVE 12 YEARS OF IT EXPERIENCE AND QUICK SIGHT EXPERIENCE Senior Data Engineer with 12+ years of experiencedesigning and delivering enterprise-scale data warehousing, ETL/ELT, and cloud-native analytics solutions usingAWS Redshift, S3, Glue, Lambda, Airflow, PySpark, and Python.Strong hands-on expertise with Amazon Redshift, including schema design, distribution keys, sort keys, query optimization, workload management, Redsh

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer Junior

Wilmington, Delaware

•

Today

Location: Wilmington, DE Salary: $50.00 USD Hourly - $60.00 USD Hourly Description: Role: Junior Data Engineer Location: Wilmington, DE (Hybrid - 3 days onsite) Duration: 6+ month contract (with potential extension) Interview Process Round 1: Virtual interview (Zoom) Round 2: In-person interview (for local candidates) Includes a coding/scripting assessment About the Role We are seeking a Junior Data Engineer to support the development and optimization of scalable data pipelines in a clou

Contract

USD 50.00 - 60.00 per hour

Lead Data Enigneer

Hybrid in Malvern, Pennsylvania

•

14d ago

Role:Data Engineer- Lead Location: Malvern, PA (HYBRID) Responsibilities Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for AnalyticsQualifications: 12+ years of experience Python, SQL, AWS Services Strong, hands-on Data Engineers Comfortable working end-to-end (ingestion, transformation, delivery) Hands-on experience with AWS cloud services, including EMR, S3, EC2, Lambda, SNS, Step Functions, Glue, and ECS, for building, orchestrating, and operati

Easy Apply

Full-time

60 - 65

Search all similar jobs

More jobs at P2PSoftTek Inc in Philadelphia, PA