Overview
On Site
Hybrid
$50 - $60
Contract - W2
Contract - 12 Month(s)
Skills
Data Modeling
Data Manipulation
Tableau
NoSQL
Big Data
Amazon Web Services
Python
Apache Hive
Apache Spark
Pandas
Extract
Transform
Load
Data Visualization
API
Unit Testing
SQL
Job Details
Role: Big Data Engineer
Location: Malvern, PA (3 days onsite Local Candidates Only)
Duration: 1 Year
Experience: 10+ Years
Qualifications:
- Strong Python programming skills
- Expertise in SQL, Presto, HIVE, Spark, and PySpark
- Familiarity with trading and investment data
- Proficient in data manipulation libraries: Pandas, Polars, NumPy
- Experience with ETL, data pipelines, and warehousing concepts
- Hands-on experience with API development
- Strong unit testing skills with a TDD approach
- Deep experience with AWS services: EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS, DynamoDB, Timeseries DB, CloudWatch, Athena, SNS, SQS, and VPC
- Proficiency with serverless architecture on AWS
- Solid background in both relational and NoSQL databases
- Skilled in data modeling and warehousing (Redshift)
- Strong analytical and troubleshooting skills
- Familiar with version control, CI/CD, and code quality best practices
- Strong communication skills
- Experience with Tableau or similar data visualization tools
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.