Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required
Unable to Provide Sponsorship
Skills
Lambda
Python
PySpark
AWS (Glue
Athena)
Databricks
Job Details
Senior Data Engineers to join us on W2
New Jersey (NJ) or Delaware (DE).
Responsibilities:
- Design, develop, and maintain scalable data pipelines for processing and analyzing large volumes of data
- Implement data integration solutions using Python, PySpark, and AWS services such as Glue, Lambda, and Athena
- Collaborate with cross-functional teams to understand data requirements and deliver solutions to meet business needs
- Optimize data processing and storage for performance and cost efficiency
- Troubleshoot and debug data processing issues and performance bottlenecks
- Stay up-to-date with industry trends and best practices in data engineering
Requirements:
Required Skills:
- Python
- PySpark
- AWS (Glue, Lambda, Athena)
- Databricks
Preferred Skills:
- Experience with data warehousing and ETL processes
- Knowledge of SQL and relational databases
- Experience with big data technologies such as Hadoop and Spark
- Certifications in AWS or Databricks
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.