Overview
On Site
Depends on Experience
Contract - W2
Contract - Independent
Skills
Spark
Structured Streaming
PySpark
SQL
Databricks
API Development
Python
Job Details
Direct Client
Two Rounds of Interview
On W2
6+ years in data engineering or similar domain working with large-scale datasets.
Proficiency in Python, PySpark, and Structured Streaming.
Hands-on experience with Databricks for pipeline development and optimization.
Strong SQL skills and ability to write complex, optimized queries across large datasets.
Proven ability in API development using Python frameworks.
Experience deploying and managing pipelines on AWS and/or Google Cloud Platform cloud platforms.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.