Senior Data Engineer (Python / PySpark / Structured Streaming)

Overview

On Site
Depends on Experience
Contract - Independent
Contract - W2

Skills

Spark
Structured Streaming
PySpark
SQL
Databricks
API Development
Python

Job Details

Direct Client

Two Rounds of Interview

On W2

  • 6+ years in data engineering or similar domain working with large-scale datasets.

  • Proficiency in Python, PySpark, and Structured Streaming.

  • Hands-on experience with Databricks for pipeline development and optimization.

  • Strong SQL skills and ability to write complex, optimized queries across large datasets.

  • Proven ability in API development using Python frameworks.

  • Experience deploying and managing pipelines on AWS and/or Google Cloud Platform cloud platforms.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.