Overview
On Site
Depends on Experience
Contract - W2
Contract - Independent
Skills
Apache Spark
Apache Kafka
Python
PySpark
NiFi
AWS
Job Details
Direct Client
Two Rounds of Interview
On W2
6+ years in data engineering, building production-grade pipelines.
Deep expertise with Apache NiFi for data ingestion, routing, and transformation
Proven experience with Python (3.x) and PySpark for large-scale data processing .
Strong working knowledge of AWS data stack (S3, EMR, Glue, Lambda, RDS/DynamoDB, Athena).
Solid SQL skills and experience with relational or NoSQL databases.
Familiarity with Kafka or similar streaming systems is a plus.
Experience with performance tuning for Spark and pipeline optimization.
Excellent problem-solving, documentation, and teamwork skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.