Overview
Remote
$160,000 - $180,000
Full Time
Skills
Spark
SCALA
Kafka
Databricks
ETL
Job Details
**No Employer****
**Must have 15 to 20+ years of experience***
Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance.
Job Description
Handson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data Quality, Good understanding of data operations. AWS or Azure cloud. Should have experience with solutioning & consulting (MUST HAVE).
Roles & Responsibilities
Design/develop big data pipelines using Spark (batch/streaming) and other related technology stacks. MUST HAVE experience in solutioning big data systems and consultancy as SME on big data technologies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.