Lead Spark Scala Engineer

Title: Lead Spark Scala Engineer

Location: Austin, TX (onsite)

Position: Contract

JD:

Lead Spark Scala Engineer

• Strong experience in Apache Spark with Scala

• Experience building and working on Spark application with Scala data frame APIs

• Knowledge of Cloud AWS/S3, Iceberg, Git

• Strong SQL and data modelling skills

• Experience with building/managing application for large scale data platforms – storage, computing aspects, data ingestion/governance and data management and performance.

• Skilled at troubleshooting complex issues in large scale distributed systems.

• Strong understanding of technical concepts

• Should be able to Drive the team’s execution on status reporting, roadmap reviews, quarterly engineering reviews and/or newsletters

• Good understanding of Spark, Scala (big data technology)

• Strong strategic thinking skills

• Strong project management skills

• Strong communication skills

• Able to handle fast paced and ambiguously defined projects with multiple customers and partners

• Familiarity with using a Mac laptop preferred

• Someone who understands and thinks about data and data analytics. Not the “containers” of data (ie, it moves from here to there), but the data inside the containers. What is the meaning of the data in the datasets? How is it transformed? If the data changes, what analytics or metrics would break or would no longer make sense?