San Francisco, California
•
Today
Position: Spark job migration specialist SFO, CA A Spark job migration specialist migrates data pipelines, JAR tasks, and analytics workloads from legacy systems (like Hadoop/CDH or AWS EMR) to ACOS modern platforms This involves refactoring code (e.g., Hive to PySpark), performance testing, and updating Spark 2.x to 3.x. Key Job Responsibilities Workload Migration: Migrate JVM workloads and Spark-Submit tasks to Databricks JAR tasks or Notebook tasks.Pipeline Re-engineering: Convert existing Hi
Easy Apply
Contract
Depends on Experience


















