Bigdata + Spark Developer

Big data, Spark, DevOps, RDBMS, TDD
Full Time
Depends on Experience
Work from home available Travel not required

Job Description

Detailed Job Description:

  • At least 5+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python
  • Knowledge of Big Data & Spark with AWS / EMR or Data Proc background will be beneficial
  • At least4 years of experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
  • At least 4 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps
  • At least 2 years of experience with SQL and Shell Scripting experience
  • Experience of designing, building, and deploying production-level data pipelines using tools from Hadoop stack (HDFS, Hive, Spark, HBase, Kafka, NiFi, Oozie, Apache Beam, Apache Airflow etc).
  • Experience with Spark programming (pyspark or scala or java).

 

Mandatory Skills:

  • At least4 years of experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
  • At least 4 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps

 

Good to have Skills:

  • Knowledge of Big Data & Spark with AWS / EMR or Data Proc background will be beneficial
Dice Id : 10115393
Position Id : 7012227
Originally Posted : 5 months ago
Have a Job? Post it

Similar Positions

Big Data Lead
  • Maveric NXT Inc
  • Irving, TX, USA
Sr Big Data Developer
  • Maveric NXT Inc
  • Irving, TX, USA
AWS Spark + Java Developer
  • Kani Solutions
  • Irving, TX, USA
Big Data Engineer, Tech Lead
  • Syeta Inc
  • Irving, TX, USA
Bigdata developer
  • Syeta Inc
  • Irving, TX, USA
Pyspark Lead
  • Maveric NXT Inc
  • Irving, TX, USA
Spark Developer
  • Virtusa Corporation
  • Irving, TX, USA
Pyspark developer
  • Syeta Inc
  • Irving, TX, USA
Bigdata Engineer-FTE
  • Impetus
  • Dallas, TX, USA