Big Data Engineer

  • Phoenix, AZ
  • Posted 60+ days ago | Updated 12 days ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

Big Data
Apache Spark
Pyspark
Hadoop
Scala
AWS/GCP

Job Details

  • 6-8 years of big data technologies or data platform architecture experience with deep technology expertise in the following:
    • Spark, Python/Pyspark, Hadoop, Hive, Scala
  • Experience in service architecture and development experience with high performance and scalability
  • Experience in Spark, SQL performance tuning and optimization
  • Design and development of large-scale data platforms and data application
  • Expertise in design and management of complex data structures and data processes like ETL/ELT
  • Deep understanding of issues in multiple areas such as data acquisition and processing, data management, distributed processing, and high availability is required.
  • Knowledge/Familiarity with AWS/Google Cloud Platform