Data Architect (PySpark)

Plano, TX, US • Posted 1 hour ago • Updated 1 hour ago
Full Time
On-site
$140,000 - $160,000/yr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Apache Hadoop
  • Apache Hive
  • Apache Kafka
  • Apache Spark
  • Apache Sqoop
  • Cloudera
  • Extract
  • Transform
  • Load
  • Good Clinical Practice
  • ELT
  • Databricks
  • Python
  • Data Processing

Summary

Job Title - Data Architect (PySpark)
Location - Jersey City, NJ, Plano, TX

Type: Fulltime

Job Description:

Required Skill and Experience

  • Experience in technology consulting, enterprise and solutions architecture and architectural frameworks
    Experience in Cloudera Hadoop ecosystem, i.e. Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL database technologies
    Understanding and knowledge of Hadoop architecture and various components such as high availability architecture, experience in workload management, scalability and distributed platform architecture
    Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting
    Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and micro service architecture

Preferred Skill and Experience

  • Experience in working in any hyperscalers, AWS, Azure, Google Cloud Platform, Databricks and Snowflake
    Experience in data virtualization/data federation for creating data product (e.g. in Starburst) in heterogenous environment (Hadoop, RDBMS, NoSQL etc.)
    Hands-on development mentality, with a willingness to troubleshoot and solve complex problems
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10200946b
  • Position Id: 9094424
  • Posted 1 hour ago
Contact the job poster
VC

Vinish Choudhary

Recruitment Manager @ Nityo Infotech Corporation
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Irving, Texas

Today

Easy Apply

Full-time

Hybrid in Irving, Texas

Today

Easy Apply

Full-time

Depends on Experience

Hybrid in Irving, Texas

20d ago

Easy Apply

Full-time

$80,000 - $100,000

Plano, Texas

Today

Easy Apply

Full-time

$160000 - $210000

Search all similar jobs