Hadoop Data Engineer

Irvine, CA, US • Posted 1 day ago • Updated 1 day ago
Contract Independent
Contract W2
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

  • hadoop
  • spark
  • hive
  • etl
  • sql

Summary

Roles and Responsibilities:

  • Develop, implement, and design data pipelines and ETL processes to efficiently ingest, transform, and load large volumes of data.
  • Collaborate with cross-functional teams to gain insights into data requirements and devise scalable solutions for data storage, processing, and retrieval.
  • Fine-tune and optimize data processes to ensure exceptional performance, reliability, and data integrity.
  • Utilize PySpark, Spark, Hadoop, to build robust data solutions.
  • Keep abreast of the latest industry best practices and emerging technologies in data engineering.
  • Address and troubleshoot issues related to data pipelines and processing.
  • Participate actively in code reviews and offer constructive feedback to enhance code quality.

Qualifications:

  • Strong experience with Hadoop and its ecosystem tools such as Spark, Kafka, Hive, and Sqoop
  • Proficiency in SQL for data analysis, querying, and performance optimization
  • Hands-on experience with Unix/Linux environments
  • Programming experience in Scala and Python for data processing and pipeline development
  • Experience working with large-scale datasets and distributed data processing frameworks
  • Good understanding of ETL processes, data pipelines, and big data architecture
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX1cc9fd
  • Position Id: 8908856
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Long Beach, California

Today

Full-time

Hybrid in Los Angeles, California

5d ago

Easy Apply

Contract

60 - 80

Remote

7d ago

Easy Apply

Third Party, Contract

50 - 55

Los Angeles, California

8d ago

Easy Apply

Contract, Third Party

$50 - $60

Search all similar jobs