Apply Now

Big data engineer

• Posted 2 hours ago • Updated 2 hours ago

Contract Corp To Corp

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

workflows
Data Analysis
Big Data
Communication Skills
apache spark
data pipelines
shell script
Scrum Methodology
Scalability
Problem Solving
Software Debugging
Amazon Web Services
Microsoft Azure
Apache Hive
Apache Kafka
Extract Transform Load (ETL)
SQL Databases
Reliability
Data Processing
Scheduling
Project Collaboration
Records Management
Distributed Data Store
Apache Hadoop
Apache Flume
Apache Oozie
Apache Pig
Apache Yarn
Hadoop Distributed File System
MapReduce
Sqoop

Summary

Job Title: Big Data Hadoop Developer
Location: Remote (USA)
Employment Type: Contract

Required Skills

5+ years of experience in Hadoop ecosystem development.
Strong hands-on experience with Apache Hadoop (HDFS, MapReduce, YARN).
Strong knowledge of Hive and writing complex HiveQL queries.
Good understanding of HDFS and distributed data storage.
Experience with SQL and data analysis.
Familiarity with Linux/Unix environments and shell scripting.
Knowledge of Spark is a plus.
Experience working with large-scale data pipelines and ETL processes.
Strong problem-solving and debugging skills.
Excellent communication and collaboration skills.

Responsibilities

Design, develop, and maintain data processing solutions using the Hadoop ecosystem.
Optimize Hadoop jobs for performance and scalability.
Work closely with data engineers, analysts, and cross-functional teams.
Troubleshoot production issues and ensure data pipeline reliability.
Maintain documentation and follow coding best practices.

Preferred Qualifications

Experience working in enterprise big data environments.
Exposure to cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus.
Knowledge of Kafka, Sqoop, or Flume is an added advantage.
Experience with Agile/Scrum methodologies.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90553186
Position Id: 2026-19625
Posted 2 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

PySpark Consultant

Irving, Texas

•

10d ago

Sharing a brief JD as below: 10+ years of relevant experience in Apps Development or systems analysis role with extensive Python and/or big data expertisePython/Pyspark Mastery:Expert-level capability in developing and maintaining complex data processing and analytical solutions usingPython/Pyspark, including advanced scripting and framework development.Big Data Technologies & Platforms:Extensive experience (8+ years) architecting, designing, implementing, and managing solutions within distribu

Easy Apply

Full-time

Depends on Experience

Big Data Engineer

Charlotte, North Carolina

•

Today

Job#: 3040573 Job Description: Big Data Engineer Location: Charlotte, North Carolina (On-site) Role Overview We are seeking a Big Data Developer/Engineer to join a dynamic team. This role involves the end-to-end design and build process of near-real-time and batch data pipelines. The position requires a self-starter who can work with minimal supervision and adapt to new technologies within an Agile development environment. Key Responsibilities Design and build near-real-time and batch data pi

Easy Apply

Full-time

$68 - $73 per hour

Senior Software Engineer, Big Data

Palo Alto, California

•

Today

We offer a hybrid work environment. Most US-based positions can alsobeperformed remotely (any exceptions will be noted in the Minimum Qualifications below.) Our Mission: To actively connect people to their next great opportunity. Who We Are: ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through pa

Full-time

USD 140,000.00 - 200,000.00 per year

Senior Software Engineer, Big Data

Santa Monica, California

•

Today

Full-time

USD 140,000.00 - 200,000.00 per year

Search all similar jobs