Big data jobs | Dice.com

Honolulu, Hawaii

•

Today

Job ID: 2617910 Location: Honolulu, HI, US Date Posted: 2026-10-14 Category: Information Technology Subcategory: Big Data Engineer Schedule: Full-Time Shift: Day Job Travel: Yes - 10% of the time Minimum Clearance Required: TS.SCI Clearance Level Must Be Able to Obtain: None Potential for Remote Work: ORA_ON_SITE Description We are seeking a Big Data Engineer to design, build, and maintain real-time and near-realtime data ingestion pipelines supporting a mission-critical system and mov

Full-time

USD 120,001.00 - 160,000.00 per year

Apache Spark / Big Data Administrator

Berkeley Heights, New Jersey

•

Today

Job Description 10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.Focuses on cluster health, performance tuning, and production data pipelines.Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes,

Easy Apply

Full-time

$100,000 - $120,000

Big Data Engineer

Rockville, Maryland

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in the DMV or NY/NJ area. Responsibilities : As a Data Engineer on our team, you'll design, develop, and maintain large-scale data processing pipelines using Big Data technologies. In this role, you will: Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Optimize and enhance e

Contract

USD 67.00 - 72.00 per hour

Big Data Engineer

Rockville, Maryland

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in Rockville, MD or Tysons, VA. We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and

Contract

USD 73.00 - 77.00 per hour

Big Data Engineer

Rockville, Maryland

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in the DMV or NY/NJ area. Seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability

Contract

USD 72.00 - 77.00 per hour

Data Scientist (Big Data) III (Contractor)

Philadelphia, Pennsylvania

•

Today

Description Data Scientist (Supply Chain Optimization & Forecasting) Long Term Contract Hybrid Philadelphia, PA Pay: Available on W2 Overview We are seeking an experienced Data Scientist to support a Supply Chain Planning Center of Excellence focused on forecasting, inventory optimization, and advanced analytics. This individual will design and deploy data science and operations research solutions that improve demand planning, inventory performance, and supply chain decision-making across co

Easy Apply

Contract

USD 56.00 - 61.00 per hour

Airflow Architect Big Data Systems

Austin, Texas

•

Today

Job Summary Need an experienced Airflow Architect to design, architect, and lead enterprise-scale data orchestration solutions for modern big data platforms. The ideal candidate will have deep expertise in Apache Airflow, Big Data technologies, cloud-native architectures, and data engineering best practices to build scalable, reliable, and high-performance data pipelines. Key Responsibilities Architect and implement large-scale data orchestration frameworks using Apache Airflow. Design, devel

Easy Apply

Contract

Depends on Experience

Big Data Architect IT Consultant Master

Washington, District of Columbia

•

Today

Position Title & Code: Big Data Architect IT Consultant Master Location: Washington DC 20003 Project End Date: 12/31/2026 (With Possible extension to next fiscal year) Responsibilities: Coordinates IT project management, engineering, maintenance, QA, and risk management. Plans, coordinates, and monitors project activities. Develops technical applications to support users. Develops, implements, maintains and enforces documented standards and procedures for the design, development, installati

Easy Apply

Full-time, Contract

Senior Big Data / Hadoop / Kafka / DevOps Administrator

St. Louis, Missouri

•

13d ago

Senior Big Data / Hadoop / Kafka / DevOps AdministratorLocation: Charlotte NC/ St.Louis, MO Must Have:Hadoop Administration (Cloudera/CDP)Apache Kafka AdministrationAWS Cloud ServicesLinux (RHEL/Rocky Linux)Shell Scripting and PythonJenkins, Git, Ansible, TerraformDocker and KubernetesMonitoring Tools (Grafana, Prometheus, Splunk)Networking, Security, and High Availability ConceptsPerformance Tuning and Capacity PlanningPython, Shell, ELK, KafkaKafka Administration with MSK ExperienceJob Summary

Easy Apply

Full-time

$50 - $52

Big Data Engineer

Rockville, Maryland

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in the DMV area. We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability of big d

Contract

USD 70.00 - 75.00 per hour

Big data Pyspark Developer- Full Time Role- 7+years

Hybrid in Irving, Texas

•

7d ago

Job Title:Big data Pyspark Developer Work Location: Irving, Texas- 3 days Hybrid Duration: Full Time Job Summary Exp 7+ Years Must have good technical experience and should be able to provide technical solutions for multiple modules in parallel on need basis and bring the task to closure on timeUnix SQL and Shell Scripting experience is a must haveExpertise in Designing and developing scalable Apache spark ETL based Data processing pipelinesStrong commandline knowledge in UnixLinux with Shell sc

Easy Apply

Full-time, Third Party

Depends on Experience

Junior Big Data Engineer (AI-Forward)

Tysons, Virginia

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Junior Big Data Engineer (AI-Forward) for a CONTRACT assignment with one of our premier Regulatory clients in the DMV area. We are seeking an early-career Big Data Engineer who works AI-first. This role is for someone 1-2 years into their career who already treats AI tools as a core part of how they build, not an occasional autocomplete, and who has real projects to show for it. You will build and maintain data pipelines alongside s

Contract

USD 58.00 - 63.00 per hour

Airflow Architect – Big Data Systems

Austin, Texas

•

Today

Key Responsibilities Architect and implement large-scale data orchestration frameworks using Apache Airflow. Design, develop, and optimize ETL/ELT pipelines for batch and near real-time processing. Build scalable workflows integrating Hadoop, Spark, Kafka, Databricks, data lakes, and data warehouses. Define Airflow deployment strategies, DAG standards, security, monitoring, and governance. Implement workflow scheduling, dependency management, error handling, retries, alerting, and SLA monit

Easy Apply

Full-time

Depends on Experience

Senior Software Engineer Java/Python Big Data

Rockville, Maryland

•

13d ago

NMK Global Inc.is a global IT Services & Solutions company specializing in IT Staffing, Technology Consulting, Workforce Solutions, and Application Development Services. We help organizations build high-performing technology teams by connecting them with exceptional talent across a wide range of industries. Our expertise, industry knowledge, and consultative approach enable clients to achieve successful business outcomes while helping professionals advance their careers. Job Title: Senior So

Easy Apply

Contract, Third Party

Depends on Experience

Big Data Engineer / Data Platform Engineer

Charlotte, North Carolina

•

Today

Job Title: Big Data Engineer / Data Platform Engineer Location: Jersey City, NJ or Charlotte, NC Duration: Contract - 12 months Pay Range: Jersey City, NJ (Pay Rate: $68.25) Charlotte, NC (Pay Rate: $65.06) Job ID: 410963 About BCforward BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. W

Easy Apply

Contract

$68.00 - $68.25 per hour

Big Data & Agentic AI Workflows || MTV California - 3 days Onsite

Hybrid in Mountain View, California

•

4d ago

Job: Big Data & Agentic AI Workflows Location: MTV California - 3 days Onsite 1.DataEngineering Hands-on experience creating and managingETL/datapipelines Experience designingDataWarehouses andDataMarts Large-scaledataprocessing experience 2. Technical Skills Python scripting Shell scripting SQL SQL-based technical evaluation Hadoop Hive on Spark AWS/ cloud-baseddataengineering experience 3.AI/ LLM Evaluatebasic LLM/AIknowledge and understanding AdvancedAgentic AIor complex LLM questions

Easy Apply

Third Party, Contract

Depends on Experience

Big Data Engineer

Hybrid in Reston, Virginia

•

2d ago

Position Summary The Big Data Engineer will design, develop, and maintain big data ecosystem to support advanced analytics and data-driven decision-making across engineering, procurement, and construction workflows. This role is pivotal in enabling scalable, secure, and efficient data solutions for projects in semiconductor, electric vehicle, advanced materials, and data center sectors. Job Dimensions Supervision Received: Reports to Digital Solutions Lead and works under general direction.Super

Easy Apply

Contract

Depends on Experience

Kafka/Spark Developer

Hybrid in Pittsburgh, Pennsylvania

•

19d ago

Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full Time Work Model: Hybrid onsite and remote Responsibilities Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.Develop Spark applications usi

Easy Apply

Full-time

Depends on Experience

Scala / Apache Spark Developer

Hybrid in Jersey City, New Jersey

•

4d ago

Job Role: Scala / Apache Spark Developer (Onsite or Hybrid or Remote): Hybrid 3 days (Relocation allowed or Not allowed): Need locals either from NY/NJ Contract Duration: 11+ months Interview Mode: In-person at client location Position Overview The ideal candidate will have solid programming skills, experience developing scalable data processing solutions, and the ability to collaborate with technical teams in a fast-paced environment. Key Responsibilities Design, develop, and maintain applicat

Easy Apply

Third Party, Contract

Depends on Experience

Kafka Administrator

St. Louis, Missouri

•

14d ago

Senior Kafka Administrator St. Louis, Missouri or Denver, Colorado The key skills focused on are: Strong Terraform experienceCI/CD expertise (any major toolset/platform is fine)Kafka experience any flavor, preferably with Confluent and Amazon MSK Key Responsibilities: Kafka Administration Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments.Monitor broker health, partitions, replication factors, and consumer lag.Perform capacity planning and cluster scaling activities.M

Easy Apply

Contract, Third Party

Depends on Experience