Big data jobs | Dice.com

Bentonville, Arkansas

•

Today

Job Title: Technology Lead | Big Data - Data Processing | Spark Work Location: BentonvilleAR72712 Job Details: Must Have Skills Google Cloud Platform Spark Java Nice to have skills Airflow Spark Detailed Job Description Technically strong candidate with expertise in Java, Spark, Google Cloud Platform and Airflow. Client facing role in Bentonville, Arkansas. Agile delivery experience required. Client interview mandatory as this is an Onsite role Minimum years of experience 5-8 years

Easy Apply

Contract

$30 - $40

Sr. Big Data Engineer

Dearborn, Michigan

•

Today

Akkodis is seeking a Sr. Big Data Engineer for a Contract with a client in Dearborn, MI (Hybrid). You willdevelop and maintain real-time data pipelines and backend APIs that support connected vehicle and fleet management platforms. Rate Range: $55/Hour to $65/Hour; The rate may be negotiable based on experience, education, geographic location, and other factors. Sr. Big Data Engineer Responsibilities include: Design, develop, and maintain scalable backend services and APIs that process high-vo

Easy Apply

Full-time

USD 55.00 - 65.00 per hour

Big Data Architect IT Consultant Master

Washington, District of Columbia

•

Today

Position Title & Code: Big Data Architect IT Consultant Master Location: Washington DC 20003 Project End Date: 12/31/2026 (With Possible extension to next fiscal year) Responsibilities: Coordinates IT project management, engineering, maintenance, QA, and risk management. Plans, coordinates, and monitors project activities. Develops technical applications to support users. Develops, implements, maintains and enforces documented standards and procedures for the design, development, installati

Easy Apply

Full-time, Contract

Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start

San Jose, California

•

Today

Responsibilities About The Team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for our recommendation system to provide the most stable and best experience for our TikTok users. The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-perform

Full-time

USD 128,000.00 - 316,800.00 per year

Big Data Engineer

Rockville, Maryland

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in the DMV area. We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability of big d

Contract

USD 70.00 - 75.00 per hour

Big Data Developer (Exp-8 Y) with PySpark exp-Full time-Hybrid-F2F

Hybrid in Dallas, Texas

•

Today

Exp6 Years Must have good technical experience and should be able to provide technical solutions for multiple modules in parallel on need basis and bring the task to closure on timeUnix SQL and Shell Scripting experience is a must haveExpertise in Designing and developing scalable Apache spark ETL based Data processing pipelinesStrong commandline knowledge in UnixLinux with Shell scripting using Bash Kornshell or Perl and File processing using awk scriptsExpertise in SQL querying and complex joi

Easy Apply

Full-time

Depends on Experience

Big Data Architect IT Consultant Master with Min 16yrs exp (In Person interview)(ONSITE_only local to DMV Area)

Washington, District of Columbia

•

Today

We are looking for a Big Data Architect IT Consultant Master (Min 16+ Yrs. Exp) ONSITE (In Person Interview). POSITION DESCRIPTION DIRECT CLIENT Position Number of positions:1 Length: 12 Months+ Work Address: Washington DC 20003 Immediate interviews In Person Interview Please Note this position is ONSITE seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Data Modernization Effort. This role will

Easy Apply

Full-time, Third Party, Contract

$DOE

Big Data Developer

Hybrid in Irvine, California

•

7d ago

OverviewWe are seeking a skilled Big Data Developer with expertise in building scalable data pipelines and processing large datasets. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and data engineering best practices. Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines.Process and transform large volumes of structured and unstructured data.Develop data ingestion, ETL, and batch/streaming solutions.Optimize data processing perf

Easy Apply

Full-time

Depends on Experience

Big data Developer

Tampa, Florida

•

Yesterday

Job Title: Big data Developer Location: Jersey City, NJ / Tampa, FL/Onsite Position Type: Full time/Permanent role Job Description Must Have Technical/Functional Skills 1. Strong experience in Kafka, Spark, Scala, SQL ,Hive, Impala, Hadoop, Splunk, Autosys . 3. Data Analysis and Data Wrangling skills when dealing with Huge Volume. 4. Performance analysis, troubleshooting, and resolution including Cloudera Big Data eco system. 5. Experience with Linux-based infrastructures. C

Easy Apply

Full-time

Depends on Experience

Big data engineer

Hybrid in Chicago, Illinois

•

15d ago

Big DataEngineer(Azure) Long term Onsite - Dallas,TX and Chicago,IL Client : BCBS Key Skills & Experience: Worked with large and messydatafrom different sources to find useful insights. Builtdataprocesses to clean, organize, and managedata, including handling metadata and tracking dependencies. Good at working with different teams and managing projects effectively. Strong SQL skills with experience using relational databases and writing complex queries. Familiar with tools likeHadoop, Pig, and

Easy Apply

Full-time, Third Party

60 - 65

Big Data Engineer

Hybrid in Reston, Virginia

•

Yesterday

Position Summary The Big Data Engineer will design, develop, and maintain big data ecosystem to support advanced analytics and data-driven decision-making across engineering, procurement, and construction workflows. This role is pivotal in enabling scalable, secure, and efficient data solutions for projects in semiconductor, electric vehicle, advanced materials, and data center sectors. Job Dimensions Supervision Received: Reports to Digital Solutions Lead and works under general direction.Super

Easy Apply

Contract

Depends on Experience

Excellent Opportunity - PySpark Developer in Irving, TX- Fulltime.

Irving, Texas

•

Today

Hi, We are currently looking for a PySpark Developer for a full-time opportunity in Irving, TX with one of our global clients. If you are interested, please reply with your updated resume and let me know a convenient time to discuss the opportunity. Job Title: PySpark Developer Experience: 8- 10 Years Location: Irving, TX- Hybrid Duration: Fulltime Role Overview: Experience with big data processing and distributed computing systems like Spark. Implement ETL pipelines and data transformation

Easy Apply

Full-time

Application Programmer

Mississauga, Ontario

•

8d ago

Application Programmer - Mississauga, ON - Contract - $65-75 Per HRSeeking an experienced professional for a contract position in Mississauga, ON. This role involves developing and optimizing data pipelines for financial data processing. The ideal candidate should have a strong background in backend development and be proficient in high-level programming languages and big data technologies. Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines for financial data processing.Le

Easy Apply

Contract, Third Party

$65 - $75

Application Programmer

Mississauga, Ontario

•

8d ago

Application Programmer - Mississauga, ON- Contract -$65-75 Per HRJoin a dynamic environment in Mississauga, ON, as a Contract Application Programmer. This role focuses on developing and optimizing data pipelines for financial data processing using a range of technologies. The ideal candidate will have experience in software development and big data processing within a TechFin setting. Key ResponsibilitiesDesign and develop scalable data pipelines for processing large-scale financial data.Lead pr

Easy Apply

Third Party, Contract

$65 - $75

Iceberg DBA / Lakehouse Operations Engineer

Remote

•

12d ago

Job Title:Iceberg DBA / Lakehouse Operations Engineer Location:Remote Duration:Long-Term Openings:5 L3 Senior Iceberg DBA:2 positionsL2 Iceberg DBA:3 positionsJob Summary: SeekingIceberg DBA / Lakehouse Operations Engineersto support an enterprise-scale Lakehouse platform and large-scale data modernization initiatives (Hive/Teradata Apache Iceberg). The role focuses on Iceberg table operations, performance tuning, metadata management, production support, and multi-engine query optimization. Req

Easy Apply

Full-time

Depends on Experience

Senior Hadoop Developer with Java

Charlotte, North Carolina

•

14d ago

Responsibilities / Skills List Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.Build and optimize ETL/ELT pipelines using Java, Spark, Hive, and Python.Process and analyze large datasets in distributed environments.Develop high-performance Spark jobs and optimize existing workloads.Create and manage Hive tables, partitions, views, and complex queries.Implement data quality, data validation, and reconciliation frameworks.Perform code reviews and ensure adherence t

Easy Apply

Full-time

100,000 - 115,000

Data Robot AI Platform Consultant

Remote

•

8d ago

Hi, We have a job opportunity with one of our clients for a Data Robot AI Platform Consultant. If interested, please respond back to me with the below-required details or appreciate it if you would be able to refer an ex-colleague/team member/friend looking for similar roles. CardinalIT offers a referral bonus of $500 for each such referral, to show gratitude and appreciation for this gesture. Updated Resume:Expected W2:Availability to start: - Looking forward to seeing your reply. Position: Dat

Easy Apply

Contract

Depends on Experience

Big Data Engineer

No location provided

•

Today

Job Title:- Big Data Engineer Location:- Remote with occasional travel required to Parsippany or Richmond VA Duration:- Contract to hire Job Description Job Responsibilities: Client is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL) - spanning IT and OT - to deliver trustworthy, performant data products that power Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate analytics. You'll engineer batch/CDC/streaming pipelines, mode

Easy Apply

Contract

Google Cloud Platform Data Engineer

Charlotte, North Carolina

•

5d ago

Data Engineer w Google Cloud Platform & SQL The position of Data Engineer II will be on a dynamic and growing team within the Global Risk & Compliance Technology (GRCT) organization at American Express. Exp Required is 4 to 6 only Evaluates data requirements and stories, documents them for seamless integration into existing architectures, and maintains data models to support business needs. Builds and enhances data pipelines and database designs to meet performance, scalability, and security re

Easy Apply

Full-time

40 - 45

Big Data Engineer

Bernards, New Jersey

•

Today

Job Responsibilities: Design and lead end-to-end data integrationPerform performance tuning, diagnose, and resolve complex big data and streaming technical issues.Design and implement scalable solutions across the technology stack, including data processing, database, web services, network, and security layers.Perform integration testing and provide support to QA teams on large-scale projects.Contribute to requirements analysis, project estimation, system design, coding, and testing.Evaluate and

Easy Apply

Third Party, Contract

Depends on Experience