Big Data jobs | Dice.com

Software Engineer Java, Search and Big Data

Hybrid in Columbus, Ohio

•

Today

Key ResponsibilitiesAnalyze, design, develop, test, and enhance software applications and systems.Build scalable backend applications using Java and the Spring ecosystem.Develop and maintain RESTful web services.Design and optimize full-text search, indexing, and retrieval capabilities.Contribute to large-scale search architecture and system design.Translate business and technical requirements into scalable, maintainable code.Participate in unit, system, performance, and acceptance testing.Lead

Easy Apply

Full-time

Depends on Experience

Python Developer

Mississauga, Ontario

•

6d ago

Hi Python Developer Mississauga,Canada Fulltime Interview Process (3 Levels): 1. L1 Altimetrik Internal Panel (Teams/Zoom) 2. Karat Interview 3. Discussion with Project Team (Teams/Zoom) Python (core & Advance preferable), Pyspark (Advanced Level)- Data processing, Engineering, ETL Development(using Oracle, mongo, Hive), Advanced Optimization Techniques for processing Large volume of data. Pandas - Advanced level, Numpy - Intermediate Level SQL/Oracle - Advanced Level spark - Advanced level H

Easy Apply

Full-time

120,000+

Kafka/Spark Developer

Hybrid in Pittsburgh, Pennsylvania

•

8d ago

Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full Time Work Model: Hybrid onsite and remote Responsibilities Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.Develop Spark applications usi

Easy Apply

Full-time

Depends on Experience

Kafka Administrator

St. Louis, Missouri

•

3d ago

Senior Kafka Administrator St. Louis, Missouri or Denver, Colorado The key skills focused on are: Strong Terraform experienceCI/CD expertise (any major toolset/platform is fine)Kafka experience any flavor, preferably with Confluent and Amazon MSK Key Responsibilities: Kafka Administration Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments.Monitor broker health, partitions, replication factors, and consumer lag.Perform capacity planning and cluster scaling activities.M

Easy Apply

Contract, Third Party

Depends on Experience

Data Analyst

Hybrid in Toronto, Ontario

•

Today

Working with the Project teams, business stakeholders, technical SMEs, Data Insights on a growing portfolio of interactive dashboards across many product teams Create new datasets and sophisticated dashboards Understand the data and business processes across all applications, all data domains Advocate best practices for development across our teams Must Have Expert in SQL, Hadoop, Big Data, Hive, NiFi Strong experience in Azure Data Services analysis, BI Analysis Ability to analyse the con

Easy Apply

Contract

Depends on Experience

Data Engineers with Lumi

Hybrid in Phoenix, Arizona

•

7d ago

Data Engineers with Lumi Long term contract Phoenix, AZ (F2F interview is mandatory) Direct client - Immediate client interview We are looking for 2 highly skilled Data Engineer with a solid experience of building Bigdata, Google Cloud Platform Cloud based ETL Pipelines and Spark applications, strong problem-solving skills, articulate communications, and a collaborative mindset.Highly prefer AXP LUMI experience. Hands-on software development experience with Big Data & Analytics solutions like

Easy Apply

Contract, Third Party

Depends on Experience

Bus Systems Analyst Lead

Remote

•

8d ago

Position Title: Business Systems Analyst Lead Location: Remote Industry background: Banking Big Data Sensitive PII requirements (all a plus) Team Dynamic: Part of sub team of 4 individuals under one lead. Roles and Responsibilities: Code review of business analytics work. Must Have Technical Skills: 2+ years of Python development - ability to review code created in the Python environment 5+ years experience writing SQL for Business Analytics projects Documentation Skills Enthusiasm fo

Easy Apply

Contract

Depends on Experience

Cloudera Public Cloud Platform Engineer

Remote

•

16d ago

Job Title: Cloudera Public Cloud Platform Engineer Location: RemoteDuration: 12+ Months Openings:5 L3 Senior Cloudera Platform Engineer 2L2 Cloudera Platform Engineer 3Job Summary: SeekingCloudera Public Cloud Platform Engineersto support enterprise-scale CDP environments across data, analytics, AI/ML, NiFi, Kafka, and observability. The role focuses on platform reliability, performance, security, monitoring, troubleshooting, and cloud modernization. Required Skills L3: 12+ years in Big Dat

Easy Apply

Full-time

Depends on Experience

Big Data Engineer

No location provided

•

Today

Job Title:- Big Data Engineer Location:- Remote with occasional travel required to Parsippany or Richmond VA Duration:- Contract to hire Job Description Job Responsibilities: Client is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL) - spanning IT and OT - to deliver trustworthy, performant data products that power Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate analytics. You'll engineer batch/CDC/streaming pipelines, mode

Easy Apply

Contract

Big Data Engineer

Bernards, New Jersey

•

Today

Job Responsibilities: Design and lead end-to-end data integrationPerform performance tuning, diagnose, and resolve complex big data and streaming technical issues.Design and implement scalable solutions across the technology stack, including data processing, database, web services, network, and security layers.Perform integration testing and provide support to QA teams on large-scale projects.Contribute to requirements analysis, project estimation, system design, coding, and testing.Evaluate and

Easy Apply

Contract, Third Party

Depends on Experience

Business Systems Analyst Lead

Remote

•

8d ago

Position Title: Business Systems Analyst Lead Location: Remote Work Status : Remote Duration : Contract to Hire Years Of Experience Required : 5 + Years Industry Background: Banking Big Data Sensitive PII requirements Function of the Group: Mitigating Risk Roles and Responsibilities: Code review of business analytics work. Must Have Technical Skills: 2+ years of Python development - ability to review code created in the Python environment 5+ years experience writing SQL for Business An

Easy Apply

Contract

Depends on Experience

Senior Data Engineer

Remote

•

Yesterday

What You Will Do: Assist in building a world-class Big Data platform which will give us power to process streams of data , as well as, enable machine learning and advanced analytics capabilities. Everything cloud-based for scalability and speed to market. Handle large volumes of data and integrate our platform with a range of internal and external systems. Understand new tech and how it can be applied to data management. Work with an agile team alongside business, testers, architects and project

Easy Apply

Contract

Depends on Experience

Senior Data Engineer with Databricks Exp. - 100% Remote

Remote or Arkansas

•

Today

Job Title: Senior Databricks Engineer Location: 100% Remote Interview Process: Video (2 Rounds) Job Description: Job Description Lead/Senior Databricks Data Engineer Position: Lead Databricks Data Engineer / Databricks Architect Experience: 10+ Years Location: Remote Job Summary We are looking for an experienced Lead Databricks Data Engineer / Databricks Architect with 10+ years of overall experience in Data Engineering and strong hands-on expertise in Databricks, Apache Spark, PySpark, SQ

Contract

Big Data Architect IT Consultant Master

Remote

•

Today

Job Description: Short Description: The DC Client seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort. Complete Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart Cit

Full-time

USD 75.00 - 80.00 per hour

Big Data Analyst

Springfield, Virginia

•

Today

Reinventing Geospatial (RGi) is a leading expert in geospatial solutions for Defense, Intelligence, and Federal clients. We enhance situational awareness for soldiers and analysts by integrating software development with geospatial intelligence. Our projects range from data collection to advanced deep learning, leveraging tools like Python, Java, and ArcGIS. We don't just fill roles we build teams of high performers and leaders who make an immediate impact. At our core, we're driven by innovati

Full-time

USD 130,000.00 - 190,000.00 per year

Big Data Engineer

Irvine, California

•

Today

ABOUT US: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world's top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people's lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the

Full-time

USD 100,000.00 - 120,000.00 per year

Sr Software Engineer - Big Data

Reston, Virginia

•

Today

Verisign helps enable the security, stability, and resiliency of the internet. We are a trusted provider of internet infrastructure services for the networked world and deliver unmatched performance in domain name system (DNS) services. We are a mission focused, values driven company where each individual can contribute to building a stronger, more secure internet. We offer a dynamic and flexible work environment with competitive benefits and the ability to grow your career. Verisign is looking

Full-time

USD 164,300.00 - 222,300.00 per year

Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start

San Jose, California

•

Today

Responsibilities About The Team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for our recommendation system to provide the most stable and best experience for our TikTok users. The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-perform

Full-time

USD 128,000.00 - 316,800.00 per year

Data Scientist II - Big Data R&D, Identity Graph & Deceased Monitoring

San Francisco, California

•

Today

Why Socure? Socure is building the identity trust infrastructure for the digital economy - verifying 100% of good identities in real time and stopping fraud before it starts. The mission is big, the problems are complex, and the impact is felt by businesses, governments, and millions of people every day. We hire people who want that level of responsibility. People who move fast, think critically, act like owners, and care deeply about solving customer problems with precision. If you want predi

Full-time

USD 140,000.00 - 170,000.00 per year

Big Data Engineer

Lansing, Michigan

•

Today

Benefits: ONSITE Competitive salary Opportunity for advancement Big Data Engineer Location: Chicago, IL (Day 1 Onsite) Hybrid Job Type: Contract / Full Time Experience: 8+ yrs Duration: Long Term We are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will have strong hands-on expertise in the Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with experience building scalable data pipelines and

Full-time

USD 110,000.00 - 125,000.00 per year