hadoop big data spark engineer Jobs

Refine Results
41 - 60 of 1,346 Jobs

Lead Software Engineer - Big Data Infrastructure

Disney Entertainment

San Francisco, California, USA

Full-time

Disney Entertainment & ESPN Product & Technology On any given day at Disney Entertainment & ESPN Product & Technology (DEEP&T), we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched en

Senior Engineer, Big Data

Molina Healthcare

Long Beach, California, USA

Full-time

Job Description Job Description Job Summary Responsible for all the aspects of architecture, design and implementation of Data Management solution using Big Data platform on Cloudera or Hortonworks and other areas of enterprise application platforms. Knowledge/Skills/Abilities Convert concepts to technical architecture, design and implementation Provide guidance on choosing ideal Architecture, Evaluating tools and Frameworks, define Standards & Best Practices for implementing scalable business

SQL Server / Big Data - Software Engineer 3

Genesis10

Texas, USA

Full-time

Genesis10 is currently seeking a SQL Server / Big Data Engineer with our client in the financial Industry located in Irving, TX. This is a 24+ month contract position. Responsibilities: Develop and optimize complex SQL Server queries based on business requirements Support and enhance an existing data framework using SQL Server Apply knowledge of the Hadoop ecosystem to inform decisions around data structure, architecture, and scalability (hands-on experience not required, but must understand the

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) Responsibilities : Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala). Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable. Stay cu

Sr Big Data Engineer

Anblicks

Irving, Texas, USA

Full-time

Must be local to TX Core Skills: Python, Pyspark, Distributed data processing & CI/CD skills- Gen AI exposure is plus Roles and responsibilities: Proficiency in Python, SQL, and AI/ML frameworks (Transformers, LangChain, OpenAI, Hugging Face, PyTorch, TensorFlow).Strong understanding of AI cost optimization strategies, including serverless inference, model distillation, quantization, and GPU efficiency tuning.Experience deploying AI models in cloud environments (AWS, Azure, Google Cloud Platform

Sr. Bigdata Engineer - Fulltime Only

CitiusTech

Remote

Full-time

Job Description Sr. Bigdata Engineer Who we are: - At CitiusTech, we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140 organizations through next-generation technologies, solutions, and products. We aim to accelerate the transition to a human-first, sustainable, and

Engineer, Big Data - Databricks/Python/SQL/Power BI - Remote

Molina Healthcare

Remote or Long Beach, California, USA

Full-time

Job Description Job Description Job Summary Responsible for collecting, storing, processing, and analyzing large sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. He/she will also be responsible to follow architecture and best practices used across the enterprise. Knowledge/Skills/Abilities Define ideal Architecture, Evaluating tools and Frameworks, Standards & Best Practices for implementing sc

Senior Big Data Engineer

ProHire Solution

Remote

Full-time

Job Location: 100% remote (USA or Canada) Job Summary: We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and bui

Senior Software Engineer (Big Data)

Mastercard

Arlington, Virginia, USA

Full-time

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest po

763232 - Agentic Data Engineer

App Maisters

Richmond, Virginia, USA

Contract

Role : Agentic Data Engineer Location: Richmond, VA (Hybrid) Need candidate within 2hrs drivable distance Interview Mode: Both Phone and In Person Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems.

Big Data Engineer (F2F interview)

CoppelTech

Massachusetts, USA

Contract, Third Party

Big Data Engineer (Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda is a must) Location: Boston, MA (locals only) F2F interview. No h1 B Share DL, Visa and LinkedIn Responsibilities: Design and implement production big data environments using modern technologies. Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments. Develop and manage ETLs in batch (Spark and Scala), and streaming (Apache Flink). To be su

VDOT - Agentic Data Engineer

Cyber Resource Provider LLC

Remote or Richmond, Virginia, USA

Full-time, Part-time, Contract, Third Party

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction bet

Data Engineer

Horizontal Talent

Seattle, Washington, USA

Contract

*Candidates must complete a background check upon offer* KEY PERFORMANCE AREAS Design, implement and support an analytical data infrastructure. Managing AWS resources including EC2, EMR, S3, Glue, Redshift, etc. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies. Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency. Collaborate with Product Manage

Big Data Engineer

Resource Informatics Group

Malvern, Pennsylvania, USA

Contract

Hi Hope you are doing well,Big Data Engineer Malvern PA (Locals)Job Description: Responsibilities Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year. The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy. As an Engineer on the full

Big Data Engineer

Resource Informatics Group

Malvern, Pennsylvania, USA

Contract

Big Data Engineer Location: Malvern, PA (3 days onsite) - LOCAL CANDIDATES ONLY Duration: 1 year Responsibilities: Client's Trading Analytics and Strategy (TAS) team collaborates with global trading desks to optimize trading strategies, saving millions of dollars for clients annually. The team partners with traders and portfolio managers across various asset classes and mandates, both passive and active, to conduct data-driven analyses and develop tools that shape trading strategies. As a Full S

Big Data Engineer

Cymertek Corporation

Reston, Virginia, USA

Full-time

Big Data Engineer LOCATION Reston, VA 20190 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with cr

Big Data Engineer

Cymertek Corporation

Honolulu, Hawaii, USA

Full-time

Big Data Engineer LOCATION Honolulu, HI 96815 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with

Big Data Engineer

Cymertek Corporation

Annapolis, Maryland, USA

Full-time

Big Data Engineer LOCATION Annapolis Junction, MD 20701 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work clo

Big Data Engineer

Cymertek Corporation

Georgia, USA

Full-time

Big Data Engineer LOCATION Fort Eisenhower, GA 30905 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closel

Big Data Engineer

Cymertek Corporation

Tysons, Virginia, USA

Full-time

Big Data Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with cr