Hadoop Big Data Spark Engineer Jobs

Refine Results
361 - 380 of 1,352 Jobs

SQL Server / QA - Software Engineer 3

Genesis10

Texas, USA

Full-time

Genesis10 is currently seeking a SQL Server / QA Engineer with our client in the financial Industry located in Irving, TX. This is a 24+ month contract position. Responsibilities: Develop complex SQL Server queries from business requirements to support data frameworks Optimize database queries and performance tuning within the SQL Server environment Conduct QA testing and data validation using Selenium and other automation tools Perform data modeling, mapping, integration, and capacity planning

Senior Data Engineer

Thinking Minds Inc.

Reston, Virginia, USA

Full-time

Job Summary Location: Reston VA Experience: Minimum 7 years in data engineering Job Type: Permanent Ideal Candidate Should Have Expertise in Databricks on AWS, including Delta Lake, Databricks SQL, and Databricks Workflows. Proficiency in Python, Java, or Scala for data processing and pipeline development. Experience with Apache Spark, Hadoop, or similar big data processing frameworks. Strong understanding of ETL tools (e.g., Fivetran, Apache Airflow, MuleSoft). Hands-on experience with

Software Engineer

UBS AG - Investment Banking

Raleigh, North Carolina, USA

Full-time

Your role Software Engineer - UBS Business Solutions US LLC - Morrisville, NC: Design and develop large-scale data models and data pipelines leveraging Apache Spark, Scala, Pyspark on Cloudera Hadoop big data environment and Azure cloud. Build and maintain data pipelines and ETL workflows using Spark Core, Spark SQL, and Spark Streaming. Implement data processing solutions utilizing Hive, Impala, and Sqoop on Hadoop Distributed File System (HDFS). Optimize data storage and retrieval using vario

Senior Data Engineer (Python, AWS, Python BDD Frameworks)

Capital One

Richmond, Virginia, USA

Full-time

Senior Data Engineer (Python, AWS, Python BDD Frameworks) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital O

Senior Data Engineer (Python, AWS, Python BDD Frameworks)

Capital One

Plano, Texas, USA

Full-time

Senior Data Engineer (Python, AWS, Python BDD Frameworks) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital O

Senior Data Engineer (Python, AWS, Python BDD Frameworks)

Capital One

McLean, Virginia, USA

Full-time

Senior Data Engineer (Python, AWS, Python BDD Frameworks) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital O

Senior Manager, Data Engineering

Capital One

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data En

Data Engineer - USDS (Multiple Positions)

TikTok

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A239672 Apply to this job Share this listing: Responsibilities About TikTok U.S. Data Security TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U

Back End Software Developer

QinetiQ US

Chantilly, Virginia, USA

Full-time

Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial intelligence (AI), machine learning (ML), and augmented reality (AR). QinetiQ US's dedicated experts in defense, aerospace, security, and related fields a

Site Reliability Engineer, Data Platform- USDS

TikTok

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Regular Job Code : AJP Apply to this job Share this listing: Responsibilities Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed services and infrastructures. As a site reliability engineer in the data platform area, you will have the opportunity to manage the services and infrastructures in one of the largest data plaforms in the world. You'll need to ensure the data, servic

Senior Manager, Data Engineering

Capital One

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data En

Solution Architect, Senior Principal

Gainwell Technologies LLC

Denver, Colorado, USA

Full-time

Be part of a team that unleashes the power of leading-edge technologies to help improve the health and well-being of those most vulnerable in our country and communities. Working at Gainwell carries its rewards. You'll have an incredible opportunity to grow your career in a company that values work flexibility, learning, and career development. You'll add to your technical credentials and certifications while enjoying a generous, flexible vacation policy and educational assistance. We also have

Senior Data Engineer (Python, SQL, AWS) - FS Partnerships

Capital One

Plano, Texas, USA

Full-time

Senior Data Engineer (Python, SQL, AWS) - FS Partnerships Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital O

Senior Google Cloud Platform Data Engineer

American IT Systems

Sunnyvale, California, USA

Contract, Third Party

Role : Senior Google Cloud Platform Data Engineer Bentonville AR / Sunnyvale, CA- hybrid (3-days onsite , 2 days remote) Long Term Contract Google Cloud Platform Experience 4+ years of recent Google Cloud Platform experience Experience building data pipelines in Google Cloud Platform Google Cloud Platform Dataproc, GCS & BIGQuery experience Google Cloud Platform, Python, Java, Scala, Jenkins, Kubernetes As a Senior Data Engineer, you will Design and develop big data applications using the late

Senior Data Engineer

Disney Entertainment

Santa Monica, California, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Lead Data Engineer

Disney Entertainment

New York, New York, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Senior Data Engineer

Disney Entertainment

New York, New York, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Lead Data Engineer

Disney Entertainment

Seattle, Washington, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Lead Data Engineer

Disney Entertainment

Santa Monica, California, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Senior Data Engineer

Disney Entertainment

Seattle, Washington, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe