big data engineer(scala & spark) Jobs

41 - 60 of 201 Jobs

Fullstack Python EngineerJob Title - Fullstack Python Engineer

CDI SolutionsCompany Name - CDI Solutions

•

Charlotte, North Carolina, USA

Contract

Role: Fullstack Python Engineer Location: Charlotte, NC CIC 28262 Qualifications: Experience: o 5+ years working on Apache Spark for big data processing. o 3+ years of Django development experience. o 2+ years of creating and maintaining conda environments. o 4+ years managing containerized environments with OpenShift or Kubernetes Technical Skills: Proficiency in Spark frameworks(Python/PySpark, Scala, or Java) Hands-on experience with OpenShift administration (e.g., cluster setup, netwo

Data Engineer 3- Scala - Chicago, IL or Reston, VA- ONSITE (4 days a week)Job Title - Data Engineer 3- Scala - Chicago, IL or Reston, VA- ONSITE (4 days a week)

Comcast CorpCompany Name - Comcast Corp

•

Chicago, Illinois, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary We are seeking a Data Engineer to design, build, and optimize scalable, high-performance

Staff ML Systems EngineerJob Title - Staff ML Systems Engineer

General MotorsCompany Name - General Motors

•

Austin, Texas, USA

Full-time

Job Description This role is categorized as hybrid. This means the successful candidate is expected to report to offices in Austin, TX, Mountain View, CA or the Greater Seattle Area three times per week, at minimum [or other frequency dictated by the business if more than 3 days]. The Role As an engineer on this team, you will be responsible for building and supporting a petabyte-scale data platform in the cloud and providing powerful foundations for GM ML Data Platform tools, frameworks, and se

BigData DeveloperJob Title - BigData Developer

Innova Solutions, IncCompany Name - Innova Solutions, Inc

•

Addison, Texas, USA

Contract

A client of Innova Solutions is looking for Bigdata Engineer. Position type: Contract Duration: Long Term Location: Addison, TX/Charlotte, NC/Chicago, IL (Hybrid 3 Days Onsite) As a Bigdata Engineer, you will: Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml Experience working with SPARK Structured steaming Experience working with Ha

Data Engineer, Analytics Data EngineeringJob Title - Data Engineer, Analytics Data Engineering

Dropbox IncCompany Name - Dropbox Inc

•

Remote

Full-time

Role Description In this role you will build large, scalable analytics pipelines using modern data technologies. This is not a "maintain existing platform" or "make minor tweaks to current code base" kind of role. We are effectively building from the ground up and plan to leverage the most recent Big Data technologies. If you enjoy building new things without being constrained by technical debt, this is the job for you! Our Engineering Career Framework is viewable by anyone outside the company

Big Data Engineer/Developer, AVP (C12)Job Title - Big Data Engineer/Developer, AVP (C12)

CitiCompany Name - Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

About Citi: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that is systemic

Data Engineer 2Job Title - Data Engineer 2

Kforce Technology StaffingCompany Name - Kforce Technology Staffing

•

Seattle, Washington, USA

Contract

RESPONSIBILITIES: Kforce has an enterprise client that is seeking a Data Engineer 2 in Seattle, WA. Key Job Responsibilities: * Data Engineer 2 will solve data warehousing problems on a massive scale and apply cloud-based services to solve challenging problems around: big data processing, data warehouse design, self-service data access, automated data quality detection and building infrastructure as a code * Be part of the team that focuses on automation and optimization for all areas of DW/ETL

Data Engineer- MapsJob Title - Data Engineer- Maps

Apple, Inc.Company Name - Apple, Inc.

•

No location provided

Full-time

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we Are you ready to take Apple Maps Analytics Platform to next level? We in Maps Analytics Platform team partner closely with Data Scientists, Program Managers and Product Analysts to measure and improve Apple Maps user experience. You will work with some of the most unique and interesting data sets in the world includi

Software Engineer III, Machine Learning Trust and SafetyJob Title - Software Engineer III, Machine Learning Trust and Safety

Match Group, LLCCompany Name - Match Group, LLC

•

Palo Alto, California, USA

Full-time

Our Mission Launched in 2012, Tinder revolutionized how people meet, growing from 1 match to one billion matches in just two years. This rapid growth demonstrates its ability to fulfill a fundamental human need: real connection. Today, the app has been downloaded over 630 million times, leading to over 97 billion matches, serving approximately 50 million users per month in 190 countries and 45+ languages - a scale unmatched by any other app in the category. In 2024, Tinder won four Effie Award

Staff ML Systems EngineerJob Title - Staff ML Systems Engineer

General MotorsCompany Name - General Motors

•

Mountain View, California, USA

Full-time

Sr. Software Engineer, Machine Learning RevenueJob Title - Sr. Software Engineer, Machine Learning Revenue

Match Group, LLCCompany Name - Match Group, LLC

•

Palo Alto, California, USA

Full-time

Staff Software Engineer, Machine LearningJob Title - Staff Software Engineer, Machine Learning

Match Group, LLCCompany Name - Match Group, LLC

•

Palo Alto, California, USA

Full-time

Sr. Software Development Engineer 4Job Title - Sr. Software Development Engineer 4

Adobe SystemsCompany Name - Adobe Systems

•

San Jose, California, USA

Full-time

Our Company Changing the world through digital experiences is what Adobe's all about. We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We're on a mission to hire the very best and are committed to creating exceptional employee experiences wher

Sr. Big Data EngineerJob Title - Sr. Big Data Engineer

AlgebraITCompany Name - AlgebraIT

•

Connecticut, USA

Contract, Third Party

Hi, Hope you are doing well. Below is the Job Description, kindly go through it and please let me know if you are interested. Role:- Sr. Big Data Engineer Location:- Weehawken, NJ (Onsite) Please Note: Strong Banking Domain experience is required & Only Local candidates to NJ/NY. Our Challenge As a Big Data Engineer, candidate will be instrumental in developing and optimizing big data technologies such as Apache Spark and Azure Databricks. Candidate will create robust data pipelines, ensure hi

Software Quality Assurance Engineer, OfficerJob Title - Software Quality Assurance Engineer, Officer

State Street CorporationCompany Name - State Street Corporation

•

Quincy, Massachusetts, USA

Full-time

Who we are looking for The Software Quality Automation Engineer will play a key role in the quality assurance of AML Transaction Monitoring suite of applications. We are looking for someone who has proven experience with testing and automating complex applications. This role will be responsible for defining and maintaining an acceptance testing cycle that is common in an Agile process including automation. Candidate will be expected to attend daily scrum ceremonies and required to attend meetin

ServiceNow DeveloperJob Title - ServiceNow Developer

Judge Group, Inc.Company Name - Judge Group, Inc.

•

Westlake, Texas, USA

Full-time

Location: Westlake, TX Salary: $69.00 USD Hourly - $74.00 USD Hourly Description: Job Title: ServiceNow Developer Location: Westlake, TX Job Type: Contract About the Role As a Senior Software Engineer on this contingent assignment, you will play a critical role in designing and delivering scalable data engineering solutions. You'll consult on complex, high-impact initiatives, contribute to strategic planning, and collaborate with cross-functional teams to solve multifaceted software enginee

Software Engineer Graduate (Data Arch - Data Ecosystem ) - 2025 Start (BS/MS)Job Title - Software Engineer Graduate (Data Arch - Data Ecosystem ) - 2025 Start (BS/MS)

TikTokCompany Name - TikTok

•

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Regular Job Code : A184268 Apply to this job Share this listing: Responsibilities Team Introduction: The TikTok Data Ecosystem Team has the vital role of crafting and implementing a storage solution for offline data in TikTok's recommendation system, which caters to more than a billion users. Their primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. They aim to create a storage and computing infrastr

Software Engineer Graduate (Data Arch - Data Ecosystem ) - 2025 Start (BS/MS)Job Title - Software Engineer Graduate (Data Arch - Data Ecosystem ) - 2025 Start (BS/MS)

TikTokCompany Name - TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A24090 Apply to this job Share this listing: Responsibilities Team Introduction: The TikTok Data Ecosystem Team has the vital role of crafting and implementing a storage solution for offline data in TikTok's recommendation system, which caters to more than a billion users. Their primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. They aim to create a storage and computing infrastr

Data Engineer, Assistant Vice PresidentJob Title - Data Engineer, Assistant Vice President

Deutsche BankCompany Name - Deutsche Bank

•

Cary, North Carolina, USA

Full-time

Job Description: Job Title: Data Engineer Corporate Title: AVP Location: Cary, NC Who We Are In short - an essential part of Deutsche Bank's technology solution, developing applications for key business areas. Our Technologists drive Cloud, Cyber and business technology strategy while transforming it within a robust, hands-on engineering culture. Learning is a key element of our people strategy, and we have a variety of options for you to develop professionally. Our approach to the future of wor

SWE - Sr Software Engineer, Siri User Experience Metrics and DataJob Title - SWE - Sr Software Engineer, Siri User Experience Metrics and Data

Apple, Inc.Company Name - Apple, Inc.

•

No location provided

Full-time

We're looking for a Senior Software Engineer to help build the next generation of large-scale data systems that power high-impact decisions across Siri. In this role, you'll operate at the intersection of engineering excellence and business impact. You'll design and implement scalable, reliable systems to transform raw data into actionable insights for leadership. This is a high-visibility, high-impact position with the opportunity to influence the direction of products and strategy. The Siri Us