Apache Spark Jobs in San Jose, CA

Refine Results
1 - 20 of 576 Jobs

ADB Technical Lead Azure Databricks / Python / Spark Streaming

Unicorn Technologies LLC

Pleasanton, California, USA

Third Party, Contract

Hi,Hope you are doing well. Job Title: ADB Technical Lead Azure Databricks / Python / Spark StreamingLocation: Pleasanton, CAJob Type: Contracting Department: Data Engineering / Cloud Analytics About the Role: We are seeking a hands-on and technically strong Azure Databricks (ADB) Technical Lead to architect and drive the development of large-scale batch and streaming data pipelines on Azure Cloud. This role requires expertise in Python, Databricks Notebooks, Apache Spark (including Structured

Lead Apache Spark Developer

Everest Global Solutions

Remote

Full-time

Role: Lead Apache Spark Developer Location: Remote Duration: long term Contract: C2C Required experience: 10+ years Job Summary: We are looking for a skilled Apache Spark Developer to join our Big Data team. The ideal candidate will have hands-on experience in building scalable and efficient data processing pipelines using Spark and related big data technologies. Key Responsibilities: Design, develop, and optimize large-scale data processing pipelines using Apache Spark.Work with big data platfo

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur

Java Spark Developer - AVP

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Data Architect V

Aditi Consulting

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d

Databricks Data Engineer - Only on W2 OR H1 transfer

XFORIA Inc

San Jose, California, USA

Contract

Role: Databricks Data EngineerLocation: San Jose, CA - Hybrid Overview: We are seeking a highly skilled Data Engineer with strong expertise in Databricks to lead the design and execution of scalable data pipelines and architectures. This role sits at the intersection of Customer Analytics, Master Data Management (MDM), and Generative AI/LLMs. The ideal candidate also brings experience building custom applications, supporting BI integration, reverse ETL workflows, and applying user experience des

Data Engineer III

OSI Engineering, Inc.

Sunnyvale, California, USA

Full-time

A globally leading tech company is seeking a Data Engineer with 6+ years of experience in software development and 3+ years in big data and data warehouse technologies (e.g., Trino, Spark, Snowflake). The role involves data modeling, database optimization, pipeline development, and full-stack integration using Java, Python, and SQL. If you're passionate about building scalable, data-driven solutions, we encourage you to apply! Job Responsibilities: Data Modeling and Database Design: Identifyi

Databricks Admin with AWS

Nityo Infotech Corporation

Menlo Park, California, USA

Third Party, Contract

Responsibilities: Databricks Platform Infrastructure: Design, build, and maintain data infrastructure on the Databricks Platform, including Spark and Databricks SQL.Data Team Enablement: Provide technical expertise and support to Data Scientists, Data Engineers, and Analysts, enabling them to effectively utilize the Databricks platform.Performance Optimization: Optimize Databricks workloads for performance, scalability, and cost efficiency.Infrastructure as Code (IaC): Implement and manage infra

Data Engineer experienced in RETAIL

Emonics LLC

Sunnyvale, California, USA

Contract

Key Responsibilities:Design and develop scalable data pipelines for large-scale processing and transformation. Integrate structured and unstructured data sources from various systems. Build, manage, and optimize data architectures to support business intelligence and analytics. Develop frameworks for data transformation, metadata management, dependencies, and workload orchestration. Collaborate with analysts, data scientists, and product teams to deliver timely and accurate data solutions. Requi

Lead Data Engineer

Exl Service

Fremont, California, USA

Full-time

Hi, We have urgent requirements for our direct client, please go through the below Job Description. If you are interested please send me your updated word format resume to and reach me @ . Role: Lead Data Engineer Location: Fremont, CA (3 days onsite, 2 days work from home) Duration: Full Time Experience range: 12-15 years Job Description: Candidate should Provide technical expertise in needs identification, data modelling, data movement, translating business needs into technical solutions wit

Data Engineer

MARKS IT SOLUTIONS LLC

Sunnyvale, California, USA

Contract

Data EngineerLocation: Sunnyvale CA (Onsite)Need local to CA candidatesClient: WalmartW2 roleResponsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancem

Azure Databriks Developer

Spiceorb

Pleasanton, California, USA

Contract

Hello, SpiceOrb is looking for Azure Databricks Developer and Lead Azure Databricks Job Title: Senior Azure Databricks Developer - Azure Databricks/Python/Spark Streaming Location: Pleasanton, CA (3 Days/Week Onsite) Duration: 12+ Months Contract Department: Data Engineering/Cloud Analytics About the Role: We are looking for a highly skilled Senior Azure Databricks (ADB) Developer to join our Data Engineering team. This role involves developing large-scale batch and streaming data pipelines on

Data Scientist

Caspex Corporation

Mountain View, California, USA

Full-time

Qualifications Solid background in machine learning, deep learning, statistical analysis, and software developmentProficient in data mining, machine learning, and deep learning packages in Python/Tensorflow/KerasExperience working with large data sets and cloud computing (Hive, Spark, Google Cloud Platform, or Azure)Proficient in coding SQL, Python, Java, or JavaScriptAdvanced degree (Master or PhD) in any STEM field plus 4~6 years of related experienceOption 1- Bachelors degree in Statistics, E

Database and Capture Engineer

Vaco by Highspring

Menlo Park, California, USA

Contract

We are seeking an experienced engineer to lead the development of a centralized image capture and data infrastructure supporting next-gen camera validation. This role blends hands-on camera work with backend data engineering to ensure image data is organized, accessible, and scalable across teams. What Youll Do Build and manage image capture workflows in lab environments. Develop infrastructure for automated image upload, tagging, and indexing. Define and enforce metadata standards for consisten

Sr. DevOps/Site Reliability Engineer (SRE)

JKV International

Mountain View, California, USA

Contract

Job Title: Sr. DevOps/Site Reliability Engineer (SRE)Location: Mountain View, CA (Onsite)Position Type: Fulltime | Independent | H1B TransferInterview Process: Final In-Person (F2F) Interview Required About the Role:We are looking for a passionate and experienced Sr. DevOps/Site Reliability Engineer (SRE) to join our dynamic Platform Engineering team. You will work on cutting-edge cloud platforms like Azure, AWS, or Google Cloud Platform, leveraging state-of-the-art CI/CD tools to support modern

Tech Lead Manager - Data Platform

TikTok

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A161570 Apply to this job Share this listing: Responsibilities The Data Platform team works on building data infrastructures and data products to support business engineering teams at TikTok. Responsibilities - Responsible for the construction of offline and real-time data warehouses - In-depth understanding of business and product and reasonably abstract business requirements, work closely with the business team and give full play

Data Scientist

Aziro Technologies LLC

San Jose, California, USA

Contract

We are looking for Data Scientist Position. Below is the Job Description, please have a look and if you are available for this position, please get back to me along with your updated resume in word format with contact number. Job Title: Data Scientist Job location: 100% Onsite (San Jose, CA) Duration: 3+ Months Contract Job Summary: We are seeking a Senior Data Scientist with expertise in AI-driven triage optimization, log analysis, and system migrations to support Client s QA leadership. The go

Data Scientist

Adobe Systems

San Jose, California, USA

Full-time

Our Company Changing the world through digital experiences is what Adobe's all about. We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We're on a mission to hire the very best and are committed to creating exceptional employee experiences wher

Staff Data Scientist, LLMs

Walmart Inc.

Sunnyvale, California, USA

Full-time

Position Summary What you'll do We are looking for our next Staff Data Scientist to bring their experience and help us keep pushing forward as leaders of the next retail disruption! About Team: Our team works closely with our US stores and eCommerce business to better serve customers by empowering team members, stores, and merchants with technological innovation. From groceries and entertainment to sporting goods and crafts, Walmart U.S. offers an extensive selection that our customers value