Pyspark jobs in livermore, ca

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

Fabric Data Engineer

Hybrid in Fremont, California

•

3d ago

**Locals to Fremont needs to apply** Azure Data Engineer Fremont, CA - Hybrid (Locals Only) 12 months Required Experience: 12+ years Key Skills: SQL, Python, Pyspark, Azure, Azure Databricks, Fabric, ADLS/ADF etc. 10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.8+ years of experience in modern data engineering/data warehousing/data lakes technologies on Azure, Data Bricks etc.Solid knowledge of data warehouse best pra

Easy Apply

Contract, Third Party

Depends on Experience

Palantir Foundry Engineer

Remote or Hybrid in Livermore, California

•

3d ago

About GSPANN Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a

Easy Apply

Third Party, Contract

Depends on Experience

15+ Data Engineer with (Palantir Foundry)

Hybrid in Livermore, California

•

9d ago

DataEngineer (Palantir Foundry) Location-Livermore CA (Local CandidatesOnlyfor Onsite/Hybrid work) Job Type-Long Term Contract Tech Stack : SQL, Python, Pyspark. Data Modelling Data Quality System of Records Integration Git Discipline Palantir Foundry, Pipeline Builder, Core Repositories, Ontology Manager, OSDK AI FluencyEach FDE will own a workflow end to end working directly with business users in a forward-deployed model, iterating rapidly on real production data. Model ontology objects and

Easy Apply

Contract, Third Party

Depends on Experience

Senior Data Engineer

Hybrid in San Jose, California

•

24d ago

Senior Data EngineerLocation: San Jose, California, United States Experience: 8 10 Years Job SummaryWe are seeking a Senior Data Engineer with strong expertise in Databricks, AWS, PySpark, and Apache Airflow to build scalable data pipelines and modern data platforms that support analytics and business-critical applications. Required Skills8 10 years of Data Engineering experience.Strong hands-on experience with Databricks, AWS, PySpark, Python, SQL, and Apache Airflow.Experience with Delta Lake,

Easy Apply

Third Party, Contract

$60 - $75

Data Engineer / Analyst

Foster City, California

•

9d ago

Client: Autonomous Vehicle/Tech Title: Data Engineer / Analyst Job Location: Foster City, CA Duration: ~6 Months Pay Rate: $37.24/HR W2 The Pay rate is commensurate with experience and is an estimated range provided by WorkGenius. Data Engineer PSQA Onsite in Foster City, CA | 5 days in office Responsibilities: Design, build, and maintain dashboards and scorecards for PSQA release and quality metrics Query, aggregate, and transform release/version data using SQL and Python Develop ETL pipel

Easy Apply

Contract

Data Scientist, Subscription Analytics

Cupertino, California

•

Today

We're idealists. Inventors. Forever tinkering with products and processes, always on the lookout for better. Whether you work at our global offices, offsite, or even at home, a job at Apple will be demanding. But it also rewards bright, creative thinking and hard work. And none of us here would have it any other way. Does an exciting, dynamic and fast paced environment catch your attention? Do you like puzzles and determining solutions that are not obvious? Terrific! Consider joining us. We are

Full-time

Machine Learning (ML) Data Scientist - ISE Analytics and User Studies, Input Experience

Cupertino, California

•

Today

Apple's Intelligent System Experience (ISE) group builds intelligent software products and experiences on platforms that are used by millions of users around the world every single day. The ISE Data Science team works across products and platforms to translate vast amounts of metrics about software feature usage on iPhone, iPad, and Mac into actionable insights for our leadership in Engineering, Design, and Product Marketing teams. As Apple Intelligence features such as Writing Tools, Smart Repl

Full-time

NewsBreak Venture, AI Growth Intelligence Engineer (New Grad)

Mountain View, California

•

Today

About NewsBreak Founded in 2015, NewsBreak is the Content Intelligence platform shaping the future content economy. With over 40 million monthly active users, our flagship platform delivers highly personalized local news and information powered by advanced AI, recommendation systems, and adtech. Recognized by Fast Company as #32 on the Top Workplaces for Innovators, we're proud to be Great Place to Work certified and home to a dynamic team of technologists, product innovators, and business le

Full-time

USD 135,000.00 - 155,000.00 per year

MTS 1, Software Engineer

San Jose, California

•

Today

At eBay, we're more than a global ecommerce leader - we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the futur

Full-time

Compensation information provided in the description

Staff Applied AI Scientist

Redwood City, California

•

Today

About Poshmark Poshmark is the leading fashion marketplace where style comes alive through discovery, self-expression, and human connection. Powered by a vibrant community of 165 million members, Poshmark brings real people and taste to shopping through a social experience shaped by shared discovery. Buying and selling fashion feels simple, joyful, and personal, while every item tells its own story. Poshmark empowers sellers to grow meaningful businesses, keeps fashion in circulation longer, an

Full-time

USD 192,157.00 - 297,843.00 per year

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Contract, Third Party

Azure Data Architect

Remote

•

4d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

Principal Data Platform Architect

Menlo Park, California

•

Today

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who ra

Full-time

USD 189,000.00 - 248,062.00 per year

Engineering Manager, Data Platform

San Jose, California

•

Today

As Engineering Manager for the Data Platform team, you'll lead a team of engineers building and operating the infrastructure that powers data ingestion, governance, storage, processing, and access across FloQast's product and analytics systems. This is a deeply technical role - roughly half your time is writing code, designing systems, and making architecture calls alongside your team. The other half is growing the people doing that work: hiring, developing, unblocking, and setting direction. Y

Full-time

USD 188,000.00 - 282,000.00 per year

Palantir Forward Deployed Engineer

Remote

•

2d ago

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

Databricks Engineer (W2 only)

Remote

•

2d ago

Role: Databricks Engineer Duration: 6+ months contract Location:100% Remote Position details Required Skills: Proficiency in PySpark and SQL, experience with Medallion architecture, and performance tuning within the Databricks Lakehouse platform. Set up row/column-level security and manage data lineage and sharing in Unity Catalog. Utilize CI/CD and testing processes like Databricks. Utilize CI/CD and testing processes like Databricks. Preferred Skills: SAS, SQL, Unix, Linux Education: Bachel

Easy Apply

Contract

Depends on Experience

System Development Engineer

Remote

•

5d ago

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Sr. Enterprise Data Engineer

Palo Alto, California

•

Today

If you're ready to be part of our legacy of hope and innovation, we encourage you to take the first step and explore our current job openings. Your best is waiting to be discovered. Day - 08 Hour (United States of America) This is a Stanford Health Care job. This role will develop data ingestion processes to the SHC Enterprise Data Platform (Lake), create data pipelines and other solutions, and automate development and operational processes to enable Data Products and solutions that improve th

Full-time

USD 66.52 - 88.14 per hour

Senior Data Product Manager

San Jose, California

•

Today

The Opportunity Adobe Firefly is revolutionizing the world of creative AI, and we want you to be a part of it! As a Senior Data Product Manager, you'll be at the forefront of transforming data into actionable insights for our innovative Firefly platform. This is your chance to work with a world-class team and drive the evolution of one of Adobe's most ambitious products! What you'll do Take ownership of and lead the complete analytics instrumentation process for Firefly on web and mobile platf

Full-time

USD 125,800.00 per year

Pyspark jobs in Livermore, CA, USA