Python Pyspark Jobs in San Francisco, CA

Refine Results
1 - 20 of 74 Jobs

AWS Data Architect

Talent Glide

•

Remote

Contract

Position - AWS Data ArchitectDuration 12monthLocation - Remote Must skills - AWS Redshift, AWS Glu, AWS Lake formation, PySpark Key Responsibilities: Design and implement end-to-end cloud-native data architectures on AWS.Build and optimize data lakes, data warehouses, and analytics platforms using AWS services.Architect and manage data pipelines with AWS Glue, Apache Airflow, and PySpark.Implement advanced data formats and technologies including Apache Iceberg and Delta Lake.Strong programming s
Easy Apply
Posted 16 hours ago

Azure Databricks Lead

DataAffect

•

Remote

Contract

About DataAffect: We are a boutique data/service management firm specializing in the delivery of Data Governance, Enterprise Data Strategy, Solutions Architecture, Data Warehousing, Data Integrations, Data Security & Privacy Management, IT Service Management, Business analysis (and) Agile Project Management services to diverse clients across multiple industries. Role: Azure Databricks Lead Location: Remote Duration: 6+ months Job Summary We are looking for a results-driven Lead Data Engineer (Co
Easy Apply
Posted 17 hours ago

Google Cloud Platform Data Engineers with PySpark

Oraapps Inc

•

Remote

Contract

Must Haves:3+ years of Google Cloud Platform Engineer workDataprocBigQueryCloud ComposerETL experience - working with large data setsPySparkusing Python to call APIs Nice to haves:Healthcare/Insurance industry
Easy Apply
Posted 1 day ago | Updated moments ago

Lead Palantir Foundry - Remote

Nava Software Solutions

•

Remote or Jersey City, New Jersey, USA

Contract, Third Party

NAVA Software solutions is looking for a Technical Lead, Palantir Foundry Details: Technical Lead, Palantir Foundry-Predictive AI Location: : Remote | Central / East Coast Hours Duration : 12+ months Description: Technical Lead at Client work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate data solutions with external systems containing the data. Key Responsibilities Include: Evaluate and inform Product Owner and other
Easy Apply
Posted 1 day ago | Updated 22 hours ago

Senior Azure Data Engineer - Full time (12+ Years of Exp)

MethodHub

•

San Francisco, California, USA

Full-time

Bisoft is looking for Senior Azure Data Engineer - Full time (12+ Years of Exp) Senior Data Engineer We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing. The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark. Knowledge of Databricks or Synapse is essential. Good to have MS Fabric experience. Responsibilities Design and BuildData Pipelines:
Easy Apply
Posted 5 days ago | Updated 2 days ago

OneTrust Developer

Infojini

•

US

Third Party, Contract

Role: OneTrust Developer Location: Remote-USA Type: Contact C2C/W2 Experience: 9-11 Years Job summary: Looking for SA Level 9-11 years experienced hands-on expert Sr. Developer with experience in Python, Pyspark and Pandaas, SQL, Databricks, Apache Freemarker or Java scripting to quickly pick Freemarker. Experienced in OneTrust application as work involves enhancements/fixes to Workflows, Jobs, Reports, configuration and metadata creations in OneTrust SaaS application Required Skills Technica
Easy Apply
Posted 1 day ago | Updated 18 hours ago

Senior Azure Data Engineer

Purple Drive Technologies LLC

•

San Francisco, California, USA

Full-time

Senior Data Engineer We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing. The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark. Knowledge of Databricks or Synapse is essential. Good to have MS Fabric experience. Responsibilities Design and BuildData Pipelines: Develop and manage modern data pipelines and data streams using Azure Data Data
Easy Apply
Posted 5 days ago | Updated 1 day ago

Data Engineer Manager @ Remote - 12 + Years

SelSoft Inc.

•

Remote

Full-time

Position Summary: We are looking for a skilled Data Engineer Manager with healthcare domain expertise to lead the development of innovative healthcare technology solutions. The ideal candidate will work closely with cross-functional Agile teams to deliver high-impact products that improve patient care, streamline provider workflows, and support compliance with healthcare regulations. Key Responsibilities: Define and prioritize product backlog based on business and user needs.Mandatory experience
Easy Apply
Posted 8 days ago | Updated 8 days ago

Azure Data Engineer Lead

Aptino

•

San Francisco, California, USA

Contract

Job Description:We are seeking a highly skilled Senior Data Engineer with extensive experience in Python, PySpark, SQL, and Microsoft Azure Cloud Services. The ideal candidate will have a strong background in data warehousing, big data technologies, and cloud data engineering, along with a proven ability to lead development teams and drive high-quality project deliverables. Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and SQL. Design, implement, and op
Easy Apply
Posted 33 days ago | Updated 16 hours ago

Data Engineer (Only Local to San Francisco Bay Area)

Peritus Inc.

•

San Francisco, California, USA

Contract

Databricks Spark Scala AWS, Azure or Google Cloud Platform Data Engineering and ETL Pipeline Kafka SQL and NoSQL Python CI/CD Docker and Kubernetes
Easy Apply
Posted 20 days ago

Data Engineer II

Kforce Technology Staffing

•

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer II. This is a 100% remote role, but a local candidate is preferred, if not then PST or CST time zones. Duties: * Data Engineer II will be responsible for developing and translating computer algorithms into prototype code and maintaining, organizing, and identifying trends in large data sets * Develop technical solutions to improve access to data and data usage * Understand data needs and advise company on
Posted 13 days ago | Updated 1 hour ago

Senior Data Engineer Healthcare Domain

TekLeaders, Inc

•

Remote or New York, New York, USA

Full-time, Part-time, Contract, Third Party

Position Details Requirement Creq TBD No of Positions 1 Role Senior Data Engineer Healthcare Domain Client C2H Location NYC, NY (Remote) Type of Hire - Contract/ C2H Rate (Max) W2 OR 1099 Duration Long-Term Number of Interviews L1+HR+Client In person interviews Yes/No No Client Interview Yes/No Yes No of submission (example not more than 3 resumes) 3 submissions Timeline for submission 2 hours Position requirements (Remote/ Hybrid/Fully onsite) Remote Job Description Senior Data Engineer Positio
Easy Apply
Posted 1 day ago | Updated moments ago

Senior Data Engineer

Sensiple Inc.

•

Remote

Contract

Sensiple Inc is a New Jersey corporation with over two decades of expertise in technology-driven solutions specializing in Customer Experience, Contact Center Solutions, Digital Transformation, Cloud Computing & Independent Testing. With an expert team that has enriched experience in executing & developing sustainable IT strategies in Healthcare, Technology, Retail, Logistics, Education, Telecommunications, Government and Media, we help our diverse customers to envision the future. By developing
Easy Apply
Posted 2 days ago | Updated 1 day ago

Java/Google Cloud Platform Engineer

Global Soft Systems

•

Remote or US

Contract

Java/Google Cloud Platform Engineer Remote Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients Java/Google Cloud Platform Engineer - Prime Therapeutics - Remote - Contract to Hire Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients A ton of data coming from a variety of sources (100+) Legacy app built on access and .Net and was never set up for enterprise support o Will be maintaine
Easy Apply
Posted 14 days ago | Updated 7 hours ago

Palantir Foundry Data Engineer

PeakIT

•

Remote

Contract

12 Months+ Key things Python, Pyspark, Palantir Foundry Palantir Found experience a must. Remote Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platformIdentify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater sc
Easy Apply
Posted 6 days ago

Sr. Software Engineer, ML Platform - Slack

Salesforce

•

San Francisco, California, USA

Full-time

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving you
Posted 19 days ago | Updated 4 hours ago

Intern, Software Engineering

LiveRamp

•

San Francisco, California, USA

Full-time

LiveRamp is the leading data connectivity platform. We believe connected data has the power to change the world. Our platform powers insights and experiences centered around the needs of real people, and in ways that keep the Internet open for all. LiveRampers thrive on building together with curiosity and humility-and have a good bit of fun along the way. We're always looking for smart, kind, and creative people to grow our team and impact. Mission: LiveRamp makes it safe and easy for businesse
Posted 18 days ago | Updated 4 hours ago

MLOps Architect (Databricks Specialist)

Amiseq Inc.

•

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know
Easy Apply
Posted 23 days ago | Updated 16 days ago

***Sr. AWS Glue ETL Developer***W2****Remote*****

SmartIMS Inc.

•

Remote

Contract

Title: Sr. AWS Glue ETL Developer Location: Remote Duration: Contract Required skills: Candidate must have bachelor s with 12 years of prior relevant experience or master s with 6-10 years of prior relevant experience Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue. Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing. Coordinate closely with mainframe res
Easy Apply
Posted 14 days ago | Updated 7 days ago

Azure Architect - Data, AI/ML, Cloud Transformation & Security

Milestone Technologies, Inc.

•

Remote

Contract

Azure Architect with extensive Data, AI/ML, Cloud Transformation & Security experience. Initially: Two month W2 Contract (no C2C) 100% remote Estimated rate: $100 - 110/hr. Please review and let me know if you, or someone you know, may be interested in discussing. We are looking for aseasoned Azure Architectwith a robust foundation inData and AI/MLto lead the end-to-end design and implementation ofscalable, secure, and high-performance cloud-native solutions. This role requires a deep understa
Easy Apply
Posted 8 days ago | Updated 20 hours ago