python pyspark Jobs in san francisco, ca

Refine Results
1 - 20 of 73 Jobs

Hiring for Python/Pyspark Developer - Remote

Feuji Inc

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. PYTHON AND PYSPARK Developer Location :: USA- Remote These engineers will require a proficiency specifically in the following areas: Python/Pyspark, Java 17, Hadoop (Hive, Hue, Impala, Hbase), Drools experience, SQL Server 3+ years experience Should you be interested, please send me a copy of your resume in word

Azure Data Engineer Lead

Aptino

San Francisco, California, USA

Contract

Job Description:We are seeking a highly skilled Senior Data Engineer with extensive experience in Python, PySpark, SQL, and Microsoft Azure Cloud Services. The ideal candidate will have a strong background in data warehousing, big data technologies, and cloud data engineering, along with a proven ability to lead development teams and drive high-quality project deliverables. Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and SQL. Design, implement, and op

Senior Azure Data Engineer - Full time (12+ Years of Exp)

MethodHub

San Francisco, California, USA

Full-time

Bisoft is looking for Senior Azure Data Engineer - Full time (12+ Years of Exp) Senior Data Engineer We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing. The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark. Knowledge of Databricks or Synapse is essential. Good to have MS Fabric experience. Responsibilities Design and BuildData Pipelines:

Senior Azure Data Engineer

Purple Drive Technologies LLC

San Francisco, California, USA

Full-time

Senior Data Engineer We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing. The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark. Knowledge of Databricks or Synapse is essential. Good to have MS Fabric experience. Responsibilities Design and BuildData Pipelines: Develop and manage modern data pipelines and data streams using Azure Data Data

Data Engineer (Only Local to San Francisco Bay Area)

Peritus Inc.

San Francisco, California, USA

Contract

Databricks Spark Scala AWS, Azure or Google Cloud Platform Data Engineering and ETL Pipeline Kafka SQL and NoSQL Python CI/CD Docker and Kubernetes

Senior Data Engineer Healthcare Domain

TekLeaders, Inc

Remote or New York, New York, USA

Full-time, Part-time, Contract, Third Party

Position Details Requirement Creq TBD No of Positions 1 Role Senior Data Engineer Healthcare Domain Client C2H Location NYC, NY (Remote) Type of Hire - Contract/ C2H Rate (Max) W2 OR 1099 Duration Long-Term Number of Interviews L1+HR+Client In person interviews Yes/No No Client Interview Yes/No Yes No of submission (example not more than 3 resumes) 3 submissions Timeline for submission 2 hours Position requirements (Remote/ Hybrid/Fully onsite) Remote Job Description Senior Data Engineer Positio

Palantir Foundry Data Engineer

PeakIT

Remote

Contract

12 Months+ Key things Python, Pyspark, Palantir Foundry Palantir Found experience a must. Remote Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platformIdentify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater sc

Intern, Software Engineering

LiveRamp

San Francisco, California, USA

Full-time

LiveRamp is the leading data connectivity platform. We believe connected data has the power to change the world. Our platform powers insights and experiences centered around the needs of real people, and in ways that keep the Internet open for all. LiveRampers thrive on building together with curiosity and humility-and have a good bit of fun along the way. We're always looking for smart, kind, and creative people to grow our team and impact. Mission: LiveRamp makes it safe and easy for businesse

Sr. Software Engineer, ML Platform - Slack

Salesforce

San Francisco, California, USA

Full-time

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving you

Data Engineer II

Kforce Technology Staffing

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer II. This is a 100% remote role, but a local candidate is preferred, if not then PST or CST time zones. Duties: * Data Engineer II will be responsible for developing and translating computer algorithms into prototype code and maintaining, organizing, and identifying trends in large data sets * Develop technical solutions to improve access to data and data usage * Understand data needs and advise company on

Java/Google Cloud Platform Engineer

Global Soft Systems

Remote or US

Contract

Java/Google Cloud Platform Engineer Remote Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients Java/Google Cloud Platform Engineer - Prime Therapeutics - Remote - Contract to Hire Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients A ton of data coming from a variety of sources (100+) Legacy app built on access and .Net and was never set up for enterprise support o Will be maintaine

Lead Palantir Foundry - Remote

Nava Software Solutions

Remote or Jersey City, New Jersey, USA

Contract, Third Party

NAVA Software solutions is looking for a Technical Lead, Palantir Foundry Details: Technical Lead, Palantir Foundry-Predictive AI Location: : Remote | Central / East Coast Hours Duration : 12+ months Description: Technical Lead at Client work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate data solutions with external systems containing the data. Key Responsibilities Include: Evaluate and inform Product Owner and other

OneTrust Developer

Infojini

US

Third Party, Contract

Role: OneTrust Developer Location: Remote-USA Type: Contact C2C/W2 Experience: 9-11 Years Job summary: Looking for SA Level 9-11 years experienced hands-on expert Sr. Developer with experience in Python, Pyspark and Pandaas, SQL, Databricks, Apache Freemarker or Java scripting to quickly pick Freemarker. Experienced in OneTrust application as work involves enhancements/fixes to Workflows, Jobs, Reports, configuration and metadata creations in OneTrust SaaS application Required Skills Technica

Data Engineer Manager @ Remote - 12 + Years

SelSoft Inc.

Remote

Full-time

Position Summary: We are looking for a skilled Data Engineer Manager with healthcare domain expertise to lead the development of innovative healthcare technology solutions. The ideal candidate will work closely with cross-functional Agile teams to deliver high-impact products that improve patient care, streamline provider workflows, and support compliance with healthcare regulations. Key Responsibilities: Define and prioritize product backlog based on business and user needs.Mandatory experience

Azure Databricks Lead

DataAffect

Remote

Contract

About DataAffect: We are a boutique data/service management firm specializing in the delivery of Data Governance, Enterprise Data Strategy, Solutions Architecture, Data Warehousing, Data Integrations, Data Security & Privacy Management, IT Service Management, Business analysis (and) Agile Project Management services to diverse clients across multiple industries. Role: Azure Databricks Lead Location: Remote Duration: 6+ months Job Summary We are looking for a results-driven Lead Data Engineer (Co

MLOps Architect (Databricks Specialist)

Amiseq Inc.

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know

***Sr. AWS Glue ETL Developer***W2****Remote*****

SmartIMS Inc.

Remote

Contract

Title: Sr. AWS Glue ETL Developer Location: Remote Duration: Contract Required skills: Candidate must have bachelor s with 12 years of prior relevant experience or master s with 6-10 years of prior relevant experience Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue. Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing. Coordinate closely with mainframe res

Azure Architect - Data, AI/ML, Cloud Transformation & Security

Milestone Technologies, Inc.

Remote

Contract

Azure Architect with extensive Data, AI/ML, Cloud Transformation & Security experience. Initially: Two month W2 Contract (no C2C) 100% remote Estimated rate: $100 - 110/hr. Please review and let me know if you, or someone you know, may be interested in discussing. We are looking for aseasoned Azure Architectwith a robust foundation inData and AI/MLto lead the end-to-end design and implementation ofscalable, secure, and high-performance cloud-native solutions. This role requires a deep understa

Azure Data Engineer Remote

Georgia IT

Remote

Contract

Azure Data Engineer Remote Duration: 10 months Rate: DOE Tech screening -Interview after 3 PM PST Core skills needed MS Fabric's hands-on experience is a must to have. Just having POC experience is not good enough.AzureSQLDax-Fabric-SynapseETL-SparkPySpark-PythonAzure Databricks -MUST HAVEData Lake

Data Scientist, Expert

Pacific Gas & Electric

Oakland, California, USA

Full-time

Requisition ID # 164706 Job Category: Accounting / Finance Job Level: Individual Contributor Business Unit: Operations - Other Work Type: Hybrid Job Location: Oakland; Alameda; Alta; American Canyon; Angels Camp; Antioch; Auberry; Auburn; Avenal; Avila Beach; Bakersfield; Balch Camp; Bay Point; Bear Valley; Belden; Bellota; Belmont; Benicia; Berkeley; Brentwood; Brisbane; Buellton; Burney; Buttonwillow; Calistoga; Campbell; Canyon Dam; Canyondam; Capitola; Caruthers; Chico; Clearlake; Clovis;