Cloud Big Data Software Engineer Jobs in San Francisco, CA

Refine Results
181 - 200 of 221 Jobs

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

•

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth
Easy Apply
Posted 60+ days ago | Updated 6 days ago

Senior/Principle Google Cloud Platform Data Engineer with strong SQL and Python

ChaTeck Incorporated

•

Remote or Atlanta, Georgia, USA

Third Party

Role: Senior/Principle Google Cloud Platform Data Engineer with strong SQL and Python Location- Remote Duration- 6 Months C2H Openings - 6 Positions Steer Clear No one < 3 years of experience on Google Cloud Platform No one with only experience in AWS and Azure Data Engineering Requirement Programming SQL Python Java (Optional) Google Cloud Platform BigQuery Dataflow (Apache Beam) Cloud Composer (Airflow) GCS GKE Dataform (Optional to dbt) Tools dbt / Dataform(On Google Cloud Pl
Easy Apply
Posted 60+ days ago | Updated 17 days ago

Could Support Engineer_Texas Based Project_100% Remote

Sparity

•

Remote or Dallas, Texas, USA

Third Party, Contract

Hi, Greetings from Sparity Inc. We have a urgent requirement for you and the details are as follows Job Title: Could Engineer/Solutions Architect Location: Remote_TX Duration: Long term Job Description: You have 4+ years of demonstrated experience as a Solutions Architect or Cloud Support Engineer (Database/Big data) doing Tier 1 or Tier 2 support work. You have a strong working knowledge of AWS Services. You have hands-on experience with Redshift / Snowflake, Athena, S3, EC2, ECS, Kinesis
Posted 60+ days ago | Updated 3 hours ago

Automation Engineer

Info Dinamica Inc

•

San Francisco, California, USA

Third Party, Contract

Job Title- Automation Engineer Location- Hybrid in San Francisco, CA Duration- 12 months Job Description/ Responsibilities- The ideal candidate will have a strong technical background in CI/CD, Kubernetes, AWS, Jenkins, and other relevant technologies. Configure and manage cloud networks, specifically Cisco Meraki. - Validate Bigdata processes and ensure data integrity. Administer Red hat Linux systems and automate tasks using Ansible. Work with Linux and Google Kubernetes Engine (GKE) on Goo
Easy Apply
Posted 14 days ago | Updated 1 day ago

Solution Architect

Zenox Global, LLC

•

San Francisco, California, USA

Full-time

Role: Solution Architect -Location: San Francisco, CA (other US Locations can be considered )Full-Time Responsibilities: -Build and optimize machine learning models using frameworks like TensorFlow, PyTorch, or Scikit-learn.-Architect and implement end-to-end MLOps pipelines for model training, deployment, and monitoring.-Leverage cloud-based AI services (AWS SageMaker, Google Vertex AI, Azure ML) to develop scalable ML solutions.-Work with big data technologies (Spark, Hadoop, BigQuery, Databri
Easy Apply
Posted 4 days ago

Azure Data Engineer Lead

Aptino

•

San Francisco, California, USA

Contract

Job Description:We are seeking a highly skilled Senior Data Engineer with extensive experience in Python, PySpark, SQL, and Microsoft Azure Cloud Services. The ideal candidate will have a strong background in data warehousing, big data technologies, and cloud data engineering, along with a proven ability to lead development teams and drive high-quality project deliverables. Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and SQL. Design, implement, and op
Easy Apply
Posted 38 days ago | Updated 1 day ago

AI/ ML Engineer

Resource 1

•

Remote

Contract

Resource 1 is in need of an Artificial Intelligence (AI)/ Machine Learning (ML) Engineer for a long-term, remote contract position. Responsibilities: Architect, build, maintain and improve new and existing suite of algorithms and their underlying systemsImplement end-to-end solutions for batch and real-time algorithms along with requisite tooling around monitoring, logging, automated testing, performance testing and A/B testingEstablish scalable and efficient automated processes for data analyse
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Sr Data Engineer (DBT, FiveTran, SQL) @ Fulltime with CriticalRiver

Critical River, Inc.

•

San Francisco, California, USA

Full-time

Hi , I hope you are doing well..!! Title: Sr Data Engineer (DBT, FiveTran, SQL) Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 10-15 Years Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement d
Easy Apply
Posted 60+ days ago | Updated 10 days ago

Data Engineer - Databricks - Remote

Contract Staffing Recruiters

•

Remote

Contract

100% Remote role. W2 ONLY Pay rate 60/hr range We are seeking a software engineer/developer or ETL/data integration/big data developer with experience in projects emphasizing data processing and storage. This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. Candidate will perform requirements analysis, design/develop process flow, unit and integration tests, and create/update process documentation. Work with the Business Intelligenc
Easy Apply
Posted 11 days ago | Updated 4 days ago

Machine Learning Engineer (Infrastructure)

Photon

•

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras
Easy Apply
Posted 14 days ago | Updated 4 days ago

Databricks Engineer

SOHO Square Solutions

•

Remote or US

Contract, Third Party

Qualifications Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of database structures (MongoDB, DataVault) Experience building and optimizing data pipelines, architectures, and datasets Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement Strong analytic skills related to working wit
Easy Apply
Posted 6 days ago | Updated 3 hours ago

ETL SDET Engineer with SQL Queries

TekShapers

•

Michigan, USA

Third Party

SDET Position Summary: The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows. This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues. The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall
Easy Apply
Posted 12 days ago | Updated 8 hours ago

Platform Engineer - Databricks

Sunrise Systems, Inc.

•

Remote

Contract

Our client, a leading apparel and sporting goods manufacturing company, is looking for a Platform Engineer - Databricks. This is for an initial duration of 12 months and is a REMOTE position. Job Type: Contract (Candidates must be able to work on W2 without VISA sponsorship) Must Haves: Dataricks,PlatformAIML experience Required: Strong Computer Science fundamentals2+ years professional software development experienceProgramming - Python AND GolangInfrastructure as Code / Dev Ops practices and
Easy Apply
Posted 52 days ago | Updated 17 days ago

Lead Data Engineer with Google Cloud Platform, Python

TekDallas

•

Remote

Contract

Position: Lead Data Engineer Location: 100% Remote (EST time zone) Contract Duration: 12+ years Summary: Need candidates that can confidently build and maintain the data infrastructure that supports the data-related initiatives.This person will need hands on Python experience and the heavy data background. Focus will be developing scalable data pipelines, optimizing data workflows, and ensures the quality of the data.Anyone with a Google Professional Data Engineer Certification will be intervie
Easy Apply
Posted 11 days ago | Updated 7 days ago

Databricks Developer

eSolutionsFirst, LLC

•

Remote or Vienna, Virginia, USA

Full-time

Databricks Developer Job Type: Full-time employment Location : Onsite Vienna, VA - Hybrid Job Description: We are seeking a skilled and experienced Databricks Developer with expertise in Azure to join our dynamic team.The ideal candidate will be responsible for designing, developing, and implementing data solutions using Databricks on Azure cloud platform. Key Responsibilities: Design and develop scalable data pipelines and ETL processes using Databricks on Azure.Collaborate with data engineers
Easy Apply
Posted 6 days ago | Updated 18 hours ago

Data Scientist - Operations Research

Factspan Inc

•

Remote

Full-time

Job Title: Operations Research - Associate Job Type: Full Time Job Location: Remote/Orlando, FL Required Qualifications & Skills 3-5 years of overall technical experience Experience with operations research modelling techniques such as assignment problems, integer programming, queuing theory etc High Proficiency in SQL coding Proven experience and expertise using Python Ability to showcase an understanding of one or more business domains Prior experience gathering and refining data requirements
Easy Apply
Posted 11 days ago | Updated 6 days ago

AI & Cloud Engineering Intern (Azure-Focused)

Global Bridge InfoTech Inc.

•

Remote or Irving, Texas, USA

Contract

We are seeking a motivated and technically skilled AI & Cloud Engineering Intern to join our team. This role is ideal for a graduate student pursuing a Master s in Artificial Intelligence with a strong foundation in software development, machine learning, and cloud technologies. The intern will support the design, development, and deployment of intelligent solutions using Azure AI services, big data tools, and machine learning frameworks. Key Responsibilities: Collaborate with senior AI enginee
Easy Apply
Posted 10 hours ago

Windows Administrator - Active Directory, VMWare, Power Shell Scripting, AWS

SES

•

Remote or Denver, Colorado, USA

Full-time

Windows Administrator Type: W2 With Benefits - No C2C Location: Remote - will support Denver, CO hours Experience in the following: Experience supporting large scale infrastructure preferred. Active Directory Domain Administration VMWare PowerShell Scripting AWS and Azure background Automation background Experience working in a ticket queue Experience with Windows OS upgrades\migrations About SES: Systems Engineering Services Corporation (SESC), founded in 1989, is a leading provider of
Easy Apply
Posted 16 hours ago

Big Data Principal Architect

Heliogic LLC

•

Remote

Full-time

Role: Big Data Principal Architect Location: Remote Job type :Full time Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation. Years Of Experience15 to 20 Years Job Description Handson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of b
Easy Apply
Posted 41 days ago | Updated 31 days ago

Immediate interview in this week for IoT Analyst - Hybrid

Cerebra Consulting Inc

•

Remote or Atlanta, Georgia, USA

Contract

Cerebra Consulting Inc is a System Integrator and IT Services Solution provider with a focus on Big Data, Business Analytics, Cloud Solutions, Amazon Web Services, Salesforce, Oracle EBS, Peoplesoft, Hyperion, Oracle Configurator, Oracle CPQ, Oracle PLM and Custom Application Development. Utilizing solid business experience, industry-specific expertise, and proven methodologies, we consistently deliver measurable results for our customers. Cerebra has partnered with leading enterprise software c
Easy Apply
Posted 60+ days ago | Updated 3 hours ago