Hadoop Big Data Spark Engineer Jobs in San Francisco, CA

Refine Results
21 - 40 of 246 Jobs

Senior Staff Software Engineer, Data and ML Platform

Discord Inc.

•

San Francisco, California, USA

Full-time

This position is US based only. Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. We are seeking an accomplished and experienced Senior Staff so
Posted 60+ days ago | Updated moments ago

Senior Software Engineer - Distributed Data Systems

Databricks Inc

•

San Francisco, California, USA

Full-time

P-59 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical challenges, from designing n
Posted 60+ days ago | Updated moments ago

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

•

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin
Easy Apply
Posted 60+ days ago | Updated 6 days ago

Staff Software Engineer - Distributed Data Systems

Databricks Inc

•

San Francisco, California, USA

Full-time

P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark , Databricks has grown from a tiny corner office in Berkeley, California to a global organizati
Posted 60+ days ago | Updated moments ago

Hadoop Engineer

Buxton Consulting

•

Remote

Full-time

Hadoop Engineer Remote Role- must work on PST time zone 12+contract Must Haves- Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must.Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must.4-5 experience building data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL., HBase.4-5 years of programming experience in Python, Java and Scala is must.Strong experience with REST API development using Python fr
Easy Apply
Posted 60+ days ago | Updated 11 days ago

AWS Glue Big data engineer

System Soft Technologies

•

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution
Easy Apply
Posted 19 days ago

Sr. Data Engineer(Data Bricks Certified)

Amiseq Inc.

•

Remote

Contract

1. 4+ Years Data Engineering Experience, 5+ years of consulting experience 2. Completed Data Engineering Professional certification & required classes 3. Minimum 2-3 projects delivered with hands-on experience in Databricks 4. Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache SparkTM on Databricks 5. Experience in Spark and/or Hadoop, Flink, Presto, other popular big data engines 6. Familiarity with Databricks multi-hop pipeline architecture
Easy Apply
Posted 6 days ago

Database Administrator (100% Remote - W2 Only)

Performix Business Services, LLC

•

Remote

Contract

Database infrastructure administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistanc
Easy Apply
Posted 26 days ago | Updated 13 days ago

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

•

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Data Engineer- Azure

BayOne Solutions

•

Fremont, California, USA

Third Party, Contract

Role: Azure / Data Engineer Location: Fremont, CA Duration: Long Term Contract Its a Hybrid Role and need to be Onsite 2 Days a Week Looking for someone Local to Fremont, California only Must have Skills : 1. Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms. 2. 10 + years of proven experience with SQL, schema design and
Easy Apply
Posted 21 days ago | Updated moments ago

Hadoop Developer (100% Remote -USC-GC-on W2)

Synergy Technologies, LLC

•

Remote

Contract

Job Title: Hadoop Developer Location: Jacksonville, FL (100% Remote) Duration: Long Term Job Description A Hadoop developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics. IT Developers are responsible for development, programming, coding of Information Technology solutions. I
Easy Apply
Posted 3 days ago | Updated 3 days ago

AI/ML Architect

Savvyan Technologies

•

Remote

Contract

Greetings from Savvyan Technologies! We are looking for AI/ML Architect for one of our client. Please find the JD below and revert back if interested in. Job Description: We are seeking an experienced AI/ML Architect with a strong background in data to join our team. As an AI/ML Architect, you will play a crucial role in designing, implementing, and optimizing AI and machine learning solutions that leverage our vast data resources. You will collaborate closely with cross-functional teams to ensu
Easy Apply
Posted 19 days ago | Updated 19 days ago

Azure Data Architect

Cloudpaths

•

Remote

Contract, Third Party

Job Title: Azure Data Architect Location: Remote Contract Role Job description Designing and developing high volume data ingestion components and cloud architecture solutionsSelecting and integrating Big Data tools and frameworks like Azure Data bricks, Hadoop or SFDC Data CloudAdministering the overall data strategy, architectures, and securityImplementing Business rules and transformations as a processesSupervising the migration of data from legacy systems to new solutionsMonitoring performanc
Easy Apply
Posted 7 hours ago

Data Scientist V

West Coast Consulting LLC

•

Menlo Park, California, USA

Contract

Job Description Remote role. (PST timezone preference) 8+ years of experience. Masters degree required. 3 different areas 1. Medical marketing campaigns - Late 2023 and 2024 2. Social marketing measurement 3. Marketing decision science foundation research Typical Day: Campaign planning - spending time In measurement plan including: metric taxonomy, learning questions, measurement, and reporting cadence Reporting phase: Analysis, determining what we need to be conducting, data analysis, insights
Posted 3 days ago | Updated moments ago

Data Architect with EPIC

RIIM

•

Remote

Contract, Third Party

Looking for Data Architect - EPIC Healthcare exp. Bachelor s degree in Computer Science, Information Technology, Health Informatics, or a related field. Master s degree preferred.Minimum of 5 years of experience as a Data Architect, with significant experience in hospital systems.Strong understanding of healthcare data standards (HL7, FHIR, DICOM, etc.).Proven experience with EHR systems such as Epic, Cerner, or similar.Expertise in data modeling, database design, and data warehousing.Proficien
Easy Apply
Posted 24 days ago

Engineering Manager, Efficiency

Stripe

•

San Francisco, California, USA

Full-time

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important
Posted 60+ days ago | Updated moments ago

Senior Java Backend Developer with Big data Experience

Symantrix Inc

•

Remote

Contract, Third Party

Minimum Qualifications:4+ years of experience programming in Java/J2EEHands on Experience with Spark Streaming, Flink, Hive and related Big Data Tech stacksExperience with distributed publish-subscribe messaging system like Kafka Experience with no-sql technologies like Cassandra and Elasticsearch Experience with REST microservices using Sprint BootPreferred Qualifications:Experience with Google cloud tech stacks such as BigQuery, GCS Experience with Jenkins, Kubernetes, OneOps and related DevOp
Easy Apply
Posted 5 days ago | Updated 10 hours ago

Senior Data Engineer (Machine Learning)

W3Global

•

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi
Posted 19 days ago | Updated moments ago

Project Manager-Remote

First Tek, Inc.

•

Remote

Full-time

My name is Gaurav and I'm a Technical Recruiter at First Tek. We are currently sourcing for candidates with the following skills. Kindly forward your resume if interested, do share with your friends and colleagues as well. Job Title: Project Manager Location: Remote Client: Major Entertainment Company Duration: 9 months contract As a Project Manager within the Technology Services organization, you will work horizontally across the different verticals of the business (product, support, data scie
Easy Apply
Posted 6 days ago

Azure Data Architect (Locals are preferred who can work on Mountain time zone)

GLOBAL VISSE INC

•

Remote

Contract

Locals are preferred but it s 100% remote role so need candidates who can work on Mountain time zone Position: Azure Data Architect Location: Denver , CO Duration: 6 Months Designing and developing high volume data ingestion components and cloud architecture solutions Selecting and integrating Big Data tools and frameworks like Azure Data bricks, Hadoop or SFDC Data Cloud Administering the overall data strategy, architectures, and security Implementing Business rules and transformations as a p
Easy Apply
Posted 6 hours ago | Updated 5 hours ago