spark Jobs in San Mateo, CA

Refine Results
1 - 20 of 449 Jobs

Spark Developer

Nityo Infotech Corporation

•

San Francisco, California, USA

Contract, Third Party

JD: Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools/technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)Experience analyzing data to discover opportunities and address gaps.Experience working with cloud or on-prem Big Data platforms (i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data W
Easy Apply
Posted 20 hours ago

Sr. Engineering Manager - Spark Platform

Databricks Inc

•

Mountain View, California, USA

Full-time

P-932 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Apache Spark is a multi-language engine for data engineering, data science, and machine learning that lies at the core of
Posted 44 days ago | Updated 4 hours ago

Spark Developer with Scala

Cogent IBS, Inc

•

San Francisco, California, USA

Full-time

Position Spark Developer with Scala Location: SFO, CA (Onsite) Need Only Local Candidate (In person Interview Mandatory)Long TermYour Headline: Focused and to the point The ask is for a 100% Hands on developer, who has strong understanding on Apache Spark and is good in preferably Scala (if not, then Python or Java).Please find below JD:Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive e
Easy Apply
Posted 1 hour ago | Updated 1 hour ago

Software Engineer-Spark

Veear

•

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N
Easy Apply
Posted 7 days ago | Updated 17 hours ago

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

•

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions
Easy Apply
Posted 9 days ago | Updated 8 days ago

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

•

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili
Easy Apply
Posted 16 days ago | Updated 8 days ago

Senior Spark Data Engineer

Randstad Digital

•

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe
Posted 19 hours ago | Updated 1 hour ago

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

•

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa
Easy Apply
Posted 6 days ago | Updated moments ago

Software Engineer (Spark)

Bayside Solutions

•

Remote or

Contract

Software Engineer (Spark) W2 Contract Salary Range: $145,600 - $166,400 per year Location: Seattle, WA - Remote Role Requirements and Qualifications: Strong understanding of distributed systems and cloud computing principles Demonstrated experience with Apache Spark Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud Experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and net
Easy Apply
Posted 7 days ago | Updated moments ago

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

•

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Spark Scala Developer

Infosys Technologies Ltd

•

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i
Easy Apply
Posted 9 days ago

Data Engineer I

Innova Solutions, Inc

•

Cupertino, California, USA

Contract

Innova Solutions is immediately hiring for a < Data Engineer I> Position type: Duration: <6+ months > Location: < Cupertino, CA 95014> As a < Data Engineer I> you will: < Candidate will be gathering data and using statistical, ML(to Create causal models, etc) Must be able to understand full stack.Pars usage data.Goal is to optimize app using data. > The ideal candidate will have: < Top required skills SQL, Spark > Qualified candidates should APPLY NOW for immediate consideration! Please hi
Easy Apply
Posted 3 days ago | Updated 1 day ago

Data Engineers - Google Cloud Platform

Caspex Corporation

•

Sunnyvale, California, USA

Contract

Data Engineer - only locals to CA o Spark Streaming, Scala/Python, Spark SQL o Big Data ecosystem + Airflow & Google Cloud Platform o Exp with REST APIs
Easy Apply
Posted 38 days ago | Updated 2 days ago

Data Architect

ApTask

•

Santa Clara, California, USA

Full-time

Job Description: We are seeking a highly skilled Data Architect with expertise in modeling data lake and data warehouse environments, as well as extensive experience in database analysis, optimization, and query performance optimization. The ideal candidate will have a strong understanding of database table retrievals, partitions, indexing, and query optimization techniques. Responsibilities: Design and implement logical and physical data models for data lake and data warehouse environments. Col
Easy Apply
Posted 21 days ago | Updated 8 days ago

Data Technical Lead

W3Global

•

Santa Clara, California, USA

Full-time

Data Technical Lead Location: Santa Clara, CA & San Francisco, CA ,Disney Hub Locations Bristol, CT, New York, NY, Seattle, WA, Orlando, FL, Hybrid Full Time Required Experience: 9 - 12 Years Skills : Writing & analyzing complex SQL queries, Python, Spark, Databricks, Airflow Candidate should be proficient in the following areas: Writing & analyzing complex SQL queries Python Spark Airflow Databricks Snowflake Should have working knowledge of CICD tools (Git, Jenkins) Good to have skill: Datora
Posted 21 days ago | Updated 1 hour ago

Local Only : Google Cloud Platform Data Engineer : Sunnyvale, CA (Hybrid)

Spar Information Systems

•

Sunnyvale, California, USA

Contract, Third Party

Role - Senior Google Cloud Platform Data Engineer with HIve, SQL, Spark Need 10+ Years of Profile- Need Locals Only Location: Sunnyvale, CA (Onsite from Day1) Duration: Long Term Must Have Skills Data Engineer-11 Years Experience Spark Scala Google Cloud Platform Hive SQL ETL Process / Data Pipling - 8+ Years of experience Description: Client is looking for a highly energetic and collaborative Senior Data Engineer (10+ yrs) for a 12-month engagement. Responsibilities: As a Senior Data Engineer
Easy Apply
Posted 60+ days ago | Updated moments ago

Product Support Engineer

Talent Group

•

San Jose, California, USA

Full-time

Key Responsibilities: Provide production support for Java-based applications running on Kubernetes clusters.Monitor application performance and troubleshoot issues as they arise.Implement and maintain monitoring solutions to ensure the health and availability of applications.Collaborate with development teams to identify and resolve technical issues impacting production environments.Perform root cause analysis for incidents and implement preventive measures.Automate routine tasks and processes t
Easy Apply
Posted 6 days ago | Updated 2 days ago

Data Infrastructure Engineer

TEKsystems c/o Allegis Group

•

Cupertino, California, USA

Full-time

Description: Data Infrastructure team within a specific organization powers analytics, experimentation, and ML feature engineering to power a service we all love in our devices. The mission of the Data Infrastructure org is to provide our engineers and data scientists a cutting edge, reliable and easy to use infrastructure for ingesting, storing, processing, and interacting with data and ultimately help the teams that build data intensive applications be successful. You will work with many cross
Posted 2 days ago | Updated 4 hours ago

Senior Data Engineer

Caspex Corporation

•

Sunnyvale, California, USA

Third Party, Contract

Position: Senior Data Engineer Location: Sunnyvale CA (only locals to Sunnyvale CA, Relocation will not be considered) Job Description: Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential.Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (Google Cloud Platform preferred) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.Ex
Easy Apply
Posted 60+ days ago | Updated 20 days ago

Data Engineer with Google Cloud Platform

Astir IT Solutions

•

Sunnyvale, California, USA

Contract

9+ years of hands-on experience with developing data warehouse solutions and data products. 5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive,Scala, Airflow or a workflow orchestration solution are required 5+ years of experience in Google Cloud Platform,GCS Data proc, BIG Query 2+ years of hands-on experience in modeling(Erwin) and designing schema for data lakes or for RDBMS platforms. Experience with programming languages: Python, Java, Scala,
Easy Apply
Posted 43 days ago | Updated 18 hours ago