apache spark Jobs in san jose, ca

Refine Results
481 - 500 of 544 Jobs

Hiring for Data Scientist :: Remote

Feuji Inc

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. Data Scientist II/GenAI Remote C2H Required technical skills: Core Duties: Build models, Measure Impact, Prioritization/Optimization Required technical skills: SQL/Spark/Python/Data Science/ML Tools or platform experience requirements: SQL/Spark, Scala, Langchain Should you be interested, please send me a cop

Databricks Senior Manager

Oscar Technology

Remote

Full-time

Senior Manager, Databricks Location Remote Overview Databricks is seeking a seasoned Senior Manager to lead the strategy, implementation, and operation of our Databricks platform across Azure, AWS, and Google Cloud Platform. You'll manage and mentor a high-performing team, oversee cloud-native data platform initiatives, and ensure reliable, scalable analytics and AI capabilities. Key Responsibilities Lead and develop a team of data engineers, platform specialists, or solution architects, setti

Databricks Architect

Showman Staffing

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level:10+ Years About the Role We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure archit

Data Engineer (Matillion ETL)

Sharpedge Solutions

Remote

Full-time

Job Details: Data Pipeline Development: Design, construct, test, and maintain highly scalable data management systems. Develop and implement architectures that support the extraction, transformation, and loading (ETL) of data from various sources. Data Integration: Integrate structured and unstructured data from multiple data sources into a unified data system, ensuring data quality and consistency. Data Warehousing: Build and maintain data warehouses and data lakes to store and retrieve vast am

Data Architect with AWS, Databricks and Pyspark

E-Solutions, Inc.

California, USA

Full-time

Hi Professionals, Role Data Architect (Databricks) Duration: Fulltime Key Responsibilities: Solution Design & Implementation: Architecting and building scalable, secure, and high-performance data solutions on the Databricks platform using technologies like DLT Pipelines, Spark, Delta Lake, AI/BI Genie, etc. Data Pipeline Development: Designing and implementing end-to-end data pipelines, including ETL/ELT processes, for both batch and real-time data processing. Data Governance & Security: Defini

AWS Engineer

Axiom Global Technologies, Inc.

Remote

Contract

We're looking for a talented and experienced Senior AWS Engineer to join our team. In this role, you'll be instrumental in designing, developing, and implementing robust and scalable backend solutions, with a strong focus on data processing, API development, and AWS cloud infrastructure. If you're passionate about building high-performance systems and have a solid understanding of modern cloud architectures, we encourage you to apply! Key Responsibilities: Design and develop data-driven solutio

Databricks Engineer

Reveille Technologies

Remote

Contract, Third Party

Data Analysis and Mapping: Analyzing the source Salesforce instance and target environment to understand data structures, relationships, and migration requirements. Migration Strategy: Developing and documenting the overall data migration strategy, including data extraction, transformation, loading, and validation processes. Data Modeling: Designing and implementing data models in Databricks that align with the target environment and business requirements. Performance Optimization: Optimizing da

Azure Data Solution Architect

RNR IT Solutions, Inc.

Remote or Little Elm, Texas, USA

Full-time

Job Title: Data Warehouse & Azure Data Architect / Principal Data Engineer Location: Remote 15+ years of experience in database architecture, data engineering, and analytics solutionsStrong expertise in Azure Data Platform: Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, Azure Data Lake Storage, Event Hub, Azure Analysis Services, Power BI, Microsoft FabricProficient in Python, Spark SQL, T-SQL, and metadata-driven developmentExperience designing and implementing Data Vault 2.0,

Resident Solution Architect

Cycle 3 IT Staffing

Remote

Contract

Cycle3 IT Staffing is seeking several Resident Solutions Architects who are SENIOR LEVEL for a REMOTE role. Architecting and Leadership: o Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh. Data Engineering: o Strong programming experience in Python; Scala is a significant plus. o Proficiency in complex query tuning. o Experience building Slowly Changing Dimensions (SCD) TYPEs. o Familiarity with DBT. o Experience with structured streaming

Technical Architect/Data Architect

MSquare Systems Inc.

Remote

Full-time

Key Responsibilities: Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure) Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc. Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGaps Optimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environments Collaborate with sales teams to understand client needs and

Machine Learning Artificial Intelligence Engineer with Big Data and Cloudera

Buxton Consulting

Remote

Contract

Machine Learning Artificial Intelligence Engineer with Big Data and Cloudera Location Fully Remote Must Haves- Strong project experience in Big Data platform with Amazon Web Services and Cloudera Data Platform is must. Strong experience with REST API development using Python frameworks (Django, Flask etc.) is must. Micro Services/Web service development experience using Spring framework is must. 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Good project e

AI/ML Specialist (Mid)

Meta Soft Inc.

Remote

Full-time

AI/ML Specialist (Mid) Job Type: Full-time (Hourly or Salaried) Scheduled Weekly Hours: 40 Location: 100% Remote Clearance: Public Trust or Higher levels Only for Citizens with Clearance Required Skills/ Experience 5+ years of hands-on experience in AI/ML or applied data science Strong proficiency in Python for AI/ML development, with demonstrated real-world project experience Proven ability to design and implement custom ML components beyond standard prebuilt models and tools, particularly

Databricks Engineer

Oscar Technology

Remote

Full-time

Job Title: Databricks Engineer - Remote Location: Remote Job Type: Full-Time Experience Level: Mid to Senior (5+ years) About the Role: We are seeking a skilled and experienced Databricks Engineer with a strong background in both Azure and AWS cloud platforms. As a key member of our Data Engineering team, you will design, develop, and optimize scalable data solutions using Apache Spark on Databricks, enabling advanced analytics and data-driven decision-making across the organization. This is

ML Ops Engineer (AWS GovCloud Databricks) - Remote - W2 only

Saksoft

Remote

Contract

Position: ML Ops Engineer (AWS GovCloud Databricks) Duration: 12+ months contract Location: Charlotte, NC (100% remote) JOB DESCRIPTION SKILLS NEEDED : Bachelor's degree in computer science, Engineering, Applied Mathematics or related field4 to 6 years of strong experience with AWS Gov Cloud environments, Export Control FedRAMP environmentsOverall 8 to 10 years of solid experience in the areas of data engineering, machine learning data science4 to 6 years of strong experience with the following

Data Architect

JC CORPORATIONS

Remote

Third Party, Contract

Key Responsibilities: Architect and design data-driven solutionsfor large-scale applications within the Wealth Management and Billing ecosystem.Lead the development of robust data pipelines using technologies such as AWS Glue, Athena, and Snowflake.Apply caching strategies and data modeling best practices to optimize system performance and throughput.Translate complex business requirements into effective, scalable enterprise data architectures.Ensure all solutions align with non-functional requi

Sr. Machine Learning Engineer / GenAI Architect -- 100% REMOTE

Excellerent Technology Solutions

Remote

Third Party, Contract

As a Sr. Machine Learning Engineer on our GenAI applications team, lead development of innovative generative AI products Client need folks who have and can write production level code. 80% coding Individual Contributor role. Required Skills and Qualifications: Minimum of seven years post-secondary education or relevant work experienceBachelor's degree in mathematics, physics, computer science, engineering, statistics, or an equivalent technical discipline.Minimum of five years software develo

Program Manager

Tektend llc

Remote or New York, New York, USA

Contract, Third Party

Job Title: Program Manager Location: Remote Duration: 12+ Months Key Skills & Qualifications: Experience: 7+ years of experience in program management, with at least 3-5 years focused on digital transformation, cloud data platforms, and data analytics initiatives. Expertise in Databricks: Strong hands-on experience with Databricks platform, including but not limited to data engineering, machine learning workflows, and data science pipelines. Data Analytics: Solid understanding of data analytics

BackFill - DataScientist - Visa Independent

Prodware Solutions

Remote

Contract

Job title: Data ScientistDuration: 12+ MonthsLocation: 100% Remote Job Description :- 12+ Years Experience required Understanding of machine learning and deep learning models to select and implement for prediction, classification, and clustering projects Apply machine learning or reinforcement learning to optimize marketing efforts with respect to customer acquisition, retention, pricing, cross-selling, operations and trading Passion to learn latest Al techniques and explore applications for

DevOps Engineer - W2

Javen Technologies, Inc

Remote

Contract

Job Title: DevOps Engineer Location: 100% Remote Duration: 6+ Months with possible extensions Technical Skills - Must Have AWSCI/CDTerraform Nice To Have Application DevelopmentJavaScript Job Summary Description Site Reliability Engineer Build and maintain the production infrastructure and services.Ensure proper security for the infrastructure.Troubleshoot production issues.Develop/maintain processes, tools, and documentation in support of production.Participate in the evaluation of new softw

Devops Engineer

Javen Technologies, Inc

Remote

Contract

Must Have: AWS CI/CD Terraform Nice To Have: Application Development JavaScript JOB DESCRIPTION: Build and maintain the production infrastructure and services. Ensure proper security for the infrastructure. Troubleshoot production issues. Develop/maintain processes, tools, and documentation in support of production. Participate in the evaluation of new software, hardware, and infrastructure solutions. Experience as a er working with large distributed systems Experience with a variety of scriptin