spark Jobs

Refine Results
1,641 - 1,660 of 1,881 Jobs

Senior Quantitative Developer Machine Learning & Regulatory Credit Risk

Teknoviq Solutions

Westerville, Ohio, USA

Contract, Third Party

Key Responsibilities: Develop and implement regulatory credit risk models (PD, LGD, EAD) using Python, Spark (Scala), and distributed systems in a Kubernetes-based Azure environment.Build scalable ML pipelines integrated with MLflow, CI/CD (Azure DevOps), and model governance frameworks.Create model explainability layers using tools such as SHAP, LIME, or custom counterfactual frameworks to support model governance and audit.Participate in the lifecycle of CECL and CCAR models, including data pr

Lead-Site Reliability Engineer

Kodeva LLC

Remote

Full-time

Role - LEAD/ Senior Site Reliability Engineer Remote Full time Experience Range: 8 to 15 years Mandatory Skills: Linux, AWS or Google Cloud Platform, Kubernetes, Python/Shell or any scripting. Additional Skills (good to have) : Prometheus & Grafana, Kafka Administration, Docker, Jenkins, Terraform Location: Anywhere in USA and Canada 1. Good experience of maintaining production systems on AWS and/or Google Cloud Platform as SRE 2. Hands on with Linux and Python, Shell or any scripting language.

Databricks Senior Manager

Oscar Technology

Remote

Full-time

Senior Manager, Databricks Location Remote Overview Databricks is seeking a seasoned Senior Manager to lead the strategy, implementation, and operation of our Databricks platform across Azure, AWS, and Google Cloud Platform. You'll manage and mentor a high-performing team, oversee cloud-native data platform initiatives, and ensure reliable, scalable analytics and AI capabilities. Key Responsibilities Lead and develop a team of data engineers, platform specialists, or solution architects, setti

Azure Data Architect

Ledgent Technology

Houston, Texas, USA

Contract

We are seeking an experienced Azure Databricks Architect to design and implement scalable big data solutions leveraging the Microsoft Azure cloud ecosystem. The ideal candidate will possess deep technical knowledge of Databricks, data engineering best practices, and modern cloud architectures. This role will be instrumental in leading data transformation initiatives, optimizing data pipelines, and ensuring secure, high-performance environments for advanced analytics and AI workloads. Key Respons

Data Engineer

HCL America Inc.

Remote

Full-time

HCLTech is looking for a highly talented and self- motivated Data Engineer to join it in advancing the technological world through innovation and creativity. Job Title: Data Engineer Job ID: 1594508BR Position Type: Full-time/ remote ship required based on client requirement or Secret Clearance required Role/Responsibilities Python, AWS Glue, Iceberg, Redshift, S3, Lambda, Terraform, Spark, API Gateway Secondary Skills (knowledge is a must): Data modeling and ETL We are seeking a Mid-Level Data

Snowflake Architect

ITBMS Inc.

New York, New York, USA

Contract, Third Party

Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity. Deep understanding of Snowflake sharing capabilities, Listings (auto fulfillment), and Marketplace features. Hands-on experience with Snowflake cost management in multi-tena

Databricks Architect

Showman Staffing

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level:10+ Years About the Role We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure archit

Databricks Lead - Data Engineering

Anblicks

Dallas, Texas, USA

Contract

Job Title: Databricks Lead - Data EngineeringLocation: Addison, Texas (Hybrid/On-site) Job Summary:As a Databricks Lead, you will be a critical member of our data engineering team, responsible for designing, developing, and optimizing our data pipelines and platforms on Databricks, primarily leveraging AWS services. You will play a key role in implementing robust data governance with Unity Catalog and ensuring cost-effective data solutions. This role requires a strong technical leader who can me

Snowflake Architect

SelSoft Inc.

Lake Mary, Florida, USA

Full-time

Hi, Position: Strong Snowflake Architect - NYC/Lake Mary,FL Locals only Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity. Deep understanding of Snowflake sharing capabilities, Listings (auto fulfillment), and Marketplace f

Snowflake Architect

SelSoft Inc.

New York, New York, USA

Full-time, Third Party

Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity. Deep understanding of Snowflake sharing capabilities, Listings (auto fulfillment), and Marketplace features. Hands-on experience with Snowflake cost management in multi-tena

Data Engineer

Intraedge

New York, New York, USA

Contract, Third Party

Job Title: : Google Cloud Platform Data Engineer Location: NYC (Day 1 onsite Hybrid 3 days a week in office) Duration: Long Term Contract Job Description: Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (Google Cloud Platform, Azure, AWS). Google Cloud Platform certification will be very good to have. Strong Hands on experience with one or more programming languages ( Python or Java). Hands-on expertise with application design and software devel

Senior Data Engineer

Symantrix Inc

California, USA

Contract

Greetings from symantrix Inc #we have postion JOB Description: Position: Senior Data Engineer (Only w2 no c2c) Location: Sunnyvale, CA-Need locals Duration: 12+ Months Description: What you'll do: Build and maintain optimal data platform and pipeline architecture. Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infr

Data Architect with AWS (Insuremo/Ebao)

Lorven Technologies, Inc.

Woodbridge Township, New Jersey, USA

Third Party, Contract

Data Architect with AWS (Insuremo/Ebao) Location: Iselin, NJ (Hybrid role 3 days a week onsite) Local Candidates preferred. Duration: 12+ Months Job Type: C2C\W2 Job Description: We are seeking a highly experienced and motivated Solution Architect with strong hands-on expertise in AWS and Databricks, and experience integrating rating engines such as InsureMO or eBaoTech. Roles & Responsibilities: Lead architecture and design of a centralized pricing database for actuarial modeling. Define the d

Sr. Data Engineer

VDart, Inc.

Berkeley Heights, New Jersey, USA

Contract, Third Party

Data Engineer New Providence, NJ Contract Job Description: Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance Work in tandem with our engineering team to identify and implement the most optimal solutions Ensure platform performance, uptime, an

Senior ML engineers

Caspex Corporation

Sunnyvale, California, USA

Contract, Third Party

ML senior engineers Technical Skills Must have: Expertise in Python and experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn, etc.). Strong Experience in deployment/devops technologies: CI/CD pipelines, Kubernetes/Docker, and infrastructure-as-code tools (Terraform, Ansible, etc.). and cloud-native architectures (Google Cloud Platform and Aruze), monitoring and observability for ML workloads Advanced understanding of ML pipeline orchestration tools like Kubeflow, MLflow, Airflow, or

Senior Software Engineer Big Data & Cloud (Google Cloud Platform)

Nasscomm, Inc.

Phoenix, Arizona, USA

Contract

Looking for a seasoned Software Engineer with big data and full-stack development expertise. This role will be pivotal in maintaining and modifying existing NIFI jobs, migrating existing big data, NIFI and java rest APIs to the Google Cloud Platform (Google Cloud Platform). Minimum Qualifications BS in computer science, computer engineering, or other technical discipline, or equivalent work experience.Hands-on software development experience with Google Cloud Platform, AWS or other Cloud/Big Dat

Job Opening - Snowflake Architect @ NYC/Lake Mary,FL (Onsite)

SelSoft Inc.

Lake Mary, Florida, USA

Contract, Third Party

Hi, We have an opening for the position below. If you are interested in this opportunity kindly share your updated resume with details. Role: Snowflake Architect Location : NYC/Lake Mary,FL Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for sec

Fraud SME

Prodware Solutions

Remote or Malvern, Pennsylvania, USA

Full-time

This is Aishwary fromProdware Solutions LLC. We have a role which closely matches your skill set. Please go through the job description below and let me know if you or anyone who is looking for a good opportunity. You can reach me on. Job Title: Fraud SME Location: Hybrid inMalvern, PA(2 days from home and 3 days in office) Type: Full Time Permanent This is a Hybrid - 3 days Onsite Strong experience working with fraud detection, fraud strategy, and fraud prevention, with hands-on working experi

ML Ops Senior Engineers

Symantrix Inc

California, USA

Contract

Technical Skills Must have: Expertise in Python and experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn, etc.). Strong Experience in deployment/devops technologies: CI/CD pipelines, Kubernetes/Docker, and infrastructure-as-code tools (Terraform, Ansible, etc.). and cloud-native architectures (Google Cloud Platform and Aruze), monitoring and observability for ML workloads Advanced understanding of ML pipeline orchestration tools like Kubeflow, MLflow, Airflow, or TFX. Nice to have:

Job Title: Data Engineer LeadLocation: San Jose, CA (Onsite)

First Object Inc.

San Jose, California, USA

Full-time

Job Title: Data Engineer Lead Location: San Jose, CA (Onsite) Duration: Long term contract Job Description of Overview: We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects. The ideal candidate will have hands-on expertise in Databricks, Azure Data Factory, and related technologies, with a proven track record of leading at least 3 successful data projects. Experience Required: Minimum of 12 years of experien