Apache Spark jobs in Minneapolis, MN

Remote or New York, New York

•

3d ago

VACANCY: Freelance Java Developer - Outside IR35 Remote (UK-based) | Occasional travel to Farnborough or Hammersmith 550-620/day | Contract until 2026 We're looking for a freelance Java Engineer to join a long-term project building scalable, cloud-native platforms within the Financial Services Payment industry. This role is outside IR35, fully remote (UK only), with occasional site visits in Farnborough or Hammersmith. This isn't a role for task-takers - we want someone who thinks like an engine

Full-time

USD 620.00 per day

Job Role: Data Engineer (GenAI + Python + SQL)

Remote

•

4d ago

Job Role: Data Engineer (GenAI + Python + SQL) Location: Remote Hire-Type: Contract No C2C Required Skills & Qualifications Experience: 12+ years in Data Engineering, Software Development, or a related field.Programming: Expert-level proficiency in Python and SQL. Proficiency in Scala or JavaScript is a plus.Big Data Tech: Deep hands-on experience with Apache Spark, Databricks, and Cloud Data Platforms (Azure/AWS).GenAI Stack: Proven experience with LLM orchestration frameworks (LangChain, Llam

Easy Apply

Contract

Depends on Experience

Senior/Lead Data Engineer with AI

Remote

•

Today

Title: Senior/Lead Data Engineer with AI Location: 100% remote Contract length 1+ year Required start date: ASAP Recruitment process: Coding test - Technical Interview - Manager Interview - Client Interview Description: We are in search of a Senior Data Engineer who is adept in SQL, Python, and Spark, and ideally with an experience in AI-related tasks and API integrations for chatbot development/integration. SQL Expertise: Essential for complex query handling and database manipulation. Pyth

Easy Apply

Contract

$DOE

Data & AI Engineer (Python & SQL)

Remote

•

4d ago

Easy Apply

Contract

Depends on Experience

Distributed Systems Engineer (L5) - Commerce Product Data Engineering

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Netflix is re-imagining entertainment with over 300 million paid memberships in over 190 countries on millions of devices. One of the ways we do this is by using insigh

Full-time

USD 170,000.00 per year

Senior Data Architect

Remote

•

Today

Join a leading provider of technology solutions for government and commercial clients, recognized for its expertise in cloud services, data analytics, and application development. The team is dedicated to solving complex challenges and delivering high-impact results for its customers. As a Senior Data Architect you will serve as the lead Data Solutions Architect for a federal data platform, responsible for designing data lakes, data warehouses, and pipelines for batch and streaming data. Require

Easy Apply

Full-time

$160000 - $190000

Data Integration Lead

Remote

•

22d ago

The Data Integration Lead/Architect will be responsible for designing, building, and optimizing the high-volume, reliable data pipelines that integrate data fromAzure Databricks (source)environments into theAzure Data Lake Storage (ADLS)and ultimately into theSnowflake Data Warehouse (target). This role requires deep expertise in the Microsoft Azure Data stack, Databricks/Spark optimization, and Snowflake architecture to ensure data quality, security, and performance across the entire data lifec

Easy Apply

Contract, Third Party

Depends on Experience

Databricks Solution Architect

Remote

•

Today

Position: Databricks Solution Architect Location: Remote-USA Employment Type: Full-time Role Work Authorization: This role is not eligible for company sponsorship now or in future. JD: Ability to work with Senior leadership, VP's/Senior directors and directors in the areas of Analytics, Data Science, AIML and Business analysts while exhibiting effective communication and dynamic Databricks architecture, in particular Photon, Liquid Clustering, Spark EMRS workloads, Autoloader, AI for coding,

Easy Apply

Full-time

Engineering Manager II, Big Data Storage

Remote or Palo Alto, California

•

Today

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility

Full-time

USD 177,185.00 - 364,795.00 per year

Software Engineer (L5) - Commerce Data Engineering, Foundations Team

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. About the Commerce Data Engineering: The Commerce Data Engineering ensures the availability, reliability, and quality of the critical data that powers our product exper

Full-time

USD 100,000.00 per year

Data Architect

Remote

•

Today

Leidos has an exciting opportunity for an experienced Data Engineer/Architect to support the design of a new data foundation. This foundation will drive AI/ML tools for both generative and predictive applications and enable analysis of diverse data sets. We are looking for an engineer with the ability to define the foundation (tools, schemas, and ontologies) and document that definition so that software engineers can implement, and management can understand the capabilities that the foundation

Full-time

USD 107,900.00 - 195,050.00 per year

Senior Machine Learning Engineer

Remote

•

Today

Join a leading provider of technology solutions for government and commercial clients, recognized for its expertise in cloud services, data analytics, and application development. The team is dedicated to solving complex challenges and delivering high-impact results for its customers. As a Senior ML Engineer you will deliver scalable, secure AI solutions by applying modern ML, data engineering, and platform-based development-especially within Palantir Foundry. The ideal candidate has hands-on Fo

Easy Apply

Full-time

$140000 - $170000

Sr. Azure Cloud DevOps Engineer (Healthcare exp is must) with certifications

Remote

•

15d ago

Position: Sr Azure Cloud DevOps Engineer (Healthcare exp is must) Location:100% remote Experience: 10+ years Must have updated LinkedIn Candidate must show the DL copy on video at the time of submission Description: Looking for Cloud Platform Engineer who is proficient in Azure cloud, Azure data bricks, Apache Spark, IaC tools, AI/ML. Hands on experience working on cloud data platforms Strong proficiency in Terraform, Python, Apache Spark/PySpark, SQL, and Shell scripting. Familiar with He

Easy Apply

Contract, Third Party

Depends on Experience

Application Architect - Microservices

Remote

•

18d ago

Title: Senior Software Engineer Work Location: Bellevue, WA (Pref) Remote - Acceptable Position Type: Contract Duration: Long Term Required skills: 7+ years of experience in software development with at least 3 years in AWS cloud architecture.Strong ability in AWS services: S3, Lambda, Step Functions, Aurora DB, Redis, Redshift.Experience with workflow orchestration tools like Conductor.Solid understanding of data modelling, ETL pipelines, and data warehousing.Ability in programming language

Easy Apply

Contract, Third Party

$60 - $70

Software Engineer - Open Connect Control Plane

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Netflix has been changing the way people watch shows and movies, and we've built a global Content Delivery Network called Open Connect, which sets the standard for vide

Full-time

USD 100,000.00 per year

Senior Software Architect, Observability Platform

Remote or Santa Clara, California

•

Today

NVIDIA's Infrastructure organization is seeking a Senior Software Architect for our Observability Platform to architect and implement distributed observability systems for data centers enabling EDA workflows. We serve and collaborate directly with NVIDIA's rapidly growing HW, and SW engineering teams across the company. You will be working with a team of dedicated engineers on systems for data collection, aggregation, enrichment, storage, retrieval, and visualization to spectacularly improve eff

Full-time

USD 184,000.00 per year

Backend & Applied AI/ML Engineer

Remote or Portland, Oregon

•

Today

At eBay, we're more than a global ecommerce leader - we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the futur

Full-time

USD 115,200.00 - 199,700.00 per year

Senior AI Architect / Data Scientist - Remote Job

Remote

•

Yesterday

Senior AI Architect / Data Scientist REMOTE - USA Key Responsibilities Provide technical leadership across AI architecture model integration, and delivery. Architect end-to-end AI pipelines using Databricks (Delta, Unity Catalog, MLflow, Model Serving). Integrate GenAI platforms (Mosaic AI, Genie, Azure OpenAI) and orchestrate them via an MCP server for NL SQL and conversational intelligence. Implement governed, cost-optimized MLOps pipelines with retraining, lineage, and observability. Build mu

Easy Apply

Contract

Depends on Experience

Security ML Engineer (L5)

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. The team you will join: We leverage data and ML to identify anomalies, detect threats, and automate security decisions at Netflix scale. Our work defends against accou

Full-time

USD 190,000.00 per year

Software Engineer L4 - Revenue Finance Infrastructure

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. The Revenue Infrastructure team's mission is to streamline revenue financial workflows so that our financial teams can close the books with a high degree of accuracy an

Full-time

USD 100,000.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Apache Spark jobs in Minneapolis, MN, USA