Apache Spark jobs in Minneapolis, MN

Remote

•

Today

We are looking for a Lead Data Quality Engineer to drive the data quality testing strategy across our products, collaborating with cross-functional teams to ensure data reliability, governance, and performance meet the highest standards. Responsibilities Work with product, engineering and customer teams to understand requirements and implement a quality testing strategy, defining and setting up data quality metrics Design and implement a quality verification strategy for data products and ensure

Full-time

Data Engineer / Business Analyst

Remote

•

15d ago

Seeking a Data Engineer / Business Analyst to support a large-scale Databricks implementation. This hybrid role will bridge business, contracting, data-governance, and engineering teams to define business requirements, construct data contracts, map source data, and develop reliable Databricks data pipelines. The successful candidate must have hands-on experience with the Open Contracting Data Standard (OCDS) and understand how contracting and procurement information is structured across planning

Easy Apply

Contract

Depends on Experience

Enterprise Solution Engineer - South East / Mid Atlantic

Remote

•

Today

Location: South East / Mid Atlantic Region Sigma's vision is to create an insight-driven world where people, organizations, and, ultimately, humanity are transformed for the better by data. At Sigma, we are building a cloud-native business intelligence platform that allows users to tap into their biggest databases hosted in the cloud and easily conduct ad hoc analysis to gain business insights in seconds. All without any SQL programming. We are growing the Solution Engineering team and are look

Full-time

Remote || Data bricks Architect (Healthcare Domain)

Remote or Hybrid

•

Today

Position: Databricks Architect (Healthcare Domain) Location: Remote Job Description Required Skills & Experience 15+ years of overall experience in Data Engineering, Data Architecture, Data Warehousing, Analytics, or Business Intelligence. Strong hands-on experience with AWS cloud services and enterprise-scale Databricks implementations. Proven experience serving as a Lead Architect or Principal Architect for enterprise data platform initiatives. Advanced expertise in Python, PySpark, Spark S

Easy Apply

Third Party, Contract

$85

Senior Data Engineer

Remote

•

Today

Job Description 8+ years in data engineering/data warehousing; 3+ years delivering Azure solutions and productionMicrosoft Fabric experienceAdvanced T-SQL, Spark SQL, Python/PySpark; working knowledge of KQL and DAXDeep experience with Delta Lake, Spark tuning, medallion/lakehouse patterns, CDC and incremental loadingStrong dimensional modeling and working knowledge of Data Vault 2.0Practical CI/CD, Git, automated testing, infrastructure as code, DataOps, governance and security experienceProfe

Full-time

Sr Data Engineer

Remote or Nebraska

•

Today

The work we do has an impact on millions of lives, and you can be a part of it. We help protect our customers against life's uncertainties. Regardless of where you work within the company, you'll be helping provide protection and peace of mind when our customers need it most. Protective is looking for Data Engineers to design, build, and operate production data pipelines on Voyager, our Databricks lakehouse on Azure. You will own the end-to-end flow of data through a medallion architecture - in

Full-time

USD 84,000.00 - 128,667.00 per year

Forward Deployed Engineer I (Remote, US)

Remote

•

Today

About Sayari: Sayari is the judgment infrastructure for trustworthy AI in economic security and commercial risk. The Sayari Commercial World Model resolves 11.7B+ primary-source records from 250+ jurisdictions forming the ground truth of global commerce. A Judgment Ontology, encoding over a decade of investigative tradecraft, and Superconductor, an agentic orchestration platform, deliver AI that reasons like an expert analyst, shows its work, and traces every finding to its source. Trusted by U.

Full-time

USD 119,000.00 - 149,000.00 per year

Data Scientist, 2027 Graduate U.S.

Remote or Seattle, Washington

•

Today

Overview Working at Atlassian Atlassians have the flexibility to work where they can collaborate most effectively with their team, whether at home, one of our global offices, or both. We hire in any country where we have a legal entity. Learn how we work at go.atlassian.com/distributed. Your Future Org Atlassian's Grad++ program combines hands-on technical training, professional growth opportunities, dedicated mentorship, and strong social connections. This holistic approach empowers student

Full-time

USD 124,200.00 - 162,150.00 per year

Data Analyst I (ERIB)

Remote

•

Today

Overview Goldbelt Professional Services specializes in providing expert resources for Public Health missions including scientific, technical, and administrative support from junior staff to high-level subject matter experts. Research and data driven, Goldbelt Professional Services' experts create solutions customized to the client's needs. Summary: Goldbelt Professional Services is seeking a Data Analyst I to provide data management and analytic expertise support for the Epidemiology Research

Full-time

USD 80,000.00 - 90,000.00 per year

Staff Data Platform Engineer

Remote or Atlanta, Georgia

•

Today

At PrizePicks, we are the fastest-growing sports company in North America, as recognized by Inc. 5000. As the leading platform for Daily Fantasy Sports, we cover a diverse range of sports leagues, including the NFL, NBA, and Esports titles like League of Legends and Counter-Strike. Our team of over 550 employees thrives in an inclusive culture that values individuals from diverse backgrounds, regardless of their level of sports fandom. Ready to reimagine the DFS industry together? Staff Data Pla

Full-time

USD 200,000.00 - 220,000.00 per year

Data Engineer V - US

Remote

•

Today

Data Engineer V Exp - 10+ years. Have worked extensively within the Healthcare domain. EMR/EHR experience, specifically Epic and/or Cerner:Have partnered closely with Healthcare Providers, Clinical Operations teams, or Healthcare Organizations.Understand healthcare data standards and compliance frameworks such as HIPAA, HL7, and FHIR.Have experience translating provider and clinical stakeholder needs into scalable data solutions. Leads the technical direction, delivery standards, and day-to-da

Full-time

USD 165,830.00 per year

Staff Product Security Engineer

Remote

•

Today

Chainguard is the trusted source for open source. By delivering hardened, secure, and production-ready builds of all the open source software engineers and AI agents rely on, Chainguard helps organizations build faster, stay compliant, and eliminate risk. Our customers include Fortune 500 enterprises and global industry leaders, including Anduril, Canva, Fortinet, Hewlett Packard Enterprise, OpenAI, Snap Inc., and Snowflake. Chainguard is venture-backed by leading investors, including Amplify, I

Full-time

USD 205,000.00 - 231,000.00 per year

Sr. Solutions Architect - Services Presales - Microsoft Fabric & Data Engineering

Remote

•

Today

About Us Since 1989, SHI International Corp. has helped organizations change the world through technology. We've grown every year since, and today we're proud to be a $16 billion global provider of IT solutions and services. Over 17,000 organizations worldwide rely on SHI's concierge approach to help them solve what's next. But the heartbeat of SHI is our employees - all 7,000 of them. If you join our team, you'll enjoy: Our commitment to diversity, as the largest minority- and woman-owned ent

Full-time

USD 128,000.00 - 176,000.00 per year

Databricks Data Engineer

Remote

•

Today

Description: Remote Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and SaaS solutions. You will partner with machine learning engineers, software engineers, data scientists, and analysts to deliver data products for clients and to support internal data practices. This is a full-time, permanent opportunity, offering a competitive salary and comprehensive benef

Full-time

USD 150,000.00 - 154,000.00 per year

Sr Generative AI Scientist II - (Model Risk)

Remote

•

Today

Overview Join a recently formed team focused on Model Risk and Responsible AI. The Senior GenAI Scientist II - Risk will apply knowledge and experience to real world problems and seek to utilize their skills to reduce the cost of healthcare and improve health quality and outcomes. As a Data Scientist on this team, you will focus on three main project areas: Model Validation, Model Metrics and Monitoring, and Responsible AI. This requires someone with depth in AI/ML/GenAI from a data science per

Full-time

USD 153,000.00 - 180,000.00 per year

Analytics Platform Engineer - Senior Associate

Remote or Chicago, Illinois

•

Today

Huron is redefining what a global consulting organization can be. Advancing new ideas every day to build even stronger clients, individuals and communities. We're helping our clients find new ways to drive growth, enhance business performance and sustain leadership in the markets they serve. And, we're developing strategies and implementing solutions that enable the transformative change they need to own their future. As a member of the Huron corporate team, you'll help to evolve our business m

Full-time

USD 138,000.00 - 189,750.00 per year

Staff AI Data Scientist (Remote)

Remote or Menomonee Falls, Wisconsin

•

Today

Role Specific Information Job Description About the Role As Staff AI Data Scientist, you will work with a data science team and cross-functional partners to solve business challenges and promote data-driven decision-making with advanced data analysis and machine learning. What You'll Do Use data and insights to make decisions, set goals and identify the right levers to achieve balanced team objectivesLead end-to-end data science projects from problem formulation to model deploymentOversee th

Full-time

Staff Software Engineer, Chainguard Harness

Remote

•

Today

Full-time

USD 205,000.00 - 231,000.00 per year

Principal Architect, EDT Cloud Data & Analytics (Remote)

Remote or Mahwah, New Jersey

•

Today

Work Flexibility: Remote As a Principal Architect, EDT Data & Analytics you will own the operational excellence, security, and reliability of the enterprise data & analytics platform on Azure. The role combines platform operations, DevOps automation, and Infrastructure as Code across the core stack - Azure Databricks, Synapse, ADLS Gen2, Azure SQL, Azure Data Factory, Key Vault, and Unity Catalog - with a reliability-engineering mindset: automate everything repeatable, secure everything by defa

Full-time

USD 135,600.00 - 225,900.00 per year

Principal Product Security Engineer

Remote

•

Today

Full-time

USD 229,000.00 - 258,000.00 per year

Apache Spark jobs in Minneapolis, MN, USA