apache spark jobs in minneapolis, mn

Senior/Lead Data Engineer-Python,Spark & SQL (Only W2)

Remote or New Jersey

•

Today

Description: We are in search of a Senior Data Engineer who is adept in SQL, Python, and Spark, and ideally with an experience in AI-related tasks and API integrations for chatbot development/integration. SQL Expertise: Essential for complex query handling and database manipulation. Python Proficiency: Required for automation, data processing, AWS Bedrock API integration, and chatbot development workflows using Boto3 SDK Spark Familiarity: Needed for large-scale data processing. Responsibilit

Easy Apply

Contract

Data Engineer w/ Spark/Scala Exp

Remote

•

2d ago

Key Responsibilities: Design, develop, and maintain scalable big data solutions using Apache, Spark and Scala. Implement complex SQL queries for data transformation and analytics. Develop and optimize Power BI dashboards for business reporting and visualization. Collaborate with cross-functional teams to integrate data pipelines and reporting solutions. Ensure data quality, security, and compliance across all systems. Required Skills & Experience Strong proficiency in Apache, Spark with hands-on

Easy Apply

Contract

$60+

Senior Java Spark Engineer - Tech Lead - Vice President

Remote or Jersey City, New Jersey

•

Today

We are seeking a highly skilled and experienced Senior Java Spark Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and implementing robust and scalable data processing solutions using Core Java, Sprint Integration Framework, and Apache Spark. You will play a crucial part in integrating these solutions into our existing data infrastructure, addressing complex data challenges, and providing technical leadership. The ideal candidate will possess a

Full-time

USD 142,320.00 - 213,480.00 per year

Azure Data Engineer - Minneapolis, MN

Minneapolis, Minnesota

•

Today

Job Title: Azure Data Engineer Location: Minneapolis, MN Domain: Healthcare Long Term Contract Looking for W2 Candidates. No C2C Responsibilities: Design, develop, and maintain scalable data pipelines and architectures on Azure Cloud. Implement and manage Azure Data Lake solutions to store and process large volumes of data. Utilize Databricks for data processing, transformation, and analytics. Develop and maintain ETL processes using Azure Data Factory. Write efficient and optimized SQL queri

Contract

$DOE

Lead AI/ML Engineer - 2333302

Eden Prairie, Minnesota

•

Today

Lead AI/ML Engineer - 2333302 EMPLOYER: Optum Services Inc. JOB TITLE: Lead AI/ML Engineer LOCATION: 1 Optum Circle, Eden Prairie, MN 55344 (Telecommuting available from anywhere in the U.S.) DUTIES: Design, lead and implement systems that derive information from patient data in a scalable, reliable, and cost-effective manner. Analyze clinical data and determine the best designs on how to process this data. Ensure the delivery of high-quality, maintainable, and efficient code. Lead systems desig

Full-time

USD 147,297.00 - 257,040.00 per year

Software Engineer - 2333294

Eden Prairie, Minnesota

•

Today

Software Engineer - 2333294 EMPLOYER: Optum Services Inc. JOB TITLE: Software Engineer LOCATION: 1 Optum Circle, Eden Prairie, MN 55344 (Telecommuting available from anywhere in the U.S.) DUTIES: Research, design, and develop computer and network software or specialized utility programs. Duties include: Design, develop and maintain Value Connect web solutions using React; develop, enhance and maintain analytical enrichments using Spark/Scala deployed to AWS/Azure cloud environments; enhance and

Full-time

USD 145,018.00 - 191,520.00 per year

Lead AI/ML Scientist - Remote

Remote or Eden Prairie, Minnesota

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health op

Full-time

USD 110,200.00 - 188,800.00 per year

Machine Learning Engineer

Saint Paul, Minnesota

•

Today

Job#: 3013061 Job Description: Apex Systems is partnering with one of our top Financial Services clients to find a talented Senior Machine Learning Engineer to join their growing team in St. Paul, MN. If you're looking for a role where you can make an impact, grow your skills, and work with a respected organization-this could be the perfect fit! Position Summary We are seeking a Senior Machine Learning Engineer to design, build, and implement machine learning solutions that address key busine

Easy Apply

Full-time

Data Engineer - 2333495

Eden Prairie, Minnesota

•

Today

Data Engineer - 2333495 EMPLOYER: Optum Services Inc. JOB TITLE: Data Engineer LOCATION: 1 Optum Circle, Eden Prairie, MN 55344 (Telecommuting available from anywhere in the U.S.) DUTIES: Develop and implement a set of techniques or analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software. Duties include: Support Life Sciences operations, product builds, data delivery and platform maintenance activities; Manage

Full-time

USD 97,032.00 - 139,678.00 per year

Databricks Lead

Remote

•

12d ago

Key Responsibilities Lead implementation of modern data solutions on DatabrickImplement data governance, access control, and lineage using Unity Catalog.Optimize ETL/ELT processes and Spark workloads for high performance.Collaborate with data engineers, analysts, and scientists to ensure business and technical alignment.Provide guidance on cloud data architecture and CI/CD best practices.Required Skills & Experience 8 10 years in Big Data Engineering with Apache Spark; 3 4 years hands-on with Da

Easy Apply

Contract

Depends on Experience

Lead Software Engineer - Remote

Remote or Eden Prairie, Minnesota

•

Today

Full-time

USD 89,900.00 - 160,600.00 per year

Azure Data Engineer

Remote

•

30+d ago

Year of exp In Synapse, Year of exp in IAAS, SQL Server Year of exp in ADLS Gen 2 Year of exp in Azure Automation account runbooks using PowerShell, spark, scala programming Data Engineer PST time zone only Remote Key skills Synapse, IAAS, SQL Server, ADLS Gen 2, Azure Automation account runbooks using PowerShell, spark, scala programming 1. Experience with Azure technologies like Synapse, IAAS VM, SQLserver and ADSL Gen 2 2. Experience with developing, maintaining, and debugging Azure automa

Easy Apply

Contract

$30 - $55

Lead Bigdata Engineer

Remote

•

Today

Lead Engineer- Big Data (Fulltime Role) The Lead Engineer Analytics (Advanced Software Engineer) will report to a Senior Manager - Analytics. Using Big Data technology, you will be responsible for designing, developing, implementing and supporting data analytics solutions utilizing cloud architecture. Primary Responsibilities: Lead, build and deliver projects with high impact and cross-portfolio scope, complexity and collaboration with cross-functional teams, both business and technology Iden

Easy Apply

Full-time

Depends on Experience

Senior Engineer - Fraud & Abuse Data Engineering

Brooklyn Park, Minnesota

•

Today

The pay range is $95,000.00 - $171,000.00 Pay is based on several factors which vary based on position. These include labor markets and in some instances may include education, work experience and certifications. In addition to your pay, Target cares about and invests in you as a team member, so that you can take care of yourself and your family. Target offers eligible team members and their dependents comprehensive health benefits and programs, which may include medical, vision, dental, life i

Full-time

USD 95,000.00 - 171,000.00 per year

Data Warehouse Administrator

Remote or Salt Lake City, Utah

•

Today

Data Warehouse Administrator Remote 6 months MADlib, PXF, GPCC, gpfdist, gpload, gpbackup/gprestore, gpdr backup/restore SQL development skills in data warehousing environments Bash scripting and Python UNIX/Linux (RHEL) environments Terraform or other infrastructure-as-code tools ETL technologies (e.g., IBM DataStage) cloud platforms (AWS, Google Cloud Platform, Azure) Databricks and Spark-based data processing containerization (Docker, Kubernetes) and CI/CD pipelines

Easy Apply

Third Party, Contract

ITSS-Big Data/Hadoop/Splunk Tester

Remote or Hybrid in Louisville, Kentucky

•

Today

ITSS-Big Data/Hadoop/Splunk Tester - 25-06801 100% REMOTE 6+ Months Duration W2 or C2CAt NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors in our company's growth and market presence. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here.For more than 25 years, NTT DATA Services have focused

Easy Apply

Contract

BASED ON EXPERIENCE

DATA Engineer - Remote - W2 only

Remote

•

6d ago

Position: DATA Engineer Location San Jose, CA (Remote) Duration: 12 Months Skills Mandatory Skills: Python Job Description: Experienced Data Engineer with strong expertise in building scalable data pipelines, API-based data ingestion and data-as-a-service solutionsSkilled in designing metadata-driven self-service data platforms that enable rapid onboarding of producers and consumersHands-on with cloud data ecosystems, AWS, Azure, Spark SQL and PythonAdept at developing REST APIs, optimizing da

Easy Apply

Contract

Depends on Experience

Senior Data Engineering Specialist

Minneapolis, Minnesota

•

Today

At U.S. Bank, we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and dis

Full-time

USD 105,400.00 - 124,000.00 per year

Senior Data Engineer

Remote or Hybrid in Cleveland, Ohio

•

Today

Are you an experienced Data Engineer looking for a change? Do you want to work with cutting edge technology for an established Fortune 100 company on a fully remote basis? Our client is looking for a Senior Data Engineer to join their dynamic Media Data and Analytics team, where you would be at the forefront of leveraging data to optimize digital adverstising campaigns. You'd play a key role in building the necessary infrastructure, integrating models, and enhancing data pipelines to support the

Easy Apply

Contract

DOE

Data Architect

Remote

•

21d ago

Role :: Data Architect Location :: Remote Type :: Fulltime Job Description Must Have Technical/Functional Skills: Strong expertise in data modeling techniques (conceptual, logical, physical). Proficiency in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). In-depth knowledge of data warehousing concepts and tools (e.g., Redshift, Snowflake, Google BigQuery) Experience with big data platforms (e.g., Hadoop, Spark, Kafka). Familiarity with cloud-based data platforms and servic

Easy Apply

Full-time

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

apache spark jobs in Minneapolis, MN, USA