apache spark Jobs in minneapolis, mn

Refine Results
1 - 20 of 247 Jobs

Apache Spark Engineer

Capital Info Group Inc.

Remote

Contract, Third Party

Apache Spark Engineer Remote (PST zone) 12+ months Contract Must Required: Must be a "Apache Spark Community Committer" Must have worked on open-source projects contributions to Apache Spark

Spark Developer

Amiseq Inc.

Remote

Contract

Spark Developer Remote 12 Months Contract We are working with a strategic customer and looking specifically for an individual with: Deep expertise when it comes to identifying and fixing bottlenecks in Spark jobs. This role will also require structured streaming expertise to build/optimize jobs. Please let us know if you can share a couple of profiles, we will be happy to review them asap! Identifying and Fixing Bottlenecks in Spark Jobs: Dive deep into Spark applications to identify perfor

Spark Developer - 10+ years of experience

Next Level Business Services, Inc.

Remote

Third Party, Contract

Spark Developer - 10+ years of experience 12+ months Remote This role requires a person to have strong development background with 5+ years of Hands-On Application Development experience. 5+ Years Experience in Spark and Python. 5+ Years Experience of DataBricks(DBRX models.) 3+ Years Experience working with AZURE AI studio. Strong Debugging skills (Stack traces, log files, and other system outputs) Must have worked on Agile driven development. Should be pro-active in providing technical solu

Spark/ Scala Engineer

Aptino

Remote

Contract

Hands on experience Spark, Scala, Python Strong experience with big data methods and with retrieving data Perform detail exploratory data analysis various file formats (Parquet, AVRO, CSV, JSON). Build and enhance Spark-based frameworks Experience with Single Store, Snowflake, Kafka, Nifi and AWS big data technologies is good to have. Experience of architecting data using cloud technologies. Extensive Hands-on experience with Azure cloud services.

Big Data Engineer - Spark/Databricks

Eliassen Group

Remote

Contract

**Hybrid - candidate must be local to Atlanta, GA to go onsite 2-3 times a month.** Our transportation client is looking for a Big Data Engineer - Spark/Databricks to join their team. Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Pay Rate: $65.00 - $70.00/hr on W2 Skills, experience, and other compens

Direct Client:: W2 Position :: Need Sr. Hadoop Developer with CDP, Spark, Scala, Python & Healthcare Exp.:: 100% Remote

Synergy Technologies, LLC

Remote

Contract

W2 Contract to Full Time position = Role: Senior Hadoop Developer Location: 100% Remote Job Description: Responsible for the design, development and operations of systems that store and manage large amounts of data. Job Requirements: Experience and understanding with unit testing, release procedures, coding design and documentation protocol as well as change management procedures Proficiency using versioning tools Thorough knowledge of Information Technology fields and computer systems Demo

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Hbase Database Engineer (100% Remote)

Performix Business Services, LLC

Remote or Saint Paul, Minnesota, USA

Contract

Database Engineers administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistance to

Data Science Engineer

Ledelsea

Remote or Arden Hills, Minnesota, USA

Contract

Role: - Data Science Engineer Location: - Arden Hills, MN (Remote) Type of hire: - Contract Responsibilities: The data science engineer will be a critical part of a small team tasked with advanced analytics related to sustainable agriculture and large-scale crop operations. In this role, you will: Provide technical expertise to a team strong in agronomic sciences Leverage statistical analysis and machine learning to support informed, data-driven decision making Incrementally improve a data scie

Sparks Developer

NTT DATA Americas, Inc

Remote or Canton, Massachusetts, USA

Contract

About NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and s

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Lead AI/ML Engineer - Remote

UnitedHealth Group

Remote or Eden Prairie, Minnesota, USA

Full-time

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Lead Data Scientist - Experimentation

Target Corporation

Brooklyn Park, Minnesota, USA

Full-time

The pay range is $126,600.00 - $227,900.00 Pay is based on several factors which vary based on position. These include labor markets and in some instances may include education, work experience and certifications. In addition to your pay, Target cares about and invests in you as a team member, so that you can take care of yourself and your family. Target offers eligible team members and their dependents comprehensive health benefits and programs, which may include medical, vision, dental, life

Software Engineer

Judge Group, Inc.

Minneapolis, Minnesota, USA

Full-time

Location: Minneapolis, MN Salary: $69.00 USD Hourly - $74.00 USD Hourly Description: Software Engineer Location: Minneapolis, MN Duration: 12 months (Hybrid work type) Responsibilities: The Lead Engineer will participate in the design, development, testing, and implementation of new or modified applications software. They will have knowledge and experience in the following areas: Database Concepts and Modeling: Strong understanding of relational database concepts, SQL (Structured Query La

Data Engineer - Data Analyst (No C2C - Only W2) (PST, MST, CST Only)

HireTeq

Remote

Contract

Client Software company for Financial Tax filling Role: Data Support Specialist Location: Remote, must work PST Duration: 12+ months Project and Role Overview: Client develops internal proprietary toolsets aggregating multiple data pipelines to aid their Data Analysts and SME's to ease the review and analysis of data. This role will be a part of this team and provide first level support to the users of these toolsets. Role Requirements: 1-to-3 year experienced person is okMust have proven exper

Senior Data Engineer - 2236714

UnitedHealth Group

Eden Prairie, Minnesota, USA

Full-time

Senior Data Engineer - 2236714 EMPLOYER: Optum Services, Inc. JOB TITLE: Senior Data Engineer LOCATION: 11000 Optum Circle, Eden Prairie, MN 55344 (Telecommuting available from anywhere in the U.S.) DUTIES: Design strategies for enterprise databases, data warehouse systems, and multidimensional networks. Duties include: Conduct gap analysis to compare the client's data structure and content to that of the standard implementation for that EMR, Billing and other sources; Review client's data to lo

Data Engineer

Scigon Solutions

Remote

Full-time, Contract

Responsibilities: Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Apache Airflow (MWAA) and Apache Spark. Big Data Solutions: Implement and manage big data technologies such as Oozie and Hbase. Cloud Infrastructure: Leverage AWS services for deploying and managing data processing solutions. Programming and Scripting: Write efficient, maintainable code primarily in Java and Python, with additional work in Scala where applicable. Infrastructure as Code (IaC):

Senior Data Scientist with Gen AI (W2 Only)

Opallios

Remote

Contract

Job Title - Senior Data Scientist with Gen AI Job Location - 100 % Remote (USA) Duration Long Term (W2 Only) Job Description Essential Duties/Responsibilities - Understanding of machine learning and deep learning models to select and implement for prediction, classification, and clustering projects - Apply machine learning or reinforcement learning to optimize marketing efforts with respect to customer acquisition, retention, pricing, cross-selling, operations and trading - Passion to learn l

Data Engineer with Pyspark and Healthcare

Infinite Computer Solutions (ICS)

Remote

Full-time

Hi Greetings from Infinite Computer Solutions ! Hope you are well today! I'd like to discuss a job opportunity with you. Hope you would be interested. Position: Data Engineer (Remote) Location: Remote Develop Spark jobs to identify potential overpayment opportunities using Pyspark SQLExperience in the creation and maintenance of ETL scripts, tools, queries, and applications used for healthcare data management, data validation, statistical report generation, and program validation.Strong workin

Lead Data Engineer 15+ years of exp needed

Tech Rakers

Remote

Contract

Title: Lead Data Engineer Top Skills' Details Python - candidates must have advanced to expert Python experience SQL Spark AWS Job Duties . Engineer data solutions in support of Sustainability reporting and analytics initiatives . Engage with product owner, analysts, visualization developers, and business partners to understand capability requirements, and to develop and support data solutions based on product backlog priorities