Apache Spark Jobs in Minneapolis, MN

Refine Results
1 - 20 of 176 Jobs

Sr. Data Engineer (Spark)

JBC powered by Workgenius

Remote or New York, New York, USA

Contract

Sr. Data Engineer with Top Mass Media & Entertainment Company Location: EAST COAST PREFERRED(NYC/ORLANDO) BUT OK WITH FOLKS ON WEST COAST SINCE THE TEAM IS SPREAD OUT. Contract duration: 3 months + (very likely to extend) Rate: up to $93/HR (W2 ONLY) Summary: The Product Performance Data Solutions team for the Data organization within Streaming is in search of a Senior Data Engineer. As a member of the Product Performance team, you will work on building foundational datasets from clickstream a

Remote Sr. Hadoop Developer (Spark/PySpark/Scala)

Software Guidance & Assistance

Remote or Jacksonville, Florida, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Sr. Hadoop Developer for a CONTRACT assignment with one of our premier Healthcare Services clients for a Remote position. Top Skills Needed: Candidate must have proven development experience with Spark/Scala and Python (PySpark) Ab Initio development experience highly preferred Responsibilities: A Hadoop developer is responsible for the design, development and operations of systems that store and manage large amounts of

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Hbase Database Engineer (100% Remote)

Performix Business Services, LLC

Remote or Saint Paul, Minnesota, USA

Contract

Database Engineers administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistance to

Sparks Developer

NTT DATA Americas, Inc

Remote or Canton, Massachusetts, USA

Contract

About NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and s

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Sr Software Engineer - Analytics - Remote

Optum, Inc

Remote or Plymouth, Minnesota, USA

Full-time

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Sr. Big Data Engineer

DHANU GLOBAL ENTERPRISES, INC.

Remote

Contract, Third Party

Position Title: Sr. Big Data Engineer Location: San Bruno, CA (Remote)Duration: 12+ Months with Possibility of Extension Primary Skills :SQL,Java Job Description: Strong in real time & batch pipelines in big data technologies (i.e. Spark/Kafka/Cassandra/Hadoop/Hive/Elasticsearch) Proficient in RESTful Services, Java, Scala, Spring Boot/Play Framework, RDBMS, NoSql, Python, Trino, Airflow, Looker, Bit Query Proficient in development of scalable cloud native microservices Proficient with Design

Sr. Data Engineer(Data Bricks Certified)

Amiseq Inc.

Remote

Contract

1. 4+ Years Data Engineering Experience, 5+ years of consulting experience 2. Completed Data Engineering Professional certification & required classes 3. Minimum 2-3 projects delivered with hands-on experience in Databricks 4. Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache SparkTM on Databricks 5. Experience in Spark and/or Hadoop, Flink, Presto, other popular big data engines 6. Familiarity with Databricks multi-hop pipeline architecture

Sr Software Engineer - Remote

Optum, Inc

Remote or Eden Prairie, Minnesota, USA

Full-time

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and Cthey need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance heal

Pyspark Developer

People Force Consulting Inc

Remote

Contract, Third Party

Role - Pyspark Developer Experience level - 9+ Years of experience Remote / EST work hours Tentative Duration - 6 - 12 months Mandatory Skills: Apache Spark, ETL, Netezza, Stored Procedures, SQL Job Description; Skillset (Must have) 1)Hands-on experience on Spark based application using PySPark 2)Experience in writing IBM Netezza based SQL queries & Store procedure 3)Good understanding on Ab Initio ETL tool for data processing. 4)Knowledge on writing & executing Shell script program. 5)Excellen

Big Data Engineer

CitiusTech

Remote

Full-time

Job Title: Big Data Engineer Skills and JD: Spark, PySpark, AWS, Big Data, Python, SQL Mandatory skills: Big Data with Databricks, Spark, PySpark, SQL Job Description: 1. Strong technical expertise in SQL, Python, Spark, PySpark and Databricks 2. Strong experience playing architect or lead role on Big Data project 3. Should have good experience working of scrum process 4. Should be fine to playing scrum master role for offshore team 5. Good communication skills 6. Well versed with onsite o

Senior Big Data Engineer (Scala)

JBC powered by Workgenius

Remote

Contract

Sr. Big Data Engineer (Scala) for Top Mass Media & Entertainment Company Location: REMOTE Contract Duration: 19 months + Pay rate: up to $100/HR Summary: We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E solutions covering tech areas ranging from machine learning, big data, microservices to data visualization. Our team is seeking a senior software engineer who will be a core team member for our advert

Hadoop Developer ( 100% Remote -Only on W2)

Synergy Technologies, LLC

Remote

Contract

Job Title: Hadoop Developer Client Location: Jacksonville, FL (100% Remote) Duration: Long Term Job Description A Hadoop developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics. IT Developers are responsible for development, programming, coding of Information Technology solut

Principal Data Engineer, Infusion Operations - Remote

Optum, Inc

Remote or Eden Prairie, Minnesota, USA

Full-time

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Data Scientist

VDart, Inc.

Remote or Oakland, California, USA

Contract, Third Party

Job Title: Data Scientist Location: Oakland, CA (Remote) Duration: 12+ Months Contract Job Description: 4+ years' experience delivering DevOps and MLOps in a Production/Enterprise setting Bachelor's degree required; Masters preferred in Computer Science or Data Science Excellent written and oral communication and presentation skills. Experienced in a technical role involving platform and infrastructure operation. System administration experience of Unix or Linux systems. Container-based deploy

Big Data Engineer (No C2C)

AptoNet Inc

Remote or Atlanta, Georgia, USA

Contract

Our client is currently seeking an experienced Big Data Engineer for their Midtown office in Atlanta, GA. The successful candidate must have substantial Big Data engineering experience and demonstrate an affinity for working with others to create successful solutions. Join a smart, highly skilled team with a passion for technology where you will work on our state-of-the-art Big Data Platforms. You must be an excellent communicator, both written and verbal, and have experience working with busine

Azure Databricks Engineer | Full Time Position | Remote

Bramkas Inc.

Remote

Full-time

Azure DataBricks Engineer Location: Flexible/RemoteExperience Level: Mid to SeniorMust-Have Skills:AzureDatabricks with Scala (MUST HAVE)Experience withAzure Data Factory (ADF) dataflow and ADF pipelines (MUST HAVE)Practical experience in handling error or invalid formats in incoming data.Experience working with Delta table formats (Must) Job Description: We are looking for a skilled Data Engineer with expertise in Databricks and Scala to join our team. The ideal candidate will have hands-on e

Principal Intelligence Analyst - Remote

Optum, Inc

Remote or Eden Prairie, Minnesota, USA

Full-time

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Azure Data Architect

Intraedge

Remote

Third Party, Contract

Job Title: : Azure Data Architect Location: REMOTE Duration: Long Term Contract Responsibilities: Engineer Azure-based solutions with a focus on cost-efficiency, performance, and operational effectiveness. Craft and enforce a framework to quantify data quality across various customer and prospect sources, ensuring data accuracy, completeness, consistency, and timeliness. Scrutinize first-party customer data sources to establish the most reliable ones and formulate ingestion strategies for both