Apache Spark Jobs in Detroit, MI

Refine Results
1 - 20 of 329 Jobs

Technical Lead Spark Streaming (Postgres SQL, Kafka)

Prism IT Corp

Remote

Third Party, Contract

10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack.Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization.Experience in Database Administration, specifically in PostgreSQL.Perform and oversee tasks such as writing scripts, calling APIs, and writing SQL queries.Implement data stores that support the scalable processing and storage of our high-frequency data.Hands-on experience with dat

Technical Lead Spark Streaming Lead (Postgres SQL, Kafka)

Prism IT Corp

Remote or New York, New York, USA

Contract

JD: 10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack.Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization.Experience in Database Administration, specifically in PostgreSQL.Perform and oversee tasks such as writing scripts, calling APIs, and writing SQL queries.Implement data stores that support the scalable processing and storage of our high-frequency data.Hands-on experience with

Technical Architect/ Spark Streaming Architect

TekLeaders, Inc

Remote or New York, New York, USA

Full-time, Part-time, Contract, Third Party

Title: Technical Architect Spark Streaming Architect (Postgres SQL, Kafka) - Kafka Admin with spark streaming Duration: 6 Months Location: 100% Remote (NYC, NY) Responsibilities: 10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack. Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization. Experience in Database Administration, specifically in PostgreSQL. Perform and oversee tasks such a

Senior Backend and Data Engineer - Java/Spark/Cassandra

Kunai

Remote or McLean, Virginia, USA

Full-time

Job DescriptionJob DescriptionKunai is a fast-growing digital consultancy focused on banking, payments, and fintech powered by a global network that attracts the best and brightest people from all backgrounds and cultures, driven by innovation and experimentation, spread across almost every single continent. Over the past decade, we've shipped over 150 products for clients that include Visa, American Express, Capital One, WEX, Wells Fargo, Ernst & Young, and TOMS Shoes. Our founders built a prev

Engineering Manager, Spark

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. The Role Big Data Analytics Platform (BDAP) group is responsible for providing orchestration and compute technologies to ETL and to access nearly 1 ExaByte of data in the Ne

Spark Streaming Architect (Postgres SQL, Kafka)

Pegasys Information Technologies

Remote

Contract, Third Party

Hi Please find below requirement. Spark Streaming Architect (Postgres SQL, Kafka) NYC, NY ( Remote) Contract Job Description 10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack. Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization. Experience in Database Administration, specifically in PostgreSQL. Perform and oversee tasks such as writing scripts, calling APIs, and writing SQL queri

Cloud Data Engineer - Dearborn, MI

Digital Technology Solutions

Dearborn, Michigan, USA

Contract

DTS is looking for Cloud Data Engineer for our direct client Position in Dearborn, MI Top Technical Skills Azure Databricks - will be asked to get the cert once they startMost people started in big data and moved to the cloudIdeal big data with exposure to cloud preferable AzureSpark if have this they will learn data bricks - Strong knowledge of programming languages such as Python, SQL, or ScalaSpark data engineer type roleReally looking for big data Hadoop, hive, spark along with java, pyth

Google Cloud Platform Data Engineer (W2- Hybrid) 318404

MeganSoft

Dearborn, Michigan, USA

Contract

Position: Google Cloud Platform Data Engineer with SAP (W2 Position) 318404 Location: Dearborn MI (Hybrid) Duration: 12+ Months MOI: Phone & WebEx Direct Client: FORD MOTORS Note: 1. U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are NOT ABLE to sponsor H1-B at this time. - H1B Consultant who are willing to WORK ON OUR W2 (H1B TRANSFER) are welcome Position Description: Materials Management Platform (MMP) is a multi-year transformation initiative aimed at tra

Michigan Location - ML Ops Engineer [ No C2C/1099 candidates can be considered ]

PMC

Troy, Michigan, USA

Contract

This is a W2 position, with benefits, for someone living in the Detroit MI area. This is a multi-year engagement that will be 3+ years. We cannot consider c2c or 1099 candidates. Description: Data MLOps engineer resource will be member of the Enterprise Data and Advanced Analytics team, working with cross-functional teams to leverage data and advanced analytical techniques and deliver data-driven solutions within an organization. This work entails supporting data ingestion processes and problem

LEAD, DATA ENGINEERING

JS Consulting Solutions

Detroit, Michigan, USA

Full-time, Part-time, Contract, Third Party

Job Title Lead Data Engineer Location Detroit, MI (Remote Role) Duration 12+ Month Contract Interview Mode :Phone/Video Job Description : The Role The Lead, Data Engineering will be responsible for driving the vision, and execution of Marketing Experimentation and Optimization Platform. This individual will be a technical leader and has expertise in building scalable Machine Learning data products for experimentation and optimization including experiment design, Statistical and ML models for

Advanced Gas Engine Senior Project Engineer

General Motors

Pontiac, Michigan, USA

Full-time

Description Hybrid: This role requires the Engineer to be onsite 3x a week. Time will be spent in both Pontiac, Michigan and Warren, Michigan depending on project needs. The Role The Advanced Engines group is responsible for the design and development of Advanced Internal Combustion Engines and related technologies that are approximately 5-7 years away from production implementation. The focus of the group is to identify and develop innovative technologies that meet future emissions and fuel ec

Senior Data Engineer - HV Battery Manufacturing Data Analytics

General Motors

Warren, Michigan, USA

Full-time

Description Are you a curious data engineer? Do you have a passion for data driven decisions? If so, Senior Data Engineer - Manufacturing Data Analytics position is for you! The Senior Data Engineer will play a crucial role in developing robust data pipelines to monitor high voltage battery systems using manufacturing end-of-line data. This role will contribute to enhancing the overall quality and reliability of high voltage battery systems through data-driven insights. This role is growing i

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Senior Data Engineer - HV Battery Analytics

General Motors

Warren, Michigan, USA

Full-time

Description Are you a curious data engineer? Do you have a passion for transforming the utilization of big data in the field of high voltage battery performance monitoring? If so, High Voltage Battery Senior Data Engineer position is for you! The Senior Data Engineer will develop data pipelines for monitoring high voltage battery performance and advanced cloud-based prognostics algorithms. This role is growing in response to the dramatic growth of hybrid and electric vehicle markets as well a

Data Engineer

Mahaugha LLC

Remote

Contract

Skill Set Expert in SQL, Spark, Python, pyspark, Azure Data bricks, Synapse, Tabular models and DaxProficient in Python ProgrammingStrong Skills in API DevelopmentExcellent communication skills for explaining technical details to cross functional teams

AI Big Data Engineer

Delphi-US

Troy, Michigan, USA

Contract

Job Title: AI Big Data Engineer - Contract - Job #5242 Location: Hybrid near Troy, MI Job Description: You will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of our clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and Kubernetes, to handle large-scale and complex data challenges. You will also collabora

Reltio Experienced Engineer - 100% Remote - (#CH)

Pioneer Corporate Services Inc

Remote

Contract

Job: Reltio Experienced Engineer Remote Role Long term Job Description Reltio Experienced EngineerData Engineering Spark/SQLOptional AWS ClouldGood CommuncationRoles & Responsibilities Reltio Experienced EngineerData Engineering Spark/SQLOptional AWS ClouldGood CommuncationYears Of Experience 5 to 8 Years

Data Engineer

Heliogic LLC

Remote

Full-time

Job Title : Data Engineer Location : Remote Full Time must be open to taking a hackerrank test. Remote but prefer Seattle/NJ/LA JD : 8 years of experience in data engineering with expertise in SQL, Python, Spark Hands-on experience with Snowflake, Databricks tools Knowledge of cloud technologies like AWS and Azure Experience in building and optimizing data pipelines for large datasets Proficiency in writing and optimizing SQL queries

Scala Developer // Remote 100% // Only W2

Siri Infosolutions Inc

US

Contract

Only W2 No C2C, CTH, 1099 Senior Scala Developer! PLEASE NOTE, we are looking for candidates that come from a Software development background and will NOT submit those from Data Engineering background. Title: Senior Scala Developer REMOTE Duration: 7 months Contract on W2 Required Skills: 7+ years of experience with hands on development with Scala and Spark. This role is 100% hands on development. Scala is the top programming requirement for this role. Need someone strong in Scala. Bulk of the

Staff Data Scientist

General Motors

Warren, Michigan, USA

Full-time

Description The Role This is a unique opportunity to become part of a diverse team comprising seasoned professionals. Together, we spearhead the discovery of opportunities and craft solutions, advancing analytics initiatives across our global operations. Our responsibilities encompass both strategic analytics planning and project-driven problem-solving, concentrating on pivotal business domains. This role applies leading analytic practices and methods, designs and leads iterative development and