Kafka Apache Spark jobs

Super urgent position for Data Engineer - Only W2 and Independent Resources - Onsite at New York City, NY

New York, New York

•

Today

Job Title: Data EngineerLocation: [Remote / Hybrid / Onsite Specify]Experience: 5-12 Years (Flexible)Employment Type: Full-Time and W2 resources Job SummaryWe are seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms. The ideal candidate will have strong hands-on experience with Snowflake, Python, Apache Spark, Kafka, and Hadoop, and a passion for transforming large volumes of data into reliable, high-performance data solutions that support a

Easy Apply

Full-time

Depends on Experience

MD_Application Architect III_Hadoop Admin

Chicago, Illinois

•

13d ago

A client of Innova Solutions is immediately hiring for a Hadoop Engineer Position: Hadoop Engineer Location: Charlotte, NC / Chicago, IL (3 Days/week Onsite) Position Type: Contract Duration: Long Term Contract Job Description: Hadoop Engineer (SME) role supporting NextGen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more). Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products

Easy Apply

Contract

Depends on Experience

Ab Initio ETL Developer

Dallas, Texas

•

Today

Required skills: Please submit only candidates who are authorized to work in the United States. Only applicants who are currently local to Dallas Texas or are willing to relocate will be considered. Design, develop, and deploy ETL processes using Ab Initio GDE. Build high-performance data integration and transformation pipelines. Work with Ab Initio Co-Operating System, EME (Enterprise Meta Environment), and metadata-driven development. Develop and optimize graphs for batch and real-time process

Easy Apply

Contract

Depends on Experience

Big Data Engineer (Only 12+ Years Exp).

New York, New York

•

Yesterday

Position: Big Data Engineer (Only 12+ Years Exp). Location: NYC, NY Duration: Contract All 5 Days Onsite Skills: Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive Strong work experience - Agile environment preferred Data Engineer (Big Data Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum. Ensures data quality, security, and compliance through govern

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer

Hybrid in Seattle, Washington

•

28d ago

Data Engineer (3 4 Years Experience) Experience Level: Mid-level (3 4 years) Eligibility: Open to U.S. Citizens and GC only. We do not offer visa sponsorship. We focus on modern technologies across cloud, data, and software disciplines. Our client engagements offer long-term stability, competitive compensation, and the opportunity to work on cutting-edge data projects. Position Overview We are seeking a Data Engineer with 3 4 years of experience to join a client-facing role focused on building

Easy Apply

Full-time

70,000 - 80,000

Analyst, Data Engineering

Orlando, Florida

•

16d ago

Were seeking a skilled and motivated Data Engineer to join our team and help drive data-driven decision-making across the organization. This role is ideal for someone passionate about building scalable data solutions and collaborating cross-functionally to deliver impactful analytics. Key Responsibilities: Design, build, and maintain secure, scalable data pipelines and engineering solutions. Develop and support cloud and on-premise data infrastructure, including data warehouses and APIs. Collabo

Easy Apply

Contract

$52

Solutions Architect

San Leandro, California

•

7d ago

Role: Solution Architect /Tech Manager level Location - San Leandro, CA / Charlotte, NCJD:10+ years of hands-on programming experience in Java, Python, Scripting languages. Good experience in Oracle, MongoDB databases.5+ years hands-on architectural and design experience. Function as the technical representative for development, remove technology roadblocks including code, build, deployment.Interpret , develop and ensure security, stability, scalability within functions of technology, with low t

Easy Apply

Contract

$70 - $80

Big Data Engineer

Queens, New York

•

Today

Job Title Big Data Engineer Location NYC, NY-Onsite Job Type/Duration Contract Job Description: Mandatory Skills:Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive. Strong work experience - Agile environment preferredData Engineer (Big Data Hadoop, Green Plum, etc. , Data Owner)Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum.Ensures data quality, security, and compliance through gover

Easy Apply

Contract

Depends on Experience

Data solution Architect

Phoenix, Arizona

•

Yesterday

Solution Architect Data Overview The Solution Architect Data is responsible for contributing to the design, modernization, and optimization of enterprise-scale data systems, as well as the maintenance and operations strategy for CHP. This role involves designing and implementing data systems that organize, store, and manage data within our cloud data platform. The architect will perform continuous maintenance and operations work for CHP in the cloud environment. They will review and analyze C

Easy Apply

Contract

Depends on Experience

Data Engineer (Scala & Spark)

Hybrid in Atlanta, Georgia

•

Today

Job Title: Sr. Data Engineer Location: Atlanta, GA (Hybrid Onsite) Client: Financial Services (Direct) W2/Fulltime Key Responsibilities: Design and implement high-performance data pipelines using Apache Spark and Scala.Optimize Spark jobs for efficiency, scalability, and reliability.Collaborate with cross-functional teams and diverse data sources to deliver data-driven insights.Monitor, troubleshoot, and maintain production data pipelines to ensure seamless operations.Create and maintain compre

Easy Apply

Contract

$60 - $70

Senior Data Engineer

Atlanta, Georgia

•

2d ago

We are looking for Senior Data Engineer for our client in Atlanta, GA Job Title: Senior Data Engineer Job Location: Atlanta, GA Job Type: Contract Job Description: Responsibilities: Participate in the agile development process.Develop functional and technical specifications from business requirements for the commercial platform.Ensure application quality and adherence to performance requirementsHelp create project estimates and plans. Represent engineering team in project meetings and solution

Easy Apply

Contract, Third Party

Depends on Experience

Sr Backend Software Engineer - Data and ML Innovation

Cupertino, California

•

Today

Job Title: Sr Backend Software Engineering, Data and ML Innovation Location: Cupertino, CA (Hybrid onsite Tues - Thurs) Duration: 3 months with possible extension Pay Range: $70-$74.00/hr on w2, DOEJob Summary: Description We are looking for people with a track record in building scalable pipelines and services. Join us, and impact hundreds of millions of customers across billions of their interactions with foundation model powered Intelligence features, that are available on iPhone, iPad, HomeP

Easy Apply

Full-time, Contract

$74.63 hr

Abinitio Engineer (with Data Lake MarTech) - Atlanta, GA (Hybrid) - CG

Hybrid in Stockton, Georgia

•

2d ago

Role: Abinitio Engineer (with Data Lake MarTech) Locations: Atlanta, GA (Hybrid Onsite) Duration: 12+ Months Contract F2F Interview Highly Preferred for Local Candidates. Note: Candidate needs to be in the office 3-4 Days every week. Local or candidates from adjacent states only. Summary/Purpose: We are looking for a Senior Data Engineer to be part of our scrum teams and perform functional & system development for Hadoop applications for our Enterprise Data Lake initiative.This is high visibil

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer

Hybrid in Newark, New Jersey

•

29d ago

Easy Apply

Full-time

60,000 - 80,000

Sr. Databricks Architect - Princeton, NJ (Onsite)

Princeton, New Jersey

•

Yesterday

Role Name: Sr. Databricks Architect Location: Princeton, NJ (Onsite) Duration: 12 Months JOB DESCRIPTION: Contribute to the design and implementation of scalable data architectures, such as a Lakehouse, using Delta Lake and Unity Catalog. Manage and maintain the underlying data infrastructure, which typically exists on a major cloud platform like AWS, Azure, or Google Cloud Platform. Implement data governance practices, including data lineage, metadata management, and access controls integrat

Easy Apply

Contract, Third Party

Depends on Experience

Site Reliability Engineer- Hybrid Reston, VA

Arlington, Virginia

•

Today

Site Reliability Engineer The candidate will be involved in all aspects of the data platform, including ideation, design, implementation, deployment, customer onboarding and support. This implies regular cross-team collaboration with Data Engineering, Infrastructure, Engineering, Security, and Operation Teams. As part of the team, we expect the candidate to take ownership of the data platform, regularly interacting with the internal customers, proactively identifying, prioritizing, and deliverin

Easy Apply

Full-time

$100000 - $150000

Data Architect

Remote

•

21d ago

Role :: Data Architect Location :: Remote Type :: Fulltime Job Description Must Have Technical/Functional Skills: Strong expertise in data modeling techniques (conceptual, logical, physical). Proficiency in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). In-depth knowledge of data warehousing concepts and tools (e.g., Redshift, Snowflake, Google BigQuery) Experience with big data platforms (e.g., Hadoop, Spark, Kafka). Familiarity with cloud-based data platforms and servic

Easy Apply

Full-time

Depends on Experience

Data Architect/ Databricks Architect- Princeton, NJ (Onsite)

Princeton, New Jersey

•

Today

Role Name: Databricks Architect Location: Princeton, NJ (Onsite) Duration: 12 Months Job ID : CGEMJP00324803 JOB DESCRIPTION: Contribute to the design and implementation of scalable data architectures, such as a Lakehouse, using Delta Lake and Unity Catalog. Manage and maintain the underlying data infrastructure, which typically exists on a major cloud platform like AWS, Azure, or Google Cloud Platform. Implement data governance practices, including data lineage, metadata management,

Easy Apply

Contract

Depends on Experience

Data Engineer

Alpharetta, Georgia

•

9d ago

Data Engineer Locations: Alpharetta, GA (In-Person Required) Rate: $105K Annual Job Overview: Hiring a Data Engineer to design, build, and optimize data pipelines and analytics platforms for enterprise data ecosystems. Responsibilities: Develop robust ETL/ELT pipelinesBuild scalable data models and storage solutionsWork with cloud data platforms (AWS, Azure, or Google Cloud Platform)Implement data quality, governance, and monitoring processesOptimize queries and large-scale data workflowsPartner

Easy Apply

Full-time

$90,000 - $100,000

Solutions Architect

Phoenix, Arizona

•

2d ago

The ideal candidate will have a proven track record of delivering end-to-end ETL/ELT pipelines across Databricks, Azure, and AWS environments.Key Responsibilities Design scalable data lake and data architectures using Databricks and cloud-native services. Develop metadata-driven, parameterized ingestion frameworks and multi-layer data architectures. Optimize data workloads and performance. Define data governance frameworks for CHP. Design and develop robust data pipelines. Architect AI systems,

Easy Apply

Contract

100

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Kafka Apache Spark jobs