hadoop administrator with apache spark Jobs

Refine Results
1 - 20 of 740 Jobs

NiFi Administrator

4A IT Services LLC

•

St. Louis, Missouri, USA

Contract, Third Party

Job Title: NiFi Administrator Location: St. Louis, MO , Hybrid ( 3 days Onsite) Duration: Long-term Project Start Date: ASAP Job Description: We are seeking a highly skilled NiFi Administrator to join our team for a project based out of St. Louis, MO. The ideal candidate will be responsible for the installation, configuration, tuning, and administration of Apache NiFi environments to support data flow pipelines across our enterprise systems. This role is critical to ensuring secure, efficient, a
Easy Apply
Posted 9 hours ago

KAFKA Admin

Ventures Unlimited

•

New York, New York, USA

Full-time

Must Have Technical/Functional Skills Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafka infrastructure. Creating and managing Kafka topics, producers, consumers, and Python-based Kafka consum
Easy Apply
Posted 7 days ago | Updated 1 day ago

KAFKA Admin

Galaxy i Technologies, Inc.

•

New York, New York, USA

Third Party, Contract

CONTRACT ROLE CONTRACT ROLE CONTRACT ROLE Title : KAFKA Admin Location : New York, NY- onsite 3 days per week Job Description : Primary Skill Set Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafk
Easy Apply
Posted 6 days ago | Updated moments ago

Lead Big Data Engineer

RIIM

•

Pune, Maharashtra, India

Full-time

Title: Lead Big Data Location: Pune Kharadi (Onsite) Duration: Full Time Looking someone who can start immediately (1 month or Serving Notice Period) 8-10 years of experience as a big data engineer.Must be proficient with Python & PySparkIn-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics servicesMust have extensive experience with Delta Tables, JSON, Parquet file formatGood to have experience with AWS data analytics services like Athena, Glue, Redshift, EM
Easy Apply
Posted 7 days ago

Data Engineer experienced in RETAIL

Emonics LLC

•

Sunnyvale, California, USA

Contract

Key Responsibilities:Design and develop scalable data pipelines for large-scale processing and transformation. Integrate structured and unstructured data sources from various systems. Build, manage, and optimize data architectures to support business intelligence and analytics. Develop frameworks for data transformation, metadata management, dependencies, and workload orchestration. Collaborate with analysts, data scientists, and product teams to deliver timely and accurate data solutions. Requi
Easy Apply
Posted 5 days ago

Java/Big Data Developer

Apex Systems

•

New York, New York, USA

Full-time

Job#: 2076577 Job Description: Apex Systems combines with parent company ASGN Inc. to make it the 2nd largest IT staffing agency in the country. Apex has an opportunity for a Java Developer . If interested in discussing the position further, please send an MS Word version of your resume to Patryk Kopczynski, To apply please email your resume to Here are the details: Position: Java Developer Location: Onsite 3 days a week in Midtown Manhattan Rate: 68/hr Duration: 24 month contract Iv Proc
Easy Apply
Posted 44 days ago | Updated 3 hours ago

Big Data Technology Architect

Accenture LLP

•

New York, New York, USA

Full-time

We Are Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world's largest network of Advanced Technology and Intelligent Operations centers. Our 738,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 c
Posted 2 days ago | Updated 3 hours ago

Senior Data Scientist - TikTok E-commerce Governance

TikTok

•

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Regular Job Code : P1545A Apply to this job Share this listing: Responsibilities Governance and Experience team strives to build a worry-free shopping journey for our users on TikTok. We provide a trustworthy e-commerce experience by (1) eliminating malicious sellers, (2) ensuring listings are policy compliant, (3) ensuring users receive authentic products in the condition they expect, and (4) in the rare chance the order experience does not meet custo
Posted 60+ days ago | Updated 3 hours ago

Software Engineer, Infrastructure

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A221532 Apply to this job Share this listing: Responsibilities About the Team Our Search Team is responsible for building and owning TikTok's search engine, which provides our users the best search experience. On the TikTok Search Team, you'll have the opportunity to build a full-stack search engine system and combine information retrieval technology with modern machine learning methods from related fields such as NLP, CV, and recom
Posted 60+ days ago | Updated 3 hours ago

Software Engineer (Backend) - TikTok Search

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A191660 Apply to this job Share this listing: Responsibilities About the Team Our Search Team is responsible for building and owning TikTok's search engine, which provides our users the best search experience. On the TikTok Search Team, you'll have the opportunity to build a full-stack search engine system and combine information retrieval technology with modern machine learning methods from related fields such as NLP, CV, and recom
Posted 60+ days ago | Updated 3 hours ago

Senior Software Engineer, Infrastructure - TikTok Search Engine

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A259556 Apply to this job Share this listing: Responsibilities About the Team Our Search Team is responsible for building and owning TikTok's search engine, which provides our users the best search experience. On the TikTok Search Team, you'll have the opportunity to build a full-stack search engine system and combine information retrieval technology with modern machine learning methods from related fields such as NLP, CV, and recom
Posted 60+ days ago | Updated 3 hours ago

Tech Lead Engineer, Infrastructure - TikTok Search Engine

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A150942 Apply to this job Share this listing: Responsibilities About the Team Our Search Team is responsible for building and owning TikTok's search engine, which provides our users the best search experience. On the TikTok Search Team, you'll have the opportunity to build a full-stack search engine system and combine information retrieval technology with modern machine learning methods from related fields such as NLP, CV, and recom
Posted 60+ days ago | Updated 3 hours ago

Software Engineer, Search Ranking

eBay Inc.

•

Remote or San Jose, California, USA

Full-time

At eBay, we're more than a global ecommerce leader - we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the futur
Posted 60+ days ago | Updated 3 hours ago

Data Scientist Intern (E-commerce Governance Algorithms) - 2025 Summer/Fall (BS/MS)

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Intern Job Code : A144597 Apply to this job Share this listing: Responsibilities Governance and Experience team of e-commerce are responsible for ensuring the safety and trust-worth of the marketplace for not only our users, but also sellers and creators. We value our users' satisfaction by working on policies, rules and systems to ensure the quality. We are looking for an algorithm technical manager who is obsessed with customer experience and passio
Posted 60+ days ago | Updated 3 hours ago

Data Scientist Intern (E-commerce Governance Algorithms) - 2025 Summer/Fall (PhD)

TikTok

•

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Intern Job Code : A236191A Apply to this job Share this listing: Responsibilities Governance and Experience team of e-commerce are responsible for ensuring the safety and trustworth of the marketplace for not only our users, but also sellers and creators. We value our users' satisfaction by working on policies, rules and systems to ensure the quality. We are looking for an algorithm technical manager who is obsessed with customer experience and passion
Posted 60+ days ago | Updated 3 hours ago

Data Scientist Intern (E-commerce Governance Algorithms) - 2025 Summer/Fall (PhD)

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Intern Job Code : A247468 Apply to this job Share this listing: Responsibilities Governance and Experience team of e-commerce are responsible for ensuring the safety and trustworth of the marketplace for not only our users, but also sellers and creators. We value our users' satisfaction by working on policies, rules and systems to ensure the quality. We are looking for an algorithm technical manager who is obsessed with customer experience and passion
Posted 60+ days ago | Updated 3 hours ago

Data Scientist Intern (E-commerce Governance Algorithms) - 2025 Summer/Fall (BS/MS)

TikTok

•

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Intern Job Code : A10576 Apply to this job Share this listing: Responsibilities Governance and Experience team of e-commerce are responsible for ensuring the safety and trust-worth of the marketplace for not only our users, but also sellers and creators. We value our users' satisfaction by working on policies, rules and systems to ensure the quality. We are looking for an algorithm technical manager who is obsessed with customer experience and passiona
Posted 60+ days ago | Updated 3 hours ago

Software Engineer Intern (Big Data - Data Platform) - 2025 Summer/Fall (PhD)

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Intern Job Code : A18471A Apply to this job Share this listing: Responsibilities As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of
Posted 60+ days ago | Updated 3 hours ago

Data Engineer, E-Commerce

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : V0220 Apply to this job Share this listing: Responsibilities As a Data Engineer in the Data Platform E-Commerce team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of m
Posted 60+ days ago | Updated 3 hours ago

Software Engineer Intern (Big Data - Data Platform) - 2025 Summer/Fall (PhD)

TikTok

•

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Intern Job Code : A52940 Apply to this job Share this listing: Responsibilities As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of u
Posted 60+ days ago | Updated 3 hours ago