HDFS jobs

Scala/Spark Developer (AML or FCT or Actimize)

Hybrid in Montreal, Quebec

•

20d ago

Financial Crimes Technology Scala Developer The Financial Crimes Technology (FCT) is a dynamic and fast-paced global group within the Non-Financial Risk Technology (NFRT) organization. We are responsible for implementing state-of-the-art technology solutions for the firm Global Financial Crimes (GFC) division which manages the Firm's Anti Money Laundering (AML), Sanctions/PEP & Adverse News Screenings, Know your Customer (KYC), Anti-Bribery & Corruption programs. Financial Crimes Technology (FCT

Easy Apply

Contract

Depends on Experience

Hadoop Architect

Omaha, Nebraska

•

14d ago

Job Title: Hadoop Architect Location: Omaha, NE Type: Contract Job Description: Responsibilities: Architect, design, and implement solutions within the Hadoop ecosystem, including HDFS, YARN, MapReduce, Hive, Spark, and HBase. Manage and optimize the on-prem Hadoop infrastructure for performance and scalability. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Facilitate the migration of existing Hadoop workloads to cloud

Easy Apply

Third Party, Contract

Depends on Experience

Ab Initio Developer

Reston, Virginia

•

Today

Ab Initio Developer 12 + month contract - strong possibility of extensions Reston, VA - Mostly Remote but hybrid as needed 1X monthly and 2-3X a year for team events Qualifications & Experience: Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse area Must have at least 5 years of ETL Design and Development experience using Ab Initio MUST HAVE strong Ab Initio Development experience Experience in AWS ecosystem Experienced in Ab Initio EKS Nice to Have: 1-2 year

Easy Apply

Contract

Ab Initio Developer

Reston, Virginia

•

Today

Easy Apply

Full-time

Lead Specialty Software Engineer

Wilmington, Delaware

•

Today

Location: Wilmington, DE Description: Our client is currently seeking a Lead Specialty Software Engineer/ Bigdata Engineer - Local to Wilmington DE and Philadelphia PA Required Qualifications: 7+ years of Big Data Platform (data lake) and data warehouse engineering experience demonstrated through prior work experiences. Preferably with Hadoop stack: HDFS, Hive, SQL, Spark, Spark Streaming, Spark SQL, HBase, Kafka, Sqoop, Atlas, Flink, Kafka, Cloudera Manager, Airflow, Impala, Hive, HBase, Tez

Contract

Principal Data Engineer

San Francisco, California

•

Today

About the Role This is a Technical Data Leader position. The Data Engineering team focuses on building core Business Intelligence and Data Solutions for multiple business verticals at Uber, like Uber Eats, Grocery & Retail, Growth & Marketing, Uber for Business, Memberships and Ads! The team also works on ground up initiatives like Data Anomaly Detection and Optimizing Data Compute and Storage. What You'll Do - Design & Architecture: Partners with stakeholders to understand customer and/or bu

Full-time

USD 284,000.00 - 315,500.00 per year

Senior Infrastructure Engineer Linux, Hadoop & Spark

Hybrid in Charlotte, North Carolina

•

28d ago

Job Title:Senior Infrastructure Engineer Linux, Hadoop & SparkLocation:Charlotte, NC (Onsite/Hybrid as applicable)Type:Long-Term ContractExperience Range:5 + yearsJob Overview:Seeking a seasoned Infrastructure Support Engineer with deep expertise in Linux system administration and distributed compute/storage platforms, especially in Cloudera Hadoop and Apache Spark GRID environments.This role is central to supporting a high-performance big data platform consisting of a 5+ PB Cloudera Hadoop clu

Easy Apply

Contract

Depends on Experience

BigData Architect

No location provided

•

5d ago

Mode of Interview: Inteview via Teams. Work Location: Columbus, Ohio Work Arrangement: ONSITE Shift: EST experience in Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, Impala, StreamSets, Kudu, Oozie, Hue, Kafka, Yarn, Python, Flume, Zookeeper, Sentr Strong development experience in creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats writing Hadoop/Hive/Impala scripts for gathering stats on table post data loads. hands-on experience with Cloud databases. hands-on da

Easy Apply

Contract, Third Party

Sr.?Ab?Initio?Developer

Remote or Hybrid in Reston, Virginia

•

Today

Job Title: Sr. Data Engineer ( Ab Initio Developer) Job Location: Reston, VA (Hybrid) Job Type: ContractMust Haves: 5-10 + years Exp. Ab Initio developer role with AWS Tech stack Ab Initio CDC Experienced in Ab Initio EKS. Help with design. Team player and hit the ground running from day 1. On call support on rotation basis (rarely they will get a call). ETL processing to support data products. Hadoop strongly preferred.Preferred: Hive technology, ProSQL. Certifications. Healthcare Insurance.J

Easy Apply

Contract

BASED ON EXPERIENCE

Databricks Developer: Java Spark (MBI Clearance Required)

No location provided

•

Today

Greetings for the day !! My name is Bril, and I am Technical Recruiter, Talent Acquisition for Resourcesys Inc. We are looking for a Requirement: 1 Databricks Developer: Java Spark Start Date: onboarding takes 3-4 weeks Position Type: Contract Location: Remote Active IRS MBI Clearance Required. IRS issued laptop strongly preferred. Please provide a copy of the candidate's active MBI letter. Task Description: The Databricks Developer will be responsible for designing, developing, and maintaining

Easy Apply

Contract

Data Engineer

Hybrid in San Jose, California

•

Today

Job Description: We are seeking a skilled Data Engineer with expertise in Big Data technologies to join our client in San Jose, CA. This role requires a long-term W2 contract and onsite presence 3 days per week. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL workflows.Work extensively with Big Data technologies including Hadoop, HDFS, Hive, and Spark SQL.Develop and optimize Python scripts for data processing and automation.Write and maintain Unix/Linux shell

Easy Apply

Contract

$55 - $60

Lead Data Engineer

Remote

•

5d ago

Willing to go IN person interview nearby (Final round)Must have 14+ years of experience as Data Engineer and lead at least 2-3 projects.(Mandatory)Must have strong expertise in skills Kafka, AWS, Spark, Python,SQL (Must)Strong background in math, statistics, computer science, or data scienceProficiency in Snowflake, PythonHands-on experience with HDFS, YARN, Hive, Spark, Kafka, AWS, Docker/Kubernetes, Snowflake(Must)Proficiency in SAS, SQL, R, PythonFamiliarity with PostgreSQL, Redshift, Greenpl

Easy Apply

Contract

Depends on Experience

Software Engineer Graduate (Agentic AI Engine - Data Management platform) - 2026 Start (BS/MS)

San Jose, California

•

6d ago

Location : San Jose Employment Type : Regular Job Code : A01422B Apply to this job Share this listing: Responsibilities We are looking for talented individuals to join our team in 2026. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Launch your career where inspiration is infinite at TikTok. Team Introduction: Join us in pushing the boundaries of AI technology and creating the next generation of intelligent systems t

Full-time

USD 144,000.00 - 259,200.00 per year

Senior Manager Data Engineer (multiple openings) - IHM

Riverwoods, Illinois

•

Today

Discover. A brighter future. With us, you'll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it - we want you to grow and make a difference at one of the world's leading digital banking and payments companies. We value what makes you unique so that you have an opportunity to shine. Come build your future, while being the reason millions of people find a brighter financial future

Full-time

USD 148,949.00 - 217,400.00 per year

Lead Big Data Software Engineering

Plano, Texas

•

Today

Job Description: JOB TITLE: Lead Big Data Software Engineering REMOTE TYPE: Office Worker *Office Worker: In office position with work from home allowed, i.e. flex or hybrid worker JOB LOCATION: 2900 W Plano Pkwy., Plano, TX 75075 DUTIES: Responsible for the development of high performance, distributed computing tasks using Big Data and Generative AI technologies such as Hadoop, NoSQL, text mining and other distributed environment technologies. Utilize Big Data programming languages and tec

Full-time

USD 163,966.00 - 215,800.00 per year

Data Platform SRE

Austin, Texas

•

Today

People at Apple don't just build products - they craft the kind of experience that have revolutionized entire industries. The diverse collection of our people and their ideas inspire innovation in everything we do. Imagine what you could do here! Join Apple, and help us leave the world better than we found it. The Apple Services Engineering (ASE) organization builds and provides systems and infrastructure that fuel Apple's services (such as iCloud, iTunes, Siri, and Maps). We are the foundation

Full-time

Software Engineer Intern (Agentic AI Engine - Data Management platform) - 2026 Summer (BS/MS)

San Jose, California

•

Today

Location : San Jose Employment Type : Intern Job Code : A186565A Apply to this job Share this listing: Responsibilities We are looking for talented individuals to join us for an internship in 2026. Internships at TikTok aim to offer students industry exposure and hands-on experience. Turn your ambitions into reality as your inspiration brings infinite opportunities at TikTok. Internships at TikTok aim to provide students with hands-on experience in developing fundamental skills and explor

Full-time

USD 36.00 - 45.00 per hour

Senior Tableau Developer - AVP

Remote or Irving, Texas

•

Today

Senior Tableau Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Strong on data analytics with executing SQL queries in different databases for example: Oracle, SQL, Mongo, PostgreSQL, hive/impala/spark to analy

Full-time

USD 107,120.00 - 160,680.00 per year

Engineering -New York - Associate, Software Engineering - 9658252

New York, New York

•

4d ago

Job Description Job Duties: Associate, Software Engineering with Goldman Sachs & Co. LLC in New York, New York. Develop, enhance, support, and maintain the Firm's software solutions in support of its global businesses. Design and implement high-quality, scalable, and thoughtful technology solutions leveraging both internal and open-source services. Assist in requirements gathering, user story refinement, development, testing (unit, integration, and regression), User Acceptance Testing (UAT) and

Full-time

USD 132,000.00 - 167,000.00 per year

Engineering -New York - Associate, Software Engineering - 9658252

New York, New York

•

Today

Full-time

USD 132,000.00 - 167,000.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization