Apache Hadoop Jobs in New York

Refine Results
1 - 20 of 203 Jobs

Hadoop Admin with Ecosystem Expertise

Capgemini America, Inc.

Hanover, New Jersey, USA

Full-time

Position Title : Hadoop Admin with Ecosystem Expertise Location : Whippany, NJ (Hybrid) Experience : 6+ Years Preferred Employee Type : Full Time with Benefits Job Description Execute weekly server rebuilds (21 30 nodes) with zero data loss and minimal performance impactPerform Hadoop-level pre/post validations: cluster health, HDFS usage, replication, skew, and logsCoordinate with Data Center Ops and Unix Admins for hardware and OS-level tasksReconfigure and reintegrate rebuilt nodes into the c

Hadoop Data Discovery and Protection Execution Engineer - 5770355

Accenture LLP

Remote or Charlotte, North Carolina, USA

Full-time

Accenture Flex offers you the flexibility of local fixed-duration project-based work powered by Accenture, a leading global professional services company. Accenture is consistently recognized on FORTUNE's 100 Best Companies to Work For and Diversity Inc's Top 50 Companies For Diversity lists. As an Accenture Flex employee, you will apply your skills and experience to help drive business transformation for leading organizations and communities. In addition to delivering innovative solutions for

KAFKA Admin

Galaxy i Technologies, Inc.

New York, New York, USA

Contract, Third Party

CONTRACT ROLE CONTRACT ROLE CONTRACT ROLE Title : KAFKA Admin Location : New York, NY- onsite 3 days per week Job Description : Primary Skill Set Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafk

KAFKA Admin

Ventures Unlimited

New York, New York, USA

Full-time

Must Have Technical/Functional Skills Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafka infrastructure. Creating and managing Kafka topics, producers, consumers, and Python-based Kafka consum

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

.Net Developer

SRISYS Inc.

New York, New York, USA

Contract

100% W2 Position only. Job Title: .Net Developer Location - New York Duration: 6+ Months (Contract to Hire) Responsibilities: Understand complex business systems and workflows and explain them to other developersDevelop component designs that work cohesively in the context of existing architectureExercise judgment within defined standard practices and procedures to analyze, test, design, program, debug, modify and implement system requirementsWork closely with the business units and stakeholders

Technical Architect (Python, Google Cloud Platform, microservices & Java)

Avance Consulting

Parsippany-Troy Hills, New Jersey, USA

Full-time

Job Description Strong Python Development Experience is mandatory 8-10 years of Data Engineering experience working with both distributed architectures, ETL, EDW and Big Data technologies Demonstrable knowledge & Experience using Google Cloud Big Query is mandatory Experience with DataProc & DataFlows with Java on Google Cloud Platform is highly desired Experience with serverless data warehousing concepts on Google Cloud is highly desired Experience with DWBI modelling framework is highly regar

Big Data Technology Architect

Accenture LLP

New York, New York, USA

Full-time

We Are Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world's largest network of Advanced Technology and Intelligent Operations centers. Our 738,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 c

Software Engineering Senior Managers- Hybrid

Cigna

Remote or New York, New York, USA

Full-time

The job profile for this position is Software Engineering Senior Manager, which is a Band 4 Contributor Career Track Role with Cigna-Evernorth Services Inc. Responsibilities- Lead and participate in the design, definition, planning, development, and implementation of I.T. projects conforming to software development best practices. Confer with project personnel to identify and resolve problems.Contribute technical expertise to team projects to develop solutions for cases that use AWS Cloud hoste

Senior Machine Learning Engineer - BLaw/BTax/BGov

Bloomberg L.P.

New York, New York, USA

Full-time

Description & Requirements Bloomberg Law, Tax & Government (BLAW/BTAX/BGOV) delivers AI-powered solutions that integrate trusted editorial content and billions of documents and data points into the workflows of legal, tax, accounting, and government professionals. Our mission is to be an indispensable resource, empowering our users to make faster, smarter decisions and better serve their clients and constituents. The Information Enrichment & Content Generation (IECG) Team builds scalable ML sol

Senior Machine Learning Engineer - BLaw/BTax/BGov

Bloomberg

New York, New York, USA

Full-time

Senior Machine Learning Engineer - BLaw/BTax/BGov Location New York Business Area Engineering and CTO Ref # 10044732 Description & Requirements Bloomberg Law, Tax & Government (BLAW/BTAX/BGOV) delivers AI-powered solutions that integrate trusted editorial content and billions of documents and data points into the workflows of legal, tax, accounting, and government professionals. Our mission is to be an indispensable resource, empowering our users to make faster, smarter decisions and better serv

Java Spark Developer - AVP

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

IT Business Lead Analyst

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Citibank, N.A. seeks an IT Business Lead Analyst for its Jersey City, New Jersey location. Duties: Address data quality concerns and issues associated with the North American (NAM) products. Work in partnership with different business and functions to execute Consent Orders from the regulators, meticulously adhering to the Data Operating Model (DOM) in implementing and validating the right measures. Use domain knowledge in banking with focus on mortgages, personal loans, credit cards, and depos

Big Data Engineer

Motion Recruitment Partners, LLC

Woodbridge Township, New Jersey, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data Engineer in Iselin, NJ (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly

Java/Big Data Developer

Apex Systems

New York, New York, USA

Full-time

Job#: 2076577 Job Description: Apex Systems combines with parent company ASGN Inc. to make it the 2nd largest IT staffing agency in the country. Apex has an opportunity for a Java Developer . If interested in discussing the position further, please send an MS Word version of your resume to Patryk Kopczynski, To apply please email your resume to Here are the details: Position: Java Developer Location: Onsite 3 days a week in Midtown Manhattan Rate: 68/hr Duration: 24 month contract Iv Proc

Site Reliability Engineer - USDS (Multiple Positions)

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A221437A Apply to this job Share this listing: Responsibilities About TikTok U.S. Data Security TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep

Full Stack Developer - Assistant Vice President

Deutsche Bank

New York, New York, USA

Full-time

Job Description: Job Title Full Stack Developer Corporate Title Assistant Vice President Location New York Overview A Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. You have to ensure that solutions are well architected, with maintainability and ease of testing built in from the outset, and that they can be integrated successfully into the end-to-end business process flow. You will have gained significant experience throu

Sr. Field Applications Engineer

SUPERMICRO COMPUTER INC

New York, New York, USA

Full-time

Job Req ID: 26865 About Supermicro: Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, pass

Lead Software Engineer, Full Stack-Card Tech

Capital One

New York, New York, USA

Full-time

Lead Software Engineer, Full Stack-Card Tech Do you want to work for a tech company that writes its own code, develops its own software, and builds its own products? We experiment and innovate leveraging the latest technologies, engineer breakthrough customer experiences, and bring simplicity and humanity to banking. We make a difference for 65 million customers. At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet rea

Senior Data Engineer

Capital One

New York, New York, USA

Full-time

Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opp