apache hadoop Jobs in new york, ny

Refine Results
1 - 20 of 200 Jobs

Data Engineer - ETL, Spark hadoop and Funds background.

RIIM

Jersey City, New Jersey, USA

Full-time

Looking for Data Engineer having experience with ETL, Spark hadoop and Funds background. Jersey City, NJ - Hybrid ETL, spark hadoop as tech skills but needs someone from Funds background.Proficient in Hadoop, Python, Spark, SQL Unix and HiveBasic understanding of on Prem and Google Cloud Platform data securityHands on development experience on large ETL/ big data systems .Google Cloud Platform being a big plus

BigData / Hadoop Admin

SumasEdge Corporation

Jersey City, New Jersey, USA

Contract, Third Party

Position : Hadoop Admin Location : Mount Laurel, NJ or NYC, NY or Charlotte, NC Duration : 12+ Months Install, configure, and maintain Hadoop clusters (HDFS, YARN, Hive, HBase, Spark, etc.)Experience with Java 8 and frameworks like Spring, Spring MVC, Spring boot, Spring Security (OAuth, LDAP), Spring Data (JPA, JDBCExperience developing multi-threaded applications and developing Micro Services using modern technology stackMonitor cluster performance and troubleshoot issues related to hardware,

Project Manager W2 only

MSYS Inc.

Jersey City, New Jersey, USA

Contract

Title: Project Manager - Hybrid Location: Jersey City, NJ, USA Location Jersey city Length of the project 12 + months Note: Must have a solid understanding of projects involving data extraction from the Hadoop ecosystem. Webcam interview; Long term project Hybrid Description: Recent Banking Domain is a must. We are seeking an experienced Program Manager /PMO with a strong background in managing complex technical initiatives, particularly within the banking and regulatory reporting space. T

ETL Tester

Collabera LLC

Jersey City, New Jersey, USA

Full-time

Major investment Bank is looking for ETL Tester for a long term contract position in Jersey City, NJ/Pennington, NJ Industry : Banking/Finance Position : QA Tester Location : Jersey City, NJ/Pennington, NJ Duration : 12 -18 Months (Contract to Hire) Pay Range : $55/hr - 59/hr Required Skills 7+ years of experience in QA testing with a strong focus on ETL processes. Excellent knowledge and hands-on experience with SQL and database validation. Experience working with DB2 database systems. Goo

KAFKA Admin

Ventures Unlimited

New York, New York, USA

Full-time

Must Have Technical/Functional Skills Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafka infrastructure. Creating and managing Kafka topics, producers, consumers, and Python-based Kafka consum

Big Data Developer

Hecta Data LLC DBA Vilwaa

Jersey City, New Jersey, USA

Contract

Greeting From Vilwaa About Us Innovative Solutions for the Digital Age : Powering Business Transformation In the dynamic landscape of the digital age, innovation is the key to unlocking new possibilities and driving transformative change. Big Data Developer Whippany NJ We are seeking a Python PySpark Big Data Developer with strong expertise in building scalable data processing solutions using PySpark and Python. You will design, develop, and optimize high performance ETL pipelines to process la

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Application Programmer

BCforward

Jersey City, New Jersey, USA

Contract

BCforward is currently seeking a highly motivated Application Programmer V/ Teradata Developer (for an opportunity in Jersey City, NJ! Position Title: Application Programmer V/ Teradata developer Location: Jersey City, NJ Anticipated Start Date: ASAP Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date. Expected Duration: 12 Months. Job Type: CONTRACT Pay Range: $65/HR - $70/Hr Please note that actual compensatio

Technical Architect (Python, Google Cloud Platform, microservices & Java)

Avance Consulting

Parsippany-Troy Hills, New Jersey, USA

Full-time

Job Description Strong Python Development Experience is mandatory 8-10 years of Data Engineering experience working with both distributed architectures, ETL, EDW and Big Data technologies Demonstrable knowledge & Experience using Google Cloud Big Query is mandatory Experience with DataProc & DataFlows with Java on Google Cloud Platform is highly desired Experience with serverless data warehousing concepts on Google Cloud is highly desired Experience with DWBI modelling framework is highly regar

Data Quality Specialist Contractor - Hybrid - New York (Bryant Park - Mid Manhattan)

Access Global Group LLC

New York, New York, USA

Full-time

Company Overview Do you want to be part of a exciting environment, supporting the growth of cutting-edge technology in cloud computing? Access Global Group (AGG) employees are passionate about what they do. We're a diverse group of cloud technology professionals with the same goal: to make our clients' lives easier through technology and we have a good time while we're at it! As a Salesforce Cloud Alliance Partner, Our recognized ability to deliver outstanding value is the product of effectively

Big Data Technology Architect

Accenture LLP

Remote or New York, New York, USA

Full-time

We Are Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world's largest network of Advanced Technology and Intelligent Operations centers. Our 738,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 c

Data Engineer with scala and Spark.

ISite Technologies Inc

New York, New York, USA

Full-time

Experience: 8-9 years Strong proficiency in Scala programming. Solid hands-on experience with Apache Spark (Batch and/or Streaming). Familiarity with Hadoop ecosystem, Hive, Kafka, or HBase. Experience with SQL and data transformation logic. Understanding of software engineering best practices (version control, CI/CD, testing). Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus. Experience with Delta Lake, Databricks, or Snowflake. Familiarity with containeri

Field Applications Engineer

SUPERMICRO COMPUTER INC

New York, New York, USA

Full-time

Job Req ID: 26280 About Supermicro: Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, pass

Developer

Akkodis

Jersey City, New Jersey, USA

Full-time

Akkodis is seeking a Developer for a contract job with a client in Jersey City, NJ(Hybrid). The ideal candidate must have strong hands-on experience with Big Data technologies like Hadoop, Sqoop, and Spark to be considered for the role. Rate Range: $45/hour to 49/hour; The rate may be negotiable based on experience, education, geographic location, and other factors. Developer job responsibilities include: Design, develop, and maintain software applications using appropriate programming languag

Software Engineering Senior Managers- Hybrid

Cigna

Remote or New York, New York, USA

Full-time

The job profile for this position is Software Engineering Senior Manager, which is a Band 4 Contributor Career Track Role with Cigna-Evernorth Services Inc. Responsibilities- Lead and participate in the design, definition, planning, development, and implementation of I.T. projects conforming to software development best practices. Confer with project personnel to identify and resolve problems.Contribute technical expertise to team projects to develop solutions for cases that use AWS Cloud hoste

BigData Engineer

K-Tek Resourcing LLC

Jersey City, New Jersey, USA

Full-time

Hello, My name is Sanket Parate, and I work as a Technical Recruiter for K-Tek Resourcing. We are searching for Professionals below business requirements for one of our clients. Please read through the requirements and connect with us in case it suits your profile. Job title: Bigdata Developer Location: Jersey City NJ (Onsite/Hybrid)Type of Job : Fulltime Job Description: Bachelor s Degree or Master s in Computer Science, Engineering, Software Engineering or a relevant field. Around 8-10 year

Big data engineer - Full time

K-Tek Resourcing LLC

Jersey City, New Jersey, USA

Full-time

Job title: Big Data Engineer Bachelor s Degree or Master s in Computer Science, Engineering, Software Engineering or a relevant field. Around 8-10 years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Sca

Senior Machine Learning Engineer - BLAW/BGOV/BTAX

Bloomberg L.P.

New York, New York, USA

Full-time

Description & Requirements Bloomberg Law, Tax & Government (BLAW/BTAX/BGOV) delivers AI-powered solutions that integrate trusted editorial content and billions of documents and data points into the workflows of legal, tax, accounting, and government professionals. Our mission is to be an indispensable resource, empowering our users to make faster, smarter decisions and better serve their clients and constituents. The Information Enrichment & Content Generation (IECG) Team builds scalable ML sol

Java Spark Developer - AVP

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Big Data Senior Development Lead (SVP) - Hybrid

Citi

Remote or Jersey City, New Jersey, USA

Full-time

The Big Data Senior Development Lead (Applications Development Technology Senior Lead Analyst - C14) is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business p