Big Data jobs in New York

Berkeley Heights, New Jersey

•

4d ago

Job Description 10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.Focuses on cluster health, performance tuning, and production data pipelines.Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes,

Easy Apply

Full-time

$100,000 - $120,000

100% Remote- Big Data Engineer

Remote

•

Today

The Skills You'll Need: Proven experience with Hadoop, Spark (Batch/Streaming), and Hive.Proficiency in Shell scripting and programming languages such as Python, Java, and/or Scala.Ability to design, develop, and deploy big data solutions in a high-performance environment.Excellent problem-solving skills and the ability to work independently or as part of a team.Strong communication skills to effectively collaborate with team members and stakeholders.Proven experience with Google Cloud Platforms

Easy Apply

Full-time, Third Party

45 - 50

Active secret clearance SR. BIG DATA ENGINEER

Remote

•

Yesterday

Candidate resume submissions must include 3 references and skills highlights to be considered.Job Description:Project Overview The DLA Procurement Integrated Enterprise Environment (PIEE) Development and Sustainment program supports modernization, enhancement, and sustainment of a mission-critical defense procurement and payment platform comprising approximately 34 applications. The program focuses on enterprise software modernization, legacy-code refactoring, Agile/DevSecOps delivery, AWS GovCl

Easy Apply

Contract

75+

AWS Data Engineer – Big Data - Atlanta, GA, Charlotte, NC, Raleigh, NC, Durham, NC, Columbia, SC.

Remote or Atlanta, Georgia

•

Today

Job Title: AWS Data Engineer Big Data Location: Atlanta, GA, Charlotte, NC, Raleigh, NC, Durham, NC, Columbia, SC. Looking for W2 candidates. No C2C Job Summary We are seeking an AWS Data Engineer with expertise in big data processing, cloud-native data engineering, and streaming architectures. The ideal candidate should possess strong experience building enterprise data platforms using AWS analytics services. Key Responsibilities Develop scalable AWS data pipelines. Build ETL jobs using AWS G

Easy Apply

Contract

Depends on Experience

Big Data Engineer

Bernards, New Jersey

•

4d ago

Job Responsibilities: Design and lead end-to-end data integrationPerform performance tuning, diagnose, and resolve complex big data and streaming technical issues.Design and implement scalable solutions across the technology stack, including data processing, database, web services, network, and security layers.Perform integration testing and provide support to QA teams on large-scale projects.Contribute to requirements analysis, project estimation, system design, coding, and testing.Evaluate and

Easy Apply

Contract, Third Party

Depends on Experience

Scala / Apache Spark Developer

Hybrid in Jersey City, New Jersey

•

Yesterday

Job Role: Scala / Apache Spark Developer (Onsite or Hybrid or Remote): Hybrid 3 days (Relocation allowed or Not allowed): Need locals either from NY/NJ Contract Duration: 11+ months Interview Mode: In-person at client location Position Overview The ideal candidate will have solid programming skills, experience developing scalable data processing solutions, and the ability to collaborate with technical teams in a fast-paced environment. Key Responsibilities Design, develop, and maintain applicat

Easy Apply

Contract, Third Party

Depends on Experience

Java Fullstack developer with Hadoop Ecosystems

New York, New York

•

14d ago

Role: Java Fullstack developer with Hadoop Ecosystems Location: New York,NY Type : C2C seeking a highly experienced Senior Java Full Stack Developer with deep expertise in enterprise grade application development, distributed systems, and modern data streaming platforms. The ideal candidate brings strong architectural thinking, hands-on coding capability, and the ability to design scalable, resilient solutions in a complex financial ecosystem. Key Responsibilities * Lead end-to-end design and

Easy Apply

Contract

Depends on Experience

Senior Java Big Data Developer - AVP

Jersey City, New Jersey

•

Today

Overview of the Role: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that i

Full-time

USD 121,200.00 - 181,800.00 per year

Big Data Architect IT Consultant Master

Remote

•

Today

Job Description: Short Description: The DC Client seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort. Complete Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart Cit

Full-time

USD 75.00 - 80.00 per hour

Senior Software Engineer (Java- Big Data)

Remote

•

Today

We are looking for a skilled Backend / Big Data Engineer to join a technology modernization initiative focused on building scalable data and AI-driven applications. You will work primarily with Java, Big Data technologies, AWS, and Kubernetes, helping modernize existing data platforms and develop backend services that support large-scale analytics and AI search capabilities. Essential functions Participate in design and development of Big Data analytical applicationsDesign, support and continuo

Full-time

Principal Engineer, Big Data Platform

Remote or San Francisco, California

•

Today

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility

Full-time

USD 242,634.00 - 499,541.00 per year

Senior Engineer, Big Data - Medical Cost Grouper - Remote

Remote

•

Today

Job Description JOB DESCRIPTION Job Summary Provides senior level engineering support for information technology (IT) big data architecture activities on Microsoft Azure cloud infrastructure. Representing as a Forward Deployed Engineer, responsible for collecting, storing, processing, and analyzing large health care payor datasets supporting Medicare/Medicaid operations. Designs and builds data solutions on Azure Databricks, Azure Data Factory, and Azure Synapse with emphasis on performance, sc

Full-time

USD 79,607.91 - 172,483.80 per year

Big Data Testing Engineer

Remote

•

Today

Net Orbit Inc has openings for the position Big Data Testing Engineer. Project Location: Remote / El Segundo, CA 90245 Job Description: (Current Roles & Responsibility): Validation of data using sqoop and shell scripts. Hands on HQL, hdfs files, partitioning, data load, mock data prep and queries writing in hive/impala Writing queries using joins and using db Managing hdfs directories using UNIX/Linux Writing test automation scripts etc Work location is Tempe, AZ with required travel to client

Full-time

Onsite Position: Middleware Admin with financial exp or Banking in New York, NY (Local candidates only)

New York, New York

•

Yesterday

Location: New York, NY, Local candidates only, onsite no hybrid. Positions: 2 Must have financial exp or Banking TitleMiddleware Infrastructure Support Engineer Organization: Information Technology Position:Contract PRIMARY LOCATION Rate: Best Visa: Citizen, Roles:2 DESCRIPTION Citi, the world leading global bank, has approximately 200 million customer accounts and a presence in more than 160 countries and jurisdictions worldwide. Citi provides consumers, corporations, governments, and instit

Easy Apply

Third Party, Contract

Depends on Experience

2027 | Americas | New York City Area | Engineering | Summer Analyst

New York, New York

•

Today

About Us About the program Our Summer Analyst Program is a nine to ten week summer internship for students pursuing a bachelors / graduate degree. You will be fully immersed in our day-to-day activities. As a participant, you will: Attend orientation where you'll learn about our culture, as well as the benefits and responsibilities of being a member of the firm Receive training designed to help you succeed Have the opportunity to work on real responsibilities alongside fellow interns and our

Full-time

2027 | Americas | New York City Area | Engineering | New Analyst

New York, New York

•

Today

About Us About the program Our New Analyst Program is a full-time program for final year undergraduate and graduate students. As a new analyst, you will learn about our businesses, develop important relationships, and build career-enhancing skills. As a participant, you will: Learn about the firm and how we do business Gain the skills and knowledge necessary to support our businesses Have unlimited access to the training and guidance to help you prepare for the next level Build your professi

Full-time

Sr. Application Support with Infrastructure & Middleware - New York Local Candidates ONLY

New York, New York

•

3d ago

Application Support & Infrastructure Candidate New York, NY (Onsite) 12+ Months Skillset: Working knowledge in UNIX, Tableau, WebLogic, Tibco, WebSphere, Ab Initio, MHub, Appian, Orcle, BigData, Autowatch, control center environment setup maintenance. Knowledge in upgrade, and vulnerability patching Knowledge on SAN, NAS, Load Balancing, data archival, backup and restore process. Responsibilities: The Apps Support Senior Tech Specialist is responsible for providing expertise through comprehensi

Easy Apply

Contract

Depends on Experience

Data Engineer at a Major Japanese Bank

Hybrid in Jersey City, New Jersey

•

24d ago

Description: Summary: Builds systems that gather, store, and process large volumes of data for analysis. Responsibilities: Develop ETL pipelines, ensure data quality, optimize data storage solutions. Skills: Python, SQL, cloud data tools experience (e.g., AWS Glue, Azure Data Factory). Job Overview: We are seeking an experienced Django Backend Lead Developer to join our team. The ideal candidate will have a strong background in backend development, cloud technologies, and bigdata processing. Thi

Easy Apply

Contract

Lead Software Engineer- Financial Services Data Engineering: Pyspark / Java / BigData / Datalake / AI

Jersey City, New Jersey

•

Today

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer- Financial Service Data Engineering: Pyspark / Java / BigData / Datalake / AI, at JPMorganChase within the Asset and Wealth Management- Analytics & Applied AI Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As

Full-time

USD 156,750.00 - 215,000.00 per year

Application Support

New York, New York

•

3d ago

Hi TitleSr. Tech Specialist Organization: Information Technology Position:Contract PRIMARY LOCATION Rate: Best Visa: Citizen, Skillset: Working knowledge in UNIX, Tableau, WebLogic, Tibco, WebSphere, Ab Initio, MHub, Appian, Orcle, BigData, Autowatch, control center environment setup maintenance. Knowledge in upgrade, and vulnerability patching Knowledge on SAN, NAS, Load Balancing, data archival, backup and restore process. DESCRIPTION Citi, the world leading global bank, has approximately 200

Easy Apply

Contract

70+

Big Data jobs in New York, NY, USA