Hadoop Big Data Spark Engineer Jobs in New York, NY

Refine Results
21 - 40 of 285 Jobs

Engineer, Big Data - SQL/Databricks/Data Modeling/Pipelines/Power BI - Remote

Molina Healthcare

Remote or Long Beach, California, USA

Full-time

Job Description Job Description Job Summary Responsible for collecting, storing, processing, and analyzing large sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. He/she will also be responsible to follow architecture and best practices used across the enterprise. Knowledge/Skills/Abilities: Define ideal Architecture, Evaluating tools and Frameworks, Standards & Best Practices for implementing

Fulltime opportunity - Data Solution Architect - Photon - Jersey City, NJ

Photon

Jersey City, New Jersey, USA

Full-time

Architect, implement, and optimize end-to-end solutions designed for large-scale datasets, ensuring scalability and efficiency. Big data ecosystem (Good understanding of Hadoop, Cloudera), exposure to Hive, Impala, Yarn, Kafka. Drive cross-functional collaboration, bridging technical teams and business stakeholders. Oversee data pipeline design, model development, and deployment with a focus on scalability and accuracy. Drive compliance with policies/standards (e.g., data quality) and adoption o

Data Engineer (Databricks)

iTech US, Inc.

New York, New York, USA

Contract

Job Role : Databricks Engineer/Developer Job Location: New York City, NY 12+ Months Your future duties and responsibilities: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Databricks. The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a deep understanding of Databricks and Apache Spark. Key Responsibilities: Design and develop scalable data pipeline

SQL Server / Big Data - Software Engineer 3

Genesis10

Remote

Full-time

Genesis10 is currently seeking a SQL Server / Big Data Engineer with our client in the financial Industry located in Irving, TX. This is a 24+ month contract position. Responsibilities: Develop and optimize complex SQL Server queries based on business requirements Support and enhance an existing data framework using SQL Server Apply knowledge of the Hadoop ecosystem to inform decisions around data structure, architecture, and scalability (hands-on experience not required, but must understand the

Tech Lead Machine Learning Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A35008 Apply to this job Share this listing: Responsibilities The Ads Targeting's goal is to help advertisers reach their desired audience and optimize advertisement performance. As a member of the Ads Targeting, Ads Core team, you will apply machine learning models to scale budgets by understanding user interest and intention, and build large-scale foundations for data processing and serving for next-generation ad targeting product

Senior Machine Learning Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A36558 Apply to this job Share this listing: Responsibilities The Ads Targeting's goal is to help advertisers reach their desired audience and optimize advertisement performance. As a member of the Ads Targeting, Ads Core team, you will apply machine learning models to scale budgets by understanding user interest and intention, and build large-scale foundations for data processing and serving for next-generation ad targeting product

Machine Learning Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A154520 Apply to this job Share this listing: Responsibilities The Ads Targeting's goal is to help advertisers reach their desired audience and optimize advertisement performance. As a member of the Ads Targeting, Ads Core team, you will apply machine learning models to scale budgets by understanding user interest and intention, and build large-scale foundations for data processing and serving for next-generation ad targeting produc

PySpark/Big Data Development Lead

E-Solutions, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : PySpark/Big Data Development Lead Location : Jersey City, NJ (Hybrid) Fulltime Job Description Must have minimum of 8+ years of overall experience in Big Data. Preferred with 6+ years hands-on experience as a PySpark development Strong programming skills in Hive/Python with minimum 5 Years of Experience. Familiarity with big data processing tools and techniques Experience with the Hadoop ecosystem Good understanding of distributed systems Should be familiar with Data warehouse

Data Engineer

Photon

Jersey City, New Jersey, USA

Full-time

Hi All, We have below opening for Data Engineer | Onsite - Jersey City, NJ, USA, if you are interested please share your updated resume to Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment w

Java Solution Architect

Fynbosys Inc

New York, New York, USA

Contract

JPC - 9421Java Solution ArchitectThe Solution Architect will be responsible for creating technical solutions and leading initiatives for our business. You will provide technical leadership and solution engineering expertise to bring together all of our technology assets to create new and innovative products. These could be for our prepaid card processing system, mobile & web applications or our API suite. The scope for you will be broad, and may include infrastructure, software and security doma

Pyspark Development Lead

Capgemini America, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : PySpark Development Lead Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description: 8 + years hands-on experience as a PySpark developmentStrong programming skills in Hive/Python with minimum 5 Years of Experience.Familiarity with big data processing tools and techniquesExperience with the Hadoop ecosystemGood understanding of distributed systemsShould be familiar with Data warehouse concepts.Experience with streaming data

Hadoop Developer

New York Technology Partners

East Hanover, New Jersey, USA

Contract

Hello Manoj I hope you are doing well. We are constantly on the lookout for professionals to fulfil the staffing needs of our clients, and we currently have a job opening that may interest you. Job Title: Hadoop Developer Location: Whippany, NJ Position Type: Long term contract Job Description Responsibilities: Cluster Management: Setting up, configuring, and maintaining Hadoop clusters, including adding and removing nodes.Performance Tuning: Monitoring and tuning the performance of Hadoop clus

Python Developer

Savvyan Technologies

New York, New York, USA

Contract

Here s a typical job description for a Python Developer: Job Title: Python Developer<>Job Type: W2Job Description:We are seeking a talented and passionate Python Developer to join our dynamic development team. As a Python Developer, you will be responsible for designing, developing, testing, and maintaining high-quality Python-based applications. The role involves working with cutting-edge technologies, collaborating with cross-functional teams, and contributing to both front-end and back-end de

Sr. Bigdata Engineer - Fulltime Only

CitiusTech

Remote

Full-time

Job Description Sr. Bigdata Engineer Who we are: - At CitiusTech, we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140 organizations through next-generation technologies, solutions, and products. We aim to accelerate the transition to a human-first, sustainable, and

Senior Big Data Engineer

ProHire Solution

Remote

Full-time

Job Location: 100% remote (USA or Canada) Job Summary: We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and bui

Big Data Architect

Photon

Jersey City, New Jersey, USA

Full-time

We are Photon, one of the world's largest Digital Platform Engineering company providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.I found your profile interesting and wanted to chat with you about a role in one of our programs as a 'Big Data Architect'. Please refer the below job description and let me know if you are interested in proceeding. Designation: Big Data ArchitectLocation:

Senior Lead Software Engineer - Machine Learning Engineer

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

Job Description Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. Are you ready to make a significant impact in the world of AI and machine learning? At JPMorgan Chase, In this role, you'll be a key player in an agile team dedicated to enhancing, building, and delivering market-leading technology products that are secure, stable, and scalable As a Senior Lead Software/Machine Learning Engineer, at JPMorgan

Lead Data Engineer Insurance Domain Mandatory 12+years experience only

Marici Solutions

Jersey City, New Jersey, USA

Full-time

Key Skills:Snowflake, SQL, Python, Spark, AWS- Glue,Big Data Concepts Must have: 10+ years of relevant experienceinData Engineeringand delivery. 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations. Strong experience with SQL, python and Pyspark Good understanding of Data ingestion and data processing frameworks Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture) Good aptitude, strong problem-solving abilities, analyt

Hadoop Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for a Hadoop Developer. Position type: Contract Duration: Long Term Location: Chicago, IL/Jersey City, NJ/Dallas, TX (Hybrid) As a Hadoop Developer, you will: Position Summary: Top 3 Skills: 1. Hands-on experience of Hadoop ecosystem and its tools 2. Proficient in Spark and at least one programming language(Python/Scala) 3. Good Communication and teamwork skills Required Education: A Bachelors and/or Masters Degree in Relevant field Other Required Skills:

Summer College Intern-IT Data Scientist

City of New York

Queens, New York, USA

Part-time

Company Description Job Description The New York City Department of Correction (DOC) is an integral part of the City's evolving criminal justice system, participating in reform initiatives and strategies aimed to move the City towards a smaller jail system without compromising public safety. The DOC is responsible for maintaining a safe and secure environment for our employees, visitors, volunteers, and people in our custody. Importantly, safe jails enable DOC to provide people in custody with