apache spark Jobs in new york

Refine Results
21 - 40 of 461 Jobs

Data Engineer (Databricks)

iTech US, Inc.

•

New York, New York, USA

Contract

Job Role : Databricks Engineer/Developer Job Location: New York City, NY 12+ Months Your future duties and responsibilities: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Databricks. The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a deep understanding of Databricks and Apache Spark. Key Responsibilities: Design and develop scalable data pipeline
Easy Apply
Posted 11 days ago | Updated 11 days ago

Big Data Developer

Capgemini America, Inc.

•

Jersey City, New Jersey, USA

Full-time

Position Title : Big Data Developer Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in software development, data engineering, and large-scale distributed systems. This role requires a deep understanding of big data technologies and the ability to lead and implement enterprise-scale
Easy Apply
Posted 20 days ago | Updated 16 days ago

BigData Architect

Avance Consulting

•

Jersey City, New Jersey, USA

Full-time

Spark Architect Newport, NJ Fulltime Required Qualifications: At least 11 years of Information Technology experienceMust have deep experience in architecting Big Data solutions using Hadoop, Spark, Hive, Kafka, ScalaMust have in depth knowledge of hadoop ecosystemShould have data background. Must have knowledge on data warehouse, ETL, reporting. Good experience in end-to-end implementation of data warehouse and data martsExperience and detailed knowledge with Master Data Management, ETL, Data Q
Easy Apply
Posted 6 days ago | Updated 5 hours ago

Data Engineer

Photon

•

Jersey City, New Jersey, USA

Full-time

Hi All, We have below opening for Data Engineer | Onsite - Jersey City, NJ, USA, if you are interested please share your updated resume to Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment
Easy Apply
Posted 25 days ago | Updated 4 days ago

Lead Data Engineer

Clairvoyant AI, Inc.

•

Jersey City, New Jersey, USA

Full-time

Job Title: Lead Data Engineer Hybrid: Jersey City, NJ Job Type: Fulltime only Key Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Responsibilities: Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Develop and maintain data pipelines, ensuring data quality, integrity, and security. Optimize data storage and retrieva
Easy Apply
Posted 5 days ago

Databricks Developer

RiseIT Solutions

•

New York, New York, USA

Contract

JOB DESCRIPTION: Position: Databricks Developer Location: NYC, NY Duration: 12 months Responsibilities: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Databricks. The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a deep understanding of Databricks and Apache Spark. Key Responsibilities: Design and develop scalable data pipelines and ETL processes us
Easy Apply
Posted 11 days ago

Python Developer with Java

Alchemy Software Solutions LLC

•

Jersey City, New Jersey, USA

Third Party, Contract

Position: Python Developer with Java Location: Jersey City, NJ All 5 Days Onsite Onsite from Day 1 Locals only Duration: Contract Must have: Python: 80% / Java: 20% Required Qualifications, capabilities, and skills Proven Senior Developer with expertise in Oracle, Spark SQL, Java, Python/Shell scriptingStrong experience with AWS services and cloud-based architecturesHands on practical experience in system design, application development, testing and operational stabilityExperience in developing,
Easy Apply
Posted 9 hours ago

Senior Java Backend Developer

Brilliant Infotech Inc.

•

Jersey City, New Jersey, USA

Contract

Senior Java Backend DeveloperJersey City NJ Job Description:Sr. Java Developer with back end services development experience.Looking for a senior Java Developer with spring boot experienceAny knowledge of Spark will be added advantage
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Java Solution Architect

Brandon Consulting

•

New York, New York, USA

Full-time, Contract, Third Party

The Solution Architect will be responsible for creating technical solutions and leading initiatives for our business. You will provide technical leadership and solution engineering expertise to bring together all of our technology assets to create new and innovative products. These could be for our prepaid card processing system, mobile & web applications or our API suite. The scope for you will be broad, and may include infrastructure, software and security domain engineering as well working wi
Easy Apply
Posted 5 days ago | Updated 4 hours ago

Senior Backend Java Developer

ProCorp Systems Inc.

•

New York, New York, USA

Third Party, Contract

Position: Senior Backend Java Developer Location: NYC, NY Duration: 12 Months basically BE Javawith good grip on handlign data volume vs transacrtion app dev Understanding code versioning system, PR, PR builds and branching strategies. (GitHub, bit bucket) Good understanding of below testing framework and its importance; unit testing, integration testing,BDD and Regression. (Junit, cucumber, concordion, etc) knowledge of CICD pipeline (Jenkins or team city, sonar, etc) Ability to understand and
Easy Apply
Posted 5 days ago

Lead Data Engineer Insurance Domain Mandatory 12+years experience only

Marici Solutions

•

Jersey City, New Jersey, USA

Full-time

Key Skills:Snowflake, SQL, Python, Spark, AWS- Glue,Big Data Concepts Must have: 10+ years of relevant experienceinData Engineeringand delivery. 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations. Strong experience with SQL, python and Pyspark Good understanding of Data ingestion and data processing frameworks Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture) Good aptitude, strong problem-solving abilities, analyt
Easy Apply
Posted 14 days ago

Big Data Architect

Photon

•

Jersey City, New Jersey, USA

Full-time

Hi Everyone,We are Photon, one of the world's largest Digital Platform Engineering company providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.I found your profile interesting and wanted to chat with you about a role in one of our programs as a 'Big Data Architect'.Please refer the below job description and let me know if you are interested in proceeding.Designation: Big Data Architect
Easy Apply
Posted 60+ days ago | Updated 3 hours ago

Java Developer (Big Data exp)

Techgroup America Inc.

•

New York, New York, USA

Contract

Position is in NYC, NY, 2 Bryant Park 3 step iv process 1 hour virtual coding round 15 min virtual 1.5 hour onsite interview Only candidates that sit on my w-2 Must Haves CORE Java SPRING BIG DATA- STORM/SPARK/SCALA KAFKA Financial Experience Job Description: Regulatory data and architecture Real time data processing Apache spark, kafka, big data processing technologies Need to work on real projects in the past Deploying to production really helps Business logic is in java Python for scripting a
Easy Apply
Posted 10 hours ago

Apache Flink Streaming Developer/ Lead At Jersey City, NJ

MARVEL INFOTECH Inc

•

Jersey City, New Jersey, USA

Full-time

Apache Flink Streaming Developer/ Lead Location: Jersey City, NJ Hybrid Role ( Need onsite 3-4 days/week) Long Term Project Job Summary: We are seeking a highly skilled and motivated Lead Software Engineer with deep expertise in Apache Flink to lead the development and optimization of our real-time streaming applications. You will be responsible for designing, building, and maintaining scalable and robust data pipelines that process high-volume, high-velocity data. You will provide technical
Easy Apply
Posted 19 days ago | Updated 7 hours ago

Software Development Engineer, Consumer Domains

Amazon.com

•

Newark, New Jersey, USA

Full-time

At Audible, we believe stories have the power to transform lives. It's why we work with some of the world's leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE As a Software Development Engineer, it's up to you to define, design and refine the tech that keeps us one step ahead of listen
Posted 17 hours ago

Hadoop Developer

Innova Solutions, Inc

•

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for a Hadoop Developer. Position type: Contract Duration: Long Term Location: Chicago, IL/Jersey City, NJ/Dallas, TX (Hybrid) As a Hadoop Developer, you will: Position Summary: Top 3 Skills: 1. Hands-on experience of Hadoop ecosystem and its tools 2. Proficient in Spark and at least one programming language(Python/Scala) 3. Good Communication and teamwork skills Required Education: A Bachelors and/or Masters Degree in Relevant field Other Required Skills:
Easy Apply
Posted 60+ days ago | Updated 12 days ago

Senior Machine Learning Engineer

Uber Corporate

•

New York, New York, USA

Full-time

About the Role Uber Marketplace is at the core of Uber's business, and Delivery Pricing is a strategically critical component of Marketplace. The mission of the team is to foster growth and increase profitability of Uber by pushing the frontiers of machine learning, data science, and economics and developing highly reliable and scalable platforms to accelerate Uber's impact on the transportation industry.This role will drive high-impact projects to optimize pricing at Uber using optimization, m
Posted 4 days ago | Updated 4 hours ago

Software Development Engineer, Consumer Domains

Amazon.com

•

Newark, New Jersey, USA

Full-time

At Audible, we believe stories have the power to transform lives. It's why we work with some of the world's leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE As a Software Development Engineer, it's up to you to define, design and refine the tech that keeps us one step ahead of listen
Posted 17 hours ago

Big Data Engineer - Multiple Locations - W2 only

Pyramid Technology Solutions, Inc.

•

New York, New York, USA

Contract

Job Role: Big Data Engineer Location: New York, NY; Chicago, IL, Irving, TX, Woonsocket, RI, Falls Church, VA - Hybrid Role Duration: 12-month contract Responsibilities: Spark Processing engine.Big data tools / technologies/ Streaming (Hive, Kafka)Data Modeling.Experience analyzing data to discover opportunities and address gaps.Experience working with cloud or on-prem Big Data platform(i.e. Google BigQuery, Azure Data Warehouse, or similar).Programming experience in Python.Skills: Hadoop, Hiv
Easy Apply
Posted 6 hours ago | Updated 5 hours ago

Data Engineer

New York Blood Center

•

Rye, New York, USA

Full-time

Overview At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing needs of our diverse communities, further our lifesaving strategic goals in a rapidly changing environment, and expand our impact on the local,
Posted 13 days ago | Updated 13 days ago