big data platform engineer hadoop Jobs in 10001

Refine Results
41 - 60 of 340 Jobs

Big Data Engineer

Diamond Pick

Remote

Contract

POSITION SUMMARY: The Big Data Engineer is responsible for designing and developing data pipelines, ensuring efficient data processing, and maintaining data infrastructure. They work with large-scale data sets, implement ETL (Extract, Transform, Load) processes, and collaborate with cross-functional teams to meet business needs. RESPONSIBILITIES: Designing and Building Data Pipelines Develop and maintain data processing pipelines using Python, PySpark, and Big Data technologies (e.g., Dataproc

Staff Engineer - App Platform Datastore

Datadog

New York, New York, USA

Full-time

Datadog is seeking an experienced Staff Engineer to join our App Platform team. The team is responsible for foundational services that support the App Builder and Workflow Automation products. Today, those services power a catalog of 500+ out-of-the-box actions used to manage queues, jobs or deployments, list or page on-call engineers, scale up container clusters, block IP addresses, and much more. We're looking to evolve this platform by building capabilities to unlock new use-cases for App Bu

Specialist Software Platform Engineer

Metropolitan Transportation Authority

New York, New York, USA

Full-time

Description JOB TITLE: Specialist Software Platform Engineer SALARY RANGE: $110,748 - $130,719 HAY POINTS: 451 DEPT/DIV: Information Technology SUPERVISOR: Director, Office of Enterprise Application Middleware LOCATION: Vario 2 Broadway New York, NY 10004 HOURS OF WORK: 9:00 am - 5:30 pm (7.5 hours/day) or as required) This position is eligible for telework which is currently two day per week. New hires are eligible to apply 30 days after their effective date of hire. Summary: Specialist Softwar

Software Engineer - Production Platform

Datadog

New York, New York, USA

Full-time

The Compute Production Platform team at Datadog provides a suite of secure services to Datadog's engineering teams. In this role, you'll develop and maintain critical secrets management tooling and provisioning that power Datadog's products. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What Yo

Senior Scientist - Delivery Pricing

Uber Corporate

New York, New York, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create

Data Engineer - Scala

Jobot

New York, New York, USA

Contract

100% Remote This Jobot Consulting Job is hosted by: Duran Workman Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $75 - $95 per hour A bit about us: We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, E

Vice President - Compliance Engineering DevOps - New York

Goldman Sachs & Co.

New York, New York, USA

Full-time

YOUR IMPACT Are you passionate about developing mission-critical, high quality software solutions, using cutting-edge technology,in a dynamic environment? OUR IMPACT We are Compliance Engineering,a global team of more than 300 engineers and scientists whowork on the most complex, mission-critical problems. We: build and operate a suite of platforms and applications that prevent, detect, and mitigate regulatory and reputational risk across the firm.have access to the latest technology andto ma

Senior Scientist - Marketplace Pricing/Incentives

Uber Corporate

New York, New York, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create

Senior Data Architect

Raas Infotek LLC

Newark, New Jersey, USA

Contract

Job Title: Senior Data Architect Summary: We are seeking an experienced Senior Data Architect with over 15 years of experience to join our dynamic team. The ideal candidate will have a strong background in data architecture, data modeling, and data management, with a proven track record of leading complex data projects. This role requires a visionary leader who can drive our data strategy forward, ensuring data solutions are scalable, secure, and aligned with business objectives. Key Responsibil

Hadoop Engineer

Buxton Consulting

Remote

Full-time

Hadoop Engineer Remote Role- must work on PST time zone 12+contract Must Haves- Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must.Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must.4-5 experience building data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL., HBase.4-5 years of programming experience in Python, Java and Scala is must.Strong experience with REST API development using Python fr

Big Data Engineer

ADDSOURCE

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme

Senior Data Engineer

Tiger Analytics

Jersey City, New Jersey, USA

Full-time

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in t

AWS Glue Big data engineer

System Soft Technologies

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution

Sr. Data Platform Engineer(Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm) : Princeton NJ

Yashco Systems, Inc.

Remote or Princeton, New Jersey, USA

Contract

Sr. Data Platform Engineer Location: Princeton NJ Duration: 6 months Sr. Data Platform Engineer Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigmIntegrating technical functionality, ensuring data accessibility, accuracy, and security.Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces.Define and organize data assets (structured and unstructured

Engineering Manager

Apple, Inc.

New York, New York, USA

Full-time

Summary The Apple Services Engineering team is one of the most exciting examples of Apple's long-held passion for combining art and technology. These are the people who power the App Store, Apple TV, Apple Music, Apple Podcasts, and Apple Books. And they do it on a massive scale, meeting Apple's high expectations with high performance to deliver a huge variety of entertainment in over 35 languages to more than 150 countries. These engineers build secure, end-to-end solutions. They develop the c

Senior Data Engineer- Asset & Wealth Management- New York- Vice President

Goldman Sachs & Co.

New York, New York, USA

Full-time

At Goldman Sachs, our Engineers don't just make things - we make things possible. We change the world by connecting people and capital with ideas and solve the most challenging and pressing engineering problems for our clients. Our engineering teams build scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Engineering, which is c

Senior Software Engineer, Android

Capital One

New York, New York, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Software Engineer, Android Do you want to work for a tech company that writes its own code, develops its own software, and builds its own products? We experiment and innovate leveraging the latest technologies, engineer breakthrough customer experiences, and bring simplicity and humanity to banking. We make a difference for 65 million customers. At Capital One, you'll be part of a big group of makers, breakers, doers and disru

Principal Software Engineer - Data Enrichment Platform (Remote)

CrowdStrike

Remote

Full-time

#WeAreCrowdStrike and our mission is to stop breaches. As a global leader in cybersecurity, our team changed the game. Since our inception, our market leading cloud-native platform has offered unparalleled protection against the most sophisticated cyberattacks. We work on large scale distributed systems, processing over 1 trillion events a day with a petabyte of RAM deployed in our Cassandra clusters - and this traffic is growing daily. We're looking for people with limitless passion, a relentle

Senior Data Engineer

Capital One

New York, New York, USA

Full-time

Locations: TX - Plano, United States of America, Plano, Texas Senior Data Engineer Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying

Senior Data Engineer - Principal Associate

Capital One

New York, New York, USA

Full-time

Center 2 (19050), United States of America, McLean, Virginia Senior Data Engineer - Principal Associate Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying d