big data engineer (spark) Jobs in new york, ny

Refine Results
1 - 20 of 118 Jobs

Senior Software Engineer, Back End (Python, SQL, Scala, Spark)

Capital One

•

New York, New York, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Software Engineer, Back End (Python, SQL, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software En
Posted 2 days ago | Updated 3 hours ago

Senior Data Engineer (Python, Scala, or Spark)

Capital One

•

New York, New York, USA

Full-time

West Creek 3 (12073), United States of America, Richmond, Virginia Senior Data Engineer (Python, Scala, or Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about
Posted 2 days ago | Updated 17 hours ago

Lead Software Engineer - Python Spark

JPMorgan Chase & Co.

•

Jersey City, New Jersey, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking in Wealth Management technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solu
Posted 60+ days ago | Updated 6 hours ago

Software Engineer III - Big Data

JPMorgan Chase & Co.

•

Jersey City, New Jersey, USA

Full-time

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate & Investment Bank under Payments technology Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various busines
Posted 42 days ago | Updated 6 hours ago

Lead Software Engineer - Python, Big Data

JPMorgan Chase & Co.

•

Jersey City, New Jersey, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Corporate Sector Liquidity Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical
Posted 60+ days ago | Updated 6 hours ago

Software Engineer III - AWS Cloud, Big Data, Python

JPMorgan Chase & Co.

•

Jersey City, New Jersey, USA

Full-time

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate Sector Liquidity Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of t
Posted 60+ days ago | Updated 6 hours ago

Data Engineer Scala, AWS, Spark - Major Entertainment Company

TechLink Resources

•

New York, New York, USA

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Responsibilities: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needsBuild next-gen cloud based big data infrastructure for batch and streaming data appli
Easy Apply
Posted 60+ days ago | Updated 13 days ago

Data Engineer

Reveille Technologies

•

Jersey City, New Jersey, USA

Contract

Job Description:- Develop and maintain data platforms using Python, Spark, PySparkHandling migration to PySpark on AWS Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity. Collaborate with cross functional teams to understand data requirements and design solutions that meet business needs. Implement and manage agents for monitoring, logging, and automation within AWS environments
Easy Apply
Posted 2 days ago

Bigdata Lead

Tanisha Systems, Inc.

•

Woodbridge Township, New Jersey, USA

Contract

Position : Big Data Lead / Data Engineer Location : Philadelphia, PA (Remote) EST Prefer Duration : Contract JOB DESCRIPTION : Primary Skill : 1 Azure data bricks- Build Data Pipelines using ADB-Leveraging Python and Spark Build Data Transformation in ADB Convert Scala Pgms to Py Spark Pgms Understand the SCALA program in Data Bricks 2 ADF Secondary Skills 1 Azure data lake gen 2 2. Synapse analytics (dedicated SQL pool) 3. Exp in delta Lake 4. Pyspark Nice to Have : Tidal Scheduler , Exp
Easy Apply
Posted 1 day ago | Updated moments ago

Senior Spark Data Engineer

Randstad Digital

•

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe
Posted 20 days ago | Updated moments ago

Bigdata Hadoop Engineer

Softsol Resources Inc

•

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S
Easy Apply
Posted 7 days ago | Updated 3 hours ago

Senior Big Data Engineer

VeridianTech

•

Woodbridge Township, New Jersey, USA

Contract, Third Party

Job title: Senior Big Data Engineer Location: New Jersey (Hybrid) Duration: 6 + months Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and D
Easy Apply
Posted 60+ days ago | Updated 1 hour ago

Sr. Cloud Data Engineer

Synechron

•

New York, New York, USA

Full-time, Third Party

We are hiring Sr. Cloud Data Engineer for New York City, NY Job Description: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working with business users along with business analyst expertise Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and in
Easy Apply
Posted 39 days ago | Updated 6 days ago

Big Data Engineer

ADDSOURCE

•

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme
Easy Apply
Posted 15 days ago | Updated 2 hours ago

Azure Data Engineer

Prudential Financial

•

Newark, New Jersey, USA

Full-time

This role is not approved for H1 or F1 OPT applicants. What you will do Our Technology Solutions Group is a dynamic, fast-paced environment, with exciting changes on the horizon under new senior leadership. We are looking for an astute, determined professional like you to fulfil a Data Engineering role within our Technology Solutions Group. You will showcase your success in an Agile environment through collaboration, ownership and innovation. Your expertise in emerging trends and practices will
Easy Apply
Posted 6 days ago | Updated 5 days ago

Staff Hadoop Administrator - Cloudera / BigData

ServiceNow, Inc.

•

Remote or New York, New York, USA

Full-time

Company Description At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can't wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make t
Posted 4 days ago | Updated 5 hours ago

Staff Software Engineer - Big Data

ServiceNow, Inc.

•

Remote or San Diego, California, USA

Full-time

Company Description At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can't wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make t
Posted 20 days ago | Updated 5 hours ago

Data Engineer

Synechron Inc.

•

New York, New York, USA

Full-time

We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development in
Posted 6 days ago

Senior Big Data Engineer

ADDSOURCE

•

Remote

Third Party

Senior Big Data Engineer 12+Years Remote Mandatory Skills: Spark, Scala EMR and AWS Requirements: Bachelor's degree preferably in Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployments, technical guida
Easy Apply
Posted 35 days ago | Updated 2 hours ago

Data Engineer - Scala

Jobot

•

New York, New York, USA

Contract

100% Remote This Jobot Consulting Job is hosted by: Duran Workman Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $75 - $95 per hour A bit about us: We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, E
Posted 18 hours ago | Updated 6 hours ago