big data engineer Jobs in new york

Refine Results
21 - 40 of 403 Jobs

AWS Data Engineer

First Soft Solutions

Florham Park, New Jersey, USA

Contract, Third Party

We are actively hiring for Sr.AWS Data Engineer C2C Senior Data Engineer Location: Florham Park, NJ OR Charlotte, NC (Hybrid) AWS Data Engineer (Spark, AWS, Glue) Must Skill: - Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities - Design and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large disparate datasets - Build robust data pipelines on the Cloud usin

19028976 Data Engineer, MTA

TransUnion

New York, New York, USA

Full-time

As the real-time provider of cloud-based information services and data analytics, we enable marketing and IT security professionals to promote and protect their businesses. With a commitment to privacy and neutrality, TransUnion operates complex data registries and uses its expertise to deliver actionable, data-driven insights that help clients make high-value business decisions in real time, one customer interaction at a time. Our vision is to be the single most trusted source of commercial ins

Sr Data Modeler

Cystems Logic

Jersey City, New Jersey, USA

Full-time, Contract, Third Party

Sr Data Modeler Location: Jersy City, New Jersey 3 Data Modelers needed: Contract only, Onsite Mon-Wed in Jersey City. Team is tasked with cataloging data models, assessing risk, and determining what data can be purged. 6+ years of experience with Erwin Hands on Data Modeling and Data Mapping experience. Domain experience with Risk / Controls for large enterprise Excellent verbal communication skills, needs to explain data concepts clearly to the business. Understanding of Risk, Data Author

Quantitative Developer - Only on W2(NY&NJ Local's)

Reliable Software Resources

New York, New York, USA

Contract

Job Title: Quantitative Developer Location: New York City, NY (Hybrid) Duration: 24+ Months Job Description: Top Skills' Details 5+ years experience within Quantitative Analysis 2. Strong experience with Python and Big Data Technologies 3. Strong understanding of Capital Markets 4. Strong Communication Responsibilities: Performs end-to-end market risk stress testing including scenario design, scenario implementation, results consolidation, internal and external reporting, and analyzes stress s

Data Engineer II

The Connors Group, Inc.

Remote

Full-time

The Data Engineer II plays a critical role in engineering of data solutions that support the reporting and analytic needs. As a key member of the Data engineering team, will work on diverse data technologies such as Steramsets, dbt, data ops and others to build insightful, scalable, and robust data pipelines that feed our various analytics platforms. ESSENTIAL FUNCTIONS: Design and Model data engineering pipelines that support company reporting and analytic needs. Engineer efficient, adaptable,

Software Engineer 4 - Contingent

Pinnacle Group

New York, New York, USA

Full-time

Only W2 Job Title: Big Data Developer/ Engineer with Java Location: New York City, NY Duration: 12 months Contract RTO: 3 Days/ week to office Job Description: In this contingent resource assignment, candidate may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or u

Bigdata Lead

Tanisha Systems, Inc.

Woodbridge Township, New Jersey, USA

Contract

Position : Big Data Lead / Data Engineer Location : Philadelphia, PA (Remote) EST Prefer Duration : Contract JOB DESCRIPTION : Primary Skill : 1 Azure data bricks- Build Data Pipelines using ADB-Leveraging Python and Spark Build Data Transformation in ADB Convert Scala Pgms to Py Spark Pgms Understand the SCALA program in Data Bricks 2 ADF Secondary Skills 1 Azure data lake gen 2 2. Synapse analytics (dedicated SQL pool) 3. Exp in delta Lake 4. Pyspark Nice to Have : Tidal Scheduler , Exp

Azure Data Engineer

Prudential Financial

Newark, New Jersey, USA

Full-time

This role is not approved for H1 or F1 OPT applicants. What you will do Our Technology Solutions Group is a dynamic, fast-paced environment, with exciting changes on the horizon under new senior leadership. We are looking for an astute, determined professional like you to fulfil a Data Engineering role within our Technology Solutions Group. You will showcase your success in an Agile environment through collaboration, ownership and innovation. Your expertise in emerging trends and practices will

A senior KDB/Q developer for a global innovative firm

GTechNY

New York, New York, USA

Full-time

A global FinTech is looking for a Senior KDB developer. You should have a minimum of 5 years of experience working in a financial setting. We are looking for true KDB+/Q expertise. You will be the senior resource on our KDB team and be the go-to for all complex KDB matters. In-memory column-based database virtuosity is essential for this role. A thorough knowledge of the KDB syntax and functional programming paradigm is expected. You should have worked with Big Data and high frequency mechanis

Senior Quantitative Finance Analyst

Rivi Consulting Group

New York, New York, USA

Contract

Job title: Senior Quantitative Finance Analyst Top Skills' Details 5+ years experience within Quantitative Analysis 2. Strong experience with Python and Big Data Technologies 3. Strong understanding of Capital Markets 4. Strong CommunicationJob Description: This job is responsible for conducting quantitative analytics and complex modeling projects for specific business units or risk types. Key responsibilities include leading the development of new models, analytic processes, or system approach

AWS Data Architect

Brilliant Infotech Inc.

Edison, New Jersey, USA

Full-time

Role: Aws Data Architect Location: NY, NJ locations Duration: Long term Job Description: Proven experience as a Data Architect, with a focus on designing and implementing data solutions in AWS cloud environments.Extensive knowledge of AWS cloud services, data lake architecture, and big data technologies. Strong understanding of data modeling principles, data governance, and data security practices.Demonstrated expertise in designing data integration solutions and optimizing data processing perf

Distinguished Engineer, Card Data

Capital One

New York, New York, USA

Full-time

West Creek 2 (12072), United States of America, Richmond, Virginia Distinguished Engineer, Card Data Distinguished Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to delive

Distinguished Engineer, Card Tech Data

Capital One

New York, New York, USA

Full-time

West Creek 2 (12072), United States of America, Richmond, Virginia Distinguished Engineer, Card Tech Data Distinguished Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to d

Big Data

OJUS LLC

Jersey City, New Jersey, USA

Contract

Big Data Developer Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing errors/exceptions. occurred in Spark job execution. Must have experience working in different SDLC phases

Data Engineer - Scala

Jobot

New York, New York, USA

Contract

100% Remote This Jobot Consulting Job is hosted by: Duran Workman Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $75 - $95 per hour A bit about us: We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, E

KDB+/Q developer for a global PS firm

GTechNY

New York, New York, USA

Full-time

A global specialized solutions provider is looking for a KDB developer. We are expanding our US presence and are looking to add growth hires. You should have experience doing development with KDB+. Q skills are obviously essential. You will work on low latency high frequency applications. A background in data analytics and data science is helpful. Any knowledge of AI, specifically with KDB.ai, or any other generative AI contextual search skills will make you standout. Big Data, infrastructure,

Senior Software Engineer - ModBus, DNP3, .NET [REMOTE]

Technology Navigators

Remote

Full-time

No sponsorship. No third-party/C2C candidates. Senior Software Engineer C#, .NET Core, PostGres, Modbus, DNP3 REMOTE, must reside in Texas Salary: 120-135K DOE Benefits: Medical, Dental, and Vision Insurance, Flexible Spending Account, Long and Short term Disability, 401K Match, Unlimited PTO *This is an exclusive, off-market opportunity. Our client searches are confidential.* Apply now to learn more about this unique new position! What you get to do: Operate independently in a distributed team

Sr. Cloud Data Engineer

Synechron

New York, New York, USA

Full-time, Third Party

We are hiring Sr. Cloud Data Engineer for New York City, NY Job Description: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working with business users along with business analyst expertise Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and in

Software Engineer, VP - Search & Retrieval (New York, NY)

Goldman Sachs & Co.

New York, New York, USA

Full-time

At Goldman Sachs, our Engineers don't just make things - we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create ne

Sr Talend Developer

iQuest Solutions Corp

New York, New York, USA

Third Party

Role: Sr. Talend Developer Location: New York, NY (Onsite Role) Duration: 12+ Months Responsibilities: Ability to grasp complex problems and develop a simple yet comprehensive solution that meets or exceeds the client's expectations Ability to explain difficult or complex problems and solutions to varying audiences which allows them to understand and works to build consensus Proactively shares experiences and knowledge to help the team improve its development processes and practices Actively s