Big data Jobs in New York

Refine Results
421 - 440 of 528 Jobs

Data Management Operations Specialist

Guardian Life Insurance Company

•

Remote or Bethlehem, Pennsylvania, USA

Full-time

Job Overview: We are seeking a highly skilled and proactive Data Management Operations Specialist to join our Data Management team in the insurance industry. This individual will play a critical role in supporting the Data Management Strategy and Operations Leader by overseeing the daily operations of our data management processes, ensuring the accuracy, accessibility, and compliance of data, and implementing strategic initiatives aimed at optimizing data governance and quality. This is a uniqu
Posted 60+ days ago | Updated 1 hour ago

Master Data Management Sr. Developer

Lincoln Financial Group

•

US

Full-time

Alternate Locations: Charlotte, NC (North Carolina); Fort Wayne, IN (Indiana); Greensboro, NC (North Carolina); Radnor, PA (Pennsylvania); Work from Home Work Arrangement: Hybrid Preferred : Preferred employee will work 3 days a week in a Lincoln office Relocation assistance: is not available for this opportunity. Requisition #: 73942 The Role at a Glance The person in this role will be responsible for designing, developing, and implementing Master Data Management solutions. It involves wor
Posted 51 days ago | Updated 25 days ago

AVP- Data Analytics Senior Analyst (hybrid)

Citi

•

Remote or Irving, Texas, USA

Full-time

The Data Analytics Senior Analyst is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flow for the area or function. Integrates subject matter and industry expertise within a defined area. Requires in-depth understanding of how areas collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the function and overall business. Evaluates mo
Posted 60+ days ago | Updated 1 hour ago

Arity - Lead Data Scientist - AdTech/RTB

Allstate Insurance Company

•

Remote

Full-time

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description Arity Founded by The Allstate Corporation in 2016, Arity i
Posted 60+ days ago | Updated 1 hour ago

Principal, Software Engineer - Conversational AI

Walmart Inc.

•

Remote or Sunnyvale, California, USA

Full-time

Position Summary What you'll do Cortex Team is Walmarts core A.I. conversational platform, powering the vision of delivering the worlds best personal assistants to Walmarts customers, accessible via natural voice commands, text messages, rich UI interactions, and a mix of all of the above via multi-modal experiences. We believeconversationsare a natural and powerful user interface for interacting with technology and enable a richer customer experiences both online and in-store. We are building
Posted 60+ days ago | Updated 1 hour ago

Cloud Infrastructure Engineers-Azure-Evergreen

General Dynamics

•

District of Columbia, USA

Full-time

Type of Requisition: Pipeline Clearance Level Must Currently Possess: Secret Clearance Level Must Be Able to Obtain: Secret Public Trust/Other Required: None Job Family: Software Development Job Qualifications: Skills: Cloud Infrastructure, Extract Transform Load (ETL), Microsoft Azure, Microsoft Azure Databricks, Terraform (Software) Certifications: None Experience: 10 + years of related experience ship Required: No Job Description: Software Developer Expert Your Impact Own your oppor
Posted 29 days ago | Updated 1 hour ago

Director, Data Services and AI

Kentro

•

US

Full-time

Description Thank you for considering IT Concepts dba Kentro, where innovation drives opportunity and collaboration leads to success. Our dynamic community of experts is fully committed to advancing our customers' missions, fostering professional growth, and making a positive impact on our communities. Our transition to Kentro in 2025 reflects a rich legacy built upon the foundation of IT Concepts. Rather than leaving ITC behind, we confidently embrace a future centered around the Core of More
Posted 60+ days ago | Updated 9 hours ago

Senior Data Engineer

iSpace, Inc

•

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P
Easy Apply
Posted 60+ days ago | Updated 6 hours ago

Azure SQL Developer

iSpace, Inc

•

Remote

Full-time

JOB DETAILS: Title: Senior SQL Developer (with Azure Data Factory) Location: Remote, but must work PST hours (client is based out in Burbank, CA) Type: Direct Hire / Full Time Employee Job Description: Knowledge/Skills/Abilities: Expertise in ELT optimization, designing, coding, and tuning big data processes using Microsoft Azure Synapse or similar technologies.Experience with building data pipelines and analytics solution to stream and process datasets at low latencies.Knowledge of Data Eng
Easy Apply
Posted 60+ days ago | Updated 6 hours ago

Data Engineer - ETL, Spark hadoop and Funds background.

RIIM

•

Jersey City, New Jersey, USA

Full-time

Looking for Data Engineer having experience with ETL, Spark hadoop and Funds background. Jersey City, NJ - Hybrid ETL, spark hadoop as tech skills but needs someone from Funds background.Proficient in Hadoop, Python, Spark, SQL Unix and HiveBasic understanding of on Prem and Google Cloud Platform data securityHands on development experience on large ETL/ big data systems .Google Cloud Platform being a big plus
Easy Apply
Posted 5 days ago

Java Spark Developer

ITBMS Inc.

•

Jersey City, New Jersey, USA

Contract, Third Party

Mandatory Skills: Strong experience in Java Spark, understanding of distributed computing, big data principles, and batch processing.Proficiency in understanding and working with AWS services, especially S3, Glue and Athena. Detailed Description: Combine interface design concepts with digital design and establish milestones to encourage cooperation and teamwork.Develop overall concepts for improving the user experience within a business webpage or product, ensuring all interactions are intuitiv
Easy Apply
Posted 2 hours ago

Google Cloud Platform Engineer

Aptino

•

Jersey City, New Jersey, USA

Contract, Third Party

Implement and control the flow of data to and from Google Cloud Platform Migrate on-premises workloads to Google Cloud Platform, hands on experience migrating data to the cloud. familiarity with the disciplines of enterprise software development such as configuration & release management, source code. Data engineering tools and technologies, including SQL, and Google Cloud Platform Experience with Big Query and Big Data technologies like Spark, Hadoop Exposure to any programming ( Java , .Net ,
Easy Apply
Posted 11 days ago | Updated 4 hours ago

Kafka Admin

OJUS LLC

•

Jersey City, New Jersey, USA

Third Party, Contract

Job Title: Kafka Admin Location NJ, Delaware, Tampa FL Design and architect solutions using Confluent Kafka. Sound understanding of Big data concepts.Must have knowledge on securing Kafka using Kafka ACLs.Good to have knowledge of enablement of Kafka connectors.Must have experience with security in Confluent Kafka v5.* and above.Out-of-the-box thinking regarding technology solutions and in resolving technical issues for the team.Will be required to provide high-level technical support for automa
Easy Apply
Posted 17 days ago

Java Spark Developet

SelSoft Inc.

•

New York, New York, USA

Contract, Third Party

Greetings, Job Description: Mandatory Skills: Strong experience in Java Spark, understanding of distributed computing, big data principles, and batch processing.Proficiency in understanding and working with AWS services, especially S3, Glue and Athena. Detailed Description: Combine interface design concepts with digital design and establish milestones to encourage cooperation and teamwork.Develop overall concepts for improving the user experience within a business webpage or product, ensuring a
Easy Apply
Posted 3 days ago

Sr. AI/ML Engineer

Info Dinamica Inc

•

Jersey City, New Jersey, USA

Contract, Third Party

Title: Sr. AI/ML Engineer Location: Jersey City, NJ/ NYC, NY Detailed Description: Experienced AI/ML Engineer with expertise in Machine Learning, Deep Learning, NLP, Generative AI, and Big Data Engineering. Proven track record in leading large-scale AI/ML initiatives using Java Spark, PySpark, and cloud-native tools. Strong hands-on experience in LLMs, RAG with the ability to drive end-to-end solutions from architecture to production. Highly skilled Lead Engineer with deep expertise in Large La
Easy Apply
Posted 3 days ago | Updated moments ago

KAFKA Admin

Ventures Unlimited

•

New York, New York, USA

Full-time

Must Have Technical/Functional Skills Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafka infrastructure. Creating and managing Kafka topics, producers, consumers, and Python-based Kafka consum
Easy Apply
Posted 19 days ago | Updated 13 days ago

Spark/Scala Developer

EdHike, LLC

•

Jersey City, New Jersey, USA

Third Party, Contract

Job Title: Spark/Scala DeveloperLocation: NJ / DE / FL Job Description: We are seeking a skilled Scala and Spark Developer to join our data engineering team. The ideal candidate will be responsible for developing, optimizing, and maintaining big data pipelines using Apache Spark and Scala. You will work closely with data scientists, analysts, and other engineers to ensure high-quality data processing solutions that support business intelligence and analytics initiatives. Key Responsibilities: D
Easy Apply
Posted 3 days ago

Sr. AI/ML Engineer

Pegasys Information Technologies

•

Jersey City, New Jersey, USA

Contract, Third Party

Job Title: Sr. AI/ML Engineer Location: Jersey City, NJ/ NYC, NY (Onsite) Duration: Long term Job Description : Designing and developing AI/ML applications and LLM, JAVA Spark.sound knowledge on GEN AILLMs & RAG Applications: Fine-tune and deploy LLMs integrated with vector databases (FAISS, Pinecone, ChromaDB).Experienced AI/ML Engineer with expertise in Machine Learning, Deep Learning, NLP, Generative AI, and Big Data Engineering.Proven track record in leading large-scale AI/ML initiatives u
Easy Apply
Posted 5 hours ago

Snowflake Architect

ITBMS Inc.

•

New York, New York, USA

Contract, Third Party

Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity. Deep understanding of Snowflake sharing capabilities, Listings (auto fulfillment), and Marketplace features. Hands-on experience with Snowflake cost management in multi-tena
Easy Apply
Posted 6 days ago

Snowflake Architect

SelSoft Inc.

•

New York, New York, USA

Full-time, Third Party

Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity. Deep understanding of Snowflake sharing capabilities, Listings (auto fulfillment), and Marketplace features. Hands-on experience with Snowflake cost management in multi-tena
Easy Apply
Posted 4 hours ago