apache spark Jobs in new york, ny

Refine Results
361 - 380 of 462 Jobs

Arity - Senior Data Engineer - Google Cloud Platform

Allstate Insurance Company

Remote

Full-time

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description Founded by The Allstate Corporation in 2016, Arity is a da

Staff Data Engineer (Remote)

Becton Dickinson & Company

Florida, USA

Full-time

Job Description Summary Job Description We are the makers of possible BD is one of the largest global medical technology companies in the world. Advancing the world of health is our Purpose, and it's no small feat. It takes the imagination and passion of all of us-from design and engineering to the manufacturing and marketing of our billions of MedTech products per year-to look at the impossible and find transformative solutions that turn dreams into possibilities. We believe that the human e

Senior Software Engineer II - Security Full Stack REMOTE

Walgreens

Remote or Deerfield, Illinois, USA

Full-time

Job Description Job Summary: This role demonstrates proficiency in all areas of the professional function and advanced in-depth specialization to perform and implement activities that impact components / processes of specified functional areas of the Walgreens Digital/Online application. This role is typically assigned to strategic, complex undertakings. Receives work in the form of short- and mid-term outcomes that regularly require the application of independent judgment and creativity. Ment

Senior Software Engineer II - Mobile Security REMOTE

Walgreens

Remote or Deerfield, Illinois, USA

Full-time

Job Description Job Summary: This role demonstrates proficiency in all areas of the professional function and advanced in-depth specialization to perform and implement activities that impact components / processes of specified functional areas of the Walgreens Digital/Online application. This role is typically assigned to strategic, complex undertakings. Receives work in the form of short- and mid-term outcomes that regularly require the application of independent judgment and creativity. Ment

Senior Azure SQL/Cosmos Data Architect

Kforce Technology Staffing

Remote or Charleston, South Carolina, USA

Full-time

RESPONSIBILITIES: Kforce has a client that is looking for a Remote Senior Azure SQL/Cosmos Data Architect for a client. Key Tasks: * Hands-on development - Azure SQL & Cosmos DB: develop and unit test database code * Create and maintain database structures * Senior Azure SQL/Cosmos Data Architect will participate in the design of databases, using first, second or third normalized form as needed to support business requirements * Create, deploy, and maintain ADF pipelines * Monitor database perf

Senior Azure ML/Data Scientist (Mortgage)

Kforce Technology Staffing

Remote or San Diego, California, USA

Full-time

RESPONSIBILITIES: Kforce has a client in San Diego, CA that is looking for a Senior Azure ML/Data Scientist (Mortgage) that is a key technical position and plays an important role in the organization by leading and performing number of activities related to the company's Information Technology functions. Essential Functions: * Lead the development and deployment of sophisticated analytics models to predict, quantify, and interpret complex data related to mortgage lending; Utilize machine learnin

Principal Data/Information Architect

CVS Health

Remote or Dallas, Texas, USA

Full-time

At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care. As the nation's leading health solutions company, we reach millions of Americans through our local presence, digital channels and more than 300,000 purpose-driven colleagues - caring for people where, when and how they choose in a way that is uniquely more connected, more convenient and more compassionate. And we do it all w

Senior Data Engineer

iSpace, Inc

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P

Full Stack Engineer(Java)-Data Modeling - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

Citi: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that is systemically r

Sr. Application Developer (Data Mastering) - Remote

Lincoln Financial Group

Remote or Radnor, Pennsylvania, USA

Full-time

Alternate Locations: Charlotte, NC (North Carolina); Fort Wayne, IN (Indiana); Greensboro, NC (North Carolina); Radnor, PA (Pennsylvania) Work Arrangement: Hybrid Preferred : Preferred employee will work 3 days a week in a Lincoln office Relocation assistance: is not available for this opportunity. Requisition #: 73942 The Role at a Glance The person in this role will be responsible for designing, developing, and implementing Master Data Management solutions. It involves working closely wit

Senior Java Developer 12+ years on W2

Divit Technologies, Inc.

Hanover, New Jersey, USA

Full-time

12+ Years of exp. Work experience as a Fullstack Developer with Core Java, Spring framework (Spring Boot & Spring Batch), RESTful API Services and Angular Experience in writing test cases and Unix Shell scripts Good Knowledge in Relational databases and SQL Problem-solving abilities Eager to learn new technologies in Big Data Space (Hive, Impala, Spark Sql, Scala etc). Any cloud experience (AWS/Azure/Google/Oracle). Desirable skills/Preferred Qualifications: Understanding of Big Data Technologie

Java Developer - 3 Days onsite - Only Local and W2 please

3i Infotech Inc.

Metuchen, New Jersey, USA

Contract

Must be local. In-person interview may required after initial phone interview. Not accepting C2C candidate. Candiadte must be wiing to work on our W2. Java Developer 12 Month Contract to hire Location: Menlo Park, NJ Need atleast 3 days onsite at client location Required skills: Java Spring Boot Microservices Kafka CI/CD SQL Nice to have: Angular Spark

Data Architect: III (Senior)

Randstad Digital

Remote or Madison, New Jersey, USA

Contract

job summary: The Senior Data Engineer is responsible for designing and developing scalable, high-performance data solutions to support millions of users and clients. The role requires expertise in big data technologies such as Spark with Scala, Kafka, NoSQL databases, and AWS cloud services, with a focus on building robust data pipelines and platforms in a fast-paced, collaborative environment. Candidates should have extensive experience in real-time stream processing, data architecture, and a

Fullstack Python Developer - Fulltime - Remote (NY)

ERPMark Inc

New York, New York, USA

Full-time

Role : Full-Stack Python Developer Location: Remote (NY) Fulltime Job Description: o Experience in implementing server-side technologies with RESTful APIs and MVC/MVT design patterns using Django/Flask frameworks. o Experienced in MVW frameworks like Django, /Django and jQuery. o Experienced in developing web-based applications using Python, Django, PHP, XML, CSS5, HTML, DHTML, JavaScript, RabbitMQ, Jdk1.7. o Excellent Programming skills at a higher level of abstraction using Scala and Spa

Lead Data Engineer (GenAI) - Jersey City, NJ (Hybrid - 3days onsite per week)

Lorven Technologies, Inc.

Jersey City, New Jersey, USA

Third Party

Our client is looking for a Lead Data Engineer (GenAI) with a Fulltime / Contract project in Jersey City, NJ (Hybrid) below is the detailed requirement. Job Title : Lead Data Engineer (GenAI) Location : Jersey City, NJ (Hybrid 3days onsite per week) Mode of Hire : Fulltime / Contract Must skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Job Description: Responsibilities: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Proven ex

Lead Data Engineer

Lorven Technologies, Inc.

Jersey City, New Jersey, USA

Third Party

Hi, Our client is looking Lead Data Engineer for Long Term Contract project in Jersey City, NJ below is the detailed requirements. Job Title : Lead Data Engineer Location : Jersey City, NJ Duration : Contract Exp: 12+ Yrs Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Job description: Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them

Data Science- AI Developer

SR Partners LLC

New York, New York, USA

Contract, Third Party

Job Title: Data Scientist / AI Developer Remote Key Responsibilities Design, develop, and deploy machine learning and AI models to support healthcare use cases such as risk prediction, care management, disease progression, and utilization forecasting. Perform data exploration, wrangling, and advanced statistical analysis using structured and unstructured healthcare data (e.g., claims, EMR, SDoH, labs). Collaborate with data engineers and MLOps teams to operationalize models in a scalable and m

Apache Flink Streaming Lead Developer

Business Integra

Jersey City, New Jersey, USA

Full-time

Apache Flink Streaming Developer/ Lead Location: Jersey City, NJ Hybrid Role Long Term Project Job Summary: We are seeking a highly skilled and motivated Lead Software Engineer with deep expertise in Apache Flink to lead the development and optimization of our real-time streaming applications. You will be responsible for designing, building, and maintaining scalable and robust data pipelines that process high-volume, high-velocity data. You will provide technical leadership, mentor junior engine

Lead Python developer - Onsite 5 days a week in NYC NY - locals only

Cyber Sphere LLC

New York, New York, USA

Contract

Job title: Lead Python developerOnsite 5 days a week in NYC NY Longterm Role Description Role Description Lead Python Developer with 10+ years of experience in designing, developing, and deploying enterprise-grade applications across the finance sector, with expertise in Python, PySpark, FastAPI, Pandas, Polars, and Spring Boot to deliver scalable, high-performance solutions Experience in quantitative engineering for interest rate derivatives within a SWAP QE environment Knowledge of big data p

Azure Data Engineer

Kaynes Technology Inc

Woodbridge Township, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin NJ 3 Days Hybrid from Day 1 Note: Only W2 and EST Time Zone Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize