apache spark Jobs in new york, ny

Refine Results
21 - 40 of 426 Jobs

VP, Architecture & Data Engineering

Horizon Media, Inc.

New York, New York, USA

Full-time

Who We Are Horizon Media, founded in 1989 by Bill Koenigsberg, is recognized as one of the most innovative marketing and advertising firms. We are headquartered in New York City, with offices in Los Angeles and Toronto. A leader in driving business solutions for marketers, Horizon is known for its highly personal approach to client service. Renowned for its incredible culture, Horizon is consistently named to all the prestigious annual Best Places to Work lists published by Fortune, AdAge, Crai

Scala Developer

Arthur Lawrence

Yonkers, New York, USA

Contract

Arthur Lawrence is looking to hire a Scala Developer for one of our clients in Yonkers, NY. Please find the job description below and send us your updated resume, if interested: Must-Have: 8+ years of experience as a Scala DeveloperExperienced with Scala, Spark, Kubernetes, Azure, Airflow, and SQLWorked with Financial Services, CAT regulation, AKS, ACR, and ADLS **TN visa sponsorship is available for successful candidates. About Us: Arthur Lawrence is a management and technology consulting fir

Hadoop Developer

New York Technology Partners

East Hanover, New Jersey, USA

Contract

Hello Manoj I hope you are doing well. We are constantly on the lookout for professionals to fulfil the staffing needs of our clients, and we currently have a job opening that may interest you. Job Title: Hadoop Developer Location: Whippany, NJ Position Type: Long term contract Job Description Responsibilities: Cluster Management: Setting up, configuring, and maintaining Hadoop clusters, including adding and removing nodes.Performance Tuning: Monitoring and tuning the performance of Hadoop clus

Placement Role - Senior Azure Cloud Engineer - Hybrid - Warren NJ

Infinity Tech Group Inc

Warren, New Jersey, USA

Contract, Third Party

Our client seeks an Senior Azure Cloud Engineer (Hybrid 3 Days Onsite/ Week) at Warren, NJ. Please look at the job description, and if you are available, feel free to contact me at or Ext 327. Role: Senior Azure Cloud Engineer (Hybrid 3 Days Onsite/ Week) (Direct Client) Location: Warren, NJ Duration: 9 + Months Note: No O PTs/ H 1s for this Position. Job Description: Needed Senior Azure Cloud Engineer with our Global Insurance/Reinsurance client. This position requires 3 days per week hybrid

Azure Data Architect - 15+ years of experiences

Sage IT Inc

Jersey City, New Jersey, USA

Part-time, Third Party, Contract

Azure Data Architect Location: New Jersey (Hybrid) Minimum 15+ years overall experience along with 10 years of data engineering experience.Strong experience on Data Architecture Expertise in database design and ETL, with a focus on Azure Databricks, Python, and Spark for building data pipelines.Proficient in Azure Data Factory (ADF), Azure Data Lake Gen 2, and Synapse Analytics.Hands-on experience with at least 2-3 live projects.Ability to understand client requirements and deliver tailored sol

Java Full Stack Developer

Engineersmind

Jersey City, New Jersey, USA

Contract

Job Title: Java Full Stack Developer on W2 Location: Jersey City NJ 07302 Duration: 12 Month Job Description: Design and build horizontally scalable components within the major platform that the team is developingReview and provide code feedback in terms of best practices with keen eye towards performance and stability optimizationsBecome subject matter expert on code deployed on our platform and mentor other developersWrite reusable and extendable code and become a key contributor of the core p

Integration Engineer

PeopleNTech

Woodbridge Township, New Jersey, USA

Third Party, Contract

Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.Design, develop, and deploy Spark program in data bricks environment to process and analyse large volumes of data.Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.Proficient in developing programs in Python and SQLExperience with Data warehouse Dimensional data modelling.Working with even

Software Dev Engineer - Software Dev Engineer II

INSPYR Solutions

New York, New York, USA

Contract

Title: Software Development Engineer Location: 100% Onsite in New York, NY Duration: 12-month contract (additional extensions/conversion to FTE possible) Compensation: $50/hr - $55/hr Work Requirements: , Holders or Authorized to Work in the U.S. Skillset / Experience:Job Description: We are looking for a Software Development Engineer who will act as first level support and development for all incoming production software application issues dealing with seller eligibility. Your solutions will

Lead Cloud Solutions Designer

Motion Recruitment Partners, LLC

Woodbridge Township, New Jersey, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Lead Cloud Solutions Designer in Iselin, NJ or Charlotte, NC (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a h

Senior Back-End - Python -SQL Developer -Lead Python Developer-Onsite @NYC NY-Need Locals

Cyber Sphere LLC

New York, New York, USA

Contract

Title Senior Back-End - Python -SQL Developer - Lead Python Developer Location-Onsite @ NYC NY-Need Locals Duration Contract Job Description: Role Description Role Description Lead Python Developer with 10+ years of experience in designing, developing, and deploying enterprise-grade applications across the finance sector,with expertise in Python, PySpark, FastAPI, Pandas, Polars, and Spring Boot to deliver scalable, high-performance solutions Experience in quantitative engineering for inter

Hadoop/Big Data/Java Developer

Motion Recruitment Partners, LLC

Woodbridge Township, New Jersey, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Hadoop/Big Data/Java Developer in Iselin, NJ (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, b

Software Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A213888 Apply to this job Share this listing: Responsibilities The Ads Targeting team's goal is to optimize advertisement placement and help advertisers run their ads more effectively. As a Software Engineer on the Ads Targeting team, you will design and build large-scale foundations for data processing and serving for next-generation ads targeting products, and applied machine learning models to scale budgets by understanding user

Tech Lead Software Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A32668 Apply to this job Share this listing: Responsibilities The Ads Targeting team's goal is to optimize advertisement placement and help advertisers run their ads more effectively. As a Software Engineer on the Ads Targeting team, you will design and build large-scale foundations for data processing and serving for next-generation ads targeting products, and applied machine learning models to scale budgets by understanding user i

Senior Software Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A229022 Apply to this job Share this listing: Responsibilities The Ads Targeting team's goal is to optimize advertisement placement and help advertisers run their ads more effectively. As a Software Engineer on the Ads Targeting team, you will design and build large-scale foundations for data processing and serving for next-generation ads targeting products, and applied machine learning models to scale budgets by understanding user

Tech Lead Machine Learning Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A35008 Apply to this job Share this listing: Responsibilities The Ads Targeting's goal is to help advertisers reach their desired audience and optimize advertisement performance. As a member of the Ads Targeting, Ads Core team, you will apply machine learning models to scale budgets by understanding user interest and intention, and build large-scale foundations for data processing and serving for next-generation ad targeting product

Senior Machine Learning Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A36558 Apply to this job Share this listing: Responsibilities The Ads Targeting's goal is to help advertisers reach their desired audience and optimize advertisement performance. As a member of the Ads Targeting, Ads Core team, you will apply machine learning models to scale budgets by understanding user interest and intention, and build large-scale foundations for data processing and serving for next-generation ad targeting product

Machine Learning Engineer, Ads Targeting

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A154520 Apply to this job Share this listing: Responsibilities The Ads Targeting's goal is to help advertisers reach their desired audience and optimize advertisement performance. As a member of the Ads Targeting, Ads Core team, you will apply machine learning models to scale budgets by understanding user interest and intention, and build large-scale foundations for data processing and serving for next-generation ad targeting produc

Data and AI Architect

Photon

New York, New York, USA

Full-time

Greetings from Photon!! Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case studies. Title: Lead Data and AI Architect Location: New York Overview: We are seeking a Data and AI Architect with a proven track re

PySpark Developer

Photon

Jersey City, New Jersey, USA

Full-time

Big Data Engineer - PySpark Developer Jersey City, NJ Requirements and Qualifications: 8+ years of relevant experience in the Data Engineering, ApacheSparkStrong proficiency in PySpark and Apache Spark.Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).Expertise in cloud platforms (AWS, Azure, or Google Cloud Platform).Proficiency in Python programming and data manipulation.Knowledge of ETL tools, data lake

Azure Data Engineer

Swanktek

Jersey City, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin, NJ 3 Days Hybrid from Day 1 Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize data pipelines for efficient dat