apache spark Jobs in new york

Refine Results
361 - 380 of 437 Jobs

Data Engineer New York City (3 Days onsite) - In-Person client interview

Nobl Q, LLC.

New York, New York, USA

Third Party, Contract

Role : Data Engineer Location New York City (3 DAYS IN THE OFFICE ARE MANDATORY!)In-Person client interview is MANDATORY - has to be LOCAL in NY ResponsibilitiesRequired daily participation in highly loaded data transformations.Manage timelines/deliverables within the team towards the successful delivery of projects.Design software solutions by interacting with portfolio managers, traders, operations staff and peers to understand requirements.Develop solutions that are in line with client's tech

Sr. Databricks Data Engineer Location : New York city (Hybrid) - Local to NY/NJ only

E-Solutions, Inc.

New York, New York, USA

Contract, Third Party

Role : Sr. Databricks Data Engineer Location : New York city (Hybrid) Azure Data Engineer with Databricks Expertise Job Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions. Key

Java/Scala developer

SOHO Square Solutions

New York, New York, USA

Contract, Third Party

Description: Understanding code versioning system, PR, PR builds and branching strategies. (GitHub, bit bucket) Good understanding of below testing framework and its importance; unit testing, integration testing,BDD and Regression. (Junit, cucumber, concordion, etc) knowledge of CICD pipeline (Jenkins or team city, sonar, etc) Ability to understand and translate functional requirements in to code / algorithm. Ability to extend functionality for additional use case while appropriately adding c

Data Engineer

Application Management Services LLC

New York, New York, USA

Full-time

8+ years of experience in data engineering, with a focus on large-scale and high-throughput systems Deep experience working with time series data and purpose-built storage systems (e.g., KDB+, TimeSet, Kronos) Strong experience building streaming and batch data pipelines using tools like Glue, Kafka, Flink, or Spark Proficiency in Python and integrating data pipelines with machine learning workflows and libraries (e.g., pandas, NumPy, scikit-learn, PyTorch) Experience designing efficient, scalab

Data Engineer

Cyber Space Technologies LLC

New Providence, New Jersey, USA

Contract, Third Party

Role: Sr. Data Engineer Location- Providence NJ (3days Hybrid) Snowflake, Python, Spark and Scala mandatory Job Description CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower businesses around the world to make better, faster operational decisions.

Java Developer - 3 Days onsite - Only Local and W2 please

3i Infotech Inc.

Metuchen, New Jersey, USA

Contract

Must be local. In-person interview may required after initial phone interview. Not accepting C2C candidate. Candidate must be willing to work on our W2. Java Developer 12 Month Contract to hire Location: Menlo Park, NJ Need at least 3 days onsite at client location Required skills: Java Spring Boot Must have experience in API Security and Unit Testing Microservices Kafka CI/CD SQL OpenAPI / SwaggerUI Nice to have: Angular Spark

Java Fullstack Developer

Innorev Technologies, Inc

Jersey City, New Jersey, USA

Full-time

Responsibilities: Develop and design scalable application on java sprint boot and related technologies, learning new technologies and solve complete business issues. Working closely with Operation support and platform team for the Release management, experienced working on cloud environment. Azure experience is plus. Helping CI/CD team during rolling out application and infrastructure to support global solutions. Collaborates with Architecture team, Product team, Development team and othInforma

Big Data Engineer

Enternet Business Systems, Inc.

Franklin Township, New Jersey, USA

Contract

Title: Big Data Engineer Duration: Long term Location: NJ "U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.." Job Description: We are looking for a Big Data Engineer with expertise in Spark, Scala, Hive, SQL, and Hadoop within the Banking and Capital Markets domain. The ideal candidate will have experience working with Linux-based Hadoop ecosystems, handling real-time data processing with Spark Streaming, and demonstrating st

Java Architect

HCL America Inc.

Jersey City, New Jersey, USA

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 220,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version

Python Developer with Java - Berkeley Heights, NJ (Onsite) - 12+ Months contract

Lorven Technologies, Inc.

Berkeley Heights, New Jersey, USA

Full-time, Contract

Job Title: Python Developer with Java Location: Berkeley Heights, NJ (Onsite) Duration: 12+ Months Contract Required Qualifications Proven Senior Developer with expertise in Oracle, Spark SQL, Java, Python/Shell scripting. Strong experience with AWS services and cloud-based architectures. Hands on practical experience in system design, application development, testing and operational stability. Experience in developing, debugging and maintaining code in a large corporate environment with o

Software Developer - .NET

Idexcel Inc.

Montvale, New Jersey, USA

Contract

Job Title: Software Developer - .NET Location: Montvale, NJ (Hybrid) Duration: 12+ MonthsJob Responsibilities:Coding, testing, and debugging programs according to computer engineering specifications.Modifying, expanding, and updating applications.Collaborating with analysts, engineers, and quality assurance testers to coordinate and document application development and testing.Developing software prototypes.Acting with integrity, professionalism, and personal responsibility to uphold the firm s

Senior Software Engineer (Back-End)

Simons Foundation

New York, New York, USA

Full-time

Senior Software Engineer (Back-End) POSITION SUMMARY The Simons Foundation is seeking an experienced Senior Software Engineer, with significant back-end engineering experience, to join its Autism and Neuroscience Division. The Senior Software Engineer will report to the Principal Software Engineer and Team Lead and will work collaboratively with back-end and front-end engineers to create and maintain real-time, robust, high-quality, highly available and highly scalable distributed systems. These

Azure Data Engineer

Sansar Tec

Woodbridge Township, New Jersey, USA

Full-time

Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.Design, develop, and deploy Spark program in datab

Sr.Fullstack .Net Developer

Orion Business Innovations Careers

Montvale, New Jersey, USA

Contract

Hi, My name is Vikram Pisal, and I m reaching out from Orion Innovations. We are currently looking to fill a .NET Full Stack Developer position for a 12-month contract (with potential for contract-to-hire) with our direct client based in Montvale, NJ. If you're interested in this opportunity, please share your most recent resume in Word format along with your contact details at your earliest convenience. Please find the job details below: Job Description: Coding, testing and debugging programs a

Azure Data Engineer

Kaynes Technology Inc

Woodbridge Township, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin NJ 3 Days Hybrid from Day 1 Note: Only W2 and EST Time Zone Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize

Dremio Alteryx Architect

Themesoft Inc

Woodbridge Township, New Jersey, USA

Full-time, Part-time, Third Party, Contract

Dremio Alteryx Architect 3 days hybrid in Iselin, NJ Needs: Dremio Alteryx Architect 8+ years of hands-on experience as a Data Architect working on innovative, scalable, data-heavy, on-demand enterprise applications and guiding data analysts & engineers 5+ years - hands-on experience working on Greenfield solutions, leading data tracks and building data sourcing, integration from scratch -working closely with partners in Infosec, Infrastructure and Operations and establish data & system i

Urgent Needed - Splunk/Dynatrace Engineer - New Jersey

SATCON Inc

Jersey City, New Jersey, USA

Third Party, Contract

Hi, Our client is looking for Splunk/Dynatrace Engineer for NJ (New Jersey) location. If you are looking for a job change, please let me know. Job Title: Splunk/Dynatrace Engineer Location: NJ (New Jersey) Duration: 12+ Contract Job Description: Key Responsibilities: Observability and Monitoring: Deploy and configure Splunk Enterprise/Cloud and Dynatrace to monitor application performance, infrastructure, and digital experience. Create custom dashboards, alerts, and reports to provide real-tim

Machine Learning AI Data Scientist

Cyma Systems Inc

New Brunswick, New Jersey, USA

Contract, Third Party

Client is looking for Data Scientist / Machine Learning Engineer to join our growing AI and ML team. This role is perfect for someone passionate about cutting-edge machine learning technologies, with deep expertise in Data Science, Deep Learning, and Generative AI. You will play a key role in designing and deploying intelligent systems that drive strategic decisions and user-centric innovations across the organization. Key Responsibilities design, development, and deployment of machine learning

Senior Data and Observability Engineer (W2 only)

SATCON Inc

Jersey City, New Jersey, USA

Contract

Job Title: Senior Data and Observability Engineer Location: NJ (New Jersey) Duration: 12+ Contract Job Description: We are seeking a highly skilled Senior Data and Observability Engineer to design, implement, and manage advanced data analytics and monitoring solutions. This role combines expertise in Splunk, Dynatrace, Tableau, SQL, Machine Learning, and R Programming to drive operational excellence, application performance, and business insights. The candidate will build and maintain observabi

Data Scientist (AI & LLM Specialist) - to 240k + bonus + equity (SK)

Phaxis, LLC

New York, New York, USA

Full-time

Salary: $180k to $240k + bonus + equity We are seeking a highly skilled Data Scientist with a focus on Large Language Models (LLMs) and Machine Learning (ML) to join our team. The ideal candidate will have deep experience in developing and deploying AI solutions, particularly using LLMs such as GPT-3, BERT, or similar technologies, to solve complex business problems. You will work closely with cross-functional teams to design, build, and deploy data-driven models that leverage advanced language