apache spark Jobs

Refine Results
21 - 40 of 1,650 Jobs

Senior Data Engineer (Python, Spark, AWS)

Capital One

•

McLean, Virginia, USA

Full-time

Job DescriptionSenior Data Engineer (Python, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital On
Posted 23 days ago | Updated 8 hours ago

Java Spark Developer

Veear

•

Sunnyvale, California, USA

Contract

- 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms. - Excellent expertise in Spark and Java. - Knowledge of Golang is highly desirable. - Good understanding of containerization using Docker and Kubernetes. - Understanding of version control like Git and CI/CD workflow. - Understanding of Parquet/Avro/Hive/Iceberg. - Well experienced in debugging and troubleshooting. - Good Communication and excellent collaboration skills to inter
Easy Apply
Posted 7 days ago | Updated 1 hour ago

Senior Spark Data Engineer

Apex Systems

•

Akron, Ohio, USA

Full-time

Job#: 2058492 Job Description: Position: Senior Spark Data Engineer Direct Hire 100% Remote Apex Systems is seeking a Senior Spark Data Engineer for a Direct-Hire position that is 100% remote. You will be joining an innovating Data team to help drive our recent Databricks adoption. The ideal candidate will have a deep background in Data Engineering and can help lead our Data Unification & Optimization approach. Must Have Qualifications: 10+ years of enterprise-level Data Engineering and/or Sof
Easy Apply
Posted 60+ days ago | Updated 8 hours ago

Senior Java Spark Developer or Big Data with Spark and Java

Culinovo

•

Austin, Texas, USA

Contract

Job Title: Senior Java Spark Developer or Big Data with Spark and Java Location: Austin, TX or Sunnyvale, CA (Hybrid-3 Days Onsite) Work Mode: Hybrid Duration: Long Term Note: We require candidates on our W2. Independent Visa candidates can apply like EAD's, s, s, etc. Experience Level: 9+ years Job Summary: We are seeking a Senior Java Spark Developer with expertise in Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ide
Easy Apply
Posted 9 days ago | Updated moments ago

Core Java Developer, Spark, SQL, Algorithms, Data Structures, Python/Shell, Junit/BDD, NYC 12 months

Zen & Art

•

New York, New York, USA

Third Party, Contract

Job Id: 3374 L4 Duration: 12 Months Location: NYC Title: Core Java Developer, Spark, SQL, Algorithms, Data Structures, Python/Shell, Junit/BDD, NYC 12 months Top Skills : JAVA + SPARK, Spark Core, Spark SQL, Stored procedure, Data models, writing SQL queries, Microservices, Rest API, Multi Threading, Data Structures , Algorithms Job Description below Market Risk Technology is seeking a strong senior application developer with experience in developing distributed systems, capable of proces
Easy Apply
Posted 21 days ago | Updated moments ago

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish Consulting

•

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Data Engineer (Spark/Scala/Python)

XTGlobal

•

Virginia, USA

Contract

Data Engineer * Hybrid in Richmond Only W2 consultants. 5+ years of experience in at least one of the following: Java, Scala, Python/PySpark, SQL or Go 3+ years of experience with AWS, specifically EMR 3+ years of experience in open source frameworks Experience building high-volume data interactions and observability/monitoring tools will be a huge plus Required Skills : Spark Python, Java, or Scala EMR SQL MQ experience (Kafka, Kinesis, etc.) Please share resumes to
Easy Apply
Posted 60+ days ago | Updated 8 hours ago

Java Developer With MongoDB

Visionary Innovative Technology Solutions

•

Herndon, Virginia, USA

Contract, Third Party

Role: Java Full Stack Developer with MongoDB & Spark Location: Herndon, VA( Looking local profile) Job Type: Contract Skill: Java, MongoDB, Spark Mandatory: 10+ years of experience in Design and Development of applications using Java 8+/J2EE, Spring, Spring-Boot, RESTful Services and UI FrameworkDevelop, program, and maintain applications using the Apache Spark open-source framework.Spark Developer must have strong programming skills in Java, Scala, or Python2+ years of experience in design and
Easy Apply
Posted 4 days ago | Updated 1 day ago

Data Engineer(Expertise in Scala)

Photon

•

Tampa, Florida, USA

Full-time

Greetings from Photon, We hope you are staying safe. We are looking for a Data Engineer(Expertise in Scala)to join our team for large Fortune 500 Client. Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case stu
Easy Apply
Posted 10 days ago

Senior AI/ML - Data Scientist

Apps Technologies, LLC

•

Hyderabad, Telangana, India

Full-time

Job Title: Senior AI/ML - Data ScientistExperience Required: 5+ YearsLocation: HyderabadNotice Period: Immediate Joiners Preferred About the RoleWe are looking for a Senior AI/ML Data Scientist with a strong foundation in big data technologies and a proven track record in building scalable AI/ML solutions. You will play a pivotal role in harnessing data to drive insights and power intelligent systems. This is a great opportunity for professionals who thrive in a data-driven environment and can s
Easy Apply
Posted 8 days ago

Senior Data Architect

Brains Workgroup, Inc.

•

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite
Easy Apply
Posted 3 days ago | Updated 4 hours ago

Data Engineer EX Apple exp Must

Pioneer Corporate Services Inc

•

Cupertino, California, USA

Contract

Job title: Data EngineerLocation: Cupertino , CA or Austin,TXDuration: 6-12months Client : Apple EX Apple experience Mandatory Data engineer with Spark Scala PySpark technology
Easy Apply
Posted 22 hours ago

Data Scientist

C&G Consulting Services

•

New York, New York, USA

Full-time

Hybrid - 3 days onsite Banking experience is a plus NO 3rd PARTIES Contract to hire Midtown Manhattan Data Scientist Job Responsibilities:Formulates and leads guided, multifaceted analytic studies against large volumes of data.Interprets and analyzes data using exploratory mathematic and statistical techniques based on the scientific method.Coordinates research and analytic activities utilizing various data points (unstructured and structured) and employ programming to clean, massage, and organ
Easy Apply
Posted 16 days ago

Data Engineer-Palantir

AspireIT Solutions

•

Spring Valley Village, Texas, USA

Contract

Job Title: Palantir-Data Engineer Location: Spring, TX (On-site 5 days/week) Job Type: Long-Term Contract Interview Process: 60-minute Zoom video interview, followed by a potential onsite round Role Overview: Join a cross-functional data team working to develop tools that optimize investment and operational decision-making for a large-scale carbon capture initiative. You'll play a key role in building and maintaining high-performance, production-grade data pipelines and ontologies using the Pal
Easy Apply
Posted 2 days ago | Updated moments ago

Data Engineer

VDart, Inc.

•

US

Third Party, Contract

Role: Data Engineer with Healthcare Location: Remote Type: Contract The ideal member of Porter will be a change agent, altering the status quo of healthcare delivery. You and your fellow Porter team members will provide an innovative and empathetic ecosystem of transparency to our customers. New Team Member will join feeling energetic and excited to revolutionize the healthcare continuum and contribute to the success of our mission driven organization. Now is the time to seize the moment for c
Easy Apply
Posted 3 hours ago | Updated 1 hour ago

Scala Developer (Local is Plus NY)

Pacific Consultancy Services

•

New York, New York, USA

Contract

Role: Scala Developer Location: New York, NY Hybrid (Local is Plus) Project Duration: 12+ months contract Interview Mode: Video + In-person required Qualification: Overall 10+ years of experience with Proficiency in Scala Experience with SQL and NoSQL databases (Teradata, PostgreSQL, MongoDB) Expertise in ETL pipeline development and data warehousing (Snowflake, Redshift) Familiarity with Cloud infrastructure Azure Experience with Apache Spark, Kafka, Databricks, and Airflow Thanks regards..! Si
Easy Apply
Posted 3 days ago

Informatica IICS Lead

VDart, Inc.

•

Dallas, Texas, USA

Third Party, Contract

Position: Informatica IICS Lead Location: Dallas, TX (Mutliple Location) Duration: 06+ Months Contract Job Description Over 13+ years of IT experience in Analysis, Design, Development, Implementation, Testing and Support of Data Warehousing and Data Integration Solutions Experience in using ETL Tool Informatica Power center, Informatica Cloud Services (IICS) or Intelligent Data Management Could (IDMC) Proficient use of PowerCenter tools (Designer, Workflow Manager, Workflow Monitor, Repository
Easy Apply
Posted 3 hours ago

Data Engineer

DNS Info Ltd

•

New York, New York, USA

Contract

Sr. Data Engineer New York City (under 50 miles) || Local & onsite Spark: 80% Hadoop: 20% Job Description :- Required Skills: 1.Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java) 2. Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink or Storm) 3. Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data
Easy Apply
Posted 3 days ago | Updated 3 days ago

Data Modeler / Data Engineer (Hybrid onsite - W2 Contract)

Xoriant Corporation

•

Quincy, Massachusetts, USA

Contract

Job Title : Data Modeler / Data Engineer Client Location: Boston/Quincy, MA (Hybrid 3 - 4 days a week onsite) Contract: W2 Duration: Long term contract Job Description: Total 7-11 years of experience. 50% data modelling, 50% spark & python coding which includes advanced spark Must have 5+ Years of data analyst + Data modelling experience Data Modeling Experience is a must( Erwin tool), should be able to create physical model & logical model. Candidate should be able to write SQL queries. Kn
Easy Apply
Posted 1 day ago

Google Cloud Platform Data Architect / Engineer (Must work on W2)

Activesoft, Inc.

•

Remote

Contract

Required: Deep experienced data engineer/architect. Review ascend.io installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by Ascend.io.
Easy Apply
Posted 14 days ago | Updated 4 hours ago