Apache Spark Jobs

Refine Results
1 - 20 of 2,084 Jobs

Lead Software Engineer (Spark, Scala and Azure)

Diligente Technologies

San Francisco, California, USA

Full-time

8-10 years of software development and deployment experience with at least 5 years of hands-on experience with Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning)Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architectureHands-on development experience using open source big data components such as Hadoop, Hive, Pig, Spark, HBase, Hawk, Oozie, Mahout, Flum

Spark Developer with Scala/Python

Nityo Infotech Corporation

Sunnyvale, California, USA

Full-time

Job Role: Spark Developer with Scala/Python Job Location: Sunnyvale, CA or Ausin,TX Job Type: Full Time Job Description: In the role of Spark Developer with Scala/Python, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high

Java Spark Developer

Enexus Global

Plano, Texas, USA

Contract

Java Spark Developer - Plano, TX (Onsite) Locals required only Experience required: 8+ years W2 Contract Strong hands on Experience in Spark with Java with minimum 7 years in Java spark and lead the team Advanced experience in ETL and data wrangling using language Java is a plus Proficiency in Java/J2EE, Web Service, Cloud, Micro service, Spring Boot, Kafka, Control -M, Unix Shell Scripting ad Kubernetes. Experience in developing, deploying and administering Java applications ,Java spring, Java

Data Engineer with AWS, Must have Scala and Spark

Puresoft, Inc.

McLean, Virginia, USA

Contract

Data Engineer with AWS, Must have Scala and Spark Mc Lean, VA (Hybrid) 12+ Months Please let me know these all details and send me your updated resume :- Visa :- Expiry Date :- DOB: (dd/mm)- Current location:- SSN No (Last 4 digits):- Notice Period :- Education:- LinkedIn Profile:- Job Requirement- Data Management - Big Data/Machine Learning Engineer Supporting Sunset FrameworkTech surge increase in work load and need to for extra coverage - BAU Must have techs: Scala data pipelines, Spark eng

Hadoop/Spark/Scala: GA/TX

Genesis10

Plano, Texas, USA

Full-time

Genesis10 is currently seeking an Application Programmer with our client in the financial industry located in Plano, TX and Atlanta, GA. This is a 12+ month contract position. Responsibilities: Development and implementation of data integration solutions involving Informatica and Hadoop Lead multiple projects concurrently each with competing deadlines Serves as a fully seasoned/proficient technical resource; provides technical knowledge and capabilities as team member and individual contributor

Mid-Senior Data Engineer (Databricks, Spark, and more!)

Motion Recruitment Partners, LLC

Arlington, Virginia, USA

Full-time

Job Description Join a thriving analytics consultancy that's redefining how businesses harness data for success. They specialize in empowering organizations with cutting-edge analytics and business intelligence solutions, enabling informed decisions and operational excellence. As part of this dynamic team, they currently seeking Mid-Senior Data Engineers who are experts in Databricks, proficient in Spark, and skilled in Airflow for orchestration. Experience with any major public cloud platform (

Java Spark Developer

AIT Global, Inc.

Plano, Texas, USA

Third Party

Job Title: Java Spark Developer Location: Plano, TX - Day One Onsite Job Description: Strong hands on Experience in Spark with Java with minimum 6 years in Java spark and lead the team Advanced experience in ETL and data wrangling using language Java is a plus Proficiency in Java/J2EE, Web Service, Cloud, Micro service, Spring Boot, Kafka, Control -M, Unix Shell Scripting ad Kubernetes. Experience in developing, deploying and administering Java applications ,Java spring, Java Spring MVC, Sprin

Lead Back End Engineer (Python/Golang, ETL, SPARK, AWS)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Lead Back End Engineer (Python/Golang, ETL, SPARK, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software

Scala Spark Engineer - Onsite in Broadway,NY

Chabez Tech LLC

New York, New York, USA

Contract, Third Party

Role: Scala Engineer (Spark, Java) Location: Broadway, NY - Onsite Requirement & Preference: 9 to 10 years of relevant experience. Extensive experience in Scala Engineering. Hands-on experience with Big-Data Technologies such as Spark. Strong background exposure to Java.

BIG DATA DEVELOPER (SPARK)

Thoughtwave Software and Solutions

Illinois, USA

Full-time, Part-time, Contract

Role: Big Data Developer II Duration: 6 months (should be extended) Location: Pittsburgh, PA (1-2 days on-site required) Visa: W2 role Rate: $60/hr on w2 Iv process: Video Interview followed by mandatory on-site interview Day to Day Responsibilities: Lead Developer provides application software development services or technical support in situations of moderate complexity. May also be responsible for requirements gathering and BRD/SRD preparation. Has thorough knowledge of the Software Developm

Lead Developer - Python / Spark

Eliassen Group

Pittsburgh, Pennsylvania, USA

Contract

Hybrid Role, applicants must be local to Pittsburgh PA. Our industry-leading financial services client is seeking a Lead Developer with Python and Spark experience to join their finance and regulatory team. We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. J ob Responsibilities: Lead Developer provides application software development serv

Spark Developer

Cloudious LLC

Austin, Texas, USA

Third Party

Job Description: Spark Experience is a must. Spark Java Developer, build data pipeline. Spark knowledge is a must. Snowflake, worked in ML is good to have

ETL Engineer / Java Spark/ Ab Initio

ATR International, Inc.

Wilmington, Delaware, USA

Full-time

Job Description: We are seeking an ETL Engineer / Java Spark/ Ab Initio for a very important client. Requirement: Must have: Ab Initio exposure or knowledge is a MUST have, will be more flexible on AWS, Hadoop, Spark. Min 5 plus years of experience Experience with big data - preferably in a large complex organization Must have hands on ETL background and pipeline development. Must have Java background (We need core Java, not J2EE, the profile I rejected are advance Java and suited for UI base

Data Engineer with Strong Scala/Python and Spark

Techmatic Inc

Charlotte, North Carolina, USA

Contract

We are looking for a Data Engineer that will be responsible for designing and implementing data pipelines to efficiently load data from various sources into Google Cloud Platform (Google Cloud Platform). The ideal candidate will have a strong background in Spark and Scala/Python. While not required, the ideal candidate will also have exposure to SQL, Airflow, and Google Cloud Platform (DataProc, BQ). Key Responsibilities: - Design and develop data pipelines with Spark with Scala to ingest, trans

Spark Engineer

Maveric NXT Inc

Irving, Texas, USA

Full-time

Job Title: Spark Engineer Job Type Full Time Location- Irving, TX Experience: 4 - 9 Years Job Responsibilities: Designing, developing, and implementing scalable Spark-based applications for large-scale data processing.Optimizing Spark jobs for performance and efficiency, including tuning for memory management and caching.Integrating Spark with other Big Data technologies and frameworks such as Hadoop, Kafka, and Hive.Monitoring Spark jobs and clusters, diagnosing and resolving performance issues

Senior Data Engineer - Principal Associate (Spark, Scala, AWS)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who

Java Spark Developer

LTIMindtree

Irving, Texas, USA

Full-time

Job Description: 7+ years of Experience in Java/J2EE, Big Data, Spark, Process Orchestration, (Architecture Low Level Design Experience).Strong experience in Core Java, Servlets, JavaScript, JMS, Spring, Hibernate.Strong experience with JUnit in writing test-cases and Experience in error logging and debuggingStrong experience in Spark, Core Java, Unix scripting, SparkSQL, Hive.Experience on Open Source Frameworks Spring MVC, Spring (Core, DAO, ORM), Hibernate, Maven.Experience in writing SQLs us

Spark Developer

Amiseq Inc.

Remote

Contract

Spark Developer Remote 12 Months Contract We are working with a strategic customer and looking specifically for an individual with: Deep expertise when it comes to identifying and fixing bottlenecks in Spark jobs. This role will also require structured streaming expertise to build/optimize jobs. Please let us know if you can share a couple of profiles, we will be happy to review them asap! Identifying and Fixing Bottlenecks in Spark Jobs: Dive deep into Spark applications to identify perfor

Scala Spark Developer

CrackaJack Digital Solutions

Alpharetta, Georgia, USA

Contract

Self-starter who is proficient in development with Process Development, Headless REST APIs, JAVA, JEE, Spring, Git and other Frameworks with experience in guiding Project teams with full life cycle of development/design and requirements gathering Significant programming experience in a structured software development environment Build strategic generic tech solutions that can be reused and leveraged across business areas Possess framework mindset, in terms of building components/libraries tha

Spark Developer - 10+ years of experience

Next Level Business Services, Inc.

Remote

Third Party, Contract

Spark Developer - 10+ years of experience 12+ months Remote This role requires a person to have strong development background with 5+ years of Hands-On Application Development experience. 5+ Years Experience in Spark and Python. 5+ Years Experience of DataBricks(DBRX models.) 3+ Years Experience working with AZURE AI studio. Strong Debugging skills (Stack traces, log files, and other system outputs) Must have worked on Agile driven development. Should be pro-active in providing technical solu