Spark Jobs

Refine Results
1 - 20 of 1,941 Jobs

Lead Data Engineer (Python, AWS, Spark) - Application Intelligence

Capital One

Plano, Texas, USA

Full-time

Lead Data Engineer (Python, AWS, Spark) - Application Intelligence Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One L

Lead Data Engineer (Python, Spark, Airflow}

Capital One

McLean, Virginia, USA

Full-time

Lead Data Engineer (Python, Spark, Airflow} Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data

AWS/Spark Data Engineer

Isoftech Inc

Remote

Contract

Job Description:We are seeking a highly skilled and experienced AWS/Spark Data & AI Engineer with a strong background in Python and artificial intelligence to join our team. The ideal candidate will be responsible for designing, developing, and deploying scalable data pipelines and AI solutions on the AWS cloud platform. This role requires a deep understanding of big data technologies, machine learning concepts, and a proven ability to leverage Python to build robust and efficient data and AI ap

Sr. Big Data Engineer - Must have experience in Hadoop, Scala, Spark, Python, Kafka - Remote.

Keylent

Remote

Contract, Third Party

Sr Big Data Engineer with Hadoop, Scala, Spark, Python, Kafka Experience- 10+ Years Required Skills: Experience in Hadoop ecosystem components: HIVE, Pyspark, HDFS, SPARK, Scala, Streaming,(kinesis, Kafka) Strong experience in PySpark, Phython development Proficient with writing Hive and Impala Queries Ability to write complex SQL queries Experience with AWS Lambda, EMR, Clusters, Partitions, Datapipelines Experience in Hadoop ecosystem components: HIVE,Pyspark, HDFS, SPARK, Scala, Streaming

Automation Quality Engineer- Test Automation, EHR, Selenium, SQL, Hive, Pyspark, Snowflake, Kafka, Python, R, Spark, Scala, BDD,TDD-Remote-Must need Client round F2F interview

Keylent

Remote

Contract, Third Party

Automation Quality Engineer- Test Automation, Selenium, SQL, Hive, Pyspark, Snowflake, Kafka, Python, R, Spark, Scala, BDD,TDD-Remote-Must need Client round F2F interview Automation Quality Engineer- Test Automation,Selenium, SQL, Python, R, Sparl, Scala, BDD,TDD 10+ Years- Python Scripting is must and should be expert Required Skills: Experience in Hadoop ecosystem components: HIVE,Pyspark, HDFS, SPARK, Scala, Snowflake,Streaming,(kinesis, Kafka)Strong experience in PySpark, Phython developmen

Sr. SPARK Scala Developer

SumasEdge Corporation

Mount Laurel Township, New Jersey, USA

Contract, Third Party

Position: Sr. SPARK Scala Developer Location: Mount Laurel NJ/ Charlotte NC (hybrid) Duration : 12+ Months Responsibilities Skills Experience with APACHE SPARK with SCALA programmingExperience with APACHE SPARK Actions, Transformations and task Execution hierarchyExperience in developing, optimizing, and scaling Spark FunctionsExperience with SCALA framework ? Experience with Functional ProgrammingExperience with Predefined FunctionsExperience with MONADSExperience with TraitsExperience with C

Scala/Spark Developer (AML or FCT or Actimize)

Xoriant Corporation

Montreal, Quebec, Canada

Contract

Financial Crimes Technology Scala Developer The Financial Crimes Technology (FCT) is a dynamic and fast-paced global group within the Non-Financial Risk Technology (NFRT) organization. We are responsible for implementing state-of-the-art technology solutions for the firm Global Financial Crimes (GFC) division which manages the Firm's Anti Money Laundering (AML), Sanctions/PEP & Adverse News Screenings, Know your Customer (KYC), Anti-Bribery & Corruption programs. Financial Crimes Technology (FCT

Senior Java Spark Developer (ETL Exp) : Clinton, NJ : Long-Term Contract

HAN IT Staffing Inc.

Clinton, New Jersey, USA

Third Party, Contract

Hi, I'd like you to take a look at a great new position we now have available! Your opinion would be valued with regards to this opening. I really appreciate sending an updated resume & the best number with the best time to reach you. Role:Senior Java Spark Developer (ETL Exp) Location: Clinton, NJ(Only Locals) Duration: Long-Term Contract Required Skills & Experience: 8 + Years of Java Experience5 + Years of Strong Spring boot experience4 + Years of experience using Java-spark7 + Years of writi

SR PYTHON SPARK ENGINEER- Hybrid in Pittsburgh PA or Strongsville OH

Pyramid Consulting Group, Inc

Pittsburgh, Pennsylvania, USA

Contract

Design and implement new applications/maintain existing applications Pyramid Consulting Group Inc has a banking client with an immediate need for an experienced PYTHON/SPARK ENGINEER with the following background and skills: Technical Skills required: Spark3 Python Shell Scripting Hadoop Cloudera - Hadoop admin , Hadoop Tables/hdfs file processing Data and System Architectural experience Knowledge with Data Modelling using Erwin Tool. Knowledge with Alation or any data mining/reporting tools F

Data Engineer with scala and spark

ISite Technologies Inc

New York, New York, USA

Full-time

Strong proficiency in Scala programming. Solid hands-on experience with Apache Spark (Batch and/or Streaming). Familiarity with Hadoop ecosystem, Hive, Kafka, or HBase. Experience with SQL and data transformation logic. Understanding of software engineering best practices (version control, CI/CD, testing). Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus. Experience with Delta Lake, Databricks, or Snowflake. Familiarity with containerization and orchestratio

Technical Architect (Java, Spark)

Photon

Tampa, Florida, USA

Full-time

Hi Everyone, We are Photon, one of the world's largest Digital Platform Engineering companies providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.Please refer the below job description and apply if you are interested in discussing further. Designation: Technical ArchitectLocation: Irving, TX or Tampa, FL or Mississauga, ON (Onsite)Job Type: Fulltime Job Duties/Responsibilities: Archite

Technical Architect (Java, Spark)

Photon

Irving, Texas, USA

Full-time

Hi Everyone, We are Photon, one of the world's largest Digital Platform Engineering companies providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.Please find the below JD and apply if you are interested in discussing further. Designation: Technical ArchitectLocation: Irving, TX or Tampa, FL or Mississauga, ON (Onsite)Job Type: Fulltime Job Duties/Responsibilities: Architect and design

Technical Architect (Java, Spark)

Photon

Mississauga, Ontario, Canada

Full-time

Hi Everyone,We are Photon, one of the world's largest Digital Platform Engineering companies providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.Please refer the below job description and apply if you are interested in discussing further.Designation: Technical ArchitectLocation: Irving, TX or Tampa, FL or Mississauga, ON (Onsite)Job Type: FulltimeJob Duties/Responsibilities:Architect a

Scala/Spark Developer (Hybrid Onsite)

Xoriant Corporation

Montreal, Quebec, Canada

Contract

Job Title : Spark / Scala Developer Location: Montreal, Canada (3 days a week Hybrid onsite) Duration : Long term contract We would like to hire hands on Scala developer that will be responsible for delivering a high quality code in a big data platform, Unit testing in automated test framework, automated DevOps release and documentation of technology solutions for transaction monitoring, customer activity review, Optimization of scenarios and other associated transformation activities. Candidate

Senior Infrastructure Engineer Linux, Hadoop & Spark

Purple Hires

Charlotte, North Carolina, USA

Contract

Job Title:Senior Infrastructure Engineer Linux, Hadoop & SparkLocation:Charlotte, NC (Onsite/Hybrid as applicable)Type:Long-Term ContractExperience Range:5 + yearsJob Overview:Seeking a seasoned Infrastructure Support Engineer with deep expertise in Linux system administration and distributed compute/storage platforms, especially in Cloudera Hadoop and Apache Spark GRID environments.This role is central to supporting a high-performance big data platform consisting of a 5+ PB Cloudera Hadoop clu

AWS Databricks Developer with Apache Spark

MphasiS Corporation USA

Houston, Texas, USA

Full-time

Job Summary We are seeking an experienced and highly skilled Databricks Lead Developer to lead our data engineering team. The successful candidate will be responsible for designing, implementing, and optimizing large-scale data processing systems on Databricks, ensuring efficient data flow and seamless integration across various platforms. You will also collaborate with other data professionals and stakeholders across the organization to define and execute the data strategy and vision. Years of

Automation Quality Engineer - Remote. Must have experience in Test Automation, Selenium, SQL, Python, R, Spark, Scala, BDD,TDD

Keylent

Remote

Contract, Third Party

Automation Quality Engineer- Test Automation,Selenium, SQL, Python, R, Sparl, Scala, BDD,TDD 10+ Years- Python Scripting is must and should be expert Required Skills: Experience in Hadoop ecosystem components: HIVE,Pyspark, HDFS, SPARK, Scala, Snowflake, Streaming,(kinesis, Kafka) Strong experience in PySpark, Phython development Proficient with writing Hive and Impala Queries Ability to write complex SQL queries Experience with AWS Lambda, EMR, Clusters, Partitions, Datapipelines

Senior Scala/Java/Python/Spark Engineer

Eliassen Group

Durham, North Carolina, USA

Contract

Description: *Hybrid in Durham, NC* We need a data focused full stack professional with strong data engineering and streaming technology experience willing to work a 6 month contract for a client seeking a professional to hit the ground running Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $

spark developer

Rivi Consulting Group

New York, New York, USA

Contract

Responsibilities will include: Understand and implement tactical or strategic solution for a given business problem Discussion with stakeholders on business needs and technology requirements. Define and derive the strategic solutions as well as identify tactical solutions when necessary. Write technical design & other solution documents per Agile (SCRUM) standards. Perform data analysis to aid development work and other business needs. Perform unit testing of the developed code leveraging

Senior Java Spark Developer

ASK IT Solutions LLC

New York, New York, USA

Contract

Job Title: Senior Spark Developer Java Location: 750 Seventh Ave. New York NY 10019 (HYBRID 3 days on site) Local only Duration: 12 Months Contract (with possible extension) SPARK JAVA and SQL Spark: Good concepts of spark core. How a spark process executes and able to solve and write spark code to questions. Java : They should be able to provide solution and write code as well. Hands on Job Description: The ideal candidate will have extensive experience in Java development, a strong understa