big data engineer(scala & spark) Jobs

Refine Results
1 - 20 of 197 Jobs

Senior Big Data Engineer (Spark, Scala, Hadoop, Banking & Capital Markets)

VDart, Inc.

Mississauga, Ontario, Canada

Contract

Job Title: Senior Big Data Engineer (Spark, Scala, Hadoop, Banking & Capital Markets) Location: Mississauga, ON (Hybrid) Duration/Term: Long Term Contract Job Description: We are looking for a Big Data Engineer with expertise in Spark, Scala, Hive, SQL, and Hadoop within the Banking and Capital Markets domain. The ideal candidate will have experience working with Linux-based Hadoop ecosystems, handling real-time data processing with Spark Streaming, and demonstrating strong problem-solving and

Data Engineer - Spark

Exl Service

Remote

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract

W2-Hybrid :: Big Data Engineer / Developer

Bitsoft International, Inc.

Charlotte, North Carolina, USA

Full-time

Big Data Engineer / Developer 6+Months Charlotte, NC (Hybrid) **Core Requirements** - At least 6 years' proficiency in Big Data, Spark, Scala, and Cloud technologies - Proven expertise in utilizing Spark and Scala, as well as familiarity with leading cloud services providers, notably AWS, Azure, and Google Cloud Platform for Big Data operations - Advanced knowledge and operational skills with Azure Data Lake Storage (DLS) - Demonstrable proficiency in using Databricks for data integration and pi

AWS Big Data Engineer

Chabez Tech LLC

Seattle, Washington, USA

Contract

Role: AWS Big Data Engineer Location: Seatle, WA - 5 Days On-Site Key Result Areas and Activities: Seeking a Data Engineer with 10+ years of hands-on data architecture experience designing and managing large-scale data lakes and warehouses.Solid understanding and hands-on experience with Apache Iceberg and AWS GlueDeep experience with AWS systems like Lakeformation, IAM and Redshift.Proficiency in Python, Scala, or Java for ETL and custom tooling is essential.Proven expertise in complex schema a

Data Engineer - Need 9+ yrs Candidate - NY/NJ/FL

Photon

Weehawken Township, New Jersey, USA

Full-time

Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big Data Analyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment with business requirements. Work with the stakeholders to understand and gather requirements and produce business specifications Validate solution implem

Big Data Engineer

Motion Recruitment Partners, LLC

Woodbridge Township, New Jersey, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data Engineer in Iselin, NJ (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly

Scala Developer

NR Consulting LLC

Hanover, New Jersey, USA

Contract, Third Party

Title: Scala Developer Location: Whippany, NJ (hybrid-2 days) Type: Contract Duration: Long Term Description: Scala Developer is a software engineer specializing in using the Scala programming language to design, develop, and maintain applications.These roles are often found in companies working with big data, distributed systems, backend infrastructure, and data-intensive enterprise applications. Required Skills: Strong proficiency in Scala and experience with functional programming concepts.E

Big Data Hadoop Engineer with Cloudera Distribution 7.x and Java

Buxton Consulting

Remote

Contract

Position: Big Data Hadoop Engineer with Cloudera Distribution 7.x and Java Location: Remote (PST Timing) Duration: 12+ Months (May extend till 48 months) Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development 4-5 years of programming experience in Python, Java, Scala, and SQL is must. Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase. Strong experience with REST API development using Python fra

Sr. Software Engineer, Big Data

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility

Big Data Engineer

Enternet Business Systems, Inc.

Franklin Township, New Jersey, USA

Contract

Title: Big Data Engineer Duration: Long term Location: NJ "U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.." Job Description: We are looking for a Big Data Engineer with expertise in Spark, Scala, Hive, SQL, and Hadoop within the Banking and Capital Markets domain. The ideal candidate will have experience working with Linux-based Hadoop ecosystems, handling real-time data processing with Spark Streaming, and demonstrating st

Hadoop/Big Data/Java Developer

Motion Recruitment Partners, LLC

Woodbridge Township, New Jersey, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Hadoop/Big Data/Java Developer in Iselin, NJ (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, b

Big Data Hadoop Engineer

Harvey Nash Inc.

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API

Senior Databricks Engineer

VDart, Inc.

Remote

Third Party, Contract

Job Title: Senior Databricks Engineer Location: Remote Duration/Term: Long-Term Contract Job Summary: We are seeking an experienced Databricks Engineer with a strong background in Databricks, Apache Spark, and big data ecosystem tools. You will lead the design and development of scalable data pipelines, architect efficient data models, and mentor junior engineers ensuring performance, reliability, and governance across cloud-native infrastructure. Key Responsibilities: Design and develop data

Data Architect

Skysoft Inc

Washington, District of Columbia, USA

Contract

Job Title: Data Architect Location: Hybrid (preferred in the Maryland/DC/VA area ) Experience: 15+years Must Job Summary: We are seeking a highly experienced Data Architect / Lead Data Engineer to design and implement scalable data platforms, data integration frameworks, and analytics solutions. The ideal candidate should have a proven track record in data engineering, cloud migration, data governance, and leading end-to-end data pipeline development using modern data technologies. Key Responsi

Local only - Inperson Interview --- BigData engineer@ Location : Mountain View CA

E-Solutions, Inc.

Mountain View, California, USA

Full-time, Third Party, Contract

Role : BigData engineer Location : Mountain View CA (100% day1 onsite) Local only - Inperson Interview Responsibilities: Design and develop scalable data pipelines using Apache Spark, Flink, and Scala Build. and maintain data integration solutions across various data sources using AWS services. Develop efficient, reusable, and reliable code in Java and Scala. Implement real-time stream processing and batch processing architectures. Collaborate with data scientists, architects, and other engine

Big Data Engineer

Key Business Solutions, Inc.

Seattle, Washington, USA

Contract, Third Party

Big Data Engineer Seattle, WA 6+ Months Onsite Work Need min 12+ years of exp Key Result Areas and Activities: Seeking a Data Engineer with 12+ years of hands-on data architecture experience designing and managing large-scale data lakes and warehouses. Solid understanding and hands-on experience with Apache Iceberg and AWS Glue Deep experience with AWS systems like Lakeformation, IAM and Redshift. Proficiency in Python, Scala, or Java for ETL and custom tooling is essential. Proven expertise in

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer (Python/Spark/AWS) for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) We are seeking a Big Data Engineer to lead the design, develop, and maintain scalable data pipelines and infrastructure to support our market regulation technology applications. You will play a key role in modernizing existing data pipelines, enabling downstream use

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) Responsibilities : Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala). Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable. Stay cu

Big Data Engineer - W2

Pyramid Technology Solutions, Inc.

San Francisco, California, USA

Contract

Title: Senior Big Data Engineer Location: San Francisco, CA - Hybrid Duration: 12 Months Contract Type: Only W2 Mandatory Skills: Either Java or Scala, SQL and NoSQL, Apache Spark, Cloud Platforms Data Engineer Responsibilities: System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market.Support code versioning, and code deployments for Data Pipelines.Ensure test covera

AIML - Sr Software Data Infrastructure Engineer - Data and ML Innovation

Apple, Inc.

No location provided

Full-time

Do you get excited by driving impact via measurement and evaluation, for products and services used by hundreds of millions of people globally? The vision of AIML Data and ML Innovation organization is to improve products by using data as the voice of our customers. We are seeking a passionate and experienced Data Infrastructure Engineer to play a pivotal role in revolutionizing how we process and use substantial datasets as the heart of Siri, Search and Machine Learning. You will be instrumenta