big data engineer(scala & spark) Jobs

Refine Results
181 - 196 of 196 Jobs

Databricks Technical Lead Level 3

Judge Group, Inc.

Cincinnati, Ohio, USA

Contract

Location: Cincinnati, OH Salary: $75.00 USD Hourly - $80.00 USD Hourly Description: Databricks Technical Lead Level 3 Length:12 Months (possible extension) Location: Cincinnati (OH) or Charlotte (NC) Work type: Hybrid Job Summary We are seeking a seasoned Databricks Technical Lead to join our HR Systems Engineering team. This role is pivotal in enhancing the experience of over 420,000 associates by leading the design, build, and optimization of our data platform, services, APIs, and cloud mi

Data Engineer- Manager

PricewaterhouseCoopers LLP

New York, New York, USA

Full-time

Industry/Sector EUR X-Sector Specialism Data, Analytics & AI Management Level Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infr

Sr. ML Engineer

Comcast Corp

Philadelphia, Pennsylvania, USA

Full-time

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou

Staff Cloud Support Engineer - Data Platform

Snowflake Inc.

Atlanta, Georgia, USA

Full-time

Where Data Does More. Join the Snowflake team. Snowflake Support is committed to providing high-quality resolutions to help deliver data-driven business insights and results. We are a team of subject matter experts collectively working toward our customers' success. We form partnerships with customers by listening, learning, and building connections. Snowflake's values are key to our approach and success in delivering world-class Support. Putting customers first, acting with integrity, owning i

Solution Engineer - Forecasting and Replenishment

Endava

Chicago, Illinois, USA

Full-time

What You Will DoAct as the lead engineer for each domainCollaborate with Solution Architects to ensure understanding needed for engineering level guidance to nearshore teamsTranslate architecture design to engineering level guidanceOwn specifying architectural designs into sprint-ready engineering tasks for assigned domainEnsure delivery to the solution architecture within domainAnswer design questions for sprint teamsParticipate in backlog refinement sessions to align team with the architecture

Business Intelligence Developer

SBS Creatix, LLC

O'Fallon, Illinois, USA

Full-time

Business Intelligence Developer Our client is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis. Responsibilities Design

Devops Engineer

Javen Technologies, Inc

Remote

Contract

Must Have: AWS CI/CD Terraform Nice To Have: Application Development JavaScript JOB DESCRIPTION: Build and maintain the production infrastructure and services. Ensure proper security for the infrastructure. Troubleshoot production issues. Develop/maintain processes, tools, and documentation in support of production. Participate in the evaluation of new software, hardware, and infrastructure solutions. Experience as a er working with large distributed systems Experience with a variety of scriptin

Data Services Engineer

SAIC

Reston, Virginia, USA

Full-time

Job ID: 2415359 Location: RESTON, VA, US Date Posted: 2025-04-21 Category: Information Technology Subcategory: Database Engr Schedule: Full-time Shift: Day Job Travel: No Minimum Clearance Required: TS/SCI with Poly Clearance Level Must Be Able to Obtain: None Potential for Remote Work: No Description SAIC, a leading provider of systems development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the Intell

Google Cloud Platform Data Engineer III

Caspex Corporation

Sunnyvale, California, USA

Contract, Third Party

Position: Google Cloud Platform Data Engineer Location : Sunnyvale, CA Duration : 12 Months + What you'll do: Build and maintain optimal data platform and pipeline architecture.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.Build the infrastructure required for optimal extraction,

Data Engineer (AWS & Python)

Commercial Programming Systems, Inc.

Los Angeles, California, USA

Full-time

Data Engineer - (AWS & Python) Our client is an investment advisor that builds algorithmic strategies based on proprietary quantitative factor research. Remote work is authorized. Summary As a member of the Technology Services Team, the Senior Data Engineer will participate in the design and development of sophisticated data management systems, data science driven analytics and algorithmic trading platforms. This person will implement and maintain these processes in both internally hosted data c

Databricks Engineer

Oscar Technology

Remote

Full-time

Job Title: Databricks Engineer - Remote Location: Remote Job Type: Full-Time Experience Level: Mid to Senior (5+ years) About the Role: We are seeking a skilled and experienced Databricks Engineer with a strong background in both Azure and AWS cloud platforms. As a key member of our Data Engineering team, you will design, develop, and optimize scalable data solutions using Apache Spark on Databricks, enabling advanced analytics and data-driven decision-making across the organization. This is

Software Engineer Gen AI

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

Job Title: Software Engineer Gen AI Location: Hybrid - Charlotte, North Carolina 28262 Contract Type - Full-time W2 Duration: 6 months Contract As a Software Engineer Gen AI, You Will: Lead and consult on complex, high-impact software engineering initiatives, from planning to problem resolution.Analyze multifaceted challenges, applying deep understanding of policies and compliance to meet deliverables.Collaborate strategically with clients to achieve optimal outcomes.The Ideal Candidate Will H

Azure Data Architect

Ledgent Technology

Houston, Texas, USA

Contract

We are seeking an experienced Azure Databricks Architect to design and implement scalable big data solutions leveraging the Microsoft Azure cloud ecosystem. The ideal candidate will possess deep technical knowledge of Databricks, data engineering best practices, and modern cloud architectures. This role will be instrumental in leading data transformation initiatives, optimizing data pipelines, and ensuring secure, high-performance environments for advanced analytics and AI workloads. Key Respons

AI/ ML Engineer

Resource 1

Remote

Contract

Resource 1 is in need of an Artificial Intelligence (AI)/ Machine Learning (ML) Engineer for a long-term, remote contract position. Responsibilities: Architect, build, maintain and improve new and existing suite of algorithms and their underlying systemsImplement end-to-end solutions for batch and real-time algorithms along with requisite tooling around monitoring, logging, automated testing, performance testing and A/B testingEstablish scalable and efficient automated processes for data analyse

DevOps Engineer IV

V-Soft Consulting Group, Inc

Remote

Contract

DevOps Engineer IV (Remote) Primary Location: Remote V-Soft Consulting is currently hiring for a DevOps Engineer IV (Remote) for our premier client. Education and Experience Degree or equivalent experience. Experience in scripting and development. Experience with open source monitoring and alerting systems. Experience with web applications. IP networking experience, LB technologies. Experience with systems automation. Experience with big data systems. Experience as a developer working with la

Need AWS Lead Data Engineer at Portland, OR (Onsite) (Full Time)

Agile Enterprise Solutions, Inc.

Portland, Oregon, USA

Full-time

Job Title : AWS Lead Data Engineer Location : Portland, OR (Onsite) Duration : Full Time Mandatory Skills: Python, Pyspark, SQL, AWS ENR, AWS Redshift Job Description : Roles and Responsibilities: 9+ years relevant work experience in the Data Engineering field 6+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.) 6+ years of experience Strong experience with relational SQL and at least one programming language such as Python,