443 results (22 new)

Group by company

Kainos Innovative Solutions Inc

Remote • Today

Easy Apply

Contract, Third Party

50 - 55

Data Engineer - Azure Databricks

Randstad Digital

Charleston, West Virginia • Today

Full-time

USD130,000 - USD130,000

Senior Data Engineer - Azure, DataBricks, Python

Technology Navigators

Hybrid in Austin, Texas • 5d ago

Easy Apply

Contract

Depends on Experience

Senior Data Engineer-Azure and Databricks

Technology Recruiting Solutions,Inc.

Hybrid in Houston, Texas • 22d ago

Easy Apply

Full-time

Depends on Experience

ETS Senior Engineer - Azure Databricks & Data Platform Engineer

Navy Federal Credit Union

Hybrid in Vienna, Virginia • Today

Full-time

$115,600-$181,200 per year

ETS Senior Engineer - Azure Databricks & Data Platform Engineer

Navy Federal Credit Union

Hybrid in Pensacola, Florida • Today

Full-time

$115,600-$181,200 per year

ETS Senior Engineer - Azure Databricks & Data Platform Engineer

Navy Federal Credit Union

Hybrid in Winchester, Virginia • Today

Full-time

$115,600-$181,200 per year

Senior Data Engineer (Databricks & Cloud Analytics)

System One

Hybrid in Magna, Utah • 6d ago

Easy Apply

Full-time

Depends on Experience

Senior Data Engineer (Databricks & Cloud Analytics)

System One

Hybrid in Magna, Utah • Today

Easy Apply

Full-time

Depends on Experience

Azure Databricks / Python Data Engineer

P2PSoftTek Inc

Hybrid in Phoenix, Arizona • 6d ago

Easy Apply

Contract

Depends on Experience

Data Engineer (Azure Data Factory (ADF), Databricks) - W2 Contract only

Silverlink Technologies LLC

Remote • 26d ago

Easy Apply

Contract

55 - 60

Senior Data Engineer with Databricks Exp. - 100% Remote

SDH Systems

Remote or Arkansas • Today

Contract

Senior Data Engineer

AMH

Hybrid in Las Vegas, Nevada • Today

Full-time

Depends on Experience

Senior Data Engineer/ Databricks, PySpark, Python

EPAM Systems

Remote • Today

Full-time

Senior Data Engineer, Databricks

Dycom Industries

Denver, Colorado • Today

Full-time

USD 119,340.00 - 145,860.00 per year

Senior Data Engineer / Databricks Specialist

Satsyil Corporation

Washington, District of Columbia • Today

Easy Apply

Full-time

Depends on Experience

Senior Data Engineer (Databricks, Snowflake, ETL)

The Travelers Indemnity Company

Hartford, Connecticut • 17d ago

Full-time

USD 139,400.00 - 230,000.00 per year

Senior Data Engineer (AWS Databricks)

HMG America

Seattle, Washington • Today

Easy Apply

Full-time, Third Party, Contract

$DOE

Senior Data Engineer - With DataBricks

Neurolynx Global inc

Remote • 5d ago

Easy Apply

Contract

Depends on Experience

Senior Data Engineer / Databricks / AI / Chicagoland Area

Motion Recruitment Partners, LLC

Oak Brook, Illinois • Today

Easy Apply

Contract

$60 - $75

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Atlanta, Georgia • Today

Full-time

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Denver, Colorado • Today

Full-time

USD 90,000.00 - 200,000.00 per year

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Chicago, Illinois • Today

Full-time

USD 90,000.00 - 200,000.00 per year

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Columbus, Ohio • Today

Full-time

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Philadelphia, Pennsylvania • Today

Full-time

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Charlotte, North Carolina • Today

Full-time

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Reston, Virginia • Today

Full-time

USD 90,000.00 - 200,000.00 per year

Senior Data Engineer (AWS, Azure, Google Cloud Platform)

CapTech Ventures

Richmond, Virginia • Today

Full-time

USD 90,000.00 - 200,000.00 per year

Sr. Data Engineer

InfoBeans Inc

Hybrid in Charlotte, North Carolina • Today

Easy Apply

Contract

Depends on Experience

Sr Data Engineer

Innova Solutions, Inc

New York, New York • 8d ago

Easy Apply

Contract

Depends on Experience

Kainos Innovative Solutions Inc

Job Details

Skills

Python
PySpark
Apache Spark
Databricks
Azure Data Factory (ADF)
SQL
Unix/Linux
Shell Scripting
Control-M
ETL/ELT
Data Engineering
AWS Cloud

Summary

Senior Data Engineer – Azure Databricks

Job Title: Senior Data Engineer
Location: Remote
Employment Type: Contract

Job Summary

We are looking for an experienced Senior Data Engineer with strong expertise in Python, PySpark, Apache Spark, Databricks, Azure Data Factory (ADF), and SQL. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and ETL/ELT processes in a cloud-based data engineering environment.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines using Python, PySpark, Apache Spark, and Databricks.
Develop and optimize data processing workflows using Azure Databricks and Azure Data Factory (ADF).
Write complex and optimized SQL queries for data extraction, transformation, validation, and analysis.
Build batch and large-scale data processing solutions using Apache Spark/PySpark.
Develop reusable data engineering frameworks and components using Python.
Create and maintain ADF pipelines, datasets, triggers, and integrations.
Perform data transformation, cleansing, validation, and reconciliation across multiple data sources.
Work with Unix/Linux shell scripting for automation, scheduling, and production support.
Use Control-M for enterprise job scheduling, monitoring, and batch processing.
Troubleshoot production data pipelines and resolve performance, data quality, and integration issues.
Optimize Spark jobs, Databricks workloads, SQL queries, and ETL processes for performance and scalability.
Collaborate with architects, analysts, developers, and business teams to understand data requirements.
Follow data engineering best practices for performance, reliability, scalability, and data quality.
Support deployment, monitoring, and production operations of data pipelines.

Required Skills

Strong hands-on experience with Python
Strong experience with PySpark and Apache Spark
Hands-on experience with Databricks
Strong experience with Azure Data Factory (ADF)
Advanced SQL skills
Experience with Unix/Linux Shell Scripting
Experience with Control-M
Strong understanding of ETL/ELT concepts
Strong data engineering and data pipeline development experience
Experience working with large-scale datasets and distributed data processing

Preferred / Optional Skills

AWS Cloud experience is preferred.
Experience with AWS services such as S3, Glue, EMR, Redshift, or Lambda is a plus.
Experience working in multi-cloud environments is an advantage.
Experience with CI/CD and DevOps practices for data engineering is a plus.

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
6+ years of experience in Data Engineering with strong hands-on development experience.
Strong problem-solving and communication skills.
Ability to work independently as well as collaboratively in a technical team environment.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91138973
Position Id: 9106568
Posted 1 hour ago

Company Info

About Kainos Innovative Solutions Inc

Kainos was established in early 2019 and is headquartered in Falls Church, Virginia. Though a humble beginning, we bring proven expertise in-depth knowledge gained through working in key roles in multinational companies serving global customers in the IT industry over the last few decades.

With our expertise, we understand the complexity of today’s and next generation technologies. This enables us to deliver Innovative solutions for global challenges that are scalable, optimal and secure for Government Agencies and Commercial Clients delivered on-time customized to fit the budget and meeting the business needs. Our areas of expertise include providing Digital Services, Application, Data & Infrastructure Services, Cyber Security Services, Professional Services, and Customer Support Services.

Our focus is to offer customized solutions and service with cost effective solutions. We faithfully strive to be a customer-centric organization.

Go to company profile

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Data Engineer - Remote

Remote

•

4d ago

Senior Data Engineer to lead data migration and pipeline modernization initiatives. The ideal candidate will have expertise in designing and building scalable data pipelines, cloud-based data platforms, and ETL/ELT solutions, with strong experience across AWS, Google Cloud Platform, Apache Airflow, Spark/PySpark, SQL, and Python. Requirements Strong experience with Apache Airflow, AWS, Spark/PySpark, Amazon RedshiftAdvanced SQL and Python skillsProven track record building and optimizing large-s

Easy Apply

Contract, Third Party

Depends on Experience