Apply Now

Data Engineer

Atlanta, GA, US • Posted 1 day ago • Updated 7 hours ago

Contract W2

Contract Corp To Corp

Contract Independent

12 Months

On-site

$DOE

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

ADF
Spark
SQL
ETL
Databricks
Azure Data Factory
Data Frames
Dataframes
Spark SQL
Data pipes

Summary

Job Title :Data Engineer

Location:Atlanta, GA

Duration:12 months

Skills: DataFrames, Spark SQL,ETL, Databricks, ADF, Azure Data Factory,

Job Requirement:

Apache Spark Expertise

Deep understanding of Spark concepts, including RDDs, DataFrames, Spark SQL, and performance tuning, to efficiently process large-scale data on the Databricks platform.

Programming Proficiency

Strong coding skills in Python and SQL for developing robust ETL pipelines and data transformations within Databricks notebooks and jobs.

Delta Lake & Lakehouse Architecture

Experience working with Delta Lake for reliable, ACID-compliant data storage and familiarity with Lakehouse principles for unified analytics. Strong Working knowledge of Medallion Architecture. Time Travel.

ETL & Data Pipeline Development

Proven ability to design, build, and orchestrate scalable ETL pipelines for both batch and streaming data, ensuring data quality and reliability.

Databricks Platform Usage

Hands-on experience with Databricks notebooks, jobs, clusters, and workspace management for collaborative data engineering workflows.

Data Modeling & Advanced SQL

Ability to design efficient data models and write complex SQL queries for data analysis and transformation within Databricks

Cloud Platform Knowledge

. Understanding of cloud infrastructure (Azure or Google Cloud Platform) as it relates to Databricks deployments, including storage, networking, and security best practices.

Workflow Orchestration & Automation

Experience with orchestration tools (e.g., Databricks Lake flow, Airflow, or Azure Data Factory) to automate and schedule data workflows. Asset bundles

Collaboration & Version Control

Strong collaboration skills and experience using version control systems (such as Git) for code management and teamwork. Experience working with Git hub actions and using Git to store the code required for moving the data within Databricks environment

Skillset Requirements

Performance Optimization & Troubleshooting Ability to monitor, troubleshoot, and optimize Spark jobs and Databricks workflows for efficiency and cost-effectiveness. Al Proficiency Al Proficiency in Databricks /Data science

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91088813
Position Id: 2026-1961
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Tech Lead with Java

Alpharetta, Georgia

•

21d ago

Data Tech Lead with Java Alpharetta GA (or) Berkley Hills NJ 1. Role Overview Experienced Data Technical Lead to design, develop, and support scalable cloud-based data platforms and streaming data pipelines. The ideal candidate should possess strong expertise in Databricks, PySpark, Python, Java-based streaming technologies, GitLab CI/CD pipelines, and cloud migration initiatives. 2. Key Responsibilities - Design and develop scalable Databricks ETL/ELT pipelines (Lakeflow & LakeBase) using A

Easy Apply

Contract

60+

Sr Databricks/Agentic AI

Remote

•

Today

Hi, Greetings from DIA SOFTWARE SOLUTIONS LLC! We reaching out about an exciting Direct client opportunity with one of our clients. Please review the requirements and let me know if you are interested in this position? Direct client Req:: Need Sr Databricks/Agentic AI ,Remote, TX PLEASE SEND THE RESUMES TO SKUMAR AT DIASOFTWARESOLUTIONS DOT COM ! Job Description: The Worker is responsible for developing, maintaining, and optimizing big data solutions using the Databricks Unified Analytics Platfo

Easy Apply

Contract, Third Party

Depends on Experience

Databricks developer

Remote

•

3d ago

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Data Engineer

Remote

•

20d ago

Job Title: Senior Data Engineer Experience:10+ Years Title: Data Engineer Location: Remote Need Data Engineers with: 1. Hands on experience working in Databricks understanding the core engineering capabilities of the tool (data organization, engineering techniques, compute). 2. Strong understanding of data i.e. ability to read tables and come up with the right join criteria, run data checks like duplicate identification, etc. 3. Very strong communication skills. We are moving very fast, many m

Easy Apply

Contract

Search all similar jobs

More jobs at Virtual Networx in Atlanta, GA