Data Engineer

  • Atlanta, GA
  • Posted 5 hours ago | Updated 5 hours ago

Overview

On Site
Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required

Skills

Data Engineer
LangGraph
RAG DB
ETL
ELT
DW
CI/CD
Azure DevOps
Databricks
data governance
Microsoft Purview
Fabric
Unity Catalog
SSIS
Python
Spark
Power BI
Microsoft Power BI
Microsoft SQL Server
Extract
Transform
Load
Management
Microsoft
Microsoft Azure
Microsoft SSIS
Data Engineering
Data Flow
Data Warehouse
Database
DevOps
Legacy Systems
Apache Spark
Collaboration
Continuous Delivery
Continuous Integration
Dashboard
Migration
RTR
SQL
Unity
Workflow

Job Details

Job ID: GA-778831

Hybrid/Local Data Engineer (15+) with LangGraph, RAG DB, ETL/ELT, DW, CI/CD, Azure DevOps/Databricks, data governance/Microsoft Purview/Fabric/Unity Catalog, SSIS, Python, Spark, Power BI experience

Location: Atlanta GA (DECAL-IT)
Duration: 12 Months

Skills:
Bachelor s degree in computer science, Information Systems, or related field. Required 3 Years
2 3 years of experience in data engineering or related roles. Required 3 Years
Familiarity with LangGraph and RAG DB concepts. Required 3 Years
Understanding of ETL/ELT pipelines and data warehousing concepts. Required 3 Years
Knowledge of CI/CD automation with Azure DevOps. Nice to have 3 Years
Familiarity with data governance tools (Microsoft Purview, Unity Catalog). Nice to have 3 Years
Experience with SSIS package migration and maintenance. Nice to have 3 Years

Job Description:
We are seeking a motivated Data Engineer to join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data solutions using modern technologies, particularly Microsoft Fabric and Azure-based platforms.

Key Responsibilities
Assist in designing, building, and maintaining ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
Support migration and maintenance of SSIS packages from legacy systems.
Implement medallion architecture (Bronze, Silver, Gold) for data lifecycle and quality.
Create and manage notebooks (Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.
Build curated datasets to support Power BI dashboards.
Collaborate with data analysts and business stakeholders to deliver fit-for-purpose data assets.
Apply data governance policies in line with Microsoft Purview or Unity Catalog.
Support monitoring, logging, and CI/CD automation using Azure DevOps.

Technical Stack
Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake)
Azure Databricks
SQL Server / SQL Managed Instances
Power BI
SSIS (migration and maintenance)
LangGraph and RAG DB (for advanced data workflows)

Qualifications
Bachelor s degree in computer science, Information Systems, or related field.
2 3 years of experience in data engineering or related roles.
Proficiency in SQL, Python, Spark.
Familiarity with LangGraph and RAG DB concepts.
Hands-on experience with Microsoft Fabric and Power BI.
Understanding of ETL/ELT pipelines and data warehousing concepts.

Preferred
Knowledge of CI/CD automation with Azure DevOps.
Familiarity with data governance tools (Microsoft Purview, Unity Catalog).
Experience with SSIS package migration and maintenance.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.