Overview
On Site
Full Time
Skills
Legacy Systems
Artificial Intelligence
Business Development
Change Data Capture
Streaming
Batch Processing
Analytical Skill
KPI
Semantics
Terraform
DevOps
GitHub
RBAC
Collaboration
Auditing
Mentorship
Scalability
Continuous Integration
Continuous Delivery
Version Control
Automated Testing
Computer Science
Information Technology
Python
Programming Languages
Computer Networking
Data Warehouse
Data Modeling
Dimensional Modeling
Data Structure
Unity
Microsoft BI
Microsoft SQL Server
Microsoft SQL Server Management Studio (SSMS)
Microsoft SQL Server DBA
Microsoft SSAS
Conflict Resolution
Problem Solving
Communication
Microsoft SSIS
SQL
Modeling
Data Architecture
Migration
Microsoft Azure
Databricks
Job Details
SW Engineer Specialist
In one sentence
Responsible for designing and governing Azure Databricks architecture, enabling migration from legacy systems, enabling full Databricks/Databricks AI power and optimizing Lakehouse solutions for performance, security, and scalability.
What will your job look like?
You will work as a technical leader alongside the customer business, development, and DevOps teams.
You will architect Lakehouse (Delta medallion), Databricks SQL Warehouses, Unity Catalog security, Data Lineage.
You will understand the existing Legacy SQL server and SQL Server Integration Services system and propose migration strategies
You will design ingestion, CDC, streaming, batch processing, and medallion (bronze/silver/gold) architecture.
You will optimize cluster sizing, autoscaling, photon usage, query performance, Delta Z-Ordering/VACUUM strategies
You will translate business questions into analytical models, KPIs, and reusable semantic layers.
You will implement CI/CD (Terraform, Azure DevOps/GitHub), observability, and security (RBAC, row/column policies).
You will collaborate across engineering, product, and business to prioritize value.
You will conduct architectural reviews, code audits, and mentoring sessions to ensure adherence to standards and scalability.
You will guide teams in implementing CI/CD pipelines, version control, and automated testing for Databricks notebooks and jobs.
All you need is...
Bachelor's degree in computer science, Information Technology, or related field
Strong knowledge of Azure Databricks and the Azure platform
Proficiency in Databricks SQL, Python, and other relevant programming languages.
Deep Azure knowledge: ADLS Gen2, Key Vault, Networking (VNet/Private Endpoints), Event Hub
An understanding of advanced data warehouse concepts is required
Experience with data modeling, dimensional modeling, and temporal data structures
Unity Catalog security & lineage; Purview integration.
Strong business problem framing and stakeholder communication.
Key understanding of Microsoft Business intelligence Platform (SSIS (SQL Server Integration Services), SSMS (SQL Server Management Services) & AAS (Azure Analysis Services))
Excellent problem-solving and communication skills
Ability to work independently and collaboratively in a fast-paced environment.
Even better if you have...
Databricks and Azure Certifications
Proven Migration experience of SQL and SSIS to Databricks SQL
Cost/performance modeling.
Why you will love this job:
You will be engaged with cutting-edge data architecture initiatives, influence enterprise migration strategies, and work with advanced Azure Databricks technologies to deliver scalable, high-performance solutions.
Additional Information:
Expected start date: As soon as possible
Duration of engagement: 3 months with possible extensions
Locations: Atlanta, customer office
Work format: On-site/ Hybrid
Number of open positions: 1
In one sentence
Responsible for designing and governing Azure Databricks architecture, enabling migration from legacy systems, enabling full Databricks/Databricks AI power and optimizing Lakehouse solutions for performance, security, and scalability.
What will your job look like?
You will work as a technical leader alongside the customer business, development, and DevOps teams.
You will architect Lakehouse (Delta medallion), Databricks SQL Warehouses, Unity Catalog security, Data Lineage.
You will understand the existing Legacy SQL server and SQL Server Integration Services system and propose migration strategies
You will design ingestion, CDC, streaming, batch processing, and medallion (bronze/silver/gold) architecture.
You will optimize cluster sizing, autoscaling, photon usage, query performance, Delta Z-Ordering/VACUUM strategies
You will translate business questions into analytical models, KPIs, and reusable semantic layers.
You will implement CI/CD (Terraform, Azure DevOps/GitHub), observability, and security (RBAC, row/column policies).
You will collaborate across engineering, product, and business to prioritize value.
You will conduct architectural reviews, code audits, and mentoring sessions to ensure adherence to standards and scalability.
You will guide teams in implementing CI/CD pipelines, version control, and automated testing for Databricks notebooks and jobs.
All you need is...
Bachelor's degree in computer science, Information Technology, or related field
Strong knowledge of Azure Databricks and the Azure platform
Proficiency in Databricks SQL, Python, and other relevant programming languages.
Deep Azure knowledge: ADLS Gen2, Key Vault, Networking (VNet/Private Endpoints), Event Hub
An understanding of advanced data warehouse concepts is required
Experience with data modeling, dimensional modeling, and temporal data structures
Unity Catalog security & lineage; Purview integration.
Strong business problem framing and stakeholder communication.
Key understanding of Microsoft Business intelligence Platform (SSIS (SQL Server Integration Services), SSMS (SQL Server Management Services) & AAS (Azure Analysis Services))
Excellent problem-solving and communication skills
Ability to work independently and collaboratively in a fast-paced environment.
Even better if you have...
Databricks and Azure Certifications
Proven Migration experience of SQL and SSIS to Databricks SQL
Cost/performance modeling.
Why you will love this job:
You will be engaged with cutting-edge data architecture initiatives, influence enterprise migration strategies, and work with advanced Azure Databricks technologies to deliver scalable, high-performance solutions.
Additional Information:
Expected start date: As soon as possible
Duration of engagement: 3 months with possible extensions
Locations: Atlanta, customer office
Work format: On-site/ Hybrid
Number of open positions: 1
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.