Data Engineering Platform Engineer

Location: Atlanta, GA (Hybrid – Local Candidates Preferred)
Duration: 6-Month Contract-to-Hire
Client: Floor & Decor

Job Summary

We are seeking an experienced Data Engineering Platform Engineer to own, administer, and continuously improve our enterprise data platforms supporting analytics, reporting, and data product delivery across the organization.

This role is focused on platform ownership and administration, not pure data pipeline development. The ideal candidate will have hands-on experience managing Databricks on Azure environments, supporting SQL Server data warehouse platforms, implementing governance and security controls, optimizing cloud infrastructure, and ensuring platform reliability and performance.

You will play a key role in a multi-year cloud modernization initiative, helping migrate legacy SQL Server data warehouse environments to a modern Databricks Lakehouse architecture.

Key Responsibilities

Databricks Platform Administration

• Administer and support Databricks workspaces in Azure.

• Manage Unity Catalog, data governance, access controls, and security policies.

• Configure and maintain cluster policies, compute resources, and workspace settings.

• Monitor platform health and troubleshoot production issues.

• Implement best practices for data governance, lineage, metadata management, and security.

• Evaluate and implement new Databricks features and capabilities.

Azure Platform Management

• Manage Azure Data Lake Storage Gen2 (ADLS Gen2).

• Support Azure Data Factory (ADF), Azure Active Directory (AAD), and Azure Key Vault.

• Configure networking, private endpoints, service principals, and security controls.

• Monitor cloud infrastructure and optimize platform performance.

SQL Server & Migration Support

• Support existing SQL Server Enterprise Data Warehouse environments.

• Maintain SSIS packages and SQL Server operations.

• Perform performance tuning, backup/recovery, and database maintenance.

• Assist with SQL Server to Databricks migration initiatives.

• Support migration planning, validation, and production cutovers.

Security, Governance & Compliance

• Implement RBAC, access governance, and audit controls.

• Manage service principals, secrets, credential rotation, and Key Vault integrations.

• Ensure compliance with SOX, IT and enterprise security requirements.

• Partner with Security and Governance teams on platform standards and controls.

Monitoring & Optimization

• Develop monitoring and alerting frameworks.

• Troubleshoot production platform issues and drive root cause analysis.

• Optimize Databricks clusters and Azure resources for performance and cost efficiency.

• Create platform health dashboards and operational reports.

• Participate in incident management and capacity planning activities.

Platform Engineering & DevOps

• Support CI/CD processes and deployment automation.

• Collaborate with Data Engineering, Analytics, and Governance teams.

• Maintain platform documentation, runbooks, and operational procedures.

• Drive platform standardization and continuous improvement initiatives.

Required Skills

• 5+ years of experience in Data Engineering, Platform Engineering, Database Administration, or Cloud Engineering.

• Hands-on Databricks Administration experience.

• Strong experience with Unity Catalog, RBAC, Access Controls, and Data Governance.

• Experience administering Azure Data Services including:

  • Azure Data Factory (ADF)

  • Azure Data Lake Storage Gen2 (ADLS Gen2)

  • Azure Active Directory (AAD)

  • Azure Key Vault

• Strong SQL Server administration experience.

• Experience with SSIS, T-SQL, query optimization, and database performance tuning.

• Experience supporting enterprise production environments.

• Strong understanding of Delta Lake, Spark SQL, and modern Data Engineering architectures.

• Experience with monitoring, alerting, troubleshooting, and platform support.

• Experience with Git, Azure DevOps, and CI/CD practices.

• Knowledge of cloud security, compliance, and governance frameworks.

Preferred Qualifications

• Databricks Platform Administrator Certification.

• Databricks Data Engineer Certification.

• Microsoft Azure Data Engineer Associate (DP-203).

• Experience with SQL Server to Databricks migration programs.

• Experience with Terraform, ARM Templates, or Infrastructure as Code.

• Experience with Alteryx Server Administration.

• Retail, Supply Chain, or Enterprise Data Platform experience.

What We''re Looking For

This is not a pure Data Engineer or ETL Developer position.

We are specifically seeking candidates who have:

• Owned and administered Databricks platforms in production.

• Managed platform security, governance, and access controls.

• Supported enterprise-scale Azure data environments.

• Worked with both Databricks and SQL Server platforms.

• Experience with production support, monitoring, troubleshooting, and platform optimization.

If your background includes Databricks Administration, Azure Platform Engineering, SQL Server Administration, Platform Governance, and Cloud Modernization initiatives, we''d love to hear from you.