Azure SQL Database Administrator / Databricks Administrator

Job Title: Azure SQL Database Administrator / Databricks Administrator
Location: Richardson, TX (On-site 3 days a week)
Duration: Direct Hire 

Position Summary
We are looking for a skilled Azure SQL Database and Databricks Administrator to join our Data Platform team. This hybrid role blends traditional database administration with modern cloud-native data engineering, focusing on Microsoft Azure SQL services and Databricks environments. The ideal candidate will manage and optimize our cloud data infrastructure while supporting advanced analytics and machine learning capabilities.

Key Responsibilities

SQL Database Administration

• Administer and maintain both on-premises and cloud-based SQL Server environments

• Manage database installation, configuration, backups, and disaster recovery strategies

• Implement high availability solutions such as Always On Availability Groups, clustering, and replication

• Conduct performance tuning, query optimization, and capacity planning

• Develop and maintain T-SQL scripts, stored procedures, and complex queries

Azure Databricks Administration

• Design, deploy, and manage Azure Databricks clusters and environments

• Develop and optimize ETL pipelines using Apache Spark (PySpark/Scala)

• Integrate Databricks with Delta Lake to support ACID transactions and versioning

• Connect Databricks to Azure services (Blob Storage, Data Lake Storage, Synapse)

• Configure authentication methods (e.g., JDBC, service principals, access keys)

• Create and manage analytics workflows in Databricks notebooks and integrate with Power BI

Security & Compliance

• Implement Role-Based Access Control (RBAC) across platforms

• Enforce data security through masking and encryption (at rest and in transit)

• Ensure compliance with regulatory and security standards for sensitive data

• Define and maintain security best practices across cloud environments

Required Skills & Experience

Technical Expertise

• 5+ years of SQL Server administration (on-prem and cloud)

• 3+ years of Azure Databricks administration experience

• Advanced skills in T-SQL scripting, performance tuning, and stored procedures

• Experience with Azure SQL Database and SQL Managed Instance

• Proficiency in Apache Spark (PySpark/Scala) for large-scale data processing

• Background in cloud database migrations and modernization projects

Cloud & DevOps

• Deep understanding of Azure services (Blob Storage, Data Lake, Synapse, Data Factory)

• Hands-on experience with Infrastructure-as-Code (Terraform, ARM templates, Bicep)

• Familiarity with CI/CD pipelines using Azure DevOps

• Knowledge of containerization and orchestration (e.g., Kubernetes, Docker)

Data Engineering & Analytics

• Proven ability to build and manage scalable ETL workflows

• Understanding of data lake architecture and Delta Lake integration

• Exposure to machine learning pipelines and BI tool integrations

• Experience with data governance, lineage tracking, and metadata management

Preferred Qualifications

Certifications

• Microsoft Certified: Azure Database Administrator Associate

• Microsoft Certified: Azure Data Engineer Associate

• Databricks Certified Associate Developer – Apache Spark

• Additional Azure certifications (e.g., Solutions Architect, DevOps Engineer)

Additional Experience

• Disaster recovery strategy development and implementation

• Knowledge of dimensional modeling and data warehouse design

• Familiarity with monitoring tools (Azure Monitor, Log Analytics, Databricks metrics)

• Experience with AWS or GCP is a plus

• Experience in regulated industries (e.g., healthcare, finance)

Key Competencies

• Strong analytical and troubleshooting abilities

• Effective communicator across technical and business teams

• Capable of managing multiple priorities independently

• Committed to continuous learning and skill development

• Experience mentoring junior team members and sharing best practices