Overview
Hybrid
Depends on Experience
Full Time
Unable to Provide Sponsorship
Skills
Azure
Databricks
ADF
Azure Data Factory
Job Details
Must be local to TX
Role Overview:
We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.
Key Responsibilities:
- Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.
- Proactive Monitoring & Optimization – Improve performance, cost, and reliability.
- Data Quality & Governance – Enforce data integrity, lineage, and compliance.
- Change & Release Management – Streamline deployments and minimize disruptions.
- Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.
- Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.
- Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.
Qualifications:
- 8+ years in data engineering & platform support, with expertise in Azure & Databricks.
- Strong knowledge of incident management, performance tuning, and data governance.
- Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
- Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
- Excellent communication and stakeholder management skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.