Location: Cincinnati, OH- 100% ONSITE
Duration: 6 months
Role: Databricks Engineer
Exp: 6-8 years in required skills
Keyword: Azure DevOps and Azure Data factory
Skills: Digital: Cloud DevOps, Digital: Databricks
Role Descriptions:
Provision and manage infrastructure resources in the cloud using tools like Azure Resource Manager templates or terraform.
Establish and manage CICD pipelines to automate the build| test| and deployment processes.
Oversee the release process working closely with development and operations teams ensuring deployments and having contingency plans for rollbacks if needed.
Implement and maintain tools| like Ansible or Puppet| for uniformity across environments.
Establish systems to monitor performance issues or errors in applications proactively.
Implement security measures while adhering to industry norms and laws.
Investigate and resolve issues related to the application| infrastructure| or deployment pipelines.
Collaborate with development| testing| and operations teams for effective communication and smooth workflow.
Proven experience as a DevOps Platform Engineer in cloud environments| with a strong focus on Azure.
Deep expertise in Azure Databricks| Azure Data Lake Storage| Azure Resource Manager (ARM)| Microsoft Entra| Azure SQL Database. Hands on experience automating Databricks clusters| libraries| jobs| notebooks| and environment promotions via pipelines.
Proficiency in Unity Catalog and Databricks data governance.
Familiarity with Apache Spark (PySpark| Spark SQL).
Strong IaC skills Terraform| ARM| or Bicep.
Scripting (Python PowerShell)| and Git (branching strategies| conflict resolution).
Observability with Azure Monitor| Log Analytics pipeline orchestration with Azure Data Factory.
Security best practices for cloud (RBAC| managed identities| Key Vault).Excellent problem solving and collaboration across cross functional teams.
Desirable Skills: Create and maintain documentation related to infrastructure| deployment processes| and standard operating procedures.
Analyze and estimate resource requirements to ensure optimum performance and scalability of applications.
Implement backup and disaster recovery strategies to ensure data protection and business continuity.
Identify areas for improvement in the development and deployment processes and implement changes to enhance efficiency and productivity.
Never miss an opportunity! Create an alert based on the job you applied for.
