Title: DevOps Engineer AWS, Databricks & Infrastructure
Location: Dallas, TX (Local)
Job Summary:
We are looking for an experienced DevOps Engineer with strong expertise in AWS, Databricks, Infrastructure as Code (IaC), Terraform, CI/CD, and Jenkins. The candidate will be responsible for designing, implementing, automating, and maintaining scalable and secure cloud infrastructure and deployment pipelines.
The role requires close collaboration with development, data engineering, security, and operations teams to ensure reliable application and data-platform deployments across environments.
Key Responsibilities:
- Design, deploy, configure, and maintain AWS cloud infrastructure across development, testing, staging, and production environments.
- Build and manage Infrastructure as Code (IaC) using Terraform, following reusable and modular design principles.
- Manage and support Databricks infrastructure and platform deployments on AWS.
- Develop, maintain, and optimize CI/CD pipelines for application, infrastructure, and Databricks deployments.
- Configure and administer Jenkins pipelines, agents, integrations, credentials, and deployment workflows.
- Automate infrastructure provisioning, configuration, deployment, monitoring, and operational processes.
- Implement DevOps best practices for version control, continuous integration, continuous delivery, release management, and environment management.
- Integrate Terraform with CI/CD workflows to enable automated and controlled infrastructure deployments.
- Work with AWS services such as EC2, S3, IAM, VPC, CloudWatch, Lambda, RDS, EKS, and other relevant cloud services.
- Support Databricks workspace configuration, cluster policies, compute resources, access controls, networking, and deployment automation.
- Implement appropriate security, IAM, networking, encryption, logging, and monitoring controls across cloud infrastructure.
- Troubleshoot infrastructure, deployment, CI/CD, and production issues and perform root-cause analysis.
- Establish monitoring, alerting, logging, and operational dashboards to improve platform reliability.
- Collaborate with development and data engineering teams to streamline application and data-platform releases.
- Maintain technical documentation covering infrastructure architecture, deployment procedures, operational processes, and troubleshooting.
- Identify opportunities to improve automation, scalability, reliability, security, and cost efficiency.
Required Skills & Experience:
- Strong hands-on experience in DevOps engineering and cloud infrastructure.
- Strong experience with AWS cloud services and architecture.
- Hands-on experience with Terraform and Infrastructure as Code.
- Experience designing and implementing CI/CD pipelines.
- Strong experience with Jenkins and pipeline automation.
- Experience with Databricks, preferably on AWS.
- Good understanding of AWS networking concepts including VPC, subnets, security groups, IAM, routing, and load balancing.
- Experience with Git-based source control and branching strategies.
- Strong scripting/automation skills using Python, Bash, or Shell scripting.
- Experience with infrastructure deployment automation and environment management.
- Understanding of cloud security, access management, secrets management, monitoring, and logging.
- Strong troubleshooting and problem-solving skills.
