Senior Systems Analyst- Databricks Administrator (AWS)

Senior Systems Analyst Databricks Administrator (AWS)

(Austin, TX Hybrid Local Candidates Only)

We are seeking an experienced Systems Analyst with a strong background in Databricks administration and cloud-based data platforms. This role will be responsible for managing and optimizing the Databricks environment to support scalable data engineering, analytics, and AI/ML workloads.

This is a highly technical, hands-on role focused on platform reliability, security, governance, and performance.

Key Responsibilities:

• Administer and support Databricks workspaces in a cloud environment (AWS)
• Configure and manage clusters, job scheduling, and workspace settings
• Manage user access, roles, and permissions using IAM, SCIM, and RBAC
• Monitor platform performance, availability, and overall system health
• Implement and enforce cluster policies and governance standards
• Integrate Databricks with cloud storage solutions (e.g., S3)
• Support data engineers, analysts, and data scientists across the platform
• Troubleshoot performance issues and optimize Spark workloads
• Collaborate with DevOps teams to support automation and CI/CD pipelines

Required Qualifications:

• 8 years of experience administering Databricks workspaces in a cloud environment (AWS)
• 8 years of experience with Databricks cluster configuration, job scheduling, and workspace management
• 8 years of experience managing user access, roles, and permissions (IAM, SCIM, RBAC)
• 8 years of experience with Apache Spark concepts, including performance tuning and troubleshooting
• 8 years of experience integrating Databricks with cloud storage services (e.g., S3)
• 8 years of experience implementing cluster policies and governance standards
• 8 years of experience with Databricks SQL, notebooks, and job orchestration
• 8 years of experience monitoring platform performance, health, and availability
• 8 years of understanding data security, encryption, and compliance requirements
• 8 years of experience with DevOps or automation tools (e.g., Terraform, CI/CD, scripting)

Preferred Qualifications:

• 4 years of experience administering Databricks in an enterprise environment
• 4 years of experience with Unity Catalog for governance and access control
• 4 years of experience with cost management and optimization for Databricks workloads
• 4 years of experience supporting AI/ML workloads using Databricks ML and MLflow
• 4 years of familiarity with data lake and lakehouse architectures
• 4 years of experience with Python, SQL, or Scala for administration and troubleshooting

Additional Details:

• Location: Austin, TX (Hybrid work environment)
• Schedule: Monday Friday, standard business hours
• Engagement expected through August 2026, with potential for extension

Requirements:

• Must be authorized to work in the U.S. without sponsorship
• W2 employment only (no C2C or third-party arrangements)
• Candidates must be local to the Austin, TX area
• Ability to work onsite as required in a hybrid environment

Why This Role:

• Opportunity to manage and optimize a modern data platform
• Work with Databricks, AWS, and advanced data/AI workloads
• High-impact role supporting enterprise analytics initiatives