Job Title: Sr. AWS DevOps Engineer
Location: Plano-Tx Onsite
Duration: 5 Months
What are the top 3 skills required for this role?
1. AWS / AWS DevOps (includes CI/CD pipelines)
2. DataBricks / Terraform
3. Unity Catalog / Python / Spark
Job Description/ Responsibilities:
We’re seeking a hands-on Senior Cloud Data Platform Engineer to build, operate, and support secure, reliable data platforms across AWS and Databricks. This role spans infrastructure as code, cloud and data platform operations, access management, automation, migrations, and production support. You’ll partner with engineering, data, security, and operations teams to deliver platform capabilities across development, QA, and production environments.
Responsibilities:
• Design, deploy, and operate AWS infrastructure supporting enterprise data platforms, including S3, IAM, networking, databases, and cross-account access.
• Build and maintain infrastructure using Terraform and related automation tools, with consistent, repeatable deployments across environments.
• Administer Databricks workspaces and Unity Catalog, including catalogs, schemas, tables, compute, jobs, and service principals.
• Implement and troubleshoot data access using groups and least-privilege grants; investigate permission inheritance, workspace access, and identity synchronization.
• Support data platform migrations, including Hive Metastore to Unity Catalog, and validate data access and workloads after migration.
• Develop and maintain CI/CD pipelines for infrastructure and data platform deployments; troubleshoot failed runs and support safe releases.
• Support data movement and integration between cloud accounts and platforms, including testing and validating representative data-copy workflows.
• Monitor platform reliability, security, performance, and cost; troubleshoot incidents and recommend lasting improvements.
• Support operational requests such as user onboarding, access changes, audit activities, and production changes in accordance with approval and change-management processes.
• Document architecture, operational procedures, access patterns, and incident resolutions; collaborate with distributed teams across time zones.
Required Qualification:
• Experience operating cloud infrastructure in AWS, including IAM, S3, networking, and cross-account access.
• Hands-on experience with Terraform or a comparable infrastructure-as-code tool.
• Experience supporting Databricks, Apache Spark, or a comparable cloud data platform.
• Understanding of data access controls, identity and group-based permissions, and least-privilege security.
• Experience with CI/CD, scripting, and production troubleshooting.
• Strong communication skills and the ability to work with platform users, application teams, security, and operations.
• Careful approach to production changes, including validation, rollback planning, and change documentation.
Preferred Qualifications:
• Experience with Unity Catalog, including catalog/schema/table grants and migration from Hive Metastore.
• Experience with Databricks workspaces, clusters or compute, jobs, service principals, and workspace identity configuration.
• Experience with AWS cross-account data access, encryption, KMS, and cloud security controls.
• Familiarity with data-copy and ingestion patterns, SQL, Spark, Python, or Bash.
• Experience supporting enterprise data lakes, lakehouses, or regulated production environments.
• Familiarity with incident management, audit requirements, and service-management workflows.
What success looks like:
• Infrastructure and platform changes are repeatable, reviewed, and deployed consistently across environments.
• Users receive the right data access with minimal delay and no unnecessary privilege.
• Data platform migrations and cross-account workflows are validated and supported with clear operational procedures.
• Production issues are resolved effectively, with root causes documented and recurring problems reduced.
• Platform reliability, security, and cost are continuously improved.
