job summary:
We are seeking an experienced AWS Databricks Platform Administrator with 9 years of overall IT experience including substantial handson expertise in administering securing optimizing and supporting Databricks on AWS The role will own platform reliability governance security cost management automation and operational excellence across enterprise data and analytics workloads The ideal candidate combines strong Databricks administration skills with deep knowledge of AWS services infrastructure automation cloud security and production support
location: Raritan, New Jersey
job type: Contract
salary: $65 - 75 per hour
work hours: 8am to 4pm
education: Bachelors
responsibilities:
- Administer and support Databricks accounts workspaces Unity Catalog metastores clusters SQL warehouses jobs instance pools repositories libraries secrets and access controls on AWS
- Design and maintain secure scalable and highly available Databricks platform architecture aligned with enterprise cloud standards
- Manage identity and access through IAM roles and policies service principals single signon SCIM provisioning and rolebased access control
- Implement data governance using Unity Catalog including catalogs schemas external locations storage credentials privileges lineage and auditability
- Configure and troubleshoot AWS integrations such as S3 IAM VPC PrivateLink KMS CloudWatch CloudTrail Route 53 and Secrets Manager
- Establish cluster policies approved runtime standards library controls tagging autotermination serverless usage guidelines and workload isolation
- Monitor platform health performance job reliability capacity and usage proactively identify and resolve bottlenecks and recurring issues
- Drive FinOps practices by analyzing DBU and AWS consumption enforcing tagging and budgets optimizing compute configurations and reducing idle or inefficient resources
- Automate workspace provisioning configuration policy enforcement and operational tasks using Terraform Databricks Asset Bundles Databricks CLISDK Python and CICD pipelines
- Lead incident problem change release vulnerability and servicerequest management for the platform while meeting agreed SLAs and operational KPIs
- Plan and execute runtime upgrades platform migrations disasterrecovery tests backup validation and businesscontinuity activities
- Partner with data engineering analytics security networking cloud engineering and application teams to onboard workloads and resolve complex technical issues
- Maintain architecture diagrams runbooks standard operating procedures support documentation compliance evidence and knowledge articles
- Provide technical leadership mentor administrators and engineers conduct reviews and define platform standards and product roadmaps
- Coordinate with Databricks and AWS support teams for critical incidents product defects and service improvements
qualifications:
9 years of overall experience in cloud infrastructure data platforms DevOps platform engineering or production administration
5 years of handson Databricks administration experience preferably with enterprise deployments on AWS
Strong experience with Databricks account console workspace administration Unity Catalog cluster policies SQL warehouses jobs Delta Lake system tables and audit logs
Strong knowledge of AWS networking security storage encryption monitoring and identity services particularly VPC S3 IAM KMS PrivateLink CloudWatch and CloudTrail
Handson experience with infrastructure as code and automation using Terraform Python shell scripting REST APIs Databricks CLISDK and CICD tools
Proven experience supporting businesscritical platforms in production including incident response rootcause analysis change management capacity planning and SLA governance
Working knowledge of Linux administration networking DNS firewalls certificates proxies and secure connectivity patterns
Good understanding of Spark architecture Delta Lake workload performance data lakehouse patterns and troubleshooting distributed data workloads
Experience implementing security controls leastprivilege access secrets management encryption audit logging vulnerability remediation and compliance requirements
Bachelors degree in Computer Science Information Technology Engineering or a related discipline or equivalent relevant experience
skills:
EC2,AWS S3,VPC,AWS,Spark,audit logs,audit logging,cloud infrastructure,cloud security,cloud engineering,CloudWatch,CICD pipelines,CICD,data governance,data lakehouse,Delta Lake,data platforms,Databricks Platform,Databricks,DevOps platform,disaster recovery,distributed data,DNS,IAM,data engineering,Information Technology Engineering,Computer Science,infrastructure automation,secrets management,Monitoring observability,performance tuning,Python,REST APIs,Route 53,SQL,serverless,shell scripting,single signon,vulnerability remediation,Terraform,Coordinate,troubleshoot,reliability,proactively,access controls,access control,administration,architecture,architecture diagrams,automation,Automate,budgets,capacity management,secure connectivity,cost management,FinOps,encryption,governance,incident response,cost controls,mentor,operational excellence,policy enforcement,product defects,production support,compliance requirements,security controls,standard operating procedures,warehouses,technical leadership,product roadmaps,vulnerability
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
![]()
