Platform Infrastructure Engineer
VeridianTech
Dice Job Match Score™
🛠️ Calibrating flux capacitors...
Job Details
Skills
- AWS
- hive
- Spark
- Hadoop
- Ansible
- terraform
- VPC
- EC2
- EMR
- S3
- IAM
- Amazon Web Services
- HDFS
- data bricks
- Cloudera
- yarn
- CDP
- CDH
- IAC
- Infrastructure as Code
- DataRobot
- Snowflakes
- Data Platform Infrastructure Engineer
- infrastructure-as-code
Summary
Job Role - Platform Infrastructure Engineer
Location - Scottsdale AZ (100% onsite)
Duration: Contract (12 Months)
Job Description:
Data infra role -
This position we are interviewing is primary for :
- Cloudera
- Ansible
- AWS
Good to have, but secondary:
- Data Bricks
- DataRobot
- Snowflakes
Role Overview
We are seeking a highly skilled Data Platform Infrastructure Engineer to design, build, and manage scalable data platforms across on-premise and cloud environments. The role involves working with cluster technologies, infrastructure automation, and modern data ecosystems to enable reliable and high-performing data platforms.
Key Responsibilities
- Design, deploy, and manage data platform infrastructure across on-prem (Cloudera) and cloud (AWS, Databricks) environments
- Build and maintain distributed data clusters ensuring high availability, scalability, and performance
- Automate infrastructure provisioning using Terraform and Ansible
- Manage and optimize Cloudera Hadoop ecosystems (HDFS, Hive, Spark, YARN, etc.)
- Deploy and manage Databricks workspaces, clusters, and integrations on AWS
- Implement infrastructure-as-code (IaC) and configuration management best practices
- Monitor cluster performance, troubleshoot issues, and ensure system reliability
- Collaborate with data engineers, architects, and DevOps teams to support data pipelines and analytics workloads
- Ensure security, compliance, and governance across data platforms
- Support migration from on-prem to cloud-based data platforms
Technical Skills Required
Core Technologies
- Strong experience in Cloudera (CDH/CDP) cluster setup and administration
- Hands-on experience with Databricks (cluster management, jobs, notebooks)
- Strong exposure to AWS (EC2, S3, IAM, VPC, EMR, networking concepts)
Infrastructure & Automation
- Expertise in Terraform (mandatory) for infrastructure provisioning
- Proficiency in Ansible for configuration management and automation
- Experience with CI/CD pipelines for infrastructure deployments
Cluster & Data Technologies
- Experience managing distributed systems / cluster technologies
- Strong understanding of:
-
- Hadoop ecosystem (HDFS, Hive, Spark, Kafka, etc.)
- Spark performance tuning and cluster optimization
-
- Knowledge of containerization (Docker/Kubernetes) is a plus
- Dice Id: 91120142
- Position Id: 2026-18457
- Posted 4 hours ago
Company Info
About VeridianTech
Veridian Tech Solutions Houston based Cloud Consulting and IT Services firm specializing in Enterprise Mobility, Information Management, and Cloud-based solutions.
Founded in 2013, Veridian Tech Solutions was created to address the growing need for technology that enables businesses to be mobile and flexible in managing their applications and employees. As the market began transitioning into the Digital Era, Veridian realized that companies needed specific skill sets of technology expertise to provide their customers with new tools and services, create better ways for their employees to do their jobs, and do so in a modern, cost-effective way.
With decades of industry experience, Veridian's leadership team brought the expertise and guidance of extensive enterprise systems execution and project management expertise across numerous industries, and most importantly, the knowledge of what is required for a consultant to be effective.
Veridian builds its team by only selecting resources who have deep consulting experience, proven technical skills, and are highly proficient in specific sought-after areas of cutting-edge Mobility, Cloud, and Analytics technologies.
These cutting-edge skills we have often found are the gaps at organizations across North America, from mid-tier to Fortune 500, and at big 4 consulting firms as well. We work with our clients to comprehend their project requirements and utilize our experience to present the correct solutions and right resources.
We provide onshore services to North America, coordinated from our headquarters in Houston, and we provide offshore services from our Delivery center in New Delhi, India.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs