Hadoop Architect

Job Title: Hadoop Architect

Location: Plano, TX (Onsite)

Job Type: Full Time/Permanent

Experience: 10+ years

Job Description:

Primary Skill: Hadoop Architect

Key Responsibilities

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Required Technical Skills

• Strong experience with the Hadoop ecosystem:

• HDFS
• Hive
• Spark
• Ozone

• Hive Metastore management and table/partition maintenance.
• Hadoop data lifecycle management.
• Data ingestion, ETL processes, and data validation.
• Shell scripting and Python automation.
• Cloudera Data Platform (CDP) or similar Hadoop distributions.
• Strong SQL and data analysis skills.

Desired / Preferred Skills

• Experience supporting large-scale Hadoop environments with multi-petabyte storage.
• Knowledge of distributed storage architecture and data replication.
• Capacity management, storage forecasting, and quota governance.
• Platform onboarding, integration, and decommissioning.
• Familiarity with cloud platforms (Azure, AWS, or Google Cloud Platform).
• Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.
• Strong analytical and problem-solving skills with root cause analysis.
• Assessment Based on what you’ve shared with me previously, this role aligns well with your background in:
• Hadoop administration and platform support
• HDFS and Ozone
• Hadoop migration and enablement
• SQL
• Python
• Grafana and Prometheus
• Enterprise production support It looks like a good match if you’re applying for a Senior Hadoop Administrator, Hadoop Platform Engineer, or Big Data Support Engineer position.