Senior Hadoop DevOps Manager

company banner
Matlen Silver
Operations, Hadoop, Big Data, Global Operations, Management
Contract W2, Contract
Work from home available Travel not required

Job Description

Main focus will be on leading one of the quickest growing organizations within the company, Hadoop Administration and Operations. Manage, Mentor, and help architect our full Hadoop stack among many other cutting-edge technologies. You will also contribute and become a key member in expansions, POC s of new technologies, Private and Public cloud expansions, Hybrid-technology implementations, and lead critical integration work.

Required Experience:
Hadoop, Hive, Impala, HBase and related technologies such as Spark2
Managing teams of 10+
Hands on and Architecture experience with Cloudera and/or Hortonworks Experience to mentor direct and non-direct reports under Operations organization for Big Data
Strong Communication and Interpersonal Skills
Excellent knowledge of Linux, AIX, or other Unix flavors
Vast Experience in implementing Processes, Procedures, 24x7 Rotations, ITIL backed standards.
Great with numbers, ability to build key KPI metrics and use for total transparency into Platform and Resources
Experience with scripting (i.e. Chef/Puppet, Bash, Linux scripting)

Preferred Experience

Strong interpersonal skills, including a positive, solution-oriented attitude
Must be passionate, flexible and innovative in utilizing the tools, their experience, and any other resources, to effectively deliver to very challenging and always changing business requirements with continuous success
Must be able to interface with various solution/business areas to understand the requirements and support development
Healthcare and/or reference data experience is a plus
Strong native SQL skills
Experience in database and data warehousing/data lake concepts and techniques.
Understand: relational and dimensional modeling, star/snowflake schema design, BI, Data Warehouse operating environments and related technologies, ETL, MDM, and data governance practices.
Experience with containerization (Mesosphere, Docker, Kubernetes)
Experience with MPP, shared nothing database systems, and NoSQL systems
Experience with Spark, Scala, Python, Java, and/or R
Ability to work in a fast-paced, team-oriented environment
Ability to complete the full lifecycle of software development and deliver in an Agile/Scrum/Kanban environment, leveraging Continuous Integration/Continuous Development


Operational management and architecture of Hadoop ecosystem, managing 100s 1000s of nodes globally, ensuring 99% availability and 24x7 support. Building and managing high performing teams towards this, involved in recruiting, mentoring, and performance management of this team
Help and Manage teams that Build out clusters in data centers around the world
Tuning multi-tenant Hadoop ecosystem for operational efficiency, balancing various workloads and optimizing Yarn and Impala accordingly
Implement security, encryption, authentication, and authorization controls to adhere to corporate security policies
Support Data Governance and data lineage on the cluster
Enable High Availability and resiliency in the cluster, achieving 99.9999% uptime
Understand network optimization and DR strategies
Support and help to drive our hybrid cloud strategy, develop strategies for compute burst
Work with data architects on the logical data models and physical database designs optimized for performance, availability and reliability
Helping to tuning and optimization of backend processes, runbooks, procedures, change management, and SLA enforcement.
Proactively helps to resolve difficult technical issues
Provide technical knowledge to teams during project discovery and architecture phases
Keep upper management informed of work activities and schedules
Assess new initiatives to determine the work effort and estimate the necessary time-to-completion
Document new development, procedures or test plans as needed
Participate in data builds and deployment efforts. Help mature our Continuous Integration and Continuous Deployment methodologies
Participate in projects through various phases
Performs other related duties as assigned
Partner with the business units to develop effective solutions that solve business challenges

Minimum Education, Experience, & Specialized Knowledge Required:

Computer Science Degree, MBA, or Equivalent Work Experience
5+ years of experience managing a high-performance compute infrastructure team, enabling production systems at 99% availability with 24x7 Tier 1 and 2 support as well as Administrator Functions
3+ years managing operations and high-performance computing team of multiple 10+ team members. Involved in recruiting, developing, mentoring and performance management of that team

Company Information

Matlen Silver is the hardest working staffing team in the U.S. We do what we know is right for consultants and companies, creating a unique and powerful recruiting and talent experience. We don’t just say we’re hard-working. We are. We don’t just invest in great people, we invest in people with guts, who don’t stand alone with integrity, but together as one united front. Our core is a powerhouse that can’t be described but should be experienced.

Dice Id : matlennj
Position Id : 100999535248553
Originally Posted : 1 month ago

Similar Positions at Matlen Silver

Sr. Spark / Scala Developer
  • Plymouth Meeting, PA
  • 9 hours ago
Data Architects
  • Plymouth Meeting, PA
  • 9 hours ago
Big Data Engineer - W2
  • Berkeley Heights, NJ
  • 9 hours ago
Big Data Hadoop Engineer
  • Atlanta, GA
  • 9 hours ago
Hadoop Developer
  • Jacksonville, FL
  • 9 hours ago