Grand Prairie, TX Description:
Devops for Spark/Hadoop. Manage, Deploy, Maintain, Finetune Software Applications on Private/Public Clouds in both batch and realtime worlds.
Work closely with development, release engineering teams closely to propose and implement optimizations.
Make physical deployment recommendations on both public and private clouds. Maintain Spark/Hadoop infrastructure and monitor data services and solutions. Requirements
: 7 or more years relevant work experience Experience with Linux operating system Experience working in Production environment.
Experience with Spark (Hadoop) ecosystem Experience with Bash or Python Experience with Monitoring tools like Nagios/Splunk Experience in managing ETL jobs in production and reporting failures CI CD Expertise (Screwdriver/Jenkins).Good to Have:
At least 7 years experience in Linux Administration (Redhat and CentOS distributions preferred).
At least 5 years experience in managing Spark/Hadoop Clusters, including providing monitoring and administration support of Spark, HBase/Hive Kafka Experience with configuration management tools, deployment pipelines, and orchestration services Ansible or Chef Jenkins Experience managing cloud native applications and infrastructure.
Experience troubleshooting and actively debugging live production systems.
Ability to identify improvements, and work with the team to design solutions that will be deployed into production.
Ability to work independently and as a member of collaborative teams. Provide on-site Linux System Administration support for Hadoop Cluster and related software stack Work directly with software developers to simplify processes, enhance services and automate application delivery facilitating the release of production-ready software.
Proactively escalate and own issues to resolution before they become problems. Document maintenance and support procedures for routine and complex tasks.EVEN BETTER IF YOU HAVE:
Experience with securing services using Mutual TLS (mTLS)/x509 certificate management/Multi-factor authentication Experience with creation and management of CI/CD pipelines.
Experience with OKTA or similar identity platforms/Certificate Management or Authority Certification with any of the top leading cloud infrastructure like AWS, Google Cloud Platform or AzContact:
This job and many more are available through The Judge Group. Find us on the web at www.judge.com