Please note: This is NOT a Data Engineer role.
Position: Hadoop Admin
Industry: Public Sector
Type: 12 months contract
Location: Chicago, IL (on-site)
Pay Rate: $70 - $73/hour
Day to day:
Provide subject matter expertise in managing Hadoop and Data Science Platform operations, focusing on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management, and Administration.
Integrate solutions with other applications and platforms outside the framework.
Manage platform operations across all environments, including upgrades, bug fixes, deployments, metrics/monitoring for resolution and forecasting, disaster recovery, incident/problem/capacity management.
Serve as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs
Manage day-to-day operations for platforms built on Hadoop, Spark, Kafka, Kubernetes/OpenShift, Docker/Podman, and Jupyter Notebook.
Support and maintain AI/ML platforms such as Cloudera, DataRobot, C3 AI, Panopticon, Talend, Trifacta, Selerity, ELK, KPMG Ignite, and others.
Perform cluster management, upgrades, bug fixes, deployments, and disaster recovery activities.
Own incident response, problem management, and capacity planning.
Implement monitoring, alerting, and forecasting solutions to ensure system reliability.
Collaborate closely with development teams, vendors, and stakeholders to support agile software delivery.
Automate platform tasks using tools like Ansible, shell scripting, and Python.
Must haves:
Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster, and Hadoop Administrator's role
Intimate knowledge of fully integrated AD/Kerberos authentication.
Experience setting up optimum cluster configurations
Expert-level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres.
Hands-on experience analyzing various Hadoop log files, compression, encoding, and file formats.
Scripting and automation skills Python, Shell, Ansible
Experience in Monitoring Alerting, and Job Scheduling Systems.
Knowledge of databases: SQL, Cassandra, Postgres.
Strongly Proficiency with Unix/SQL scripting
Experience in agile development environments.
Plusses:
Previous experience with Snowflake, Data Bricks or Cloud Platforms (azure)
Previous Financial Experience
Salary and Compensation:
The hourly rate for this position is between $70 - $73 per hour. Factors which may affect pay within this range may include geography/market, skills, education, experience, and other qualifications of the successful candidate.
Benefits:
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable).