Genesis10 is currently seeking a Hadoop Engineer (SME) for a contract position with a Global Financial Institution located in Chicago, IL or Charlotte, NC. This is a 12+ month contract opportunity. This role supports NextGen Platforms built around Big Data Technologies such as Hadoop, Spark, Kafka, and Impala. The ideal candidate will have experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera and Databricks. As a Hadoop Engineer involved in the full life cycle of an application, you will be part of an agile development process, requiring the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, and vendors.
Shift Timings: 8AM - 5PM / 12:30PM ET - 9:30PM ET
Responsibilities: - Work on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
- Provide subject matter expertise in managing Hadoop and Data Science Platform operations with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container Cluster Management and Administration
- Integrate solutions with other applications and platforms outside the framework
- Manage platform operations across all environments which includes upgrades, bug fixes, deployments, metrics/monitoring for resolution and forecasting, disaster recovery, and incident/problem/capacity management
- Serve as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs
- Provide L1, L2, and L3 level support in the Hadoop Platform
- Debug and troubleshoot Yarn, Spark and Impala jobs
- Address issues around Name node, HDFS Space, and File/Folder Permission backups
Requirements: - Experience in query performance tuning and resource utilization tuning
- Technical knowledge of relational databases, data warehousing, and SQL skills
- Proficiency with Big Data technologies: Hadoop, Kafka, Spark, Impala, Hive, HBase, Ozone, etc
- Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster, and the Hadoop Administrator's role
- Intimate knowledge of fully integrated AD/Kerberos authentication
- Experience setting up optimum cluster configurations
- Debugging knowledge of YARN
- Hands-on experience analyzing various Hadoop log files, compression, encoding, and file formats
- Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres
- Strong technical knowledge of Unix/Linux, Database (Sybase/SQL/Oracle), Java, Python, Perl, and Shell scripting
- Experience with Monitoring, Alerting, and Job Scheduling Systems (e.g., Autosys)
- Strong grasp of automation / DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket
Desired skills: - Experience with BI tools such as Tableau, including dashboard building connecting to Hadoop-Hive Tables
- Experience working on Big Data Technologies
- Cloudera Admin / Dev Certification
- Certification in Cloud, Docker-Container, or OpenShift Technologies
Pay range: $63.68 - $71.68 per hour
Only candidates available and ready to work directly as Genesis10 employees will be considered for this position. If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: - Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
- The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
- Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
- Behavioral Health Platform
- Medical, Dental, Vision
- Health Savings Account
- Voluntary Hospital Indemnity (Critical Illness & Accident)
- Voluntary Term Life Insurance
- 401K
- Sick Pay (for applicable states/municipalities)
- Commuter Benefits (Dallas, NYC, SF, and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Never miss an opportunity! Create an alert based on the job you applied for.