Genesis10 is currently seeking a Big Data Developer/Engineer for an onsite position with a Global Financial Institution located in Chicago, IL. This is a 12+ month contract opportunity. We invite you to join a tight-knit, supportive team passionate about delivering the best experience for customers. This role requires a self-starter who can design, build, and optimize end-to-end data pipelines in a complex Big Data environment, working with a diverse set of technologies within an Agile framework.
Responsibilities: - Design and build end-to-end Near-Real Time and Batch Data Pipelines
- Perform data ingestion from message queues, file shares, REST APIs, and relational databases, handling formats like JSON, CSV, and XML
- Develop and optimize processes using SPARK Structured Streaming
- Conduct performance tuning for Spark, MapReduce, and SQL jobs
- Utilize source code and version control systems like Git and Bit Bucket
- Work within an Agile development process and use tools like Jenkins for CI/CD
Requirements: - Strong SQL skills with experience in one or more of the following: MySQL, HIVE, Impala, or SPARK SQL
- Experience working with Hadoop/Big Data, Distributed Systems, Spark, Sqoop, Kafka, and MapReduce
- Working knowledge of NoSQL Databases such as HBase or SOLR
- Experience with Cloudera (CDP) or Hortonworks (HDP) distributions
- Familiarity with Elastic Search and Kibana
- Hands-on programming experience in at least one of the following: Scala, Python, PHP, or Shell Scripting
- Proficiency with the Linux operating system is a must
- Strong analytical mind to take on complicated problems
- Ability to adapt and continue to learn new technologies
Pay rate: $63.94 - $71.94 per hour
Only candidates available and ready to work directly as Genesis10 employees will be considered for this position. If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: - Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
- The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
- Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
- Behavioral Health Platform
- Medical, Dental, Vision
- Health Savings Account
- Voluntary Hospital Indemnity (Critical Illness & Accident)
- Voluntary Term Life Insurance
- 401K
- Sick Pay (for applicable states/municipalities)
- Commuter Benefits (Dallas, NYC, SF, and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Never miss an opportunity! Create an alert based on the job you applied for.