Job Title: Hadoop data engineer
Location: Chicago, IL
Work Arrangement: Onsite
Client Industry: Financial Services
Duration: 12 Months Contract
Schedule: Standard Hours( Monday - Friday, 8 AM to 5 PM)
Day-to-Day:
- Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks.
- Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases.
- Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL.
- Convert and manage data in formats like JSON, CSV, XML to support downstream analytics.
- Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity.
- Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures.
Must Haves:
- Strong SQL Skills one or more of MySQL, HIVE, Impala, SPARK SQL
- Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
- Experience working with SPARK Structured steaming
- Experience working with Hadoop/Big Data and Distributed Systems
- Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
- Hands on programming experience in at least one of Scala, Python, PHP,
Plusses:
- Prior Bank Experience
- Experience in Service Now
Compensation
- Hourly Rate: $60 - $65 per hour
This reflects base compensation and may vary based on candidate qualifications.
Benefits
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually as applicable.
About Us
At Collabera, we don t just offer jobs we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.
Never miss an opportunity! Create an alert based on the job you applied for.
