Genesis10 is currently seeking a Data Engineer/Python Developer (Hadoop - On-Prem) with our client in the financial industry located in Chicago, IL and Denver, CO. This is a 12 month contract position.
Responsibilities: - Build and maintain data pipelines using Python, SQL, and Hadoop ecosystem tools
- Develop and optimize Spark (PySpark) jobs for large-scale data processing
- Work with HDFS, Hive, Yarn, and other on prem Hadoop components
- Perform data modeling, schema design, and data transformation for analytics workloads
- Troubleshoot and tune data jobs for performance, reliability, and cost efficiency
- Collaborate with business and technical teams to define data requirements and delivery timelines
- Implement logging, monitoring, validation, and alerting for production pipelines
- Participate in code reviews, version control procedures, and best-practice engineering standards
- Document workflows, data lineage, tables, and pipeline runbooks
Requirements: - 6-8 years of professional experience in Data Engineering or similar roles
- 5 years strong Python development skills (modules, packaging, testing, best practices)
- Hands-on experience in an on prem Hadoop environment including HDFS, Hive/HCatalog, Spark/PySpark
- Proficient in SQL with experience working on large structured/unstructured datasets
- Experience building scalable ETL/ELT solutions end-to-end
- Familiarity with workflow orchestration tools (Airflow or Oozie preferred)
- Comfortable working in Linux environments and writing shell scripts
- Strong debugging, performance tuning, and distributed system problem-solving skills
Desired skills: - Experience with data quality frameworks (e.g., Great Expectations)
- Exposure to metadata catalog or lineage tools (Amundsen, DataHub, Atlas)
- Understanding of BI/reporting support workflows
- Familiarity with Git-based CI/CD pipelines (GitHub, GitLab, Jenkins, etc.)
- Experience modernizing or migrating legacy Hadoop workloads
Pay Range: $55.44-$63.44
Only candidates available and ready to work directly as Genesis10 employees will be considered for this position.
If you have the described qualifications and are interested in this exciting opportunity, please apply!
About Genesis10:Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: Access to hundreds of clients, most who have been working with Genesis10 for 5-20 years.
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Never miss an opportunity! Create an alert based on the job you applied for.