Genesis10 is currently seeking a Senior Big Data / Hadoop Developer for a contract position with a Global Financial Institution located in Pennington, NJ. This is a 12+ month contract opportunity. We are looking for a highly skilled Hadoop Developer to join a data engineering team. You will be responsible for building, optimizing, and maintaining scalable data pipelines within the Hadoop ecosystem. The ideal candidate will have extensive experience in ETL processing, data warehousing concepts, and optimizing large-scale distributed data architectures.
Responsibilities: - Design, develop, and maintain robust data processing jobs using Hadoop (HDFS, MapReduce, Hive, Spark)
- Architect and implement complex ETL/ELT pipelines to ingest, transform, and load large-scale structured and unstructured data
- Fine-tune performance for distributed queries and data processing tasks to ensure high efficiency in a multi-tenant environment
- Translate business requirements into logical and physical data models suitable for big data analytics
- Implement data validation and reconciliation processes to ensure high data integrity and reliability
- Troubleshoot production data issues, resolve pipeline bottlenecks, and manage system upgrades within the Hadoop stack
- Mentor junior developers and enforce coding standards and best practices for big data development
Requirements: - Strong hands-on experience with Hive, Spark, HDFS, and Oozie or Airflow
- Deep experience in designing end-to-end ETL processes using Python, Scala, or Java, and SQL
- Proficiency in processing large datasets (Petabyte scale) and understanding partition strategies, file formats (Parquet, Avro, ORC), and compression techniques
- Expert-level knowledge of complex SQL queries, window functions, and performance tuning
Desired skills: - Experience with Starburst (Trino) for high-performance distributed SQL queries and federated query engines is a significant plus
- Familiarity with migrating or running Hadoop workloads on cloud platforms (AWS EMR, Databricks, or Google Dataproc)
- Knowledge of tools like Ranger, Atlas, or similar metadata management tools
Pay range: $55.06 - $63.06 per hour
Only candidates available and ready to work directly as Genesis10 employees will be considered for this position. If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: - Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
- The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
- Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
- Behavioral Health Platform
- Medical, Dental, Vision
- Health Savings Account
- Voluntary Hospital Indemnity (Critical Illness & Accident)
- Voluntary Term Life Insurance
- 401K
- Sick Pay (for applicable states/municipalities)
- Commuter Benefits (Dallas, NYC, SF, and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Never miss an opportunity! Create an alert based on the job you applied for.