Overview
On Site
Full Time
Skills
SQL
Hive
Spark
Airflow
BQ
Job Details
Role: Sr. Hadoop Engineer
Location : Dallas, TX, Houston, TX, Atlanta, GA-Hybrid
Location: Foster City, CA
Experience 10+ to 15 years
Job description:
Must Have: Hadoop On Prem experience
Experience & Core Skills
- 10+ years hands-on software development experience
- Strong algorithms, data structures, OOP, design patterns
- Proficient in multi-threaded programming, troubleshooting, debugging, and analytics
- Google Cloud Platform development expertise
Mandatory Technical Skills
- SQL (BQ, Hive, Spark SQL)
- Spark job debugging & performance tuning
- Python, PySpark
- Big Data Architecture Hadoop, Hive, SQL, Airflow
- Strong architecture skills for end-to-end data pipelines
- Unix & GitHub proficiency
Secondary/Preferred Skills
- Client & stakeholder management
- Offshore team & delivery leadership
- Relevant certifications (big data, Google Cloud Platform, etc.)
Key Responsibilities
- Design, develop, test, and maintain multi-tier software & large-scale data solutions
- Own full lifecycle: architecture coding testing deployment
- Collaborate with engineers, Ops, and business stakeholders on scalable solutions
- Ensure code is high-quality, well-tested (unit tests in Golang), reusable, and maintainable
- Deliver features/sub-systems on time and to spec
- Drive solutions with excellent problem-solving and system design thinking
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.