Overview
On Site
Full Time
Skills
Hadoop
big data
gcp
engineer
Job Details
Job Title: Sr. Hadoop Engineer
Location: Foster City, CA (Hybrid)
Type: Long Term Contract / Full-time
Job Description:
We are seeking a highly skilled Sr. Hadoop Engineer with over 10 years of experience in software development and big data engineering. The ideal candidate will be strong in algorithms, data structures, and design patterns, with proven expertise in building scalable, high-performance data solutions on Google Cloud Platform.
Responsibilities:
- Design, develop, test, and maintain large-scale data solutions and multi-tier software systems.
- Build and optimize end-to-end data pipelines using Hadoop, Hive, Spark, and Airflow.
- Own the full software development lifecycle architecture, coding, testing, deployment.
- Troubleshoot, debug, and tune Spark jobs for performance.
- Collaborate with engineers, operations, and business stakeholders to deliver scalable solutions.
- Ensure code quality through unit testing, reusable design, and maintainable coding practices.
- Lead offshore delivery teams and engage with clients/stakeholders as needed.
Required Skills:
- 10+ years in software development with strong algorithms, OOP, and design patterns.
- Expertise in SQL (BQ, Hive, Spark SQL).
- Strong in Python, PySpark.
- Hands-on with Big Data architecture Hadoop, Hive, Spark, Airflow.
- Google Cloud Platform (Google Cloud Platform) development experience.
- Strong debugging and performance tuning for Spark jobs.
- Proficiency in Unix, GitHub, and multi-threaded programming.
Preferred Skills:
- Client and stakeholder management experience.
- Offshore team leadership.
- Certifications in Big Data or Google Cloud Platform.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.