Overview
On Site
Depends on Experience
Full Time
Able to Provide Sponsorship
Skills
Big Data
Hadoop
Spark
Scala
Cloudera
Job Details
Hi Everyone,
We are Photon, one of the world's largest Digital Platform Engineering companies providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.
Please refer the below JD and apply if you are interested in discussing further.
Designation: Sr. Data Engineer
Location: Jersey City, NJ (Onsite)
Job Type: Fulltime
Qualifications:
- We need a Senior Data Engineer 10+ years exp proficient in Spark, Scala/Java, and Hive, with extensive hands-on development experience in the Big Data Ecosystem.
Key Responsibilities:
- Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop echo systems.
- Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle from initial design and development to deployment and ongoing maintenance.
- Develop robust and efficient Hive queries for extensive data analysis and reporting.
- Champion and enforce best practices and coding standards for new and existing data flows to ensure they are robust, scalable, secure, and maintainable using Spark, Scala/Java, and Hive within the big data ecosystem.
- Diagnose, troubleshoot, and resolve complex issues related to Spark, Scala/Java, and Hive applications and YARN resource management, implementing performance optimization solutions.
- Proactively collaborate with stakeholders, working closely to develop solutions with full commitment and accountability.
Technical Skills & Experience:
- Proven hands-on development expertise with Apache Spark
- Strong programming proficiency in Scala and/or Java
- In-depth knowledge and practical experience with Hive, including query optimization and data analysis.
- Experience with data platforms such as Cloudera Data Platform (CDP) is highly desirable.
Regards,
Karthik T
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.