Involvement in the full development lifecycle: requirements gathering, design, development, documentation, testing, and deployment.
Daily responsibilities include developing, testing and optimizing Hadoop/Spark applications, troubleshooting data issues, and supporting production environments.
Regular interaction with local manager, Agile team members, and business stakeholders.
Mid to senior-level Hadoop Developer who can design, develop, and optimize Big Data solutions using the Hadoop ecosystem (HDFS, Hive, Spark) to process large-scale datasets efficiently.
Must have strong ETL, Big Data-Hadoop, and SQL testing expertise, along with solid knowledge of Spark development including performance optimization and troubleshooting, as well as Unix, Data Warehousing, scheduling tools, and scripting.
Excellent data and code analysis capabilities, including troubleshooting data quality and integrity issues, identifying root causes, and assisting the production support team as needed to resolve critical issues.
Ability to lead small initiatives and promote best practices in software development and testing across the team.
Experience working in Agile teams.
Good understanding of Bit Bucket, Gradle, Jenkins, Ansible and CI-CD pipeline
Thanks
Charan