Job Description:
Roles and Responsibilities
Develop and maintain applications using Apache Spark and Java
Work with different aspects of spark echo system including Datasets, Spark SQL and Scalability support
Work with business analysts and lead engineers to understand requirements and designs for implementing software solutions
Work on performance improvement activities to support spark applications to process millions of data elements everyday
Production support and troubleshooting activities to uncover the issues in the spark applications
Contributes to software engineering communities of practice and events that explore new and emerging technologies
Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
Formal training or certification on software engineering concepts and 3+ years applied experience
Work experience on Data Engineering domain
Hands-on practical experience in system design (simple), application development, testing, and operational stability
Proficient in coding in one or more languages including Java
Experience in developing, debugging, and maintaining code in a corporate environment with Java, Spark Framework and Database querying languages (any SQL usage experience)
Overall knowledge of the Software Development Life Cycle
Experience working in an Agile Software Development Environment
Preferred qualifications, capabilities, and skills
Exposure to cloud technologies such as AWS, Kubernetes and Kafka.
Must Have Skills
Java, Spring Boot, AWS Glue
NICE to have skills
Kubernetes
CI/CD pipeline
Python
Kafka
Lambdas, API
Looking for curious, AWS certified, Java, ETL Engineer.
