Overview
Remote
Depends on Experience
Full Time
Accepts corp to corp applications
No Travel Required
Skills
Amazon Web Services
Atlassian
COBOL
Bash
PySpark
JIRA
JCL
Job Details
Primary Responsibilities:
- Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue.
- Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing.
- Coordinate closely with mainframe resources to ensure requirements and specifications are clearly understood.
- Design Glue jobs to meet requirements, consider performance where applicable, code per standards, and perform end-to-end testing.
- Document the design specifications and contribute to implementation plan then work with the architecture team and lead developer to review the design and the code.
- Effectively coordinate the infrastructure/service needs working with the architecture and infrastructure teams.
- Implement overall solution comprising of Glue ETL PySpark jobs including SQL queries, Lambda, Step Functions, REST API calls.
- Develop and integrate custom developed software solutions to leverage automated deployment technologies.
- Use industry leading DevOps tools such as CodeCommit, CodeBuild, CodePipeline and AWS CloudFormation.
- Communicate key project data to team members and infrastructure team cohesion and effectiveness.
- Leverage Atlassian tool suite like JIRA and Confluence to track activities.
- Identify and apply best practices and standard operating procedures.
- Create innovative solutions to meet the technical needs of customers.
Basic Qualifications:
- Experience working in the software development lifecycle, with strong experience on ETL based development.
- Working experience with development using Amazon Web Services (AWS) and primarily on AWS Glue studio.
- Experience working with programming language PySpark/Python
- Experience working with relational database like PostgreSQL.
- Experience working in a fast-paced development environment with drive to completion.
- Well versed with using version control systems (CodeCommit, CodeBuild, CodePipeline preferred)
- Well versed with using issue/problem tracking systems (Jira preferred)
- Candidate must have bachelor s with 8-12 years of prior relevant experience or master s with 6-10 years of prior relevant experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.