Data Engineer

ETL unit testing, mplement Data structure, mapping, AWS Glue, Python, Java, Security standards, EDI
Full Time
Depends on Experience
Travel not required

Job Description

Develop the end-to-end data flow architecture of ETL process on AWS cloud, extraction, transformation and load of data functions

Develop EDI Mapping via MapForce or homegrown EDI transformer, process the data extraction as per the target/desired state of ETL process.
Develop test plans for ETL unit testing and integration testing
Implement Data structure, mapping, enrichment etc.
Validate ETL end-to-end solution performance and troubleshoot problems
Experience with ETL tools on AWS  like AWS Glue
Programming skills with Python, Java or Scala and implement on AWS Lambda, Glue
Implement ETL jobs, auto-scaling
Implement Security standards
Work with ETL lead to validate the ETL implementation is as per the design.
Implement data collection methods, data models, types and transformation process.
Implement Data pipeline (ETL tools) development on AWS"

Posted By

Sriram Jaladi

Dice Id : 91115284
Position Id : Sparktek_1
Originally Posted : 5 months ago
Have a Job? Post it