Remote
•
Yesterday
About the job Project Description: Migration of legacy data ingestion pipelines to a shared data management system (BDMS). The work will involve: - Datasets will be loaded into BDMD - New tools will be created to allow data analysts to modify the datasets - Analysts will validate and cleanse the data which will then be delivered to AWS S3 - Data will then be enriched using technologies like Databricks, AWS Lambda & Step Functions and Jupyter Notebooks/Workflows and loaded in Delta tables. - 5+
Easy Apply
Full-time
$100,000 - $135,000