Overview
Remote
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
data pipeline
Job Details
Job Title: AWS Databricks Engineer
Job Location: Remote
Duration: 12 Months Contract / Full Time
RESPONSIBILITIES
Designing and implementing data ingestion pipelines from multiple sources using AWS Databricks
Developing scalable and re-usable frameworks for ingesting of data sets
Integrating the end to end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Working with event based / streaming technologies to ingest and process data
Working with other members of the project team to support delivery of additional project components (API interfaces, Search)