Overview
Skills
Job Details
We are currently seeking a Data Engineer to be part of the Data Engineering team. This position will design and develop an ingestion process for big data processing.
General Duties/Responsibilities (May include but are not limited to):
Translates business requirements into specifications that will be used to implement the Data ingestion process.
Understands the requirements, development and delivery of data solutions and lead end to end delivery.
Develops and implements data pipelines to support organizational initiatives.
Builds and maintainsto move data from various sources into a usable format.
Implements processes and tools to ensure data accuracy, consistency, and compliance with relevant policies and regulations.
Works closely with,analysts, and other stakeholders to understand their data needs and provide them with the necessary data infrastructure and tools.
Ensures data systems are efficient, scalable, and performant to meet the demands of data-intensive applications.
Creates functional and technical design documents and maintains documentation for all data processes created or modified.
Minimum Requirements:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
Minimum Experience:
5+ years of experience building data ingestion processes and tools.
5+ years of experience with DataBricks, Scala, Azure Data Factory (ADF) and SQL Server.
5+ years database experience with MS SQL Server.
5+ years of experience in healthcare industry with proven understanding of data terminology.
Healthcare experience and clear understanding and working knowledge of HIPAA protocols.
Experience with Microsoft s Power-BI/SSRS/SSAS/Azure Data Factory and other cloud based BI and reporting services is a plus.