Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
Amazon Redshift
Amazon S3
Amazon Web Services
Analytical Skill
Analytics
Cloud Computing
Collaboration
Data Governance
Data Lake
Data Management
Data Security
Decision Support
IT Management
Identity Management
Meta-data Management
Microsoft Azure
Microsoft SQL Server
MySQL
Python
R
Reporting
Security Controls
Use Cases
Lake House
Security
Governance
Job Details
Beacon Systems, Inc, delivers Program Management, Science, Engineering, and Technology Solutions to Federal, Commercial State, and Local Agencies. We are a subsidiary of Radiant Digital Solutions. Our Technology support to many DoD Agencies, NASA, Voice of America, FDA, and State Agencies such as State of FL, RI, MS, ND, VA, and WV extends our delivery of solutions worldwide.
We are looking for an Azure Data Lakehouse Data Governance Architect - Montpelier, VT
Request you to make sure your updated Resume highlights all the below-mentioned required Skills & Experience.
Job Title: Azure Data Lakehouse Data Governance Architect
Location: Montpelier, VT
Duration: Long term
Job Description:
Implement a Data Lakehouse in the AWS Commercial environment as a template solution that will serve as the model for the next generation of data platform. This work builds upon existing templates previously deployed in AWS GovCloud for the Department of Public Safety, with adjustments to leverage features available in the commercial environment.
Roles and Responsibilities:
- Design and implement a data lake in AWS compliant with requirements and best practices for protecting sensitive data, including health data, in collaboration with the Technical Lead, using the latest Lakehouse standards.
- Ensure the lakehouse is designed for maintainability, enhancement, and expansion by the State.
- Build the solution using templates that enable refinement and reuse across other data domains.
- Implement a medallion architecture with scalable layers to support tuning for performance and cost.
- Prioritize the use of Python-based solutions while also supporting R and other data management languages.
- Ensure data ingestion is read-only and used solely for reporting and analytical purposes not for mission-critical operational decision support or control system automation.
Data Security Layer Responsibilities:
- Design and implement Identity and Access Management (IAM) roles and processes.
- Develop flexible data governance processes that accommodate evolving security requirements and use cases.
- Create technical templates to enforce security controls.
- Adapt existing CJIS-compliant templates for use in commercial cloud environments, ensuring alignment with other data standards.
Data Catalog Layer Responsibilities:
- Design and implement solutions for data governance and cataloging using AWS Glue and other recommended technologies.
- Address schema drift issues across data layers to support reporting and analytics.
- Design and implement crawlers and catalogs to store and maintain schema information.
- Leverage the metadata catalog to control access and drive processing logic across solution components.
- Develop reusable crawler templates for various data sources.
Skills Required:
- Azure Data Lakehouse
- Azure Governance
- AWS GovCloud
- AWS S3, Redshift, Glue, Lake Formation
- Data ETL
- Scripting Languages: Python, R
- Databases: MySQL, SQL Server.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.