Sr. Data Engineer/Data Architect (100% Remote)

Overview

Seeking an experienced Senior Cloud Data Engineer to support the Department of Veterans Affairs (VA) Data Modernization initiative. This role focuses on providing the necessary subject matter expertise to design, provision, and automate cloud-based data workspaces. The ideal candidate is an expert in modern cloud tools, Databricks, VHA Data Lake integrations, and automated workspace creation.

Responsibilities

• Create cloud workspaces equipped with the most commonly used tools to ensure rapid assignment and reduced onboarding friction.
• Lead migration efforts from on-premises infrastructure to cloud-based solutions.
• Develop and maintain documentation for network designs, policies, and procedures.
• Automate provisioning processes for user intake, workspace creation, and core data access.
• Lead teams of data platform engineers, security teams, and analytics stakeholders to ensure compliant and efficient workspace operations.
• Map new users to the appropriate workspace personas and configurations.
• Build and configure workspaces in PreProd (with live data) or Prod environments, including setup of Service Principals, workgroup personas, access controls, and security configurations.
• Create and manage linked services, mount points, and integrations between Databricks and the VHA Data Lake.
• Develop and maintain Databricks catalogs to support streamlined data discovery and governed access.
• Troubleshoot issues related to cloud provisioning, access, and workspace functionality, delivering timely and high‑quality support.
• Contribute to continuous improvement initiatives including automation enhancement, intake optimization, and workspace standardization.
• Document processes, SOPs, access models, and configurations to support operational transparency and repeatability.
• Provide white‑glove support to new and existing users, ensuring strong adoption and high user satisfaction.

Qualifications

 Required Skills and Experience:

• Bachelor’s degree plus 12 years experience in Information Technology, Engineering, or a related field. (or commensurate experience) 
• Strong analytical, problem-solving, and communication skills. 
• Expertise with Azure or other major cloud platforms.
• Experience in both Azure services MAG and MAC
• Certifications: Databricks Certified, Azure Data Engineer, AZ900 - Azure fundamentals
• Experience with SQL Server/SQL Server Admin, Azure, ETL, Relational Databases, AWS Cloud Platforms, ADF, Python, Spark SQL, Synapse, Azure Storage, Azure Eventhub, Azure Logic Apps, Database Design, Sharepoint, Power BI.
• Experience with Databricks workspace administration, catalog creation, mount configurations, and cluster setup.
• Strong knowledge and experience with data lake architectures, especially Delta Lake or similar structured storage solutions.

Preferred Skills and Experience:

• Expertise with Azure or other major cloud platforms.
• Certifications: Databricks Certified, Azure Data Engineer, AZ900 - Azure fundamentals
• Experience with SQL Server/SQL Server Admin, Azure, ETL, Relational Databases, AWS Cloud Platforms, ADF, Python, Spark SQL, Synapse, Azure Storage, Azure Eventhub, Azure Logic Apps, Database Design, Sharepoint, Power BI.
• Experience with Databricks workspace administration, catalog creation, mount configurations, and cluster setup.
• Familiarity with cloud identity and access management (IAM), including Service Principals, role-based access control (RBAC), and persona‑based configurations.
• Strong knowledge and experience with data lake architectures, especially Delta Lake or similar structured storage solutions.
• Experience automating cloud provisioning workflows (e.g., Terraform, ARM, Bicep, PowerShell, Python).
• Ability to collaborate with cross-functional engineering and business teams.
• Strong documentation practices and experience building standard operating procedures.
• Experience supporting public sector or healthcare data environments is a plus.