Overview
Skills
Job Details
Role: Data Governance Platform Engineer / Solution Architect
Location: New York, NY (3 days Office) Locals
Duration: Long-term
Mode of Interview: Virtual & Final In-person
Must Have: Finance domain experience
Role Summary
We're seeking a seasoned Platform Engineer / Solution Architect to lead the end-to-end implementation and adoption of a modern data catalog and metadata platform, such as Atlan or Alation. You will architect the solution, integrate it with our data ecosystem (warehouses, pipelines, BI, ML), operationalize metadata ingestion and lineage, drive governance and security, and enable organization-wide adoption through automation, training, and change management.
This role blends deep technical engineering and pragmatic architecture with product-minded thinking and stakeholder leadership.
Key Outcomes (First 12 Months)
- Production-grade catalog platform deployed (SaaS or self-managed) with SSO, RBAC, and secure network patterns.
- Automated metadata ingestion for priority sources (e.g., SQL Server, Snowflake, Databricks).
- End-to-end lineage capability operationalized across application data pipelines and BI reporting tools.
- Capability to build a business glossary, stewardship workflows, and metadata templates for critical domains.
- CI/CD for connectors, policies, and configuration as code.
- Capability to monitor adoption metrics implemented (active users, curated assets, coverage, search-to-click, trust flags).
Responsibilities
- Experience: 7+ years in data/platform engineering or solution architecture; 3+ years implementing data catalog/metadata platforms (e.g., Atlan, Alation), including connectors, lineage, governance workflows, and adoption.
- Data Stack & Integration: Proficiency with warehouses/lakes (Snowflake, Databricks), databases (SQL Server), pipelines (ADF, SSIS), BI (Power BI), and APIs.
- Programming: Strong SQL and Python; scripting and automation for ingestion/enrichment; familiarity with SDKs/APIs.
- Governance & Metadata: Business glossary/taxonomy, ownership/stewardship models, policy workflows; metadata modeling and enrichment.
- DevOps/IaC: Terraform, configuration-as-code, CI/CD (GitHub Actions/GitLab CI/Azure DevOps), platform monitoring and incident response.
- Soft Skills: Excellent communication, stakeholder management, and product mindset to translate governance into practical solutions.
Qualifications
- Catalog implementation expertise (Atlan/Alation): Environment design (prod/non-prod), metadata model/glossary/taxonomy, custom metadata templates, lineage capture, and custom enrichment pipelines/processors.
- Integration & connectors: Metadata ingestion from data platforms (Snowflake, Databricks, SQL Server); pipelines (ADF, SSIS); BI tools (Tableau, Power BI).
- Lineage & observability: setup and integration; alerting, and incident response; monitoring.
- Data governance & policy enforcement: operationalise via catalogue workflows, approvals, stewardship assignments, and role-based access (RBAC/ABAC).
- Security & compliance: SSO with SAML/OIDC, user provisioning, data masking policies, audit logging and evidence collection.
- Change Management: process implementation for DEV, QA, UA, PROD environments.
- Reliability & performance: Capacity planning, scaling ingest jobs, tuning crawlers, search/index performance, and backup/restore and disaster recovery for catalog components.
Soft Skills
- Exceptional communication and stakeholder management across engineering, analytics, and business.
- Ability to translate governance requirements into pragmatic technical solutions.
- Product mindset: iterate with feedback, measure adoption, and drive value.