Platform Engineer/Solution Architect

Overview

On Site
Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)
No Travel Required
Unable to Provide Sponsorship

Skills

Data Link Layer
Continuous Delivery
Database
GitLab
Incident Management
Databricks
DevOps
Disaster Recovery
Continuous Integration
Data Governance
Data Masking
Capacity Management
Change Management
Communication
GitHub
ADF
Machine Learning (ML)
Meta-data Management
Auditing
Backup
Microsoft Azure
Business Intelligence
Python
Quality Assurance
Physical Layer
Process Management
Provisioning
Microsoft SQL Server
Microsoft SSIS
Stakeholder Management
Snow Flake Schema
SaaS
Scripting
Regulatory Compliance
Reporting
SQL
SSO
Network
OIDC
Leadership
Metadata Modeling
Microsoft Power BI
RADIUS
RBAC
Recovery
SAML
Search Engines
Soft Skills
Solution Architecture
Tableau
Taxonomy
Terraform
Training
Workflow

Job Details

  • Role : Platform Engineer/Solution Architect
    Location: New York City, NY (Need Local)
    Duration: 12+ Months
    MOI : Telephonic & Skype


Primary Skills: SNOWFLAKE, DATABRICKS, Atlan/Alation, SQL Server, Strong SQL , and Python.

Need H1-B, L1-B, L2-EAD & Citizens Only with a Minimum of 12 Years of Experience. This is Onsite/Hybrid and needs local candidates or within a 50-mile Radius.

Role Summary:
We’re seeking a seasoned Platform Engineer / Solution Architect to lead the end-to-end implementation and adoption of a modern data catalog and metadata platform, such as Atlan or Alation. You will architect the solution, integrate it with our data ecosystem (warehouses, pipelines, BI, ML), operationalize metadata ingestion and lineage, drive governance and security, and enable organization-wide adoption through automation, training, and change management.
This role blends deep technical engineering and pragmatic architecture with product-minded thinking and stakeholder leadership.

Key Outcomes (First 12 Months):
§ Production-grade catalog platform deployed (SaaS or self-managed) with SSO, RBAC, and secure network patterns.
§ Automated metadata ingestion for priority sources (e.g., SQL Server, Snowflake, Databricks).
§ End-to-end lineage capability operationalized across application data pipelines and BI reporting tools.
§ Capability to build a business glossary, stewardship workflows, and metadata templates for critical domains.
§ CI/CD for connectors, policies, and configuration as code.
§ Capability to monitor adoption metrics implemented (active users, curated assets, coverage, search-to-click, trust flags)

Responsibilities:
§ Experience: 7+ years in data/platform engineering or solution architecture; 3+ years implementing data catalog/metadata platforms (e.g., Atlan, Alation), including connectors, lineage, governance workflows, and adoption.
§ Data Stack & Integration: Proficiency with warehouses/lakes (Snowflake, Databricks), databases (SQL Server), pipelines (ADF, SSIS), BI (Power BI), and APIs.
§ Programming: Strong SQL and Python; scripting and automation for ingestion/enrichment; familiarity with SDKs/APIs.
§ Governance & Metadata: Business glossary/taxonomy, ownership/stewardship models, policy workflows; metadata modeling and enrichment.
§ DevOps/IaC: Terraform, configuration-as-code, CI/CD (GitHub Actions/GitLab CI/Azure DevOps), platform monitoring and incident response.
§ Soft Skills: Excellent communication, stakeholder management, and product mindset to translate governance into practical solutions.

Qualifications:
§ Catalog implementation expertise (Atlan/Alation): Environment design (prod/non-prod), metadata model/glossary/taxonomy, custom metadata templates, lineage capture, and custom enrichment pipelines/processors.
§ Integration & connectors: Metadata ingestion from data platforms (Snowflake, Databricks, SQL Server); pipelines (ADF, SSIS); BI tools (Tableau, Power BI).
§ Lineage & observability: setup and integration; alerting, and incident response; monitoring
§ Data governance & policy enforcement: operationalize via catalog workflows, approvals, stewardship assignments, and role-based access (RBAC/ABAC).
§ Security & compliance: SSO with SAML/OIDC, user provisioning, data masking policies, audit logging, and evidence collection.
§ Change Management: process implementation for DEV, QA, UA, PROD environments
§ Reliability & performance: Capacity planning, scaling ingest jobs, tuning crawlers, search/index performance, and backup/restore and disaster recovery for catalog components.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Source Code Technologies LLC