Role Name: Sr. Data Architect
Location: New York, NY (Onsite)
Duration: 12 Months
Key responsibilities:
Architecture & Platform Engineering
1.Develop end to end architectural patterns leveraging Databricks, Spark, Delta Lake, Unity catalog and Azure Data services
2.Design scalable Lakehouse foundations, ensuring performance, reliability, and maintainability of data layers.
3.Establish architectural frameworks and standards for ingestion, curation, storage, and consumption.
4.Experience in building a data platform with unity catalog and design the multi-tenant solution with data governance principles.
Collaboration & Leadership
5.Serve as a primary technical advisor for engineering teams, analysts, and data science partners.
6.Participate in planning ceremonies, architectural councils, and cross-functional strategy discussions.
Platform Innovation & Best Practices
7.Continuously evaluate emerging tools, Databricks capabilities, and Azure offerings to enhance platform maturity.
8.Maintain and refine coding conventions, DevOps standards, and operational playbooks.
9.Drive automation across deployment processes using Azure DevOps, or equivalent CI/CD toolchains.
Skills:
1.Bachelor’s degree in Computer Science, Engineering, or related discipline.
2.10 to 15+ years of experience in data engineering and/or data architecture roles.
3.Advanced hands-on experience with Databricks, Apache Spark, and the Azure data stack.
4.Strong practical knowledge of Lakehouse patterns, Delta Lake, and modern data warehousing.
5.Demonstrated background designing resilient ETL/ELT systems with both batch and streaming patterns.
6.Proficiency with SQL data stores, schema design, and performance optimization.
7.Experience working with structured and semi-structured formats such as Parquet, ORC, and JSON.
8.Solid understanding of cloud security, access governance, and metadata/catalog strategies (e.g., Unity Catalog).
9.Experience implementing automated build/deploy workflows for data solutions.
10.Excellent analytical, problem-solving, and communication skills.
Preferred Skills
11.Hands-on experience with data lineage tools, or governance frameworks.
12.Exposure to domain-driven design or product-oriented data architecture.
Best Regards,
Chetna
Truth Lies in Heart