ADLS Gen2 Engineer / Architect.

New York, NY, US • Posted 9 hours ago • Updated 9 hours ago
Contract Independent
Contract W2
Contract Corp To Corp
12 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • ADLS Gen2 Engineer / Architect
  • cloud data architecture

Summary

Hi  ,
 
 

We have a job opening for the position of ADLS Gen2 Engineer / Architect.

 Please find the job description below and if you are interested, kindly share your updated resume with contact details...

 

Job Title:           ADLS Gen2 Engineer / Architect 

Location:           New York / New Jersey

Duration :         Long Term

 

ADLS:

Role overview

We are looking for an experienced ADLS Gen2 Engineer / Architect to design, build, and govern our cloud data lake on Microsoft Azure. You will define the storage architecture, security model, and ingestion patterns that underpin our analytics, reporting, and data science platforms. The role combines hands-on engineering with architectural ownership, and you will work closely with data engineers, analysts, security, and platform teams.

Key responsibilities

Architecture and design

  • Design the end-to-end ADLS Gen2 architecture, including storage accounts, containers, hierarchical namespace layout, and zone structure (e.g. raw/bronze, curated/silver, consumption/gold).
  • Define standards for folder structure, file formats (Parquet, Delta, Avro), partitioning, and naming conventions.
  • Develop a lakehouse strategy and reference architectures that integrate ADLS Gen2 with Snowflake.
  • Produce high-level and low-level design documents and run architecture reviews.

Engineering and delivery

  • Build and maintain scalable batch and streaming ingestion pipelines into the lake (ADF, Databricks, Synapse Pipelines, Event Hubs, Kafka).
  • Implement data lifecycle management, including tiering (hot/cool/archive), retention, and cost-optimisation policies.
  • Automate infrastructure provisioning using Infrastructure as Code (Terraform, Bicep, or ARM) and CI/CD pipelines (Azure DevOps or GitHub Actions).
  • Optimize performance, including file sizing, small-file compaction, partition pruning, and throughput tuning.

Security and governance

  • Design and implement the access control model using Azure RBAC, POSIX-style ACLs, managed identities, and Microsoft Entra ID groups.
  • Configure network security, including private endpoints, firewalls, VNet integration, and encryption at rest and in transit (including customer-managed keys).
  • Partner with governance teams to implement cataloguing, lineage, and classification (e.g. Microsoft Purview).
  • Ensure compliance with relevant regulatory and data protection requirements (e.g. GDPR).

Operations and reliability

  • Define monitoring, alerting, and logging using Azure Monitor and Log Analytics.
  • Design backup, disaster recovery, and replication strategies (LRS/ZRS/GRS/RA-GRS, soft delete, versioning, snapshots).
  • Manage storage costs and report on usage and capacity.

Leadership and collaboration

  • Act as the subject matter expert on ADLS Gen2 and mentor engineers on best practice.
  • Translate business and analytics requirements into technical solutions.
  • Evaluate new Azure storage and data platform features and recommend adoption where appropriate.

Required qualifications

  • 5+ years of experience in data engineering or cloud data architecture, with at least 2–3 years of hands-on ADLS Gen2 experience.
  • Deep understanding of ADLS Gen2 features: hierarchical namespace, ACLs vs RBAC, access tiers, lifecycle policies, and the ABFS driver.
  • Proficiency in Python and/or PySpark, and advanced SQL.
  • Experience with data lake and lakehouse design patterns (medallion architecture, Delta Lake).
  • Experience with Infrastructure as Code and CI/CD.
  • Solid grounding in cloud security, networking, and identity management on Azure.

Preferred qualifications

  • Microsoft certifications such as Azure Data Engineer Associate (DP-203), Azure Solutions Architect Expert (AZ-305), or Fabric Analytics Engineer.
  • Experience with Microsoft Purview, Unity Catalog, or similar governance tools.
  • Experience migrating from on-premises Hadoop/HDFS or other cloud storage to ADLS Gen2.
  • Familiarity with data mesh or data product approaches.
  • Experience with FinOps practices for cloud storage and compute.
  • Background in a regulated industry such as financial services or healthcare.

Key competencies

  • Strong architectural judgement and the ability to balance trade-offs among cost, performance, security, and simplicity.
  • Clear written and verbal communication, including the ability to explain technical concepts to non-technical stakeholders.
  • A pragmatic, delivery-focused approach with attention to documentation and standards.
  • Comfort working across multiple teams and influencing without direct authority.
 
 

Thanks & Regards,

Subash – US IT Consulting

Ph: / Email: @blockedge.io
Blockedge Technologies Inc
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91172365
  • Position Id: 9147398
  • Posted 9 hours ago
Contact the job poster
SC

Subash Chandra Bose

Recruiter @ Healthcare Triangle Inc

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.