Lead Azure Data Developer/ Architect-Full time-Hybrid

Hybrid in Pittsburgh, PA, US • Posted 15 hours ago • Updated 15 hours ago
Full Time
No Travel Required
Hybrid
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Data Engineering
  • ADF
  • ELT
  • PySpark
  • Python

Summary

We are looking for an experienced Lead Azure Data Engineer to design, develop, and manage scalable data pipelines and data platforms on the Azure cloud. The ideal candidate will have strong expertise in Azure Data Factory, Azure Synapse, Databricks, PySpark/Python, and SQL, with the ability to lead data engineering initiatives and mentor team members.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Azure Data Factory and Azure Databricks.

  • Build and optimize data warehouse solutions using Azure Synapse Analytics.

  • Develop and maintain PySpark/Python-based data processing pipelines for large-scale data transformations.

  • Create and maintain Source-to-Target Mapping (STTM) and technical design documents.

  • Implement data ingestion, transformation, and integration from multiple data sources.

  • Optimize SQL queries and data models for improved performance and scalability.

  • Ensure data quality, governance, and security across the data platform.

  • Collaborate with business stakeholders, architects, and development teams to translate business requirements into technical solutions.

  • Mentor and guide junior data engineers and review code to maintain best practices.

  • Support deployment and monitoring of data pipelines in production environments.

Required Skills

  • 12+ years of experience in Data Engineering, Data Warehousing, and ETL development.

  • Strong hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Databricks.

  • Expertise in PySpark/Python and advanced SQL for data transformation and analytics.

  • Experience in data modeling, data lake architectures, and ETL/ELT frameworks.

  • Ability to create technical documentation, STTM, and solution design documents.

  • Experience working in Agile development environments.

  • Strong analytical, problem-solving, and leadership skills.

Nice to Have

  • Azure certifications such as Azure Data Engineer Associate.

  • Experience in Banking/Financial services domain (Risk & Regulatory, Credit Cards, Retail Banking).

  • Knowledge of CI/CD pipelines, DevOps practices, and data governance tools.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91020323
  • Position Id: 8905788
  • Posted 15 hours ago

Company Info

About Visionary Innovative Technology Solutions

VITS provide staffing and recruitment services along with technology consulting to more than 50+ clients globally Our skilled & expertise professionals help clients to manage varying skill needs, skills gaps and changing staffing needs to encounter project deadlines. VITS staff augmentation services provide skilled resources which assist clients to develop, maintain, manage and support their applications. Our vigorous pursuit for excellence in hiring, delivery model, work ethics, and approach has enabled us to become a highly trusted & preferred recruitment solution provider.



Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Herndon, Virginia

3d ago

Easy Apply

Full-time

Depends on Experience

Hybrid in New York, New York

Today

Easy Apply

Full-time

Depends on Experience

Hybrid in Dallas, Texas

Today

Easy Apply

Full-time

Depends on Experience

Search all similar jobs