Technical Lead Cloud Data Engineering

title: Technical Lead Cloud Data Engineering.
Location: This is a fully remote, teleworking position with potential travel to the Washington D.C. metro area on special occasions.
Duration: 6 months, extension.

Job Description:
seeking a seeking a customer experience focused Technical Lead Cloud Data Engineering to lead a team of developers in, Design and implementation of data engineering solutions for Azure Cloud based Data Lake, SQL, and NoSQL data stores. As a technical lead, you will work directly with end users to translate business requirements into cloud data engineering to support an enterprise scale Microsoft Azure based data analytics and reporting platform. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking, including the use of AI concepts, to create innovative functions and solve technical issues.

In this role, you will:
Work directly with business users to understand data requirements, and develop, deliver, and maintain appropriate data solutions.
Lead a team of data engineering developers to implement Azure Data Lake based ETL/ELT/data pipelines, data extracts, and API based data delivery.
Ensure continued legacy EDW development and operations utilizing Microsoft SQL Server, SSIS, SSRS, SSAS, PowerShell, and related technologies.
Drive migration of legacy EDW platform data workloads to the new Azure Cloud Data Lake platform.
Define ETL performance testing scope, benchmark workloads against legacy EDW baselines, validate SLA-compliant data loads, and optimize throughput to ensure scalable cloud performance.
Work with IT infrastructure, DevOps, Data Engineers, Modelers, Architects, to optimize pipelines, in test environment, test design, test execution, resolve issues, perform optimization and tuning.
Support the design and implementation of data models and data pipelines for relational, dimensional, data Lakehouse (Medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
Utilize Microsoft Azure services including Azure Data Lake Storage Gen2, Azure SQL Managed Instance, Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures and Azure OpenAI to develop cloud native data solutions.
Prepare data required for advanced analytics, visualization, reporting, data extracts, and AI/ML.
Develop and implement processes, procedures, checklists to guide development and operations of the legacy EDW platform and modernized Azure platform.
Implement data migration, data integrity, data quality, metadata management, performance management, audit data capture, and data security functions.
Monitor and troubleshoot data related issues to maintain high availability and performance.
Implement governance, build, deployment and monitoring to automate platform operation.
Actively support Agile DevOps process, including Program Increment planning.
Actively engage in continuous learning to increase relevant skills.
Maintain strict versioning and configuration control to ensure integrity of data.

For this position, you must possess:
At least a BS degree in Computer Science or related field and 9+ years experience.
5+ years of proven experience leading a team supporting enterprise data warehousing using Microsoft data warehousing and reporting solutions.
5+ years of experience working directly with clients to understand data needs, develop and deliver solutions (data engineering, reports, dashboards, data extracts), and provide continued support.
5+ years of strong experience in ETL performance testing for traditional EDW and Azure Cloud Data platforms with the use of tools such as JMeter, Native Azure Tools like Azure App Testing, Azure Monitor + Log Analytics, Spark UI + Ganglia for Lakehouse Performance.
5+ years of experience delivering solutions using Microsoft database, ETL/ELT, and business intelligence tools, including SQL Server (e.g. stored procedures), SSIS, SSRS, SSAS, (cubes).
5+ years of experience with more than one of the following scripting languages: SQL, T-SQL, Python, PySpark, PowerShell.
3+ years of experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime.
Experience with data management and engineering best practices, including system development lifecycle, configuration control, change management, quality assurance, performance management, documentation support.
Experience in Agile projects, working with a multi-functional team.
Must be detail oriented, and able to support multiple projects and tasks.
Demonstrate continuous learning to increase relevant skills.
Demonstrated experience in supporting production, testing, integration, and development environments.
Open mindset, ability to quickly adapt new technologies to solve customer problems.

Not required, but additional education, certifications, and/or experience are a plus:
Experience working with data in law, HR, financial management, inventory, property, and management domains.
Experience working on Federal government projects with at least active Public Trust Clearance
Experience working with Azure DevOps.
Microsoft certification in Azure fundamentals, data engineering, AI, data analytics.
solutions.