Azure Data/Data Platform Engineer

Summary
Somebody who worked hands-on in Azure Data Factory, Synapse, SQL Managed Instances building pipelines and has brought data from source systems and traditional on-prem/EDW Enterprise Data Warehouse.

• Heavy in Data Engineering skills along with someone who can improve overall report performance with ETL performance testing using tools like JMeter, Spark UI + Ganglia
• Definitely needs to be hands on, not leadership- need to be strong individual contributor.
• Use of Azure Cloud Native Performance Testing Tool.

In this role, you will:

• Work directly with business users to understand data requirements, and develop, deliver, and maintain appropriate data solutions.
• Lead a team of data engineering developers to implement Azure Data Lake based ETL/ELT/data pipelines, data extracts, and API based data delivery.
• Ensure continued legacy EDW development and operations utilizing Microsoft SQL Server, SSIS, SSRS, SSAS, PowerShell, and related technologies.
• Drive migration of legacy EDW platform data workloads to the new Azure Cloud Data Lake platform.
• Define ETL performance testing scope, benchmark workloads against legacy EDW baselines, validate SLA-compliant data loads, and optimize throughput to ensure scalable cloud performance.
• Work with IT infrastructure, DevOps, Data Engineers, Modelers, Architects, to optimize pipelines, in test environment, test design, test execution, resolve issues, perform optimization and tuning.
• Support the design and implementation of data models and data pipelines for relational, dimensional, data Lakehouse (Medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
• Utilize Microsoft Azure services including Azure Data Lake Storage Gen2, Azure SQL Managed Instance, Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures and Azure OpenAI to develop cloud native data solutions.
• Prepare data required for advanced analytics, visualization, reporting, data extracts, and AI/ML.
• Develop and implement processes, procedures, checklists to guide development and operations of the legacy EDW platform and modernized Azure platform.
• Implement data migration, data integrity, data quality, metadata management, performance management, audit data capture, and data security functions.
• Monitor and troubleshoot data related issues to maintain high availability and performance.
• Implement governance, build, deployment and monitoring to automate platform operation.
• Actively support Agile DevOps process, including Program Increment planning.
• Actively engage in continuous learning to increase relevant skills.
• Maintain strict versioning and configuration control to ensure integrity of data.

For this position, you must possess:

• At least a BS degree in Computer Science or related field and 9+ years experience.
• 5+ years of proven experience leading a team supporting enterprise data warehousing using Microsoft data warehousing and reporting solutions.
• 5+ years of experience working directly with clients to understand data needs, develop and deliver solutions (data engineering, reports, dashboards, data extracts), and provide continued support.
• 5+ years of strong experience in ETL performance testing for traditional EDW and Azure Cloud Data platforms with the use of tools such as JMeter, Native Azure Tools like Azure App Testing, Azure Monitor + Log Analytics, Spark UI + Ganglia for Lakehouse Performance.
• 5+ years of experience delivering solutions using Microsoft database, ETL/ELT, and business intelligence tools, including SQL Server (e.g. stored procedures), SSIS, SSRS, SSAS, (cubes).
• 5+ years of experience with more than one of the following scripting languages: SQL, T-SQL, Python, PySpark, PowerShell.
• 3+ years of experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime.
• Experience with data management and engineering best practices, including system development lifecycle, configuration control, change management, quality assurance, performance management, documentation support.
• Experience in Agile projects, working with a multi-functional team.
• Must be detail oriented, and able to support multiple projects and tasks.
• Demonstrate continuous learning to increase relevant skills.
• Demonstrated experience in supporting production, testing, integration, and development environments.
• Open mindset, ability to quickly adapt new technologies to solve customer problems.
• ship and ability to successfully obtain government-issued Public Trust clearance.

Not required, but additional education, certifications, and/or experience are a plus:

• Experience working with data in law, HR, financial management, inventory, property, and management domains.
• Experience working on Federal government projects with at least active Public Trust Clearance
• Experience working with Azure DevOps.

Microsoft certification in Azure fundamentals, data engineering, AI, data analytics. solution

Navnish kumar

Sr. IT Technical Recruiter

Stellent IT Phone:

Email: navnish
Gtalk: navnishom