ETL & Data Warehousing Lead

Overview

On Site
Depends on Experience
Contract - W2

Skills

ETL & Data Warehousing
SSIS ETL
SSIS (ETL Tool)
Azure Cloud
ADF
Azure
Agile
SAFe
DevOps
GitHub
Jenkins
Data Warehousing
Data Analysis
Data Profiling
EDW
Azure SQL
Microsoft SSIS & Power BI
Data pipelines

Job Details

Title: ETL & Data Warehousing – Lead

Location: Dallas

Duration: 12 month

 

Qualifications:

  • 15+ years of experience in ETL & Data Warehousing
  • Should have excellent leadership & communication skills
  • Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI
  • Should have worked on data sources such as SAP and Salesforce
  • Should have very good knowledge of SSIS (ETL Tool), Azure Cloud, ADF, Azure Synapse Analytics & Azure Hub Events
  • Should have executed at least 2 Azure Cloud Data Warehousing projects
  • Should have worked at least 4 projects using Agile/SAFe methodology
  • Should have demonstrated working knowledge on ITIL V4 concepts such as Incident Management, Problem Management, Change Management & Knowledge Management
  • Should have working experience on any DevOps tools like GitHub, Jenkins, etc & on semi-structured data formats like JSON, Parquet and/or XML files & written complex SQL queries for data analysis and extraction
  • Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping
  • Should have cross global location experience and led a team of at least 15+ members in a global delivery model
  • Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions

Responsibilities:

  • Lead nearshore and offshore team to do production support of existing EDW, design, build & deploy enhancements and bug fixes to existing EDW
  • Support the existing EDW system built using ADF, Azure SQL, Microsoft SSIS & Power BI
  • Be on call to support job incidents on rotational basis
  • Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations
  • Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge
  • Analyze the different source systems, profile data, understand, document & fix Data Quality issues
  • Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users
  • Write complex SQLs to extract & format source data for ETL/data pipeline
  • Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration
  • Design, Develop and Test ETL/Data pipelines
  • Write Unit Test cases, execute Unit Testing and document Unit Test results
  • Deploy ETL/Data pipelines
  • Use DevOps tools to version, push/pull code and deploy across environments
  • Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests
  • Maintain and improve already existing processes
  • Ensure that the data pipelines are stable, secure, maintainable and highly available