Overview
Skills
Job Details
Azure data factory, ETL pipelines
PySpark based application in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into the customer usage patterns.
Experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL.
External data sources and tables in Azure SQL Database for data visualization and reporting
Automated jobs using different triggers like Events, Schedules and Tumbling in ADF
Developing linked services, datasets, and data pipelines using Azure data factory to Ingest data from source systems to Azure data lake storage (ADLS Gen2)
Orchestrating the data flow from source system (ADLS) to Synapse
CDP
Leading efforts to design data pipelines to build a new Customer Data Platform (CDP) to create unique customer experience targeting and automation.