Requisition Title : Sr. ETL Consultant (ADF)
City :Palo Alto
State : California
Job Type : H1B / EAD / GC-EAD / USC (6-9 Months)
Total Experience : 7+yrs Must have hands on experience in Azure Data Factory.
End to end implementation experience in data analytics solutions (data ingestion, processing, provisioning and visualization) for large-scale and complex environments.
Strong experience in Azure ecosystem such as HDInsight, Azure Data Factory, Azure Data Lake and SQL DW.
Hands-on-experience developing enterprise solutions using designing and building frameworks, enterprise patterns, database design and development.
o End to end Cloud solution on Azure (Azure SQL DW, Azure Data factory, HDInsight, Cosmos DB, PostgreSQL, SQL on Azure).
o Batch solution and distributed computing using ETL/ELT (SSIS/Informatica/Talend/Spark SQL/Spark Data frame/AWS Glue/ADF).
o Distributed compute solution (Spark).
o Distributed storage and NoSQL storage.
o Languages (Spark, Scala).
o DW-BI (MSBI, Oracle, Sql Server), Data modelling, performance tuning, memory optimization/DB partitioning.
o Frameworks, reusable components, accelerators, CI/CD automation.
o Data governance, Erwin, Metadata manager.
Proficiency in data modelling, for both structured and unstructured data, for various layers of storage.
Strong hands on knowledge on Python.
Mentor and lead a data engineering teams to design, develop, test and deploy high performance data analytics solutions.
Collaborate with Scrum Master and PMO to organize deliverable into phases and sprints; drive estimation and sizing, contribute actively to planning and scheduling the solution implementation.
Ability to mentor development and testing teams, agile estimations and engagement in daily Scrum activities.
Thanks & Regards,
Talent Acquisition - North America