Job Title/Role: Azure Data Lead
Job Location/Client Location (with City & State): Fremont, CA – Onsite
Remote ok (Yes / No) No
W2 Contract Role
JD:
1. 10 + years of proven experience with ETL/ELT( Structure & unStructure , API's), SQL, PySpark, schema design and dimensional data modelling, medallion architecture
2. Solid knowledge of data warehouse best practices, development standards and methodologies
3. Strong experience with big data tools(Databricks , Spark ) and programming skills in PySpark and Spark SQL.
4. Be an independent self-learner with "let's get this done" approach and ability to work in Fast paced and Dynamic environment.
Job Summary
The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices.
Key Responsibilities
1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.
3. Design and develop etl processes, data models, and data integration solutions.
4. Provide technical guidance and mentorship to the team members.
5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.
6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.
7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.
Skill Requirements:
1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.
2. Strong experience with sql and oracle pl/sql for data querying and manipulation.
3. Advanced programming skills in python for scripting and data processing tasks.
4. Knowledge of data modeling, data warehousing concepts, and database design principles.
5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
6. Strong analytical and problem-solving skills with attention to detail.
7. Experience in data visualization tools and techniques is a plus.
Other Requirements
1.Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.
