Overview
On Site
$80 - $85
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required
Skills
SQL
ETL
Pipeline
Bricks
lake
Job Details
Job Title: Sr Lead Data Engineer
Location: San Jose, CA (Onsite) Need only locals
Duration: Long term contract
Educational Qualification*
Bachelor s degree in Computer Science, Information Systems, or a related field.
Experience Range
12-15 years
Primary (Must have skills)* - To be Screened by TA Team
5+ years of experience in data engineering and data platform development.
5+ years of experience contributing enterprise data projects involving Azure-based ETL solutions.
5+ years of experience with Databricks & SQL
5+ years of in building ETL pipelines using Azure Data Factory
5+ years of experience contributing enterprise data projects involving Azure-based ETL solutions.
5+ years of experience with Databricks & SQL
5+ years of in building ETL pipelines using Azure Data Factory
Job Description of Role* (RNR) - To be Evaluated by Technical Panel (Define it to give more clarity)
Key Responsibilities:
1. Lead the design and implementation of ETL solutions using SAP Data Services and Azure Data Factory.
2. Leverage Fivetran for automated data ingestion from SAP S4 source systems into the Bronze layer.
3. Analyze and migrate stored procedures from SAP HANA using SQL / PL/SQL to Databricks-based logic.
4. Guide and mentor team members on data engineering best practices.
5. Develop and maintain complex ETL pipelines using Python
6. Identify and resolve performance bottlenecks and network-related issues.
7. Ensure adherence to data governance and compliance standards across all data flows.
8. Participate in performance tuning, issue resolution, and data validation tasks.
9. Document data flows, pipeline logic, and lineage as part of project delivery.
Experience Required:
Minimum of 8 years of experience in data engineering and architecture roles.
Must have led 3 or more end-to-end enterprise data projects using Databricks, and Azure technologies.
1. Lead the design and implementation of ETL solutions using SAP Data Services and Azure Data Factory.
2. Leverage Fivetran for automated data ingestion from SAP S4 source systems into the Bronze layer.
3. Analyze and migrate stored procedures from SAP HANA using SQL / PL/SQL to Databricks-based logic.
4. Guide and mentor team members on data engineering best practices.
5. Develop and maintain complex ETL pipelines using Python
6. Identify and resolve performance bottlenecks and network-related issues.
7. Ensure adherence to data governance and compliance standards across all data flows.
8. Participate in performance tuning, issue resolution, and data validation tasks.
9. Document data flows, pipeline logic, and lineage as part of project delivery.
Experience Required:
Minimum of 8 years of experience in data engineering and architecture roles.
Must have led 3 or more end-to-end enterprise data projects using Databricks, and Azure technologies.
Soft skills/other skills - To be Evaluated by Hiring Manager (To define how this will be evaluated)
Communication Skills:
Communicate effectively with internal and customer stakeholders
Communication approach: verbal, emails and instant messages
Interpersonal Skills:
Strong interpersonal skills to build and maintain productive relationships with team members
Provide constructive feedback during code reviews and be open to receiving feedback on your own code.
Problem-Solving and Analytical Thinking:
Capability to troubleshoot and resolve issues efficiently.
Analytical mindset
Task/ Work Updates
Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps
Provides regular updates, proactive and due diligent to carry out responsibilities
Communicate effectively with internal and customer stakeholders
Communication approach: verbal, emails and instant messages
Interpersonal Skills:
Strong interpersonal skills to build and maintain productive relationships with team members
Provide constructive feedback during code reviews and be open to receiving feedback on your own code.
Problem-Solving and Analytical Thinking:
Capability to troubleshoot and resolve issues efficiently.
Analytical mindset
Task/ Work Updates
Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps
Provides regular updates, proactive and due diligent to carry out responsibilities
Expected Outcome
Successfully lead the design, development, and execution of scalable data engineering solutions and migration strategies. Ensure seamless data movement from legacy systems to modern platforms with minimal downtime and data integrity. Deliver optimized data pipelines, enforce data governance standards, and enable analytics readiness. Drive technical excellence, mentor engineering teams, and collaborate with stakeholders to align data solutions with business goals.
Secondary Skills to be planned Post Hiring - Training Plan
Experience using Fivetran to automate data pipeline builds.
Understanding of Databricks ML and analytics tools.
Experience resolving networking/VPN issues related to data flow.
Familiarity with data governance, security, and compliance frameworks.
Understanding of Databricks ML and analytics tools.
Experience resolving networking/VPN issues related to data flow.
Familiarity with data governance, security, and compliance frameworks.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.