Overview
On Site
Depends on Experience
Contract - W2
Contract - Independent
Skills
ETL
Databricks
Job Details
Data Engineer /Technical Lead
Location : San Jose, CA 95110 (First Preference) / Santa Clara, CA 95054 (Onsite)
Contract (C2C/W2)
Long Term Contract
We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects
Databricks & Delta Lake Evaluate good understanding of Hands-on experience with Databricks, including development using PySpark or Spark SQL, Efficient use of Delta Lake for scalable data pipelines, and data lineage in Databricks
Azure Data Factory Evaluate good understanding of Building and managing ETL pipelines using ADF, Using ADF for orchestration with Databricks, Blob Storage, SAP sources, Monitoring, error handling, and pipeline performance tuning
Performance Optimization Evaluate good understanding of handling Performance optimization on Databricks
Python & PySpark Evaluate good understanding of Writing robust, maintainable data processing scripts, Using Python/Spark for custom transformations and integration logic
SAP HANA Experience/knowledge Integrating SAP data with other platforms, Handling large-scale SAP data extraction, transformation, and migration; Good understanding of SAP HANA architecture and data modeling
ETL Tools, SAP Data Services Evaluate good understanding of Creating, deploying, and optimizing data jobs in SAP BODS/Data Services, Working with complex mappings and SAP-specific data types, Handling change data capture (CDC) scenarios
Data Profiling & Validation Evaluate good understanding of Experience in data profiling, validation, and reconciliation during migrations
Azure Cloud & Networking Evaluate good understanding of Azure services related to compute, storage, networking, and security, Experience resolving firewall, VPN, and VNet issues impacting data pipelines, Familiarity with IAM, RBAC, and secure credential storage
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.