Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required
Skills
Azure DataBricks
data engineer
python
Kafka
NoSQL
Job Details
Role: Azure DataBricks Lead
Location: Pleasanton CA - Onsite - Locals preferred
Location: Pleasanton CA - Onsite - Locals preferred
Exp: 15
Required Qualifications
15+ years of experience in data engineering, with 7+ years in a technical leadership role.
Deep hands-on experience with Azure Databricks and Apache Spark, including Structured Streaming.
Proficiency in Python for building scalable and reusable data workflows.
Experience with Kafka for real-time data ingestion and event streaming.
Strong experience integrating with relational (DB2, PostgreSQL) and NoSQL (MongoDB) databases.
Demonstrated expertise in performance tuning and scaling Spark jobs in production environments.
Strong communication and analytical skills, with the ability to work cross-functionally and lead through influence.
15+ years of experience in data engineering, with 7+ years in a technical leadership role.
Deep hands-on experience with Azure Databricks and Apache Spark, including Structured Streaming.
Proficiency in Python for building scalable and reusable data workflows.
Experience with Kafka for real-time data ingestion and event streaming.
Strong experience integrating with relational (DB2, PostgreSQL) and NoSQL (MongoDB) databases.
Demonstrated expertise in performance tuning and scaling Spark jobs in production environments.
Strong communication and analytical skills, with the ability to work cross-functionally and lead through influence.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.