Senior Data Engineer-Databricks Certified

Overview

Remote
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)
No Travel Required

Skills

Access Control
Apache Spark
Big Data
Cloud Computing
Collaboration
Communication
Continuous Delivery
Continuous Integration
Data Architecture
Data Governance
Data Integration
Data Modeling
Databricks
DevOps
ELT
Extract
Transform
Load
Management
Optimization
PySpark
Real-time
SQL
Stakeholder Management
Streaming
Unity

Job Details

Position: Senior Data Engineer- Databricks Certified
Duration: Long term
Location: Remote

Key Responsibilities
Lead implementation of modern data solutions on Databricks
Design and manage scalable batch and streaming data pipelines using Delta Lake, declarative pipelines, and Autoloader for real-time ingestion.
Implement data governance, access control, and lineage using Unity Catalog.
Optimize ETL/ELT processes and Spark workloads for high performance.
Collaborate with data engineers, analysts, and scientists to ensure business and technical alignment.
Provide guidance on cloud data architecture and CI/CD best practices.
Required Skills & Experience
8 10 years in Big Data Engineering with Apache Spark; 3 4 years hands-on with Databricks.
Expertise in Delta Lake, declarative pipelines, batch/streaming data integration and Autoloader.
Proficient in PySpark, SQL, Spark optimization, and data modeling.
Experience in cloud platforms and DevOps/CI/CD practices.
Strong communication and stakeholder management skills.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About GLOBAL IT CON LLC