Job Title: Databricks Engineer
Work Mode: Remote with travel
Department: Data Engineering / Data Platform
About the Role
We are seeking an experienced Databricks Engineer to design, develop, and maintain scalable data engineering solutions using the Databricks Lakehouse Platform. The ideal candidate will have strong expertise in Python, PySpark, SQL, Apache Spark, Delta Lake, and cloud-based data platforms.
The candidate will be responsible for building reliable ETL/ELT pipelines, optimizing large-scale data processing workloads, and implementing modern data architectures to support analytics, reporting, and business intelligence.
Required Skills and Qualifications
- Strong hands-on experience with the Databricks Lakehouse Platform.
- Proficiency in Python, PySpark, Apache Spark, and SQL.
- Experience developing ETL/ELT pipelines and large-scale data processing solutions.
- Knowledge of Delta Lake, Delta tables, and ACID transactions.
- Experience with Databricks notebooks, workflows, jobs, and cluster or compute management.
- Understanding of Medallion Architecture and modern data warehouse/lakehouse concepts.
- Experience working with cloud platforms such as Azure, AWS, or Google Cloud Platform.
- Knowledge of data modeling, partitioning, schema evolution, and incremental data processing.
- Experience with Git, CI/CD pipelines, and software development best practices.
- Strong debugging, analytical, and problem-solving skills.
“Tekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.”