Databricks Engineer

Job Title: Databricks Engineer
Location: Cleveland, OH
Work Arrangement: Onsite – 4 days per week

Job Overview:

We are looking for an experienced Databricks Engineer to design, develop, and optimize scalable data engineering solutions using Databricks and modern cloud data technologies.

Key Responsibilities:

• Develop and maintain scalable data pipelines using Databricks, Apache Spark, and PySpark.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Develop data transformations using Python and SQL.
• Work with cloud data platforms, data lakes, and enterprise data warehouses.
• Implement data quality, performance optimization, monitoring, and troubleshooting.
• Collaborate with data architects, analysts, developers, and business stakeholders.
• Follow best practices for data security, governance, CI/CD, and deployment.
• Troubleshoot production issues and improve pipeline reliability and performance.

Required Skills:

• Strong hands-on experience with Databricks and Apache Spark/PySpark.
• Strong Python and SQL development skills.
• Experience building enterprise-scale ETL/ELT data pipelines.
• Experience with cloud data platforms such as Azure, AWS, or Google Cloud Platform.
• Knowledge of Delta Lake and Databricks data engineering capabilities.
• Strong understanding of data modeling, data warehousing, and data lake architecture.
• Excellent troubleshooting and problem-solving skills.
• Databricks Certified Data Engineer Professional certification – MUST HAVE.
• Ability to work onsite in Cleveland, OH, 4 days per week.

Preferred Skills:

• Experience with Azure Data Factory / AWS Glue / similar orchestration tools.
• Experience with Git, CI/CD, and DevOps practices.
• Knowledge of Unity Catalog, Databricks Workflows, and Delta Live Tables.
• Experience working in Agile development environments.