Data Engineer Databricks Certified candidates

Overview

Remote
Depends on Experience
Contract - W2
10% Travel

Skills

databricks
data

Job Details

Job Title: Data Engineer Databricks

Job Summary:

We are seeking a skilled and motivated Data Engineer with expertise in Databricks to join our growing data team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines and analytics solutions using the Databricks platform. You will work closely with data scientists, analysts, and business stakeholders to enable data-driven decisions.

Key Responsibilities:

  • Design and build scalable ETL/ELT data pipelines using Databricks and Apache Spark.

  • Develop notebooks and workflows for data transformation, enrichment, and integration.

  • Collaborate with data architects and analysts to implement data models and optimize data storage.

  • Integrate Databricks with various data sources (Azure Data Lake, AWS S3, SQL, APIs).

  • Monitor and tune job performance in Databricks clusters.

  • Ensure data quality, security, and compliance standards are met.

  • Implement CI/CD practices for Databricks notebooks and jobs.

  • Support data democratization by building reusable libraries and templates for team use.

Required Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.

  • 3+ years of experience in data engineering or related roles.

  • Hands-on experience with Databricks and Apache Spark.

  • Proficiency in Python and SQL for data manipulation.

  • Experience with cloud platforms (Azure, AWS, or Google Cloud Platform), especially Azure Databricks or AWS Glue.

  • Familiarity with Delta Lake, data lakes, and lakehouse architecture.

  • Knowledge of CI/CD, Git, and DevOps practices in a data environment.

Preferred Qualifications:

  • Databricks Certification (e.g., Databricks Certified Data Engineer Associate/Professional).

  • Experience with orchestration tools (e.g., Airflow, Azure Data Factory).

  • Exposure to ML workflows in Databricks (MLflow, Feature Store).

  • Strong problem-solving and communication skills.

  • Experience working in Agile/Scrum teams.

Benefits:

  • Competitive salary and performance-based bonuses.

  • Health, dental, and vision insurance.

  • Flexible working hours and remote options.

  • Opportunities for career growth and certification support.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.