Senior Data Engineer

Overview

Hybrid
$130,000 - $150,000
Full Time

Skills

Kafka
Google Cloud
communication skills
data engineering
data modeling
data warehousing
Data Bricks
Java
ETL processes
ETL
transform
data security
data pipelines
Python
big data
computer science
problem - solving
DevOps
Git
Spark
automated testing
data pipeline
AWS
Power BI

Job Details

Job Description

Role: Senior Data Engineer

Location: Wasco, CA (Bakersfield area)/Hybrid (3 days remote and 2 days onsite in a week)

Job Type: Fulltime/Permanent

Responsibilities

  • Collaborate with cross-functional teams to understand data requirements and design scalable data solutions on the Databricks platform.
  • Develop and maintain ETL processes to ingest, transform, and load data from various sources into Databricks Delta Lake.
  • Design and implement data models and schemas to ensure data accuracy, consistency, and reliability.
  • Optimize and tune data pipelines for performance and efficiency.
  • Work closely with Business analysts, and other stakeholders to understand their data needs and provide timely data support.
  • Implement data security and privacy measures to ensure compliance with industry standards and regulations.
  • Monitor and troubleshoot data pipeline issues, providing timely resolution to minimize downtime.
  • Stay abreast of the latest advancements in Databricks and other relevant technologies to continually enhance data engineering practices.

Qualifications

  • Bachelor s degree in computer science, Information Technology, or a related field.
  • Proven experience as a Data Engineer with a focus on Databricks.
  • Strong proficiency in programming languages such as Python, Scala, or Java.
  • Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake.
  • Solid understanding of data modeling, ETL processes, and data warehousing concepts.
  • Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.
  • Excellent problem-solving and communication skills.
  • Ability to work collaboratively in a team-oriented environment.

Preferred Qualifications:

  • Databricks Certified Developer or Databricks Certified Data Engineer certification.
  • Experience with version control systems, such as Git.
  • Knowledge of DevOps practices and tools for automated testing and deployment.
  • Familiarity with data streaming technologies (e.g., Apache Kafka)