Data Engineer US and gc

Overview

On Site
Depends on Experience
Full Time

Skills

Data Engineer
Databricks
Data scientist

Job Details

Job Description:

Role: Senior Data Engineer

Location: Wasco, California (Hybrid)

Job type: Full Time/Permanent

Job Description:

We are seeking a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data-driven initiatives. This position is based on the Databricks platform, and we are looking for candidates with expertise in building scalable and efficient data pipelines.

Responsibilities

  • Collaborate with cross-functional teams to understand data requirements and design scalable data solutions on the Databricks platform.
  • Develop and maintain ETL processes to ingest, transform, and load data from various sources into Databricks Delta Lake.
  • Design and implement data models and schemas to ensure data accuracy, consistency, and reliability.
  • Optimize and tune data pipelines for performance and efficiency.
  • Work closely with Business analysts, and other stakeholders to understand their data needs and provide timely data support.
  • Implement data security and privacy measures to ensure compliance with industry standards and regulations.
  • Monitor and troubleshoot data pipeline issues, providing timely resolution to minimize downtime.
  • Stay abreast of the latest advancements in Databricks and other relevant technologies to continually enhance data engineering practices.

Qualifications

  • Bachelor s degree in computer science, Information Technology, or a related field.
  • Proven experience as a Data Engineer with a focus on Databricks.
  • Strong proficiency in programming languages such as Python, Scala, or Java.
  • Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake.
  • Solid understanding of data modeling, ETL processes, and data warehousing concepts.
  • Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.
  • Excellent problem-solving and communication skills.
  • Ability to work collaboratively in a team-oriented environment.

Preferred Qualifications:

  • Data bricks Certified Developer or Databricks Certified Data Engineer certification.
  • Experience with version control systems, such as Git.
  • Knowledge of DevOps practices and tools for automated testing and deployment.

Familiarity with data streaming technologies (e.g., Apache Kafka)

Thanks & Regards,

Salman khan