Overview
On Site
Depends on Experience
Full Time
Skills
Data Engineer
Databricks
Data scientist
Job Details
Job Description:
Role: Senior Data Engineer
Location: Wasco, California (Hybrid)
Job type: Full Time/Permanent
Job Description:
We are seeking a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data-driven initiatives. This position is based on the Databricks platform, and we are looking for candidates with expertise in building scalable and efficient data pipelines.
Responsibilities
- Collaborate with cross-functional teams to understand data requirements and design scalable data solutions on the Databricks platform.
- Develop and maintain ETL processes to ingest, transform, and load data from various sources into Databricks Delta Lake.
- Design and implement data models and schemas to ensure data accuracy, consistency, and reliability.
- Optimize and tune data pipelines for performance and efficiency.
- Work closely with Business analysts, and other stakeholders to understand their data needs and provide timely data support.
- Implement data security and privacy measures to ensure compliance with industry standards and regulations.
- Monitor and troubleshoot data pipeline issues, providing timely resolution to minimize downtime.
- Stay abreast of the latest advancements in Databricks and other relevant technologies to continually enhance data engineering practices.
Qualifications
- Bachelor s degree in computer science, Information Technology, or a related field.
- Proven experience as a Data Engineer with a focus on Databricks.
- Strong proficiency in programming languages such as Python, Scala, or Java.
- Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.
- Excellent problem-solving and communication skills.
- Ability to work collaboratively in a team-oriented environment.
Preferred Qualifications:
- Data bricks Certified Developer or Databricks Certified Data Engineer certification.
- Experience with version control systems, such as Git.
- Knowledge of DevOps practices and tools for automated testing and deployment.
Familiarity with data streaming technologies (e.g., Apache Kafka)
Thanks & Regards,
Salman khan