Overview
On Site
$100,000 - $120,000
Full Time
No Travel Required
Skills
Spark
Databricks
AWS
RDS
Job Details
Job Summary
We are seeking an experienced and highly skilled Databricks Lead Developer to lead our data engineering team. The successful candidate will be responsible for designing, implementing, and optimizing large-scale data processing systems on Databricks, ensuring efficient data flow and seamless integration across various platforms. You will also collaborate with other data professionals and stakeholders across the organization to define and execute the data strategy and vision.
Years of experience needed
Minimum of 8+ years of experience in data engineering or a related field.
At least 3 years of hands-on experience with Databricks and Apache Spark.
Technical Skills:
- Proficient in SQL, Python/pyspark.
- Strong understanding of ETL processes, data warehousing, and big data technologies.
- Experience with cloud platforms(AWS), particularly with their data services.
- Hands-on experience with Airflow for orchestration.
- Experience with AWS services, particularly Redshift and RDS.
- Proficient in Databricks Lake.
- Strong understanding of data engineering practices and big data technologies. Leadership Skills: Proven experience leading a team of developers, with strong mentoring and project management abilities.
Certifications Needed:
- Certification in Databricks or Apache Spark or AWS (Preferabl
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.