Overview
Skills
Job Details
Position: Databricks Lead Developer
Location: Chicago, IL (ONSITE)
Databricks Lead Developer to lead our data engineering team. The successful candidate will be responsible for designing, implementing, and optimizing large-scale data processing systems on Databricks, ensuring efficient data flow and seamless integration across various platforms. You will also collaborate with other data professionals and stakeholders across the organization to define and execute the data strategy and vision.
8+ years of experience in data engineering or a related field.
At least 3 years of hands-on experience with Databricks and Apache Spark.
Proficient in SQL, Python/pyspark.
Strong understanding of ETL processes, data warehousing, and big data technologies.
Experience with cloud platforms(AWS), particularly with their data services.
Hands-on experience with Airflow for orchestration.
Experience with AWS services, particularly Redshift and RDS.
Proficient in Databricks Lake.
Strong understanding of data engineering practices and big data technologies. Leadership Skills: Proven experience leading a team of developers, with strong mentoring and project management abilities.
Certifications Needed: Certification in Databricks or Apache Spark or AWS (Preferable)