Lead Databricks Engineer

Overview

On Site
$47 - $50
Contract - W2

Skills

Amazon EC2
Amazon S3
Amazon Web Services
Data Modeling
Data Warehouse
Databricks
Extract
Transform
Load
SQL
Python
PySpark
Apache Airflow
Master Data Management
Salesforce.com

Job Details

Primary Skills: Databricks, Pyspark

  • Proficiency in PySpark and Databricks (Delta Lake, clusters, jobs).
  • Experience is architecting designs for integrating DBX with different application like Sales Force & MDM etc
  • Different tool like Collibra etc.
  • Hands-on with Apache Airflow (DAG design, monitoring).
  • Strong in AWS services: S3, EC2, Lambda, IAM.
  • Strong SQL and Python for transformations and orchestration.
  • Knowledge of Lakehouse architecture (Delta Lake) and data modeling.
  • Experience in ETL/ELT and data warehousing best practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.