Databricks Architect / ETL Consultant role

Remote • Posted 2 hours ago • Updated 2 hours ago
Contract Independent
Contract W2
12 Months
No Travel Required
Remote
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Apache Spark
  • Communication
  • Customer Facing
  • Extract, Transform, Load
  • Continuous Integration
  • GitHub
  • Data Engineering

Summary

Note: Need solid Architect level candidate with good communication skills, this is a customer facing role.
 
Required Skills: Good customer presence and ability to answer a variety of Databricks questions.
GitHub and CI/CD experience is a plus Day-to-day
Responsibilities:
Design, develop, and maintain data engineering pipelines in Databricks using PySpark or SQL
Experience developing streaming pipelines using Databricks Autoloader or Structured Streaming
Data Modeling experience designing Delta Lake tables and the Bronze-Silver-Gold Medallion Architecture
Understanding of Spark for performance optimizations including Delta Lake optimizations
Experience with cloud service provider (Azure) services used in Databricks’ implementations (e.g., Azure ALDS, IAM)
Triaging ad hoc questions across the Databricks product suite Certifications
Preferred Skills: FiveTran
Responsibilities: Support ETL and CI/CD pipelines to create tables in the data lake.
Support data refresh and reconciliation processes to validate data accuracy.
Expected Deliverable(s): Data pipelines, tables, row-level security configurations, and ETL processes to automatically update datasets daily

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91133032
  • Position Id: 9124168
  • Posted 2 hours ago
Contact the job poster
BJ

Ben Joseph

Recruiter @ Rapisource LLC

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.