Databricks Engineer

  • Dallas, TX
  • Posted 32 days ago | Updated 18 days ago

Overview

Hybrid
$60 - $70
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

Azure
Azure Data Factory
Azure architecture
Data Lake
ETL
Python
Scala
Teradata
code refactoring
data engineering
data pipelines
design patterns
relational databases
root cause analysis

Job Details

7+ years relevant and progressive data engineering experience
Deep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF (Azure Data Factory) pipelines and Synapse stored procedures
Hands-on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, Synapse, Data Lake, file-based, SQL database)
Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes
Experience developing batch ETL pipelines; real-time pipelines are a plus
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience working with Teradata is plus