Overview
BASED ON EXPERIENCE
Contract - Independent
Contract - W2
Skills
Extract
Transform
Load
ELT
Apache Spark
Collaboration
Data Governance
Unity
Cloud Computing
Python
SQL
Scala
Data Engineering
Continuous Integration
Continuous Delivery
Terraform
Databricks
SANS
IT Management
Mentorship
Job Details
Hi,
The following requirement is open with our client.
Job Title : Databricks Architect
Location : Remote
Duration : 12+ Months
Description:
The following requirement is open with our client.
Job Title : Databricks Architect
Location : Remote
Duration : 12+ Months
Description:
- Design and architect scalable data solutions using the Databricks Lakehouse Platform.
- Develop and optimize ETL/ELT pipelines using Apache Spark and Delta Lake.
- Collaborate with data engineers, analysts, and business stakeholders to gather requirements.
- Implement data governance, quality, and security best practices using Unity Catalog.
- Integrate Databricks with various data sources across cloud and on-premise environments.
- Optimize performance and cost of data pipelines and jobs running on Databricks.
- Use Python, SQL, and/or Scala to build robust data engineering solutions.
- Support deployment using CI/CD pipelines and infrastructure-as-code tools like Terraform.
- Stay updated on Databricks features and recommend improvements or new capabilities.
- Provide technical leadership, guidance, and mentoring to engineering teams.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.