Overview
On Site
$0 - $0
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)
No Travel Required
Unable to Provide Sponsorship
Skills
AWS
Apache Airflow
Databricks
ELT
Extract
Transform
Load
Data Governance
PySpark
Python
Data Modeling
Amazon S3
Collibra
MDM
DAG
Job Details
Databricks Architect
Lcation: Boston, MA (Day 1 Onsite)
Job Description:
Primary Skills: Databricks, PySpark
We are seeking a highly skilled Databricks Architect with strong experience in building scalable data solutions using Databricks and PySpark.
Key Responsibilities:
- Expertise in PySpark and Databricks (including Delta Lake, clusters, jobs).
- Experience in architecting solutions that integrate Databricks with:
- Applications such as Salesforce, MDM, etc.
- Tools such as Collibra and other data governance platforms.
- Hands-on experience with Apache Airflow (DAG design, scheduling, and monitoring).
- Strong working knowledge of AWS services including S3, EC2, Lambda, and IAM.
- Proficient in SQL and Python for data transformations and orchestration.
- In-depth understanding of Lakehouse architecture (Delta Lake) and data modeling.
- Experience with ETL/ELT pipelines and adherence to data warehousing best practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.