Databricks Architect

New York City, NY, US • Posted 3 hours ago • Updated 3 hours ago
Contract W2
Contract Independent
12 Months
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Insurance
  • Databricks Architect

Summary

Databricks Architect

Job Summary

We are looking for an experienced Databricks Architect to design and implement scalable data platforms using Databricks, Apache Spark, and cloud technologies. The candidate will work with data engineering teams to build reliable data pipelines, data lakes, and analytics solutions.

Responsibilities
  • Design and implement Databricks data architecture and data platforms.
  • Develop and optimize ETL/ELT pipelines using Databricks and Apache Spark.
  • Work with Delta Lake, PySpark, SQL, and Databricks Workflows.
  • Design Data Lake / Lakehouse solutions on AWS, Azure, or Google Cloud Platform.
  • Implement data ingestion from various sources into Databricks.
  • Optimize Spark jobs, clusters, queries, and overall platform performance.
  • Implement data security, governance, access control, and monitoring.
  • Work with cloud services such as Azure Data Lake, AWS S3, or Google Cloud Platform Cloud Storage.
  • Collaborate with Data Engineers, Data Scientists, Analysts, and business teams.
  • Provide technical guidance and architecture best practices to the development team.
Required Skills
  • 8+ years of experience in Data Engineering / Data Architecture.
  • Strong hands-on experience with Databricks.
  • Strong knowledge of Apache Spark / PySpark.
  • Experience with Delta Lake and Lakehouse architecture.
  • Strong SQL and data modeling skills.
  • Experience with AWS, Azure, or Google Cloud Platform.
  • Experience designing scalable ETL/ELT data pipelines.
  • Knowledge of data security, governance, and performance tuning.
  • Experience with CI/CD and tools such as Git, Azure DevOps, or Jenkins.
  • Good communication and architecture/design skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91082022
  • Position Id: 9085290
  • Posted 3 hours ago
Contact the job poster
SR

Sukhdev Rana

Recruiter @ SIGNin Solutions Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

New York, New York

Today

Contract

New York, New York

Today

Contract

USD 70.00 - 75.00 per hour

New York, New York

Today

Full-time

USD 97,000.00 - 156,000.00 per year

New York, New York

Today

Full-time

USD 73,000.00 - 98,000.00 per year

Search all similar jobs