Data Scientist / Cloud Architect (Azure Databricks)

Overview

On Site
Depends on Experience
Contract - W2
Contract - 24 Month(s)

Skills

Azure Cloud
Databricks
Data Lake architecture
ETL migration
Apache Spark
Delta Lake.
Python
SQL
PySpark
big data
ML/NLP
unstructured data
Sqoop
Oozie
Flume
DevOps
Tableau
Power BI
ML/AI deployment
shell
PowerShell

Job Details

Job Description:
Seeking an experienced Data Scientist / Cloud Architect (SME) with strong expertise in Azure Cloud, Databricks, and Data Lake architecture. The ideal candidate will design and implement large-scale data solutions, support ETL migration to cloud, and optimize big data / machine learning pipelines. Must be able to advise, architect, and operationalize advanced analytics platforms in an enterprise environment.

Required Skills:

  • 15+ years IT architecture/systems experience, 10+ years in cloud/data solutions.

  • Strong background in Azure Cloud (compute, storage, networking, databases).

  • Hands-on expertise with Databricks, Apache Spark, Delta Lake.

  • Proficiency in Python, SQL, PySpark (C++/Scala/Perl/Ruby a plus).

  • Experience with ETL migration, big data, ML/NLP, and unstructured data.

  • Familiar with Sqoop, Oozie, Flume, DevOps (CI/CD, Git), and monitoring tools.

  • Data visualization: Tableau, Power BI.

Preferred: Cloud certifications, ML/AI deployment experience, shell/PowerShell scripting.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.