Snowflake Data Engineer with Databricks Expertise

  • Jersey City, NJ
  • Posted 21 hours ago | Updated 21 hours ago

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required

Skills

SQL
Snowflake
Databricks
ELT
GitLab
Microsoft Azure
PySpark
Apache Spark

Job Details

Job Title: Snowflake Data Engineer with Databricks Expertise
Location: Iselin, NJ (Hybrid 3 Days Onsite per Week)
Type: Contract
Rate: DOEU


Job Summary:


We are looking for a highly skilled Snowflake Data Engineer with strong experience in Databricks to join our dynamic data team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines, ensuring scalability, performance, and reliability. This role requires close collaboration with cross-functional teams and business stakeholders to deliver enterprise-grade data solutions.


Key Responsibilities:

Data Pipeline Development
Build and maintain scalable ETL/ELT pipelines using Databricks.
Leverage PySpark/Spark and SQL to process and transform large-scale datasets.
Integrate data from multiple sources including Azure Blob Storage, ADLS, and other relational/non-relational databases.
Collaboration & Analysis
Collaborate with teams to prepare data for dashboards and BI tools.
Work closely with stakeholders to understand requirements and provide tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance and cost-efficiency.
Monitor and troubleshoot pipelines to ensure data integrity and reliability.
Governance & Security
Implement data security, access controls, and governance using Unity Catalog.
Ensure compliance with organizational and regulatory data policies.
Deployment & Best Practices
Use Databricks Asset Bundles for deployment of jobs, notebooks, and configurations.
Manage version control (e.g., GitLab) and follow development best practices. Technical Skills:


Expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Delta Live Tables, etc.)
Strong hands-on experience with Snowflake, Snowpipe, and SnowSQL
Proficiency in Azure Cloud Services
Solid understanding of Spark/PySpark for big data processing
Experience working with relational databases
Knowledge of Databricks Asset Bundles and GitLab

Preferred Qualifications:


Familiarity with Databricks Runtime configurations
Experience with Spark Streaming and real-time data solutions
Relevant certifications such as:
o Azure Data Engineer Associate
o Databricks Certified Data Engineer Associate

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.