Overview
Skills
Job Details
Job Title: Snowflake Data Engineer with Databricks Expertise
Location: Iselin, NJ (Hybrid 3 Days Onsite per Week)
Type: Contract
Rate: DOEU
Job Summary:
We are looking for a highly skilled Snowflake Data Engineer with strong experience in Databricks to join our dynamic data team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines, ensuring scalability, performance, and reliability. This role requires close collaboration with cross-functional teams and business stakeholders to deliver enterprise-grade data solutions.
Key Responsibilities:
Data Pipeline Development
Build and maintain scalable ETL/ELT pipelines using Databricks.
Leverage PySpark/Spark and SQL to process and transform large-scale datasets.
Integrate data from multiple sources including Azure Blob Storage, ADLS, and other relational/non-relational databases.
Collaboration & Analysis
Collaborate with teams to prepare data for dashboards and BI tools.
Work closely with stakeholders to understand requirements and provide tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance and cost-efficiency.
Monitor and troubleshoot pipelines to ensure data integrity and reliability.
Governance & Security
Implement data security, access controls, and governance using Unity Catalog.
Ensure compliance with organizational and regulatory data policies.
Deployment & Best Practices
Use Databricks Asset Bundles for deployment of jobs, notebooks, and configurations.
Manage version control (e.g., GitLab) and follow development best practices. Technical Skills:
Expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Delta Live Tables, etc.)
Strong hands-on experience with Snowflake, Snowpipe, and SnowSQL
Proficiency in Azure Cloud Services
Solid understanding of Spark/PySpark for big data processing
Experience working with relational databases
Knowledge of Databricks Asset Bundles and GitLab
Preferred Qualifications:
Familiarity with Databricks Runtime configurations
Experience with Spark Streaming and real-time data solutions
Relevant certifications such as:
o Azure Data Engineer Associate
o Databricks Certified Data Engineer Associate