W2Hiring - Data Engineer - Iselin, NJ or NYC, NY (Hybrid)

Overview

Hybrid
Depends on Experience
Contract - W2

Skills

Databricks
ETL
ELT
Azure

Job Details

Role: Cloud Data Platform Engineer (Finance Domain) Location: Iselin, NJ or NYC, NY (Hybrid, 3 days in a week from office) In-person is required
About the Role:
We are seeking a skilled Cloud Data Platform Engineer to design, develop, and maintain our cloud-based data infrastructure. The ideal candidate will have extensive experience working with cloud platforms, data engineering pipelines, and modern data tools to enable scalable analytics and data-driven decision-making.
Key Responsibilities:

  • Design, implement, and maintain cloud data platforms leveraging Azure Cloud.
  • Develop and optimize ETL/ELT pipelines to transform raw data into actionable insights.
  • Manage and configure cloud-based data warehouses, data lakes, and data platforms such as Databricks, Snowflake, and Redshift.
  • Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver scalable solutions.
  • Automate infrastructure deployment using Infrastructure as Code (IaC) tools like Terraform or CloudFormation.
  • Maintain and optimize cluster configurations, notebooks, jobs, and workspace components within Databricks.
  • Monitor cloud data platform performance, troubleshoot issues, and implement improvements.
  • Promote best practices in DevOps, CI/CD pipelines, and data security.
  • Stay abreast of new cloud and data engineering trends and incorporate innovative approaches.

Required Skills & Qualifications:

  • Overall 8+ years of experience in IT is required
  • Proven experience with cloud platforms such as Azure, AWS, or Google Cloud.
  • Strong understanding of data warehousing, data lakes, and ETL processes.
  • Programming experience in Python, Java, or Scala.
  • Deep expertise with cloud data platforms, particularly Databricks; knowledge of Snowflake, Redshift, etc., is a plus.
  • Solid understanding of Databricks architecture including clusters, notebooks, jobs, and workspace management.
  • Familiarity with relational databases and NoSQL technologies.
  • Hands-on experience with Infrastructure as Code tools (Terraform, CloudFormation).
  • Understanding of CI/CD practices, automation, and DevOps principles.
  • Excellent analytical, problem-solving, and troubleshooting skills.
  • Strong communication and collaboration abilities across multidisciplinary teams.

Preferred Qualifications:

  • Prior experience working in agile development environments.
  • Certifications in cloud platforms or data engineering (e.g., Azure Data Engineer, AWS Certified Data Analytics, Databricks certification).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.