Expert Cloud Data Engineer

Hiring - Expert Cloud Data Engineer

Location - New York, NY

Duration - 6 months

Onsite

Job Summary:

We are seeking an Expert Cloud Data Engineer with strong, hands on data pipeline experience to build and maintain robust, scalable cloud data infrastructure. This role requires deep expertise in Databricks based data pipelines, Snowflake, and MLflow, along with strong knowledge of the Azure cloud stack.

The ideal candidate will have proven experience designing, building, and operating production grade data pipelines that support analytics and machine learning workflows at scale.

Key Responsibilities

• Architect, build, and maintain end to end data pipelines using the Databricks technology stack
• Design and operate robust, scalable, and reliable data infrastructure on Azure
• Implement and manage data ingestion, transformation, and orchestration pipelines
• Integrate and optimize data storage and analytics using Snowflake
• Implement and support MLflow for model lifecycle management and experimentation tracking
• Ensure data pipelines meet standards for performance, reliability, scalability, and cost efficiency
• Collaborate closely with data scientists, ML engineers, analytics teams, and platform teams
• Monitor, troubleshoot, and optimize data workflows in production environments
• Apply best practices for data governance, security, and operational excellence

Mandatory Skills & Experience (Must Have)

• Strong, hands on experience building data pipelines (end to end)
• Deep expertise in:
• Databricks (pipeline development, orchestration, optimization)
• Snowflake (data modeling, performance tuning, integration)
• MLflow (ML lifecycle management, experiments, tracking)
• Strong understanding of the Azure cloud stack and cloud native architectures
• Experience supporting both analytics and machine learning workloads
• Proven ability to operate production grade data platforms at scale

Mandatory Requirement

Hands on experience using AI coding agents or any, including:

• AMP
• Claude Code

Use of AI coding agents is a mandatory requirement for this role.

Ideal Candidate Profile

• Expert level Cloud Data Engineer with deep data pipeline ownership
• Strong engineering mindset with a focus on scalability and reliability
• Comfortable working in complex, cross functional enterprise environments
• Able to clearly explain pipeline design, trade offs, and optimization strategies