Data Engineer

Hybrid in New York, NY, US • Posted 17 hours ago • Updated 17 hours ago

Contract Independent

Contract W2

No Travel Required

Hybrid

$65 - $70/hr

Intellect Quest LLC

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Apache Spark
ELT
Databricks
Artificial Intelligence
Machine Learning (ML)

Summary

Role: Data Engineer

Location: NY (Hybrid)

Contract description

Design, build, and maintain scalable production data pipelines for ingestion, transformation, and modeling across cloud data platforms (Azure, Databricks, Snowflake).
Develop solutions using Python/PySpark, Databricks, and Snowflake, ensuring performance, reliability, and cost‑efficient Spark execution.
Implement orchestration workflows, data quality frameworks, monitoring/alerting, and CI/CD pipelines to support automated, high‑quality data delivery.
Collaborate with data scientists to operationalize machine learning models using MLflow and MLOps best practices.
Partner closely with cross‑functional stakeholders to understand requirements, communicate progress, and deliver high‑impact data solutions.

Qualifications

5+ years of professional experience with Python, PySpark, Databricks, and Snowflake in production data environments.
Proven expertise in building scalable data pipelines, including ingestion frameworks, ETL/ELT processes, and data modeling.
Deep experience with Spark performance tuning and cloud cost‑optimization strategies.
Hands‑on experience with workflow orchestration, data quality frameworks, monitoring/alerting systems, and CI/CD automation.
Exposure to AI/LLM technologies and experience supporting ML workloads using MLflow or related MLOps tools.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91170855
Position Id: 8926390
Posted 17 hours ago

Company Info

About Intellect Quest LLC

At Intellect Quest Inc, we are dedicated to delivering innovative technology solutions that empower businesses to excel in the digital age. Our expertise spans a wide range of services, including enterprise data solutions, scalable cloud infrastructure, artificial intelligence, machine learning, and custom app development. We pride ourselves on offering tailored strategies designed to meet the unique needs of every client, ensuring efficiency, scalability, and long-term success.

With a commitment to excellence and a focus on driving results, we help organizations across industries navigate the complexities of modern technology. Our solutions enable businesses to transform operations, embrace innovation, and stay ahead in today’s fast-paced and ever-evolving digital landscape. Partner with Intellect Quest Inc and unlock your potential to thrive in a world driven by technology.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Azure Big Data Engineer

Remote

•

28d ago

Key ResponsibilitiesDesign and implement end-to-end big data solutions on Microsoft AzureDevelop and optimize data pipelines using Azure Data Factory (ADF)Build and manage large-scale data processing using Azure DatabricksWork with Azure Synapse Analytics for data warehousing and analyticsDevelop scalable data lakes using Azure Data Lake Storage (ADLS)Implement ETL/ELT pipelines for structured and unstructured dataIntegrate data from multiple sources including APIs, databases, and streaming plat

Easy Apply

Full-time

120,000 - 130,000

AWS Data Architect

Hybrid in Illinois City, Illinois

•

14d ago

Position: AWS Data ArchitectFTE Salary: $180kLocation: Chicago, IL (hybrid)H1B Visa Transfer Welcome* Job Summary:We are seeking an experienced AWS Data Architect to design, build, and optimize scalable data solutions on AWS Cloud. The ideal candidate will have strong expertise in data architecture, data modeling, cloud data platforms, and big data technologies. The role involves defining data strategy, implementing data lakes and warehouses, and ensuring secure, high-performance data systems.

Easy Apply

Full-time

$180,000 - $220,000

Search all similar jobs