Data Engineer with Gen AI

New York, NY, US • Posted 1 day ago • Updated 1 day ago

Full Time

No Travel Required

On-site

Depends on Experience

Skywaves MP LLC

Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

Amazon Web Services
Artificial Intelligence
Data Engineering
Extract, Transform, Load
Google Cloud Platform
Machine Learning (ML)
Orchestration
SQL
Dagster
Python
Pandas
PostgreSQL
Generative Artificial Intelligence (AI)

Summary

Key Responsibilities

Design, build, and maintain scalable data pipelines using modern data engineering tools.
Develop and manage data transformation workflows using dbt and Dagster.
Build robust data models and pipelines supporting analytics and AI workloads.
Develop backend services and APIs using Python and FastAPI to enable data access for AI applications.
Work with PostgreSQL and SQL to design efficient schemas and optimize queries.
Process and analyze data using Pandas and Python-based data frameworks.
Integrate structured and unstructured data pipelines to support Generative AI applications.
Collaborate with AI/ML engineers to enable LLM-powered applications and data pipelines.
Implement data quality, monitoring, and performance optimization practices.
Participate in architecture design discussions and contribute to scalable data platform design.

Required Skills

Strong programming experience in Python.
Experience working with Dagster for orchestration.
Hands-on experience with dbt for data transformation and modeling.
Advanced SQL skills and experience with PostgreSQL.
Experience working with Pandas for data processing.
Experience building APIs using FastAPI.
Solid understanding of data pipeline design and ETL/ELT processes.
Familiarity with building data infrastructure for AI/ML or GenAI use cases.

Good to Have

Experience designing Star Schema / Dimensional Data Models.
Familiarity with Medallion Architecture (Bronze, Silver, Gold layers).
Experience with Generative AI frameworks or LLM integrations.
Knowledge of RAG pipelines, vector databases, or embedding workflows.

Exposure to cloud platforms such as AWS / Google Cloud Platform / Azure.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91170747
Position Id: dd21
Posted 1 day ago

Company Info

About Skywaves MP LLC

We keep identifying great talent for our clients who can build thriving IT organizations, Multi-functional teams and businesses.

Our team includes seasoned professionals who have worked as/involved in:

Program Managers in leading IT companies, handled project teams in areas like

Blockchain
SAP
Cyber security among other technologies
HR

Profit Centre/P&L heads in

IT
Manufacturing
Services sectors
Handled multi-functional teams

Built IT teams/Business teams/Start Up from the scratch

Independent directors in the boards of banks/financial institutions
Advising CXOs and Board of Directors on
Project Turnaround
Change Management, Organization Design
HR Strategy
Finance Strategy
Tax consulting
Balance sheet consulting
Supply Chain Management

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

New York, New York

•

Today

THE POSITIONOur roster has an opening with your name on it We are looking for a Data Engineer to join our growing data engineering team and help build the pipelines and infrastructure that power analytics, machine learning, and business decision-making across the company. In this role, you'll contribute to the design, development, and maintenance of reliable data systems while collaborating with stakeholders to support high-impact data use cases. The ideal candidate is a strong technical contr

Full-time

USD 116,000.00 - 152,250.00 per year

Data AI Engineer, Dir, P4

New York, New York

•

Today

Since 1935, Morgan Stanley is known as a global leader in financial services, always evolving and innovating to better serve our clients and our communities in more than 40 countries around the world. In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. Our mission is to develop a firmwide Artificial Intelligence (AI) Development Platform

Full-time

USD 150,000.00 - 190,000.00 per year

Gen AI Engineer

New York, New York

•

Today

Job Title: Gen AI EngineerLocation: NY/NJ Role Summary: We are seeking a Generative AI Engineer to build, optimize, and scale production-ready AI applications. You will design complex multi-agent systems, implement advanced RAG pipelines, and manage the deployment of both frontier and local LLMs. The ideal candidate blends deep machine learning expertise with modern software engineering practices. Technical Stack:LLMs: Gemini, OpenAI, Claude, Llama, and Local Model deployment.Frameworks: LangCha

Easy Apply

Full-time

Depends on Experience

Principal Data Engineer, Data Architecture

New York, New York

•

Today

At Rockstar Games, we create world-class entertainment experiences. Become part of a team working on some of the most rewarding, large-scale creative projects to be found in any entertainment medium - all within an inclusive, highly-motivated environment where you can learn and collaborate with some of the most talented people in the industry. Rockstar is looking for a passionate Principal Data Engineer, Data Architecture to provide cross-team oversight and alignment as we continue to scale ou

Full-time

USD 133,900.00 - 198,160.00 per year

Search all similar jobs