Senior Data Engineer – AI Ready Data Platforms

Job Title: Senior Data Engineer – AI Ready Data Platforms

Location: Remote (Must be able to work PST Hours)
 

Role Summary

We are seeking a highly experienced Senior Data Engineer to design, build, and optimize enterprise-scale AI-ready data platforms. This role is focused on creating modern data ecosystems that support AI/ML workloads, Generative AI applications, RAG architectures, and autonomous AI agents.

The ideal candidate will possess deep expertise in cloud-native data engineering, modern data architecture, governance, and AI data platform design. This individual will play a key role in enabling trusted, scalable, and intelligent data foundations that power next-generation analytics and AI-driven business capabilities.

Key Responsibilities

• Architect and build scalable, cloud-native data platforms supporting AI/ML and agentic applications
• Design and implement data architectures optimized for advanced analytics, machine learning, and Generative AI workloads
• Build and manage enterprise-grade data lakes, lakehouses, and data warehouses

• Develop robust batch and real-time data ingestion pipelines
• Design transformation and serving layers that deliver AI-ready datasets
• Create curated, contextualized, feature-rich, and governed data products

• Enable semantic data models to support AI agents and intelligent applications
• Design and implement knowledge graph architectures
• Integrate vector databases and semantic search capabilities
• Support Retrieval-Augmented Generation (RAG) architectures and LLM-powered solutions

• Implement data quality, lineage, metadata, and governance frameworks
• Ensure compliance, security, and trust across enterprise data assets
• Establish monitoring and observability practices for data platforms

• Collaborate with Data Scientists, ML Engineers, and AI teams
• Support feature engineering workflows and feature stores
• Enable model training, inference, and AI lifecycle management
• Build data pipelines optimized for LLM and Generative AI use cases

• Mentor engineering teams and promote engineering excellence
• Establish standards, reusable frameworks, and architectural best practices
• Drive modernization and enterprise data transformation initiatives

Required Skills & Experience

• 10+ years of experience in Data Engineering and Data Platform Architecture
• Strong expertise in cloud platforms:
  • AWS
  • Azure
  • Google Cloud Platform
• Experience with modern data ecosystem technologies:
  • Data Lakes
  • Lakehouses
  • Data Warehouses
  • Distributed Data Processing
• Strong experience designing scalable batch and streaming data pipelines
• Familiarity with AI/ML data pipelines and model lifecycle support
• Experience supporting Feature Stores and Feature Engineering workflows
• Experience building data pipelines for LLMs and Generative AI applications
• Strong understanding of:
  • Data Governance
  • Metadata Management
  • Data Security
  • Data Lineage
  • Data Quality Frameworks

Preferred Qualifications

• Experience building platforms supporting AI Agents and Agentic Workflows
• Hands-on experience with:
  • RAG (Retrieval Augmented Generation)
  • Semantic Search
  • Knowledge Graphs
  • Vector Databases (Pinecone, Weaviate, Milvus, Chroma, etc.)
• Experience with Data Mesh and Domain-Oriented Data Architectures
• Experience leading large-scale enterprise data modernization programs
• Strong understanding of MLOps and LLMOps practices

eye