Lead Data Engineer / Big Data Engineer / Senior Data Engineer

We're Hiring: Lead Data Engineer (Hands-On)

Location: Remote
Experience: 12 18 Years
Employment: Full-Time

We are looking for an experienced Lead Data Engineer with strong expertise in Azure Databricks, large-scale data engineering, and Generative AI to build an enterprise-scale, AI-first Data Hub for a leading financial services and insurance client.

Key Skills Required:

• Strong Python, PySpark, Scala, and SQL

• Azure Databricks, Delta Lake, and Medallion Architecture

• Azure Data Factory (ADF) and ADLS Gen2

• Generative AI, LLMs, RAG, and AI-powered data pipelines

• LangChain, LangGraph, or LlamaIndex

• Data quality, anomaly detection, and data governance

• Azure DevOps, Terraform, and CI/CD

• Enterprise data platform architecture and technical leadership

Must Have: 3+ years of hands-on experience building and deploying production-grade LLM-based systems, along with strong data engineering and architecture expertise.

We are looking for a hands-on technical leader who can design scalable data platforms, write production code, optimize pipelines, and mentor engineering teams.