AIT Global, Inc.
AIT Global, Inc.

Lead Data Engineer

Cary, NC, US • Posted 4 hours ago • Updated 3 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • sql
  • python
  • Scala
  • azure
  • Pyspark

Summary

Job Title: Lead Data Engineer
Location: Cary, NC
Mandatory Skills Must-Have:
  • Python, PySpark, Scala and SQL strong production-level data engineering skills.
  • Azure Databricks Delta Lake, Spark performance tuning, Jobs/Workflows and Unity Catalog.
  • Azure data services ADLS Gen2 and Azure Data Factory (ADF).
  • Lakehouse / Medallion Architecture proven experience implementing Bronze, Silver and Gold layers at enterprise scale.
  • Data Pipeline Engineering metadata-driven ingestion frameworks, data transformation, data quality and large-scale pipeline optimization.
  • Production AI/LLM Experience hands-on experience designing and deploying LLM-based solutions, including RAG, embeddings, retrieval and prompt engineering.
  • LLM Frameworks experience with LangChain, LlamaIndex or LangGraph, plus Azure OpenAI, OpenAI or Databricks Model Serving.
  • Azure DevOps / CI-CD experience automating data pipeline deployments; Terraform and Databricks Asset Bundles are highly relevant.
  • Technical Leadership ability to design solutions, write production code, review code and guide data engineering teams.
  • Financial services or insurance data, especially financial reconciliation, general ledger or accounting data.
  • AI-driven data quality, anomaly detection and automated reconciliation.
  • Knowledge graphs, ontologies, semantic layers or enterprise Text-to-SQL solutions.
  • Azure security, data governance, PII protection and fine-grained access controls.
  • MLOps/LLMOps, model evaluation and production AI monitoring.
Important: This is a hands-on Lead Data Engineer position, not a purely managerial or coordination role. Candidates must demonstrate recent production coding experience.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10106248
  • Position Id: 2026-4563
  • Posted 4 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at AIT Global, Inc. in Cary, NC