Big Data Engineer (LLM, AI, GIS Experience-15 years experience)

Overview

Remote
$80,000 - $100,000
Contract - W2
Contract - 11 Month(s)

Skills

GIS
AI
Spatial GIS
Azure
Azure AI
ETL
ELT

Job Details

Hello All,

This is Archana from Hanker Systems Inc. I'm trying to reach you regarding the Big Data Engineer role.

Title: Agentic Engineer (Big Data Engineer)

Location: Richmond, VA

Both Phone and In Person Interview

Rate: $90/hr on W2.

Required Skills

  • Understanding the Big data technologies
  • Experience developing ETL and ELT pipelines
  • Experience with Spark, GraphDB, Azure Databricks
  • Experience training LLMs with structured and unstructured data sets
  • Experience in Data Partitioning and Data conflation
  • Experience with GIS spatial data

Qualifications

  • Strong data engineering fundamentals.
  • Experience with big data frameworks such as Apache Spark and Azure Databricks.
  • Ability to train LLMs using structured and unstructured datasets.
  • Understanding of graph databases.
  • Experience with Azure services including Blob Storage, Data Lakes, Databricks, Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI, Azure Media Services, and Azure AI Search.
  • Proficient in determining effective data partitioning criteria and implementing partition schemas using Spark.
  • Understanding of core machine learning concepts and algorithms.
  • Familiarity with cloud computing concepts and practices.
  • Strong programming skills in Python and experience with AI/ML frameworks.
  • Proficiency in working with vector databases and embedding models for retrieval tasks.
  • Expertise in integrating with AI agent frameworks.
  • Experience with cloud-based AI services, especially Azure AI.
  • Proficient with version control systems such as Git.
  • Bachelor s or Master s degree in Computer Science, Artificial Intelligence, Data Science, or a related field.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.