Overview
Remote
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
Data Engineer
Python
AI
ML
LLM
Spark
Data Bricks
Job Details
Role: Data Engineer
Exp: 10+ Yrs
Location: Remote
Type: Contract-To-Hire Position
Description:
We are looking for a highly skilled Data Engineer with deep expertise in Databricks and a strong understanding of AI/ML workflows. This role is central to building and optimizing scalable data platforms that support advanced analytics and machine learning initiatives. You will work closely with data engineers, data scientists, ML engineers, and business stakeholders to enable intelligent data-driven solutions.
Tech Stack - Core Tools:
- Databricks (Spark, Delta Lake, MLflow, Notebooks)
- Python & SQL
- Apache Spark (via Databricks)
- Delta Lake (for lakehouse architecture)
- Cloud Platforms
- Azure, AWS, or Google Cloud Platform
- Cloud Storage (ADLS, S3, GCS)
- Data Integration
- Kafka or Event Hubs (streaming)
- Auto Loader (Databricks file ingestion)
- REST APIs
- AI/ML
- MLflow (model tracking/deployment)
- Hugging Face Transformers
- LangChain / LlamaIndex (LLM integration)
- LLMs: Anthropic Claude, Meta LLaMA, Google Gemini
- DevOps
- Git (GitHub, GitLab, Azure Repos)
- Databricks Repos
- CI/CD: GitHub Actions, Azure DevOps
- Security & Governance
- Unity Catalog
- RBAC
Regards,
Prakash
732-7 9 0-5440
prakash.v(@)primesoftinc(.)com
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.