Senior/Lead Data Engineer with AI

Overview

Remote
$DOE
Contract - W2
Contract - Months Contract

Skills

Automation
workflows
Amazon Web Services
Artificial Intelligence
Software Engineering
databases
Data Processing
Apache Spark
Cloud Services
systems integration
Prompt Engineering
Data Visualisation
Python (Programming Language)
Application Programming Interfaces (APIs)
Chatbots
SQL Databases
Curiosity
Boto3

Job Details

Title: Senior/Lead Data Engineer with AI

Location: 100% remote

Contract length 1+ year

Required start date: ASAP

Recruitment process: Coding test - Technical Interview - Manager Interview - Client Interview

Description:

  • We are in search of a Senior Data Engineer who is adept in SQL, Python, and Spark, and ideally with an experience in AI-related tasks and API integrations for chatbot development/integration.
  • SQL Expertise: Essential for complex query handling and database manipulation.
  • Python Proficiency: Required for automation, data processing, AWS Bedrock API integration, and chatbot development workflows using Boto3 SDK
  • Spark Familiarity: Needed for large-scale data processing.

Requirements:

  • A solid background in database engineering and software development.
  • Experience with AI Agents Design and Integration
  • Demonstrated ability with Python and Spark within data-intensive environments
  • Experience with cloud services, particularly integrating foundation models through Bedrock runtime APIs
  • Understanding of prompt engineering, system messages, and model parameter tuning for optimal AI responses
  • Eager to learn and apply new technologies in data visualization, automation, AI.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.