Overview
Skills
Job Details
Job Title: Lead Data Engineer
Location: Columbia, SC
Duration: 12 Months
Project Overview: The Data Operations Hub (DOH) functions as a centralized platform responsible for the ingestion, validation, transformation, security, and provisioning of enterprise data. It supports analytics, reporting, operational efficiency, and regulatory compliance.
Daily Duties & Responsibilities: As a System Software Programmer - Consultant, you will be a core member of the Data Operations Hub Team. This position focuses on designing and implementing analytical data solutions that align with the organization s strategic objectives. The ideal candidate will have strong skills in data architecture, modeling, integration, and migration. You will work closely with cross-functional teams to execute modern, scalable data solutions.
Key Responsibilities:
Represent the Data Operations Hub team in cross-functional forums, offering guidance on data solutions.
Design and maintain scalable data architectures, including data lakes and data warehouses.
Collaborate with stakeholders to ensure solutions meet business requirements and support data-driven decision-making.
Evaluate and recommend emerging technologies for adoption.
Develop architectural models and related artifacts using tools like Sparx or equivalent.
Act as a subject matter expert in data-related domains.
Utilize modern data processing tools (e.g., Python, Java, Airflow) in a data mesh or data lake environment.
Participate in hands-on coding, testing, and deployment of production-grade data solutions.
Enhance system performance and resolve technical inefficiencies.
Create reusable data frameworks and adopt cutting-edge technologies.
Required Skills:
3+ years in a Data Engineer or similar role, with leadership in solving complex technical challenges.
3+ years hands-on experience with system design, Python application development, and system stability.
3+ years experience in architecture and proficiency in Python and Java.
2+ years experience in data modeling, data integration, and domain-driven design using cloud data services.
2+ years experience with AWS or Azure cloud services and related data engineering tools.
3+ years experience working with SQL, cloud-native relational databases, and data warehouse solutions (e.g., Snowflake, Athena, Postgres).
Preferred Skills:
AWS or Azure certification (Cloud Practitioner or Developer).
Experience working in a Medicaid or healthcare-related environment.