Cloud Data Architect / Principal Data Engineer

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 60 Month(s)
No Travel Required

Skills

Cloud Architecture
Data Engineering
Kubernetes
Docker
Mediation

Job Details

Key Responsibilities

1. Architect and Lead Development

  • Serve as architect lead and lead developer for mission-critical data mediation platforms.
  • Design and implement modernized cloud-native solutions for high-volume ETL streaming pipelines and file stream services.
  • Transform and migrate legacy data processing solutions to containerized Kubernetes environments.

2. ETL Streaming Pipeline (Mediation Data Stream Service)

  • Architect and develop ETL streaming pipelines managing data feeds.
  • Optimize performance and scalability, reducing resource consumption.

3. File Stream Service (Data Ingress/Egress)

  • Architect and deliver file mediation services handling feeds
  • Modernize system into cloud-native Kubernetes architecture.
  • Achieve latency reduction.

4. Performance and Cost Optimization

  • Deliver measurable improvements in system efficiency, cost, and maintainability.
  • Lead initiatives to reduce infrastructure footprint while enhancing throughput and reliability.

5. Leadership and Collaboration

  • Provide architectural guidance and technical leadership to development teams.
  • Partner with stakeholders to define solution strategies and roadmaps.
  • Mentor engineers in cloud architecture, containerization, and data engineering best practices.

Required Qualifications

  • 8+ years of experience in software engineering and data platform development.
  • Proven leadership in architecting and implementing ETL streaming and file mediation systems.
  • Strong expertise in Kubernetes, Docker, and cloud-native solution design.
  • Proficiency with data engineering frameworks and streaming technologies.
  • Track record of optimizing resource utilization, latency, and operational cost.
  • Strong problem-solving, communication, and leadership skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.