Lead Data Engineer Enterprise Data Platforms

Overview

Hybrid
$50 - $60
Contract - W2

Skills

Ansible
Apache Flink
Apache Hive
Apache Kafka
Apache NiFi
Cloud Computing
Cloudera
Data Governance
Databricks
Git
Data Engineering
Java
Jenkins
Kerberos
Snow Flake Schema
Microsoft Azure
Microservices
RBAC
Grafana
JIRA
Terraform
Continuous Integration
Good Clinical Practice
Google Cloud Platform
Management

Job Details


Key Responsibilities
Develop and implement data governance frameworks and policies
Design, build, and modernize secure, scalable data platforms (Kafka, Confluent, NiFi, Java microservices)
Ensure compliance (GDPR, CCPA) and integrate governance tools
Lead team onboarding, enablement, and technical guidance
Define and support SLAs, SLOs; automate ops and manage CI/CD (Ansible, Terraform, Jenkins)
Deploy monitoring and security (Prometheus, Grafana, ELK, OpenTelemetry, RBAC, Ranger, TLS, OAuth, Kerberos)
Integrate platform with enterprise tools (Git, JIRA, Vault, Snowflake, Databricks, Hive, ServiceNow)
Partner with architects to align data platform with enterprise IT strategy
Requirements
10+ years in data engineering, platform architecture, or DevOps
Bachelor s/Master s in Computer Science, Engineering, or related field
Expertise: Kafka, Confluent, NiFi, Java microservices, cloud-native architectures
Strong data governance and compliance experience
Hands-on with infrastructure-as-code, CI/CD, monitoring/observability
Excellent communication and stakeholder management
Certifications: Confluent, Cloudera, AWS/Google Cloud Platform/Azure, Kubernetes
Stream processing experience (ksqlDB, Kafka Streams, Flink)

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Learn Beyond Consulting LLC