Sr. Kafka Engineer

Overview

On Site
$DOE
Full Time

Skills

Kafka

Job Details

Kafka Engineer

Richardson, TX
Fulltime (Permanent)

Day 1 Onsite Job

Job Description:

  • Lead and work as Architect on Kafka Capacity planning, installation, administration/Platform management, performance optimization of Kafka partitioning and Kafka brokers.
  • Lead on Kafka Cluster, Partitions, Security, Disaster recovery, Data pipeline, Data replication.
  • Lead on Operational management of the Confluent Kafka platform.
  • Lead on tuning Kafka partitioning. Performance optimization with Kafka brokers.
  • Lead and Architect Self-Managed Kafka connectors.
  • Lead on deploying confluent Kafka cluster which includes Installation, Configuration, Deployment, Securing, Monitoring and Troubleshooting.
  • Work on administrating confluent Kafka.
  • Lead on optimization of Kafka cluster using performance tuning at different levels (Producer, broker, and consumer).
  • Design and automate the daily operations of the Event Streaming Environments, as well as architecting additional tools for integrating with the Event Streaming environment.
  • Analyze current information technology environments to identify and assess critical capabilities and recommend solutions.
  • Provide research and development activities for architecture.
  • Collaborate with engineering and development teams to evaluate and identify optimal cloud solutions for confluent connectivity.
  • Collaborate with Project Managers and technical leads to provision estimates, develop overall implementation solution plan, and serve as a lead as required. Provide lab and vendor support.
  • Provide guidance for enterprise-wide technology to junior staff.
  • Develop frameworks, standards & reference material for architecture and associated products.
  • Develop & maintain common services, repositories & utility components for the enterprise.
  • Provide data, application & technology deliverables on a program & project level basis including risk & opportunity assessment, modeling and design related products and services.
  • Effectively communicate the architecture to all levels of the organization.
  • Adhere to enterprise architecture strategies, principals, standards, policies, and procedures.