Overview
Remote
Depends on Experience
Full Time
Accepts corp to corp applications
Skills
Cloud Computing
Apache Kafka
Artificial Intelligence
Prompt Engineering
kafka
Amazon Web Services
Continuous Integration
Continuous Delivery
Generative Artificial Intelligence (AI)
Kubernetes
Microsoft Power BI
Microsoft Azure
IBM WebSphere MQ
Job Details
Job Description: Job Title: Architect; Open Source Software (OSS) Kafka (SME)
Location: Remote/Eagan, MN
Location: Remote/Eagan, MN
Job Description:
Chosen resource must demonstrate these capabilities through actual work experience not merely training:
Hands-on experience designing and implementing kafka event streaming capabilities in applications and infrastructure across hybrid multi-cloud environments.
Experience producing IT technical artifacts, with an emphasis on kafka event streams, including design documents, architecture diagrams, architecture assessments, white papers, test plans, requirements mapping, and implementation plans.
In-depth knowledge of design principles and inner workings of kafka implementations and applicable use cases for migrating applications from legacy style tmodern style with the use of Event Streams and Async APIs.
Demonstrable knowledge of Apache Kafka, Confluent Platform, Confluent Cloud.
Demonstrable knowledge of Apache Strimzi, Confluent for Kubernetes.
Demonstrable knowledge of Cloud services with Kafka API compatibility (e.g. Azure Event Hub, Amazon MSK).
Demonstrable knowledge of Confluent Schema Registry and serialization using JSON and AVRschemas.
Demonstrable knowledge of kafka replication options including Mirror Maker, Confluent Cluster Linking and Schema Linking.
Demonstrable knowledge of Confluent Identity Mgmt and RBAC, integrated/federated with enterprise IDP & role management.
Demonstrable knowledge of Kafka Client APIs (Producer, Consumer, Streams).
Demonstrable knowledge of Kafka Connect and Connectors (e.g. JDBC, Cassandra, Google BigQuery, Websphere MQ, etc).
Demonstrable knowledge of sizing and capacity planning for kafka clusters.
Demonstrable knowledge of kafka topic partitioning strategies including partition key design strategies.
Chosen resource should exhibit through actual work experience not merely training:
Desirable: integrating kafka event streams with Agentic AI workflows.
Using design patterns for building scalable and maintainable applications/solutions.
Clearly document code, models, and technical solutions.
Proficiency in Generative AI and prompt engineering.
Continuous learning and adaptability in a very large IT organization
Communicating complex technical concepts tboth technical and executive stakeholders.
Troubleshooting software and technical implementations in large-scale enterprise ecosystems.
Understanding of concepts like CI/CD, containerization, and deployment strategies for kafka components in large-scale production environments.
Querying and managing data in both SQL and NoSQL databases.
Proficiency creating technical diagrams with products like Microsoft Visior Draw.io.
Proficiency creating technical design and architecture documents in Microsoft Word.
Proficiency creating business and technical presentations in Microsoft PowerPoint.
Proficiency creating data representations, charts and reports in tools such as Microsoft's Excel worksheets and Power BI.
Tasks might include (neither exhaustive nor restrictive):
Analysis support tintegrate new kafka cluster and event stream requirements intestablished large-scale, production enterprise architectures.
Conduct Design and Architecture assessments and provide written recommendations for integrating kafka event streams within an application domain or enterprise event brokering.
Troubleshoot production kafka event streams and software integration issues as top tier internal support, including review of performance issues and proposing resolutions.
Conduct research and provide written reviews of kafka ecosystem best practices and innovative strategies for hybrid multi-cloud high availability.
Conduct proof of concept activities and build prototypes for kafka technology stack components in sandbox environments tassess new capabilities.
Define and implement standards and patterns for kafka ecosystem life cycle, test-driven protection schemes, and automated implementation strategies.
Devise strategies and roadmaps for enterprise expansion of kafka ecosystem capabilities, integrations, and governance.
Strategy and compliance reviews and recommendations for enterprise kafka ecosystem elements which may include the following: architecture frameworks, databases, network, web and application architecture resources, backup and recovery, high availability, disaster recovery, patch management and analytics.
Education:
A minimum of thirteen (13) ttwenty (20) years' relevant experience.
A degree from an accredited College/University in the applicable field of services is preferred. four additional years of relevant experience in lieu of a college degree is required. If the individual's degree is not in the applicable field then four additional years of related experience is required.
Chosen resource must demonstrate these capabilities through actual work experience not merely training:
Hands-on experience designing and implementing kafka event streaming capabilities in applications and infrastructure across hybrid multi-cloud environments.
Experience producing IT technical artifacts, with an emphasis on kafka event streams, including design documents, architecture diagrams, architecture assessments, white papers, test plans, requirements mapping, and implementation plans.
In-depth knowledge of design principles and inner workings of kafka implementations and applicable use cases for migrating applications from legacy style tmodern style with the use of Event Streams and Async APIs.
Demonstrable knowledge of Apache Kafka, Confluent Platform, Confluent Cloud.
Demonstrable knowledge of Apache Strimzi, Confluent for Kubernetes.
Demonstrable knowledge of Cloud services with Kafka API compatibility (e.g. Azure Event Hub, Amazon MSK).
Demonstrable knowledge of Confluent Schema Registry and serialization using JSON and AVRschemas.
Demonstrable knowledge of kafka replication options including Mirror Maker, Confluent Cluster Linking and Schema Linking.
Demonstrable knowledge of Confluent Identity Mgmt and RBAC, integrated/federated with enterprise IDP & role management.
Demonstrable knowledge of Kafka Client APIs (Producer, Consumer, Streams).
Demonstrable knowledge of Kafka Connect and Connectors (e.g. JDBC, Cassandra, Google BigQuery, Websphere MQ, etc).
Demonstrable knowledge of sizing and capacity planning for kafka clusters.
Demonstrable knowledge of kafka topic partitioning strategies including partition key design strategies.
Chosen resource should exhibit through actual work experience not merely training:
Desirable: integrating kafka event streams with Agentic AI workflows.
Using design patterns for building scalable and maintainable applications/solutions.
Clearly document code, models, and technical solutions.
Proficiency in Generative AI and prompt engineering.
Continuous learning and adaptability in a very large IT organization
Communicating complex technical concepts tboth technical and executive stakeholders.
Troubleshooting software and technical implementations in large-scale enterprise ecosystems.
Understanding of concepts like CI/CD, containerization, and deployment strategies for kafka components in large-scale production environments.
Querying and managing data in both SQL and NoSQL databases.
Proficiency creating technical diagrams with products like Microsoft Visior Draw.io.
Proficiency creating technical design and architecture documents in Microsoft Word.
Proficiency creating business and technical presentations in Microsoft PowerPoint.
Proficiency creating data representations, charts and reports in tools such as Microsoft's Excel worksheets and Power BI.
Tasks might include (neither exhaustive nor restrictive):
Analysis support tintegrate new kafka cluster and event stream requirements intestablished large-scale, production enterprise architectures.
Conduct Design and Architecture assessments and provide written recommendations for integrating kafka event streams within an application domain or enterprise event brokering.
Troubleshoot production kafka event streams and software integration issues as top tier internal support, including review of performance issues and proposing resolutions.
Conduct research and provide written reviews of kafka ecosystem best practices and innovative strategies for hybrid multi-cloud high availability.
Conduct proof of concept activities and build prototypes for kafka technology stack components in sandbox environments tassess new capabilities.
Define and implement standards and patterns for kafka ecosystem life cycle, test-driven protection schemes, and automated implementation strategies.
Devise strategies and roadmaps for enterprise expansion of kafka ecosystem capabilities, integrations, and governance.
Strategy and compliance reviews and recommendations for enterprise kafka ecosystem elements which may include the following: architecture frameworks, databases, network, web and application architecture resources, backup and recovery, high availability, disaster recovery, patch management and analytics.
Education:
A minimum of thirteen (13) ttwenty (20) years' relevant experience.
A degree from an accredited College/University in the applicable field of services is preferred. four additional years of relevant experience in lieu of a college degree is required. If the individual's degree is not in the applicable field then four additional years of related experience is required.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.