Overview
Remote
60 - 80
Contract - Independent
Contract - 1 Month(s)
No Travel Required
Unable to Provide Sponsorship
Skills
Apache Kafka
Oracle Db
Streaming
Oracle
Xstream connector
Xstream
confluent kakfa
Job Details
We are currently evaluating a data streaming solution where Oracle CDC using XStream will be used to stream data into a downstream system via Confluent Kafka. Given the complexity and scale of this setup, we are looking for an architect who has hands-on experience with the Confluent Kafka Oracle CDC XStream connector.This is not a trivial integration. The source Oracle system produces about 5TB of archive logs, and we expect to stream data at a peak rate of around 10 Mbps. The architecture must account for best practices in:1) Confluent-managed Kafka usage (scalability, fault tolerance, etc.)
2) Error handling and retries
3) Notification and alerting mechanisms
4) Source system optimizations, including:
a) Use of multiple outbound servers
b) SGA allocation and tuning
c) Monitoring of the Streams PoolGiven the involvement of multiple moving parts—Oracle DB, Capture Process, Streams Queue, XStream Outbound Server, and the Kafka Connector—we need someone who can provide architectural guidance to ensure a robust, performant, and maintainable setup.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.