Lead Cloudera Consultant (Solution Architect)

Lead Cloudera Streaming Architect with deep, hands-on experience across the Cloudera CDP streaming stack, including NiFi, Kafka, Flink, Kudu/Impala, and SQL Stream Builder (SSB). This is a highly technical, architecture-plus-implementation role responsible for designing, delivering, and optimizing mission-critical real-time data pipelines at enterprise scale.

If you have personally built end-to-end CDP/CDF streaming pipelines and can execute complex ingestion, transformation, CDC, and Kudu write-path use cases on day one — this role is for you.

• Architect and build real-time data pipelines using the full Cloudera Data Platform (CDP) streaming suite:
• NiFi → Kafka → Flink → Kudu/Impala → SSB
• Own architectural decisions, patterns, and best practices for streaming, CDC, state management, schema evolution, and exactly-once delivery.
• Develop complex NiFi flows involving controller services (DBCP/JDBC), stateful processors, record processors, schema registry integrations, batch-to-stream conversions, and high-volume ingestion patterns.
• Build and optimize Flink SQL or DataStream API jobs with:
• ? Kafka sources/sinks
• ? event-time windows
• ? watermarks
• ? state management
• ? checkpointing / savepoints
• ? exactly-once guarantees
• Design and tune Kudu tables (PKs, partitioning, distribution, upserts, deletes, merges).
• Build and deploy streaming SQL jobs using Cloudera SQL Stream Builder (SSB).

Use Case Delivery

You must be able to deliver the following four core use cases immediately:

1. NiFi → Snowflake → Impala/Kudu ingestion pipeline
2. Kafka → Flink streaming (real-time processing)
3. Flink → Kafka sink with exactly-once semantics
4. CDC ingestion via NiFi, Flink CDC, or SSB (incremental keys, late events, deletes)

Optimization, Monitoring & Governance

• Tune NiFi, Kafka, and Flink clusters for performance, throughput, and stability.
• Implement schema governance, error handling, back-pressure strategies, and replay mechanisms.
• Work closely with platform engineers to optimize CDP components and CDF deployments.
• Provide architectural guidance, documentation, and mentorship to engineering teams.