Lead Cloudera Consultant (Solution Architect)

Remote • Posted 1 hour ago • Updated 1 hour ago

Contract W2

No Travel Required

Able to Sponsor

Remote

Depends on Experience

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

API
Apache Flink
Apache Kafka
Apache NiFi
Change Data Capture
Cloudera
Cloudera Impala
Distribution
Documentation
IT Architecture
JDBC
Management
Mentorship
Microsoft Windows
Optimization
Real-time
Snow Flake Schema
SQL
Streaming
Use Cases
Apache NiFi (hands-on) Apache Kudu Apache Flink (hands-on development) Cloudera SQL Stream Builder (SSB) Cloudera CDP (Streaming / CDF) SQL-based CDC ingestion

Summary

Lead Cloudera Streaming Architect with deep, hands-on experience across the Cloudera CDP streaming stack, including NiFi, Kafka, Flink, Kudu/Impala, and SQL Stream Builder (SSB). This is a highly technical, architecture-plus-implementation role responsible for designing, delivering, and optimizing mission-critical real-time data pipelines at enterprise scale.

If you have personally built end-to-end CDP/CDF streaming pipelines and can execute complex ingestion, transformation, CDC, and Kudu write-path use cases on day one — this role is for you.

Architect and build real-time data pipelines using the full Cloudera Data Platform (CDP) streaming suite:
NiFi → Kafka → Flink → Kudu/Impala → SSB
Own architectural decisions, patterns, and best practices for streaming, CDC, state management, schema evolution, and exactly-once delivery.
Develop complex NiFi flows involving controller services (DBCP/JDBC), stateful processors, record processors, schema registry integrations, batch-to-stream conversions, and high-volume ingestion patterns.
Build and optimize Flink SQL or DataStream API jobs with:
? Kafka sources/sinks
? event-time windows
? watermarks
? state management
? checkpointing / savepoints
? exactly-once guarantees
Design and tune Kudu tables (PKs, partitioning, distribution, upserts, deletes, merges).
Build and deploy streaming SQL jobs using Cloudera SQL Stream Builder (SSB).

Use Case Delivery

You must be able to deliver the following four core use cases immediately:

NiFi → Snowflake → Impala/Kudu ingestion pipeline
Kafka → Flink streaming (real-time processing)
Flink → Kafka sink with exactly-once semantics
CDC ingestion via NiFi, Flink CDC, or SSB (incremental keys, late events, deletes)

Optimization, Monitoring & Governance

Tune NiFi, Kafka, and Flink clusters for performance, throughput, and stability.
Implement schema governance, error handling, back-pressure strategies, and replay mechanisms.
Work closely with platform engineers to optimize CDP components and CDF deployments.
Provide architectural guidance, documentation, and mentorship to engineering teams.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10205111
Position Id: 8875425
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.