Lead Cloudera Consultant
Chicago, IL, US • Posted 3 days ago • Updated 3 days agoDice Job Match Score™
⭐ Evaluating experience...
Job Details
Skills
- Health Care
- JSON
- SQL*Plus
- Snow Flake Schema
- Streaming
- Telecommunications
- Apache Flink
- Apache Kafka
- Apache NiFi
- ATLAS
Summary
Lead Cloudera Consultant
Chicago, IL
Job Description:
You must have hands-on, production-grade experience with ALL of the following:
Cloudera CDP / CDF
- CDP Public Cloud or Private Cloud Base
- Cloudera Flow Management (NiFi + NiFi Registry)
- Cloudera Streams Messaging (Kafka, SMM)
- Cloudera Stream Processing (Flink, SSB)
- Kudu / Impala ecosystem
Apache NiFi (Advanced)
- Building complex flows (not just admin/ops)
- QueryDatabaseTable / GenerateTableFetch / Merge Record
- Record-based processors & schema registry
- JDBC / DBCP controller services
- Stateful processors & incremental ingestion
- NiFi Snowflake integration
- NiFi Kudu ingestion patterns
Apache Kafka
- Kafka brokers, partitions, retention, replication, consumer groups
- Schema registry (Avro/JSON)
- Designing topics for high-throughput streaming
Apache Flink
- Flink SQL + DataStream API
- Event-time processing, watermarks, windows
- Checkpointing, save points, state backends
- Kafka source/sink connectors
- Exactly-once semantics
- Flink CDC a plus
Apache Kudu
- Table design (PKs, partition strategies)
- Upserts, deletes, merge semantics
- Integration with Impala
SQL Stream Builder (SSB)
- Creating jobs, connectors, materialized views
- Deploying and monitoring Flink SQL jobs in CDP
CDC (Change Data Capture)
- CDC via NiFi or Flink CDC or SSB
- Handling late-arriving events
- Handling deletes, updates, schema evolution
- Incremental key tracking
General Requirements
- 11+ years in data engineering / streaming
- 3 5+ years specifically with CDP/CDF streaming
- Strong SQL and distributed system fundamentals
- Experience in financial services, healthcare, telecom, or other high-volume industries preferred
Nice to Have
- Kubernetes experience running NiFi/Kafka/Flink operators
- Snowflake ingestion patterns (staging, Copy Into)
- Experience with Debezium
- CI/CD for data pipelines
- Security (Kerberos, Ranger, Atlas)
- Dice Id: RTX16eb70
- Position Id: 8899668
- Posted 3 days ago
Company Info
We are a global consulting, technology services, training and outsourcing company. By using leading technologies and providing a solution tailored to organization's needs, we can help companies and governments increase productivity, improve business outcomes and support greater business agility.
We collaborates with clients to help them become high-performance businesses.We focuses on integrated end-to-end outsourcing and delivers transformational benefits to its clients through reduced costs, ongoing productivity improvements, and process reengineering.
We address your business challenges and unlocks business value by applying proven process methodologies with integrated IT solutions and applies business excellence frameworks to enhance effectiveness and optimize business processes.
Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs