Lead Cloudera Consultant

Overview

Remote
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

(("Lead Cloudera Consultant" OR "Cloudera Architect" OR "Big Data Architect") AND (CDP OR Hadoop OR Kafka OR Flink OR Iceberg OR Snowflake) AND (CI/CD OR GitHub OR Datadog))

Job Details

  • Architecture & Design: Design and implement secure, scalable, and decoupled data pipelines across on-premises and cloud Cloudera platforms.
  • Provide architectural guidance for integrating message brokers (e.g., Kafka) and warehousing solutions (e.g., Snowflake Iceberg).
  • Development Support: Assist client teams with backlog execution and development of data products
  • Ensure end-to-end updates without negative impact on other data products.
  • Training & Knowledge Transfer: Develop and deliver tailored training sessions and materials for technical leads, data engineers, and architects.
  • Enable client teams to build, extend, and support pipelines independently.
  • Performance & Optimization: Implement cost-performance trade-offs to meet KPIs (e.g., data flow within 5 minutes at target resource cost).
  • Advise on cost optimization strategies during initial engagement phase.
  • Integration & Automation: Configure CI/CD pipelines using GitHub Actions.
  • Implement automated testing and logging (Datadog) for performance and error tracking.
  • Security & Compliance: Ensure secrets are managed securely using approved tools.
  • Document and transition all data flows, logic, and components to sustaining teams.
  • Proven experience as a Cloudera Solution Architect or Lead Consultant in enterprise environments.
  • Expertise in Cloudera CDP, Hadoop ecosystem, Kafka, Flink, and SSB.
  • Strong knowledge of data curation, metadata management, and schema design.
  • Hands-on experience with Snowflake Iceberg or similar warehousing technologies.
  • Proficiency in CI/CD automation (GitHub Actions) and logging tools (Datadog).
  • Familiarity with cloud and on-premises Cloudera deployments.
  • Excellent communication and training skills.
  • Cloudera Certified Professional or equivalent certifications.
  • Experience with secret management tools and enterprise security practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.