Senior Iceberg DBA / Lakehouse Operations Engineer
Transcend IT Solutions
Dice Job Match Score™
⭐ Evaluating experience...
Job Details
Skills
- Apache Iceberg
- Iceberg Administration
- Lakehouse Operations
- Data Operations
- Big Data
- Data Engineering
- Cloudera CDP
- Cloudera Data Platform
- Iceberg Table Optimization
- Compaction
- Metadata Management
- Partition Evolution
- Spark
- Spark SQL
- Hive
- Impala
- Trino
- NiFi
- Performance Tuning
- Query Optimization
- Data Modeling
- Medallion Architecture
- Data Lake
- Lakehouse Architecture
- Distributed Data Processing
- Partitioning Strategies
- Parquet
- ORC
- Large Scale Data (TB/PB)
- Production Support
- P1 P2 Incident Handling
- Data Migration
- Hive to Iceberg Migration
- Teradata to Iceberg Migration
- Data Governance
- Data Standards
- Cloudera CDE
- Cloudera CDW
- AWS
- Azure
- Python
- Shell Scripting
Summary
• 10+ years of experience in Big Data / Data Engineering / DBA / Data Operations roles
• Minimum 2+ years of hands-on experience with Apache Iceberg in production environments
• 6+ years of experience working with Cloudera ecosystem (CDP Ecosystem)
• Strong expertise in:
o Iceberg table optimization (compaction, metadata management, partition evolution)
o Multi-engine performance tuning (Spark, Hive, Impala)
o Troubleshooting complex data and query performance issues
• Proven experience handling:
o P1/P2 production incidents
o Large-scale environments (TB/PB scale)
o Data migration initiatives (Hive/Teradata → Iceberg)
• Lead enforcement of data modeling and Lakehouse standards across applications
• Guide teams on:
o Medallion architecture implementation
o Balancing normalization vs performance
• Review and resolve complex data modeling and performance trade-offs
• Ensure consistency of data structures across domains and workloads
• Mentor and guide L2 resources in operational best practices and troubleshooting
Required Skills
• Strong hands-on experience with Apache Iceberg and/or Hive-based data lakes
• Understanding of data modeling concepts (normal forms) and modern Lakehouse patterns (Medallion architecture)
• Expertise in:
o Table-level optimization and performance tuning
o Large-scale data management (TB/PB scale)
• Experience with:
o Spark SQL, Hive, Impala, NiFI, Trino
• Strong understanding of:
o Partitioning strategies
o File formats (Parquet/ORC)
o Distributed query processing
Preferred Skills
• Experience with:
o Hive-to-Iceberg or Teradata-to-Iceberg migration
o Cloudera CDP (CDE/CDW)
• Familiarity with:
o Cloud platforms (AWS, Azure)
• Scripting/automation (Python, Shell)
- Dice Id: 91140092
- Position Id: TIS040526
- Posted 2 hours ago
Company Info
About Transcend IT Solutions
Our business model has scaled to successful heights on account of the long-lasting and loyal relationship with our clients, partners and candidates who have been pillar foundation of why Transcend IT Solutions is a market leader.
Our team has an outstanding track record of success in project staffing, project development and management, and consulting services. With firsthand experience in these areas, we have a sound understanding of our client’s needs.
Transcend IT Solutions provides assistance with staffing for all Information Technology roles. Providing the best-fit person of the highest caliber is our recruiting team’s goal. Our success is based on longevity of client-candidate relationships. Whether it is an individual team member or an entire team, Transcend IT Solutions will assist you with your staffing needs.
Our consulting services cover all aspects of Information Technology. Our expert consultants provide expertise in the areas of project management, requirement gathering and management, analysis and design, construction, quality control and assurance, and system deployment. As well as being individual contributors, our consultants also provide mentoring, process improvement expertise, and reviews and audits of existing projects.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs