Data Platform Architect - Apache Iceberg Lakehouse
Vision Square
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Data Platform
- Apache Iceberg
- Python
- Data Architecture
Summary
Position Summary
We are seeking a hands-on Principal Data Platform Architect to lead the design, implementation, and operationalization of an enterprise Apache Iceberg Lakehouse platform. This role combines enterprise architecture with deep platform engineering experience to build a scalable, cloud-native data platform supporting analytics, AI/ML, GenAI, streaming, and governed data products.
Key Responsibilities:
Define enterprise Lakehouse architecture, standards, governance, and implementation roadmap.
Design and build Apache Iceberg-based bronze, silver and gold data layers.
Develop ingestion frameworks for batch, streaming, CDC, APIs, and event-driven integrations.
Build scalable Spark, Flink, Kafka, dbt, SQL, and Python pipelines.
Implement metadata management, cataloging, lineage, RBAC, encryption, and data quality.
Optimize partitioning, compaction, snapshots, metadata, and query performance.
Enable AI-ready semantic layers, feature engineering, RAG, and GenAI workloads.
Implement Infrastructure as Code, CI/CD, monitoring, and observability.
Required Skills:
Apache Iceberg, Spark, Flink, Kafka, dbt, Trino, Snowflake, Databricks
AWS, Azure, or Google Cloud
Python, Scala, SQL, Java
Kubernetes, Docker, Terraform
Airflow, Dagster, or Prefect
Polaris, Unity Catalog, Glue Catalog, Apache Nessie
Preferred Qualifications:
12+ years designing enterprise data platforms.
Experience implementing Lakehouse architectures at enterprise scale.
Experience with petabyte-scale environments and AI/ML platforms.
Success Measures:
Deliver a production-ready Apache Iceberg Lakehouse.
Establish governance, data quality, and enterprise standards.
Enable self-service analytics and AI-ready governed data products.
- Dice Id: RTX1d0567
- Position Id: 9119479
- Posted 6 hours ago
Company Info
At Vision Square Inc, we believe that Great Workforce is the cause for phenomenal growth of the company. By combining the skill and experience of the founders and executives, Vision Square Inc follows a disciplined process of identifying quality candidates, partnering with employers to understand their core business and their employment requirements and delivering exceptional service, we achieve great results for all concerned.
Vision Square Inc is one of the fastest growing information technology consulting and services with superior value-priced consulting, contracting, permanent recruiting and placement services for both private and government sector clients.
Our vision is to provide complete quality services for all clients at all levels, while allowing the clients to remain focused on there core business. Our processes are robust and we invest heavily in our delivery models and ensure that our clients globally get uniformity of delivery and highest quality of service. Our clients rely on us to connect them with high caliber technology professionals and we ensure that they remain on top of the continually evolving technology landscape.