Apache Iceberg Engineer

  • Pittsburgh, PA
  • Posted 20 hours ago | Updated 10 hours ago

Overview

On Site
BASED ON EXPERIENCE
Contract - W2
Contract - Independent

Skills

APACHE ICEBERG
PARQUET
ORC
TRINO
FLINK
SPARK
SQL
NOSQL
CASSANDRA
DYNAMODB
OPEN SOURCE
OPEN-SOURCE DEVELOPMENT
OPEN SOURCE SOFTWARE
PYTHON
SCALA
JAVA
APACHE AIRFLOW
APACHE KAFKA
AIRFLOW
KAFKA
LEAD
TECHNICAL LEAD
TEAM LEAD
SOFTWARE LEAD

Job Details

Location: Hybrid in Dallas, TX/Pittsburgh, PA/ Cleveland, OH/ Birmingham, AL/Phoenix, AZ

Remote:

 Largely remote, but must have access to an office location

Responsibilities

  • Act as Apache Iceberg SME
  • Design environment and architecture for Iceberg adoption
  • Build steps and lead implementation of new solution
  • Lead migration from Hadoop to Apache Iceberg (open source software)
Must-Have Technical Skills (6+ years, except Iceberg which is newer)
  • Open Source Development & Software
  • Data Formats: Apache Iceberg, Parquet, ORC (4-6 years)
  • Catalogs: JDBC, Nessie, Polaris
  • Programming Languages: Python, Scala, Java
  • Data Processing Frameworks: Spark, Trino, Flink
  • Databases: SQL, NoSQL (Cassandra, DynamoDB)
  • Workflow Orchestration: Apache Airflow, Apache Kafka

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.