Data Engineer with Python, Flink and Starburst-Hybrid-Full time

We are seeking an experienced Senior Data Engineer to design and implement scalable, high-performance data platforms supporting real-time streaming and analytical workloads. The ideal candidate will have strong expertise in Apache Flink, Iceberg-based Lakehouse architecture, and federated query engines like Starburst/Trino, along with solid programming skills in Java, Python, and Scala.

Key Responsibilities

• Design, develop, and maintain real-time data streaming pipelines using Apache Flink.

• Implement Lakehouse architectures leveraging Apache Iceberg for scalable data storage and ACID transactions.

• Enable federated data access and distributed analytics using Starburst/Trino.

• Develop robust ETL/ELT pipelines using Java, Python, or Scala.

• Integrate streaming and batch data pipelines with cloud platforms (AWS, Azure, or Google Cloud Platform).

• Optimize performance across distributed systems, queries, and storage layers.

• Implement data quality checks, monitoring, logging, and governance standards.

• Work with Kafka for real-time data ingestion and event-driven architectures.

• Deploy containerized applications using Docker and Kubernetes.

• Mentor junior engineers and contribute to overall data platform architecture strategy.

Required Skills & Qualifications

• 7+ years of experience in Data Engineering and distributed data platforms.

• Strong hands-on experience with Apache Flink, Apache Iceberg, and Starburst/Trino.

• Strong programming skills in Java, Python, and/or Scala (mandatory).

• Advanced SQL knowledge and query optimization experience.

• Experience with Kafka and streaming architectures.

• Experience working with cloud-native data services (AWS, Azure, or Google Cloud Platform).

• Understanding of distributed systems and large-scale data processing.

Preferred Qualifications

• Experience in financial services or banking domain.

• Exposure to Delta Lake, Apache Hudi, and Airflow.

• Cloud certifications (AWS, Azure, or Google Cloud Platform).

• Experience designing enterprise-grade Lakehouse architectures.