Senior Big Data / Real-Time Data Engineer with AIRLINES Domain

Job Title: Senior Big Data Engineer – Real-Time Data (Airlines Domain)

Location: Westlake, TX.

Experience: 8+ Years

Job Summary:

We are looking for a Senior Big Data Engineer with strong expertise in real-time data pipelines, advanced analytics, and data science platforms, along with hands-on experience in the Airlines/Aviation domain. The ideal candidate will have a solid background in legacy and modern big data frameworks (e.g., Hadoop ecosystem) and experience handling high-volume, real-time airline data such as booking, flight operations, and customer analytics.

Key Responsibilities:

• Design and develop scalable real-time and batch data pipelines for airline data use cases
• Work with Big Data frameworks (Hadoop ecosystem, Spark, Hive, HDFS)
• Build streaming solutions using Kafka, Spark Streaming, Flink, etc.
• Process and analyze high-volume airline data (PNR, reservations, ticketing, flight operations, loyalty programs)
• Collaborate with data science and analytics teams to enable predictive modeling and insights
• Optimize data workflows for performance, scalability, and reliability
• Implement data integration, transformation, and orchestration pipelines
• Ensure data quality, governance, and compliance standards

Required Skills:

• Strong experience with Big Data technologies (Hadoop, Spark, Hive, HDFS)
• Expertise in real-time data processing frameworks (Kafka, Spark Streaming, Flink)
• Proficiency in Python, Java, or Scala
• Experience with analytics and data science platforms
• Strong understanding of distributed systems and data architecture
• Experience with SQL and NoSQL databases
• Hands-on with ETL/ELT tools and workflow orchestration (Airflow, etc.)

Airlines Domain Experience (Mandatory):

• Experience working with Airlines/Aviation clients or projects
• Knowledge of airline data systems such as:
• Passenger Service Systems (PSS)
• Reservation/Ticketing systems (PNR, GDS)
• Flight operations and scheduling systems
• Loyalty and customer analytics platforms
• Understanding of airline KPIs like load factor, revenue management, on-time performance

Preferred Qualifications:

• Experience with cloud platforms (AWS, Azure, or Google Cloud Platform) and related data services
• Familiarity with Data Lake / Lakehouse architectures (Databricks, Delta Lake, Snowflake)
• Exposure to machine learning pipelines / MLOps

Experience with Docker, Kubernetes