Data Engineer

Job Title: Data Engineer

Location: Downtown Chicago, IL - Willis Tower

Duration: 10 Months

Work Arrangement: Onsite - 3 to 4 days per week

Interview Process: 2 Rounds (Video Interview followed by In-Person Interview)

C2C: Not preferred by the client manager

Key Responsibilities

• Design, develop, and support large-scale data pipelines in distributed and scalable environments.
• Enable and optimize AWS production environments for data infrastructure and frameworks.
• Develop reusable Terraform modules to automate infrastructure deployments.
• Work with Databricks and data lake technologies.
• Design and develop batch and streaming data applications using AWS technologies.
• Collaborate with development teams, business stakeholders, and department leaders to deliver innovative technical solutions.
• Provide technical leadership, architectural guidance, and troubleshooting support to the team.
• Perform root cause analysis and resolve complex data and infrastructure issues.
• Coordinate cross-functional projects involving internal teams, vendors, and external partners.
• Manage multiple deliverables while adapting to changing business priorities.
• Collaborate with project managers, product owners, and development leads to support Agile development and delivery.

Required Qualifications

• Bachelor's degree in Statistics, Software Engineering, Business Analytics, Information Systems, Aviation Management, or a related field.
• Minimum 5 years of experience in Data Engineering or ETL Development.
• Strong experience with AWS cloud services, including:
  • Amazon Redshift
  • Amazon S3
  • Amazon Athena
  • AWS Glue
  • AWS Lambda
• Strong hands-on experience with Python, Bash scripting, and PySpark.
• Experience with Terraform and infrastructure automation.
• Strong understanding of DevOps practices and CI/CD pipelines.
• Experience with SQL and database tools such as:
  • SQL Server
  • SSMS
  • Oracle SQL Developer
  • BigQuery
• Knowledge of Apache Airflow and Databricks.
• Experience working with structured, semi-structured, and unstructured datasets.
• Strong analytical, troubleshooting, and problem-solving skills.
• Experience performing root cause analysis on data and business processes.
• Ability to develop data models and data-driven solutions.
• Excellent communication, presentation, and stakeholder management skills.
• Proficiency in Microsoft Excel and PowerPoint.
• Ability to work under pressure and manage multiple priorities.
• Fluent in written and spoken English.
  

  Preferred Qualifications

• Master's degree in a relevant field.
• AWS Certification.
• Experience with Blue-Green deployments.
• Knowledge of Kubernetes and Ansible Playbooks.
• Experience with Quantum Metric and Akamai.
• Programming experience in Python and R.
• Strong experience with Continuous Integration and Continuous Delivery (CI/CD).
• Experience working in Agile development environments.
• Data Engineering experience in the airline or transportation industry.

• Interview Process

• Round 1: Video Interview
• Round 2: In-Person Interview

• Important Work Location Requirement

  This is an onsite position in Downtown Chicago at Willis Tower.

  Candidates are expected to work onsite 3-4 days per week. Candidates must be comfortable with the hybrid onsite schedule and attending in-person interviews in Chicago.