Big Data Engineer

Overview

Hybrid
Depends on Experience
Full Time
No Travel Required

Skills

Airflow
Big Data
Kafka
Python

Job Details

Greetings from ITC Infotech!

Role - Big Data Engineer

Location - Vancouver, BC

Start Date: Immediate

Job Description:

As a Big Data Engineer create and maintain the architecture and systems using distributed computing frameworks. Design and build integrations between internal systems to support planning, forecasting, and scenario modelling. Operationalize ML models for demand forecasting, inventory optimization, and supply chain analytics. Develop intuitive tools for planners and business users to interact with forecast, adjust plans, and simulate outcomes. Establish and maintain CI/CD pipelines using Gitlab to automate testing, deployment, and monitoring. Drive agile product development, working closely with Product, UX, and Planning teams to deliver high-impact features. Mentor engineers and promote best practices in architecture, testing, and DevOps.

Champion strong engineering practices, including:

  • Test-driven development (TDD)
  • Code reviews and pair programming
  • Scalable architecture and modular design
  • Observability, logging, and performance monitoring

Key Responsibilities:

  • Strong experience in software engineering, with 2+ years in technical leadership role.
  • Strong full stack development skills with modern frameworks (React, Next.js, Node.js).
  • Experience with Python (Pytest), Pandas, or ML libraries (e.g., Prophet, XGBoost, TensorFlow).
  • Experience with streaming frameworks such as Kafka
  • Knowledge of SQL, ETL, Data-warehousing and data-modelling techniques
  • Experience with Snowflake, Airflow, Postgres, or similar cloud offerings.
  • Proven experience implementing and managing CI/CD pipelines and automated testing frameworks.
  • Strong understanding of cloud infrastructure (AWS, Google Cloud Platform, or Azure).
  • Excellent communication and cross-functional collaboration skills.
  • Anaplan model building experience is a plus.

Education Qualification:

Bachelor s degree in computer science, Information Technology, or a related field (or equivalent experience).

About US:

ITC Infotech is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. ITC infotech is committed to providing veteran employment opportunities to our service men and women.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About ITC Infotech (USA), Inc