Big Data Integration/IOT Tech Lead

Job Title: Big Data Integration / IoT Tech Lead

Job Summary

We are seeking an experienced Big Data Integration / IoT Tech Lead to architect, design, and lead the implementation of scalable data integration and IoT data platforms. This role is responsible for end-to-end ownership of data ingestion, processing, and analytics pipelines that handle high-volume, high-velocity IoT and enterprise data. The ideal candidate combines strong technical leadership with hands-on expertise in big data, cloud platforms, and IoT ecosystems.

Key Responsibilities

• Technical Leadership:
  Lead the design and delivery of Big Data and IoT integration solutions; provide technical guidance to development teams.
• Architecture & Design:
  Define scalable, secure, and fault-tolerant architectures for IoT data ingestion, streaming, storage, and analytics.
• IoT Data Integration:
  Integrate data from IoT devices, sensors, gateways, and enterprise systems using real-time and batch pipelines.
• Big Data Pipelines:
  Design and implement ETL/ELT pipelines for structured and unstructured data using modern big data frameworks.
• Streaming & Real-Time Processing:
  Build and manage real-time data processing solutions for telemetry, alerts, and operational analytics.
• Cloud & Platform Management:
  Deploy and optimize big data and IoT solutions on cloud platforms (AWS, Azure, or Google Cloud Platform).
• Performance & Scalability:
  Ensure high availability, low latency, and scalability of data platforms handling massive data volumes.
• Security & Governance:
  Implement data security, access controls, and governance standards for IoT and enterprise data.
• Collaboration:
  Work closely with product owners, data scientists, architects, and business stakeholders to translate requirements into technical solutions.
• Mentoring & Code Review:
  Mentor engineers, enforce best practices, and conduct design and code reviews.
• Innovation & Continuous Improvement:
  Stay current with emerging trends in IoT, big data, cloud services, and analytics technologies.

Required Skills & Qualifications

• Big Data Technologies:
  Strong experience with Hadoop ecosystem, Spark, Kafka, Flink, or similar frameworks.
• IoT Platforms & Protocols:
  Experience with IoT platforms and protocols such as MQTT, AMQP, OPC-UA, REST APIs.
• Data Integration:
  Expertise in building batch and streaming data pipelines; experience with ETL tools and custom integrations.
• Cloud Platforms:
  Hands-on experience with AWS (Kinesis, IoT Core, EMR), Azure (IoT Hub, Event Hubs, Databricks), or Google Cloud Platform equivalents.
• Databases & Storage:
  Experience with data lakes, NoSQL databases (Cassandra, MongoDB), and time-series databases.
• Programming:
  Proficiency in Java, Scala, Python, or similar languages.
• DevOps & Automation:
  Experience with CI/CD pipelines, containerization (Docker, Kubernetes), and infrastructure as code.
• Leadership & Communication:
  Strong ability to lead technical teams and communicate complex concepts to non-technical stakeholders.

Education & Experience

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 8+ years of experience in big data engineering or data integration roles.
• 3+ years in a technical lead or architecture role involving IoT or large-scale data platforms.

Preferred Qualifications

• Experience with edge computing and device lifecycle management.
• Exposure to advanced analytics, AI/ML pipelines, or digital twin solutions.
• Knowledge of data governance, compliance, and industry standards (e.g., ISO, GDPR).
• Experience in industries such as manufacturing, energy, automotive, healthcare, or smart cities.