Senior Data Engineer

Job Title: Senior Data Engineer

Experience Required: 10+ Years

We are seeking a highly skilled Senior Data Engineer with 10+ years of experience in designing, developing, and maintaining enterprise-scale data solutions. The ideal candidate will have strong expertise in data warehousing, ETL/ELT development, cloud platforms, big data technologies, and data modeling. The candidate will play a key role in building scalable data pipelines and supporting analytics, reporting, and AI/ML initiatives.

Key Responsibilities

• Design, develop, and optimize large-scale data pipelines and ETL/ELT processes.
• Build and maintain data warehouses, data lakes, and lakehouse architectures.
• Develop scalable solutions for batch and real-time data processing.
• Collaborate with business stakeholders, architects, data scientists, and analysts to gather requirements and deliver data solutions.
• Implement data quality, governance, security, and compliance standards.
• Optimize database performance, query tuning, and data processing workflows.
• Develop and maintain data models, metadata, and technical documentation.
• Monitor and troubleshoot production data pipelines and resolve performance bottlenecks.
• Mentor junior engineers and promote best practices in data engineering.
• Support cloud migration and modernization initiatives.

Required Skills

• Strong expertise in SQL and Python.
• Hands-on experience with Apache Spark, Kafka, Hadoop, and distributed data processing frameworks.
• Extensive experience with ETL/ELT tools such as Informatica, Talend, SSIS, Airflow, or dbt.
• Experience with cloud platforms (AWS, Azure, or Google Cloud Platform).
• Strong knowledge of Snowflake, Redshift, BigQuery, Synapse, or similar data warehouse technologies.
• Expertise in data modeling, data architecture, and database design.
• Experience with real-time streaming and event-driven architectures.
• Knowledge of CI/CD pipelines, Git, and DevOps practices.
• Strong understanding of data governance, security, and compliance standards.

Preferred Qualifications

• Experience with Databricks and Delta Lake.
• Exposure to AI/ML data pipelines and MLOps.
• Experience with Terraform or Infrastructure as Code (IaC).
• Cloud certifications (AWS, Azure, or Google Cloud Platform).
• Experience working in Agile/Scrum environments.

Education

• Bachelor''s or Master''s degree in Computer Science, Information Technology, Engineering, or a related field.