Data Engineer

Job Title: Data Engineer

Introduction

We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data platforms. The ideal candidate will have strong experience with SQL, Python, cloud technologies, ETL/ELT processes, data warehousing, and distributed data processing.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines.
• Develop reliable data ingestion and transformation workflows using Python and SQL.
• Build and optimize data warehouses, data lakes, and data marts.
• Work with large datasets using technologies such as Spark, PySpark, or similar distributed processing frameworks.
• Develop data pipelines using cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Implement data quality, validation, monitoring, and error-handling processes.
• Optimize SQL queries, data models, and pipeline performance.
• Integrate data from APIs, databases, SaaS applications, and other structured/unstructured sources.
• Collaborate with Data Scientists, BI Developers, Analysts, Software Engineers, and business stakeholders.
• Implement CI/CD, version control, testing, and deployment best practices for data engineering workflows.
• Ensure data security, governance, privacy, and compliance requirements are followed.
• Troubleshoot data pipeline failures and resolve production issues.

Requirements

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• 10+ years of professional experience in data engineering or a related field.
• Strong proficiency in SQL and Python.
• Experience developing ETL/ELT pipelines and working with data integration tools.
• Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with data warehousing technologies such as Snowflake, BigQuery, Redshift, or Azure Synapse.
• Experience with Apache Spark/PySpark or other distributed processing technologies.
• Familiarity with Git, CI/CD, Docker, and Agile development practices.
• Strong analytical, troubleshooting, and communication skills.