Jr. Data Engineer (Snowflake & AWS)

We are seeking a talented Data Engineer with 2 4 years of experience in building and maintaining scalable data pipelines on the AWS Cloud using Snowflake. The ideal candidate should have hands-on experience with AWS data services, ETL/ELT development, cloud data warehousing, and data integration. The candidate will be responsible for designing, developing, and optimizing data pipelines that support business intelligence, analytics, and reporting initiatives.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services and Snowflake.
• Build robust data ingestion frameworks to load data from multiple sources, including relational databases, APIs, flat files, and cloud storage.
• Develop and optimize data models, schemas, and database objects in Snowflake.
• Implement data transformation logic using SQL, Snowflake Stored Procedures, and Snowpark (preferred).
• Load structured and semi-structured data (CSV, JSON, XML, Parquet, Avro) into Snowflake.
• Develop batch and incremental data processing pipelines using AWS services.
• Optimize Snowflake performance through clustering, query tuning, partitioning, and warehouse optimization.
• Integrate data from AWS S3 into Snowflake using Snowpipe, COPY INTO, or external stages.
• Monitor, troubleshoot, and resolve ETL failures and performance bottlenecks.
• Implement data quality checks, validation, and reconciliation processes.
• Collaborate with business analysts, data architects, and application teams to deliver high-quality data solutions.
• Follow coding standards, documentation practices, and data governance policies.
• Participate in Agile ceremonies, code reviews, and production support activities.

Required Technical Skills

Snowflake

• Strong hands-on experience with Snowflake Cloud Data Platform.
• Experience with Snowflake architecture, virtual warehouses, databases, schemas, stages, and file formats.
• Strong SQL development skills with query optimization techniques.
• Experience with Snowflake Tasks, Streams, Stored Procedures, Secure Views, and Time Travel.
• Experience using Snowpipe and COPY INTO commands for automated data ingestion.
• Knowledge of data sharing and role-based access control (RBAC).

AWS Data Engineering

• Amazon S3
• AWS Glue
• AWS Lambda
• Amazon Redshift (good to have)
• AWS IAM
• Amazon CloudWatch
• AWS Secrets Manager
• Amazon EventBridge or Amazon SNS/SQS (preferred)

ETL/ELT

• Design and development of ETL/ELT workflows.
• Data migration from on-premises systems to AWS Cloud.
• Experience with incremental loads and Change Data Capture (CDC).
• Experience scheduling and orchestrating workflows using AWS Glue Workflows or Apache Airflow (preferred).

Databases

• SQL Server
• Oracle
• PostgreSQL
• MySQL

Programming Languages

• SQL (Mandatory)
• Python (Mandatory)
• PySpark (Preferred)