Overview
Skills
Job Details
Requirement: Automation Skills in ETL Space (SSIS, Snowflake, etc.)
The candidate must possess strong hands-on experience in automating ETL processes using tools and technologies such as:
ETL Automation: Proven ability to design, implement, and maintain automated ETL pipelines, ensuring data quality, consistency, and performance.
SSIS (SQL Server Integration Services): Advanced knowledge of developing, scheduling, and troubleshooting SSIS packages for data extraction, transformation, and loading from diverse data sources.
Snowflake: Experience in automating data workflows within Snowflake, including scripting, task management, and Snowpipe configurations for real-time or near real-time ingestion.
Scripting & Orchestration: Proficiency in scripting languages (e.g., Python, PowerShell, SQL) for task automation and integration, as well as experience with orchestration tools (e.g., Azure Data Factory, Airflow).
Monitoring & Error Handling: Ability to implement robust logging, error handling, and alerting mechanisms to ensure high availability and reliability of ETL workflows.
Performance Optimization: Skilled in optimizing ETL processes for large datasets, including parallel processing, indexing strategies, and minimizing data movement.
Version Control & CI/CD: Familiarity with using version control systems (e.g., Git) and integrating ETL processes into CI/CD pipelines for automated deployments.