ETL Developer Lead

Job Summary

Skilled SQL BI Developer responsible for designing, developing, and maintaining ETL processes to support our data integration and data warehousing needs. Will work closely with data analysts, data scientists, and other stakeholders to ensure data is accurately and efficiently processed and available for analysis.

Key Responsibilities

Key Responsibilities:

Design and Architecture:

Design, develop, and maintain ETL processes using SQL and ETL tools.

Extract, transform, and load data from various data sources into data warehouses and data marts.

Implement data validation and error handling mechanisms.

Design, develop, and maintain SQL databases and queries.

Write and optimize complex SQL queries for data extraction and reporting.

Automate SSIS packages using SQL Agent.

Hands on experience with windows scheduler and bat file processing

Develop stored procedures, functions, and triggers to support application development.

Performance Monitoring and Optimization:

Optimize and tune ETL processes for performance and scalability.

Monitor and troubleshoot database issues to ensure high availability and performance.

Monitor and troubleshoot ETL processes to ensure data accuracy and integrity.

Stakeholder Collaboration:

Collaborate with data analysts and data scientists to understand data requirements and ensure data quality.

Best Practices and Standard

Develop and maintain documentation for ETL processes and data flows.

Participate in code reviews and provide feedback to ensure best practices are followed.

Stay up to date with industry trends and best practices in ETL and data integration.

Skill Requirements

Preferred Skills:

Proven experience as an SQL ETL Developer or similar role.

Strong proficiency in SQL and experience with ETL tools (e.g., SSIS, Informatica, Talend).

Experience with data warehousing concepts and technologies.

Knowledge of database management systems (e.g., SQL Server, Oracle, MySQL).

Familiarity with data visualization tools (e.g., Tableau, Power BI).

Knowledge of scripting languages (e.g., Python, Shell scripting, C#).

Strong problem-solving and analytical skills.

Excellent communication and collaboration skills.

Ability to work independently and as part of a team.