Key Responsibilities:
Design and Architecture:
Design, develop, and maintain ETL processes using SQL and ETL tools.
Extract, transform, and load data from various data sources into data warehouses and data marts.
Implement data validation and error handling mechanisms.
Design, develop, and maintain SQL databases and queries.
Write and optimize complex SQL queries for data extraction and reporting.
Automate SSIS packages using SQL Agent.
Hands on experience with windows scheduler and bat file processing
Develop stored procedures, functions, and triggers to support application development.
Performance Monitoring and Optimization:
Optimize and tune ETL processes for performance and scalability.
Monitor and troubleshoot database issues to ensure high availability and performance.
Monitor and troubleshoot ETL processes to ensure data accuracy and integrity.
Stakeholder Collaboration:
Collaborate with data analysts and data scientists to understand data requirements and ensure data quality.
Best Practices and Standard
Develop and maintain documentation for ETL processes and data flows.
Participate in code reviews and provide feedback to ensure best practices are followed.
Stay up to date with industry trends and best practices in ETL and data integration.