Senior ETL Developer – Job Description
Senior / Lead ETL Developer
Role Overview
We are seeking an experienced ETL Developer with 13+ years of IT experience to design, develop, implement, and support enterprise-scale data integration and ETL solutions. The ideal candidate should have strong expertise in ETL development, data warehousing, SQL, database technologies, performance tuning, and end-to-end data integration.
The candidate will work closely with business analysts, data architects, application teams, and technical stakeholders to deliver scalable and high-quality data solutions.
Key Responsibilities
- Design, develop, test, and deploy complex ETL/ELT workflows and data integration solutions.
- Develop robust data extraction, transformation, and loading processes from multiple source systems.
- Analyze business and technical requirements and translate them into scalable ETL solutions.
- Design and develop data warehouse, staging, dimensional, and reporting structures.
- Perform complex SQL development, query optimization, and database performance tuning.
- Develop reusable ETL frameworks, mappings, workflows, and transformation components.
- Implement data cleansing, validation, reconciliation, and error-handling processes.
- Monitor ETL jobs and troubleshoot production failures and data issues.
- Perform root-cause analysis and provide permanent solutions for recurring ETL issues.
- Optimize ETL processes for performance, scalability, and reliability.
- Work with large-volume datasets and complex data pipelines.
- Develop technical specifications, data mapping documents, and ETL design documentation.
- Collaborate with Data Architects, Business Analysts, QA teams, DBAs, and application developers.
- Participate in code reviews and ensure adherence to development and data quality standards.
- Support production releases, deployments, and post-production validation.
- Mentor junior and mid-level ETL developers and provide technical guidance.
- Participate in Agile/Scrum ceremonies, sprint planning, estimation, and technical discussions.
Required Technical Skills
- 13+ years of experience in ETL/Data Integration and software development.
- Strong hands-on experience with ETL tools such as Informatica, IBM DataStage, Talend, SSIS, Ab Initio, or equivalent.
- Strong expertise in SQL, PL/SQL, stored procedures, functions, and database programming.
- Extensive experience with Oracle, SQL Server, PostgreSQL, DB2, or other relational databases.
- Strong understanding of Data Warehousing concepts, including:
- Star and Snowflake Schema
- Fact and Dimension Tables
- Slowly Changing Dimensions (SCD)
- Data Marts
- Staging and ODS
- Incremental/Delta Loads
- Full and Initial Loads
- Experience with data profiling, data quality, data validation, and reconciliation.
- Strong understanding of ETL architecture, data integration patterns, and batch processing.
- Experience with Unix/Linux shell scripting.
- Experience with performance tuning of ETL jobs and database queries.
- Knowledge of scheduling and enterprise job-processing tools such as Control-M, Autosys, or equivalent.
- Experience with source control and CI/CD tools such as Git, Jenkins, Azure DevOps, or equivalent.
Cloud & Modern Data Technologies
- Experience working with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
- Exposure to cloud data services such as:
- AWS S3
- AWS Glue
- Redshift
- Azure Data Factory
- Azure Data Lake
- Databricks
- Snowflake
- BigQuery
- Knowledge of modern ETL/ELT and data pipeline architecture.
- Experience with distributed data processing technologies such as Spark/PySpark is a plus.
Preferred Skills
- Experience with Python for data processing and automation.
- Knowledge of Big Data technologies such as Hadoop, Hive, Spark, or Kafka.
- Experience with REST APIs and web-service-based data integration.
- Experience with CDC (Change Data Capture) and real-time/near-real-time data integration.
- Understanding of Data Governance, Metadata Management, and Master Data Management.
- Experience in enterprise-scale application migration and database modernization projects.
Soft Skills
- Strong analytical and problem-solving abilities.
- Excellent communication and interpersonal skills.
- Ability to work independently and collaboratively with cross-functional teams.
- Strong documentation and technical writing skills.
- Ability to manage multiple priorities in a fast-paced environment.
- Strong leadership and mentoring capabilities.
Education
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
Ideal Candidate
The ideal candidate will be a Senior/Lead ETL Developer with 13+ years of experience, strong hands-on ETL and SQL expertise, solid data warehousing knowledge, and experience working on large-scale enterprise data integration projects. Experience with cloud data platforms and modern ETL/ELT technologies will be highly preferred.
Never miss an opportunity! Create an alert based on the job you applied for.