Senior ETL Developer – Job Description

Senior / Lead ETL Developer

Role Overview

We are seeking an experienced ETL Developer with 13+ years of IT experience to design, develop, implement, and support enterprise-scale data integration and ETL solutions. The ideal candidate should have strong expertise in ETL development, data warehousing, SQL, database technologies, performance tuning, and end-to-end data integration.

The candidate will work closely with business analysts, data architects, application teams, and technical stakeholders to deliver scalable and high-quality data solutions.

Key Responsibilities

• Design, develop, test, and deploy complex ETL/ELT workflows and data integration solutions.
• Develop robust data extraction, transformation, and loading processes from multiple source systems.
• Analyze business and technical requirements and translate them into scalable ETL solutions.
• Design and develop data warehouse, staging, dimensional, and reporting structures.
• Perform complex SQL development, query optimization, and database performance tuning.
• Develop reusable ETL frameworks, mappings, workflows, and transformation components.
• Implement data cleansing, validation, reconciliation, and error-handling processes.
• Monitor ETL jobs and troubleshoot production failures and data issues.
• Perform root-cause analysis and provide permanent solutions for recurring ETL issues.
• Optimize ETL processes for performance, scalability, and reliability.
• Work with large-volume datasets and complex data pipelines.
• Develop technical specifications, data mapping documents, and ETL design documentation.
• Collaborate with Data Architects, Business Analysts, QA teams, DBAs, and application developers.
• Participate in code reviews and ensure adherence to development and data quality standards.
• Support production releases, deployments, and post-production validation.
• Mentor junior and mid-level ETL developers and provide technical guidance.
• Participate in Agile/Scrum ceremonies, sprint planning, estimation, and technical discussions.

Required Technical Skills

• 13+ years of experience in ETL/Data Integration and software development.
• Strong hands-on experience with ETL tools such as Informatica, IBM DataStage, Talend, SSIS, Ab Initio, or equivalent.
• Strong expertise in SQL, PL/SQL, stored procedures, functions, and database programming.
• Extensive experience with Oracle, SQL Server, PostgreSQL, DB2, or other relational databases.
• Strong understanding of Data Warehousing concepts, including:
  • Star and Snowflake Schema
  • Fact and Dimension Tables
  • Slowly Changing Dimensions (SCD)
  • Data Marts
  • Staging and ODS
  • Incremental/Delta Loads
  • Full and Initial Loads
• Experience with data profiling, data quality, data validation, and reconciliation.
• Strong understanding of ETL architecture, data integration patterns, and batch processing.
• Experience with Unix/Linux shell scripting.
• Experience with performance tuning of ETL jobs and database queries.
• Knowledge of scheduling and enterprise job-processing tools such as Control-M, Autosys, or equivalent.
• Experience with source control and CI/CD tools such as Git, Jenkins, Azure DevOps, or equivalent.

Cloud & Modern Data Technologies

• Experience working with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
• Exposure to cloud data services such as:
  • AWS S3
  • AWS Glue
  • Redshift
  • Azure Data Factory
  • Azure Data Lake
  • Databricks
  • Snowflake
  • BigQuery
• Knowledge of modern ETL/ELT and data pipeline architecture.
• Experience with distributed data processing technologies such as Spark/PySpark is a plus.

Preferred Skills

• Experience with Python for data processing and automation.
• Knowledge of Big Data technologies such as Hadoop, Hive, Spark, or Kafka.
• Experience with REST APIs and web-service-based data integration.
• Experience with CDC (Change Data Capture) and real-time/near-real-time data integration.
• Understanding of Data Governance, Metadata Management, and Master Data Management.
• Experience in enterprise-scale application migration and database modernization projects.

Soft Skills

• Strong analytical and problem-solving abilities.
• Excellent communication and interpersonal skills.
• Ability to work independently and collaboratively with cross-functional teams.
• Strong documentation and technical writing skills.
• Ability to manage multiple priorities in a fast-paced environment.
• Strong leadership and mentoring capabilities.

Education

Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.

Ideal Candidate

The ideal candidate will be a Senior/Lead ETL Developer with 13+ years of experience, strong hands-on ETL and SQL expertise, solid data warehousing knowledge, and experience working on large-scale enterprise data integration projects. Experience with cloud data platforms and modern ETL/ELT technologies will be highly preferred.