Data Stage Developer

A DataStage Developer is a specialized data engineer who works with IBM InfoSphere DataStage, a powerful ETL (Extract, Transform, Load) tool used for building and managing data integration pipelines. Their role is to design, develop, and optimize workflows that move and transform data across enterprise systems.

Responsibilities

• ETL Development: Build and maintain DataStage jobs to extract data from multiple sources, transform it, and load it into target systems (data warehouses, lakes, or marts).
• Data Integration: Connect heterogeneous systems (databases, flat files, APIs, cloud platforms).
• Performance Optimization: Tune jobs for efficiency, scalability, and reliability.
• Error Handling & Debugging: Implement logging, error recovery, and monitoring.
• Collaboration: Work with data architects, analysts, and business teams to ensure data quality and availability.

Required Skills

• IBM InfoSphere DataStage (parallel jobs, server jobs, sequences).
• SQL & Database Expertise (Oracle, DB2, SQL Server, Teradata, etc.).
• Scripting (Unix/Linux shell scripting, Python for automation).
• Data Warehousing Concepts (star schema, snowflake schema, dimensional modeling).
• ETL Best Practices (incremental loads, CDC, error handling).
• Cloud & Big Data Integration (increasingly with AWS, Azure, Google Cloud Platform, Hadoop, Spark).
• Migrating legacy data into modern data warehouses.
• Integrating multiple enterprise systems for reporting and analytics.
• Ensuring data quality and consistency across business units.
• Supporting BI tools (Tableau, Power BI, Cognos) with clean, reliable data.