Dear Applicants,
Greetings!
We currently have an opening for the position of Senior ETL Developer with Data stage and Enterprise Data Integration. Candidates must have strong experience working with government agencies.
If you are interested and meet the requirements, please share your updated resume along with your contact details.
Email: shahATSprucetechDOTcom
Contact: (Nine Seven Three) (Five Two Eight) (Five Seven Seven Three)
We look forward to hearing from you.
Title: Senior ETL Developer with 15 years experience
Mandatory Skills Focus: IBM DataStage & Enterprise Data Integration
Location: New York city, NY - look somebody local to NY/NJ
Client: New York city Department of Correction
Rate:$..?/hr c2c
Job description:
Seeking a highly skilled and analytical Senior ETL Developer to join our Information Technology Division and support enterprise data integration, ETL development, and data warehouse initiatives. The primary objective of this role is to design, develop, deploy, maintain, and optimize robust IBM DataStage ETL solutions supporting agency databases, data warehouses, cross-agency data exchanges, vendor feeds, and open-data initiatives. The ideal candidate will have strong hands-on experience with IBM DataStage 11.7.x+, Linux/Shell scripting, DB2, SQL Server, and complex SQL development.
This role requires an individual who can independently troubleshoot production ETL processes, participate in UAT and System Integration Testing, collaborate with QA, DBA, architecture, and application development teams, and contribute to the continuous improvement of the organization's data architecture and development practices.
Key Responsibilities
• ETL Development & Architecture: Design, develop, and maintain scalable and reliable ETL jobs using IBM DataStage, following established technical specifications, architecture standards, coding standards, and development best practices.
• DataStage Job Design: Develop complex DataStage parallel jobs, job sequences, transformations, mappings, and data integration workflows to support enterprise data movement and business requirements.
• Production Support: Troubleshoot DataStage job failures, investigate root causes, resolve production issues, and provide ongoing operational support for existing ETL processes.
• Data Integration: Develop ETL solutions for data exchanges between agency databases, data warehouses, external agencies, vendors, and open-data platforms.
• Job Deployment: Manage and execute DataStage job deployments across development, testing, UAT, and production environments, ensuring appropriate configuration and release procedures are followed.
• Performance Optimization: Monitor ETL processes, identify performance bottlenecks, optimize DataStage jobs and SQL queries, and implement improvements to increase processing efficiency and reliability.
• SQL & Database Development: Develop complex SQL queries and perform data validation, transformation, reconciliation, and optimization across DB2 and SQL Server environments.
• File Transfer Automation: Develop and maintain Linux shell scripts and file-transfer processes to securely exchange data files with internal business units, external agencies, and third-party vendors.
• Testing & Quality Assurance: Perform developer-level testing of DataStage jobs and collaborate closely with QA teams to ensure ETL functionality, data quality, integration points, and defect resolutions are thoroughly validated.
• UAT & System Integration Testing: Support User Acceptance Testing (UAT) and participate in System Integration Testing (SIT) to validate end-to-end data flows and application integrations.
• Technical Documentation: Create and maintain technical design documents, ETL specifications, data-flow documentation, deployment documentation, troubleshooting guides, and other technical artifacts.
• Architecture & Continuous Improvement: Contribute to the evolution of the organization's data architecture, ETL technology stack, development methodologies, and engineering processes.
• Cross-Functional Collaboration: Partner with solution architects, application developers, DBAs, QA engineers, technical staff, operations managers, project managers, and business stakeholders to define and implement effective data integration solutions.
• Mentorship: Mentor junior ETL developers, conduct knowledge-sharing sessions, promote development best practices, and provide technical guidance on DataStage and data integration solutions.
Required Skills & Qualifications
• Experience: 10+ years of dedicated professional experience utilizing IBM DataStage (version 11.7.x and higher) for enterprise data integration.
• OS & Scripting: Strong, non-negotiable proficiency in Linux operating systems and Linux shell scripting.
• Data Integration Tools: Practical hands-on experience utilizing Kettle alongside DataStage.
• Database & Querying: Advanced proficiency in IBM DB2 and SQL Server, with a proven ability to write complex SQL queries for data-driven validation and optimization.
• Development Methodologies: Well-versed in modern software development methodologies including Agile, Scrum, and Iterative frameworks.
• Problem Solving & Independence: Self-motivated and self-directed learner with the exceptional ability to adapt to a constantly changing environment, handle multiple tasks simultaneously, and deliver end-to-end solutions with minimal supervision.
• Communication & Teamwork: Strong interpersonal skills coupled with articulate verbal and written communication abilities to collaborate effectively across technical and non-technical teams.
• Testing: Experience performing developer-level testing and collaborating with QA teams during SIT, UAT, integration testing, and defect resolution.
Preferred Qualifications
• Experience with JavaScript and HTML for supporting data-driven applications and integration requirements.
• Experience with reporting and visualization tools such as Cognos 11.x and Tableau.
• Exposure to modern data integration technologies and willingness to learn and adopt new tools and technologies.