Senior Data Engineer

Senior Data Engineer
Orlando, FL | Hybrid 3 Days Onsite
Contract (Extension Possible)

About the Role
We are seeking a Senior Data Engineer with strong ETL and IBM InfoSphere DataStage experience to design, build, and support file-to-table data pipelines. In this role, you ll transform inbound file feeds into reliable, auditable, and high-performance SQL Server table loads, ensuring data quality, operational stability, and scalability.

This position requires hands-on expertise in DataStage parallel jobs, SQL Server, and file-based ingestion, along with the ability to design ETL processes that are supportable and production-ready.

Key Responsibilities

• Design, develop, and maintain IBM DataStage ETL jobs to ingest file feeds (CSV, fixed-width, delimited) into SQL Server

• Build end-to-end data pipelines including staging, transformations, validations, and publishing

• Perform source-to-target mapping and implement transformation logic per business and technical requirements

• Utilize DataStage stages and patterns (Sequential File, Transformer, Lookup, Join/Merge, Aggregator, Sort, Funnel, Remove Duplicates) with strong parallel job design

• Write, optimize, and tune SQL Server queries, stored procedures, and T-SQL scripts

• Implement restartable, parameter-driven ETL jobs with robust logging, reject handling, auditing, and reconciliation checks

• Apply data quality controls (format, null, duplicate, referential, threshold checks) and generate clear exception outputs

• Monitor, troubleshoot, and resolve ETL issues using DataStage Director/Operations Console and SQL Server tools

• Improve performance through DataStage tuning (partitioning, sorting, buffering) and SQL optimization

• Participate in code reviews, testing, documentation, and release activities

• Collaborate with business analysts, data modelers, QA, and production support teams

Required Qualifications

• Hands-on experience as a Senior Data Engineer or ETL Developer using IBM DataStage

• Strong SQL Server / T-SQL expertise (joins, CTEs, window functions, temp tables, indexing, query plans)

• Solid understanding of file-based data ingestion (CSV, fixed-width, headers/trailers, control totals, encoding)

• Experience designing production-grade ETL pipelines with logging, error handling, and restart/re-run capability

• Strong troubleshooting skills across the full data flow (source staging target)

• Ability to work in a hybrid environment (3 days onsite in Orlando, FL)

Preferred Qualifications

• Experience tuning DataStage Parallel Jobs (partitioning strategies, skew handling, collect/sort trade-offs)

• UNIX/Linux knowledge and basic shell scripting

• Experience with job schedulers (Control-M, Autosys) and CI/CD practices

• Knowledge of data warehousing patterns (incremental loads, SCDs, surrogate keys, effective dating)

• Experience with Git and structured release management across environments

• Exposure to data governance, lineage, and secure data handling

Education

• Bachelor s degree in Computer Science, Engineering, Information Systems, or equivalent practical experience

What Success Looks Like

• File feeds load consistently with accurate reconciliation results

• Failures are easy to diagnose through logs and reject outputs

• Jobs meet runtime SLAs through strong DataStage and SQL tuning

• Mappings and transformations are well-documented and traceable to requirements