Senior Data Integration Engineer/Designer/Architect - Peoria, IL

Job Title: Senior Data Integration Engineer/Designer/Architect
Location: Peoria, IL (Hybrid)
Duration: 12 Months

• SnapLogic
• AWS
• Python
• Snowflake
• DataStage

1.Design Responsibilities

Solution & Technical Design

• Translate business requirements into scalable, maintainable, and secure technical designs across DataStage, SnapLogic, AWS, Python, and Snowflake ecosystems.
• Create high-level and low-level design documents covering data flows, mappings, process orchestration, and integration patterns.
• Develop data models, transformation logic, and interface specifications for batch, real-time, and event-driven pipelines.
• Ensure designs align with enterprise architecture standards, security guidelines, and best practices.
• Collaborate with product owners, analysts, and architects to finalize solution design and validate technical feasibility.

2.Senior Development Responsibilities
Hands-on Development & Implementation

• Build and enhance ETL/ELT pipelines in IBM DataStage, SnapLogic, and Python.
• Develop scalable Snowflake SQL, stored procedures, and performance-optimized ELT logic.
• Implement AWS services (Lambda, S3, SNS, SQS, IAM, CloudWatch,Cloudformation, EventBridge) as part of cloud-native data pipelines.
• Code reusable frameworks, utilities, and components to accelerate team productivity.
• Conduct peer code reviews, mentor team members, and establish coding standards.

Quality & Delivery

• Perform unit testing and support integration/UAT activities.
• Optimize workflows for performance, cost-efficiency, and maintainability.
• Ensure version control, CI/CD integration, and documentation are consistently maintained.
• GitHub CI/CD integration

3.Production Support & Issue Resolution Responsibilities

Incident & Problem Management

• Serve as the point for any production issues across DataStage, SnapLogic, Snowflake, AWS, and Tidal.
• Responsible for analyzing and fixing production issues in any system.
• Analyze root causes, identify systemic issues, and propose permanent fixes.
• Develop automated monitoring, alerting, using Python/AWS.

Stability & Reliability

• Work closely with operations teams to ensure SLAs, uptime, and performance thresholds are met.
• Improve recovery processes, failover mechanisms, and operational resiliency.
• Troubleshoot orchestration and scheduling issues in Tidal Enterprise Scheduler.
  

4.Architecture Input & Technical Leadership Responsibilities
Architecture Contributions

• Provide architectural guidance for new integrations, data warehouse initiatives, and migration projects.
• Recommend best practices for cloud adoption, pipeline modernization, and platform evolution.
• Contribute to reference architectures, standards, reusable patterns, and decision frameworks.

Strategic Technology Guidance

• Evaluate emerging tools and technologies in data engineering, integration, cloud, and orchestration.
• Champion automation, observability, data quality, and performance optimization initiatives.
• Collaborate with enterprise architects and infrastructure teams to ensure future-proof design choices.

5.Cross-functional Collaboration Responsibilities

• Work with QA, business analysts, and project managers to enable smooth delivery.
• Assist and collaborate with offshore teams to ensure alignment, effective knowledge transfer, and smooth delivery across time zones.
• Communicate technical concepts clearly to both technical and non-technical stakeholders.

Tools & Technology Scope

• ETL/ELT: IBM DataStage, SnapLogic
• Cloud: AWS (Compute, Storage, Serverless, Orchestration, IAM, Monitoring)
• Data Warehouse: Snowflake
• Programming: Python, SQL
• Scheduling: Tidal Enterprise Scheduler
• Other: Git, CI/CD tools, DevOps pipelines, monitoring platforms
  

Mail: Dileep (at) humacinc (dot) com