Overview
On Site
$100,000 - $120,000
Full Time
Skills
datastage
ETL
ADF
Azure data Factory
python
Job Details
We are seeking a seasoned Data Engineer with strong expertise in both IBM DataStage and Azure Data Factory (ADF). This role requires hands-on technical capabilities along with experience in leading offshore teams to deliver enterprise-grade data solutions across hybrid environments.
Key Responsibilities:
- 8+ years of experience in data engineering with a balanced focus on traditional ETL and modern cloud-based integration.
- 4+ years of hands-on experience with IBM DataStage, including development, optimization, and support of complex ETL workflows.
- 4+ years of experience with Azure Data Factory, Azure SQL Database, and other Azure-native services for data ingestion and transformation.
- Experience in ETL migration projects, particularly transitioning DataStage workloads to ADF or equivalent cloud pipelines.
- Ability to design, develop, and maintain ETL pipelines in both on-premise (DataStage) and cloud (ADF) ecosystems.
- Proven ability to lead and coordinate offshore development teams, ensuring alignment with timelines, quality standards, and delivery goals.
- Expertise in building and managing data pipelines using Databricks, implementing data quality, lineage, and governance practices.
- Proficient in SQL and Python, including writing scripts for data manipulation and orchestration logic.
- Experience in Azure-based data warehouse platforms like Azure Synapse Analytics, Azure Data Lake, and associated data services.
- Familiar with CI/CD practices using Azure DevOps, including automation of pipeline deployment and version control.
- Knowledge of data governance, security, and compliance best practices in the Azure cloud environment.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.