Senior Data Engineer
Rivago infotech inc
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Apache Spark
- Microsoft Azure
- Migration
- Databricks
- Datastage
- Teradata
- SQL
- JDBC
- Database
Summary
Role: Senior Data Engineer – DataStage to Azure Databricks Migration
Remote
Job Description:
· Strong hands-on experience in IBM DataStage, Teradata, SQL and Azure Databricks.
· Analyze existing DataStage jobs and their Teradata dependencies.
· Knowledge of Teradata utilities/components such as BTEQ and TPT.
· Experience configuring or working with JDBC/ODBC database connectivity from ETL platforms.
· Identify and remediate Teradata-specific SQL for compatibility with Databricks/Spark SQL
· Perform data reconciliation and validation, including row-count and checksum validation.
· Troubleshoot migration issues related to SQL, connectivity, schemas, metadata and data types.
· Support unit testing, SIT, UAT, cutover and post-production stabilization.
· Good understanding of ADLS Gen2, Delta tables, Unity Catalog and Azure connectivity/security.
· Experience in large-scale Teradata-to-Azure/Databricks migration is preferred.
- Dice Id: 91131106
- Position Id: 9135253
- Posted 5 hours ago
Company Info
About Rivago infotech inc
Rivago Infotech Inc has been a leader in IT staffing and Software development for over 5 years and is one of the largest diversity and development firms in the industry. We are known for our high-touch, customer-eccentric approach, offering our clients unmatched quality, responsiveness and flexibility . We are appreciated by our clients for our streamlined execution, highly efficient service and exceptional talent management that go above and beyond traditional staffing services.
