Job Opportunity
We have an exciting opportunity for a talented individual to join our team as a Senior Engineer. This role offers the flexibility of working remotely from anywhere in Texas, providing a great work-life balance while contributing to innovative projects.
Experience Required
10 years
Job Summary
Design and develop scalable data-engineering solutions supporting the migration of Client DB2 data and workloads to the Databricks Lakehouse. Analyze DB2 database objects and dependencies, modernize SQL and legacy ETL workflows, validate migrated data, and optimize high-volume Databricks workloads. Collaborate with business, data engineering, cloud, and architecture teams on enterprise data-modernization initiatives.
Must Have Technical/Functional Skills
- Client DB2 and AS400
- Databricks
- DB2-to-Databricks data migration
- ETL and ELT pipeline development
- DB2 schemas, tables, views, aliases, stored procedures, functions, triggers, and sequences
- DB2 Catalog SQL
- DB2 LUW command-line and SQL clients, including DBeaver and Data Studio
- Mainframe TSO/ISPF
- Lakebridge Analyzer
- Databricks Unity Catalog
- SQL and stored-procedure modernization
- Data-quality validation and reconciliation
- Python and PySpark
- Property and casualty insurance domain knowledge
- AI and generative AI capabilities for data engineering and migration, as an added advantage
Roles & Responsibilities
- Analyze and extract data from Client DB2 databases for migration to the Databricks Lakehouse.
- Design and develop scalable ETL and ELT pipelines connecting DB2 and Databricks.
- Extract inventories of DB2 schemas, tables, views, aliases, stored procedures, functions, triggers, and sequences.
- Perform database-object and dependency validations.
- Convert DB2 SQL, stored procedures, and legacy ETL workflows into scalable Databricks solutions.
- Translate DB2 security grants and sensitive-data access controls into corresponding controls using Databricks Unity Catalog.
- Apply knowledge of DB2 structures and data models supporting property and casualty insurance products.
- Validate data quality, reconciliation, completeness, and migration accuracy between source and target platforms.
- Optimize high-volume data ingestion, transformations, Spark jobs, and Databricks workloads.
- Collaborate with business, data engineering, cloud, and architecture teams supporting data-modernization programs.
- Use Databricks AI and machine-learning capabilities to support AI-enabled data-engineering and migration solutions.
- Use generative AI or AI coding assistants to accelerate code analysis, conversion, documentation, and modernization.
- Apply large language models and prompt engineering to SQL transformation, code explanation, dependency analysis, and migration-artifact generation.
- Build or use AI-assisted data-quality and reconciliation frameworks to identify anomalies, schema mismatches, transformation discrepancies, and migration defects.
- Apply retrieval-augmented generation patterns to database metadata, data dictionaries, mapping documents, and migration knowledge bases.
- Develop Python- or PySpark-based automation utilities for metadata discovery, schema mapping, code conversion, test-case generation, and migration validation.
- Integrate AI-assisted development into CI/CD and data-engineering workflows.
About Tanisha Systems, Inc.
Tanisha Systems, founded in 2002 in Massachusetts-USA, is a leading provider of Custom Application Development and end-to-end IT Services to clients globally. We use a client-centric engagement model that combines local on-site and off-site resources with the cost, global expertise and quality advantages of off-shore operations. We deliver Custom Application Development, Application Modernization, Business Process Outsourcing and Professional IT Services from office locations in USA and India. Tanisha Systems services clients in Government, Banking & Financial Markets, Insurance, Healthcare, Retail & Consumer Goods, Energy & Utilities, Life Sciences, Telecom, Manufacturing and Transportation Industries around the globe. Our engagement model provides a flexible operational environment that empowers our clients with the right levels of control.
Want to read more about Tanisha Systems? Visit us at
