Experience
8+ years of experience in Data/ETL Functional Consulting, Business Analysis, Data Migration, or Data Modernization, with strong experience in Talend-based data environments
Role Overview
We are looking for an experienced Functional Consultant to support a large-scale Talend-to-Databricks migration program for a leading Retail/Grocery client.
The Functional Consultant will act as the bridge between business stakeholders, data architects, Talend SMEs, Databricks engineering teams, QA teams, and offshore delivery teams.
The role will focus on understanding existing Talend data processes, documenting business rules and data flows, gathering requirements, supporting migration assessment, defining functional mappings, validating migrated data, and ensuring that the Databricks solution meets business requirements.
The ideal candidate should have strong experience working with enterprise data/ETL programs, preferably with Talend, and a good understanding of Retail/Grocery business processes and data domains.
Key Responsibilities
Business & Functional Analysis
- Engage with business stakeholders to understand business processes, data requirements, and reporting needs.
- Analyze existing data processes and understand how Talend supports critical business functions.
- Document functional requirements, business rules, data definitions, and process flows.
- Identify current-state pain points, data-quality issues, manual processes, and business dependencies.
- Translate business requirements into clear functional specifications for technical teams.
- Facilitate workshops with business users, SMEs, architects, and engineering teams.
Talend Migration Assessment
- Analyze existing Talend jobs, workflows, mappings, schedules, dependencies, and interfaces from a functional perspective.
- Understand the business purpose and downstream consumers of Talend jobs.
- Identify critical Talend processes that need to be migrated to Databricks.
- Classify migration workloads based on business criticality, complexity, dependencies, frequency, and data volume.
- Identify jobs that can be retired, consolidated, redesigned, or migrated as-is.
- Document functional dependencies between Talend jobs and upstream/downstream applications.
- Support creation and prioritization of migration waves.
Functional Mapping & Transformation Rules
- Review existing Talend transformation logic and translate it into understandable business/functional rules.
- Prepare source-to-target mapping documents.
- Define field-level mappings, transformation rules, default values, derivations, filters, joins, aggregations, and business validations.
- Identify data elements requiring special treatment during migration.
- Validate that existing Talend business logic is correctly understood before implementation in Databricks.
- Work with Databricks developers to clarify functional requirements and transformation logic.
Data Validation & Reconciliation
- Define functional validation criteria for migrated data.
- Develop and execute data reconciliation scenarios between Talend/legacy and Databricks.
- Validate record counts, key business metrics, aggregations, data completeness, and transformation results.
- Investigate data mismatches and coordinate with technical teams for resolution.
- Support SIT, UAT, regression testing, and production validation.
- Ensure business-critical reports and downstream processes continue to produce expected results after migration.
Retail / Grocery Domain
Strong understanding of Retail/Grocery business processes is preferred.
The consultant should be comfortable working with data related to:
- Product / Item
- Product Hierarchy
- Store / Location
- Customer / Loyalty
- Sales / POS Transactions
- Pricing
- Promotions
- Inventory
- Orders
- Suppliers / Vendors
- Supply Chain
- Merchandising
- Forecasting
- E-commerce / Digital Sales
Experience understanding retail metrics such as sales, units, margin, inventory, promotion effectiveness, customer transactions, and store performance is highly desirable.
Stakeholder Management
- Act as the primary functional point of contact for assigned migration workloads.
- Work closely with client business SMEs and product owners.
- Coordinate with Talend developers/SMEs, Databricks architects, data engineers, QA, and offshore teams.
- Conduct requirement clarification and functional walkthrough sessions.
- Manage functional issues, dependencies, assumptions, and risks.
- Communicate migration status and functional risks to project leadership.
- Support change-management and business adoption activities.
Documentation
Prepare and maintain:
- Business Requirements Documents (BRD)
- Functional Requirements Documents (FRD)
- Current-state and future-state process flows
- Source-to-target mapping documents
- Data dictionaries
- Business rules and transformation specifications
- Talend job functional inventories
- Migration assessment documents
- Data validation/reconciliation specifications
- Test scenarios and UAT scripts
- Functional design documents
- Migration wave plans
Required Skills
Talend
- Strong understanding of Talend Data Integration and enterprise ETL processes.
- Ability to understand and document Talend jobs and workflows.
- Understanding of Talend components, mappings, transformations, lookups, joins, filters, aggregations, error handling, and scheduling.
- Experience analyzing existing Talend implementations for migration or modernization.
- Ability to translate Talend technical logic into business/functional requirements.
Data & ETL
- Strong understanding of ETL/ELT concepts.
- Good SQL skills for data analysis and validation.
- Understanding of relational databases and data warehouses.
- Strong knowledge of data mapping and transformation concepts.
- Experience with data profiling, data quality, reconciliation, and validation.
- Understanding of batch and incremental data processing.
- Knowledge of CDC and historical data concepts is desirable.
Databricks / Cloud - Functional Understanding
- Good understanding of Databricks and modern cloud data platforms.
- Understanding of Lakehouse architecture and Bronze/Silver/Gold data layers.
- Ability to understand how Talend workloads are transformed into Databricks pipelines.
- Understanding of Delta Lake and cloud data storage concepts is desirable.
- No requirement to be a deep hands-on Databricks developer, but the consultant should be able to communicate effectively with Databricks architects and engineers.
Testing
- Experience in SIT, UAT, regression, and data validation.
- Ability to create functional test scenarios and acceptance criteria.
- Experience validating data migration and reconciliation.
- Experience with defect management and root-cause analysis.
Preferred Skills
- Retail/Grocery domain experience.
- Experience with large-scale Talend modernization/migration programs.
- Experience working with Databricks migration programs.
- Knowledge of Azure/AWS cloud environments.
- Experience with Power BI or other reporting/analytics platforms.
- Knowledge of data governance, lineage, metadata, and data quality.
- Experience with Agile/Scrum methodologies.
- Experience working in distributed onsite/offshore delivery models.
- Strong SQL and data analysis capabilities.
Key Deliverables
The Functional Consultant will be responsible for:
- Talend application/job functional inventory.
- Current-state process documentation.
- Business and functional requirements.
- Source-to-target mappings.
- Business transformation rules.
- Data definitions and business rules.
- Migration assessment and prioritization.
- Functional migration specifications.
- Data validation and reconciliation rules.
- SIT/UAT test scenarios.
- Defect analysis and functional sign-off support.
- Requirement Traceability Matrix.
- Business stakeholder communication and documentation.