Project Scope / Tasks
The Enterprise Analytics & Data Services team requires one (1) consultant proficient in Data Integration Development. The consultant will develop dimensional models, transformation solutions, and provide data integration environment functional administration to develop and support data analytics solutions for Client business users. The data integrator role provides technical expertise to perform data integration services that support the data warehouse, operational data store, and reporting. These services include new development, software changes, and environment maintenance and operations. New development includes the expansion of the data warehouse data sets such as self-service data marts, facts and related dimension tables, and Extract/Transform/Load (ETL) job development using the Oracle Data Integrator product.
To quantify the need, maintenance and operations are required for the Data & Analytics foundation. The major components of the foundation are listed below:
Data Warehouse
A centralized collection of transformed business data sourced from transactional application databases across Client, where data is structured in the form of dimensional models, historical snapshots (i.e., CAFR data), metric marts, and data marts. Hundreds of business unit users rely on this data being current and accurate. New development is required to adapt to changing business needs, while maintenance and operations are necessary to monitor data freshness and accuracy. The data warehouse is key to enabling self-service data analytics across Client.
Data Hub
A centralized collection of raw data sourced from transactional application databases across Client and the cloud. The Data Hub is used to fulfill data extract requests and any analytical requirement not directly supported by the data warehouse.
Source Application Change Management Coordination
Many Client applications feed into the Data & Analytics foundation. A few of the larger applications are myClient, PeopleSoft HCM, Wavetec, and Client Customer Education Center (CEC). When source applications are upgraded and patched, coordinated Data & Analytics maintenance is required for continued operations.
BI Platform Modernization
Modernization of the BI data platform includes architecting DevOps into the data & analytics software project lifecycle, designing frameworks that increase automation capabilities, Java programming for add-on modules and cloud data source connectors that work with the existing data platform, Groovy programming for task automation and repeatable frameworks, and exploration of new data warehousing tools.
Scope of Work
Deliverable 1: Design and Development of BI Data Integration Solutions
Design, develop, and maintain specialized software for a Business Intelligence (BI) solution to analyze Client business transactions.
BI provides historical, current, and predictive insights into business operations by translating business data requirements into technical specifications and developing enterprise data warehouse star schemas.
Each data warehouse deliverable focuses on a specific business subject area (star schema) and includes:
- Technical specifications
- Dimensional data models
- Extract, Transform, and Load (ETL) programs
- Validation and testing to ensure data aligns with the subject area and integrates seamlessly into the enterprise data platform
The enterprise data platform includes a data warehouse and scheduled ETL jobs.
Responsibilities include:
- Designing multidimensional data models (star schemas) to represent business transactions and support data analysis and analytic dashboards
- Integrating data models and ETL jobs into the enterprise data warehouse following established standards
- Validating data records to ensure they meet business requirements
- Providing backup support for maintaining and operating the data platform, which includes over 3,000 ETL jobs, an operational data store (raw, unprocessed data from multiple applications), and a data warehouse (star schemas and data marts)
- Troubleshooting and resolving issues related to deliverables during the assignment
Deliverable 2: Modernization of BI Data Platform and Automation Frameworks
Modernize the BI data platform and integrate DevOps practices into the data and analytics software project lifecycle.
Responsibilities include:
- Architecting frameworks to enhance automation capabilities, ensuring scalability and efficiency
- Implementing Java programming for add-on modules and cloud data source connectors that integrate seamlessly with the existing data platform
- Utilizing Groovy programming to automate tasks and create repeatable frameworks that streamline development and operations
- Developing a proof of concept (PoC) for Client s data integration process using a modern data integration tool, demonstrating improved performance, flexibility, and scalability
- Evaluating and implementing advanced data integration technologies to optimize data flow, reduce latency, and enhance data quality
- Aligning the BI platform with current industry standards and leveraging cloud-based solutions
- Establishing automated testing, deployment pipelines, and monitoring frameworks for faster delivery, higher quality, and reduced operational risk
- Architecting solutions that support hybrid data environments, enabling seamless integration of on-premises and cloud data sources
Deliverable 3: Knowledge Transfer
On an ongoing basis through the end of the contract, all work products and deliverables must be discussed with the contract manager to ensure that all information is documented and placed in a file share.
This includes:
- Project status reports
- Business process documentation
- Triage incident reports with resolution
- Meeting minutes
- Test cases
- Test outcomes
The contract manager will schedule knowledge transfer sessions at regular intervals to ensure that all work product details are documented and knowledge is transferred to state personnel.
Knowledge transfer to State staff is required as part of each project when completed and released into maintenance mode.