Data Engineer

The consultant will collaborate with the Enterprise Solution Development team to fulfill the role of a Data Engineer to support investment management systems. The consultant will assist in implementing critical system change initiatives and contribute to delivering robust, scalable, and reliable data solutions tailored to the unique needs of investment management. Key responsibilities include developing and optimizing data pipelines to efficiently

extract, transform, and load (ETL) data from various sources into centralized data warehouses or data lakes. The consultant will ensure data quality and integrity by implementing validation processes and monitoring systems to detect and address anomalies. Additionally, the consultant will collaborate with cross-functional teams, such as data scientists and analysts, to understand data requirements and enable seamless access to both structured and unstructured data. They will focus on automating workflows, improving system performance, and implementing robust security measures to safeguard sensitive information.

Deliverable 1: Analysis, Design, Implementation, Testing, Support, Documentation and Knowledge Transfer

• Identify data integration and migration requirements by examining unstructured, transactional, hierarchical, master, and metadata.
• Analyze data quality and integrity, detecting anomalies and implementing validation processes to optimize data pipelines and support reliable decision-making.
• Propose one or more design options as appropriate to each situation, including a level- of-effort estimate and target delivery date.
• Develop approved database solutions within approved environments, using approved promotional patterns and testing methodology.
• Perform internal unit testing, and facilitate system and user acceptance testing.
• Produce detailed documentation, including technical specifications, workflows, and design artifacts, and lessons learned, and prepared according to best practices and according to CalPERS standards.
• Provide knowledge transfer solutions via collaborative documentation, code commenting, cross training, and job shadowing.

On an ongoing basis through the end of the contract all work products and deliverables (project status reports, business process, triage incident reports with resolution, meeting minutes, test cases, test outcomes) details have to be discussed with the contract manager to ensure that all of the information is documented and placed in a file share. The contract manager will schedule knowledge transfer sessions at regular intervals to ensure that all of the work production details have been documented and the knowledge has been transferred to the state personnel.

Qualifications

1. Must have a minimum of five (5) years of experience designing logical

data models and developing dimensional data models for Business Intelligence and Analytical solutions.

1. Must have a minimum of five (5) years of experience developing and maintaining data architecture, including modelling, transformation, data

dictionaries, metadata and governance.

1. Must have a minimum of five (5) years of experience ensuring data

integrity and quality through data conversions, monitoring, audits, and fixes.

1. Must have a minimum of five (5) years of experience developing and distributing operational and management reports.
2. Must have a minimum of five (5) years of experience developing and implementing Business Intelligence and Analytical solutions, including strategies for data analysis.
3. Must have a minimum of five (5) years of experience designing, developing, and implementing Extract, Transform, and Load (ETL) processes to transform unstructured and disparate source data into target

data stores, data warehouses, or data marts.

1. Must have a minimum of five (5) years of experience analyzing and identifying required data integrations and implementing solutions to

manage transactional, analytic, and master data.

1. Must have a minimum of five (5) years of experience performing business

analysis, gathering requirements, and translating them into design specifications for data management solutions.

1. Must have a minimum of five (5) years of experience working with ETL tools to load data into data stores, data warehouses, or data marts. Experience with Snowflake, DBT, Atacama, and Python is highly

desirable