GenAI PROOF OF CONCEPT (POC) AND MINIMUM VIABLE PRODUCT (MVP) - 4986.6

Scope:

This Chapter of the GenAI Policy applies to all Executive Branch State Entities.

Policy:

1. All GenAI POCs shall be hosted in a CDT approved “sandbox” environment.
   1. POC testing shall not be performed in a production environment.

    

2. All GenAI MVP shall be hosted in a CDT approved production environment.
   1. All MVPs testing must be performed in a test environment.

    

3. As part of the POC and MVP, an Executive Branch State Entity must:
   1. Test the feasibility of GenAI to determine if it aligns with the specific needs and objectives of the use case.
   2. Validate the performance, accuracy, and relevance of GenAI by assessing its ability to produce outputs that meet the desired quality and application standards.
   3. Implement risk mitigation strategies to address potential challenges, such as model bias, hallucination, bad actors, equity, and data quality issues, by identifying and addressing these risks during the POC phase.
   4. Limit the data used for testing public data for any POC and ensure that testing for both POCs and MVPs includes any necessary data pre- processing of State-provided data. Data pre-processing should ensure the data is adequately prepared for use with the GenAI solution including scanning for sensitive or classified information (e.g., Personally Identifiable Information (PII), Personal Health Information (PHI), and Federal Tax Information (FTI)). Appropriate measures must be implemented to identify and block such sensitive data.

    

4. Any GenAI POC that goes into production must be hosted in a CDT approved data center.

References:

EO N-12-23;SAM 4983.1;SIMM 140;SIMM 141