Table of Contents - F.748.52 (03/2025) - Requirements and evaluation methods for retrieval augmented generation of large scale pre-trained models
1 Scope 2 References 3 Definitions 3.1 Terms defined elsewhere 3.2 Terms defined in this Recommendation 4 Abbreviations and acronyms 5 Conventions 6 Framework of requirements and evaluation methods for retrieval augmented generation of large scale pre-trained models 7 Requirements and evaluation methods of dataset construction 7.1 Data access 7.2 Data segmentation 7.3 Data indexing 7.4 Data updates 7.5 Data storage 8 Requirements and evaluation methods of technical capabilities 8.1 Retrieval capability 8.2 Generative capability 8.3 Optimization capability 9 Requirements and evaluation methods of application capabilities 9.1 Application maturity 9.2 Application stability Annex A – Grading requirements for generation capability A.1 Answers relevance grading requirements A.2 Answers faithfulness grading requirements A.3 Answers truthfulness grading requirements A.4 Answers relevance grading requirements
|