Table of Contents - F.748.52 (03/2025) - Requirements and evaluation methods for retrieval augmented generation of large scale pre-trained models

1	Scope
2 References
3 Definitions
3.1 Terms defined elsewhere
3.2 Terms defined in this Recommendation
4 Abbreviations and acronyms
5 Conventions
6 Framework of requirements and evaluation methods for retrieval augmented generation of large scale pre-trained models
7 Requirements and evaluation methods of dataset construction
7.1 Data access
7.2 Data segmentation
7.3 Data indexing
7.4 Data updates
7.5 Data storage
8 Requirements and evaluation methods of technical capabilities
8.1 Retrieval capability
8.2 Generative capability
8.3 Optimization capability
9 Requirements and evaluation methods of application capabilities
9.1 Application maturity
9.2 Application stability
Annex A – Grading requirements for generation capability
A.1 Answers relevance grading requirements
A.2 Answers faithfulness grading requirements
A.3 Answers truthfulness grading requirements
A.4 Answers relevance grading requirements