Summary - F.748.44 (03/2025) - Assessment criteria for foundation models – Benchmark

Recommendation ITU-T F.748.44 focuses on the requirements and evaluation methods of foundation models. It covers the overview of the benchmark for foundation models and identifies the requirements and evaluation methods of foundation models. It is important for ensuring consistency, transparency, and comparability across different foundation models, enabling fair evaluations and informed decision-making. It can assist industry participants in analysing and optimizing foundation models, as well as help users build and select products that align with these requirements.