1
Scope
1.1
Limitations
2
References
3
Definitions
3.1
Terms defined elsewhere
3.2
Terms defined in this Recommendation
4
Abbreviations and acronyms
5
Conventions
6 Source
stimuli
6.1
Source signals recordings
6.2
Video considerations
6.3
Audio considerations
6.4
Audiovisual considerations
6.5
Duration of stimuli
6.6
Number of source stimuli
7
Test methods, rating scales and allowed changes
7.1
List of methods
7.2
Acceptable changes to the methods
7.3
Discouraged but acceptable changes to the methods
8 Environment
8.1 Controlled
environment
8.2 Public
environment
8.3
Viewing distance
8.4
Documentation of environment
9
Subjects
10
Experiment design
10.1
Size of the experiment and subject fatigue
10.2
Special considerations for transmission error, rebuffering, and
audiovisual synchronization impairments
10.3
Special considerations for longer stalling events
11
Experiment implementation
11.1
Informed consent
11.2
Optional pre-screening of subjects
11.3
Post-screening of subjects
11.4
Instructions and training
11.5
Experiment sessions and breaks
11.6
Voting
11.7
Questionnaires and interviews
12
Data analysis
12.1
Documenting the experiment
12.2
Calculate MOS or DMOS
12.3
Evaluating objective metrics
Annex A – Method for post-experiment screening of subjects using
Pearson's linear correlation
A.1
Screen by PVS
A.2
Screen by PVS and HRC
Appendix I – Informed consent form: example
Appendix II – Example
instructions
Bibliography