Recommendation ITU-T G.1052 (05/2024) Testbed framework for mobile application quality of service and quality of experience evaluation
Summary
History
FOREWORD
Table of Contents
Introduction
1 Scope
2 References
3 Definitions
     3.1 Terms defined elsewhere
     3.2 Terms defined in this Recommendation
4 Abbreviations and acronyms
5 Conventions
6 Scoring methodology
     6.1 Measurements
     6.2 Key performance indicators
     6.3 Session quality score
     6.4 Aggregated scores
7 Use cases and network scenarios
     7.1 Use cases
          7.1.1 Augmented reality
          7.1.2 Cloud gaming
          7.1.3 Content distribution streaming services
          7.1.4 High-speed Internet
          7.1.5 Live streaming services
          7.1.6 Social networking
          7.1.7 Telemeeting
          7.1.8 Virtual reality
     7.2 Definition of network scenarios
          7.2.4 Urban
               7.2.4.1 Office
               7.2.4.2 Pedestrian
               7.2.4.3 Driving
                    7.2.4.3.1 Normal
                    7.2.4.3.2 Traffic jam
                    7.2.4.3.3 Emergency driving
               7.2.4.4 Internet cafe
                    7.2.4.4.1 Busy hours
                    7.2.4.4.2 Off-peak
          7.2.5 Suburban
               7.2.5.1 Festival
               7.2.5.2 Stadium
               7.2.5.3 Shopping mall
                    7.2.5.3.1 Busy hours
                    7.2.5.3.2 Off-peak
          7.2.6 High-speed train
               7.2.6.1 Relay
               7.2.6.2 Direct passenger connections
     7.3 Network scenario parameters
          7.3.1 Network scenario applicability
8 Testing methodology
     8.1 Test system configuration
          8.1.1 Testbed configuration
          8.1.2 Device under test configuration
          8.1.3 Application under test configuration
     8.2 Test case initial conditions
     8.3 Test case post-conditions
     8.4 Application test case
9 Testbed calibration
     9.1 Calibration of individual measurement instruments
     9.2 Characterization of the testbed
          9.2.1 Round-trip-time
          9.2.2 Throughput
          9.2.3 Time synchronization
     9.3 Radio frequency connection compensation
     9.4 Measurement probes
     9.5 Baseline calibration standard reference
     9.6 Testbed health tracking
10 Testbed description
     10.1 Devices, operating systems, and applications
     10.2 Communication system
          10.2.1 Radio frequency connection
               10.2.1.1 Radio frequency shielding box and anechoic chamber
               10.2.1.2 Conducted radio frequency connection
               10.2.1.3 Over-the-air connection
               10.2.1.4 Comments on radio frequency connections
          10.2.2 Radio access technologies
               10.2.2.1 Wi-Fi access
               10.2.2.2 3GPP access
          10.2.3 Radio frequency channel models
               10.2.3.1 Long-term evolution propagation conditions
               10.2.3.2 New-radio propagation conditions
          10.2.4 Scheduling
               10.2.4.1 Symbols
               10.2.4.2 Resource blocks
               10.2.4.3 Frames and slots
               10.2.4.4 5G new-radio scheduling configuration
          10.2.5 Core network
               10.2.5.1 Long-term evolution
               10.2.5.2 New radio
               10.2.5.3 Mobility
               10.2.5.4 Cell load
               10.2.5.5 Dual connectivity
          10.2.6 Network impairments
     10.3 Service provider
     10.4 Measurements
     10.5 Test coordination and automation
Appendix I  Relevant ITU-T Recommendations
Appendix II  Examples of key performance indicator normalization mapping functions
     II.1 Linear mapping
     II.2 Logarithmic mapping
Appendix III  Scenario parameter settings
     III.1 Parameters explained
          III.1.1 Long-term evolution parameters
               III.1.1.1 Channel models
               III.1.1.2 Scheduling
          III.1.2 5G new-radio parameters
               III.1.2.1 Channel models
               III.1.2.2 Scheduling
                    III.1.2.2.1 Downlink scheduling
                    III.1.2.2.2  Uplink scheduling
          III.1.3 Parameter translation between long-term evolution and new-radio scenarios
     III.2 Scenarios
          III.2.1 Urban office
          III.2.2 Urban pedestrian
          III.2.3 Urban driving
          III.2.4 Urban Internet café
          III.2.5 Suburban
          III.2.6 High speed train
Appendix IV  Opentap overview
     IV.1 Test plans
     IV.2 Test steps
     IV.3 Verdicts
     IV.4 Resources
     IV.5 Result listeners
     IV.6 Session logs
     IV.7 Packages and plugins
Bibliography