Committed to connecting the world

SDG DIGITAL

Executive Summary, SG12, May 2021

​​​Executive summary: e-Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), 4-13 May 2021​

Note: This is not an official record and is subject to correction or modification​

​Overview​

ITU-T Study Group 12 held its tenth meeting of the study period as an electronic meeting, 4-13 May 2021.

​The meeting was attended by 158 participants from 47 countries. Delegates exclusively used the MyMeetings web conferencing system to participate in the meeting.

The meeting received 49 Contributions and handled 140 TDs. Delegates reviewed 44 incoming Liaison statements and adopted 12 outgoing Liaison statements.

Eleven Recommendations were consented (1 new, 5 revised, 4 Corrigenda, 1 Amendment) by the meeting (see below for details). The meeting also agreed on one Supplement and one Corrigendum to the Bibliography of one Recommendation. 

​Major accomplishments

Recommendations consented during closing plenary (AAP, Recommendation ITU-T A.8)​

See last call in AAP-104​

ITU-T Rec. No. Title Status Question Reference
P.57
Artificial ears
Rev5/12
 TD1501R1
P.58
​Head and torso simulator for telephonometry
​Rev
​5/12
​​TD1500R1
​P.383
(ex. PDHIP)
​Technical requirements and test methods for the digital wired or wireless headset interface of mobile terminals
​New
​6/12
​​TD1435R2
​P.700
​Calculation of loudness for speech communication
Rev
​5/12
 TD1475
P.808​
 ​Subjective evaluation of speech quality with a crowdsourcing approach
 ​Rev
 ​7/12
​TD1496
​P.913
​Methods for the subjective assessment of video quality, audio quality and audiovisual quality of Internet video and distribution quality television in any environment
​Rev
​19/12
​​TD1498
​P.1203.3

​Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module
​Cor
​14/12
​​TD1477
​​Y.1222
​Traffic control and congestion control in Ethernet-based networks​
​Cor
​11/12
 TD1477
​​Y.1545.1
​Framework for monitoring the quality of service of IP network services
​Amd
​12/12
​TD1428R1
​Y.1563​
​Ethernet frame transfer and availability performance
​Cor
​17/12
​TD1488
Y.1564​
 ​Ethernet service activation test methodology
 ​Cor
 ​17/12
​TD1491​


Texts during closing plenary​

​
Text Title Status Question Reference
Y.1545
Roadmap for the quality of service of interconnected networks that use the Internet Protocol​
Cor
12/12

 TD1495
Y Suppl.60
Interpreting Y.1540 Maximum IP-Layer Capacity Measurements
Rev
17/12
 TD​1493

​
New work items​

​
Text Title Question Editor(s)
GSTR-5GQoE​
Study of existing QoE requirements for 5G services
13/12

 Pablo Pérez (Nokia)
Jaime Ruiz (Nokia)
Diego González-Morín (Nokia)
Femi Adeyemi-Ejeye (University of Surrey)
Kjell Brunnström (RISE, Sweden)
Narciso García (UPM, Spain)
Jesús Gutiérrez UPM, Spain)
Maria Martini (Kingston University London)
Ian Wagdin (BBC)
​P.DFSinter
​Extended methodology for cross-country and inter-operator Digital Financial Services testing
​20/12
​Wolfgang Balzer (Focus Infocom)​
​P.IntVR
​Subjective Test Method for Interactive Virtual Reality Applications
​7/12
​Sebastian Möller (TU Berlin)
​P.MOSQUITO
​Subjective test methodology for assessing impact of adaptive streaming effects on longer-term Quality of Experience (MOS) and quitting (for objective model development)
​14/12
​Alexander Raake (TU Ilmenau)
​Pierre Lebreton (NTT)
Rakesh Rao Ramachandra Rao (TU Ilmenau)
​David Lindero (Ericsson)
Shahid Mahmood Satti (Opticom)
Silvio Borer (Rohde & Schwarz)
​P.SEC
​Subjective quality evaluation of text-based chatbots
​7/12
​Sebastian Möller (TU Berlin)
​P.Suppl_DFS
​Considerations on automation of DFS testing
​20/12
​Joachim Pomy (Opticom)
​P.SUPPL800
​ITU-T Rec. P.800 use cases
​7/12
​Stefan Bruhn (Dolby Labs)
Imre Varga (Qualcomm)
Erik Norvell (Ericsson)
​PSTR.OUTLAB​​
​Conducting subjective tests outside of the lab
​7/12
​Ludovic Malfait (Dolby Labs)
​Alexander Raake (TU Ilmenau)
​Joel Jung (Tencent) 
​SupplGQoECAT
​QoE influencing factors for high definition (HD) video customized alerting tone (CAT) services
​13/12
​Shijun Zhang (China Mobile) 
Lei Yang (China Mobile)
Mengying Liu (China Mobile)
​SupplGQoEMVV
​QoE influencing factors for Multi-View Video (MVV) services
​13/12
​Zuyuan Peng (China Mobile)
Lei Yang (China Mobile)
Mengying Liu (China Mobile)
Y.TestBed
Test Bed Framework for Mobile Application QoS and QoE Evaluation
17/12
 Pierre Lynch (Keysight)​

​​

​WTSA matters


WTSA-16 Resolution 95 (ITU-T initiatives to raise awareness on best practices and policies related to service quality)​ 
  • The web page containing information on a ques​tionnaire rele​ased by SG12 on the status of national quality regulatory frameworks, as well as country case studies and SG12 activities to implement the Resolution was updated, see https://www.itu.int/en/ITU-T/studygroups/2017-2020/12/Pages/resolution95.aspx. 
  • ​SG12's operational plan on the implementation of this Resolution was approved, as updated in TD1458. Work on Res. 95-related draft Recommendations also progressed, in particular in Question 12/12.
Preparation for WTSA-20​​​
  • ​With WTSA postponed to March 2022, this meeting operated under the set of SG12 Questions endorsed by TSAG (TSAG-R17). ​​The updated set of Questions introduced the new Question 20/12 on "Perceptual and field assessment principles for quality of service (QoS) and quality of experience (QoE) of digital financial services (DFS)" which was allocated to WP3/12. 3 appointments were made for Q20/12 Co-Rapporteurship: Ms Fiona Kamikazi Beyaraaza (Uganda Communications Commission), Mr Wolfgang Balzer (Focus Infocom) and Mr Joachim Pomy (Opticom).​​​
  • SG12 will continue the preparatory process for WTSA, review the Question texts, Study Group mandate for WTSA-20 Resolution 2 and lead study group roles using the current set as a bas​is for further modifications (if any). 
  • SG12 Management are to consider and discuss Q8, Q11 and Q16 between this meeting and October 2021 to decide on its presentation to TSAG meetings before the next WTSA 20.

Results by group directly reporting to Plenary

  • Q2 progressed work on draft Technical Report "Roadmap for QoS and QoE in the ITU-T Study Group 12 context" (TR-RQ)​. ​

SG12 Regional Group on QoS for the Africa Region (SG12RG-AFR)​

  • ​Reviewed its action plan;
  • Coordinated African contributions to SG12

Quality of Service Development Group (QSDG)​

  • ​Reviewed and updated its work programme for 2021​.​

Results by working party​

Working Party 1/12

  • Produced the following texts for consent in plenary:
    • New Recommendation ITU-T P.383: Technical requirements and test methods for the digital wired or wireless headset interface of mobile terminals;​
    • Revised Recommendation ITU-T P.57: Artificial ears; 
    • Revised Recommendation ITU-T P.58: Head and torso simulator for telephonometry; 
    • Revised Recommendation ITU-T P.700: Calculation of loudness for speech communicati​on; 
    • Revised Recommendation ITU-T P.808: Subjective evaluation of speech quality with a crowdsourcing approach.
  • Established work items P.IntVR , P.SEC, P.SUPPL800 and PSTR.OUTLAB​.​

Working Party 2/12

  • Produced the following texts for consent in plenary:
    • Corrigendum 1 to Recommendation ITU-T P.1203.3: Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module;
    • Revised Recommendation ITU-T P.913: Methods for the subjective assessment of video quality, audio quality and audiovisual quality of Internet video and distribution quality television in any environment. 
  • Established work item P.MOSQUITO.​
​Working Party 3/12
  • Produced the following texts for consent in plenary:
    • ​Amendment 1 to Recommendation ITU-T Y.1545.1: Framework for monitoring the quality of service of IP network services;
    • Corrigendum 1 to Recommendation ITU-T Y.1222: Traffic control and congestion control in Ethernet-based networks; 
    • Corrigendum 1 to Recommendation ITU-T Y.1563: Ethernet frame transfer and availability performance; 
    • Corrigendum 1 to Recommendation ITU-T Y.1564: Ethernet service activation test methodology. 
  • Produced the following texts for agreement in plenary:
    • ​Corrigendum to the Bibliography of Recommendation ITU-T Y.1545: Roadmap for the quality of service of interconnected networks that use the Internet Protocol;
    • Revised Supplement ​Y.Sup60: Interpreting Y.1540 Maximum IP-Layer Capacity Measurements.​
  • Established work items GSTR-5GQoE, P.DFSinter, P.Suppl_DFS, SupplGQoECAT, SupplGQoEMVV and Y.TestBed​.​​

Future meetings 

Meetings of Study Group 12​

  • E-meeting, 12-21 October 2021
  • Exact dates TBD: Geneva, June 2022

Interim meetings

Please see ​​here for updated information​. Additional conference calls of Questions will be announced on the respective mailing lists.​​
  • Qs 7&10/12: Joint monthly e-meetings (1st Tuesday of the month), June - October 2021
  • Q12/12: No more than 10 e-meetings, June - October 2021 
  • Q14/12: Weekly e-meetings (Thursdays), May - October 2021 
  • Q14/12: P.BBQCG project - Tri-weekly e-meetings , May - October 2021
  • Q15/12: G.CMVTQS project - Bi-weekly e-meetings , May - October 2021
  • Q17/12: No more than monthly e-meetings, June - October 2021
  • TBC: Q9/12: First half of September 2021
  • TBC: Q14/12: RGM - E-meeting, Late August/early September 
  • TBC: Q15/12: P.565, P.VSQMTF-1, E-meeting, 21-22 June 2021

Meetings of SG12 Regional for QoS for the Africa Region (SG12RG-AFR)

  • TBC: Early September 2021 (jointly with workshop)

SG12​ Workshops

Meetings of Intersector Rapporteur Group Audiovisual Quality Assessment (IRG AVQA)

  • E-meeting, 7-11 June 2021 (jointly with VQEG)

© ITU All Rights Reserved

Back to top