Committed to connecting the world

Executive Summary, SG12, April 2020

​​Executive summary: e-Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), 15-24 April 2020 ​​​​

​Note: This is not an official record and is subject to correction or modification ​

​​Ove​rview 

​ITU-T Study Group 12 held its seventh meeting of the study period as an e​​lectronic meeting, 15-24 April 20​20The meeting was attended by ​159 participants from 50 countriesDelegates exclusively used the MyMeetings web conferencing system to participate in the meeting​.


The meeting received 
4Contributions​ and handled 121 TDs​. Delegates reviewed 28 incoming Liaison statements and adopted outgoing Liaison statements.


4
 Recommendations were consented (2 new1 revised, 1 Amendment) by the meeting (see below for details). The meeting also agreed on one Amendment of an Appendix to a Recommendation, one Supplement, and one Technical Paper. ​

Major accomplishments

Recommendations consented during closing plenary (AAP, Recommendation ITU-T A.8) 

See last call in AAP​-80​​​​

ITU-T Rec. No. Question Reference New/Rev​ ​Title​
E.812 
(ex E.CrowdESFB)

12/12 TD1167R1
NewCrowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks 
G.1035
(ex G.QoE-VR) 
13/12 TD1207R2
New
Influencing factors on quality of experience (QoE) for virtual reality (VR) services 
P.501 
6/12 TD1198R1​

Rev
Test signals for use in telephony and other speech-based applications 
P.1203.3 Amd.1 
14/12 TD1216R1
New
Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module - Amendment 1: Adjustment of the audiovisual quality 


Texts agreed during closing plenary

​​ITU-T Rec. No. Question Reference New/Rev​ ​Title​
GSTP-IPTV-QoS
13/12 TD1203R1
NewTechnical Paper: Performance metrics for end-to-end IPTV video quality 
P.863 Amd.1
9/12 TD1149
New
Perceptual objective listening quality prediction - Amendment 1: Revised Appendix III – Prediction of acoustically recorded narrowband speech 
Y Suppl.60​
17/12 TD1213​

New
Interpreting Y.1540 Maximum IP-Layer Capacity Measurements  

New work items


​​Work item​ Title Question Editor​​
P.CROWDV 
Subjective evaluation of video and audiovisual quality with the crowdsourcing approach 
7/12 
Babak Naderi (TU Berlin) 
E.CrowdESFB-app 
Appendices for Recommendation ITU-T E.812 "Crowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks" 
12/12 
​Isis De Andrade Lima (Brazil) 
Yeow Hong Teo (Singapore) 
Tania Villa (Mexico) 
G.ODP

QoS metrics for the assessment of the impact of fixed geographic structures on telephony quality and call stability 
13/12 
​Wolfgang Balzer (Focus Infocom) 
Joachim Pomy (Opticom)
P.BBQCG 
Parametric bitstream-based quality assessment of cloud gaming services 
14/12 Sebastian Möller (TU Berlin) 
P.DiAQoSE 

Diagnostic assessment of QoS and QoE for adaptive video streaming sessions 
14/12 
​Jörgen Gustafsson (Ericsson) 
Yoichi Matsuo (NTT) 
Alexander Raake (TU Ilmenau) 
P.NATS-ph3 
Quality integration module for adaptive video streaming QoE in the context of P.120X-Recommendation series 
14/12 
​Jörgen Gustafsson (Ericsson) 
Alexander Raake (TU Ilmenau) 
P.CONVSIM 

Conversational quality prediction based on simulation of conversations 
15/12 
​Sebastian Möller (TU Berlin) 
P.VSQMTF-1 
A first predictor of speech quality by machine learning based on P.565 framework 
15/12 
​Irina Cotanis (Infovista) 
G.IntAct 
Latency measurement and interactivity scoring under real application data traffic patterns 
17/12 
​Jens Berger (Rohde & Schwarz) 
Al Morton (AT&T) 
G.NCAP 

Framework for capacity assessment of packet data services in mobile networks 
​17/12
​Wolfgang Balzer (Focus Infocom) 
Joachim Pomy (Opticom) 
Y.1565-rev 
Home network performance parameters 
17/12
​Janusz Jezowicz (Speedchecker) 
Al Morton (AT&T) 
Y.COPI 
QoS metrics for continuity-of-performance of packet data based services 
17/12
Wolfgang Balzer (Focus Infocom) 
Joachim Pomy (Opticom) 
Y Suppl.60 updates 
Interpreting Y.1540 Maximum IP-Layer Capacity Measurements 
17/12 
​Len Ciavattone (AT&T) 
Al Morton (AT&T) 


WTSA matters

Implementation of WTSA-16 Resolution 95 (ITU-T initiatives to raise awareness on best practices and policies related to service quality) is progressing. 

The web page containing information on a questionnaire released by SG12 on the status of national quality regulatory frameworks, as well as country case studies and SG12 activities to implement the Resolution was updated, see https://www.itu.int/en/ITU-T/studygroups/2017-2020/12/Pages/resolution95.aspx

SG12's operational plan on the implementation of this Resolution was updated. Work on Res.95-related draft Recommendations progressed, in particular in Question 12/12. Some discussion took place about quality of service aspects of alternative calling procedures (ACP), in response to WTSA-16 Resolution 29.  

In the context of WTSA-16 Resolution 89 on the use of ICTs to bridge the financial inclusion gap, and taking into account the progress made by SG12 in this domain (see Recommendations ITU-T G.1033 and P.1505), SG12 is proposing a new Question on “Perceptual and field assessment principles for quality of service (QoS) and quality of experience (QoE) of digital financial services (DFS)," for study in the next study period. 

Finally, SG12 adopted its proposal for Res.2 and ToRs for 18 Questions for study in the next study period. ​

Results by group directly reporting to Plenary

Results by working party​

Working Party 1/12

Working Party 2/12

Working Party 3/12

​Future meetings and workshops

Meetings of Study Group 12


shorter additional virtual SG12 meeting with limited scope to take decisions on selected open work items scheduled for 7-11 September 2020

Work items potentially ready for a decision in September, as identified by Questions and in WP plenaries: Supp.CDR; P.381, P.382, P.DHIP; P.57, P.58; P.STBN; P.QXM, G.TeleMeTax; E.QosMgtMod, E.804.1, E.RQST, E.crowdesfbApp; P.360-VR; P.1204.1, P.1204.2; P.VSQMTF-1; Y Supp.60-updates. ​

Meetings of Rapporteur groups


Please see ​​
here for updated information​. Additional conference calls of Questions will be announced on the respective mailing lists.​

Meeting of Quality of Service Development Group (QSDG​)

SG12 Workshops

Meetings of Intersector Rapporteur Group Audiovisual Quality Assessment​​ (IRG AVQA)