Executive summary: e-Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), 7-11 September 2020
Note: This is not an official record and is subject to correction or modification
Overview
ITU-T Study Group 12 held its eighth meeting of the study period as electronic meeting, 7-11 September 2020. The meeting was held to address outstanding work carried over from the
April 2020 meeting.
The meeting was attended by
124 participants from 40 countries. Delegates exclusively used the MyMeetings web conferencing system to participate in the meeting.
The meeting received
20 Contributions and handled
118 TDs. Delegates reviewed
26 incoming Liaison statements and adopted
10 outgoing Liaison statements.
One Recommendation was determined and five Recommendations were consented (2 new, 2 revised, 1 Corrigendum) by the meeting (see below for details).
The meeting also agreed on two Supplements (1 new, 1 revised) and new Appendices to one Recommendation.
Major accomplishments
Recommendations determined during closing plenary (TAP, Resolution 1)
ITU-T Rec. No. |
Title |
Status |
Question |
Reference |
E.805.1 (ex E.QoSMgtMod)
|
QoS operational strategy for improved regulatory supervision on providers of mobile telecommunication services | New
| 12/12
|
TD1268R2
|
Recommendations consented during closing plenary (AAP, Recommendation ITU-T A.8)
See last call in
AAP-89
ITU-T Rec. No. |
Title |
Status |
Question |
Reference |
E.804.1 | Application guide for ITU-T Recommendation E.804: Quality of service aspects for popular services in mobile networks | New | 12/12 |
TD1265R2 |
G.1072 | Opinion model predicting gaming quality of experience for cloud gaming services | Cor. | 13/12 |
TD1319 |
P.381 | Technical requirements and test methods for the universal wired headset or headphone interface of digital mobile terminals
| Rev | 3/12 |
TD1299R2 |
P.382
| Technical requirements and test methods for multi-microphone wired headset or headphone interfaces of digital wireless terminals | Rev | 3/12 |
TD1302R1 |
P.919
(ex P.360-VR)
| Subjective test methodologies for 360 degree video on HMD
| New
| 13/12
|
TD1320R1
|
Texts agreed during closing plenary
Text |
Title |
Status |
Question |
Reference |
E.CrowdESFB-app | Appendices of Recommendation ITU-T E.812: Crowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks | New | 12/12 |
TD1303R1 |
P.Sup28
(ex Suppl.CDR / Suppl.ML) | Considerations for the development of new QoS and QoE related objective models to be embedded in Recommendations prepared by Study Group 12 | New | 1/12 |
TD1332R2 |
Y.Sup60
| Interpreting Y.1540 Maximum IP-Layer Capacity Measurements
| Rev | 17/12 |
TD1326
|
New work items
SG12 established work items on the following topics:
Text |
Title |
Question |
Editor(s) |
E.AIQ
| Artificial Intelligence Quotient (AI-Q) for indexing and rating AI algorithms used in conversational AI systems employed for customer service management, service optimization and management as part of service quality assessment methodologies
| 12/12 | Preeti Banzal (India)
|
P.833.2
| Extension of the methodology for the derivation of equipment impairment factors from subjective listening-only tests for super-wideband and fullband speech codecs | 15/12 | Thilo Michael (TU Berlin) Sebastian Möller (TU Berlin)
|
P.834.2
| Extension of the methodology for the derivation of equipment impairment factors from instrumental models for super-wideband and fullband speech codecs
| 15/12 |
Thilo Michael (TU Berlin) Sebastian Möller (TU Berlin)
|
WTSA Matters
WTSA-16 Resolution 95 (ITU-T initiatives to raise awareness on best practices and policies related to service quality)
- The web page containing information on a questionnaire released by SG12 on the status of national quality regulatory frameworks, as well as country case studies and SG12 activities to implement the Resolution was updated, see https://www.itu.int/en/ITU-T/studygroups/2017-2020/12/Pages/resolution95.aspx.
-
SG12's operational plan on the implementation of this Resolution was approved, as updated in
TD1300. Work on Res. 95-related draft Recommendations also progressed, in particular in Question 12/12.
WTSA-16 Resolution 29 (Alternative calling procedures on international telecommunication networks)
- In response to Res. 29, some discussion took place about quality of service aspects of alternative calling procedures (ACP). A response to WTSA providing updates on the status of
G.ACP “Guidelines regarding the minimum QoS and QoE threshold to be fulfilled during the use of alternative calling procedures” was
approved.
-
SG12’s preparation for WTSA-20 was completed in its previous meeting in April 2020 where its proposal for Res. 2 and ToRs for 18 Questions for study in the next study period
were adopted.
Results by group directly reporting to Plenary
Q1/12
-
Produced the following text for agreement in plenary:
-
New Supplement P.Sup28: Considerations for the development of new QoS and QoE related objective models to be embedded in Recommendations prepared by Study Group 12.
-
Established work item E.AIQ which was assigned to Q12/12.
Q2/12
-
Adopted a response to WTSA providing updates on the status of G.ACP “Guidelines regarding the minimum QoS and QoE threshold to be fulfilled during the use of alternative calling procedures”.
Quality of Service Development Group (QSDG)
- Provided a briefing on the recent
QSDG webinar series;
- Reviewed and updated its work programme for 2021.
Results by working party
Working Party 1/12
- Produced the following texts for consent in plenary:
- Revised Recommendation ITU-T P.381: Technical requirements and test methods for the universal wired headset or headphone interface of digital mobile terminals;
-
Revised Recommendation ITU-T P.382: Technical requirements and test methods for multi-microphone wired headset or headphone interfaces of digital wireless terminals.
Working Party 2/12
-
Established work items P.833.2 and P.834.2.
Working Party 3/12
- Produced the following text for approval in plenary:
- New Recommendation ITU-T E.805.1 (ex. E.QoSMgtMod): QoS operational strategy for improved regulatory supervision on providers of mobile telecommunication services.
- Produced the following texts for consent in plenary:
-
New Recommendation ITU-T E.804.1: Application guide for ITU-T Recommendation E.804: Quality of service aspects for popular services in mobile networks;
-
Corrigendum 1 to Recommendation ITU-T G.1072: Opinion model predicting gaming quality of experience for cloud gaming services;
-
New Recommendation ITU-T P.919 (ex. P.360-VR): Subjective test methodologies for 360 degree video on HMD.
-
Produced the following texts for agreement in plenary:
-
New appendices of Recommendation ITU-T E.812: Crowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks
-
Revised Supplement Y.Sup60: Interpreting Y.1540 Maximum IP-Layer Capacity Measurements.
Future meetings and workshops
Meetings of Study Group 12
A
virtual SG12 plenary meeting with limited scope to take decisions on the determined draft new Recommendation E.805.1 (ex E.QoSMgtMod) and selected open work items was scheduled for 6-7 January 2021.
Work items potentially ready for a decision in January, as identified by Questions and in WP plenaries: P.57, P.58, P.1204.1, P.1204.2, P.DHIP, E.800Sup9-rev, E.803-rev, E.RQST, Y.1545.1, Amendments to P.1204.[3,4,5].
Interim meetings
Please see here for updated information. Additional conference calls of Questions will be announced on the respective mailing lists.
-
Q3/12: RGM - E-meeting, 18 November 2020
- Q5/12: RGM - E-meeting, 17 November 2020
- Qs 7&10/12: Joint monthly e-meetings, September - December 2020
- Q12/12: 12 editing e-meetings, September - December 2020
- Q14/12: Weekly e-meetings, September - December 2020
-
Q14/12: P.BBQCG project - Tri-weekly e-meetings, September - December 2020
-
Q15/12: G.CMVTQS project - Bi-weekly e-meetings, September - December 2020
-
Q17/12: Monthly e-meetings, September - December 2020
-
TBC: Q2/12: E-meetings, September - December 2020
-
TBC: Q9/12: RGM - E-meeting, Early December 2020
-
TBC: Q14/12: RGM - E-meeting
-
TBC: Q19/12: E-meeting, Autumn 2020
Meeting of Quality of Service Development Group (QSDG)
- Details TBC: Amman, Jordan, 2021 (jointly with workshop)
SG12 Workshops
-
Details TBC: Amman, Jordan, 2021 (jointly with QSDG)
Meetings of Intersector Rapporteur Group Audiovisual Quality Assessment (IRG AVQA)
-
Details TBC: E-meeting, Autumn 2020 (jointly with Q19/12 and VQEG)