Executive summary: Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), Geneva, 10-19 January 2017
Note: This is not an official record and is subject to correction or modification
Overview
ITU-T Study Group 12 opened the ITU-T study period 2017-2020 with a meeting held in Geneva from 10 to 19 January 2017. The meeting was attended by 121 participants from 38 countries (see
here for the list of participants). 16 delegates used the remote participation facilities.
The meeting received 68
Contributions and handled 164
TDs. Delegates reviewed 36
incoming Liaison statements and adopted 14
outgoing Liaison statements.
Eleven Recommendations were consented (5 new, 5 revised, 1 amendment), and two informative text were agreed (1 supplement, 1 amendment) (see below for details).
A webinar (announcement |
recording |
slides) was held on 19 January 2017 following the closing plenary, summarizing key meeting results. Photos of the SG12 opening plenary can be found
here.
Major accomplishments
WTSA matters
The first meeting since
WTSA-16, the study group under the leadership of its
new management team re-established its
working party structure, confirmed
rapporteur,
liaison and representative roles, as well as the mandate and leadership positions for its only Regional Group, the SG12 Regional Group on QoS for the Africa Region (SG12 RG-AFR).
The meeting reviewed SG12 related WTSA-16 Resolutions, and took initial action on some of them. In particular, SG12 adopted an operational plan for the implementation of Resolution 95 (Hammamet, 2016) on
ITU-T initiatives to raise awareness on best practices and policies related to service quality. The operational plan
was sent to TSAG, TDAG, and to ITU-T and ITU-D Study Groups.
Provisions were taken to prepare for contributions on "Guidelines regarding the minimum QoS and QoE threshold to be fulfilled during the use of alternative calling procedures," in response to WTSA Resolution 29 (Rev. Hammamet, 2016) on
Alternative calling procedures on international telecommunication networks.
Completed work
|
ITU-T Rec. No. |
Question |
Reference |
New/Rev. |
Title |
AAP/Last Call |
| P.381 | 3/12 |
TD141 | Rev. | Technical requirements and test methods for the universal wired headset or headphone interface of digital mobile terminals |
AAP-5 |
| P.1100 | 4/12 |
TD80R5 | Rev. | Narrow-band hands-free communication in motor vehicles |
AAP-5 |
| P.1110 | 4/12 |
TD81R3 | Rev. | Wideband hands-free communication in motor vehicles |
AAP-5 |
| P.1120 | 4/12 |
TD27R4 | New | Super-wideband and fullband hands-free communication in motor vehicles |
AAP-5 |
| P.1140 | 4/12 |
TD28R2 | Rev. | Speech communication requirements for emergency calls originating from vehicles |
AAP-5 |
| P.501 | 6/12 |
TD86R2 | Rev. | Test signals for use in telephonometry |
AAP-5 |
| P.1310 | 10/12 |
TD95R1 | New | Spatial audio meetings quality evaluation |
AAP-5 |
| E.847 | 11/12 |
TD50R4 | New | Quality of service norms for time-division multiplexing interconnection between telecom networks |
AAP-5 |
| Y.1545.1 | 12/12 |
TD131R3 | New | Framework for monitoring the quality of service of Internet Protocol network services |
AAP-5 |
| E.802 Amd.1 | 12/12 |
TD129 | Rev. | Framework and methodologies for the determination and application of quality of service parameters |
AAP-5 |
| E.811 | 12/12 |
TD130R1 | New | Quality measurement in major events |
AAP-5 |
The meeting consented
new ITU-T Recommendations on
(1) Super-wideband (SWB) and fullband (FB) hands-free communication in motor vehicles (will be known as ITU-T P.1120);
(2) Spatial audio meetings quality evaluation (ITU-T P.1310);
(3) Quality of service (QoS) norms for time-division multiplexing (TDM) interconnection between telecom networks (ITU-T E.847);
(4) Framework for monitoring the Quality of service (QoS) of Internet Protocol (IP) network services (Y.1545.1);
(5) Quality measurement in major events (ITU-T E.811).
Note that ITU-T E.847, Y.1545.1, and E.811 were based on the Contributions and leadership assumed by delegates from developing countries (India; Rwanda; Brazil and Ghana). ITU-T Y.1545.1 and E.811 were initially discussed in SG12's
Quality of Service Development Group (QSDG), before being elevated to Study Group level.
ITU-T E.811 is based on recent experience of Brazil and Ghana in hosting major sports events (2008 Africa Cup of Nations, Ghana; 2014 FIFA World Cup, Brazil; 2016 Summer Olympics, Rio de Janeiro, Brazil).
ITU-T P.1120 is joining its sister Recommendations ITU-T P.1100 and P.1110 (see below).
The meeting consented
revisions of existing ITU-T Recommendations on
(6) Technical requirements and test methods for the universal wired headset or headphone interface of digital mobile terminals (ITU-T P.381);
(7) Narrow-band hands-free communication in motor vehicles (ITU-T P.1100);
(8) Wideband hands-free communication in motor vehicles (ITU-T P.1110);
(9) Speech communication requirements for emergency calls originating from vehicles (ITU-T P.1140);
(10)Test signals for use in telephonometry (ITU-T P.501).
Recommendations in the P.1100 series were updated and revised to remove ambiguity concerning which tests defined in these standards are mandatory, and which are optional, e.g., for the use in
ITU test events.
Revised Recommendation ITU-T P.501 integrates all amendments accrued since 2012, and further updates including an updated description of the double talk test signal; new Chinese and American test signals. Signals in Annex C and D are now available in fullband, super-wideband and narrowband.
SG12 also consented the
amendment of one existing ITU-T Recommendation on
(11) Framework and methodologies for the determination and application of quality of service (QoS) parameters (ITU-T E.802)
Amendment 1 to Recommendation ITU-T E.802 incorporates Annex A, which provides guidance on the selection of representative samples in the measurement of QoS parameters. The guidance takes into account these technical (statistical) and operational (practical QoS data collection) conditions by proposing a simple random sampling methodology. The amendment also adds Appendices IV and V with additional information on the implementation of the sampling algorithm included in Annex A, and on the use of sample-based QoS parameters. Work on this Amendment, which includes a software attachment, was largely driven by a delegate from Lesotho in order to increase the usability of E.802 in the day-to-day work of a regulator. This work was prepared in discussions in SG12 RG-AFR and QSDG, before being elevated to Study Group level.
|
Doc# |
Question |
Reference |
Title |
| P Suppl. 27 | 9/12 |
TD163R1 | Supplement to ITU-T P series of Recommendations: Application of P.863 and P.863.1 for speech processed by blind bandwidth extension approaches |
| P.1203 Amd.1 | 14/12 |
TD139 | Revised Appendix I: Performance figures |
SG12 agreed on two
non-normative texts:
(1) Supplement to ITU-T P series of Recommendations: Application of P.863 and P.863.1 for speech processed by blind bandwidth extension approaches;
(2) Amendment 1 to Recommendation ITU-T P.1203: Completion of performance figures in Appendix I.
The supplement was initially proposed as Implementers' Guide, but changed to a supplement to be in line with the definitions in Recommendation ITU-T A.1. The next meeting foresees a major overhaul of ITU-T P.863 ('POLQA') and P.863.1 incorporating the various supplement and existing related Implementers' Guides, as appropriate.
Amendment 1 to ITU-T P.1203 (P.NATS) will be reflected in the first published version of P.1203.
New work items
SG12 established new work items on
- Transmission characteristics for in car communication (P.ICC);
- Subjective methodology for speech and audio multi-channel test (P.SAT);
- Parametric bitstream-based and pixel based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport for HEVC and UHD (P.NATS Phase II);
- Parametric non-intrusive bitstream assessment for HEVC and 4K media streaming quality over UDP (P.NAMS Phase II);
- Framework for intelligent network analytics and diagnostics (E.FINAD);
- End-to-end QoS for video telephony over 4G mobile networks (G.ViLTE);
- Strategies to establish quality measurement frameworks (E.RQUAL);
- Statistical framework for QoE-centric benchmarking, scoring and ranking (E.NetPerfRank);
- Voice and data QoS KPI thresholds on mobile networks (E.RQST);
- QoE for Virtual Reality (G.QoE-VR).
Work items E.RQUAL, E.NetPerfRank and E.RQST are related to the mandate given to SG12 by WTSA Resolution 95.
G.ViLTE will complement the existing ITU-T G.1028 on end-to-end
QoS for voice over 4G mobile networks (ex. G.VoLTE).
Further to these new work items proposed to lead to new ITU-T Recommendations, provisions were taken to prepare for contributions on "Guidelines regarding the minimum QoS and QoE threshold to be fulfilled during the use of alternative calling procedures," in response to WTSA Resolution 29 (Rev. Hammamet, 2016) on
Alternative calling procedures on international telecommunication networks.
Other issues
As part of the QoENet project (http://www.qoenet-itn.eu/), ITU welcomed 12 early stage researchers in the field of quality of experience (QoE) and their 7 supervisors to attend the first week of the SG12 meeting as invited guests. The programme for the visitors consisted of dedicated sessions and regular SG12 sessions the visitors were able to follow. During the dedicated sessions testimonials (delegates, ITU staff) shared some of their experience in QoS/QoE related standardization with the early stage researchers. In another session, ITU and WIPO representatives discussed the role of intellectual property rights in (ITU) standards. Some of the researchers have already contributed to SG12 in the context of the QoENet project, and is hoped that the visit will motivate the participants to submit more input, in the context of the project and beyond.
SG12 received and responded positively to a request from ETSI TC STQ MOBILE to explore the possibility to establish a close collaboration on certain topics of particular common interest to SG12 and TC STQ MOBILE. Potential areas for close collaboration may include the update and maintenance of the ETSI TS 102 250 series and Recommendation ITU-T E.804; QoS and QoE aspects of digital financial services; subjective test design.
SG12 in the news
Results by group directly reporting to Plenary
Q1/12
- Coordination on WTSA Resolution 95 (Hammamet, 2016)
-
Coordination of response concerning ITU test events
-
Review and response to ETSI TC STQ
-
Adopted four outgoing liaison statements
Q2/12
- Prepared updates for handbooks on country case studies
Regional Group for Africa
-
Appointed new management team
Chairman:
Mr Seyni Malan Fati (Senegal)
Vice-Chairmen:
Mr Hassan Mohamed (Sudan);
Mr Aymen Salah (Tunisia);
Mr Isaac Laryea (Ghana). - Reviewed and confirmed its
ToRs
- Discussed contribution on the use of mobile phones in cars, guidance for telecommunications regulators
Quality of service development group (QSDG)
- Reviewed and updated its work programme for 2017-18
Results by working party
Working Party 1/12
- Produced the following Recommendations for consent in plenary:
- Revised Recommendation ITU-T P.381: Technical requirements and test methods for the universal wired headset or headphone interface of digital mobile terminals;
- Revised Recommendation ITU-T P.501: Test signals for use in telephonometry;
- Revised Recommendation ITU-T P.1100: Narrow-band hands-free communication in motor vehicles;
- Revised Recommendation ITU-T P.1110: Wideband hands-free communication in motor vehicles;
- New Recommendation ITU-T P.1120: Super-wideband and fullband hands-free communication in motor vehicles;
- Revised Recommendation ITU-T P.1140: Speech communication requirements for emergency calls originating from vehicles.
- Established new work items P.ICC and P.SAT
- Adopted four outgoing liaison statements
Working Party 2/12
- Produced the following texts for agreement in plenary:
- Supplement to ITU-T P series of Recommendations: Application of P.863 and P.863.1 for speech processed by blind bandwidth extension approaches;
- Amendment 1 to Recommendation ITU-T P.1203: Completion of performance figures in Appendix I.
- Established new work items P.NATS.ph2, P.NAMS.ph2 and E.FINAD
Working Party 3/12
- Produced the following Recommendations for consent in plenary:
- Amendment 1 to Recommendation ITU-T E.802: Framework and methodologies for the determination and application of quality of service (QoS) parameters;
- New Recommendation ITU-T E.811: Quality measurement in major events;
- New Recommendation ITU-T E.847: Quality of service (QoS) norms for time-division multiplexing (TDM) interconnection between telecom networks;
- New Recommendation ITU-T Y.1545.1: Framework for monitoring the Quality of service (QoS) of Internet Protocol (IP) network services.
- Established new work items G.ViLTE, E.RQUAL, E.NetPerfRank, E.RQST, G.QoE-VR
- Adopted five outgoing liaison statements
Future meetings and workshops
Meetings of SG12
- Next SG12 meeting:
- 19-28 September 2017, Geneva, Switzerland
- Planned future meetings:
- 17-26 April 2018
- 27 November - 6 December 2018
Meetings of Rapporteur groups
(Please see
here for updated information)
- Q4/12: 2 August 2017, Geneva, Switzerland (ITU)
- Q5/12: 29-30 May 2017, Berne, Switzerland (Swisscom)
- Q9/12: June/early July 2017, tbd
- Qs 13, 14, 17/12: 22-24 March 2017, Berlin, Germany (Deutsche Telekom / T-Labs) (tbc)
- Q14/12: 8-12 May 2017, Los Gatos, CA, United States (Netflix) (jointly with VQEG) (tbc)
Meeting of Quality of Service Development Group (QSDG)
- July 2017, Johannesburg, South Africa (hosted by the Southern Africa Telecommunications Association (SATA)) (dates to be confirmed)
Meeting of SG12 Regional Group on QoS for the Africa Region (SG12 RG-AFR)
- Under discussion: the possibility of collocating the meetings of the QSDG and SG12 RG-AFR, when QSDG is meeting in Africa, i.e., 1 day during QSDG meeting in Johannesburg.
