Multimedia framework, applications and services
(Continuation of Question 21/16)
MotivationThe standardization work in Study Group 16 has resulted in the definition of several multimedia systems. ITU-T H.610 defines a multiservice system architecture and customer premises equipment architecture for the delivery of video, data and voice services across a VDSL access network to an in-home environment, and the H.700-series defines a family of IPTV protocols. As broadband services over various access technologies have evolved and given that the desire for the delivery of multimedia services to the home and other service platforms has gained attention from service providers, networking architectural issues and their impact on broader communication systems and services must also be considered.
With the fast development of smart buildings, smart communities and smart cities, requirements for vertical industry services and applications, such as civilian unmanned aerial vehicle (CUAV) communication and related applications and services are fast growing. Communication applications based on or using CUAV are strongly related to multimedia services and applications, such as CUAV mission payload related picture and video, data and images, and their display as well as virtual reality presentation, etc. should be taken as the study objectives and tasks for this Question. Definition of requirements, architectures and protocols in support of massive successful commercial deployment of CUAV communication application and service is crucial for this Question.
To echo the growth trend in intelligent multimedia services and applications, this Question will also focus on architectural and protocol issues for typical intelligent multimedia services and applications such as intelligent question answering services and language learning service.
With the continuous development of network technologies and multimedia technologies, a variety modal of smart devices gets into people's daily life. Smart devices are expected to provide multimedia communication capabilities besides assisting home automation. It is particularly important to integrate new technologies into the existing communication capabilities, providing more intelligent, scenario-based and linkage-based communication services. This Question will study and investigate some multimedia services over smart devices.
The Question will also pay attention to the multimedia framework, applications, and services built for various systems, e.g., cloud computing systems, museum information systems, etc., and underlying networks, e.g., information-centric networks and error-prone networks. It also follows with interest Internet video, internet-based streaming media services, language learning, multimedia services based on mobile edge computing (MEC), etc. For each of these networks or systems, the specific requirement(s), architecture and protocols need to be identified and standardized.
Study itemsStudy items to be considered include, but are not limited to:
- identify multimedia services and applications that are studied by ITU and other bodies and produce a map of their interrelationship;
- identify the services and applications to be explored by Study Group 16 and define their respective scopes, requirements and contribute to the development of technical specifications;
- study of cloud computing-based multimedia services and applications by identifying requirements, defining architectures and developing underlying protocols;
- study service-agnostic, context awareness adaptation. Multimedia service systems are required to be aware of and adaptive to frequent changes in the environment, such as variable bandwidth, transport delay, device capabilities and instability, etc. when the user accesses the system from different sites/strata of network;
- study media streams transport: generic formats and encapsulation methods of various media streams for the purpose of transport over heterogeneous networks (in coordination with relevant IETF WGs such as AVT Core);
study of multimedia system, service and application based on cutting-edge technologies by identifying requirements, defining architectures and developing underlying protocols;
- study CUAV-related multimedia application and services (such as power line and petroleum pipeline inspection, disaster monitoring, environmental quality monitoring and forecasting analysis, aerial photography and video, express delivery, forestry and forest fire monitoring, and crop monitoring, etc.) as well as CUAV task executing, cooperation, video/audio data transmission optimization, flight electronic fence along with artificial-intelligence controlling, multimedia display and virtual reality presentation;
study MEC-related multimedia services (such as MEC based VR/AR application, vehicles interconnection, traffic information monitoring and management);
- study big data related technology, solutions, services and regulations;
- study smart device-based multimedia application and services (such as smart speaker-based audio/video communication, set-top box based multimedia communications) as well as their advanced presentation forms on Ultra-HD, VR and holographic communication;
- study Internet-based streaming media services (such as online education, video based online shopping, video based social services, live event broadcast, video-based marketing, online corporate training, online medical diagnosis, voice calling, etc.);
- study network-related multimedia framework, applications, and services, which built for various systems, e.g. cloud computing systems, museum information systems, etc., and underlying networks, information-centric networks, error-prone networks, mobile edge networks etc.
TasksTasks include, but are not limited to:
- documentation of architectural assumptions made by previous work on multimedia standardization (H- and T-series Recommendations) and production of the scope, use cases, and requirements capture for the services and applications under Study Group 16 responsibility, such as speech-to-speech translation, CUAV communication service, application and framework; intelligent question answering systems and language learning systems; information-centric networks; error-prone networks; network-related multimedia frameworks; MEC based multimedia application and service;
- study the requirements for and, if needed, create F-series Recommendations to cover new applications and services; e.g.:
- retrieval services, including interactive audiovisual and multimedia services;
- real-time collaboration services;
- intelligent multimedia services and applications;
- cloud-computing-based multimedia services and applications;
- CUAV inspection, monitoring, logistics express delivery and signal relay services;
- MEC-based multimedia services and applications;
- intelligent question answering systems and language learning systems;
- big data architecture and related application and services;
- Internet-based streaming media services;
- network-related multimedia framework, applications, and services;
- coordinate with ITU‑T Study Groups 2, 9, 11, 12, 13, 15, 17, 20 and other groups to advance multimedia services and applications related work;
- enhancement and maintenance of Recommendations ITU-T F.700, F.701, F.702, F.703, F.720, F.721, F.723, F.724, F.731, F.732, 733, F.740, F.741, F.742, F.743, F.743.1, F.745, F.746, F.746.1, F.746.2, F.746.3, F.746.4, F.746.5, F.746.6, F.746.7, F.746.8, F.746.9, F.749.10, F.750, F.761, H.610, H.611, H.622.2, H.625, H.626, H.626.1, H.627;
- identification of requirements for service-agnostic multimedia service functions;
- develop service-agnostic architecture specifications, such as the inspection technology, inspection policy, delivery function, network topologies, robustness, etc.
An up-to-date status of work under this Question is found in the SG16 work programme
(
https://www.itu.int/ITU-T/workprog/wp_search.aspx?sp=16&q=21/16).
Relationships
Recommendations
- E, F, G, H, I, Q, T, V, X, Y-series Recommendations under the responsibility of SG16
- ITU‑T J.160- and J.170-series
Questions
- All Questions of Study Group 16
Study groups
- ITU‑T SGs 2, 9, 11, 12, 13, 15, 17 and 20 for multimedia studies related to cloud computing, future networks and IoT
- ITU‑T SG5 for ICT and climate change issues
- ITU‑R SG6 for multimedia-related studies and broadcast services and applications
Other bodies- 3GPP, 3GPP2 for mobile multimedia services and applications
- Architectural groups within regional telecommunications standardization bodies
- IETF for Internet services (particularly the Applications and Real-Time Area, Transport Area, and Internet Area)
- W3C for Internet multimedia services and applications
- DMTF for cloud computing related multimedia services and applications
- IMTC for interoperability
- Broadband Forum for home network issues and other E2E IP/MPLS network issues
- ISO, IEC, OASIS and UN/ECE for the MoU on electronic business
- ISO/IEC JTC1/SCs 25 (home networking), 29 (JPEG/MPEG), 35 (user interfaces)
- APT ASTAP E.G.-MA for speech-to-speech translation
