Project Details


AI Repository Project

WSIS Prizes Contest 2023 Nominee

The gospel for the hearing-impaired, AI subtitles create new experiences of watching games on an equal basis


Description

It solved the problem of 'inaudible,not clear or inaccurate' for special groups with hearing impairments and people in a mute or noisy environment. China Mobile Migu Corporation is the first in the industry to create AI subtitles for sports live broadcast, and comprehensively improve the accuracy of live broadcast subtitles through innovative research and development of front-end noise reduction, terminology hot words, AI error correction, semantic analysis and other technologies. Improve the level of subtitle translation through translation memory, translation terminology,millions of sports corpus translation training models and other technologies.Realize innovative commercialization of sports live broadcast AI subtitles in the Beijing 2022 Beijing Winter Olympics and Paralympics,the accuracy of Chinese The average accuracy of Chinese characters reaches 96%, as for English words it’s 80%,then it was commercialized in live events on a regular basis including the Top 5 European leagues, Champions League and World Cup. provide a good barrier-free viewing experience for hearing-impaired groups and many users.
Up till now , AI subtitles has been reported by a dozen of mainstream media including China Daily,Xinhua Net and People's Daily Online, and established a normalized communication mechanism with the China Association for the Deaf and the Beijing Information Accessibility Promotion Committee. and was selected successively as as example case of new audio-visual public service by Beijing Radio and Television Bureau,National AI Innovation&Application Avant-garde Zone in Beijing and 'China Quality' magazine

Project website

https://www.miguvideo.com/mgs/website/prd/detail.html?cid=739734315


Action lines related to this project
  • AL C8. Cultural diversity and identity, linguistic diversity and local content 2023
Sustainable development goals related to this project
  • Goal 4: Quality education
  • Goal 10: Reduced inequalities
  • Goal 11: Sustainable cities and communities
  • Goal 16: Peace, justice and strong institutions

Coverage
  • International

Status

Ongoing

Start date

January 2021

End date

Not set


Target beneficiary group(s)
  • Older persons
  • People with disabilities
  • special groups of people in a mute or noisy environment

Replicability

AI subtitles is based on the architectural mode that can be independently deployed, it simplifies the professional AI subtitles production, lowers it’s threshold and costs in the form of platform service, It can provide fast and convenient internal and external access of subtitles productions,Supports Web API, Android/iOS SDK, TV SDK, and unity SDK, which meets the subtitle production demands of different business types, realizes product differentiation and improves user experience,it creates highlight functions, and can be replicable


Sustainability

Project sustainability is mainly reflected in the following aspects:
(1)AI subtitles make its debut in the Beijing Winter Olympics in February,2022.Then its intents and production has being continuously upgraded,it has been commercialized on a regular basis in broadcasting nearly 600 large-scale international sport events including the Top 5 European leagues, Champions League,Asian U23 Cup, East Asian Cup,WNBA and etc..
(2)AI subtitles established a regular communication mechanism with the China Deaf Association and the Beijing Information Accessibility Promotion Committee in order to coordinate development.
(3)In order to meet the new needs of a wonderful life and the multi-scenario applications demands which follow-up,including live broadcasting subtitles in English and other languages,cross-language subtitles and dialect subtitles in conference ,subtitles for cross-language barrier-free calls , and barrier-free simultaneous interaction AI subtitles in Metaverse World.


WSIS values promotion

From the aspect of the industry: 1、There was no subtitle in the sports live broadcast industry, which affects the normal watching of hearing impaired groups,it lacks of attention; 2、Pay attention to vulnerable groups, realize barrier-free communication, which is in line with the WSIS values. From the aspect of the technique: Based on the needs of hearing-impaired and other special groups, create a new model of barrier-free and equal game watching, realize barrier-free subtitles in various scenes, and pay attention to hearing-impaired vulnerable groups; 1、Subtitles for video scenes (1)Chinese and English bilingual live subtitles: In Migu Video’s major international competitions, the Chinese subtitles with its English translation based on Chinese commentary helps hearing-impaired people around the world to enjoy the competition; (2)Sign language subtitle by digital avatar:Based on AI subtitle,we updated the sign language digital avatar,realizing the simultaneous synchronization of the AI subtitles and sign language,The trinity of 'Audio Words and Avatar' accompanies the hearing-impaired people more warmly; (3)Covering all scenes: From the time dimension, it covers live subtitles, full-time review subtitles, and on-demand subtitles for edited highlights; from the client-ends type, it covers mobile phones (Android/iOS), tablets, Web, large-screen and other client-ends to achieve full scenes' coverage; 2、Subtitles of cross-language conference scenes: We extend from video scenes to conference scenes, and from sports scenes to general scenes, to realize cross-language subtitle transcription and translation, and help more people to realize native language communication; 3、Subtitles for barrier-free call scenes: add subtitle capabilities in call scenes to realize multi-language barrier-free calls;


Entity name

Migu Culture Technology Co., Ltd

Entity country—type

China Private Sector

Entity website

https://www.migu.cn/