You are currently viewing Functional requirements for 3 new standards published

Functional requirements for 3 new standards published

  • Post author:
  • Post category:MPAI

Geneva, Switzerland – 22 June 2022. Today the international, non-profit, unaffiliated Moving Picture, Audio and Data Coding by Artificial Intelligence (MPAI) standards developing organisation has concluded its 21st General Assembly. Among the outcomes is the approval of three Use Cases and Functional Requirements documents for AI Framework V2, Multimodal Conversation V2 and Neural Network Watermarking V1.

This milestone is important because MPAI Principal Members intending to participate in the development of the standards can develop the Framework Licences of the three planned standards. The Framework Licence has been devised by MPAI to facilitate the practical availability of approved standards (see here for an example). It is a licence without critical data such as cost, dates, rates etc. MPAI is now drafting the Calls for Technologies for the 3 standards and plans to adopt and publish them on 2022/07/19, the 2nd anniversary of the launch of the MPAI project.

AI Framework (MPAI-AIF) V1 specifies an infrastructure enabling the execution of implementations and access to the MPAI Store. V2 will add security support to the framework and is the next step following today’s release of the MPAI-AIF V1 Reference Software.

Multimodal Conversation (MPAI-MMC) V1 Enables human-machine conversation emulating human-human conversation. V2 will specify technologies supporting 5 new use cases:

  1. Personal Status Extraction: provides an estimate of the Personal Status (PS) – of a human or an avatar – conveyed by Text, Speech, Face, and Gesture. PS is the ensemble of information internal to a person, including Emotion, Cognitive State, and Attitude.
  2. Personal Status Display: generates an avatar from Text and PS that utters speech with the intended PS while the face and gesture show the intended PS.
  3. Conversation About a Scene: a human holds a conversation with a machine about objects in a scene. While conversing, the human points their fingers to indicate their interest in a particular object. The machine is helped by the understanding of the human’s PS.
  4. Human-Connected Autonomous Vehicle (CAV) Interaction: a group of humans converse with a CAV which understands the utterances and the PSs of the humans it converses with and manifests itself as the output of a Personal Status Display.
  5. Avatar-Based Videoconference: avatars representing humans with a high degree of accuracy participate in a videoconference. A virtual secretary (VS) represented as an avatar displaying PS creates an online summary of the meeting with a quality enhanced by the virtual secretary’s ability to understand the PS of the avatar it converses with.

Neural Network Watermarking (MPAI-NNW): will provide the means to measure, for a given size of the watermarking payload, the ability of 1) the watermark inserter to inject a payload without deteriorating the NN performance, 2) the watermark detector to recognise the presence and the watermark decoder to successfully retrieve the payload of the inserted watermark, 3) the watermark inserter to inject a payload and the watermark detector/decoder to detect/decode a payload from a watermarked model or from any of its inferences at a measured computational cost.

MPAI will hold four online presentations of the documents on the following dates:

TitleAcronymDay of July TimeNote
AI Framework V2MPAI-AIF1115:00 UTCRegister
Multimodal Conversation V2MPAI-MMC0714:00 UTCRegister
Multimodal Conversation V2MPAI-MMC1214:00 UTCRegister
Neural Network WatermarkingMPAI-NNW1215:00 UTCRegister

MPAI-MMC will be presented in two sessions because of the number and scope of the use cases and of the supporting technologies.

Those intending to attend a presentation event are invited to register at the link above.

MPAI develops data coding standards for applications that have AI as the core enabling technology. Any legal entity supporting the MPAI mission may join MPAI, if able to contribute to the development of standards for the efficient use of data.

So far, MPAI has developed 5 standards (normal font in the list below), is currently engaged in extending two approved standards (underlined) and is developing other 9 standards (italic).

Name of standardAcronymBrief description
AI FrameworkMPAI-AIFSpecifies an infrastructure enabling the execution of implementations and access to the MPAI Store.
Context-based Audio EnhancementMPAI-CAEImproves the user experience of audio-related applications in a variety of contexts.
Compression and Understanding of Industrial DataMPAI-CUIPredicts the company performance from governance, financial, and risk data.
Governance of the MPAI EcosystemMPAI-GMEEstablishes the rules governing the submission of and access to interoperable implementations.
Multimodal ConversationMPAI-MMCEnables human-machine conversation emulating human-human conversation.
Server-based Predictive Multiplayer GamingMPAI-SPGTrains a network to com­pensate data losses and detects false data in online multiplayer gaming.
AI-Enhanced Video CodingMPAI-EVCImproves existing video coding with AI tools for short-to-medium term applications.
End-to-End Video CodingMPAI-EEVExplores the promising area of AI-based “end-to-end” video coding for longer-term applications.
Connected Autonomous VehiclesMPAI-CAVSpecifies components for Environment Sensing, Autonomous Motion, and Motion Actuation.
Avatar Representation and AnimationMPAI-ARASpecifies descriptors of avatars impersonating real humans.
Neural Network WatermarkingMPAI-NNW Measures the impact of adding ownership and licensing information to models and inferences.
Integrative Genomic/Sensor AnalysisMPAI-GSACompresses high-throughput experiments data combining genomic/proteomic and other.
Mixed-reality Collaborative SpacesMPAI-MCSSupports collaboration of humans represented by avatars in virtual-reality spaces.
Visual Object and Scene DescriptionMPAI-OSDDescribes objects and their attributes in a scene.

Visit the MPAI website, contact the MPAI secretariat for specific information, subscribe to the MPAI Newsletter and follow MPAI on social media: LinkedIn, Twitter, Facebook, Instagram, and YouTube.

Most importantly: join MPAI, share the fun, build the future.