The MPAI project called Multimodal Conversation (MPAI-MMC), one of the earliest MPAI projects, has the ambitious goal of using AI to enable forms of conversation between humans and machines that emul­ate the conversation between humans in completeness and intensity. An important element to achieving this goal is the leveraging of all modalities used by a human when talking to another human: speech, but also text, face, and gesture. In the Conversation with Emotion use case standardised in Version 1 (V1)…

Geneva, Switzerland – 22 June 2022. Today the international, non-profit, unaffiliated Moving Picture, Audio and Data Coding by Artificial Intelligence (MPAI) standards developing organisation has concluded its 21st General Assembly. Among the outcomes is the approval of three Use Cases and Functional Requirements documents for AI Framework V2, Multimodal Conversation V2 and Neural Network Watermarking V1. This milestone is important because MPAI Principal Members intending to participate in the development of the standards can develop the Framework Licences of the…

Friday 3 June, I published MPAI wants to do it again, an article describing the 5 use cases MPAI intends to address in its next Call for Technologies. Yesterday, I ran across How will AI power the metaverse? by Luca Sambucci. The paper identifies some key technologies that happen to be listed among those planned to be in the next MPAI Call for Technologies. Luca writes: “A digital world requires the presence of digital places, as in rooms or villas…

On the 30th of September 2021, on the first anniversary of its incorporation, MPAI approved Version 1 of its Multimodal Conversation standard (MPAI-MMC). The standard included 5 use cases: Conversation with Emotion, Multimodal Question Answering and e Automatic Speech Translation Use Cases. Three months later, MPAI approved Version 1 of Context-based Audio Enhancement (MPAI-CAE). The standard included 4 use cases: Emotion-Enhanced Speech, Audio Recording Preservation, Speech Restoration System and Enhanced Audioconference Experience. A lot more has happened in MPAI beyond these…