“Digital human”  has recently become a trendy expression and different meanings can be attached to it. MPAI says that it is “a digital object able to receive text/audio/video/commands (“Information”) and generate Information that is congruent with the received Information”. MPAI has been developing several standards for “digital humans” and plans on extending them and developing more. Let’s have an overview. In Conversation with Emotion a digital human perceives text or speech from and video of a human. It then generates…

The year 2021 was very productive for MPAI. In January it started with a Call for Technologies on AI Framework and ended in December with 5standards approved and 7 projects in the pipeline. How was that possible? Simple: intense collaborative work. OK, but exactly how? So far MPAI has not held physical meetings. MPAI does all current work online in 1, 2 or 3 one-hour sessions a day in the 13-18 UTC time frame. Purpose of this post is to…

Today video/audio conference is a virtual space where many of us spend their working hours. Still the experience of a conference suffer from many deficiencies depending on the fact that the way audio is captured and conveyed to the virtual space is inadequate. Our brains can separate the voice of competing speakers, and remove the effect of non-ideal acoustical properties of the physical space and/or the background noise in the same in the same physical environment. However, when the acoustic…

The third context of the Context-based Audio Enhancement (MPAI-CAE) standard is restoration of damaged speech. Unlike Audio Recording Preservation where audio has clear provenance – the magnetic tape of an open reel whose analogue audio has been digitised – Speech Restoration System does not make a reference to anything analogue. It assumes that there is a file containing digital speech. For whatever reason, it may be so that portions of the file are damaged – maybe the physical medium from…