Research, standards and thoughts for the digital world

Earlier posts by categories:


MPAI is running at full speed

  • Post author:
  • Post category:MPAI

Established in September 2020, MPAI has published five standard this week bringing the total to nine. Let’s see what they are about. MPAI Metaverse Model (MPAI-MMM) – Architecture is the first technical metaverse standard published by a standard body. MPAI MMM specifies technologies enabling two metaverse instances M-InstanceA and M-InstanceB to interoperate if they: rely on the same Operation Model, use the same Profile, and either use the same technologies, or use independent technologies while accessing Conversion Services that losslessly transform data…

Continue ReadingMPAI is running at full speed

New AI-driven standards pioneer the future of immersive entertainment

  • Post author:
  • Post category:MPAI

The founder of MPEG, Leonardo Chiariglione, inspired by the prospects of AI, is leading an initiative – MPAI (Moving Picture, Audio and Data Coding by Artificial Intelligence) – to drive AI standards that will supercharge next-generation immersive entertainment venues.  They have already developed a range of AI standards for audio enhancement and more natural forms of human-machine conversation and others which have subsequently been adopted by the IEEE. The MPAI community is now focused on developing standards for XR Venues…

Continue ReadingNew AI-driven standards pioneer the future of immersive entertainment

What is the Object and Scene Description (MPAI-OSD) Call for Technologies about?

  • Post author:
  • Post category:MPAI

Object and Scene Description (MPAI-OSD) is a project for a standard specifying technologies for object description and their localisation in space. Such technologies are used across several use cases of several MPAI standards. Figure 1 gives two examples that assume the types of output to Audio and Visual Scene Descriptors. Figure 1 - Audio and Visual Scene Description The nextFigure 2 provides one solution to the problem of assigning identifiers to the Objects – extracted from an audio-visual scene, especially…

Continue ReadingWhat is the Object and Scene Description (MPAI-OSD) Call for Technologies about?

An overview of AI Framework (MPAI-AIF)

From its early days, MPAI realised that AI-based data coding standards could facilitate AI explainability if monolithic AI applications could be broken down to individual components with identified functionality processing and producing data with semantics known as far as possible. An important side effect of this approach was identified in the possibility for developers to provide components with standard interfaces and potentially better performance than that provided by other developers. Version 1 of AI Framework (MPAI-AIF) published in September 2021…

Continue ReadingAn overview of AI Framework (MPAI-AIF)

What is the AI for Health Call for Technologies about?

AI for Health (MPAI-AIH) is a project addressing interfaces and data types involved in an AIH Platform where End Users acquire and process health data on their handsets equipped with an AI Framework executing AI Workflows enabled by models distributed by the AIH Back end and installed in their handsets (AIH Front ends). Figure 1 depicts the AIH Front end. Figure 1 – The AIH Front-End End Users upload their processed health data with associated Smart Contracts granting the AIH…

Continue ReadingWhat is the AI for Health Call for Technologies about?

An overview of Avatar Representation and Animation (MPAI-ARA)

  • Post author:
  • Post category:MPAI

“Digital humans” are computer-created digital objects that can be rendered with a human appearance and called Avatars. As Avatars have mostly been created, animated, and rendered in closed environments, there is no surprise that there has been very little need for standards. In a communication context, say, in an interoperable metaverse, digital humans may not be constrained to be in a closed environment. Therefore, if a sender requires that a remote receiving client reproduce a digital human as intended by…

Continue ReadingAn overview of Avatar Representation and Animation (MPAI-ARA)