MPEG-7

MPEG -7 is a retired in the ISO 2002 standard (ISO / IEC 15938 ), which has been defined by the Moving Picture Experts Group, MPEG short. MPEG -7 is a short form, the actual name is Multimedia Content Description Interface. In general, the standard used to describe multimedia data using meta-information. MPEG-7 metadata is stored in the form of one or more XML documents. In addition to the XML representation of the MPEG- 7 data, which is determined by several complex XML schemas, there is also a space- optimized binary representation, called BiM.

Application

MPEG -7 is, in contrast to MPEG-1, MPEG-2 and MPEG-4 compression standard does not for video or audio data. It is used to describe various aspects of multimedia data. Among other MPEG -7 standardized metadata for:

  • The management of production, production and use of content
  • The description of content in structural and semantic point of view,
  • The organization of content,
  • User-specific data such as user profiles and
  • Aspects of access to the data, such as views and summaries.

By the definition of the MPEG-7 descriptors and description structures, it is possible to extend MPEG-7 description to the requirements for the respective applications. Will not get the full functionality of MPEG -7 is required, can use an MPEG -7 profile ( part 9 of the standard), the scope will be limited in terms Descriptors and Description Schemes.

Main components

The MPEG-7 standard specifies three main elements:

Descriptors

  • Descriptors are used for the description of the specific characteristics (features) to be described multimedia file. Such features may be, for example, the color or the title of a scene, but also semantic descriptions of. In general, the representation of a feature descriptor, which in turn is a data segment, which is of some significance to a user or a system.

Description Schemes

  • Description Schemes are predefined Descriptorstrukturen that are related to each other, and it can also be relationships between Descriptors and Description Schemes, or the relations of the Description Schemes each other.

As an example, here are a film whose scenes are on the one hand describes the content, including but technical descriptions (color, luminance, etc. ) are related.

Description Definition Language (DDL)

  • The DDL is a language by which Descriptors and Description Schemes can be defined and extended. It is an extension of XML Schema.

By the definition of the MPEG-7 descriptors and description structures, it is possible to extend MPEG-7 description to the requirements for the respective applications. By means of this description method can be stored and exchanged standardized data in different application fields, such as those used in broadcasting or in multimedia digital libraries.

Construction

The MPEG - 7 standard is currently organized into 10 parts. This organization will make it possible to use also isolated the individual behind the respective points technology fields, which corresponds to the toolbox principle of MPEG. For example, to restrict the scope in terms Descriptors and Descriptor Schemes using profiles ( part 9 ), provided their full functionality is not required.

  • System ( described storage format of MPEG-7 documents)
  • Description Definition Language ( DDL describes the syntax of the MPEG-7 Description Structure )
  • Visual descriptors (Enter description features of images and videos)
  • Audiodeskriptoren ( specify audio signals )
  • Multimedia Description Schemes ( MDS specifies a library of description structures)
  • Reference software ( includes sample implementations for generating and handling of MPEG -7 Descriptors )
  • Conformity ( instructions for carrying out the conformity conditions, quality control)
  • Extraction and use of descriptors ( instructions for dealing with content-based descriptors )
  • Profiles (simplification in the use of limitation on scope description )
  • Schema definitions (collects the XML schemas used together)

MPEG-7-Software/-Demonstratoren

  • Caliph & Emir: Creation and search of MPEG -7 documents for image files.
  • IBM Annex Video Annotation Tool: Creating MPEG -7 documents for video files. Features: Automatic segmentation, manual indexing of segments ( binary release, proprietary license )
  • MPEG- 7 Audio Encoder: Creating MPEG -7 documents for audio files based on automatic extraction of low-level metadata, no user interface (Binary & Source Release, Java, LGPL)
  • XM Feature Extraction Web Service: The functionalities of the Experimentation Model to be low-level MPEG -7 visual descriptions can automatically extract from images as Web services exposed. (PDF file, 811 kB)
  • TU Berlin MPEG- 7 Audio Analyzer ( web demo ): MPEG -7 documents ( XML) to be created for audio files ( WAV, MP3). All 17 MPEG-7 low-level audio descriptors are implemented.
  • TU Berlin MPEG -7 spoken content Demonstrator ( Web Demo ): Creates MPEG -7 documents ( XML) with the spoken content descriptor from a speech signal (WAV, MP3).
  • MP7JRS C Library Complete MPEG -7 implementation of Part 3, 4 and 5 (Visual, Audio and MDS ) of Joanneum Research - Institute for Information and Communication Technologies, Audiovisual Media Group.
585345
de