Multiview Video Coding

Source: Wikipedia, the free encyclopedia.

Multi view Video Coding (MVC, also known as MVC 3D) is a

H.264 (MPEG-4 AVC) video compression standard, developed jointly by MPEG and VCEG,[2] with contributions from a number of companies, primarily Panasonic and LG Electronics.[3]

MVC formatting is intended for encoding

Blu-ray 3D releases.[4]

Technical overview

MVC is based on the idea that video recordings of the same scene from multiple angles share many common elements. It is possible to encode all simultaneous frames captured in the same

elementary stream and to share as much information as possible across the different layers. This can reduce the size of the encoded video.[5][6]

Multiview video contains a large amount of inter-view statistical dependencies, since all cameras capture the same scene from different viewpoints. Therefore, combined temporal and inter-view prediction is important for efficient MVC encoding. A frame from a certain camera can be predicted not only from temporally related frames from the same camera, but also from the frames of neighboring cameras. These interdependencies can be used for efficient prediction.[7][8][9]

The method for this is used in Multiview Video Coding for Blu-ray 3D movies is known as the 2D plus Delta algorithm, and the MVC specification itself is part of the H.264 standard as an amendment in H.264 “Annex H” of the specification.[10]

Open source support mostly missing

As of April 2015, there is no free and open-source software that supports software decoding of the MVC video compression standard.[11] Popular open source H.264 and HEVC (H.265) decoders, such as those used in the FFmpeg and Libav libraries, simply ignore the second view and thus do not show the second view for stereoscopic views. In most cases, the reason for this support not being added is that MVC was not considered when the initial core H.264 and HEVC decoders code was written. Later amendment would as such often mean a lot of prerequisite code refactoring work and large changes its current architecture, with major work in untangling and reordering some code, and splitting different functions in existing decoder code into smaller chunks for simpler handling to in turn then make amendments such as MVC easier to add.[12]

Some

proof-of-concept work has however been done downstream in the past, but never made it upstream into official releases of FFmpeg or Libav.[13][14]

On March 8, 2016, the situation improved. Version 0.68 of the DirectShow Media Splitter and Decoders Collection

MPC-HC)) with support of H.264 MVC 3D demuxing and decoding. With the aid of this release and FRIM [16] written by a programmer named “videohelp3d” [17] it is possible to write an AviSynth script to pre process a H.264 MVC 3D video clip which can then be opened by free 3D video player Bino[18] and then shown as red — cyan anaglyph video for example.[11]

The usage of the FRIM AviSynth plugin (FRIMSource) is described on “videohelp3d” home page. LAV Filters can be used to get audio from H.264 MVC 3D video clip. The developer [19] posted that in a future release of, it might be possible that LAV Video renders the video as Side-by-Side directly.[20]

Patent holders

The following organizations hold patents that contributed to the development of MVC technology, listed in a patent pool by MPEG LA.[21]

Organization[22] Active patents Expired patents Total patents[3]
Panasonic 607 41 648
LG Electronics 85 2 87
Dolby Laboratories
 77 3 80
Fraunhofer 65 0 65
Fujitsu 59 3 62
Mitsubishi Electric 28 21 49
GE 31 0 31
Tagivan II LLC 27 0 27
Siemens 14 9 23
Columbia University 0 17 17
Maxell 14 0 14
Thomson
Licensing 		0 14 14
Koninklijke KPN N.V.1 0 13 13
Nippon Telegraph and Telephone 8 0 8
NTT Docomo 6 0 6
Sony 5 0 5
Electronics and Telecommunications Research Institute 2 1 3
HP Inc. 0 1 1

See also

References

  1. ^ https://research.nokia.com/page/4988 Archived 16 July 2015 at the Wayback Machine Mobile 3D Video
  2. ^ "Archived copy" (PDF). Archived from the original (PDF) on 19 July 2011. Retrieved 13 January 2011.{{cite web}}: CS1 maint: archived copy as title (link) 3DTV AT HOME: STATUS, CHALLENGES AND SOLUTIONS FOR DELIVERING A HIGH QUALITY EXPERIENCE
  3. ^ a b "MVC Patent List" (PDF). MPEG LA. Retrieved 11 July 2019.
  4. ^ "mpeg4-mvc - 3D Vision Blog". Retrieved 8 March 2023.
  5. ^ https://wiki.libav.org/Blueprint/MultiAVFrame Libav MultiAVFrame Blueprint
  6. ISBN 978-0-470-02273-3
    .
  7. ^ MPEG – Technologies – Introduction to Multiview Video Coding
  8. ^ http://vision.princeton.edu/projects/2008/ECCV_stereo/paper_low-res.pdf Learning Two-View Stereo Matching
  9. ^ http://cs.nyu.edu/~fergus/teaching/vision_2012/6_Multiview_SfM.pdf Lecture 6: Multi-view Stereo & Structure from Motion
  10. ^ http://www.itu.int/rec/T-REC-H.264 H.264 : Advanced video coding for generic audiovisual services
  11. ^
    S2CID 453153
    .
  12. ^ blogs.gentoo.org/lu_zero/2014/04/04/the-road-to-mvc/ The road to MVC
  13. ^ http://www.nt.uni-saarland.de/fileadmin/file_uploads/theses/master/Optimized_implementation_of_a_MVC_decoder.pdf Archived 4 March 2016 at the Wayback Machine Jochen Britz – Optimized implementation of an MVC decoder – Master’s Thesis in Computer and Communication Technology
  14. ^ https://github.com/Britz/FFmpeg Britz – In terms of my master thesis, I work on a H.264 MVC implementation in libvacodec based on H.264 Annex H.
  15. ^ https://github.com/Nevcairiel/LAVFilters GitHub repository of LAV Filters project Retrieved 2016-03-30
  16. ^ http://www.videohelp.com/software/FRIM Videohelp download page Retrieved 2016-03-30
  17. ^ http://forum.doom9.org/showthread.php?t=169651 developers page of "videohelp3d" Retrieved 2016-03-30
  18. ^ http://bino3d.org/index.html Home page of Bino - a free 3D video player Retrieved 2016-03-30
  19. ^ http://forum.doom9.org/showthread.php?t=156191&page=1029 developers page of "Nevcairiel" (at bottom of page) Retrieved 2016-03-30
  20. ^ CrendKing (10 February 2022), AviSynth Filter and VapourSynth Filter, retrieved 10 February 2022
  21. ^ "Media: Licensing Programs". MPEG LA. Retrieved 10 February 2022.
  22. ^ "Licensors Included in the MVC Patent Portfolio License". MPEG LA. Retrieved 11 July 2019.

External links

Retrieved from "https://en.wikipedia.org/w/index.php?title=Multiview_Video_Coding&oldid=1216387443"