Video coding format
A video coding format
Some video coding formats are documented by a detailed
Video content encoded using a particular video coding format is normally bundled with an audio stream (encoded using an
Distinction between format and codec
A format is the layout plan for data produced or consumed by a codec.
Although video coding formats such as H.264 are sometimes referred to as codecs, there is a clear conceptual difference between a specification and its implementations. Video coding formats are described in specifications, and software,
This distinction is not consistently reflected terminologically in the literature. The H.264 specification calls
As an example of conflation, Chromium's[5] and Mozilla's[6] pages listing their video format support both call video coding formats such as H.264 codecs. As another example, in Cisco's announcement of a free-as-in-beer video codec, the press release refers to the H.264 video coding format as a codec ("choice of a common video codec"), but calls Cisco's implementation of a H.264 encoder/decoder a codec shortly thereafter ("open-source our H.264 codec").[7]
A video coding format does not dictate all
History
The concept of
The earliest digital video coding algorithms were either for
Motion-compensated DCT
Practical
DCT coding is a
The other key development was motion-compensated hybrid coding.
The DCT was applied to video encoding by Wen-Hsiung Chen,
Video coding standards
The first digital video coding standard was
The most widely used video coding format as of 2019[update] is
A main problem for many video coding formats has been
The current-generation video coding format is
List of video coding standards
Basic algorithm | Video coding standard | Year | Publishers | Committees | Licensors | Market presence (2019)[33] | Popular implementations |
---|---|---|---|---|---|---|---|
DPCM | H.120 | 1984 | CCITT | VCEG
|
— | — | Unknown |
DCT | H.261 | 1988 | CCITT | VCEG | — | Videoconferencing, videotelephony
| |
Motion JPEG (MJPEG) | 1992 | JPEG | JPEG | Open Source does NOT mean free! [40]
|
— | QuickTime | |
MPEG-1 Part 2
|
1993 | ISO, IEC | MPEG
|
— | Video CD, Internet video | ||
H.262 / MPEG-2 Part 2 (MPEG-2 Video) | 1995 | ISO, IEC, ITU-T | MPEG, VCEG | 29% | SDTV
| ||
DV | 1995 | IEC | IEC | Sony, Panasonic | Unknown | Camcorders, digital cassettes
| |
H.263 | 1996 | ITU-T | VCEG | Mitsubishi, Hitachi, Panasonic, etc.[32] | Unknown | Videoconferencing, videotelephony, MPEG-4 Visual
| |
MPEG-4 Part 2 (MPEG-4 Visual) | 1999 | ISO, IEC | MPEG | Mitsubishi, Hitachi, Panasonic, etc.[32] | Unknown | Internet video, DivX, Xvid | |
DWT | Motion JPEG 2000 (MJ2) | 2001 | JPEG[44] | JPEG[45] | — | Unknown | Digital cinema[46] |
DCT | Advanced Video Coding (H.264 / MPEG-4 AVC) | 2003 | ISO, IEC, ITU-T | MPEG, VCEG | Panasonic, etc.[34]
|
91% | Silverlight, VOD
|
Theora | 2004 | Xiph | Xiph | — | Unknown | Internet video, web browsers
| |
VC-1 | 2006 | SMPTE
|
SMPTE
|
Microsoft, Panasonic, LG, Samsung, etc.[47] | Unknown | Blu-ray, Internet video | |
Apple ProRes | 2007 | Apple | Apple | Apple | Unknown | Video production, post-production | |
High Efficiency Video Coding (H.265 / MPEG-H HEVC) | 2013 | ISO, IEC, ITU-T | MPEG, VCEG | Samsung, GE, NTT, JVCKenwood, etc.[39][48] | 43% | ||
AV1 | 2018 | AOMedia
|
AOMedia
|
— | 7% | HTML5 video
| |
Versatile Video Coding (VVC / H.266) | 2020 | JVET | JVET | Unknown | — | — |
Lossless, lossy, and uncompressed
Consumer video is generally compressed using
Uncompressed video formats, such as Clean HDMI, is a form of lossless video used in some circumstances such as when sending video to a display over a HDMI connection. Some high-end cameras can also capture video directly in this format.
Intra-frame
Interframe compression complicates editing of an encoded video sequence.[50] One subclass of relatively simple video coding formats are the
Because interframe compression copies data from one frame to another, if the original frame is simply cut out (or lost in transmission), the following frames cannot be reconstructed properly. Making 'cuts' in intraframe-compressed video while video editing is almost as easy as editing uncompressed video: one finds the beginning and ending of each frame, and simply copies bit-for-bit each frame that one wants to keep, and discards the frames one does not want. Another difference between intraframe and interframe compression is that, with intraframe systems, each frame uses a similar amount of data. In most interframe systems, certain frames (such as "I frames" in MPEG-2) are not allowed to copy data from other frames, so they require much more data than other frames nearby.[51]
It is possible to build a computer-based video editor that spots problems caused when I frames are edited out while other frames need them. This has allowed newer formats like HDV to be used for editing. However, this process demands a lot more computing power than editing intraframe compressed video with the same picture quality. But, this compression is not very effective to use for any audio format.[52]
Profiles and levels
A video coding format can define optional restrictions to encoded video, called profiles and levels. It is possible to have a decoder which only supports decoding a subset of profiles and levels of a given video format, for example to make the decoder program/hardware smaller, simpler, or faster.[53]
A profile restricts which encoding techniques are allowed. For example, the H.264 format includes the profiles baseline, main and high (and others). While P-slices (which can be predicted based on preceding slices) are supported in all profiles, B-slices (which can be predicted based on both preceding and following slices) are supported in the main and high profiles but not in baseline.[54]
A level is a restriction on parameters such as maximum resolution and data rates.[54]
See also
- Comparison of video container formats
- Data compression § Video
- Display resolution
- List of video compression formats
- Video file format
Notes
- ^ The term video coding includes Advanced Video Coding, High Efficiency Video Coding, and Video Coding Experts Group.[1]
References
- ^ Thomas Wiegand; Gary J. Sullivan; Gisle Bjontegaard & Ajay Luthra (July 2003). "Overview of the H.264 / AVC Video Coding Standard" (PDF). IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY.
- ^ a b "SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS : Infrastructure of audiovisual services – Coding of moving video : Advanced video coding for generic audiovisual services". Itu.int. Retrieved January 6, 2015.
- ^ "Front Page". Alliance for Open Media. Retrieved May 23, 2016.
- ^ Adrian Grange; Peter de Rivaz & Jonathan Hunt. "VP9 Bitstream & Decoding Process Specification" (PDF).
- ^ "Audio/Video". The Chromium Projects. Retrieved May 23, 2016.
- ^ "Media formats supported by the HTML audio and video elements". Mozilla. Retrieved May 23, 2016.
- ^ Rowan Trollope (October 30, 2013). "Open-Sourced H.264 Removes Barriers to WebRTC". Cisco. Archived from the original on May 14, 2019. Retrieved May 23, 2016.
- ^ "Chapter 3 : Modified A* Prune Algorithm for finding K-MCSP in video compression" (PDF). Shodhganga.inflibnet.ac.in. Retrieved January 6, 2015.
- ^ a b c d e f g h i j "History of Video Compression". ITU-T. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6). July 2002. pp. 11, 24–9, 33, 40–1, 53–6. Retrieved November 3, 2019.
- .
- ^ ISBN 9780852967102.
- ^ a b c d e f Lea, William (1994). Video on demand: Research Paper 94/68. House of Commons Library. Retrieved September 20, 2019.
- ISBN 9780470857649.
- .
- S2CID 149806273
- ISBN 978-0-12-580203-1
- ^ .
- S2CID 13743007.
- ISBN 9780120145720.
A significant advance in image coding methodology occurred with the introduction of the concept of hybrid transform/DPCM coding (Habibi, 1974).
- ISBN 9783662466919.
- ^ S2CID 62725808.
- ISBN 9783642870378.
- ^ a b c Stanković, Radomir S.; Astola, Jaakko T. (2012). "Reminiscences of the Early Work in DCT: Interview with K.R. Rao" (PDF). Reprints from the Early Days of Information Sciences. 60. Retrieved October 13, 2019.
- .
- CCITT. September 1992. Retrieved July 12, 2019.
- ISBN 9780786487974.
- ^ ISBN 9789812709998.
- ^ a b c d e f g "The History of Video File Formats Infographic". RealNetworks. April 22, 2012. Retrieved August 5, 2019.
- ^ a b "ITU-T Recommendation declared patent(s)". ITU. Retrieved July 12, 2019.
- ^ a b "MPEG-2 Patent List" (PDF). MPEG LA. Retrieved July 7, 2019.
- ISBN 9781483298511.
- ^ a b c "MPEG-4 Visual - Patent List" (PDF). MPEG LA. Retrieved July 6, 2019.
- ^ a b c "Video Developer Report 2019" (PDF). Bitmovin. 2019. Retrieved November 5, 2019.
- ^ a b "AVC/H.264 – Patent List" (PDF). MPEG LA. Retrieved July 6, 2019.
- S2CID 2060937.
- ^ "Digital Video Broadcasting (DVB); Specification for the use of video and audio coding in DVB services delivered directly over IP" (PDF).
- ^ "World, Meet Thor – a Project to Hammer Out a Royalty Free Video Codec". August 11, 2015.
- ^ Thomson, Gavin; Shah, Athar (2017). "Introducing HEIF and HEVC" (PDF). Apple Inc. Retrieved August 5, 2019.
- ^ a b "HEVC Patent List" (PDF). MPEG LA. Retrieved July 6, 2019.
- ^ ISO. "Home". International Standards Organization. ISO. Retrieved August 3, 2022.
- ^ "ISO Standards and Patents". ISO. Retrieved July 10, 2019.
- ^ Davis, Andrew (June 13, 1997). "The H.320 Recommendation Overview". EE Times. Retrieved November 7, 2019.
- ISBN 9780780341470.
H.263 is similar to, but more complex than H.261. It is currently the most widely used international video compression standard for video telephony on ISDN (Integrated Services Digital Network) telephone lines.
- ^ "Motion JPEG 2000 Part 3". Joint Photographic Experts Group, JPEG, and Joint Bi-level Image experts Group, JBIG. Archived from the original on October 5, 2012. Retrieved June 21, 2014.
- ISBN 9781461507994.
- ISBN 9780240806174.
- ^ "VC-1 Patent List" (PDF). MPEG LA. Retrieved July 11, 2019.
- ^ "HEVC Advance Patent List". HEVC Advance. Archived from the original on August 24, 2020. Retrieved July 6, 2019.
- ^ Filippov, Alexey; Norkin, Aney; Alvarez, José Roberto (April 2020). "RFC 8761 - Video Codec Requirements and Evaluation Methodology". datatracker.ietf.org. Retrieved February 10, 2022.
- ^ Bhojani, D.R. "4.1 Video Compression" (PDF). Hypothesis. Retrieved March 6, 2013.
- ISBN 9788190639675.
- ^ "WebCodecs". www.w3.org. Retrieved February 10, 2022.
- ^ "Video Rendering - an overview | ScienceDirect Topics". www.sciencedirect.com. Retrieved February 10, 2022.
- ^ a b Jan Ozer. "Encoding options for H.264 video". Adobe.com. Retrieved January 6, 2015.