Video Acceleration API
 | This article may be too technical for most readers to understand. (November 2021) |
| Original author(s) | Intel |
|---|---|
| Initial release | 2008 |
| Stable release | 2.21.0[1]
/ 26 March 2024 |
| Repository | |
| Written in | C |
| Operating system | Linux, Android, BSD, Windows 10, Windows 11 |
| Type | API |
| License | MIT License |
| Website | www |
Video Acceleration API (VA-API) is an
free and open-source library
libva, combined with a hardware-specific driver, usually provided together with the GPU driver.
VA-API video decode/encode interface is platform and window system independent but is primarily targeted at
video encoding, subpicture blending, and rendering.[2]
The VA-API specification was originally designed by
XvMC standard as the default Unix multi-platform equivalent of Microsoft Windows DirectX Video Acceleration (DxVA) API, but today the API is no longer limited to Intel-specific hardware or GPUs.[3] Other hardware and manufacturers can freely use this open standard API for hardware accelerated video processing with their own hardware without paying a royalty fee.[4]
Overview
The main motivation for VA-API is to enable hardware-accelerated video decode at various entry-points (
MotionComp only, it made more sense to design an interface from scratch that can fully expose the video decode capabilities in today's GPUs.[6]
Supported hardware and drivers
As of 2022, VA-API is natively supported by:[7]
- Intel Quick Syncopen-source drivers for Linux
- Mesa open-source drivers for AMD and Nvidia graphics cards
- AMDGPU-PRO drivers for AMD graphics cards on Linux
- libva-vdpau-driver for cards supported by VDPAU
- Direct3D 12 implementations with the VAOn12 driver[8]
Supported video codecs
VA-API currently supports these video codecs in the official mainline version, but note that exactly which video codecs are supported depends on the hardware and the driver's capabilities.
- MPEG-2 decode acceleration Main Profile
- VC-1 / WMV3 decode acceleration Advanced Profile
- MPEG-4 Part 2 (H.263) (a.k.a. MPEG-4 SP / MPEG-4 ASP, more commonly known as Xvid) decode acceleration
- H.264 AVCencode acceleration Main Profile
- H.264 AVC decode acceleration High Profile
- H.264 / AVC Hardware Variable Length Decoding (VLD) - CABAC
- H.264 / AVC Hardware Variable Length Decoding (VLD) - CAVLC
- H.264 / AVC Hardware Inverse Transform (IT)
- H.264 / AVC Hardware Motion Compensation (HWMC)
- H.264 / AVC Hardware In-Loop Deblocking (ILDB)
- H.265/HEVC encode acceleration
- H.265/HEVC decode acceleration
- VP9 8-bit encode acceleration[9]
- VP9 8-bit and 10-bit decode acceleration[9]
- AV1 8-bit and 10-bit encode acceleration
- AV1 8-bit and 10-bit decode acceleration[7]
Processes that can be accelerated with VA-API
Video decoding and post-processing processes that can be offloaded and accelerated if both the device drivers and GPU hardware supports them:
- Motion compensation
- Inverse discrete cosine transform
- In-loop deblocking filter
- Intra-frame prediction
- variable-length decoding, more commonly known as slice-level acceleration
- Bitstream processing (Context-adaptive variable-length coding/Context-adaptive binary arithmetic coding)
Software architecture
The current interface is window system independent, so that it can potentially be used with graphics sub-systems other than the
compressed bit-stream
.
Software supporting VA-API
- Cluttertoolkit
- Jellyfin media server
- datarhei Restreamer real-time live video streaming
- Emby media server (starting from release 3.0.6400)[10]
- ffmpeg, a command line tool from the FFmpeg project, supports VA-API encoding through CLI with version starting from 3.1 and also libavcodec (also part of the FFmpeg project) does contain code that other applications use to support hardware accelerated decoding, including VA-API.[13]
- Fluendo[14]
- Gnash Flash / SWF player[15]
- GStreamer through gstreamer-vaapi[16]
- Kodi (formerly XBMC Media Center) (Linux)[17]
- Kodibuntu (formerly XBMC Live) (Linux Live CD/USB operating-system)[17]
- MPlayer (v1 with patches)[18] and its fork mpv (native)
- MythTV (starting from release 0.25)[19]
- OpenShot
- VLC media player (starting from release 1.1.0)[20]
- Bluecherry DVR client (starting from release 2.2.6)[21]
- Xine (via "xine-lib-vaapi" library) since Version 1.2.3[22]
- OBS Studio[23]
- Firefox (On Wayland since release 78 and on X11 since release 80)[24][25]
See also
- Distributed Codec Engine (libdce) — Texas Instruments API for the video codec engine in OMAP based embedded systems
- OpenMAX — a royalty-free cross-platform media abstraction API from the Khronos Group
References
- ^ "libva 2.21.0". 26 March 2024. Retrieved 26 March 2024.
- ^ "VA-API Video Acceleration On Intel Medfield - Phoronix". Phoronix.com. Retrieved 23 February 2019.
- ^ "Video4Linux2: Path to a Standardized Video Codec API" (PDF). Events.linuxfoundation.org. Retrieved 23 February 2019.
- ^ Nathan Willis (2009-07-01). "VA API slowly, but surely, making progress". Lwn.net.
- ^ "Mplayer, FFmpeg Gain VA-API Support - Phoronix". Phoronix.com. Retrieved 23 February 2019.
- ^ "vaapi". Freedesktop.org. Retrieved 23 February 2019.
- ^ a b "Hardware video acceleration". wiki.ArchLinux.org.
- ^ Vilerino, Sil (2023-02-15). "Video acceleration API (VA-API) now available on Windows!". DirectX Developer Blog. Retrieved 2023-03-08.
- ^ a b "Hardware/vaapi". wiki.libav.org. Archived from the original on 2017-02-01. Retrieved 2017-01-20.
- ^ "Emby Server 3.0.6400 Released". Emby.media. 29 August 2016. Retrieved 23 February 2019.
- ^ "Mailing list entry that describes uses of VA-API". Lists.moblin.org. Retrieved 23 February 2019.
- ^ "RealPlayer for MID & Intel/Linux FAQ". HelixCommunity.org. Archived from the original on 2012-03-24. Retrieved 2011-05-12.
- ^ "Archived copy". Archived from the original on 2016-09-16. Retrieved 2016-08-31.
{{cite web}}: CS1 maint: archived copy as title (link) - ^ "Fluendo's New Codecs Support VDPAU, VA-API - Phoronix". Phoronix.com. Retrieved 23 February 2019.
- ^ "H.264 VA-API GPU Video Acceleration For Flash - Phoronix". Phoronix.com. Retrieved 23 February 2019.
- ^ "Hardware-accelerated video decoding, encoding and processing on Intel graphics through VA-API". Cgit.freedesktop.org. Retrieved 23 February 2019.
- ^ a b "XBMC Gets Working Intel VA-API Support - Phoronix". Phoronix.com. Retrieved 23 February 2019.
- ^ "Mplayer in vaapi - Gitorious". Archived from the original on 2013-08-03. Retrieved 2014-02-10.
- ^ "Release Notes - 0.25 - MythTV Official Wiki". Mythtv.org. Retrieved 23 February 2019.
- ^ "VLC 1.1.0 release - VideoLAN". Videolan.org. Retrieved 23 February 2019.
- ^ "[Client] 2.2.6 Released – Significant CPU usage reductions included". Bluecherrydvr.com. 2 March 2017. Retrieved 23 February 2019.
- ^ "the xine project - News Feed". Xine-project.org. Retrieved 23 February 2019.
- ^ "OBS Studio Now Supports VA-API For Video Encoding - Phoronix". www.phoronix.com. Retrieved 2020-08-06.
- ^ "Firefox on Fedora finally gets VA-API on Wayland". mastransky.wordpress.com. 3 June 2020. Retrieved 2020-08-19.
- ^ "Firefox 80 Available With VA-API On X11, WebGL Parallel Shader Compile Support". www.phoronix.com. Retrieved 2020-08-25.
External links
- Official website
- Intel Media and Audio for Linux
- mobile-hw-decode
- "VA API slowly -- but surely -- making progress" – an overview from 2009
- "MPlayer, FFmpeg Gain VA-API Support" – from 2008
| Architecture |  | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Extensions | |||||||||||||||
| Components and notable implementations |
| ||||||||||||||
| Standards |
| ||||||||||||||
| Applications |
| ||||||||||||||
Free and open-source software projects hosted by freedesktop.org | ||||||||
|---|---|---|---|---|---|---|---|---|
| OS components |
|  | ||||||
| Libraries | ||||||||
| Frameworks | ||||||||
| Meetings | ||||||||