gzip

gzip (software)

Original author(s)	Jean-loup Gailly Mark Adler
Developer(s)	GNU Project
Initial release	31 October 1992; 31 years ago (1992-10-31)
Stable release	1.13[1]  / 19 August 2023
Repository	git.savannah.gnu.org/cgit/gzip.git
Written in	C
Operating system	Unix-like, Plan 9, Inferno
Type	Data compression
License	GPL-3.0-or-later
Website	www.gnu.org/software/gzip/

gzip is a

(from where the "g" of gzip is derived). Version 0.1 was first publicly released on 31 October 1992, and version 1.0 followed in February 1993.

The decompression of the gzip format can be implemented as a streaming algorithm, an important feature for Web protocols, data interchange and ETL (in standard pipes) applications.

File format

gzip (file format)

Filename extension	.gz
Internet media type	application/gzip[2]
Uniform Type Identifier (UTI)	org.gnu.gnu-zip-archive
Magic number	1f 8b
Developed by	Jean-loup Gailly and Mark Adler
Type of format	Data compression
Open format?	Yes
Website	gzip.org (obsolete)

gzip is based on the

utility and other popular archivers.

"gzip" is often also used to refer to the gzip file format, which is:

• a 10-byte header, containing a magic number (1f 8b), the compression method (08 for DEFLATE), 1-byte of header flags, a 4-byte timestamp, compression flags and the operating system ID.
• optional extra headers as allowed by the header flags, including the original filename, a comment field, an "extra" field, and the lower half of a
  CRC-32 checksum for the header section.^[3]
• a body, containing a DEFLATE-compressed payload
• an 8-byte trailer, containing a CRC-32 checksum and the length of the original uncompressed data, modulo 2³².^[4]

tar

program to compress multiple files.

Although its file format also allows for multiple such streams to be

and then compressing that archive with gzip. The final compressed file usually has the extension .tar.gz or .tgz.

gzip is not to be confused with the ZIP archive format, which also uses DEFLATE. The ZIP format can hold collections of files without an external archiver, but is less compact than compressed tarballs holding the same data, because it compresses files individually and cannot take advantage of redundancy between files (solid compression). The gzip file format is also not to be confused with the that of the compress utility, based on LZW, with extension .Z; however, the gunzip utility is able to decompress .Z files.^[8]

Implementations

NetBSD Gzip / FreeBSD Gzip

Developer(s)	The NetBSD Foundation
Repository	cvsweb.netbsd.org/bsdweb.cgi/src/usr.bin/gzip/
Written in	C
Type	Data compression
License	Simplified BSD License

Various implementations of the program have been written. The most commonly known is the GNU Project's implementation using

format.

An alternative compression program achieving 3-8% better compression is Zopfli. It achieves gzip-compatible compression using more exhaustive algorithms, at the expense of compression time required. It does not affect decompression time.

pigz, written by Mark Adler, is compatible with gzip and speeds up compression by using all available CPU cores and threads.^[11]

Damage recovery

Data in blocks prior to the first damaged part of the archive is usually fully readable. Data from blocks not demolished by damage that are located afterward may be recoverable through difficult workarounds.^[12]

Derivatives and other uses

The tar utility included in most Linux distributions can extract .tar.gz files by passing the z option, e.g., tar -zxf file.tar.gz, where -z instructs decompression, -x means extraction, and -f specifies the name of the compressed archive file to extract from. Optionally, -v (verbose) lists files as they are being extracted.^[13]

zlib is an abstraction of the DEFLATE algorithm in library form which includes support both for the gzip file format and a lightweight data stream format in its API. The zlib stream format, DEFLATE, and the gzip file format were standardized respectively as RFC 1950, RFC 1951, and RFC 1952.

The gzip format is used in HTTP compression, a technique used to speed up the sending of HTML and other content on the World Wide Web. It is one of the three standard formats for HTTP compression as specified in RFC 2616. This RFC also specifies a zlib format (called "DEFLATE"), which is equal to the gzip format except that gzip adds eleven bytes of overhead in the form of headers and trailers. Still, the gzip format is sometimes recommended over zlib because Internet Explorer does not implement the standard correctly and cannot handle the zlib format as specified in RFC 1950.^[14]

zlib DEFLATE is used internally by the

(PNG) format.

Since the late 1990s, bzip2, a file compression utility based on a block-sorting algorithm, has gained some popularity as a gzip replacement. It produces considerably smaller files (especially for source code and other structured text), but at the cost of memory and processing time (up to a factor of 4).^[15]

AdvanceCOMP, Zopfli, libdeflate and 7-Zip can produce gzip-compatible files, using an internal DEFLATE implementation with better compression ratios than gzip itself—at the cost of more processor time compared to the reference implementation.^{[citation needed]}

Research published in 2023 showed that simple lossless compression techniques such as gzip could be combined with a

See also

• Comparison of file archivers
• Free file format
• List of archive formats
• List of Unix commands
• Libarc
• Brotli

Notes

References

• RFC 1952 – GZIP file format specification version 4.3

External links

• Official website