Brotli compression format
Go to file
Dmitry Rozhkov 0cd2e3926e
Fix MSVC linker error (#840)
The -lm linker option is not known to MSVC and setting it triggers
errors in some build systems:

  [6,366 / 6,367] Linking source/exe/envoy-static.exe; 11s remote
  LINK : warning LNK4044: unrecognized option '/lm'; ignored
  LINK : error LNK1218: warning treated as error; no output file generated
  ERROR: C:/source/source/exe/BUILD:22:16: Linking of rule
    '//source/exe:envoy-static' failed (Exit 4044): link.exe failed: error
    executing command

Do not set -lm in case of MSVC.
2020-09-08 16:48:31 +02:00
.github/workflows Adding CIFuzz (#797) 2020-03-19 09:52:07 +01:00
c add execution time (#834) 2020-09-07 10:53:03 +02:00
csharp Transpile Java speedup (#548) 2017-05-07 17:40:12 +02:00
docs Update (#807) 2020-05-15 11:06:21 +02:00
fetch-spec Update shared-brotli-fetch-spec.txt 2017-11-17 01:38:05 +01:00
go Update (#807) 2020-05-15 11:06:21 +02:00
java Update (#807) 2020-05-15 11:06:21 +02:00
js Update (#807) 2020-05-15 11:06:21 +02:00
python Update (#807) 2020-05-15 11:06:21 +02:00
research Update (#826) 2020-08-26 12:32:27 +02:00
scripts Revert "Add runtime linker path to pkg-config files (#740)" (#838) 2020-09-02 11:38:26 +02:00
tests Fix build files (#829) 2020-08-26 17:13:31 +02:00
.editorconfig Add an EditorConfig file to provide consistent style across editors. (#579) 2017-08-02 16:58:43 +02:00
.gitattributes Re-add python bindings to sources tarball 2020-08-27 16:01:44 +02:00
.gitignore .gitignore: Ignore .obj files (#805) 2020-05-15 13:05:03 +02:00
.gitmodules New feature: "Large Window Brotli" (#640) 2018-02-26 09:04:36 -05:00
.travis.yml Update (#826) 2020-08-26 12:32:27 +02:00
bootstrap Address issues noted in #833 2020-08-28 10:14:08 +02:00
BUILD Fix MSVC linker error (#840) 2020-09-08 16:48:31 +02:00
CMakeLists.txt Fix build files (#829) 2020-08-26 17:13:31 +02:00
compiler_config_setting.bzl Update (#807) 2020-05-15 11:06:21 +02:00
configure Update (#620) 2017-11-28 15:37:28 +01:00
configure-cmake Move files & update paths (#541) 2017-04-23 14:07:08 +02:00
configure.ac Update (#620) 2017-11-28 15:37:28 +01:00
CONTRIBUTING.md Apply 80-chars limit to CONTRIBUTING.md 2016-02-18 15:20:59 +01:00
LICENSE Prepare to release 0.4.0 2016-06-14 15:07:13 +02:00
Makefile make/build: ensure NEON is enabled and tested (#718) 2018-10-17 17:29:32 +02:00
Makefile.am Fix missing symbols errors in libbrotlienc and dec (#623) 2017-11-29 22:38:16 +01:00
MANIFEST.in Update MANIFEST.in 2017-09-19 11:25:55 +02:00
premake5.lua Added windows platform support to premake (#567) 2017-07-10 19:57:05 +02:00
README Fix #741 2019-02-18 11:31:48 +01:00
README.md Re-release 2020-08-27 16:12:55 +02:00
setup.cfg Python: Update README with information about code formatting 2016-10-17 13:57:56 -04:00
setup.py Update (#826) 2020-08-26 12:32:27 +02:00
WORKSPACE Inverse bazel project/workspace tree (#677) 2018-06-04 17:53:16 +02:00

Brotli

SECURITY NOTE

Please consider updating brotli to version 1.0.9 (latest).

Version 1.0.9 contains a fix to "integer overflow" problem. This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash.

Introduction

Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression.

The specification of the Brotli Compressed Data Format is defined in RFC 7932.

Brotli is open-sourced under the MIT License, see the LICENSE file.

Brotli mailing list: https://groups.google.com/forum/#!forum/brotli

TravisCI Build Status AppVeyor Build Status Fuzzing Status

Build instructions

Vcpkg

You can download and install brotli using the vcpkg dependency manager:

git clone https://github.com/Microsoft/vcpkg.git
cd vcpkg
./bootstrap-vcpkg.sh
./vcpkg integrate install
vcpkg install brotli

The brotli port in vcpkg is kept up to date by Microsoft team members and community contributors. If the version is out of date, please create an issue or pull request on the vcpkg repository.

Autotools-style CMake

configure-cmake is an autotools-style configure script for CMake-based projects (not supported on Windows).

The basic commands to build, test and install brotli are:

$ mkdir out && cd out
$ ../configure-cmake
$ make
$ make test
$ make install

By default, debug binaries are built. To generate "release" Makefile specify --disable-debug option to configure-cmake.

Bazel

See Bazel

CMake

The basic commands to build and install brotli are:

$ mkdir out && cd out
$ cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=./installed ..
$ cmake --build . --config Release --target install

You can use other CMake configuration.

Premake5

See Premake5

Python

To install the latest release of the Python module, run the following:

$ pip install brotli

To install the tip-of-the-tree version, run:

$ pip install --upgrade git+https://github.com/google/brotli

See the Python readme for more details on installing from source, development, and testing.

Benchmarks

Disclaimer: Brotli authors take no responsibility for the third party projects mentioned in this section.

Independent decoder implementation by Mark Adler, based entirely on format specification.

JavaScript port of brotli decoder. Could be used directly via npm install brotli

Hand ported decoder / encoder in haxe by Dominik Homberger. Output source code: JavaScript, PHP, Python, Java and C#

7Zip plugin

Dart native bindings