Brotli compression format
Go to file
Stephen Kyle 9402ac5c08 decode: faster huffman code loading on 32-bit Arm (#703)
* platform: add macro for using the 'aligned' attribute

* decode: add accessor macros for HuffmanCode fields

Adds a constructor function for building HuffmanCode values
so they can be accessed quickly on different architectures.

Also adds macros for marking a HuffmanCode table pointer
that can be accessed quickly (BROTLI_HC_MARK_TABLE_FOR_FAST_LOAD),
adjusting the index into that table (BROTLI_HC_ADJUST_TABLE_INDEX),
and getting the .bits or .value fields out of the table at the
current index (BROTLI_HC_GET_BITS/VALUE).

For example, assuming |table| contains a HuffmanCode pointer:

  BROTLI_HC_MARK_TABLE_FOR_FAST_LOAD(table);
  BROTLI_HC_ADJUST_TABLE_INDEX(table, index_into_table);
  *bits = BROTLI_HC_GET_BITS(table);
  *value = BROTLI_HC_GET_VALUE(table);
  BROTLI_HC_ADJUST_TABLE_INDEX(table, offset);
  *bits2 = BROTLI_HC_GET_BITS(table);
  *value2 = BROTLI_HC_GET_VALUE(table);

All uses of the HuffmanCode have been updated appropriately.

* decode: add alternative accessors for HuffmanCode on Arm AArch32
2018-09-27 13:15:46 +02:00
c decode: faster huffman code loading on 32-bit Arm (#703) 2018-09-27 13:15:46 +02:00
csharp Transpile Java speedup (#548) 2017-05-07 17:40:12 +02:00
docs Update (#651) 2018-03-20 17:37:41 +06:00
fetch-spec Update shared-brotli-fetch-spec.txt 2017-11-17 01:38:05 +01:00
go Update go_library to use standard importpath (#690) 2018-06-26 18:08:07 +02:00
java Update (#706) 2018-09-13 08:09:32 -04:00
js Update (#706) 2018-09-13 08:09:32 -04:00
python Fix "memory leak" in python tests (#652) 2018-03-23 02:09:00 +06:00
research Update (#680) 2018-06-09 11:17:13 +02:00
scripts Cross compilation support (#709) 2018-09-27 11:00:33 +02:00
tests Cross compilation support (#709) 2018-09-27 11:00:33 +02:00
.editorconfig Add an EditorConfig file to provide consistent style across editors. (#579) 2017-08-02 16:58:43 +02:00
.gitignore Inverse bazel project/workspace tree (#677) 2018-06-04 17:53:16 +02:00
.gitmodules New feature: "Large Window Brotli" (#640) 2018-02-26 09:04:36 -05:00
.travis.yml Cross compilation support (#709) 2018-09-27 11:00:33 +02:00
bootstrap New feature: "Large Window Brotli" (#640) 2018-02-26 09:04:36 -05:00
BUILD Inverse bazel project/workspace tree (#677) 2018-06-04 17:53:16 +02:00
CMakeLists.txt Cross compilation support (#709) 2018-09-27 11:00:33 +02:00
configure Update (#620) 2017-11-28 15:37:28 +01:00
configure-cmake Move files & update paths (#541) 2017-04-23 14:07:08 +02:00
configure.ac Update (#620) 2017-11-28 15:37:28 +01:00
CONTRIBUTING.md Apply 80-chars limit to CONTRIBUTING.md 2016-02-18 15:20:59 +01:00
LICENSE Prepare to release 0.4.0 2016-06-14 15:07:13 +02:00
Makefile Cross compilation support (#709) 2018-09-27 11:00:33 +02:00
Makefile.am Fix missing symbols errors in libbrotlienc and dec (#623) 2017-11-29 22:38:16 +01:00
MANIFEST.in Update MANIFEST.in 2017-09-19 11:25:55 +02:00
premake5.lua Added windows platform support to premake (#567) 2017-07-10 19:57:05 +02:00
README Update (#620) 2017-11-28 15:37:28 +01:00
README.md Update README.md (#646) 2018-03-20 17:53:32 +06:00
setup.cfg Python: Update README with information about code formatting 2016-10-17 13:57:56 -04:00
setup.py Fix missing header files (#695) 2018-07-09 10:40:08 +02:00
WORKSPACE Inverse bazel project/workspace tree (#677) 2018-06-04 17:53:16 +02:00

Brotli

Introduction

Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression.

The specification of the Brotli Compressed Data Format is defined in RFC 7932.

Brotli is open-sourced under the MIT License, see the LICENSE file.

Brotli mailing list: https://groups.google.com/forum/#!forum/brotli

TravisCI Build Status AppVeyor Build Status

Build instructions

Autotools-style CMake

configure-cmake is an autotools-style configure script for CMake-based projects (not supported on Windows).

The basic commands to build, test and install brotli are:

$ mkdir out && cd out
$ ../configure-cmake
$ make
$ make test
$ make install

By default, debug binaries are built. To generate "release" Makefile specify --disable-debug option to configure-cmake.

Bazel

See Bazel

CMake

The basic commands to build and install brotli are:

$ mkdir out && cd out
$ cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=./installed ..
$ cmake --build . --config Release --target install

You can use other CMake configuration.

Premake5

See Premake5

Python

To install the latest release of the Python module, run the following:

$ pip install brotli

To install the tip-of-the-tree version, run:

$ pip install --upgrade git+https://github.com/google/brotli

See the Python readme for more details on installing from source, development, and testing.

Benchmarks

Disclaimer: Brotli authors take no responsibility for the third party projects mentioned in this section.

Independent decoder implementation by Mark Adler, based entirely on format specification.

JavaScript port of brotli decoder. Could be used directly via npm install brotli

Hand ported decoder / encoder in haxe by Dominik Homberger. Output source code: JavaScript, PHP, Python, Java and C#

7Zip plugin

Dart native bindings