Commit Graph

245 Commits

Author SHA1 Message Date
szabadka
a13ea018f5 Merge pull request #114 from szabadka/master
Brotli custom LZ77 dictionary support.
2015-06-12 15:45:41 +02:00
Zoltan Szabadka
b43df8f699 Brotli custom LZ77 dictionary support.
Adds functions to prepend such dictionary to the
encoder and decoder, and twiddles their internal
parameters to do as if that was a previous part of
the input. This dictionary is just a prefilled LZ77
window, it is not related to the built in transformable
brotli dictionary.
2015-06-12 15:43:54 +02:00
szabadka
631184d40c Merge pull request #113 from szabadka/master
Speedups to brotli quality 11.
2015-06-12 15:32:31 +02:00
Zoltan Szabadka
667f70adcb Speedups to brotli quality 11.
* Cluster at most 64 histograms at a time in the first
    round of clustering.

  * Use a faster histogram cost estimation function.

  * Don't compute the log2(total) multiple times in the
    block splitter.
2015-06-12 15:29:06 +02:00
szabadka
af09ee7344 Merge pull request #112 from szabadka/master
Speedups and fixes to the decoder.
2015-06-12 15:14:13 +02:00
Zoltan Szabadka
641bc15882 Speedups and fixes to the decoder.
* Read data by 4-byte runs.
    This resolves unaligned read (Bus error) on arm-android.

  * Get rid of malloc/free in BrotliBuildHuffmanTable.

  * Tweak order of instructions when reading Huffman codes.
2015-06-12 15:12:23 +02:00
lvandeve
e0510a828e Update README.md 2015-06-12 14:31:47 +02:00
szabadka
996ec28993 Merge pull request #111 from szabadka/master
Create -04 version of the internet draft.
2015-05-11 17:22:04 +02:00
Zoltan Szabadka
ea35936816 Change the expiration date and title of the -04 draft. 2015-05-11 17:04:13 +02:00
Zoltan Szabadka
14ea2b5805 Create -04 version of the draft. 2015-05-11 17:03:35 +02:00
szabadka
6ee61e78c8 Merge pull request #110 from anthrotype/test_quality
[roundtrip_test.py] repeat test at different quality (1, 6, 9, 11)
2015-05-11 15:15:55 +02:00
Cosimo Lupo
e356b9bc2f [roundtrip_test.py] repeat test at different quality (1, 6, 9, 11) 2015-05-11 14:12:37 +01:00
szabadka
682facef7b Merge pull request #109 from szabadka/master
Expose the quality parameter to the bro.cc tool.
2015-05-11 14:15:05 +02:00
Zoltan Szabadka
8d83839ac2 Expose the quality parameter to the bro.cc tool. 2015-05-11 14:14:05 +02:00
szabadka
463ceda563 Merge pull request #108 from szabadka/master
Use the same hasher for text and font mode.
2015-05-11 14:12:24 +02:00
Zoltan Szabadka
6622355a9a Use the same hasher for text and font mode.
We use 4-byte hashing in both and look for length 3
matches separately.
2015-05-11 14:11:07 +02:00
szabadka
6bb4316280 Merge pull request #107 from szabadka/master
Fix broken quality 0, make it same as quality 1.
2015-05-11 13:52:54 +02:00
Zoltan Szabadka
cc8d64dfec Fix broken quality 0, make it same as quality 1. 2015-05-11 13:51:47 +02:00
szabadka
cc211b92f1 Merge pull request #105 from anthrotype/newparams
[python] expose new encoder parameters as kwargs of brotli.compress
2015-05-11 13:36:43 +02:00
Cosimo Lupo
c93c0dab92 [bro.py] use brotli.MODE_GENERIC as default compression mode;
remove additional low-level parameters
2015-05-11 11:10:48 +01:00
Cosimo Lupo
aa6f7d8f0c [brotlimodule] add MODE_GENERIC constant 2015-05-11 11:09:36 +01:00
Cosimo Lupo
b7e8291788 [bro.py] remove debug print 2015-05-11 10:39:29 +01:00
Cosimo Lupo
4106a406d0 [bro.py] use new optional encoder parameters when compressing;
modified the help string to include the new parameters.
2015-05-11 10:39:28 +01:00
Cosimo Lupo
32c44ec87d [bro.py] use argparse instead of getopt 2015-05-11 10:39:26 +01:00
Cosimo Lupo
3351bb08e3 [brotlimodule] apply uniform docstring style 2015-05-11 10:39:24 +01:00
Cosimo Lupo
6d935db75c [brotlimodule] add quality, lgwin and lgblock parameters 2015-05-11 10:39:23 +01:00
Cosimo Lupo
dbcb32614a [brotlimodule] add enable_context_modeling parameter (defaults to True) 2015-05-11 10:39:21 +01:00
Cosimo Lupo
4c1d06931e [brotlimodule] add new keyword params docstring of brotli.compress 2015-05-11 10:39:20 +01:00
Cosimo Lupo
6264bea2e4 [brotlimodule] add greedy_block_split parameter (defaults to False);
renamed variables: transform -> enable_transforms, dictionary -> enable_dictionary
2015-05-11 10:39:18 +01:00
Cosimo Lupo
b2eba122c8 [brotlimodule] add enable_dictionary parameter (defautls to True) 2015-05-11 10:39:17 +01:00
Cosimo Lupo
89c74d6859 [brotlimodule] use keyword arguments for mode and enable_transforms;
update brotli.compress docstring accordingly
2015-05-11 10:39:15 +01:00
szabadka
621cd0cf04 Merge pull request #106 from szabadka/master
Add a MODE_GENERIC compression mode to the interface.
2015-05-11 11:34:39 +02:00
Zoltan Szabadka
aa853f3cbc Add a MODE_GENERIC compression mode to the interface.
With this the users can distinguish between not knowing
what the input is (ddefault) and knowing that it is text,
and thus can be relied on to force some UTF-8 specific settings.
2015-05-11 11:33:19 +02:00
szabadka
288f70d7ea Merge pull request #104 from anthrotype/py3split
[python] fix compatibility_test.py with Python 3
2015-05-08 11:11:22 +02:00
Cosimo Lupo
e6913b2e78 [python] use built-in split instead of 'string' module for py23
In python3, the 'string' module no longer has a 'split' function.
2015-05-08 10:06:18 +01:00
szabadka
4e94277e9d Merge pull request #103 from szabadka/master
Handle multiple compressed files per original in the test.
2015-05-07 20:46:40 +02:00
Zoltan Szabadka
10a2f3745a Handle multiple compressed files per original in the test.
Add some more test cases that decompress to the empty
file or a one byte long file. These test cases have
examples for the updated stream header and meta-block
header formats.
2015-05-07 20:43:01 +02:00
szabadka
7ee6449b83 Merge pull request #102 from szabadka/master
Restrict the ARM optimizations to little endian architectures.
2015-05-07 20:37:22 +02:00
Zoltan Szabadka
bef6938af7 Restrict the ARM optimizations to little endian architectures. 2015-05-07 20:36:35 +02:00
szabadka
14c571ca0b Merge pull request #101 from szabadka/master
Add an Acknowledgements section to the spec.
2015-05-07 20:11:15 +02:00
Zoltan Szabadka
78350a9135 Add an Acknowledgements section to the spec. 2015-05-07 20:10:22 +02:00
szabadka
f0500266c8 Merge pull request #100 from szabadka/master
Fix 32bit build.
2015-05-07 19:47:14 +02:00
Zoltan Szabadka
f3e71e441e Fix 32bit build. 2015-05-07 19:45:21 +02:00
szabadka
7c277c3ef7 Merge pull request #99 from szabadka/master
Support window bits 10 - 15 in the decoder.
2015-05-07 17:45:18 +02:00
Zoltan Szabadka
54f69c9ef7 Support window bits 10 - 15 in the decoder.
The previous window bit value 17 is used to
extend the range, since it has not been used
in any previous encoders.
2015-05-07 17:44:33 +02:00
szabadka
7bbfd5df95 Merge pull request #98 from szabadka/master
Align distance code meaning in the brotli encoder.
2015-05-07 17:41:11 +02:00
Zoltan Szabadka
12eb9bfd70 Align distance code meaning in the brotli encoder.
Two different definitions (offset by 1) were used in
command.h and hash.h. Now they have been made the same,
also consistent with the spec (e.g. 0 means use previous dist, etc...)
2015-05-07 17:40:00 +02:00
szabadka
fa2c6df4f5 Merge pull request #97 from szabadka/master
Faster encoding for low quality settings.
2015-05-07 17:36:37 +02:00
Zoltan Szabadka
7cde616c9e Faster encoding for low quality settings.
With this commit, the encoder will skip some
compression optimization steps for quality <= 4,
which results in faster compression but higher
compressed sizes.
2015-05-07 17:30:10 +02:00
szabadka
e4a309ac07 Merge pull request #96 from szabadka/master
Use a static context map with two buckets for UTF8 data.
2015-05-07 17:24:12 +02:00