Commit Graph

279 Commits

Author SHA1 Message Date
Yann Collet
31683c0b28 benchmark can use dictionary 2015-12-18 01:26:48 +01:00
Yann Collet
fdcad6d3e1 added ZSTD_compress_usingDict() 2015-12-17 23:50:15 +01:00
Yann Collet
035c5429ba fix test32 2015-12-17 23:12:07 +01:00
Yann Collet
deb078b9b1 added : -m : decompress multiple files 2015-12-17 20:30:14 +01:00
Yann Collet
9d90922d49 refactored file compression 2015-12-17 14:09:55 +01:00
Yann Collet
24c98f2b4b fixed : conversion warning 2015-12-17 02:48:26 +01:00
Yann Collet
4f13703b2f added : -m : compress multiple files in a single command 2015-12-17 02:23:58 +01:00
Yann Collet
367060b874 larger cBuffer 2015-12-17 00:07:10 +01:00
Yann Collet
ad84ac9375 reduce memory usage 2015-12-16 03:57:46 +01:00
Yann Collet
880486ff05 fix g++ warning 2015-12-16 03:37:21 +01:00
Yann Collet
a52c98d23a fix Visual warning 2015-12-16 03:12:31 +01:00
Yann Collet
7061135d33 faster init for multi-files bench 2015-12-16 03:01:03 +01:00
Yann Collet
6c8b925ab9 fixed Visual warning 2015-12-16 02:44:56 +01:00
Yann Collet
ed699e692d benchmark multiple files 2015-12-16 02:37:24 +01:00
Yann Collet
7a3ab588c7 minor fixes 2015-12-15 11:25:12 +01:00
Yann Collet
397f1ffd52 fixed test script 2015-12-13 14:05:00 +01:00
Yann Collet
5d4fa0ed9b fixed arm-specific shadow warning 2015-12-13 13:58:51 +01:00
Yann Collet
60348b91f3 fixed silent conversion warnings 2015-12-13 13:44:23 +01:00
Yann Collet
f6f3d7526a external dictionary capability added to command line 2015-12-13 13:35:21 +01:00
Yann Collet
3a061a4c9f extended static dictionary to buffered mode 2015-12-12 11:17:42 +01:00
Yann Collet
6c3e2e7855 fixed : high compression modes for Windows 32 bits 2015-12-11 10:44:07 +01:00
Yann Collet
695a6cb463 fixed #94 2015-12-10 15:51:38 +01:00
Konstantin Tokarev
2b465840a8 Re-added accidentally lost round-trip tests for compression levels > 12. 2015-12-08 19:36:42 +03:00
Konstantin Tokarev
0b570b59d2 playTests.sh: Added --test-large-data switch. 2015-12-08 18:47:43 +03:00
Konstantin Tokarev
76be378513 playTests.sh: refactored round-trip tests 2015-12-08 18:36:37 +03:00
Konstantin Tokarev
d66db2ff04 Move tests from zstd-playTests target to separate shell script.
This patch allows me to run tests on MIPS board which lacks make.
2015-12-08 18:11:10 +03:00
Yann Collet
4bfe415fa7 validated external dictionary 2015-12-06 13:18:37 +01:00
Yann Collet
e47c4e5f8e strengthened bufferless streaming decompression 2015-12-05 09:23:53 +01:00
Yann Collet
1c2ddba469 use time limited fuzzer tests in CI 2015-12-04 17:45:35 +01:00
Yann Collet
553cf6a926 time-limited fuzzer tests 2015-12-04 17:25:26 +01:00
Yann Collet
417890cec2 strengthened streaming bufferless compression 2015-12-04 17:16:37 +01:00
Yann Collet
28e7cefea9 new zstd-noBench & zstd-frugal builds 2015-12-03 12:11:30 +01:00
Yann Collet
6a2f03295c update version to 0.4.2 2015-12-02 15:05:22 +01:00
Yann Collet
a9b34280a1 minor cosmetic improvement for small blocks 2015-12-02 13:00:25 +01:00
Yann Collet
c620b48489 revert install to normal zstd due to travis limitation (likely gcc 4.6) 2015-12-01 01:56:02 +01:00
Yann Collet
d062f1379c fixed benchmark autogen 2015-12-01 01:31:17 +01:00
Yann Collet
0338635e93 pgo 2015-12-01 01:28:32 +01:00
Yann Collet
aead1bf86b changed to ZSTD_LEGACY_SUPPORT=0, as suggested within #80 2015-11-30 14:18:47 +01:00
Yann Collet
a85a8dd94a Fixed #80 (reported by @luben)
Added : tests for ZSTD_LEGACY=disable build mode
extended ZSTD_LEGACY=disable to dll build
2015-11-30 11:53:11 +01:00
Yann Collet
7fe531e7ec fixed address space overflow (32-bits mode) 2015-11-29 02:38:09 +01:00
Yann Collet
00fd7a2110 protect 32-bits mode 2015-11-28 16:03:22 +01:00
Yann Collet
49cc9b7d03 large file support 2015-11-27 17:52:57 +01:00
Yann Collet
09116c2e4d optimizer mode 2015-11-27 17:46:14 +01:00
Yann Collet
b096cbf0d2 can build without legacy support using ZSTD_LEGACY=disable 2015-11-27 16:18:56 +01:00
Yann Collet
800fa6c378 stronger tests for zbuff decompression 2015-11-27 14:30:23 +01:00
Yann Collet
31d1806a77 zbuff properly supports small dst buffers 2015-11-27 14:07:36 +01:00
Yann Collet
29a2c838c5 support for legacy 0.3 format 2015-11-26 16:02:04 +01:00
Yann Collet
661f843637 fixed test in zbufftest 2015-11-26 15:39:44 +01:00
Yann Collet
26415d3ff2 fixed leak 2015-11-26 12:43:28 +01:00
Yann Collet
6bcdeac954 fixed asan warning 2015-11-26 11:43:00 +01:00
Yann Collet
7447ee96f6 fixed g++ warning 2015-11-26 10:52:30 +01:00
Yann Collet
5f2ec63852 fixed decompression bug (buffered mode) 2015-11-26 10:32:17 +01:00
Yann Collet
91a97960f7 Added zbufftest 2015-11-26 09:59:49 +01:00
Yann Collet
d3cb690156 fixed leak issue 2015-11-25 15:26:55 +01:00
Yann Collet
785b5ecc54 stronger tests 2015-11-25 15:16:19 +01:00
Yann Collet
88fcd2916e Added : zstd buffered API 2015-11-25 14:42:45 +01:00
Yann Collet
b5d2a0c827 visual compatibility 2015-11-23 17:10:19 +01:00
Yann Collet
225179dd05 more tests (bt modes) 2015-11-23 16:52:22 +01:00
Yann Collet
d7233d6e14 more compression tests 2015-11-22 14:40:51 +01:00
Yann Collet
a5c737411a complex level selector 2015-11-22 14:16:56 +01:00
Yann Collet
402fdcf1a3 fixed asan 2015-11-20 12:46:08 +01:00
Yann Collet
6a11a69b15 added : repcode generation to datagen 2015-11-20 12:00:25 +01:00
Yann Collet
dc5e3e96f8 minor memsave 2015-11-20 09:23:56 +01:00
Yann Collet
110cc14bab fixed bug #73 notified by @nemequ 2015-11-19 12:02:28 +01:00
Yann Collet
b2549846ba more tests 2015-11-18 11:29:32 +01:00
Yann Collet
2666d3e56c more tests 2015-11-14 11:07:51 +01:00
Yann Collet
93a823ccb7 fixed asan warnings 2015-11-13 15:08:43 +01:00
Yann Collet
0f366c61ed fixed streaming decoder 2015-11-12 16:19:30 +01:00
Yann Collet
cfdeb34180 fixed g++ link error 2015-11-12 16:00:04 +01:00
Yann Collet
7f6e91fa98 fixed library compilation 2015-11-11 14:39:50 +01:00
Yann Collet
5be2dd25f2 Changed Library source tree
- no more zstdhc ; zstd.h is enough
- ZSTD_compress() now needs a compressionLevel
- separated zstd_compress.c and zstd_decompress.c
- updated zstdcli, fullbench, fuzzer with new API
2015-11-11 13:43:58 +01:00
Yann Collet
b7d6e8f6bc fixed Visual warning 2015-11-09 18:20:39 +01:00
Yann Collet
9f432926b4 fileio can use small blocks params 2015-11-09 17:42:17 +01:00
Yann Collet
43e0cd512a small blocks params 2015-11-09 16:38:17 +01:00
Yann Collet
7ccff59cb3 fold fast stats 2015-11-09 12:07:44 +01:00
Yann Collet
6d2c9e6c62 generic param table 2015-11-09 11:39:48 +01:00
Yann Collet
d61ddd03ec pg display CL-compatible params 2015-11-08 14:45:38 +01:00
Yann Collet
4c7aae3a36 fuzzer tests more HC levels 2015-11-08 14:24:59 +01:00
Yann Collet
f48e35c206 minor bt improvements 2015-11-07 01:13:31 +01:00
Yann Collet
acd222c82e update readme 2015-11-06 12:39:39 +01:00
Yann Collet
444873f494 minor greedy mod 2015-11-06 11:48:56 +01:00
Yann Collet
f12c1304a8 integrate fast mode 2015-11-05 18:16:59 +01:00
Yann Collet
1f44b3f778 added fast mode 2015-11-05 17:32:18 +01:00
Yann Collet
47b68908b2 rename lazy2 2015-11-05 15:14:17 +01:00
Yann Collet
5106a76dc9 merged strats 2015-11-05 15:00:24 +01:00
Yann Collet
50c5cdb44c fixed issues reported by Maciej Adamczyk 2015-11-04 20:35:33 +01:00
Yann Collet
3e3582719c Fixed issue #62, reported by @luben 2015-11-04 18:19:39 +01:00
Yann Collet
2c7ac7c055 fix bench on /dev/null 2015-11-04 17:52:18 +01:00
Yann Collet
b241e9deb7 small compression improvement 2015-11-04 13:57:24 +01:00
Yann Collet
59d7063fbc fix and level tuning 2015-11-04 12:05:27 +01:00
Yann Collet
96b9f0ba4d btlazy2 2015-11-04 03:52:54 +01:00
Yann Collet
293d0cc261 fixed Visual warning 2015-11-03 13:10:25 +01:00
Yann Collet
cdc2b2f758 fixed clang warning 2015-11-03 10:52:14 +01:00
Yann Collet
050efba81b level tuning 2015-11-03 09:49:30 +01:00
Yann Collet
3564487614 lazydeep 2015-11-02 16:14:46 +01:00
Yann Collet
7671f393be v0.3.2 2015-11-02 12:17:39 +01:00
Yann Collet
66d22b803b v0.3.1 2015-11-02 02:36:10 +01:00
Yann Collet
21f96934c3 fixed config counter 2015-11-01 14:32:59 +01:00
Yann Collet
9b11b46f8a Fixed speed regression 2015-11-01 12:40:22 +01:00
Yann Collet
be2010ea1b lazy strategy 2015-10-31 12:57:14 +01:00
Yann Collet
4b100f43b0 level tuning 2015-10-30 15:49:48 +01:00
Yann Collet
aa074051d6 decoding support for legacy v0.2 format 2015-10-30 11:21:50 +01:00
Yann Collet
fc04bcc6d7 fixed minor gcc warning 2015-10-30 07:11:07 +01:00
Yann Collet
4114f95ce9 fix Visual Studio projects 2015-10-30 06:40:22 +01:00
Yann Collet
f8eaf0e158 added HC tests 2015-10-30 05:59:18 +01:00
Yann Collet
44fe99116e fixed hc alloc 2015-10-29 22:02:40 +01:00
Yann Collet
c776c46b46 range bench 2015-10-29 19:10:54 +01:00
Yann Collet
2f648e54ff hc fuzzer tests 2015-10-29 18:23:38 +01:00
Yann Collet
71bcdb5c1f sync paramgrill with HC starting at level 2 2015-10-29 17:08:03 +01:00
Yann Collet
2acb5d3d48 HC modes can be selected from command line 2015-10-29 16:49:43 +01:00
Yann Collet
76c5c2a4a0 minor tuning 2015-10-28 19:07:05 +01:00
Yann Collet
81e49e6654 fine tune & messages 2015-10-28 15:56:48 +01:00
Yann Collet
10ba1834cc value time 2015-10-28 14:05:37 +01:00
Yann Collet
1077bb8141 memory notation 2015-10-28 12:32:25 +01:00
Yann Collet
b315bc86e1 srcLog 2015-10-27 13:12:25 +01:00
Yann Collet
2c6992e1dc blocksize & T 2015-10-27 12:18:00 +01:00
Yann Collet
8b91abec18 can test param conf 2015-10-27 02:59:12 +01:00
Yann Collet
786f5b554a skip slow conf faster 2015-10-26 15:45:58 +01:00
Yann Collet
b2ad30cea2 faster scan 2015-10-26 02:45:19 +01:00
Yann Collet
0b87939dc0 clean paramgrill 2015-10-26 00:11:16 +01:00
Yann Collet
78d0f39605 make paramgrill 2015-10-26 00:07:32 +01:00
Yann Collet
fd9d6b8e2f paramgrill 2015-10-26 00:06:36 +01:00
Yann Collet
83fae977e6 Added asan tests 2015-10-23 15:21:53 +01:00
Yann Collet
eeb8ba18d1 uncoupled maxdlog and chainlog 2015-10-22 16:55:40 +01:00
Yann Collet
f3eca25322 quick first zstdhc version 2015-10-22 15:31:46 +01:00
Yann Collet
353c5d26cf unified ctx naming convention 2015-10-21 14:39:26 +01:00
Yann Collet
1c00dc3e24 Added block size to bench 2015-10-21 08:22:25 +01:00
Yann Collet
07e0674007 Fixed fullbench 2015-10-19 20:02:46 +01:00
Yann Collet
b1f3f4b565 update huff0 2015-10-18 22:18:32 +01:00
Yann Collet
0fef5be1cc Fix fullbench 2015-10-14 18:07:24 +01:00
Yann Collet
be50aaa0ee Added : Frame concatenation ability 2015-09-10 23:26:09 +01:00
Yann Collet
5abd8203cb Fix : decompression i/o detects flush write errors 2015-08-27 03:16:04 +01:00
Yann Collet
352ab88aea fixed minor issue on decoding invalid data 2015-08-26 22:45:23 +01:00
Yann Collet
ddf39e91c5 modified man page 2015-08-26 12:04:58 +02:00
Yann Collet
50b6f941e8 added : --verbose command 2015-08-26 10:32:17 +01:00
Yann Collet
bf50409e05 Refactor Makefile and .travis tests 2015-08-26 00:19:06 +01:00
Yann Collet
f44b2b02b4 Zstd cli : --version and --help write to stdout 2015-08-25 23:32:45 +01:00
Yann Collet
61d08c52a5 More informative write error messages 2015-08-25 18:13:32 +01:00
Yann Collet
5b147600f9 Fixed #42 2015-08-25 17:41:46 +01:00
Yann Collet
1885029ba1 Fixed a few issues found by AFL (American Fuzzy Lop) 2015-08-24 20:17:11 +01:00
Yann Collet
fee8e240c7 Fixed decoding error #11 (reported by @magv) 2015-08-24 15:47:04 +01:00
Yann Collet
d5d9bc3f82 Added : ZSTD decompression : ability to resist to noisy/faulty data source 2015-08-23 23:13:49 +01:00
Yann Collet
cf5ce55cca Updated xxhash 2015-08-21 12:00:52 +01:00
Yann Collet
997f9ee2ef Added : fuzzer tests : decompressing noisy src 2015-08-21 02:44:20 +01:00
Yann Collet
602834f794 Fixed : bug in compression in specific conditions (too small dst size) 2015-08-20 07:46:10 +01:00
Yann Collet
f3cb79b58f Fixed : g++ link error within fullbench 2015-08-20 00:02:43 +01:00
Yann Collet
f4ce8913a3 Added more strigent tests : compresson into too small buffer 2015-08-11 14:18:45 +01:00
Yann Collet
bd8f4e0e5c added : .gitignore generated binaries 2015-08-10 18:02:52 +01:00
Yann Collet
e9853b2cdb Fixed : ZSTD_compress() can attempt compression on a too small buffer 2015-08-07 19:07:32 +01:00
Yann Collet
e8c6bb1e42 Integrated huff0 (breaking format change) 2015-07-26 00:23:57 +01:00