Commit Graph

1093 Commits

Author SHA1 Message Date
Yann Collet
ab43c50224 Merge branch 'dev070' of github.com:Cyan4973/zstd into dev070 2016-05-31 08:56:38 +02:00
Yann Collet
6ae270d772 Merge pull request #194 from ot/dev070
Expose function to add entropy tables to pre-built dictionary.
2016-05-31 08:56:22 +02:00
Giuseppe Ottaviano
370b751e24 Expose function to add entropy tables to pre-built dictionary.
In some cases a custom dictionary building algorithm tailored for a specific
input can be more effective than the one produced by `ZDICT_trainFromBuffer`,
but with the current API it's not possible encode the entropy tables into the
custom-built dictionary.

This commit extracts the logic to add entropy tables to a dictionary from
`ZDICT_trainFromBuffer` and exposes it as a function
`ZDICT_addEntropyTablesFromBuffer`.
2016-05-30 19:50:09 -07:00
Yann Collet
6fca9e7545 Changed : max dictionary file size increased to 8 MB 2016-05-31 02:40:42 +02:00
Yann Collet
6381e99fb2 Added : ability to create compressed frames without dictID 2016-05-31 02:29:45 +02:00
Yann Collet
b81cbbade1 fixed minor conversion warning 2016-05-30 22:29:45 +02:00
Yann Collet
290aaa7521 Added : ability to manually select the dictionary ID of a newly created dictionary 2016-05-30 21:18:52 +02:00
Yann Collet
815580a538 added cmake --version to check cmake version on Travis 2016-05-30 18:57:39 +02:00
Yann Collet
118bfc4ccb fixed cmaketest 2016-05-30 18:50:28 +02:00
cyan
b880631aed Fixed visual projects
Signed-off-by: Yann Collet <yann.collet.73@gmail.com>
2016-05-30 18:28:29 +02:00
Yann Collet
30009521d7 fuzzer tests dictBuilder.
Added : ability to not store dictID during compression; decompression doesn't check dictID then
2016-05-30 16:17:33 +02:00
Yann Collet
d2858e93cb minor refactoring 2016-05-30 15:11:17 +02:00
Yann Collet
829dc6612a Merge branch 'dev' into dev070 2016-05-30 14:06:44 +02:00
Yann Collet
dd97e241a8 Updated NEWS with @inikep's work 2016-05-30 14:05:44 +02:00
Yann Collet
c0a9bf3c2e minor code refactoring 2016-05-30 04:48:32 +02:00
Yann Collet
954e2bc48f added fuzzer test for ZSTD_compressBegin_advanced() 2016-05-30 01:42:05 +02:00
Yann Collet
7d64cb375c commented versionsTest, which won't succeed while legacy 0.6 is missing 2016-05-30 01:12:13 +02:00
Yann Collet
33341de7d7 fixed fuzzer dictionary test 2016-05-29 23:09:51 +02:00
Yann Collet
fcf2087a15 restored zstdcli.c 2016-05-29 05:16:05 +02:00
Yann Collet
c46fb924df added dictionary ID (incomplete) 2016-05-29 05:01:04 +02:00
Yann Collet
0d348d46d8 fixed cmake
fixed playTests
2016-05-29 02:02:24 +02:00
Yann Collet
f51e0660f4 Simplified list of *.c files 2016-05-29 01:39:19 +02:00
Yann Collet
0c5e8b17ad moved xxhash to lib/common 2016-05-29 01:06:30 +02:00
Yann Collet
04fa41b5ce Merge pull request #192 from Cyan4973/dev
updated xxhash
2016-05-29 00:41:36 +02:00
Yann Collet
ab2ee08042 fixed makefile error in clean target 2016-05-28 16:06:29 +02:00
Yann Collet
fb0ba59c41 Added : utility roundTripCrash
which generates a crash (double-free) on detecting a round-trip corruption
2016-05-28 15:30:01 +02:00
Yann Collet
6c903a8dd5 updated xxhash to latest "dev" version 2016-05-28 13:34:07 +02:00
Yann Collet
1eeba1cf89 Merge branch 'dev' of github.com:Cyan4973/zstd into dev 2016-05-25 23:51:59 +02:00
Yann Collet
bc6e27cc6f Merge pull request #191 from inikep/dev
AppVeyor tests
2016-05-25 23:42:44 +02:00
inikep
bff23b72c5 fixed Visual Studio warning 2016-05-25 17:40:58 +02:00
inikep
957823f56f zstdcli: -r (operate recursively on directories) works with dictBuilder and compression 2016-05-25 15:30:55 +02:00
inikep
4f1acdd158 usage of fileno() only on POSIX and Windows 2016-05-25 12:41:41 +02:00
inikep
e75909ef93 ZBUFF_createCCtx_advanced moved to zbuff_static.h 2016-05-25 11:31:16 +02:00
Yann Collet
0d0f7e4357 minor linter modifications 2016-05-25 10:58:11 +02:00
inikep
5d589562fe playTests.sh joined with playTestsMSYS.sh 2016-05-25 10:50:28 +02:00
Yann Collet
ebc13bc180 cleaner versionsTest script and output 2016-05-25 10:12:39 +02:00
inikep
460a4ee6d4 playTests updated with Pass-Through mode 2016-05-24 18:22:38 +02:00
inikep
33b8a893ed CMake project moved to projects 2016-05-24 17:44:14 +02:00
inikep
02c244bf78 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-05-24 17:15:04 +02:00
inikep
c8f5509b32 Merge remote-tracking branch 'refs/remotes/origin/playTests' into dev 2016-05-24 15:45:29 +02:00
inikep
4a9ec65c9d Merge remote-tracking branch 'refs/remotes/origin/playTests' into dev 2016-05-24 15:38:52 +02:00
inikep
fb5df613cf zstd_stats.h included only in debug mode 2016-05-24 15:36:37 +02:00
inikep
a1653fbfd0 zbufftest.c: tests for ZBUFF_createCCtx_advanced/ZBUFF_createDCtx_advanced 2016-05-24 15:35:48 +02:00
inikep
71dd67cf57 fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced 2016-05-24 10:57:14 +02:00
Yann Collet
ddbb8e27bf fixed minor conversion warning 2016-05-24 00:52:14 +02:00
Yann Collet
de95f96462 Pass-Through mode support (using -df), for compatibility with gzip 2016-05-23 19:46:47 +02:00
Yann Collet
32990b5dae Added tests for Sparse mode support
Fixed : complex cli arg case involving a mix of `stdin` and `-o`
2016-05-23 17:48:57 +02:00
inikep
13ba880b49 added ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced 2016-05-23 17:04:23 +02:00
Yann Collet
75424d1139 Added : Sparse write support
--[no-]sparse command
2016-05-23 16:56:56 +02:00
inikep
107e243195 added ZSTD_createDCtx_advanced 2016-05-23 16:24:52 +02:00