Commit Graph

918 Commits

Author SHA1 Message Date
Yann Collet
f51e0660f4 Simplified list of *.c files 2016-05-29 01:39:19 +02:00
Yann Collet
0c5e8b17ad moved xxhash to lib/common 2016-05-29 01:06:30 +02:00
Yann Collet
ab2ee08042 fixed makefile error in clean target 2016-05-28 16:06:29 +02:00
Yann Collet
fb0ba59c41 Added : utility roundTripCrash
which generates a crash (double-free) on detecting a round-trip corruption
2016-05-28 15:30:01 +02:00
Yann Collet
6c903a8dd5 updated xxhash to latest "dev" version 2016-05-28 13:34:07 +02:00
inikep
993a9dfc5a playTests.sh updated to work better with /bin/sh 2016-05-27 10:07:46 +02:00
inikep
bff23b72c5 fixed Visual Studio warning 2016-05-25 17:40:58 +02:00
inikep
957823f56f zstdcli: -r (operate recursively on directories) works with dictBuilder and compression 2016-05-25 15:30:55 +02:00
inikep
4f1acdd158 usage of fileno() only on POSIX and Windows 2016-05-25 12:41:41 +02:00
inikep
e75909ef93 ZBUFF_createCCtx_advanced moved to zbuff_static.h 2016-05-25 11:31:16 +02:00
inikep
5d589562fe playTests.sh joined with playTestsMSYS.sh 2016-05-25 10:50:28 +02:00
inikep
460a4ee6d4 playTests updated with Pass-Through mode 2016-05-24 18:22:38 +02:00
inikep
02c244bf78 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-05-24 17:15:04 +02:00
inikep
fb5df613cf zstd_stats.h included only in debug mode 2016-05-24 15:36:37 +02:00
inikep
a1653fbfd0 zbufftest.c: tests for ZBUFF_createCCtx_advanced/ZBUFF_createDCtx_advanced 2016-05-24 15:35:48 +02:00
inikep
71dd67cf57 fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced 2016-05-24 10:57:14 +02:00
Yann Collet
ddbb8e27bf fixed minor conversion warning 2016-05-24 00:52:14 +02:00
Yann Collet
de95f96462 Pass-Through mode support (using -df), for compatibility with gzip 2016-05-23 19:46:47 +02:00
Yann Collet
32990b5dae Added tests for Sparse mode support
Fixed : complex cli arg case involving a mix of `stdin` and `-o`
2016-05-23 17:48:57 +02:00
Yann Collet
75424d1139 Added : Sparse write support
--[no-]sparse command
2016-05-23 16:56:56 +02:00
Peter (Stig) Edwards
04773ac90a Minor changes needed for OpenVMS
Define util sleep functions on VMS.
If PRIO_PROCESS is not defined then do not attempt to use it in the definition of SET_HIGH_PRIORITY.
2016-05-21 12:15:48 +01:00
Yann Collet
45f84ab7cc all programs use ZSTD_VERSION_STRING from zstd.h to display their version 2016-05-20 12:34:40 +02:00
Yann Collet
de4d4da52d changed version to 0.6.2
removed make-controlled version (now used from zstd.h)
removed std=c99 by default
added : c90/gno90/c99/gnu99/c11 tests
2016-05-20 12:20:12 +02:00
Yann Collet
e162aceeb6 minor simplification 2016-05-20 11:35:00 +02:00
inikep
96abb5a806 AppVeyor tests use playTests.bat 2016-05-19 15:50:58 +02:00
inikep
44bb2f6c89 added datagen in Visual Studio project 2016-05-19 12:16:14 +02:00
inikep
60af95d971 fixed compression with -c with multiple files on Windows 2016-05-19 10:29:49 +02:00
inikep
2bd6b13e53 added playTests.bat 2016-05-18 18:05:56 +02:00
inikep
3aa4b2b598 update file permission 2016-05-18 18:04:10 +02:00
Yann Collet
35276a9441 fixed minor conversion warnings 2016-05-18 17:26:23 +02:00
Yann Collet
bde926fce7 removed msan tests 2016-05-18 17:18:48 +02:00
inikep
f33021552b added playTestsMSYS.sh 2016-05-18 16:38:36 +02:00
klemens
268775dae8 spelling-fixes, as of lintian.debian.org 2016-05-16 22:23:24 +02:00
inikep
63ecd747de added common/entropy_common.c 2016-05-13 11:27:56 +02:00
inikep
58a1d45aa5 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-05-13 11:05:35 +02:00
inikep
0bdb6a8118 changed definition of UTIL_createFileList 2016-05-13 10:52:02 +02:00
inikep
3eabe9b474 added zlibWrapper - zstd wrapper for zlib 2016-05-12 17:15:41 +02:00
inikep
4dbf7f4a3b dynamic memory allocation in UTIL_createFileList 2016-05-11 14:11:00 +02:00
Yann Collet
a96f9fd5bc datagencli uses mem.h 2016-05-11 11:42:51 +02:00
Yann Collet
b3a9938d0c Merge pull request #182 from inikep/dev
support for Visual Studio 2012, 2013, 2015
2016-05-10 17:18:12 +02:00
Yann Collet
b12b369817 fixed : unused argument in printf 2016-05-10 15:30:43 +02:00
inikep
95459458ed disable Visual Studio code analysis 2016-05-10 14:42:54 +02:00
inikep
3733797fcd bench.c: experimental -r (operate recursively on directories) for Windows and _POSIX_C_SOURCE >= 200112L 2016-05-10 14:22:55 +02:00
Yann Collet
bd39d54576 zbuff supports byte-by-byte decompression scenarios 2016-05-10 14:14:19 +02:00
inikep
ed9a08538c Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
# Conflicts:
#	lib/common/util.h
#	programs/paramgrill.c
#	visual/2013/fullbench/fullbench.vcxproj.filters
#	visual/2013/fuzzer/fuzzer.vcxproj.filters
2016-05-10 13:20:01 +02:00
Yann Collet
d693117113 fixed : null-length string roundtrip 2016-05-10 05:56:09 +02:00
Yann Collet
8b23eea694 minor refactor : more accurate variables scope
Added null-length string test
2016-05-10 05:37:43 +02:00
inikep
349fcf7ea2 fixed Linux compilation 2016-05-09 18:04:07 +02:00
inikep
aaaf923a17 common/util.h moved to programs/util.h
decompress/fse_decompress.c moved to common/
2016-05-09 16:19:25 +02:00
Yann Collet
d782890576 fixed datagen 2016-05-09 12:28:20 +02:00
Yann Collet
ceca200c77 datagen uses mem.h 2016-05-09 12:20:50 +02:00
Yann Collet
59b6ba7677 Merge pull request #180 from thatsafunnyname/patch-1
No stdint.h on OpenVMS.
2016-05-09 11:56:42 +02:00
Yann Collet
f6ca09b5ff Reduced console display on loading lots of files with zstd --train. Reported by @KrzysFR, see #177 2016-05-09 04:44:45 +02:00
Yann Collet
95af06f6ef fixed legacy dictionary decompression 2016-05-08 08:23:51 +02:00
Yann Collet
0c0f314550 CLI supports dictionary decompression in legacy mode v0.5.x 2016-05-08 08:11:24 +02:00
Yann Collet
f849462d4c minor refactor : more accurate variable scope 2016-05-07 22:43:40 +02:00
inikep
13c8424ea0 code cleaning 2016-05-05 13:58:56 +02:00
inikep
0bd0faec32 fixed compatibility issues 2016-05-05 13:10:57 +02:00
inikep
9c22e57bfb Compiler Options moved to util.h 2016-05-05 11:53:42 +02:00
Yann Collet
3f8ed50bf1 Added gnu90 test
work-around : disabled automatic selection of huff0 quad-decoder (see #173)
2016-05-05 03:01:13 +02:00
thatsafunnyname
dca5cf92ac No stdint.h on OpenVMS.
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
2016-05-04 15:42:25 +01:00
thatsafunnyname
eef5fdb58a No stdint.h on OpenVMS.
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
2016-05-04 15:39:31 +01:00
Yann Collet
6f9c056662 Fixed BMI behavior on x86 and x32 targets, reported by @tycho (#178) 2016-05-01 10:26:30 +02:00
inikep
bab4317961 util.h must the the first include to #define _POSIX_C_SOURCE 2016-04-29 15:19:40 +02:00
inikep
55d047aa92 getTotalFileSize moved to common/util.h 2016-04-28 16:50:13 +02:00
inikep
d5ff2c3d9a ordering of #include 2016-04-28 14:40:45 +02:00
inikep
83c76b4594 bench.c: time functions moved to common/util.h 2016-04-28 13:16:01 +02:00
inikep
69fcd7c0ae getFileSize moved to common/util.h 2016-04-28 12:23:33 +02:00
inikep
ea4ee3eee0 added compatibility with Visual C++ 2012 2016-04-25 13:09:06 +02:00
inikep
f066816998 fix for g++ compilation 2016-04-22 18:54:05 +02:00
inikep
db3964382c introduced ZSTD_NODECOMPRESS to link only compressor 2016-04-22 18:22:30 +02:00
inikep
a1febea01d Error functions moved to common/zstd_common.c 2016-04-22 17:14:25 +02:00
inikep
3c7c3527d0 introduced ZSTD_NOCOMPRESS to generate decompressor only 2016-04-22 13:59:05 +02:00
inikep
23a0889301 separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/ 2016-04-22 12:43:18 +02:00
inikep
4699b3be03 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-21 12:30:58 +02:00
inikep
38654988f3 minor speed improvements 2
bench.c: block size has to be bigger than 32 bytes
zstdcli.c: support for e.g. -B16k -B16m
2016-04-21 12:18:47 +02:00
Yann Collet
e02808ffc5 bumped lib version to 0.6.1
added ZSTD_VERSION_STRING
2016-04-20 22:46:16 +02:00
inikep
c5e1d295ee bench.c: force at least one compression and decompression loop
fix for -i0 with small files
2016-04-19 09:37:59 +02:00
inikep
6d157f1fbe bench.c: fixed rare compression and decompression speed bug
concerns only big files with compression or decompression time longer
than 100 seconds
2016-04-15 16:54:11 +02:00
inikep
4b3c5eed99 removed ZSTD_compressBegin_targetSrcSize 2016-04-14 13:43:51 +02:00
inikep
c70c90e8a3 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-13 10:48:26 +02:00
inikep
c0d5f4eb2e bench.c: ignore directories from a file list for benchmark 2016-04-13 10:48:04 +02:00
Yann Collet
389648cc6d Fixed : contentSize + copyCCtx() 2016-04-12 19:13:08 +02:00
Yann Collet
541dc7c7d4 Added : fuzzer test, checking contentLength value after copyCCtx() usage 2016-04-12 18:00:20 +02:00
Yann Collet
887e7da785 Fixed copyCCtx() on uninitialized cctx (reported by Oliver Lange) 2016-04-11 20:12:27 +02:00
inikep
8844e21dff Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-11 16:49:27 +02:00
Yann Collet
81e493651a Fixed minor conversion warning 2016-04-11 01:47:10 +02:00
Yann Collet
c51aa6ccce minor refactor 2016-04-11 01:20:14 +02:00
Yann Collet
c456077066 fixed : minor warning on return value 2016-04-11 01:12:32 +02:00
Yann Collet
7928f6f024 Fixed : cli error on stdin + stdout, as detected by Alexey Spiridonov
Added : relevant test case
2016-04-10 20:40:26 +02:00
Yann Collet
ccbba296e1 Fix infinite loop with invalid data (fuzzer test) 2016-04-10 14:42:26 +02:00
Yann Collet
4d008083e6 fixed fullbench link stage 2016-04-09 17:38:53 +02:00
Yann Collet
9990986bdc fixed minor warnings when compiling with gcc -g (aka -std=gnu90) 2016-04-09 16:17:18 +02:00
Yann Collet
029267ab3f Integrated Legacy v0.5.x decoder (provided by @inikep) 2016-04-09 09:42:27 +02:00
Yann Collet
1fce6e0baa Fixed : minor variable isolation 2016-04-08 20:26:33 +02:00
inikep
1eeddde625 clock() is default timer for all platforms except Windows 2016-04-08 16:55:17 +02:00
Yann Collet
ea63bb7b5e converted fuzzer timer to clock_t 2016-04-08 15:25:32 +02:00
Yann Collet
72cc704514 Merge branch 'dev060' of github.com:Cyan4973/zstd into dev060 2016-04-08 02:02:31 +02:00
Yann Collet
0dbf2874ee faster level 1 at 256 KB 2016-04-08 02:02:12 +02:00
Yann Collet
04a4fd638b Merge pull request #164 from inikep/dev
only repcode 0 for lazy, lazy2 and btlazy2 strategies
2016-04-07 20:46:13 +02:00
Yann Collet
9e8b09a7bd Fixed memory initialization issue, reported by Maciej Adamczyk 2016-04-07 19:35:23 +02:00
inikep
64d7bcb0dc only repcode 0 for lazy, lazy2 and btlazy2 strategies 2016-04-07 19:14:09 +02:00
inikep
e47f33f980 reordered code 2016-04-06 20:58:00 +02:00
inikep
5ce00aee37 ZSTD_compressBlock_opt_extDict_generic in progress 2016-04-05 21:03:43 +02:00
inikep
0c7456c5b7 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_static.h
2016-04-04 14:54:53 +02:00
Yann Collet
8a57b928ba changed contentLog -> chainLog 2016-04-04 13:49:18 +02:00
inikep
19bd48f516 Merge from Cyan4973/dev060 2016-04-04 12:10:00 +02:00
Yann Collet
1535414927 Fixed 32-bits windowLog limitation
Fixed some macro errors in zbufftest
2016-04-04 04:22:53 +02:00
Yann Collet
9bf7016627 minor variable isolation 2016-04-04 03:01:15 +02:00
Yann Collet
fd265ca518 minor cli correction (arguments are const char*) 2016-04-04 02:48:55 +02:00
Yann Collet
38461085d8 code refactorization, for better clarity and reliability 2016-04-04 02:47:20 +02:00
Yann Collet
541cf1993f minor variable isolation 2016-04-04 01:49:30 +02:00
Yann Collet
15bc943201 stronger zbuff synchronization tests 2016-04-04 01:22:26 +02:00
Yann Collet
fe56eb9408 removed unwanted files 2016-04-02 00:21:55 +02:00
Yann Collet
efb18309ef fixed minor visual 32-64bits conversion warning 2016-04-01 18:54:13 +02:00
Yann Collet
27caf2afca minor variable isolation 2016-04-01 15:48:48 +02:00
Yann Collet
51d500425f fixed paramgrill 2016-03-30 20:42:19 +02:00
Yann Collet
3b71925c2d separate params into compressionParams and frameParams 2016-03-30 19:48:05 +02:00
inikep
1c556a3838 ticksPerSecond=0 2016-03-30 10:59:48 +02:00
inikep
33ad251236 removed clock_gettime (not portable) 2016-03-30 09:55:37 +02:00
inikep
4611d11fea added -lrt required by clock_gettime 2016-03-29 15:52:38 +02:00
inikep
4c12f232ec support for QueryPerformanceCounter and clock_gettime 2016-03-29 14:52:13 +02:00
inikep
06f793a3ab fix for BMK_clockSpan on Windows 2016-03-29 11:17:58 +02:00
Yann Collet
b44be74244 Fixed zdict
more dictionary compression tests
2016-03-26 20:52:14 +01:00
Yann Collet
b9151406de fixed 32-bits compatibility 2016-03-26 17:18:11 +01:00
Yann Collet
a5b66e34c7 minor variable isolation
and remove a goto
2016-03-26 01:48:27 +01:00
Yann Collet
b58c685cf7 fixed : fullbench link to deprecate function (wrong prototype) 2016-03-25 20:29:35 +01:00
inikep
5553442376 fixed compilation with ZSTD_NOBENCH 2016-03-25 13:35:33 +01:00
Yann Collet
7cbe79ab25 fixed write overflow found by fuzzer 2016-03-23 22:31:57 +01:00
inikep
eaba91a161 added ZSTD_compressBegin_targetSrcSize 2016-03-23 20:30:26 +01:00
inikep
7adceef974 hashLog3 added to ZSTD_CCtx 2016-03-23 15:53:38 +01:00
inikep
472638c861 added mili_sleep and setHighPriority 2016-03-23 12:28:28 +01:00
Yann Collet
fd69225086 bench : added HIGH_PRIORTY 2016-03-23 02:47:33 +01:00
Yann Collet
be391438ff first working version with both encoder and decode alternate LL + ML coding scheme.
decompression speed highly impacted
2016-03-22 23:19:28 +01:00
inikep
2872b6f01f Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
#	programs/bench.c
2016-03-22 14:38:34 +01:00
Yann Collet
fadda6c875 first prototype with ML encoding scheme (but not yet decoding scheme) 2016-03-22 12:14:26 +01:00
Yann Collet
1dcf930f72 Merge branch 'dev060' into alternateLLcode 2016-03-22 00:29:57 +01:00
Yann Collet
5a854af006 Fixed #153, reported by @thatsafunnyname 2016-03-22 00:22:50 +01:00
Yann Collet
5c71491a46 first working version with alternate LL codes 2016-03-21 02:23:34 +01:00
Yann Collet
6c62b7dfc8 support default LL distribution 2016-03-21 00:39:19 +01:00
Yann Collet
d64f435f63 handles litLength >= 65535 2016-03-21 00:07:42 +01:00
Yann Collet
597847a2ae first emulation 2016-03-20 19:14:22 +01:00
Yann Collet
ecabfe3777 Improved index overflow protection 2016-03-20 16:20:06 +01:00
Yann Collet
de406eebcd minor code refactor 2016-03-20 15:46:10 +01:00
Yann Collet
70e4577179 minor code refactoring 2016-03-19 18:08:32 +01:00
Yann Collet
0d9ce04cd5 minor refactoring 2016-03-19 13:21:08 +01:00
Yann Collet
546c9b1c02 minor refactoring 2016-03-19 12:47:52 +01:00
Yann Collet
d1d210f3fb minor code refactor 2016-03-19 12:12:07 +01:00
Yann Collet
f3120413cc Fixed : decoder error on erroneous data 2016-03-19 11:40:19 +01:00
Yann Collet
1d1ae40258 bench.c : implemented single pass mode -i0 2016-03-17 19:51:02 +01:00
Yann Collet
699b14db1b bench : changed timer to clock_t, reduced timeloop to 1sec 2016-03-17 19:37:33 +01:00
Yann Collet
512220a82f fullbench : restored -b31 (decodeLiterals) and -b32 (decodeSeqHeaders) 2016-03-17 16:42:16 +01:00
Yann Collet
cdabd4a2a6 switched fullbench time measurement to clock_t from <time.h> 2016-03-17 16:18:36 +01:00
Yann Collet
31922d7931 Added : ability to test direct-streaming functions ZSTD_compressContinue() and ZSTD_decompressContinue() 2016-03-16 16:05:18 +01:00
Yann Collet
569b81adb1 changed BLOCKSIZE into ZSTD_BLOCKSIZE_MAX 2016-03-16 15:26:51 +01:00
Yann Collet
69afc716d3 minor refactoring, from char* to const char* 2016-03-15 21:44:39 +01:00
Yann Collet
f141eaa211 fullbench : ZSTD_decompress is now option 2 2016-03-15 21:13:52 +01:00
Yann Collet
34b20ec2c6 fullbench can measure speed of zbuff 2016-03-15 20:47:23 +01:00
Yann Collet
346bffbc68 Added frame content size test within fuzzer 2016-03-15 15:24:52 +01:00
Yann Collet
09b21ee2f6 fix fileio bug with new zbuff
simplified zbuff decoding
2016-03-15 12:56:03 +01:00
inikep
d700a1a8b9 ZSTD_setAdditionalParam 2016-03-15 12:18:44 +01:00
inikep
5fdd0b46d3 added additionalParam 2016-03-14 19:51:11 +01:00
Yann Collet
886274bc79 Merge pull request #147 from Cyan4973/dev
Decompression error return code, by @chipturner
2016-03-14 18:41:24 +01:00
inikep
e9554b73cc -r# : test all compression levels from -bX to # 2016-03-14 18:10:30 +01:00
Yann Collet
97406c9b2c Added test to check decompression error return code 2016-03-14 17:05:40 +01:00
inikep
44af12deb1 removed DEFAULT_CHUNKSIZE 2016-03-14 15:59:04 +01:00
Chip Turner
9da7f86591 use remove instead of unlink 2016-03-14 07:44:59 -07:00
inikep
c034b73f8f benchResult_t changed to double 2016-03-14 13:13:42 +01:00
inikep
4e26bb69c7 bench.c can generate a log file with average values 2016-03-14 12:48:51 +01:00
Chip Turner
6de382cdbb propagate errors when decompressing; also unlink dstfile if we create it but fail
to successfully compress or decompress
2016-03-13 22:33:11 -07:00
Yann Collet
27d3dad751 benchmark mode : automated cooling (overheat protection) 2016-03-11 13:41:20 +01:00
Yann Collet
8a1d1a6a6c implemented --ultra mode protection 2016-03-10 21:02:25 +01:00
inikep
aff4ba1714 hashLog3 removed from paramgrill 2016-03-10 15:45:21 +01:00
Yann Collet
2e91dde43e improved memory size evaluation by paramgrill 2016-03-08 12:22:11 +01:00
Yann Collet
dd54bbc184 Fixed large NbSeq > 32 K
Added a test in Fuzzer to check NbSeq > 32 K
2016-03-08 02:35:34 +01:00
Yann Collet
370b08e840 fix compression ratio for blocks <= 16 KB 2016-03-08 00:03:59 +01:00
Yann Collet
4ba85344e3 added test to generate lots of small sequences (3-bytes) 2016-03-07 20:01:45 +01:00
Yann Collet
4ec2998b1f Added zeroes test (#137) 2016-03-04 19:09:28 +01:00
Yann Collet
a997654670 Merge pull request #136 from inikep/dev
merging mml3 mode
2016-03-01 17:31:03 +01:00
inikep
59493e8669 fixed paramgrill 2016-02-25 19:15:08 +01:00
Yann Collet
7de4f9fd81 minor cosmetic 2016-02-23 21:34:18 +01:00
Yann Collet
2cf6d662a8 fixed #131 2016-02-23 21:21:29 +01:00
Yann Collet
728c8fc995 longer pgo tests 2016-02-17 17:04:12 +01:00
Yann Collet
2673076b3d fix zstd-frugal 2016-02-17 13:40:11 +01:00
Yann Collet
9abc358df6 added : test for too large CLevel 2016-02-16 16:35:28 +01:00
Yann Collet
6aa896adc6 zstd cli : control maximum compression level 2016-02-16 16:33:48 +01:00
Yann Collet
2d08b098ef Updated man zstd
Added `-t` | `--test` to zstd cli
Added a few long commands, compatible with gzip
2016-02-16 14:42:08 +01:00
Yann Collet
459a6b712f Fix corner case multiple files bug
Added test cases
2016-02-15 20:37:23 +01:00
Yann Collet
accfd80c37 Added : option -t to test compressed files integrity 2016-02-15 19:33:16 +01:00
Yann Collet
e93add0439 Removed if (matchIndex >= current) return 0; as recommended by @inikep 2016-02-15 17:44:14 +01:00
Yann Collet
cefef8cde7 Change : zstd_opt_bt => zstd_btopt 2016-02-15 07:21:54 +01:00
Yann Collet
8154c3d7e2 added simple one file test 2016-02-13 03:12:10 +01:00
Yann Collet
e8bd73df80 Fixed : error when compressing one file 2016-02-13 03:09:48 +01:00
Yann Collet
23e8aee224 Introduced new compression level settings
Changed position of parameter TargetLength
2016-02-13 02:08:46 +01:00
Yann Collet
6f3acbac0d notificationLevel into ZDICT_param_t 2016-02-12 20:19:48 +01:00
Yann Collet
62ae5fb0d2 zstd_buffered => zbuff 2016-02-12 18:59:11 +01:00
Yann Collet
f4c9d75370 dictBuilder => zdict 2016-02-12 18:45:02 +01:00
Yann Collet
1f1f239ed9 zstd cli can decompress multiple files with no specific suffix condition into stdout 2016-02-12 18:33:26 +01:00
Yann Collet
f062436fa6 cli : added ability to compress multiple files into stdout (-c) 2016-02-12 15:56:46 +01:00
Yann Collet
492a9bb88e fixed Valgrind tests 2016-02-12 03:52:37 +01:00
Yann Collet
883a67eee2 fixed cmake 2016-02-12 03:50:05 +01:00
Yann Collet
c8da2c9f8f updated tests 2016-02-12 02:56:27 +01:00
Yann Collet
71eafdd23f Integrated dictionary builder into zstd cli 2016-02-12 02:31:57 +01:00
Yann Collet
04b12d8bcb paramgrill can select manually targetLength
new compression levels
2016-02-11 06:23:24 +01:00
Yann Collet
bd828d9cd1 changed : sufficientLength => targetLength 2016-02-11 04:38:55 +01:00
Yann Collet
4488661678 minor cosmetics 2016-02-11 04:17:50 +01:00
Yann Collet
b79a0b34f3 paramgrill supports sufficientLength
stronger variation for ZSTD_opt
2016-02-10 17:07:37 +01:00
Yann Collet
70e8c389f1 Refactoring for portability 2016-02-10 13:37:52 +01:00
Yann Collet
ee602ce68c Added btlazy2 to short tests 2016-02-08 18:46:26 +01:00
Yann Collet
521b0108dd Added PowerPC tests with Qemu user more
Shortened tests for emulated platforms
removed date from CLI for reproducibility
2016-02-08 01:27:59 +01:00
Yann Collet
648959a9ed new : ARM tests with Qemu user-mode 2016-02-07 23:58:32 +01:00
Yann Collet
ef37063503 fix big-endian compression error 2016-02-07 03:53:12 +01:00
Yann Collet
45ff4309fd Updated documentation 2016-02-05 15:24:57 +01:00
Yann Collet
464fa996e9 added v0.4 legacy support 2016-02-03 01:09:46 +01:00
Yann Collet
2ce4923238 modified buffer management rules 2016-02-02 14:36:49 +01:00
Yann Collet
e93d6ced17 minor compression gain 2016-01-31 00:58:06 +01:00
Yann Collet
fd416f1eaf added : ZSTD_compress_usingPreparedCCtx() 2016-01-30 03:14:15 +01:00
Yann Collet
fb810d6053 changed dictionary format 2016-01-28 00:21:13 +01:00
Yann Collet
1c8e194297 modified streaming compression API 2016-01-26 16:31:22 +01:00
Yann Collet
7b51a2948f modified streaming decompression API 2016-01-26 15:58:49 +01:00
Yann Collet
b923f65076 introduced dictionary format 2016-01-26 03:14:20 +01:00
Yann Collet
59d1f79768 variable litblock header size 2016-01-23 19:28:41 +01:00
Yann Collet
977f1f3600 modified error system, following suggestions by @nemequ 2016-01-21 15:38:47 +01:00
Yann Collet
03a6dab721 bench : more accurate block nb in error report 2016-01-21 02:21:17 +01:00
Yann Collet
1840d6af33 bench pay attention to variable block sizes 2016-01-20 15:39:06 +01:00
Yann Collet
2630a5eadc benchmark uses ZSTD_duplicateCCtx() 2016-01-14 19:13:22 +01:00
Yann Collet
b012510d9f dictionary with block API 2016-01-09 02:00:10 +01:00
Yann Collet
bf42c8e5d8 block-level API 2016-01-09 01:08:23 +01:00
Yann Collet
600962711d added duplication tests 2016-01-08 17:27:50 +01:00
Yann Collet
ecd651bd91 added ZSTD_duplicateCCtx() 2016-01-07 15:35:18 +01:00
Yann Collet
1fdd82312d Fixed : strict aliasing warnings in legacy decoders 2016-01-06 12:35:42 +01:00
Yann Collet
8ab94b653c updated xxhash 2016-01-06 01:37:46 +01:00
Yann Collet
5835e1b5ba updated xxhash source 2016-01-05 01:44:36 +01:00
Yann Collet
722504c2a0 update version to 0.4.6 2015-12-31 18:32:15 +01:00
Yann Collet
5f9f98768a Makefile version automatically follows zstd.h 2015-12-30 19:52:08 +01:00
Yann Collet
c1450f721d fix confirmation prompt 2015-12-29 11:57:15 +01:00
Yann Collet
324a3e27c3 fixed visual warning 2015-12-18 03:19:27 +01:00
Yann Collet
6a4583542a fixed asan warning 2015-12-18 02:51:14 +01:00
Yann Collet
17d188fa38 robust file list 2015-12-18 02:14:46 +01:00
Yann Collet
31683c0b28 benchmark can use dictionary 2015-12-18 01:26:48 +01:00
Yann Collet
fdcad6d3e1 added ZSTD_compress_usingDict() 2015-12-17 23:50:15 +01:00
Yann Collet
035c5429ba fix test32 2015-12-17 23:12:07 +01:00
Yann Collet
deb078b9b1 added : -m : decompress multiple files 2015-12-17 20:30:14 +01:00
Yann Collet
9d90922d49 refactored file compression 2015-12-17 14:09:55 +01:00
Yann Collet
24c98f2b4b fixed : conversion warning 2015-12-17 02:48:26 +01:00
Yann Collet
4f13703b2f added : -m : compress multiple files in a single command 2015-12-17 02:23:58 +01:00
Yann Collet
367060b874 larger cBuffer 2015-12-17 00:07:10 +01:00
Yann Collet
ad84ac9375 reduce memory usage 2015-12-16 03:57:46 +01:00
Yann Collet
880486ff05 fix g++ warning 2015-12-16 03:37:21 +01:00
Yann Collet
a52c98d23a fix Visual warning 2015-12-16 03:12:31 +01:00
Yann Collet
7061135d33 faster init for multi-files bench 2015-12-16 03:01:03 +01:00
Yann Collet
6c8b925ab9 fixed Visual warning 2015-12-16 02:44:56 +01:00
Yann Collet
ed699e692d benchmark multiple files 2015-12-16 02:37:24 +01:00
Yann Collet
7a3ab588c7 minor fixes 2015-12-15 11:25:12 +01:00
Yann Collet
397f1ffd52 fixed test script 2015-12-13 14:05:00 +01:00
Yann Collet
5d4fa0ed9b fixed arm-specific shadow warning 2015-12-13 13:58:51 +01:00
Yann Collet
60348b91f3 fixed silent conversion warnings 2015-12-13 13:44:23 +01:00
Yann Collet
f6f3d7526a external dictionary capability added to command line 2015-12-13 13:35:21 +01:00
Yann Collet
3a061a4c9f extended static dictionary to buffered mode 2015-12-12 11:17:42 +01:00
Yann Collet
6c3e2e7855 fixed : high compression modes for Windows 32 bits 2015-12-11 10:44:07 +01:00
Yann Collet
695a6cb463 fixed #94 2015-12-10 15:51:38 +01:00
Konstantin Tokarev
2b465840a8 Re-added accidentally lost round-trip tests for compression levels > 12. 2015-12-08 19:36:42 +03:00
Konstantin Tokarev
0b570b59d2 playTests.sh: Added --test-large-data switch. 2015-12-08 18:47:43 +03:00
Konstantin Tokarev
76be378513 playTests.sh: refactored round-trip tests 2015-12-08 18:36:37 +03:00
Konstantin Tokarev
d66db2ff04 Move tests from zstd-playTests target to separate shell script.
This patch allows me to run tests on MIPS board which lacks make.
2015-12-08 18:11:10 +03:00
Yann Collet
4bfe415fa7 validated external dictionary 2015-12-06 13:18:37 +01:00
Yann Collet
e47c4e5f8e strengthened bufferless streaming decompression 2015-12-05 09:23:53 +01:00
Yann Collet
1c2ddba469 use time limited fuzzer tests in CI 2015-12-04 17:45:35 +01:00
Yann Collet
553cf6a926 time-limited fuzzer tests 2015-12-04 17:25:26 +01:00
Yann Collet
417890cec2 strengthened streaming bufferless compression 2015-12-04 17:16:37 +01:00
Yann Collet
28e7cefea9 new zstd-noBench & zstd-frugal builds 2015-12-03 12:11:30 +01:00
Yann Collet
6a2f03295c update version to 0.4.2 2015-12-02 15:05:22 +01:00
Yann Collet
a9b34280a1 minor cosmetic improvement for small blocks 2015-12-02 13:00:25 +01:00
Yann Collet
c620b48489 revert install to normal zstd due to travis limitation (likely gcc 4.6) 2015-12-01 01:56:02 +01:00
Yann Collet
d062f1379c fixed benchmark autogen 2015-12-01 01:31:17 +01:00
Yann Collet
0338635e93 pgo 2015-12-01 01:28:32 +01:00
Yann Collet
aead1bf86b changed to ZSTD_LEGACY_SUPPORT=0, as suggested within #80 2015-11-30 14:18:47 +01:00
Yann Collet
a85a8dd94a Fixed #80 (reported by @luben)
Added : tests for ZSTD_LEGACY=disable build mode
extended ZSTD_LEGACY=disable to dll build
2015-11-30 11:53:11 +01:00
Yann Collet
7fe531e7ec fixed address space overflow (32-bits mode) 2015-11-29 02:38:09 +01:00
Yann Collet
00fd7a2110 protect 32-bits mode 2015-11-28 16:03:22 +01:00
Yann Collet
49cc9b7d03 large file support 2015-11-27 17:52:57 +01:00
Yann Collet
09116c2e4d optimizer mode 2015-11-27 17:46:14 +01:00
Yann Collet
b096cbf0d2 can build without legacy support using ZSTD_LEGACY=disable 2015-11-27 16:18:56 +01:00
Yann Collet
800fa6c378 stronger tests for zbuff decompression 2015-11-27 14:30:23 +01:00
Yann Collet
31d1806a77 zbuff properly supports small dst buffers 2015-11-27 14:07:36 +01:00
Yann Collet
29a2c838c5 support for legacy 0.3 format 2015-11-26 16:02:04 +01:00
Yann Collet
661f843637 fixed test in zbufftest 2015-11-26 15:39:44 +01:00
Yann Collet
26415d3ff2 fixed leak 2015-11-26 12:43:28 +01:00
Yann Collet
6bcdeac954 fixed asan warning 2015-11-26 11:43:00 +01:00
Yann Collet
7447ee96f6 fixed g++ warning 2015-11-26 10:52:30 +01:00
Yann Collet
5f2ec63852 fixed decompression bug (buffered mode) 2015-11-26 10:32:17 +01:00
Yann Collet
91a97960f7 Added zbufftest 2015-11-26 09:59:49 +01:00
Yann Collet
d3cb690156 fixed leak issue 2015-11-25 15:26:55 +01:00
Yann Collet
785b5ecc54 stronger tests 2015-11-25 15:16:19 +01:00
Yann Collet
88fcd2916e Added : zstd buffered API 2015-11-25 14:42:45 +01:00
Yann Collet
b5d2a0c827 visual compatibility 2015-11-23 17:10:19 +01:00
Yann Collet
225179dd05 more tests (bt modes) 2015-11-23 16:52:22 +01:00
Yann Collet
d7233d6e14 more compression tests 2015-11-22 14:40:51 +01:00
Yann Collet
a5c737411a complex level selector 2015-11-22 14:16:56 +01:00
Yann Collet
402fdcf1a3 fixed asan 2015-11-20 12:46:08 +01:00
Yann Collet
6a11a69b15 added : repcode generation to datagen 2015-11-20 12:00:25 +01:00
Yann Collet
dc5e3e96f8 minor memsave 2015-11-20 09:23:56 +01:00
Yann Collet
110cc14bab fixed bug #73 notified by @nemequ 2015-11-19 12:02:28 +01:00
Yann Collet
b2549846ba more tests 2015-11-18 11:29:32 +01:00
Yann Collet
2666d3e56c more tests 2015-11-14 11:07:51 +01:00
Yann Collet
93a823ccb7 fixed asan warnings 2015-11-13 15:08:43 +01:00
Yann Collet
0f366c61ed fixed streaming decoder 2015-11-12 16:19:30 +01:00
Yann Collet
cfdeb34180 fixed g++ link error 2015-11-12 16:00:04 +01:00
Yann Collet
7f6e91fa98 fixed library compilation 2015-11-11 14:39:50 +01:00
Yann Collet
5be2dd25f2 Changed Library source tree
- no more zstdhc ; zstd.h is enough
- ZSTD_compress() now needs a compressionLevel
- separated zstd_compress.c and zstd_decompress.c
- updated zstdcli, fullbench, fuzzer with new API
2015-11-11 13:43:58 +01:00
Yann Collet
b7d6e8f6bc fixed Visual warning 2015-11-09 18:20:39 +01:00
Yann Collet
9f432926b4 fileio can use small blocks params 2015-11-09 17:42:17 +01:00
Yann Collet
43e0cd512a small blocks params 2015-11-09 16:38:17 +01:00
Yann Collet
7ccff59cb3 fold fast stats 2015-11-09 12:07:44 +01:00
Yann Collet
6d2c9e6c62 generic param table 2015-11-09 11:39:48 +01:00
Yann Collet
d61ddd03ec pg display CL-compatible params 2015-11-08 14:45:38 +01:00
Yann Collet
4c7aae3a36 fuzzer tests more HC levels 2015-11-08 14:24:59 +01:00
Yann Collet
f48e35c206 minor bt improvements 2015-11-07 01:13:31 +01:00
Yann Collet
acd222c82e update readme 2015-11-06 12:39:39 +01:00
Yann Collet
444873f494 minor greedy mod 2015-11-06 11:48:56 +01:00
Yann Collet
f12c1304a8 integrate fast mode 2015-11-05 18:16:59 +01:00
Yann Collet
1f44b3f778 added fast mode 2015-11-05 17:32:18 +01:00
Yann Collet
47b68908b2 rename lazy2 2015-11-05 15:14:17 +01:00
Yann Collet
5106a76dc9 merged strats 2015-11-05 15:00:24 +01:00
Yann Collet
50c5cdb44c fixed issues reported by Maciej Adamczyk 2015-11-04 20:35:33 +01:00
Yann Collet
3e3582719c Fixed issue #62, reported by @luben 2015-11-04 18:19:39 +01:00
Yann Collet
2c7ac7c055 fix bench on /dev/null 2015-11-04 17:52:18 +01:00
Yann Collet
b241e9deb7 small compression improvement 2015-11-04 13:57:24 +01:00
Yann Collet
59d7063fbc fix and level tuning 2015-11-04 12:05:27 +01:00
Yann Collet
96b9f0ba4d btlazy2 2015-11-04 03:52:54 +01:00
Yann Collet
293d0cc261 fixed Visual warning 2015-11-03 13:10:25 +01:00
Yann Collet
cdc2b2f758 fixed clang warning 2015-11-03 10:52:14 +01:00
Yann Collet
050efba81b level tuning 2015-11-03 09:49:30 +01:00
Yann Collet
3564487614 lazydeep 2015-11-02 16:14:46 +01:00
Yann Collet
7671f393be v0.3.2 2015-11-02 12:17:39 +01:00
Yann Collet
66d22b803b v0.3.1 2015-11-02 02:36:10 +01:00
Yann Collet
21f96934c3 fixed config counter 2015-11-01 14:32:59 +01:00
Yann Collet
9b11b46f8a Fixed speed regression 2015-11-01 12:40:22 +01:00
Yann Collet
be2010ea1b lazy strategy 2015-10-31 12:57:14 +01:00
Yann Collet
4b100f43b0 level tuning 2015-10-30 15:49:48 +01:00
Yann Collet
aa074051d6 decoding support for legacy v0.2 format 2015-10-30 11:21:50 +01:00
Yann Collet
fc04bcc6d7 fixed minor gcc warning 2015-10-30 07:11:07 +01:00
Yann Collet
4114f95ce9 fix Visual Studio projects 2015-10-30 06:40:22 +01:00
Yann Collet
f8eaf0e158 added HC tests 2015-10-30 05:59:18 +01:00
Yann Collet
44fe99116e fixed hc alloc 2015-10-29 22:02:40 +01:00
Yann Collet
c776c46b46 range bench 2015-10-29 19:10:54 +01:00
Yann Collet
2f648e54ff hc fuzzer tests 2015-10-29 18:23:38 +01:00
Yann Collet
71bcdb5c1f sync paramgrill with HC starting at level 2 2015-10-29 17:08:03 +01:00
Yann Collet
2acb5d3d48 HC modes can be selected from command line 2015-10-29 16:49:43 +01:00
Yann Collet
76c5c2a4a0 minor tuning 2015-10-28 19:07:05 +01:00
Yann Collet
81e49e6654 fine tune & messages 2015-10-28 15:56:48 +01:00
Yann Collet
10ba1834cc value time 2015-10-28 14:05:37 +01:00
Yann Collet
1077bb8141 memory notation 2015-10-28 12:32:25 +01:00
Yann Collet
b315bc86e1 srcLog 2015-10-27 13:12:25 +01:00
Yann Collet
2c6992e1dc blocksize & T 2015-10-27 12:18:00 +01:00
Yann Collet
8b91abec18 can test param conf 2015-10-27 02:59:12 +01:00
Yann Collet
786f5b554a skip slow conf faster 2015-10-26 15:45:58 +01:00
Yann Collet
b2ad30cea2 faster scan 2015-10-26 02:45:19 +01:00
Yann Collet
0b87939dc0 clean paramgrill 2015-10-26 00:11:16 +01:00
Yann Collet
78d0f39605 make paramgrill 2015-10-26 00:07:32 +01:00
Yann Collet
fd9d6b8e2f paramgrill 2015-10-26 00:06:36 +01:00
Yann Collet
83fae977e6 Added asan tests 2015-10-23 15:21:53 +01:00
Yann Collet
eeb8ba18d1 uncoupled maxdlog and chainlog 2015-10-22 16:55:40 +01:00
Yann Collet
f3eca25322 quick first zstdhc version 2015-10-22 15:31:46 +01:00
Yann Collet
353c5d26cf unified ctx naming convention 2015-10-21 14:39:26 +01:00
Yann Collet
1c00dc3e24 Added block size to bench 2015-10-21 08:22:25 +01:00
Yann Collet
07e0674007 Fixed fullbench 2015-10-19 20:02:46 +01:00
Yann Collet
b1f3f4b565 update huff0 2015-10-18 22:18:32 +01:00
Yann Collet
0fef5be1cc Fix fullbench 2015-10-14 18:07:24 +01:00
Yann Collet
be50aaa0ee Added : Frame concatenation ability 2015-09-10 23:26:09 +01:00
Yann Collet
5abd8203cb Fix : decompression i/o detects flush write errors 2015-08-27 03:16:04 +01:00
Yann Collet
352ab88aea fixed minor issue on decoding invalid data 2015-08-26 22:45:23 +01:00
Yann Collet
ddf39e91c5 modified man page 2015-08-26 12:04:58 +02:00
Yann Collet
50b6f941e8 added : --verbose command 2015-08-26 10:32:17 +01:00
Yann Collet
bf50409e05 Refactor Makefile and .travis tests 2015-08-26 00:19:06 +01:00
Yann Collet
f44b2b02b4 Zstd cli : --version and --help write to stdout 2015-08-25 23:32:45 +01:00
Yann Collet
61d08c52a5 More informative write error messages 2015-08-25 18:13:32 +01:00
Yann Collet
5b147600f9 Fixed #42 2015-08-25 17:41:46 +01:00
Yann Collet
1885029ba1 Fixed a few issues found by AFL (American Fuzzy Lop) 2015-08-24 20:17:11 +01:00
Yann Collet
fee8e240c7 Fixed decoding error #11 (reported by @magv) 2015-08-24 15:47:04 +01:00
Yann Collet
d5d9bc3f82 Added : ZSTD decompression : ability to resist to noisy/faulty data source 2015-08-23 23:13:49 +01:00
Yann Collet
cf5ce55cca Updated xxhash 2015-08-21 12:00:52 +01:00
Yann Collet
997f9ee2ef Added : fuzzer tests : decompressing noisy src 2015-08-21 02:44:20 +01:00
Yann Collet
602834f794 Fixed : bug in compression in specific conditions (too small dst size) 2015-08-20 07:46:10 +01:00
Yann Collet
f3cb79b58f Fixed : g++ link error within fullbench 2015-08-20 00:02:43 +01:00
Yann Collet
f4ce8913a3 Added more strigent tests : compresson into too small buffer 2015-08-11 14:18:45 +01:00
Yann Collet
bd8f4e0e5c added : .gitignore generated binaries 2015-08-10 18:02:52 +01:00
Yann Collet
e9853b2cdb Fixed : ZSTD_compress() can attempt compression on a too small buffer 2015-08-07 19:07:32 +01:00
Yann Collet
e8c6bb1e42 Integrated huff0 (breaking format change) 2015-07-26 00:23:57 +01:00
Yann Collet
8b48b24821 Fixed minor visual analyzer warning 2015-07-07 17:26:17 -08:00
Yann Collet
674d91b3da Added sanitize=undefine test 2015-07-07 00:36:49 -08:00
Yann Collet
17867ced03 Fixed minor clang warnings 2015-07-07 00:14:27 -08:00
Yann Collet
7083b8a54a Travis CI : added ARM compilation tests 2015-07-06 23:58:59 -08:00
Yann Collet
effbd9811b Merge pull request #30 from jforberg/dev
Add `unzstd` program for decompression.
2015-07-05 15:02:41 -07:00
Yann Collet
b5e06dc7c3 Fixed a few minor visual analyzer warnings 2015-07-04 23:20:56 -08:00
Yann Collet
94f998b1fc Fixed a few visual analyzer warnings 2015-07-04 23:10:40 -08:00
Yann Collet
7393c5a51d Advanced API change : Cctx & DCtx are now incomplete types for stricter type checking 2015-07-04 18:20:42 -08:00
Yann Collet
14c6d0db9f updated xxhash version 2015-07-04 18:14:14 -08:00
Yann Collet
b6a0072699 Updated Visual projects 2015-07-04 16:23:52 -08:00
Yann Collet
1efa31fad8 Updated FSE lib 2015-07-04 15:56:41 -08:00
Yann Collet
078a9a2804 Added Wcast-qual compilation flag
Updated xxHash
Removed log traces
2015-06-20 19:37:53 -08:00
Yann Collet
213089c078 Updated FSE
Added clang and g++ tests
2015-06-18 07:43:16 -08:00
Johan Förberg
273d049a7c Add unzstd program for decompression. 2015-03-24 20:15:56 +01:00
Yann Collet
1d62914ea7 Added : valgrind test for datagen 2015-03-09 13:48:34 +01:00
Yann Collet
5203b8c68d Updated datagen : sparse file generation 2015-03-09 13:17:36 +01:00
Yann Collet
c5d46b5c90 New streaming API behavior, to solve issue 19 (https://github.com/Cyan4973/zstd/issues/19) 2015-02-16 18:06:26 +01:00
Yann Collet
f66d2babf8 Updated test-fullbench 2015-02-11 08:34:50 +01:00
Yann Collet
f96780683b updated fullbench, to include datagen 2015-02-11 08:19:57 +01:00
Yann Collet
fb98fd0bd4 datagen refactoring 2015-02-10 18:15:20 +01:00
Yann Collet
6610cb381c datagen is now a library, to be included in multiple programs 2015-02-09 08:00:26 +01:00
Yann Collet
aacace37f7 Fixed a few clang warnings 2015-02-01 11:57:30 +01:00
Yann Collet
439eb77088 Normalize all the line endings 2015-01-31 10:52:59 +01:00
Yann Collet
6434adcf54 Fix : no AVX2 for Visual 2008 and older 2015-01-29 07:00:43 +01:00
Yann Collet
e1e6f7d0b1 Removed minor warnings under minGW 2015-01-25 15:50:24 +01:00
Yann Collet
759433d679 Updated fullbench tests 2015-01-24 13:31:55 +01:00
Yann Collet
18a68714d0 Fixed : issue within fullbench, reported by AJ Baxter 2015-01-24 12:08:52 +01:00
Yann Collet
04d8e15e57 fixed : file permissions 2015-01-24 11:22:13 +01:00
Yann Collet
4856a00164 Initial release 2015-01-24 01:58:16 +01:00