AuroraMiddleware/zstd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
3,201 Commits 1 Branch 0 Tags 27 MiB
31533bacce
Commit Graph

924 Commits

Author SHA1 Message Date
Yann Collet
5c6d244973 Merge branch 'dev' of github.com:facebook/zstd into dev 2016-09-07 14:54:54 +02:00
Yann Collet
ac8bace6b1 support large skippable frames 2016-09-07 14:54:23 +02:00
Yann Collet
03d3f238de minor comment 2016-09-07 07:01:33 +02:00
Yann Collet
aad9fe5470 don't remove() /dev/null (#316) 2016-09-07 07:00:08 +02:00
Yann Collet
7ae67bb18a small compression speed gains with using_CDict 2016-09-06 06:28:05 +02:00
Thomas Klausner
b85cdabd50 Enable install targets for NetBSD. 2016-09-04 14:37:57 +02:00
Yann Collet
33a0465a51 fixed a few links 2016-09-02 22:11:49 -07:00
Yann Collet
5b8c024716 fixed zstd-pgo (#329) reported by @octoploid 2016-09-02 09:44:00 -07:00
Yann Collet
60181e3aaf zstd cli correctly detects console on Mac OS-X 2016-09-01 17:14:02 -07:00
Yann Collet
c843142ad0 zstd -d writes to stdout when input is stdin 2016-09-01 15:05:57 -07:00
Yann Collet
1c59c20903 removed redundant files 2016-08-31 07:15:44 -07:00
Yann Collet
599c69d917 minor Makefile updates 2016-08-30 13:33:20 -07:00
Yann Collet
4ded9e591c added boilerplate 2016-08-30 11:06:28 -07:00
Yann Collet
09c3c8e885 Merge pull request #307 from inikep/dev08 
updated README.md
 2016-08-29 16:32:33 -07:00
inikep
6416b0d705 updated README.md 2016-08-29 13:04:26 +02:00
Yann Collet
54caf6893e Removed fileio_legacy; now legacy supports relies entirely on streaming API. 
CLI legacy support now limited to v0.4+
 2016-08-28 19:20:13 -07:00
Yann Collet
9097f7b156 fixed versionsTest 2016-08-28 16:25:56 -07:00
Yann Collet
1c69baa1a9 CLI supports Legacy formats v0.4+ 2016-08-28 12:47:17 -07:00
Yann Collet
5f53b0335e fixed continuation context 2016-08-28 10:00:49 -07:00
Yann Collet
ab267e772c removed fileio specific legacy support; 
now depends on ZSTD_decompressStream() transparent legacy support
 2016-08-28 08:46:25 -07:00
Yann Collet
87c18b2ebd fixed multiple minor warnings for XCode 2016-08-26 01:43:47 +02:00
Yann Collet
0baa64a763 increased maximum memory size for 64-bits bench to 16 GB 2016-08-25 22:54:13 +02:00
inikep
de9d13068f updated zstd_compression_format.md 2016-08-25 14:59:08 +02:00
inikep
0132375ba6 improved zstd_compression_format.md 2016-08-25 12:20:38 +02:00
inikep
637d33566d minor README.md corrections 2016-08-25 10:42:49 +02:00
inikep
ab2f7708c1 created programs\README.md 2016-08-25 10:07:20 +02:00
inikep
e416e30019 remove unnecessary comments 2016-08-24 17:32:09 +02:00
inikep
7bcdbcf51d Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into Other 2016-08-24 17:09:19 +02:00
Yann Collet
d1733f7417 fixed crc bug in rare timing conditions within bench.c 2016-08-21 01:04:46 +02:00
inikep
c629776b31 make clean will remove decompress/zstd_decompress.o 2016-08-19 10:45:59 +02:00
Yann Collet
b571a0eab4 Merge pull request #298 from inikep/Other 
Other
 2016-08-18 17:14:03 +02:00
inikep
b6514d2496 improved .gitignore 2016-08-18 16:53:29 +02:00
Yann Collet
49d105cfcf better warning and error messages in case of dictionary training failure (#292) 2016-08-18 15:02:11 +02:00
inikep
2868d565e4 test-related files moved to tests/ 2016-08-18 13:18:11 +02:00
Yann Collet
e80d15304a Merge pull request #296 from inikep/Other 
Other
 2016-08-18 11:48:48 +02:00
inikep
a7bb322a93 removed never referenced functions 2016-08-18 10:30:21 +02:00
inikep
5a54870047 fixed Intel Compiler warnings with Visual Studio 
http://encode.ru/threads/2119-Zstandard?p=49504&viewfull=1#post49504
 2016-08-18 09:00:25 +02:00
Yann Collet
bfdc34e5a3 Merge pull request #294 from inikep/Other 
improved Makefiles
 2016-08-17 19:41:56 +02:00
inikep
79b4062c81 fixed paramgrill dependency 2016-08-17 16:29:57 +02:00
inikep
d0c270fe85 improved programs\Makefile 2016-08-17 15:59:50 +02:00
inikep
78f3e0630b disabled %llu warnings with MinGW on Windows 2016-08-17 14:52:11 +02:00
Yann Collet
3d9211e961 Merge pull request #290 from david-y-lam/fix_file_name 
Remove file name truncation in zstd CLI output
 2016-08-17 14:05:29 +02:00
Yann Collet
53e17fbd5e updated streaming API 2016-08-17 01:39:22 +02:00
Yann Collet
94ca85d01b fixed Visual warning 2016-08-16 15:11:28 +02:00
Yann Collet
6263ba5451 fileio uses new streaming API 2016-08-16 15:11:28 +02:00
Yann Collet
fb5e385164 minor changes 2016-08-16 15:11:28 +02:00
Yann Collet
d7883a2c0e added zstreamtest 2016-08-16 15:11:28 +02:00
David Lam
0f2704581e Remove truncation of filename in zstd CLI log lines 2016-08-13 11:26:21 -07:00
David Lam
ac43e9582e Add more descriptive message to -v option in zstd CLI 2016-08-12 17:47:18 -07:00
Yann Collet
fab023010d changed test, in compliance with new --ultra policy 2016-08-12 19:00:18 +02:00
Yann Collet
fe0590f63f new --ultra policy 2016-08-12 18:04:15 +02:00
inikep
7132fb15ba bench.c: removed benchResult_t 2016-08-10 14:59:18 +02:00
inikep
3d2c58c3a9 fixed compilation with Visual in C++ mode 2016-08-10 14:28:47 +02:00
Yann Collet
666398e7ed added : xxhash namespace enforced from xxhash.h. 
added : xxhash namespace test.
removed : -DXXH_NAMESPACE
 2016-08-10 08:16:51 +02:00
Yann Collet
6a21971f4a bench : implemented avgSize 2016-08-03 00:06:24 +02:00
Yann Collet
bf2bc112bb bench : controlled display update when loading lot of files 2016-08-02 23:48:13 +02:00
Yann Collet
de4c04f6c2 Fixed : ZSTD_compress* can compress > 4 GB in a single pass, reported by Nick Terrell 2016-08-02 11:27:05 +02:00
Yann Collet
9a69ec4f3b added : resilience test for ZSTD_getErrorName() 2016-08-01 16:25:58 +02:00
Yann Collet
415251c63b minor style change 2016-08-01 14:26:49 +02:00
Yann Collet
a9febe81ae changed bench behavior for slow compression levels 2016-08-01 13:40:52 +02:00
Yann Collet
2a2ba3691c Merge pull request #266 from jrmarino/master 
Enable build on FreeBSD ports (includes DragonFly BSD) [dev branch]
 2016-07-31 02:21:26 +02:00
jrmarino
0d07ec0c0c Enable build on FreeBSD ports (includes DragonFly BSD) 
Zstd has been introduced to FreeBSD ports
(http://www.freshports.org/archivers/zstd/) which DragonFly BSD also
uses.  FreeBSD and DragonFly use the install targets (albeit modified in
some cases) so they must be added to the associated Makefile filters.
 2016-07-30 19:11:15 -05:00
Yann Collet
235911e13f removed "avg" evaluation from bench -q 
removed "sleeping" notification from bench -q
 2016-07-31 01:32:48 +02:00
Yann Collet
4c5bbf64f9 fixed : frame concatenation without checksum 2016-07-28 20:30:25 +02:00
Yann Collet
60ba31c570 zbuff uses ZSTD_compressEnd() 2016-07-28 19:55:09 +02:00
Yann Collet
62470b4bab Changed ZSTD_compressEnd() 2016-07-28 15:29:08 +02:00
Yann Collet
c991cc1828 new frame end, 32-bits checksums 2016-07-28 00:55:43 +02:00
Yann Collet
4110534886 ZSTD_maxCLevel() is promoted to "stable" API (#254, by @FrancescAlted) 2016-07-27 15:09:11 +02:00
Yann Collet
dd25a27702 added tutorial warning messages for dictBuilder 2016-07-27 12:43:09 +02:00
Yann Collet
fbd557d5c2 multi-files -t doesn't stop after detecting magic number read failure 2016-07-26 17:13:58 +02:00
Yann Collet
a1dd6b97d2 fixed null-length round trip 2016-07-26 16:44:09 +02:00
Yann Collet
7adc2328a3 fixed --test on zero-length files, reported by @amnilsson 2016-07-26 15:49:24 +02:00
Yann Collet
9cebec21e1 Merge pull request #259 from inikep/dev08 
legacy decoder for v0.7 format
 2016-07-26 15:13:05 +02:00
inikep
7bc5c6b5cb util.h: detect if an error occurs in readdir() (thanks to Jim Meyering) 2016-07-26 11:07:37 +02:00
Yann Collet
24a3d90bf0 strengthened integrity tests 2016-07-26 01:33:20 +02:00
Yann Collet
b402490546 fixed #260, reported by @amnilsson 2016-07-26 00:49:47 +02:00
inikep
fca90f8f60 legacy decoder for v0.7 format 2016-07-25 17:49:08 +02:00
Yann Collet
e5a817a2d8 better MOREFLAGS 2016-07-24 17:46:05 +02:00
Yann Collet
10b9c13d07 fixed doc on cLevel default, reported by Oliver Lange 2016-07-24 01:21:53 +02:00
Yann Collet
f8e7b5363f unified encoding types 2016-07-23 16:31:49 +02:00
Yann Collet
b752298d1d fixed 32-bits compilation 2016-07-22 14:37:09 +02:00
Yann Collet
32faf6c8e7 fixed conversion warnings 2016-07-22 14:37:09 +02:00
Yann Collet
5e45a5fbb3 force loop-align to 32 for zstd_decompress 2016-07-22 14:37:09 +02:00
Yann Collet
5288ac0cb7 changed filed order 2016-07-22 14:37:09 +02:00
Yann Collet
6fa05a2371 cBlockSize uses little-endian convention 2016-07-22 14:37:09 +02:00
Yann Collet
06dd74114a minor : long tests display progression status 2016-07-18 04:06:43 +02:00
Yann Collet
85f3919960 moved zstd.h to /lib 2016-07-17 20:42:21 +02:00
Yann Collet
988bcf360a -v and --verbose increase display level by 1 2016-07-15 19:43:30 +02:00
Yann Collet
d3d2db587e adapted fuzzer test to new blockSizeMax rule for ZSTD_compressBlock() 2016-07-15 12:20:26 +02:00
Yann Collet
227cc39e15 improved efficiency for large messages with small dictionaries 2016-07-15 11:27:09 +02:00
Yann Collet
e20d5cf117 fixed paramgrill 2016-07-14 20:46:24 +02:00
Yann Collet
17508f1a16 fixed a few minor coverity warnings 2016-07-14 17:18:20 +02:00
Yann Collet
69c2cdb45c fixed conversion warning 2016-07-14 16:52:45 +02:00
Yann Collet
44f684ded3 fixed minor coverity warning 2016-07-13 20:12:33 +02:00
Yann Collet
5e80dd3261 fixed minor coverity warnings 2016-07-13 19:21:57 +02:00
Yann Collet
158e7703bb reduced paramgrill dependency to C standard lib only 2016-07-13 16:45:24 +02:00
Yann Collet
2b1a3638e6 changed macro name to ZSTDCLI_CLEVEL_DEFAULT 2016-07-13 15:16:00 +02:00
Yann Collet
3c242e79d3 updated compression levels table 2016-07-13 14:56:24 +02:00
Yann Collet
2cac5b30b9 changed default compression level to 3 (can be modified with macro ZSTDCLI_DEFAULT_CLEVEL) 2016-07-13 14:15:08 +02:00
Yann Collet
696c4d7ef5 new paramgrill mode : -O# : find optimal parameters for a given sample and a given target speed 2016-07-13 13:11:08 +02:00
Yann Collet
650a8778c1 minor filter improvement 2016-07-13 11:49:05 +02:00
Yann Collet
a43a854cdb updated paramgrill 2016-07-12 13:42:10 +02:00
Yann Collet
45dc35628c first version of doubleFast 2016-07-12 09:47:31 +02:00
Yann Collet
3ae543ce75 added ZSTD_estimateCCtxSize() 2016-07-11 03:12:17 +02:00
Yann Collet
aa2628da30 added : ZSTD_insertBlock(), basic tests 2016-07-07 15:28:41 +02:00
Yann Collet
19c27d27f1 simplified legacy functions, no longer need magic number 2016-07-07 14:40:13 +02:00
Yann Collet
e72efeb0a1 removed "error_public.h" dependency from "zstd.h" 2016-07-07 14:17:40 +02:00
Yann Collet
f323bf7d32 added : ZSTD_getDecompressedSize() 2016-07-07 13:14:21 +02:00
Yann Collet
a3d03a3973 added <errno.h> dependency 2016-07-06 16:27:17 +02:00
Yann Collet
bcb5f77efa dictBuilder manages better samples of null size 0 and large size > 128 KB 2016-07-06 15:41:03 +02:00
Yann Collet
9ca73364e6 updated spec 2016-07-05 10:53:38 +02:00
Yann Collet
f9cac7a734 Added GNU separator --, to specifies that all following arguments are necessary file names (and not commands). Suggested by @chipturner (#230) 2016-07-04 18:18:24 +02:00
Yann Collet
92c986b4e8 fixed cmake error (missing errno) 2016-07-04 01:37:30 +02:00
Yann Collet
d916c908e0 updated doc 2016-07-04 00:42:58 +02:00
Yann Collet
440bb637e2 Merge pull request #238 from juanfra684/patch-2 
Add OpenBSD to the Makefile test.
 2016-07-04 00:38:19 +02:00
Juan Francisco Cantero Hurtado
06ad6f1911 Add OpenBSD to the Makefile test. 2016-07-03 22:16:00 +02:00
Juan Francisco Cantero Hurtado
fb5c59fc89 Redundant entry for options in the man page. 
".SH OPTIONS" is enough.
 2016-07-03 22:15:26 +02:00
Yann Collet
5cc1882d45 fixed minor visual warning 2016-07-03 19:03:13 +02:00
Yann Collet
c62cda9def fileio.c no longer depends on zstd_internal.h 2016-07-03 01:36:57 +02:00
Yann Collet
92d75667e4 fix for fast mode 2016-07-03 01:10:53 +02:00
Yann Collet
b2b5309c6f removes Visual warning on strerror() 2016-07-03 00:20:03 +02:00
Yann Collet
f4b7b747c7 -c does no longer modify displayLevel when -v set. 2016-07-02 22:57:28 +02:00
Yann Collet
ed7fb8413c extended use of strerror(errno) 2016-07-02 21:01:54 +02:00
Yann Collet
b71adf45c1 extended use of strerror(errno) 2016-07-02 01:51:12 +02:00
Yann Collet
b7f197633a use strerror(errno) to return system error message 2016-07-02 00:59:25 +02:00
Yann Collet
a7a5d7736c Updated doc 2016-07-02 00:37:32 +02:00
Yann Collet
cebab1d322 Explicit error message when dst file cannot be created / opened 2016-07-02 00:12:14 +02:00
Yann Collet
6c6e1751f6 use ZSTD_getParams() to simplify code 2016-06-27 15:28:45 +02:00
Yann Collet
3d2cd7f816 Introduced ZSTD_getParams() 
bench now uses ZSTD_createCDict_advanced()
 2016-06-27 15:12:26 +02:00
Yann Collet
ec224d256d removed useless context 2016-06-27 13:39:30 +02:00
Yann Collet
4c56f4a3cf fixed error messages 2016-06-27 13:36:54 +02:00
Yann Collet
d4f4e58ee1 fixed ZSTD_decompressBlock() using multiple blocks 2016-06-27 01:31:35 +02:00
inikep
9649126f70 Merge remote-tracking branch 'refs/remotes/origin/speedTest' into dev 2016-06-22 16:22:29 +02:00
inikep
d7d251ccb5 bench.c: added support for ZSTD_GIT_COMMIT 2016-06-22 16:13:25 +02:00
inikep
f2f59d758e test-zstd-speed.py: added ZSTD_GIT_COMMIT 2016-06-22 15:42:26 +02:00
Yann Collet
8d30cd562a Merge pull request #219 from inikep/dev 
added gcc5test and gcc6test for Travis
 2016-06-21 21:51:52 +02:00
Yann Collet
391a128794 fix : segfault in command line during automatic overwrite protection mode 2016-06-21 17:06:25 +02:00
Yann Collet
446d442989 zbufftest now ensures ZBUFF_compressEnd() is fully flushed in a single pass if dst buffer is large enough 2016-06-21 14:14:02 +02:00
Yann Collet
f15c1cb00c Fixed : ZBUFF_compressEnd() called multiple times with too small dst buffer (#206) 2016-06-21 13:11:48 +02:00
Yann Collet
2565971ea4 stronger fuzzer tests for ZBUFF_compressEnd() 2016-06-21 12:17:26 +02:00
inikep
9bf5357101 bench.c: use ZSTD_VERSION_STRING 2016-06-21 11:01:29 +02:00
Yann Collet
c98f8e7b57 Modified : zstd CLI enables checksum by default 2016-06-20 16:31:24 +02:00
Yann Collet
cbf8c52954 roundTripCrash automatic compression level now depends on first 128 bytes 2016-06-20 16:18:19 +02:00
Yann Collet
19cab46f2f Joined seqStore initialization at dispatch point 2016-06-17 12:54:52 +02:00
Yann Collet
3f01c8833f better seed randomization for systems with poor clock() resolutation 2016-06-16 13:38:10 +02:00
Yann Collet
803c05ec7e fuzzer : tests with high id are run without need to change finalTestNb 2016-06-16 11:32:57 +02:00
Yann Collet
23ccc34262 Merge branch 'dev' of github.com:Cyan4973/zstd into dev 2016-06-15 23:33:52 +02:00
Yann Collet
1a7b8fbc24 fixed dictionary tests 2016-06-15 23:33:38 +02:00
Yann Collet
9b998e4d08 Fixed decompression of literals in dictionary mode 2016-06-15 23:11:20 +02:00
Tobias Ibounig
3915545605 Fix Max Compression Level in zstd.1 2016-06-15 22:20:46 +02:00
Yann Collet
531a4273c0 stronger dictionary compression tests 2016-06-15 19:02:11 +02:00
Yann Collet
1869f7966e Merge pull request #205 from inikep/dev 
legacy decoder for v0.6
 2016-06-10 17:13:07 +02:00
Yann Collet
b09b12ce10 Added command --rm : remove source file after successful de/compression 2016-06-09 23:01:19 +02:00
inikep
bf853d5510 added legacy decoder for v0.6 format 2016-06-09 17:59:18 +02:00
Yann Collet
ee1a084852 Integrated new dictionary API into bench module 2016-06-07 01:40:49 +02:00
Yann Collet
f72dc6091b removed msan tests, due to issues with datagen.c 2016-06-06 19:42:47 +02:00
Yann Collet
2cc72f1fd3 fixed initialization issue in bench 2016-06-06 17:50:07 +02:00
Yann Collet
673f0d7cdc new frame format, allowing custom window size 2016-06-06 00:26:38 +02:00
Yann Collet
a91ca620cf removed HUF_readStats() from public space 2016-06-05 01:33:55 +02:00
Yann Collet
f3a1a84c9a fixed cmake project 2016-06-05 01:05:01 +02:00
Yann Collet
d0e2cd15cb Merged fse_static into fse.h . Now requires FSE_STATIC_LINKING_ONLY macro. 2016-06-05 00:58:01 +02:00
Yann Collet
d3b7f8d21f Merged zstd_static.h into zstd.h . Now requires ZSTD_STATIC_LINKING_ONLY macro 2016-06-04 19:47:02 +02:00
Yann Collet
5347aee8f7 merged zbuff_static.h into zbuff.h . Now requires ZBUFF_STATIC_LINKING_ONLY macro 2016-06-04 19:12:48 +02:00
Yann Collet
e69b8ccceb merged zdict_static.h into zdict.h. Now requires ZDICT_STATIC_LINKING_ONLY macro. 2016-06-04 18:56:23 +02:00
Yann Collet
0d31160b4e better dynamic memory adaptation when using CLI 2016-06-04 00:09:02 +02:00
Yann Collet
ab7b6f1ece Merge pull request #198 from inikep/dev070 
Dev070
 2016-06-03 21:37:49 +02:00
Yann Collet
441f5d61fd dictionary size objective can be described in Megabytes 2016-06-03 15:15:47 +02:00
Yann Collet
1dd7961557 minor code refactoring 2016-06-03 15:14:09 +02:00
inikep
36fac00149 removed calloc calls from lib/ 2016-06-03 13:23:04 +02:00
inikep
db2f540414 added defaultCustomNULL 2016-06-03 12:56:56 +02:00
inikep
ff2d18928d zlibWrapper: added gcc flag -Wdeclaration-after-statement 2016-06-02 22:15:09 +02:00
inikep
b74a468fad Merge remote-tracking branch 'refs/remotes/Cyan4973/dev070' into dev070 2016-06-02 22:09:09 +02:00
inikep
7cab86f647 ZWRAP_allocFunction and ZWRAP_freeFunction are static 2016-06-02 18:24:07 +02:00
Yann Collet
923938edde Added -Wdeclaration-after-statement compilation flag 2016-06-02 17:56:00 +02:00
Yann Collet
2c4acdabdc Changed command name to --check , -C, following xz convention 2016-06-02 17:05:50 +02:00
inikep
ff9114aee3 zlibWrapper: added support for custom memory allocation functions 2016-06-02 16:52:36 +02:00
inikep
2866951558 opaque parameter for custom memory allocation functions 2016-06-02 13:04:18 +02:00
Yann Collet
87cfbe3e5f checksum generation can be selected from command line (--checksum) 2016-06-01 19:22:15 +02:00
Yann Collet
eb70043e59 Fixed paramgrill 2016-06-01 18:59:55 +02:00
Yann Collet
70d1301d6e Changed ZSTD_adjustCParams() prototype 
`ZSTD_adjustCParams()` is now automatically invoked at the end of `ZSTD_getCParams()`
 2016-06-01 18:45:34 +02:00
Yann Collet
83c3f4427c upgraded zbufftest to also test advanced frame parameters no/checksum no/dictID 2016-06-01 17:44:53 +02:00
inikep
5c2771710d Merge remote-tracking branch 'refs/remotes/Cyan4973/dev070' into dev070 
# Conflicts:
#	.gitignore
#	lib/decompress/zstd_decompress.c
#	programs/zbufftest.c
 2016-06-01 09:16:11 +02:00
Yann Collet
202844ebd0 fixed zbufftest : 2016-06-01 00:44:36 +02:00
inikep
00fa1ae0c0 update playTests.sh permission 2016-06-01 00:13:02 +02:00
inikep
a6b942018d Merge remote-tracking branch 'refs/remotes/origin/dev' into dev070 
# Conflicts:
#	.travis.yml
#	Makefile
#	lib/common/zstd_static.h
#	programs/Makefile
#	projects/VS2008/zstd/zstd.vcproj
#	projects/VS2008/zstdlib/zstdlib.vcproj
#	projects/cmake/lib/CMakeLists.txt
#	projects/cmake/programs/CMakeLists.txt
 2016-06-01 00:07:09 +02:00
Yann Collet
f2a3b6e7b4 added : frame content checksum 2016-05-31 22:23:45 +02:00
inikep
cf6edcd0a1 zbufftest.c: fixed g++ warning 2016-05-31 20:21:43 +02:00
inikep
43aa9fe8b3 fixed skippable frame 2016-05-31 19:36:51 +02:00
inikep
5bee32e349 cmake project works with MSYS 2016-05-31 13:36:14 +02:00
inikep
f772bf54a5 support for skippable frames 2016-05-31 12:43:46 +02:00
Yann Collet
6fca9e7545 Changed : max dictionary file size increased to 8 MB 2016-05-31 02:40:42 +02:00
Yann Collet
6381e99fb2 Added : ability to create compressed frames without dictID 2016-05-31 02:29:45 +02:00
Yann Collet
b81cbbade1 fixed minor conversion warning 2016-05-30 22:29:45 +02:00
Yann Collet
290aaa7521 Added : ability to manually select the dictionary ID of a newly created dictionary 2016-05-30 21:18:52 +02:00
cyan
b880631aed Fixed visual projects 
Signed-off-by: Yann Collet <yann.collet.73@gmail.com>
 2016-05-30 18:28:29 +02:00
Yann Collet
30009521d7 fuzzer tests dictBuilder. 
Added : ability to not store dictID during compression; decompression doesn't check dictID then
 2016-05-30 16:17:33 +02:00
Yann Collet
d2858e93cb minor refactoring 2016-05-30 15:11:17 +02:00
inikep
1dcb2ff23f improved scripts compatibility 2016-05-30 11:33:52 +02:00
inikep
957d678031 update playTests.sh perimissions 2016-05-30 10:23:52 +02:00
inikep
93fc13ebc8 playTests.sh working with Linux, Windows, OS X 2016-05-30 10:17:55 +02:00
Yann Collet
c0a9bf3c2e minor code refactoring 2016-05-30 04:48:32 +02:00
Yann Collet
954e2bc48f added fuzzer test for ZSTD_compressBegin_advanced() 2016-05-30 01:42:05 +02:00
Yann Collet
33341de7d7 fixed fuzzer dictionary test 2016-05-29 23:09:51 +02:00
Yann Collet
fcf2087a15 restored zstdcli.c 2016-05-29 05:16:05 +02:00
Yann Collet
c46fb924df added dictionary ID (incomplete) 2016-05-29 05:01:04 +02:00
Yann Collet
0d348d46d8 fixed cmake 
fixed playTests
 2016-05-29 02:02:24 +02:00
Yann Collet
f51e0660f4 Simplified list of *.c files 2016-05-29 01:39:19 +02:00
Yann Collet
0c5e8b17ad moved xxhash to lib/common 2016-05-29 01:06:30 +02:00
Yann Collet
ab2ee08042 fixed makefile error in clean target 2016-05-28 16:06:29 +02:00
Yann Collet
fb0ba59c41 Added : utility roundTripCrash 
which generates a crash (double-free) on detecting a round-trip corruption
 2016-05-28 15:30:01 +02:00
Yann Collet
6c903a8dd5 updated xxhash to latest "dev" version 2016-05-28 13:34:07 +02:00
inikep
993a9dfc5a playTests.sh updated to work better with /bin/sh 2016-05-27 10:07:46 +02:00
inikep
bff23b72c5 fixed Visual Studio warning 2016-05-25 17:40:58 +02:00
inikep
957823f56f zstdcli: -r (operate recursively on directories) works with dictBuilder and compression 2016-05-25 15:30:55 +02:00
inikep
4f1acdd158 usage of fileno() only on POSIX and Windows 2016-05-25 12:41:41 +02:00
inikep
e75909ef93 ZBUFF_createCCtx_advanced moved to zbuff_static.h 2016-05-25 11:31:16 +02:00
inikep
5d589562fe playTests.sh joined with playTestsMSYS.sh 2016-05-25 10:50:28 +02:00
inikep
460a4ee6d4 playTests updated with Pass-Through mode 2016-05-24 18:22:38 +02:00
inikep
02c244bf78 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-05-24 17:15:04 +02:00
inikep
fb5df613cf zstd_stats.h included only in debug mode 2016-05-24 15:36:37 +02:00
inikep
a1653fbfd0 zbufftest.c: tests for ZBUFF_createCCtx_advanced/ZBUFF_createDCtx_advanced 2016-05-24 15:35:48 +02:00
inikep
71dd67cf57 fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced 2016-05-24 10:57:14 +02:00
Yann Collet
ddbb8e27bf fixed minor conversion warning 2016-05-24 00:52:14 +02:00
Yann Collet
de95f96462 Pass-Through mode support (using -df), for compatibility with gzip 2016-05-23 19:46:47 +02:00
Yann Collet
32990b5dae Added tests for Sparse mode support 
Fixed : complex cli arg case involving a mix of `stdin` and `-o`
 2016-05-23 17:48:57 +02:00
Yann Collet
75424d1139 Added : Sparse write support 
--[no-]sparse command
 2016-05-23 16:56:56 +02:00
Peter (Stig) Edwards
04773ac90a Minor changes needed for OpenVMS 
Define util sleep functions on VMS.
If PRIO_PROCESS is not defined then do not attempt to use it in the definition of SET_HIGH_PRIORITY.
 2016-05-21 12:15:48 +01:00
Yann Collet
45f84ab7cc all programs use ZSTD_VERSION_STRING from zstd.h to display their version 2016-05-20 12:34:40 +02:00
Yann Collet
de4d4da52d changed version to 0.6.2 
removed make-controlled version (now used from zstd.h)
removed std=c99 by default
added : c90/gno90/c99/gnu99/c11 tests
 2016-05-20 12:20:12 +02:00
Yann Collet
e162aceeb6 minor simplification 2016-05-20 11:35:00 +02:00
inikep
96abb5a806 AppVeyor tests use playTests.bat 2016-05-19 15:50:58 +02:00
inikep
44bb2f6c89 added datagen in Visual Studio project 2016-05-19 12:16:14 +02:00
inikep
60af95d971 fixed compression with -c with multiple files on Windows 2016-05-19 10:29:49 +02:00
inikep
2bd6b13e53 added playTests.bat 2016-05-18 18:05:56 +02:00
inikep
3aa4b2b598 update file permission 2016-05-18 18:04:10 +02:00
Yann Collet
35276a9441 fixed minor conversion warnings 2016-05-18 17:26:23 +02:00
Yann Collet
bde926fce7 removed msan tests 2016-05-18 17:18:48 +02:00
inikep
f33021552b added playTestsMSYS.sh 2016-05-18 16:38:36 +02:00
klemens
268775dae8 spelling-fixes, as of lintian.debian.org 2016-05-16 22:23:24 +02:00
inikep
63ecd747de added common/entropy_common.c 2016-05-13 11:27:56 +02:00
inikep
58a1d45aa5 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-05-13 11:05:35 +02:00
inikep
0bdb6a8118 changed definition of UTIL_createFileList 2016-05-13 10:52:02 +02:00
inikep
3eabe9b474 added zlibWrapper - zstd wrapper for zlib 2016-05-12 17:15:41 +02:00
inikep
4dbf7f4a3b dynamic memory allocation in UTIL_createFileList 2016-05-11 14:11:00 +02:00
Yann Collet
a96f9fd5bc datagencli uses mem.h 2016-05-11 11:42:51 +02:00
Yann Collet
b3a9938d0c Merge pull request #182 from inikep/dev 
support for Visual Studio 2012, 2013, 2015
 2016-05-10 17:18:12 +02:00
Yann Collet
b12b369817 fixed : unused argument in printf 2016-05-10 15:30:43 +02:00
inikep
95459458ed disable Visual Studio code analysis 2016-05-10 14:42:54 +02:00
inikep
3733797fcd bench.c: experimental -r (operate recursively on directories) for Windows and _POSIX_C_SOURCE >= 200112L 2016-05-10 14:22:55 +02:00
Yann Collet
bd39d54576 zbuff supports byte-by-byte decompression scenarios 2016-05-10 14:14:19 +02:00
inikep
ed9a08538c Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 
# Conflicts:
#	lib/common/util.h
#	programs/paramgrill.c
#	visual/2013/fullbench/fullbench.vcxproj.filters
#	visual/2013/fuzzer/fuzzer.vcxproj.filters
 2016-05-10 13:20:01 +02:00
Yann Collet
d693117113 fixed : null-length string roundtrip 2016-05-10 05:56:09 +02:00
Yann Collet
8b23eea694 minor refactor : more accurate variables scope 
Added null-length string test
 2016-05-10 05:37:43 +02:00
inikep
349fcf7ea2 fixed Linux compilation 2016-05-09 18:04:07 +02:00
inikep
aaaf923a17 common/util.h moved to programs/util.h 
decompress/fse_decompress.c moved to common/
 2016-05-09 16:19:25 +02:00
Yann Collet
d782890576 fixed datagen 2016-05-09 12:28:20 +02:00
Yann Collet
ceca200c77 datagen uses mem.h 2016-05-09 12:20:50 +02:00
Yann Collet
59b6ba7677 Merge pull request #180 from thatsafunnyname/patch-1 
No stdint.h on OpenVMS.
 2016-05-09 11:56:42 +02:00
Yann Collet
f6ca09b5ff Reduced console display on loading lots of files with zstd --train. Reported by @KrzysFR, see #177 2016-05-09 04:44:45 +02:00
Yann Collet
95af06f6ef fixed legacy dictionary decompression 2016-05-08 08:23:51 +02:00
Yann Collet
0c0f314550 CLI supports dictionary decompression in legacy mode v0.5.x 2016-05-08 08:11:24 +02:00
Yann Collet
f849462d4c minor refactor : more accurate variable scope 2016-05-07 22:43:40 +02:00
inikep
13c8424ea0 code cleaning 2016-05-05 13:58:56 +02:00
inikep
0bd0faec32 fixed compatibility issues 2016-05-05 13:10:57 +02:00
inikep
9c22e57bfb Compiler Options moved to util.h 2016-05-05 11:53:42 +02:00
Yann Collet
3f8ed50bf1 Added gnu90 test 
work-around : disabled automatic selection of huff0 quad-decoder (see #173)
 2016-05-05 03:01:13 +02:00
thatsafunnyname
dca5cf92ac No stdint.h on OpenVMS. 
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
 2016-05-04 15:42:25 +01:00
thatsafunnyname
eef5fdb58a No stdint.h on OpenVMS. 
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
 2016-05-04 15:39:31 +01:00
Yann Collet
6f9c056662 Fixed BMI behavior on x86 and x32 targets, reported by @tycho (#178) 2016-05-01 10:26:30 +02:00
inikep
bab4317961 util.h must the the first include to #define _POSIX_C_SOURCE 2016-04-29 15:19:40 +02:00
inikep
55d047aa92 getTotalFileSize moved to common/util.h 2016-04-28 16:50:13 +02:00
inikep
d5ff2c3d9a ordering of #include 2016-04-28 14:40:45 +02:00
inikep
83c76b4594 bench.c: time functions moved to common/util.h 2016-04-28 13:16:01 +02:00
inikep
69fcd7c0ae getFileSize moved to common/util.h 2016-04-28 12:23:33 +02:00
inikep
ea4ee3eee0 added compatibility with Visual C++ 2012 2016-04-25 13:09:06 +02:00
inikep
f066816998 fix for g++ compilation 2016-04-22 18:54:05 +02:00
inikep
db3964382c introduced ZSTD_NODECOMPRESS to link only compressor 2016-04-22 18:22:30 +02:00
inikep
a1febea01d Error functions moved to common/zstd_common.c 2016-04-22 17:14:25 +02:00
inikep
3c7c3527d0 introduced ZSTD_NOCOMPRESS to generate decompressor only 2016-04-22 13:59:05 +02:00
inikep
23a0889301 separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/ 2016-04-22 12:43:18 +02:00
inikep
4699b3be03 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-21 12:30:58 +02:00
inikep
38654988f3 minor speed improvements 2 
bench.c: block size has to be bigger than 32 bytes
zstdcli.c: support for e.g. -B16k -B16m
 2016-04-21 12:18:47 +02:00
Yann Collet
e02808ffc5 bumped lib version to 0.6.1 
added ZSTD_VERSION_STRING
 2016-04-20 22:46:16 +02:00
inikep
c5e1d295ee bench.c: force at least one compression and decompression loop 
fix for -i0 with small files
 2016-04-19 09:37:59 +02:00
inikep
6d157f1fbe bench.c: fixed rare compression and decompression speed bug 
concerns only big files with compression or decompression time longer
than 100 seconds
 2016-04-15 16:54:11 +02:00
inikep
4b3c5eed99 removed ZSTD_compressBegin_targetSrcSize 2016-04-14 13:43:51 +02:00
inikep
c70c90e8a3 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-13 10:48:26 +02:00
inikep
c0d5f4eb2e bench.c: ignore directories from a file list for benchmark 2016-04-13 10:48:04 +02:00
Yann Collet
389648cc6d Fixed : contentSize + copyCCtx() 2016-04-12 19:13:08 +02:00
Yann Collet
541dc7c7d4 Added : fuzzer test, checking contentLength value after copyCCtx() usage 2016-04-12 18:00:20 +02:00
Yann Collet
887e7da785 Fixed copyCCtx() on uninitialized cctx (reported by Oliver Lange) 2016-04-11 20:12:27 +02:00
inikep
8844e21dff Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-11 16:49:27 +02:00
Yann Collet
81e493651a Fixed minor conversion warning 2016-04-11 01:47:10 +02:00
Yann Collet
c51aa6ccce minor refactor 2016-04-11 01:20:14 +02:00
Yann Collet
c456077066 fixed : minor warning on return value 2016-04-11 01:12:32 +02:00
Yann Collet
7928f6f024 Fixed : cli error on stdin + stdout, as detected by Alexey Spiridonov 
Added : relevant test case
 2016-04-10 20:40:26 +02:00
Yann Collet
ccbba296e1 Fix infinite loop with invalid data (fuzzer test) 2016-04-10 14:42:26 +02:00
Yann Collet
4d008083e6 fixed fullbench link stage 2016-04-09 17:38:53 +02:00
Yann Collet
9990986bdc fixed minor warnings when compiling with gcc -g (aka -std=gnu90) 2016-04-09 16:17:18 +02:00
Yann Collet
029267ab3f Integrated Legacy v0.5.x decoder (provided by @inikep) 2016-04-09 09:42:27 +02:00
Yann Collet
1fce6e0baa Fixed : minor variable isolation 2016-04-08 20:26:33 +02:00
inikep
1eeddde625 clock() is default timer for all platforms except Windows 2016-04-08 16:55:17 +02:00
Yann Collet
ea63bb7b5e converted fuzzer timer to clock_t 2016-04-08 15:25:32 +02:00
Yann Collet
72cc704514 Merge branch 'dev060' of github.com:Cyan4973/zstd into dev060 2016-04-08 02:02:31 +02:00
Yann Collet
0dbf2874ee faster level 1 at 256 KB 2016-04-08 02:02:12 +02:00
Yann Collet
04a4fd638b Merge pull request #164 from inikep/dev 
only repcode 0 for lazy, lazy2 and btlazy2 strategies
 2016-04-07 20:46:13 +02:00
Yann Collet
9e8b09a7bd Fixed memory initialization issue, reported by Maciej Adamczyk 2016-04-07 19:35:23 +02:00
inikep
64d7bcb0dc only repcode 0 for lazy, lazy2 and btlazy2 strategies 2016-04-07 19:14:09 +02:00
inikep
e47f33f980 reordered code 2016-04-06 20:58:00 +02:00
inikep
5ce00aee37 ZSTD_compressBlock_opt_extDict_generic in progress 2016-04-05 21:03:43 +02:00
inikep
0c7456c5b7 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_static.h
 2016-04-04 14:54:53 +02:00
Yann Collet
8a57b928ba changed contentLog -> chainLog 2016-04-04 13:49:18 +02:00
inikep
19bd48f516 Merge from Cyan4973/dev060 2016-04-04 12:10:00 +02:00
Yann Collet
1535414927 Fixed 32-bits windowLog limitation 
Fixed some macro errors in zbufftest
 2016-04-04 04:22:53 +02:00
Yann Collet
9bf7016627 minor variable isolation 2016-04-04 03:01:15 +02:00
Yann Collet
fd265ca518 minor cli correction (arguments are const char*) 2016-04-04 02:48:55 +02:00
Yann Collet
38461085d8 code refactorization, for better clarity and reliability 2016-04-04 02:47:20 +02:00
Yann Collet
541cf1993f minor variable isolation 2016-04-04 01:49:30 +02:00
Yann Collet
15bc943201 stronger zbuff synchronization tests 2016-04-04 01:22:26 +02:00
Yann Collet
fe56eb9408 removed unwanted files 2016-04-02 00:21:55 +02:00
Yann Collet
efb18309ef fixed minor visual 32-64bits conversion warning 2016-04-01 18:54:13 +02:00
Yann Collet
27caf2afca minor variable isolation 2016-04-01 15:48:48 +02:00
Yann Collet
51d500425f fixed paramgrill 2016-03-30 20:42:19 +02:00
Yann Collet
3b71925c2d separate params into compressionParams and frameParams 2016-03-30 19:48:05 +02:00
inikep
1c556a3838 ticksPerSecond=0 2016-03-30 10:59:48 +02:00
inikep
33ad251236 removed clock_gettime (not portable) 2016-03-30 09:55:37 +02:00
inikep
4611d11fea added -lrt required by clock_gettime 2016-03-29 15:52:38 +02:00
inikep
4c12f232ec support for QueryPerformanceCounter and clock_gettime 2016-03-29 14:52:13 +02:00
inikep
06f793a3ab fix for BMK_clockSpan on Windows 2016-03-29 11:17:58 +02:00
Yann Collet
b44be74244 Fixed zdict 
more dictionary compression tests
 2016-03-26 20:52:14 +01:00
Yann Collet
b9151406de fixed 32-bits compatibility 2016-03-26 17:18:11 +01:00
Yann Collet
a5b66e34c7 minor variable isolation 
and remove a goto
 2016-03-26 01:48:27 +01:00
Yann Collet
b58c685cf7 fixed : fullbench link to deprecate function (wrong prototype) 2016-03-25 20:29:35 +01:00
inikep
5553442376 fixed compilation with ZSTD_NOBENCH 2016-03-25 13:35:33 +01:00
Yann Collet
7cbe79ab25 fixed write overflow found by fuzzer 2016-03-23 22:31:57 +01:00
inikep
eaba91a161 added ZSTD_compressBegin_targetSrcSize 2016-03-23 20:30:26 +01:00
inikep
7adceef974 hashLog3 added to ZSTD_CCtx 2016-03-23 15:53:38 +01:00
inikep
472638c861 added mili_sleep and setHighPriority 2016-03-23 12:28:28 +01:00
Yann Collet
fd69225086 bench : added HIGH_PRIORTY 2016-03-23 02:47:33 +01:00
Yann Collet
be391438ff first working version with both encoder and decode alternate LL + ML coding scheme. 
decompression speed highly impacted
 2016-03-22 23:19:28 +01:00
inikep
2872b6f01f Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 
# Conflicts:
#	lib/zstd_compress.c
#	programs/bench.c
 2016-03-22 14:38:34 +01:00
Yann Collet
fadda6c875 first prototype with ML encoding scheme (but not yet decoding scheme) 2016-03-22 12:14:26 +01:00
Yann Collet
1dcf930f72 Merge branch 'dev060' into alternateLLcode 2016-03-22 00:29:57 +01:00
Yann Collet
5a854af006 Fixed #153, reported by @thatsafunnyname 2016-03-22 00:22:50 +01:00
Yann Collet
5c71491a46 first working version with alternate LL codes 2016-03-21 02:23:34 +01:00
Yann Collet
6c62b7dfc8 support default LL distribution 2016-03-21 00:39:19 +01:00
Yann Collet
d64f435f63 handles litLength >= 65535 2016-03-21 00:07:42 +01:00
Yann Collet
597847a2ae first emulation 2016-03-20 19:14:22 +01:00
Yann Collet
ecabfe3777 Improved index overflow protection 2016-03-20 16:20:06 +01:00
Yann Collet
de406eebcd minor code refactor 2016-03-20 15:46:10 +01:00