Commit Graph

584 Commits

Author SHA1 Message Date
inikep
4f7f79ef9d fixed update of nextToUpdate 2016-03-07 16:14:58 +01:00
inikep
e2446b0e36 added support for MINMATCH=3 on big endian architecture
changed ZSTD_HASHLOG3_MIN to 2 (4 bytes for MINMACH > 3)
2016-03-07 10:07:08 +01:00
inikep
89c9e1a847 added missing "case 3:" in ZSTD_BtGetAllMatches 2016-03-06 23:21:52 +01:00
Yann Collet
1df2594bfe new compression level scale for <= 16KB 2016-03-05 18:43:21 +01:00
inikep
01060bc477 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
2016-03-04 20:10:09 +01:00
inikep
f3c6503e55 resolve conflict in zstd_internal.h 2016-03-04 20:04:25 +01:00
inikep
e29caf7d1c code cleanup 2016-03-04 19:52:23 +01:00
inikep
805d2a7465 removed zstd_opt_internal.h 2016-03-04 19:31:57 +01:00
Yann Collet
944d0d2285 updated fse version 2016-03-04 19:26:59 +01:00
inikep
4ab9c913a5 MEM_readMINMATCH replaced with inline function 2016-03-04 19:17:31 +01:00
Yann Collet
4c01580362 finer searchLength validation 2016-03-04 17:07:54 +01:00
Yann Collet
d409db68d3 Support for nbSeq > 32767
tamed -Wstrict-aliasing warning
2016-03-04 14:45:31 +01:00
Yann Collet
1435335342 Merge pull request #138 from inikep/dev
reduce stack usage with optimal parsing mode
2016-03-03 02:08:34 +01:00
inikep
5cccd77c55 fix clang -Wcast-align warning (part 2) 2016-03-02 20:37:49 +01:00
inikep
51bb9a0064 fix clang -Wcast-align warning 2016-03-02 19:17:13 +01:00
inikep
87d4f3daa4 priceTable moved to heap 2016-03-02 15:56:24 +01:00
inikep
338533f741 improved price function initialization 2016-03-02 14:36:41 +01:00
Yann Collet
a997654670 Merge pull request #136 from inikep/dev
merging mml3 mode
2016-03-01 17:31:03 +01:00
inikep
a4dde25498 fixed repcode before lowLimit 2016-03-01 14:14:35 +01:00
inikep
2d55563b92 better logs 2016-02-29 22:07:40 +01:00
inikep
f647d99d61 fixed bug with 3 or more succesive rep codes 2016-02-29 12:33:08 +01:00
inikep
f414647c6b fixed ZSTD_copyCCtx 2016-02-25 22:31:07 +01:00
inikep
59493e8669 fixed paramgrill 2016-02-25 19:15:08 +01:00
inikep
afa9c9f5ab turn off RTF optimization 2016-02-25 16:47:57 +01:00
Yann Collet
ee0229287c changed version to v0.6.0 2016-02-25 14:53:35 +01:00
inikep
02137f8c42 more accurate gain function 2016-02-24 18:09:36 +01:00
inikep
ee55628c9d combined price function 2016-02-24 14:40:30 +01:00
Yann Collet
3152a8c87a finer dictionary completion 2016-02-23 21:28:59 +01:00
inikep
4a981f7937 improved ZSTD_GETPRICE 2016-02-23 19:08:20 +01:00
inikep
e0010e9baf priceFunc 2016-02-23 16:25:04 +01:00
inikep
15174b0cfb statistics of encoded sequences 2016-02-23 12:41:56 +01:00
inikep
9f754d23dc dummy levels 22-25 2016-02-22 17:00:04 +01:00
inikep
6b3739c8e5 MINMATCH=3 or 4 selected in ZSTD frame 2016-02-22 15:53:42 +01:00
inikep
84f43e2359 support for searchLength from 3 to 7 for optimal parser 2016-02-22 11:34:07 +01:00
inikep
c950b78ce2 removed backward match extension 2016-02-22 10:11:39 +01:00
inikep
d3b8d7a4e5 removed ZSTD_opt parser 2016-02-22 10:06:17 +01:00
inikep
6291c54006 litlen bounded to 128 bytes 2016-02-19 18:24:14 +01:00
Yann Collet
f8482131d7 better compatibility with Visual <= 2012 2016-02-19 17:33:43 +01:00
Yann Collet
191b52a8dc silence array subscript warning 2016-02-19 15:16:15 +01:00
inikep
fcafb26b2e speed optimiaztions 2016-02-19 11:59:44 +01:00
inikep
c3a9a9ca56 ZSTD_rescaleFreqs and removed minml 2016-02-19 11:05:25 +01:00
inikep
cc52a97214 added hashLog3 2016-02-19 10:09:35 +01:00
Yann Collet
4c64d51425 modified level 18 2016-02-18 01:01:42 +01:00
Yann Collet
d56a4192f6 Added : README within /lib directory, to help file selection 2016-02-17 17:47:29 +01:00
Yann Collet
6062b15a07 performance fix for hash chain mode 2016-02-16 17:41:03 +01:00
Yann Collet
accfd80c37 Added : option -t to test compressed files integrity 2016-02-15 19:33:16 +01:00
Yann Collet
0068be94d8 Faster literals cost evaluation (suggested by @inikep) 2016-02-15 18:42:13 +01:00
Yann Collet
e93add0439 Removed if (matchIndex >= current) return 0; as recommended by @inikep 2016-02-15 17:44:14 +01:00
Yann Collet
b8a6f6824b refactored fix to be more generic and applicable to both btlazy2 and btopt 2016-02-15 17:06:29 +01:00
Yann Collet
b37e0a9241 performance tweak : bt search w/ long repeated segments 2016-02-15 14:07:07 +01:00
Yann Collet
cefef8cde7 Change : zstd_opt_bt => zstd_btopt 2016-02-15 07:21:54 +01:00
Yann Collet
0d78a33374 updated CLevel confs for 256K 2016-02-15 06:49:09 +01:00
Yann Collet
422fd563f3 modified : compression Levels for blocks <= 16KB 2016-02-13 15:07:24 +01:00
Yann Collet
38fba56483 Changed compression level settings 2016-02-13 11:20:23 +01:00
Yann Collet
e8bd73df80 Fixed : error when compressing one file 2016-02-13 03:09:48 +01:00
Yann Collet
23e8aee224 Introduced new compression level settings
Changed position of parameter TargetLength
2016-02-13 02:08:46 +01:00
Yann Collet
82f4d7da03 Fixed Visual solution 2016-02-12 22:04:49 +01:00
Yann Collet
6f3acbac0d notificationLevel into ZDICT_param_t 2016-02-12 20:19:48 +01:00
Yann Collet
09ab681328 fixed libzstd install 2016-02-12 19:00:30 +01:00
Yann Collet
62ae5fb0d2 zstd_buffered => zbuff 2016-02-12 18:59:11 +01:00
Yann Collet
f4c9d75370 dictBuilder => zdict 2016-02-12 18:45:02 +01:00
Yann Collet
f062436fa6 cli : added ability to compress multiple files into stdout (-c) 2016-02-12 15:56:46 +01:00
Yann Collet
71eafdd23f Integrated dictionary builder into zstd cli 2016-02-12 02:31:57 +01:00
Yann Collet
fb92a78ac1 Fixed clang warnings 2016-02-12 00:32:38 +01:00
Yann Collet
7d36028078 Integrate dictBuilder into libzstd 2016-02-12 00:10:25 +01:00
Yann Collet
82260ddd8a fixed asan read error in ZSTD_HcGetAllMatches 2016-02-11 07:14:25 +01:00
Yann Collet
04b12d8bcb paramgrill can select manually targetLength
new compression levels
2016-02-11 06:23:24 +01:00
Yann Collet
bd828d9cd1 changed : sufficientLength => targetLength 2016-02-11 04:38:55 +01:00
Yann Collet
4488661678 minor cosmetics 2016-02-11 04:17:50 +01:00
Yann Collet
490aa68b18 restored fast zstd_opt variant 2016-02-10 17:18:24 +01:00
Yann Collet
b79a0b34f3 paramgrill supports sufficientLength
stronger variation for ZSTD_opt
2016-02-10 17:07:37 +01:00
Yann Collet
62ae262771 restored currentMl>0 condition, as suggested by @inikep 2016-02-10 15:44:07 +01:00
Yann Collet
3b63f7fbb0 change zstd_opt.c into zstd_opt.h, since it's included 2016-02-10 15:05:12 +01:00
Yann Collet
0db4115f35 fixed debug print macros on Windows 2016-02-10 14:50:22 +01:00
Yann Collet
2f94d2f166 minor refactor 2016-02-10 14:26:30 +01:00
Yann Collet
768c6bc705 fix : inlining difficulties with gcc 4.6 (travis) 2016-02-10 14:01:49 +01:00
Yann Collet
70e8c389f1 Refactoring for portability 2016-02-10 13:37:52 +01:00
Yann Collet
302177a0c8 Merge pull request #125 from inikep/dev
Dev
2016-02-10 00:57:00 +01:00
inikep
ce6730a740 fix for ZSTD_HcGetAllMatches_generic 2016-02-09 23:26:30 +01:00
inikep
be77f3342d Revert "Revert "ZSTD_compressBlock_opt_extDict_generic""
This reverts commit 2b714dfd26.
2016-02-09 23:00:41 +01:00
inikep
2b714dfd26 Revert "ZSTD_compressBlock_opt_extDict_generic"
This reverts commit b498fc1c99.
2016-02-09 22:47:51 +01:00
inikep
b498fc1c99 ZSTD_compressBlock_opt_extDict_generic 2016-02-09 22:23:48 +01:00
inikep
e75621f98d dumpsEnd 2016-02-09 21:12:23 +01:00
inikep
31314ae0d1 int to U32 2016-02-09 20:47:39 +01:00
Yann Collet
6bff748e43 Fixed minor warnings in legacy modes 2016-02-09 17:55:01 +01:00
Yann Collet
4f0a3931c8 added missing patches 2016-02-07 04:00:27 +01:00
inikep
da730ff092 a bugfix for backward matches 2016-02-06 15:18:26 +01:00
inikep
dbade7c263 remove ZSTD_compressBlock_opt2_generic 2016-02-05 20:29:31 +01:00
inikep
f2fee4c316 added params.sufficientLength 2016-02-05 19:45:25 +01:00
inikep
5b0749715d backward match extension 2016-02-05 19:25:40 +01:00
inikep
2712b69582 Merge remote-tracking branch 'refs/remotes/origin/v05x' into dev 2016-02-05 09:22:10 +01:00
inikep
3379c5df36 ZSTD_OPT_DEBUG 2016-02-05 09:21:20 +01:00
inikep
f967753bc2 ssize_t -> int 2016-02-05 09:07:22 +01:00
Yann Collet
982ffc773d changed enum type name to ZSTD_ErrorCode 2016-02-05 02:33:10 +01:00
inikep
55a444764b sufficient_len = 32 2016-02-04 22:22:47 +01:00
inikep
34608aaa29 ssize_t 2016-02-04 22:18:02 +01:00
inikep
17712afdbc Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into v05x 2016-02-04 21:49:45 +01:00
inikep
b3df71e538 code cleaning 2016-02-04 21:45:26 +01:00
inikep
4fa4098628 last match will start at a minimum distance of 8 from oend 2016-02-04 21:16:07 +01:00
inikep
08f500ca10 cur_min 2016-02-04 20:53:54 +01:00
inikep
6f07186745 clean code 2016-02-04 17:57:50 +01:00
inikep
59c9146258 40099096 2016-02-04 17:48:33 +01:00
inikep
baff8d6c1f gitignore 2016-02-04 16:02:05 +01:00
inikep
40dd4739e3 removed llen 2016-02-04 15:52:35 +01:00
inikep
c9483f0982 clean code 2016-02-04 15:28:55 +01:00
Yann Collet
953ce72f4a minor comments refactoring 2016-02-04 15:28:14 +01:00
inikep
158677c16a new copy rep 2016-02-04 15:25:37 +01:00
inikep
d1ff7bf89a cur_rep 2016-02-04 14:57:11 +01:00
inikep
eb72f5992a i != litlen 2016-02-04 14:55:23 +01:00
inikep
997fb064a6 anchor 2016-02-04 13:01:56 +01:00
inikep
75be1a412c fixes 2016-02-04 11:48:06 +01:00
inikep
cb5cd16d6b 40392170 integer 2016-02-04 11:19:06 +01:00
inikep
27e1c6a51f ZSTD_resetFreqs 2016-02-04 11:11:08 +01:00
inikep
4196923dc9 40370570 ZSTD_getPriceReal 2016-02-04 10:04:33 +01:00
inikep
70b054559b MaxLit 2016-02-03 22:56:55 +01:00
inikep
a98149df59 ZSTD_getLiteralPrice 2 2016-02-03 21:26:18 +01:00
inikep
dbbedfbd95 ZSTD_getLiteralPrice 2016-02-03 19:53:29 +01:00
inikep
892776efd6 ZSTD_get_price2 2016-02-03 19:27:44 +01:00
inikep
1292509987 ZSTD_get_price 2016-02-03 19:13:28 +01:00
inikep
749460d9ab ZSTD_updatePrice 2016-02-03 19:08:48 +01:00
inikep
3bfcfc7bb0 ZSTD_updatePrice 2016-02-03 18:47:30 +01:00
inikep
53721f134c Merge remote-tracking branch 'refs/remotes/Cyan4973/v05x' into v05x
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_static.h
2016-02-03 17:29:40 +01:00
inikep
78e5ea3a32 ZSTD_getPrice 2016-02-03 17:25:42 +01:00
inikep
d02506c186 40699855 2016-02-03 16:54:23 +01:00
inikep
85cc6b509b minml 2016-02-03 15:58:08 +01:00
inikep
7f6680e658 clean some code 2016-02-03 13:30:34 +01:00
inikep
4cb2009821 40901629 2016-02-03 13:25:34 +01:00
inikep
1b8b1f9d53 auto check of matches 2016-02-03 13:17:28 +01:00
inikep
e9f30eae4b 40970636 2016-02-03 12:53:07 +01:00
Yann Collet
b010b3b627 Fixed decoding error (afl) 2016-02-03 12:39:34 +01:00
Yann Collet
72bff50ecf Updated error API, following suggestions by @nemequ (#116) 2016-02-03 12:06:24 +01:00
Yann Collet
ae7aa06650 lots of minor refactorings 2016-02-03 02:46:46 +01:00
Yann Collet
7d968c7bdd move _usingDict() to stable API (zstd.h) 2016-02-03 02:11:32 +01:00
Yann Collet
464fa996e9 added v0.4 legacy support 2016-02-03 01:09:46 +01:00
inikep
5391a718a4 fixed 2016-02-03 00:04:14 +01:00
inikep
55bc9a868a 41374379 2016-02-02 19:47:09 +01:00
inikep
5d4131067b update 2016-02-02 17:41:21 +01:00
Yann Collet
7d8e6bddb9 changed long length format 2016-02-02 17:30:37 +01:00
inikep
d6e8cc5f0c 41403384 2016-02-02 16:43:31 +01:00
Yann Collet
7a6343fb1b fixed encoding bugs 2016-02-02 16:00:50 +01:00
inikep
e1b8e53e84 better logging 2016-02-02 15:41:16 +01:00
Yann Collet
2ce4923238 modified buffer management rules 2016-02-02 14:36:49 +01:00
inikep
59140c5480 turn off: last match must start at a minimum distance of 8 from oend 2016-02-02 12:36:09 +01:00
inikep
ef2706ed12 in progress 2016-01-31 15:32:01 +01:00
inikep
6b0715b8fd no "start" 2016-01-31 15:17:50 +01:00
inikep
d4c3e8c595 fixed logs 2016-01-31 14:28:26 +01:00
inikep
c0dc4c361d best_off 2016-01-31 12:36:41 +01:00
inikep
9bfb1a3357 working 2016-01-31 12:17:16 +01:00
inikep
ee4be5e981 ZSTD_compressBlock_opt_generic 2016-01-31 11:57:01 +01:00
inikep
e2bfe2407a GetAllMatches 2016-01-31 11:26:05 +01:00
inikep
c71568fd44 ZSTD_opt 2016-01-31 11:26:04 +01:00
Yann Collet
35f7de52c8 fixed Visual warnings 2016-01-31 02:51:03 +01:00
Yann Collet
61e16ce07c minor optimization for small files 2016-01-31 02:04:15 +01:00
Yann Collet
e93d6ced17 minor compression gain 2016-01-31 00:58:06 +01:00
Yann Collet
fd416f1eaf added : ZSTD_compress_usingPreparedCCtx() 2016-01-30 03:14:15 +01:00
Yann Collet
863ec40f1e minor compression speed improvement 2016-01-28 17:56:33 +01:00
Yann Collet
9cadd0853c add basic tests 2016-01-28 15:39:52 +01:00
Yann Collet
4ddb1f5566 optimized counting of small segments 2016-01-28 03:24:53 +01:00
Yann Collet
fb810d6053 changed dictionary format 2016-01-28 00:21:13 +01:00
Yann Collet
1c8e194297 modified streaming compression API 2016-01-26 16:31:22 +01:00
Yann Collet
7b51a2948f modified streaming decompression API 2016-01-26 15:58:49 +01:00
Yann Collet
b923f65076 introduced dictionary format 2016-01-26 03:14:20 +01:00
Yann Collet
bc4c8aa4b7 fixed new MIN_CBLOCK_SIZE 2016-01-25 17:26:01 +01:00
Yann Collet
3742219b4e fixed decompression bugs 2016-01-25 16:54:05 +01:00
Yann Collet
a1249dc8da fix visual warnings 2016-01-25 04:22:03 +01:00
Yann Collet
afe0709964 stream control 2016-01-25 04:10:46 +01:00
Yann Collet
59d1f79768 variable litblock header size 2016-01-23 19:28:41 +01:00
Yann Collet
a768a301ba fixed VS project 2016-01-21 16:04:35 +01:00
Yann Collet
ffec740d37 fixed visual and clang errors 2016-01-21 15:50:11 +01:00
Yann Collet
977f1f3600 modified error system, following suggestions by @nemequ 2016-01-21 15:38:47 +01:00
Yann Collet
74ce8e812c fixed VS 2015 'ERROR already defined', reported by Rich Geldreich 2016-01-21 14:32:41 +01:00
Yann Collet
7beaa05d81 fixed bt bug 2016-01-21 11:57:45 +01:00
Yann Collet
1840d6af33 bench pay attention to variable block sizes 2016-01-20 15:39:06 +01:00
Yann Collet
fba6aed175 changed : ZSTD_LEGACY_SUPPORT set to 0 by default within zstd_decompress.c (#113) 2016-01-18 12:03:54 +01:00
Yann Collet
a87278a4f0 small compression speed 2016-01-17 00:12:55 +01:00
Yann Collet
3a3b72f25a Implemented ZSTD_HEAPMODE for zstd_decompress.c
Reduce cmake version requirement to 2.8.7
2016-01-11 12:56:11 +01:00
Yann Collet
523b594233 fixed read error 2016-01-09 02:10:40 +01:00
Yann Collet
b012510d9f dictionary with block API 2016-01-09 02:00:10 +01:00
Yann Collet
bf42c8e5d8 block-level API 2016-01-09 01:08:23 +01:00
Yann Collet
c64c100658 fixed : unused variable 2016-01-08 17:54:02 +01:00
Yann Collet
600962711d added duplication tests 2016-01-08 17:27:50 +01:00
Yann Collet
6e1c4c6c65 fixed context copy 2016-01-07 23:07:44 +01:00
Yann Collet
ecd651bd91 added ZSTD_duplicateCCtx() 2016-01-07 15:35:18 +01:00
Yann Collet
494c786a3b fixed outstanding strict aliasing warnings 2016-01-06 12:54:02 +01:00
Yann Collet
1fdd82312d Fixed : strict aliasing warnings in legacy decoders 2016-01-06 12:35:42 +01:00
Yann Collet
218bd31942 minor strict aliasing warning 2016-01-06 02:19:55 +01:00
Yann Collet
3b994cb465 updated fse 2016-01-06 01:58:37 +01:00
Yann Collet
96ffa424eb minor fast mode improvement 2016-01-02 01:16:28 +01:00
Yann Collet
2cc12cb3cb minor refactoring 2016-01-01 07:47:58 +01:00
Yann Collet
1358f91ec4 minor refactoring 2016-01-01 07:29:39 +01:00
Yann Collet
72e84cfd0f minor simplification 2015-12-31 19:08:44 +01:00
Yann Collet
722504c2a0 update version to 0.4.6 2015-12-31 18:32:15 +01:00
Yann Collet
5f9f98768a Makefile version automatically follows zstd.h 2015-12-30 19:52:08 +01:00
Yann Collet
48da164f14 fixed clang warnings 2015-12-29 23:40:02 +01:00
Yann Collet
ee3f4515c1 faster hc mode with repetitive data (experimental) 2015-12-29 22:26:09 +01:00
Yann Collet
d94efbf95c fix fast mode on Windows 2015-12-29 14:29:08 +01:00
Yann Collet
1ac364d60b Merge pull request #99 from KrzysFR/dev
Update version to 0.4.5 in zstdlib resources
2015-12-21 10:19:26 +01:00
Yann Collet
ed73ae8c67 fix #101 2015-12-19 19:51:42 +01:00
Christophe Chevalier
8972f13b4a Added missing ZSTDLIB_API for ZSTD_decompress_usingDict and ZSTD_decompressDCtx 2015-12-18 11:20:37 +01:00
Yann Collet
31683c0b28 benchmark can use dictionary 2015-12-18 01:26:48 +01:00