Commit Graph

584 Commits

Author SHA1 Message Date
inikep
1269e2f7db working kSlotNew for ZSTD_btopt 2016-03-19 15:32:21 +01:00
Yann Collet
bb604486f1 fixed clang warning 2016-03-19 15:18:42 +01:00
Yann Collet
37f3d1b2ab minor refactor 2016-03-19 15:11:42 +01:00
Yann Collet
90a03a95a1 minor performance fix (decompression) 2016-03-19 14:47:31 +01:00
Yann Collet
01e5b95199 code refactor 2016-03-19 14:14:31 +01:00
Yann Collet
d1d210f3fb minor code refactor 2016-03-19 12:12:07 +01:00
Yann Collet
4db09efde4 simplifications 2016-03-18 22:23:49 +01:00
Yann Collet
39c596ca58 minor simplifications 2016-03-18 21:40:56 +01:00
inikep
fade9b7ae3 ZSTD_btopt with 4 repcodes 2016-03-18 16:10:35 +01:00
inikep
1c1e6916e4 improved timer accuracy 2016-03-18 12:49:44 +01:00
Yann Collet
a910dc8238 minor code refactoring 2016-03-18 12:37:45 +01:00
inikep
5b15865413 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into repcodes
# Conflicts:
#	lib/zstd_decompress.c
#	programs/bench.c
2016-03-18 11:14:58 +01:00
inikep
eca2ec0b3b introduced ZSTD_REP_MOVE and ZSTD_REP_INIT 2016-03-18 11:03:43 +01:00
inikep
c56e32e782 4 repcodes when litLen==0 2016-03-17 19:53:38 +01:00
inikep
3e743052cd kSlotNew 2016-03-17 17:24:17 +01:00
Yann Collet
3fd164e656 minor refactoring 2016-03-17 13:43:32 +01:00
Yann Collet
b40287aaef Improved decompression speed (by @inikep) 2016-03-17 12:11:16 +01:00
inikep
7d1742825b support for ZSTD_REP_NUM == 1 and ZSTD_REP_NUM == 4 2016-03-17 11:21:00 +01:00
inikep
5945308983 working 4 reps 2016-03-16 15:35:14 +01:00
Yann Collet
569b81adb1 changed BLOCKSIZE into ZSTD_BLOCKSIZE_MAX 2016-03-16 15:26:51 +01:00
inikep
62d694795d ZSTD_compressBlock_lazy supports more reps 2016-03-16 12:57:07 +01:00
inikep
0ac4a551b9 ZSTD_REP_NUM removed from ZSTD_storeSeq 2016-03-16 12:03:07 +01:00
inikep
df164e6d35 introduced U32 rep[ZSTD_REP_NUM] 2016-03-16 11:56:59 +01:00
inikep
4569667c85 ZSTD_REP_NUM 2016-03-16 11:40:09 +01:00
Yann Collet
6cb41356e8 update doc / comments 2016-03-15 15:47:38 +01:00
Yann Collet
346bffbc68 Added frame content size test within fuzzer 2016-03-15 15:24:52 +01:00
Yann Collet
09b21ee2f6 fix fileio bug with new zbuff
simplified zbuff decoding
2016-03-15 12:56:03 +01:00
inikep
d700a1a8b9 ZSTD_setAdditionalParam 2016-03-15 12:18:44 +01:00
Yann Collet
1c2c2bcaff minor refactoring 2016-03-15 01:33:36 +01:00
Yann Collet
d1b26849e5 Frame content size supported 2016-03-15 01:24:33 +01:00
inikep
5fdd0b46d3 added additionalParam 2016-03-14 19:51:11 +01:00
Yann Collet
fb7973580f minor comments update 2016-03-13 11:08:40 +01:00
Yann Collet
03ea59b17b Decompression can decode frame content size 2016-03-12 01:25:40 +01:00
Yann Collet
0e491c01fe created ZSTD_frameParams 2016-03-11 21:58:04 +01:00
inikep
cc6c283633 removed hashLog3 from ZSTD_parameters 2016-03-10 15:17:24 +01:00
inikep
260a9e3886 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 2016-03-10 15:04:12 +01:00
inikep
b0c640d934 small ratio improvement with MINMATCH=3 2016-03-10 13:18:36 +01:00
Yann Collet
da5be72fda update compression level parameters 2016-03-10 11:01:44 +01:00
Yann Collet
dcc000f0eb minor doc clarifications 2016-03-10 01:09:41 +01:00
Yann Collet
e3193c4081 update compresson levels 2016-03-09 16:57:09 +01:00
Yann Collet
4f013a2281 Merge pull request #142 from inikep/dev
Dev
2016-03-09 16:29:42 +01:00
inikep
b5a519f43c improved compression speed
introduced cache in ZSTD_setLog2Prices
2016-03-09 15:45:01 +01:00
Yann Collet
95cd0c2e26 frame format can support window sizes up to 128 MB 2016-03-08 18:24:21 +01:00
Yann Collet
ff14b351f5 Merge pull request #141 from inikep/dev
fix update for zstd_opt
2016-03-08 14:41:04 +01:00
Yann Collet
d3a6660ad1 Update clevel table for <= 128K 2016-03-08 14:12:46 +01:00
Yann Collet
2e91dde43e improved memory size evaluation by paramgrill 2016-03-08 12:22:11 +01:00
inikep
48413765b4 fixed update of hashTable for matches with length of 4+ 2016-03-08 11:03:55 +01:00
Yann Collet
dd54bbc184 Fixed large NbSeq > 32 K
Added a test in Fuzzer to check NbSeq > 32 K
2016-03-08 02:35:34 +01:00
Yann Collet
370b08e840 fix compression ratio for blocks <= 16 KB 2016-03-08 00:03:59 +01:00
Yann Collet
fb7ab8b2b8 Merge pull request #140 from inikep/dev
mml3
2016-03-07 18:06:48 +01:00
inikep
4f7f79ef9d fixed update of nextToUpdate 2016-03-07 16:14:58 +01:00
inikep
e2446b0e36 added support for MINMATCH=3 on big endian architecture
changed ZSTD_HASHLOG3_MIN to 2 (4 bytes for MINMACH > 3)
2016-03-07 10:07:08 +01:00
inikep
89c9e1a847 added missing "case 3:" in ZSTD_BtGetAllMatches 2016-03-06 23:21:52 +01:00
Yann Collet
1df2594bfe new compression level scale for <= 16KB 2016-03-05 18:43:21 +01:00
inikep
01060bc477 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
2016-03-04 20:10:09 +01:00
inikep
f3c6503e55 resolve conflict in zstd_internal.h 2016-03-04 20:04:25 +01:00
inikep
e29caf7d1c code cleanup 2016-03-04 19:52:23 +01:00
inikep
805d2a7465 removed zstd_opt_internal.h 2016-03-04 19:31:57 +01:00
Yann Collet
944d0d2285 updated fse version 2016-03-04 19:26:59 +01:00
inikep
4ab9c913a5 MEM_readMINMATCH replaced with inline function 2016-03-04 19:17:31 +01:00
Yann Collet
4c01580362 finer searchLength validation 2016-03-04 17:07:54 +01:00
Yann Collet
d409db68d3 Support for nbSeq > 32767
tamed -Wstrict-aliasing warning
2016-03-04 14:45:31 +01:00
Yann Collet
1435335342 Merge pull request #138 from inikep/dev
reduce stack usage with optimal parsing mode
2016-03-03 02:08:34 +01:00
inikep
5cccd77c55 fix clang -Wcast-align warning (part 2) 2016-03-02 20:37:49 +01:00
inikep
51bb9a0064 fix clang -Wcast-align warning 2016-03-02 19:17:13 +01:00
inikep
87d4f3daa4 priceTable moved to heap 2016-03-02 15:56:24 +01:00
inikep
338533f741 improved price function initialization 2016-03-02 14:36:41 +01:00
Yann Collet
a997654670 Merge pull request #136 from inikep/dev
merging mml3 mode
2016-03-01 17:31:03 +01:00
inikep
a4dde25498 fixed repcode before lowLimit 2016-03-01 14:14:35 +01:00
inikep
2d55563b92 better logs 2016-02-29 22:07:40 +01:00
inikep
f647d99d61 fixed bug with 3 or more succesive rep codes 2016-02-29 12:33:08 +01:00
inikep
f414647c6b fixed ZSTD_copyCCtx 2016-02-25 22:31:07 +01:00
inikep
59493e8669 fixed paramgrill 2016-02-25 19:15:08 +01:00
inikep
afa9c9f5ab turn off RTF optimization 2016-02-25 16:47:57 +01:00
Yann Collet
ee0229287c changed version to v0.6.0 2016-02-25 14:53:35 +01:00
inikep
02137f8c42 more accurate gain function 2016-02-24 18:09:36 +01:00
inikep
ee55628c9d combined price function 2016-02-24 14:40:30 +01:00
Yann Collet
3152a8c87a finer dictionary completion 2016-02-23 21:28:59 +01:00
inikep
4a981f7937 improved ZSTD_GETPRICE 2016-02-23 19:08:20 +01:00
inikep
e0010e9baf priceFunc 2016-02-23 16:25:04 +01:00
inikep
15174b0cfb statistics of encoded sequences 2016-02-23 12:41:56 +01:00
inikep
9f754d23dc dummy levels 22-25 2016-02-22 17:00:04 +01:00
inikep
6b3739c8e5 MINMATCH=3 or 4 selected in ZSTD frame 2016-02-22 15:53:42 +01:00
inikep
84f43e2359 support for searchLength from 3 to 7 for optimal parser 2016-02-22 11:34:07 +01:00
inikep
c950b78ce2 removed backward match extension 2016-02-22 10:11:39 +01:00
inikep
d3b8d7a4e5 removed ZSTD_opt parser 2016-02-22 10:06:17 +01:00
inikep
6291c54006 litlen bounded to 128 bytes 2016-02-19 18:24:14 +01:00
Yann Collet
f8482131d7 better compatibility with Visual <= 2012 2016-02-19 17:33:43 +01:00
Yann Collet
191b52a8dc silence array subscript warning 2016-02-19 15:16:15 +01:00
inikep
fcafb26b2e speed optimiaztions 2016-02-19 11:59:44 +01:00
inikep
c3a9a9ca56 ZSTD_rescaleFreqs and removed minml 2016-02-19 11:05:25 +01:00
inikep
cc52a97214 added hashLog3 2016-02-19 10:09:35 +01:00
Yann Collet
4c64d51425 modified level 18 2016-02-18 01:01:42 +01:00
Yann Collet
d56a4192f6 Added : README within /lib directory, to help file selection 2016-02-17 17:47:29 +01:00
Yann Collet
6062b15a07 performance fix for hash chain mode 2016-02-16 17:41:03 +01:00
Yann Collet
accfd80c37 Added : option -t to test compressed files integrity 2016-02-15 19:33:16 +01:00
Yann Collet
0068be94d8 Faster literals cost evaluation (suggested by @inikep) 2016-02-15 18:42:13 +01:00
Yann Collet
e93add0439 Removed if (matchIndex >= current) return 0; as recommended by @inikep 2016-02-15 17:44:14 +01:00
Yann Collet
b8a6f6824b refactored fix to be more generic and applicable to both btlazy2 and btopt 2016-02-15 17:06:29 +01:00
Yann Collet
b37e0a9241 performance tweak : bt search w/ long repeated segments 2016-02-15 14:07:07 +01:00
Yann Collet
cefef8cde7 Change : zstd_opt_bt => zstd_btopt 2016-02-15 07:21:54 +01:00
Yann Collet
0d78a33374 updated CLevel confs for 256K 2016-02-15 06:49:09 +01:00
Yann Collet
422fd563f3 modified : compression Levels for blocks <= 16KB 2016-02-13 15:07:24 +01:00
Yann Collet
38fba56483 Changed compression level settings 2016-02-13 11:20:23 +01:00
Yann Collet
e8bd73df80 Fixed : error when compressing one file 2016-02-13 03:09:48 +01:00
Yann Collet
23e8aee224 Introduced new compression level settings
Changed position of parameter TargetLength
2016-02-13 02:08:46 +01:00
Yann Collet
82f4d7da03 Fixed Visual solution 2016-02-12 22:04:49 +01:00
Yann Collet
6f3acbac0d notificationLevel into ZDICT_param_t 2016-02-12 20:19:48 +01:00
Yann Collet
09ab681328 fixed libzstd install 2016-02-12 19:00:30 +01:00
Yann Collet
62ae5fb0d2 zstd_buffered => zbuff 2016-02-12 18:59:11 +01:00
Yann Collet
f4c9d75370 dictBuilder => zdict 2016-02-12 18:45:02 +01:00
Yann Collet
f062436fa6 cli : added ability to compress multiple files into stdout (-c) 2016-02-12 15:56:46 +01:00
Yann Collet
71eafdd23f Integrated dictionary builder into zstd cli 2016-02-12 02:31:57 +01:00
Yann Collet
fb92a78ac1 Fixed clang warnings 2016-02-12 00:32:38 +01:00
Yann Collet
7d36028078 Integrate dictBuilder into libzstd 2016-02-12 00:10:25 +01:00
Yann Collet
82260ddd8a fixed asan read error in ZSTD_HcGetAllMatches 2016-02-11 07:14:25 +01:00
Yann Collet
04b12d8bcb paramgrill can select manually targetLength
new compression levels
2016-02-11 06:23:24 +01:00
Yann Collet
bd828d9cd1 changed : sufficientLength => targetLength 2016-02-11 04:38:55 +01:00
Yann Collet
4488661678 minor cosmetics 2016-02-11 04:17:50 +01:00
Yann Collet
490aa68b18 restored fast zstd_opt variant 2016-02-10 17:18:24 +01:00
Yann Collet
b79a0b34f3 paramgrill supports sufficientLength
stronger variation for ZSTD_opt
2016-02-10 17:07:37 +01:00
Yann Collet
62ae262771 restored currentMl>0 condition, as suggested by @inikep 2016-02-10 15:44:07 +01:00
Yann Collet
3b63f7fbb0 change zstd_opt.c into zstd_opt.h, since it's included 2016-02-10 15:05:12 +01:00
Yann Collet
0db4115f35 fixed debug print macros on Windows 2016-02-10 14:50:22 +01:00
Yann Collet
2f94d2f166 minor refactor 2016-02-10 14:26:30 +01:00
Yann Collet
768c6bc705 fix : inlining difficulties with gcc 4.6 (travis) 2016-02-10 14:01:49 +01:00
Yann Collet
70e8c389f1 Refactoring for portability 2016-02-10 13:37:52 +01:00
Yann Collet
302177a0c8 Merge pull request #125 from inikep/dev
Dev
2016-02-10 00:57:00 +01:00
inikep
ce6730a740 fix for ZSTD_HcGetAllMatches_generic 2016-02-09 23:26:30 +01:00
inikep
be77f3342d Revert "Revert "ZSTD_compressBlock_opt_extDict_generic""
This reverts commit 2b714dfd26.
2016-02-09 23:00:41 +01:00
inikep
2b714dfd26 Revert "ZSTD_compressBlock_opt_extDict_generic"
This reverts commit b498fc1c99.
2016-02-09 22:47:51 +01:00
inikep
b498fc1c99 ZSTD_compressBlock_opt_extDict_generic 2016-02-09 22:23:48 +01:00
inikep
e75621f98d dumpsEnd 2016-02-09 21:12:23 +01:00
inikep
31314ae0d1 int to U32 2016-02-09 20:47:39 +01:00
Yann Collet
6bff748e43 Fixed minor warnings in legacy modes 2016-02-09 17:55:01 +01:00
Yann Collet
4f0a3931c8 added missing patches 2016-02-07 04:00:27 +01:00
inikep
da730ff092 a bugfix for backward matches 2016-02-06 15:18:26 +01:00
inikep
dbade7c263 remove ZSTD_compressBlock_opt2_generic 2016-02-05 20:29:31 +01:00
inikep
f2fee4c316 added params.sufficientLength 2016-02-05 19:45:25 +01:00
inikep
5b0749715d backward match extension 2016-02-05 19:25:40 +01:00
inikep
2712b69582 Merge remote-tracking branch 'refs/remotes/origin/v05x' into dev 2016-02-05 09:22:10 +01:00
inikep
3379c5df36 ZSTD_OPT_DEBUG 2016-02-05 09:21:20 +01:00
inikep
f967753bc2 ssize_t -> int 2016-02-05 09:07:22 +01:00
Yann Collet
982ffc773d changed enum type name to ZSTD_ErrorCode 2016-02-05 02:33:10 +01:00
inikep
55a444764b sufficient_len = 32 2016-02-04 22:22:47 +01:00
inikep
34608aaa29 ssize_t 2016-02-04 22:18:02 +01:00
inikep
17712afdbc Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into v05x 2016-02-04 21:49:45 +01:00
inikep
b3df71e538 code cleaning 2016-02-04 21:45:26 +01:00
inikep
4fa4098628 last match will start at a minimum distance of 8 from oend 2016-02-04 21:16:07 +01:00
inikep
08f500ca10 cur_min 2016-02-04 20:53:54 +01:00