Commit Graph

3322 Commits

Author SHA1 Message Date
Yann Collet
324c2cd908 Merge branch 'dev' of github.com:facebook/zstd into dev 2017-04-11 14:42:46 -07:00
Yann Collet
0e30059ba1 cli : FIO_createDictBuffer() replaces FIO_loadFile()
makes it more explicit that it allocates a buffer
and that it's meant to be used for dictionary.

Also : simplified function a bit,
now only works for dictionaries up to DICTSIZE_MAX
2017-04-11 14:41:02 -07:00
Sean Purcell
d048fefef7 Move seekable format content to /contrib 2017-04-11 14:38:56 -07:00
Sean Purcell
b13da709e8 Fixes 2017-04-11 14:11:18 -07:00
Sean Purcell
45f3bc4801 Add format specification 2017-04-11 13:53:09 -07:00
Sean Purcell
a3b7c22604 Make seekable streams work w/ small buffers, misc fixes 2017-04-11 13:53:09 -07:00
Sean Purcell
c3ba15e48f Seekable compression demo 2017-04-11 13:53:09 -07:00
Yann Collet
1f72b07cc0 Merge pull request #653 from terrelln/dev
Update linux kernel patch
2017-04-11 13:46:40 -07:00
Nick Terrell
b633377d0e Add BtrFS benchmarks 2017-04-11 12:40:53 -07:00
Yann Collet
4ee6b15dac force contentSizeFlag=0 when using ZSTD_initCStream_usingCDict()
because by definition srcSize is not known when using this prototype.
added relevant test

Note : this use was already working, because at a later stage
(both ZSTD_compressBegin_usingCDict() and ZSTD_copyCCtx())
pledgedSrcSize=0 is translated into "unknown", no matter the frame parameter.
This is not correct, but of little importance,
as the medium term plan is to no longer set fParams within CDict
2017-04-11 11:59:44 -07:00
Nick Terrell
b4dd3378f1 Add BtrFS patch for 4.10 kernel 2017-04-11 11:50:24 -07:00
Yann Collet
ab9162ebb4 simplified call graph
by calling ZSTD_compressBegin_internal() instead of ZSTD_compressBegin_advanced()
2017-04-11 10:46:20 -07:00
Yann Collet
e88034fe26 simplified ZSTD_initCStream*() flow
all variants converge towards ZSTD_initCStream_stage2()
2017-04-10 22:24:02 -07:00
Yann Collet
4b987ad8ce Introduce ZSTD_initCStream_internal()
This is now the regroup point for ZSTD_initCStream*() functions

ZSTD_initCStream_advanced() now properly checks for parameters validity.

Also : added <assert.h> usage inside zstd_compress.c
Needs ZSTD_DEBUG=1 macro to be triggered.
Will be triggered by default from `tests` directory
2017-04-10 17:50:44 -07:00
Nick Terrell
adb1974aec Switch comments to kernel style + limit to 80 cols 2017-04-10 16:52:59 -07:00
Nick Terrell
bed6c0a4b0 Remove ZSTDLIB_API from decompress.c 2017-04-10 14:49:34 -07:00
Yann Collet
1fa3b75369 Merge pull request #648 from facebook/zstdmt
improved zstreamtest --mt to trap bug #644
2017-04-07 06:09:52 -07:00
Yann Collet
97b23a98d9 Merge pull request #650 from iburinoc/ro-overwrite
Make zstd overwrite destination files even when it is read only
2017-04-07 06:09:25 -07:00
Sean Purcell
1652172b2d Add refuse to overwrite test and fix format 2017-04-06 17:06:30 -07:00
Yann Collet
8fd8772efb Merge pull request #649 from iburinoc/win-release
Don't build zstd release binary with debug symbols
2017-04-06 16:53:28 -07:00
Sean Purcell
9da11c6aae Add test for overwriting read-only 2017-04-06 12:58:49 -07:00
Sean Purcell
279be2015b Let zstd overwrite read-only files 2017-04-06 12:56:40 -07:00
Sean Purcell
17c12cbca6 Push both artifacts without debug symbols 2017-04-06 10:34:09 -07:00
Sean Purcell
e128ac096f Don't build zstd release binary with debug symbols 2017-04-06 10:15:32 -07:00
Yann Collet
0181fef545 ensure cctx internal buffer is correctly sized in case of memory error 2017-04-06 01:25:26 -07:00
Yann Collet
36c2a03757 updated comments for ZSTD_resetCStream() 2017-04-05 22:06:21 -07:00
Yann Collet
ce80098f14 improved zstreamtest --mt to trap bug #644 2017-04-05 16:34:09 -07:00
Yann Collet
003a244324 DStream : ensure correct size of internal buffers in case of error 2017-04-05 15:28:56 -07:00
Yann Collet
02d37aa1c1 ensure correct size of internal buffers in case of error 2017-04-05 14:53:51 -07:00
Yann Collet
b5b79b3942 Merge pull request #647 from terrelln/linux
Add linux kernel modules to contrib/
2017-04-05 07:35:48 -07:00
Nick Terrell
9c7371b3ee Improve comments and ordering 2017-04-04 19:02:28 -07:00
Nick Terrell
97693aff98 Add a README 2017-04-04 18:39:22 -07:00
Nick Terrell
7f510a7797 Add Kconfig and Makefile diffs 2017-04-04 18:37:55 -07:00
Yann Collet
d6166ef1c7 Merge pull request #646 from terrelln/dev
Switch call of FSE_count() to FSE_count_wksp()
2017-04-04 18:18:53 -07:00
Nick Terrell
60b34b0d1c fix gitignore 2017-04-04 18:15:21 -07:00
Nick Terrell
bb213798d9 Rename zstd_(de)compress.c to (de)compress.c 2017-04-04 18:09:02 -07:00
Nick Terrell
1b3856463e Undef current if defined 2017-04-04 17:21:49 -07:00
Nick Terrell
c53bacc881 Fix up some old names 2017-04-04 17:03:48 -07:00
Nick Terrell
2e4dbd2105 Really move the makefile 2017-04-04 17:02:28 -07:00
Nick Terrell
5859101396 Move Makefile to lib/zstd 2017-04-04 17:00:12 -07:00
Nick Terrell
d0bbceac40 Add fs/btrfs/zstd.c 2017-04-04 16:56:52 -07:00
Yann Collet
9631e603ae paramgrill : results from optimizer use cli format
Best found configuration is displayed
using documented cli advanced parameter syntax.
2017-04-04 16:54:33 -07:00
Yann Collet
89b32f3db0 fix paramgrill -O#
ensure proposed config does not require more memory than necessary
2017-04-04 16:41:11 -07:00
Nick Terrell
2eb623a6eb Explicitly convert scratchBuffer to unsigned* 2017-04-04 16:38:13 -07:00
Nick Terrell
405d2a1027 Explicitly convert scratchBuffer to unsigned* 2017-04-04 16:35:31 -07:00
Yann Collet
2724f25567 fixed paramgrill -O#
find optimal settings for a minimum speed
2017-04-04 16:31:17 -07:00
Nick Terrell
fd95be0ade Move sources to lib/zstd/ 2017-04-04 16:30:11 -07:00
Nick Terrell
1af700ea43 Remove unused FSE/HUF functions 2017-04-04 16:22:58 -07:00
Nick Terrell
16a739cab0 Switch call of FSE_count() to FSE_count_wksp() 2017-04-04 16:17:21 -07:00
Nick Terrell
dd62829ccf Remove more restrict 2017-04-04 15:55:48 -07:00