Yann Collet
209df52ba2
Changed nbThreads for nbWorkers
...
This makes it easier to explain that nbWorkers=0 --> single-threaded mode,
while nbWorkers=1 --> asynchronous mode (one mode thread on top of the "main" caller thread).
No need for an additional asynchronous mode flag.
nbWorkers>=2 works the same as nbThreads>=2 previously.
2018-02-01 19:29:30 -08:00
Nick Terrell
4680e85bdf
Allow -o with multiple files
2017-12-13 17:44:34 -08:00
Stella Lau
eb3327c10a
Merge branch 'dev' of https://github.com/facebook/zstd into ldm-mergeDev
2017-09-11 15:00:01 -07:00
Yann Collet
3128e03be6
updated license header
...
to clarify dual-license meaning as "or"
2017-09-08 00:09:23 -07:00
Stella Lau
67d4a6161c
Add ldmBucketSizeLog param
2017-09-02 21:55:29 -07:00
Stella Lau
a1f04d518d
Move hashEveryLog to cctxParams and update cli
2017-09-01 15:05:47 -07:00
Stella Lau
17d8e0bdcc
Merge remote-tracking branch 'upstream/longRangeMatcher' into ldm-integrate
2017-09-01 10:19:38 -07:00
Stella Lau
6a546efb8c
Add long distance matcher
...
Move last literals section to ZSTD_block_internal
2017-08-31 12:53:19 -07:00
Yann Collet
32fb407c9d
updated a bunch of headers
...
for the new license
2017-08-18 16:52:05 -07:00
Paul Cruz
bda57754a2
moved signifcant operations to fileio.c
2017-06-20 12:43:10 -07:00
Paul Cruz
0f06f4f266
added display for compressed size
2017-06-06 09:21:42 -07:00
Paul Cruz
901435e9ef
setup basic functions for adding --list functionality
2017-06-05 14:45:31 -07:00
Sean Purcell
4de8632957
Add LZ4 compress/decompress support to CLI
2017-04-24 16:48:25 -07:00
Nick Terrell
aa8bcf360f
Add xz and lzma support.
...
Finish feature started by @inikep.
* Add xz and lzma compression and decompression support to target `xzstd`.
* Fix bug in gzip decompression that silently accepted truncated files.
* Add gzip frame composition tests.
* Add xz/lzma compatibility tests.
* Add xz/lzma frame composition tests.
2017-03-13 18:45:41 -07:00
Przemyslaw Skibinski
98509a70ac
fixed function name
2017-02-14 09:23:32 +01:00
Przemyslaw Skibinski
cfd4dc299a
add "--format=gzip" option
2017-02-08 15:17:55 +01:00
Yann Collet
6be2337c26
added command --block-size=
...
for Multi-threading only.
alias : -B#
2017-01-30 11:17:26 -08:00
Yann Collet
8dafb1acf5
CLI : automatically set overlap size to max (windowSize) for max compression level
2017-01-25 17:01:13 -08:00
Yann Collet
512cbe8c10
zstdmt cli and API allow selection of section sizes
...
By default, section sizes are 4x window size.
This new setting allow manual selection of section sizes.
The larger they are, the (slightly) better the compression ratio,
but also the higher the memory allocation cost,
and eventually the lesser the nb of possible threads,
since each section is compressed by a single thread.
It also introduces a prototype to set generic parameters,
ZSTDMT_setMTCtxParameter()
The idea is that it's possible to add enums
to extend the list of parameters that can be set this way.
This is more long-term oriented than a fixed-size struct.
Consider it as a test.
2017-01-24 17:08:53 -08:00
Yann Collet
500014af49
zstd cli can now compress using multi-threading
...
added : command -T#
added : ZSTD_resetCStream() (zstdmt_compress)
added : FIO_setNbThreads() (fileio)
2017-01-19 17:04:28 -08:00
Przemyslaw Skibinski
8349d675e0
fileio.c: support advanced compression parameters
2016-12-13 13:24:59 +01:00
Yann Collet
743b33f57e
fix zstdcat
2016-12-02 15:18:57 -08:00
Przemyslaw Skibinski
d0815583d9
Changed stdinmark and stdoutmark
2016-11-04 11:37:27 +01:00
Yann Collet
d4cda27b63
new command -M#, to limit memory usage during decompression ( #403 )
2016-10-14 13:32:20 -07:00
Yann Collet
a6bdf55759
fixed memory leak
2016-09-15 17:02:06 +02:00
Yann Collet
43eeea4725
fileio uses ZSTD_resetCStream()
2016-09-15 15:38:44 +02:00
Yann Collet
4ded9e591c
added boilerplate
2016-08-30 11:06:28 -07:00
Yann Collet
b402490546
fixed #260 , reported by @amnilsson
2016-07-26 00:49:47 +02:00
Yann Collet
b09b12ce10
Added command --rm : remove source file after successful de/compression
2016-06-09 23:01:19 +02:00
Yann Collet
87cfbe3e5f
checksum generation can be selected from command line (--checksum)
2016-06-01 19:22:15 +02:00
Yann Collet
6381e99fb2
Added : ability to create compressed frames without dictID
2016-05-31 02:29:45 +02:00
Yann Collet
75424d1139
Added : Sparse write support
...
--[no-]sparse command
2016-05-23 16:56:56 +02:00
Yann Collet
8a1d1a6a6c
implemented --ultra mode protection
2016-03-10 21:02:25 +01:00
Yann Collet
accfd80c37
Added : option -t to test compressed files integrity
2016-02-15 19:33:16 +01:00
Yann Collet
f062436fa6
cli : added ability to compress multiple files into stdout (-c)
2016-02-12 15:56:46 +01:00
Yann Collet
883a67eee2
fixed cmake
2016-02-12 03:50:05 +01:00
Yann Collet
c8da2c9f8f
updated tests
2016-02-12 02:56:27 +01:00
Yann Collet
deb078b9b1
added : -m : decompress multiple files
2015-12-17 20:30:14 +01:00
Yann Collet
9d90922d49
refactored file compression
2015-12-17 14:09:55 +01:00
Yann Collet
4f13703b2f
added : -m : compress multiple files in a single command
2015-12-17 02:23:58 +01:00
Yann Collet
f6f3d7526a
external dictionary capability added to command line
2015-12-13 13:35:21 +01:00
Yann Collet
2acb5d3d48
HC modes can be selected from command line
2015-10-29 16:49:43 +01:00
Yann Collet
f3eca25322
quick first zstdhc version
2015-10-22 15:31:46 +01:00
Yann Collet
439eb77088
Normalize all the line endings
2015-01-31 10:52:59 +01:00
Yann Collet
04d8e15e57
fixed : file permissions
2015-01-24 11:22:13 +01:00
Yann Collet
4856a00164
Initial release
2015-01-24 01:58:16 +01:00
