Yann Collet
500014af49
zstd cli can now compress using multi-threading
...
added : command -T#
added : ZSTD_resetCStream() (zstdmt_compress)
added : FIO_setNbThreads() (fileio)
2017-01-19 17:04:28 -08:00
Yann Collet
736788f8e8
added streaming fuzzer tests for MT API
...
Also : fixed corner case, where nb of jobs completed becomes > jobQueueSize
which is possible when many flushes are issued
while there is not enough dst buffer to flush completed ones.
2017-01-19 12:15:29 -08:00
Yann Collet
5eb749e734
ZSTDMT_compress() creates a single frame
...
The new strategy involves cutting frame at block level.
The result is a single frame, preserving ZSTD_getDecompressedSize()
As a consequence, bench can now make a full round-trip,
since the result is compatible with ZSTD_decompress().
This strategy will not make it possible to decode the frame with multiple threads
since the exact cut between independent blocks is not known.
MT decoding needs further discussions.
2017-01-11 18:21:25 +01:00
Yann Collet
f1cb55192c
fixed linux warnings
2017-01-02 01:11:55 +01:00
Yann Collet
0ec6a95ba1
minor fixes
2017-01-02 00:49:42 +01:00
Yann Collet
c6a6417458
bench correctly measures time for multi-threaded compression (posix only)
2016-12-31 03:31:26 +01:00
Yann Collet
e70912c72b
Changed : input divided into roughly equal parts.
...
Debug : can measure time waiting for mutexes to unlock.
2016-12-29 01:24:01 +01:00
Yann Collet
ab7a579180
added -T command , to set nb of threads
2016-12-28 16:11:09 +01:00
Yann Collet
3d93f2fce7
first zstdmt sketch
2016-12-27 07:19:36 +01:00
Yann Collet
8333106b8a
Merge branch 'dev' of github.com:facebook/zstd into dev
2016-12-21 16:44:24 +01:00
Yann Collet
1f57c2ed32
added : ZSTD_createCDict_byReference()
2016-12-21 16:20:11 +01:00
Przemyslaw Skibinski
7a8a03c20d
util.h: restore BSD license for Facebook Open-Source
2016-12-21 15:08:44 +01:00
Przemyslaw Skibinski
e679741b18
_CRT_SECURE_NO_WARNINGS moved to util.h
2016-12-21 13:47:11 +01:00
Przemyslaw Skibinski
2f6ccee6af
platform.h: removed Compiler Options
2016-12-21 13:23:34 +01:00
Przemyslaw Skibinski
16ae6563a2
executables use new util.h and platform.h
2016-12-21 09:06:14 +01:00
Przemyslaw Skibinski
f8046b8e72
Merge remote-tracking branch 'refs/remotes/facebook/dev' into v112
...
# Conflicts:
# appveyor.yml
2016-12-19 08:20:26 +01:00
Przemyslaw Skibinski
b866e72826
tools use platform.h
2016-12-16 14:24:01 +01:00
Przemyslaw Skibinski
c71e552b2e
fixed "strategy" in advanced compression parameters
2016-12-13 20:04:32 +01:00
Przemyslaw Skibinski
897b8bb5eb
bench.c: support advanced compression parameters
2016-12-13 13:03:41 +01:00
Yann Collet
e63c631aaf
decode benchmark, multi-files
2016-12-06 17:46:49 -08:00
Yann Collet
d946501d2c
decode benchmark - single file (hidden option)
2016-12-06 16:49:23 -08:00
Yann Collet
167c494748
Merge branch 'dev' of github.com:facebook/zstd into dev
2016-11-29 14:05:15 -08:00
Yann Collet
4f5350f610
long matches support overflow
2016-11-29 13:12:24 -08:00
Przemyslaw Skibinski
fd0ac93024
bench.c: use ZSTD_maxCLevel()
2016-11-23 21:45:29 +01:00
Przemyslaw Skibinski
5ddcd9d9ae
bench.c: fixed MAX_CLEVEL
2016-11-21 16:37:56 +01:00
Przemyslaw Skibinski
2558b4cdbc
bench.c without dict uses ZSTD_compressCCtx
2016-11-18 11:46:30 +01:00
Przemyslaw Skibinski
26306fcacf
BMK_SetNbIterations renamed to BMK_SetNbSeconds
2016-11-03 11:38:01 +01:00
Yann Collet
7ae67bb18a
small compression speed gains with using_CDict
2016-09-06 06:28:05 +02:00
Yann Collet
4ded9e591c
added boilerplate
2016-08-30 11:06:28 -07:00
Yann Collet
87c18b2ebd
fixed multiple minor warnings for XCode
2016-08-26 01:43:47 +02:00
Yann Collet
0baa64a763
increased maximum memory size for 64-bits bench to 16 GB
2016-08-25 22:54:13 +02:00
Yann Collet
d1733f7417
fixed crc bug in rare timing conditions within bench.c
2016-08-21 01:04:46 +02:00
inikep
5a54870047
fixed Intel Compiler warnings with Visual Studio
...
http://encode.ru/threads/2119-Zstandard?p=49504&viewfull=1#post49504
2016-08-18 09:00:25 +02:00
inikep
7132fb15ba
bench.c: removed benchResult_t
2016-08-10 14:59:18 +02:00
Yann Collet
6a21971f4a
bench : implemented avgSize
2016-08-03 00:06:24 +02:00
Yann Collet
bf2bc112bb
bench : controlled display update when loading lot of files
2016-08-02 23:48:13 +02:00
Yann Collet
de4c04f6c2
Fixed : ZSTD_compress* can compress > 4 GB in a single pass, reported by Nick Terrell
2016-08-02 11:27:05 +02:00
Yann Collet
a9febe81ae
changed bench behavior for slow compression levels
2016-08-01 13:40:52 +02:00
Yann Collet
235911e13f
removed "avg" evaluation from bench -q
...
removed "sleeping" notification from bench -q
2016-07-31 01:32:48 +02:00
Yann Collet
3c242e79d3
updated compression levels table
2016-07-13 14:56:24 +02:00
Yann Collet
3d2cd7f816
Introduced ZSTD_getParams()
...
bench now uses ZSTD_createCDict_advanced()
2016-06-27 15:12:26 +02:00
Yann Collet
ec224d256d
removed useless context
2016-06-27 13:39:30 +02:00
Yann Collet
4c56f4a3cf
fixed error messages
2016-06-27 13:36:54 +02:00
inikep
d7d251ccb5
bench.c: added support for ZSTD_GIT_COMMIT
2016-06-22 16:13:25 +02:00
inikep
f2f59d758e
test-zstd-speed.py: added ZSTD_GIT_COMMIT
2016-06-22 15:42:26 +02:00
inikep
9bf5357101
bench.c: use ZSTD_VERSION_STRING
2016-06-21 11:01:29 +02:00
Yann Collet
ee1a084852
Integrated new dictionary API into bench module
2016-06-07 01:40:49 +02:00
Yann Collet
2cc72f1fd3
fixed initialization issue in bench
2016-06-06 17:50:07 +02:00
Yann Collet
d3b7f8d21f
Merged zstd_static.h into zstd.h . Now requires ZSTD_STATIC_LINKING_ONLY macro
2016-06-04 19:47:02 +02:00
Yann Collet
70d1301d6e
Changed ZSTD_adjustCParams() prototype
...
`ZSTD_adjustCParams()` is now automatically invoked at the end of `ZSTD_getCParams()`
2016-06-01 18:45:34 +02:00
