Yann Collet
cc3d1bc262
Merge pull request #525 from terrelln/covermt
...
Multithreaded COVER dictionary training
2017-01-30 10:15:33 -08:00
Yann Collet
4fd0fffdea
Merge pull request #523 from terrelln/buck
...
Add BUCK files for Nuclide integration
2017-01-28 19:17:58 -08:00
Nick Terrell
43474313f8
Fix documentation about memory usage
2017-01-27 18:43:05 -08:00
Nick Terrell
90db3afdee
Fix typos in VS2010 build config
2017-01-27 17:32:16 -08:00
Yann Collet
64bf8ffce6
report @terrelln patch to ST fuzzer tests
2017-01-27 17:25:07 -08:00
Yann Collet
716ea3b361
Merge pull request #524 from terrelln/asan-failure
...
Fix segfault in zstreamtest MT
2017-01-27 16:50:16 -08:00
Nick Terrell
b42dd27ef5
Add include guards and extern C
2017-01-27 16:00:19 -08:00
Nick Terrell
d98bf49224
Fix segfault in zstreamtest MT
...
It was reading beyond the end of the input buffer because no errors were
detected. Once that was fixed, it wasn't making forward progress because
no errors were detected and it was waiting for input.
2017-01-27 15:42:36 -08:00
Nick Terrell
6570167f8b
Fix VS fuzzer build configs
2017-01-27 13:56:41 -08:00
Nick Terrell
5cf84a05e7
Revert unnecessary change to Logging.h
2017-01-27 13:26:44 -08:00
Nick Terrell
8959910412
Add threading and pool to build configs
2017-01-27 12:29:27 -08:00
Yann Collet
20bed4210c
changed format specification version number
2017-01-27 12:16:16 -08:00
Nick Terrell
c43c27127f
Merge branch 'dev' into buck
...
* dev:
updated NEWS
fixed MSAN warnings in legacy decoders
Fix cmake build
updated NEWS
Edits as per comments, and change wildcard 'X' to '?'
Fix Visual Studios project
Fix pool.c threading.h import
Fix zstdmt_compress.h include
Fixed commented issues
Updated format specification to be easier to understand
improved #232 fix
Fixed https://github.com/facebook/zstd/issues/232
.travis.yml: different tests for "master" branch
.travis.yml: optimized order of short tests
.travis.yml: test jobs 12-15
JOB_NUMBER -eq 9
improved ZSTD_compressBlock_opt_extDict_generic
2017-01-27 12:05:48 -08:00
Nick Terrell
2fe9126591
Add multithread support to COVER
2017-01-27 11:56:02 -08:00
Yann Collet
609c123a01
Merge pull request #522 from terrelln/benchmt
...
Fix some includes
2017-01-27 11:40:25 -08:00
Yann Collet
bbfcc24309
updated NEWS
2017-01-27 11:27:34 -08:00
Yann Collet
b9fd442d30
Merge pull request #520 from iburinoc/spec
...
Updated format specification to be easier to understand
2017-01-27 11:26:38 -08:00
Yann Collet
cafdd31a38
fixed MSAN warnings in legacy decoders
...
In some extraordinary circumstances,
*Length field can be generated from reading a partially uninitialized memory segment.
Data is correctly identified as corrupted later on,
but the read taints some later pointer arithmetic operation.
2017-01-27 10:44:03 -08:00
Nick Terrell
58f499c41e
Clean imports and shorten tests
2017-01-27 10:43:18 -08:00
Nick Terrell
9c018cc140
Add BUCK files for Nuclide support
2017-01-27 10:43:12 -08:00
Przemyslaw Skibinski
eb2d23a90c
improved #232 fix
2017-01-27 10:43:03 -08:00
Przemyslaw Skibinski
92a4dbf2e4
Fixed https://github.com/facebook/zstd/issues/232
2017-01-27 10:43:03 -08:00
Przemyslaw Skibinski
4b66ddea7e
.travis.yml: different tests for "master" branch
2017-01-27 10:43:03 -08:00
Przemyslaw Skibinski
e1ccaa7957
.travis.yml: optimized order of short tests
2017-01-27 10:43:03 -08:00
Przemyslaw Skibinski
89f74fc0a0
.travis.yml: test jobs 12-15
2017-01-27 10:43:03 -08:00
Przemyslaw Skibinski
a1cc179669
JOB_NUMBER -eq 9
2017-01-27 10:43:03 -08:00
Przemyslaw Skibinski
29157320fb
improved ZSTD_compressBlock_opt_extDict_generic
2017-01-27 10:43:02 -08:00
Nick Terrell
1f1a336241
Fix cmake build
2017-01-27 10:27:29 -08:00
Yann Collet
122b6aa657
updated NEWS
2017-01-27 03:22:37 -08:00
Sean Purcell
d86153d903
Edits as per comments, and change wildcard 'X' to '?'
2017-01-26 16:58:25 -08:00
Nick Terrell
9aa1aa13c1
Fix Visual Studios project
2017-01-26 16:52:47 -08:00
Nick Terrell
e628eaf87a
Fix pool.c threading.h import
2017-01-26 15:29:10 -08:00
Nick Terrell
83c387eb8e
Fix zstdmt_compress.h include
2017-01-26 15:25:32 -08:00
Yann Collet
717c65d690
Merge pull request #519 from inikep/dev11
...
Dev11
2017-01-26 14:23:44 -08:00
Yann Collet
c8a27d9303
Merge pull request #518 from facebook/zstdmt
...
zstd with multi-threading
2017-01-26 14:22:27 -08:00
Yann Collet
ef33d00532
fixed : ZSTD_setCCtxParameter() properly exposed in DLL
2017-01-26 12:24:21 -08:00
Sean Purcell
81c9670226
Fixed commented issues
2017-01-26 11:15:34 -08:00
Yann Collet
4a62f79ec9
fixed clang documentation warning
2017-01-26 09:16:56 -08:00
Yann Collet
8dafb1acf5
CLI : automatically set overlap size to max (windowSize) for max compression level
2017-01-25 17:01:13 -08:00
Sean Purcell
ab226d4828
Updated format specification to be easier to understand
2017-01-25 16:42:41 -08:00
Yann Collet
06e7697f96
added test of new parameter ZSTD_p_forceWindow
2017-01-25 16:39:03 -08:00
Yann Collet
bb0027405a
fixed zstdmt corruption issue when enabling overlapped sections
...
see Asana board for detailed explanation on why and how to fix it
2017-01-25 16:25:38 -08:00
Yann Collet
943cff9c37
fixed zstdmt cli freeze issue with large nb of threads
...
fileio.c was continually pushing more content without giving a chance to flush compressed one.
It would block the job queue when input data was accumulated too fast (requiring to define many threads).
Fixed : fileio flushes whatever it can after each input attempt.
2017-01-25 12:35:19 -08:00
Przemyslaw Skibinski
5022a18d51
improved #232 fix
2017-01-25 13:11:26 +01:00
Przemyslaw Skibinski
64fa2dbc5e
Fixed https://github.com/facebook/zstd/issues/232
2017-01-25 13:02:33 +01:00
Przemyslaw Skibinski
e98788e0dc
Merge remote-tracking branch 'refs/remotes/origin/master' into dev11
2017-01-25 12:24:24 +01:00
Przemyslaw Skibinski
c4874aab4c
.travis.yml: different tests for "master" branch
2017-01-25 11:57:28 +01:00
Przemyslaw Skibinski
3bb010a667
.travis.yml: optimized order of short tests
2017-01-25 11:19:35 +01:00
Yann Collet
dc8dae596a
overlapped section, for improved compression
...
Sections 2+ read a bit of data from previous section
in order to improve compression ratio.
This also costs some CPU, to reference read data.
Read data is currently fixed to window>>3 size
2017-01-24 22:32:12 -08:00
Yann Collet
f14a669054
refactor job creation
...
code shared accross ZSTDMT_{compress,flush,end}Stream(),
for easier maintenance
2017-01-24 17:41:49 -08:00
