AuroraMiddleware/zstd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
2,607 Commits 1 Branch 0 Tags 27 MiB
71c5263c00
Commit Graph

2607 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Terrell
71c5263c00 Attribute cover dictionary code 2017-02-07 11:35:07 -08:00
Yann Collet
11df67cb09 Merge branch 'dev' of github.com:facebook/zstd into dev 2017-02-06 17:40:38 -08:00
Yann Collet
816edeb9c2 corrected contributor's name 2017-02-06 17:39:54 -08:00
Yann Collet
696a749d30 Merge pull request #532 from terrelln/zlib 
Change zlib include to be a system include
 2017-02-06 14:44:23 -08:00
Nick Terrell
7e3fc73795 Ensure <zlib.h> can be included in HAVE_ZLIB test 2017-02-06 11:54:31 -08:00
Nick Terrell
2cb8ee8784 Change zlib include to be a system include 2017-02-06 11:32:13 -08:00
Yann Collet
d44d363ec1 changed download URL for github_users sample set 2017-02-06 10:01:06 -08:00
Yann Collet
5962e58659 updated NEWS for v1.1.3 2017-02-05 18:09:35 -08:00
Yann Collet
f6e9c4f1e1 Merge pull request #529 from facebook/gzstd_default 
Gzstd default
 2017-02-05 18:03:36 -08:00
Yann Collet
b54e235bf3 fixed Mac OS-X specific directory in $(RM) list 
these directories are now removed with -r command
 2017-02-05 10:22:58 -08:00
cyan4973
613087c02b Silence zlib detection routine 
When it fails, $(CC) sends error message into stderr
redirected to /dev/null
 2017-02-04 23:36:12 -08:00
cyan4973
6f31b76d1d removed gzstd test from travis 
this target does no longer exist
 2017-02-04 21:39:41 -08:00
Yann Collet
11d3bc885e Merge pull request #530 from terrelln/cover-man 
Add cover dictionary training to zstd.1
 2017-02-03 17:10:06 -08:00
Nick Terrell
b4016ff02f Add cover dictionary training to zstd.1 
Tested with `make install && man zstd` and visual inspection.
 2017-02-03 16:42:07 -08:00
Yann Collet
762ddeeb9e fixed zstdmt compilation under Windows minGW/MSYS2, by @inikep 2017-02-03 14:35:42 -08:00
Yann Collet
21eb80d485 remove zlib detection artefact 
result of compilation test is sent to /dev/null
 2017-02-03 14:34:41 -08:00
Yann Collet
b02ac8d613 fixed pointer conversion warnings (C++) 
in gz module
 2017-02-03 08:43:06 -08:00
Yann Collet
c2a4632789 release builds use less debug symbols and warnings 
release build are triggered through either `make`,
or their specific target `make zstd-release` and `make lib-release`.
 2017-02-02 20:54:41 -08:00
Yann Collet
c3cba9d858 fixed silent conversion warnings in GZDECOMPRESS path 2017-02-02 17:12:50 -08:00
Yann Collet
030ac243a0 Changed Makefile to generate zstd with .gz support by default 
.gz support is detected by a runtime test.
 2017-02-02 16:49:34 -08:00
Yann Collet
3dc85bae66 minor : fixed zstd-frugal 
fixed a minor unused variable warning when compiling zstd-frugal target
 2017-02-02 16:19:09 -08:00
Yann Collet
4dfabc45d9 removed unused chart 2017-02-02 13:50:51 -08:00
Yann Collet
c13cd3aa62 updated dictionary compression paragraph 2017-02-02 13:50:07 -08:00
Yann Collet
48bed91606 Merge pull request #527 from facebook/zstdmt 
zstdmt refinements
 2017-01-31 16:36:46 -08:00
Yann Collet
b2e1b3d670 fixed overlapLog==0 => no overlap 2017-01-30 14:54:46 -08:00
Yann Collet
8d8513fb64 fixed C constant restrictions 2017-01-30 14:37:08 -08:00
Yann Collet
3672d06d06 zstdmt : section size is set to be a minimum of overlapSize 
the minimum size condition size is applied transparently (no warning, no error)
like previous minimum section size condition (1 KB) which still applies.
 2017-01-30 13:35:45 -08:00
Yann Collet
6ccd37c8d4 cli : added advanced parameter overlapLog 
as a hidden (undocumented) parameter for now
 2017-01-30 13:07:24 -08:00
Yann Collet
92c98a5b21 zstreamtest uses random section sizes for fuzzing 2017-01-30 12:50:31 -08:00
Yann Collet
cd23dd24af zstreamtest uses random overlapLog for fuzzing 2017-01-30 12:46:35 -08:00
Yann Collet
6be2337c26 added command --block-size= 
for Multi-threading only.
alias : -B#
 2017-01-30 11:17:26 -08:00
Yann Collet
88df1aed61 changed advanced parameter overlapLog 
Follows a positive logic (increasing value => increasing overlap)
which is easier to use
 2017-01-30 11:00:00 -08:00
Yann Collet
b5fd15ccb2 fixed : legacy decoders v04 and v05 2017-01-30 10:45:58 -08:00
Yann Collet
cc3d1bc262 Merge pull request #525 from terrelln/covermt 
Multithreaded COVER dictionary training
 2017-01-30 10:15:33 -08:00
Yann Collet
4fd0fffdea Merge pull request #523 from terrelln/buck 
Add BUCK files for Nuclide integration
 2017-01-28 19:17:58 -08:00
Nick Terrell
43474313f8 Fix documentation about memory usage 2017-01-27 18:43:05 -08:00
Nick Terrell
90db3afdee Fix typos in VS2010 build config 2017-01-27 17:32:16 -08:00
Yann Collet
64bf8ffce6 report @terrelln patch to ST fuzzer tests 2017-01-27 17:25:07 -08:00
Yann Collet
716ea3b361 Merge pull request #524 from terrelln/asan-failure 
Fix segfault in zstreamtest MT
 2017-01-27 16:50:16 -08:00
Nick Terrell
b42dd27ef5 Add include guards and extern C 2017-01-27 16:00:19 -08:00
Yann Collet
f6d4a786fc reduced zstdmt latency when using small custom section sizes with high compression levels 
Previous version was requiring a fairly large initial amount of input data
before starting to create compression jobs.
This new version starts the process much sooner.
 2017-01-27 15:55:30 -08:00
Nick Terrell
d98bf49224 Fix segfault in zstreamtest MT 
It was reading beyond the end of the input buffer because no errors were
detected. Once that was fixed, it wasn't making forward progress because
no errors were detected and it was waiting for input.
 2017-01-27 15:42:36 -08:00
Nick Terrell
6570167f8b Fix VS fuzzer build configs 2017-01-27 13:56:41 -08:00
Yann Collet
5d9b894e46 Fixed status display for zstdmt 
There is a large buffering effect when using zstdmt in MT mode.
Consequently, data is read first, pushed to workers,
and only later will the compressed result come out.
That means there is no longer immediate correlation
between amount of data read, and amount of data written.

This patch disables the displaying of % compression
when multi-threading is enabled.

It adds the displaying of total size when it can be determined
(it usually can be determined for files, but not for stdin)
so the user has a sense of "how far from the end" the compression compressed is.

There is no modification to decompression side,
since decompression is only single-threaded for now.
 2017-01-27 13:30:18 -08:00
Nick Terrell
5cf84a05e7 Revert unnecessary change to Logging.h 2017-01-27 13:26:44 -08:00
Nick Terrell
8959910412 Add threading and pool to build configs 2017-01-27 12:29:27 -08:00
Yann Collet
20bed4210c changed format specification version number 2017-01-27 12:16:16 -08:00
Nick Terrell
c43c27127f Merge branch 'dev' into buck 
* dev:
  updated NEWS
  fixed MSAN warnings in legacy decoders
  Fix cmake build
  updated NEWS
  Edits as per comments, and change wildcard 'X' to '?'
  Fix Visual Studios project
  Fix pool.c threading.h import
  Fix zstdmt_compress.h include
  Fixed commented issues
  Updated format specification to be easier to understand
  improved #232 fix
  Fixed https://github.com/facebook/zstd/issues/232
  .travis.yml: different tests for "master" branch
  .travis.yml: optimized order of short tests
  .travis.yml: test jobs 12-15
  JOB_NUMBER -eq 9
  improved ZSTD_compressBlock_opt_extDict_generic
 2017-01-27 12:05:48 -08:00
Nick Terrell
2fe9126591 Add multithread support to COVER 2017-01-27 11:56:02 -08:00
Yann Collet
609c123a01 Merge pull request #522 from terrelln/benchmt 
Fix some includes
 2017-01-27 11:40:25 -08:00