AuroraMiddleware/zstd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
7,482 Commits 1 Branch 0 Tags 27 MiB
a93fadfcd9
Commit Graph

7482 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Bimba Shrestha
075783c1f0
Merge pull request #1980 from bimbashrestha/params 
Adding --show-default-cparams to cli
 2020-02-03 14:43:55 -08:00
Bimba Shrestha
f1de05f348
Merge pull request #1981 from bimbashrestha/bug-fix 
Benchzstd multiple file decompression enable
 2020-02-03 14:40:26 -08:00
Bimba Shrestha
d1389ac3ff Adding assert(NB_STRATEGIES == upperLimit) 2020-02-03 09:52:39 -08:00
Bimba Shrestha
80c26117a9 Line-wrapping 2020-02-03 09:38:16 -08:00
Bimba Shrestha
ee8a712af3 Using appliedParams instead of supplied params 2020-01-31 15:49:07 -08:00
Bimba Shrestha
f33baa21c6 Removing assert and changing ratio cSize 2020-01-31 11:54:14 -08:00
Bimba Shrestha
19473390d1 Adding (void)ZSTD_strategyMap 2020-01-31 10:54:02 -08:00
Bimba Shrestha
38d010eea0 Adding static assert and using it in cli 2020-01-31 10:47:17 -08:00
Bimba Shrestha
0fa6c90e89 Moving to same category as -v 2020-01-31 10:38:19 -08:00
Bimba Shrestha
f4ae6c0b94 Moving documentation and elaborating 2020-01-30 17:54:42 -08:00
Bimba Shrestha
9d9cfa9ef9 Adding assert and using ZSTD_STRATEGY_MAX as ZSTD_NB_STRATEGIES 2020-01-30 17:54:01 -08:00
Bimba Shrestha
6ad2f0d7d6 Adding back one cast and using UTIL_FILESIZE_UNKNOWN to check unknown file size 2020-01-30 17:16:02 -08:00
Bimba Shrestha
6bf05a53ab Documenting in the man file 2020-01-30 17:11:38 -08:00
Bimba Shrestha
c203341292 Removing more casts 2020-01-30 17:07:58 -08:00
Bimba Shrestha
2a0771cfdb Removing unnecessary cast 2020-01-30 17:05:33 -08:00
Bimba Shrestha
b0ceab4dc0 Moving default cparams back, checking for unknown file size, using getCParams() 2020-01-30 16:52:07 -08:00
Bimba Shrestha
b660ef87f8 Convertion nit U32 -> size_t 2020-01-30 14:29:04 -08:00
Bimba Shrestha
71754a26f8 Update comment 2020-01-30 14:14:27 -08:00
Bimba Shrestha
2f10019b92 Adding --show-default-cparams (show cparams before compressing 2020-01-30 14:12:03 -08:00
Nick Terrell
6a426ef65e
Merge pull request #1977 from terrelln/copyless 
Improve wildcopy performance across the board
 2020-01-29 15:32:19 -08:00
Bimba Shrestha
3b10060b71
Merge pull request #1978 from bimbashrestha/quick 
[Typo][fix] make benchmarking typo fix
 2020-01-28 22:11:51 -08:00
Bimba Shrestha
9b049836c9 Typo baseline_build -> baseline_label 2020-01-28 21:39:20 -08:00
Nick Terrell
e32e3e8662 Improve wildcopy performance across the board 2020-01-28 20:37:04 -08:00
Bimba Shrestha
8fe562a770 [automated_benchmarking] Make arguments optional and add --dict argument (#1968) 
* Make arugments optional and add --dict argument

* Removing accidental print statement

* Change to more likely scenario for dictionary compression benchmark
 2020-01-28 11:29:43 -08:00
Yann Collet
9a71d07aa4
added ability to remove error messages and dictionary support (#1975) 
for the benefit of smaller binary.
 2020-01-27 11:39:29 -08:00
Yann Collet
5bcd6448b6
refactor of harness, for clarity (#1974) 
following #1953 (false positive, due to heuristic confusion)
 2020-01-24 20:16:28 -08:00
Yann Collet
5c769e33f8 Merge branch 'dev' of github.com:facebook/zstd into dev 2020-01-24 15:04:02 -08:00
Yann Collet
f34eab162f updated CHANGELOG 2020-01-24 14:12:25 -08:00
Nick Terrell
7627759b4e
Merge pull request #1972 from terrelln/check-cont 
Move ZSTD_checkContinuity() to zstd_decompress_block.c
 2020-01-23 22:02:50 -08:00
Nick Terrell
e6d3a61db8
Merge pull request #1973 from terrelln/mobile-perf 
Fix performance regression on aarch64 with clang
 2020-01-23 22:02:32 -08:00
Nick Terrell
fa6a772f38 Initialize dctx->bType to silence valgrind false positive 2020-01-23 17:54:48 -08:00
Nick Terrell
cb2abc3dbe Fix performance regression on aarch64 with clang 2020-01-23 17:31:14 -08:00
Nick Terrell
6e3cd5b024 Move ZSTD_checkContinuity() to zstd_decompress_block.c 2020-01-23 12:27:39 -08:00
Nick Terrell
2f31050a3f
Merge pull request #1965 from terrelln/android-fix 
Fix timefn on android
 2020-01-22 15:42:50 -08:00
Nick Terrell
7ec87cfb28 Update comment in timefn 2020-01-22 11:17:30 -08:00
Nick Terrell
768adc0774 Fix timefn on android 2020-01-21 18:57:16 -08:00
Felix Handte
3a9a079ed1
Merge pull request #1956 from PhoebeHui/dev 
Add vcpkg installation instructions
 2020-01-21 11:54:00 -05:00
PhoebeHui
7738709020 Update comments 2020-01-19 23:51:40 -08:00
Nick Terrell
db9c8af600
Merge pull request #1957 from terrelln/fix-ultra 
Fix lowLimit underflow in overflow correction
 2020-01-17 18:01:35 -08:00
Nick Terrell
76e01f3555
Merge pull request #1958 from terrelln/docs 
Add --single-thread to zstd --help
 2020-01-17 14:46:00 -08:00
Nick Terrell
009f388457 Fix playTests.sh for 32-bit mode 2020-01-17 14:20:44 -08:00
Nick Terrell
fa48af545f Add --single-thread to zstd --help 2020-01-17 13:54:49 -08:00
Nick Terrell
a11a9271d6 Fix lowLimit underflow in overflow correction 2020-01-17 12:10:18 -08:00
PhoebeHui
3e8222be58 Add vcpkg installation instructions 2020-01-17 03:31:08 -08:00
Nick Terrell
957d59c721
Merge pull request #1950 from terrelln/ctest 
[cmake] Add playTests.sh as a test
 2020-01-13 16:16:25 -08:00
Nick Terrell
f6d00c059f [util] Fix readLineFromFile on Cygwin 2020-01-13 14:37:22 -08:00
Nick Terrell
3ed0f65158 [cmake] Add playTests.sh as a test 2020-01-13 14:16:15 -08:00
Nick Terrell
f27b4b4ec5
Merge pull request #1948 from lazka/cygwin-fix-c99-build 
Fix the c99/cmake build under Cygwin/MSYS2
 2020-01-13 11:35:28 -08:00
Christoph Reiter
9a5d8a6cb4 appveyor: build with CMake under Cygwin 2020-01-11 11:37:22 +01:00
Nick Terrell
036b30b555
Fix super block compression and stream raw blocks in decompression (#1947) 
Super blocks must never violate the zstd block bound of input_size + ZSTD_blockHeaderSize. The individual sub-blocks may, but not the super block. If the superblock violates the block bound we are liable to violate ZSTD_compressBound(), which we must not do. Whenever the super block violates the block bound we instead emit an uncompressed block.

This means we increase the latency because of the single uncompressed block. I fix this by enabling streaming an uncompressed block, so the latency of an uncompressed block is 1 byte. This doesn't reduce the latency of the buffer-less API, but I don't think we really care.

* I added a test case that verifies that the decompression has 1 byte latency.
* I rely on existing zstreamtest / fuzzer / libfuzzer regression tests for correctness. During development I had several correctness bugs, and they easily caught them.
* The added assert that the superblock doesn't violate the block bound will help us discover any missed conditions (though I think I got them all).

Credit to OSS-Fuzz.
 2020-01-10 18:02:11 -08:00