AuroraMiddleware/zstd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
7,172 Commits 1 Branch 0 Tags 27 MiB
2d5d961a60
Commit Graph

7172 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Bimba Shrestha
2d5d961a60 Typo in comment 2019-11-15 19:00:53 -08:00
Bimba Shrestha
dba767c0bb Leaving room for checksum 2019-11-15 18:44:51 -08:00
Yann Collet
4b1ac69f19
Merge pull request #1868 from senhuang42/superblocks_fixed 
Superblocks rebased for merge
 2019-11-14 13:31:34 -08:00
Sen Huang
c26d32c91c Change superblock #include to be last 2019-11-14 13:12:17 -05:00
Yann Collet
d67742bc5d
Merge pull request #1858 from senhuang42/dictionary_header_size 
Method to get dictionary header size
 2019-11-14 09:44:07 -08:00
Yann Collet
2ba0167a7d
Merge pull request #1884 from facebook/specMBS 
Specs. clarifications for Block_Maximum_Size
 2019-11-14 09:32:07 -08:00
Yann Collet
098b36e9ab clarifications for Block_Maximum_Size 
as a follow up of #1882
 2019-11-13 09:50:15 -08:00
Yann Collet
7d85f354fd
Merge pull request #1875 from ryandesign/c89 
Change c90 to c89
 2019-11-11 11:00:10 -08:00
Nick Terrell
cabbb1e99e
Merge pull request #1874 from terrelln/adjust-fix 
Fix parameter selection and adjustment with srcSize == 0
 2019-11-08 10:57:59 -08:00
Sen Huang
c85d10d0ea Remove mixed declarations 2019-11-08 13:57:26 -05:00
Sen Huang
d9c475f3b3 Fix static analyze error, use proper bounds for dictEnd 2019-11-08 13:57:26 -05:00
Sen Huang
d06b90692b Move asserts to loadZstdDictionary() 2019-11-08 13:57:26 -05:00
Sen Huang
b39149e156 Expose ZSTD_reset_compressedBlockState() to shared API 2019-11-08 13:57:26 -05:00
Sen Huang
6ce335371b Add error forwarding to loadCEntropy(), make check for dictSize >= 8 from bad merge 2019-11-08 13:57:26 -05:00
Sen Huang
4a61aaf368 Remove redundant comment 2019-11-08 13:57:26 -05:00
Sen Huang
c787b351ea Use ZSTD Error codes, improve explanation of ZSTD_loadCEntropy() and ZSTD_loadDEntropy() 2019-11-08 13:57:26 -05:00
Sen Huang
04fb42b4f3 Integrated refactor into getDictHeaderSize, now passes tests 2019-11-08 13:57:26 -05:00
Sen Huang
0bcaf6db08 First working pass at refactor of loadZstdDictionary() 2019-11-08 13:57:26 -05:00
Sen Huang
4b141b63e0 Revert "Move decompress symbols into zstd_internal.h, remove dependency" 
This reverts commit a152b4c67a5266f611db4a2eac4a79003852a795.
 2019-11-08 13:57:26 -05:00
Sen Huang
84404cff6e Move decompress symbols into zstd_internal.h, remove dependency 2019-11-08 13:57:26 -05:00
Sen Huang
341e0641ed Checks malloc() for failure, returns 0 if so 2019-11-08 13:57:26 -05:00
Sen Huang
97b7f712f3 Change to heap allocation, remove implicit type conversion 2019-11-08 13:57:25 -05:00
Sen Huang
e1edc554a3 Added 2 unit tests: one for sanity, one for correctnesson fixed dict 2019-11-08 13:57:25 -05:00
Sen Huang
3c36a7f13a Add ZDICT_getHeaderSize() 2019-11-08 13:57:08 -05:00
Ryan Schmidt
6ddb783c3e Change c90 to c89 
c89 and c90 are the same language. Old compilers like gcc 4.2.1 don't
know the c90 alias.
 2019-11-07 11:04:31 -06:00
Nick Terrell
8c474f9845 Fix parameter selection and adjustment with srcSize == 0 2019-11-07 08:58:43 -08:00
Yann Collet
2ed5344e84 added target zstd-dictBuilder 
check that the dictBuilder can be compiled
with only lib/common and lib/compress as dependencies.
 2019-11-06 15:46:58 -08:00
Felix Handte
5688447758
Merge pull request #1873 from felixhandte/make-overlap-log-multithread-only 
Fix #1861: Restrict overlapLog Parameter When Not Built With Multithreading
 2019-11-06 16:56:37 -05:00
Felix Handte
ba4613602f
Merge pull request #1843 from moozzyk/issue-1637 
Take ZSTD_parameters as a const pointer
 2019-11-06 16:56:14 -05:00
Felix Handte
32f989c39a
Merge pull request #1869 from bket/openbsd 
'head -c BYTES' is non-portable.
 2019-11-06 16:54:03 -05:00
Felix Handte
cba922f3e6
Merge pull request #1870 from bket/portable 
'date -r FILE' is non-portable.
 2019-11-06 16:52:24 -05:00
W. Felix Handte
c13f81905a Fix #1861: Restrict overlapLog Parameter When Not Built With Multithreading 
This parameter is unused in single-threaded compression. We should make it
behave like the other multithread-only parameters, for which we only accept
zero when we are not built with multithreading.
 2019-11-06 16:05:02 -05:00
Björn Ketelaars
e488cabf25 'date -r FILE' is non-portable. 
date(1) is used to display the last modification time of a file, which
is not supported on OpenBSD, FreeBSD and Darwin. Instead use stat(1).

Tested on OpenBSD.
 2019-11-06 13:55:59 +01:00
Björn Ketelaars
66b6688274 'head -c BYTES' is non-portable. 
Similar to #1321: The '-c' option for 'head' is non-portable (not in
POSIX).
 2019-11-06 11:39:59 +01:00
Sen Huang
e21a8bbecd Fix FUZZ_rand32() bug 2019-11-05 16:43:24 -05:00
Sen Huang
13bb7500e8 Fix frame argument to compression 2019-11-05 16:15:55 -05:00
Sen Huang
f2932fb5eb Fix more merge conflicts 2019-11-05 15:54:05 -05:00
Sen Huang
7ce891870c Fix merge conflicts 2019-11-05 15:51:25 -05:00
Yann Collet
73f8905b83
Merge pull request #1867 from bimbashrestha/dict_load_fuzz_err 
[clean up] Replacing some literals with constants in zstd_compress_literals.c
 2019-11-05 12:24:54 -08:00
Bimba Shrestha
3fb5b106da Replacing some literals with constants 2019-11-05 10:26:57 -08:00
Bimba Shrestha
cf62c31f82
Merge pull request #15 from facebook/dev 
Merging facebook/dev into bimbashrestha/dev
 2019-11-04 11:23:44 -08:00
Yann Collet
305ac2653e update table benchmark with zstd v1.4.4 2019-11-04 10:59:59 -08:00
Nick Terrell
332aade370
Merge pull request #1864 from terrelln/dict-fix 
Fix 2 bugs in dictionary loading
 2019-11-01 20:01:12 -07:00
Nick Terrell
60205fec02 Fix 2 bugs in dictionary loading 
* Silently skip dictionaries less than 8 bytes, unless using `ZSTD_dct_fullDict`.
  This changes the compressor, which silently skips dictionaries <= 8 bytes.
* Allow repcodes that are equal to the dictionary content size, since it is in bounds.
 2019-11-01 16:52:07 -07:00
Nick Terrell
75e7c0d107 [fuzz] Add dictionary_loader fuzzer 
* Adds the fuzzer
* Adds an additional `InputType` for the fuzzer

I ran the fuzzer for about 10 minutes and it found 2 bugs:

* Catches the original bug without any help
* Catches an additional bug with 8-byte dictionaries
 2019-11-01 15:54:24 -07:00
Yann Collet
d770a2a89f fixed zlibwrapper build script 2019-10-31 10:47:06 -07:00
Yann Collet
94dcce2bd8
Merge pull request #1860 from senhuang42/streaming_compression_using_cdict 
Disable reloading dictionary when there is no known srcSize
 2019-10-30 16:27:58 -07:00
Sen Huang
b9ede1c8c2 Make sure contentsize is known 2019-10-30 16:03:58 -04:00
Felix Handte
f9d867e79f
Merge pull request #1857 from 0x123456789A/link-shared 
Add CMake flag for linking programs dynamically
 2019-10-30 15:43:11 -04:00
Yann Collet
47034cd6c3
Merge pull request #1850 from bimbashrestha/named_pipes 
Gating named pipe support on windows
 2019-10-30 12:18:58 -07:00