AuroraMiddleware/zstd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
5,206 Commits 1 Branch 0 Tags 27 MiB
01d940b670
Commit Graph

5206 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet
82ad249645 Clarifications of Zstandard format specification 
from IETF RFC review
 2018-04-30 12:36:55 -07:00
Peter Seiderer
64bfdca5b9 Split library install target into pc, static, shared and include only target 
Signed-off-by: Peter Seiderer <ps.report@gmx.net>
 2018-04-30 20:32:32 +02:00
Yann Collet
a11f0c67bb
Merge pull request #1113 from terrelln/dict-fix 
Fix parameter adjustment with dictionary
 2018-04-26 10:31:25 -07:00
Nick Terrell
ca77822ddf Fix parameter adjustment with dictionary 
The new advanced API basically set `requestedParams = appliedParams` when
using a dictionary. This halted all parameter adjustment, which can hurt
compression ratio if, for example, the window log is small for the first
call, but the rest of the files are large.

This patch fixes the bug, and checks that the `requestedParams` don't change
in the new advanced API when using a dictionary, and generally in the fuzzer.
 2018-04-25 16:32:29 -07:00
Yann Collet
12f60b8c98 clarified documentation related to refPrefix() 2018-04-25 10:17:06 -07:00
Yann Collet
449cccf6c9
Merge pull request #1112 from facebook/lz4dec 
fixed decoding bogus lz4 frame
 2018-04-24 16:50:54 -07:00
Yann Collet
ace856a835 updated documentation of streaming compression api 2018-04-24 14:44:27 -07:00
cyan4973
62487b5e76 fixed decoding bogus lz4 frame 
FIO would keep presenting data after an LZ4F decoding error
resulting in a NULL pointer dereference
when associated with older liblz4 version (< v1.8.1.2)
 2018-04-23 18:50:16 -07:00
taigacon
2c3ad05812 Fix the problem that enables DYNAMIC_BMI2 macro by mistake on ARM architecture with Clang (#1110) 2018-04-23 15:41:50 -07:00
Yann Collet
9de03cd748
Merge pull request #1107 from terrelln/reset-params 
Add ZSTD_CCtx_resetParameters() function
 2018-04-13 13:23:47 -07:00
Nick Terrell
e8c9dc5cea Fix documentation 2018-04-13 12:43:38 -07:00
Nick Terrell
c0987986e5 Only reset CDict in ZSTD_CCtx_resetParameters() 2018-04-13 11:26:40 -07:00
Nick Terrell
9f76eebd17 Add ZSTD_CCtx_resetParameters() function 
* Fix docs for `ZSTD_CCtx_reset()`.
* Add `ZSTD_CCtx_resetParameters()`.

Fixes #1094.
 2018-04-12 16:54:07 -07:00
Nick Terrell
3c3f59e68f
Enforce pledgeSrcSize whenever known (#1106) 
The test fails before the patch and passes after.

Fixes #1095.
 2018-04-12 16:02:03 -07:00
Yann Collet
1f25b17c7d
Merge pull request #1105 from terrelln/get-param 
Add ZSTD_CCtx(Param)?_getParameter() function
 2018-04-12 13:25:57 -07:00
Nick Terrell
280a236e9e Add ZSTD_CCtx(Param)?_getParameter() function 
Closes #1096.
 2018-04-12 11:50:12 -07:00
Yann Collet
04212178b5 doc : clarified advanced API usage 
sticky parameters only work with `ZSTD_compress_generic()`
 2018-04-10 11:40:36 -07:00
Yann Collet
ad5ba6cdcf updated comment on parameters that can be changed during compression 2018-04-09 17:39:07 -07:00
Yann Collet
1da629f2ad
Merge pull request #1104 from terrelln/fast-train 
Allow negative compression levels in training
 2018-04-09 14:16:20 -07:00
Nick Terrell
569e2abccd Allow negative compression levels in training 
* Set `dictCLevel` in `zstdcli.c`.
* Only set to default level if the compression level `== 0`, not `<= 0`.
 2018-04-09 12:12:03 -07:00
Yann Collet
77e373bff5
Merge pull request #1103 from kilobyte/dev 
Fix riscv.
 2018-04-09 11:12:51 -07:00
Adam Borowski
00d52282d0 Use -pthread rather than -lpthread. 
It can have other effects, such as pulling in extra libraries.  Without it,
riscv build fails with undefined reference to `__atomic_compare_exchange_1'.
 2018-04-09 01:50:49 +02:00
Yann Collet
4195b36dd7
Merge pull request #1100 from bket/stable_sort 
zstd requires a stable sort.
 2018-04-05 11:39:27 -07:00
Yann Collet
f35b8ba9da updated ZSTD_p_chainLog description 2018-04-05 11:05:11 -07:00
Yann Collet
b1e4d891cf
Merge pull request #1099 from bket/fix_typo 
fix typo in programs/zstd.{1,1.md}
 2018-04-05 10:30:35 -07:00
Björn Ketelaars
462aed6811 zstd requires a stable sort. 
On OpenBSD qsort() is not guaranteed to be stable, their mergesort() is.
This fixes issue #1088. All the hard work has been done by @terrelln.
 2018-04-05 07:59:16 +02:00
Björn Ketelaars
e5ea8d272a fix typo in programs/zstd.{1,1.md} 
s/nodictID/no-dictID/g
 2018-04-05 06:44:46 +02:00
Yann Collet
55f67502f4
Merge pull request #1098 from terrelln/nd-mt 
Only load extra table positions for CDicts
 2018-04-02 15:38:20 -07:00
Nick Terrell
295ab0dbfa Only load extra table positions for CDicts 
Zstdmt uses prefixes to load the overlap between segments. Loading extra
positions makes compression non-deterministic, depending on the previous
job the context was used for. Since loading extra position takes extra
time as well, only do it when creating a `ZSTD_CDict`.

Fixes #1077.
 2018-04-02 14:41:30 -07:00
Yann Collet
e866f0919f
Merge pull request #1089 from bket/portability 
examples/Makefile assumes GNU make.
 2018-04-02 14:16:16 -07:00
Yann Collet
5b616fa269
Merge pull request #1090 from bket/openbsd 
Fix building zstd on OpenBSD.
 2018-04-02 14:15:26 -07:00
bket
daf3ab0aad Make sure that make check runs on OpenBSD. (#1091) 
OpenBSD uses md5 instead of md5sum, and has no device called full.

With this patch, make check runs until #1088. With the assumption made
in the issue make check runs succesfully.
 2018-04-02 14:12:18 -07:00
Yann Collet
754a821f17
Merge pull request #1080 from facebook/getFrameHeader 
added ZSTD_getFrameHeader_advanced()
 2018-04-01 14:27:46 -07:00
Björn Ketelaars
9d3048346d Fix building zstd on OpenBSD. 2018-03-31 10:46:20 +02:00
Björn Ketelaars
b7e2c8e723 examples/Makefile assumes GNU make. 
This fixes a building issue on systems that default to a different
flavour of make (as is the case with OpenBSD).
 2018-03-31 10:25:12 +02:00
Yann Collet
8be984ec45 fixed comments as suggested by @terrelln 2018-03-30 20:09:27 -07:00
Yann Collet
7188862d32
Merge pull request #1086 from hagemt/hagemt-patch-1 
Correct small typo in manual (man file and markdown)
 2018-03-30 20:45:10 -06:00
Tor E Hagemann
c7a5e60bc6
Update zstd.1.md 2018-03-30 15:25:32 -07:00
Tor E Hagemann
292d370ab4
Update zstd.1 2018-03-30 14:53:57 -07:00
Yann Collet
678d0cacbf
Merge pull request #1079 from facebook/ovlog 
restore ability to set overlapLog
 2018-03-30 15:52:07 -06:00
Yann Collet
70c9b90eaf
Merge pull request #1085 from terrelln/readme 
Clarify license in the second paragraph
 2018-03-30 15:51:51 -06:00
Nick Terrell
259fb2d0fb Clarify license in the second paragraph 2018-03-30 12:39:58 -07:00
Yann Collet
e6e848bfe9 added ZSTD_getFrameHeader_advanced() 
makes it possible to request frame header from a magicless frame
 2018-03-29 17:51:08 -06:00
Yann Collet
a6694838e1 added more code documentation for ZSTD_getFrameHeader() 2018-03-29 15:24:17 -06:00
Yann Collet
96b480a96d added ovlog tests 
check that setting ovlog has a direct impact on compression ratio
(hence is not silently ignored)
 2018-03-29 13:08:09 -06:00
Yann Collet
525f3fab33 restored ability to manually set overlapLog 2018-03-28 11:33:41 -06:00
Yann Collet
99e8063d40
Merge pull request #1075 from terrelln/cmake 
Fix CMake build
 2018-03-26 15:19:02 -07:00
Nick Terrell
268cc2a516 Fix CMake build 
`MAN_INSTALL_DIR` was undefined.

Tested with `make cmakebuild`, and saw that the man pages got installed to the right place:

```
-- Installing: /Users/terrelln/install_test_dir/lib/pkgconfig/libzstd.pc
-- Installing: /Users/terrelln/install_test_dir/include/zstd.h
-- Installing: /Users/terrelln/install_test_dir/include/zbuff.h
-- Installing: /Users/terrelln/install_test_dir/include/zdict.h
-- Installing: /Users/terrelln/install_test_dir/include/zstd_errors.h
-- Installing: /Users/terrelln/install_test_dir/lib/libzstd.1.3.4.dylib
-- Installing: /Users/terrelln/install_test_dir/lib/libzstd.dylib
-- Installing: /Users/terrelln/install_test_dir/lib/libzstd.a
-- Installing: /Users/terrelln/install_test_dir/bin/zstd
-- Up-to-date: /Users/terrelln/install_test_dir/bin/zstd
-- Installing: /Users/terrelln/install_test_dir/bin/zstdcat
-- Installing: /Users/terrelln/install_test_dir/bin/unzstd
-- Installing: /Users/terrelln/install_test_dir/share/man/man1/zstd.1
-- Installing: /Users/terrelln/install_test_dir/share/man/man1/zstdcat.1
-- Installing: /Users/terrelln/install_test_dir/share/man/man1/unzstd.1
-- Installing: /Users/terrelln/install_test_dir/bin/zstdmt
-- Installing: /Users/terrelln/install_test_dir/bin/pzstd
-- Installing: /Users/terrelln/install_test_dir/zstd_manual.html
```
 2018-03-26 14:59:26 -07:00
Yann Collet
eba13dba2e updated NEWS for v1.3.4 2018-03-26 10:23:46 -07:00
Yann Collet
bffb4b46a1 updated VS studio readme 2018-03-26 09:55:10 -07:00