Commit Graph

7922 Commits

Author SHA1 Message Date
Nick Terrell
08981d2638 [lib] Allow compression dictionaries with missing symbols
Allow compression to use dictionaries with missing symbols in their
entropy tables. We set the FSE repeat mode to check when there are
missing symbols, and set the FSE repeat mode to valid when all symbols
are present.

Note that when not all symbols are present, the heuristics which favor
dictionary tables for lower compression levels won't activate.

Tested by manually creating a dictionary with missing symbols of every
type, and validing that the compressor rejects it before this change,
and accepts it after this change. Also, I ran the `dictionary_loader`
fuzzer for >1 hour of CPU time without running into cases where
compression succeeds, but decompression fails.

Fixes #2174.
2020-06-12 17:57:19 -07:00
Yann Collet
e8127b3f15
Merge pull request #2196 from tru/dumpversion_argument
Make --version respect -q for ouptut a shorter version string
2020-06-11 02:04:04 -07:00
Tobias Hieta
1c9b1ddac7 Update version documention with the support for -q 2020-06-11 10:56:47 +02:00
Rosen Penev
447629b61b
meson: remove build requirement for distutils
Tested on a default installation of Debian 10.

Signed-off-by: Rosen Penev <rosenp@gmail.com>
2020-06-09 16:33:16 -07:00
Tobias Hieta
b1cce9a6ad Short version string output
This adds support for just showing the version string
without the full welcome message if the log level is
less than the default. That means that you pass -q once
and you will just see "1.4.5".

This makes it easier to parse in scripts.
2020-06-09 08:40:41 +02:00
Bimba Shrestha
4c144cf9c5
Merge pull request #2193 from bimbashrestha/typos
Fixing some typos
2020-06-05 12:00:04 -05:00
Bimba Shrestha
e2838d9eb9 Spelling mistakes 2020-06-05 05:11:26 -05:00
Yann Collet
4b201f98eb
Merge pull request #2190 from facebook/playTest_improvement
Check environmental variables in playTests.sh and add default values
2020-06-03 13:26:52 -07:00
Shaojing Li
847349195f fix the if statements in posix sh env 2020-06-03 11:36:38 -07:00
Shaojing Li
3a3da1712b check env variables and add default values 2020-06-03 10:49:21 -07:00
Bimba Shrestha
448658a662
Merge pull request #2187 from bimbashrestha/bourne
[ci] Adding bourne shell compatibility test
2020-06-02 13:07:36 -05:00
Bimba Shrestha
00ac0415ac
Merge pull request #2186 from bimbashrestha/dll-install
[cmake] Fix dll install location
2020-06-02 12:32:12 -05:00
Bimba Shrestha
eee59be6a8 excluding ls | grep warning 2020-06-02 09:15:24 -07:00
Bimba Shrestha
b0f851675a [shellcheck] setting if unset 2020-06-02 09:12:50 -07:00
Bimba Shrestha
151deaf143 [shellcheck] adding quotes to expansion 2020-06-02 09:12:13 -07:00
Bimba Shrestha
12185ec5e7 adding shellcheck bourne test 2020-06-02 09:08:16 -07:00
Bimba Shrestha
0ce5f70ca8 newline lints (ignore) 2020-06-02 09:07:45 -07:00
Bimba Shrestha
e75db971fc DLL install fix for https://github.com/facebook/zstd/issues/2160
Credit goes to @xantares

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
2020-06-02 07:45:06 -07:00
Tony Theodore
53fe73a720
Install pkg-config file on MINGW also
Mingw follows unix conventions and often expects pkg-config files to be present.
2020-06-02 18:18:40 +10:00
Yann Collet
e7948fdf84
Merge pull request #2181 from facebook/makejall
fixed double-compilation of lib with make -j all
2020-05-29 13:49:38 -07:00
Yann Collet
105b5839de added comment on $(Q) 2020-05-29 12:40:59 -07:00
Yann Collet
6ac6472988 fixed double-compilation of lib with make -j all
also implemented verbose mode (make V=1)
2020-05-29 12:09:51 -07:00
Felix Handte
2af4e07326
Merge pull request #2133 from felixhandte/single-size-calculation
Consolidate CCtx Size Estimation Code
2020-05-28 13:07:18 -04:00
Bimba Shrestha
7f248af036
Merge pull request #2180 from facebook/generic-release
[actions] Migrating 2nd batch of tests from Travis to Github Actions
2020-05-26 16:30:11 -05:00
Yann Collet
11a392ce23 minor markdown formatting fix 2020-05-26 13:15:35 -07:00
Bimba Shrestha
4ae5cb1ec9
Create generic-release.yml 2020-05-26 15:12:00 -05:00
Bimba Shrestha
b1a269437a
Merge pull request #2137 from facebook/generic-dev
[actions] Migrating 1st batch of tests from Travis to Github Actions
2020-05-26 13:03:17 -05:00
Bimba Shrestha
c96151a25d
Merge pull request #2178 from bimbashrestha/quick-fix
Change --patch-from limit from 4gb to 2gb
2020-05-26 12:26:22 -05:00
Bimba Shrestha
f847909cf2 Using ZSTD_MAX_WINDOWLOG instead of INT_MAX 2020-05-26 09:23:26 -07:00
Yann Collet
8a5f794e16
Merge pull request #2176 from facebook/make_implicit
fixed default rule for lib/Makefile
2020-05-26 08:55:34 -07:00
Yann Collet
a49db88020
Merge pull request #2177 from facebook/dictID0
updated spec on dictID==0
2020-05-26 08:54:10 -07:00
Bimba Shrestha
01b38ef162 Change --patch-from limit from 4gb to 2gb 2020-05-26 06:52:30 -07:00
Yann Collet
bb3c9bf43a updated spec on dictID==0
Specified decoder behavior on receiving a frame with dictID=0.

Pushed paragraph on reserved DictID ranges into the Dictionary Format section.
2020-05-25 08:15:09 -07:00
Yann Collet
39a32f40c9 fixed default rule for lib/Makefile
default rule is `lib-release`

`lib-release` wasn't working : it was just skipped.

Removing `lib-release` from the list of .PHONY targets fixes it.

Same for `lib-mt`.
2020-05-25 06:50:45 -07:00
Nick Terrell
9eb2ccc9fb
Merge pull request #2167 from terrelln/pzstd-ms-fix
[pzstd] Fix compilation error in MinGW
2020-05-22 23:38:27 -07:00
Nick Terrell
5aa5aa4df7 [pzstd] Fix compilation error in MinGW 2020-05-22 22:26:02 -07:00
Yann Collet
52a62e46f5
Merge pull request #2166 from facebook/donotinstall_zbuffh
do not install zbuff.h
2020-05-22 17:16:23 -07:00
Yann Collet
082755bd3f do not install zbuff.h
this API is deprecated, for a loong time now,
all related symbols will be removed in a future version (likely v1.5.0)
and the header file `zbuff.h` doesn't compile from `include/` anyway,
because it needs to be positioned one directory below `zstd.h`.

Also removed `cover.h` from `cmake` installer,
as it should have never been part of this list to begin with.
2020-05-22 15:35:54 -07:00
Yann Collet
e20b601781
Merge pull request #2163 from orivej/fix-legacy-build
Fix legacy build after #2103
2020-05-22 09:55:17 -07:00
Orivej Desh
93cec0c1d6 Fix legacy build after #2103 2020-05-22 12:48:02 +00:00
Yann Collet
b706286adb
Merge pull request #2154 from facebook/dev
v1.4.5
2020-05-21 22:04:00 -07:00
Yann Collet
299229316a
Merge pull request #2159 from facebook/visual_playTests
Fix playTests.sh
2020-05-21 20:50:50 -07:00
Yann Collet
306e922f60 fixed environment variables 2020-05-21 18:06:43 -07:00
Yann Collet
5d0c8a0770 Merge branch 'dev' into visual_playTests 2020-05-21 16:45:02 -07:00
Yann Collet
9fdf5daef7
Merge pull request #2158 from facebook/meson_fix
fix meson playTests.sh
2020-05-21 16:07:56 -07:00
Yann Collet
26b21e481f fix meson playTests.sh 2020-05-21 15:17:22 -07:00
Yann Collet
a63810e2ac try to fix PPC64 Qemu tests 2020-05-21 10:26:40 -07:00
Yann Collet
b7158cf9f1
Merge pull request #2155 from facebook/fix_zbufftest
fixed zbuff test
2020-05-21 09:44:52 -07:00
Yann Collet
ad0c0d1946 fixed appveyor long tests
playTests changed variable name
2020-05-21 00:53:57 -07:00
Yann Collet
14aaa5290a fixed zbuff test
error introduced in 3b39ce6b52/.travis.yml (L192)
2020-05-21 00:22:52 -07:00