AuroraMiddleware/zstd
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
5,847 Commits 1 Branch 0 Tags 27 MiB
7791f192ee
Commit Graph

5847 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet
7791f192ee removed one assert() 
which can be triggered when input is corrupted.
 2018-10-10 16:39:15 -07:00
Yann Collet
d3ec23313d improved decompression speed 
while reviewing #1364,
I found a decompression speed improvement.

On my laptop, the new code decompresses +5-6% faster on clang
and +2-3% faster on gcc.

not bad for an accidental optimization...
 2018-10-10 15:48:43 -07:00
Yann Collet
8d2c844cf1
Merge pull request #1363 from facebook/backtrace 
backtrace support compiled with more conditions
 2018-10-10 09:37:33 -07:00
Yann Collet
b304b679e5 use #if BACKTRACE_ENABLE directly 
as suggested by @terrelln
 2018-10-09 17:56:59 -07:00
Julian Fessard
0ea286f740 Merge branch 'backtrace' of github.com:facebook/zstd into backtrace 2018-10-09 17:24:48 -07:00
Julian Fessard
70d8c2a031 fileio.c: Disable backtrace when built with address sanitizer 
Covers clang and gcc's sanitizer flags.
Can still be overridden through CFLAGS on commandline.
 2018-10-09 17:14:57 -07:00
Yann Collet
e0ab6b61b7 fixed explicit BACKTRACE order 
and automatic linux backtrace detection :
__GLIBC__ must be tested after #include <features.h>
 2018-10-09 17:12:21 -07:00
Yann Collet
1e0c5466c5 fixed BACKTRACE_ENABLE macro test 2018-10-09 16:36:57 -07:00
Yann Collet
942df522cc
Merge pull request #1361 from facebook/streamdoc 
Clarify streaming api doc
 2018-10-08 19:19:34 -07:00
Yann Collet
92192b267c
Merge pull request #1362 from felixhandte/fix-btlazy-skipping 
`ZSTD_btlazy2`: Avoid Erroneously Trampling on Match with Worse Dictionary Match
 2018-10-08 17:06:43 -07:00
Yann Collet
f17c1df1ac backtrace support compiled with more conditions 
following #1356,
only enable backtrace compilation on linux+glibc.

Also, disable backtrace by default from "release" compilation,
so that less platforms get impacted by the new requirements.
Can be manually enabled/disabled using BACKTRACE=1/0.
 2018-10-08 17:03:06 -07:00
Yann Collet
4083bdc8f2
Merge pull request #1356 from maxice8/fix-musl 
don't assume __linux__ means __GLIBC__ on BACKTRACES_ENABLE
 2018-10-08 16:43:30 -07:00
W. Felix Handte
b8235be865 Avoid Searching Dictionary in ZSTD_btlazy2 When an Optimal Match is Found 
Bailing here is important to avoid reading past the end of the input buffer.
 2018-10-08 15:59:32 -07:00
W. Felix Handte
d121b3451c Clean Up Debug Log Statements 2018-10-08 15:59:32 -07:00
W. Felix Handte
08da9ad316 Remove Unused Variable 2018-10-08 15:59:32 -07:00
Yann Collet
8fc79fac07 clarify streaming api doc 
as suggested by @indygreg in #1360
 2018-10-08 15:53:29 -07:00
maxice8
1d75697d9b
don't assume __linux__ means __GLIBC__ on BACKTRACES_ENABLE 
check for __GLIBC__ instead of __linux__ as musl libc doesn't provide
execinfo.h

fixes compilation on Alpine Linux and Void Linux musl arches.
 2018-10-05 21:23:45 -03:00
Yann Collet
33d643124d fixed fullbench-lib target 2018-10-04 18:12:36 -07:00
Yann Collet
0854b06d1b
Merge pull request #1351 from facebook/haikubuild 
portability macro flags updates, for Haiku
 2018-10-04 14:59:35 -07:00
Yann Collet
1f8a3df6d8
Merge pull request #1353 from facebook/paramgrill 
fixed paramgrill wrong assert() conditions
 2018-10-04 14:59:14 -07:00
Yann Collet
d4eba30bb3 Merge branch 'dev' of github.com:facebook/zstd into dev 2018-10-04 14:39:35 -07:00
Yann Collet
68bec4c5bb added graph for ZSTD_compress_usingCDict() in v1.3.6 2018-10-04 14:39:11 -07:00
Yann Collet
a9217c93b8
Merge pull request #1352 from facebook/visual 
fixed VS2017Community build script
 2018-10-04 14:30:02 -07:00
Yann Collet
efbc3e823d fixed paramgrill wrong assert() conditions 
and slightly refactored affected function.

Honestly, the formula calculating variance should get a second reviewing round,
it's not clear if it's correct.
 2018-10-04 14:27:13 -07:00
Yann Collet
9ac8f2d7b9 fixed VS2017Community build script 
reported by @epicabsol
 2018-10-03 18:42:44 -07:00
Yann Collet
11cd2ea43d finalized minor warnings on Haiku 2018-10-03 16:37:50 -07:00
Yann Collet
4a85b126d9 changed ZSTD_NANOSLEEP_SUPPORT definition 
to please `-Wexpansion-to-defined`
 2018-10-03 15:34:41 -07:00
Yann Collet
549c19b42e portability macro flags updates, for Haiku 
some non-trivial changes to platform.h and util.h,
initially related to compilation for Haiku,
but I used this opportunity to make them cleaner
and add some documentation.

Noticed several tests that could be improved
(too harsh conditions, useless exception, etc.)
but I did not dare modifying too many tests just before release.
 2018-10-03 14:56:46 -07:00
Yann Collet
bc93b801f0
Merge pull request #1330 from korli/haiku 
Enable building zstd on Haiku.
 2018-10-03 13:36:00 -07:00
Yann Collet
b1407f9acd fixed wrong assert() position 
could fire on invalid input.
blocking for afl tests.
 2018-10-03 12:43:59 -07:00
Yann Collet
63f8fb07ec
Merge pull request #1350 from facebook/fixmsan 
fixed msan warning
 2018-10-03 12:01:45 -07:00
Jerome Duval
87c10e2f58 Enable building zstd on Haiku. 2018-10-03 09:51:56 +02:00
Yann Collet
22ddf3523a fixed msan warning 
on btlazy2 strategy with dictAttach
 2018-10-02 18:20:20 -07:00
Yann Collet
c9843ec232
Merge pull request #1348 from facebook/donotdelete 
Fix #1082
 2018-10-02 16:37:58 -07:00
Yann Collet
3ca6261223 fixed static analyzer warnings 
note : for some reason,
scan-build version on my laptop found problems within fastcover.c
that scan-build on travisCI does not flag.

They are, as usual, false positive :
the analyzer does not understand that a table (`offset`) is correctly filled before usage.
 2018-10-02 15:59:11 -07:00
Yann Collet
d98733b37e restored backtrace on failure 
for Linux and Mac OS-X.

Note : the backtraces fires up through a trap
before the sanitizer get a chance to report.
There are situations where the sanitizer report is actually preferable.

It might be good to consider a kind of build macro
which can disable backtrace
when sanitizer is enabled.
 2018-10-01 17:50:16 -07:00
Yann Collet
8514bd8eb9 updated NEWS in anticipation for v1.3.6 2018-10-01 17:49:18 -07:00
Yann Collet
228c6e5147
Merge pull request #1317 from felixhandte/split-logs 
Independent Dictionary and Working Context Table Logs
 2018-10-01 17:20:12 -07:00
Yann Collet
9012b6cba0 ./zstd -f do no longer overwrite destination file 
if source file does not exist (#1082)
 2018-10-01 17:16:34 -07:00
Yann Collet
c7bd6a41ab zstd -d -f do no longer erase destination file 
when source file does not exist (#1082)
 2018-10-01 14:04:00 -07:00
W. Felix Handte
5b296869df Revert Ability to Set HashLog and ChainLog on Context When Dict is Attached 
This capability is not needed / used in the current unit of work. I'll
re-introduce it later, when we start allowing users to override the deduced
working context logs.
 2018-10-01 13:28:13 -07:00
Yann Collet
1ab71a8e72 regroup name creation logic into its own function 
for a cleaner main file decompression loop
 2018-09-28 18:19:23 -07:00
Yann Collet
69596c0ca6
Merge pull request #1347 from terrelln/werror 
Add -Werror to *build rules
 2018-09-28 17:34:49 -07:00
Yann Collet
918603c9c7
Merge pull request #1346 from terrelln/small-block-fse 
[zstd] Fix resetting FSE tables
 2018-09-28 17:34:27 -07:00
W. Felix Handte
c2369fedc4 Restore Passing CParams to ZSTD_insertAndFindFirstIndex_internal 2018-09-28 17:12:54 -07:00
W. Felix Handte
bad74c4781 Use Working Ctx Logs when not in DMS Mode 
We pre-hash the ptr for the dict match state sometimes. When that actually
happens, a hashlog of 0 can produce undefined behavior (right shift a long
long by 64). Only applies to unoptimized compilations, since when
optimizations are applied, those hash operations are dropped when we're not
actually in dms mode.
 2018-09-28 17:12:54 -07:00
W. Felix Handte
c38acff94f When Attaching Dictionary, Size Working Tables Based on Input Size Only 2018-09-28 17:12:54 -07:00
W. Felix Handte
9d87d50878 Remove Log Overriding for the Time Being 2018-09-28 17:12:54 -07:00
W. Felix Handte
77fd17d93f Remove Strategy-Dependency in Making Attachment Decision 2018-09-28 17:12:54 -07:00
W. Felix Handte
00c088b32d Support Split Logs in ZSTD_btopt..ZSTD_btultra 2018-09-28 17:12:54 -07:00