mikir
63a7f34fee
Separated visibility from LZ4LIB_API macro.
2017-10-30 13:44:24 +01:00
Yann Collet
a31b7058cb
small modification of lz4 decoder to shortcut common case (short branch).
2017-10-25 10:10:53 +02:00
Yann Collet
16a4337473
added hash chain with conditional length
...
not a success yet
2017-10-25 07:07:08 +02:00
Yann Collet
a12cdf00c3
lz4opt: added hash chain search
2017-10-20 17:04:29 -07:00
Yann Collet
fd6bd5107b
switched many types to int
2017-10-20 15:33:52 -07:00
Yann Collet
d813134619
removed SET_PRICE macro
2017-10-20 13:44:49 -07:00
Yann Collet
fa064c8a8c
removed one macro usage
2017-10-20 13:32:45 -07:00
Yann Collet
ee62faee08
minor refactor
...
reduce variable scope
remove one macro usage
2017-10-20 12:05:00 -07:00
Yann Collet
fc879fe170
lz4opt: refactor sequence reverse traversal
2017-10-20 11:32:15 -07:00
Yann Collet
c058753393
refactor variable matchnum
...
separate initial and iterative search
renamed nb_matches
2017-10-20 11:24:56 -07:00
Yann Collet
7bb0a617ee
simplified initial cost conditions
...
llen integrated in opt[]
2017-10-20 11:00:10 -07:00
Yann Collet
6cec68de39
added assert
2017-10-19 16:47:25 -07:00
Yann Collet
ac2ad52257
renamed last_pos into last_match_pos
2017-10-19 16:43:36 -07:00
Yann Collet
708e2cbb60
simplified early exit when single solution
2017-10-19 16:39:40 -07:00
Rei Odaira
73bcf90e51
Use the optimization level of O2 for the decompression functions on ppc64le with gcc, to avoid harmful unrolling and SIMDization with O3
2017-10-13 14:53:37 -05:00
Yann Collet
a4314829db
fused getLongerMatch and getWiderMatch
2017-10-09 01:50:28 -07:00
Yann Collet
97c18f5f0e
re-inserted last byte test in widerMatch
2017-10-09 01:44:05 -07:00
Yann Collet
bdca63ed69
early out is not better
2017-10-09 00:36:47 -07:00
Yann Collet
1ee17e4eb8
optional fuse
2017-10-09 00:31:12 -07:00
Yann Collet
b9459faeb2
improved search of rep-1 patterns
2017-10-08 23:55:42 -07:00
Yann Collet
f1fa91d6fc
insertAndFindBestMatch defers to insertAndGetWiderMatch
2017-10-08 23:40:21 -07:00
Yann Collet
87968517f9
fixed decoding block checksum in lz4frame
2017-10-04 15:24:08 -07:00
Yann Collet
f6b31bf0d0
fix #404
...
static analyzer `cppcheck` complains about a shift-by-32 on a 32 bits value,
which is an undefined behavior.
However, the flagged code path is never triggered in 32-bits mode,
(actually, it's not even generated if DCE kicks in),
the shift-by-32 is necessarily performed on a 64-bits value.
While it doesn't change anything regarding lz4 code generation, for both 32 and 64 bits mode,
(can be checked by md5sum on the generated binary),
the shift has been rewritten in a way which should please this static analyzer,
since it now pretends to shift by 16 on 32-bits cpu (note : it doesn't matter since the code will not even be generated in this case).
Note : this is a blind fix, the new code has not been tested with cppcheck, because cppcheck only works on Windows.
Other static analyzer, such as scan-build, do not trigger this false positive.
2017-09-30 10:35:55 -07:00
Yann Collet
ceb868f442
minor lz4frame code refactor
...
try to improve code readability.
minor optimization on condition to preserve history.
2017-09-23 15:06:24 -07:00
W. Felix Handte
77f7245ea7
Fix Segfault When Copying Dict
...
dctx must have been initialized before we can copy the dictionary in.
2017-09-22 13:20:49 -07:00
Yann Collet
a30cba08f4
fixed a bunch of -Wcomma warnings
...
reported by @rvandermeulen (#398 )
2017-09-10 14:32:38 -07:00
Yann Collet
b500c5282e
fix #397 : decompression failed when using a combination of extDict + low memory address
...
Reported and fixed by @jscheid
Note : we are missing a test case to include it in the CI
2017-09-07 12:48:24 -07:00
Yann Collet
00418f7611
bench : made decompression speed evaluation same time as compression
...
minor : slightly modified an example do avoid disabling a gcc warning through #pragma
2017-09-07 12:12:36 -07:00
Yann Collet
ee5332438b
minor Makefile fixes
2017-09-06 17:41:44 -07:00
Yann Collet
1ad9a36cfb
updated lib/README
...
clarifications, improved wording
2017-09-06 11:22:45 -07:00
Yann Collet
3d260f3522
complementary information for #394
2017-08-30 16:09:10 -07:00
Yann Collet
e3c71584ff
clarified documentation of streaming decompression functions
...
(synchronous bufferless mode)
answering questions by @jtbandes (#394 )
2017-08-30 15:42:04 -07:00
Yann Collet
f212a10ae0
fixed FS-independent file order in /lib
...
identified by @bmwiedemann
2017-08-29 15:31:56 -07:00
Yann Collet
c4d6884cd8
build: source files sorted in a FS independent manner
...
to be more compatible with reproducible builds.
patch inspired by @bmwiedemann
2017-08-26 12:22:51 -07:00
Nick Terrell
252ce14fd2
Don't use C++11 deprecation attribute with clang
...
Clang doesn't accept a C++11 attribute following `LZ4LIB_API`.
Use the GNU attribute instead.
2017-08-24 14:06:34 -07:00
tcpan
f423d016cf
FIX: added prefix to FORCE_INLINE to prevent redefinition error during compilation when used with other libraries that define FORCE_INLINE
2017-08-24 10:14:20 -04:00
Yann Collet
c10863b98e
fix : asan error in dctx, due to increased maximum frame header size, reported by Craig Young
2017-08-17 10:55:30 -07:00
Yann Collet
a1f3a27e9b
Merge branch 'dev' into installVars and fixed conflicts
2017-08-15 16:57:00 -07:00
Yann Collet
af9d72b7f6
Merge pull request #383 from lz4/blockChecksum
...
Block checksum
2017-08-15 16:50:04 -07:00
Yann Collet
8593ba8831
Merge pull request #380 from lz4/dictID
...
Frame Dictionary API
2017-08-15 14:12:04 -07:00
Yann Collet
aea7d521ae
better respect GNU standard Makefile conventions
...
supports lowercase directory variables
add an "Installation" section in README.md
added an INSTALL file
2017-08-14 15:13:23 -07:00
Yann Collet
77f99d2922
restored block checksum capability at lz4frame API level
2017-08-11 17:46:52 -07:00
Yann Collet
757497ae3d
implemented lz4frame decompression API
2017-08-10 16:53:57 -07:00
Yann Collet
4531637ecd
support dictionary compression with independent blocks
2017-08-10 12:12:53 -07:00
Yann Collet
8d597d62d5
fixed gcc prototype warning
2017-08-10 10:28:52 -07:00
Yann Collet
d8aafe2c52
dictionary compression correctly uses compression level
...
Not obvious : copying the state was copying cdict's compression level
2017-08-10 00:48:19 -07:00
Yann Collet
ca2fb166ab
fixed C++ conversion warnings
2017-08-09 18:22:26 -07:00
Yann Collet
bf8daa2fd5
fixed uninitialization error in lz4frame
2017-08-09 18:00:48 -07:00
Yann Collet
31f2cdf4d2
implemented dictionary compression in lz4frame
...
note : only compression API is implemented and tested
still to do : decompression API
2017-08-09 16:51:19 -07:00
Yann Collet
a82dadfbae
added dictID inside LZ4F_frameInfo_t
...
Compressor can set dictID on LZ4F_compressBegin()
Decompressor can retrieve it using LZ4F_getFrameInfo()
2017-08-08 17:43:11 -07:00
Alex Deymo
76ef6d0ab0
Allow to predefine FORCE_INLINE macro.
...
FORCE_INLINE macro is defined based on the compiler used. When using
gcc, it will include "__attribute__((always_inline))" forcing gcc to
always inline all the functions marked as FORCE_INLINE. However, this
can cause a performance degradation of about 15%.
This patch allows to set the FORCE_INLINE macro from the compiler
command line to either "static" or "static inline" giving allowing it
to inline functions as needed when performing optimizations.
2017-08-07 10:34:33 +02:00
Ido Rosen
8aeaf6bb3a
Fix typos preventing installation of static lib.
2017-08-01 00:48:58 -04:00
Yann Collet
6ad3a983db
fix #369
...
The bug would make the bt search read one byte in an invalid memory region,
and make a branch decision based on its value.
Impact was small (missed compression opportunity).
It only happens in -BD mode, with extDict-prefix overlapping matches.
The bt match search is supposed to work also in extDict mode.
In which case, the match ptr can point into Dict.
When the match was overlapping Dict<->Prefix,
match[matchLength] would end up outside of Dict, in an invalid memory area.
The correction ensures that in such a case,
match[matchLength] ends up at intended location, inside prefix.
2017-06-26 11:29:05 -07:00
Chocobo1
a4ec7fa7b7
Fix gcc7 Wimplicit-fallthrough warnings
...
For the default Wimplicit-fallthrough=3 level,
the comment should start with "fall*"
2017-06-19 13:57:35 +08:00
Yann Collet
89b9f026c9
made level 10 a bit faster
...
at the expense of a little bit of compression ratio.
Now speed is intermediate on calgary corpus :
25 - 12 - 8 - 3
2017-06-13 17:25:29 -07:00
Yann Collet
bfc1806605
clarified lz4frame api comment ( #350 )
2017-06-13 12:35:00 -07:00
Yann Collet
139a387d17
updated NEWS
2017-06-12 10:54:59 -07:00
Yann Collet
e60cbb5cac
added test for LZ4F_resetDecompressionContext()
2017-05-10 16:28:36 -07:00
Yann Collet
a902127613
bumped version number to 1.8.0
...
due to addition of prototype
LZ4F_resetDecompressionContext()
2017-05-10 13:27:18 -07:00
Yann Collet
b8575f2d2b
updated Makefile
...
to automatically build manual files with
make all
2017-05-10 13:26:04 -07:00
Yann Collet
fe932c4527
expose LZ4F_resetDecompressionContext()
2017-05-10 12:25:05 -07:00
Yann Collet
1efa48831e
minor readability changes
2017-05-02 12:01:13 -07:00
Yann Collet
a8dd86d93e
changed macro HEAPMODE into LZ4_HEAPMODE
...
This macro is susceptible to be triggered from user side
typically through compiler flag (-DLZ4_HEAPMODE=1).
In which case, it makes sense to prefix the macro
since we want to reduce potential side-effect on namespace.
2017-05-01 22:32:21 -07:00
Alexey Tourbin
6cf1f7d758
lz4hc.c: clamp compression levels > 12
...
I noticed that, while 'lz4 -12' works fine, 'lz4 -13' does not compress
at all.
$ cat </etc/passwd |wc -c
2565
$ lz4 -12 </etc/passwd |wc -c
1456
$ lz4 -13 </etc/passwd |wc -c
2584
Perhaps the best way to fix this is to clamp the compression level
in the LZ4HC_compress_generic routine.
2017-04-29 16:33:15 +03:00
Alexey Tourbin
f3460fc148
liz4hc.h: fix a comment: LZ4HC_MAX_CLEVEL -> LZ4HC_CLEVEL_MAX
2017-04-29 16:06:45 +03:00
Nick Terrell
0b3e807043
[LZ4F] Allow users to disable LZ4F_DEPRECATE
2017-04-26 10:03:23 -07:00
Yann Collet
e2c9b19122
lz4frame : Added negative compression levels
2017-04-09 01:41:36 -07:00
Yann Collet
7eecd32c07
ensure lz4f_cctx internal buffer size remain valid in case of malloc error
2017-04-09 01:11:39 -07:00
Yann Collet
e169edac05
lz4frame : control lz4 context creation success
2017-04-08 18:27:31 -07:00
Yann Collet
e2827775ee
make __packed memory access default for gcc
...
It's always as good or better then memcpy()
but depends on gcc-specific extension.
solves https://github.com/facebook/zstd/issues/620
2017-03-30 12:22:17 -07:00
Yann Collet
6226d52eab
fixed minor Visual warning
2017-03-29 14:18:10 -07:00
Yann Collet
b88df6b1b0
Improved comments on LZ4F_getFrameInfo()
...
and added LZ4F_resetCompressionContext()
2017-03-29 12:51:08 -07:00
Yann Collet
f0a7651fce
Safer LZ4_getFrameInfo()
...
LZ4_getFrameInfo() is now guaranteed to keep dctx state clean,
even in case of failure.
2017-03-28 17:10:01 -07:00
Yann Collet
4567d0def5
Merge pull request #340 from lz4/optlz4opt
...
lz4opt
2017-03-24 17:10:45 -07:00
Yann Collet
38362c1d65
Merge pull request #338 from ldv-alt/dev
...
Export deprecated symbols declared in lz4hc.h
2017-03-24 12:03:32 -07:00
Yann Collet
60b6d2907f
improved level 10 speed for degenerated cases
2017-03-24 11:29:35 -07:00
Yann Collet
8f8fc52fcf
Merge branch 'dev' into optlz4opt
2017-03-24 11:00:40 -07:00
Yann Collet
0863931a1c
fixed API comment for LZ4F_createCompressionContext()
...
as reported by @nh2
2017-03-24 10:34:18 -07:00
Dmitry V. Levin
dab3590fce
Export deprecated symbols declared in lz4hc.h
...
Commit 25b2435885
2017-03-24 03:12:48 +00:00
Yann Collet
68044acfec
Merge branch 'optlz4opt' of github.com:Cyan4973/lz4 into optlz4opt
2017-03-20 09:58:00 -07:00
Yann Collet
b8bc70022b
minor refactor
2017-03-20 05:04:12 -07:00
Yann Collet
cea8f60df1
slight btopt speed improvement
...
removing a useless test
2017-03-20 02:33:02 -07:00
Yann Collet
f513020a6d
slight btopt speed improvement
...
removing a useless test
2017-03-17 18:07:53 -07:00
Yann Collet
8bd32a17b1
made SET_PRICE macro more usable
...
previous version would use argument to also change target member.
Now, only values are transferred
2017-03-17 17:42:47 -07:00
Yann Collet
118b47f3d1
improved lz4opt speed (~4%)
2017-03-17 16:53:35 -07:00
Yann Collet
eff6166eb8
minor price function optimization
2017-03-17 15:51:21 -07:00
Yann Collet
0d073d4d28
added extern C for lz4.h static section
...
should make the file more compatible with C++ compiler, such as Visual or g++
2017-03-17 15:11:09 -07:00
Yann Collet
aae447fffd
LZ4_compress_HC_continue_destSize() works as intended up to level 10
...
It's incompatible with btopt though,
so cLevel >= 11 feature much reduced performance (degraded mode)
2017-03-16 15:41:30 -07:00
Yann Collet
cd35f0d98c
LZ4_compress_HC_destSize() uses LZ4HC_compress_generic() code path
...
Limits compression level to 10,
to remain compatible with Hash Chain.
2017-03-16 15:10:38 -07:00
Yann Collet
6b2a1b3606
updated lz4 version number
2017-03-16 02:24:46 -07:00
Yann Collet
430b7d32b3
created LZ4_HC_STATIC_LINKING_ONLY section
...
where are exposed new prototypes *_destSize()
2017-03-16 02:16:24 -07:00
Yann Collet
e945a27f9c
fix #333 : expose obsolete decoding functions
...
with deprecation warning.
notified by Chen Yufei
2017-03-14 21:21:54 -07:00
Yann Collet
b9132bedcd
Merge pull request #331 from ldv-alt/dev
...
Export only those symbols that are part of public API
2017-03-12 03:16:23 -07:00
Dmitry V. Levin
883ebdcee0
Export only those symbols that are part of public API
...
Specify -fvisibility=hidden parameter when linking the shared library
using -fPIC, assuming that gcc >= 4 is used.
This change results to unexporting of the following 42 functions:
LZ4F_getErrorCode
LZ4_XXH32
LZ4_XXH32_canonicalFromHash
LZ4_XXH32_copyState
LZ4_XXH32_createState
LZ4_XXH32_digest
LZ4_XXH32_freeState
LZ4_XXH32_hashFromCanonical
LZ4_XXH32_reset
LZ4_XXH32_update
LZ4_XXH64
LZ4_XXH64_canonicalFromHash
LZ4_XXH64_copyState
LZ4_XXH64_createState
LZ4_XXH64_digest
LZ4_XXH64_freeState
LZ4_XXH64_hashFromCanonical
LZ4_XXH64_reset
LZ4_XXH64_update
LZ4_XXH_versionNumber
LZ4_compressHC
LZ4_compressHC2
LZ4_compressHC2_continue
LZ4_compressHC2_limitedOutput
LZ4_compressHC2_limitedOutput_continue
LZ4_compressHC2_limitedOutput_withStateHC
LZ4_compressHC2_withStateHC
LZ4_compressHC_continue
LZ4_compressHC_limitedOutput
LZ4_compressHC_limitedOutput_continue
LZ4_compressHC_limitedOutput_withStateHC
LZ4_compressHC_withStateHC
LZ4_compress_fast_force
LZ4_compress_forceExtDict
LZ4_createHC
LZ4_decompress_safe_forceExtDict
LZ4_freeHC
LZ4_resetStreamStateHC
LZ4_sizeofStreamStateHC
LZ4_slideInputBufferHC
LZ4_uncompress
LZ4_uncompress_unknownOutputSize
2017-03-10 23:35:30 +00:00
Dmitry V. Levin
25b2435885
Export deprecated symbols
...
Deprecated symbols are still a part of ABI and have to be exported,
so mark them with LZ4LIB_API attribute.
2017-03-10 23:35:30 +00:00
Dmitry V. Levin
7aeecbff71
Explicitly set visibility of public API functions when gcc is used
...
Windows builds already limit exporting of functions to those marked
with LZ4LIB_API tag. The same behaviour could be achieved on other
platforms when a relatively fresh gcc is used.
This change assigns public visibility to all symbols marked with
LZ4LIB_API tag. When the library is built in -fvisibility=hidden
mode, only these marked symbols will be exported.
2017-03-10 23:35:30 +00:00
remittor
36842ebb19
lz4hc: Fix LZ4HC_compress_hashChain for backward compatibility
2017-03-09 12:19:24 +03:00
remittor
baa155088b
lz4hc: Fix LZ4HC_compress_hashChain for full support destSize variant
2017-03-08 18:49:55 +03:00
remittor
f007153e3f
lz4hc: Add LZ4_compressHC_destSize and LZ4_compress_HC_continue_destSize
2017-03-08 11:11:15 +03:00
remittor
45b592b7ec
lz4hc: Cleanup function LZ4HC_encodeSequence
2017-03-08 00:30:54 +03:00
