lz4/lib
Alexander Gallego e68c7d3878 avoid computing 0 offsets from null pointers
Similar work in the kernel:
https://patchwork.kernel.org/patch/11351499/

UBsan (+clang-10) complains about doing pointer arithmetic (adding 0)
to a nullpointer.

This patch is tested with clang-10+ubsan
2020-07-08 08:30:07 -07:00
..
dll/example Windows: create import library with gcc directly, remove now useless def file 2018-12-02 18:50:18 +01:00
.gitignore lz4 version source from lz4.h 2016-09-02 22:04:16 -07:00
liblz4-dll.rc.in More build imrpvements 2019-04-23 07:44:00 -04:00
liblz4.pc.in lz4 version source from lz4.h 2016-09-02 22:04:16 -07:00
LICENSE added a few dates 2016-11-21 15:51:39 -08:00
lz4.c avoid computing 0 offsets from null pointers 2020-07-08 08:30:07 -07:00
lz4.h bumped version number to v1.9.2 2019-07-01 09:01:43 -07:00
lz4frame_static.h Integrate lz4frame_static.h Declarations into lz4frame.h 2018-04-24 16:22:28 -04:00
lz4frame.c [lz4frame] Fix unused variable warnings in fuzzing mode 2019-07-19 14:44:06 -07:00
lz4frame.h Add multiframe report to --list command 2019-05-15 21:13:19 +01:00
lz4hc.c fix malloc handling 2020-02-03 16:50:02 +03:00
lz4hc.h ensure lz4.h can be included with or without LZ4_STATIC_LINKING_ONLY in any order 2019-05-29 12:21:14 -07:00
Makefile lib/Makefile: Fix detection of Darwin. 2019-04-24 03:13:19 +08:00
README.md ensure conformance with custom LZ4_DISTANCE_MAX 2019-07-15 12:11:34 -07:00
xxhash.c updated xxhash to latest version 2018-09-18 12:14:26 -07:00
xxhash.h updated xxhash to latest version 2018-09-18 12:14:26 -07:00

LZ4 - Library Files

The /lib directory contains many files, but depending on project's objectives, not all of them are necessary.

Minimal LZ4 build

The minimum required is lz4.c and lz4.h, which provides the fast compression and decompression algorithms. They generate and decode data using the LZ4 block format.

High Compression variant

For more compression ratio at the cost of compression speed, the High Compression variant called lz4hc is available. Add files lz4hc.c and lz4hc.h. This variant also compresses data using the LZ4 block format, and depends on regular lib/lz4.* source files.

Frame support, for interoperability

In order to produce compressed data compatible with lz4 command line utility, it's necessary to use the official interoperable frame format. This format is generated and decoded automatically by the lz4frame library. Its public API is described in lib/lz4frame.h. In order to work properly, lz4frame needs all other modules present in /lib, including, lz4 and lz4hc, and also xxhash. So it's necessary to include all *.c and *.h files present in /lib.

Advanced / Experimental API

Definitions which are not guaranteed to remain stable in future versions, are protected behind macros, such as LZ4_STATIC_LINKING_ONLY. As the name implies, these definitions can only be invoked in the context of static linking only. Otherwise, dependent application may fail on API or ABI break in the future. The associated symbols are also not present in dynamic library by default. Should they be nonetheless needed, it's possible to force their publication by using build macro LZ4_PUBLISH_STATIC_FUNCTIONS.

Build macros

The following build macro can be selected at compilation time :

  • LZ4_FAST_DEC_LOOP : this triggers the optimized decompression loop. This loops works great on x86/x64 cpus, and is automatically enabled on this platform. It's possible to enable or disable it manually, by passing LZ4_FAST_DEC_LOOP=1 or 0 to the preprocessor. For example, with gcc : -DLZ4_FAST_DEC_LOOP=1, and with make : CPPFLAGS+=-DLZ4_FAST_DEC_LOOP=1 make lz4.

  • LZ4_DISTANCE_MAX : control the maximum offset that the compressor will allow. Set to 65535 by default, which is the maximum value supported by lz4 format. Reducing maximum distance will reduce opportunities for LZ4 to find matches, hence will produce a worse compression ratio. However, a smaller max distance can allow compatibility with specific decoders using limited memory budget. This build macro only influences the compressed output of the compressor.

  • LZ4_DISABLE_DEPRECATE_WARNINGS : invoking a deprecated function will make the compiler generate a warning. This is meant to invite users to update their source code. Should this be a problem, it's generally possible to make the compiler ignore these warnings, for example with -Wno-deprecated-declarations on gcc, or _CRT_SECURE_NO_WARNINGS for Visual Studio. Another method is to define LZ4_DISABLE_DEPRECATE_WARNINGS before including the LZ4 header files.

Amalgamation

lz4 source code can be amalgamated into a single file. One can combine all source code into lz4_all.c by using following command:

cat lz4.c lz4hc.c lz4frame.c > lz4_all.c

(cat file order is important) then compile lz4_all.c. All *.h files present in /lib remain necessary to compile lz4_all.c.

Windows : using MinGW+MSYS to create DLL

DLL can be created using MinGW+MSYS with the make liblz4 command. This command creates dll\liblz4.dll and the import library dll\liblz4.lib. To override the dlltool command when cross-compiling on Linux, just set the DLLTOOL variable. Example of cross compilation on Linux with mingw-w64 64 bits:

make BUILD_STATIC=no CC=x86_64-w64-mingw32-gcc DLLTOOL=x86_64-w64-mingw32-dlltool OS=Windows_NT

The import library is only required with Visual C++. The header files lz4.h, lz4hc.h, lz4frame.h and the dynamic library dll\liblz4.dll are required to compile a project using gcc/MinGW. The dynamic library has to be added to linking options. It means that if a project that uses LZ4 consists of a single test-dll.c file it should be linked with dll\liblz4.dll. For example:

    $(CC) $(CFLAGS) -Iinclude/ test-dll.c -o test-dll dll\liblz4.dll

The compiled executable will require LZ4 DLL which is available at dll\liblz4.dll.

Miscellaneous

Other files present in the directory are not source code. There are :

  • LICENSE : contains the BSD license text
  • Makefile : make script to compile and install lz4 library (static and dynamic)
  • liblz4.pc.in : for pkg-config (used in make install)
  • README.md : this file

License

All source material within lib directory are BSD 2-Clause licensed. See LICENSE for details. The license is also reminded at the top of each source file.