Sean Purcell
0f7bd772e6
Update seekable API to simplify IO
2017-04-18 16:48:30 -07:00
Sean Purcell
9626cf1ac6
Address @terrelln's comments
2017-04-13 17:48:35 -07:00
Sean Purcell
2785b28e05
Reduce the limit on frame decompressed size to 2 GB
2017-04-12 14:09:13 -07:00
Sean Purcell
5ee1135f30
s/chunk/frame/
2017-04-12 11:15:50 -07:00
Sean Purcell
e80f1d74b3
Address PR comments and minor fixes
2017-04-12 11:15:46 -07:00
Sean Purcell
d048fefef7
Move seekable format content to /contrib
2017-04-11 14:38:56 -07:00
Nick Terrell
b633377d0e
Add BtrFS benchmarks
2017-04-11 12:40:53 -07:00
Nick Terrell
b4dd3378f1
Add BtrFS patch for 4.10 kernel
2017-04-11 11:50:24 -07:00
Nick Terrell
adb1974aec
Switch comments to kernel style + limit to 80 cols
2017-04-10 16:52:59 -07:00
Nick Terrell
bed6c0a4b0
Remove ZSTDLIB_API from decompress.c
2017-04-10 14:49:34 -07:00
Yann Collet
b5b79b3942
Merge pull request #647 from terrelln/linux
...
Add linux kernel modules to contrib/
2017-04-05 07:35:48 -07:00
Nick Terrell
9c7371b3ee
Improve comments and ordering
2017-04-04 19:02:28 -07:00
Nick Terrell
97693aff98
Add a README
2017-04-04 18:39:22 -07:00
Nick Terrell
7f510a7797
Add Kconfig and Makefile diffs
2017-04-04 18:37:55 -07:00
Nick Terrell
60b34b0d1c
fix gitignore
2017-04-04 18:15:21 -07:00
Nick Terrell
bb213798d9
Rename zstd_(de)compress.c to (de)compress.c
2017-04-04 18:09:02 -07:00
Nick Terrell
1b3856463e
Undef current if defined
2017-04-04 17:21:49 -07:00
Nick Terrell
c53bacc881
Fix up some old names
2017-04-04 17:03:48 -07:00
Nick Terrell
2e4dbd2105
Really move the makefile
2017-04-04 17:02:28 -07:00
Nick Terrell
5859101396
Move Makefile to lib/zstd
2017-04-04 17:00:12 -07:00
Nick Terrell
d0bbceac40
Add fs/btrfs/zstd.c
2017-04-04 16:56:52 -07:00
Nick Terrell
2eb623a6eb
Explicitly convert scratchBuffer to unsigned*
2017-04-04 16:38:13 -07:00
Nick Terrell
fd95be0ade
Move sources to lib/zstd/
2017-04-04 16:30:11 -07:00
Nick Terrell
1af700ea43
Remove unused FSE/HUF functions
2017-04-04 16:22:58 -07:00
Nick Terrell
dd62829ccf
Remove more restrict
2017-04-04 15:55:48 -07:00
Nick Terrell
9c257dc268
Fix up xxhash
2017-04-04 15:54:39 -07:00
Nick Terrell
0888251fb1
Switch intptr_t to ptrdiff_t
2017-04-04 15:49:38 -07:00
Nick Terrell
675839254d
Move zstd.h to linux/zstd.h
2017-04-04 15:44:27 -07:00
Nick Terrell
b06507221e
Test module macros
2017-04-04 12:56:44 -07:00
Nick Terrell
b1b582b9fa
Add module macros
2017-04-04 12:56:35 -07:00
Nick Terrell
b5e3e3c9a8
Add zstd kernel module Makefile
2017-04-04 12:10:47 -07:00
Nick Terrell
79298bf187
Add userland test with mock kernel headers
2017-04-04 11:53:22 -07:00
Nick Terrell
33fc0ad56a
Fix ZSTD_createCStream_usingCDict() and ZSTD_compress_usingCDict()
2017-04-04 11:52:49 -07:00
Nick Terrell
87cec8fd56
Fix compilation errors
2017-04-03 16:08:20 -07:00
Nick Terrell
59aadc85dc
Preallocate workSpace for cctx and combine create and init for cstream
2017-04-03 15:23:09 -07:00
Nick Terrell
21b6c53b9f
Working on API
2017-03-31 18:07:32 -07:00
Nick Terrell
e48b135521
Remove STATIC_LINKING_ONLY defines
2017-03-30 14:54:33 -07:00
Nick Terrell
6ce58897da
Use <asm/unaligned.h> for unaligned memory access
2017-03-30 14:53:57 -07:00
Nick Terrell
be7da5d98b
Change stdlib includes to linux includes
2017-03-30 14:53:52 -07:00
Nick Terrell
b3b41d0f6d
Remove platform specific macros
2017-03-30 14:53:23 -07:00
Nick Terrell
1075c12078
Convert all spaces to tabs
2017-03-30 14:49:45 -07:00
Nick Terrell
78063ca2bd
spaces to tabs
2017-03-30 14:47:42 -07:00
Nick Terrell
b1c6bb8702
Copy files into contrib/linux-kernel/
2017-03-30 14:47:35 -07:00
Yann Collet
6851db48e0
created contrib/cleanTabs
2017-03-30 12:42:44 -07:00
Sean Purcell
793e7bb6dd
Add symbolic link checking to pzstd
2017-03-23 12:41:51 -07:00
Yann Collet
7e35b352c6
Merge pull request #602 from iburinoc/doc
...
Add functions missing from manual, and fix parameter alignment
2017-03-14 14:08:41 -07:00
Sean Purcell
dec2b96536
Add functions missing from manual, and fix parameter alignment
2017-03-14 11:24:09 -07:00
Sean Purcell
120df494e9
Update builds to not support legacy v01-v03
2017-03-13 14:44:08 -07:00
Pádraig Brady
38a3428b37
support -Werror=format-security
...
Fedora now enables this option by default, resulting
in the following build failure:
Logging.h: In instantiation of
'void pzstd::Logger::operator()(int, const char*, Args ...)
Pzstd.cpp:413:48: required from here
Logging.h:46:17: error: format not a string literal and no format arguments
[-Werror=format-security]
std::fprintf(out_, fmt, args...);
~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~
2017-03-05 19:42:51 -08:00
Sean Purcell
822c7187d4
Merge branch 'dev' into doc
2017-02-23 15:23:24 -08:00
Yann Collet
7e224ea03e
Merge pull request #562 from iburinoc/testcorpus
...
Create a tool that generates random, valid, Zstd frames for decoder testing
2017-02-23 15:19:36 -08:00
Sean Purcell
1d1932480e
Move educational_decoder to doc/ and add doc README
...
- Also make some minor bugfixes to educational decoder
2017-02-23 14:34:52 -08:00
Yann Collet
db478ad27e
Merge pull request #558 from facebook/manual
...
Manual
2017-02-23 13:39:36 -08:00
Sean Purcell
3cd8d50c34
Update CLI and link from educational decoder
2017-02-23 13:06:50 -08:00
Yann Collet
508404514c
added manual target to contrib/gen_html/Makefile
2017-02-22 00:57:50 -08:00
Przemyslaw Skibinski
346ce32ade
legacy.c: fix memory leaks
2017-02-21 20:10:21 +01:00
Przemyslaw Skibinski
d8114e5802
zstd_compress.c: fix memory leaks
2017-02-21 18:59:56 +01:00
Przemyslaw Skibinski
684858e7b7
fix memory leaks
2017-02-21 18:17:24 +01:00
Dima Krasner
107c9a4e42
Moved to contrib
2017-02-18 23:30:57 +02:00
Sean Purcell
0f5c95af44
Disambiguate pledgedSrcSize == 0
...
- Modify ZSTD CLI to only set contentSizeFlag if it _knows_ the size
- Change pzstd to stop setting contentSizeFlag without accurate pledgedSrcSize
2017-02-08 15:12:46 -08:00
Sean Purcell
eb52dbd4fe
Minor changes to educational decoder
2017-02-07 14:44:11 -08:00
Sean Purcell
f191be2fe6
Inlined portions of specification for clarity
2017-02-03 18:04:00 -08:00
Sean Purcell
18ce8b54dd
Switch IO to go through streams
2017-02-03 15:22:52 -08:00
Sean Purcell
823d8c233b
Minor security fixes
2017-02-01 10:41:04 -08:00
Sean Purcell
92ec2ea62f
More const's and readability improvements
2017-01-31 15:57:18 -08:00
Sean Purcell
f5d2f32d4d
Removed circular buffer, matches access destination buffer directly
2017-01-31 15:54:55 -08:00
Sean Purcell
f231626244
Minor fixes according to comments
...
- Add Facebook copyright notice
- Make max size macros more consistent
- Fix some unchecked malloc's
2017-01-30 15:00:19 -08:00
Sean Purcell
5657e0e07d
Added ZSTD_get_decompressed_size
...
Since this implementation handles multiple concatenated frames,
to determine decompressed size we must traverse the entire input,
checking each frame's frame_content_size field
2017-01-30 14:56:29 -08:00
Sean Purcell
9700f92583
Add educational decoder to /contrib
2017-01-30 11:44:43 -08:00
Nick Terrell
5cf84a05e7
Revert unnecessary change to Logging.h
2017-01-27 13:26:44 -08:00
Nick Terrell
58f499c41e
Clean imports and shorten tests
2017-01-27 10:43:18 -08:00
Nick Terrell
9c018cc140
Add BUCK files for Nuclide support
2017-01-27 10:43:12 -08:00
Chocobo1
37a2fb4ce1
Move -std=c++11 cxxflag to PZSTD_CXXFLAGS
...
Fixes the problem that the compiler doesn't enable c++11 mode by default
and the package build system has its own CXXFLAGS
2016-12-26 23:08:23 +08:00
Dimitry Andric
83cc2fb083
Enable using isatty() and nanosleep() on *BSD
2016-12-12 19:24:51 +01:00
Przemyslaw Skibinski
4da53219a0
zstd Manual updated to 1.1.2
2016-12-07 11:18:40 +01:00
Przemyslaw Skibinski
abd9ec0d53
gen_html: comments of type /*= and /**= can be longer than a single line
2016-12-07 11:13:20 +01:00
Yann Collet
379908be3d
fixed zstd.h for manual
2016-12-06 10:36:15 -08:00
Nick Terrell
bcd61586a8
[pzstd] Cast unused parameters to void
2016-11-15 17:46:28 -08:00
Nick Terrell
f147fccd0c
[pzstd] Fix frame size for small files + add logging
2016-11-15 16:39:09 -08:00
Nick Terrell
324c8ab000
[pzstd] Remove gtest dependency from make all
2016-11-14 11:56:28 -08:00
Nick Terrell
4bafb5aa97
The static library was moved to libzstd.a
2016-11-03 11:32:45 -07:00
Przemyslaw Skibinski
f882e132cf
added gen-zstd-manual.sh
2016-10-31 10:51:58 +01:00
Yann Collet
03982b5ddb
Merge pull request #434 from terrelln/dev
...
Pzstd Improvements
2016-10-28 20:27:59 -07:00
Nick Terrell
25086d9bc6
[pzstd] Move -I flags to PZSTD_CPPFLAGS
2016-10-28 14:24:15 -07:00
Nick Terrell
ac4310d303
[pzstd] Fix test mode for streaming input
2016-10-26 00:09:39 -07:00
Przemyslaw Skibinski
86d9424c81
added doc\zstd_manual.html
2016-10-24 16:07:53 +02:00
Przemyslaw Skibinski
984b66cd72
added contrib\gen_html
2016-10-24 15:59:51 +02:00
Nick Terrell
8c6c686d0a
[pzstd] Fix lantent bug in WorkQueue::push()
2016-10-14 15:26:56 -07:00
Nick Terrell
baa152e56e
[pzstd] Add Logger class
2016-10-14 15:26:55 -07:00
Nick Terrell
e9e151ce31
[pzstd] Reuse ZSTD_{C,D}Stream
2016-10-14 15:26:55 -07:00
Nick Terrell
48294b57c3
[pzstd] Put ErrorHolder into SharedState
2016-10-14 15:26:55 -07:00
Nick Terrell
9b603ee284
[pzstd] Run the reading thread separately
2016-10-14 15:26:55 -07:00
Nick Terrell
96e0702c00
[pzstd] Print the correct width ints
2016-10-14 15:26:55 -07:00
Nick Terrell
8b4e84249b
[pzstd] Fix Makefile
2016-10-14 15:26:50 -07:00
Nick Terrell
87629978d3
[pzstd] Fix latent bug in WorkQueue
2016-10-06 15:51:58 -07:00
Pádraig Brady
0dd8071e2e
pzstd: fix test failure on headless build
...
Remove this test as pass/fail status is
dependent on whether I/O is connected to a tty.
It currrently passes on a tty but fails on
a package build system for example.
2016-10-06 22:38:27 +01:00
Nick Terrell
b0f6d73002
[pzstd] Remove empty else statement
2016-10-06 12:58:23 -07:00
Nick Terrell
5fa71396e0
[pzstd] Fix typo in readme
2016-10-06 12:45:47 -07:00
inikep
0ff0f2a259
Merge remote-tracking branch 'refs/remotes/facebook/dev' into zlibWrapper
2016-09-26 20:57:01 +02:00
Yann Collet
02c17e18d8
Merge pull request #387 from terrelln/display
...
[pzstd] Print (de)compression results
2016-09-24 11:52:29 +02:00
Nick Terrell
3980167488
[pzstd] Add status update for MB written
2016-09-23 15:47:26 -07:00
Nick Terrell
dac0376908
[pzstd] Add header required for Visual Studios
2016-09-23 14:38:25 -07:00
Nick Terrell
d249889b9f
[pzstd] Print (de)compression results
2016-09-23 13:42:50 -07:00
Nick Terrell
e5b60e859b
[pzstd] Update README to reflect new CLI
2016-09-23 13:07:54 -07:00
inikep
611cd094d1
typo in pzstd
2016-09-23 21:14:37 +02:00
Nick Terrell
5ca471990b
[pzstd] Spawn less threads in tests
...
MinGW thread performance degrades significantly when there are
a lot of threads, so limit the number of threads spawned to ~10.
2016-09-22 18:59:22 -07:00
Nick Terrell
5eaf5da723
[pzstd] Turn on warnings + quiet them
2016-09-22 16:12:29 -07:00
Nick Terrell
0a5910b23b
[pzstd] Fix and test 32 bit support
2016-09-21 17:47:09 -07:00
Nick Terrell
5c9adff7f8
[pzstd] Check if input is a directory
2016-09-21 16:25:08 -07:00
Nick Terrell
f1073c1da7
[pzstd] Fix invalid argument message
2016-09-21 16:04:44 -07:00
Nick Terrell
1c209a4feb
[pzstd] Reduce memory usage to 60-75% of previous
2016-09-21 15:12:23 -07:00
Nick Terrell
254c5b1692
[pzstd] Make CLI compatible with zstd
2016-09-21 14:29:47 -07:00
Nick Terrell
4d4d1ad3b3
Fix minor potential narrowing bug
2016-09-06 20:27:11 -07:00
Nick Terrell
823bf3d08d
Fix invalid narrowing conversion to size_t
2016-09-06 20:11:02 -07:00
Nick Terrell
4db9fbdec7
[pzstd] Compile with minGW 64
2016-09-06 14:00:20 -07:00
Nick Terrell
378d12bb0c
[pzstd] Changes to compile on VS2015
2016-09-06 12:43:07 -07:00
Nick Terrell
4c202815c7
[pzstd] Smart default # of threads ( #331 )
2016-09-06 12:41:36 -07:00
Nick Terrell
9622fe499d
Fix memory usage issues.
2016-09-02 20:11:22 -07:00
Nick Terrell
64c1c065cc
Add optional max size to work queue
2016-09-02 13:53:23 -07:00
Nick Terrell
2fcf8a4b99
Update tests to reflect new default options
2016-09-02 12:59:14 -07:00
Nick Terrell
ac14348a28
When reading from stdin, write to stdout by default
2016-09-02 12:35:36 -07:00
Nick Terrell
1e2f6a1f5d
Clean up compiler warnings + Build pzstd on travis
2016-09-02 12:23:49 -07:00
Nick Terrell
2ebe1cf732
Put libzstd last
2016-09-01 21:12:39 -07:00
Nick Terrell
7bf8c4d7ff
Add zstd/lib in includes
2016-09-01 20:53:34 -07:00
Nick Terrell
724e3d534f
Put linker -l commands at the end
2016-09-01 20:45:55 -07:00
Nick Terrell
7aa7e5aaab
Merge remote-tracking branch 'upstream/dev' into dev
2016-09-01 18:27:18 -07:00
Nick Terrell
7df55e17e9
Fix up Makefiles, and fix include issues compiling with gcc
2016-09-01 18:26:19 -07:00
Yann Collet
c53926c077
Merge branch 'dev' of github.com:Cyan4973/zstd into dev
2016-09-01 18:11:43 -07:00
Yann Collet
5153a084f3
zbufftest only depends on standard C time.h
2016-09-01 18:11:12 -07:00
Nick Terrell
bff1c92c87
Minor tweaks to pzstd graph
2016-09-01 17:53:23 -07:00
Nick Terrell
2741677a8d
Update scale for compression speed graph
2016-09-01 17:43:07 -07:00
Nick Terrell
2b0830b067
Randomize tests so travis-ci tests can check for existing failures
2016-09-01 16:39:45 -07:00
Nick Terrell
040cfd8e7d
Get ready to add tests to travis-ci
2016-09-01 16:21:19 -07:00
Nick Terrell
4c3b1881f2
Remove old benchmark code
2016-09-01 15:32:10 -07:00
Nick Terrell
f381d2d39c
Fix small README things
2016-09-01 15:30:36 -07:00
Nick Terrell
c932520960
Add PZstandard to contrib/
2016-09-01 15:25:31 -07:00
inikep
33b8a893ed
CMake project moved to projects
2016-05-24 17:44:14 +02:00
inikep
63ecd747de
added common/entropy_common.c
2016-05-13 11:27:56 +02:00
inikep
aaaf923a17
common/util.h moved to programs/util.h
...
decompress/fse_decompress.c moved to common/
2016-05-09 16:19:25 +02:00
inikep
a1febea01d
Error functions moved to common/zstd_common.c
2016-04-22 17:14:25 +02:00
inikep
d6be2751a8
updated CMakeLists.txt
2016-04-22 13:59:21 +02:00
Yann Collet
62ae5fb0d2
zstd_buffered => zbuff
2016-02-12 18:59:11 +01:00
Yann Collet
e0a3084d30
fixed cmake
2016-02-12 18:48:07 +01:00
Yann Collet
883a67eee2
fixed cmake
2016-02-12 03:50:05 +01:00
Yann Collet
dd283b1f4f
fixed cmake
2016-01-21 16:08:01 +01:00
Artyom Dymchenko
52197bcd32
CMake minimal version 2.8.7 test
2016-01-13 00:18:49 +06:00
Artyom Dymchenko
0b7c10121e
CMake 2.8.8 final test;
2016-01-11 23:40:16 +06:00
Artyom Dymchenko
a207930d30
CMake 2.8.11 with travis test;
2016-01-11 23:03:55 +06:00
Artyom Dymchenko
706ced3553
CMake check version test;
2016-01-11 22:50:57 +06:00
Artyom Dymchenko
1e0081699b
travis and CMake 2.8.8 installation test;
2016-01-11 21:39:42 +06:00
