Yann Collet
805c5a3efb
updated documentation on multithreading modes
2017-04-01 00:36:31 -07:00
Yann Collet
30c7698970
optimize ZSTDMT_compress() memory usage
...
does no longer allocate temporary buffers
when there is enough room in dstBuffer to decompress directly there.
(previous method would skip that for 1st chunk only).
Also : fix ZSTD_compressBound() for small srcSize
2017-03-31 18:27:03 -07:00
Yann Collet
3f75d52527
Changed ZSTD_compressBound()
...
required so that if Total = A+B
compressBound(Total) <= compressBound(A) + compressBound(B)
under condition of a minimum size for A and B
Will help for ZSTDMT_compress() memory allocation
2017-03-31 17:11:38 -07:00
Yann Collet
7b70a1969e
Merge branch 'dev' into zstdmt
2017-03-31 16:22:33 -07:00
Yann Collet
d11c7bf9bf
Merge branch 'dev' of github.com:facebook/zstd into dev
2017-03-31 16:19:52 -07:00
Yann Collet
271bff63d6
Merge pull request #642 from terrelln/no-sparse
...
Turn off sparse mode for OS X by default
2017-03-31 16:19:46 -07:00
Yann Collet
596ee423bb
Merge branch 'dev' of github.com:facebook/zstd into dev
2017-03-31 16:19:33 -07:00
Yann Collet
a935d67bf1
minor typo fixes in specification
2017-03-31 16:19:04 -07:00
Yann Collet
53203e7c38
Merge pull request #640 from facebook/memAccess
...
Changed memory strategy to __packed for gcc
2017-03-31 15:49:12 -07:00
Yann Collet
14433ca1ad
numerous typos and clarifications in format specification
...
fix limit values of Window_Size
bump version to 0.2.5
2017-03-31 15:45:58 -07:00
Nick Terrell
eb38617175
Clean up default sparse logic
2017-03-31 15:20:50 -07:00
Nick Terrell
96fe545a18
Turn off sparse mode for OS X by default
2017-03-31 15:16:43 -07:00
Yann Collet
eea7858e2b
fixed minor warnings in debug code
2017-03-30 16:47:19 -07:00
Yann Collet
34cc487d05
overlap at full windowSize for max compression level
...
as it provides max compression ratio
2017-03-30 16:23:22 -07:00
Yann Collet
458e955c23
improved ZSTDMT_compress()
...
Use a bit more threads by default.
Uses overlap segments to boost compression ratio (like the streaming variant)
2017-03-30 15:51:58 -07:00
Yann Collet
6476c51b86
Merge pull request #637 from facebook/zstdmt
...
Zstdmt
2017-03-30 14:18:37 -07:00
Yann Collet
274f59919d
Changed memory strategy to __packed for gcc
...
Method 1 __packed is always as good or better than memcpy().
But it's not portable, as it depends on compiler extension.
For gcc, __pakced directive works fine.
Furthermore, gcc has serious performance issues with memcpy() on ARM 32 bits.
See #620
2017-03-30 12:52:14 -07:00
Yann Collet
6851db48e0
created contrib/cleanTabs
2017-03-30 12:42:44 -07:00
Yann Collet
b6f9303af7
Merge pull request #638 from terrelln/tabs
...
Convert all tabs to spaces
2017-03-30 12:32:40 -07:00
Yann Collet
3d58a1f9b9
fixed Visual fuzzer project
2017-03-30 12:28:09 -07:00
Yann Collet
2bcefcc50d
fixed Visual Studio projects
2017-03-29 22:03:27 -07:00
Nick Terrell
5152fb2cb2
Convert all tabs to spaces
2017-03-29 18:51:58 -07:00
Yann Collet
ca5a8bbe36
re-added patch ...
2017-03-29 17:15:27 -07:00
Yann Collet
1e1e26f2ac
fixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header
2017-03-29 17:09:59 -07:00
Yann Collet
e8e1e13d4f
Merge pull request #636 from iburinoc/appveyor
...
Build windows releases on appveyor as artifacts
2017-03-29 17:01:24 -07:00
Yann Collet
0ef6803707
added ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer
...
Now tests fail, because ZSTDMT_compress() doesn't fill frame content size correctly.
2017-03-29 16:58:57 -07:00
Yann Collet
2e2e78de47
removed unnecessary restriction on minmatchLength
...
it's now transparently translated to nearest value when unsupported
(7->6) (3->4)
2017-03-29 16:02:47 -07:00
Yann Collet
26769d88bc
Merge branch 'dev' of github.com:facebook/zstd into dev
2017-03-29 15:21:30 -07:00
Sean Purcell
dd79c5c9e8
Make pzstd and cmake use gcc/g++
2017-03-29 14:40:11 -07:00
Yann Collet
933ce4a1dd
fix : minmatch 7 conversion
...
minmatch 7 now converted to minmatch 6 for strategies which do not support 7
Used to folded into "default", which applied minmatch 4
2017-03-29 14:35:38 -07:00
Sean Purcell
fcc55ccae4
Build windows releases on appveyor as artifacts
2017-03-29 13:08:10 -07:00
Yann Collet
dae3be80e9
Merge pull request #635 from iburinoc/skipmagic
...
Remove extra 'F' from skippable magic mask
2017-03-29 12:16:53 -07:00
Yann Collet
5bde4be5a1
fix : bench automatically adapts parameters to srcSize
2017-03-29 12:10:38 -07:00
Sean Purcell
4708394bdd
Remove extra 'F' from skippable magic mask
2017-03-29 11:46:57 -07:00
Yann Collet
57458d4cea
Merge branch 'dev' of github.com:facebook/zstd into dev
2017-03-27 14:43:53 -07:00
Yann Collet
32ef985877
Merge pull request #631 from facebook/LegacyDictBuilder
...
Legacy dict builder
2017-03-27 14:42:52 -07:00
Yann Collet
70a4cc6e7f
Merge pull request #633 from iburinoc/isatty
...
Fix IS_CONSOLE returning 1 for NUL on windows
2017-03-27 14:32:21 -07:00
Sean Purcell
efdaf8bb7c
Fix inline compile errors
2017-03-27 12:26:40 -07:00
Sean Purcell
894bf49713
Fix IS_CONSOLE returning 1 for NUL on windows
2017-03-27 12:19:30 -07:00
Yann Collet
41fefd573a
Improved speed tests
...
Better compatibility with Mac OS-X
Force attribution to a selected core # (Linux)
2017-03-26 23:52:19 -07:00
Yann Collet
4cf0093571
restored bonus rule
2017-03-26 14:51:00 -07:00
Yann Collet
69017bf253
Merge branch 'dev' into LegacyDictBuilder
2017-03-26 14:39:13 -07:00
Yann Collet
582760818f
minor refactor
...
add const
changed if for easier to add new conditions
2017-03-26 03:04:56 -07:00
Yann Collet
858f72eeb8
fixed dictBuilder issue
...
dictionary loading would fail during entropy analysis
2017-03-26 02:50:00 -07:00
Yann Collet
ecee9f2ef8
fixed conversion warnings
2017-03-26 00:59:14 -07:00
Yann Collet
0246d5c531
Merge pull request #630 from facebook/advancedCliCommands
...
changed advanced commands --maxdict= and --dictID=
2017-03-26 00:13:35 -07:00
Yann Collet
3a2ff15e90
Merge pull request #629 from iburinoc/exematch
...
Ignore extension in command name matching
2017-03-24 20:41:56 -07:00
Yann Collet
4c41d37fcc
changed test for new syntax
...
--dictID= and --maxdict=
2017-03-24 18:36:56 -07:00
Yann Collet
d41f707e88
minor improvement : remove duplicates with 1 char prefix difference
2017-03-24 17:56:45 -07:00
Yann Collet
b364caf455
Merge pull request #628 from facebook/dictBuilder_limits
...
Ensure all limits derived from same constants
2017-03-24 17:54:42 -07:00
