Nick Terrell
|
721726d688
|
Split parsers out of zstd_compress.c
|
2017-09-05 17:10:25 -07:00 |
|
Stella Lau
|
08d33fe1c9
|
Fix parameter handling in copyCCtx with cdict
|
2017-09-05 15:50:20 -07:00 |
|
Stella Lau
|
fd0071da29
|
Fix parameter handling with ZSTD_copyCCtx
|
2017-09-05 15:34:17 -07:00 |
|
Stella Lau
|
643d28c701
|
Add ldm options to 'man zstd'
|
2017-09-05 11:27:15 -07:00 |
|
Nick Terrell
|
423b133568
|
[POOL] Allow free on NULL when multithreading is disabled
|
2017-09-05 11:18:13 -07:00 |
|
Stella Lau
|
67d4a6161c
|
Add ldmBucketSizeLog param
|
2017-09-02 21:55:29 -07:00 |
|
Stella Lau
|
a1f04d518d
|
Move hashEveryLog to cctxParams and update cli
|
2017-09-01 15:05:47 -07:00 |
|
Stella Lau
|
767a0b3be1
|
Move ldm hashLog, bucketLog, and mml to cctxParams
|
2017-09-01 12:24:59 -07:00 |
|
Yann Collet
|
8a5c0c98ae
|
restored 32-bits decoder ability to decode long offsets (>32 MB, levels 21+)
|
2017-09-01 11:56:57 -07:00 |
|
Yann Collet
|
36aa8b5999
|
improved decoding speed
|
2017-09-01 11:40:59 -07:00 |
|
Stella Lau
|
17d8e0bdcc
|
Merge remote-tracking branch 'upstream/longRangeMatcher' into ldm-integrate
|
2017-09-01 10:19:38 -07:00 |
|
Stella Lau
|
8081becadc
|
Add long distance matching as a CCtxParam
|
2017-09-01 09:18:58 -07:00 |
|
Yann Collet
|
d963daa6a9
|
fixed minor warning (empty translation unit)
|
2017-09-01 00:12:07 -07:00 |
|
Yann Collet
|
3704507774
|
fixed decompression bug reported by @Etsukata (#828)
|
2017-09-01 00:05:37 -07:00 |
|
Yann Collet
|
369c29dd1a
|
fixed impact of merge conflict for longRange
|
2017-08-31 18:25:56 -07:00 |
|
Yann Collet
|
d7ad99b2ab
|
Merge branch 'longRangeMatcher' into dev
|
2017-08-31 18:08:37 -07:00 |
|
Stella Lau
|
6a546efb8c
|
Add long distance matcher
Move last literals section to ZSTD_block_internal
|
2017-08-31 12:53:19 -07:00 |
|
Yann Collet
|
b0cb081dc8
|
last batch of header files changed to reflect new license (#825)
only remains to update contrib/linux-kernel (@terrelln)
|
2017-08-31 12:20:50 -07:00 |
|
Yann Collet
|
e21384fffb
|
fixed more file headers after license change (#825)
|
2017-08-31 12:11:57 -07:00 |
|
Yann Collet
|
e9dc204f42
|
fixed a bunch of headers after license change (#825)
|
2017-08-31 11:24:54 -07:00 |
|
Stella Lau
|
90a31bfa16
|
Pass dictMode to ZSTDMT_initCStream; fix nits
- Return error code in estimate{CCtx,CStream}Size functions
|
2017-08-30 16:19:07 -07:00 |
|
Stella Lau
|
ee65701720
|
Minor fixes; remove formatting only changes
|
2017-08-29 20:27:35 -07:00 |
|
Stella Lau
|
a6e20e1bd7
|
Add test for raw content starting with dict header
|
2017-08-29 18:36:18 -07:00 |
|
Stella Lau
|
623e3cd40b
|
Use ZSTD_dm_rawContent in zstdmt_compress
|
2017-08-29 18:04:32 -07:00 |
|
Stella Lau
|
82d636b76a
|
Rename applyCCtxParams()
|
2017-08-29 18:03:06 -07:00 |
|
Stella Lau
|
4e835720bf
|
Delay creation of ZSTDMT_CCtx
|
2017-08-29 17:58:32 -07:00 |
|
Stella Lau
|
c7a18b7c21
|
Localize 'dictMode' from cctx to function param
|
2017-08-29 15:52:24 -07:00 |
|
Yann Collet
|
d6ddb879da
|
Merge pull request #817 from terrelln/pool-custom-alloc
[pool] Accept custom allocators
|
2017-08-29 13:05:39 -07:00 |
|
Stella Lau
|
c88fb9267f
|
Replace 'byReference' with enum
|
2017-08-29 11:55:02 -07:00 |
|
Nick Terrell
|
9822f97721
|
[error] Don't guard undef X with ifdef X
|
2017-08-29 11:54:38 -07:00 |
|
Stella Lau
|
b5b9275e67
|
Rename estimateCCtxSize_advanced() and estimateCStreamSize_advanced()
|
2017-08-29 10:49:29 -07:00 |
|
Stella Lau
|
0e56a84a1e
|
Fix getting cParams from CCtxParams
|
2017-08-28 19:25:17 -07:00 |
|
Nick Terrell
|
02033be08c
|
[pool] Visual Studios disallows empty structs
|
2017-08-28 17:19:01 -07:00 |
|
Nick Terrell
|
7c365eb02c
|
[threading] Fix ERROR macro after including windows.h
|
2017-08-28 16:25:02 -07:00 |
|
Bernhard M. Wiedemann
|
cf689b84f9
|
Sort input file list
in order to make builds reproducible
in spite of indeterministic filesystem readdir order.
See https://reproducible-builds.org/ for why this is good.
|
2017-08-26 17:08:00 +02:00 |
|
Stella Lau
|
024098a47d
|
Fix parameter retrieval from cdict
|
2017-08-25 17:58:28 -07:00 |
|
Stella Lau
|
2adde898c8
|
Fix typo with ZSTDMT_parameter
|
2017-08-25 16:13:40 -07:00 |
|
Stella Lau
|
18224608ff
|
Remove ZSTD_setCCtxParameter()
|
2017-08-25 13:58:41 -07:00 |
|
Stella Lau
|
0744592d38
|
Add function initializing cctxParams from clevel
|
2017-08-25 13:36:47 -07:00 |
|
Stella Lau
|
9911153723
|
Move jobSize and overlapLog in zstdmt to cctxParams
|
2017-08-25 13:14:51 -07:00 |
|
Stella Lau
|
de5193422d
|
Distinguish between jobParams and cctxParams in zstdmt
|
2017-08-25 11:36:17 -07:00 |
|
Stella Lau
|
eb7bbab36a
|
Remove ZSTD_p_refDictContent and dictContentByRef
|
2017-08-25 11:11:45 -07:00 |
|
Nick Terrell
|
db3f5372df
|
[zstdmt] Use POOL_create_advanced()
|
2017-08-24 18:12:28 -07:00 |
|
Nick Terrell
|
de6c6bce85
|
Fix zstd_internal.h for C++ mode
|
2017-08-24 18:09:50 -07:00 |
|
Nick Terrell
|
26dc040a7b
|
[pool] Accept custom allocators
|
2017-08-24 17:01:41 -07:00 |
|
Nick Terrell
|
89dc856cae
|
[pool] Fix formatting
|
2017-08-24 16:48:32 -07:00 |
|
Stella Lau
|
15fdeb9e41
|
Enforce nbThreads<=1 for estimateCCtxSize
|
2017-08-24 16:28:49 -07:00 |
|
Nick Terrell
|
376f435914
|
[dictBuilder] Set default compression level to 3
|
2017-08-24 16:21:05 -07:00 |
|
Stella Lau
|
2fbf0285b2
|
Fix interaction with ZSTD_setCCtxParameter() and cleanup
|
2017-08-24 11:25:41 -07:00 |
|
Stella Lau
|
fd9bf42516
|
Fix forceWindow and dictMode setting for zstdmt jobs
|
2017-08-23 19:16:57 -07:00 |
|
Stella Lau
|
bf3108fb50
|
Ensure zstdmt uses 'job version' of cctx parameters
|
2017-08-23 17:03:31 -07:00 |
|
Stella Lau
|
1c81f725ff
|
Remove duplicated testing code
|
2017-08-23 15:47:15 -07:00 |
|
Stella Lau
|
64ce49426b
|
Fix cstream compression level
|
2017-08-23 12:30:47 -07:00 |
|
Stella Lau
|
5bc2c1e982
|
Add prototype support for customMem with cctxParams
|
2017-08-23 12:03:30 -07:00 |
|
Yann Collet
|
e9ce1208a1
|
Merge pull request #812 from facebook/longRangeFix
fixed extraordinary scenario where all fields use maximum nbBits
|
2017-08-23 11:35:28 -07:00 |
|
Yann Collet
|
74cde5a4d8
|
Merge pull request #813 from stellamplau/highbit32fix
Fix undefined behavior when srcSize==1
|
2017-08-23 11:31:06 -07:00 |
|
Stella Lau
|
6f1a21c7e9
|
Remove formatting-only changes
|
2017-08-23 10:24:19 -07:00 |
|
Dmitriy Titarenko
|
20f715d709
|
Fix displayLevel overflow
|
2017-08-23 15:56:15 +05:00 |
|
Stella Lau
|
11303778d0
|
Add function to make cctxParams from ZSTD_parameters
|
2017-08-22 14:53:13 -07:00 |
|
Yann Collet
|
bd9c8ca146
|
Merge pull request #811 from terrelln/segmentSize
[cover] Fix end condition for small dictionary
|
2017-08-22 14:36:30 -07:00 |
|
Stella Lau
|
23fc0e41fa
|
Remove 'opaque' naming from internal functions
|
2017-08-22 14:24:47 -07:00 |
|
Stella Lau
|
8fd1636776
|
Remove unused functions
|
2017-08-22 13:33:58 -07:00 |
|
Yann Collet
|
6b2b6a9bd5
|
fixed extraordinary scenario where all fields use maximum possible nb of bits simultaneously
can only happen if windowLog>=27 (level 22 --ultra)
|
2017-08-22 12:09:21 -07:00 |
|
Stella Lau
|
e50ed1fa3a
|
Fix undefined behavior when srcSize==1
|
2017-08-22 11:55:42 -07:00 |
|
Stella Lau
|
60e1bc617c
|
Explicitly create a job cctxParam for multithreading
|
2017-08-21 15:39:37 -07:00 |
|
Stella Lau
|
5b956f4753
|
Comment out CCtx_param versions of CDict functions
|
2017-08-21 14:49:16 -07:00 |
|
Nick Terrell
|
29c2d9a4d0
|
[cover] Turn down notification for ZDICT subroutines
|
2017-08-21 14:28:31 -07:00 |
|
Nick Terrell
|
98de3f6847
|
[cover] Add dictionary size to compressed size
|
2017-08-21 14:23:17 -07:00 |
|
Yann Collet
|
78c3d16bf4
|
Merge pull request #809 from terrelln/dev
[cover] Fix divide by zero
|
2017-08-21 13:33:19 -07:00 |
|
Nick Terrell
|
9a54a315aa
|
[cover] Convert score to U32 and check for zero
|
2017-08-21 13:30:07 -07:00 |
|
Stella Lau
|
fd8a25786e
|
Check parameters are valid in initCCtxParams
|
2017-08-21 13:23:35 -07:00 |
|
Stella Lau
|
1c0dbe81b1
|
Add documentation for CCtx_params
|
2017-08-21 13:18:00 -07:00 |
|
Nick Terrell
|
d49eb40c03
|
[cover] Stop when segmentSize is less than d
|
2017-08-21 13:10:03 -07:00 |
|
Stella Lau
|
939f954285
|
Pass ZSTD_CCtx_params as const ptr when possible
|
2017-08-21 12:57:18 -07:00 |
|
Stella Lau
|
73c73bf16a
|
Reduce code duplication in zstreamtest
|
2017-08-21 12:41:19 -07:00 |
|
Stella Lau
|
560b34f6d2
|
Return error code when initializing NULL cctxParams
|
2017-08-21 11:52:26 -07:00 |
|
Stella Lau
|
25be09c6b4
|
Set some parameters to zero before initializing cdict
|
2017-08-21 11:35:46 -07:00 |
|
Yann Collet
|
232d62b637
|
fixed a few headers that were too hastily copy/pasted during last license change
|
2017-08-21 11:24:32 -07:00 |
|
Nick Terrell
|
f306d400c0
|
[cover] Fix divide by zero
|
2017-08-21 11:12:11 -07:00 |
|
Stella Lau
|
502031ca10
|
Use cctxParam version of createCDict internally
|
2017-08-21 11:00:44 -07:00 |
|
Stella Lau
|
91b30dbe84
|
Remove test parameter
|
2017-08-21 10:09:06 -07:00 |
|
Stella Lau
|
f181f33bdf
|
Disable tests and refactor
|
2017-08-21 01:59:08 -07:00 |
|
Stella Lau
|
023b24e6d4
|
Add cctx param tests
|
2017-08-20 22:55:07 -07:00 |
|
Yann Collet
|
7db552676e
|
reduced pool queue to 0 to save memory
fixed : pool performance when jobs are fires fast and queueSize==0
|
2017-08-19 15:07:54 -07:00 |
|
Stella Lau
|
6cee6e07e5
|
Add internal createCDict function
|
2017-08-18 22:48:31 -07:00 |
|
Stella Lau
|
d775519296
|
Add cctxParam versions of internal functions
|
2017-08-18 17:37:58 -07:00 |
|
Yann Collet
|
32fb407c9d
|
updated a bunch of headers
for the new license
|
2017-08-18 16:52:05 -07:00 |
|
Stella Lau
|
63b8c98531
|
Pass cctx parameters to MTCtx
|
2017-08-18 16:17:24 -07:00 |
|
Stella Lau
|
399ae013d4
|
Add function to apply cctx params
|
2017-08-18 13:01:55 -07:00 |
|
Stella Lau
|
81d89d82a6
|
Move nbThreads to cctx params
|
2017-08-18 12:08:57 -07:00 |
|
Stella Lau
|
2300c58a6f
|
Move dictContentByRef to cctx params
|
2017-08-18 12:03:16 -07:00 |
|
Stella Lau
|
b6cb2ed8cb
|
Move dictMode to cctxParams
|
2017-08-18 11:43:31 -07:00 |
|
Stella Lau
|
97e27affcb
|
Move compression level to cctx params
|
2017-08-18 11:20:08 -07:00 |
|
Stella Lau
|
c0221124d5
|
Add function to set opaque parameters
|
2017-08-17 19:30:22 -07:00 |
|
Stella Lau
|
4169f49171
|
Add initialization/allocation functions for opaque params
|
2017-08-17 18:45:04 -07:00 |
|
Stella Lau
|
ade95b8bed
|
Add opaque interfaces for static initialization
|
2017-08-17 18:13:08 -07:00 |
|
Stella Lau
|
699f11b4f7
|
Create opaque parameter structure
|
2017-08-17 17:33:46 -07:00 |
|
Yann Collet
|
f9e6590715
|
Merge pull request #796 from terrelln/is-error
[FSE][HUF] Inline error checks
|
2017-08-15 12:37:28 -07:00 |
|
Yann Collet
|
2dbcfc6994
|
Merge pull request #794 from terrelln/force-inline
[libzstd] Fix FORCE_INLINE macro
|
2017-08-15 12:03:44 -07:00 |
|
Nick Terrell
|
07c6ff588e
|
[FSE][HUF] Inline error checks
Caught by Clang's optimization remarks.
|
2017-08-15 11:23:28 -07:00 |
|