Yann Collet
064b8e6785
Merge branch 'travisTest' of github.com:facebook/zstd into travisTest
2018-08-02 11:52:12 -07:00
Yann Collet
5892dd5da4
Merge pull request #1255 from terrelln/norm-fix
...
[FSE] Fix division by zero
2018-08-02 11:48:56 -07:00
Nick Terrell
dc5a67cb7b
Disallow tableLog == srcLog
2018-08-02 11:12:17 -07:00
Jennifer Liu
0acb0abd1e
Add non-optimize FASTCOVER ( #1260 )
...
* Add non-optimize FASTCOVER
* Minor fix
* Pass param as value instead of pointer
2018-08-01 11:06:16 -07:00
Nick Terrell
1420129fda
Merge pull request #1258 from jennifermliu/fastCover
...
Use CDict instead of CCtx in analyzeEntropy
2018-07-31 14:31:05 -07:00
Jennifer Liu
f5228f2c44
Refactoring
2018-07-31 13:58:54 -07:00
Jennifer Liu
4e29bc2469
Use CDict instead of CCtx in analyzeEntropy
2018-07-31 10:36:45 -07:00
Nick Terrell
fc685d6b94
Merge pull request #1257 from jennifermliu/fastCover
...
Increment frequency for every dmer occurence within same sample
2018-07-30 16:03:18 -07:00
Nick Terrell
b9faaa1dc3
[FSE] Add division by zero test
2018-07-30 13:24:09 -07:00
Jennifer Liu
31229e527b
Increment frequency for every dmer occurence within same sample instead of at most once per sample
2018-07-30 12:54:22 -07:00
cyan4973
e85b4c56b2
speed up appveyor tests
2018-07-30 17:13:13 +02:00
cyan4973
3f535007e4
fix %zu support under minGW
...
and relevant test on Appveyor
2018-07-30 16:56:18 +02:00
cyan4973
c738a2c795
ensure appveyor test fails due to formatting error
...
to catch %zu incompatibility
2018-07-30 16:44:20 +02:00
cyan4973
aade1e5904
Merge branch 'dev' into fix1241
2018-07-30 16:30:35 +02:00
cyan4973
3d4b09a5aa
support %zu under mingw
2018-07-30 16:29:20 +02:00
Nick Terrell
92633789f6
Merge pull request #1254 from jennifermliu/fastCover
...
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
2018-07-27 18:22:52 -07:00
Jennifer Liu
51b109c1b5
Delete old benchmarking result
2018-07-27 17:31:33 -07:00
Nick Terrell
9889bca530
[FSE] Fix division by zero
...
When the primary normalization method fails, and
`(1 << tableLog) == (maxSymbolValue + 1)`, and every symbol gets assigned
normalized weight 1 or -1 in the first loop, then the next division can
raise `SIGFPE`.
2018-07-27 17:30:03 -07:00
Jennifer Liu
53ef22a4bc
Undo deleting clean in make
2018-07-27 16:56:50 -07:00
Jennifer Liu
96d84ee235
Revert test.sh
2018-07-27 16:54:05 -07:00
Jennifer Liu
61262f6c0d
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
2018-07-27 16:51:38 -07:00
Nick Terrell
3abfbee215
Merge pull request #1250 from jennifermliu/fastCover
...
Add Fast Cover Dictionary Builder
2018-07-27 15:11:57 -07:00
Jennifer Liu
49b398e93f
Use same param after optimizing cover and fastCover and record k and d for benchmarking
2018-07-27 13:39:19 -07:00
Jennifer Liu
759c543312
Rerun cover and fastCover with optimized values
2018-07-26 19:03:01 -07:00
Jennifer Liu
3d7941ce41
Benchmark different f values
2018-07-26 16:24:13 -07:00
Nick Terrell
7974628587
Merge pull request #1252 from GeorgeLu97/bench-quiet-display-fix
...
Fixes bug
2018-07-26 16:12:15 -07:00
George Lu
09ccd977c3
no zero
2018-07-26 15:17:58 -07:00
Jennifer Liu
3b163e0b5b
Add array to keep track of frequency within active segment, fix malloc bug, update benchmarking result
2018-07-26 13:53:13 -07:00
Jennifer Liu
2333ecb173
Allow d=6
2018-07-25 18:10:09 -07:00
Jennifer Liu
1e85f314d8
Benchmark fast cover optimize vs k=200
2018-07-25 17:53:38 -07:00
Jennifer Liu
d1fc507ef9
Initial benchmarking result for fastCover
2018-07-25 17:05:54 -07:00
Jennifer Liu
f5407e398a
Make hash value const
2018-07-25 16:54:08 -07:00
Jennifer Liu
7f3f70f766
Add Fast Cover Dictionary Builder
2018-07-25 16:34:07 -07:00
Nick Terrell
77068a8447
Merge pull request #1246 from jennifermliu/benchmark
...
Benchmark dictionary builders
2018-07-20 18:09:31 -07:00
Jennifer Liu
b6c5d4982c
Minor fix
2018-07-20 17:41:22 -07:00
Jennifer Liu
71e767ac09
Refactoring and benchmark without dictionary
2018-07-20 17:03:47 -07:00
Jennifer Liu
470c8d42f4
Benchmark dictionary builders
2018-07-20 11:32:39 -07:00
Nick Terrell
2e47865d7d
Merge pull request #1245 from terrelln/disable-arm
...
Revert "attempt to re-enable arm64 tests"
2018-07-19 15:32:53 -07:00
Nick Terrell
5624f3f1ea
Revert "attempt to re-enable arm64 tests"
...
This reverts commit 9c277f137c
2018-07-19 14:35:27 -07:00
Nick Terrell
4d1ad5cdb2
Merge pull request #1238 from jennifermliu/random
...
Add random dictionary builder
2018-07-19 13:52:15 -07:00
Jennifer Liu
0c5eaef248
Update Makefile
2018-07-19 13:44:27 -07:00
Jennifer Liu
5bb46a898e
Rename cleanup
2018-07-18 12:15:49 -07:00
Jennifer Liu
52e7cf0e40
Add cleanup to trainfromFiles and move RANDOM_segment_t declaration
2018-07-18 10:40:13 -07:00
Yann Collet
effa84c8d1
Merge pull request #1230 from terrelln/train-out
...
zstdcli: Allow -o before --train
2018-07-18 16:34:10 +02:00
Yann Collet
6e490a2f09
Merge pull request #1237 from terrelln/init-cstream-adv
...
Set requestedParams in ZSTD_initCStream*()
2018-07-18 16:33:30 +02:00
cyan4973
7d1bc9cc8c
fix minor conversion warning
2018-07-18 16:10:23 +02:00
Yann Collet
37da48986b
Merge pull request #1242 from facebook/mingw_traces
...
zstdmt debug traces compatibles with mingw
2018-07-18 12:23:07 +02:00
Yann Collet
545bd3dd01
Merge pull request #1244 from terrelln/ferror
...
fileio: Error in compression on read errors
2018-07-18 12:22:41 +02:00
Jennifer Liu
ce09fb723d
Update freeSampleInfo
2018-07-17 16:13:40 -07:00
Jennifer Liu
896ff0644a
Fix deallocation problem and add documentation
2018-07-17 16:01:44 -07:00
