zstd/lib/compress
Yann Collet 134388ba6b collect statistics for first block in ultra mode
this patch makes btultra do 2 passes on the first block,
the first one being dedicated to collecting statistics
so that the 2nd pass is more accurate.

It translates into a very small compression ratio gain :

enwik7, level 20:
blocks  4K : 2.142 -> 2.153
blocks 16K : 2.447 -> 2.457
blocks 64K : 2.716 -> 2.726

On the other hand, the cpu cost is doubled.

The trade off looks bad.
Though, that's ultimately a price to pay to reach better compression ratio.
So it's only enabled when setting btultra.
2018-05-17 12:24:30 -07:00
..
fse_compress.c opt: init statistics from dictionary 2018-05-10 17:59:12 -07:00
huf_compress.c pass entropy tables to optimal parser 2018-05-08 15:37:06 -07:00
zstd_compress_internal.h slightly improved weight calculation 2018-05-17 11:19:44 -07:00
zstd_compress.c slightly improved weight calculation 2018-05-17 11:19:44 -07:00
zstd_double_fast.c fix ZSTD_compressBlock() associated with CDict 2018-05-07 12:54:13 -07:00
zstd_double_fast.h Only load extra table positions for CDicts 2018-04-02 14:41:30 -07:00
zstd_fast.c Only load extra table positions for CDicts 2018-04-02 14:41:30 -07:00
zstd_fast.h Only load extra table positions for CDicts 2018-04-02 14:41:30 -07:00
zstd_lazy.c Split the window state into substructure 2018-02-26 13:29:57 -08:00
zstd_lazy.h Split ZSTD_CCtx into smaller sub-structures 2018-01-16 11:17:50 -08:00
zstd_ldm.c Only load extra table positions for CDicts 2018-04-02 14:41:30 -07:00
zstd_ldm.h Merge pull request #1057 from facebook/lrmSettings 2018-03-21 05:59:39 -07:00
zstd_opt.c collect statistics for first block in ultra mode 2018-05-17 12:24:30 -07:00
zstd_opt.h Split ZSTD_CCtx into smaller sub-structures 2018-01-16 11:17:50 -08:00
zstdmt_compress.c Only load extra table positions for CDicts 2018-04-02 14:41:30 -07:00
zstdmt_compress.h Merge branch 'dev' into advancedDecompress 2018-03-21 06:08:28 -07:00