zstd/contrib
Jennifer Liu 9d6ed9def3 Merge fastCover into DictBuilder (#1274)
* Minor fix

* Run non-optimize FASTCOVER 5 times in benchmark

* Merge fastCover into dictBuilder

* Fix mixed declaration issue

* Add fastcover to symbol.c

* Add fastCover.c and cover.h to build

* Change fastCover.c to fastcover.c

* Update benchmark to run FASTCOVER in dictBuilder

* Undo spliting fastcover_param into cover_param and f

* Remove convert param functions

* Assign f to parameter

* Add zdict.h to Makefile in lib

* Add cover.h to BUCK

* Cast 1 to U64 before shifting

* Remove trimming of zero freq head and tail in selectSegment and rebenchmark

* Remove f as a separate parameter of tryParam

* Read 8 bytes when d is 6

* Add trimming off zero frequency head and tail

* Use best functions from COVER and remove trimming part(which leads to worse compression ratio after previous bugs were fixed)

* Add finalize= argument to FASTCOVER to specify percentage of training samples passed to ZDICT_finalizeDictionary

* Change nbDmer to always read 8 bytes even when d=6

* Add skip=# argument to allow skipping dmers in computeFrequency in FASTCOVER

* Update comments and benchmarking result

* Change default method of ZDICT_trainFromBuffer to ZDICT_optimizeTrainFromBuffer_fastCover

* Add dictType enum and fix bug about passing zParam when converting to coverParam

* Combine finalize and skip into a single parameter

* Update acceleration parameters and benchmark on 3 sample sets

* Change default splitPoint of FASTCOVER to 0.75 and benchmark first 3 sample sets

* Initialize variables outside of for loop in benchmark.c

* Update benchmark result for hg-manifest

* Remove cover.h from install-includes

* Add explanation of f

* Set default compression level for trainFromBuffer to 3

* Add assertion of fastCoverParams in DiB_trainFromFiles

* Add checkTotalCompressedSize function + some minor fixes

* Add test for multithreading fastCovr

* Initialize segmentFreqs in every FASTCOVER_selectSegment and move mutex_unnlock to end of COVER_best_finish

* Free segmentFreqs

* Initialize segmentFreqs before calling FASTCOVER_buildDictionary instead of in FASTCOVER_selectSegment

* Add FASTCOVER_MEMMULT

* Minor fix

* Update benchmarking result
2018-08-23 12:06:20 -07:00
..
adaptive-compression Fix name of macOS 2018-06-09 14:31:17 -05:00
docker added docker readme 2018-03-19 16:13:12 -07:00
experimental_dict_builders Merge fastCover into DictBuilder (#1274) 2018-08-23 12:06:20 -07:00
gen_html Remove duplicate CXXFLAGS 2018-06-10 18:04:21 -05:00
linux-kernel [linux-kernel] Update license 2017-08-31 12:48:36 -07:00
meson meson: fix build 2018-07-02 15:06:46 +01:00
premake Fix wrong conditions 2018-07-14 12:34:03 +02:00
pzstd Add CXXFLAGS to ALL_LDFLAGS (#1178) 2018-06-14 13:05:33 -07:00
seekable_format Makefile: added variable SCANBUILD 2018-08-16 16:44:13 -07:00
snap moved snap to /contrib 2018-03-19 16:15:06 -07:00
VS2005 added a project support notice for VS2005 2017-06-02 10:28:56 -07:00
cleanTabs created contrib/cleanTabs 2017-03-30 12:42:44 -07:00