History

Yann Collet 34f01e600f fixed multiple conversions from 64-bit to 32-bit		2018-12-13 14:02:22 -08:00
..
.gitignore	first working test program	2018-08-28 15:47:07 -07:00
largeNbDicts.c	fixed multiple conversions	2018-12-13 14:02:22 -08:00
Makefile	separated bench module into benchfn and benchzstd	2018-11-13 11:01:59 -08:00
README.md	updated documentation	2018-09-04 14:57:45 -07:00

README.md

largeNbDicts

largeNbDicts is a benchmark test tool dedicated to the specific scenario of dictionary decompression using a very large number of dictionaries. When dictionaries are constantly changing, they are always "cold", suffering from increased latency due to cache misses.

The tool is created in a bid to investigate performance for this scenario, and experiment mitigation techniques.

Command line :

largeNbDicts [Options] filename(s)

Options :
-r           : recursively load all files in subdirectories (default: off)
-B#          : split input into blocks of size # (default: no split)
-#           : use compression level # (default: 3)
-D #         : use # as a dictionary (default: create one)
-i#          : nb benchmark rounds (default: 6)
--nbDicts=#  : set nb of dictionaries to # (default: one per block)
-h           : help (this text)