Lines Matching +full:- +full:- +full:without +full:- +full:zstd
5 * This source code is licensed under both the BSD-style license (found in the
8 * You may select, at your option, one of the above-listed licenses.
51 * Zstd dictionary builder
56 * ------------------------------
58 * Zstd can use dictionaries to improve compression ratio of small data.
63 * these files. Then, zstd can use the dictionary to find repetitions that are
67 * ----------------------------
75 * --------------------------
77 * Simply pass the dictionary to the zstd compressor with
80 * more advanced functions that allow selecting some options, see zstd.h for
83 * What is a zstd dictionary?
84 * --------------------------
86 * A zstd dictionary has two pieces: Its header, and its content. The header
88 * entropy tables allow zstd to save on header costs in the compressed file,
93 * ---------------------------------
95 * A raw content dictionary is just bytes. It doesn't have a zstd dictionary
100 * ----------------------------
118 * ----------------------------------
121 * The zstd CLI defaults to a 110KB dictionary. You likely don't need a
130 * ------------------------------------------------------------
139 * -----------------------------------------------------
141 * Simply train a dictionary and try it out. You can use zstd's built in
144 * # Benchmark levels 1-3 without a dictionary
145 * zstd -b1e3 -r /path/to/my/files
146 * # Benchmark levels 1-3 with a dictionary
147 * zstd -b1e3 -r /path/to/my/files -D /path/to/my/dictionary
150 * -----------------------------------
159 * I have a raw content dictionary, how do I turn it into a zstd dictionary?
160 * -------------------------------------------------------------------------
163 * using a third-party dictionary builder, you can turn it into a zstd
165 * provide some samples of the data. It will add the zstd header to the
167 * will improve compression ratio, and allow zstd to write the dictionary ID
170 * Do I have to use zstd's dictionary builder?
171 * -------------------------------------------
175 * a zstd dictionary, which can improve compression ratio, use
178 * What is the attack surface of a zstd dictionary?
179 * ------------------------------------------------
181 * Zstd is heavily fuzz tested, including loading fuzzed dictionaries, so
182 * zstd should never crash, or access out-of-bounds memory no matter what
184 * during decompression, they can cause zstd to generate arbitrary bytes,
192 * Redirect towards ZDICT_optimizeTrainFromBuffer_fastCover() single-threaded, with d=8, steps=4,
201 * If dictionary training fails, you should use zstd without a dictionary, as the dictionary
215 …int compressionLevel; /**< optimize for a specific zstd compression level; 0 means default …
217 unsigned dictID; /**< force dictID value; 0 means auto mode (32-bits random value)
218 … * NOTE: The zstd format reserves some dictionary IDs for future use.
220 … * may be used by zstd in a public dictionary registry in the future.
222 * - low range : <= 32767
223 * - high range : >= (2^31)
229 * finalize dictionary by adding headers and statistics according to the zstd
270 …id* dictBuffer, size_t dictSize); /* returns dict header size; returns a ZSTD error code on failu…
309 …unsigned nbThreads; /* Number of threads : constraint: 0 < nbThreads : 1 means single-thr…
310 …ples * splitPoint samples will be used to training, the last nbSamples * (1 - splitPoint) samples …
321 …unsigned nbThreads; /* Number of threads : constraint: 0 < nbThreads : 1 means single-thr…
322 …ples * splitPoint samples will be used to training, the last nbSamples * (1 - splitPoint) samples …
356 * If d is non-zero then we don't check multiple values of d, otherwise we check d = {6, 8}.
358 …* If k is non-zero then we don't check multiple values of k, otherwise we check steps values in [5…
398 * If d is non-zero then we don't check multiple values of d, otherwise we check d = {6, 8}.
400 …* If k is non-zero then we don't check multiple values of k, otherwise we check steps values in [5…
443 for example with -Wno-deprecated-declarations for gcc