Lines Matching +full:- +full:- +full:with +full:- +full:zstd
5 - `datagen` : Synthetic and parametrable data generator, for tests
6 - `fullbench` : Precisely measure speed for each zstd inner functions
7 - `fuzzer` : Test tool, to check zstd integrity on target platform
8 - `paramgrill` : parameter tester for zstd
9 - `test-zstd-speed.py` : script for testing zstd speed difference between commits
10 - `test-zstd-versions.py` : compatibility test between zstd versions stored on Github (v0.1+)
11 - `zstreamtest` : Fuzzer test tool for zstd streaming API
12 - `legacy` : Test tool to test decoding of legacy zstd frames
13 - `decodecorpus` : Tool to generate valid Zstandard frames, for verifying decoder implementations
16 #### `test-zstd-versions.py` - script for testing zstd interoperability between versions
18 This script creates `versionsTest` directory to which zstd repository is cloned.
19 Then all tagged (released) versions of zstd are compiled.
20 In the following step interoperability between zstd versions is checked.
22 #### `automated-benchmarking.py` - script for benchmarking zstd prs to dev
24 This script benchmarks facebook:dev and changes from pull requests made to zstd and compares
26 desktop machine for every pull request that is made to the zstd repo but can also
31 pull requests from the zstd repo and compare facebook:dev to all of them once, continuous
32 will continuously get pull requests from the zstd repo and run benchmarks against facebook:dev.
39 usage: automated_benchmarking.py [-h] [--directory DIRECTORY]
40 [--levels LEVELS] [--iterations ITERATIONS]
41 [--emails EMAILS] [--frequency FREQUENCY]
42 [--mode MODE] [--dict DICT]
45 -h, --help show this help message and exit
46 --directory DIRECTORY
47 directory with files to benchmark
48 --levels LEVELS levels to test e.g. ('1,2,3')
49 --iterations ITERATIONS
51 --emails EMAILS email addresses of people who will be alerted upon
53 --frequency FREQUENCY
56 --mode MODE 'fastmode', 'onetime', 'current', or 'continuous' (see
58 --dict DICT filename of dictionary to use (when set, this
60 inside --directory)
63 #### `test-zstd-speed.py` - script for testing zstd speed difference between commits
67 This script creates `speedTest` directory to which zstd repository is cloned.
68 Then it compiles all branches of zstd and performs a speed benchmark for a given list of files (the…
72 If compression or decompression speed for one of zstd levels is lower than `lowerLimit` (an optiona…
73 If second results are also lower than `lowerLimit` the warning e-mail is sent to recipients from th…
76 - To be sure that speed results are accurate the script should be run on a "stable" target system w…
77 - Using the script with virtual machines can lead to large variations of speed results
78 - The speed benchmark is not performed until computers' load average is lower than `maxLoadAvg` (an…
79 - The script sends e-mails using `mutt`; if `mutt` is not available it sends e-mails without attach…
82 The example usage with two test files, one e-mail address, and with an additional message:
84 ./test-zstd-speed.py "silesia.tar calgary.tar" "email@gmail.com" --message "tested on my laptop" --…
89 nohup ./test-zstd-speed.py testFileNames emails &
96 emails list of e-mail addresses to send warnings
99 -h, --help show this help message and exit
100 --message MESSAGE attach an additional message to e-mail
101 --lowerLimit LOWERLIMIT
103 --maxLoadAvg MAXLOADAVG
105 --lastCLevel LASTCLEVEL
107 --sleepTime SLEEPTIME
111 #### `decodecorpus` - tool to generate Zstandard frames for decoder testing
114 This tool will generate .zst files with checksums,
120 ./decodecorpus -ptestfiles -otestfiles -n10000 -s5
123 with the zstd checksum field set,
127 ./decodecorpus -t -T1mn
131 zstd library correctly decompresses them in both simple and streaming modes.
133 #### `paramgrill` - tool for generating compression table parameters and optimizing parameters on f…
137 -T# : set level 1 speed objective
138 -B# : cut input into blocks of size # (default : single block)
139 -S : benchmarks a single run (example command: -Sl3w10h12)
140 w# - windowLog
141 h# - hashLog
142 c# - chainLog
143 s# - searchLog
144 l# - minMatch
145 t# - targetLength
146 S# - strategy
147 L# - level
148 --zstd= : Single run, parameter selection syntax same as zstdcli with more parameters
150 When invoked with --optimize, this represents the sample to exceed.
151 --optimize= : find parameters to maximize compression ratio given parameters
152 …Can use all --zstd= commands to constrain the type of solution found in addition to the following …
157 …stc= : When invoked with lvl=, represents percentage slack in ratio/cSpeed allowed for a solu…
159 (Lower value will begin with stronger strategies) (Default 90%)
167 --display= : specify which parameters are included in the output
168 …can use all --zstd parameter names and 'cParams' as a shorthand for all parameters used in ZSTD_co…
170 -P# : generated sample compressibility (when no file is provided)
171 -t# : Caps runtime of operation in seconds (default: 99999 seconds (about 27 hours))
172 -v : Prints Benchmarking output
173 -D : Next argument dictionary file
174 -s : Benchmark all files separately
175 -q : Quiet, repeat for more quiet
176 -q Prints parameters + results whenever a new best is found
177 … -qq Only prints parameters whenever a new best is found, prints final parameters + results
178 -qqq Only print final parameters + results
179 -qqqq Only prints final parameter set in the form --zstd=
180 -v : Verbose, cancels quiet, repeat for more volume
181 -v Prints all candidate parameters and results