Lines Matching +full:zstd +full:- +full:dev
5 - `datagen` : Synthetic and parametrable data generator, for tests
6 - `fullbench` : Precisely measure speed for each zstd inner functions
7 - `fuzzer` : Test tool, to check zstd integrity on target platform
8 - `paramgrill` : parameter tester for zstd
9 - `test-zstd-speed.py` : script for testing zstd speed difference between commits
10 - `test-zstd-versions.py` : compatibility test between zstd versions stored on Github (v0.1+)
11 - `zstreamtest` : Fuzzer test tool for zstd streaming API
12 - `legacy` : Test tool to test decoding of legacy zstd frames
13 - `decodecorpus` : Tool to generate valid Zstandard frames, for verifying decoder implementations
16 #### `test-zstd-versions.py` - script for testing zstd interoperability between versions
18 This script creates `versionsTest` directory to which zstd repository is cloned.
19 Then all tagged (released) versions of zstd are compiled.
20 In the following step interoperability between zstd versions is checked.
22 #### `automated-benchmarking.py` - script for benchmarking zstd prs to dev
24 This script benchmarks facebook:dev and changes from pull requests made to zstd and compares
25 them against facebook:dev to detect regressions. This script currently runs on a dedicated
26 desktop machine for every pull request that is made to the zstd repo but can also
30 build comparison (between facebook:dev and facebook:release), onetime will pull all the current
31 pull requests from the zstd repo and compare facebook:dev to all of them once, continuous
32 will continuously get pull requests from the zstd repo and run benchmarks against facebook:dev.
39 usage: automated_benchmarking.py [-h] [--directory DIRECTORY]
40 [--levels LEVELS] [--iterations ITERATIONS]
41 [--emails EMAILS] [--frequency FREQUENCY]
42 [--mode MODE] [--dict DICT]
45 -h, --help show this help message and exit
46 --directory DIRECTORY
48 --levels LEVELS levels to test e.g. ('1,2,3')
49 --iterations ITERATIONS
51 --emails EMAILS email addresses of people who will be alerted upon
53 --frequency FREQUENCY
56 --mode MODE 'fastmode', 'onetime', 'current', or 'continuous' (see
58 --dict DICT filename of dictionary to use (when set, this
60 inside --directory)
63 #### `test-zstd-speed.py` - script for testing zstd speed difference between commits
67 This script creates `speedTest` directory to which zstd repository is cloned.
68 Then it compiles all branches of zstd and performs a speed benchmark for a given list of files (the…
72 If compression or decompression speed for one of zstd levels is lower than `lowerLimit` (an optiona…
73 If second results are also lower than `lowerLimit` the warning e-mail is sent to recipients from th…
76 - To be sure that speed results are accurate the script should be run on a "stable" target system w…
77 - Using the script with virtual machines can lead to large variations of speed results
78 - The speed benchmark is not performed until computers' load average is lower than `maxLoadAvg` (an…
79 - The script sends e-mails using `mutt`; if `mutt` is not available it sends e-mails without attach…
82 The example usage with two test files, one e-mail address, and with an additional message:
84 ./test-zstd-speed.py "silesia.tar calgary.tar" "email@gmail.com" --message "tested on my laptop" --…
89 nohup ./test-zstd-speed.py testFileNames emails &
96 emails list of e-mail addresses to send warnings
99 -h, --help show this help message and exit
100 --message MESSAGE attach an additional message to e-mail
101 --lowerLimit LOWERLIMIT
103 --maxLoadAvg MAXLOADAVG
105 --lastCLevel LASTCLEVEL
107 --sleepTime SLEEPTIME
111 #### `decodecorpus` - tool to generate Zstandard frames for decoder testing
120 ./decodecorpus -ptestfiles -otestfiles -n10000 -s5
123 with the zstd checksum field set,
127 ./decodecorpus -t -T1mn
131 zstd library correctly decompresses them in both simple and streaming modes.
133 #### `paramgrill` - tool for generating compression table parameters and optimizing parameters on f…
137 -T# : set level 1 speed objective
138 -B# : cut input into blocks of size # (default : single block)
139 -S : benchmarks a single run (example command: -Sl3w10h12)
140 w# - windowLog
141 h# - hashLog
142 c# - chainLog
143 s# - searchLog
144 l# - minMatch
145 t# - targetLength
146 S# - strategy
147 L# - level
148 --zstd= : Single run, parameter selection syntax same as zstdcli with more parameters
150 When invoked with --optimize, this represents the sample to exceed.
151 --optimize= : find parameters to maximize compression ratio given parameters
152 …Can use all --zstd= commands to constrain the type of solution found in addition to the following …
167 --display= : specify which parameters are included in the output
168 …can use all --zstd parameter names and 'cParams' as a shorthand for all parameters used in ZSTD_co…
170 -P# : generated sample compressibility (when no file is provided)
171 -t# : Caps runtime of operation in seconds (default: 99999 seconds (about 27 hours))
172 -v : Prints Benchmarking output
173 -D : Next argument dictionary file
174 -s : Benchmark all files separately
175 -q : Quiet, repeat for more quiet
176 -q Prints parameters + results whenever a new best is found
177 … -qq Only prints parameters whenever a new best is found, prints final parameters + results
178 -qqq Only print final parameters + results
179 -qqqq Only prints final parameter set in the form --zstd=
180 -v : Verbose, cancels quiet, repeat for more volume
181 -v Prints all candidate parameters and results