Lines Matching +full:- +full:- +full:with +full:- +full:zstd
1 <p align="center"><img src="https://raw.githubusercontent.com/facebook/zstd/dev/doc/images/zstd_log…
3 __Zstandard__, or `zstd` as short version, is a fast lossless compression algorithm,
4 targeting real-time compression scenarios at zlib-level and better compression ratios.
8 This repository represents the reference implementation, provided as an open-source dual [BSD](LICE…
11 …and bindings is provided on [Zstandard homepage](https://facebook.github.io/zstd/#other-languages).
20 [travisDevBadge]: https://api.travis-ci.com/facebook/zstd.svg?branch=dev "Continuous Integration te…
21 [travisLink]: https://travis-ci.com/facebook/zstd
22 [CircleDevBadge]: https://circleci.com/gh/facebook/zstd/tree/dev.svg?style=shield "Short test suite"
23 [CircleLink]: https://circleci.com/gh/facebook/zstd
24 [CirrusDevBadge]: https://api.cirrus-ci.com/github/facebook/zstd.svg?branch=dev
25 [CirrusLink]: https://cirrus-ci.com/github/facebook/zstd
26 [OSSFuzzBadge]: https://oss-fuzz-build-logs.storage.googleapis.com/badges/zstd.svg
27 [OSSFuzzLink]: https://bugs.chromium.org/p/oss-fuzz/issues/list?sort=-opened&can=1&q=proj:zstd
32 on a desktop featuring a Core i7-9700K CPU @ 4.9GHz
33 and running Ubuntu 20.04 (`Linux ubu20 5.15.0-101-generic`),
34 using [lzbench], an open-source in-memory benchmark by @inikep
35 compiled with [gcc] 9.4.0,
43 | --------------- | ------| -----------| ---------- |
44 | **zstd 1.5.6 -1** | 2.887 | 510 MB/s | 1580 MB/s |
45 | [zlib] 1.2.11 -1 | 2.743 | 95 MB/s | 400 MB/s |
46 | brotli 1.0.9 -0 | 2.702 | 395 MB/s | 430 MB/s |
47 | **zstd 1.5.6 --fast=1** | 2.437 | 545 MB/s | 1890 MB/s |
48 | **zstd 1.5.6 --fast=3** | 2.239 | 650 MB/s | 2000 MB/s |
49 | quicklz 1.5.0 -1 | 2.238 | 525 MB/s | 750 MB/s |
50 | lzo1x 2.10 -1 | 2.106 | 650 MB/s | 825 MB/s |
52 | lzf 3.6 -1 | 2.077 | 420 MB/s | 830 MB/s |
58 The negative compression levels, specified with `--fast=#`,
62 Zstd can also offer stronger compression ratios at the cost of compression speed.
63 Speed vs Compression trade-off is configurable by small increments.
68 on a server running Linux Debian (`Linux version 4.14.0-3-amd64`)
69 with a Core i7-6700K CPU @ 4.0GHz,
70 using [lzbench], an open-source in-memory benchmark by @inikep
71 compiled with [gcc] 7.3.0,
75 ---------------------------|--------------------
84 …cable to typical file and stream scenarios (several MB). Small data comes with different perspecti…
88 To solve this situation, Zstd offers a __training mode__, which can be used to tune the algorithm f…
89 Training Zstandard is achieved by providing it with a few samples (one file per sample). The result…
92 …-users` [sample set](https://github.com/facebook/zstd/releases/tag/v1.1.3), created from [github p…
96 ------------------|-------------------|--------------------
97 …ges/dict-cr.png "Compression Ratio") | ![Compression Speed](doc/images/dict-cs.png "Compression Sp…
102 Training works if there is some correlation in a family of small data samples. The more data-specif…
110 `zstd --train FullPathToTrainingSet/* -o dictionaryName`
112 2. Compress with dictionary
114 `zstd -D dictionaryName FILE`
116 3. Decompress with dictionary
118 `zstd -D dictionaryName --decompress FILE.zst`
124 All other build systems are "compatible" and 3rd-party maintained,
126 When your system allows it, prefer using `make` to build `zstd` and `libzstd`.
130 If your system is compatible with standard `make` (or `gmake`),
131 invoking `make` in root directory will generate `zstd` cli in root directory.
135 - `make install` : create and install zstd cli, library and man pages
136 - `make check` : create and run `zstd`, test its behavior on local platform
138 …dard Makefile conventions](https://www.gnu.org/prep/standards/html_node/Makefile-Conventions.html),
142 are documented in [`lib/README.md`](lib/README.md#modular-build) for the `libzstd` library
143 and in [`programs/README.md`](programs/README.md#compilation-variables) for the `zstd` CLI.
149 to create `zstd` binary, and `libzstd` dynamic and static libraries.
155 `zstd` can be built and installed with support for both Apple Silicon (M1/M2) as well as Intel by u…
159 cmake -B build-cmake-debug -S build/cmake -G Ninja -DCMAKE_OSX_ARCHITECTURES="x86_64;x86_64h;arm64"
160 cd build-cmake-debug
176 You can build and install zstd [vcpkg](https://github.com/Microsoft/vcpkg/) dependency manager:
180 ./bootstrap-vcpkg.sh
182 ./vcpkg install zstd
184 The zstd port in vcpkg is kept up to date by Microsoft team members and community contributors.
189 You can install pre-built binaries for zstd or build it from source using [Conan](https://conan.io/…
192 conan install --requires="zstd/[*]" --build=missing
195 The zstd Conan recipe is kept up to date by Conan maintainers and community contributors.
196 …e, please [create an issue or pull request](https://github.com/conan-io/conan-center-index) on the…
201 - Projects for Visual Studio 2005, 2008 and 2010.
202 + VS2010 project is compatible with VS2012, VS2013, VS2015 and VS2017.
203 - Automated build scripts for Visual compiler by [@KrzysFR](https://github.com/KrzysFR), in `build/…
204 which will build `zstd` cli and `libzstd` library without any need to open Visual Studio solution.
208 You can build the zstd binary via buck by executing: `buck build programs:zstd` from the root of th…
209 The output binary will be in `buck-out/gen/programs/`.
213 … integrate zstd into your Bazel project by using the module hosted on the [Bazel Central Repositor…
219 Two env variables `$ZSTD_BIN` and `$DATAGEN_BIN` are needed for the test script to locate the `zstd…
230 Zstandard is dual-licensed under [BSD](LICENSE) OR [GPLv2](COPYING).