• Home
  • Line#
  • Scopes#
  • Navigate#
  • Raw
  • Download
1# Overview
2
3This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our
4tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.
5
6# Unit tests (run_tests.py)
7
8Builds gRPC in given language and runs unit tests. Use `tools/run_tests/run_tests.py --help` for more help.
9
10###### Example
11`tools/run_tests/run_tests.py -l csharp -c dbg`
12
13###### Useful options (among many others)
14- `--use_docker` Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
15- `--build_only` Only build, do not run the tests.
16
17Note: If you get an error such as `ImportError: No module named httplib2`, then you may be missing some Python modules. Install the module listed in the error and try again.
18
19Note: some tests may be flaky. Check the "Issues" tab for known flakes and other issues.
20
21The full suite of unit tests will take many minutes to run.
22
23# Interop tests (run_interop_tests.py)
24
25Runs tests for cross-platform/cross-language interoperability. For more details, see [Interop tests descriptions](/doc/interop-test-descriptions.md)
26The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.
27
28###### Example
29`tools/run_tests/run_interop_tests.py -l csharp -s c++ --use_docker` (run interop tests with C# client and C++ server)
30
31Note: if you see an error like `no space left on device` when running the
32interop tests using Docker, make sure that Docker is building the image files in
33a location with sufficient disk space.
34
35# Performance benchmarks (run_performance_tests.py)
36
37Runs predefined benchmark scenarios for given languages. Besides the simple configuration of running all the scenarios locally,
38the script also supports orchestrating test runs with client and server running on different machines and uploading the results
39to BigQuery.
40
41###### Example
42`tools/run_tests/run_performance_tests.py -l c++ node`
43
44###### Useful options
45- `--regex` use regex to select particular scenarios to run.
46
47# Artifacts & Packages (task_runner.py)
48
49A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)
50
51###### Example
52`tools/run_tests/task_runner.py -f python artifact linux x64` (build tasks with labels `python`, `artifact`, `linux`, and `x64`)
53
54