README.md
1# `android_bench_suite`
2
3This is a Android Toolchain benchmark suite.
4
5Where to find this suite:
6
7This suite locates at google3, please create a google3 branch first, then run:
8
9```
10$ cd experimental/users/zhizhouy/benchtoolchain
11```
12
13Copy this directory to the place you want to put it.
14
15To use this suite:
161. Configure the basic envrionment in `env_setting` file.
17
182. Run `./apply_patches.py`, which will:
19
20 1. Patch all the android benchmarks in the android tree.
21 Benchmark Panorama does not exist in android tree, so perftests/
22 gets copied into the top-level of android tree.
23
24 2. Apply patch autotest.diff to `android_root/external/autotest`, which
25 includes all the test scripts for benchmarks. Copy testcases to
26 related autotest directory.
27
28 If you have applied the patch partially and hope to discard the
29 patch, just run `discard_patches.py`
30
313. Build and run benchmark on the device using ./run.py. You can either
32 use test configuration file (-t `test_config`), or set all the variables
33 manually.
34
354. The raw results locate at `bench_result_*` in bench suite home
36 directory.
37
385. The JSON format result will be generated for crosperf report.
39
40Utility tools:
41
421. Autotest is a test framework located in android exteranl/autotest
43 Before first time running it, please run
44 `utils/build_externals.py` first to ensure all the environments
45 and tools needed are installed.
46
472. Crosperf is a report generating tool in ChromeOS toolchain utilities.
48 Please look for it in chromium source:
49 `src/third_party/toolchain-utils/crosperf`.
50