This is a Android Toolchain benchmark suite. =========================================== Where to find this suite: This suite locates at google3, please create a google3 branch first, then run: $cd experimental/users/zhizhouy/benchtoolchain Copy this directory to the place you want to put it. To use this suite: 1. Configure the basic envrionment in env_setting file. 2. Run ./apply_patches.py, which will: 1) Patch all the android benchmarks in the android tree. Benchmark Panorama does not exist in android tree, so perftests/ gets copied into the top-level of android tree. 2) Apply patch autotest.diff to android_root/external/autotest, which includes all the test scripts for benchmarks. Copy testcases to related autotest directory. If you have applied the patch partially and hope to discard the patch, just run discard_patches.py 3. Build and run benchmark on the device using ./run.py. You can either use test configuration file (-t test_config), or set all the variables manually. 4. The raw results locate at bench_result_* in bench suite home directory. 5. The JSON format result will be generated for crosperf report. Utility tools: 1. Autotest is a test framework located in android exteranl/autotest Before first time running it, please run utils/build_externals.py first to ensure all the environments and tools needed are installed. 2. Crosperf is a report generating tool in ChromeOS toolchain utilities. Please look for it in chromium source: src/third_party/toolchain-utils/crosperf.