• Home
  • Raw
  • Download

Lines Matching +full:build +full:- +full:and +full:- +full:run +full:- +full:tests

7 ------------
9 [Github](https://github.com/linux-test-project/ltp) (upstream)
11 LTP (Linux Test Project) is a suite of tests that covers both kernel interfaces
12 and userspace functionality (glibc, commonly used binaries, etc).  For the
14 and in fact much of it must be disabled, given the functionality is not
17 As of Jan 2023 there are on the order of 1300 tests executed in VTS on arm64.
18 Most tests are run in both 32-bit and 64-bit mode. Many more are available but
21 How is LTP Run in VTS?
22 ----------------------
28 test/vts-testcase/kernel/ltp. Some noteworthy directories/files:
30 * `external/ltp/android/`: Contains Android-specific files, aside from Android.[bp, mk] at top leve…
31 …ernal/ltp/android/Android.ltp.mk`: Lists build rules for the LTP modules built under make. This fi…
32 * `external/ltp/gen.bp`: Lists build rules for the LTP modules built under Soong. This file gets au…
33 …d/ltp_package_list.mk`: Lists all tests that will get pulled into VTS - VTS depends on this list. …
34 …tests which cannot or should not be compiled for Android. This file is read by gen_android_build.s…
35 * `external/ltp/testcases`: Source for LTP tests. Among the most important for the purposes of Treb…
36 * `test/vts-testcase/kernel/ltp/testcase/tools/configs/disabled_tests.py`: Any test listed here wil…
37 * `test/vts-testcase/kernel/ltp/testcase/tools/configs/stable_tests.py`: Any test listed here will …
40 -------------------------
41 You can run LTP tests with atest, which handles all the setup and build steps.
43 To run all 32 bit LTP tests:
46 To run all 64 bit LTP tests:
49 To run a single test:
53 -----------------------
54 To run VTS LTP it must first be built. VTS is not device specific, you need not
55 compile it specifically for the device you wish to run it on, assuming it is
58 * `. build/envsetup.sh`
60 * `make -j vts`
62 Then open vts-tradefed and run the VTS stable set:
63 * `vts-tradefed`
64 * `vts-tf > run vts-kernel -m vts_ltp_test_arm`
67 specific device you wish to run VTS on via the serial number:
68 * `vts-tf > run vts-kernel -m vts_ltp_test_arm -s 000123456789`
71 * `vts-tf > run vts-kernel -m vts_ltp_test_arm -t dio.dio13_32bit`
74 --------------------
76 Running LTP tests within VTS can be quite cumbersome, especially if you are
77 iterating a lot trying to debug something. Build and run LTP tests faster by
86 * `external/ltp$ git clean -x -f -d`
87 Otherwise, build will fail.
90 of these tests, you can set the following environment variables before you run
97 * `mkdir -p /data/local/tmp/ltp/tmp/ltptemp`
98 * `mkdir -p /data/local/tmp/ltp/tmp/tmpbase`
99 * `mkdir -p /data/local/tmp/ltp/tmp/tmpdir`
100 * `restorecon -F -R /data/local/tmp/ltp`
108 For running 64-bit tests:
111 Or For running 32-bit tests:
114 How do I enable or disable tests from the LTP build?
115 ----------------------------------------------------
117 Tests are disabled from the LTP build by adding them to
118 external/ltp/android/tools/disabled_tests.txt. Many tests have been added to
119 this file over time. Some of them are not applicable to Android and therefore
124 and then update the Android-specific build files for LTP, mentioned above:
132 are in external/ltp/android/how-to-update.txt.
135 How do I enable or disable tests from VTS LTP?
136 ----------------------------------------------
139 to configure the VTS harness for LTP to determine which tests are in the stable
141 affect whether the test is built, but rather determines whether it is run at
144 The file test/vts-testcase/kernel/ltp/testcase/tools/configs/stable_tests.py
145 lists tests that will run as part of VTS (vts_ltp_test_arm/vts_ltp_test_arm_64).
148 set. The behavior of the test will be observed over a period of time and ensure
152 Tests that will never be relevant to Android should be disabled from the build
153 in external/ltp. Tests that are (hopefully) temporarily broken should be
154 runtime disabled in VTS. The staging and stable sets should normally all be
158 If the runtime of LTP changes significantly be sure to update the runtime-hint
159 and test-timeout parameters to VTS in
160 `test/vts-testcase/kernel/ltp/stable/AndroidTest.xml`.
164 ----------------------------------------------------------
166 The internal portal at go/vts11-dashboard shows results for the continuous VTS testing
169 Test results are also gathered by Linaro and may be seen
170 [here](https://qa-reports.linaro.org/android-lkft/).
173 Help! The external/ltp build is failing!
174 ----------------------------------------
177 recently merged or the build files were recently updated, stale files in
178 external/ltp can cause build failures.
182 ------------------------------
184 The hotlist for LTP bugs is [ltp-todo](https://buganizer.corp.google.com/hotlists/733268).
191 --------------
193 It is not advisable to run LTP tests directly on your host unless you are fully
194 aware of what the tests will do and are okay with it. These tests may
195 destabilize your box or cause data loss. If you need to run tests on an x86
196 platform and are unsure if they are safe you should run them in emulation, in a
199 To run LTP tests for x86 platform, you can do:
205 ----------------------
210 the kernel repository) clean and sent in plain text in canonical patch format.
211 One easy way to do this is by using git format-patch and git send-email.
218 ------------------------
225 -------------------------------------------
228 upstream development is important to get additional tests and bug-fixes.
233 repository, called `aosp/upstream-master`.
239 itself and conflicts resolutions:
246 $ git log --oneline aosp/upstream-master
247 c00f96994 (aosp/upstream-master) openposix/Makefile: Use tabs instead of spaces
252 Force the creation of a merge commit (no fast-forward).
254 `git merge <release commit> --no-ff`
259 `git clean -dfx && make autotools && ./configure && make -j`
267 ### Update the Android build targets
269 Building LTP with the Android build system requires the additional Android
270 build configuration files mentioned above.
271 A new LTP release may have disabled existing tests or enabled new ones, so the
272 Android build configurations must be updated accordingly.
275 `git clean -dfx && android/tools/gen_android_build.sh && git clean -dfx && mma .`
278 `android/ltp_package_list.mk` and `gen.bp`.
282 `android/tools/compare_ltp_projects.py` is a script that helps comparing the tests available in two…
285 LTP_OLD=/tmp/ltp-base
286 git archive aosp/master | tar -x -C $LTP_OLD
287 android/tools/compare_ltp_projects.py --ltp-new $LTP_NEW --ltp-old $LTP_OLD