| /third_party/flutter/flutter/dev/devicelab/ |
| D | manifest.yaml | 20 # run device tests on red Cirrus builds.
26 # * flaky: boolean true or false
27 # whether the task is considered flaky; the result of running a flaky task does not affect
28 # the overall build status. Tests should be marked flaky when newly added, until they have
29 # been proved for a few cycles. Tests that are actually flaky but not being actively worked
35 # Tests of compiling in a variety of modes
133 flaky: true
135 # Android on-device tests
213 Tests embedded Android views.
219 Tests that the Android accessibility bridge produces correct semantics.
[all …]
|
| D | README.md | 3 "Devicelab" (a.k.a. "cocoon") is a physical lab that tests Flutter on real
6 This package contains the code for test framework and the tests. More generally
7 the tests are referred to as "tasks" in the API, but since we primarily use it
8 for testing, this document refers to them as "tests".
10 Build results are available at https://flutter-dashboard.appspot.com.
16 The build page is accessible at https://flutter-dashboard.appspot.com/build.html.
28 
33 statuses are color-coded. The following statuses are available:
43 **Task is flaky** (yellow): the task was attempted multiple time, but only the
55 In addition to color-coding, a task may display a question mark. This means
[all …]
|
| /third_party/node/.github/ISSUE_TEMPLATE/ |
| D | 4-report-a-flaky-test.md | 1 ---
2 name: Report a flaky test
3 about: Report a flaky test in our CI
4 labels: "CI / flaky test"
6 ---
8 <!--
9 Thank you for reporting a flaky test.
11 Flaky tests are tests that fail occasionally in the Node.js CI, but not
17 Test: The test that is flaky - e.g. `test-fs-stat-bigint`
18 Platform: The platform the test is flaky on - e.g. `macos` or `linux`
[all …]
|
| /third_party/node/.github/workflows/ |
| D | pythonpackage.yml | 7 runs-on: ubuntu-latest
9 fail-fast: false
10 max-parallel: 1
12 python-version: [3.8] # [2.7, 3.5, 3.6, 3.7]
14 - uses: actions/checkout@v2
15 - name: Set up Python ${{ matrix.python-version }}
16 uses: actions/setup-python@v1
18 python-version: ${{ matrix.python-version }}
19 - name: Compile Node.js
22 make -j2 V=1
[all …]
|
| /third_party/grpc/test/core/end2end/ |
| D | generate_tests.bzl | 8 # http://www.apache.org/licenses/LICENSE-2.0
16 """Generates the appropriate build.json data for all the end2end tests."""
58 # TODO(juanlishen): This is disabled for now, but should be considered to re-enable once we have
122 # TODO(juanlishen): This is disabled for now, but should be considered to re-enable once we have
207 # TODO(b/151212019): Test case known to be flaky under epoll1.
274 # TODO(roth): Remove proxyable=False for all retry tests once we
287 # TODO(jtattermusch): too long bazel test name makes the test flaky on Windows RBE
294 # TODO(jtattermusch): too long bazel test name makes the test flaky on Windows RBE
305 # TODO(jtattermusch): too long bazel test name makes the test flaky on Windows RBE
333 # TODO(jtattermusch): too long bazel test name makes the test flaky on Windows RBE
[all …]
|
| /third_party/curl/tests/ |
| D | CMakeLists.txt | 8 # Copyright (C) 1998 - 2020, Daniel Stenberg, <daniel@haxx.se>, et al.
44 add_runtests(test-quiet "-a -s")
45 add_runtests(test-am "-a -am")
46 add_runtests(test-full "-a -p -r")
47 # !flaky means that it'll skip all tests using the flaky keyword
48 add_runtests(test-nonflaky "-a -p !flaky")
49 add_runtests(test-torture "-a -t")
50 add_runtests(test-event "-a -e")
|
| D | Makefile.am | 8 # Copyright (C) 1998 - 2020, Daniel Stenberg, <daniel@haxx.se>, et al.
30 serverhelp.pm tftpserver.pl rtspserver.pl directories.pm symbol-scan.pl \
31 CMakeLists.txt mem-include-scan.pl valgrind.supp extern-scan.pl \
32 manpage-scan.pl nroff-scan.pl http2-server.pl dictserver.py \
34 disable-scan.pl manpage-syntax.pl error-codes.pl badsymbols.pl \
35 azure.pm appveyor.pm version-scan.pl options-scan.pl
53 PERLFLAGS = -I$(srcdir)
63 TEST = @echo "NOTICE: we can't run the tests when cross-compiling!"
64 else # if not cross-compiling:
66 TEST_Q = -a -s
[all …]
|
| /third_party/grpc/templates/tools/run_tests/generated/ |
| D | tests.json.template | 2 --- |
16 "flaky": tgt.flaky,
31 tests,
|
| /third_party/grpc/tools/run_tests/ |
| D | run_tests.py | 8 # http://www.apache.org/licenses/LICENSE-2.0
15 """Run tests in parallel."""
68 BigQueryTestData = collections.namedtuple('BigQueryTestData', 'name flaky cpu')
78 SUM(result != 'PASSED' AND result != 'SKIPPED') > 0 as flaky,
85 [grpc-testing:jenkins_test_results.aggregate_results]
87 timestamp >= DATE_ADD(CURRENT_DATE(), -1, "WEEK")
94 query_job = big_query_utils.sync_query_job(bq, 'grpc-testing', query)
154 flaky=False): argument
164 if not flaky and shortname and shortname in flaky_tests:
165 flaky = True
[all …]
|
| D | README.md | 3 This directory contains scripts that facilitate building and running tests. We are using python scr…
4 tests because that gives us the opportunity to run tests using the same commandline regardless of t…
6 # Unit tests (run_tests.py)
8 Builds gRPC in given language and runs unit tests. Use `tools/run_tests/run_tests.py --help` for mo…
11 `tools/run_tests/run_tests.py -l csharp -c dbg`
14 - `--use_docker` Builds a docker container containing all the prerequisites for given language and …
15 - `--build_only` Only build, do not run the tests.
19 Note: some tests may be flaky. Check the "Issues" tab for known flakes and other issues.
21 The full suite of unit tests will take many minutes to run.
23 # Interop tests (run_interop_tests.py)
[all …]
|
| /third_party/grpc/test/cpp/qps/ |
| D | gen_build_yaml.py | 9 # http://www.apache.org/licenses/LICENSE-2.0
78 # make an arbitrary guess if set to auto-detect
79 # about the size of the jenkins instances we have for unit tests
100 'tests':
107 '--scenarios_json',
112 'flaky':
139 '--run_inproc', '--scenarios_json',
144 'flaky':
169 '--scenarios_json',
174 'flaky':
|
| /third_party/flutter/flutter/dev/devicelab/lib/framework/ |
| D | manifest.dart | 2 // Use of this source code is governed by a BSD-style license that can be
48 /// A human-readable description of the task.
57 /// Whether this test is flaky.
59 /// Flaky tests are not considered when deciding if the build is broken.
96 'flaky',
100 final dynamic isFlaky = taskYaml['flaky'];
102 _checkType(isFlaky is bool, isFlaky, 'flaky', 'boolean');
|
| /third_party/node/tools/ |
| D | test.py | 92 # ---------------------------------------------
93 # --- P r o g r e s s I n d i c a t o r s ---
94 # ---------------------------------------------
132 # Spawn N-1 threads and then use this thread as the last one.
133 # That way -j1 avoids threading altogether which is a nice fallback
135 for i in range(tasks - 1):
143 # Use a timeout so that signals (ctrl-c) will be processed.
176 # See https://smartos.org/bugview/OS-2767
183 case.duration = (datetime.now() - start)
190 if FLAKY in output.test.outcomes and self.flaky_tests_mode == DONTCARE:
[all …]
|
| /third_party/grpc/tools/internal_ci/helper_scripts/ |
| D | prepare_build_macos_rc | 1 #!/bin/bash -ex
8 # http://www.apache.org/licenses/LICENSE-2.0
19 ulimit -a
23 # - think twice before adding installer that takes long time (builds are already slow)
24 # - do not add any steps that are flaky (builds will become flaky)
25 # - try adding a dependency under a language-specific section first (reduces latency and increases …
26 # - only add stuff that you absolutely need for your builds to work (add comment to explain why its…
29 pip install --user google-api-python-client oauth2client
30 export GOOGLE_APPLICATION_CREDENTIALS=${KOKORO_GFILE_DIR}/GrpcTesting-d0eeee2db331.json
32 # If this is a PR using RUN_TESTS_FLAGS var, then add flags to filter tests
[all …]
|
| /third_party/grpc/tools/buildgen/ |
| D | extract_metadata_from_bazel_xml.py | 8 # http://www.apache.org/licenses/LICENSE-2.0
30 ['tools/bazel', 'query', '--noimplicit_deps', '--output', 'xml', query])
46 'flaky': False,
60 if bool_name in ['flaky']:
111 """Gets list of non-public headers from a bazel rule"""
196 deps_added += len(new_deps) - len(old_deps)
251 bazel_dep = build_order[-1]
294 … # make the 'deps' field transitive, but only list non-intermediate deps and selected external deps
331 # otherwise the already-renamed libraries will have different names than expected
390 None) # public headers make no sense for tests
[all …]
|
| /third_party/flutter/skia/infra/bots/recipes/ |
| D | infra.py | 2 # Use of this source code is governed by a BSD-style license that can be
6 # Recipe which runs the Skia infra tests.
22 # Run the infra tests.
23 repo_name = api.properties['repository'].split('/')[-1]
25 repo_name = repo_name[:-len('.git')]
42 # Some tests assume that they're being run inside a git repo.
45 api.step('git commit', cmd=['git', 'commit', '-a', '-m', 'initial commit'])
47 # Unfortunately, the recipe tests are flaky due to file removal on Windows.
52 api.step('infra_tests', cmd=['python', '-u', infra_tests])
62 api.properties(buildername='Housekeeper-PerCommit-InfraTests_Win',
|
| /third_party/grpc/tools/buildgen/plugins/ |
| D | make_fuzzer_tests.py | 7 # http://www.apache.org/licenses/LICENSE-2.0
14 """Create tests for each fuzzer"""
22 tests = dictionary['tests']
44 tests.append({
52 'flaky': False,
|
| /third_party/grpc/bazel/ |
| D | grpc_build_system.bzl | 7 # http://www.apache.org/licenses/LICENSE-2.0
22 # Each rule listed must be re-written for Google's internal build system, and
81 copts = if_mac(["-DGRPC_CFSTREAM"])
83 copts = copts + if_not_windows(["-std=c99"])
84 linkopts = if_not_windows(["-pthread"])
86 linkopts = linkopts + if_mac(["-framework CoreFoundation"])
112 "src/core/ext/upb-generated", # Once upb code-gen issue is resolved, remove this.
171 …one, tags = [], exec_compatible_with = [], exec_properties = {}, shard_count = None, flaky = None):
172 copts = if_mac(["-DGRPC_CFSTREAM"])
174 copts = copts + if_not_windows(["-std=c99"])
[all …]
|
| /third_party/grpc/src/python/grpcio_tests/tests_aio/unit/ |
| D | BUILD.bazel | 7 # http://www.apache.org/licenses/LICENSE-2.0
44 "//src/python/grpcio_tests/tests/unit:resources",
61 name = test_file_name[:-3],
65 "//src/python/grpcio_tests/tests/unit/credentials",
67 flaky = test_file_name in _FLAKY_TESTS,
80 "//src/python/grpcio_tests/tests/unit:resources",
81 "//src/python/grpcio_tests/tests/unit/framework/common",
|
| /third_party/flutter/skia/third_party/externals/angle2/src/tests/test_expectations/ |
| D | GPUTestExpectationsParser_unittest.cpp | 3 // Use of this source code is governed by a BSD-style license that can be
6 // GPUTestExpectationsParser_unittest.cpp: Unit tests for GPUTestExpectationsParser*
9 #include "tests/test_expectations/GPUTestExpectationsParser.h"
11 #include "tests/test_expectations/GPUTestConfig.h"
39 R"(100 : dEQP-GLES31.functional.layout_binding.ubo.vertex_binding_max = SKIP)"; in TEST()
44 parser.getTestExpectation("dEQP-GLES31.functional.layout_binding.ubo.vertex_binding_max"), in TEST()
54 R"(100 : dEQP-GLES31.functional.layout_binding.ubo.vertex_binding_max = FAIL)"; in TEST()
59 parser.getTestExpectation("dEQP-GLES31.functional.layout_binding.ubo.vertex_binding_max"), in TEST()
69 R"(100 : dEQP-GLES31.functional.layout_binding.ubo.vertex_binding_max = PASS)"; in TEST()
74 parser.getTestExpectation("dEQP-GLES31.functional.layout_binding.ubo.vertex_binding_max"), in TEST()
[all …]
|
| /third_party/flutter/skia/modules/pathkit/tests/ |
| D | pathops.spec.js | 6 …return `${(bounds.fLeft-2)*.95} ${(bounds.fTop-2)*.95} ${(bounds.fRight+2)*1.05} ${(bounds.fBottom…
19 max-width: 45%;
20 vertical-align: top;
35 <path stroke=black fill=white stroke-width=0.01 d="${expectedPath.toSVGString()}"></path>
39 <path stroke=black fill=white stroke-width=0.01 d="${actualPath.toSVGString()}"></path>
66 if (Math.abs(eCmd[arg] - aCmd[arg]) > TOLERANCE) {
113 // ./out/Clang/pathops_unittest -J ./modules/pathkit/tests/PathOpsOp.json -m PathOpsOp$
114 fetch('/base/tests/PathOpsOp.json').then((r) => {
118 // Assert we loaded a non-zero amount of tests, i.e. the JSON is valid.
149 } else if (test.expectMatch === 'flaky') {
[all …]
|
| /third_party/flutter/skia/third_party/externals/angle2/src/tests/deqp_support/ |
| D | deqp_khr_gles2_test_expectations.txt | 2 // Use of this source code is governed by a BSD-style license that can be
5 // This file contains a list of defective dEQP conformance tests. The expected
7 // {BUG#} {MODIFIERS} : {TEST_NAME} = {PASS,FAIL,FLAKY,TIMEOUT,SKIP}
33 3457 VULKAN : KHR-GLES2.core.internalformat.texture2d.depth_stencil_unsigned_int_24_8_depth_stencil…
36 3797 VULKAN : KHR-GLES2.texture_3d.framebuffer_texture.rgba8 = SKIP
40 3797 VULKAN : KHR-GLES2.texture_3d.copy_sub_image.rgba8 = FAIL
42 // Compressed texture tests on Android
43 3190 VULKAN PIXEL2 : KHR-GLES2.texture_3d.compressed_texture.rgba_astc_* = SKIP
44 3190 VULKAN PIXEL2 : KHR-GLES2.texture_3d.compressed_texture.sgb8_alpha8_astc_* = SKIP
45 3190 VULKAN PIXEL2 : KHR-GLES2.texture_3d.compressed_texture.srgb8_alpha8_astc_* = SKIP
[all …]
|
| /third_party/flutter/engine/flutter/lib/web_ui/lib/src/ui/ |
| D | initialization.dart | 2 // Use of this source code is governed by a BSD-style license that can be
62 /// For example in these tests we use a predictable-size font which makes widget
63 /// tests less flaky.
|
| /third_party/flutter/engine/flutter/shell/common/ |
| D | shell_test.h | 2 // Use of this source code is governed by a BSD-style license that can be
49 // declarations as shell unit tests and Shell are in different name spaces.
54 // Do not assert |UnreportedTimingsCount| to be positive in any tests.
55 // Otherwise those tests will be flaky as the clearing of unreported timings
|
| /third_party/flutter/skia/tests/ |
| D | Skbug6653.cpp | 4 * Use of this source code is governed by a BSD-style license that can be
15 #include "tests/Test.h"
19 bmp.allocN32Pixels(surface->width(), surface->height()); in read_pixels()
21 if (!surface->readPixels(bmp, 0, 0)) { in read_pixels()
41 // The one device that fails this test (Galaxy S6) does so in a flaky fashion. Trying many in test_bug_6653()
54 s1->getCanvas()->clear(SK_ColorBLACK); in test_bug_6653()
55 s1->getCanvas()->drawOval(rect, paint); in test_bug_6653()
61 s2->getCanvas()->clear(SK_ColorBLUE); in test_bug_6653()
66 s3->getCanvas()->clear(SK_ColorBLUE); in test_bug_6653()
68 s0->getCanvas()->drawBitmap(b3, 0, 0); in test_bug_6653()
[all …]
|