Lines Matching full:suite
10 The desired test suite will be scheduled with autotest. By default,
15 dynamic suite infrastructure in server/cros/dynamic_suite.py.
18 0 - OK: Suite finished successfully
24 * Suite job issues, like bug in dynamic suite,
25 user aborted the suite, lose a drone/all devservers/rpc server,
30 4 - SUITE_TIMEOUT: Suite timed out, some tests ran,
31 none failed by the time the suite job was aborted. This will cover,
34 * No DUTs available midway through a suite
87 # E.g. if we have a test failure and the suite also timed out,
165 help="Address of a webserver to receive suite requests.")
197 "suite, and creates report.")
199 # --no_wait is passed in to the suite rpc itself and affects the suite,
203 help="Create the suite and print the job id, then "
221 help="Priority of suite. Either numerical value, or "
229 'allowed at suite level. No limit if not specified.')
233 'healthy machines, otherwise suite will not run. '
239 'the suite when it is competing with another suite '
244 help="Argument string for suite control file.")
253 help='Advanced. Run the suite based on ATTRIBUTES of '
254 'control files, rather than SUITE.')
275 help='A dict of job keyvals to be inject to suite control file')
291 # suite scheduler v2.
294 help=('Check lab and job status before kicking off a suite. Used by '
295 'suite scheduler v2.'))
310 print ('When using -m, need to specify build, board and suite '
321 print 'Need to specify suite name'
330 print ('The new suite control file cannot parse the suite_args: %s.'
345 new style suite control file, suite_attr_wrapper. Then, change the
356 attr_filter_val = 'suite:%s' % options.name
358 attr_filter_val = ' or '.join(['suite:%s' % x for x in options.name])
410 """Get the original suite name when running suite_attr_wrapper.
412 @param suite_name: the name of the suite launched in afe. When it is
413 suite_attr_wrapper, the suite that actually running is
415 @param suite_args: the parsed option which contains the original suite name.
417 @returns: the original suite name.
423 if x and x.startswith('suite:')])
452 @param server The hostname of the server this suite ran on.
581 """Timings for important events during a suite.
585 @var suite_job_id: the afe job id of the suite job for which
595 @var suite_start_time: the time the suite started.
608 # suite instead of an individual test.
620 info about the various parts of a suite run. This method can take
677 'Suite timings:\n'
680 'Suite started at %s\n'
693 Return the hostname of the server that should be used to service a suite
696 @param pool_name: The pool (without 'pool:' to schedule the suite against.
697 @return: The correct host that should be used to service this suite run.
708 SUITE_JOB = 'Suite job'
719 @param suite_name: The name of the suite
723 @param solo_test_run: This is a solo test run not part of a suite.
735 # usually indicates suite has timed out (unless aborted by user).
766 Remove 'build/suite' prefix if any.
775 1) A test view is for the suite job's SERVER_JOB.
776 In this case, this method will return 'Suite job'.
779 suite, and for a SERVER_JOB or CLIENT_JOB.
780 In this case, we will take the job name, remove the build/suite
788 3) A test view is of a suite job and its status is ABORT.
800 4) A test view's status is of a suite job and its status is TEST_NA.
816 # Rename suite job's SERVER_JOB to 'Suite job'.
826 # Remove the build and suite name from testname if any.
833 """Checks whether this is a suite view we should care about.
867 that belongs to a suite job and are determined as irrelevant
869 to the suite job, whose job start/finished time make no sense
877 # Any relevant suite test view except SUITE_JOB
896 For suite job and child job test views, we check job keyval
899 For relevant suite job test views, we only check test status
900 because the suite job keyval won't make sense to individual
957 will be stored in the suite job's keyvals. This method attempts to
962 @param suite_job_keyvals: The job keyval dictionary of the suite job.
964 suite job's keyvals.
988 For suite job view, show buildbot link if it fails.
995 suite has timed out).
1080 # This gurantees that the suite has timed out.
1085 # because the suite has timed out, but may
1087 # Since suite timing out is determined by checking
1088 # the suite job view, we simply ignore this view here.
1097 # The test/suite job raised a wanrning.
1121 return 'Suite job failed or provisioning failed.'
1124 ' suite must have timed out.')
1137 """Collect test results of a suite or a single test run.
1139 Once a suite job has finished, use this class to collect test results.
1147 1) Collect the suite job's results from tko_test_view_2.
1148 For the suite job, we only pull test views without a 'subdir'.
1159 4) Compute timings of the suite run.
1163 to service the suite.
1166 @var _build: The build for which the suite is run,
1168 @var _board: The target board for which the suite is run,
1170 @var _suite_name: The suite name, e.g. 'bvt', 'dummy'.
1171 @var _suite_job_id: The job id of the suite for which we are going to
1173 @var _original_suite_name: The suite name we record timing would be
1177 the suite is.
1179 test views of the suite job.
1190 @var is_aborted: Whether the suite was aborted or not.
1192 @var timings: A Timing object that records the suite's timings.
1228 """Fetch relevant test views of the suite job.
1230 For the suite job, there will be a test view for SERVER_JOB, and views
1232 a suite job (afe_job_id: 40) that runs dummy_Pass, dummy_Fail,
1235 So the suite job's test views would look like
1244 For a suite job, we only care about
1245 a) The test view for the suite job's SERVER_JOB
1252 test views of the suite job.
1264 # displayed in the suite view instead of the child view,
1265 # then afe_job_id is incorrect and from the suite.
1338 # state, we read the test view from the suite job
1340 # suite job's page for the aborted job. Need a fix.
1343 # Bug info are stored in the suite job's keyvals.
1366 """Record suite timings."""
1401 # Output suite timings
1460 # Write the suite timings into |output_dict|
1482 Fetch relevent test views of the suite job.
1484 Check whether the suite was aborted.
1486 Calculate suite timings.
1500 # This can happen when a suite job in Starting status is aborted. When
1502 # max_jobs_started_per_cycle, a suite job can stays in Starting status.
1516 # Record suite runtime in metadata db.
1531 """Create a dict of builds for creating a suite job.
1553 """Create a suite with retries.
1555 @param afe: The afe object to insert the new suite job into.
1556 @param options: The options to use in creating the suite.
1558 @return: The afe_job_id of the new suite job.
1589 """Result of running a suite to return."""
1607 # If indicate to use the new style suite control file, convert the args
1664 logging.info('%s Created suite job: %s',
1668 text='Link to suite',
1719 """Handle suite job synchronously.
1722 @param job_id Suite job id.
1724 @param job_timer JobTimer for suite job.
1727 @return SuiteResult of suite job.
1734 logging.info('The suite job has another %s till timeout.',
1737 logging.info('%s Suite job is finished.',
1740 # a suite has timed out by checking information in the test view.
1744 # the suite finishes to make it as accurate as possible.
1754 # Extract the original suite name to record timing.
1769 # for provision suite to pass if only a
1772 # failure even if the suite reports
1788 # Do not record stats if the suite was aborted (either by a user
1793 logging.info('%s Gathering timing stats for the suite job.',
1798 # There are two possible cases when a suite times out.
1799 # 1. the suite job was aborted due to timing out
1800 # 2. the suite job succeeded, but some child jobs
1801 # were already aborted before the suite job exited.
1808 return_message = 'Suite job timed out.'
1810 'because suite job has timed out.',
1819 # aborting the suite or checking for results.
1838 """Handle suite job asynchronously.
1840 @param job_id Suite job id.
1844 @return SuiteResult of suite job.
1846 logging.info('Created suite job: %r', job_id)
1857 """Check whether the suite should be run based on lab/job status checking.
1865 'suite %s, board %s, build %s: %s',
1884 @param job_id Suite job id.
1885 @param job_timer JobTimer for suite job.
1963 logging.info('Lab is closed, OR build %s is blocked, OR suite '