Changes between Version 21 and Version 22 of Rebaseline


Ignore:
Timestamp:
Aug 6, 2012 4:54:22 PM (12 years ago)
Author:
pkasting@chromium.org
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Rebaseline

    v21 v22  
    2020You should start on the "Unexpected failures" tab.  Look at the "Latest revision processed by every bot" line.  If this revision does not contain all tests and changes you want reflected in the new baselines, do not proceed; you must wait until the bots cycle sufficiently, or you may check in erroneous baselines.
    2121
    22 To examine the current results for a particular test, either hover the test name on the "Unexpected failures" tab and click the blue "Examine" button that appears to the right, or switch to the "Expected failures" tab and hover the appropriate test directory and click "Examine".  Either one will take you to the "Results" tab where you can select the test you're interested in from the list at the top.  Be sure that your test does not appear in both the "expected" and "unexpected" lists, as may happen if your TestExpectations already list some failures for the test, but you're now seeing additional ones; if this is the case, then each "Results" set will only reflect the expected or unexpected failing results, respectively.  This can lead to generating incorrect baselines.  To resolve this, update your test expectations to list all the failures, commit, and wait for the bots to cycle, so that all your failures will be "expected".
     22To examine the current results for a particular test, either hover the test name on the "Unexpected failures" tab and click the blue "Examine" button that appears to the right, or switch to the "Expected failures" tab and hover the appropriate test directory and click "Examine".  Either one will take you to the "Results" tab where you can select the test you're interested in from the list at the top.  (Note: Your test may appear in both the "expected" and "unexpected" lists if your TestExpectations already lists some failures for the test, but you're now seeing additional ones.  In this case, the "Results" tab will only show one of the two sets of results at a time, depending on which set you asked to "Examine".  Make sure you rebaseline both sets if you mean to completely rebaseline the test -- at the end of that process, you should have a fully optimal set of local baselines just as if you'd rebaselined the entire set of all results at once.)
    2323
    2424Once you have the results up for a test, you can use the arrow buttons on the right side just below the test list to quickly scan through the current results for the test.  (Going past the last result for a test will skip to the next test in the list.)  Make sure all the results appear (and are as you expect); this ensures that the tool can actually reach all the bots and fetch the expected results.  (Unreachable bots can be another source of incorrect baseline generation.)