Changes between Version 4 and Version 5 of SelectiveTestEWS


Ignore:
Timestamp:
Jul 6, 2012 6:46:33 AM (12 years ago)
Author:
kerekattila.hun@gmail.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • SelectiveTestEWS

    v4 v5  
    66
    77The test system is modified so that it executes both the full and the selective test on the patch. First the test selection is performed based on the changes in the patch and using the coverage database, and if it returns a non-trivial selection (not 0 and not all the tests), then the full test is executed on the same patch. The system returns always with a failure so that we can examine the build logs to verify the correctness.
     8
     9= For example =
     10
     11Here will be some example, where the early warning system caught a bug with test selection:[[BR]]
     12[[BR]]
     13 * At revision [http://trac.webkit.org/changeset/115655 115655] the patch committed for the bug [https://bugs.webkit.org/show_bug.cgi?id=85217 85217] failed on the fast/flexbox/flex-hang.html test with unexpected text diff mismatch. For this result we had to run only 1036 test case.
     14
     15 * At revision [http://trac.webkit.org/changeset/115781 115781] the patch committed for the bug [https://bugs.webkit.org/show_bug.cgi?id=85334 85334] failed on the following tests:
     16     editing/deleting/5546763.html[[BR]]
     17     editing/deleting/delete-block-merge-contents-005.html[[BR]]
     18     editing/deleting/delete-block-merge-contents-006.html[[BR]]
     19     editing/deleting/delete-block-merge-contents-008.html[[BR]]
     20     editing/execCommand/format-block-multiple-paragraphs.html[[BR]]
     21     editing/pasteboard/4076267-3.html[[BR]]
     22     editing/pasteboard/copy-paste-bidi.html[[BR]]
     23     editing/pasteboard/do-not-copy-unnecessary-styles.html[[BR]]
     24     editing/pasteboard/merge-end-3.html[[BR]]
     25     editing/pasteboard/paste-line-endings-009.html[[BR]]
     26     editing/pasteboard/paste-table-002.html[[BR]]
     27with unexpected text diff mismatch. For this result we had to run only 361 test case.