Changeset 57843 in webkit

Timestamp:

Apr 19, 2010 2:56:59 PM (14 years ago)

Author:

dpranke@chromium.org

Message:

2010-04-19 Dirk Pranke <​dpranke@chromium.org>

Reviewed by Eric Seidel.

new-run-webkit-tests: add a way (--print-unexpected-results) to
(re-)print out the tests that produced unexpected results in the
last run. Also add a way (--retry-unexpected-results) to
automatically re-test them.

​https://bugs.webkit.org/show_bug.cgi?id=37783

• Scripts/webkitpy/layout_tests/run_webkit_tests.py:

Location:

trunk/WebKitTools

Files:

• ChangeLog (modified) (1 diff)
• Scripts/webkitpy/layout_tests/run_webkit_tests.py (modified) (3 diffs)

trunk/WebKitTools/ChangeLog

@@ +1 @@
+2010-04-19  Dirk Pranke  <dpranke@chromium.org>
+
+        Reviewed by Eric Seidel.
+
+        new-run-webkit-tests: add a way (--print-unexpected-results) to
+        (re-)print out the tests that produced unexpected results in the
+        last run. Also add a way (--retry-unexpected-results) to
+        automatically re-test them.
+
+        https://bugs.webkit.org/show_bug.cgi?id=37783
+
+        * Scripts/webkitpy/layout_tests/run_webkit_tests.py:
+
 2010-04-19  Dirk Pranke  <dpranke@chromium.org>
 

trunk/WebKitTools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

@@ -1440 +1440 @@
         options.results_directory = port_obj.results_directory()
 
+    last_unexpected_results = []
+    if options.print_unexpected_results or options.retry_unexpected_results:
+        unexpected_results_filename = os.path.join(
+           options.results_directory, "unexpected_results.json")
+        f = file(unexpected_results_filename)
+        results = simplejson.load(f)
+        f.close()
+        last_unexpected_results = results['tests'].keys()
+        if options.print_unexpected_results:
+            print "\n".join(last_unexpected_results) + "\n"
+            return 0
+
     if options.clobber_old_results:
         # Just clobber the actual test results directories since the other
@@ -1483 +1495 @@
     if not paths:
         paths = []
+    paths += last_unexpected_results
     if options.test_list:
         paths += read_test_files(options.test_list)
@@ -1732 +1745 @@
         # FIXME: consider: --iterations n
         #      Number of times to run the set of tests (e.g. ABCABCABC)
+        optparse.make_option("--print-unexpected-results", action="store_true",
+            default=False, help="print the tests in the last run that "
+            "had unexpected results."),
+        optparse.make_option("--retry-unexpected-results", action="store_true",
+            default=False, help="re-try the tests in the last run that "
+            "had unexpected results."),
     ]