Changeset 252946 in webkit

Timestamp:

Nov 29, 2019 10:20:45 AM (4 years ago)

Author:

aakash_jain@apple.com

Message:

Add a unit-test to new EWS for scenario when there is flakiness with patch and also on clean tree
​https://bugs.webkit.org/show_bug.cgi?id=204707
<rdar://problem/57533998>

Unreviewed unit-test.

• BuildSlaveSupport/ews-build/steps_unittest.py:

(TestAnalyzeLayoutTestsResults.test_mildly_flaky_patch_with_some_tree_redness_and_flakiness):

Location:

trunk/Tools

Files:

• BuildSlaveSupport/ews-build/steps_unittest.py (modified) (1 diff)
• ChangeLog (modified) (1 diff)

trunk/Tools/BuildSlaveSupport/ews-build/steps_unittest.py

@@ -1656 +1656 @@
         self.setProperty('second_run_failures', ['test1'])
         self.setProperty('clean_tree_run_failures', ['test1', 'test2'])
+        self.expectOutcome(result=RETRY, state_string='Unable to confirm if test failures are introduced by patch, retrying build (retry)')
+        return self.runStep()
+
+    def test_mildly_flaky_patch_with_some_tree_redness_and_flakiness(self):
+        self.configureStep()
+        self.setProperty('first_run_failures', ['PreExistingFail1', 'PreExistingFail2', 'Fail1'])
+        self.setProperty('second_run_failures', ['PreExistingFail1', 'PreExistingFail2'])
+        self.setProperty('clean_tree_run_failures', ['PreExistingFail1', 'PreExistingFail2', 'Fail2'])
         self.expectOutcome(result=RETRY, state_string='Unable to confirm if test failures are introduced by patch, retrying build (retry)')
         return self.runStep()

trunk/Tools/ChangeLog

@@ +1 @@
+2019-11-29  Aakash Jain  <aakash_jain@apple.com>
+
+        Add a unit-test to new EWS for scenario when there is flakiness with patch and also on clean tree
+        https://bugs.webkit.org/show_bug.cgi?id=204707
+        <rdar://problem/57533998>
+
+        Unreviewed unit-test.
+
+        * BuildSlaveSupport/ews-build/steps_unittest.py:
+        (TestAnalyzeLayoutTestsResults.test_mildly_flaky_patch_with_some_tree_redness_and_flakiness):
+
 2019-11-29  Aakash Jain  <aakash_jain@apple.com>