Changeset 242658 in webkit

Timestamp:

Mar 8, 2019, 3:20:15 PM (7 years ago)

Author:

sbarati@apple.com

Message:

Add a compare-results script to compare benchmark results
​https://bugs.webkit.org/show_bug.cgi?id=195486
<rdar://problem/48723397>

Reviewed by Geoffrey Garen.

This patch adds a script to compare benchmark results using Welch's two-tailed t test.
Initially, this patch only reasons about PLT5/JetStream2/Speedometer2. It will be easy
to extend it to learn about our other benchmarks.

• Scripts/compare-results: Added.

(readJSONFile):
(detectJetStream2):
(JetStream2Results):
(detectSpeedometer2):
(Speedometer2Results):
(detectPLT5):
(PLT5Results):
(detectBenchmark):
(biggerIsBetter):
(ttest):
(getOptions):
(main):

Location:

trunk/Tools

Files:

• ChangeLog (modified) (1 diff)
• Scripts/compare-results (added)

trunk/Tools/ChangeLog

@@ +1 @@
+2019-03-08  Saam barati  <sbarati@apple.com>
+
+        Add a compare-results script to compare benchmark results
+        https://bugs.webkit.org/show_bug.cgi?id=195486
+        <rdar://problem/48723397>
+
+        Reviewed by Geoffrey Garen.
+
+        This patch adds a script to compare benchmark results using Welch's two-tailed t test.
+        Initially, this patch only reasons about PLT5/JetStream2/Speedometer2. It will be easy
+        to extend it to learn about our other benchmarks.
+
+        * Scripts/compare-results: Added.
+        (readJSONFile):
+        (detectJetStream2):
+        (JetStream2Results):
+        (detectSpeedometer2):
+        (Speedometer2Results):
+        (detectPLT5):
+        (PLT5Results):
+        (detectBenchmark):
+        (biggerIsBetter):
+        (ttest):
+        (getOptions):
+        (main):
+
 2019-03-08  Stephanie Lewis  <slewis@apple.com>