Handling Test Expectations

by Jonathan Bedard

• Test Expectations
  • LayoutTests/TestExpectations

… swipe [ skip ]

• LayoutTests/fast/dom (Baselines)

… wrapper-classes-expected.txt

• Verbose baseline search path:
  • Inheritance order for baseline and test expectations
• Proposals
  • Use tags for platform TestExpectations
    • [ Debug ] fast/selectors/not-backtracking.html [ Slow ]
    • [ Mojave+ ] fast…
    • Propose a bunch of others:
      • [ ios ],[ ipad ], [ appkit ], [ watchos ], iPhone, uikit, iOS13, simulator, wk1, wk2, iPadOS13, iPhone-x
  • Re-think baseline search path
    • ipad-(5th generation)-simulator-13-wk2
    • Platform - Model - Mode - Version
    • Re-Thinking Baseline Search Path
      • LayoutTests/platform/
      • Run-webkit-tests - -ipad-simulator —release

Tags:

release wk2 …

• Move all baselines out of platform/
  • LayoutTests/platform/

… gtk gtk-wk2 ios ios-device ios-simulator mac mac-highsierra mac-mojave …

• Move to:
• LayoutTests/cssl/basic

… containment.html containment-expected/

default.txt ios.txt mac.txt …