⚠ Archived content — this site is no longer maintained.   Current WebKit documentation is at docs.webkit.org.

Changeset 126942 in webkit


Ignore:
Timestamp:
Aug 28, 2012, 5:28:05 PM (14 years ago)
Author:
wangxianzhu@chromium.org
Message:

[Chromium-Android] Upstream layout test expectations (Part 2)
​https://bugs.webkit.org/show_bug.cgi?id=95212

Reviewed by Adam Barth.

Tools:

  • Now run both gpu path and non-gpu path of 2d canvas layout tests

because both are used in chromium-android.

  • Exclude all webgl tests because webgl is not enabled yet.
  • Removed 'win' from the baseline fallback list. This was a mistake.
  • Scripts/webkitpy/layout_tests/port/chromium_android.py:

(ChromiumAndroidPort):
(ChromiumAndroidPort.skipped_layout_tests):

LayoutTests:

Update test expectations for Android:

  • 2d canvas tests (both gpu and non-gpu path)
  • compositing tests
  • more WONTFIXes for control behavior tests
  • skip features not enabled on Android
  • platform/chromium/TestExpectations:
Location:
trunk
Files:
4 edited

Legend:

Unmodified
Added
Removed

  • trunk/LayoutTests/ChangeLog

    r126941 r126942  
     12012-08-28  Xianzhu Wang  <wangxianzhu@chromium.org>
     2
     3        [Chromium-Android] Upstream layout test expectations (Part 2)
     4        https://bugs.webkit.org/show_bug.cgi?id=95212
     5
     6        Reviewed by Adam Barth.
     7
     8        Update test expectations for Android:
     9        - 2d canvas tests (both gpu and non-gpu path)
     10        - compositing tests
     11        - more WONTFIXes for control behavior tests
     12        - skip features not enabled on Android
     13
     14        * platform/chromium/TestExpectations:
     15
    1162012-08-28  Joanmarie Diggs  <jdiggs@igalia.com>
    217

  • trunk/LayoutTests/platform/chromium/TestExpectations

    r126929 r126942  
    873873WONTFIX SKIP : media/video-controls-fullscreen-volume.html = TEXT
    874874
    875 // ENABLE(INPUT_TYPE_TIME_MULTIPLE_FIELDS) isn't enabled for Android (WK94186).
    876 WONTFIX SKIP ANDROID : fast/forms/time-multiple-fields = PASS
    877 
    878875// Test fails because it's trying to load a plugin we don't have. We probably don't need to fix this.
    879876WONTFIX : platform/gtk/plugins/invalidate-rect-with-null-npp-argument.html = TEXT
    … …  
    881878// This test is only for GTK which is not applicable to Android.
    882879WONTFIX ANDROID SKIP : platform/chromium-linux/fast/text/chromium-linux-fontconfig-renderstyle.html = TEXT
     880
     881// The following features are not enabled on Android.
     882// Some bigger whole directories (plugins, webgl, inspector, etc.) are skipped in chromium_android.py.
     883BUGCR145338 WONTFIX ANDROID SKIP : fast/forms/time-multiple-fields = PASS
     884BUGCR145338 WONTFIX ANDROID SKIP : fast/forms/color = PASS
     885BUGCR145338 WONTFIX ANDROID SKIP : fast/forms/datalist = PASS
     886BUGCR145338 WONTFIX ANDROID SKIP : fast/forms/date = PASS
     887BUGCR145338 WONTFIX ANDROID SKIP : fast/mediastream = PASS
     888BUGCR145338 WONTFIX ANDROID SKIP : fast/notifications = PASS
     889BUGCR145338 WONTFIX ANDROID SKIP : fast/speech = PASS
     890BUGCR145338 WONTFIX ANDROID SKIP : webaudio = PASS
     891
     892// Skip tests depending on plugins that is not available on Android.
     893// The whole directories of plugins, http/tests/plugins, etc. are skipped in chromium_android.py.
     894BUGCR145338 WONTFIX ANDROID SKIP : fast/dom/Window/Plug-ins.html = PASS
     895BUGCR145338 WONTFIX ANDROID SKIP : fast/frames/sandboxed-iframe-about-blank.html = PASS
     896BUGCR145338 WONTFIX ANDROID SKIP : fast/frames/sandboxed-iframe-navigation-allowed.html = PASS
     897BUGCR145338 WONTFIX ANDROID SKIP : fast/frames/sandboxed-iframe-plugins.html = PASS
     898BUGCR145338 WONTFIX ANDROID SKIP : fast/replaced/invalid-object-with-fallback.html = PASS
     899BUGCR145338 WONTFIX ANDROID SKIP : fast/replaced/object-with-embed-url-param.html = PASS
     900BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/1.1/plugintypes-invalid.html = PASS
     901BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/1.1/plugintypes-mismatched-data.html = PASS
     902BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/1.1/plugintypes-mismatched-url.html = PASS
     903BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/1.1/plugintypes-notype-url.html = PASS
     904BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/1.1/plugintypes-url-01.html = PASS
     905BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/object-src-none-allowed.html = PASS
     906BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/object-src-url-allowed.html = PASS
     907BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/contentSecurityPolicy/object-src-url-blocked.html = PASS
     908BUGCR145338 WONTFIX ANDROID SKIP : http/tests/security/frameNavigation/xss-DENIED-plugin-navigation.html = PASS
     909BUGCR145338 WONTFIX ANDROID SKIP : platform/chromium/permissionclient/plugin-permission.html = PASS
     910BUGCR145338 WONTFIX ANDROID SKIP : userscripts/user-script-plugin-document.html = PASS
    883911
    884912// -----------------------------------------------------------------
    … …  
    13851413
    13861414// This test is overly-finicky about pixel values.
    1387 BUGWK64876 LINUX ANDROID WIN : platform/chromium/virtual/gpu/fast/canvas/canvas-scale-strokePath-shadow.html = TEXT
     1415BUGWK64876 LINUX WIN : platform/chromium/virtual/gpu/fast/canvas/canvas-scale-strokePath-shadow.html = TEXT
    13881416
    13891417BUGWK75276 : fast/repaint/shadow-multiple-horizontal.html = IMAGE
    … …  
    18391867BUGWK45991 : canvas/philip/tests/2d.pattern.image.broken.html = TEXT
    18401868BUGWK45991 : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.image.broken.html = TEXT
    1841 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.text.draw.baseline.ideographic.html = TEXT
    1842 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.text.draw.baseline.ideographic.html = TEXT
     1869BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.text.draw.baseline.ideographic.html = TEXT
     1870BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.text.draw.baseline.ideographic.html = TEXT
    18431871
    18441872// Update canvas/philip in WK r71481
    … …  
    18831911
    18841912// These tests fail everywhere we use skia and are most likely skia bugs
    1885 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.gradient.radial.outside3.html = TEXT
    1886 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.path.arc.angle.3.html = TEXT
    1887 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.path.arc.angle.5.html = TEXT
    1888 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.path.arcTo.shape.curve1.html = TEXT
    1889 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.path.arcTo.shape.curve2.html = TEXT
    1890 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.pattern.paint.norepeat.coord3.html = TEXT
    1891 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.pattern.paint.repeatx.coord1.html = TEXT
    1892 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.pattern.paint.repeaty.coord1.html = TEXT
    1893 BUGWK45991 LINUX WIN : canvas/philip/tests/2d.shadow.enable.blur.html = TEXT
    1894 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.gradient.radial.outside3.html = TEXT
    1895 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.path.arc.angle.3.html = TEXT
    1896 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.path.arc.angle.5.html = TEXT
    1897 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.paint.norepeat.coord3.html = TEXT
    1898 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.paint.repeatx.coord1.html = TEXT
    1899 BUGWK45991 LINUX ANDROID WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.paint.repeaty.coord1.html = TEXT
     1913BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.gradient.radial.outside3.html = TEXT
     1914BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.path.arc.angle.3.html = TEXT
     1915BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.path.arc.angle.5.html = TEXT
     1916BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.path.arcTo.shape.curve1.html = TEXT
     1917BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.path.arcTo.shape.curve2.html = TEXT
     1918BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.pattern.paint.norepeat.coord3.html = TEXT
     1919BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.pattern.paint.repeatx.coord1.html = TEXT
     1920BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.pattern.paint.repeaty.coord1.html = TEXT
     1921BUGWK45991 LINUX ANDROID WIN : canvas/philip/tests/2d.shadow.enable.blur.html = TEXT
     1922BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.gradient.radial.outside3.html = TEXT
     1923BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.path.arc.angle.3.html = TEXT
     1924BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.path.arc.angle.5.html = TEXT
     1925BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.paint.norepeat.coord3.html = TEXT
     1926BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.paint.repeatx.coord1.html = TEXT
     1927BUGWK45991 LINUX WIN : platform/chromium/virtual/gpu/canvas/philip/tests/2d.pattern.paint.repeaty.coord1.html = TEXT
    19001928
    19011929// Chromium does not support cancel for notifications permissions.
    … …  
    20012029BUGWK91431 : platform/chromium/virtual/gpu/fast/canvas/webgl/point-size.html = TEXT
    20022030BUGWK91431 LINUX MAC : fast/canvas/webgl/gl-object-get-calls.html = TEXT
    2003 BUGWK91431 LINUX ANDROID MAC : platform/chromium/virtual/gpu/fast/canvas/webgl/gl-object-get-calls.html = TEXT
     2031BUGWK91431 LINUX MAC : platform/chromium/virtual/gpu/fast/canvas/webgl/gl-object-get-calls.html = TEXT
    20042032
    20052033// These were not fixed by the Mesa 7.9 upgrade. Need to investigate.
    … …  
    21692197
    21702198BUGCR67442 LINUX WIN : fast/canvas/fillText-shadow.html = TEXT
    2171 BUGCR67442 LINUX ANDROID WIN : platform/chromium/virtual/gpu/fast/canvas/fillText-shadow.html = TEXT
     2199BUGCR67442 LINUX WIN : platform/chromium/virtual/gpu/fast/canvas/fillText-shadow.html = TEXT
    21722200
    21732201BUGCR68436 LINUX ANDROID DEBUG : fast/dom/DOMImplementation/createDocument-with-used-doctype.html = PASS TIMEOUT
    … …  
    31033131
    31043132// Started flaking at around http://trac.webkit.org/changeset/116278.
    3105 BUGWK85950 LINUX ANDROID DEBUG : compositing/geometry/limit-layer-bounds-transformed-overflow.html = PASS TEXT
     3133BUGWK85950 LINUX DEBUG : compositing/geometry/limit-layer-bounds-transformed-overflow.html = PASS TEXT
    31063134
    31073135BUGWK81416 : fast/dom/wrapper-scope.html = TEXT
    … …  
    31903218
    31913219// A few pixels off from the baseline, added by r118567.
    3192 BUGWK87653 WIN LINUX ANDROID : compositing/geometry/composited-in-columns.html = IMAGE+TEXT
     3220BUGWK87653 WIN LINUX : compositing/geometry/composited-in-columns.html = IMAGE+TEXT
    31933221
    31943222// Fails with a mismatch in $("menulist").selectedIndex
    … …  
    34653493BUGWK94793 : fast/notifications/notifications-event-listener-crash.html = TEXT PASS
    34663494
     3495BUGCR144536 WONTFIX ANDROID : editing/selection/context-menu-on-text.html = TEXT
     3496BUGCR144536 WONTFIX ANDROID : editing/selection/context-menu-text-selection.html = TEXT
    34673497BUGCR144536 WONTFIX ANDROID : fast/dom/HTMLSelectElement/select-selectedOptions.html = TEXT
    34683498BUGCR144536 WONTFIX ANDROID : fast/events/select-element.html = TEXT
    … …  
    34723502BUGCR144536 WONTFIX ANDROID : fast/forms/listbox-select-all.html = TEXT
    34733503BUGCR144536 WONTFIX ANDROID : fast/forms/listbox-selection.html = TEXT
     3504BUGCR144536 WONTFIX ANDROID : fast/forms/listbox-selection-2.html = TEXT
     3505BUGCR144536 WONTFIX ANDROID : fast/forms/listbox-typeahead-scroll.html = TEXT
    34743506BUGCR144536 WONTFIX ANDROID : fast/forms/option-mouseevents.html = TEXT
    34753507BUGCR144536 WONTFIX ANDROID : fast/forms/select-cache-desynchronization.html = TEXT
    … …  
    34833515BUGCR144536 WONTFIX ANDROID : fast/forms/select/listbox-drag-in-non-multiple.html = TEXT
    34843516BUGCR144536 WONTFIX ANDROID : fast/forms/select/listbox-in-multi-column.html = TEXT
     3517BUGCR144536 WONTFIX ANDROID : fast/forms/select/option-selecting.html = TEXT
    34853518BUGCR144536 WONTFIX ANDROID : fast/forms/select/optgroup-clicking.html = TEXT
    34863519BUGCR144536 WONTFIX ANDROID : fast/forms/select/optgroup-rendering.html = TEXT
    34873520BUGCR144536 WONTFIX ANDROID : fast/repaint/select-option-background-color.html = TEXT
     3521BUGCR144536 WONTFIX ANDROID : scrollbars/custom-scrollbar-with-incomplete-style.html = TEXT
    34883522BUGCR144536 WONTFIX ANDROID : scrollbars/listbox-scrollbar-combinations.html = TEXT
     3523
     3524BUGCR145084 ANDROID : platform/chromium/virtual/gpu/canvas/philip = PASS TEXT
     3525BUGCR145084 ANDROID : platform/chromium/virtual/gpu/fast/canvas = PASS TEXT TIMEOUT
     3526
     3527BUGCR145087 ANDROID : compositing/geometry/composited-in-columns.html = TEXT
     3528BUGCR145087 ANDROID : compositing/geometry/fixed-position-composited-switch.html = TEXT
     3529BUGCR145087 ANDROID : compositing/overflow/nested-scrolling.html = TEXT
     3530BUGCR145087 ANDROID : compositing/reflections/nested-reflection-animated.html = TEXT PASS
    34893531
    34903532// Require rebaseline after https://bugs.webkit.org/show_bug.cgi?id=84286

  • trunk/Tools/ChangeLog

    r126941 r126942  
     12012-08-28  Xianzhu Wang  <wangxianzhu@chromium.org>
     2
     3        [Chromium-Android] Upstream layout test expectations (Part 2)
     4        https://bugs.webkit.org/show_bug.cgi?id=95212
     5
     6        Reviewed by Adam Barth.
     7
     8        - Now run both gpu path and non-gpu path of 2d canvas layout tests
     9        because both are used in chromium-android.
     10
     11        - Exclude all webgl tests because webgl is not enabled yet.
     12
     13        - Removed 'win' from the baseline fallback list. This was a mistake.
     14
     15        - Moved some small directories to TestExpectations from skipped_layout_tests().
     16
     17        * Scripts/webkitpy/layout_tests/port/chromium_android.py:
     18        (ChromiumAndroidPort):
     19        (ChromiumAndroidPort.skipped_layout_tests):
     20
    1212012-08-28  Joanmarie Diggs  <jdiggs@igalia.com>
    222

  • trunk/Tools/Scripts/webkitpy/layout_tests/port/chromium_android.py

    r126607 r126942  
    147147        'chromium-win',
    148148        'chromium',
    149         'win',
    150149        'mac',
    151150    ]
    … …  
    235234        # This method is more convenient to skip whole directories than SKIP in TestExpectations
    236235        # because its higher priority.
    237         # Still use TestExpectations to skip individual tests.
    238         return self._real_tests([
    239             # Only run these tests as virtual gpu tests.
    240             'canvas/philip',
    241             'fast/canvas',
    242 
     236        # Still use TestExpectations to skip individual tests and small directories.
     237        skipped_tests = self._real_tests([
    243238            # Skip tests of other platforms to save time.
    244239            'platform/gtk',
    … …  
    248243            'platform/win',
    249244
    250             # Features not supported.
     245            # Features not supported: http://crbug.com/145338.
    251246            'compositing/plugins',
    252247            'plugins',
    … …  
    262257            'accessibility',
    263258            'platform/chromium/accessibility',
    264 
    265             'fast/dom/MediaStream',
    266             'fast/mediastream',
    267             'fast/notifications',
    268             'fast/speech',
    269             'webaudio',
    270259        ])
     260
     261        # Skip webgl tests: http://crbug.com/135877.
     262        fast_canvas_webgl_tests = self._real_tests(['fast/canvas/webgl'])
     263        return (skipped_tests |
     264                fast_canvas_webgl_tests |
     265                self._real_tests(['http/tests/canvas/webgl']) |
     266                set(['platform/chromium/virtual/gpu/' + f for f in fast_canvas_webgl_tests]))
    271267
    272268    def create_driver(self, worker_number, no_timeout=False):
Note: See TracChangeset for help on using the changeset viewer.