= Summary = It's now possible to write layout tests that exercise code in the UI process in iOS WebKit2. This allows testing of things like tapping, zooming, keyboard interaction, selection, text input etc. This is done by running JavaScript in an isolated JS context in the UI process from a test. That JavaScript has access to a UIScriptController, which has properties that expose information about the state of the UI process and functions to make things happen, including event synthesis. The UI script itself runs asynchronously, and many of the UIScriptController functions are asynchronous. Callbacks are used to tell the test when something completes. = A simple example = {{{ }}} = Some more detail = Let's say we want to write a test that reads back the zoom scale of the WKWebView's UIScrollView (e.g. to test viewport scale). First, since we're testing viewport zooming, we need to have the test opt into iOS-style viewport behavior with an HTML comment after the doctype: {{{ }}} then let's put in the viewport settings to test: {{{ ... }}} Now we want to write some script to read the zoom scale in the UI process. [https://trac.webkit.org/browser/trunk/Tools/WebKitTestRunner/InjectedBundle/Bindings/TestRunner.idl TestRunner] now has a runUIScript() function, which takes a string and a callback: {{{ interface TestRunner { ... // UI Process Testing void runUIScript(DOMString script, object callback); }}} We can call this from our test inside some }}} The script passed into runUIScript() is just a string. You can pass a string literal here or, for longer scripts, make a script tag and get its content as text: {{{ }}} So, what script can you run in the UI process? This UI-side script runs in a separate JS context that has no access to the DOM, no timers, no requestAnimationFrame(), no XHR etc. What it can do is run vanilla JavaScript, and access properties and functions on [https://trac.webkit.org/browser/trunk/Tools/WebKitTestRunner/UIScriptContext/Bindings/UIScriptController.idl UIScriptController], which is exposed as uiController. Here's a simple example, using function-like syntax for the inline script, that returns zoom scale: {{{ }}} Because testRunner.runUIScript() is asynchronous, the caller has to supply a callback function. The string result returned by the UI process script is passed to this callback function as an argument. You can use this to return simple bits of data as strings, or use JSON.stringify() in the UI script, and JSON.parse() in the test script to get more complex objects across the process boundary. = UIScriptController functions = UIScriptController is the mechanism for driving behavior in the UI process and to accessing UI state. Many of the functions will trigger UI behaviors that take time (e.g. a zoom animation, or bringing up the keyboard). Rather than blocking, these functions take a callback that is triggered in the UI script context when that operation is complete: {{{ (function() { uiController.doubleTapAtPoint(50, 50, function() { console.log("Taps were dispatched"); }); })(); }}} Note that this console.log() won't show in layout test output, since it's being generated in the UI process (but it will be logged if you run WebkitTestRunner directly, which is useful for debugging). Also, the web process usually needs to be told that the UI script completed (see below for more details). So, when your test has finished doing work in the UI process, it should call uiScriptComplete(), passing the result: {{{ (function() { uiController.doubleTapAtPoint(50, 50, function() { uiController.uiScriptComplete("Taps were dispatched"); }); })(); }}} There are some callbacks you can register on UIScriptController to get notified when certain things happen, like zooming. These are useful because event dispatch doesn't imply that zooming is done, since the zoom is animated. So in the above example, we don't have the final zoom scale when calling uiScriptComplete(). We really have to wait for the zoom to finish: {{{ (function() { uiController.didEndZoomingCallback = function() { uiController.uiScriptComplete('Zoomed to scale ' + uiController.zoomScale); }; uiController.doubleTapAtPoint(50, 50, function() { /* Do nothing here */ }); })(); }}} UIScriptController also supports sending key events. However, the keyboard must first be shown for the key events to be properly handled. First, your UI-side script must perform some action that will cause the keyboard to be shown. Your script must then bind uiController.didShowKeyboardCallback to a function which is invoked after the keyboard is shown and is ready to accept key inputs. This callback should call one of the typeCharacter methods (currently, there is only typeCharacterUsingHardwareKeyboard, but we intend on supporting software key events as well). In the below example, suppose that tapping at (50, 25) touches a HTML input element. {{{ (function() { uiController.singleTapAtPoint(50, 25, function() { ... }); uiController.didShowKeyboardCallback = function() { uiController.typeCharacterUsingHardwareKeyboard("a", function() { ... }); } })(); }}} Observe that we didn't call uiController.uiScriptComplete(). This is because when the key event is handled by the UI process, there is no guarantee that the web process has received the resulting editing event, so the value of the element may not be updated. Instead of waiting on the UI-side script to complete, we can instead invoke testRunner.notifyDone() when the element itself has received a event to its oninput handler. If your UI-side script is very simple and only accesses uiController properties, then it doesn't need to call uiScriptComplete(). If you call any uiController functions that are asynchronous (i.e. take a callback), then you need to call uiScriptComplete() at some point unless you are waiting to invoke testRunner.notifyDone() from the web process. You can chain as many asynchronous things as you like in the UI-side script, as long as you call uiScriptComplete() when the chain is complete. You can also call testRunner.runUIScript() as many times as you like from the test content, making it possible to test a long sequence of operations that bounce between the UI process and the web process. = Future enhancements = UIScriptController will grow to allow tests to drive more behaviors in the UI process, for things like the software keyboard events, selection, callouts etc.. We will also likely add ways to read back UI process state, like the state of the selection handles and callout bars. = Non-iOS platforms = testRunner.runUIScript() and UIScriptController build and are available on other WebKit2 platforms as well. There's no reason why they could not be used for testing UI-side features there too.