Changeset 239086 in webkit

Timestamp:

Dec 11, 2018 1:13:32 PM (5 years ago)

Author:

Wenson Hsieh

Message:

[iOS] Send the full list of file upload URLs and types in PasteboardItemInfo
​https://bugs.webkit.org/show_bug.cgi?id=192598
Work towards <rdar://problem/35626913>

Reviewed by Tim Horton.

Refactors PasteboardItemInfo to contain lists of file URLs and corresponding pasteboard types, instead of just
a "preferred" file upload URL and type. See below for more details.

• platform/PasteboardItemInfo.h:

(WebCore::PasteboardItemInfo::pathForContentType const):

Add a helper method to find a file upload URL corresponding to a given type.

(WebCore::PasteboardItemInfo::encode const):
(WebCore::PasteboardItemInfo::decode):

Change pathForFileUpload to pathsForFileUpload, and contentTypeForFileUpload to contentTypesForFileUpload.

• platform/ios/AbstractPasteboard.h:
• platform/ios/PasteboardIOS.mm:

(WebCore::Pasteboard::readRespectingUTIFidelities):

Adjust this to take the file path for the highest fidelity representation in pathsForContentType.

(WebCore::Pasteboard::readFilePaths):

• platform/ios/PlatformPasteboardIOS.mm:

(WebCore::PlatformPasteboard::informationForItemAtIndex):

• platform/ios/WebItemProviderPasteboard.h:
• platform/ios/WebItemProviderPasteboard.mm:

(-[NSItemProvider web_containsFileURLAndFileUploadContent]):
(-[NSItemProvider web_fileUploadContentTypes]):

Replace web_containsFileUploadContent with web_fileUploadContentTypes, which returns the full list of file
upload content types (rather than just a BOOL indicating whether one or more of these types exist).

(-[WebItemProviderPasteboard fileUploadURLsAtIndex:fileTypes:]):
(-[WebItemProviderPasteboard numberOfFiles]):
(-[NSItemProvider web_containsFileUploadContent]): Deleted.
(-[WebItemProviderPasteboard preferredFileUploadURLAtIndex:fileType:]): Deleted.

Replaced with -fileUploadURLsAtIndex:fileTypes:. This implementation currently just returns the highest
fidelity loaded type identifier, but this is wrong because it doesn't take into account inline data types that
shouldn't be represented as data for file uploads (for instance, it never makes sense to upload the internal
data serialization for an NSURL as a file on the web).

Instead, use existing logic in web_fileUploadContentTypes to determine which file types can be treated as file
uploads, and return all of these file types that we've loaded.

Location:

trunk/Source/WebCore

Files:

• ChangeLog (modified) (1 diff)
• platform/PasteboardItemInfo.h (modified) (4 diffs)
• platform/ios/AbstractPasteboard.h (modified) (1 diff)
• platform/ios/PasteboardIOS.mm (modified) (3 diffs)
• platform/ios/PlatformPasteboardIOS.mm (modified) (1 diff)
• platform/ios/WebItemProviderPasteboard.h (modified) (1 diff)
• platform/ios/WebItemProviderPasteboard.mm (modified) (4 diffs)

trunk/Source/WebCore/ChangeLog

@@ +1 @@
+2018-12-11  Wenson Hsieh  <wenson_hsieh@apple.com>
+
+        [iOS] Send the full list of file upload URLs and types in PasteboardItemInfo
+        https://bugs.webkit.org/show_bug.cgi?id=192598
+        Work towards <rdar://problem/35626913>
+
+        Reviewed by Tim Horton.
+
+        Refactors PasteboardItemInfo to contain lists of file URLs and corresponding pasteboard types, instead of just
+        a "preferred" file upload URL and type. See below for more details.
+
+        * platform/PasteboardItemInfo.h:
+        (WebCore::PasteboardItemInfo::pathForContentType const):
+
+        Add a helper method to find a file upload URL corresponding to a given type.
+
+        (WebCore::PasteboardItemInfo::encode const):
+        (WebCore::PasteboardItemInfo::decode):
+
+        Change `pathForFileUpload` to `pathsForFileUpload`, and `contentTypeForFileUpload` to `contentTypesForFileUpload`.
+
+        * platform/ios/AbstractPasteboard.h:
+        * platform/ios/PasteboardIOS.mm:
+        (WebCore::Pasteboard::readRespectingUTIFidelities):
+
+        Adjust this to take the file path for the highest fidelity representation in `pathsForContentType`.
+
+        (WebCore::Pasteboard::readFilePaths):
+        * platform/ios/PlatformPasteboardIOS.mm:
+        (WebCore::PlatformPasteboard::informationForItemAtIndex):
+        * platform/ios/WebItemProviderPasteboard.h:
+        * platform/ios/WebItemProviderPasteboard.mm:
+        (-[NSItemProvider web_containsFileURLAndFileUploadContent]):
+        (-[NSItemProvider web_fileUploadContentTypes]):
+
+        Replace `web_containsFileUploadContent` with `web_fileUploadContentTypes`, which returns the full list of file
+        upload content types (rather than just a `BOOL` indicating whether one or more of these types exist).
+
+        (-[WebItemProviderPasteboard fileUploadURLsAtIndex:fileTypes:]):
+        (-[WebItemProviderPasteboard numberOfFiles]):
+        (-[NSItemProvider web_containsFileUploadContent]): Deleted.
+        (-[WebItemProviderPasteboard preferredFileUploadURLAtIndex:fileType:]): Deleted.
+
+        Replaced with `-fileUploadURLsAtIndex:fileTypes:`. This implementation currently just returns the highest
+        fidelity loaded type identifier, but this is wrong because it doesn't take into account inline data types that
+        shouldn't be represented as data for file uploads (for instance, it never makes sense to upload the internal
+        data serialization for an `NSURL` as a file on the web).
+
+        Instead, use existing logic in `web_fileUploadContentTypes` to determine which file types can be treated as file
+        uploads, and return all of these file types that we've loaded.
+
 2018-12-11  Don Olmstead  <don.olmstead@sony.com>
 

trunk/Source/WebCore/platform/PasteboardItemInfo.h

@@ -27 +27 @@
 
 #include <wtf/Optional.h>
+#include <wtf/Vector.h>
 #include <wtf/text/WTFString.h>
 
@@ -38 +39 @@
 
 struct PasteboardItemInfo {
-    String pathForFileUpload;
-    String contentTypeForFileUpload;
+    Vector<String> pathsForFileUpload;
+    Vector<String> contentTypesForFileUpload;
     String suggestedFileName;
     bool isNonTextType { false };
     bool containsFileURLAndFileUploadContent { false };
     PasteboardItemPresentationStyle preferredPresentationStyle { PasteboardItemPresentationStyle::Unspecified };
+
+    String pathForContentType(const String& type) const
+    {
+        ASSERT(pathsForFileUpload.size() == contentTypesForFileUpload.size());
+        auto index = contentTypesForFileUpload.find(type);
+        if (index == notFound)
+            return { };
+
+        return pathsForFileUpload[index];
+    }
 
     template<class Encoder> void encode(Encoder&) const;
@@ -52 +63 @@
 void PasteboardItemInfo::encode(Encoder& encoder) const
 {
-    encoder << pathForFileUpload << contentTypeForFileUpload << suggestedFileName << isNonTextType << containsFileURLAndFileUploadContent;
+    encoder << pathsForFileUpload << contentTypesForFileUpload << suggestedFileName << isNonTextType << containsFileURLAndFileUploadContent;
     encoder.encodeEnum(preferredPresentationStyle);
 }
@@ -60 +71 @@
 {
     PasteboardItemInfo result;
-    if (!decoder.decode(result.pathForFileUpload))
+    if (!decoder.decode(result.pathsForFileUpload))
         return std::nullopt;
 
-    if (!decoder.decode(result.contentTypeForFileUpload))
+    if (!decoder.decode(result.contentTypesForFileUpload))
         return std::nullopt;
 

trunk/Source/WebCore/platform/ios/AbstractPasteboard.h

@@ -58 +58 @@
 @property (readonly, nonatomic) NSInteger numberOfFiles;
 @property (readonly, nonatomic) NSArray<NSURL *> *allDroppedFileURLs;
-- (nullable NSURL *)preferredFileUploadURLAtIndex:(NSUInteger)index fileType:(NSString *_Nullable *_Nullable)outFileType;
+
+// Computes lists of file URLs and types. Each file URL and type corresponds to a representation of the item provider at the given index.
+// In order from highest fidelity to lowest fidelity.
+- (NSArray<NSURL *> *)fileUploadURLsAtIndex:(NSUInteger)index fileTypes:(NSArray<NSString *> *_Nullable *_Nonnull)outFileTypes;
 - (void)updateSupportedTypeIdentifiers:(NSArray<NSString *> *)types;
 

trunk/Source/WebCore/platform/ios/PasteboardIOS.mm

@@ -295 +295 @@
 #if ENABLE(ATTACHMENT_ELEMENT)
         auto info = strategy.informationForItemAtIndex(index, m_pasteboardName);
-        bool canReadAttachment = policy == WebContentReadingPolicy::AnyType && RuntimeEnabledFeatures::sharedFeatures().attachmentElementEnabled() && !info.pathForFileUpload.isEmpty();
+        bool canReadAttachment = policy == WebContentReadingPolicy::AnyType && RuntimeEnabledFeatures::sharedFeatures().attachmentElementEnabled() && !info.pathsForFileUpload.isEmpty();
         if (canReadAttachment && info.preferredPresentationStyle == PasteboardItemPresentationStyle::Attachment) {
-            reader.readFilePaths({ info.pathForFileUpload });
+            reader.readFilePaths({ info.pathsForFileUpload.first() });
             continue;
         }
@@ -318 +318 @@
 #if ENABLE(ATTACHMENT_ELEMENT)
         if (canReadAttachment && result == ReaderResult::DidNotReadType)
-            reader.readFilePaths({ info.pathForFileUpload });
+            reader.readFilePaths({ info.pathsForFileUpload.first() });
 #endif
     }
@@ -460 +460 @@
     for (NSUInteger index = 0, numberOfItems = strategy.getPasteboardItemsCount(m_pasteboardName); index < numberOfItems; ++index) {
         // Currently, drag and drop is the only case on iOS where the "pasteboard" may contain file paths.
-        auto filePath = strategy.informationForItemAtIndex(index, m_pasteboardName).pathForFileUpload;
+        auto filePath = strategy.informationForItemAtIndex(index, m_pasteboardName).pathsForFileUpload.first();
         if (!filePath.isEmpty())
             filePaths.append(WTFMove(filePath));

trunk/Source/WebCore/platform/ios/PlatformPasteboardIOS.mm

@@ -145 +145 @@
 
     PasteboardItemInfo info;
-    if ([m_pasteboard respondsToSelector:@selector(preferredFileUploadURLAtIndex:fileType:)]) {
-        NSString *fileType = nil;
-        info.pathForFileUpload = [m_pasteboard preferredFileUploadURLAtIndex:index fileType:&fileType].path;
-        info.contentTypeForFileUpload = fileType;
+    if ([m_pasteboard respondsToSelector:@selector(fileUploadURLsAtIndex:fileTypes:)]) {
+        NSArray<NSString *> *fileTypes = nil;
+        NSArray *urls = [m_pasteboard fileUploadURLsAtIndex:index fileTypes:&fileTypes];
+        ASSERT(fileTypes.count == urls.count);
+
+        info.pathsForFileUpload.reserveInitialCapacity(urls.count);
+        for (NSURL *url in urls)
+            info.pathsForFileUpload.uncheckedAppend(url.path);
+
+        info.contentTypesForFileUpload.reserveInitialCapacity(fileTypes.count);
+        for (NSString *fileType : fileTypes)
+            info.contentTypesForFileUpload.uncheckedAppend(fileType);
     }
 

trunk/Source/WebCore/platform/ios/WebItemProviderPasteboard.h

@@ -98 +98 @@
 @property (readonly, nonatomic) NSArray<NSURL *> *allDroppedFileURLs;
 
-// The preferred file URL corresponds to the highest fidelity non-private UTI that was loaded.
-- (nullable NSURL *)preferredFileUploadURLAtIndex:(NSUInteger)index fileType:(NSString *_Nullable *_Nullable)outFileType;
-
 @property (readonly, nonatomic) BOOL hasPendingOperation;
 - (void)incrementPendingOperationCount;

trunk/Source/WebCore/platform/ios/WebItemProviderPasteboard.mm

@@ -69 +69 @@
     for (NSString *identifier in self.registeredTypeIdentifiers) {
         if (UTTypeConformsTo((__bridge CFStringRef)identifier, kUTTypeFileURL))
-            return self.web_containsFileUploadContent;
+            return self.web_fileUploadContentTypes.count;
     }
     return NO;
 }
 
-- (BOOL)web_containsFileUploadContent
-{
+- (NSArray<NSString *> *)web_fileUploadContentTypes
+{
+    auto types = adoptNS([NSMutableArray new]);
     for (NSString *identifier in self.registeredTypeIdentifiers) {
         if (UTTypeConformsTo((__bridge CFStringRef)identifier, kUTTypeURL))
@@ -81 +82 @@
 
         if (typeConformsToTypes(identifier, Pasteboard::supportedFileUploadPasteboardTypes()))
-            return YES;
-    }
-    return NO;
+            [types addObject:identifier];
+    }
+
+    return types.autorelease();
 }
 
@@ -629 +631 @@
 }
 
-- (NSURL *)preferredFileUploadURLAtIndex:(NSUInteger)index fileType:(NSString **)outFileType
-{
-    if (outFileType)
-        *outFileType = nil;
+- (NSArray<NSURL *> *)fileUploadURLsAtIndex:(NSUInteger)index fileTypes:(NSArray<NSString *> **)outFileTypes
+{
+    auto fileTypes = adoptNS([NSMutableArray new]);
+    auto fileURLs = adoptNS([NSMutableArray new]);
 
     if (index >= _loadResults.size())
-        return nil;
+        return @[ ];
 
     auto result = _loadResults[index];
     if (![result canBeRepresentedAsFileUpload])
-        return nil;
-
-    NSItemProvider *itemProvider = [result itemProvider];
-    for (NSString *registeredTypeIdentifier in itemProvider.registeredTypeIdentifiers) {
-        // Search for the highest fidelity non-private type identifier we loaded from the item provider.
-        if (!UTTypeIsDeclared((__bridge CFStringRef)registeredTypeIdentifier) && !UTTypeIsDynamic((__bridge CFStringRef)registeredTypeIdentifier))
-            continue;
-
-        for (NSString *loadedTypeIdentifier in [result loadedTypeIdentifiers]) {
-            if (!UTTypeConformsTo((__bridge CFStringRef)registeredTypeIdentifier, (__bridge CFStringRef)loadedTypeIdentifier))
-                continue;
-
-            if (outFileType)
-                *outFileType = loadedTypeIdentifier;
-            return [result fileURLForType:loadedTypeIdentifier];
+        return @[ ];
+
+    for (NSString *contentType in [result itemProvider].web_fileUploadContentTypes) {
+        if (NSURL *url = [result fileURLForType:contentType]) {
+            [fileTypes addObject:contentType];
+            [fileURLs addObject:url];
         }
     }
 
-    return nil;
+    *outFileTypes = fileTypes.autorelease();
+    return fileURLs.autorelease();
 }
 
@@ -685 +679 @@
 #endif
         // Otherwise, fall back to examining the item's registered type identifiers.
-        if (itemProvider.web_containsFileUploadContent)
+        if (itemProvider.web_fileUploadContentTypes.count)
             ++numberOfFiles;
     }