The Microsoft Edge Insider version’s screenshot capture function includes the ability to send images to Copilot chats and Bing search, as well as the ability to extract text from images and search for extracted text in Bing.Neowin articles、Ghacks article)。
The screenshot capture function can be used in place of “Web Capture” by setting “Microsoft Edge Screenshot(edge://flags/#edge-screenshot)” to “Enabled” in “edge://flags”. , additional features are only available to Insiders. However, simply enabling the screenshot capture function does not enable additional features; you need to add command line options to start Microsoft Edge.
The command line option is “–enable-features=msEdgeScreenshotWithCopilotChat,msEdgeScreenshotWithOCR,msEdgeScreenshotWithSearch,msEdgeScreenshotWithSearchInSideBar”, and it was also possible to enable each feature individually by deleting unnecessary ones from the comma-separated list.
Although Neowin’s article mentions only the Canary version, the Dev version was also available in my environment. On the other hand, in the Canary version, he did not have Copilot enabled, so he could not confirm that it worked, but in the Dev version, he was able to confirm that it was sending screenshots to the chat. Note that text extraction does not seem to be compatible with Japanese text, and data that either cannot be read or has garbled characters is extracted. If alphanumeric characters are included, only those parts will be extracted.
Read Slad’s comments | IT section | microsoft | artificial intelligence | internet
Related stories:
Microsoft Edge developer tool Copilot now available December 16, 2023
Microsoft pledges to take responsibility for commercial customers’ legal issues related to Copilot, including paying damages September 9, 2023
Bing AI introduces itself when you search for “chrome” even though you’re not asked June 10, 2023