Microsoft is embarking on an innovative journey with its upcoming Windows Search, which is set to utilize a semantic index aimed at resolving the limitations of the current search functionality. This new search engine for Windows 11 promises to harness the power of artificial intelligence to enhance local search results, enabling users to delve into audio and video files with unprecedented ease.
Recall and Its Evolution
Among the standout features of Windows 11 is Recall, initially showcased as a key element of Microsoft Copilot+ PCs. However, the feature faced backlash over privacy and security concerns, prompting Microsoft to retract it temporarily. The company has assured users that Recall will make a return in October, following inquiries from the press. You can pause Recall directly from the taskbar.
Recall allows users to search through their past activities, but the forthcoming enhancements could elevate this experience further. Recent findings by Microsoft researcher Xeno revealed references to “Intelligent media search” within Windows 11 Build 27695. This feature is poised to introduce AI capabilities that will enable users to search for specific content within their video and audio files.
Windows Semantic Index for Copilot Enterprises | Image Courtesy: WindowsLatest.com
Intelligent Media Search
According to Windows Latest, users may soon be able to search for particular phrases or keywords within conversations, such as project names or critical statistics, with relevant video or audio files surfacing in the results. This feature could even pinpoint the exact timestamp of the spoken word, adding a layer of relevance to the search experience.
The intelligent media search appears to be linked to the Semantic search capabilities that Microsoft unveiled during the Copilot+ event. A recent blog post from Microsoft highlighted that “Recall AI is powered by Windows Semantic Index.” This index allows for interaction using natural language, making searches more intuitive.
Developer Tools and Capabilities
Developers will soon gain access to Vector Embeddings and RAG API within the Windows Copilot Library, enhancing their ability to create more dynamic applications. Early demonstrations of Recall AI indicated that it would utilize snapshots to assist users in locating past activities on their PCs. The introduction of Intelligent media search represents a significant advancement, although, like Recall AI, it will be exclusive to Copilot+ PCs, which were launched in June 2024.
Copilot+ PCs are equipped with the necessary hardware to run AI models locally, boasting 40 TOPS and above NPUs. Consequently, it is unlikely that this feature will be available on standard Windows 11 PCs, which lack the requisite capabilities.
Dev-Party Integration in Windows 11 AI
In addition to these developments, Microsoft aims to broaden the scope of Natural Language search capabilities to third-party app developers. This integration will allow developers to offer a similar natural language search experience within their applications. For instance, a finance app could enable users to search for past transactions using conversational language, resulting in quicker search responses since all relevant data would reside on the user’s PC.
Recall AI is set to return in October 2024 for testers after a four-month hiatus. For those who prefer not to use it, the feature can be easily removed via the Control Panel’s Optional Features dialog box.
