AI Integration in Windows 11 24H2: A New Horizon for Developers
Windows 11 24H2 is set to introduce a suite of AI-based features that will operate locally on Copilot+ PCs. However, this advancement doesn't exclude third-party app developers. Microsoft has released a new support document detailing the scope of AI in non-native Windows apps, offering a comprehensive guide for developers eager to integrate AI into their applications.
A Basic Overview of AI Concepts
First spotted by Windows Latest, the document begins with an introduction to integrating AI into Windows client apps. It recommends using an AI model, either local or cloud-hosted, alongside an AI framework like OnnxRuntime. For development, it suggests languages such as C#, C++, and Python.
For those new to app development, the AI terminology can be daunting. However, the document breaks down these concepts in an accessible manner. It covers the differences between Large Language Models (LLM), model training and inferencing, prompt engineering, various AI job roles, essential hardware, and more.
Given that Copilot+ PCs are equipped with powerful hardware, developers can leverage this to enhance the performance of their Windows apps. Microsoft subtly promotes Copilot+ PCs as the optimal choice for running AI applications at their best.
While basic AI apps can utilize the CPU, more complex models require a PC with a Neural Processing Unit (NPU). But what does this mean for end-users?
More AI Features in Apps
Native Windows apps have already incorporated AI features for some time. Microsoft Photos can restyle images, Paint can generate images, and Phone Link can suggest message replies, among other functionalities.
Third-party app developers will soon begin integrating AI models into their existing apps or creating AI-centric applications. These could range from full-fledged apps that generate images, videos, or audio to popular apps implementing AI to automate mundane tasks like replying to messages or generating reports and summaries.
Data privacy and security are also crucial aspects that Microsoft emphasizes. The company encourages developers to be transparent about the data they collect from users, its security measures, and its usage. Additionally, users should have control over data collection.
Interestingly, the 24H2 update will bring additional exclusive AI features to Copilot+ PCs, including Recall, which was previously removed from the public release due to privacy and security concerns. This move suggests that Microsoft wants developers to learn from past incidents and establish robust privacy and security policies.