Those local APIs already exist. It is called Microsoft Foundry Local: https://learn.microsoft.com/en-us/azure/foundry-local/get-st...
Supports GPU, NPU and CPU.
Those local APIs already exist. It is called Microsoft Foundry Local: https://learn.microsoft.com/en-us/azure/foundry-local/get-st...
Supports GPU, NPU and CPU.
Nice didn't know that. I was thinking lower APIs similar to directX for gaming
This is actually the case. Windows ML (https://github.com/microsoft/windowsML) is the inference framework wtih vendor agnostic support for inference on CPU, NPU, and GPU. They also announced quite a bit more including an isolation solution with MXC. There's a lot of marketing fluff in the below link but it covers the recent announcements. https://blogs.windows.com/windowsexperience/2026/10/07/build...