Microsoft Foundry-Local at 2.3K Stars: Local AI SDK Ships Chat Completions With GPU Acceleration

GitHub·medium signal

microsoft/Foundry-Local (2,326 stars, C++) provides a local-AI SDK with chat-completions support and GPU acceleration under the foundry-local topic set. It signals Microsoft's continued push to run Foundry models on-device rather than only in Azure. For builders, it's a first-party option for local inference with an OpenAI-compatible chat interface.