microsoft/Foundry-Local Reaches GA at 2,284 Stars — On-Device AI SDK With 20MB Footprint Ships Native SDKs for Python, JS, C#, and Rust

GitHub·medium signalXBlueskyLinkedInCopy link

Microsoft's Foundry Local is now generally available for building AI features that run on-device without cloud dependency, supporting Windows, macOS Apple Silicon, and Linux x64. The lightweight ~20MB package provides automatic hardware acceleration (GPU, NPU, CPU fallback with zero detection code), a curated model catalog, and OpenAI-compatible request/response format for seamless cloud-to-local switching. For agent builders: prototype locally, keep latency low, and ship offline-capable experiences where user data never leaves the device.