Vibe Coding
Tip: llama-server -np 1 Saves 4x VRAM for Single-User Local Inference — Default Allocates Context for Multiple Clients
By default, llama-server allocates 4x the configured context size to serve multiple concurrent clients. If you're the only user on your machine, passing `-np 1` reclaims that VRAM — on a system with limited GPU memory, this can be the difference between running a model in full GPU vs spilling to CPU. With 98 upvotes and 32 comments on r/LocalLLaMA, this catches many practitioners off-guard since the default behavior isn't prominently documented.
Source
↳ Follow the thread