Allan Riordan Boll's one-function Jev-style wrapper gets calibrated choices from any LLM's logprobs, including vision models on webcam frames

allanrbo.blogspot.com / Hacker News (97pts, 26 comments)·low signalXBlueskyLinkedInCopy link

The September 25 post turns each question into multiple choice, asks the model for a single letter, and normalizes the returned token logprobs into probabilities across the options. An `attachments` field adds images, and the demo runs three questions per webcam frame at about 1 fps with Gemma 4 12B on an RTX 3090, or about 0.2 fps with OpenAI's gpt-6-luna. It gets decision-model-style output from a model you already run, without a dedicated decision model.