Sources
llm 0.31.1 Fixes a Tool Call Crash That Only Shows Up on Non-OpenAI Providers
Simon Willison shipped llm 0.31.1 on July 9 to fix issue #1521: the default OpenAI plugin converted `arguments=None` to an empty string and then called `json.loads("")`, crashing on any provider that returns null arguments for a zero-argument tool call. He found it running `llm -m meta-ai/muse-spark-1.1 -T llm_time 'time?'` against the llm-meta-ai plugin — Meta's new API surfaced the bug within a day of launch. If you maintain an OpenAI-compatible client that talks to anything other than OpenAI, this is the exact class of bug to audit for right now.
↳ Follow the thread