Fetching from the wire…
Infra2026-09-17 · source-backed
PR #57226 removes a blocking collective_rpc from the handshake. EngineCoreProc._make_ready_response() called Executor.supports_draft_weight_updates() with no timeout before ready_event.set(), while __init__ waited on that event with a fixed 10-second timeout; at data_parallel_size=1 the first expiry raised a bare AssertionError and killed an engine whose workers were all alive and idle, with the front end reporting the empty message Failed core proc(s): {}. Observed on 8-GPU ROCm runs. The executor is now consulted only when weight transfer is actually configured.
Each link below shares sources, entities, or timing with this story.
jsonrpc_http_status mapped unsupported protocol version, missing client capability and invalid params to 400 but fell through to the default 200 for ErrorCode::HEADER_MISMATCH. A ServerHandler returning Err(ErrorData::header_mismatch(...)) serialized a correct JSON-RPC -32020...
PR #24292, merged September 16, fixes a per-device cached compute graph holding raw pointers into backend buffers: a client-issued FREE_BUFFER followed by GRAPH_RECOMPUTE re-executes through dangling pointers. The PR states it's reachable by an unauthenticated remote client an...
PR #28789, merged September 15, found that ggml_backend_rpc_buffer_set_tensor hashed every transfer above the 10 MB threshold and let rpc-server -c serve it from a file cache intended for weights, which also caught the activations ggml_backend_sched copies between backends (Gi...
Two merged PRs, five hours apart, and together they change what agent tool approval means on macOS. PR #43624, merged at 00:15Z on September 8, implements macOS user verification using P-256 keys in the Secure Enclave, stored in the Data Protection Keychain, with biometric aut...
Released September 4, it adds llama_lazy_mode / --lazy-mode for on-demand tensor reading (#27794), a max_buf_size quantize parameter capping quantizer RAM (#27795), quantizer row-slab streaming (#27830), and a fix preventing RAM peaking during load (#27483). It also adds spars...
JSON payloads are rejected past 1000 levels of nesting before the parser recurses, both SSE readers cap per-event bytes through a new MaxEventSize, stdio caps a single JSON-RPC frame via StdioTransport.MaxLineLength, and OAuth dynamic client registration responses are capped a...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.