CalibratedDecisions.

Post · Context & memory

Simple Jev, reusing the KV cache

Shared context cached, only the candidate logits read.

Open x.com ↗
恒星sun @vintcessun

如果分类结果最终要喂给业务系统,生成一段 JSON 往往不是最省事的路径。Simple Jev 把开放模型变成结构化决策接口。

github.com/featherless-ai…

它复用共享上下文的 KV cache,只读取各问题候选标签的下一 token logits,再由服务端组装 choice、score 和真值判断。省掉逐 token 解码与 JSON

Image from the post

The decision Jev makes

Keep or discard a tool result, or answer whether a stopping condition is met.

Where it fits

Agents drown in their own context. These projects use Jev to decide what to keep, what to drop and when a loop is actually finished. All 117 context & memory projects →

Related projects