CalibratedDecisions.

Post · Benchmarks & research

Five dollars a month was not enough

Real tasks forced reading the skills docs and using state properly.

Open x.com ↗
nocoo @zhengli

Jev 学费还是要付的,刚开始觉得,每次请求这么便宜,每个月 $5 妥妥够用,一个真实任务下来就教做人:好好研究官方 skill,学会如何正确使用 state 和按分组问问题。

Image from the post

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects