CalibratedDecisions.

Post · Benchmarks & research

Jev on Cloud Run

About 47 s cold start and about 117 ms end to end on a cloud GPU.

Open x.com ↗
Vaishnavi @_vmlops

Someone built a way to run Jev on Cloud Run with an RTX PRO 6000.

~47s cold start.
~117ms end-to-end.
100+ req/s at concurrency 32.

And somehow, they turned it into Snake, Dino & Tetris 💀

Jev is getting real interesting

Video from the post

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects