CalibratedDecisions.

Post · Benchmarks & research

Laya, 421M parameters, local

86.5 decisions a second on about 1 GB of inference memory.

Open x.com ↗
MD Fazal Mustafa @the_mdfazal

🚨 A LOCAL 421M MODEL JUST ATE CLOUD JEV ON SPEED

Laya is an open-source System 1 decision model that runs on your machine.

Laya: 86.5 decisions/sec, P50 ~9ms, score 46
Jev: 3.2 decisions/sec, 317ms API round-trip, score 1

Ships with:
— 421M params
— ~1GB inference memory

Image from the post

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects