Repo · Data & extraction
jev-curate
A Rust dataset sifter that keeps clean rows verbatim and drops the rest.
Open github.com ↗From the repository
High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
arrowclidata-cleaningdata-engineeringdataset-curationeval-harnessfine-tuningjevjsonlllmparquetpolarspretrainingpyo3reasoning-modelsrustsynthetic-datasystem-onetype-safe-aitypesafe-ai
How builders describe it
A Rust CLI and PyO3 library that streams JSONL and Parquet rows through Jev Noul and Score rubrics, writing clean and rejected records to disk without rewriting content.
The decision Jev makes
Keep or drop a row, assign a label, or select one field value at a time.
Where it fits
Putting Jev next to the data: filtering rows with plain-English conditions, classifying records, labelling datasets and pulling structure out of text one small decision at a time. All 98 data & extraction projects →