Benchmark · compare
Benchmark
Compose competitors (OCR, OCR→LLM, VLM) and compare them on a corpus, in a single run. No competitor: demonstration.
0
Corpus
15
Options
Corpus
Select a prepared corpus, or stay in demonstration mode.
Corpus ready to run
Select a prepared corpus, or stay in demonstration mode.
Choose in the Library
Competitors
Each row summarizes one pipeline that will actually run.
Region preview
Runs the segmenter on the chosen corpus and shows the detected regions (before launching the benchmark).
Queue ready to run
Each row summarizes one pipeline that will actually run.

No competitor added yet.

Options
Normalization
Custom profile (YAML) — takes precedence if filled

    
Corrects an existing ALTO corpus *inside* its layout: every line keeps its identifier, so the report can say what was changed and what the corrector refused to change. The corpus must carry a separate transcription (<name>.gt.txt) beside its ALTO. Without one, the reference is extracted from the ALTO itself: the corrector would start from the very text it is scored against, and the score would be void.
Filtered from GT AND hypothesis before scoring (those characters are no longer measured).
Picks the report's ranking columns; does not drop collected data (sections unchanged).
Saves the form state (competitors + options) as JSON; reloadable later. No server persistence.
Run the benchmark
Launch the run, then open the final report or segmentation view.
Status Ready.