Apollo Restore is a foundation LLM for historical Greek specialized for restoring gaps in fragmentary texts.
"We present Apollo Restore, a 24-billion-parameter large language model
for restoring lacunae---physical gaps---in fragmentary Ancient Greek
texts. Fine-tuned from Mistral Small with a fill-in-the-middle
objective, Apollo Restore reconstructs missing spans without requiring
oracle knowledge of their length. To our knowledge, it is the first
large-scale decoder model for historical Greek, and the first for any
ancient Mediterranean language. Evaluated as in prior work, on short
gaps of up to ten characters, Apollo Restore places the correct
restoration among its top twenty candidates for 80.6%/54.6%/61.0% of
documentary-papyrus, literary-papyrus, and stone-inscription lacunae,
exceeding the strongest published models by 1.6×/2.6×/1.4×.
Prior evaluation protocols, however, inflate scores through a bias
toward trivially short gaps; under a length-balanced metric Apollo
Restore's advantage over the strongest published models grows to 2.3×/3.5×/1.6×
and degrades gracefully, even given incorrect length hints. In a blind
study, 20 expert papyrologists, epigraphists, and philologists strongly
preferred Apollo Restore to the strongest baseline and judged its
performance at least as good as human restorations in 77% of cases.
Apollo Restore also improves the published reading of PHerc. 1667---a
papyrus roll carbonised in the eruption of Vesuvius in 79 CE and
digitally unrolled and edited after Apollo Restore's training data was
compiled. Apollo Restore is an output of the Decoding Antiquity
initiative to build specialized LLMs for historical languages and
manuscripts, led by the Austrian Academy of Sciences.
" Description from: https://arxiv.org/abs/2609.22455
Posts
Stumble It!
