Detecting Erroneously Recognized Handwritten Byzantine Text

Detecting Erroneously Recognized Handwritten Byzantine Text

Abstract

Handwritten text recognition (HTR) yields textual output that comprises errors, which are considerably more compared to that of recognised printed (OCRed) text. Post-correcting methods can eliminate such errors but may also introduce errors. In this study, we investigate the issues arising from this reality in Byzantine Greek. We investigate the properties of the texts that lead post-correction systems to this adversarial behaviour and we experiment with text classification systems that learn to detect incorrect recognition output. A large masked language model, pre-trained in modern and fine-tuned in Byzantine Greek, achieves an Average Precision score of 95%. The score improves to 97% when using a model that is pre-trained in modern and then in ancient Greek, the two language forms Byzantine Greek combines elements from. A century-based analysis shows that the advantage of the classifier that is further-pre-trained in ancient Greek concerns texts of older centuries. The application of this classifier before a neural post-corrector on HTRed text reduced significantly the post-correction mistakes.

Grafik Top
Authors
  • Pavlopoulos, John
  • Kougia, Vasiliki
  • Platanou, Paraskevi
  • Essler, Holger
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
Findings of the Association for Computational Linguistics: EMNLP 2023
Divisions
Data Mining and Machine Learning
Subjects
Kuenstliche Intelligenz
Event Location
Singapore
Event Type
Conference
Event Dates
6-10 Dec 2023
Date
2023
Export
Grafik Top