Detecting Erroneously Recognized Handwritten Byzantine Text
Handwritten text recognition (HTR) yields textual output that comprises errors, which are considerably more compared to that of recognised printed (OCRed) text. Post-correcting methods can eliminate such errors but may also introduce errors. In this study, we investigate the issues arising from this reality in Byzantine Greek. We investigate the properties of the texts that lead post-correction systems to this adversarial behaviour and we experiment with text classification systems that learn to detect incorrect recognition output. A large masked language model, pre-trained in modern and fine-tuned in Byzantine Greek, achieves an Average Precision score of 95%. The score improves to 97% when using a model that is pre-trained in modern and then in ancient Greek, the two language forms Byzantine Greek combines elements from. A century-based analysis shows that the advantage of the classifier that is further-pre-trained in ancient Greek concerns texts of older centuries. The application of this classifier before a neural post-corrector on HTRed text reduced significantly the post-correction mistakes.
Top- Pavlopoulos, John
- Kougia, Vasiliki
- Platanou, Paraskevi
- Essler, Holger
Category |
Paper in Conference Proceedings or in Workshop Proceedings (Paper) |
Event Title |
Findings of the Association for Computational Linguistics: EMNLP 2023 |
Divisions |
Data Mining and Machine Learning |
Subjects |
Kuenstliche Intelligenz |
Event Location |
Singapore |
Event Type |
Conference |
Event Dates |
6-10 Dec 2023 |
Date |
2023 |
Export |