A comprehensive benchmark focused on catalog card analysis and information extraction from historical library catalog systems. This benchmark evaluates models on structured data extraction from digitized catalog cards, testing their ability to parse complex bibliographic information, author names, dates, and hierarchical catalog structures from historical Swiss library records.
All results, details, and the leaderboard for this benchmark are available at:
- Benchmark detail: https://rise-services.rise.unibas.ch/benchmarks/p/library_cards
- Benchmark scores: https://rise-services.rise.unibas.ch/benchmarks/p/benchmarks/?id=library_cards