A preliminary study on similarity-preserving digital book identifiers
Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review
Authors
Due to proliferation of digital publishing, e-book catalogs are abundant but noisy and unstructured. Tools for the digital librarian rely on ISBN, metadata embedded into digital files (without accepted standard) and cryptographic hash functions for the identification of coderivative or nearduplicate content. However, unreliability of metadata and sensitivity of hashing to
even smallest changes prevents efficient detection of coderivative or similar digital books. Focus of the study are books with many versions that differ in certain amount of OCR errors and have a number of sentence-length variations. Identification of similar books is performed using small-sized fingerprints that can be easily shared and compared. We created synthetic datasets to evaluate fingerprinting accuracy while providing standard precision and recall measurements.
even smallest changes prevents efficient detection of coderivative or similar digital books. Focus of the study are books with many versions that differ in certain amount of OCR errors and have a number of sentence-length variations. Identification of similar books is performed using small-sized fingerprints that can be easily shared and compared. We created synthetic datasets to evaluate fingerprinting accuracy while providing standard precision and recall measurements.
Original language | English |
---|---|
Title of host publication | Proceedings of the 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities : LaTeCH 2015 |
Editors | Kalliopi A. Zervanou, Marieke van Erp, Beatrice Alex |
Number of pages | 6 |
Place of Publication | Beijing |
Publisher | Association for Computational Linguistics (ACL) |
Publication date | 2015 |
Pages | 78-83 |
ISBN (electronic) | 978-1-941643-63-1 |
Publication status | Published - 2015 |
Event | 9th Socio-Economic Sciences and Humanities Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities - SIGHUM 2015 - Peking, China Duration: 26.07.2015 → 30.07.2015 Conference number: 9 https://aclanthology.info/volumes/proceedings-of-the-9th-sighum-workshop-on-language-technology-for-cultural-heritage-social-sciences-and-humanities-latech https://sighum.wordpress.com/events/latech-2015/ |
Bibliographical note
Funding Information:
This work was supported in part by the Croatian science foundation through the Recommender System for Service-oriented Architecture research project and in part by Leuphana Universität Lüneburg, DCRL Digital Cultures Research Lab. The authors would like to thank Robert M. Ochshorn and Goran Glavasˇ for their invaluable comments and suggestions and Project Gutenberg for their book collection.
Publisher Copyright:
© 2015 Proceedings of the Annual Meeting of the Association for Computational Linguistics.
- Digital media