Document assignment in multi-site search engines

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Assigning documents accurately to sites is critical for the performance of multi-site Web search engines. In such settings, sites crawl only documents they index and forward queries to obtain best-matching documents from other sites. Inaccurate assignments may lead to inefficiencies when crawling Web pages or processing user queries. In this work, we propose a machine-learned document assignment strategy that uses the locality of document views in search results to decide upon assignments. We evaluate the performance of our strategy using various document features extracted from a large Web collection. Our experimental setup uses query logs from a number of search front-ends spread across different geographic locations and uses these logs to learn the document access patterns. We compare our technique against baselines such as region- and language-based document assignment and observe that our technique achieves substantial performance improvements with respect to recall. With our technique, we are able to obtain a small query forwarding rate (0.04) requiring roughly 45% less replication of documents compared to replicating all documents across all sites.
OriginalspracheEnglisch
TitelProceedings of the fourth ACM international conference on Web search and data mining
Anzahl der Seiten10
ErscheinungsortNew York
VerlagAssociation for Computing Machinery, Inc
Erscheinungsdatum2011
Seiten575-584
ISBN (Print)978-1-4503-0493-1
DOIs
PublikationsstatusErschienen - 2011
Extern publiziertJa
Veranstaltung4th ACM International Conference on Web Search and Data Mining - WSDM '11 2011 - Hong Kong, China
Dauer: 09.02.201112.02.2011
Konferenznummer: 4
http://www.wsdm2011.org/wsdm2011/_media/wsdm2011-program-20110127.pdf

DOI

Zuletzt angesehen

Publikationen

  1. Using EEG movement tagging to isolate brain responses coupled to biological movements
  2. Knowledge Generation and Sustainable Development
  3. Vergütung, variable
  4. Life-protecting neoliberalism
  5. Towards a Better Understanding of the Phenomenon of "Adolescent Struggling Readers"
  6. Transfer of metacognitive skills in self-regulated learning
  7. An Indirectly Controlled Full Variable Valve Train System to Improve the Internal Combustion Phase Engines
  8. Development of a robust classifier of freshwater residence in barramundi (Lates calcarifer) life histories using elemental ratios in scales and boosted regression trees
  9. Learning linear classifiers sensitive to example dependent and noisy costs
  10. Gender, Space and Development: An Introduction to Concepts and Debates
  11. Credit constraints and exports: A survey of empirical studies using firm level data
  12. 9th challenge on question answering over linked data (QALD-9)
  13. Local expansion concepts for detecting transport barriers in dynamical systems
  14. Practical critique: Bridging the gap between critical and practice oriented REDD+ research communities’
  15. Short-term effects of a web-based guided self-help intervention for employees with depressive symptoms
  16. The edge of virtual communities ?
  17. Introduction
  18. The complementary relationship of exploration and exploitation in professional service firms: An exploratory study of IT consulting firms
  19. Image, Process, Performance, Machine
  20. Numerical responses of saproxylic beetles to rapid increases in dead wood availability following geometrid moth outbreaks in sub-arctic mountain birch forest
  21. Selbstevaluation
  22. Cross-level Information and Influence in Mandated Participatory Planning: Alternative Pathways to Sustainable Water Management in Germany’s Implementation of the EU Water Framework Directive
  23. Determinants and consequences of corporate social responsibility decoupling—Status quo and limitations of recent empirical quantitative research
  24. Translation
  25. Microstructure evolution and texture development during production of homogeneous fine-grained aluminum wire by friction extrusion