Improving Search Engines Performance on Multithreading Processors
Source:
8th International Meeting on High Performance Computing for Computational Science (VECPAR 2008), June 24-27, Toulouse, France (2008)
Abstract:
In this paper we present strategies and experiments that
show how to take advantage of the multi-threading parallelism avail-
able in Chip Multithreading (CMP) processors in the context of efficient
query processing for search engines. We show that scalable performance
can be achieved by letting the search engine go synchronous so that
batches of queries can be processed concurrently in a simple but very
efficient manner. Furthermore, our results indicate that the multithread-
ing capabilities of modern CMP systems are not fully exploited when the
search engine operates on a conventional asynchronous mode due to the
moderate thread level parallelism that can be extracted from a single
query.
Download: