Full Seminar Details

Dr Shannon Bradshaw

Dr Shannon Bradshaw
Search Engine-Crawler Symbiosis: Adapting to Community Interests
This event took place on Monday 15 December 2003 at 11:30

Web crawlers have been used for nearly a decade as a search engine component to create and update large collections of documents in order to serve the widely varying needs of web users. Typically the crawler and the rest of the search engine are not closely integrated, because the objective of the crawler is simply to gather as broad a sample of the Web as possible.

This approach to search engines while effective for simple information needs such as the take away menu for a local restaurant is less effective for searches requiring a range of documents in a focused topic space. Such information needs are regularly encountered in research and business.

In this talk I will present an approach to building search engines targeted to specific communities with shared focused interests. This work differs from previous approaches to focused crawling in that the focus of the system automatically changes as the needs and interests of its community evolve. Our approach is based on a tightly coupled system in which a crawler and a search engine engage in a symbiotic relationship. The crawler feeds the search engine and the search engine in turn helps the crawler to better its performance.

We show that symbiosis can help the system learn about a community's interests and serve that community's web search needs with better focus.

Watch the webcast replay >>

Jobs

Project Officer - Data Hub Development

Knowledge Media Institute (KMi)
32,548 - 38,833
Based in Milton Keynes
Temporary contract until 30 June 2019

The Open University's Knowledge Media Institute (KMi) is a distinct research unit within the Faculty of Science, Technology, Engineering and Mathematics (STEM). KMi is looking for a Project Officer to support the maintenance and evolution of the MK...

Web Developer (Front-end and CMS)

Knowledge Media Institute (KMi)
26,495 - 31,604
Based in Milton Keynes
Temporary contract until 30 June 2018

The Knowledge Media Institute (KMi) is a distinct research unit within the Faculty of Science, Technology, Engineering and Mathematics (STEM) at the Open University. KMI is looking for a Web Developer to join their team of developers and researchers...

CONTACT US

Knowledge Media Institute
The Open University
Walton Hall
Milton Keynes
MK7 6AA
United Kingdom

Tel: +44 (0)1908 653800

Fax: +44 (0)1908 653169

Email: KMi Support

COMMENT

If you have any comments, suggestions or general feedback regarding our website, please email us at the address below.

Email: KMi Development Team