Search Engine-Crawler Symbiosis: Adapting to Community Interests
This event took place on Monday 15 December 2003 at 11:30
Dr Shannon Bradshaw
Web crawlers have been used for nearly a decade as a search engine component to create and update large collections of documents in order to serve the widely varying needs of web users. Typically the crawler and the rest of the search engine are not closely integrated, because the objective of the crawler is simply to gather as broad a sample of the Web as possible.
This approach to search engines while effective for simple information needs such as the take away menu for a local restaurant is less effective for searches requiring a range of documents in a focused topic space. Such information needs are regularly encountered in research and business.
In this talk I will present an approach to building search engines targeted to specific communities with shared focused interests. This work differs from previous approaches to focused crawling in that the focus of the system automatically changes as the needs and interests of its community evolve. Our approach is based on a tightly coupled system in which a crawler and a search engine engage in a symbiotic relationship. The crawler feeds the search engine and the search engine in turn helps the crawler to better its performance.
We show that symbiosis can help the system learn about a community's interests and serve that community's web search needs with better focus.
This event took place on Monday 15 December 2003 at 11:30
Dr Shannon Bradshaw
Web crawlers have been used for nearly a decade as a search engine component to create and update large collections of documents in order to serve the widely varying needs of web users. Typically the crawler and the rest of the search engine are not closely integrated, because the objective of the crawler is simply to gather as broad a sample of the Web as possible.
This approach to search engines while effective for simple information needs such as the take away menu for a local restaurant is less effective for searches requiring a range of documents in a focused topic space. Such information needs are regularly encountered in research and business.
In this talk I will present an approach to building search engines targeted to specific communities with shared focused interests. This work differs from previous approaches to focused crawling in that the focus of the system automatically changes as the needs and interests of its community evolve. Our approach is based on a tightly coupled system in which a crawler and a search engine engage in a symbiotic relationship. The crawler feeds the search engine and the search engine in turn helps the crawler to better its performance.
We show that symbiosis can help the system learn about a community's interests and serve that community's web search needs with better focus.
Future Internet
KnowledgeManagementMultimedia &
Information SystemsNarrative
HypermediaNew Media SystemsSemantic Web &
Knowledge ServicesSocial Software
Semantic Web and Knowledge Services is...
Our research in the Semantic Web area looks at the potentials of fusing together advances in a range of disciplines, and applying them in a systemic way to simplify the development of intelligent, knowledge-based web services and to facilitate human access and use of knowledge available on the web. For instance, we are exploring ways in which tnatural language interfaces can be used to facilitate access to data distributed over different repositories. We are also developing infrastructures to support rapid development and deployment of semantic web services, which can be used to create web applications on-the-fly. We are also investigating ways in which semantic technology can support learning on the web, through a combination of knowledge representation support, pedagogical theories and intelligent content aggregation mechanisms. Finally, we are also investigating the Semantic Web itself as a domain of analysis and performing large scale empirical studies to uncover data about the concrete epistemologies which can be found on the Semantic Web. This exciting new area of research gives us concrete insights on the different conceptualizations that are present on the Semantic Web by giving us the possibility to discover which are the most common viewpoints, which viewpoints are mutually inconsistent, to what extent different models agree or disagree, etc...
Our aim is to be at the forefront of both theoretical and practical developments on the Semantic Web not only by developing theories and models, but also by building concrete applications, for a variety of domains and user communities, including KMi and the Open University itself.
List all Semantic Web and Knowledge Services Projects
Check out these Hot Semantic Web and Knowledge Services Technologies:
List all Semantic Web and Knowledge Services Technologies
