Towards Adaptive Information Retrieval - Step 1: Collecting Real Data
This event took place on Friday 25 May 2007 at 11:30
Udo Kruschwitz University of Essex, Department of Computer Science, Wivenhoe Park, Colchester
One of the most exciting areas of research in search engine technology and information retrieval is the move towards "adaptive" search systems. A particularly promising aspect of this wide field is to move log analysis right in the centre of attention. The challenge is to exploit the user interaction (as recorded in the log files) to make the search system adapt to the users' search behaviour. Instead of looking at the Web in general we are interested in smaller document collections with a more limited range of topics.
We are focusing on a search paradigm where automatically extracted domain knowledge is incorporated in a simple dialogue system in order to assist users in the search process. The challenge is to mine the log files in order to automatically improve the suggestions made by the system, in other words to "adapt" to the users' search behaviour. We are interested in a specific aspect of this search behaviour, namely the selection of query modification terms which provides us with "implicit feedback" from the users and should be sufficient to come up with a model to automatically adjust the domain knowledge without having to rely on other forms of explicit or implicit user feedback.
This whole process requires real data. We have made a start by running a prototype of our own search system that combines a standard search engine with automatically extracted domain knowledge. The system has been running on the University of Essex intranet for nearly a year now and we have collected more than 35,000 queries. The log files we keep collecting are an extremely valuable resource because they are a reflection of real user interests (different to TREC like scenarios which are always somewhat artificial). The data collected so far are a justification for a system that guides a user in the search process: more than 10% of user queries are query modification steps, i.e. the user either replaces the initial query or adds terms to the query to make it more specific. Adding a term happens more often than replacing the query with a completely new one. We also observe that a user is more likely to select one of the suggestions made by our search engine than modifying the query manually.
The talk will focus on our ongoing research and present some analysis of
the log files collected so far.
This event took place on Friday 25 May 2007 at 11:30
One of the most exciting areas of research in search engine technology and information retrieval is the move towards "adaptive" search systems. A particularly promising aspect of this wide field is to move log analysis right in the centre of attention. The challenge is to exploit the user interaction (as recorded in the log files) to make the search system adapt to the users' search behaviour. Instead of looking at the Web in general we are interested in smaller document collections with a more limited range of topics.
We are focusing on a search paradigm where automatically extracted domain knowledge is incorporated in a simple dialogue system in order to assist users in the search process. The challenge is to mine the log files in order to automatically improve the suggestions made by the system, in other words to "adapt" to the users' search behaviour. We are interested in a specific aspect of this search behaviour, namely the selection of query modification terms which provides us with "implicit feedback" from the users and should be sufficient to come up with a model to automatically adjust the domain knowledge without having to rely on other forms of explicit or implicit user feedback.
This whole process requires real data. We have made a start by running a prototype of our own search system that combines a standard search engine with automatically extracted domain knowledge. The system has been running on the University of Essex intranet for nearly a year now and we have collected more than 35,000 queries. The log files we keep collecting are an extremely valuable resource because they are a reflection of real user interests (different to TREC like scenarios which are always somewhat artificial). The data collected so far are a justification for a system that guides a user in the search process: more than 10% of user queries are query modification steps, i.e. the user either replaces the initial query or adds terms to the query to make it more specific. Adding a term happens more often than replacing the query with a completely new one. We also observe that a user is more likely to select one of the suggestions made by our search engine than modifying the query manually.
The talk will focus on our ongoing research and present some analysis of
the log files collected so far.
Future Internet
KnowledgeManagementMultimedia &
Information SystemsNarrative
HypermediaNew Media SystemsSemantic Web &
Knowledge ServicesSocial Software
Future Internet is...
To succeed the Future Internet will need to address a number of cross-cutting challenges including:
- Scalability in the face of peer-to-peer traffic, decentralisation, and increased openness
- Trust when government, medical, financial, personal data are increasingly trusted to the cloud, and middleware will increasingly use dynamic service selection
- Interoperability of semantic data and metadata, and of services which will be dynamically orchestrated
- Pervasive usability for users of mobile devices, different languages, cultures and physical abilities
- Mobility for users who expect a seamless experience across spaces, devices, and velocities
Future Internet from KMi.
List all Future Internet Projects
Check out these Hot Future Internet Technologies:
List all Future Internet Technologies
