Tech Reports
Tech Report kmi-00-14 Abstract
Feature Reduction for Document Clustering and Classification
Techreport ID: kmi-00-14
Date: 2000
Author(s): Stefan Rüger and Susan Gauch
Often users receive search results which contain a wide range of documents, only some of which are relevant to their information needs. To address this problem, ever more systems not only locate information for users, but also organise that information on their behalf. We look at two main automatic approaches to information organisation: interactive clustering of search results and pre-categorising documents to provide hierarchical browsing structures. To be feasible in real world applications, both of these approaches require accurate yet efficient algorithms. Yet, both suffer from the curse of dimensionality - documents are typically represented by hundreds or thousands of words (features) which must be analysed and processed during clustering or classification. In this paper, we discuss feature reduction techniques and their application to document clustering and classification, showing that feature reduction improves efficiency as well as accuracy. We validate these algorithms using human relevance assignments and categorisation.
Publication(s):
DTR 2000/8, Department of Computing, Imperial College London
Future Internet
KnowledgeManagementMultimedia &
Information SystemsNarrative
HypermediaNew Media SystemsSemantic Web &
Knowledge ServicesSocial Software
Semantic Web and Knowledge Services is...
Our research in the Semantic Web area looks at the potentials of fusing together advances in a range of disciplines, and applying them in a systemic way to simplify the development of intelligent, knowledge-based web services and to facilitate human access and use of knowledge available on the web. For instance, we are exploring ways in which tnatural language interfaces can be used to facilitate access to data distributed over different repositories. We are also developing infrastructures to support rapid development and deployment of semantic web services, which can be used to create web applications on-the-fly. We are also investigating ways in which semantic technology can support learning on the web, through a combination of knowledge representation support, pedagogical theories and intelligent content aggregation mechanisms. Finally, we are also investigating the Semantic Web itself as a domain of analysis and performing large scale empirical studies to uncover data about the concrete epistemologies which can be found on the Semantic Web. This exciting new area of research gives us concrete insights on the different conceptualizations that are present on the Semantic Web by giving us the possibility to discover which are the most common viewpoints, which viewpoints are mutually inconsistent, to what extent different models agree or disagree, etc...
Our aim is to be at the forefront of both theoretical and practical developments on the Semantic Web not only by developing theories and models, but also by building concrete applications, for a variety of domains and user communities, including KMi and the Open University itself.
List all Semantic Web and Knowledge Services Projects
Check out these Hot Semantic Web and Knowledge Services Technologies:
List all Semantic Web and Knowledge Services Technologies
