Tech Report

Unsupervised data linking using a genetic algorithm

As commonly accepted identifiers for data instances in semantic datasets (such as ISBN codes or DOI identifiers) are often not available, discovering links between overlapping datasets on the Web is generally realised through the use of fuzzy similarity measures. Configuring such measures, i.e. deciding which similarity function to apply to which data properties with which parameters, is often a non-trivial task that depends on the domain, ontological schemas, and formatting conventions in data. Existing solutions either rely on the user's knowledge of the data and the domain or on the use of machine learning to discover these parameters based on training data. In this report, we present a novel approach to tackle the issue of data linking which relies on the unsupervised discovery of the required similarity parameters. Instead of using labeled training data, the method takes into account several desired properties which the distribution of output similarity values should satisfy.

The method includes these features into a fitness criterion used in a genetic algorithm to establish similarity parameters that maximise the quality of the resulting linkset according to the considered properties. We show in experiments using benchmarks as well as real-world datasets that such an unsupervised method can reach the same levels of performance as manually engineered methods, and how the different parameters of the genetic algorithm and the fitness criterion affect the results for different datasets.

ID: kmi-11-02

Date: 2011

Author(s): Andriy Nikolov,Mathieu d'Aquin,Enrico Motta

Resources:
Download PDF

View By

Other Publications

Jobs

Research Asst / Assoc - Text and Data Mining

Knowledge Media Institute (KMi)
29,799 - 38,833 (Grades AC1 / AC2)
Based in Milton Keynes
Temporary contract until 31 December 2018

WE ACCEPT APPLICATIONS FROM CITIZENS GLOBALLY The Knowledge Media Institute (KMi) is a distinct research unit within the Faculty of Science, Technology, Engineering and Mathematics (STEM) at the Open University. KMi is looking for a Web Developer to join their team of developers and researchers that runs a large aggregator of research papers called CORE, and a set of projects promoting principles of Open Science. CORE provides free access to the full-texts of 8 million+ Open Access...

Senior Research Fellow x 2

Knowledge Media Institute (KMi)
50,618 - 56,950 (Grade AC4)
Based in Milton Keynes
Permanent Position

WE ACCEPT APPLICATIONS FROM CITIZENS GLOBALLY The Knowledge Media Institute (KMi) is one of the top research centres in the world in the area of knowledge and media technologies, and we offer a creative and flexible working environment. The style, impact and content of our work are described in detail at http://kmi.open.ac.uk/ Your goal is to strengthen KMi's international research reputation and in particular pursue a robust and innovative research agenda in one or more of these...

CONTACT US

Knowledge Media Institute
The Open University
Walton Hall
Milton Keynes
MK7 6AA
United Kingdom

Tel: +44 (0)1908 653800

Fax: +44 (0)1908 653169

Email: KMi Support

COMMENT

If you have any comments, suggestions or general feedback regarding our website, please email us at the address below.

Email: KMi Development Team