Tech Report

Unsupervised data linking using a genetic algorithm

As commonly accepted identifiers for data instances in semantic datasets (such as ISBN codes or DOI identifiers) are often not available, discovering links between overlapping datasets on the Web is generally realised through the use of fuzzy similarity measures. Configuring such measures, i.e. deciding which similarity function to apply to which data properties with which parameters, is often a non-trivial task that depends on the domain, ontological schemas, and formatting conventions in data. Existing solutions either rely on the user's knowledge of the data and the domain or on the use of machine learning to discover these parameters based on training data. In this report, we present a novel approach to tackle the issue of data linking which relies on the unsupervised discovery of the required similarity parameters. Instead of using labeled training data, the method takes into account several desired properties which the distribution of output similarity values should satisfy.

The method includes these features into a fitness criterion used in a genetic algorithm to establish similarity parameters that maximise the quality of the resulting linkset according to the considered properties. We show in experiments using benchmarks as well as real-world datasets that such an unsupervised method can reach the same levels of performance as manually engineered methods, and how the different parameters of the genetic algorithm and the fitness criterion affect the results for different datasets.

ID: kmi-11-02

Date: 2011

Author(s): Andriy Nikolov,Mathieu d'Aquin,Enrico Motta

Resources:
Download PDF

View By

Other Publications

Jobs

Research Manager (Grade 7)

Knowledge Media Institute (KMi)
£33,199 - £39,609
Based in Milton Keynes
Fixed term until 31st July 2121

The Open University is the UK's largest university, a world leader in flexible part-time education combining a mission to widen access to higher education with research excellence, transforming lives through education. The Role The main purpose of the role is to provide an administrative service to KMi's Executive Team, academic and researchers and undertake other responsibilities in the Unit as directed. See the attached Job Description for further details and desirable...

Research Assistant / Associate (AC1 - AC2)

Knowledge Media Institute (KMi)
£30,395 - £38,460 (Grade AC1 / AC2)
Based in Milton Keynes
6 Months Fixed Term - Full time

The Open University is the UK's largest university, a world leader in flexible part-time education combining a mission to widen access to higher education with research excellence, transforming lives through education. The Role We are seeking to recruit a Research Assistant or Research Associate with a background in Computer Science, Electric Engineering, Physics, Mathematics or Statistics to work on a small collaborative project funded by AND technology research (www.andtr.com). See...

CONTACT US

Knowledge Media Institute
The Open University
Walton Hall
Milton Keynes
MK7 6AA
United Kingdom

Tel: +44 (0)1908 653800

Fax: +44 (0)1908 653169

Email: KMi Support

COMMENT

If you have any comments, suggestions or general feedback regarding our website, please email us at the address below.

Email: KMi Development Team