Two variations on ontology alignment evaluation: Methodological issues

Laura Hollink; Mark Van Assem; Shenghui Wang; Antoine Isaac; Guus Schreiber

doi:10.1007/978-3-540-68234-9_30

Two variations on ontology alignment evaluation: Methodological issues

Laura Hollink^*, Mark Van Assem, Shenghui Wang, Antoine Isaac, Guus Schreiber

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

14 Citations (Scopus)

29 Downloads (Pure)

Abstract

Evaluation of ontology alignments is in practice done in two ways: (1) assessing individual correspondences and (2) comparing the alignment to a reference alignment. However, this type of evaluation does not guarantee that an application which uses the alignment will perform well. In this paper, we contribute to the current ontology alignment evaluation practices by proposing two alternative evaluation methods that take into account some characteristics of a usage scenario without doing a full-fledged end-to-end evaluation. We compare different evaluation approaches in three case studies, focussing on methodological issues. Each case study considers an alignment between a different pair of ontologies, ranging from rich and well-structured to small and poorly structured. This enables us to conclude on the use of different evaluation approaches in different settings.

Original language	English
Title of host publication	The Semantic Web
Subtitle of host publication	Research and Applications - 5th European Semantic Web Conference, ESWC 2008, Proceedings
Editors	Sean Bechhofer, Manfred Hauswirth, Jorg Hoffmann, Manolis Koubarakis
Pages	388-401
Number of pages	14
ISBN (Electronic)	978-3-540-68234-9
DOIs	https://doi.org/10.1007/978-3-540-68234-9_30
Publication status	Published - 25 Jun 2008
Externally published	Yes
Event	5th European Semantic Web Conference, ESWC 2008 - Tenerife, Canary Islands, Spain Duration: 1 Jun 2008 → 5 Jun 2008 Conference number: 5

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	5021
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	5th European Semantic Web Conference, ESWC 2008
Abbreviated title	ESWC 2008
Country/Territory	Spain
City	Tenerife, Canary Islands
Period	1/06/08 → 5/06/08

Access to Document

10.1007/978-3-540-68234-9_30

Two_Variations_on_Ontology_Alignment_Evaluation_MeAccepted author version, 466 KB

Cite this

Hollink, L., Van Assem, M., Wang, S., Isaac, A., & Schreiber, G. (2008). Two variations on ontology alignment evaluation: Methodological issues. In S. Bechhofer, M. Hauswirth, J. Hoffmann, & M. Koubarakis (Eds.), The Semantic Web: Research and Applications - 5th European Semantic Web Conference, ESWC 2008, Proceedings (pp. 388-401). (Lecture Notes in Computer Science; Vol. 5021). https://doi.org/10.1007/978-3-540-68234-9_30

Hollink, Laura ; Van Assem, Mark ; Wang, Shenghui et al. / Two variations on ontology alignment evaluation : Methodological issues. The Semantic Web: Research and Applications - 5th European Semantic Web Conference, ESWC 2008, Proceedings. editor / Sean Bechhofer ; Manfred Hauswirth ; Jorg Hoffmann ; Manolis Koubarakis. 2008. pp. 388-401 (Lecture Notes in Computer Science).

@inproceedings{5d11fb93ee264a60bac337d9d080e148,

title = "Two variations on ontology alignment evaluation: Methodological issues",

abstract = "Evaluation of ontology alignments is in practice done in two ways: (1) assessing individual correspondences and (2) comparing the alignment to a reference alignment. However, this type of evaluation does not guarantee that an application which uses the alignment will perform well. In this paper, we contribute to the current ontology alignment evaluation practices by proposing two alternative evaluation methods that take into account some characteristics of a usage scenario without doing a full-fledged end-to-end evaluation. We compare different evaluation approaches in three case studies, focussing on methodological issues. Each case study considers an alignment between a different pair of ontologies, ranging from rich and well-structured to small and poorly structured. This enables us to conclude on the use of different evaluation approaches in different settings.",

author = "Laura Hollink and {Van Assem}, Mark and Shenghui Wang and Antoine Isaac and Guus Schreiber",

year = "2008",

month = jun,

day = "25",

doi = "10.1007/978-3-540-68234-9_30",

language = "English",

isbn = "978-3-540-68233-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "388--401",

editor = "Sean Bechhofer and Manfred Hauswirth and Jorg Hoffmann and Manolis Koubarakis",

booktitle = "The Semantic Web",

note = "5th European Semantic Web Conference, ESWC 2008, ESWC 2008 ; Conference date: 01-06-2008 Through 05-06-2008",

}

Hollink, L, Van Assem, M, Wang, S, Isaac, A & Schreiber, G 2008, Two variations on ontology alignment evaluation: Methodological issues. in S Bechhofer, M Hauswirth, J Hoffmann & M Koubarakis (eds), The Semantic Web: Research and Applications - 5th European Semantic Web Conference, ESWC 2008, Proceedings. Lecture Notes in Computer Science, vol. 5021, pp. 388-401, 5th European Semantic Web Conference, ESWC 2008, Tenerife, Canary Islands, Spain, 1/06/08. https://doi.org/10.1007/978-3-540-68234-9_30

Two variations on ontology alignment evaluation: Methodological issues. / Hollink, Laura; Van Assem, Mark; Wang, Shenghui et al.
The Semantic Web: Research and Applications - 5th European Semantic Web Conference, ESWC 2008, Proceedings. ed. / Sean Bechhofer; Manfred Hauswirth; Jorg Hoffmann; Manolis Koubarakis. 2008. p. 388-401 (Lecture Notes in Computer Science; Vol. 5021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Two variations on ontology alignment evaluation

T2 - 5th European Semantic Web Conference, ESWC 2008

AU - Hollink, Laura

AU - Van Assem, Mark

AU - Wang, Shenghui

AU - Isaac, Antoine

AU - Schreiber, Guus

N1 - Conference code: 5

PY - 2008/6/25

Y1 - 2008/6/25

N2 - Evaluation of ontology alignments is in practice done in two ways: (1) assessing individual correspondences and (2) comparing the alignment to a reference alignment. However, this type of evaluation does not guarantee that an application which uses the alignment will perform well. In this paper, we contribute to the current ontology alignment evaluation practices by proposing two alternative evaluation methods that take into account some characteristics of a usage scenario without doing a full-fledged end-to-end evaluation. We compare different evaluation approaches in three case studies, focussing on methodological issues. Each case study considers an alignment between a different pair of ontologies, ranging from rich and well-structured to small and poorly structured. This enables us to conclude on the use of different evaluation approaches in different settings.

AB - Evaluation of ontology alignments is in practice done in two ways: (1) assessing individual correspondences and (2) comparing the alignment to a reference alignment. However, this type of evaluation does not guarantee that an application which uses the alignment will perform well. In this paper, we contribute to the current ontology alignment evaluation practices by proposing two alternative evaluation methods that take into account some characteristics of a usage scenario without doing a full-fledged end-to-end evaluation. We compare different evaluation approaches in three case studies, focussing on methodological issues. Each case study considers an alignment between a different pair of ontologies, ranging from rich and well-structured to small and poorly structured. This enables us to conclude on the use of different evaluation approaches in different settings.

UR - http://www.scopus.com/inward/record.url?scp=45449107384&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-68234-9_30

DO - 10.1007/978-3-540-68234-9_30

M3 - Conference contribution

AN - SCOPUS:45449107384

SN - 978-3-540-68233-2

T3 - Lecture Notes in Computer Science

SP - 388

EP - 401

BT - The Semantic Web

A2 - Bechhofer, Sean

A2 - Hauswirth, Manfred

A2 - Hoffmann, Jorg

A2 - Koubarakis, Manolis

Y2 - 1 June 2008 through 5 June 2008

ER -

Hollink L, Van Assem M, Wang S, Isaac A, Schreiber G. Two variations on ontology alignment evaluation: Methodological issues. In Bechhofer S, Hauswirth M, Hoffmann J, Koubarakis M, editors, The Semantic Web: Research and Applications - 5th European Semantic Web Conference, ESWC 2008, Proceedings. 2008. p. 388-401. (Lecture Notes in Computer Science). doi: 10.1007/978-3-540-68234-9_30

Two variations on ontology alignment evaluation: Methodological issues

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this