Data-driven diachronic and categorical evaluation of ontologies: Framework, measure, and metrics

Hlomani Hlomani, Deborah A. Stacey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Ontologies are a very important technology in the semantic web. They are an approximate representation and formalization of a domain of discourse in a manner that is both machine and human interpretable. Ontology evaluation therefore, concerns itself with measuring the degree to which the ontology approximates the domain. In data-driven ontology evaluation, the correctness of an ontology is measured agains a corpus of documents about the domain. This domain knowledge is dynamic and evolves over several dimensions such as the temporal and categorical. Current research makes an assumption that is contrary to this notion and hence does not account for the existence of bias in ontology evaluation. This work addresses this gap and proposes two metrics as well as a theoretical framework. It also presents a statistical evaluation of the framework and the associated metrics.

Original languageEnglish
Title of host publicationKEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development
EditorsJoaquim Filipe, Jan Dietz, Joaquim Filipe, David Aveiro
PublisherINSTICC Press
Pages56-66
Number of pages11
ISBN (Electronic)9789897580499
Publication statusPublished - Jan 1 2014
Event6th International Conference on Knowledge Engineering and Ontology Development, KEOD 2014 - Rome, Italy
Duration: Oct 21 2014Oct 24 2014

Other

Other6th International Conference on Knowledge Engineering and Ontology Development, KEOD 2014
CountryItaly
CityRome
Period10/21/1410/24/14

Fingerprint

Ontology
Semantic Web

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems

Cite this

Hlomani, H., & Stacey, D. A. (2014). Data-driven diachronic and categorical evaluation of ontologies: Framework, measure, and metrics. In J. Filipe, J. Dietz, J. Filipe, & D. Aveiro (Eds.), KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development (pp. 56-66). INSTICC Press.
Hlomani, Hlomani ; Stacey, Deborah A. / Data-driven diachronic and categorical evaluation of ontologies : Framework, measure, and metrics. KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development. editor / Joaquim Filipe ; Jan Dietz ; Joaquim Filipe ; David Aveiro. INSTICC Press, 2014. pp. 56-66
@inproceedings{5cecf0aa869245ab8306cd62dad04c51,
title = "Data-driven diachronic and categorical evaluation of ontologies: Framework, measure, and metrics",
abstract = "Ontologies are a very important technology in the semantic web. They are an approximate representation and formalization of a domain of discourse in a manner that is both machine and human interpretable. Ontology evaluation therefore, concerns itself with measuring the degree to which the ontology approximates the domain. In data-driven ontology evaluation, the correctness of an ontology is measured agains a corpus of documents about the domain. This domain knowledge is dynamic and evolves over several dimensions such as the temporal and categorical. Current research makes an assumption that is contrary to this notion and hence does not account for the existence of bias in ontology evaluation. This work addresses this gap and proposes two metrics as well as a theoretical framework. It also presents a statistical evaluation of the framework and the associated metrics.",
author = "Hlomani Hlomani and Stacey, {Deborah A.}",
year = "2014",
month = "1",
day = "1",
language = "English",
pages = "56--66",
editor = "Joaquim Filipe and Jan Dietz and Joaquim Filipe and David Aveiro",
booktitle = "KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development",
publisher = "INSTICC Press",

}

Hlomani, H & Stacey, DA 2014, Data-driven diachronic and categorical evaluation of ontologies: Framework, measure, and metrics. in J Filipe, J Dietz, J Filipe & D Aveiro (eds), KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development. INSTICC Press, pp. 56-66, 6th International Conference on Knowledge Engineering and Ontology Development, KEOD 2014, Rome, Italy, 10/21/14.

Data-driven diachronic and categorical evaluation of ontologies : Framework, measure, and metrics. / Hlomani, Hlomani; Stacey, Deborah A.

KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development. ed. / Joaquim Filipe; Jan Dietz; Joaquim Filipe; David Aveiro. INSTICC Press, 2014. p. 56-66.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Data-driven diachronic and categorical evaluation of ontologies

T2 - Framework, measure, and metrics

AU - Hlomani, Hlomani

AU - Stacey, Deborah A.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Ontologies are a very important technology in the semantic web. They are an approximate representation and formalization of a domain of discourse in a manner that is both machine and human interpretable. Ontology evaluation therefore, concerns itself with measuring the degree to which the ontology approximates the domain. In data-driven ontology evaluation, the correctness of an ontology is measured agains a corpus of documents about the domain. This domain knowledge is dynamic and evolves over several dimensions such as the temporal and categorical. Current research makes an assumption that is contrary to this notion and hence does not account for the existence of bias in ontology evaluation. This work addresses this gap and proposes two metrics as well as a theoretical framework. It also presents a statistical evaluation of the framework and the associated metrics.

AB - Ontologies are a very important technology in the semantic web. They are an approximate representation and formalization of a domain of discourse in a manner that is both machine and human interpretable. Ontology evaluation therefore, concerns itself with measuring the degree to which the ontology approximates the domain. In data-driven ontology evaluation, the correctness of an ontology is measured agains a corpus of documents about the domain. This domain knowledge is dynamic and evolves over several dimensions such as the temporal and categorical. Current research makes an assumption that is contrary to this notion and hence does not account for the existence of bias in ontology evaluation. This work addresses this gap and proposes two metrics as well as a theoretical framework. It also presents a statistical evaluation of the framework and the associated metrics.

UR - http://www.scopus.com/inward/record.url?scp=84909946812&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84909946812&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84909946812

SP - 56

EP - 66

BT - KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development

A2 - Filipe, Joaquim

A2 - Dietz, Jan

A2 - Filipe, Joaquim

A2 - Aveiro, David

PB - INSTICC Press

ER -

Hlomani H, Stacey DA. Data-driven diachronic and categorical evaluation of ontologies: Framework, measure, and metrics. In Filipe J, Dietz J, Filipe J, Aveiro D, editors, KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development. INSTICC Press. 2014. p. 56-66