Section: Other Grants and Activities

European initiatives

SEALS infrastructure project: Evaluating semantic technologies

Participants : Cássia Trojahn dos Santos [Contact] , Jérôme Euzenat.

Exmo is a partner of the SEALS European commission infrastructure project whose goal is to provide the infrastructure for evaluating semantic technologies. Jérôme Euzenat is vice-coordinator in charge of the research area.

More particularly, Exmo is in charge of providing an infrastructure for evaluating ontology matching systems and algorithms, to be aggregated in the SEALS platform. This task involves:

• designing evaluation campaigns, including identifying criteria, metrics, datasets, and tools to be used in each campaign,

• designing and implementing services for automatic evaluation of systems and algorithms,

• analysing the results of evaluation campaigns and using them to produce a detailed report on both the effectiveness of the testing methodologies, and the systems that have been tested.

This year we have prepared the second SEALS evaluation campaign and designed a fully automated evaluation process [20] [23] [24] . We have also organised the OAEI 2011 campaign (§ 6.1.1 ) [9] .

More information on SEALS can be found at http://www.seals-project.eu/ .