WP7 Print
 WP7 - Experimentation and testing of the framework

 Workpackage number
7
 Start date or starting event
 12/2006  End date
08/2008 
 Activity type
 RTD/Innovation activities
 Participant id
FUB UOR  MAN.  TUD  TUHH 
 Person months
5
4
10 
Description of work
TASK 1: Identification of test ontologies and usage scenarios
First, a number of real-life existing ontologies will be selected from sources outside the project which
are suitable as test material to perform the identified ontology tasks and apply the developed reasoning
services and tools. Second, a number of usage scenarios will be identified, which will cover ontologies
in isolation, both during design and maintenance stages (linked to the work in WP3), and runtime stages
(WP4). They will also cover multiple ontologies integration and merging (WP5), and interoperation
(WP6).
TASK 2: Testing ontology services on single and multiple ontologies
Reasoning services and tools developed in WP3, WP4, WP5, and WP6 will be integrated and applied
to the test ontologies selected in the previous task. An error-seed approach may be used to test the
practicality and the success rate of the reasoning methods and tools. Regression testing and benchmark
repositories are set up to guarantee (i) stability of results achieved in the project and (ii) methodological
system development.
TASK 3: Tracing ontology services through usage scenarios
Rather than applying ontology services to static test ontologies, we will take these test ontologies through
simulated usage scenarios, in order to trace the quality of these reasoning services as ontologies go
through these scenarios.
TASK 4: Tuning of reasoning services and tools
One of the main objectives of testing the reasoning services and tools will be to assess their quality
in dealing with single and multiple ontologies, and to improve them so as to overcome the identified
weaknesses and problems. This will provide useful feedback to WP4, WP5, WP6, and the final phase of
WP3, allowing for fine tuning and adjustment of the developed services and tools.
Deliverables
D14 (02/2007) – Definition of usage-scenarios and test ontologies (Report)
The report will define usage scenarios and a set of ontologies to be used for testing ontology services.
They will cover all tasks related to single and multiple ontologies, both at development time and when
in operation.
D23 (08/2007) – Analysis of test results on individual test ontologies (Report)
The report will evaluate the results of the earlier WPs by testing on individual static ontologies. It will
also report on the feedback from the test results to the techniques developed in WP3 and WP4.
D27 (08/2008) – Analysis of test results on usage scenarios (Report)
The report will evaluate the results of the earlier workpackages on a number of usage scenarios. It will
also report on the feedback from the test results to the techniques developed in WP5 and WP6.
D28 (08/2008) – Demo of the overall ontology framework (Demonstrator)
The demonstrator will illustrate the overall ontology framework, covering all ontology tasks and associated
reasoning services developed within the project.
Milestones and expected results
M6 (08/2008) – Assessment of the overall ontology framework
The evaluation work carried out in this workpackage will demonstrate both the practical usefulness and
the usability of the overall ontology framework and reasoning methods developed within the project.

2005-2007 TONES - Thinking Ontologies
1