Test Plan for UIMA Version 2.2.2
This page documents the planned testing for the 2.2.2 release.
Test Schedule
Date(s) |
Task |
---|---|
March. 7 |
Code Freeze, bug fixes only |
March. 10 |
Start test phase |
March. 21 |
End of test, start release vote |
March. 24 |
Start vote on general@incubator.a.o |
April. 7 |
Target release date |
Documentation Review
Check Jira issues for necessary documentation updates:
Key |
Summary |
Assignee |
Documentation Update? |
Status |
Res |
UIMA-680 |
CAS is not unlocked on Errors |
Thilo Goetz |
no update needed |
closed |
Fixed |
UIMA-733 |
it is possible to load a type system descriptor that redefines the super type of the DocumentAnnotation |
Thilo Goetz |
no update needed |
closed |
Fixed |
UIMA-814 |
PEAR verification should be able to treat customResoruceSpecifiers |
Michael Baessler |
no update needed |
closed |
Fixed |
UIMA-718 |
add featurePath helper class |
Michael Baessler |
No updates necessary - Javadoc |
closed |
Fixed |
UIMA-721 |
Improve performance of ResultSpecification, especially for Capability Language Flows |
Marshall Schor |
updated |
closed |
Fixed |
UIMA-782 |
Document Java 1.5 requirement for running Eclipse to use CDE, and mark runtime plugin (and others) as needing 1.5 level |
Marshall Schor |
done |
closed |
Fixed |
UIMA-802 |
CDE is unable to create PEAR descriptor as delegate |
Marshall Schor |
no update needed |
closed |
Fixed |
UIMA-282 |
Work well with Apache logging (Log4J) |
Michael Baessler |
done |
closed |
Fixed |
UIMA-749 |
add performance report to CVD |
Thilo Goetz |
done |
closed |
Fixed |
UIMA framework tests
Component |
Test case |
Description |
Tester |
Platform |
Test level name |
% complete |
Comments |
---|---|---|---|---|---|---|---|
Installation |
UIMA_uimaj_Install_001 |
Installation verification testInstall release package on |
Michael |
Linux |
uimaj-2.2.2-01 |
100% |
|
Installation |
UIMA_uimaj_Install_002 |
Try migration, following documentation and using tool, with existing components |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
Tested with an annotator component |
Installation |
UIMA_uimaj_Install_003 |
Use the UIMA src distribution package, build the source code and run the test cases for all components. Use different JVMs on different plattforms. |
Michael |
Linux |
uimaj-2.2.2-01 |
100% |
Tested with different JVMs v5 and v6 |
CPM |
UIMA_uimaj_CPM_001 |
Running a CPE with AE in Integrated Deployment Mode |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
Tested cpeGUI with examples using different JVMs |
CPM |
UIMA_uimaj_CPM_002 |
Running a CPE with AE in Local Deployment Mode |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
UIMA-904 (won't be fixed) |
CPM |
UIMA_uimaj_CPM_003 |
Running a CPE with AE in Remote Deployment Mode |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
Tested cpeGUI with cpe non-managed example |
CPM |
UIMA_uimaj_CPM_004 |
Runing a CPE with mixed deployment modes |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
UIMA-904 (won't be fixed) |
CPM |
UIMA_uimaj_CPM_005 |
Introduce a TAE that crashes. |
|
Linux |
|
|
|
Core |
UIMA_uimaj_Core_001 |
UIMA remoting with SOAP |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
UIMA-906 (fixed) |
Core |
UIMA_uimaj_Core_002 |
UIMA remoting with Vinci |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
|
Core |
UIMA_uimaj_Core_003 |
Run SofA primitive and aggregate analysis engines, run using CPE |
|
Linux |
|
100% |
all Sofa testing activities are already |
Core |
UIMA_uimaj_Core_004 |
Test CAS multiplier component |
Michael |
Linux |
uimaj-2.2.2-05 |
100% |
Just tested provided UIMA example |
Core |
UIMA_uimaj_Core_005 |
Test UIMA custom flow using the FlowController |
Michael |
Linux |
uimaj-2.2.2-05 |
100% |
Just tested provided UIMA examples |
Core |
UIMA_uimaj_core_006 |
Test UIMA PEAR runtime |
|
Windows |
|
100% |
|
Tooling |
UIMA_uimaj_Tooling_001 |
Test Cas Visual Debugger |
Thilo |
Windows, Linux |
uimaj-2.2.2-04 |
100% |
Found issue with performance report in UIMA core. Will fix later. |
Tooling |
UIMA_uimaj_Tooling_002 |
Test Document Analyzer |
Michael |
Linux |
uimaj-2.2.2-03 |
100% |
UIMA-898 (fixed) |
Tooling |
UIMA_uimaj_Tooling_003 |
Test Pear Installer |
Michael |
Linux |
uimaj-2.2.2-01 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_004 |
Test Pear Merger |
Michael |
Windows |
uimaj-2.2.2-03 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_005 |
Test Annotation Viewer |
Michael |
Windows |
uimaj-2.2.2-03 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_006 |
Test CPE Configurator |
Michael |
Linux |
uimaj-2.2.2-04 |
100% |
I think this is cpeGUI, this was tested when doing the CPM tests above. |
Tooling |
UIMA_uimaj_Tooling_007 |
Test command line pear packager |
Michael |
Linux |
uimaj-2.2.2-01 |
100% |
|
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_001 |
Test CDE (Component Descriptor Editor) |
Marshall |
Eclipse 3.3 |
rc05 |
100% |
|
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_002 |
Test JCasGen generation |
Marshall |
Eclipse 3.3 |
rc05 |
100% |
|
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_003 |
Test Pear packager |
Michael |
Eclipse 3.2 |
uimaj-2.2.2-04 |
100% |
tested on Windows with eclipse 3.2, 3.3 |
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_004 |
Test UIMA Update Site for Eclipse. |
Marshall |
Eclipse 3.2.1 |
|
|
|
Examples |
UIMA_uimaj_Examples_001 |
Test provided UIMA examples |
Jerry Cwiklik |
Linux |
uimaj-2.2.2-03 |
80% |
Tested vinci, soap, most AEs, casMultiplier, FlowControler, Tutorials, CPE, some CasConsumers and CollectionReaders when doing the tests above. |
|
|
|
|
|
|
|
|
Documentation
No special documentation testing/reading for this bugfix release necessary. The important documentation changes are covered by the
JIRA issue documentation review list above.