Test Plan for UIMA Version 2.1
This page documents the planned testing for the 2.1 release.
Test Schedule
Testing is planned starting Jan 22, 2007, for approx. 2-4 weeks.
Date(s) |
Task |
---|---|
January 22 |
Code Freeze, bug fixes only |
February 9 |
End of test, start release vote |
February 12 |
Start vote on general@incubator.a.o |
February 16 |
Target release date |
Test Focus Areas
Suggest drive this using Jira analysis
- Licensing, Notices review
- Integration of Semantic Search
- Install verification for bin on XP and Linux
- Migration of existing UIMA components
Documentation Review
Parcel out documentation for review.
List Jira issues that have corresponding Doc review needs,
built a table of them here and check off as review completed.
Topic |
Description |
Who |
% complete |
Comments |
---|---|---|---|---|
conceptual overview |
|
Ferrucci |
|
|
faqs |
|
Schor |
100% |
Small updates, added hyperlinks |
glossary |
|
Lally |
90% |
Sent email about definitions of UIMA and Apache UIMA |
eclipse setup |
|
Baessler |
100% |
|
|
|
|
|
|
annotator & AE Guide |
|
Lally |
95% |
"Other Examples" section misplaced? |
Artifacts, Sofas |
|
Lally |
100% |
|
application Guide |
|
Lally |
100% |
|
Cas Multiplier |
|
Lally |
100% |
|
CPE |
|
Lally |
100% |
|
Flow Controller |
|
Lally |
100% |
|
Multiple Views |
|
Lally |
100% |
|
XMI Emf |
|
Lally |
100% |
|
|
|
|
|
|
cde |
|
Schor |
100% |
|
cpe Gui |
|
Lally |
100% |
|
CVD |
|
Goetz |
100% |
It's not good, but I'm not willing to spend more time on it right now. |
doc analyzer |
|
Lally |
100% |
|
jcasgen |
|
Schor |
100% |
screen shot replaced |
annotation viewer |
|
Lally |
100% |
|
pear installer |
|
Kozakov |
|
|
pear merger |
|
Kozakov |
|
|
Pear packager |
|
Kozakov |
100% |
|
|
|
|
|
|
cas |
|
Goetz |
100% |
|
jcas |
|
Schor |
100% |
|
pear |
|
Kozakov |
100% |
|
xmi |
|
Lally |
100% |
|
javadocs |
|
Lally |
100% |
|
component Descriptor |
|
Lally |
100% |
|
CPE Descriptor |
|
Cwiklik |
100% |
|
Documentation updates to do keyed to JIRA issues:
% Complete |
Who |
key |
Title |
|
---|---|---|---|---|
|
|
UIMA-220 |
Failure in XCasToCasDataSaxHandlerTest on Sun Java 1.4.2 |
|
|
|
UIMA-217 |
actions creating new instances which are subtypes of AnnotationBase should set the sofa ref |
|
|
|
UIMA-216 |
Add getSupportedXCasVersions to Vinci Services |
|
|
|
UIMA-212 |
Turn on socket keepAlive in jVinci |
|
|
|
UIMA-201 |
Document limitations of XML parser packaged with Sun Java 1.4 |
|
100% |
Schor |
UIMA-184 |
Add getAnnotationIndex() to JCas API, impl via forwarding to CAS |
Fixed many examples in docs |
100% |
Schor |
UIMA-179 |
Need method JFSIndexRepository.getAllIndexedFS(type) |
updated tutorial, JCas and CAS Ref |
100% |
Schor |
UIMA-177 |
JCasGen should notify user when "type merging" has occurred |
Docs updated |
100% |
Schor |
UIMA-173 |
Create Default Bag Indexes when addFsToIndexes is called but no index has been defined for that type |
Docs updated |
|
|
UIMA-171 |
Make CVD look-and-feel configurable |
|
100% |
Schor |
UIMA-166 |
Change JCasGen to not generate DocumentAnnotation if the merged version = the base |
|
100% |
Schor |
UIMA-165 |
Need JCAS fixes for DocumentatAnnotation and type merging |
Done - see UIMA-177 |
100% |
Schor |
UIMA-155 |
add cas editor (tae) project |
Sandbox described, no mention of specific projects |
|
|
UIMA-151 |
Add project for uima whitespace tokenizer implementation |
|
|
|
UIMA-146 |
UimacppAnalysisComponent doesn't support ResultSpecification |
|
|
|
UIMA-135 |
Remove Entity View mode from DocumentAnalyzer |
|
|
|
UIMA-134 |
Extend CasCopier to support multiple views |
|
100% |
Schor |
UIMA-132 |
Provide better support for filenames with spaces in resource URL |
Added Doc on URI, changed sample code to use it |
100% |
Schor |
UIMA-127 |
Add conference/workshop section to web site |
Added section to doc about web site |
100% |
Schor |
UIMA-126 |
add news section to the website |
Added section to doc about web site |
|
|
UIMA-125 |
Apache UIMA client should be able to communicate with IBM UIMA (1.x or 2.0) service |
|
100% |
Schor |
UIMA-122 |
Sofa mapping should be removed from Vinci services |
Scanned the docs, look ok |
|
|
UIMA-120 |
Logical Structure view of CAS: show view name in unexpanded form of CAS |
|
|
|
UIMA-118 |
Link to the UIMA draft specification research report |
|
100% |
Schor |
UIMA-115 |
The TCAS class should be dropped |
scanned docs for TCAS |
|
|
UIMA-112 |
Assembly should unpack into a directory |
|
|
|
UIMA-108 |
Vinci Transport using Binary CAS Serialization is not documented |
|
|
|
UIMA-95 |
add sandbox infrastructure |
|
|
|
UIMA-91 |
Remove/hide CAS Initializer Panel in CPE GUI? |
|
100% |
Schor |
UIMA-90 |
Create eclipse run configurations for startVNS and startVinciService |
updated docs |
100% |
Schor |
UIMA-78 |
CPE descriptor should support URLs to reference components |
Doc updated |
100% |
Schor |
UIMA-77 |
CasToInlineXml fails for new primitive types |
not in main docs |
|
|
UIMA-76 |
add new pear installer API to install a pear file easily out of an application |
|
|
|
UIMA-73 |
multi-threading documentation (tutorial) needs review/improvement |
|
60% |
Schor |
UIMA-71 |
New v2 features missing from tutorial chapters |
Docs updated, no examples updated (yet) |
|
|
UIMA-55 |
Descriptor validation not reporting an error if both configurationParameters and configurationGroups are defined |
|
|
|
UIMA-51 |
Add version number to XCAS (or maybe to CAS built-in typesystem?) |
|
100% |
Lally |
UIMA-49 |
Migration tools from IBM UIMA to Apache UIMA |
Schor checked docs |
|
|
UIMA-38 |
Document Analyzer doesn't provide a way to view feature values that are very long |
|
100% |
Schor |
UIMA-36 |
Change descriptor XML namespaces from uima.watson.ibm.com to uima.apache.org |
checked with scan |
100% |
Schor |
UIMA-34 |
Vinci service deployment descriptor timeoutPeriod parameter does not work. |
removed param from documentation |
|
|
UIMA-33 |
Do not use same timeout on GetMetadata as is used for Process |
|
|
|
UIMA-32 |
CPE GUI doesn't parse CPM_HOME variable |
|
|
|
UIMA-31 |
Document Analyzer doesn't save character encoding in preferences |
|
|
|
UIMA-30 |
Binary CAS Serialization is not documented |
|
100% |
Schor |
UIMA-29 |
Can't call process twice on CPE |
Doc updated |
|
|
UIMA-17 |
Do missing documentation parts |
|
|
|
UIMA-15 |
Semantic Search repackaging |
|
|
|
UIMA-10 |
Split JCas into interface and implementation |
|
100% |
Schor |
UIMA-9 |
Remove support for xi:include |
Test Scenarios, Descriptions, platforms, status
Component |
Description |
Who |
% complete |
Comments (incl platforms |
|||
---|---|---|---|---|---|---|---|
source distr |
See if Source can be built |
Adam |
100% |
uima-2.1.0-RC2 Builds successfully on Windows and Linux. |
|||
bin distr |
See if bin can be used by new user |
|
|
|
|||
semantic search integration |
Verify documentation and operation of semantic search, verify integration |
Adam |
100% |
uimaj-2.1.0-RC2 works with the semantic search pre-release that I have. |
|||
migration tool |
Try migration, following documentation and using tool, with existing components |
all |
|
See UIMA_uimaj_Install_002. Also Marshall and Adam have tested this. |
|||
Component |
Test case |
Description |
Tester |
Platform |
Test level name |
% complete |
Comments |
Installation |
UIMA_uimaj_Install_001 |
Installation verification testInstall release package on |
All |
Windows |
|
|
|
Installation |
UIMA_uimaj_Install_002 |
Try migration, following documentation and using tool, with existing components |
Thilo |
Windows |
uimaj-2.1.0-001 |
100% |
Tested with existing annotator. Worked out of the box. A bit disconcerting as there is no feedback at all. See Marshall's Jira issue on that point. |
CPM |
UIMA_uimaj_CPM_001 |
Running a CPE with TAE in Local Deployment Mode |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
CPM |
UIMA_uimaj_CPM_002 |
Running a CPE with TAE in Remote Deployment Mode |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
CPM |
UIMA_uimaj_CPM_003 |
Runing a CPE with mixed deployment modes |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
CPM |
UIMA_uimaj_CPM_004 |
Introduce a TAE that crashes. |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
Core |
UIMA_uimaj_Core_001 |
UIMA remoting with SOAP |
Michael |
Windows |
uimaj-2.1.0-002 |
100% |
Adam: also ran simple SOAP service test on Windows, no problems. |
Core |
UIMA_uimaj_Core_002 |
UIMA remoting with Vinci |
Michael |
Windows |
uimaj-2.1.0-001 |
100% |
Tested provided SDK samples von Windows and Linux |
Core |
UIMA_uimaj_Core_003 |
Run SofA primitive and aggregate analysis engines, run using CPE |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
Core |
UIMA_uimaj_Core_004 |
Test CAS multiplier component |
Michael |
Windows |
uimaj-2.1.0-004 |
100% |
Tested provided samples with DocumentAnalyzer. |
Core |
UIMA_uimaj_Core_005 |
Test UIMA custom flow using the FlowController |
Michael |
Windows |
uimaj-2.1.0-002 |
100% |
Tested eclipse plugin to create a FlowController. |
Tooling |
UIMA_uimaj_Tooling_001 |
Test Cas Visual Debugger |
Thilo |
Windows |
uimaj-2.1.0-001 |
100% |
Put the CVD through its paces on Windows. Everything worked except displaying manual. Should be tested on other platform. |
Tooling |
UIMA_uimaj_Tooling_002 |
Test Document Analyzer |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_003 |
Test Pear Installer |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
Opened trivial UI issues UIMA-270 and UIMA-271 |
Tooling |
UIMA_uimaj_Tooling_004 |
Test Pear Merger |
Michael |
Windows |
uimaj-2.1.0-004 |
100% |
Tested the merging of two pear files and run it afterwards. |
Tooling |
UIMA_uimaj_Tooling_005 |
Test Annotation Viewer |
Michael |
Windows |
uimaj-2.1.0-003 |
100% |
|
Tooling |
UIMA_uimaj_Tooling_006 |
Test CPE Configurator |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
|
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_001 |
Test CDE (Component Descriptor Editor) |
Schor |
Eclipse versions? |
various |
50% |
Extensive running on WinXP and MacOS X, used in tutorial |
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_002 |
Test JCasGen generation |
Schor |
Eclispe versions? |
various |
50% |
Extensive running on WinXP and MacOS X, used in tutorial |
EclipsePlugins |
UIMA_uimaj_EclipsePlugins_003 |
Test Pear packager |
Michael |
Windows |
uimaj-2.1.0-003 |
100% |
Adam: Ran it once (Windows, Eclipse 3.2.0) Seemed to work fine. |
Examples |
UIMA_uimaj_Examples_001 |
Test provided UIMA examples |
Adam |
Windows |
uimaj-2.1.0-RC2 |
100% |
Tested UimaMeetingDetector, NamesAndPersonTitles, NamesAndGovernmentOfficials as part of Document Analyzer testing. Tested SofaExampleAnnotator as part of Sofa testing. Tested Flow Controller and CAS Multiplier Examples (also earlier tested by Michael). Tested CPE Descriptors. |