The following table is intended to list different test phases and the corresponding frequency, method and coverage with them
Testing Process
Test Phase | Frequency | Method | Coverage |
---|---|---|---|
BVT (Build Verification Test) | Weekly | Automated | Basic operations in Writer, Calc and Impress |
FVT (Function Verification Test) | AOO 4.1 development phase | Manual | 1. Basic, advanced, complicated operations in Writer, Calc and Impress, including features in 4.1 Proposed Release Contents in AOO 4.1 Release Planning 2. Impact area testing by changes/fixes made |
Full Pass Regression | AOO 4.1 after Beta release | Manual | 1. Basic, advanced operations in Writer, Calc and Impress, including features in 4.1 Proposed Release Contents in AOO 4.1 Release Planning 2. Impact area testing by changes/fixes made |
Final Regression | Merged with FPR | Manual | Ditto |
RC Acceptance Test | AOO 4.1 after RC release | Manual | 1. Basic operations in Writer, Calc and Impress |
PVT | Monthly | Automated | 1. Basic operation like new/load/save/close in Writer, Calc and Impress, to collect the consumed time/memory/handle 2. GUI source code from our subversion repository: https://svn.apache.org/repos/asf/openoffice/trunk/test/ |
AVT | AOO 4.1 development phase | Automate/Manual | Compliance with ACC checklist (IBM software accessibility checklist) |
The following table list the test platforms and the coverage rate in different test phases
Testing Platforms
Platform | Coverage (FVT) | Coverage (FPR, FR and RCAT) | Coverage (PVT) |
---|---|---|---|
Windows 7 | 25% | 15% | 100% |
Windows 8 | 25% | 15% | |
Redhat Linux 32bit | 10% | 5% | |
Redhat Linux 64bit | 30% | 20% | |
Ubuntu Linux 64bit | 30% | 20% | 100% |
Mac OS X 10.8/10.9 | 30% | 25% | |
Total | 150% | 100% | 100% + |
The following table is intended to collect and document testing to new features, enhancements or other working areas related to the AOO 4.1 release testing
The status can be tracked highlevel for example by using the colors ok/done, in progress and open/missing .
More detailed testing material(test scenarios / steps) can be found in Testlink, defects found during testing can be found in Bugzilla
Testing Contents
Item | Feature/Enhancement | Testing way | Volunteer(s) | Status | Comment |
---|---|---|---|---|---|
Accessibility support (iAccessibiltiy2 support to improve the usability) | New Feature | Test with ACC checklist based on BVT scenarios Create and execute test cases in Teslink, | Liu Ping Tan | Done | |
Patch Mechanism in Windows | New Feature |
|
|
|
|
AOO Security Features without Mozilla |
|
|
|
| |
Icon update |
| https://cwiki.apache.org/confluence/display/OOOUSERS/AOO4.1+-+Desktop+Icons |
|
|
|
In-place editing of Input Fields |
| I am working on a solution for issue 33737 [1] and I am making good progress. | Liu Ping Tan | ||
Integrating OOXML enhancement from the OSBA patch | New Feature |
|
|
| |
use case 4 - comments/annotations on text ranges | In Progress | ||||
genLang / New translation workflow |
| No test from QA |
|
|
|
build.pl / central Makefile instead of build.pl |
| No test from QA |
|
|
|
Mac / 64bit OSX Support |
|
|
|
| |
new MacOS Mavericks OS Support |
| Repeat basic functional test |
| Done |
|
Existing functions in 3 Apps | Legacy Feature | Execute test cases in Teslink, | In Progress |