How to Run tika-eval
...
-app on the VM
While users can run tika-eval-app on their own machines with their own documents, the Apache Tika, Apache PDFBox and Apache POI communities have gathered >1TB of documents from govdocs1 and from Common Crawl to serve as a regression testing corpus. Before a release, we'll run the last release against the candidate release to identify potential regressions.
This page is intended for committers/PMC members with access to the VM who want to run the regression tests. The example focuses on testing a SNAPSHOT version of PDFBox, but the steps are nearly identical for the full Tika eval or for sub projects. See TikaEval for more information on the tika-eval-app
module by itself. See this blog for a description of running this project on the Rackspace Tika's VM.
The driver appBatchExecutor.sh
, the various configuration files and the file lists for PDFs are all available here: batch-scripts.tgz.
...
- Clean up from any previous runs
- Remove tika-app-X-Y.jar from /data1/tools/tika/batch/bin – make sure to leave in the other "optional" jars:
jai-imageio-jpeg2000-1.34.0.jar, sqlite-jdbc-3.3243.32.21.jar and zstd-jni-1.45.5-6.jar
- Remove or rename
/data1/tools/tika/batch/logs
- Remove or rename
/data1/tools/tika/batch/nohup.out
- Remove tika-app-X-Y.jar from /data1/tools/tika/batch/bin – make sure to leave in the other "optional" jars:
- Run the current "A" version
- Place the "A" version of tika-app-X.Y.jar in
/data1/tools/tika/batch/bin
- Modify
appBatchExecutor.sh
to- put the output in a new output directory
-o /data1/extracts/pdfboxA
- if using a file list, confirm that the correct file list is specified
-fileList fileLists/ccAndBugTracker_pdfs.txt
- put the output in a new output directory
- Execute:
nohup ./appBatchExecutor.sh &
- Wait for the "A" version to complete before starting the "B" version
- Place the "A" version of tika-app-X.Y.jar in
- Build and run the "B" version
- Update PDFBox from SVN,
mvn clean install
- Update the PDFBox, Fontbox and jbig2-imageio versions in the Tika project tika-parsers/pom.xml
- Run
mvn clean
on the whole Tika project and make sure that your IDE has picked up the changes - Run the PDFParser tests in tika-parsers/src/test/java/o.a.t.parsers.pdf.* to make sure that at least the Tika unit tests work.
- Build the entire Tika project (even though you'll only use tika-app.jar):
mvn clean install
- On the VM, remove the tika.app-A.jar from
/data1/tools/tika/batch/bin
, rename the existingnohup.out
tonohup-A.out
, renamelogs/
tologs-A/
- Drop the new tika-app-B.jar into (you guessed it!):
/data1/tools/tika/batch/bin
- Modify
appBatchExecutor.sh
to- put the output in a new output directory
-o /data1/extracts/pdfboxB
- if using a file list, confirm that the correct file list is specified
-fileList fileLists/ccAndBugTracker_pdfs.txt
- put the output in a new output directory
- Execute:
nohup ./appBatchExecutor.sh &
- Wait for the "B" version to complete before starting the comparisons and reports
- Update PDFBox from SVN,
- Make the comparisons and report
- In
/data1/tools/tika/eval
, remove the existing db filepdfboxAvsB.mv.db
if you don't want to rename it. nohup java -jar tika-eval-app-X.Y.jar Compare -extractsA /data1/extracts/pdfboxA -extractsB /data1/extracts/pdfboxB -db pdfboxAvsB&
- When that completes,
- Remove any files left over from the last run in
reports/
:rm -r reports
- Write the reports
java -Djava.io.tmpdir=tmp -jar tika-eval-app-X.Y.jar Report -db pdfboxAvsB
– Note the -Djava.io.tmpdir=tmp – need to set the tmp directory to something writeable by 'collab'
- Remove any files left over from the last run in
- In
...