Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Component

Model

Perf 1.5.1

Perf 1.5.2

Tester

Passed

Comment

Sentence Detector

en-sent.bin

42186.7 sent/s

 

joern

 

 

Tokenizer

en-token.bin

3091.8 sent/s

 

joern

 

 

Name Finder

en-ner-person.bin

487.1 sent/s

 

joern

 

 

POS Tagger

en-pos-maxent.bin

732.1 sent/s

 

joern

 

 

POS Tagger

en-pos-perceptron.bin

1110.6 sent/s

 

joern

 

 

Chunker

en-chunker.bin

167,3 sent/s

 

colen  

 

computerB, tested with CONLL2000 (2012 sentences)  

Parser

en-parser-chunking.bin

11.6 sent/s

 

joern

 

 

...

Component

Data

Tester

Tagging Perf 1.5.1

Tagging Perf 1.5.2

Comment

Sentence Detector

 

joern  

 

 

Will not be done in this release.  

Tokenizer

 

joern  

 

 

We need a de-tokenizer dictionary first, will be done in next release.  

Name Finder

CONLL 2002 Dutch Person ned.testa joern


Precision: 0.7906976744186046
Recall: 0.48364153627311524 
F-Measure: 0.6001765225066196

 

 

Name Finder

CONLL 2002 Dutch Person ned.testb

joern  

Precision: 0.8527980535279805
Recall: 0.6384335154826958 
F-Measure: 0.7302083333333333

 

 

Name Finder

CONLL 2002 Dutch Organization ned.testa

joern  

Precision: 0.8386075949367089
Recall: 0.38629737609329445 
F-Measure: 0.5289421157684631

 

 

Name Finder

CONLL 2002 Dutch Organization ned.testb

joern  

Precision: 0.7784200385356455
Recall: 0.4580498866213152 
F-Measure: 0.5767309064953604

 

 

Name Finder

CONLL 2002 Dutch Location ned.testa

joern  

Precision: 0.8362831858407079
Recall: 0.3945720250521921 
F-Measure: 0.5361702127659574

 

 

Name Finder

CONLL 2002 Dutch Location ned.testb

joern  

Precision: 0.854251012145749 
Recall: 0.5452196382428941 
F-Measure: 0.665615141955836

 

 

Name Finder

CONLL 2002 Dutch Misc ned.testa

joern  

Precision: 0.8300492610837439
Recall: 0.4505347593582888 
F-Measure: 0.5840554592720971

 

 

Name Finder

CONLL 2002 Dutch Misc ned.testb

joern  

Precision: 0.8373205741626795
Recall: 0.44229149115417016 
F-Measure: 0.5788313120176405

 

 

Name Finder

CONLL 2002 Combined ned.testa

joern  

Precision: 0.7906976744186046
Recall: 0.48364153627311524 
F-Measure: 0.6001765225066196


 

Name Finder

CONLL 2002 Dutch Combined ned.testb

joern  

Precision: 0.8527980535279805
Recall: 0.6384335154826958 
F-Measure: 0.7302083333333333

 

 

Name Finder

CONLL 2002 Spanish Person esp.testa

joern  

Precision: 0.8982630272952854
Recall: 0.5924713584288053 
F-Measure: 0.7140039447731755


 

Name Finder

CONLL 2002 Spanish Person esp.testb

joern  

Precision: 0.9008 
Recall: 0.7659863945578231 
F-Measure: 0.8279411764705882


 

Name Finder

CONLL 2002 Spanish Organization esp.testa

joern


Precision: 0.8216258879242304
Recall: 0.6123529411764705 
F-Measure: 0.7017189079878665


 

Name Finder

CONLL 2002 Spanish Organization esp.testb

joern


Precision: 0.8009331259720062
Recall: 0.7357142857142858  
F-Measure: 0.7669396872673119

 

 

Name Finder

CONLL 2002 Spanish Location esp.testa

joern


Precision: 0.7481789802289281
Recall: 0.7306910569105691 
F-Measure: 0.739331619537275


 

Name Finder

CONLL 2002 Spanish Location esp.testb

joern


Precision: 0.8226221079691517
Recall: 0.5904059040590406 
F-Measure: 0.6874328678839956


 

Name Finder

CONLL 2002 Spanish Misc esp.testa

joern


Precision: 0.6446886446886447
Recall: 0.3955056179775281 
F-Measure: 0.49025069637883006


 

Name Finder

CONLL 2002 Spanish Misc esp.testb
joern


Precision: 0.6595744680851063
Recall: 0.36578171091445427 
F-Measure: 0.4705882352941176


 

Name Finder

CONLL 2002 Spanish Combined esp.testa
joern


Precision: 0.8982630272952854  
Recall: 0.5924713584288053 
F-Measure: 0.7140039447731755


 

Name Finder

CONLL 2002 Spanish Combined esp.testb

joern


Precision: 0.9008 
Recall: 0.7659863945578231 
F-Measure: 0.8279411764705882


 

Name Finder

CONLL 2003 English Person eng.testa

jkosin  

Precision: 0.9352201257861635
Recall: 0.8072747014115093 
F-Measure: 0.8665501165501166

 

 

Name Finder

CONLL 2003 English Person eng.testb

jkosin  

Precision: 0.8873546511627907
Recall: 0.7551020408163265 
F-Measure: 0.8159037754761109

 

 

Name Finder

CONLL 2003 English Organization eng.testa

jkosin  

Precision: 0.8528584817244611
Recall: 0.6785980611483967 
F-Measure: 0.7558139534883722

 

 

Name Finder

CONLL 2003 English Organization eng.testb

jkosin  

Precision: 0.8263422818791947
Recall: 0.5930162552679109 
F-Measure: 0.6905012267788293


 

Name Finder

CONLL 2003 English Location eng.testa

jkosin  

Precision: 0.9283837056504599
Recall: 0.769188894937398 
F-Measure: 0.8413218219708247

 

 

Name Finder

CONLL 2003 English Location eng.testb

jkosin  

Precision: 0.9156180606957809
Recall: 0.7416067146282974 
F-Measure: 0.8194766478966545

 

 

Name Finder

CONLL 2003 English Misc eng.testa

jkosin  

Precision: 0.8539007092198582
Recall: 0.6529284164859002 
F-Measure: 0.7400122925629993

 

 

Name Finder

CONLL 2003 English Misc eng.testb

jkosin  

Precision: 0.8599137931034483
Recall: 0.5683760683760684 
F-Measure: 0.6843910806174958

 

 

Name Finder

CONLL 2003 English Combined eng.testa

jkosin  

Precision: 0.8601818493738206
Recall: 0.8438236284079434 
F-Measure: 0.8519242205420101

 

1000 iterations

Name Finder

CONLL 2003 English Combined eng.testb

jkosin  

Precision: 0.8036415565869333
Recall: 0.7970963172804533 
F-Measure: 0.8003555555555556

 

1000 iterations

Name Finder

CONLL 2003 German Person deu.testa

joern  

Precision: 0.8602620087336245
Recall: 0.28122769450392576 
F-Measure: 0.4238838084991931

 

 

Name Finder

CONLL 2003 German Person deu.testb

joern  

Precision: 0.878 
Recall: 0.3673640167364017 
F-Measure: 0.5179941002949853

 

 

Name Finder

CONLL 2003 German Organization deu.testa

joern  

Precision: 0.8365695792880259
Recall: 0.41659951651893634 
F-Measure: 0.5562130177514794

 

 

Name Finder

CONLL 2003 German Organization deu.testb

joern  

Precision: 0.7942583732057417
Recall: 0.4294954721862872 
F-Measure: 0.5575146935348446

 

 

Name Finder

CONLL 2003 German Location deu.testa

joern  

Precision: 0.7362637362637363
Recall: 0.34038950042337 
F-Measure: 0.4655471916618414

 

 

Name Finder

CONLL 2003 German Location deu.testb

joern  

Precision: 0.75 
Recall: 0.3652173913043478 
F-Measure: 0.4912280701754385

 

 

Name Finder

CONLL 2003 German Misc deu.testa

joern  

Precision: 0.7213930348258707
Recall: 0.14356435643564355 
F-Measure: 0.2394715111478117

 

 

Name Finder

CONLL 2003 German Misc deu.testb

joern  

Precision: 0.6198830409356725
Recall: 0.1582089552238806 
F-Measure: 0.2520808561236623

 

 

Name Finder

CONLL 2003 German Combined deu.testa

joern  

Precision: 0.7675205413243112
Recall: 0.32857438444030623 
F-Measure: 0.46015647638365687

 

 

Name Finder

CONLL 2003 German Combined deu.testb

joern  

Precision: 0.7553418803418803
Recall: 0.3849714130138851 
F-Measure: 0.5100090171325519

 

 

POS Tagger

CONLL 2006 Danish

joern  

Accuracy: 0.9511278195488722

 

 

POS Tagger

CONLL 2006 Dutch

joern  

Accuracy: 0.9324977618621307

 

 

POS Tagger

CONLL 2006 Portuguese

joern  

Accuracy: 0.9659110277825124

 

 

POS Tagger

CONLL 2006 Swedish

joern  

Accuracy: 0.9275106082036775

 

 

Chunker

CONLL 2000

colen  

Precision: 0.9255923572240226
Recall: 0.9220610430991112 
F-Measure: 0.9238233255623465

 

 

Chunker

Arvores Deitadas

colen  

Precision: 0.9406086044071353
Recall: 0.9364814040952779 
F-Measure: 0.9385404669668097

 

 

...

Analysis Engine

Tester

Passed

Comment

Sentence Detector

joern  

 

 

Sentence Detector Trainer

Tommaso  

 

Trained and tested with cmd line tool

Tokenizer ME

joern  

 

 

Tokenizer Trainer

Tommaso  

 

Trained and tested with cmd line tool

Name Finder

joern  

 

 

Name Finder Trainer

Tommaso  

 

Trained and tested with cmd line tool

Chunker

joern  

 

as part of sample pear

Chunker Trainer

 

 

 

POS Tagger

joern  

 

as part of sample pear

POS Tagger Trainer

Tommaso  

 

Trained and tested with cmd line tool

Parser

 

 

 

createPear.sh

joern  

 

 

Sample PEAR

joern  

 

installed and run over sample text

...