Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

End-of-line characters are considered end-of-sentence markers. Hyphenated words that appear in the hyphenated words list with frequency values greater than the FreqCutoff will be considered one token. Refer to the Context Dependent Tokenizer.

A sentence detector model is included with this project.

...