Next: Probabilistic Language Models
Up: SEGMENTATION
Previous: Simple Path Example
Although fast and often sufficient, there are problems with the
path approach:
- Rare words: Approach will refuse to find a path with an unknown
word, even if evidence is strong: ``theyattenddookuniversity.''
(Greg
Keim's Segmenter
).
- Competing interpretations: Approach gives no guidance if two
sequence of words are possible, even if one is much more probable.
Guangwei Yuan
12/4/1999