Segmentation Algorithms

The input text given to algorithms is assumed to be prepared as a suite of space separated tokens, one utterance per line (see Data Preparation).

The following word segmentation algorithms are provided with wordseg:

• Random Baseline
• Adaptor Grammar
• Diphone Based Segmenter
• Bayesian Segmenter
• Puddle Segmenter
• Transitional Probabilities