Estimation of probabilities from sparse data for the language model component of a speech recognizer

1987; Institute of Electrical and Electronics Engineers; Volume: 35; Issue: 3 Linguagem: Inglês

10.1109/tassp.1987.1165125

ISSN

0096-3518

Autores

Slava M. Katz,

Tópico(s)

Natural Language Processing Techniques

Resumo

The description of a novel type of m-gram language model is given. The model offers, via a nonlinear recursive procedure, a computation and space efficient solution to the problem of estimating probabilities from sparse data. This solution compares favorably to other proposed methods. While the method has been developed for and successfully implemented in the IBM Real Time Speech Recognizers, its generality makes it applicable in other areas where the problem of estimating probabilities from sparse data arises.

Referência(s)