Adaptive models of English text

Teahan, W.J.; Cleary, John G.

Files

uow-cs-wp-1997-30.pdf

4.203Mb

Citation

Export citation

Teahan, W.J. & Cleary, J.G. (1997). Adaptive models of English text. (Working paper 97/30). Hamilton, New Zealand: University of Waikato, Department of Computer Science.

Permanent Research Commons link: https://hdl.handle.net/10289/1126

Abstract

High quality models of English text with performance approaching that of humans is important for many applications including spelling correction, speech recognition, OCR, and encryption. A number of different statistical models of English are compared with each other and with previous estimates from human subjects. It is concluded that the best current models are word based with part of speech tags. Given sufficient training text, they are able to attain performance comparable to humans.

Date

1997-11

Type

Working Paper

Series

Computer Science Working Papers

Report No.

97/30

Publisher

Department of Computer Science, The University of Waikato

Collections

1997 Working Papers [31]