<link rel="stylesheet" href="styles.cf390c6bfbe7555f.css">

Text categorization using compression models

dc.contributor.authorFrank, Eibeen_NZ
dc.contributor.authorChui, Changen_NZ
dc.contributor.authorWitten, Ian H.en_NZ
dc.contributor.editorStorer, JAen_NZ
dc.contributor.editorCohn, Men_NZ
dc.coverage.spatialConference held at Snowbird, Utahen_NZ
dc.date.accessioned2024-01-24T03:32:02Z
dc.date.available2024-01-24T03:32:02Z
dc.date.issued2000-03en_NZ
dc.description.abstractSummary form only given. Test categorization is the assignment of natural language texts to predefined categories based on their concept. The use of predefined categories implies a "supervised learning" approach to categorization, where already-classified articles which effectively define the categories are used as "training data" to build a model that can be used for classifying new articles that comprise "the data". Typical approaches extract features from articles and use the feature vectors as input to a machine learning scheme that learns how to classify articles. The features are generally words. It has often been observed that compression seems to provide a very promising alternative approach to categorization. The overall compression of an article with respect to different models can be compared to see which one it fits most closely. Such a scheme has several potential advantages: it yields an overall judgement on the document as a whole, rather than discarding information by pre-selecting features it avoids the messy and rather artificial problem of defining word boundaries; it deals uniformly with morphological variants of words; depending on the model (and its order), it can take account of phrasal effects that span word boundaries; it offers a uniform way of dealing with different types of documents for example, arbitrary files in a computer system; it generally minimizes arbitrary decisions that inevitably need to be taken to render any learning scheme practical.
dc.format.mimetypeapplication/pdf
dc.identifier.doi10.1109/DCC.2000.838202en_NZ
dc.identifier.urihttps://hdl.handle.net/10289/16390
dc.language.isoen
dc.publisherIEEEen_NZ
dc.relation.isPartOfProc Data Compression Conferenceen_NZ
dc.rightsThis is an author’s accepted version of a conference paper published in: Proc Data Compression Conference. © 2000 IEEE.
dc.sourceDCC 2000en_NZ
dc.titleText categorization using compression modelsen_NZ
dc.typeConference Contribution
dspace.entity.typePublication
pubs.begin-page555
pubs.end-page555
pubs.finish-date2000-03-30en_NZ
pubs.start-date2000-03-28en_NZ

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Frank_categorization.pdf
Size:
23.29 KB
Format:
Adobe Portable Document Format
Description:
Accepted version

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Research Commons Deposit Agreement 2017.pdf
Size:
188.11 KB
Format:
Adobe Portable Document Format
Description: