Show simple item record  

dc.contributor.advisorKeegan, Te Taka
dc.contributor.authorCocks, John
dc.date.accessioned2012-07-15T22:44:28Z
dc.date.available2012-07-15T22:44:28Z
dc.date.issued2012
dc.identifier.citationCocks, J. (2012). Diacritic Restoration and the Development of a Part-of-Speech Tagset for the Māori Language (Thesis, Master of Science (MSc)). University of Waikato, Hamilton, New Zealand. Retrieved from https://hdl.handle.net/10289/6483en
dc.identifier.urihttps://hdl.handle.net/10289/6483
dc.description.abstractThis thesis investigates two fundamental problems in natural language processing: diacritic restoration and part-of-speech tagging. Over the past three decades, statistical approaches to diacritic restoration and part-of-speech tagging have grown in interest as a consequence of the increasing availability of manually annotated training data in major languages such as English and French. However, these approaches are not practical for most minority languages, where appropriate training data is either non-existent or not publically available. Furthermore, before developing a part-of-speech tagging system, a suitable tagset is required for that language. In this thesis, we make the following contributions to bridge this gap: Firstly, we propose a method for diacritic restoration based on naive Bayes classifiers that act at word-level. Classifications are based on a rich set of features, extracted automatically from training data in the form of diacritically marked text. This method requires no additional resources, which makes it language independent. The algorithm was evaluated on one language, namely Māori, and an accuracy exceeding 99% was observed. Secondly, we present our work on creating one of the necessary resources for the development of a part-of-speech tagging system in Māori, that of a suitable tagset. The tagset described was developed in accordance with the EAGLES guidelines for morphosyntactic annotation of corpora, and was the result of in-depth analysis of the Māori grammar.
dc.format.mimetypeapplication/pdf
dc.language.isoen
dc.publisherUniversity of Waikato
dc.rightsAll items in Research Commons are provided for private study and research purposes and are protected by copyright with all rights reserved unless otherwise indicated.
dc.subjectMāori
dc.subjectDiacritic Restoration
dc.subjectPart-of-speech Tagset
dc.subjectPart-of-speech tagging
dc.titleDiacritic Restoration and the Development of a Part-of-Speech Tagset for the Māori Languageen
dc.typeThesis
thesis.degree.grantorUniversity of Waikato
thesis.degree.levelMasters
thesis.degree.nameMaster of Science (MSc)
dc.date.updated2012-03-16T00:04:17Z
pubs.place-of-publicationHamilton, New Zealanden_NZ


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record