Repository logo

Consistent hidden Markov models

dc.contributor.authorNarayana Rao Gari, Pradyumna Kumar, author
dc.contributor.authorDraper, Bruce A., advisor
dc.contributor.authorBeveridge, Ross, committee member
dc.contributor.authorPeterson, Chris, committee member
dc.description.abstractActivity recognition in Computer Vision involves recognizing the appearance of an object of interest along with its action, and its relation to the scene or other important objects. There exist many methods that give this information about an object. However, these methods are noisy and are independent of each other. So, the mutual information between the labels is lost. For example, an object might be predicted to be a tree, whereas its action might be predicted as walk. But, trees can't walk. However, the compositional structure of the events is reflected by the compositional structure of natural language. The object of interest is the predicate, usually a noun, the action is the verb, and its relation to the scene may be a preposition or adverb. The lost mutual information that says that trees can't walk is present in natural language. The contribution of this thesis is a method of visual information fusion based on exploiting the mutual information from Natural language databases. Although Hidden Markov Models (HMM) are the traditional way to smooth noisy stream of data by integrating information across time, they can't account for the lost mutual information. This thesis proposes an extension to HMM (Consistent HMM) that can integrate visual information to the lost mutual information by exploiting the knowledge from language databases. Consistent HMM performs better than other state of the art HMMs on synthetic data generated to simulate the real world behavior. Although the performance gain of integrating the knowledge from language databases both during training phase and run-time is better, when considered individually, the performance gain is more when the knowledge is integrated during run-time than training.
dc.format.mediumborn digital
dc.format.mediummasters theses
dc.publisherColorado State University. Libraries
dc.rightsCopyright and other restrictions may apply. User is responsible for compliance with all applicable laws. For information about copyright law, please see
dc.subjectcomputer vision
dc.subjecthidden Markov models
dc.subjectinteracting hidden Markov models
dc.subjectnatural language
dc.subjectvideo activity recognition
dc.titleConsistent hidden Markov models
dcterms.rights.dplaThis Item is protected by copyright and/or related rights ( You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). Science State University of Science (M.S.)


Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
6.75 MB
Adobe Portable Document Format