Repository logo
 

Consistent hidden Markov models

dc.contributor.authorNarayana Rao Gari, Pradyumna Kumar, author
dc.contributor.authorDraper, Bruce A., advisor
dc.contributor.authorBeveridge, Ross, committee member
dc.contributor.authorPeterson, Chris, committee member
dc.date.accessioned2007-01-03T06:23:21Z
dc.date.available2007-01-03T06:23:21Z
dc.date.issued2014
dc.description.abstractActivity recognition in Computer Vision involves recognizing the appearance of an object of interest along with its action, and its relation to the scene or other important objects. There exist many methods that give this information about an object. However, these methods are noisy and are independent of each other. So, the mutual information between the labels is lost. For example, an object might be predicted to be a tree, whereas its action might be predicted as walk. But, trees can't walk. However, the compositional structure of the events is reflected by the compositional structure of natural language. The object of interest is the predicate, usually a noun, the action is the verb, and its relation to the scene may be a preposition or adverb. The lost mutual information that says that trees can't walk is present in natural language. The contribution of this thesis is a method of visual information fusion based on exploiting the mutual information from Natural language databases. Although Hidden Markov Models (HMM) are the traditional way to smooth noisy stream of data by integrating information across time, they can't account for the lost mutual information. This thesis proposes an extension to HMM (Consistent HMM) that can integrate visual information to the lost mutual information by exploiting the knowledge from language databases. Consistent HMM performs better than other state of the art HMMs on synthetic data generated to simulate the real world behavior. Although the performance gain of integrating the knowledge from language databases both during training phase and run-time is better, when considered individually, the performance gain is more when the knowledge is integrated during run-time than training.
dc.format.mediumborn digital
dc.format.mediummasters theses
dc.identifierNarayanaRaoGari_colostate_0053N_12802.pdf
dc.identifier.urihttp://hdl.handle.net/10217/88582
dc.languageEnglish
dc.language.isoeng
dc.publisherColorado State University. Libraries
dc.relation.ispartof2000-2019
dc.rightsCopyright and other restrictions may apply. User is responsible for compliance with all applicable laws. For information about copyright law, please see https://libguides.colostate.edu/copyright.
dc.subjectcomputer vision
dc.subjecthidden Markov models
dc.subjectinteracting hidden Markov models
dc.subjectnatural language
dc.subjectontology
dc.subjectvideo activity recognition
dc.titleConsistent hidden Markov models
dc.typeText
dcterms.rights.dplaThis Item is protected by copyright and/or related rights (https://rightsstatements.org/vocab/InC/1.0/). You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s).
thesis.degree.disciplineComputer Science
thesis.degree.grantorColorado State University
thesis.degree.levelMasters
thesis.degree.nameMaster of Science (M.S.)

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
NarayanaRaoGari_colostate_0053N_12802.pdf
Size:
6.75 MB
Format:
Adobe Portable Document Format
Description: