EgoRoom: egocentric 3D pose estimation through multi-coordinates heatmaps
| dc.contributor.author | Jung, Changsoo, author | |
| dc.contributor.author | Blanchard, Nathaniel, advisor | |
| dc.contributor.author | Beveridge, Ross, committee member | |
| dc.contributor.author | Clegg, Benjamin, committee member | |
| dc.date.accessioned | 2022-08-29T10:15:44Z | |
| dc.date.available | 2024-08-22T10:15:44Z | |
| dc.date.issued | 2022 | |
| dc.description.abstract | Recent head-mounted virtual reality (VR) devices include fisheye lenses oriented to users' bodies, which enable full body pose estimation from video. However, traditional joint detection methods fail under this use case because fisheye lenses make joint depth information ambiguous, causing body parts to be self-occluded by the distorted torso. To resolve these problems, we propose a novel architecture, EgoRoom, that uses three different types of heatmaps in 3D to predict body joints, even if they are self-occluded. Our approach consists of three main modules. The first module transmutes the fisheye image into feature embeddings via an attention mechanism. Then, the second module utilizes three decoder branches to convert those features into a 3D coordinate system, with each branch corresponding to the xy, yz, and xz planes. Finally, the third module combines the three decoder heatmaps into the predicted 3D pose. Our method achieves state-of-the-art results on the xR-EgoPose dataset. | |
| dc.format.medium | born digital | |
| dc.format.medium | masters theses | |
| dc.identifier | Jung_colostate_0053N_17227.pdf | |
| dc.identifier.uri | https://hdl.handle.net/10217/235557 | |
| dc.language | English | |
| dc.language.iso | eng | |
| dc.publisher | Colorado State University. Libraries | |
| dc.relation.ispartof | 2020- | |
| dc.rights | Copyright and other restrictions may apply. User is responsible for compliance with all applicable laws. For information about copyright law, please see https://libguides.colostate.edu/copyright. | |
| dc.rights.access | Embargo Expires: 08/22/2024 | |
| dc.subject | joint tracking | |
| dc.subject | egocentric pose estimation | |
| dc.subject | XR | |
| dc.title | EgoRoom: egocentric 3D pose estimation through multi-coordinates heatmaps | |
| dc.type | Text | |
| dcterms.embargo.expires | 2024-08-22 | |
| dcterms.embargo.terms | 2024-08-22 | |
| dcterms.rights.dpla | This Item is protected by copyright and/or related rights (https://rightsstatements.org/vocab/InC/1.0/). You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). | |
| thesis.degree.discipline | Computer Science | |
| thesis.degree.grantor | Colorado State University | |
| thesis.degree.level | Masters | |
| thesis.degree.name | Master of Science (M.S.) |
Files
Original bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- Jung_colostate_0053N_17227.pdf
- Size:
- 692.03 KB
- Format:
- Adobe Portable Document Format