Revealing and analyzing the shared structure of deep face embeddings
| dc.contributor.author | McNeely-White, David G., author | |
| dc.contributor.author | Beveridge, J. Ross, advisor | |
| dc.contributor.author | Blanchard, Nathaniel, committee member | |
| dc.contributor.author | Kirby, Michael, committee member | |
| dc.contributor.author | Peterson, Chris, committee member | |
| dc.date.accessioned | 2022-08-29T10:17:02Z | |
| dc.date.available | 2022-08-29T10:17:02Z | |
| dc.date.issued | 2022 | |
| dc.description.abstract | Deep convolutional neural networks trained for face recognition are found to output face embeddings which share a fundamental structure. More specifically, one face verification model's embeddings (i.e. last--layer activations) can be compared directly to another model's embeddings after only a rotation or linear transformation, with little performance penalty. If only rotation is required to convert the bulk of embeddings between models, there is a strong sense in which those models are learning the same thing. In the most recent experiments, the structural similarity (and dissimilarity) of face embeddings is analyzed as a means of understanding face recognition bias. Bias has been identified in many face recognition models, often analyzed using distance measures between pairs of faces. By representing groups of faces as groups, and comparing them as groups, this shared embedding structure can be further understood. Specifically, demographic-specific subspaces are represented as points on a Grassmann manifold. Across 10 models, the geodesic distances between those points are expressive of demographic differences. By comparing how different groups of people are represented in the structure of embedding space, and how those structures vary with model designs, a new perspective on both representational similarity and face recognition bias is offered. | |
| dc.format.medium | born digital | |
| dc.format.medium | doctoral dissertations | |
| dc.identifier | White_colostate_0053A_17238.pdf | |
| dc.identifier.uri | https://hdl.handle.net/10217/235674 | |
| dc.language | English | |
| dc.language.iso | eng | |
| dc.publisher | Colorado State University. Libraries | |
| dc.relation.ispartof | 2020- | |
| dc.rights.license | This material is open access and distributed under the terms and conditions of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 United States License. (https://creativecommons.org/licenses/by-nc-nd/4.0). | |
| dc.rights.uri | https://creativecommons.org/licenses/by-nc-nd/4.0 | |
| dc.subject | face recognition | |
| dc.subject | representational similarity | |
| dc.subject | Grassmann | |
| dc.subject | bias in face recognition | |
| dc.title | Revealing and analyzing the shared structure of deep face embeddings | |
| dc.type | Text | |
| dcterms.rights.dpla | This Item is protected by copyright and/or related rights (https://rightsstatements.org/vocab/InC/1.0/). You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). | |
| thesis.degree.discipline | Computer Science | |
| thesis.degree.grantor | Colorado State University | |
| thesis.degree.level | Doctoral | |
| thesis.degree.name | Doctor of Philosophy (Ph.D.) |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- White_colostate_0053A_17238.pdf
- Size:
- 6.12 MB
- Format:
- Adobe Portable Document Format
- Description: