Successful process evaluation provides insight into team development and goal attainment: science of team science
Date
2019
Authors
Love, Hannah
Fosdick, Bailey
Cross, Jeni
Fisher, Ellen
Suter, Meghan
Egan, Dinaida
Journal Title
Journal ISSN
Volume Title
Abstract
The Science of Team Science (SciTS) emerged as a field of study because scientists are increasingly charged with solving complex and large-scale societal, health, and environmental challenges. The SciTS field seeks to develop both methods for assessing teams and a knowledge base of effective practices in team science. What makes interdisciplinary scientific teams successful? Many early studies of team science success drew on existing data like bibliometrics and patent applications to examine the patterns of successful teams. However, these metrics have several shortcomings: they can only be used to characterize teams that were successful enough to produce publications, patents or grant proposals; and their creation lags years behind team formation. Studies which rely exclusively on existing data are not able explain the differences between successful and unsuccessful teams in their formation, interaction, and development. This study asks the questions: "How are team processes and interactions related to goal accomplishment in transdisciplinary teams? Can process metrics be used to predict team success and team outcomes?" This study aims to fill the gap in SciTS literature by longitudinally observing eight scientific transdisciplinary teams and correlating process metrics to outcome metrics. From 2015 through 2017, we used participant observation, informal interviews, turn-taking assessments, and social network surveys to follow teams through their first two years of formation. We then examined which metrics of team interaction and team processes are correlated with traditional team-defined outcome metrics such as conference presentations, grant proposals, journal articles, and invention disclosures. We found that the strength of relationships, role of women, and even participation were the biggest predictors of team success. We discuss how process evaluation can be used to assess team success in the early stages of team development and which measures are more strongly associated with team success.
Description
Data set includes three components: 1. Social network data; 2. Turn-taking Data; 3. Outcome Metrics. See Readme Files for more details.
Department of Sociology
Department of Statistics
Department of Chemistry
Department of Sociology
Department of Statistics
Department of Chemistry
Rights Access
Subject
mixed methods
Science of Team Science (SciTS)
process evaluation
social network analysis
team outcomes
team success
c-factor (collective intelligence)