Team Performance Assessment and Measurement Theory, Methods, and Applications

This book began at a conference on team performance measurement held at the University of South Florida. Several participants at the conference felt that a book on team performance measurement would be of interest to a broader audience, and they began looking for authors in diverse disciplines. Some of the chapters in this book closely follow material presented at the conference. Many others report work that was done subsequently or was done by authors not present at the conference. The result is a book rich in its diversity of approaches to measurement and which contains illustrations of many different teams. This book is the first of its kind to bring together a collection of scholars and practitioners focusing solely on the problem of team performance measurement. Although much has been written about team and group effectiveness, little theoretical and empirical progress has been made in the measurement of team processes and outcomes. The book represents a major step forward both theoretically and empirically. Section 1 provides a rich theoretical basis for measurement, including designing measures to be used in team training, measures of shared mental models, and measures of team workload. Section 2 addresses methodological developments and issues, including the design and validation of simulations, surveys, and observer checklists. It also deals with issues such as the consistency of team performance and task and level of analysis issues. Section 3 provides applications and illustrations of team performance measures in such teams as nuclear power control room operators, theater technical crews, and aircraft cockpit crews. Section 4 offers guidance for anyone interested in developing their own measures of team performance. There are both theoretical and practical reasons for the current interest in teams. Psychological research interest in groups and teams has returned and is now a thriving area. Self-managed work groups and semi-autonomous work groups have become increasingly common in industry, so there is an increased interest in team functioning from a practical standpoint. This volume's purpose is to describe recent advances in the measurement of team performance, both process and outcome. Several of the chapters provide recommendations on how, when, and why to measure aspects of teams. In addition to describing what is currently known, the book also discusses what remains to be known and what needs to be done next. The book is intended primarily for those interested in research about team processes and outcomes--researchers and academics who possess a basic understanding of statistics and psychometrics. The bulk of research reported has applied aims which provide much practical information, such as how to design simulations, rating forms, and dimensions of team performance useful for feedback to many kinds of teams. In addition, there are examples from several different kinds of teams, including aircrews, nuclear power plant operators, hospital workers, ship combat information center groups, and theater technicians. Therefore the book should be useful to people who want to design measures to evaluate teams.

Contents: E.A. Fleishman, Series Editor's Foreword. Preface. Part I:Overview. M.T. Brannick, C. Prince, An Overview of Team Performance Measurement. Part II:Theoretical Developments. T.L. Dickinson, R.M. McIntyre, A Conceptual Framework for Teamwork Measurement. J.A. Cannon-Bowers, E. Salas, A Framework for Developing Team Performance Measures in Training. K. Kraiger, L. Wenzel, Conceptual Development and Empirical Evaluation of Measures of Shared Mental Models as Indicators of Team Effectiveness. C.A. Bowers, C.C. Braun, B.B. Morgan, Jr., Team Workload: Its Meaning and Measurement. Part III:Methodological Developments and Issues. J.R. Hollenbeck, D.J. Sego, D.R. Ilgen, D.A. Major, J. Hedlund, J. Phillips, Team Decision-Making Accuracy Under Difficult Conditions: Construct Validity of Potential Manipulations Using the TIDE2 Simulation. D.J. Dwyer, J.E. Fowlkes, R.L. Oser, E. Salas, N.E. Lane, Team Performance Measurement in Distributed Environments: The TARGETs Methodology. G. Hallam, D. Campbell, The Measurement of Team Performance With a Standardized Survey. J. Mathieu, D. Day, Assessing Processes Within and Between Organizational Teams: A Nuclear Power Plant Example. P. Tesluk, S.J. Zaccaro, M. Marks, J. Mathieu, Task and Aggregation Issues in the Analysis and Assessment of Team Performance. Part IV:Applications. J.L. Komaki, Behind the Scenes: Fieldtesting a Measure of Effectiveness for Theater Teams. J.L. Toquam, J.L. Macaulay, C.D. Westra, Y. Fujita, S.E. Murphy, Assessment of Nuclear Power Plant Crew Performance Variability. A. Prince, M.T. Brannick, C. Prince, E. Salas, The Measurement of Team Process Behaviors in the Cockpit: Lessons Learned. J.H. Johnston, K.A. Smith-Jentsch, J.A. Cannon-Bowers, Performance Measurement Tools for Enhancing Team Decision-Making Training. Part V:Reflections. D. Baker, E. Salas, Principles for Measuring Teamwork: A Summary and Look Toward the Future.

Michael T. Brannick, Eduardo Salas, Carolyn W. Prince