Quantitative Analysis of Verbal Expressions in Comments From Evaluation Committee Reviewers in AIST Between Fiscal Years 2001 and 2008

In: Evaluation review: a journal of applied social research, Band 34, Heft 5, S. 419-435

Abstract

This article discusses the quantitative analysis of verbal expressions of comments from the evaluation committee reviewers for 8 years (FY2001—FY2008) at the Japanese Public Research Institute, National Institute of Advanced Industrial Science and Technology (AIST). First, the terms often appearing in the comment sheets were observed. Moreover, gradually increasing terms every year and suddenly emerging terms after the beginning of the second research phase are examined. Finally, the terms related closely to the output evaluation are considered. By properly setting the evaluation items, the comments along a specific direction can be obtained from the reviewers. Moreover, the permeation of an idea or concept can also be found by measuring the time variance of the frequency of specific terms in the comment sheet.