HOME > Development of Testing Items and Content

Assessment and Analysis of Educational Testing Theories

Topics

January 25, 2010

Report on Research Activities in 2010 (Jan. 2011)

CRET's Development of Testing Items Department has been exploring two research themes on teamwork skills.

1. Development of methods to measure teamwork skills using Computer Graphics (CG):
 We examined the possibility of using the research outcome of "group perception" using CG as a tool to measure teamwork skills. The following research was conducted:
Variables used were forms (fish or human), numbers (single target, outside the group, inside the group), and movements. 11 types of CG, each with a 45-second duration, were structured using the variables. Next, this group was displayed on a computer screen to the respondents to identify their perception of the group. They were asked what they thought the target individual which was colored differently from the others was feeling. They chose from several options. (Preliminary research was done in order to develop suitable options. A free description of what the respondents thought about the target's feelings when similar CG were shown was aggregated. The relationship between the scale value of the respondents' teamwork skills and the aforementioned outcome was analyzed.) We examined if there was any relationship between this perception outcome and the teamwork skills of each respondent.
 In order to verify this measurement method using CG, data was collected from the employees of an existing company. We examined objective teamwork skills based on a mutual assessment at the workplace and assessment data inside the company. We found a distinct relationship between stimuli by CG and certain teamwork skills. As a result, we can say that an early version of the teamwork skills test using CG was successfully developed.
 When this measurement tool is completed, nonverbal stimuli can be presented to the respondents. We believe this tool will enable us to make measurements without the influence of reading skills and also with little response bias caused by social desirability.

2. The development of a training program to enhance teamwork skills:
 In 2009, we developed a measurement scale for individual teamwork skills:
"communication", "team orientation", "monitoring adjustment", "backup action" and "leadership". This year, we intend to use this scale to grasp the condition of each individual and develop a training program to enhance skills yet to be developed.
 This program is composed of multiple factor programs. One factor program uses teaching one concrete skill through lectures and exercises as its basic type. It is a small group-style teaching where a lecturer teaches university students for 90 minutes or less per lecture and exercise. Teaching materials use PowerPoint and attach images from the slides on the left half of A4 size papers (210x297mm), and information on the slides (teaching points, objectives, information for the lecturer, etc.) can be written down on the right half of the paper. Based on this type of factor program, five themes (11 lectures) were developed.
 Our ultimate aim is to develop a comprehensive education system by combining assessment and training to enhance skills, after measuring the skills with the scale.

(Atsushi Aikawa, Ph.D., CRET Board of Directors)

page top