|
|
HOME > Assessment and Analysis of Educational Testing Theories
May 25, 2010
Research Activity Report (May 2010)
The CRET Development of Testing Items Group will engage in two research themes on teamwork skills.
1. Development of measurement methodologies for teamwork skills using CG.
This research is to explore the possibilities of applying research outcome to “group perception” utilizing computer graphics (CG), as a tool to measure teamwork skills. Basically, the following research is involved.
First, stimulus groups are structured using CG which uses shape (e.g. persons, fishes ), color, speed, number, and space as the variables. Next, the group is shown to the respondent on a computer screen, and the respondent’s perception of the group is confirmed.
The research is aimed at finding out if there is any relationship between the perception and the teamwork skills possessed by each respondent.
his year, we plan to complete the preliminary version of CG system and examine the validity of the measurement methodology using CG. To this end, data will be collected from the employees of an existing company.
When this measurement tool is completed, it will become possible to nonverbally present stimuli to respondents. Reading skills of the respondents will not have any effect. As a result, measurement with minimum reaction bias caused by social desirability will become viable.
2. Development of a training program to enhance teamwork skills.
In 2009, the Development of Testing Items Group developed a scale to measure individual teamwork skills. Following up on this milestone, this year we will consider scale factors such as communication skills, team orientation, monitoring coordination skills, backup actions, and leadership, in order to develop a training program which will enhance individual teamwork skills.
Each individual is inherently equipped with teamwork skills. The training program we plan to develop is to enable each individual to demonstrate intensified teamwork skills within the teamwork framework
When this type of program is completed, it will become possible to offer specific training programs aimed at enhancing particular skills which need reinforcement or are deficient. As a result, a comprehensive education system combining assessment and training will be offered.
(Atsushi Aikawa, Ph.D., CRET Board of Directors)
|
January 25, 2010
2nd Half 2009, Dr. Atsushi Aikawa’s Research Team
Activities Report (January 2010)
The group of Development of Testing Items and Content at CRET has been engaged in the following three areas of research in the latter half of 2009:
Theme 1 is the research on the measurement of teamwork abilities which was initiated in 2008. In 2009, we have added the inversion items which were highlighted as the challenges in 2008 survey. The outcome of the connotation survey concerning the concept of teamwork abilities for business people was referenced, when 800 university students (with an equal male/female ratio) were tested using CBT.
On “communication abilities”, one of the subordinate concepts of teamwork abilities, there appeared to be a significant difference between the genders. The two-year research has resulted in the selection of scale items to measure teamwork abilities consisting of five subordinate concepts.
Theme 2 is the group perception experiment utilizing CG (Computer Graphics). Group components such as shape, color, speed, number, and space, were used as variables to show CG. The perception of the examinees towards the group was confirmed. For instance, whether the group with a low group component is captured as a lump or as an individual depends on the degree of the examinee’s perception. The possibilities of presenting CG stimuli are also to be verified, as part of an assessment to measure teamwork abilities by relating with the Theme 1 research.
Theme 3 is the shyness measurement based on the IAT (Implicit Association Test). Considering the insufficient number of examinees we had in 2008, we increased the number in 2009 so that the recovery rate of evaluation by others would go up. The method to measure implicit abilities of the examinees, based on the length of response time, is drawing attention because of its potential applications in the area of communication abilities and interpersonal relationships.
(Chie Hoshi, CRET researcher)
|
September 25, 2009
Report by the Research Group on Development of Testing Items led by Dr. Atsushi Aikawa.
We worked on the three themes of research in 2009 as follows:
1. Continued research on “measuring teamwork skills” of children from 2008.
After defining the concept which constitutes teamwork skills, an assessment prototype is created. In the latter half of 2009, we shall embark on research on programs to develop teamwork skills.
2. Research on “testing group perceptions” using computer graphics (CG).
CG are used as a means to show stimuli in order to facilitate the control of conditions, offsetting the disadvantage of assessment using visual images. Another benefit expected is the mitigation of reaction bias such as social acceptability, because this type of testing is often unrecognizable as a means of measuring teamwork skills.
Group perception to be measured is also considered to be closely associated with teamwork skills. We are exploring the possibility of conducting assessments using CG images as a method of measuring teamwork skills in the future.
3. Measurement of shyness through the Implicit Association Test (IAT), which measures latent attitude.
IAT is recognized as a suitable method to measure attitude, which is difficult to be measured by tangible means, such as self-assessment. It is a testing method that is drawing much attention today. CRET invited Dr. Morio from Sapporo University to the research seminar in 2007. (Refer to the report on the CRET 4th research meeting)
Following up on last year’s research, we will verify the possibility of shyness measurement using IAT, and continue to work on developing the prototype for shyness measurement by IAT.
(Daisuke Abe, CRET researcher)
|
|
