Criteria for performance evaluation
Using a cognitive task (mental calculation) and a perceptual-motor task (stylized golf putting), we examined differentialproficiency using the CWS index and several other quantitative measures of performance. The CWS index (Weiss
& Shanteau, 2003) is a coherence criterion that looks only at internal properties of the data without incorporating an
external standard. In Experiment 1, college students (n = 20) carried out 2- and 3-digit addition and multiplication problems
under time pressure. In Experiment 2, experienced golfers (n = 12), also college students, putted toward a target
from nine different locations. Within each experiment, we analyzed the same responses using different methods. For
the arithmetic tasks, accuracy information (mean absolute deviation from the correct answer, MAD) using a coherence
criterion was available; for golf, accuracy information using a correspondence criterion (mean deviation from the target,
also MAD) was available. We ranked the performances of the participants according to each measure, then compared
the orders using Spearman’s rs. For mental calculation, the CWS order correlated moderately (rs =.46) with that of
MAD. However, a different coherence criterion, degree of model fit, did not correlate with either CWS or accuracy.
For putting, the ranking generated by CWS correlated .68 with that generated by MAD. Consensual answers were also
available for both experiments, and the rankings they generated correlated highly with those of MAD. The coherence
vs. correspondence distinction did not map well onto criteria for performance evaluation.
URL:
HTML Code:
Forum Code:
HTML Code:
Forum Code:
Leave a comment
Cognitive Arithmetic Across Cultures 
Canadian university students either of Chinese origin (CC) or non-Asian origin (NAC) and Chinese university students educated in Asia (AC) solved simple-arithmetic problems in the 4 basic ...
Body Mass Index and Dietary Intake of Thiamin : Evidence for a Sexually Dimorphic Relation The concept of body mass index (BMI) originated with Quetelet’s 19th century proposed relation between stature and body weight (Ross et al., 1988). BMI is correlated not only with ...
New Directions in Traffic Measurement and Accounting Accurate network traffic measurement is required for ac- counting, bandwidth provisioning and detecting DoS at- tacks. These applications see the traffic as a collection of flows ...
Says Who ? : Epistemic Authority Effects in Social Judgment This chapter features the concept of ascribed epistemic authority (Kruglanski, 1989) offered as a unique perspective on source effects in social judgment. In contrast to prior approaches ...
Modeling sequential context effects in judgment analysis: A time series approach In this article a broad perspective incorporating elements of time series theory is presented for conceptualizing the data obtained in multi-trial judgment experiments. Recent evidence suggests ...
A note on determining the number of cues used in judgment analysis studies: The issue of type II error Many judgment analysis studies employ multiple regression procedures to estimate the importance of cues. Some studies test the significance of regression coefficients in order to decide whether ...
A CMPL Alternative Account of Practice Effects in Numerosity Judgment Tasks A reanalysis of the numerosity judgment data described in T. J. Palmen ( 1997) showed that the mean latency exhibits clear deviations from the power function as predicted by the component ...
The Impact of Liberalization on Agricultural Import in Iran Liberalization is an undeniable trend these days which countries can not evade that. It will effect on all aspects of economics in the world. One of the most important parts of one economic ...
Introduction to the special issue: Coherence and correspondence in judgment and decision making In 2007, Kenneth Hammond published Beyond Rationality: The search for wisdom in a troubled time. In this book and in prior works, Hammond (1990; 1996) promotes the recognition and ...
Theories of truth as assessment criteria in judgment and decision making Hammond (1996) argued that much of the research in the field of judgment and decision making (JDM) can be categorized as focused on either coherence or correspondence (C&C) and that, in order ...