Criteria for performance evaluation
proficiency using the CWS index and several other quantitative measures of performance. The CWS index (Weiss
& Shanteau, 2003) is a coherence criterion that looks only at internal properties of the data without incorporating an
external standard. In Experiment 1, college students (n = 20) carried out 2- and 3-digit addition and multiplication problems
under time pressure. In Experiment 2, experienced golfers (n = 12), also college students, putted toward a target
from nine different locations. Within each experiment, we analyzed the same responses using different methods. For
the arithmetic tasks, accuracy information (mean absolute deviation from the correct answer, MAD) using a coherence
criterion was available; for golf, accuracy information using a correspondence criterion (mean deviation from the target,
also MAD) was available. We ranked the performances of the participants according to each measure, then compared
the orders using Spearman’s rs. For mental calculation, the CWS order correlated moderately (rs =.46) with that of
MAD. However, a different coherence criterion, degree of model fit, did not correlate with either CWS or accuracy.
For putting, the ranking generated by CWS correlated .68 with that generated by MAD. Consensual answers were also
available for both experiments, and the rankings they generated correlated highly with those of MAD. The coherence
vs. correspondence distinction did not map well onto criteria for performance evaluation.
Leave a comment

Canadian university students either of Chinese origin (CC) or non-Asian origin (NAC) and Chinese university students educated in Asia (AC) solved simple-arithmetic problems in the 4 basic ...

The concept of body mass index (BMI) originated with Quetelet’s 19th century proposed relation between stature and body weight (Ross et al., 1988). BMI is correlated not only with ...

Accurate network traffic measurement is required for ac- counting, bandwidth provisioning and detecting DoS at- tacks. These applications see the traffic as a collection of flows ...

This chapter features the concept of ascribed epistemic authority (Kruglanski, 1989) offered as a unique perspective on source effects in social judgment. In contrast to prior approaches ...

In this article a broad perspective incorporating elements of time series theory is presented for conceptualizing the data obtained in multi-trial judgment experiments. Recent evidence suggests ...

Many judgment analysis studies employ multiple regression procedures to estimate the importance of cues. Some studies test the significance of regression coefficients in order to decide whether ...

A reanalysis of the numerosity judgment data described in T. J. Palmen ( 1997) showed that the mean latency exhibits clear deviations from the power function as predicted by the component ...

Liberalization is an undeniable trend these days which countries can not evade that. It will effect on all aspects of economics in the world. One of the most important parts of one economic ...

In 2007, Kenneth Hammond published Beyond Rationality: The search for wisdom in a troubled time. In this book and in prior works, Hammond (1990; 1996) promotes the recognition and ...

Hammond (1996) argued that much of the research in the field of judgment and decision making (JDM) can be categorized as focused on either coherence or correspondence (C&C) and that, in order ...








