Research note. Valuation Mishaps and the Choreography of Repair

Abstract

This research note proposes that it is instructive to ask what happens when evaluative practices go wrong. It shows how a close study of mistakes and mishaps in evaluation - both in the process of their disclosure and subsequent management - provides important insights into ways in which evaluation practices contribute to performing and sustaining the relations of accountability involved. The note examines two cases: 1) the mistaken award of the 2017 Oscar for Best Picture and 2) the incident in November 2016 when Thomson Reuters notified a large number of scholars that they had been awarded the distinction of being a “Highly Cited Researcher” in their field, only a few hours later to retract these awards. Studying such instances provides insights into what is at stake for participants, the choreography of performing and revealing evaluations, the ways in which different evaluation practices fold together, and the accountability structures which support valuation practices.