This research note proposes that it is instructive to ask what happens when evaluative practices go wrong. It shows how a close study of mistakes and mishaps in evaluation - both in the process of their disclosure and subsequent management - provides important insights into ways in which evaluation practices contribute to performing and sustaining the relations of accountability involved. The note examines two cases: 1) the mistaken award of the 2017 Oscar for Best Picture and 2) the incident in November 2016 when Thomson Reuters notified a large number of scholars that they had been awarded the distinction of being a “Highly Cited Researcher” in their field, only a few hours later to retract these awards. Studying such instances provides insights into what is at stake for participants, the choreography of performing and revealing evaluations, the ways in which different evaluation practices fold together, and the accountability structures which support valuation practices.
References
Cussins, Charis. 1996. “Ontological Choreography: Agency through Objectification in Infertility Clinics.” Social Studies of Science 26(3): 575?610. https://doi.org/10.1177/030631296026003004
Deleuze, Gilles. 1993. The Fold: Leibnitz and the Baroque. University of Minnesota Press.
Muniesa, Fabian, and Claes-Fredrik Helgesson. 2013. “Valuation Studies and the Spectacle of Valuation.” Valuation Studies 1(2): 119?123. https://doi.org/10.3384/vs.2001-5992.1312119
Woolgar, Steve. 1980. “Discovery: logic and sequence in a scientific text.” In The Social Process of Scientific Investigation, Sociology of the Sciences Yearbook, Vol. 4, edited by Karin Knorr et al., 239?268. Dordrecht: Reidel.
Woolgar, Steve. Forthcoming. “It could be otherwise: Jimmy Savile and the situated dynamics of revelation.”
Helgesson, Claes-Fredrik, and Steve Woolgar. 2018. “Research Note. Valuation Mishaps and the Choreography of Repair”. Valuation Studies 5 (2), 145-62. https://doi.org/10.3384/VS.2001-5992.1852145.
Authors retain the copyright to their contributions. Linköping University Electronic Press publishes under Creative Commons licence CC-BY-NC, which allows users to distribute the work and to re-work it but not for any commercial purposes, without the author's permission.
