Rankings impose discipline on markets: Wendy Espeland's A Different Kind of Quantitative Sociology talk at ICOS in 2008:
Third is discipline (here comes the Foucault!). Most readers will probably know where this line of argument goes – rankings and other metrics are internalized and begin to alter our behavior without any direct action on the part of the rankings-makers. Espeland draws here on her recent work on US News and World Report law school rankings. For example, because the rankings counted median LSAT scores of only regular full-time students, law schools began to push weaker applicants into doing part-time and night programs. In response to a proposal by US News to start including those programs in the median LSAT calculations, law schools formed committees to ponder reforming or closing their night and part-time programs. Organizational discipline in action.
The whole of the argument has 5 bullet points
- Quantification takes work
- Quantification changes what it measures
- Quantification imposes discipline on those who are measured
- Numbers are seen as authoritative
- Numbers are powerful for their aesthetic qualities
The National Law Journal takes on the impact of this in May 2010:
U.S. News does maintain a law school "diversity index," but those data are not a factor in the overall rankings.
"A lot of people we interviewed expressed concern over the impact of rankings on diversity," said Wendy Espeland, an assistant professor of sociology at Northwestern University. "The overarching tension between catering to the rankings and doing what you think is best for your school is intense."
Every once in a while I invoke the phrase "quality without a number"; most recently, I guess, in a post on Reification is an Ontological Imperative, also from 2008. Ed Yourdon's The Politics of Metrics has the same theme.
