On metrics

Michael Nielsen has a good essay on the problems of using scientometrics to guide funding in science. While he accepts that any grants process will inevitably utilise some form of valuation of the science, often in unstated terms, he sees three problems with the way metrics are increasingly used (what he calls centralized metrics). One is that metrics create scientific monocultures, or “suppress cognitive diversity”. Second is that they create perverse incentives, and third that they misallocate resources. I’m not entirely sure if these three problems are not different aspects of the same, underlying problem, but the essay is interesting throughout. I quote:

The point of the story of the cosmological constant is not that Einstein was a fool. Rather, the point is that it’s very, very difficult for even the best scientists to accurately assess the value of scientific discoveries. Science is filled with examples of major discoveries that were initially underappreciated. Alexander Fleming abandoned his work on penicillin. Max Born won the Nobel Prize in physics for a footnote he added in proof to a paper – a footnote that explains how the quantum mechanical wavefunction is connected to probabilities. That’s perhaps the most important idea anyone had in twentieth century physics. Assessing science is hard.

This might actually be the take-home message of the piece.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s