Computer Architecture Today

Informing the broad computing community about current activities, advances and future directions in computer architecture.
Overwhelming Statistical Evidence That Our Review Process Is Broken

Overwhelming Statistical Evidence That Our Review Process Is Broken

I have been saying that over-positive PC (OPPC) members’ high scores mess up the paper rankings, the coverage of online discussions (lower-score papers are ignored), and the discussion order at the PC meeting. Previously I had analyzed only the pre-rebuttal score distributions but not the impact on the actual outcomes. Now, I have statistical evidence of the impact.

Read more...