Home → Magazine Archive → August 2008 (Vol. 51, No. 8) → Wake Up and Smell the Coffee: Evaluation Methodology... → Abstract

Wake Up and Smell the Coffee: Evaluation Methodology For the 21st Century

By Stephen M. Blackburn, Kathryn S. McKinley, Robin Garner, Chris Hoffmann, Asjad M. Khan, Rotem Bentzur, Amer Diwan, Daniel Feinberg, Daniel Frampton, Samuel Z. Guyer, Martin Hirzel, Antony Hosking, Maria Jump, Han Lee, J. Eliot B. Moss, Aashish Phansalkar, Darko Stefanovik, Thomas VanDrunen, Daniel von Dincklage, Ben Wiedermann

Communications of the ACM, Vol. 51 No. 8, Pages 83-89

Evaluation methodology underpins all innovation in experimental computer science. It requires relevant workloads, appropriate experimental design, and rigorous analysis. Unfortunately, methodology is not keeping pace with the changes in our field.

The full text of this article is premium content


No entries found