Journal article

Middleware Benchmarking: Approaches, Results, Experiences
P. Brebner, E. Cecchet, J. Marguerite, P. Tůma, O. Ciuhandu, B. Dufour, L. Eeckhout, S. Frénot, A. Krishna, J. Murphy, C. Verbrugge
Concurrency and Computation: Practice and Experience 17 (15)

The report summarizes the results of the Workshop on Middleware Benchmarking held during OOPSLA 2003. The goal of the workshop was to help advance the current practice of gathering performance characteristics of middleware implementations through benchmarking. The participants of the workshop have focused on identifying requirements of and obstacles to middleware benchmarking and forming a position on the related issues. Selected requirements and obstacles are presented, together with guidelines to adhere to when benchmarking, open issues of current practice, and perspectives on further research. Copyright © 2005 John Wiley & Sons, Ltd.

    title = {{Middleware Benchmarking: Approaches, Results, Experiences}},
    author = {Brebner, Paul and Cecchet, Emmanuel and Marguerite, Julie and Tůma, Petr and Ciuhandu, Octavian and Dufour, Bruno and Eeckhout, Lieven and Frénot, Stéphane and Krishna, Arvind S. and Murphy, John and Verbrugge, Clark},
    year = {2005},
    journal = {{Concurrency and Computation: Practice and Experience}},
    number = {15},
    doi = {10.1002/cpe.918},
    issn = {1532-0634},
    pages = {1799--1805},
    url = {},
    volume = {17},