Regression Benchmarking with Simple Middleware Benchmarks

Title:

Regression Benchmarking with Simple Middleware Benchmarks

Authors:

L. Bulej, T. Kalibera, P. Tůma

Publication:

Proc. 23rd IEEE International Conference on Performance, Computing, and Communications (IPCCC) IWMP Workshop

DOI:

Year:

2004

Abstract:

The paper introduces the concept of regression benchmarking as a variant of regression testing focused at detecting performance regressions. Applying the regression benchmarking in the area of middleware development, the paper explains how regression benchmarking differs from middleware benchmarking in general. On a real-world example of TAO, the paper shows why the existing benchmarks do not give results sufficient for regression benchmarking, and proposes techniques for detecting performance regressions using simple benchmarks.

BibTeX:

@inproceedings{bulej_regression_2004,
    title = {{Regression Benchmarking with Simple Middleware Benchmarks}},
    author = {Bulej, L. and Kalibera, T. and Tuma, P.},
    year = {2004},
    booktitle = {{Proc. 23rd IEEE International Conference on Performance, Computing, and Communications (IPCCC) IWMP Workshop}},
    publisher = {IEEE},
    doi = {10.1109/PCCC.2004.1395179},
    pages = {771--776},
}