Component And Middleware Performance


OOPSLA 2004 Workshop
October 25, 2004
Vancouver Convention & Exhibition Centre
Vancouver, British Columbia, Canada

The workshop call for papers has been issued

Published in special issue of Studia Informatica journal


The goal of the workshop is to help advance the current practice of gathering performance characteristics of component systems and middleware implementations through benchmarking. Positions are solicited especially from people with previous or impending benchmarking experience.

The participants of the workshop will identify requirements and obstacles of component and middleware benchmarking and form a position on issues such as designing a framework that would allow the design, running and evaluating a diverse range of benchmarks over a diverse range of platforms, designing benchmark criteria that would allow for a meaningful comparison of results collected over different platforms, designing a framework suitable for regular regression testing, or providing means to verify the benchmarking results and their applicability to specific usage situations.

Schedule

8:30-8:45Welcome and introduction
8:45-9:15Christophe Demarey et al:
Benchmarking The Round Trip Latency Of Various Java Based Middleware Platforms
9:15-9:30Discussion
9:30-10:00Jaime Spacco et al:
RUBiS Revisited: Why J2EE Benchmarking Is Hard
10:00-10:15Discussion
10:15-10:45Emmanuel Cecchet et al:
Implementing Probes For J2EE Cluster Monitoring
10:45-11:00Discussion
11:00-11:30Alexandre Oufimtsev et al:
Method Input Parameters And Performance Of EJB Applications
11:30-12:00Discussion and poster and statement preparation
12:00-13:30Lunch break
13:30-14:00Arvind S. Krishna et al:
A Distributed Continuous Quality Assurance Process To Manage Variability In Performance Intensive Software
14:00-14:15Discussion
14:15-14:45Marek Prochazka et al:
RTJBench: A Real Time Java Benchmarking Framework
14:45-15:00Discussion
15:00-15:30Dayong Gu et al:
Code Layout As A Source Of Noise In JVM Performance
15:30-15:45Discussion
15:45-16:15Matthias Hauswirth et al:
The Need For A Whole System View Of Performance
16:15-17:00Discussion and poster and statement preparation

Please note that the schedule is meant to be very flexible. At no time will discussion be stiffled for the mere purpose of observing the set presentation times.

Submissions

The attendees are invited to submit a statement of interest, a position paper or an experience report. The submitted materials should be reasonably concise. The organizing committee will disseminate all submissions to the workshop attendees prior to the workshop and select position papers and experience reports to be presented at the beginning of the workshop. The position papers and experience reports selected for presentation will be published in a special issue of the Studia Informatica journal on components and performance, scheduled for publication in Spring 2005. A joint position of the attendees will be considered for publication.

The topics are envisioned to include, but not be limited, to:

Current practice:

Issues concerning benchmarks

Issues concerning benchmarking frameworks

Issues concerning benchmarking applications

The statements of interest, position papers and experience reports should be mailed to the organizing committee at oopsla-workshop@d3s.mff.cuni.cz. Any of the DOC, PDF, PS or RTF formats are accepted, for formatting instructions please see the Studia Informatica journal.


Important dates

Submission deadline for early registration:September 2, 2004
Notification of selection for presentation:September 9, 2004
OOPSLA early registration deadline:September 16, 2004
OOPSLA conference:October 24-28, 2004
OOPSLA workshop:October 25, 2004

Organizing committee

Program committee

Contact us at oopsla-workshop@d3s.mff.cuni.cz.
For the 2003 workshop page, click here.