CFP - Workshop on Benchmarking Embedded Systems (at ESWEEK 2013)

Call for Position Statements: Workshop on
Benchmarking Embedded Systems (at ESWEEK 2013)

Montreal, Canada -- September 29, 2013
http://www.cmc.ca/NewsAndEvents/Events/ESWeek/Benchmarking.aspx

Integrated in the ESWEEK 2013: http://esweek.org/

Empirical systems research is facing a dilemma. Minor aspects of an
experimental setup can have a significant impact on its associated
performance measurements and potentially invalidate conclusions drawn
from them. The growth in complexity and size of modern systems will
further aggravate this dilemma, especially with the given time pressure
of producing results. So how can one trust any reported empirical
analysis of a new idea or concept?

This workshop aims to bring together researchers and industry concerned
with quantitative and empirical evaluation of embedded computing
systems. The workshop will have a work program with active
participation. The topics addressed will include the quality of
benchmarking, state-of-the-art workloads, standardization of workloads,
proper experimental setups, replicability and reproducibility of
results, sharing of infrastructure, creating of benchmarks, benchmarking
problems specific to the embedded domain such as sensor and actuator
benchmarking as well as I/O and connectors.

The four themes for the BES 2013 agenda are:

1) Is there a need to benchmark?

2) Trustworthiness and reproducibility of empirical measurements

3) Benchmarking heterogeneous and multicore systems

4) Benchmarking with peripherals, sensors, actuators, and bus systems

For each of these topics, we plan to have (1) a brief kick-off
presentation by an invited speaker from industry and academia, (2)
standup presentations of position statements relevant to the topic, and
(3) heated discussions before summarizing and moving to the next topic.

Submission of Position Statements

Prospective participants are invited to submit a one page position
paper. Submitters will get a chance to give a standup presentation on
their position. All position papers will be made available prior to the
workshop. Submissions must be sent to this email address prior to the
deadline: bes2013@uwaterloo.ca

Important Dates

Deadline for submitting position papers: Sept 10, 2013 Confirmation of
the position presentation: Sept 15, 2013

Organizers

Sebastian Fischmeister, University of Waterloo, Canada Peter Stokes, CMC
Microsystems, Canada Shay Gal-On, EEMBC, USA Darshika G. Perera, CMC
Microsystems, Canada