Results BIRS Center Dec 3 2013 Addressed Questions Which categories of bx benchmarks do exist Whats the difference between a bx example and a ID: 913253
Download Presentation The PPT/PDF document "BX Benchmarks Working Group" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
BX Benchmarks
Working Group
Results
BIRS Center,
Dec
. 3, 2013
Slide2Addressed
Questions
Which
categories
of
bx
benchmarks
do
exist
?
What´s
the
difference
between
a
bx
example
and a
bx
benchmark
?
What
are
bx
benchmarks
expected
to
measure
?
What
about
formats
for
bx
benchmark
descriptions
?
[
Discussion
of
meaningfulness
of „
incrementality
“ in
state-based
scenario
]
Slide3Categories of
bx
B
enchmarks
Functional
bx
benchmarks
address
selected
features
of
bx
approaches
:
Properties of
consistency
relations
Types
of
transformation
scenarios
Laws
for
bx
approaches
[
Appropriateness
for
categories
of
data
? ]
[
Platform
dependency
? ]
Non-
functional
bx
benchmarks
: …
Slide4Categories of
bx
B
enchmarks
… Non-
functional
bx
benchmarks
address
bx
transformation
characteristics
like
:
Runtime
/
memory
consumption
Scaleability
w.r.t.
to
size
of
data
,
spec
. …
Size of
propagated
deltas
[ Loss of
information
after update
propagation
]
…
Slide5bx
Benchmark Properties
A
bx
benchmark
is
a
bx
example
(
with
an optional additional
characterization
w.r.t.
to
a
bx
taxonomy
)
that
has
a
precise
and
executable
definition
of a
binary
consistency
relation
on
source
and
target
data
(
that
can
be
used
as
an
oracle
for
a
bx
application
)
an explicit
definition
of
or
a
generator
for
input
data
elements
(
for
a
bx
application
)
set
of
precisely
defined
update
scenarios
for
certain
input
data
elements
set
of
executable
metrics
definitions
(
wit
h
an SE
interpretation
of
the
word
„
metrics
“)
Slide6Further bx
Benchmark Properties
A „
useful
“
bx
benchmark
should
capture
the
essence
of
certain
aspects
of a
class
of
real-
world
bx
application
scenarios
b
x
descriptions
may
exist
on different
levels
of
abstraction
with
varying
degrees
of
dependence
on a
specific
execution
platform
(PIM
bx
benchmark
description
, … )