Unreproducible tests Successes, failures, and

conchita-marotz
Published  · 39 slides · 0 views
↓ Download
Unreproducible tests Successes, failures, and
1 / 1
Unreproducible tests Successes, failures, and - slide 1 of 39 Unreproducible tests Successes, failures, and - slide 2 of 39 Unreproducible tests Successes, failures, and - slide 3 of 39 Unreproducible tests Successes, failures, and - slide 4 of 39 Unreproducible tests Successes, failures, and - slide 5 of 39 Unreproducible tests Successes, failures, and - slide 6 of 39 Unreproducible tests Successes, failures, and - slide 7 of 39 Unreproducible tests Successes, failures, and - slide 8 of 39 Unreproducible tests Successes, failures, and - slide 9 of 39 Unreproducible tests Successes, failures, and - slide 10 of 39 Unreproducible tests Successes, failures, and - slide 11 of 39 Unreproducible tests Successes, failures, and - slide 12 of 39 Unreproducible tests Successes, failures, and - slide 13 of 39 Unreproducible tests Successes, failures, and - slide 14 of 39 Unreproducible tests Successes, failures, and - slide 15 of 39 Unreproducible tests Successes, failures, and - slide 16 of 39 Unreproducible tests Successes, failures, and - slide 17 of 39 Unreproducible tests Successes, failures, and - slide 18 of 39 Unreproducible tests Successes, failures, and - slide 19 of 39 Unreproducible tests Successes, failures, and - slide 20 of 39 Unreproducible tests Successes, failures, and - slide 21 of 39 Unreproducible tests Successes, failures, and - slide 22 of 39 Unreproducible tests Successes, failures, and - slide 23 of 39 Unreproducible tests Successes, failures, and - slide 24 of 39 Unreproducible tests Successes, failures, and - slide 25 of 39 Unreproducible tests Successes, failures, and - slide 26 of 39 Unreproducible tests Successes, failures, and - slide 27 of 39 Unreproducible tests Successes, failures, and - slide 28 of 39 Unreproducible tests Successes, failures, and - slide 29 of 39 Unreproducible tests Successes, failures, and - slide 30 of 39 Unreproducible tests Successes, failures, and - slide 31 of 39 Unreproducible tests Successes, failures, and - slide 32 of 39 Unreproducible tests Successes, failures, and - slide 33 of 39 Unreproducible tests Successes, failures, and - slide 34 of 39 Unreproducible tests Successes, failures, and - slide 35 of 39 Unreproducible tests Successes, failures, and - slide 36 of 39 Unreproducible tests Successes, failures, and - slide 37 of 39 Unreproducible tests Successes, failures, and - slide 38 of 39 Unreproducible tests Successes, failures, and - slide 39 of 39
Description
Unreproducible tests Successes, failures, and lessons in testing and verification Michael D. Ernst University of Washington Presented at ICST 20 April 2012 Reproducibility: The linchpin of verification A test should behave deterministically

Related Topics

Download this presentation From Below

"Unreproducible tests Successes, failures, and" is the property of its rightful owner. Permission is granted to download and print the materials on this website for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.

Presentation Transcript

01
Unreproducible tests Successes, failures, and lessons in testing and verification Michael D. Ernst
University of Washington

Presented at ICST
20 April 2012<br>
02
Reproducibility: The linchpin of verification A test should behave deterministically
For detecting failures
For debugging
For providing confidence

A proof must be independently verifiable

Tool support: test frameworks, mocking, capture-replay, proof assistants, …<br>
03
Reproducibility: The linchpin of research Research:
A search for scientific truth
Should be testable (falsifiable) -Karl Popper
Example: evaluation of a tool or methodology

Bad news: Much research in testing and verification fails this scientific standard<br>