Software that Matters Matt Griscom OctobeR 18 th 2016 SOFTWARE QUALITY CONFERENCE PACIFIC NW PNSQC Overview Quality Automation done Optimally Paradigm Shifts Impact on Roles ID: 730618
Download Presentation The PPT/PDF document "MetaAutomation: Quality Automation for" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
MetaAutomation:Quality Automation forSoftware that Matters
Matt GriscomOctobeR 18th, 2016
SOFTWAREQUALITYCONFERENCE
PACIFIC NW
PNSQC
™Slide2
Overview
Quality Automation done OptimallyParadigm ShiftsImpact on RolesThe Seven Patterns of MetaAutomationProblems Solved!What you can do tomorrow
SOFTWAREQUALITY
CONFERENCE
PACIFIC NW
PNSQC
™Slide3
Who am I?
Hard-core nerdHigh-level thinkerTwo degrees in physics
I like hard problemsIdealistic IdiotSOFTWAREQUALITY
CONFERENCE
PACIFIC NW
PNSQC
™
What do I ask of you?
Listen and keep an open mind
Ask questions
Think about the big picture
Look to what you can do tomorrowSlide4
Quality Automation
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Distractors:PNSQC
™
“Test Automation” is an honest mistake
“The point of test is to find bugs”Slide5
SOFTWARE
QUALITY
CONFERENCEPACIFIC NWPNSQC
™
New automation focus:
Answer “Does the system do what we need it to do?”
Quality AutomationSlide6
SOFTWARE
QUALITY
CONFERENCEPACIFIC NWPNSQC
™
The core of quality automation:
“Does the system do what we need it to do?”
Best way to do functional/perf quality:
Measure fast, with accuracy and precision
Communicate efficiently across team and geography
Enable robust analysis over time
Quality AutomationSlide7
The Six Paradigm Shifts
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Quality Automation delivers very different business value from the manual test role
PNSQC
™Slide8
The Six Paradigm Shifts
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Optimized Quality Automation vastly increases business value
PNSQC
™Slide9
The Six Paradigm Shifts
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Checks are bounded in time, enabling structured artifacts
PNSQC
™
Conventional “Test Automation” …
Quality Automation implemented with patterns of MetaAutomation …
…
LOG
… log…
log
…
log
log
log
…
log
……
log
…
log
log
…
log
…
log
… log…
<Check>… (hierarchical steps +contextual data) … </Check>
Automation (e.g. industrial or utility)
… log … log… log … log
log
log
… log …… log … log
log
… log … log … log…Slide10
The Six Paradigm Shifts
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
The Hierarchical Steps pattern gives transparency, robustness, and flexibility
PNSQC
™Slide11
The Six Paradigm Shifts
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Measure Quality with multi-tier checks for the Internet of Things
PNSQC
™
Tier
Bluetooth
TierSlide12
The Six Paradigm Shifts
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Better quality data empowers the whole team across geographies and across the SDLC
PNSQC
™
QA
Developers
Test
Executive
Leads and Managers
Geography
Geography
GeographySlide13
SOFTWARE
QUALITY
CONFERENCEPACIFIC NWPNSQC
™Slide14
MetaAutomation solves these problems…
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Secret QA knowledge
PNSQC
™
Slow checks
Lack of intra-team and cross-geography trust, respect
Flaky checks
Ignored failures
Test script documentation load
Under-appreciated QA role
Separate performance checks
SOX is missing informationSlide15
Team Happiness!
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
The team is unifiedThere is more clarity that people are doing their best work
PNSQC
™Slide16
SOFTWARE
QUALITY
CONFERENCE
PACIFIC NW
Hey, if this stuff is so great, why is nobody doing it?
PNSQC
™Slide17
What can you do tomorrow forgreater business value from automation?
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
Document requirements
Business vs. functional requirements
Short, simple, independent checks
No extraneous verifications
Be clear on what checks verify, and what they don’t
PNSQC
™Slide18
Closing
“Test Automation” -> Quality AutomationSix Paradigm ShiftsImpact on RolesThe Seven Patterns of MetaAutomationProblems Solved!
Ideas to use starting tomorrowSOFTWAREQUALITY
CONFERENCE
PACIFIC NW
PNSQC
™Slide19
SOFTWARE
QUALITY
CONFERENCE
PACIFIC NW
Questions?
PNSQC
™Slide20
MetaAutomation
SOFTWARE
QUALITYCONFERENCEPACIFIC NW
http://metaautomation.net
matt@metaautomation.net
PNSQC
™