PPT-Methods and Metrics Issues in Delivery

System Research JEFF ALEXANDER The University of Michigan The Challenge and Promise of Delivery System Research A Meeting of AHRQ Grantees Experts and Stakeholders Doubletree Dulles Sterling Virginia. 24646 Heather Heights Place Saratoga California 950709710 doughoffmanacmorg Abstract There sometimes is a decidedly dark side to software metrics that many of us have observed but few have openly discussed It is clear to me that we often get what we System . Research. JEFF ALEXANDER. The University of Michigan. The Challenge and Promise of Delivery System Research: A Meeting of AHRQ Grantees, Experts, and Stakeholders. Doubletree Dulles – Sterling, Virginia. of consistency in defining slices for slicing metrics: ensuring . comparability . in research findings. Tracy Hall, . Brunel University. David Bowes, . University of Hertfordshire. Andrew Kerr, . University of Hertfordshire. Conceptualization. Development. Actualization. Maintenance. Retirement/Transformation. Service Requirement. Managed Services Delivery Capabilities. Our Strengths and Customer Alignments. Service Delivery Practice. Don McGreal. don.mcgreal@improvingenterprises.com. @. donmcgreal. . linkedin.com. /in/. donmcgreal. Agenda. Types of Metrics. Problems with Metrics. Metrics in Software Development. Evidence-Based Management. Survey . Results. With help from Marty . Klubeck. at Notre Dame and Brenda . Osuna. at USC. Who are we?. Brown. Carnegie Mellon. Columbia . Cornell . CU. -Boulder . Duke . University . Georgetown . 10k . x. 6k overview. 4k . x. 4k overview. Caravan. ABI Delivery 2. 6/21/13. 1. Delivery 2: Caravan Movie. 600 frames @10hz; 1280x720 0.5m pixels with 9-25 adaptive samples and truth . ABI Delivery 2. ?. Metrics . are . units of . measurement . that . are used to characterize. :. software engineering . products. , e.g., designs, source code, and test cases,. software engineering . processes. , e.g., the activities of analysis, designing, and coding, and. Planning, Executing, Analyzing, and . Reporting Research on . Delivery System Improvement . Webinar #4: Formative Evaluation. Presenter: Jeffrey Smith, PhD(c). Discussant: Cheryl McDonnell, PhD. Moderator: Michael I. Harrison, PhD. Rouven Krebs (SAP AG). , Christof Momm (SAP AG), Samuel Kounev (KIT). SPEC RG Cloud. , . May . 2012. Isolation . and Shared Resources. provides. Service Provider. High overhead, low utilization .  need to share. Jeffrey L. Bernstein. Department of Political Science. Eastern Michigan University. Why I Proposed This Workshop. Carnegie experience – “methods anxiety”. Recent scholarship (McKinney edited volume) on methods. Joonkyu Kang. . Based on typical . Fedex. delivery situation. Machines: delivery trucks. Jobs: packages to be delivered. Processing time: traveling time to the destination. Deadline: different for each type of package. Zoe Fleming U. Leicester, Ruth Doherty U. Edinburgh UK . Cooper, O. R., Xu, X., Feng, Z., Simpson, D., Schultz, M., Pinto, J., . Shallcross. , D., . Moolla. , R., . Lefer. , B., Solberg, S., von . Schneidemesser. Characterizing “Good” Design. Besides the obvious — . design should match the requirements. — there are two “basic” characteristics:. . C. onsistency. . across design:. Common UI. L. ooks.