Performance with Storage Quality of Service Patrick Lang CDPB323 Private Clouds Many VMs Workloads Tenants Compute servers Shared storage clusters Scaleout File Server Cluster HyperV Cluster ID: 616880
Download Presentation The PPT/PDF document "Delivering Predictable Storage" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1Slide2
Delivering Predictable Storage Performance with Storage Quality of Service
Patrick Lang
CDP-B323Slide3
Private Clouds
Many VMs Workloads
Tenants
Compute servers
Shared storage clusters
Scale-out File Server Cluster
Hyper-V Cluster
Virtual Machines
SMB3 Storage Network Fabric Slide4
Capacity
Demand
OLTP
Web
Storage PoolSlide5Slide6
Capacity
Demand
OLTP
Web
Storage Pool
OLTP
WebSlide7
Overprovisioning vs Oversubscription
Cost vs risk.Slide8
Capacity
Demand
OLTP
Web
Web
OLTP
Storage Pool
Storage PoolSlide9
Capacity
Demand
OLTP
Web
Web
OLTP
Storage PoolSlide10
Goals
Monitor storage performance & identify trouble signsUse the right strategy to deploy Storage
QoS
Deliver
predictable performance in your private cloudSlide11
Storage Performance MonitoringSlide12
Performance Monitoring
View from virtual machineWhat the customer seesView from the host
What the admin seesSlide13
VM: Performance Counters
\PhysicalDisk(*)\Avg. Disk Queue
Length
\
PhysicalDisk(*)\Current Disk Queue Length\
PhysicalDisk(*)\Avg. Disk sec/Read Slide14
Host: Performance Counters
\Hyper-V Virtual Storage Device(*)\Queue Length
\Hyper-V Virtual Storage Device
(*)\Latency
\Hyper-V Virtual Storage Device(*)\Normalized ThroughputSlide15
Performance Counters in Perspective
Queue DepthAverage is good indicator of impactDesktop workloads have more variability than server
Aim for <2 for good responsiveness
Server may be sustained
Aim for <16Average Latency
Users likely to notice sluggish performance at > 25msNormalized ThroughputTrack overall cost for meteringUse to set Storage QoS policiesSlide16
Normalized IOPs
Input/Output Operations per Second, adjusted for size 1k = 1 normalized IOP
8k = 1 normalized IOP
10k= 2 normalized IOPs 64k = 8 normalized IOPs
Available in performance counters & VM metricsUsed by Storage QoSSlide17
VM Metrics
Introduced in Windows Server 2012 R2Provides accounting for
CPU
Memory
NetworkDiskPreserved across VM state changes
Start/Stop/RebootLiveMigrationSlide18
Tracking Usage with Metrics
Enabled using PowerShellEnable-VMResourceMonitoring
Measure-VM
Reset-
VMResourceMonitoringDisable-
VMResourceMonitoringIncludes Per-Disk Usage(get-vm TestVm1 | measure-vm).HardDiskMetricsVirtualHardDisk : Microsoft.HyperV.PowerShell.HardDiskDriveAverageNormalizedIOPS
: 5569AverageLatency : 44760DataRead : 1100DataWritten : 565NormalizedIOCount : 213045 (New in Technical Preview)Slide19
Monitoring RecapSlide20
Storage QoS
in Windows Server 2012 R2Slide21
Scale-out File Server Cluster
Hyper-V Cluster
Virtual Machines
Rate
Limiters
Rate
Limiters
Rate
Limiters
Rate
Limiters
SMB3 Storage Network Fabric
Storage
QoS
– Windows Server 2012 R2
Features
Metrics - Per-VM
&
VHD
Minimum
& Maximum
normalized IOPs per VHD
Benefits
Mitigate impact of noisy neighbors with limits
Meet performance minimums on local non-shared storage
No dependency on storage featuresSlide22
Applying Storage QoS in Windows Server 2012 R2
Reactive approach
Enable performance counters or metrics on all machines
Sort by normalized IOPs
Decide if usage appropriate, or apply a limit
Proactive approachApply limit to all individual VM’s VHDsRaise as needed based on customer demandConsider tiers based on planned usage as VMs deployed VDI: 100 IOPs limit General: 500 IOPs limit High Performance: > 500 IOPs limitSlide23
What’s Next in Storage QoS
Windows Server Technical PreviewSlide24
Automating Storage Management
Easier to monitorMetrics from all VMs available on Scale-Out File Server
Enabled by default
Easier to manage
Improved fairness by defaultPolicies centralized on Scale-Out File Server
Flexible - Per-VM, Per-Tenant, …Effective on shared storageMeet storage service level agreements even with changing demandsSlide25
Joint work with Microsoft Research
Part of Predictable Data Centers effort
http
://research.microsoft.com/datacenters
/
Mission statement: “Provide customers with predictable performance in shared cloud environments.”In-depth technical material: Storage Developer Conference (SDC’14) presentation: http://www.snia.org/sites/default/files/TomTalpey_Storage_Quality_Service.pdf Academic publication at SOSP’13:
http://research.microsoft.com/apps/pubs/default.aspx?id=198941Slide26
Continuous Performance RefinementSlide27
Scale-out File Server Cluster
Hyper-V Cluster
Virtual Machines
I/O
Sched
I/O
Sched
I/O
Sched
Policy
Manager
Rate
Limiters
Rate
Limiters
Rate
Limiters
Rate
Limiters
SMB3 Storage Network Fabric
Storage
QoS
Evolved
Building Blocks
Centralized policy manager on Scale-Out File Server Cluster
I/O Scheduler distributed across storage nodes
Profiler & rate limiter on Hyper-V compute nodesSlide28
Storage QoS Monitoring
Enabled by default on Scale-Out File ServerTechnical Preview – see guide for upgrade instructions
Identifies and tracks usage by all VMs
Available Data
Flow – VM Name & Id, Host
Counters - *IOPs, *LatencyPolicy – PolicyId, MinimumIOPs, MaximumIOPsSlide29
Storage QoS Policies
Defined on Scale-Out File Server
Applied to Hyper-V virtual disk
The rest is automatic
Scale-out File Server Cluster
Hyper-V Cluster
Virtual Machines
I/O
Sched
I/O
Sched
I/O
Sched
Policy
Manager
SMB3 Storage Network Fabric
Policy 1
Policy 2Slide30
Storage QoS Policies
Property
Example Value
Name
DesktopVM
PolicyID
8d730190-518f-4087-9362-3971255acf36MinimumIOPs100MaximumIOPs200TypeSingle InstanceMulti-Instance
MultiInstanceSlide31
Types of Policies
Single-InstanceResource distributed among VMsIdeal for representing a clustered workload, application, or tenant
Multi-Instance
All VMs perform the same
Ideal for creating per-VM performance tiers
MaximumIOPs
= 200
MaximumIOPs = 200Slide32
Sizing PoliciesSlide33
Maximum Only
No guaranteed minimum performanceEqual weight
Reduces variability compared with no policy at all
Can reserve capacity for later
Max=500Slide34
Minimum = Maximum
Most consistent performance for VMsUse to offer performance tiers to customers
No bursting
Performance weighted if over-capacity
100Slide35
Minimum < Maximum
Meets minimum performance SLAUse to offer performance tiers to customersVariable performance above minimum
Allows
for
burstingExcess capacity fairly distributed according to demand
Maximum enforcedMax=200
Min=100Slide36
Minimum Only
Meets minimum performance SLACan ensure important workloads deliver good performance
Highly variable above minimum
Excess
capacity fairly distributed according
to demandHighest overall capacity utilizedBest for burstingIndividual VM performance will degrade as load increased
Min=100Slide37
Single Instance for Tenant
1 Policy createdOverall MinimumIOPs, MaximumIOPs
Applied to each VM for tenant
Storage QoS adjusts based on demand
Can see dynamic Min/Max distributed among VMs within policySlide38
Creating Child Policies
Single-instance policies can be subdividedProvide specific allocations to tenant VMs
Tenant1
MinimumIOPs
= 1000
MaximumIOPs
= 1000
Tenant1_ImportantVm
MinimumIOPs
= 500
MaximumIOPs = 1000Slide39
Evaluating Windows Server Technical Preview
Storage QoS
Step by step deployment guide
http://go.microsoft.com/fwlink/?
LinkId=517877
* Be sure to check upgrade stepsHyper-V Management Scriptshttps://gallery.technet.microsoft.com/scriptcenter/Storage-QoS-script-for-a0d26330 Storage Survival GuideIncludes links to new features, step by step guides, scripts, and morehttp://blogs.technet.com/b/josebda/archive/2014/10/03/windows-server-technical-preview-storage-survival-guide.aspxSlide40
Scale-out File Server Cluster
Hyper-V Cluster
Virtual Machines
I/O
Sched
I/O
Sched
I/O
Sched
Policy
Manager
Rate
Limiters
Rate
Limiters
Rate
Limiters
Rate
Limiters
SMB3 Storage Network Fabric
Control
and monitor storage
performance
Flexible and customizable
Policy per VHD
, VM,
Service or Tenant
Define Minimum & Maximum IOPs
Fair distribution within policy
Simple out of box behavior
Enabled by default for Scale Out File Server
Automatic metrics (normalized IOPs & latency) per VM & VHD
Management
PowerShell
built-in for Hyper-V and SOFS
System Center VMM and Ops Manager
Storage
QoS
– Windows Server Technical Preview
CDP-B349: Storage Management in a Hybrid Cloud Environment with Windows Server and System Center (Thursday Oct 30 3.15 PM
)Slide41
Be Ready
Monitor storage performance & identify trouble signsUse the right strategy to deploy Storage
QoS
Deliver predictable performance in your private cloudSlide42
Storage Sessions in chronological order
CDP-B323: Delivering Predictable Storage Performance with Storage Quality of Service in Windows Server vNext (
Wednesday Oct
29 8:30 AM
)
CDP-B339: Leveraging SAN Replication for Enterprise-Grade Disaster Recovery with Microsoft Azure Site Recovery and System Center 2012 R2 (Wednesday Oct 29 3.15 PM)CDP-B352: Stretching Failover Clusters and Using Storage Replica for Disaster Recovery in Windows Server vNext (Wednesday Oct 29
5 pm)CDP-B349: Storage Management in a Hybrid Cloud Environment with Windows Server and System Center (Thursday Oct 30 3.15 PM)CDP-B325: Designing Scale-Out File Server with DAS Storage in Windows (Friday Oct 31 8.30 am)
Related Content
Find Me Later
At
the Hyper-V & Virtualization Booth Slide43
Come
visit us
in the Microsoft Solutions Experience (MSE)!
Look for the
Cloud and Datacenter Platform
area TechExpo
Hall 7For more information
Windows Server Technical Previewhttp://technet.microsoft.com/library/dn765472.aspx
Windows Server
Microsoft Azure
Microsoft Azure
http://azure.microsoft.com/en-us/
System Center
System Center Technical Preview
http://
technet.microsoft.com/en-us/library/hh546785.aspx
Azure Pack
Azure Pack
http://
www.microsoft.com/en-us/server-cloud/products/
windows-azure-packSlide44
Resources
Learning
Microsoft Certification & Training Resources
www.microsoft.com/learning
TechNet
Resources for IT Professionals
http://microsoft.com/technet
Sessions on Demand
http://channel9.msdn.com/Events/TechEd
Developer Network
http
://developer.microsoft.com Slide45
Please Complete An Evaluation FormYour input is important!
TechEd Schedule Builder
CommNet
station
or PC
TechEd Mobile
app
Phone or Tablet
QR codeSlide46
Evaluate this sessionSlide47
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.