with Dell and Microsoft Storage Spaces Syama Poluri Senthil Baladhandayutham Brief Introduction to Storage Spaces Hardware Support amp Capabilities Deployment Considerations VDI Performance amp Efficiency using Storage Spaces ID: 574063
Download Presentation The PPT/PDF document "Maximizing Storage efficiency" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Maximizing Storage efficiencywith Dell and Microsoft Storage Spaces
Syama PoluriSenthil BaladhandayuthamSlide2
Brief Introduction to Storage SpacesHardware Support & CapabilitiesDeployment ConsiderationsVDI Performance & Efficiency using Storage Spaces
Dell-Microsoft ValueQ&A:You will also find us at the Dell booth
AgendaSlide3
Introduction to Storage SpacesSlide4
Microsoft’s infrastructure-as-a service storage vision
Lowers the costs and effort of delivering storage services
Disaggregated compute and storage
Independently
manage and scale at each layer
Industry standard servers, networking and storage
Affordable networks
Affordable shared JBOD storageTarget MarketService Providers Private Cloud Scenarios
JBOD storage
Server Message Block (SMB)
PowerShell & SCVMM 2012 R2 Management
Scale-out file server clusters
Storage Space
Storage Space
Storage Space
Hyper-V clustersSlide5
A
nno
u
n
c
i
ng
Windows Storage Spaces support on high density Dell PowerVault MD3060e JBOD60 – 3.5” or 2.5” SAS drives4U
Dual EMM’s
Dual power supply units
What’s new?
Storage Spaces compatible EMM firmwareStorage Enclosure Management SoftwareDocumentation Slide6
PowerEdge rack servers
Excellent performance, functionality and outstanding reliability. Complete portfolio of 1-, 2-, and 4-socket rack servers designed to reduce complexity and deliver superior value.
High quality and reliability at a consistently low acquisition cost with exceptional price for performance. Complete tower server portfolio with a side choice of performance and functionality.
PowerEdge tower servers
MD1200 : 2U
– 12 drive 3.5”
enclosure
MD1220 : 2U – 24 drive 2.5” enclosureSupports Nearline, 10K and 15K RPM SAS HDDs and SAS SSDsConnectivity : Dell SAS 6Gb/s HBA
SAS Ports : 4
PowerVault MD1200/ MD1220 storage4U – 60 drive 3.5” enclosureSupports 2.5” and 3.5” drives
Supports Nearline, 10K and 15K RPM SAS HDDs and SAS SSDs
Connectivity : LSI 9207-8eSAS Ports : 6PowerVault MD3060e storageDell PowerEdge and PowerVaultStorage-optimized servers and scalable, cost-effective external storage*MD3060e dense JBOD enclosures validated with R620, R720, R720xd onlySlide7
Mirror/Parity Storage Spaces (Resilience, Flexibility)Native Data Striping (Performance)Enclosure Awareness (Resilience)
Storage Tiering (Performance, Flexibility)Write Back Cache (Performance) HW and Spaces Management (Management, Monitoring)
Storage
Spaces CapabilitiesSlide8
Pooling of disks
Flexible resilient storage spaces
Native data striping
Enclosure awareness
Parallelized rebuild of failed drives
Capabilities Overview - Resiliency,
Flexibility
Storage Pool
Storage Spaces
Data Copy 1
Data Copy 2Mirror SpaceMirror SpaceParity Space
Mirror Space …
…
Physical Disks from Shared SAS JBODsDisk Failure!Data is rebuilt to multiple disks simultaneously, using spare capacitySlide9
Automated movement of hot/cold data between SSD and HDDUse the best capabilities of HDD for capacity, and SSD for performance in a single volume
Sub-File-Level Data MovementAdmins can override automatic placement, and pin files to a Tier
Can be used, for example, to offer different performance levels to different workloads
Example : VM’s VHD in Pooled VDI scenario
WBC absorbs
write bursts
Improved performance for real-world workloads
SSDs absorb random writes at high IOPs levelsTiering and Write Back Cache (WBC)
Compute Nodes
SSD
Tier
HDD
Tier
I/O Activity Accumulates Heat on Sub-File GranularitySlide10
Write Back Cache and Tiering DemoSyama PoluriSlide11
JBOD HealthEMMPower Supply Fans
Voltage SensorsCurrent SensorsPhysical Disk HealthStorage Pool Health Storage
Space Health
Additional monitoring for Storage Enclosure Health
with
http://
support.microsoft.com/kb/2913766
Monitoring HealthSlide12
JBOD Hardware Monitoring DemoSyama PoluriSlide13
Planning a DeploymentSlide14
Capacity NeedsOverhead necessary for resiliencyResiliency NeedsHow many drive failures must the deployment sustain?
Number of JBODs required for Enclosure AwarenessPerformance NeedsUnderstanding workload IO requirements and characteristicsCan start to characterize based on raw IOPS and Throughput
High Availability and Failover needs
Number for fileserver nodes
Multipath requirement / Number of SAS HBA(s) per Server
Choose SSDs, HDDs, JBODs, and
Servers
Planning a DeploymentSlide15
Stripe SizeAmount of date written to spaces in one passNumber of Data Columns
Number physical disk across with one stripe of date is written InterleaveAmount of date written to a single column per Stripe(Default 256 KB)
Understanding Columns , Interleave and Stripe Size
1
2
3
4
5
6
Spaces layout for 2 column 2-way mirror
2 Data Columns
2 Data Copies
Minimum number of drives required to optimally expand storage space
:
Columns x CopiesSlide16
Resiliency schemes have different capacity overhead and drive/enclosure requirements
Capacity and Resiliency Planning
Resiliency Scheme
Resilient to Minimum # of Disk Failures
Capacity Efficiency
Minimum Number of Enclosures
Required for EA
Min.Disks Required for Clustered SpacesRecommended WorkloadsSimple0100%N/A3Suitable for workloads
where resiliency is not required, or provided by another mechanism.
Two-Way Mirror150.0%33Recommended for all workloads(Ex:VDI)
Three-Way Mirror
233.3%35Dual Parity (4+3 LRC)257.1%47Recommended for archival workloads.Slide17
Don’t utilize all available capacity in the pool upfront!Need to reserve capacity for:Reserved capacity in the pool for parallel rebuild
(at least 2 physical disks worth)Expansion of SSD tiers on Tiered Volumes as workloads become established and predictableIn tiered spaces column count must be identical between the HDD and SSD tiers
Maximum
recommended for clustered storage spaces
Up to 80 physical disks in a clustered storage pool
Up to 4 storage pools per cluster
Up to 64 storage spaces in a single pool
Up to 480 TB of capacity in a single storage poolCapacity Planning (2)Slide18
Resiliency schemes have different ideal performance characteristicsStart with single drive performance to extrapolate expected performance with Spaces
General Performance Planning (1)
Tested with 7200 RPM SAS HDDs, no WBC, maximum of 8 columns, 2-way mirror. Queue depth was maintained consistent between tests at an effective 3 QD/Disk to attain an average latency of at most 30msSlide19
Ensure you have sufficient SSDs in the pool for WBC to match number of data copies on virtual diskEnsure sufficient hardware (Compute, Memory ,PCI-E Slots etc.) to drive Throughput and
IOPSEnsure all latest OS updates are installedConsider starting with the defaults for advanced settingsColumn Count
Interleave
Write-Back Cache Size
Storage Spaces Performance Paper:
http://
social.technet.microsoft.com/wiki/contents/articles/15200.storage-spaces-designing-for-performance.aspx
General Performance Planning (2)Slide20
Design for what’s practical for number of drive slotsSpaces doesn’t constrain the number of SSDs or SSD capacity
Invest in sufficient number of SSDs for:Sufficient column count for both SSD and HDD tiersSufficient throughput and IOPS from SSD tierRecommended minimum number of SSDs:
Buy as much SSD capacity as your workload’s working set size
.
Sizing guidance for Tiered Spaces
Resiliency Type
24-bay
JBOD(2 columns)60-bay JBOD(4 columns)Two-Way Mirror48Three-Way Mirror
6
12Slide21
VDI Deployment Using Storage SpacesSlide22
Microsoft VDI Deployment Choices
Pooled Desktops
Personal Desktops
OS/APPS data
user data
Diff disks
Diff disks
Diff
DISKS
Diff disks
Diff disks
Diff disks
Diff disks
Diff disks
Diff disks
Diff disksSlide23
Market Challenges to VDI Adoption
Barriers of Entry
High storage cost
Linear predictable Scale
Complex storage configuratio
nSlide24
Windows 2012R2 Storage Features Value in Practice
Hot Data
Cold Data
Storage Spaces
Software configurable storage that scales with linear cost(Pay as you grow)
Improved performance with storage
tiering
Barriers of Entry
High storage cost
Linear predictable Scale
Complex storage configuratio
n
Data- deduplication
Storage cost savings by leveraging data de-duplicationSlide25
Dell–Microsoft Value in Practice
Hot Data
Cold Data
Storage Spaces certified JBOD’s to take advantage of latest features
PowerShell API integration to monitor health of JBOD
Pre-validated VDI workload optimized configurations
By leveraging Windows
storage
features and optimizing the solution for cost and
performance, Dell-Microsoft
VDI Solution offers
cost-optimized
solution at linear scale for pooled and persistent desktopsSlide26
CSV Cache
VDI Storage Optimizations in 2012R2
Storage Spaces with
SSD or HDD
Storage Spaces with SSD & HDD
Data Deduplication
Read I/O served from CSV cache helping Bootstorm & LoginStorm
SSD serving hot data absorbing boot and login spikes. WBC cache absorbs write spikes
Chunk Store
Capacity
s
avings through deduplication
Read I/O served from chunk store
Pooled Desktop
Persistent Desktop
Pinning gold image to SSD tier, improving boot performanceSlide27
VDI Deployment Scale TestingWorkload Configuration
System Under Test ConfigurationPerformance of Pooled desktops with Storage SpacesPerformance of Personal desktops with Storage SpacesDemo of Key TechnologiesSlide28
Workload ConfigurationSlide29
Test configuration & Success Criteria
Test Success Criteria:
Linear Performance
Optimized cost across pooled
& persistent desktops
LoginVsi
Medium
Workload Configuration:
JBOD Under Test:
1* MD1220(24 disks)Slide30
System under Test Configuration
Configuration :1*MD1220(24 Disks)Dell PowerEdge R720 with SOFS
Spaces: 2-way Mirror
5*Hyper-v nodes each running up to 150 Windows 8.1 VDI VM’sSlide31
Performance of Storage Spaces with Pooled VDI DeploymentSlide32
Gold Image: 25GBUser Profile Disk VHD: 1GB/UserDiff Disk size @Steady State: 3.5 GB /user*
Pooled Desktop Storage Allocation
Provision
Boot
Login
Steady State
Logoff
Diff Disk Capacity/VM
1GB
1.5GB
2.0 GB
3-4 GB1.5 GB100 Pooled VM sizing :25GB +(100*1GB)+3.5 *100GB =475GB
*Diff Disk size varies based on size of VM RAM. Test VM was assigned 2.5 GB memory.Slide33
Pooled Desktop Scalability Results
Configuration
Users
Consumed Capacity
Usable Capacity
Total
IOPS
IOPS from SSDIOPS/user4*400GB SSD150700GB750GB3100100%
20.7
4*400GB SSD20*1TB(7.2k)HDDTiering OnWBC=1GB3501.5TB10TB
7840
7000 SSD840 HDD90%22.44*400GB SSD20*1TB(7.2k)HDDTiering OnWBC=1GB7003 TB10TB1624012240 SSD4000 HDD80%23.2Configuration :1*MD1220(24 Disks)Spaces: MirrorResultsLinear Performance
4*400GB SSD20*7.2K 1TB HDDCold DataHot Data
93% Capacity used
4*400GB SSD4*400GB SSD
Most IOPS served from SSD
Linear scaling with SSD’s but at a high cost
Hit SAS HDD latency & IOPS limitsSlide34
Consider storage capacity in-addition to IOPS when sizing pooled desktopsIf high performance and cost is not a barrier,
choose single tier SSD configurations To balance cost and performance with linear scale,
choose tiered configurations with SSD & HDD
Pin
the parent VHD of pooled desktop
collections
to the SSD tierPooled Desktop Results SummarySlide35
Performance of Storage Spaces with Persistent VDI DeploymentSlide36
ConfigurationMD1220,4*400GB SSD, 20*7.2k 1TB150 Persistent users with
tiering , with and without dedupe
Impact of de-dupe on persistent desktops
67% savings
on Read IOPS
1.5X write penalty
with
dedupe. No impact to performance as most IOPS were served from SSD due to Tiering
.
No impact to Total IOPSUp to 90% Capacity savings after provisioning
4*400GB SSD
2
0*7.2K 1TB HDDSlide37
Persistent Desktop Scalability Results
Configuration
Users
Total
IOPS
IOPS from SSD
Capacity
SavingsIOPS/user4*400GB SSD20*1TB(7.2k)HDDDedupe +Tiering1503208100%92%21.3350
7952
90%88%22.727001610080%86%
23
Configuration:1*MD1220(24 Disks)Spaces:2-Way MirrorDedupe 1st+ Tiering 2ndResultsLinear IOPSPerformance from TieringCapacity savings from Dedupe
4*400GB SSD20*7.2K 1TB HDDSlide38
Leverage data deduplication to reduce the capacity needs of personal desktops
Provision VM’s across multiple smaller volumes to improve dedupe and provisioning performance
For
balanced cost
, choose a configuration with SSD & HDD
Run storage
tiering
after dedupe to increase steady state performancePersonal Desktop Results SummarySlide39
Total users:700Validated configuration was able to deliver
same cost/user for both persistent and pooled desktopsLinear IOPS was
achieved for persistent and pooled desktops
Overall Result Summary
Total
IOPS
IOPS/user
Pooled1624023Persistent1610023Slide40
Demo: VDI DemoSenthil
Baladhandayutham - DellSlide41
Data Center Networking
Dell Management Software and Plug-ins for System Center
Scale-out file server clusters
Storage Space
Storage Space
Storage Space
Hyper-V clusters
Dell PowerVault JBOD Storage
Dell PowerEdge Servers
Dell Network Switches
Dell PowerEdge Servers
Dell & Microsoft Key Value
Dell-Microsoft End –End Solutions (VDI,Private Cloud)Slide42
“Dell is Microsoft’s largest OEM partner to have implemented support for Storage Spaces.
Dell provides the most complete Storage Spaces implementation – server, controller, JBOD and disks form an end-to-end solution, and this support includes new features such as JBOD monitoring.”
Microsoft Server and Cloud Platform Team
February 11, 2014
TechNet Server & Cloud BlogSlide43
Leverage the power of Dell and Microsoft alliance
Joint IP/development
Engineering labs, technology centers, centers of excellence
US Windows Deployment Partner of the Year
2 years running
Most complete
Full, end-to-end capabilities – from tablets to the data center
Global Solutions Centers
Demonstrate the full Microsoft stack
running on Dell
Single Point of Contact
Dell provides a single contact for total solution
TAPs participation
Board participation in Technology Adoption Programs
US Windows Partner of the Year
2013Slide44
Dell-VDI Storage Spaces whitepaper
Related content
Dell PowerVault Enclosure Health Monitoring
Deploying Storage Spaces with Dell PowerVault
Manuals & documentation for
PowerVault MD3060e
Session
DCIM-B346 by Bryan Mathew
Find Us Later At Dell
Booth .
. . Slide45
Complete an evaluation
and
enter to win!Slide46
Appendix : Capabilities Overview - write-back cache
Cache absorbs write bursts
Improved performance for real-world workloads
SSDs absorb random writes at high IOPs levels
Helps smooth workloads which are
bursty
, reducing seeks on HDDs
WBC uses SSD capacityComplements tiered storageIOs with block size <256KB can be cached
Storage Spaces
Data De-Stage
Solid State Drives (SSD) Tier
Hard Disk Drives (HDD) Tier
Reads/Writes Accumulates Data Activity
Hyper-V Compute Nodes
Seamless IntegrationSlide47
Report generated after invoke of Tier Optimizationdefrag /c /g /h (optimizes all volumes)defrag <drive letter> /g /h (optimizes single drive)
Performance counters on physical disksAppendix: Tiering Perf Tools
PS C:\> defrag
/c /g /h
Microsoft Drive Optimizer
Copyright (c) 2013 Microsoft Corp.
Invoking tier optimization on New Volume (T:, C:\ClusterStorage\Pool1-CSV2
)...
The operation completed successfully.
Post Defragmentation Report: Volume Information: Volume size = 62.83 TB Free space = 45.43 TB Storage Tier Optimization Report: % I/Os Serviced from SSD SSD Tier Size Required
100% 2.52 TB 95% 1.31 TB * 90% 1.12 TB <snipped> * Current size of the faster (SSD) tier: 1.46 TB Percent of total I/Os serviced from the SSD tier: 87% Size of files pinned to the SSD tier: 0 bytes Percent of total I/Os: 0% Size
of files pinned to the HDD tier: 0 bytes
Percent of total I/Os: 0%Slide48
Insufficient SSD capacity if ideal I/O distribution too lowCan expand SSD Tier with capacity reserved earlier or with additional SSDs
Can re-balance subset of workloads to volumes with greater ideal I/O distributionsAppendix
: Optimizing Performance of Tiered Volumes
Ideal I/O distribution with current SSD tier size for the current workloads
Total
I/O Tracked by Tiering Engine
(indicates the majority of I/O)
Current I/O distribution post-optimization
High workload churn
if current I/O distribution
does not improve after successive scheduled optimization runsCan immediately run optimizationCan increase the frequency of optimization schedule (see appendix)Can pin workloads expected to generate high churn to SSD tierSlide49
Appendix : Certified JBOD enclosures for Windows Server 2012 R2 Storage Spaces
Supports SAS and SCSI Enclosure Services (SES) protocolAllows controller to send and receive diagnostic information to connected storage devices
PowerVault MD1220
By Dell Inc
PowerVault MD1200
By Dell Inc
PowerVault MD3060e
By Dell Inc