MRP862 Nathan Rutman nathanrutmanxyratexcom Multiple clients write to multiple ranges within the same file Scientific apps mostly simulations Wide striping Different than FPP Locking model ID: 413528
Download Presentation The PPT/PDF document "Single-Shared File performance" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Single-Shared File performance
MRP-862
Nathan Rutman (nathan_rutman@xyratex.com)Slide2
Multiple clients write to multiple ranges within the same file
Scientific apps mostly - simulations
Wide stripingDifferent than FPPLocking modelReadaheadStripe alignment
SSF
Slide3
IOR and Lustre terms
Stripe Count
IOR Single Shared File
Segment 1
BlockSize
BlockSize
BlockSize
process 2
process 3
process 1
TransferSize
BlockSize
process 1
Stripe Count
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
Segment 2
BlockSize
BlockSize
BlockSize
process 2
process 3
process 1
Lustre data layout
TransferSize
TransferSize
StripeSize = 1MB default
strideSlide4
IOR - misaligned blocksize
Stripe Count
IOR Single Shared File
Segment 1
BlockSize
BlockSize
BlockSize
process 2
process 3
process 1
BlockSize
process 1
Stripe Count
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
TransferSize
TransferSize
TransferSize
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
Segment 2
LDLM lock splitting
drive head contention
BlockSize
BlockSize
BlockSize
process 2
process 3
process 1
Lustre data layout
TransferSize
TransferSize
TransferSize
TransferSize
TransferSize
TransferSize
extra, small bulk RPCsSlide5
IOR Single Shared File
Segment 1
IOR - small blocksize
Stripe Count
Segment 2
Stripe Count
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
TransferSize
BlockSize
proc 2
BlockSize
proc 3
BlockSize
proc 4
TransferSize
TransferSize
BlockSize
proc 1
BlockSize
proc 2
BlockSize
proc 3
BlockSize
proc 4
BlockSize
proc 5
BlockSize
proc 6
BlockSize
proc 7
BlockSize
proc 8
TransferSize
BlockSize
proc 2
BlockSize
proc 3
BlockSize
proc 4
TransferSize
TransferSize
BlockSize
proc 1
BlockSize
proc 2
BlockSize
proc 3
BlockSize
proc 4
BlockSize
proc 5
BlockSize
proc 6
BlockSize
proc 7
BlockSize
proc 8
Lustre data layout
LDLM lock splitting
drive contentionSlide6
IOR - large blocksize
Stripe Count
IOR Single Shared File
Segment 1
BlockSize
BlockSize
BlockSize
process 2
process 3
process 1
BlockSize
process 4
Stripe Count
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
TransferSize
TransferSize
TransferSize
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
drive contention
Lustre data layout
TransferSize
TransferSize
TransferSize
TransferSize
TransferSizeSlide7
IOR - ideal
Stripe Count
IOR Single Shared File
Segment 1
Segment 2
Stripe Count
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
StripeSize
StripeSize
StripeSize
StripeSize
stripe 1
stripe 2
stripe 3
stripe 4
TransferSize
BlockSize
BlockSize
proc 1
proc 2
BlockSize
proc 3
BlockSize
proc 4
TransferSize
TransferSize
TransferSize
BlockSize
BlockSize
proc 1
proc 2
BlockSize
proc 3
BlockSize
proc 4
TransferSize
Lustre data layout