== sanity test 123ad: Verify batching statahead works correctly ========================================================== 02:44:21 (1789713861) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats=0 llite.lustre-ffff8d2508ac3000.statahead_max=32 llite.lustre-ffff8d2508ac3000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats=0 total: 100 open/close in 0.75 seconds: 133.05 ops/second llite.lustre-ffff8d2508ac3000.statahead_max=0 101 real 0m0.674s user 0m0.000s sys 0m0.248s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8d2508ac3000.statahead_max=32 llite.lustre-ffff8d2508ac3000.statahead_max=32 101 real 0m0.360s user 0m0.001s sys 0m0.222s 'ls -l' 100 files with statahead: 0 sec statahead total: 81 statahead wrong: 1 agl total: 76 list_total: 28 fname_total: 53 hit_total: 14121 miss_total: 248 swrong=1 ewrong=1 total: 900 open/close in 2.15 seconds: 417.92 ops/second llite.lustre-ffff8d2508ac3000.statahead_max=0 1001 real 0m5.796s user 0m0.024s sys 0m2.093s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8d2508ac3000.statahead_max=32 llite.lustre-ffff8d2508ac3000.statahead_max=32 1001 real 0m3.362s user 0m0.012s sys 0m1.766s 'ls -l' 1000 files with statahead: 3 sec statahead total: 82 statahead wrong: 1 agl total: 77 list_total: 29 fname_total: 53 hit_total: 15120 miss_total: 249 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8d2508ac3000.statahead_stats= statahead total: 82 statahead wrong: 1 agl total: 77 list_total: 29 fname_total: 53 hit_total: 15120 miss_total: 249 mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats= snapshot_time: 1789713886.007578167 secs.nsecs start_time: 1789713862.865368563 secs.nsecs elapsed_time: 23.142209604 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 4386 (time 1789713897.47 total 10.00 last 438.60) - open/close 9196 (time 1789713907.47 total 20.00 last 480.95) total: 10000 open/close in 21.81 seconds: 458.40 ops/second llite.lustre-ffff8d2508ac3000.statahead_batch_max=0 llite.lustre-ffff8d2508ac3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.794s user 0m0.172s sys 0m29.745s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8d2508ac3000.statahead_batch_max=32 llite.lustre-ffff8d2508ac3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.068s user 0m0.170s sys 0m20.854s batched statahead RPC= hit count=9997 mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats= snapshot_time: 1789713985.235863450 secs.nsecs start_time: 1789713943.576331051 secs.nsecs elapsed_time: 41.659532399 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats=0 llite.lustre-ffff8d2508ac3000.statahead_max=2048 llite.lustre-ffff8d2508ac3000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats=0 total: 100 open/close in 0.68 seconds: 146.56 ops/second llite.lustre-ffff8d2508ac3000.statahead_max=0 101 real 0m0.575s user 0m0.003s sys 0m0.211s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff8d2508ac3000.statahead_max=2048 llite.lustre-ffff8d2508ac3000.statahead_max=2048 101 real 0m0.306s user 0m0.002s sys 0m0.178s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10096 miss_total: 4 swrong=0 ewrong=0 total: 900 open/close in 1.79 seconds: 502.38 ops/second llite.lustre-ffff8d2508ac3000.statahead_max=0 1001 real 0m5.361s user 0m0.023s sys 0m1.961s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff8d2508ac3000.statahead_max=2048 llite.lustre-ffff8d2508ac3000.statahead_max=2048 1001 real 0m3.172s user 0m0.011s sys 0m1.835s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 swrong=0 ewrong=0 - open/close 4801 (time 1789714096.95 total 10.01 last 479.83) total: 9000 open/close in 19.06 seconds: 472.15 ops/second llite.lustre-ffff8d2508ac3000.statahead_max=0 10001 real 0m56.525s user 0m0.230s sys 0m20.408s 'ls -l' 10000 files without statahead: 57 sec llite.lustre-ffff8d2508ac3000.statahead_max=2048 llite.lustre-ffff8d2508ac3000.statahead_max=2048 10001 real 0m23.556s user 0m0.154s sys 0m17.523s 'ls -l' 10000 files with statahead: 24 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21094 miss_total: 6 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 70 seconds llite.lustre-ffff8d2508ac3000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21094 miss_total: 6 mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats= snapshot_time: 1789714266.324316363 secs.nsecs start_time: 1789713986.026246049 secs.nsecs elapsed_time: 280.298070314 secs.nsecs subreqs per batch batches %% cum %% 1: 314 64 64 2: 43 8 73 4: 43 8 82 8: 16 3 85 16: 3 0 86 32: 26 5 91 64: 0 0 91 128: 2 0 92 256: 38 7 100 - open/close 4023 (time 1789714277.18 total 10.00 last 402.27) - open/close 8989 (time 1789714287.18 total 20.00 last 496.59) total: 10000 open/close in 21.95 seconds: 455.48 ops/second llite.lustre-ffff8d2508ac3000.statahead_batch_max=0 llite.lustre-ffff8d2508ac3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.747s user 0m0.151s sys 0m22.788s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8d2508ac3000.statahead_batch_max=256 llite.lustre-ffff8d2508ac3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m21.719s user 0m0.145s sys 0m16.745s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8d2508ac3000.batch_stats= snapshot_time: 1789714343.842943335 secs.nsecs start_time: 1789714318.228420839 secs.nsecs elapsed_time: 25.614522496 secs.nsecs subreqs per batch batches %% cum %% 1: 202 55 55 2: 47 12 68 4: 41 11 80 8: 8 2 82 16: 4 1 83 32: 25 6 90 64: 0 0 90 128: 0 0 90 256: 35 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8d2508ac3000.statahead_batch_max=64 llite.lustre-ffff8d2508ac3000.statahead_max=128