== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:17:31 (1789370251) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats=0 llite.lustre-ffff8c86fbe1a800.statahead_max=32 llite.lustre-ffff8c86fbe1a800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats=0 total: 100 open/close in 0.62 seconds: 160.54 ops/second llite.lustre-ffff8c86fbe1a800.statahead_max=0 101 real 0m0.590s user 0m0.001s sys 0m0.221s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c86fbe1a800.statahead_max=32 llite.lustre-ffff8c86fbe1a800.statahead_max=32 101 real 0m0.386s user 0m0.000s sys 0m0.217s 'ls -l' 100 files with statahead: 0 sec statahead total: 58 statahead wrong: 1 agl total: 54 list_total: 27 fname_total: 31 hit_total: 13644 miss_total: 218 swrong=1 ewrong=1 total: 900 open/close in 1.98 seconds: 455.32 ops/second llite.lustre-ffff8c86fbe1a800.statahead_max=0 1001 real 0m5.557s user 0m0.013s sys 0m1.942s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff8c86fbe1a800.statahead_max=32 llite.lustre-ffff8c86fbe1a800.statahead_max=32 1001 real 0m3.319s user 0m0.022s sys 0m1.827s 'ls -l' 1000 files with statahead: 4 sec statahead total: 59 statahead wrong: 1 agl total: 55 list_total: 28 fname_total: 31 hit_total: 14643 miss_total: 219 swrong=1 ewrong=1 - open/close 4611 (time 1789370280.53 total 10.00 last 461.05) total: 9000 open/close in 19.82 seconds: 454.03 ops/second llite.lustre-ffff8c86fbe1a800.statahead_max=0 10001 real 0m55.877s user 0m0.188s sys 0m19.506s 'ls -l' 10000 files without statahead: 55 sec llite.lustre-ffff8c86fbe1a800.statahead_max=32 llite.lustre-ffff8c86fbe1a800.statahead_max=32 10001 real 0m34.881s user 0m0.152s sys 0m19.483s 'ls -l' 10000 files with statahead: 35 sec statahead total: 60 statahead wrong: 1 agl total: 56 list_total: 29 fname_total: 31 hit_total: 24642 miss_total: 220 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 69 seconds llite.lustre-ffff8c86fbe1a800.statahead_stats= statahead total: 60 statahead wrong: 1 agl total: 56 list_total: 29 fname_total: 31 hit_total: 24642 miss_total: 220 mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats= snapshot_time: 1789370459.967769578 secs.nsecs start_time: 1789370253.260192357 secs.nsecs elapsed_time: 206.707577221 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 1 0 0 8: 3 0 1 16: 4 1 2 32: 346 97 100 - open/close 2888 (time 1789370471.07 total 10.00 last 288.75) - open/close 7019 (time 1789370481.07 total 20.00 last 413.03) total: 10000 open/close in 26.51 seconds: 377.21 ops/second llite.lustre-ffff8c86fbe1a800.statahead_batch_max=0 llite.lustre-ffff8c86fbe1a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.830s user 0m0.142s sys 0m40.036s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c86fbe1a800.statahead_batch_max=32 llite.lustre-ffff8c86fbe1a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.375s user 0m0.160s sys 0m21.501s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats= snapshot_time: 1789370575.226423344 secs.nsecs start_time: 1789370531.955077875 secs.nsecs elapsed_time: 43.271345469 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats=0 llite.lustre-ffff8c86fbe1a800.statahead_max=2048 llite.lustre-ffff8c86fbe1a800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats=0 total: 100 open/close in 1.13 seconds: 88.54 ops/second llite.lustre-ffff8c86fbe1a800.statahead_max=0 101 real 0m0.897s user 0m0.007s sys 0m0.236s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c86fbe1a800.statahead_max=2048 llite.lustre-ffff8c86fbe1a800.statahead_max=2048 101 real 0m0.378s user 0m0.003s sys 0m0.186s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 8.13 seconds: 110.73 ops/second llite.lustre-ffff8c86fbe1a800.statahead_max=0 1001 real 0m11.937s user 0m0.026s sys 0m2.544s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff8c86fbe1a800.statahead_max=2048 llite.lustre-ffff8c86fbe1a800.statahead_max=2048 1001 real 0m2.777s user 0m0.018s sys 0m1.416s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff8c86fbe1a800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats= snapshot_time: 1789370721.300660635 secs.nsecs start_time: 1789370576.152425214 secs.nsecs elapsed_time: 145.148235421 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 2729 (time 1789370732.53 total 10.01 last 272.74) - open/close 4323 (time 1789370742.54 total 20.01 last 159.33) - open/close 5836 (time 1789370752.55 total 30.02 last 151.16) - open/close 7603 (time 1789370762.55 total 40.02 last 176.68) - open/close 9415 (time 1789370772.55 total 50.02 last 181.13) total: 10000 open/close in 55.37 seconds: 180.60 ops/second llite.lustre-ffff8c86fbe1a800.statahead_batch_max=0 llite.lustre-ffff8c86fbe1a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.796s user 0m0.281s sys 0m14.367s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c86fbe1a800.statahead_batch_max=256 llite.lustre-ffff8c86fbe1a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.945s user 0m0.213s sys 0m14.876s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c86fbe1a800.batch_stats= snapshot_time: 1789370880.286334453 secs.nsecs start_time: 1789370841.949051863 secs.nsecs elapsed_time: 38.337282590 secs.nsecs subreqs per batch batches %% cum %% 1: 113 47 47 2: 19 7 55 4: 25 10 65 8: 13 5 71 16: 13 5 76 32: 12 5 81 64: 7 2 84 128: 1 0 85 256: 35 14 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c86fbe1a800.statahead_batch_max=64 llite.lustre-ffff8c86fbe1a800.statahead_max=128