== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:43:03 (1780386183) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats=0 llite.lustre-ffff9a02080d1000.statahead_max=32 llite.lustre-ffff9a02080d1000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats=0 total: 100 open/close in 1.84 seconds: 54.21 ops/second llite.lustre-ffff9a02080d1000.statahead_max=0 101 real 0m1.536s user 0m0.005s sys 0m0.299s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a02080d1000.statahead_max=32 llite.lustre-ffff9a02080d1000.statahead_max=32 101 real 0m0.562s user 0m0.002s sys 0m0.184s 'ls -l' 100 files with statahead: 1 sec statahead total: 121 statahead wrong: 2 agl total: 115 list_total: 31 fname_total: 74 hit_total: 3681 miss_total: 1419 swrong=2 ewrong=2 total: 900 open/close in 8.51 seconds: 105.77 ops/second llite.lustre-ffff9a02080d1000.statahead_max=0 1001 real 0m14.865s user 0m0.029s sys 0m2.927s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffff9a02080d1000.statahead_max=32 llite.lustre-ffff9a02080d1000.statahead_max=32 1001 real 0m5.085s user 0m0.017s sys 0m1.892s 'ls -l' 1000 files with statahead: 5 sec statahead total: 122 statahead wrong: 2 agl total: 116 list_total: 32 fname_total: 74 hit_total: 4680 miss_total: 1420 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff9a02080d1000.statahead_stats= statahead total: 122 statahead wrong: 2 agl total: 116 list_total: 32 fname_total: 74 hit_total: 4680 miss_total: 1420 mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats= snapshot_time: 1780386240.326891943 secs.nsecs start_time: 1780386186.022061161 secs.nsecs elapsed_time: 54.304830782 secs.nsecs subreqs per batch batches % cum % 1: 2 4 4 2: 0 0 4 4: 1 2 7 8: 2 4 12 16: 2 4 17 32: 34 82 100 - open/close 1149 (time 1780386251.72 total 10.01 last 114.81) - open/close 2298 (time 1780386261.72 total 20.01 last 114.90) - open/close 3422 (time 1780386271.72 total 30.01 last 112.38) - open/close 4727 (time 1780386281.72 total 40.01 last 130.44) - open/close 6148 (time 1780386291.72 total 50.01 last 142.09) - open/close 7727 (time 1780386301.73 total 60.02 last 157.87) - open/close 9226 (time 1780386311.73 total 70.02 last 149.84) total: 10000 open/close in 75.09 seconds: 133.17 ops/second llite.lustre-ffff9a02080d1000.statahead_batch_max=0 llite.lustre-ffff9a02080d1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a02080d1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.872s user 0m0.245s sys 0m28.455s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a02080d1000.statahead_batch_max=32 llite.lustre-ffff9a02080d1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a02080d1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.284s user 0m0.217s sys 0m18.905s batched statahead RPC= hit count=9989 mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats= snapshot_time: 1780386410.565827517 secs.nsecs start_time: 1780386355.855031889 secs.nsecs elapsed_time: 54.710795628 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats=0 llite.lustre-ffff9a02080d1000.statahead_max=2048 llite.lustre-ffff9a02080d1000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats=0 total: 100 open/close in 0.92 seconds: 108.27 ops/second llite.lustre-ffff9a02080d1000.statahead_max=0 101 real 0m1.021s user 0m0.002s sys 0m0.301s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a02080d1000.statahead_max=2048 llite.lustre-ffff9a02080d1000.statahead_max=2048 101 real 0m0.434s user 0m0.007s sys 0m0.242s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10088 miss_total: 12 swrong=0 ewrong=0 total: 900 open/close in 5.79 seconds: 155.36 ops/second llite.lustre-ffff9a02080d1000.statahead_max=0 1001 real 0m11.138s user 0m0.027s sys 0m2.831s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff9a02080d1000.statahead_max=2048 llite.lustre-ffff9a02080d1000.statahead_max=2048 1001 real 0m3.538s user 0m0.022s sys 0m1.918s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11087 miss_total: 13 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff9a02080d1000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11087 miss_total: 13 mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats= snapshot_time: 1780386578.370638486 secs.nsecs start_time: 1780386411.646544038 secs.nsecs elapsed_time: 166.724094448 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 2139 (time 1780386589.42 total 10.00 last 213.81) - open/close 3958 (time 1780386599.42 total 20.01 last 181.84) - open/close 5966 (time 1780386609.43 total 30.01 last 200.76) - open/close 7811 (time 1780386619.43 total 40.02 last 184.38) - open/close 9436 (time 1780386629.44 total 50.02 last 162.43) total: 10000 open/close in 53.66 seconds: 186.36 ops/second llite.lustre-ffff9a02080d1000.statahead_batch_max=0 llite.lustre-ffff9a02080d1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a02080d1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.854s user 0m0.225s sys 0m27.368s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a02080d1000.statahead_batch_max=256 llite.lustre-ffff9a02080d1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a02080d1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.617s user 0m0.210s sys 0m21.044s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a02080d1000.batch_stats= snapshot_time: 1780386707.882226313 secs.nsecs start_time: 1780386670.905755188 secs.nsecs elapsed_time: 36.976471125 secs.nsecs subreqs per batch batches % cum % 1: 309 63 63 2: 60 12 75 4: 37 7 83 8: 16 3 86 16: 4 0 87 32: 25 5 92 64: 1 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a02080d1000.statahead_batch_max=64 llite.lustre-ffff9a02080d1000.statahead_max=128