== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:36:49 (1781278609) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats=0 llite.lustre-ffff8a7b5a36b800.statahead_max=32 llite.lustre-ffff8a7b5a36b800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats=0 total: 100 open/close in 2.97 seconds: 33.71 ops/second llite.lustre-ffff8a7b5a36b800.statahead_max=0 101 real 0m2.314s user 0m0.005s sys 0m0.337s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a7b5a36b800.statahead_max=32 llite.lustre-ffff8a7b5a36b800.statahead_max=32 101 real 0m1.122s user 0m0.007s sys 0m0.221s 'ls -l' 100 files with statahead: 1 sec statahead total: 118 statahead wrong: 2 agl total: 112 list_total: 29 fname_total: 61 hit_total: 3886 miss_total: 1734 swrong=2 ewrong=2 - open/close 610 (time 1781278636.60 total 10.01 last 60.95) total: 900 open/close in 14.99 seconds: 60.03 ops/second llite.lustre-ffff8a7b5a36b800.statahead_max=0 1001 real 0m24.639s user 0m0.036s sys 0m3.330s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff8a7b5a36b800.statahead_max=32 llite.lustre-ffff8a7b5a36b800.statahead_max=32 1001 real 0m10.994s user 0m0.041s sys 0m1.758s 'ls -l' 1000 files with statahead: 11 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 30 fname_total: 61 hit_total: 4884 miss_total: 1736 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff8a7b5a36b800.statahead_stats= statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 30 fname_total: 61 hit_total: 4884 miss_total: 1736 mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats= snapshot_time: 1781278714.497495291 secs.nsecs start_time: 1781278614.018302632 secs.nsecs elapsed_time: 100.479192659 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 575 (time 1781278727.01 total 10.01 last 57.44) - open/close 1193 (time 1781278737.02 total 20.03 last 61.70) - open/close 1869 (time 1781278747.04 total 30.04 last 67.52) - open/close 2504 (time 1781278757.04 total 40.04 last 63.50) - open/close 3159 (time 1781278767.04 total 50.04 last 65.48) - open/close 3788 (time 1781278777.07 total 60.07 last 62.73) - open/close 4386 (time 1781278787.07 total 70.07 last 59.78) - open/close 5031 (time 1781278797.08 total 80.08 last 64.47) - open/close 5627 (time 1781278807.08 total 90.09 last 59.56) - open/close 6257 (time 1781278817.09 total 100.09 last 62.98) - open/close 6818 (time 1781278827.09 total 110.09 last 56.06) - open/close 7445 (time 1781278837.10 total 120.10 last 62.65) - open/close 8101 (time 1781278847.11 total 130.11 last 65.52) - open/close 8629 (time 1781278857.12 total 140.12 last 52.75) - open/close 9199 (time 1781278867.12 total 150.13 last 56.98) - open/close 9781 (time 1781278877.13 total 160.13 last 58.17) total: 10000 open/close in 163.92 seconds: 61.01 ops/second llite.lustre-ffff8a7b5a36b800.statahead_batch_max=0 llite.lustre-ffff8a7b5a36b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m16.074s user 0m0.370s sys 0m18.211s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a7b5a36b800.statahead_batch_max=32 llite.lustre-ffff8a7b5a36b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m50.999s user 0m0.350s sys 0m16.339s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats= snapshot_time: 1781279094.261407195 secs.nsecs start_time: 1781278967.834934193 secs.nsecs elapsed_time: 126.426473002 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats=0 llite.lustre-ffff8a7b5a36b800.statahead_max=2048 llite.lustre-ffff8a7b5a36b800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats=0 total: 100 open/close in 4.23 seconds: 23.65 ops/second llite.lustre-ffff8a7b5a36b800.statahead_max=0 101 real 0m3.276s user 0m0.005s sys 0m0.383s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8a7b5a36b800.statahead_max=2048 llite.lustre-ffff8a7b5a36b800.statahead_max=2048 101 real 0m0.822s user 0m0.008s sys 0m0.190s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 - open/close 592 (time 1781279469.58 total 10.01 last 59.16) total: 900 open/close in 15.55 seconds: 57.89 ops/second llite.lustre-ffff8a7b5a36b800.statahead_max=0 1001 real 0m36.487s user 0m0.033s sys 0m3.605s 'ls -l' 1000 files without statahead: 37 sec llite.lustre-ffff8a7b5a36b800.statahead_max=2048 llite.lustre-ffff8a7b5a36b800.statahead_max=2048 1001 real 0m7.423s user 0m0.026s sys 0m1.673s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8a7b5a36b800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats= snapshot_time: 1781279557.349460862 secs.nsecs start_time: 1781279097.276131428 secs.nsecs elapsed_time: 460.073329434 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 624 (time 1781279570.01 total 10.02 last 62.29) - open/close 1251 (time 1781279580.02 total 20.03 last 62.62) - open/close 1811 (time 1781279590.03 total 30.04 last 55.95) - open/close 2380 (time 1781279600.03 total 40.04 last 56.89) - open/close 2903 (time 1781279610.06 total 50.07 last 52.15) - open/close 3392 (time 1781279620.06 total 60.07 last 48.89) - open/close 3929 (time 1781279630.06 total 70.07 last 53.69) - open/close 4471 (time 1781279640.08 total 80.09 last 54.11) - open/close 4976 (time 1781279650.09 total 90.10 last 50.44) - open/close 5358 (time 1781279660.11 total 100.12 last 38.14) - open/close 5903 (time 1781279670.11 total 110.12 last 54.46) - open/close 6510 (time 1781279680.12 total 120.13 last 60.69) - open/close 7037 (time 1781279690.14 total 130.15 last 52.57) - open/close 7551 (time 1781279700.14 total 140.15 last 51.40) - open/close 8109 (time 1781279710.15 total 150.16 last 55.75) - open/close 8618 (time 1781279720.16 total 160.17 last 50.88) - open/close 9187 (time 1781279730.18 total 170.19 last 56.78) - open/close 9782 (time 1781279740.18 total 180.19 last 59.46) total: 10000 open/close in 183.41 seconds: 54.52 ops/second llite.lustre-ffff8a7b5a36b800.statahead_batch_max=0 llite.lustre-ffff8a7b5a36b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.438s user 0m0.398s sys 0m19.494s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a7b5a36b800.statahead_batch_max=256 llite.lustre-ffff8a7b5a36b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.675s user 0m0.352s sys 0m18.578s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a7b5a36b800.batch_stats= snapshot_time: 1781279886.656594088 secs.nsecs start_time: 1781279817.349379800 secs.nsecs elapsed_time: 69.307214288 secs.nsecs subreqs per batch batches % cum % 1: 351 59 59 2: 88 14 74 4: 53 8 83 8: 31 5 88 16: 15 2 91 32: 14 2 93 64: 4 0 94 128: 0 0 94 256: 33 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a7b5a36b800.statahead_batch_max=64 llite.lustre-ffff8a7b5a36b800.statahead_max=128