== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:09:18 (1786943358) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats=0 llite.lustre-ffff8e6bc2f15000.statahead_max=32 llite.lustre-ffff8e6bc2f15000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats=0 total: 100 open/close in 2.24 seconds: 44.56 ops/second llite.lustre-ffff8e6bc2f15000.statahead_max=0 101 real 0m2.102s user 0m0.009s sys 0m0.317s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8e6bc2f15000.statahead_max=32 llite.lustre-ffff8e6bc2f15000.statahead_max=32 101 real 0m0.957s user 0m0.006s sys 0m0.176s 'ls -l' 100 files with statahead: 1 sec statahead total: 113 statahead wrong: 2 agl total: 108 list_total: 29 fname_total: 84 hit_total: 3713 miss_total: 1297 swrong=2 ewrong=2 - open/close 815 (time 1786943383.71 total 10.01 last 81.45) total: 900 open/close in 10.96 seconds: 82.11 ops/second llite.lustre-ffff8e6bc2f15000.statahead_max=0 1001 real 0m18.281s user 0m0.034s sys 0m3.106s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8e6bc2f15000.statahead_max=32 llite.lustre-ffff8e6bc2f15000.statahead_max=32 1001 real 0m9.521s user 0m0.026s sys 0m1.485s 'ls -l' 1000 files with statahead: 10 sec statahead total: 114 statahead wrong: 2 agl total: 109 list_total: 30 fname_total: 84 hit_total: 4710 miss_total: 1300 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff8e6bc2f15000.statahead_stats= statahead total: 114 statahead wrong: 2 agl total: 109 list_total: 30 fname_total: 84 hit_total: 4710 miss_total: 1300 mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats= snapshot_time: 1786943443.088520103 secs.nsecs start_time: 1786943362.588343881 secs.nsecs elapsed_time: 80.500176222 secs.nsecs subreqs per batch batches %% cum %% 1: 2 4 4 2: 0 0 4 4: 0 0 4 8: 3 7 12 16: 2 4 17 32: 34 82 100 - open/close 830 (time 1786943455.21 total 10.00 last 82.98) - open/close 1696 (time 1786943465.22 total 20.01 last 86.56) - open/close 2531 (time 1786943475.22 total 30.01 last 83.50) - open/close 3443 (time 1786943485.22 total 40.01 last 91.13) - open/close 4256 (time 1786943495.24 total 50.03 last 81.18) - open/close 5095 (time 1786943505.26 total 60.05 last 83.70) - open/close 5926 (time 1786943515.27 total 70.06 last 83.06) - open/close 6742 (time 1786943525.27 total 80.06 last 81.59) - open/close 7552 (time 1786943535.27 total 90.06 last 80.94) - open/close 8480 (time 1786943545.29 total 100.08 last 92.67) - open/close 9306 (time 1786943555.29 total 110.08 last 82.57) total: 10000 open/close in 118.61 seconds: 84.31 ops/second llite.lustre-ffff8e6bc2f15000.statahead_batch_max=0 llite.lustre-ffff8e6bc2f15000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.003s user 0m0.324s sys 0m16.221s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e6bc2f15000.statahead_batch_max=32 llite.lustre-ffff8e6bc2f15000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m21.536s user 0m0.304s sys 0m14.721s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats= snapshot_time: 1786943725.530816592 secs.nsecs start_time: 1786943630.649467870 secs.nsecs elapsed_time: 94.881348722 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats=0 llite.lustre-ffff8e6bc2f15000.statahead_max=2048 llite.lustre-ffff8e6bc2f15000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats=0 total: 100 open/close in 1.97 seconds: 50.71 ops/second llite.lustre-ffff8e6bc2f15000.statahead_max=0 101 real 0m1.804s user 0m0.005s sys 0m0.296s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8e6bc2f15000.statahead_max=2048 llite.lustre-ffff8e6bc2f15000.statahead_max=2048 101 real 0m0.670s user 0m0.007s sys 0m0.175s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 total: 900 open/close in 9.97 seconds: 90.27 ops/second llite.lustre-ffff8e6bc2f15000.statahead_max=0 1001 real 0m17.791s user 0m0.028s sys 0m2.974s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8e6bc2f15000.statahead_max=2048 llite.lustre-ffff8e6bc2f15000.statahead_max=2048 1001 real 0m5.517s user 0m0.026s sys 0m1.470s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff8e6bc2f15000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats= snapshot_time: 1786944034.115948025 secs.nsecs start_time: 1786943727.266828914 secs.nsecs elapsed_time: 306.849119111 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 895 (time 1786944045.94 total 10.01 last 89.45) - open/close 1774 (time 1786944055.95 total 20.02 last 87.81) - open/close 2694 (time 1786944065.96 total 30.03 last 91.87) - open/close 3682 (time 1786944075.96 total 40.03 last 98.80) - open/close 4604 (time 1786944085.97 total 50.03 last 92.17) - open/close 5491 (time 1786944095.97 total 60.04 last 88.62) - open/close 6391 (time 1786944105.99 total 70.06 last 89.84) - open/close 7350 (time 1786944116.01 total 80.08 last 95.76) - open/close 8233 (time 1786944126.01 total 90.08 last 88.30) - open/close 9291 (time 1786944136.03 total 100.10 last 105.56) total: 10000 open/close in 107.29 seconds: 93.21 ops/second llite.lustre-ffff8e6bc2f15000.statahead_batch_max=0 llite.lustre-ffff8e6bc2f15000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.069s user 0m0.287s sys 0m17.542s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e6bc2f15000.statahead_batch_max=256 llite.lustre-ffff8e6bc2f15000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.850s user 0m0.250s sys 0m16.512s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e6bc2f15000.batch_stats= snapshot_time: 1786944240.648462469 secs.nsecs start_time: 1786944193.788534817 secs.nsecs elapsed_time: 46.859927652 secs.nsecs subreqs per batch batches %% cum %% 1: 231 55 55 2: 64 15 70 4: 42 10 81 8: 14 3 84 16: 11 2 87 32: 15 3 90 64: 5 1 91 128: 0 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e6bc2f15000.statahead_batch_max=64 llite.lustre-ffff8e6bc2f15000.statahead_max=128