== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:32:13 (1786411933) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats=0 llite.lustre-ffff9bb77a765000.statahead_max=32 llite.lustre-ffff9bb77a765000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats=0 total: 100 open/close in 2.20 seconds: 45.45 ops/second llite.lustre-ffff9bb77a765000.statahead_max=0 101 real 0m2.059s user 0m0.006s sys 0m0.356s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9bb77a765000.statahead_max=32 llite.lustre-ffff9bb77a765000.statahead_max=32 101 real 0m1.406s user 0m0.005s sys 0m0.194s 'ls -l' 100 files with statahead: 2 sec statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 85 hit_total: 4519 miss_total: 774 swrong=2 ewrong=2 - open/close 692 (time 1786411961.98 total 10.02 last 69.09) total: 900 open/close in 13.27 seconds: 67.80 ops/second llite.lustre-ffff9bb77a765000.statahead_max=0 1001 real 0m22.529s user 0m0.024s sys 0m3.106s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff9bb77a765000.statahead_max=32 llite.lustre-ffff9bb77a765000.statahead_max=32 1001 real 0m11.906s user 0m0.036s sys 0m1.455s 'ls -l' 1000 files with statahead: 12 sec statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 85 hit_total: 5517 miss_total: 776 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff9bb77a765000.statahead_stats= statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 85 hit_total: 5517 miss_total: 776 mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats= snapshot_time: 1786412037.954686233 secs.nsecs start_time: 1786411938.732059948 secs.nsecs elapsed_time: 99.222626285 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 731 (time 1786412049.91 total 10.00 last 73.08) - open/close 1416 (time 1786412059.91 total 20.01 last 68.49) - open/close 2116 (time 1786412069.92 total 30.02 last 69.91) - open/close 2758 (time 1786412079.93 total 40.02 last 64.18) - open/close 3428 (time 1786412089.94 total 50.03 last 66.95) - open/close 4275 (time 1786412099.96 total 60.05 last 84.50) - open/close 5077 (time 1786412109.96 total 70.06 last 80.16) - open/close 5890 (time 1786412119.98 total 80.07 last 81.16) - open/close 6643 (time 1786412129.99 total 90.09 last 75.22) - open/close 7410 (time 1786412140.00 total 100.09 last 76.68) - open/close 8191 (time 1786412150.00 total 110.09 last 78.09) - open/close 8868 (time 1786412160.00 total 120.10 last 67.66) - open/close 9540 (time 1786412170.01 total 130.10 last 67.17) total: 10000 open/close in 136.88 seconds: 73.06 ops/second llite.lustre-ffff9bb77a765000.statahead_batch_max=0 llite.lustre-ffff9bb77a765000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb77a765000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m12.482s user 0m0.305s sys 0m15.025s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bb77a765000.statahead_batch_max=32 llite.lustre-ffff9bb77a765000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb77a765000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m50.347s user 0m0.313s sys 0m14.665s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats= snapshot_time: 1786412387.280973230 secs.nsecs start_time: 1786412260.833588599 secs.nsecs elapsed_time: 126.447384631 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats=0 llite.lustre-ffff9bb77a765000.statahead_max=2048 llite.lustre-ffff9bb77a765000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats=0 total: 100 open/close in 3.48 seconds: 28.76 ops/second llite.lustre-ffff9bb77a765000.statahead_max=0 101 real 0m2.546s user 0m0.006s sys 0m0.353s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9bb77a765000.statahead_max=2048 llite.lustre-ffff9bb77a765000.statahead_max=2048 101 real 0m0.897s user 0m0.003s sys 0m0.173s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 776 (time 1786412729.80 total 10.00 last 77.56) total: 900 open/close in 11.52 seconds: 78.14 ops/second llite.lustre-ffff9bb77a765000.statahead_max=0 1001 real 0m30.659s user 0m0.029s sys 0m3.116s 'ls -l' 1000 files without statahead: 31 sec llite.lustre-ffff9bb77a765000.statahead_max=2048 llite.lustre-ffff9bb77a765000.statahead_max=2048 1001 real 0m7.033s user 0m0.031s sys 0m1.492s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9bb77a765000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats= snapshot_time: 1786412805.972504118 secs.nsecs start_time: 1786412390.210723710 secs.nsecs elapsed_time: 415.761780408 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 2 16 66 128: 0 0 66 256: 4 33 100 - open/close 890 (time 1786412818.18 total 10.01 last 88.89) - open/close 1633 (time 1786412828.18 total 20.01 last 74.29) - open/close 2494 (time 1786412838.19 total 30.02 last 86.03) - open/close 3314 (time 1786412848.19 total 40.02 last 81.98) - open/close 4055 (time 1786412858.19 total 50.02 last 74.10) - open/close 4795 (time 1786412868.20 total 60.03 last 73.97) - open/close 5453 (time 1786412878.20 total 70.03 last 65.77) - open/close 6227 (time 1786412888.20 total 80.04 last 77.37) - open/close 7019 (time 1786412898.21 total 90.04 last 79.14) - open/close 7809 (time 1786412908.21 total 100.04 last 78.99) - open/close 8630 (time 1786412918.23 total 110.06 last 81.94) - open/close 9394 (time 1786412928.23 total 120.07 last 76.39) total: 10000 open/close in 128.31 seconds: 77.93 ops/second llite.lustre-ffff9bb77a765000.statahead_batch_max=0 llite.lustre-ffff9bb77a765000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb77a765000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.238s user 0m0.295s sys 0m15.299s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bb77a765000.statahead_batch_max=256 llite.lustre-ffff9bb77a765000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb77a765000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.631s user 0m0.290s sys 0m15.653s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bb77a765000.batch_stats= snapshot_time: 1786413079.474959263 secs.nsecs start_time: 1786413008.626307433 secs.nsecs elapsed_time: 70.848651830 secs.nsecs subreqs per batch batches %% cum %% 1: 340 58 58 2: 89 15 74 4: 47 8 82 8: 32 5 88 16: 17 2 90 32: 15 2 93 64: 4 0 94 128: 0 0 94 256: 33 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9bb77a765000.statahead_batch_max=64 llite.lustre-ffff9bb77a765000.statahead_max=128