== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:00:28 (1786834828) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats=0 llite.lustre-ffff93aa20353800.statahead_max=32 llite.lustre-ffff93aa20353800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats=0 total: 100 open/close in 2.16 seconds: 46.23 ops/second llite.lustre-ffff93aa20353800.statahead_max=0 101 real 0m1.972s user 0m0.005s sys 0m0.322s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff93aa20353800.statahead_max=32 llite.lustre-ffff93aa20353800.statahead_max=32 101 real 0m0.720s user 0m0.006s sys 0m0.176s 'ls -l' 100 files with statahead: 1 sec statahead total: 132 statahead wrong: 2 agl total: 126 list_total: 30 fname_total: 101 hit_total: 3834 miss_total: 1233 swrong=2 ewrong=2 total: 900 open/close in 9.98 seconds: 90.18 ops/second llite.lustre-ffff93aa20353800.statahead_max=0 1001 real 0m16.891s user 0m0.029s sys 0m3.013s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff93aa20353800.statahead_max=32 llite.lustre-ffff93aa20353800.statahead_max=32 1001 real 0m7.191s user 0m0.026s sys 0m1.614s 'ls -l' 1000 files with statahead: 7 sec statahead total: 133 statahead wrong: 2 agl total: 127 list_total: 31 fname_total: 101 hit_total: 4833 miss_total: 1234 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff93aa20353800.statahead_stats= statahead total: 133 statahead wrong: 2 agl total: 127 list_total: 31 fname_total: 101 hit_total: 4833 miss_total: 1234 mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats= snapshot_time: 1786834899.131230951 secs.nsecs start_time: 1786834831.771570381 secs.nsecs elapsed_time: 67.359660570 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 1053 (time 1786834910.84 total 10.00 last 105.30) - open/close 2142 (time 1786834920.84 total 20.00 last 108.86) - open/close 3218 (time 1786834930.84 total 30.01 last 107.55) - open/close 4230 (time 1786834940.84 total 40.01 last 101.20) - open/close 5254 (time 1786834950.85 total 50.01 last 102.36) - open/close 6160 (time 1786834960.85 total 60.02 last 90.56) - open/close 7134 (time 1786834970.85 total 70.02 last 97.40) - open/close 8196 (time 1786834980.86 total 80.02 last 106.15) - open/close 9240 (time 1786834990.86 total 90.03 last 104.34) total: 10000 open/close in 98.25 seconds: 101.79 ops/second llite.lustre-ffff93aa20353800.statahead_batch_max=0 llite.lustre-ffff93aa20353800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93aa20353800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.905s user 0m0.278s sys 0m21.102s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93aa20353800.statahead_batch_max=32 llite.lustre-ffff93aa20353800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93aa20353800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.619s user 0m0.248s sys 0m16.630s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats= snapshot_time: 1786835117.305276652 secs.nsecs start_time: 1786835049.307320566 secs.nsecs elapsed_time: 67.997956086 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats=0 llite.lustre-ffff93aa20353800.statahead_max=2048 llite.lustre-ffff93aa20353800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats=0 total: 100 open/close in 1.38 seconds: 72.60 ops/second llite.lustre-ffff93aa20353800.statahead_max=0 101 real 0m1.379s user 0m0.005s sys 0m0.308s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff93aa20353800.statahead_max=2048 llite.lustre-ffff93aa20353800.statahead_max=2048 101 real 0m0.539s user 0m0.004s sys 0m0.221s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 total: 900 open/close in 7.44 seconds: 120.89 ops/second llite.lustre-ffff93aa20353800.statahead_max=0 1001 real 0m15.053s user 0m0.029s sys 0m2.986s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffff93aa20353800.statahead_max=2048 llite.lustre-ffff93aa20353800.statahead_max=2048 1001 real 0m3.822s user 0m0.020s sys 0m2.027s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff93aa20353800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats= snapshot_time: 1786835357.259609218 secs.nsecs start_time: 1786835118.616337521 secs.nsecs elapsed_time: 238.643271697 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 1235 (time 1786835368.75 total 10.01 last 123.42) - open/close 2573 (time 1786835378.75 total 20.02 last 133.68) - open/close 4006 (time 1786835388.76 total 30.02 last 143.26) - open/close 5253 (time 1786835398.76 total 40.02 last 124.65) - open/close 6699 (time 1786835408.77 total 50.03 last 144.44) - open/close 7965 (time 1786835418.78 total 60.04 last 126.55) - open/close 9171 (time 1786835428.78 total 70.04 last 120.55) total: 10000 open/close in 76.57 seconds: 130.59 ops/second llite.lustre-ffff93aa20353800.statahead_batch_max=0 llite.lustre-ffff93aa20353800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93aa20353800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.361s user 0m0.241s sys 0m23.230s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93aa20353800.statahead_batch_max=256 llite.lustre-ffff93aa20353800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93aa20353800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.989s user 0m0.212s sys 0m19.887s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff93aa20353800.batch_stats= snapshot_time: 1786835514.090203147 secs.nsecs start_time: 1786835476.085311354 secs.nsecs elapsed_time: 38.004891793 secs.nsecs subreqs per batch batches %% cum %% 1: 279 58 58 2: 67 14 72 4: 58 12 84 8: 10 2 86 16: 8 1 88 32: 21 4 92 64: 1 0 92 128: 0 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff93aa20353800.statahead_batch_max=64 llite.lustre-ffff93aa20353800.statahead_max=128