== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:35:19 (1786836919) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats=0 llite.lustre-ffff9d2182be9800.statahead_max=32 llite.lustre-ffff9d2182be9800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.87 seconds: 115.42 ops/second llite.lustre-ffff9d2182be9800.statahead_max=0 101 real 0m0.694s user 0m0.007s sys 0m0.264s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9d2182be9800.statahead_max=32 llite.lustre-ffff9d2182be9800.statahead_max=32 101 real 0m0.558s user 0m0.001s sys 0m0.279s 'ls -l' 100 files with statahead: 1 sec statahead total: 128 statahead wrong: 2 agl total: 123 list_total: 32 fname_total: 96 hit_total: 4567 miss_total: 1284 swrong=2 ewrong=2 total: 900 open/close in 2.02 seconds: 446.62 ops/second llite.lustre-ffff9d2182be9800.statahead_max=0 1001 real 0m6.629s user 0m0.030s sys 0m2.498s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9d2182be9800.statahead_max=32 llite.lustre-ffff9d2182be9800.statahead_max=32 1001 real 0m4.251s user 0m0.015s sys 0m1.948s 'ls -l' 1000 files with statahead: 4 sec statahead total: 129 statahead wrong: 2 agl total: 124 list_total: 33 fname_total: 96 hit_total: 5566 miss_total: 1285 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff9d2182be9800.statahead_stats= statahead total: 129 statahead wrong: 2 agl total: 124 list_total: 33 fname_total: 96 hit_total: 5566 miss_total: 1285 mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786836948.833238809 secs.nsecs start_time: 1786836921.088568401 secs.nsecs elapsed_time: 27.744670408 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 5 5 8: 3 7 12 16: 19 48 61 32: 15 38 100 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786836948.833326206 secs.nsecs start_time: 1786836921.088641775 secs.nsecs elapsed_time: 27.744684431 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 5 4: 3 7 12 8: 2 5 17 16: 21 53 71 32: 11 28 100 - open/close 3786 (time 1786836959.77 total 10.00 last 378.56) - open/close 7824 (time 1786836969.77 total 20.00 last 403.79) total: 10000 open/close in 25.57 seconds: 391.01 ops/second llite.lustre-ffff9d2182be9800.statahead_batch_max=0 llite.lustre-ffff9d2182be9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d2182be9800.stats=clear mdc.lustre-MDT0001-mdc-ffff9d2182be9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.449s user 0m0.212s sys 0m39.127s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9d2182be9800.statahead_batch_max=32 llite.lustre-ffff9d2182be9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9d2182be9800.stats=clear mdc.lustre-MDT0001-mdc-ffff9d2182be9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.455s user 0m0.207s sys 0m26.461s batched statahead RPC= hit count=9996 mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786837075.545065042 secs.nsecs start_time: 1786837020.877833893 secs.nsecs elapsed_time: 54.667231149 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786837075.545114552 secs.nsecs start_time: 1786837020.877911908 secs.nsecs elapsed_time: 54.667202644 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats=0 llite.lustre-ffff9d2182be9800.statahead_max=2048 llite.lustre-ffff9d2182be9800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.93 seconds: 107.28 ops/second llite.lustre-ffff9d2182be9800.statahead_max=0 101 real 0m0.727s user 0m0.005s sys 0m0.274s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9d2182be9800.statahead_max=2048 llite.lustre-ffff9d2182be9800.statahead_max=2048 101 real 0m0.354s user 0m0.004s sys 0m0.200s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10095 miss_total: 5 swrong=0 ewrong=0 total: 900 open/close in 2.50 seconds: 359.70 ops/second llite.lustre-ffff9d2182be9800.statahead_max=0 1001 real 0m6.581s user 0m0.017s sys 0m2.477s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9d2182be9800.statahead_max=2048 llite.lustre-ffff9d2182be9800.statahead_max=2048 1001 real 0m3.359s user 0m0.017s sys 0m1.498s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff9d2182be9800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786837209.014802756 secs.nsecs start_time: 1786837076.531647313 secs.nsecs elapsed_time: 132.483155443 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 12 12 4: 1 12 25 8: 3 37 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786837209.014866333 secs.nsecs start_time: 1786837076.531858673 secs.nsecs elapsed_time: 132.483007660 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 12 12 4: 1 12 25 8: 2 25 50 16: 1 12 62 32: 1 12 75 64: 0 0 75 128: 0 0 75 256: 2 25 100 - open/close 3703 (time 1786837219.91 total 10.00 last 370.26) - open/close 6969 (time 1786837229.91 total 20.00 last 326.58) total: 10000 open/close in 28.93 seconds: 345.62 ops/second llite.lustre-ffff9d2182be9800.statahead_batch_max=0 llite.lustre-ffff9d2182be9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d2182be9800.stats=clear mdc.lustre-MDT0001-mdc-ffff9d2182be9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.094s user 0m0.182s sys 0m29.528s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9d2182be9800.statahead_batch_max=256 llite.lustre-ffff9d2182be9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9d2182be9800.stats=clear mdc.lustre-MDT0001-mdc-ffff9d2182be9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.493s user 0m0.167s sys 0m20.459s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786837311.306740427 secs.nsecs start_time: 1786837277.246381560 secs.nsecs elapsed_time: 34.060358867 secs.nsecs subreqs per batch batches %% cum %% 1: 355 61 61 2: 78 13 75 4: 65 11 86 8: 13 2 89 16: 5 0 90 32: 23 4 94 64: 0 0 94 128: 1 0 94 256: 33 5 100 mdc.lustre-MDT0001-mdc-ffff9d2182be9800.batch_stats= snapshot_time: 1786837311.306825114 secs.nsecs start_time: 1786837277.246449673 secs.nsecs elapsed_time: 34.060375441 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9d2182be9800.statahead_batch_max=64 llite.lustre-ffff9d2182be9800.statahead_max=128