== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:05:00 (1786356300) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats=0 llite.lustre-ffff8a38054a7000.statahead_max=32 llite.lustre-ffff8a38054a7000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.71 seconds: 141.12 ops/second llite.lustre-ffff8a38054a7000.statahead_max=0 101 real 0m0.679s user 0m0.004s sys 0m0.256s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8a38054a7000.statahead_max=32 llite.lustre-ffff8a38054a7000.statahead_max=32 101 real 0m0.423s user 0m0.006s sys 0m0.218s 'ls -l' 100 files with statahead: 0 sec statahead total: 86 statahead wrong: 1 agl total: 81 list_total: 29 fname_total: 57 hit_total: 13706 miss_total: 236 swrong=1 ewrong=1 total: 900 open/close in 2.51 seconds: 358.23 ops/second llite.lustre-ffff8a38054a7000.statahead_max=0 1001 real 0m6.721s user 0m0.015s sys 0m2.514s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8a38054a7000.statahead_max=32 llite.lustre-ffff8a38054a7000.statahead_max=32 1001 real 0m5.299s user 0m0.018s sys 0m2.598s 'ls -l' 1000 files with statahead: 5 sec statahead total: 87 statahead wrong: 1 agl total: 82 list_total: 30 fname_total: 57 hit_total: 14705 miss_total: 237 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8a38054a7000.statahead_stats= statahead total: 87 statahead wrong: 1 agl total: 82 list_total: 30 fname_total: 57 hit_total: 14705 miss_total: 237 mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356332.355758520 secs.nsecs start_time: 1786356302.995782471 secs.nsecs elapsed_time: 29.359976049 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 1 2 5 8: 3 7 12 16: 20 51 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356332.355832215 secs.nsecs start_time: 1786356302.995844452 secs.nsecs elapsed_time: 29.359987763 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 1 2 7 4: 1 2 10 8: 2 5 15 16: 19 48 64 32: 14 35 100 - open/close 4484 (time 1786356343.19 total 10.00 last 448.30) - open/close 7747 (time 1786356353.19 total 20.00 last 326.23) total: 10000 open/close in 27.00 seconds: 370.35 ops/second llite.lustre-ffff8a38054a7000.statahead_batch_max=0 llite.lustre-ffff8a38054a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a38054a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff8a38054a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.942s user 0m0.165s sys 0m51.034s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a38054a7000.statahead_batch_max=32 llite.lustre-ffff8a38054a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a38054a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff8a38054a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.288s user 0m0.169s sys 0m25.509s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356466.726714049 secs.nsecs start_time: 1786356416.706860573 secs.nsecs elapsed_time: 50.019853476 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356466.726761099 secs.nsecs start_time: 1786356416.706941142 secs.nsecs elapsed_time: 50.019819957 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats=0 llite.lustre-ffff8a38054a7000.statahead_max=2048 llite.lustre-ffff8a38054a7000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.88 seconds: 114.06 ops/second llite.lustre-ffff8a38054a7000.statahead_max=0 101 real 0m0.662s user 0m0.007s sys 0m0.253s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8a38054a7000.statahead_max=2048 llite.lustre-ffff8a38054a7000.statahead_max=2048 101 real 0m0.395s user 0m0.001s sys 0m0.280s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.96 seconds: 460.03 ops/second llite.lustre-ffff8a38054a7000.statahead_max=0 1001 real 0m5.991s user 0m0.028s sys 0m2.293s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8a38054a7000.statahead_max=2048 llite.lustre-ffff8a38054a7000.statahead_max=2048 1001 real 0m3.105s user 0m0.015s sys 0m1.550s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8a38054a7000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356607.557188689 secs.nsecs start_time: 1786356467.967936234 secs.nsecs elapsed_time: 139.589252455 secs.nsecs subreqs per batch batches %% cum %% 1: 2 28 28 2: 0 0 28 4: 1 14 42 8: 2 28 71 16: 0 0 71 32: 0 0 71 64: 0 0 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356607.557254539 secs.nsecs start_time: 1786356467.968101102 secs.nsecs elapsed_time: 139.589153437 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 12 12 4: 1 12 25 8: 2 25 50 16: 0 0 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 5318 (time 1786356618.35 total 10.00 last 531.80) total: 10000 open/close in 19.09 seconds: 523.96 ops/second llite.lustre-ffff8a38054a7000.statahead_batch_max=0 llite.lustre-ffff8a38054a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a38054a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff8a38054a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.993s user 0m0.196s sys 0m30.883s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a38054a7000.statahead_batch_max=256 llite.lustre-ffff8a38054a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a38054a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff8a38054a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.513s user 0m0.175s sys 0m19.616s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356699.973881376 secs.nsecs start_time: 1786356666.558876002 secs.nsecs elapsed_time: 33.415005374 secs.nsecs subreqs per batch batches %% cum %% 1: 460 67 67 2: 96 14 82 4: 52 7 89 8: 9 1 91 16: 3 0 91 32: 23 3 94 64: 1 0 95 128: 0 0 95 256: 33 4 100 mdc.lustre-MDT0001-mdc-ffff8a38054a7000.batch_stats= snapshot_time: 1786356699.973920251 secs.nsecs start_time: 1786356666.558929646 secs.nsecs elapsed_time: 33.414990605 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a38054a7000.statahead_batch_max=64 llite.lustre-ffff8a38054a7000.statahead_max=128