== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:32:08 (1787866328) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats=0 llite.lustre-ffff9c56c2c73800.statahead_max=32 llite.lustre-ffff9c56c2c73800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats=0 total: 100 open/close in 2.44 seconds: 41.07 ops/second llite.lustre-ffff9c56c2c73800.statahead_max=0 101 real 0m1.835s user 0m0.001s sys 0m0.288s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9c56c2c73800.statahead_max=32 llite.lustre-ffff9c56c2c73800.statahead_max=32 101 real 0m1.346s user 0m0.003s sys 0m0.163s 'ls -l' 100 files with statahead: 1 sec statahead total: 150 statahead wrong: 2 agl total: 143 list_total: 29 fname_total: 110 hit_total: 3618 miss_total: 1372 swrong=2 ewrong=2 - open/close 854 (time 1787866354.78 total 10.00 last 85.40) total: 900 open/close in 10.70 seconds: 84.09 ops/second llite.lustre-ffff9c56c2c73800.statahead_max=0 1001 real 0m19.022s user 0m0.032s sys 0m2.726s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9c56c2c73800.statahead_max=32 llite.lustre-ffff9c56c2c73800.statahead_max=32 1001 real 0m9.724s user 0m0.028s sys 0m1.348s 'ls -l' 1000 files with statahead: 10 sec statahead total: 151 statahead wrong: 2 agl total: 144 list_total: 30 fname_total: 110 hit_total: 4617 miss_total: 1373 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff9c56c2c73800.statahead_stats= statahead total: 151 statahead wrong: 2 agl total: 144 list_total: 30 fname_total: 110 hit_total: 4617 miss_total: 1373 mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats= snapshot_time: 1787866414.221958306 secs.nsecs start_time: 1787866332.685421438 secs.nsecs elapsed_time: 81.536536868 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 941 (time 1787866426.66 total 10.01 last 94.01) - open/close 1726 (time 1787866436.67 total 20.01 last 78.48) - open/close 2498 (time 1787866446.68 total 30.03 last 77.09) - open/close 3354 (time 1787866456.68 total 40.03 last 85.56) - open/close 4065 (time 1787866466.69 total 50.04 last 71.04) - open/close 4939 (time 1787866476.70 total 60.04 last 87.38) - open/close 5854 (time 1787866486.70 total 70.04 last 91.50) - open/close 6730 (time 1787866496.71 total 80.06 last 87.48) - open/close 7586 (time 1787866506.72 total 90.07 last 85.48) - open/close 8504 (time 1787866516.73 total 100.08 last 91.75) - open/close 9299 (time 1787866526.74 total 110.08 last 79.45) total: 10000 open/close in 119.74 seconds: 83.52 ops/second llite.lustre-ffff9c56c2c73800.statahead_batch_max=0 llite.lustre-ffff9c56c2c73800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.840s user 0m0.292s sys 0m13.800s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9c56c2c73800.statahead_batch_max=32 llite.lustre-ffff9c56c2c73800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m26.545s user 0m0.301s sys 0m12.608s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats= snapshot_time: 1787866696.572719213 secs.nsecs start_time: 1787866600.432260166 secs.nsecs elapsed_time: 96.140459047 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats=0 llite.lustre-ffff9c56c2c73800.statahead_max=2048 llite.lustre-ffff9c56c2c73800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats=0 total: 100 open/close in 3.05 seconds: 32.81 ops/second llite.lustre-ffff9c56c2c73800.statahead_max=0 101 real 0m2.557s user 0m0.003s sys 0m0.294s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9c56c2c73800.statahead_max=2048 llite.lustre-ffff9c56c2c73800.statahead_max=2048 101 real 0m1.086s user 0m0.002s sys 0m0.162s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 - open/close 652 (time 1787866985.81 total 10.00 last 65.19) total: 900 open/close in 13.41 seconds: 67.14 ops/second llite.lustre-ffff9c56c2c73800.statahead_max=0 1001 real 0m22.568s user 0m0.036s sys 0m2.728s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9c56c2c73800.statahead_max=2048 llite.lustre-ffff9c56c2c73800.statahead_max=2048 1001 real 0m6.711s user 0m0.034s sys 0m1.300s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9c56c2c73800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats= snapshot_time: 1787867051.281171929 secs.nsecs start_time: 1787866699.234653521 secs.nsecs elapsed_time: 352.046518408 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 2 20 50 64: 1 10 60 128: 0 0 60 256: 4 40 100 - open/close 856 (time 1787867063.62 total 10.00 last 85.58) - open/close 1708 (time 1787867073.62 total 20.01 last 85.15) - open/close 2551 (time 1787867083.63 total 30.02 last 84.23) - open/close 3358 (time 1787867093.64 total 40.02 last 80.65) - open/close 4110 (time 1787867103.64 total 50.02 last 75.20) - open/close 4865 (time 1787867113.65 total 60.04 last 75.41) - open/close 5600 (time 1787867123.66 total 70.05 last 73.44) - open/close 6392 (time 1787867133.66 total 80.05 last 79.17) - open/close 7185 (time 1787867143.67 total 90.06 last 79.23) - open/close 7998 (time 1787867153.67 total 100.06 last 81.28) - open/close 8794 (time 1787867163.68 total 110.06 last 79.57) - open/close 9651 (time 1787867173.68 total 120.07 last 85.64) total: 10000 open/close in 124.61 seconds: 80.25 ops/second llite.lustre-ffff9c56c2c73800.statahead_batch_max=0 llite.lustre-ffff9c56c2c73800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.873s user 0m0.291s sys 0m13.731s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9c56c2c73800.statahead_batch_max=256 llite.lustre-ffff9c56c2c73800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.267s user 0m0.294s sys 0m14.069s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9c56c2c73800.batch_stats= snapshot_time: 1787867302.924374319 secs.nsecs start_time: 1787867248.127063263 secs.nsecs elapsed_time: 54.797311056 secs.nsecs subreqs per batch batches %% cum %% 1: 106 47 47 2: 25 11 58 4: 15 6 65 8: 13 5 71 16: 9 4 75 32: 15 6 82 64: 4 1 83 128: 0 0 83 256: 36 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9c56c2c73800.statahead_batch_max=64 llite.lustre-ffff9c56c2c73800.statahead_max=128