== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:04:37 (1786824277) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats=0 llite.lustre-ffff9aefc5bb1000.statahead_max=32 llite.lustre-ffff9aefc5bb1000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats=0 total: 100 open/close in 3.43 seconds: 29.16 ops/second llite.lustre-ffff9aefc5bb1000.statahead_max=0 101 real 0m2.549s user 0m0.006s sys 0m0.322s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9aefc5bb1000.statahead_max=32 llite.lustre-ffff9aefc5bb1000.statahead_max=32 101 real 0m1.029s user 0m0.004s sys 0m0.178s 'ls -l' 100 files with statahead: 1 sec statahead total: 116 statahead wrong: 2 agl total: 111 list_total: 30 fname_total: 72 hit_total: 4376 miss_total: 1285 swrong=2 ewrong=2 - open/close 739 (time 1786824307.33 total 10.00 last 73.88) total: 900 open/close in 12.31 seconds: 73.13 ops/second llite.lustre-ffff9aefc5bb1000.statahead_max=0 1001 real 0m21.636s user 0m0.041s sys 0m3.201s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9aefc5bb1000.statahead_max=32 llite.lustre-ffff9aefc5bb1000.statahead_max=32 1001 real 0m9.858s user 0m0.040s sys 0m1.490s 'ls -l' 1000 files with statahead: 10 sec statahead total: 117 statahead wrong: 2 agl total: 112 list_total: 31 fname_total: 72 hit_total: 5374 miss_total: 1287 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9aefc5bb1000.statahead_stats= statahead total: 117 statahead wrong: 2 agl total: 112 list_total: 31 fname_total: 72 hit_total: 5374 miss_total: 1287 mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats= snapshot_time: 1786824378.919613731 secs.nsecs start_time: 1786824283.027012669 secs.nsecs elapsed_time: 95.892601062 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 817 (time 1786824391.69 total 10.01 last 81.65) - open/close 1638 (time 1786824401.70 total 20.02 last 82.00) - open/close 2485 (time 1786824411.71 total 30.02 last 84.68) - open/close 3316 (time 1786824421.71 total 40.02 last 83.08) - open/close 4116 (time 1786824431.71 total 50.03 last 79.97) - open/close 5005 (time 1786824441.72 total 60.04 last 88.79) - open/close 5828 (time 1786824451.73 total 70.04 last 82.25) - open/close 6640 (time 1786824461.74 total 80.05 last 81.16) - open/close 7418 (time 1786824471.75 total 90.06 last 77.70) - open/close 8222 (time 1786824481.76 total 100.07 last 80.32) - open/close 9025 (time 1786824491.77 total 110.09 last 80.19) - open/close 9803 (time 1786824501.77 total 120.09 last 77.79) total: 10000 open/close in 122.80 seconds: 81.43 ops/second llite.lustre-ffff9aefc5bb1000.statahead_batch_max=0 llite.lustre-ffff9aefc5bb1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.147s user 0m0.305s sys 0m15.661s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9aefc5bb1000.statahead_batch_max=32 llite.lustre-ffff9aefc5bb1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m41.964s user 0m0.302s sys 0m15.274s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats= snapshot_time: 1786824688.452208837 secs.nsecs start_time: 1786824572.922884803 secs.nsecs elapsed_time: 115.529324034 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats=0 llite.lustre-ffff9aefc5bb1000.statahead_max=2048 llite.lustre-ffff9aefc5bb1000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats=0 total: 100 open/close in 3.14 seconds: 31.86 ops/second llite.lustre-ffff9aefc5bb1000.statahead_max=0 101 real 0m1.933s user 0m0.003s sys 0m0.333s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9aefc5bb1000.statahead_max=2048 llite.lustre-ffff9aefc5bb1000.statahead_max=2048 101 real 0m0.771s user 0m0.006s sys 0m0.196s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 792 (time 1786824998.55 total 10.00 last 79.20) total: 900 open/close in 11.50 seconds: 78.25 ops/second llite.lustre-ffff9aefc5bb1000.statahead_max=0 1001 real 0m21.122s user 0m0.027s sys 0m3.083s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9aefc5bb1000.statahead_max=2048 llite.lustre-ffff9aefc5bb1000.statahead_max=2048 1001 real 0m7.096s user 0m0.024s sys 0m1.644s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9aefc5bb1000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats= snapshot_time: 1786825063.888869277 secs.nsecs start_time: 1786824690.855008921 secs.nsecs elapsed_time: 373.033860356 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 711 (time 1786825076.42 total 10.00 last 71.08) - open/close 1507 (time 1786825086.43 total 20.01 last 79.52) - open/close 2319 (time 1786825096.43 total 30.01 last 81.19) - open/close 3125 (time 1786825106.44 total 40.02 last 80.58) - open/close 3924 (time 1786825116.45 total 50.03 last 79.81) - open/close 4575 (time 1786825126.48 total 60.06 last 64.91) - open/close 5266 (time 1786825136.50 total 70.08 last 68.95) - open/close 6047 (time 1786825146.50 total 80.08 last 78.07) - open/close 6863 (time 1786825156.53 total 90.11 last 81.37) - open/close 7524 (time 1786825166.54 total 100.12 last 66.03) - open/close 8189 (time 1786825176.54 total 110.12 last 66.49) - open/close 8834 (time 1786825186.57 total 120.15 last 64.34) - open/close 9329 (time 1786825196.58 total 130.16 last 49.43) - open/close 9880 (time 1786825206.59 total 140.17 last 55.07) total: 10000 open/close in 141.68 seconds: 70.58 ops/second llite.lustre-ffff9aefc5bb1000.statahead_batch_max=0 llite.lustre-ffff9aefc5bb1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.263s user 0m0.340s sys 0m16.637s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9aefc5bb1000.statahead_batch_max=256 llite.lustre-ffff9aefc5bb1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.191s user 0m0.308s sys 0m16.715s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9aefc5bb1000.batch_stats= snapshot_time: 1786825340.791830935 secs.nsecs start_time: 1786825274.719383796 secs.nsecs elapsed_time: 66.072447139 secs.nsecs subreqs per batch batches %% cum %% 1: 218 51 51 2: 55 13 64 4: 51 12 76 8: 34 8 85 16: 14 3 88 32: 9 2 90 64: 6 1 91 128: 0 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9aefc5bb1000.statahead_batch_max=64 llite.lustre-ffff9aefc5bb1000.statahead_max=128