== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:41:20 (1786653680) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats=0 llite.lustre-ffff8a6c412bc000.statahead_max=32 llite.lustre-ffff8a6c412bc000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats=0 total: 100 open/close in 2.11 seconds: 47.40 ops/second llite.lustre-ffff8a6c412bc000.statahead_max=0 101 real 0m2.027s user 0m0.003s sys 0m0.340s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a6c412bc000.statahead_max=32 llite.lustre-ffff8a6c412bc000.statahead_max=32 101 real 0m0.999s user 0m0.007s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 118 statahead wrong: 2 agl total: 112 list_total: 31 fname_total: 84 hit_total: 4107 miss_total: 1551 swrong=2 ewrong=2 - open/close 757 (time 1786653706.66 total 10.01 last 75.65) total: 900 open/close in 11.95 seconds: 75.28 ops/second llite.lustre-ffff8a6c412bc000.statahead_max=0 1001 real 0m19.968s user 0m0.025s sys 0m3.063s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8a6c412bc000.statahead_max=32 llite.lustre-ffff8a6c412bc000.statahead_max=32 1001 real 0m8.752s user 0m0.029s sys 0m1.437s 'ls -l' 1000 files with statahead: 9 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 32 fname_total: 84 hit_total: 5105 miss_total: 1553 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8a6c412bc000.statahead_stats= statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 32 fname_total: 84 hit_total: 5105 miss_total: 1553 mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats= snapshot_time: 1786653770.007894522 secs.nsecs start_time: 1786653685.289796600 secs.nsecs elapsed_time: 84.718097922 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 834 (time 1786653782.90 total 10.00 last 83.38) - open/close 1660 (time 1786653792.92 total 20.03 last 82.41) - open/close 2320 (time 1786653802.92 total 30.03 last 65.97) - open/close 3130 (time 1786653812.93 total 40.03 last 80.98) - open/close 3778 (time 1786653822.93 total 50.04 last 64.75) - open/close 4418 (time 1786653832.94 total 60.04 last 63.98) - open/close 5212 (time 1786653842.94 total 70.04 last 79.39) - open/close 6060 (time 1786653852.94 total 80.05 last 84.73) - open/close 6796 (time 1786653862.95 total 90.06 last 73.58) - open/close 7470 (time 1786653872.96 total 100.07 last 67.32) - open/close 8204 (time 1786653882.98 total 110.08 last 73.27) - open/close 9016 (time 1786653892.98 total 120.09 last 81.16) - open/close 9867 (time 1786653902.99 total 130.09 last 85.07) total: 10000 open/close in 131.56 seconds: 76.01 ops/second llite.lustre-ffff8a6c412bc000.statahead_batch_max=0 llite.lustre-ffff8a6c412bc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.765s user 0m0.321s sys 0m15.471s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a6c412bc000.statahead_batch_max=32 llite.lustre-ffff8a6c412bc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m39.987s user 0m0.282s sys 0m14.999s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats= snapshot_time: 1786654088.532820839 secs.nsecs start_time: 1786653973.105722130 secs.nsecs elapsed_time: 115.427098709 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats=0 llite.lustre-ffff8a6c412bc000.statahead_max=2048 llite.lustre-ffff8a6c412bc000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats=0 total: 100 open/close in 2.43 seconds: 41.19 ops/second llite.lustre-ffff8a6c412bc000.statahead_max=0 101 real 0m2.306s user 0m0.007s sys 0m0.320s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8a6c412bc000.statahead_max=2048 llite.lustre-ffff8a6c412bc000.statahead_max=2048 101 real 0m1.120s user 0m0.001s sys 0m0.197s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 840 (time 1786654394.55 total 10.01 last 83.90) total: 900 open/close in 10.95 seconds: 82.21 ops/second llite.lustre-ffff8a6c412bc000.statahead_max=0 1001 real 0m23.707s user 0m0.032s sys 0m3.166s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff8a6c412bc000.statahead_max=2048 llite.lustre-ffff8a6c412bc000.statahead_max=2048 1001 real 0m6.498s user 0m0.032s sys 0m1.433s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8a6c412bc000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats= snapshot_time: 1786654458.868802604 secs.nsecs start_time: 1786654091.293570153 secs.nsecs elapsed_time: 367.575232451 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 760 (time 1786654471.67 total 10.00 last 75.98) - open/close 1566 (time 1786654481.68 total 20.01 last 80.54) - open/close 2317 (time 1786654491.69 total 30.02 last 75.05) - open/close 3226 (time 1786654501.69 total 40.02 last 90.84) - open/close 4119 (time 1786654511.71 total 50.04 last 89.12) - open/close 4864 (time 1786654521.72 total 60.06 last 74.42) - open/close 5564 (time 1786654531.73 total 70.06 last 69.97) - open/close 6422 (time 1786654541.73 total 80.06 last 85.77) - open/close 7283 (time 1786654551.73 total 90.07 last 86.09) - open/close 8189 (time 1786654561.73 total 100.07 last 90.58) - open/close 9008 (time 1786654571.74 total 110.07 last 81.85) - open/close 9619 (time 1786654581.74 total 120.07 last 61.09) total: 10000 open/close in 125.50 seconds: 79.68 ops/second llite.lustre-ffff8a6c412bc000.statahead_batch_max=0 llite.lustre-ffff8a6c412bc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.738s user 0m0.315s sys 0m15.494s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a6c412bc000.statahead_batch_max=256 llite.lustre-ffff8a6c412bc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.636s user 0m0.326s sys 0m15.213s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a6c412bc000.batch_stats= snapshot_time: 1786654726.506398314 secs.nsecs start_time: 1786654661.211641478 secs.nsecs elapsed_time: 65.294756836 secs.nsecs subreqs per batch batches %% cum %% 1: 188 48 48 2: 61 15 64 4: 39 10 75 8: 27 7 82 16: 19 4 86 32: 12 3 90 64: 4 1 91 128: 0 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a6c412bc000.statahead_batch_max=64 llite.lustre-ffff8a6c412bc000.statahead_max=128