== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:53:01 (1786953181) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats=0 llite.lustre-ffff9cb1b38ad000.statahead_max=32 llite.lustre-ffff9cb1b38ad000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats=0 total: 100 open/close in 2.80 seconds: 35.70 ops/second llite.lustre-ffff9cb1b38ad000.statahead_max=0 101 real 0m1.664s user 0m0.003s sys 0m0.325s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9cb1b38ad000.statahead_max=32 llite.lustre-ffff9cb1b38ad000.statahead_max=32 101 real 0m1.307s user 0m0.003s sys 0m0.174s 'ls -l' 100 files with statahead: 1 sec statahead total: 118 statahead wrong: 2 agl total: 112 list_total: 30 fname_total: 77 hit_total: 3796 miss_total: 1640 swrong=2 ewrong=2 - open/close 760 (time 1786953207.90 total 10.01 last 75.96) total: 900 open/close in 12.27 seconds: 73.36 ops/second llite.lustre-ffff9cb1b38ad000.statahead_max=0 1001 real 0m23.046s user 0m0.030s sys 0m3.166s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff9cb1b38ad000.statahead_max=32 llite.lustre-ffff9cb1b38ad000.statahead_max=32 1001 real 0m11.417s user 0m0.027s sys 0m1.580s 'ls -l' 1000 files with statahead: 11 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 77 hit_total: 4794 miss_total: 1642 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9cb1b38ad000.statahead_stats= statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 77 hit_total: 4794 miss_total: 1642 mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats= snapshot_time: 1786953282.953698151 secs.nsecs start_time: 1786953185.740605608 secs.nsecs elapsed_time: 97.213092543 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 709 (time 1786953295.93 total 10.01 last 70.83) - open/close 1460 (time 1786953305.94 total 20.02 last 75.01) - open/close 2224 (time 1786953315.95 total 30.03 last 76.37) - open/close 3028 (time 1786953325.96 total 40.04 last 80.33) - open/close 3812 (time 1786953335.96 total 50.04 last 78.39) - open/close 4628 (time 1786953345.96 total 60.04 last 81.59) - open/close 5339 (time 1786953355.96 total 70.04 last 71.08) - open/close 6199 (time 1786953365.97 total 80.05 last 85.93) - open/close 6963 (time 1786953375.98 total 90.06 last 76.34) - open/close 7734 (time 1786953385.98 total 100.06 last 77.05) - open/close 8532 (time 1786953395.99 total 110.06 last 79.79) - open/close 9324 (time 1786953405.99 total 120.07 last 79.14) total: 10000 open/close in 129.90 seconds: 76.98 ops/second llite.lustre-ffff9cb1b38ad000.statahead_batch_max=0 llite.lustre-ffff9cb1b38ad000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.182s user 0m0.303s sys 0m15.628s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cb1b38ad000.statahead_batch_max=32 llite.lustre-ffff9cb1b38ad000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m37.635s user 0m0.271s sys 0m14.477s batched statahead RPC= hit count=9990 mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats= snapshot_time: 1786953606.965575815 secs.nsecs start_time: 1786953495.648547435 secs.nsecs elapsed_time: 111.317028380 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats=0 llite.lustre-ffff9cb1b38ad000.statahead_max=2048 llite.lustre-ffff9cb1b38ad000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats=0 total: 100 open/close in 2.87 seconds: 34.87 ops/second llite.lustre-ffff9cb1b38ad000.statahead_max=0 101 real 0m2.291s user 0m0.003s sys 0m0.315s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9cb1b38ad000.statahead_max=2048 llite.lustre-ffff9cb1b38ad000.statahead_max=2048 101 real 0m1.290s user 0m0.004s sys 0m0.198s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10089 miss_total: 11 swrong=0 ewrong=0 - open/close 697 (time 1786953923.37 total 10.01 last 69.63) total: 900 open/close in 12.94 seconds: 69.56 ops/second llite.lustre-ffff9cb1b38ad000.statahead_max=0 1001 real 0m21.114s user 0m0.030s sys 0m3.085s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9cb1b38ad000.statahead_max=2048 llite.lustre-ffff9cb1b38ad000.statahead_max=2048 1001 real 0m9.061s user 0m0.032s sys 0m1.522s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11088 miss_total: 12 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9cb1b38ad000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11088 miss_total: 12 mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats= snapshot_time: 1786953991.499770555 secs.nsecs start_time: 1786953609.825360625 secs.nsecs elapsed_time: 381.674409930 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 779 (time 1786954003.83 total 10.00 last 77.86) - open/close 1562 (time 1786954013.85 total 20.03 last 78.11) - open/close 2319 (time 1786954023.86 total 30.03 last 75.69) - open/close 3039 (time 1786954033.86 total 40.03 last 71.99) - open/close 3922 (time 1786954043.86 total 50.03 last 88.26) - open/close 4584 (time 1786954053.87 total 60.04 last 66.15) - open/close 5163 (time 1786954063.88 total 70.06 last 57.82) - open/close 5722 (time 1786954073.88 total 80.06 last 55.90) - open/close 6303 (time 1786954083.89 total 90.06 last 58.08) - open/close 6949 (time 1786954093.91 total 100.08 last 64.46) - open/close 7718 (time 1786954103.91 total 110.09 last 76.86) - open/close 8380 (time 1786954113.92 total 120.10 last 66.14) - open/close 9132 (time 1786954123.93 total 130.10 last 75.18) - open/close 9894 (time 1786954133.94 total 140.11 last 76.10) total: 10000 open/close in 141.38 seconds: 70.73 ops/second llite.lustre-ffff9cb1b38ad000.statahead_batch_max=0 llite.lustre-ffff9cb1b38ad000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m6.297s user 0m0.328s sys 0m15.309s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cb1b38ad000.statahead_batch_max=256 llite.lustre-ffff9cb1b38ad000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.990s user 0m0.279s sys 0m15.340s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9cb1b38ad000.batch_stats= snapshot_time: 1786954290.502277894 secs.nsecs start_time: 1786954213.309920248 secs.nsecs elapsed_time: 77.192357646 secs.nsecs subreqs per batch batches %% cum %% 1: 195 48 48 2: 69 17 66 4: 45 11 77 8: 21 5 82 16: 22 5 88 32: 13 3 91 64: 0 0 91 128: 1 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9cb1b38ad000.statahead_batch_max=64 llite.lustre-ffff9cb1b38ad000.statahead_max=128