== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:05:02 (1786406702) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats=0 llite.lustre-ffff9523e0794800.statahead_max=32 llite.lustre-ffff9523e0794800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats=0 total: 100 open/close in 3.92 seconds: 25.52 ops/second llite.lustre-ffff9523e0794800.statahead_max=0 101 real 0m2.613s user 0m0.001s sys 0m0.340s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9523e0794800.statahead_max=32 llite.lustre-ffff9523e0794800.statahead_max=32 101 real 0m1.777s user 0m0.006s sys 0m0.180s 'ls -l' 100 files with statahead: 2 sec statahead total: 121 statahead wrong: 2 agl total: 115 list_total: 29 fname_total: 82 hit_total: 3942 miss_total: 1391 swrong=2 ewrong=2 - open/close 681 (time 1786406736.77 total 10.00 last 68.08) total: 900 open/close in 12.57 seconds: 71.61 ops/second llite.lustre-ffff9523e0794800.statahead_max=0 1001 real 0m23.430s user 0m0.030s sys 0m3.116s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff9523e0794800.statahead_max=32 llite.lustre-ffff9523e0794800.statahead_max=32 1001 real 0m13.056s user 0m0.038s sys 0m1.541s 'ls -l' 1000 files with statahead: 13 sec statahead total: 122 statahead wrong: 2 agl total: 116 list_total: 30 fname_total: 82 hit_total: 4939 miss_total: 1394 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9523e0794800.statahead_stats= statahead total: 122 statahead wrong: 2 agl total: 116 list_total: 30 fname_total: 82 hit_total: 4939 miss_total: 1394 mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats= snapshot_time: 1786406811.186040379 secs.nsecs start_time: 1786406709.263113332 secs.nsecs elapsed_time: 101.922927047 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 871 (time 1786406824.26 total 10.02 last 86.94) - open/close 1725 (time 1786406834.26 total 20.02 last 85.37) - open/close 2432 (time 1786406844.27 total 30.03 last 70.67) - open/close 3201 (time 1786406854.27 total 40.03 last 76.87) - open/close 3934 (time 1786406864.28 total 50.04 last 73.25) - open/close 4715 (time 1786406874.29 total 60.04 last 78.05) - open/close 5455 (time 1786406884.30 total 70.05 last 73.93) - open/close 6125 (time 1786406894.30 total 80.05 last 67.00) - open/close 6769 (time 1786406904.30 total 90.05 last 64.40) - open/close 7502 (time 1786406914.30 total 100.06 last 73.26) - open/close 8275 (time 1786406924.31 total 110.06 last 77.27) - open/close 8898 (time 1786406934.33 total 120.08 last 62.18) - open/close 9311 (time 1786406944.35 total 130.11 last 41.21) - open/close 9849 (time 1786406954.36 total 140.12 last 53.71) total: 10000 open/close in 142.76 seconds: 70.05 ops/second llite.lustre-ffff9523e0794800.statahead_batch_max=0 llite.lustre-ffff9523e0794800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9523e0794800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.146s user 0m0.318s sys 0m15.328s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9523e0794800.statahead_batch_max=32 llite.lustre-ffff9523e0794800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9523e0794800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m40.982s user 0m0.301s sys 0m14.687s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats= snapshot_time: 1786407149.047726961 secs.nsecs start_time: 1786407033.194533263 secs.nsecs elapsed_time: 115.853193698 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats=0 llite.lustre-ffff9523e0794800.statahead_max=2048 llite.lustre-ffff9523e0794800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats=0 total: 100 open/close in 2.27 seconds: 44.05 ops/second llite.lustre-ffff9523e0794800.statahead_max=0 101 real 0m2.447s user 0m0.005s sys 0m0.312s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9523e0794800.statahead_max=2048 llite.lustre-ffff9523e0794800.statahead_max=2048 101 real 0m0.880s user 0m0.006s sys 0m0.198s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 768 (time 1786407480.19 total 10.00 last 76.79) total: 900 open/close in 11.95 seconds: 75.32 ops/second llite.lustre-ffff9523e0794800.statahead_max=0 1001 real 0m28.789s user 0m0.045s sys 0m3.231s 'ls -l' 1000 files without statahead: 29 sec llite.lustre-ffff9523e0794800.statahead_max=2048 llite.lustre-ffff9523e0794800.statahead_max=2048 1001 real 0m9.094s user 0m0.039s sys 0m1.569s 'ls -l' 1000 files with statahead: 10 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9523e0794800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats= snapshot_time: 1786407556.213669496 secs.nsecs start_time: 1786407151.552621714 secs.nsecs elapsed_time: 404.661047782 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 874 (time 1786407568.90 total 10.01 last 87.35) - open/close 1743 (time 1786407578.91 total 20.01 last 86.87) - open/close 2560 (time 1786407588.92 total 30.02 last 81.62) - open/close 3320 (time 1786407598.93 total 40.03 last 75.94) - open/close 4111 (time 1786407608.93 total 50.03 last 79.04) - open/close 4878 (time 1786407618.94 total 60.04 last 76.64) - open/close 5736 (time 1786407628.95 total 70.05 last 85.73) - open/close 6612 (time 1786407638.96 total 80.06 last 87.51) - open/close 7464 (time 1786407648.96 total 90.06 last 85.16) - open/close 8203 (time 1786407658.97 total 100.07 last 73.89) - open/close 8965 (time 1786407668.97 total 110.07 last 76.17) - open/close 9778 (time 1786407678.98 total 120.08 last 81.25) total: 10000 open/close in 122.34 seconds: 81.74 ops/second llite.lustre-ffff9523e0794800.statahead_batch_max=0 llite.lustre-ffff9523e0794800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9523e0794800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.170s user 0m0.317s sys 0m15.753s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9523e0794800.statahead_batch_max=256 llite.lustre-ffff9523e0794800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9523e0794800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.896s user 0m0.308s sys 0m15.608s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9523e0794800.batch_stats= snapshot_time: 1786407827.579657911 secs.nsecs start_time: 1786407755.129590237 secs.nsecs elapsed_time: 72.450067674 secs.nsecs subreqs per batch batches %% cum %% 1: 249 53 53 2: 74 15 69 4: 50 10 80 8: 23 4 85 16: 15 3 88 32: 15 3 91 64: 5 1 92 128: 1 0 92 256: 33 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9523e0794800.statahead_batch_max=64 llite.lustre-ffff9523e0794800.statahead_max=128