== sanity test 123ad: Verify batching statahead works correctly ========================================================== 02:38:15 (1786171095) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats=0 llite.lustre-ffff8ba0a74c4000.statahead_max=32 llite.lustre-ffff8ba0a74c4000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats=0 total: 100 open/close in 2.22 seconds: 45.10 ops/second llite.lustre-ffff8ba0a74c4000.statahead_max=0 101 real 0m2.709s user 0m0.006s sys 0m0.334s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ba0a74c4000.statahead_max=32 llite.lustre-ffff8ba0a74c4000.statahead_max=32 101 real 0m1.262s user 0m0.005s sys 0m0.164s 'ls -l' 100 files with statahead: 1 sec statahead total: 123 statahead wrong: 2 agl total: 117 list_total: 30 fname_total: 93 hit_total: 4056 miss_total: 1510 swrong=2 ewrong=2 - open/close 730 (time 1786171121.71 total 10.01 last 72.93) total: 900 open/close in 12.23 seconds: 73.59 ops/second llite.lustre-ffff8ba0a74c4000.statahead_max=0 1001 real 0m17.850s user 0m0.025s sys 0m3.077s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8ba0a74c4000.statahead_max=32 llite.lustre-ffff8ba0a74c4000.statahead_max=32 1001 real 0m11.781s user 0m0.027s sys 0m1.436s 'ls -l' 1000 files with statahead: 12 sec statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 93 hit_total: 5054 miss_total: 1512 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8ba0a74c4000.statahead_stats= statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 93 hit_total: 5054 miss_total: 1512 mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats= snapshot_time: 1786171187.932529245 secs.nsecs start_time: 1786171099.510734390 secs.nsecs elapsed_time: 88.421794855 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 1 2 10 32: 34 89 100 - open/close 689 (time 1786171201.32 total 10.01 last 68.83) - open/close 1462 (time 1786171211.34 total 20.02 last 77.21) - open/close 2317 (time 1786171221.34 total 30.02 last 85.50) - open/close 3109 (time 1786171231.34 total 40.03 last 79.16) - open/close 3946 (time 1786171241.34 total 50.03 last 83.68) - open/close 4835 (time 1786171251.35 total 60.04 last 88.84) - open/close 5667 (time 1786171261.37 total 70.05 last 83.06) - open/close 6526 (time 1786171271.38 total 80.06 last 85.82) - open/close 7250 (time 1786171281.38 total 90.07 last 72.36) - open/close 7837 (time 1786171291.41 total 100.09 last 58.57) - open/close 8303 (time 1786171301.41 total 110.09 last 46.59) - open/close 8944 (time 1786171311.42 total 120.11 last 64.01) - open/close 9699 (time 1786171321.43 total 130.11 last 75.47) total: 10000 open/close in 135.13 seconds: 74.00 ops/second llite.lustre-ffff8ba0a74c4000.statahead_batch_max=0 llite.lustre-ffff8ba0a74c4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.616s user 0m0.313s sys 0m16.351s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ba0a74c4000.statahead_batch_max=32 llite.lustre-ffff8ba0a74c4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m48.085s user 0m0.285s sys 0m15.024s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats= snapshot_time: 1786171549.612338865 secs.nsecs start_time: 1786171418.510730805 secs.nsecs elapsed_time: 131.101608060 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats=0 llite.lustre-ffff8ba0a74c4000.statahead_max=2048 llite.lustre-ffff8ba0a74c4000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats=0 total: 100 open/close in 2.96 seconds: 33.81 ops/second llite.lustre-ffff8ba0a74c4000.statahead_max=0 101 real 0m2.204s user 0m0.003s sys 0m0.349s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ba0a74c4000.statahead_max=2048 llite.lustre-ffff8ba0a74c4000.statahead_max=2048 101 real 0m1.027s user 0m0.005s sys 0m0.167s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 - open/close 616 (time 1786171852.00 total 10.03 last 61.40) total: 900 open/close in 15.33 seconds: 58.72 ops/second llite.lustre-ffff8ba0a74c4000.statahead_max=0 1001 real 0m20.725s user 0m0.032s sys 0m3.100s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff8ba0a74c4000.statahead_max=2048 llite.lustre-ffff8ba0a74c4000.statahead_max=2048 1001 real 0m7.298s user 0m0.030s sys 0m1.591s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff8ba0a74c4000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats= snapshot_time: 1786171917.587996056 secs.nsecs start_time: 1786171552.105516836 secs.nsecs elapsed_time: 365.482479220 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 716 (time 1786171930.98 total 10.01 last 71.54) - open/close 1650 (time 1786171940.98 total 20.01 last 93.39) - open/close 2590 (time 1786171950.98 total 30.02 last 93.93) - open/close 3504 (time 1786171960.99 total 40.02 last 91.39) - open/close 4470 (time 1786171970.99 total 50.02 last 96.60) - open/close 5341 (time 1786171980.99 total 60.02 last 87.09) - open/close 6192 (time 1786171991.00 total 70.03 last 84.98) - open/close 6949 (time 1786172001.01 total 80.04 last 75.63) - open/close 7699 (time 1786172011.02 total 90.05 last 74.93) - open/close 8332 (time 1786172021.03 total 100.07 last 63.20) - open/close 9099 (time 1786172031.05 total 110.08 last 76.57) - open/close 9836 (time 1786172041.06 total 120.09 last 73.66) total: 10000 open/close in 123.07 seconds: 81.25 ops/second llite.lustre-ffff8ba0a74c4000.statahead_batch_max=0 llite.lustre-ffff8ba0a74c4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.914s user 0m0.296s sys 0m15.207s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ba0a74c4000.statahead_batch_max=256 llite.lustre-ffff8ba0a74c4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.684s user 0m0.288s sys 0m15.325s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8ba0a74c4000.batch_stats= snapshot_time: 1786172180.848553542 secs.nsecs start_time: 1786172108.825850650 secs.nsecs elapsed_time: 72.022702892 secs.nsecs subreqs per batch batches %% cum %% 1: 192 46 46 2: 68 16 62 4: 49 11 74 8: 32 7 82 16: 18 4 86 32: 15 3 90 64: 6 1 91 128: 1 0 92 256: 33 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8ba0a74c4000.statahead_batch_max=64 llite.lustre-ffff8ba0a74c4000.statahead_max=128