== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:28:07 (1783142887) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats=0 llite.lustre-ffff8ed28b8e0000.statahead_max=32 llite.lustre-ffff8ed28b8e0000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats=0 total: 100 open/close in 2.00 seconds: 49.88 ops/second llite.lustre-ffff8ed28b8e0000.statahead_max=0 101 real 0m1.812s user 0m0.008s sys 0m0.364s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ed28b8e0000.statahead_max=32 llite.lustre-ffff8ed28b8e0000.statahead_max=32 101 real 0m0.751s user 0m0.008s sys 0m0.219s 'ls -l' 100 files with statahead: 1 sec statahead total: 100 statahead wrong: 2 agl total: 95 list_total: 30 fname_total: 70 hit_total: 4256 miss_total: 777 swrong=2 ewrong=2 total: 900 open/close in 9.00 seconds: 100.04 ops/second llite.lustre-ffff8ed28b8e0000.statahead_max=0 1001 real 0m18.670s user 0m0.050s sys 0m3.311s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8ed28b8e0000.statahead_max=32 llite.lustre-ffff8ed28b8e0000.statahead_max=32 1001 real 0m5.790s user 0m0.028s sys 0m2.064s 'ls -l' 1000 files with statahead: 6 sec statahead total: 101 statahead wrong: 2 agl total: 96 list_total: 31 fname_total: 70 hit_total: 5254 miss_total: 779 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff8ed28b8e0000.statahead_stats= statahead total: 101 statahead wrong: 2 agl total: 96 list_total: 31 fname_total: 70 hit_total: 5254 miss_total: 779 mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats= snapshot_time: 1783142951.374716068 secs.nsecs start_time: 1783142890.060614070 secs.nsecs elapsed_time: 61.314101998 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 842 (time 1783142963.08 total 10.00 last 84.20) - open/close 1756 (time 1783142973.08 total 20.01 last 91.36) - open/close 2721 (time 1783142983.09 total 30.01 last 96.42) - open/close 3729 (time 1783142993.10 total 40.02 last 100.71) - open/close 4661 (time 1783143003.11 total 50.03 last 93.09) - open/close 5902 (time 1783143013.12 total 60.04 last 124.06) - open/close 7019 (time 1783143023.12 total 70.04 last 111.61) - open/close 8034 (time 1783143033.14 total 80.06 last 101.37) - open/close 9126 (time 1783143043.14 total 90.06 last 109.17) total: 10000 open/close in 98.80 seconds: 101.21 ops/second llite.lustre-ffff8ed28b8e0000.statahead_batch_max=0 llite.lustre-ffff8ed28b8e0000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.126s user 0m0.318s sys 0m25.908s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ed28b8e0000.statahead_batch_max=32 llite.lustre-ffff8ed28b8e0000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.029s user 0m0.270s sys 0m19.513s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats= snapshot_time: 1783143157.733122505 secs.nsecs start_time: 1783143096.368720612 secs.nsecs elapsed_time: 61.364401893 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats=0 llite.lustre-ffff8ed28b8e0000.statahead_max=2048 llite.lustre-ffff8ed28b8e0000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats=0 total: 100 open/close in 1.43 seconds: 69.73 ops/second llite.lustre-ffff8ed28b8e0000.statahead_max=0 101 real 0m1.335s user 0m0.008s sys 0m0.339s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8ed28b8e0000.statahead_max=2048 llite.lustre-ffff8ed28b8e0000.statahead_max=2048 101 real 0m0.482s user 0m0.004s sys 0m0.214s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 total: 900 open/close in 6.54 seconds: 137.63 ops/second llite.lustre-ffff8ed28b8e0000.statahead_max=0 1001 real 0m12.329s user 0m0.031s sys 0m3.028s 'ls -l' 1000 files without statahead: 12 sec llite.lustre-ffff8ed28b8e0000.statahead_max=2048 llite.lustre-ffff8ed28b8e0000.statahead_max=2048 1001 real 0m3.681s user 0m0.024s sys 0m1.916s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff8ed28b8e0000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats= snapshot_time: 1783143382.639208995 secs.nsecs start_time: 1783143158.908654792 secs.nsecs elapsed_time: 223.730554203 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 25 25 16: 1 12 37 32: 0 0 37 64: 0 0 37 128: 1 12 50 256: 4 50 100 - open/close 1258 (time 1783143394.18 total 10.00 last 125.77) - open/close 2641 (time 1783143404.18 total 20.01 last 138.24) - open/close 4040 (time 1783143414.18 total 30.01 last 139.86) - open/close 5831 (time 1783143424.19 total 40.01 last 179.04) - open/close 7159 (time 1783143434.19 total 50.01 last 132.80) - open/close 8256 (time 1783143444.19 total 60.02 last 109.61) - open/close 9285 (time 1783143454.20 total 70.03 last 102.86) total: 10000 open/close in 76.47 seconds: 130.77 ops/second llite.lustre-ffff8ed28b8e0000.statahead_batch_max=0 llite.lustre-ffff8ed28b8e0000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.198s user 0m0.250s sys 0m25.312s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ed28b8e0000.statahead_batch_max=256 llite.lustre-ffff8ed28b8e0000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.293s user 0m0.336s sys 0m23.317s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8ed28b8e0000.batch_stats= snapshot_time: 1783143550.107736198 secs.nsecs start_time: 1783143503.414043745 secs.nsecs elapsed_time: 46.693692453 secs.nsecs subreqs per batch batches %% cum %% 1: 364 65 65 2: 57 10 75 4: 61 10 86 8: 14 2 89 16: 11 1 91 32: 14 2 93 64: 2 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8ed28b8e0000.statahead_batch_max=64 llite.lustre-ffff8ed28b8e0000.statahead_max=128