== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:56:17 (1787568977) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats=0 llite.lustre-ffff989049fec800.statahead_max=32 llite.lustre-ffff989049fec800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats=0 total: 100 open/close in 3.03 seconds: 33.00 ops/second llite.lustre-ffff989049fec800.statahead_max=0 101 real 0m3.298s user 0m0.005s sys 0m0.314s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff989049fec800.statahead_max=32 llite.lustre-ffff989049fec800.statahead_max=32 101 real 0m1.180s user 0m0.003s sys 0m0.154s 'ls -l' 100 files with statahead: 1 sec statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 30 fname_total: 84 hit_total: 3651 miss_total: 1433 swrong=2 ewrong=2 - open/close 827 (time 1787569007.59 total 10.01 last 82.61) total: 900 open/close in 11.35 seconds: 79.28 ops/second llite.lustre-ffff989049fec800.statahead_max=0 1001 real 0m20.207s user 0m0.039s sys 0m2.842s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff989049fec800.statahead_max=32 llite.lustre-ffff989049fec800.statahead_max=32 1001 real 0m9.257s user 0m0.030s sys 0m1.295s 'ls -l' 1000 files with statahead: 10 sec statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 31 fname_total: 84 hit_total: 4645 miss_total: 1439 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff989049fec800.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 31 fname_total: 84 hit_total: 4645 miss_total: 1439 mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats= snapshot_time: 1787569074.933989640 secs.nsecs start_time: 1787568982.986238155 secs.nsecs elapsed_time: 91.947751485 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 5 5 16: 2 5 10 32: 34 89 100 - open/close 838 (time 1787569087.43 total 10.00 last 83.80) - open/close 1727 (time 1787569097.43 total 20.00 last 88.86) - open/close 2579 (time 1787569107.43 total 30.01 last 85.20) - open/close 3394 (time 1787569117.44 total 40.01 last 81.49) - open/close 4290 (time 1787569127.46 total 50.03 last 89.36) - open/close 5087 (time 1787569137.47 total 60.04 last 79.64) - open/close 5950 (time 1787569147.47 total 70.04 last 86.27) - open/close 6771 (time 1787569157.48 total 80.05 last 82.05) - open/close 7559 (time 1787569167.49 total 90.06 last 78.69) - open/close 8237 (time 1787569177.50 total 100.07 last 67.76) - open/close 8929 (time 1787569187.50 total 110.07 last 69.18) - open/close 9609 (time 1787569197.50 total 120.07 last 68.00) total: 10000 open/close in 124.42 seconds: 80.37 ops/second llite.lustre-ffff989049fec800.statahead_batch_max=0 llite.lustre-ffff989049fec800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff989049fec800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.718s user 0m0.293s sys 0m13.581s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff989049fec800.statahead_batch_max=32 llite.lustre-ffff989049fec800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff989049fec800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m37.923s user 0m0.280s sys 0m12.605s batched statahead RPC= hit count=9976 mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats= snapshot_time: 1787569382.774119711 secs.nsecs start_time: 1787569272.342585595 secs.nsecs elapsed_time: 110.431534116 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats=0 llite.lustre-ffff989049fec800.statahead_max=2048 llite.lustre-ffff989049fec800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats=0 total: 100 open/close in 2.42 seconds: 41.35 ops/second llite.lustre-ffff989049fec800.statahead_max=0 101 real 0m2.130s user 0m0.003s sys 0m0.294s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff989049fec800.statahead_max=2048 llite.lustre-ffff989049fec800.statahead_max=2048 101 real 0m0.811s user 0m0.005s sys 0m0.151s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10075 miss_total: 25 swrong=0 ewrong=0 - open/close 727 (time 1787569673.49 total 10.00 last 72.68) total: 900 open/close in 12.17 seconds: 73.98 ops/second llite.lustre-ffff989049fec800.statahead_max=0 1001 real 0m16.186s user 0m0.032s sys 0m2.653s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff989049fec800.statahead_max=2048 llite.lustre-ffff989049fec800.statahead_max=2048 1001 real 0m6.717s user 0m0.030s sys 0m1.330s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11074 miss_total: 26 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff989049fec800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11074 miss_total: 26 mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats= snapshot_time: 1787569731.207181621 secs.nsecs start_time: 1787569384.879600882 secs.nsecs elapsed_time: 346.327580739 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 593 (time 1787569743.59 total 10.04 last 59.07) - open/close 1121 (time 1787569753.60 total 20.05 last 52.72) - open/close 2006 (time 1787569763.61 total 30.06 last 88.47) - open/close 2908 (time 1787569773.61 total 40.06 last 90.14) - open/close 3660 (time 1787569783.61 total 50.06 last 75.19) - open/close 4595 (time 1787569793.62 total 60.07 last 93.43) - open/close 5509 (time 1787569803.63 total 70.08 last 91.36) - open/close 6139 (time 1787569813.63 total 80.09 last 62.95) - open/close 7018 (time 1787569823.64 total 90.09 last 87.89) - open/close 7820 (time 1787569833.64 total 100.09 last 80.19) - open/close 8575 (time 1787569843.65 total 110.10 last 75.40) - open/close 9428 (time 1787569853.66 total 120.11 last 85.20) total: 10000 open/close in 126.71 seconds: 78.92 ops/second llite.lustre-ffff989049fec800.statahead_batch_max=0 llite.lustre-ffff989049fec800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff989049fec800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.454s user 0m0.309s sys 0m13.576s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff989049fec800.statahead_batch_max=256 llite.lustre-ffff989049fec800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff989049fec800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.437s user 0m0.284s sys 0m13.900s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff989049fec800.batch_stats= snapshot_time: 1787569984.295134873 secs.nsecs start_time: 1787569929.096010641 secs.nsecs elapsed_time: 55.199124232 secs.nsecs subreqs per batch batches %% cum %% 1: 171 48 48 2: 63 18 66 4: 37 10 77 8: 15 4 81 16: 7 2 83 32: 16 4 88 64: 5 1 89 128: 2 0 90 256: 34 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff989049fec800.statahead_batch_max=64 llite.lustre-ffff989049fec800.statahead_max=128