== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:24:02 (1787790242) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats=0 llite.lustre-ffff8c18d691b800.statahead_max=32 llite.lustre-ffff8c18d691b800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats=0 total: 100 open/close in 2.21 seconds: 45.28 ops/second llite.lustre-ffff8c18d691b800.statahead_max=0 101 real 0m1.672s user 0m0.006s sys 0m0.282s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8c18d691b800.statahead_max=32 llite.lustre-ffff8c18d691b800.statahead_max=32 101 real 0m0.823s user 0m0.005s sys 0m0.172s 'ls -l' 100 files with statahead: 1 sec statahead total: 144 statahead wrong: 2 agl total: 138 list_total: 30 fname_total: 114 hit_total: 4300 miss_total: 769 swrong=2 ewrong=2 - open/close 890 (time 1787790265.90 total 10.01 last 88.94) total: 900 open/close in 10.09 seconds: 89.16 ops/second llite.lustre-ffff8c18d691b800.statahead_max=0 1001 real 0m16.331s user 0m0.034s sys 0m2.712s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff8c18d691b800.statahead_max=32 llite.lustre-ffff8c18d691b800.statahead_max=32 1001 real 0m7.703s user 0m0.023s sys 0m1.258s 'ls -l' 1000 files with statahead: 7 sec statahead total: 145 statahead wrong: 2 agl total: 139 list_total: 31 fname_total: 114 hit_total: 5297 miss_total: 772 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff8c18d691b800.statahead_stats= statahead total: 145 statahead wrong: 2 agl total: 139 list_total: 31 fname_total: 114 hit_total: 5297 miss_total: 772 mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats= snapshot_time: 1787790317.872917552 secs.nsecs start_time: 1787790245.975113888 secs.nsecs elapsed_time: 71.897803664 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 884 (time 1787790330.42 total 10.01 last 88.32) - open/close 1817 (time 1787790340.43 total 20.02 last 93.24) - open/close 2665 (time 1787790350.44 total 30.02 last 84.74) - open/close 3482 (time 1787790360.45 total 40.04 last 81.60) - open/close 4342 (time 1787790370.46 total 50.04 last 85.95) - open/close 5160 (time 1787790380.47 total 60.06 last 81.68) - open/close 6046 (time 1787790390.47 total 70.06 last 88.58) - open/close 6878 (time 1787790400.47 total 80.06 last 83.19) - open/close 7798 (time 1787790410.48 total 90.07 last 91.95) - open/close 8578 (time 1787790420.48 total 100.07 last 78.00) - open/close 9554 (time 1787790430.48 total 110.07 last 97.57) total: 10000 open/close in 114.28 seconds: 87.50 ops/second llite.lustre-ffff8c18d691b800.statahead_batch_max=0 llite.lustre-ffff8c18d691b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c18d691b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.250s user 0m0.280s sys 0m13.803s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c18d691b800.statahead_batch_max=32 llite.lustre-ffff8c18d691b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c18d691b800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.759s user 0m0.266s sys 0m12.306s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats= snapshot_time: 1787790578.504747197 secs.nsecs start_time: 1787790490.267430618 secs.nsecs elapsed_time: 88.237316579 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats=0 llite.lustre-ffff8c18d691b800.statahead_max=2048 llite.lustre-ffff8c18d691b800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats=0 total: 100 open/close in 2.05 seconds: 48.77 ops/second llite.lustre-ffff8c18d691b800.statahead_max=0 101 real 0m1.819s user 0m0.003s sys 0m0.312s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8c18d691b800.statahead_max=2048 llite.lustre-ffff8c18d691b800.statahead_max=2048 101 real 0m0.737s user 0m0.004s sys 0m0.152s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 total: 900 open/close in 9.95 seconds: 90.45 ops/second llite.lustre-ffff8c18d691b800.statahead_max=0 1001 real 0m19.786s user 0m0.031s sys 0m2.908s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8c18d691b800.statahead_max=2048 llite.lustre-ffff8c18d691b800.statahead_max=2048 1001 real 0m4.285s user 0m0.027s sys 0m1.641s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff8c18d691b800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats= snapshot_time: 1787790901.540729843 secs.nsecs start_time: 1787790580.796256973 secs.nsecs elapsed_time: 320.744472870 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 0 0 45 128: 3 27 72 256: 3 27 100 - open/close 897 (time 1787790914.08 total 10.00 last 89.69) - open/close 1875 (time 1787790924.08 total 20.00 last 97.76) - open/close 2811 (time 1787790934.09 total 30.01 last 93.53) - open/close 3695 (time 1787790944.10 total 40.02 last 88.29) - open/close 4485 (time 1787790954.10 total 50.03 last 78.98) - open/close 5323 (time 1787790964.11 total 60.03 last 83.77) - open/close 6240 (time 1787790974.12 total 70.04 last 91.58) - open/close 7082 (time 1787790984.13 total 80.05 last 84.12) - open/close 7931 (time 1787790994.13 total 90.05 last 84.89) - open/close 8782 (time 1787791004.14 total 100.06 last 85.02) - open/close 9628 (time 1787791014.15 total 110.07 last 84.54) total: 10000 open/close in 114.69 seconds: 87.19 ops/second llite.lustre-ffff8c18d691b800.statahead_batch_max=0 llite.lustre-ffff8c18d691b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c18d691b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.126s user 0m0.267s sys 0m14.274s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c18d691b800.statahead_batch_max=256 llite.lustre-ffff8c18d691b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c18d691b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.308s user 0m0.261s sys 0m13.955s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c18d691b800.batch_stats= snapshot_time: 1787791118.357252459 secs.nsecs start_time: 1787791070.279413555 secs.nsecs elapsed_time: 48.077838904 secs.nsecs subreqs per batch batches %% cum %% 1: 144 51 51 2: 31 11 62 4: 20 7 69 8: 13 4 74 16: 15 5 79 32: 20 7 86 64: 3 1 87 128: 0 0 87 256: 35 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c18d691b800.statahead_batch_max=64 llite.lustre-ffff8c18d691b800.statahead_max=128