== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:20:50 (1783142450) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats=0 llite.lustre-ffff9a99499c4800.statahead_max=32 llite.lustre-ffff9a99499c4800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats=0 total: 100 open/close in 2.22 seconds: 45.01 ops/second llite.lustre-ffff9a99499c4800.statahead_max=0 101 real 0m1.834s user 0m0.003s sys 0m0.332s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a99499c4800.statahead_max=32 llite.lustre-ffff9a99499c4800.statahead_max=32 101 real 0m0.727s user 0m0.001s sys 0m0.178s 'ls -l' 100 files with statahead: 1 sec statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 30 fname_total: 96 hit_total: 3743 miss_total: 1634 swrong=2 ewrong=2 - open/close 792 (time 1783142473.59 total 10.01 last 79.14) total: 900 open/close in 11.45 seconds: 78.64 ops/second llite.lustre-ffff9a99499c4800.statahead_max=0 1001 real 0m21.750s user 0m0.036s sys 0m3.254s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9a99499c4800.statahead_max=32 llite.lustre-ffff9a99499c4800.statahead_max=32 1001 real 0m8.125s user 0m0.029s sys 0m1.562s 'ls -l' 1000 files with statahead: 8 sec statahead total: 127 statahead wrong: 2 agl total: 122 list_total: 31 fname_total: 96 hit_total: 4741 miss_total: 1636 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff9a99499c4800.statahead_stats= statahead total: 127 statahead wrong: 2 agl total: 122 list_total: 31 fname_total: 96 hit_total: 4741 miss_total: 1636 mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats= snapshot_time: 1783142532.314329049 secs.nsecs start_time: 1783142454.170535468 secs.nsecs elapsed_time: 78.143793581 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 804 (time 1783142544.32 total 10.01 last 80.32) - open/close 1581 (time 1783142554.33 total 20.01 last 77.66) - open/close 2397 (time 1783142564.33 total 30.02 last 81.56) - open/close 3182 (time 1783142574.33 total 40.02 last 78.46) - open/close 3944 (time 1783142584.34 total 50.03 last 76.13) - open/close 4749 (time 1783142594.35 total 60.04 last 80.42) - open/close 5632 (time 1783142604.36 total 70.05 last 88.27) - open/close 6456 (time 1783142614.36 total 80.05 last 82.35) - open/close 7281 (time 1783142624.37 total 90.06 last 82.44) - open/close 8056 (time 1783142634.38 total 100.07 last 77.46) - open/close 8889 (time 1783142644.38 total 110.07 last 83.27) - open/close 9842 (time 1783142654.39 total 120.08 last 95.22) total: 10000 open/close in 121.71 seconds: 82.16 ops/second llite.lustre-ffff9a99499c4800.statahead_batch_max=0 llite.lustre-ffff9a99499c4800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a99499c4800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.192s user 0m0.292s sys 0m21.041s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a99499c4800.statahead_batch_max=32 llite.lustre-ffff9a99499c4800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a99499c4800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m15.608s user 0m0.282s sys 0m16.046s batched statahead RPC= hit count=9992 mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats= snapshot_time: 1783142792.196071984 secs.nsecs start_time: 1783142707.253941077 secs.nsecs elapsed_time: 84.942130907 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats=0 llite.lustre-ffff9a99499c4800.statahead_max=2048 llite.lustre-ffff9a99499c4800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats=0 total: 100 open/close in 1.74 seconds: 57.60 ops/second llite.lustre-ffff9a99499c4800.statahead_max=0 101 real 0m1.673s user 0m0.005s sys 0m0.340s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a99499c4800.statahead_max=2048 llite.lustre-ffff9a99499c4800.statahead_max=2048 101 real 0m0.643s user 0m0.004s sys 0m0.254s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10091 miss_total: 9 swrong=0 ewrong=0 total: 900 open/close in 8.30 seconds: 108.39 ops/second llite.lustre-ffff9a99499c4800.statahead_max=0 1001 real 0m16.073s user 0m0.036s sys 0m3.182s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff9a99499c4800.statahead_max=2048 llite.lustre-ffff9a99499c4800.statahead_max=2048 1001 real 0m4.251s user 0m0.022s sys 0m1.709s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11090 miss_total: 10 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff9a99499c4800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11090 miss_total: 10 mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats= snapshot_time: 1783143068.683594820 secs.nsecs start_time: 1783142794.110952904 secs.nsecs elapsed_time: 274.572641916 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 0 0 45 128: 3 27 72 256: 3 27 100 - open/close 1022 (time 1783143080.04 total 10.00 last 102.20) - open/close 2112 (time 1783143090.05 total 20.01 last 108.93) - open/close 3332 (time 1783143100.05 total 30.01 last 121.95) - open/close 4571 (time 1783143110.05 total 40.01 last 123.86) - open/close 5810 (time 1783143120.06 total 50.02 last 123.86) - open/close 7102 (time 1783143130.06 total 60.02 last 129.12) - open/close 8404 (time 1783143140.07 total 70.03 last 130.14) - open/close 9522 (time 1783143150.07 total 80.03 last 111.79) total: 10000 open/close in 83.93 seconds: 119.15 ops/second llite.lustre-ffff9a99499c4800.statahead_batch_max=0 llite.lustre-ffff9a99499c4800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a99499c4800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.666s user 0m0.326s sys 0m25.800s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a99499c4800.statahead_batch_max=256 llite.lustre-ffff9a99499c4800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a99499c4800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.094s user 0m0.274s sys 0m22.037s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a99499c4800.batch_stats= snapshot_time: 1783143238.952124404 secs.nsecs start_time: 1783143197.098915001 secs.nsecs elapsed_time: 41.853209403 secs.nsecs subreqs per batch batches %% cum %% 1: 446 67 67 2: 85 12 79 4: 58 8 88 8: 13 1 90 16: 7 1 91 32: 18 2 94 64: 4 0 95 128: 0 0 95 256: 33 4 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a99499c4800.statahead_batch_max=64 llite.lustre-ffff9a99499c4800.statahead_max=128