== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:45:39 (1788626739) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats=0 llite.lustre-ffff8feb87c68800.statahead_max=32 llite.lustre-ffff8feb87c68800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats=0 total: 100 open/close in 4.26 seconds: 23.45 ops/second llite.lustre-ffff8feb87c68800.statahead_max=0 101 real 0m3.937s user 0m0.008s sys 0m0.321s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8feb87c68800.statahead_max=32 llite.lustre-ffff8feb87c68800.statahead_max=32 101 real 0m1.435s user 0m0.006s sys 0m0.164s 'ls -l' 100 files with statahead: 1 sec statahead total: 162 statahead wrong: 2 agl total: 155 list_total: 30 fname_total: 122 hit_total: 4000 miss_total: 1734 swrong=2 ewrong=2 - open/close 579 (time 1788626775.85 total 10.03 last 57.74) total: 900 open/close in 15.77 seconds: 57.08 ops/second llite.lustre-ffff8feb87c68800.statahead_max=0 1001 real 0m27.727s user 0m0.039s sys 0m3.313s 'ls -l' 1000 files without statahead: 28 sec llite.lustre-ffff8feb87c68800.statahead_max=32 llite.lustre-ffff8feb87c68800.statahead_max=32 1001 real 0m14.476s user 0m0.029s sys 0m1.489s 'ls -l' 1000 files with statahead: 14 sec statahead total: 163 statahead wrong: 2 agl total: 156 list_total: 31 fname_total: 122 hit_total: 4995 miss_total: 1739 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 27 seconds llite.lustre-ffff8feb87c68800.statahead_stats= statahead total: 163 statahead wrong: 2 agl total: 156 list_total: 31 fname_total: 122 hit_total: 4995 miss_total: 1739 mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats= snapshot_time: 1788626866.485924562 secs.nsecs start_time: 1788626746.106676343 secs.nsecs elapsed_time: 120.379248219 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 2 5 7 16: 3 7 15 32: 34 85 100 - open/close 596 (time 1788626880.20 total 10.01 last 59.53) - open/close 1160 (time 1788626890.21 total 20.02 last 56.35) - open/close 1816 (time 1788626900.22 total 30.03 last 65.56) - open/close 2574 (time 1788626910.22 total 40.03 last 75.78) - open/close 3286 (time 1788626920.23 total 50.04 last 71.13) - open/close 4005 (time 1788626930.24 total 60.05 last 71.86) - open/close 4734 (time 1788626940.24 total 70.05 last 72.88) - open/close 5449 (time 1788626950.25 total 80.05 last 71.46) - open/close 6087 (time 1788626960.25 total 90.06 last 63.78) - open/close 6746 (time 1788626970.26 total 100.07 last 65.84) - open/close 7419 (time 1788626980.27 total 110.08 last 67.20) - open/close 8174 (time 1788626990.28 total 120.09 last 75.44) - open/close 8703 (time 1788627000.29 total 130.10 last 52.83) - open/close 9242 (time 1788627010.31 total 140.11 last 53.84) - open/close 9698 (time 1788627020.34 total 150.15 last 45.42) total: 10000 open/close in 155.09 seconds: 64.48 ops/second llite.lustre-ffff8feb87c68800.statahead_batch_max=0 llite.lustre-ffff8feb87c68800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8feb87c68800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m16.473s user 0m0.416s sys 0m15.346s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8feb87c68800.statahead_batch_max=32 llite.lustre-ffff8feb87c68800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8feb87c68800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m52.857s user 0m0.383s sys 0m14.333s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats= snapshot_time: 1788627236.873998354 secs.nsecs start_time: 1788627112.030649166 secs.nsecs elapsed_time: 124.843349188 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats=0 llite.lustre-ffff8feb87c68800.statahead_max=2048 llite.lustre-ffff8feb87c68800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats=0 total: 100 open/close in 3.50 seconds: 28.57 ops/second llite.lustre-ffff8feb87c68800.statahead_max=0 101 real 0m3.634s user 0m0.006s sys 0m0.351s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff8feb87c68800.statahead_max=2048 llite.lustre-ffff8feb87c68800.statahead_max=2048 101 real 0m1.028s user 0m0.006s sys 0m0.186s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 - open/close 615 (time 1788627599.89 total 10.01 last 61.44) total: 900 open/close in 14.98 seconds: 60.08 ops/second llite.lustre-ffff8feb87c68800.statahead_max=0 1001 real 0m24.599s user 0m0.031s sys 0m3.194s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff8feb87c68800.statahead_max=2048 llite.lustre-ffff8feb87c68800.statahead_max=2048 1001 real 0m8.255s user 0m0.040s sys 0m1.481s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8feb87c68800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats= snapshot_time: 1788627675.717490841 secs.nsecs start_time: 1788627240.043990872 secs.nsecs elapsed_time: 435.673499969 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 755 (time 1788627688.95 total 10.01 last 75.46) - open/close 1433 (time 1788627698.96 total 20.01 last 67.74) - open/close 2105 (time 1788627708.96 total 30.02 last 67.17) - open/close 2751 (time 1788627718.96 total 40.02 last 64.59) - open/close 3421 (time 1788627728.97 total 50.03 last 66.95) - open/close 4085 (time 1788627738.98 total 60.03 last 66.36) - open/close 4828 (time 1788627748.99 total 70.05 last 74.22) - open/close 5571 (time 1788627758.99 total 80.05 last 74.24) - open/close 6354 (time 1788627769.00 total 90.06 last 78.28) - open/close 7080 (time 1788627779.00 total 100.06 last 72.58) - open/close 7815 (time 1788627789.00 total 110.06 last 73.49) - open/close 8644 (time 1788627799.05 total 120.11 last 82.52) - open/close 9445 (time 1788627809.05 total 130.11 last 80.06) total: 10000 open/close in 136.86 seconds: 73.06 ops/second llite.lustre-ffff8feb87c68800.statahead_batch_max=0 llite.lustre-ffff8feb87c68800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8feb87c68800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.150s user 0m0.326s sys 0m13.944s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8feb87c68800.statahead_batch_max=256 llite.lustre-ffff8feb87c68800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8feb87c68800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.629s user 0m0.319s sys 0m13.599s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8feb87c68800.batch_stats= snapshot_time: 1788627951.386854480 secs.nsecs start_time: 1788627886.067283442 secs.nsecs elapsed_time: 65.319571038 secs.nsecs subreqs per batch batches %% cum %% 1: 91 34 34 2: 48 17 52 4: 39 14 66 8: 21 7 74 16: 11 4 78 32: 15 5 84 64: 7 2 86 128: 1 0 87 256: 34 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8feb87c68800.statahead_batch_max=64 llite.lustre-ffff8feb87c68800.statahead_max=128