== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:04:22 (1709057062) batching: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats=0 llite.lustre-ffff88007dd09000.statahead_max=32 llite.lustre-ffff88007dd09000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats=0 total: 100 open/close in 1.30 seconds: 77.20 ops/second llite.lustre-ffff88007dd09000.statahead_max=0 101 real 0m1.018s user 0m0.003s sys 0m0.254s ls -l 100 files without statahead: 1 sec llite.lustre-ffff88007dd09000.statahead_max=32 32 101 real 0m0.310s user 0m0.007s sys 0m0.102s ls -l 100 files with statahead: 0 sec statahead total: 28 statahead wrong: 0 agl total: 28 list_total: 28 fname_total: 0 hit_total: 1777 miss_total: 139 total: 900 open/close in 5.09 seconds: 176.78 ops/second llite.lustre-ffff88007dd09000.statahead_max=0 1001 real 0m12.738s user 0m0.063s sys 0m2.786s ls -l 1000 files without statahead: 13 sec llite.lustre-ffff88007dd09000.statahead_max=32 32 1001 real 0m3.222s user 0m0.032s sys 0m1.015s ls -l 1000 files with statahead: 3 sec statahead total: 29 statahead wrong: 0 agl total: 29 list_total: 29 fname_total: 0 hit_total: 2776 miss_total: 149 ls -l done rm -r /mnt/lustre/d123ad.sanity/: 8 seconds rm done statahead total: 29 statahead wrong: 0 agl total: 29 list_total: 29 fname_total: 0 hit_total: 2776 miss_total: 149 mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats= snapshot_time: 1709057103.226750044 secs.nsecs start_time: 1709057064.115057222 secs.nsecs elapsed_time: 39.111692822 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 1445 (time 1709057114.45 total 10.00 last 144.44) - open/close 1624 (time 1709057126.98 total 22.53 last 14.29) - open/close 1903 (time 1709057140.57 total 36.12 last 20.53) - open/close 3220 (time 1709057150.58 total 46.13 last 131.65) - open/close 4360 (time 1709057160.58 total 56.13 last 113.92) - open/close 4921 (time 1709057176.87 total 72.42 last 34.44) - open/close 5873 (time 1709057186.88 total 82.43 last 95.12) - open/close 6742 (time 1709057196.88 total 92.43 last 86.88) - open/close 7806 (time 1709057206.89 total 102.44 last 106.32) - open/close 8687 (time 1709057216.90 total 112.45 last 88.03) - open/close 9276 (time 1709057234.43 total 129.98 last 33.59) - open/close 9301 (time 1709057245.74 total 141.29 last 2.21) total: 10000 open/close in 149.28 seconds: 66.99 ops/second llite.lustre-ffff88007dd09000.statahead_batch_max=0 llite.lustre-ffff88007dd09000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88007dd09000.stats=clear 10001 real 0m18.267s user 0m0.263s sys 0m10.398s llite.lustre-ffff88007dd09000.statahead_batch_max=32 llite.lustre-ffff88007dd09000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88007dd09000.stats=clear 10001 real 0m38.243s user 0m0.294s sys 0m12.023s unbatched RPCs: 10004, batched RPCs: 315 mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats= snapshot_time: 1709057323.350739136 secs.nsecs start_time: 1709057277.578039000 secs.nsecs elapsed_time: 45.772700136 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batching: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats=0 llite.lustre-ffff88007dd09000.statahead_max=2048 llite.lustre-ffff88007dd09000.statahead_batch_max=256 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats=0 total: 100 open/close in 1.49 seconds: 67.09 ops/second llite.lustre-ffff88007dd09000.statahead_max=0 101 real 0m1.498s user 0m0.001s sys 0m0.293s ls -l 100 files without statahead: 1 sec llite.lustre-ffff88007dd09000.statahead_max=2048 2048 101 real 0m0.397s user 0m0.006s sys 0m0.110s ls -l 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 57 - open/close 391 (time 1709057466.62 total 14.57 last 26.83) total: 900 open/close in 18.85 seconds: 47.75 ops/second llite.lustre-ffff88007dd09000.statahead_max=0 1001 real 0m13.090s user 0m0.066s sys 0m2.823s ls -l 1000 files without statahead: 13 sec llite.lustre-ffff88007dd09000.statahead_max=2048 2048 1001 real 0m1.981s user 0m0.042s sys 0m1.117s ls -l 1000 files with statahead: 2 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 58 ls -l done rm -r /mnt/lustre/d123ad.sanity/: 10 seconds rm done statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 58 mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats= snapshot_time: 1709057502.399409182 secs.nsecs start_time: 1709057324.574502133 secs.nsecs elapsed_time: 177.824907049 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 0 0 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 66 (time 1709057515.71 total 11.81 last 5.59) - open/close 170 (time 1709057527.77 total 23.87 last 8.62) - open/close 1254 (time 1709057537.78 total 33.88 last 108.28) - open/close 1959 (time 1709057555.11 total 51.21 last 40.68) - open/close 1970 (time 1709057566.30 total 62.40 last 0.98) - open/close 2038 (time 1709057578.21 total 74.31 last 5.71) - open/close 3053 (time 1709057588.23 total 84.32 last 101.36) - open/close 3127 (time 1709057599.93 total 96.02 last 6.33) - open/close 3213 (time 1709057611.84 total 107.94 last 7.22) - open/close 3611 (time 1709057626.27 total 122.37 last 27.58) - open/close 4218 (time 1709057643.24 total 139.33 last 35.79) - open/close 5174 (time 1709057653.24 total 149.34 last 95.52) - open/close 6105 (time 1709057663.26 total 159.35 last 92.96) - open/close 6711 (time 1709057681.00 total 177.10 last 34.16) - open/close 7193 (time 1709057697.55 total 193.64 last 29.13) - open/close 8017 (time 1709057707.55 total 203.65 last 82.35) - open/close 8422 (time 1709057723.46 total 219.55 last 25.47) - open/close 8865 (time 1709057740.25 total 236.35 last 26.38) - open/close 9488 (time 1709057759.35 total 255.45 last 32.62) total: 10000 open/close in 261.51 seconds: 38.24 ops/second llite.lustre-ffff88007dd09000.statahead_batch_max=0 llite.lustre-ffff88007dd09000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88007dd09000.stats=clear 10001 real 0m20.274s user 0m0.258s sys 0m10.760s llite.lustre-ffff88007dd09000.statahead_batch_max=256 llite.lustre-ffff88007dd09000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88007dd09000.stats=clear 10001 real 0m18.941s user 0m0.373s sys 0m13.419s unbatched RPCs: 10004, batched RPCs: 208 mdc.lustre-MDT0000-mdc-ffff88007dd09000.batch_stats= snapshot_time: 1709057819.161291379 secs.nsecs start_time: 1709057793.145334206 secs.nsecs elapsed_time: 26.015957173 secs.nsecs subreqs per batch batches % cum % 1: 118 56 56 2: 15 7 63 4: 5 2 66 8: 8 3 70 16: 6 2 73 32: 9 4 77 64: 11 5 82 128: 1 0 83 256: 35 16 100 seq.cli-lustre-OST0000-super.width=33554431 seq.cli-lustre-OST0001-super.width=33554431 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff88007dd09000.statahead_batch_max=64 llite.lustre-ffff88007dd09000.statahead_max=128