== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:56:25 (1786035385) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats=0 llite.lustre-ffff8d3450f99800.statahead_max=32 llite.lustre-ffff8d3450f99800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats=0 total: 100 open/close in 2.62 seconds: 38.10 ops/second llite.lustre-ffff8d3450f99800.statahead_max=0 101 real 0m3.872s user 0m0.004s sys 0m0.305s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff8d3450f99800.statahead_max=32 llite.lustre-ffff8d3450f99800.statahead_max=32 101 real 0m1.681s user 0m0.001s sys 0m0.158s 'ls -l' 100 files with statahead: 1 sec statahead total: 164 statahead wrong: 2 agl total: 150 list_total: 30 fname_total: 106 hit_total: 4086 miss_total: 1465 swrong=2 ewrong=2 - open/close 635 (time 1786035421.28 total 10.00 last 63.47) total: 900 open/close in 15.18 seconds: 59.30 ops/second llite.lustre-ffff8d3450f99800.statahead_max=0 1001 real 0m28.851s user 0m0.028s sys 0m2.988s 'ls -l' 1000 files without statahead: 29 sec llite.lustre-ffff8d3450f99800.statahead_max=32 llite.lustre-ffff8d3450f99800.statahead_max=32 1001 real 0m16.538s user 0m0.023s sys 0m1.531s 'ls -l' 1000 files with statahead: 17 sec statahead total: 165 statahead wrong: 2 agl total: 151 list_total: 31 fname_total: 106 hit_total: 5084 miss_total: 1467 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 26 seconds llite.lustre-ffff8d3450f99800.statahead_stats= statahead total: 165 statahead wrong: 2 agl total: 151 list_total: 31 fname_total: 106 hit_total: 5084 miss_total: 1467 mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats= snapshot_time: 1786035517.762033151 secs.nsecs start_time: 1786035392.625414121 secs.nsecs elapsed_time: 125.136619030 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 442 (time 1786035531.74 total 10.02 last 44.10) - open/close 1067 (time 1786035541.76 total 20.04 last 62.39) - open/close 1543 (time 1786035551.77 total 30.05 last 47.55) - open/close 2066 (time 1786035561.78 total 40.06 last 52.25) - open/close 2630 (time 1786035571.80 total 50.08 last 56.26) - open/close 3175 (time 1786035581.81 total 60.09 last 54.44) - open/close 3699 (time 1786035591.82 total 70.10 last 52.36) - open/close 4208 (time 1786035601.82 total 80.11 last 50.88) - open/close 4665 (time 1786035611.86 total 90.14 last 45.54) - open/close 5293 (time 1786035621.88 total 100.16 last 62.66) - open/close 5914 (time 1786035631.90 total 110.18 last 62.01) - open/close 6670 (time 1786035641.91 total 120.19 last 75.49) - open/close 7366 (time 1786035651.92 total 130.20 last 69.53) - open/close 8148 (time 1786035661.92 total 140.21 last 78.16) - open/close 8872 (time 1786035671.93 total 150.21 last 72.36) - open/close 9508 (time 1786035681.93 total 160.21 last 63.59) total: 10000 open/close in 169.45 seconds: 59.01 ops/second llite.lustre-ffff8d3450f99800.statahead_batch_max=0 llite.lustre-ffff8d3450f99800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d3450f99800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m22.088s user 0m0.254s sys 0m14.770s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8d3450f99800.statahead_batch_max=32 llite.lustre-ffff8d3450f99800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8d3450f99800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m22.805s user 0m0.231s sys 0m14.007s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats= snapshot_time: 1786035957.527146563 secs.nsecs start_time: 1786035794.387098773 secs.nsecs elapsed_time: 163.140047790 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats=0 llite.lustre-ffff8d3450f99800.statahead_max=2048 llite.lustre-ffff8d3450f99800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats=0 total: 100 open/close in 3.65 seconds: 27.40 ops/second llite.lustre-ffff8d3450f99800.statahead_max=0 101 real 0m3.624s user 0m0.006s sys 0m0.316s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8d3450f99800.statahead_max=2048 llite.lustre-ffff8d3450f99800.statahead_max=2048 101 real 0m1.116s user 0m0.006s sys 0m0.159s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 513 (time 1786036346.23 total 10.01 last 51.27) total: 900 open/close in 16.46 seconds: 54.68 ops/second llite.lustre-ffff8d3450f99800.statahead_max=0 1001 real 0m31.851s user 0m0.024s sys 0m2.812s 'ls -l' 1000 files without statahead: 32 sec llite.lustre-ffff8d3450f99800.statahead_max=2048 llite.lustre-ffff8d3450f99800.statahead_max=2048 1001 real 0m9.853s user 0m0.018s sys 0m1.320s 'ls -l' 1000 files with statahead: 10 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 30 seconds llite.lustre-ffff8d3450f99800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats= snapshot_time: 1786036444.423185913 secs.nsecs start_time: 1786035960.338767791 secs.nsecs elapsed_time: 484.084418122 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 1 9 27 32: 3 27 54 64: 1 9 63 128: 0 0 63 256: 4 36 100 - open/close 702 (time 1786036458.22 total 10.01 last 70.16) - open/close 1195 (time 1786036468.22 total 20.01 last 49.30) - open/close 1699 (time 1786036478.26 total 30.04 last 50.20) - open/close 2051 (time 1786036488.28 total 40.06 last 35.14) - open/close 2515 (time 1786036498.29 total 50.07 last 46.35) - open/close 3073 (time 1786036508.32 total 60.10 last 55.64) - open/close 3903 (time 1786036518.32 total 70.10 last 82.97) - open/close 4359 (time 1786036528.32 total 80.11 last 45.59) - open/close 4789 (time 1786036538.33 total 90.12 last 42.96) - open/close 5349 (time 1786036548.38 total 100.17 last 55.72) - open/close 6130 (time 1786036558.40 total 110.18 last 77.96) - open/close 6714 (time 1786036568.40 total 120.19 last 58.39) - open/close 7326 (time 1786036578.40 total 130.19 last 61.18) - open/close 8112 (time 1786036588.41 total 140.19 last 78.56) - open/close 8684 (time 1786036598.44 total 150.22 last 57.04) - open/close 9240 (time 1786036608.45 total 160.23 last 55.55) - open/close 9733 (time 1786036618.46 total 170.25 last 49.22) total: 10000 open/close in 175.13 seconds: 57.10 ops/second llite.lustre-ffff8d3450f99800.statahead_batch_max=0 llite.lustre-ffff8d3450f99800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d3450f99800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m15.101s user 0m0.263s sys 0m14.292s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8d3450f99800.statahead_batch_max=256 llite.lustre-ffff8d3450f99800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8d3450f99800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m21.378s user 0m0.231s sys 0m13.849s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8d3450f99800.batch_stats= snapshot_time: 1786036820.194723173 secs.nsecs start_time: 1786036713.741473709 secs.nsecs elapsed_time: 106.453249464 secs.nsecs subreqs per batch batches %% cum %% 1: 185 47 47 2: 66 16 64 4: 48 12 76 8: 19 4 81 16: 23 5 87 32: 12 3 90 64: 2 0 91 128: 1 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8d3450f99800.statahead_batch_max=64 llite.lustre-ffff8d3450f99800.statahead_max=128