== sanity test 123ad: Verify batching statahead works correctly ========================================================== 07:46:45 (1786967205) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats=0 llite.lustre-ffff8da2c8f4b000.statahead_max=32 llite.lustre-ffff8da2c8f4b000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats=0 total: 100 open/close in 3.51 seconds: 28.51 ops/second llite.lustre-ffff8da2c8f4b000.statahead_max=0 101 real 0m2.820s user 0m0.004s sys 0m0.320s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8da2c8f4b000.statahead_max=32 llite.lustre-ffff8da2c8f4b000.statahead_max=32 101 real 0m0.808s user 0m0.001s sys 0m0.163s 'ls -l' 100 files with statahead: 1 sec statahead total: 106 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 76 hit_total: 4016 miss_total: 1284 swrong=2 ewrong=2 - open/close 595 (time 1786967233.92 total 10.01 last 59.44) total: 900 open/close in 14.97 seconds: 60.11 ops/second llite.lustre-ffff8da2c8f4b000.statahead_max=0 1001 real 0m22.953s user 0m0.046s sys 0m3.193s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff8da2c8f4b000.statahead_max=32 llite.lustre-ffff8da2c8f4b000.statahead_max=32 1001 real 0m10.316s user 0m0.028s sys 0m1.618s 'ls -l' 1000 files with statahead: 10 sec statahead total: 107 statahead wrong: 2 agl total: 102 list_total: 31 fname_total: 76 hit_total: 5015 miss_total: 1285 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff8da2c8f4b000.statahead_stats= statahead total: 107 statahead wrong: 2 agl total: 102 list_total: 31 fname_total: 76 hit_total: 5015 miss_total: 1285 mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats= snapshot_time: 1786967306.460891867 secs.nsecs start_time: 1786967210.316689143 secs.nsecs elapsed_time: 96.144202724 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 739 (time 1786967318.37 total 10.00 last 73.87) - open/close 1416 (time 1786967328.37 total 20.01 last 67.68) - open/close 2084 (time 1786967338.38 total 30.02 last 66.70) - open/close 2728 (time 1786967348.42 total 40.06 last 64.16) - open/close 3376 (time 1786967358.44 total 50.07 last 64.70) - open/close 4107 (time 1786967368.44 total 60.08 last 73.10) - open/close 4853 (time 1786967378.44 total 70.08 last 74.56) - open/close 5549 (time 1786967388.46 total 80.10 last 69.49) - open/close 6203 (time 1786967398.47 total 90.11 last 65.30) - open/close 6829 (time 1786967408.48 total 100.12 last 62.55) - open/close 7433 (time 1786967418.49 total 110.13 last 60.35) - open/close 8015 (time 1786967428.49 total 120.13 last 58.19) - open/close 8576 (time 1786967438.50 total 130.14 last 56.03) - open/close 9123 (time 1786967448.51 total 140.15 last 54.63) - open/close 9691 (time 1786967458.52 total 150.16 last 56.79) total: 10000 open/close in 155.33 seconds: 64.38 ops/second llite.lustre-ffff8da2c8f4b000.statahead_batch_max=0 llite.lustre-ffff8da2c8f4b000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m12.815s user 0m0.325s sys 0m16.161s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8da2c8f4b000.statahead_batch_max=32 llite.lustre-ffff8da2c8f4b000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m44.706s user 0m0.307s sys 0m16.092s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats= snapshot_time: 1786967665.869231462 secs.nsecs start_time: 1786967547.549025999 secs.nsecs elapsed_time: 118.320205463 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats=0 llite.lustre-ffff8da2c8f4b000.statahead_max=2048 llite.lustre-ffff8da2c8f4b000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats=0 total: 100 open/close in 2.75 seconds: 36.32 ops/second llite.lustre-ffff8da2c8f4b000.statahead_max=0 101 real 0m2.598s user 0m0.002s sys 0m0.347s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8da2c8f4b000.statahead_max=2048 llite.lustre-ffff8da2c8f4b000.statahead_max=2048 101 real 0m0.711s user 0m0.004s sys 0m0.194s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 681 (time 1786968013.53 total 10.01 last 68.05) total: 900 open/close in 14.16 seconds: 63.56 ops/second llite.lustre-ffff8da2c8f4b000.statahead_max=0 1001 real 0m25.392s user 0m0.033s sys 0m3.263s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff8da2c8f4b000.statahead_max=2048 llite.lustre-ffff8da2c8f4b000.statahead_max=2048 1001 real 0m9.465s user 0m0.023s sys 0m1.475s 'ls -l' 1000 files with statahead: 10 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8da2c8f4b000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats= snapshot_time: 1786968092.766582310 secs.nsecs start_time: 1786967667.950048917 secs.nsecs elapsed_time: 424.816533393 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 517 (time 1786968106.08 total 10.01 last 51.67) - open/close 988 (time 1786968116.12 total 20.05 last 46.91) - open/close 1471 (time 1786968126.13 total 30.05 last 48.27) - open/close 2064 (time 1786968136.14 total 40.07 last 59.21) - open/close 2544 (time 1786968146.15 total 50.08 last 47.96) - open/close 3100 (time 1786968156.16 total 60.09 last 55.54) - open/close 3642 (time 1786968166.19 total 70.12 last 54.02) - open/close 4298 (time 1786968176.20 total 80.13 last 65.55) - open/close 4920 (time 1786968186.21 total 90.13 last 62.17) - open/close 5595 (time 1786968196.22 total 100.14 last 67.42) - open/close 6210 (time 1786968206.23 total 110.15 last 61.43) - open/close 6855 (time 1786968216.24 total 120.17 last 64.42) - open/close 7530 (time 1786968226.24 total 130.17 last 67.49) - open/close 8121 (time 1786968236.25 total 140.18 last 59.06) - open/close 8716 (time 1786968246.25 total 150.18 last 59.48) - open/close 9331 (time 1786968256.28 total 160.20 last 61.34) - open/close 9950 (time 1786968266.29 total 170.21 last 61.84) total: 10000 open/close in 170.95 seconds: 58.50 ops/second llite.lustre-ffff8da2c8f4b000.statahead_batch_max=0 llite.lustre-ffff8da2c8f4b000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.609s user 0m0.301s sys 0m16.249s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8da2c8f4b000.statahead_batch_max=256 llite.lustre-ffff8da2c8f4b000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.665s user 0m0.298s sys 0m16.126s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8da2c8f4b000.batch_stats= snapshot_time: 1786968422.100712347 secs.nsecs start_time: 1786968347.568330111 secs.nsecs elapsed_time: 74.532382236 secs.nsecs subreqs per batch batches %% cum %% 1: 237 52 52 2: 80 17 70 4: 42 9 80 8: 20 4 84 16: 18 4 88 32: 15 3 91 64: 2 0 92 128: 0 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8da2c8f4b000.statahead_batch_max=64 llite.lustre-ffff8da2c8f4b000.statahead_max=128