== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:06:40 (1787846800) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats=0 llite.lustre-ffff927e5aa5a000.statahead_max=32 llite.lustre-ffff927e5aa5a000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats=0 total: 100 open/close in 2.99 seconds: 33.42 ops/second llite.lustre-ffff927e5aa5a000.statahead_max=0 101 real 0m2.403s user 0m0.005s sys 0m0.300s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff927e5aa5a000.statahead_max=32 llite.lustre-ffff927e5aa5a000.statahead_max=32 101 real 0m1.480s user 0m0.009s sys 0m0.173s 'ls -l' 100 files with statahead: 1 sec statahead total: 141 statahead wrong: 2 agl total: 135 list_total: 29 fname_total: 98 hit_total: 3973 miss_total: 1545 swrong=2 ewrong=2 - open/close 619 (time 1787846831.75 total 10.00 last 61.87) total: 900 open/close in 14.54 seconds: 61.89 ops/second llite.lustre-ffff927e5aa5a000.statahead_max=0 1001 real 0m22.964s user 0m0.035s sys 0m2.786s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff927e5aa5a000.statahead_max=32 llite.lustre-ffff927e5aa5a000.statahead_max=32 1001 real 0m13.372s user 0m0.040s sys 0m1.428s 'ls -l' 1000 files with statahead: 14 sec statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 98 hit_total: 4970 miss_total: 1548 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff927e5aa5a000.statahead_stats= statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 98 hit_total: 4970 miss_total: 1548 mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats= snapshot_time: 1787846908.769166069 secs.nsecs start_time: 1787846805.490607112 secs.nsecs elapsed_time: 103.278558957 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 758 (time 1787846921.79 total 10.02 last 75.66) - open/close 1595 (time 1787846931.81 total 20.03 last 83.57) - open/close 2217 (time 1787846941.81 total 30.03 last 62.20) - open/close 2756 (time 1787846951.81 total 40.04 last 53.89) - open/close 3382 (time 1787846961.82 total 50.04 last 62.55) - open/close 3971 (time 1787846971.83 total 60.05 last 58.84) - open/close 4810 (time 1787846981.83 total 70.05 last 83.90) - open/close 5426 (time 1787846991.85 total 80.08 last 61.44) - open/close 6020 (time 1787847001.89 total 90.12 last 59.18) - open/close 6823 (time 1787847011.89 total 100.12 last 80.29) - open/close 7568 (time 1787847021.90 total 110.13 last 74.45) - open/close 8363 (time 1787847031.90 total 120.13 last 79.48) - open/close 9159 (time 1787847041.91 total 130.13 last 79.56) - open/close 9935 (time 1787847051.91 total 140.14 last 77.57) total: 10000 open/close in 140.90 seconds: 70.97 ops/second llite.lustre-ffff927e5aa5a000.statahead_batch_max=0 llite.lustre-ffff927e5aa5a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.063s user 0m0.318s sys 0m13.632s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff927e5aa5a000.statahead_batch_max=32 llite.lustre-ffff927e5aa5a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m46.805s user 0m0.295s sys 0m13.260s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats= snapshot_time: 1787847242.706738363 secs.nsecs start_time: 1787847124.550648459 secs.nsecs elapsed_time: 118.156089904 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats=0 llite.lustre-ffff927e5aa5a000.statahead_max=2048 llite.lustre-ffff927e5aa5a000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats=0 total: 100 open/close in 2.60 seconds: 38.51 ops/second llite.lustre-ffff927e5aa5a000.statahead_max=0 101 real 0m1.712s user 0m0.004s sys 0m0.286s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff927e5aa5a000.statahead_max=2048 llite.lustre-ffff927e5aa5a000.statahead_max=2048 101 real 0m0.923s user 0m0.004s sys 0m0.150s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 - open/close 755 (time 1787847529.39 total 10.00 last 75.49) total: 900 open/close in 11.67 seconds: 77.09 ops/second llite.lustre-ffff927e5aa5a000.statahead_max=0 1001 real 0m17.350s user 0m0.028s sys 0m2.784s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff927e5aa5a000.statahead_max=2048 llite.lustre-ffff927e5aa5a000.statahead_max=2048 1001 real 0m6.890s user 0m0.026s sys 0m1.250s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff927e5aa5a000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats= snapshot_time: 1787847588.748636260 secs.nsecs start_time: 1787847244.958204268 secs.nsecs elapsed_time: 343.790431992 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 1 9 27 32: 3 27 54 64: 1 9 63 128: 0 0 63 256: 4 36 100 - open/close 645 (time 1787847601.93 total 10.02 last 64.40) - open/close 1256 (time 1787847611.94 total 20.03 last 61.04) - open/close 1945 (time 1787847621.96 total 30.05 last 68.76) - open/close 2764 (time 1787847631.96 total 40.05 last 81.87) - open/close 3718 (time 1787847641.96 total 50.05 last 95.38) - open/close 4491 (time 1787847651.96 total 60.05 last 77.28) - open/close 5296 (time 1787847661.97 total 70.06 last 80.45) - open/close 6156 (time 1787847671.98 total 80.07 last 85.92) - open/close 6993 (time 1787847681.99 total 90.08 last 83.59) - open/close 7686 (time 1787847692.01 total 100.10 last 69.19) - open/close 8412 (time 1787847702.01 total 110.10 last 72.58) - open/close 9146 (time 1787847712.01 total 120.10 last 73.38) - open/close 9854 (time 1787847722.02 total 130.11 last 70.77) total: 10000 open/close in 132.19 seconds: 75.65 ops/second llite.lustre-ffff927e5aa5a000.statahead_batch_max=0 llite.lustre-ffff927e5aa5a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.669s user 0m0.288s sys 0m14.074s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff927e5aa5a000.statahead_batch_max=256 llite.lustre-ffff927e5aa5a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.087s user 0m0.308s sys 0m13.950s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff927e5aa5a000.batch_stats= snapshot_time: 1787847852.244795028 secs.nsecs start_time: 1787847792.069780883 secs.nsecs elapsed_time: 60.175014145 secs.nsecs subreqs per batch batches %% cum %% 1: 108 41 41 2: 31 11 52 4: 29 11 63 8: 26 9 73 16: 9 3 77 32: 21 7 85 64: 4 1 86 128: 0 0 86 256: 35 13 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff927e5aa5a000.statahead_batch_max=64 llite.lustre-ffff927e5aa5a000.statahead_max=128