== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:41:56 (1781242916) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats=0 llite.lustre-ffff96a0514c7000.statahead_max=32 llite.lustre-ffff96a0514c7000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats=0 total: 100 open/close in 2.49 seconds: 40.19 ops/second llite.lustre-ffff96a0514c7000.statahead_max=0 101 real 0m2.186s user 0m0.007s sys 0m0.327s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff96a0514c7000.statahead_max=32 llite.lustre-ffff96a0514c7000.statahead_max=32 101 real 0m1.131s user 0m0.005s sys 0m0.210s 'ls -l' 100 files with statahead: 1 sec statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 94 hit_total: 4095 miss_total: 1383 swrong=2 ewrong=2 - open/close 695 (time 1781242942.79 total 10.02 last 69.37) total: 900 open/close in 12.88 seconds: 69.87 ops/second llite.lustre-ffff96a0514c7000.statahead_max=0 1001 real 0m21.952s user 0m0.033s sys 0m3.167s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff96a0514c7000.statahead_max=32 llite.lustre-ffff96a0514c7000.statahead_max=32 1001 real 0m8.709s user 0m0.025s sys 0m1.647s 'ls -l' 1000 files with statahead: 9 sec statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 31 fname_total: 94 hit_total: 5094 miss_total: 1384 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff96a0514c7000.statahead_stats= statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 31 fname_total: 94 hit_total: 5094 miss_total: 1384 mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats= snapshot_time: 1781243007.291095423 secs.nsecs start_time: 1781242921.338817412 secs.nsecs elapsed_time: 85.952278011 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 675 (time 1781243019.92 total 10.01 last 67.43) - open/close 1400 (time 1781243029.92 total 20.02 last 72.47) - open/close 2155 (time 1781243039.93 total 30.02 last 75.45) - open/close 2859 (time 1781243049.94 total 40.03 last 70.37) - open/close 3627 (time 1781243059.94 total 50.03 last 76.74) - open/close 4363 (time 1781243069.95 total 60.04 last 73.59) - open/close 5156 (time 1781243079.96 total 70.05 last 79.22) - open/close 5924 (time 1781243089.96 total 80.05 last 76.78) - open/close 6688 (time 1781243099.96 total 90.05 last 76.37) - open/close 7409 (time 1781243109.97 total 100.06 last 72.02) - open/close 8171 (time 1781243119.98 total 110.07 last 76.17) - open/close 8944 (time 1781243129.99 total 120.08 last 77.16) - open/close 9739 (time 1781243140.01 total 130.10 last 79.37) total: 10000 open/close in 133.60 seconds: 74.85 ops/second llite.lustre-ffff96a0514c7000.statahead_batch_max=0 llite.lustre-ffff96a0514c7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96a0514c7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m48.660s user 0m0.289s sys 0m19.428s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff96a0514c7000.statahead_batch_max=32 llite.lustre-ffff96a0514c7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff96a0514c7000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.473s user 0m0.270s sys 0m15.810s batched statahead RPC= hit count=9979 mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats= snapshot_time: 1781243289.542032890 secs.nsecs start_time: 1781243200.959006606 secs.nsecs elapsed_time: 88.583026284 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats=0 llite.lustre-ffff96a0514c7000.statahead_max=2048 llite.lustre-ffff96a0514c7000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats=0 total: 100 open/close in 2.32 seconds: 43.05 ops/second llite.lustre-ffff96a0514c7000.statahead_max=0 101 real 0m2.258s user 0m0.004s sys 0m0.338s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff96a0514c7000.statahead_max=2048 llite.lustre-ffff96a0514c7000.statahead_max=2048 101 real 0m0.778s user 0m0.006s sys 0m0.199s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10078 miss_total: 22 swrong=0 ewrong=0 - open/close 857 (time 1781243554.33 total 10.00 last 85.68) total: 900 open/close in 10.59 seconds: 84.98 ops/second llite.lustre-ffff96a0514c7000.statahead_max=0 1001 real 0m18.816s user 0m0.032s sys 0m3.035s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff96a0514c7000.statahead_max=2048 llite.lustre-ffff96a0514c7000.statahead_max=2048 1001 real 0m4.731s user 0m0.025s sys 0m1.723s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff96a0514c7000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats= snapshot_time: 1781243601.736864501 secs.nsecs start_time: 1781243291.560854120 secs.nsecs elapsed_time: 310.176010381 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 0 0 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 831 (time 1781243613.66 total 10.01 last 83.05) - open/close 1671 (time 1781243623.67 total 20.01 last 83.97) - open/close 2505 (time 1781243633.67 total 30.01 last 83.36) - open/close 3369 (time 1781243643.68 total 40.03 last 86.30) - open/close 4284 (time 1781243653.69 total 50.03 last 91.43) - open/close 5345 (time 1781243663.69 total 60.04 last 106.06) - open/close 6278 (time 1781243673.71 total 70.05 last 93.19) - open/close 7185 (time 1781243683.72 total 80.06 last 90.62) - open/close 8049 (time 1781243693.72 total 90.07 last 86.33) - open/close 8840 (time 1781243703.73 total 100.08 last 79.03) - open/close 9673 (time 1781243713.75 total 110.09 last 83.19) total: 10000 open/close in 116.01 seconds: 86.20 ops/second llite.lustre-ffff96a0514c7000.statahead_batch_max=0 llite.lustre-ffff96a0514c7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96a0514c7000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m23.816s user 0m0.328s sys 0m17.037s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff96a0514c7000.statahead_batch_max=256 llite.lustre-ffff96a0514c7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff96a0514c7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.151s user 0m0.299s sys 0m16.657s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff96a0514c7000.batch_stats= snapshot_time: 1781243884.463026001 secs.nsecs start_time: 1781243813.642385292 secs.nsecs elapsed_time: 70.820640709 secs.nsecs subreqs per batch batches % cum % 1: 320 59 59 2: 66 12 72 4: 48 8 80 8: 26 4 85 16: 27 5 90 32: 13 2 93 64: 3 0 93 128: 0 0 93 256: 33 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff96a0514c7000.statahead_batch_max=64 llite.lustre-ffff96a0514c7000.statahead_max=128