== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:25:37 (1781231137) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats=0 llite.lustre-ffff969f094fd800.statahead_max=32 llite.lustre-ffff969f094fd800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats=0 total: 100 open/close in 1.63 seconds: 61.53 ops/second llite.lustre-ffff969f094fd800.statahead_max=0 101 real 0m1.249s user 0m0.002s sys 0m0.315s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff969f094fd800.statahead_max=32 llite.lustre-ffff969f094fd800.statahead_max=32 101 real 0m0.561s user 0m0.006s sys 0m0.199s 'ls -l' 100 files with statahead: 0 sec statahead total: 95 statahead wrong: 2 agl total: 91 list_total: 28 fname_total: 67 hit_total: 3582 miss_total: 1079 swrong=2 ewrong=2 total: 900 open/close in 4.92 seconds: 183.07 ops/second llite.lustre-ffff969f094fd800.statahead_max=0 1001 real 0m11.026s user 0m0.022s sys 0m2.960s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff969f094fd800.statahead_max=32 llite.lustre-ffff969f094fd800.statahead_max=32 1001 real 0m4.434s user 0m0.023s sys 0m1.962s 'ls -l' 1000 files with statahead: 4 sec statahead total: 96 statahead wrong: 2 agl total: 92 list_total: 29 fname_total: 67 hit_total: 4579 miss_total: 1082 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff969f094fd800.statahead_stats= statahead total: 96 statahead wrong: 2 agl total: 92 list_total: 29 fname_total: 67 hit_total: 4579 miss_total: 1082 mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats= snapshot_time: 1781231180.688565938 secs.nsecs start_time: 1781231140.218840502 secs.nsecs elapsed_time: 40.469725436 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 1314 (time 1781231191.83 total 10.00 last 131.34) - open/close 2583 (time 1781231201.84 total 20.01 last 126.80) - open/close 4093 (time 1781231211.84 total 30.02 last 150.92) - open/close 5743 (time 1781231221.84 total 40.02 last 164.97) - open/close 7217 (time 1781231231.85 total 50.03 last 147.32) - open/close 8951 (time 1781231241.85 total 60.03 last 173.30) total: 10000 open/close in 65.17 seconds: 153.44 ops/second llite.lustre-ffff969f094fd800.statahead_batch_max=0 llite.lustre-ffff969f094fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff969f094fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.764s user 0m0.261s sys 0m31.382s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff969f094fd800.statahead_batch_max=32 llite.lustre-ffff969f094fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff969f094fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.623s user 0m0.215s sys 0m18.552s batched statahead RPC= hit count=9993 mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats= snapshot_time: 1781231338.948541454 secs.nsecs start_time: 1781231285.567816223 secs.nsecs elapsed_time: 53.380725231 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats=0 llite.lustre-ffff969f094fd800.statahead_max=2048 llite.lustre-ffff969f094fd800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats=0 total: 100 open/close in 1.23 seconds: 80.97 ops/second llite.lustre-ffff969f094fd800.statahead_max=0 101 real 0m1.155s user 0m0.010s sys 0m0.293s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff969f094fd800.statahead_max=2048 llite.lustre-ffff969f094fd800.statahead_max=2048 101 real 0m0.489s user 0m0.005s sys 0m0.263s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10092 miss_total: 8 swrong=0 ewrong=0 total: 900 open/close in 4.62 seconds: 194.73 ops/second llite.lustre-ffff969f094fd800.statahead_max=0 1001 real 0m9.497s user 0m0.043s sys 0m2.870s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff969f094fd800.statahead_max=2048 llite.lustre-ffff969f094fd800.statahead_max=2048 1001 real 0m3.541s user 0m0.015s sys 0m1.331s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11091 miss_total: 9 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff969f094fd800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11091 miss_total: 9 mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats= snapshot_time: 1781231509.549115552 secs.nsecs start_time: 1781231340.011269173 secs.nsecs elapsed_time: 169.537846379 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 2171 (time 1781231520.50 total 10.00 last 217.05) - open/close 4049 (time 1781231530.51 total 20.00 last 187.75) - open/close 5539 (time 1781231540.51 total 30.01 last 148.96) - open/close 6932 (time 1781231550.51 total 40.01 last 139.26) - open/close 8408 (time 1781231560.51 total 50.01 last 147.60) - open/close 9524 (time 1781231570.52 total 60.02 last 111.49) total: 10000 open/close in 64.25 seconds: 155.64 ops/second llite.lustre-ffff969f094fd800.statahead_batch_max=0 llite.lustre-ffff969f094fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff969f094fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.691s user 0m0.230s sys 0m27.421s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff969f094fd800.statahead_batch_max=256 llite.lustre-ffff969f094fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff969f094fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.518s user 0m0.243s sys 0m18.985s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff969f094fd800.batch_stats= snapshot_time: 1781231657.016095420 secs.nsecs start_time: 1781231614.199744873 secs.nsecs elapsed_time: 42.816350547 secs.nsecs subreqs per batch batches % cum % 1: 354 60 60 2: 84 14 74 4: 70 11 86 8: 15 2 89 16: 16 2 91 32: 8 1 93 64: 7 1 94 128: 0 0 94 256: 33 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff969f094fd800.statahead_batch_max=64 llite.lustre-ffff969f094fd800.statahead_max=128