== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:18:30 (1780327110) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats=0 llite.lustre-ffff89ed44d8c000.statahead_max=32 llite.lustre-ffff89ed44d8c000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats=0 total: 100 open/close in 2.00 seconds: 50.04 ops/second llite.lustre-ffff89ed44d8c000.statahead_max=0 101 real 0m1.815s user 0m0.005s sys 0m0.302s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff89ed44d8c000.statahead_max=32 llite.lustre-ffff89ed44d8c000.statahead_max=32 101 real 0m0.784s user 0m0.005s sys 0m0.166s 'ls -l' 100 files with statahead: 1 sec statahead total: 85 statahead wrong: 1 agl total: 80 list_total: 27 fname_total: 45 hit_total: 3831 miss_total: 228 swrong=1 ewrong=1 total: 900 open/close in 9.90 seconds: 90.89 ops/second llite.lustre-ffff89ed44d8c000.statahead_max=0 1001 real 0m16.437s user 0m0.028s sys 0m2.960s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff89ed44d8c000.statahead_max=32 llite.lustre-ffff89ed44d8c000.statahead_max=32 1001 real 0m8.933s user 0m0.029s sys 0m1.493s 'ls -l' 1000 files with statahead: 9 sec statahead total: 86 statahead wrong: 1 agl total: 81 list_total: 28 fname_total: 45 hit_total: 4829 miss_total: 230 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff89ed44d8c000.statahead_stats= statahead total: 86 statahead wrong: 1 agl total: 81 list_total: 28 fname_total: 45 hit_total: 4829 miss_total: 230 mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats= snapshot_time: 1780327185.677135225 secs.nsecs start_time: 1780327114.235212375 secs.nsecs elapsed_time: 71.441922850 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 787 (time 1780327197.70 total 10.01 last 78.59) - open/close 1621 (time 1780327207.70 total 20.02 last 83.36) - open/close 2483 (time 1780327217.70 total 30.02 last 86.20) - open/close 3419 (time 1780327227.71 total 40.02 last 93.57) - open/close 4253 (time 1780327237.71 total 50.03 last 83.37) - open/close 5156 (time 1780327247.71 total 60.03 last 90.28) - open/close 6058 (time 1780327257.72 total 70.04 last 90.12) - open/close 6897 (time 1780327267.72 total 80.04 last 83.90) - open/close 7742 (time 1780327277.72 total 90.04 last 84.48) - open/close 8610 (time 1780327287.73 total 100.05 last 86.74) - open/close 9449 (time 1780327297.73 total 110.05 last 83.89) total: 10000 open/close in 115.86 seconds: 86.31 ops/second llite.lustre-ffff89ed44d8c000.statahead_batch_max=0 llite.lustre-ffff89ed44d8c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.127s user 0m0.297s sys 0m15.830s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89ed44d8c000.statahead_batch_max=32 llite.lustre-ffff89ed44d8c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m15.086s user 0m0.287s sys 0m14.457s batched statahead RPC= hit count=9989 mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats= snapshot_time: 1780327440.346981966 secs.nsecs start_time: 1780327354.471704990 secs.nsecs elapsed_time: 85.875276976 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats=0 llite.lustre-ffff89ed44d8c000.statahead_max=2048 llite.lustre-ffff89ed44d8c000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats=0 total: 100 open/close in 1.87 seconds: 53.56 ops/second llite.lustre-ffff89ed44d8c000.statahead_max=0 101 real 0m1.767s user 0m0.004s sys 0m0.318s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff89ed44d8c000.statahead_max=2048 llite.lustre-ffff89ed44d8c000.statahead_max=2048 101 real 0m0.551s user 0m0.004s sys 0m0.193s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10088 miss_total: 12 swrong=0 ewrong=0 total: 900 open/close in 7.71 seconds: 116.71 ops/second llite.lustre-ffff89ed44d8c000.statahead_max=0 1001 real 0m13.854s user 0m0.032s sys 0m2.749s 'ls -l' 1000 files without statahead: 13 sec llite.lustre-ffff89ed44d8c000.statahead_max=2048 llite.lustre-ffff89ed44d8c000.statahead_max=2048 1001 real 0m3.348s user 0m0.028s sys 0m1.431s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11087 miss_total: 13 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff89ed44d8c000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11087 miss_total: 13 mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats= snapshot_time: 1780327692.636347165 secs.nsecs start_time: 1780327442.152300727 secs.nsecs elapsed_time: 250.484046438 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 1152 (time 1780327704.21 total 10.00 last 115.14) - open/close 2543 (time 1780327714.21 total 20.01 last 139.03) - open/close 3932 (time 1780327724.21 total 30.01 last 138.87) - open/close 5095 (time 1780327734.22 total 40.02 last 116.24) - open/close 6380 (time 1780327744.22 total 50.02 last 128.45) - open/close 7580 (time 1780327754.23 total 60.03 last 119.93) - open/close 8804 (time 1780327764.23 total 70.03 last 122.38) total: 10000 open/close in 79.85 seconds: 125.24 ops/second llite.lustre-ffff89ed44d8c000.statahead_batch_max=0 llite.lustre-ffff89ed44d8c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.442s user 0m0.290s sys 0m18.742s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89ed44d8c000.statahead_batch_max=256 llite.lustre-ffff89ed44d8c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.011s user 0m0.322s sys 0m15.739s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff89ed44d8c000.batch_stats= snapshot_time: 1780327872.692969829 secs.nsecs start_time: 1780327812.603656657 secs.nsecs elapsed_time: 60.089313172 secs.nsecs subreqs per batch batches % cum % 1: 198 59 59 2: 26 7 67 4: 23 6 74 8: 15 4 78 16: 17 5 83 32: 11 3 87 64: 7 2 89 128: 2 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff89ed44d8c000.statahead_batch_max=64 llite.lustre-ffff89ed44d8c000.statahead_max=128