== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:02:10 (1781215330) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats=0 llite.lustre-ffff8c3a8523e000.statahead_max=32 llite.lustre-ffff8c3a8523e000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats=0 total: 100 open/close in 1.39 seconds: 71.77 ops/second llite.lustre-ffff8c3a8523e000.statahead_max=0 101 real 0m1.201s user 0m0.008s sys 0m0.305s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c3a8523e000.statahead_max=32 llite.lustre-ffff8c3a8523e000.statahead_max=32 101 real 0m0.482s user 0m0.004s sys 0m0.219s 'ls -l' 100 files with statahead: 0 sec statahead total: 104 statahead wrong: 2 agl total: 100 list_total: 29 fname_total: 59 hit_total: 4071 miss_total: 1411 swrong=2 ewrong=2 total: 900 open/close in 5.55 seconds: 162.24 ops/second llite.lustre-ffff8c3a8523e000.statahead_max=0 1001 real 0m10.833s user 0m0.036s sys 0m2.930s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff8c3a8523e000.statahead_max=32 llite.lustre-ffff8c3a8523e000.statahead_max=32 1001 real 0m4.502s user 0m0.026s sys 0m1.976s 'ls -l' 1000 files with statahead: 5 sec statahead total: 105 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 59 hit_total: 5068 miss_total: 1414 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 10 seconds llite.lustre-ffff8c3a8523e000.statahead_stats= statahead total: 105 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 59 hit_total: 5068 miss_total: 1414 mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats= snapshot_time: 1781215373.981169490 secs.nsecs start_time: 1781215332.763454556 secs.nsecs elapsed_time: 41.217714934 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 1480 (time 1781215385.23 total 10.00 last 148.00) - open/close 2949 (time 1781215395.24 total 20.01 last 146.82) - open/close 4332 (time 1781215405.24 total 30.01 last 138.26) - open/close 5540 (time 1781215415.24 total 40.01 last 120.76) - open/close 6925 (time 1781215425.25 total 50.02 last 138.37) - open/close 8290 (time 1781215435.26 total 60.03 last 136.41) - open/close 9700 (time 1781215445.26 total 70.03 last 140.94) total: 10000 open/close in 71.99 seconds: 138.91 ops/second llite.lustre-ffff8c3a8523e000.statahead_batch_max=0 llite.lustre-ffff8c3a8523e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.245s user 0m0.270s sys 0m31.440s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c3a8523e000.statahead_batch_max=32 llite.lustre-ffff8c3a8523e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.854s user 0m0.239s sys 0m18.288s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats= snapshot_time: 1781215544.183093049 secs.nsecs start_time: 1781215485.578687638 secs.nsecs elapsed_time: 58.604405411 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats=0 llite.lustre-ffff8c3a8523e000.statahead_max=2048 llite.lustre-ffff8c3a8523e000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats=0 total: 100 open/close in 1.46 seconds: 68.73 ops/second llite.lustre-ffff8c3a8523e000.statahead_max=0 101 real 0m1.515s user 0m0.004s sys 0m0.327s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8c3a8523e000.statahead_max=2048 llite.lustre-ffff8c3a8523e000.statahead_max=2048 101 real 0m0.486s user 0m0.003s sys 0m0.203s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 total: 900 open/close in 7.18 seconds: 125.42 ops/second llite.lustre-ffff8c3a8523e000.statahead_max=0 1001 real 0m13.773s user 0m0.023s sys 0m2.884s 'ls -l' 1000 files without statahead: 14 sec llite.lustre-ffff8c3a8523e000.statahead_max=2048 llite.lustre-ffff8c3a8523e000.statahead_max=2048 1001 real 0m3.628s user 0m0.015s sys 0m1.388s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 10 seconds llite.lustre-ffff8c3a8523e000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats= snapshot_time: 1781215748.706008193 secs.nsecs start_time: 1781215545.204353397 secs.nsecs elapsed_time: 203.501654796 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 1380 (time 1781215760.25 total 10.00 last 137.97) - open/close 2835 (time 1781215770.25 total 20.00 last 145.49) - open/close 4286 (time 1781215780.26 total 30.01 last 145.04) - open/close 5592 (time 1781215790.27 total 40.01 last 130.52) - open/close 6798 (time 1781215800.27 total 50.02 last 120.55) - open/close 8027 (time 1781215810.27 total 60.02 last 122.84) - open/close 9425 (time 1781215820.28 total 70.03 last 139.76) total: 10000 open/close in 74.22 seconds: 134.73 ops/second llite.lustre-ffff8c3a8523e000.statahead_batch_max=0 llite.lustre-ffff8c3a8523e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.583s user 0m0.268s sys 0m25.428s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c3a8523e000.statahead_batch_max=256 llite.lustre-ffff8c3a8523e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.885s user 0m0.242s sys 0m20.436s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c3a8523e000.batch_stats= snapshot_time: 1781215903.683202727 secs.nsecs start_time: 1781215865.941393232 secs.nsecs elapsed_time: 37.741809495 secs.nsecs subreqs per batch batches % cum % 1: 252 62 62 2: 50 12 74 4: 26 6 81 8: 13 3 84 16: 5 1 85 32: 20 4 90 64: 3 0 91 128: 0 0 91 256: 35 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c3a8523e000.statahead_batch_max=64 llite.lustre-ffff8c3a8523e000.statahead_max=128