== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:59:20 (1790960360) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats=0 llite.lustre-ffff91dd3ba68000.statahead_max=32 llite.lustre-ffff91dd3ba68000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats=0 total: 100 open/close in 2.05 seconds: 48.82 ops/second llite.lustre-ffff91dd3ba68000.statahead_max=0 101 real 0m1.689s user 0m0.004s sys 0m0.295s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff91dd3ba68000.statahead_max=32 llite.lustre-ffff91dd3ba68000.statahead_max=32 101 real 0m0.747s user 0m0.002s sys 0m0.166s 'ls -l' 100 files with statahead: 1 sec statahead total: 106 statahead wrong: 2 agl total: 100 list_total: 30 fname_total: 73 hit_total: 4130 miss_total: 1284 swrong=2 ewrong=2 - open/close 822 (time 1790960382.03 total 10.00 last 82.18) total: 900 open/close in 11.00 seconds: 81.84 ops/second llite.lustre-ffff91dd3ba68000.statahead_max=0 1001 real 0m17.353s user 0m0.027s sys 0m2.761s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff91dd3ba68000.statahead_max=32 llite.lustre-ffff91dd3ba68000.statahead_max=32 1001 real 0m6.173s user 0m0.027s sys 0m1.442s 'ls -l' 1000 files with statahead: 6 sec statahead total: 107 statahead wrong: 2 agl total: 101 list_total: 31 fname_total: 73 hit_total: 5128 miss_total: 1286 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff91dd3ba68000.statahead_stats= statahead total: 107 statahead wrong: 2 agl total: 101 list_total: 31 fname_total: 73 hit_total: 5128 miss_total: 1286 mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats= snapshot_time: 1790960429.237328988 secs.nsecs start_time: 1790960362.909084067 secs.nsecs elapsed_time: 66.328244921 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 915 (time 1790960441.50 total 10.00 last 91.46) - open/close 1828 (time 1790960451.51 total 20.01 last 91.25) - open/close 3043 (time 1790960461.51 total 30.01 last 121.44) - open/close 4518 (time 1790960471.51 total 40.01 last 147.50) - open/close 5864 (time 1790960481.52 total 50.02 last 134.51) - open/close 7110 (time 1790960491.52 total 60.02 last 124.57) - open/close 8719 (time 1790960501.53 total 70.03 last 160.86) total: 10000 open/close in 79.04 seconds: 126.52 ops/second llite.lustre-ffff91dd3ba68000.statahead_batch_max=0 llite.lustre-ffff91dd3ba68000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.367s user 0m0.315s sys 0m27.310s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff91dd3ba68000.statahead_batch_max=32 llite.lustre-ffff91dd3ba68000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.481s user 0m0.249s sys 0m21.249s batched statahead RPC= hit count=9993 mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats= snapshot_time: 1790960596.004960388 secs.nsecs start_time: 1790960546.354555174 secs.nsecs elapsed_time: 49.650405214 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats=0 llite.lustre-ffff91dd3ba68000.statahead_max=2048 llite.lustre-ffff91dd3ba68000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats=0 total: 100 open/close in 1.25 seconds: 80.24 ops/second llite.lustre-ffff91dd3ba68000.statahead_max=0 101 real 0m1.325s user 0m0.003s sys 0m0.292s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff91dd3ba68000.statahead_max=2048 llite.lustre-ffff91dd3ba68000.statahead_max=2048 101 real 0m0.458s user 0m0.005s sys 0m0.252s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10092 miss_total: 8 swrong=0 ewrong=0 total: 900 open/close in 4.43 seconds: 203.13 ops/second llite.lustre-ffff91dd3ba68000.statahead_max=0 1001 real 0m10.308s user 0m0.036s sys 0m2.649s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff91dd3ba68000.statahead_max=2048 llite.lustre-ffff91dd3ba68000.statahead_max=2048 1001 real 0m3.223s user 0m0.016s sys 0m1.772s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11091 miss_total: 9 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff91dd3ba68000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11091 miss_total: 9 mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats= snapshot_time: 1790960766.431096399 secs.nsecs start_time: 1790960597.002874820 secs.nsecs elapsed_time: 169.428221579 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 2186 (time 1790960777.46 total 10.00 last 218.55) - open/close 3889 (time 1790960787.46 total 20.01 last 170.22) - open/close 5254 (time 1790960797.46 total 30.01 last 136.48) - open/close 6515 (time 1790960807.47 total 40.02 last 126.00) - open/close 7650 (time 1790960817.48 total 50.02 last 113.43) - open/close 9050 (time 1790960827.48 total 60.02 last 139.97) total: 10000 open/close in 66.84 seconds: 149.61 ops/second llite.lustre-ffff91dd3ba68000.statahead_batch_max=0 llite.lustre-ffff91dd3ba68000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.435s user 0m0.282s sys 0m24.048s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff91dd3ba68000.statahead_batch_max=256 llite.lustre-ffff91dd3ba68000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.340s user 0m0.239s sys 0m16.483s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff91dd3ba68000.batch_stats= snapshot_time: 1790960917.179010405 secs.nsecs start_time: 1790960871.312241219 secs.nsecs elapsed_time: 45.866769186 secs.nsecs subreqs per batch batches %% cum %% 1: 177 62 62 2: 15 5 68 4: 12 4 72 8: 15 5 77 16: 8 2 80 32: 15 5 85 64: 3 1 86 128: 2 0 87 256: 35 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff91dd3ba68000.statahead_batch_max=64 llite.lustre-ffff91dd3ba68000.statahead_max=128