== sanity test 123ad: Verify batching statahead works correctly ========================================================== 02:12:47 (1788934367) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats=0 llite.lustre-ffff9d4b47c2d800.statahead_max=32 llite.lustre-ffff9d4b47c2d800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats=0 total: 100 open/close in 3.00 seconds: 33.36 ops/second llite.lustre-ffff9d4b47c2d800.statahead_max=0 101 real 0m1.840s user 0m0.006s sys 0m0.285s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9d4b47c2d800.statahead_max=32 llite.lustre-ffff9d4b47c2d800.statahead_max=32 101 real 0m0.898s user 0m0.005s sys 0m0.133s 'ls -l' 100 files with statahead: 1 sec statahead total: 111 statahead wrong: 2 agl total: 106 list_total: 29 fname_total: 80 hit_total: 4400 miss_total: 1276 swrong=2 ewrong=2 - open/close 821 (time 1788934396.37 total 10.00 last 82.08) total: 900 open/close in 11.17 seconds: 80.58 ops/second llite.lustre-ffff9d4b47c2d800.statahead_max=0 1001 real 0m18.285s user 0m0.035s sys 0m2.636s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff9d4b47c2d800.statahead_max=32 llite.lustre-ffff9d4b47c2d800.statahead_max=32 1001 real 0m9.272s user 0m0.026s sys 0m1.367s 'ls -l' 1000 files with statahead: 9 sec statahead total: 112 statahead wrong: 2 agl total: 107 list_total: 30 fname_total: 80 hit_total: 5398 miss_total: 1278 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff9d4b47c2d800.statahead_stats= statahead total: 112 statahead wrong: 2 agl total: 107 list_total: 30 fname_total: 80 hit_total: 5398 miss_total: 1278 mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats= snapshot_time: 1788934455.202754318 secs.nsecs start_time: 1788934373.677083128 secs.nsecs elapsed_time: 81.525671190 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 844 (time 1788934467.71 total 10.00 last 84.40) - open/close 1675 (time 1788934477.72 total 20.01 last 83.01) - open/close 2514 (time 1788934487.72 total 30.01 last 83.88) - open/close 3411 (time 1788934497.73 total 40.02 last 89.63) - open/close 4137 (time 1788934507.76 total 50.05 last 72.39) - open/close 4786 (time 1788934517.80 total 60.09 last 64.67) - open/close 5529 (time 1788934527.80 total 70.09 last 74.29) - open/close 6345 (time 1788934537.81 total 80.10 last 81.54) - open/close 7048 (time 1788934547.81 total 90.10 last 70.27) - open/close 7887 (time 1788934557.82 total 100.11 last 83.82) - open/close 8790 (time 1788934567.83 total 110.12 last 90.24) - open/close 9630 (time 1788934577.83 total 120.12 last 83.98) total: 10000 open/close in 124.65 seconds: 80.23 ops/second llite.lustre-ffff9d4b47c2d800.statahead_batch_max=0 llite.lustre-ffff9d4b47c2d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.685s user 0m0.282s sys 0m13.480s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9d4b47c2d800.statahead_batch_max=32 llite.lustre-ffff9d4b47c2d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m26.750s user 0m0.277s sys 0m12.597s batched statahead RPC= hit count=9980 mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats= snapshot_time: 1788934746.001608641 secs.nsecs start_time: 1788934649.953880538 secs.nsecs elapsed_time: 96.047728103 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats=0 llite.lustre-ffff9d4b47c2d800.statahead_max=2048 llite.lustre-ffff9d4b47c2d800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats=0 total: 100 open/close in 1.84 seconds: 54.33 ops/second llite.lustre-ffff9d4b47c2d800.statahead_max=0 101 real 0m2.007s user 0m0.006s sys 0m0.293s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9d4b47c2d800.statahead_max=2048 llite.lustre-ffff9d4b47c2d800.statahead_max=2048 101 real 0m0.968s user 0m0.006s sys 0m0.156s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10079 miss_total: 21 swrong=0 ewrong=0 - open/close 849 (time 1788935010.91 total 10.00 last 84.90) total: 900 open/close in 10.83 seconds: 83.10 ops/second llite.lustre-ffff9d4b47c2d800.statahead_max=0 1001 real 0m17.126s user 0m0.032s sys 0m2.670s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff9d4b47c2d800.statahead_max=2048 llite.lustre-ffff9d4b47c2d800.statahead_max=2048 1001 real 0m6.089s user 0m0.025s sys 0m1.229s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff9d4b47c2d800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats= snapshot_time: 1788935064.291627316 secs.nsecs start_time: 1788934748.042225317 secs.nsecs elapsed_time: 316.249401999 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 3 25 58 64: 1 8 66 128: 0 0 66 256: 4 33 100 - open/close 766 (time 1788935076.93 total 10.00 last 76.58) - open/close 1533 (time 1788935086.94 total 20.01 last 76.65) - open/close 2300 (time 1788935096.94 total 30.01 last 76.69) - open/close 3084 (time 1788935106.94 total 40.01 last 78.40) - open/close 3921 (time 1788935116.95 total 50.02 last 83.62) - open/close 4763 (time 1788935126.95 total 60.03 last 84.16) - open/close 5650 (time 1788935136.96 total 70.03 last 88.69) - open/close 6622 (time 1788935146.96 total 80.03 last 97.14) - open/close 7566 (time 1788935156.97 total 90.04 last 94.30) - open/close 8562 (time 1788935166.98 total 100.05 last 99.52) - open/close 9588 (time 1788935176.98 total 110.06 last 102.55) total: 10000 open/close in 114.61 seconds: 87.25 ops/second llite.lustre-ffff9d4b47c2d800.statahead_batch_max=0 llite.lustre-ffff9d4b47c2d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.116s user 0m0.299s sys 0m13.819s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9d4b47c2d800.statahead_batch_max=256 llite.lustre-ffff9d4b47c2d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.219s user 0m0.287s sys 0m13.133s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9d4b47c2d800.batch_stats= snapshot_time: 1788935300.039712236 secs.nsecs start_time: 1788935243.723322082 secs.nsecs elapsed_time: 56.316390154 secs.nsecs subreqs per batch batches %% cum %% 1: 113 45 45 2: 31 12 57 4: 24 9 66 8: 16 6 73 16: 13 5 78 32: 14 5 84 64: 4 1 85 128: 1 0 86 256: 35 13 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9d4b47c2d800.statahead_batch_max=64 llite.lustre-ffff9d4b47c2d800.statahead_max=128