== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:48:22 (1788468502) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats=0 llite.lustre-ffff92f9200d8800.statahead_max=32 llite.lustre-ffff92f9200d8800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats=0 total: 100 open/close in 2.79 seconds: 35.85 ops/second llite.lustre-ffff92f9200d8800.statahead_max=0 101 real 0m3.829s user 0m0.006s sys 0m0.307s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff92f9200d8800.statahead_max=32 llite.lustre-ffff92f9200d8800.statahead_max=32 101 real 0m0.863s user 0m0.007s sys 0m0.120s 'ls -l' 100 files with statahead: 1 sec statahead total: 115 statahead wrong: 2 agl total: 109 list_total: 30 fname_total: 73 hit_total: 3696 miss_total: 1301 swrong=2 ewrong=2 - open/close 800 (time 1788468534.41 total 10.00 last 79.96) total: 900 open/close in 11.71 seconds: 76.88 ops/second llite.lustre-ffff92f9200d8800.statahead_max=0 1001 real 0m19.173s user 0m0.034s sys 0m2.737s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff92f9200d8800.statahead_max=32 llite.lustre-ffff92f9200d8800.statahead_max=32 1001 real 0m9.974s user 0m0.022s sys 0m1.242s 'ls -l' 1000 files with statahead: 10 sec statahead total: 116 statahead wrong: 2 agl total: 110 list_total: 31 fname_total: 73 hit_total: 4695 miss_total: 1302 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff92f9200d8800.statahead_stats= statahead total: 116 statahead wrong: 2 agl total: 110 list_total: 31 fname_total: 73 hit_total: 4695 miss_total: 1302 mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats= snapshot_time: 1788468596.637669765 secs.nsecs start_time: 1788468509.501490682 secs.nsecs elapsed_time: 87.136179083 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 930 (time 1788468609.21 total 10.00 last 93.00) - open/close 1832 (time 1788468619.22 total 20.02 last 90.05) - open/close 2846 (time 1788468629.23 total 30.02 last 101.32) - open/close 3726 (time 1788468639.24 total 40.03 last 87.94) - open/close 4676 (time 1788468649.24 total 50.03 last 94.97) - open/close 5602 (time 1788468659.26 total 60.05 last 92.44) - open/close 6512 (time 1788468669.26 total 70.06 last 90.96) - open/close 7318 (time 1788468679.27 total 80.06 last 80.55) - open/close 8172 (time 1788468689.27 total 90.06 last 85.39) - open/close 8895 (time 1788468699.28 total 100.07 last 72.27) - open/close 9782 (time 1788468709.28 total 110.08 last 88.62) total: 10000 open/close in 112.88 seconds: 88.59 ops/second llite.lustre-ffff92f9200d8800.statahead_batch_max=0 llite.lustre-ffff92f9200d8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92f9200d8800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.308s user 0m0.306s sys 0m12.994s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92f9200d8800.statahead_batch_max=32 llite.lustre-ffff92f9200d8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92f9200d8800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m32.280s user 0m0.280s sys 0m12.464s batched statahead RPC= hit count=9976 mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats= snapshot_time: 1788468879.063316082 secs.nsecs start_time: 1788468776.418983294 secs.nsecs elapsed_time: 102.644332788 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats=0 llite.lustre-ffff92f9200d8800.statahead_max=2048 llite.lustre-ffff92f9200d8800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats=0 total: 100 open/close in 2.17 seconds: 46.05 ops/second llite.lustre-ffff92f9200d8800.statahead_max=0 101 real 0m1.929s user 0m0.007s sys 0m0.305s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff92f9200d8800.statahead_max=2048 llite.lustre-ffff92f9200d8800.statahead_max=2048 101 real 0m0.971s user 0m0.001s sys 0m0.121s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10075 miss_total: 25 swrong=0 ewrong=0 - open/close 841 (time 1788469217.70 total 10.01 last 84.05) total: 900 open/close in 10.90 seconds: 82.58 ops/second llite.lustre-ffff92f9200d8800.statahead_max=0 1001 real 0m28.491s user 0m0.046s sys 0m3.002s 'ls -l' 1000 files without statahead: 29 sec llite.lustre-ffff92f9200d8800.statahead_max=2048 llite.lustre-ffff92f9200d8800.statahead_max=2048 1001 real 0m6.517s user 0m0.026s sys 0m1.327s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11074 miss_total: 26 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff92f9200d8800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11074 miss_total: 26 mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats= snapshot_time: 1788469292.398314235 secs.nsecs start_time: 1788468881.898171110 secs.nsecs elapsed_time: 410.500143125 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 560 (time 1788469306.09 total 10.01 last 55.94) - open/close 1203 (time 1788469316.09 total 20.02 last 64.25) - open/close 1965 (time 1788469326.10 total 30.02 last 76.15) - open/close 2846 (time 1788469336.10 total 40.02 last 88.09) - open/close 3735 (time 1788469346.11 total 50.03 last 88.81) - open/close 4664 (time 1788469356.12 total 60.04 last 92.85) - open/close 5379 (time 1788469366.13 total 70.05 last 71.41) - open/close 6211 (time 1788469376.13 total 80.06 last 83.17) - open/close 7127 (time 1788469386.14 total 90.06 last 91.55) - open/close 7953 (time 1788469396.14 total 100.06 last 82.59) - open/close 8757 (time 1788469406.17 total 110.09 last 80.15) - open/close 9645 (time 1788469416.17 total 120.10 last 88.78) total: 10000 open/close in 124.96 seconds: 80.03 ops/second llite.lustre-ffff92f9200d8800.statahead_batch_max=0 llite.lustre-ffff92f9200d8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92f9200d8800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.119s user 0m0.260s sys 0m13.067s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92f9200d8800.statahead_batch_max=256 llite.lustre-ffff92f9200d8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92f9200d8800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.683s user 0m0.290s sys 0m13.386s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff92f9200d8800.batch_stats= snapshot_time: 1788469555.637530388 secs.nsecs start_time: 1788469492.574703693 secs.nsecs elapsed_time: 63.062826695 secs.nsecs subreqs per batch batches %% cum %% 1: 53 34 34 2: 15 9 44 4: 15 9 53 8: 6 3 57 16: 7 4 62 32: 14 9 71 64: 6 3 75 128: 3 1 77 256: 35 22 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff92f9200d8800.statahead_batch_max=64 llite.lustre-ffff92f9200d8800.statahead_max=128