== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:03:07 (1789059787) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats=0 llite.lustre-ffff8c118ac83800.statahead_max=32 llite.lustre-ffff8c118ac83800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats=0 total: 100 open/close in 3.25 seconds: 30.76 ops/second llite.lustre-ffff8c118ac83800.statahead_max=0 101 real 0m3.044s user 0m0.003s sys 0m0.306s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c118ac83800.statahead_max=32 llite.lustre-ffff8c118ac83800.statahead_max=32 101 real 0m0.919s user 0m0.003s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 156 statahead wrong: 2 agl total: 150 list_total: 29 fname_total: 122 hit_total: 4085 miss_total: 1282 swrong=2 ewrong=2 - open/close 717 (time 1789059817.52 total 10.00 last 71.68) total: 900 open/close in 12.27 seconds: 73.35 ops/second llite.lustre-ffff8c118ac83800.statahead_max=0 1001 real 0m22.614s user 0m0.039s sys 0m2.796s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff8c118ac83800.statahead_max=32 llite.lustre-ffff8c118ac83800.statahead_max=32 1001 real 0m9.815s user 0m0.023s sys 0m1.307s 'ls -l' 1000 files with statahead: 10 sec statahead total: 157 statahead wrong: 2 agl total: 151 list_total: 30 fname_total: 122 hit_total: 5084 miss_total: 1283 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8c118ac83800.statahead_stats= statahead total: 157 statahead wrong: 2 agl total: 151 list_total: 30 fname_total: 122 hit_total: 5084 miss_total: 1283 mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats= snapshot_time: 1789059889.690849756 secs.nsecs start_time: 1789059792.897123458 secs.nsecs elapsed_time: 96.793726298 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 555 (time 1789059902.98 total 10.00 last 55.49) - open/close 1032 (time 1789059912.99 total 20.01 last 47.65) - open/close 1461 (time 1789059923.01 total 30.03 last 42.84) - open/close 1998 (time 1789059933.02 total 40.04 last 53.63) - open/close 2545 (time 1789059943.03 total 50.05 last 54.64) - open/close 3254 (time 1789059953.03 total 60.05 last 70.88) - open/close 3924 (time 1789059963.04 total 70.06 last 66.98) - open/close 4634 (time 1789059973.04 total 80.06 last 70.98) - open/close 5383 (time 1789059983.07 total 90.09 last 74.63) - open/close 6158 (time 1789059993.08 total 100.10 last 77.48) - open/close 6885 (time 1789060003.09 total 110.11 last 72.63) - open/close 7603 (time 1789060013.10 total 120.12 last 71.70) - open/close 8288 (time 1789060023.11 total 130.13 last 68.46) - open/close 9015 (time 1789060033.12 total 140.14 last 72.63) - open/close 9835 (time 1789060043.12 total 150.14 last 81.97) total: 10000 open/close in 151.93 seconds: 65.82 ops/second llite.lustre-ffff8c118ac83800.statahead_batch_max=0 llite.lustre-ffff8c118ac83800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c118ac83800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.819s user 0m0.295s sys 0m13.060s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c118ac83800.statahead_batch_max=32 llite.lustre-ffff8c118ac83800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c118ac83800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m55.081s user 0m0.321s sys 0m13.065s batched statahead RPC= hit count=9969 mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats= snapshot_time: 1789060253.858671030 secs.nsecs start_time: 1789060125.232426929 secs.nsecs elapsed_time: 128.626244101 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats=0 llite.lustre-ffff8c118ac83800.statahead_max=2048 llite.lustre-ffff8c118ac83800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats=0 total: 100 open/close in 2.50 seconds: 39.94 ops/second llite.lustre-ffff8c118ac83800.statahead_max=0 101 real 0m2.206s user 0m0.003s sys 0m0.334s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8c118ac83800.statahead_max=2048 llite.lustre-ffff8c118ac83800.statahead_max=2048 101 real 0m0.773s user 0m0.006s sys 0m0.145s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10068 miss_total: 32 swrong=0 ewrong=0 - open/close 759 (time 1789060560.04 total 10.02 last 75.72) total: 900 open/close in 12.12 seconds: 74.25 ops/second llite.lustre-ffff8c118ac83800.statahead_max=0 1001 real 0m18.911s user 0m0.031s sys 0m2.934s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8c118ac83800.statahead_max=2048 llite.lustre-ffff8c118ac83800.statahead_max=2048 1001 real 0m8.347s user 0m0.034s sys 0m1.269s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11067 miss_total: 33 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8c118ac83800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11067 miss_total: 33 mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats= snapshot_time: 1789060630.599834330 secs.nsecs start_time: 1789060257.501865649 secs.nsecs elapsed_time: 373.097968681 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 552 (time 1789060644.04 total 10.02 last 55.09) - open/close 1133 (time 1789060654.05 total 20.03 last 58.02) - open/close 1795 (time 1789060664.07 total 30.05 last 66.10) - open/close 2420 (time 1789060674.07 total 40.05 last 62.49) - open/close 2936 (time 1789060684.10 total 50.08 last 51.44) - open/close 3466 (time 1789060694.11 total 60.09 last 52.95) - open/close 4090 (time 1789060704.12 total 70.10 last 62.36) - open/close 4786 (time 1789060714.13 total 80.11 last 69.54) - open/close 5339 (time 1789060724.13 total 90.11 last 55.27) - open/close 5922 (time 1789060734.14 total 100.12 last 58.25) - open/close 6628 (time 1789060744.14 total 110.12 last 70.59) - open/close 7305 (time 1789060754.15 total 120.13 last 67.65) - open/close 7970 (time 1789060764.16 total 130.14 last 66.44) - open/close 8625 (time 1789060774.16 total 140.14 last 65.49) - open/close 9264 (time 1789060784.16 total 150.14 last 63.88) - open/close 9746 (time 1789060794.17 total 160.15 last 48.18) total: 10000 open/close in 163.71 seconds: 61.08 ops/second llite.lustre-ffff8c118ac83800.statahead_batch_max=0 llite.lustre-ffff8c118ac83800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c118ac83800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m19.135s user 0m0.331s sys 0m14.074s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c118ac83800.statahead_batch_max=256 llite.lustre-ffff8c118ac83800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c118ac83800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.835s user 0m0.320s sys 0m13.081s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c118ac83800.batch_stats= snapshot_time: 1789060959.308417660 secs.nsecs start_time: 1789060886.759987184 secs.nsecs elapsed_time: 72.548430476 secs.nsecs subreqs per batch batches %% cum %% 1: 48 29 29 2: 24 14 44 4: 19 11 56 8: 6 3 59 16: 7 4 64 32: 14 8 72 64: 7 4 77 128: 2 1 78 256: 35 21 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c118ac83800.statahead_batch_max=64 llite.lustre-ffff8c118ac83800.statahead_max=128