== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:45:09 (1788540309) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats=0 llite.lustre-ffff9bac90d58800.statahead_max=32 llite.lustre-ffff9bac90d58800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats=0 total: 100 open/close in 2.41 seconds: 41.55 ops/second llite.lustre-ffff9bac90d58800.statahead_max=0 101 real 0m2.069s user 0m0.007s sys 0m0.303s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9bac90d58800.statahead_max=32 llite.lustre-ffff9bac90d58800.statahead_max=32 101 real 0m1.231s user 0m0.003s sys 0m0.148s 'ls -l' 100 files with statahead: 1 sec statahead total: 122 statahead wrong: 2 agl total: 115 list_total: 30 fname_total: 90 hit_total: 3795 miss_total: 1536 swrong=2 ewrong=2 - open/close 776 (time 1788540337.91 total 10.01 last 77.56) total: 900 open/close in 11.72 seconds: 76.77 ops/second llite.lustre-ffff9bac90d58800.statahead_max=0 1001 real 0m19.941s user 0m0.030s sys 0m2.749s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9bac90d58800.statahead_max=32 llite.lustre-ffff9bac90d58800.statahead_max=32 1001 real 0m7.665s user 0m0.031s sys 0m1.377s 'ls -l' 1000 files with statahead: 8 sec statahead total: 123 statahead wrong: 2 agl total: 116 list_total: 31 fname_total: 90 hit_total: 4794 miss_total: 1537 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff9bac90d58800.statahead_stats= statahead total: 123 statahead wrong: 2 agl total: 116 list_total: 31 fname_total: 90 hit_total: 4794 miss_total: 1537 mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats= snapshot_time: 1788540394.733211473 secs.nsecs start_time: 1788540314.953800684 secs.nsecs elapsed_time: 79.779410789 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 2 4 7 4: 0 0 7 8: 2 4 12 16: 2 4 17 32: 34 82 100 - open/close 782 (time 1788540406.90 total 10.01 last 78.15) - open/close 1591 (time 1788540416.91 total 20.02 last 80.81) - open/close 2395 (time 1788540426.91 total 30.02 last 80.38) - open/close 3129 (time 1788540436.94 total 40.05 last 73.20) - open/close 3931 (time 1788540446.95 total 50.06 last 80.12) - open/close 4750 (time 1788540456.96 total 60.07 last 81.78) - open/close 5554 (time 1788540466.96 total 70.07 last 80.39) - open/close 6416 (time 1788540476.97 total 80.08 last 86.11) - open/close 7180 (time 1788540486.98 total 90.09 last 76.35) - open/close 7906 (time 1788540496.98 total 100.09 last 72.58) - open/close 8765 (time 1788540507.00 total 110.10 last 85.79) - open/close 9479 (time 1788540517.04 total 120.15 last 71.09) total: 10000 open/close in 126.35 seconds: 79.15 ops/second llite.lustre-ffff9bac90d58800.statahead_batch_max=0 llite.lustre-ffff9bac90d58800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bac90d58800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.814s user 0m0.294s sys 0m14.702s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bac90d58800.statahead_batch_max=32 llite.lustre-ffff9bac90d58800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bac90d58800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m28.849s user 0m0.250s sys 0m13.171s batched statahead RPC= hit count=9992 mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats= snapshot_time: 1788540682.106719635 secs.nsecs start_time: 1788540584.551526028 secs.nsecs elapsed_time: 97.555193607 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats=0 llite.lustre-ffff9bac90d58800.statahead_max=2048 llite.lustre-ffff9bac90d58800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats=0 total: 100 open/close in 2.52 seconds: 39.70 ops/second llite.lustre-ffff9bac90d58800.statahead_max=0 101 real 0m1.951s user 0m0.006s sys 0m0.292s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9bac90d58800.statahead_max=2048 llite.lustre-ffff9bac90d58800.statahead_max=2048 101 real 0m0.729s user 0m0.004s sys 0m0.131s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10091 miss_total: 9 swrong=0 ewrong=0 - open/close 823 (time 1788540970.01 total 10.01 last 82.24) total: 900 open/close in 11.02 seconds: 81.69 ops/second llite.lustre-ffff9bac90d58800.statahead_max=0 1001 real 0m19.864s user 0m0.032s sys 0m2.676s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9bac90d58800.statahead_max=2048 llite.lustre-ffff9bac90d58800.statahead_max=2048 1001 real 0m6.429s user 0m0.028s sys 0m1.371s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11090 miss_total: 10 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9bac90d58800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11090 miss_total: 10 mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats= snapshot_time: 1788541030.906956519 secs.nsecs start_time: 1788540684.337642114 secs.nsecs elapsed_time: 346.569314405 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 849 (time 1788541043.85 total 10.00 last 84.86) - open/close 1686 (time 1788541053.85 total 20.01 last 83.65) - open/close 2463 (time 1788541063.86 total 30.01 last 77.67) - open/close 3257 (time 1788541073.86 total 40.02 last 79.39) - open/close 4085 (time 1788541083.87 total 50.02 last 82.73) - open/close 4805 (time 1788541093.90 total 60.05 last 71.80) - open/close 5539 (time 1788541103.90 total 70.06 last 73.37) - open/close 6365 (time 1788541113.91 total 80.06 last 82.55) - open/close 7204 (time 1788541123.91 total 90.07 last 83.84) - open/close 8048 (time 1788541133.92 total 100.07 last 84.38) - open/close 8817 (time 1788541143.92 total 110.08 last 76.88) - open/close 9644 (time 1788541153.94 total 120.10 last 82.50) total: 10000 open/close in 124.31 seconds: 80.44 ops/second llite.lustre-ffff9bac90d58800.statahead_batch_max=0 llite.lustre-ffff9bac90d58800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bac90d58800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.133s user 0m0.266s sys 0m14.155s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bac90d58800.statahead_batch_max=256 llite.lustre-ffff9bac90d58800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bac90d58800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.136s user 0m0.263s sys 0m13.881s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bac90d58800.batch_stats= snapshot_time: 1788541281.149651752 secs.nsecs start_time: 1788541221.273539305 secs.nsecs elapsed_time: 59.876112447 secs.nsecs subreqs per batch batches %% cum %% 1: 53 32 32 2: 20 12 45 4: 14 8 54 8: 9 5 59 16: 7 4 63 32: 14 8 72 64: 6 3 76 128: 3 1 78 256: 35 21 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 1 seconds: 0.000000 unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9bac90d58800.statahead_batch_max=64 llite.lustre-ffff9bac90d58800.statahead_max=128