== sanity test 123ad: Verify batching statahead works correctly ========================================================== 14:23:40 (1788287020) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats=0 llite.lustre-ffff916143035000.statahead_max=32 llite.lustre-ffff916143035000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats=0 total: 100 open/close in 2.08 seconds: 48.08 ops/second llite.lustre-ffff916143035000.statahead_max=0 101 real 0m1.833s user 0m0.005s sys 0m0.310s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff916143035000.statahead_max=32 llite.lustre-ffff916143035000.statahead_max=32 101 real 0m0.826s user 0m0.002s sys 0m0.149s 'ls -l' 100 files with statahead: 1 sec statahead total: 139 statahead wrong: 2 agl total: 118 list_total: 29 fname_total: 110 hit_total: 4335 miss_total: 1276 swrong=2 ewrong=2 - open/close 835 (time 1788287046.18 total 10.00 last 83.50) total: 900 open/close in 11.06 seconds: 81.40 ops/second llite.lustre-ffff916143035000.statahead_max=0 1001 real 0m20.717s user 0m0.030s sys 0m2.839s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff916143035000.statahead_max=32 llite.lustre-ffff916143035000.statahead_max=32 1001 real 0m6.999s user 0m0.032s sys 0m1.172s 'ls -l' 1000 files with statahead: 7 sec statahead total: 140 statahead wrong: 2 agl total: 119 list_total: 30 fname_total: 110 hit_total: 5333 miss_total: 1278 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff916143035000.statahead_stats= statahead total: 140 statahead wrong: 2 agl total: 119 list_total: 30 fname_total: 110 hit_total: 5333 miss_total: 1278 mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats= snapshot_time: 1788287111.315359659 secs.nsecs start_time: 1788287024.754737122 secs.nsecs elapsed_time: 86.560622537 secs.nsecs subreqs per batch batches %% cum %% 1: 2 4 4 2: 0 0 4 4: 0 0 4 8: 3 7 12 16: 2 4 17 32: 34 82 100 - open/close 786 (time 1788287124.48 total 10.01 last 78.54) - open/close 1690 (time 1788287134.48 total 20.01 last 90.39) - open/close 2563 (time 1788287144.48 total 30.02 last 87.25) - open/close 3148 (time 1788287154.48 total 40.02 last 58.50) - open/close 3944 (time 1788287164.49 total 50.02 last 79.57) - open/close 4644 (time 1788287174.49 total 60.02 last 69.98) - open/close 5359 (time 1788287184.50 total 70.03 last 71.43) - open/close 6094 (time 1788287194.50 total 80.04 last 73.47) - open/close 6812 (time 1788287204.51 total 90.04 last 71.78) - open/close 7538 (time 1788287214.53 total 100.06 last 72.44) - open/close 8249 (time 1788287224.54 total 110.07 last 71.04) - open/close 9113 (time 1788287234.54 total 120.08 last 86.34) - open/close 9846 (time 1788287244.55 total 130.08 last 73.24) total: 10000 open/close in 132.50 seconds: 75.47 ops/second llite.lustre-ffff916143035000.statahead_batch_max=0 llite.lustre-ffff916143035000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff916143035000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.591s user 0m0.302s sys 0m13.495s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff916143035000.statahead_batch_max=32 llite.lustre-ffff916143035000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff916143035000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m41.817s user 0m0.290s sys 0m12.602s batched statahead RPC= hit count=9977 mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats= snapshot_time: 1788287431.255521500 secs.nsecs start_time: 1788287317.282559134 secs.nsecs elapsed_time: 113.972962366 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats=0 llite.lustre-ffff916143035000.statahead_max=2048 llite.lustre-ffff916143035000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats=0 total: 100 open/close in 2.92 seconds: 34.30 ops/second llite.lustre-ffff916143035000.statahead_max=0 101 real 0m1.790s user 0m0.007s sys 0m0.278s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff916143035000.statahead_max=2048 llite.lustre-ffff916143035000.statahead_max=2048 101 real 0m0.888s user 0m0.004s sys 0m0.164s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10076 miss_total: 24 swrong=0 ewrong=0 - open/close 754 (time 1788287734.64 total 10.00 last 75.38) total: 900 open/close in 12.11 seconds: 74.35 ops/second llite.lustre-ffff916143035000.statahead_max=0 1001 real 0m23.171s user 0m0.034s sys 0m2.681s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff916143035000.statahead_max=2048 llite.lustre-ffff916143035000.statahead_max=2048 1001 real 0m7.479s user 0m0.024s sys 0m1.208s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff916143035000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats= snapshot_time: 1788287806.617433491 secs.nsecs start_time: 1788287435.006055719 secs.nsecs elapsed_time: 371.611377772 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 677 (time 1788287819.82 total 10.00 last 67.68) - open/close 1379 (time 1788287829.82 total 20.01 last 70.17) - open/close 2117 (time 1788287839.83 total 30.02 last 73.72) - open/close 2807 (time 1788287849.84 total 40.03 last 68.91) - open/close 3532 (time 1788287859.85 total 50.04 last 72.44) - open/close 4268 (time 1788287869.86 total 60.05 last 73.55) - open/close 5000 (time 1788287879.89 total 70.07 last 73.01) - open/close 5759 (time 1788287889.89 total 80.07 last 75.89) - open/close 6533 (time 1788287899.89 total 90.08 last 77.35) - open/close 7411 (time 1788287909.90 total 100.09 last 87.72) - open/close 8187 (time 1788287919.92 total 110.11 last 77.47) - open/close 8967 (time 1788287929.93 total 120.12 last 77.92) - open/close 9768 (time 1788287939.93 total 130.12 last 80.09) total: 10000 open/close in 132.78 seconds: 75.31 ops/second llite.lustre-ffff916143035000.statahead_batch_max=0 llite.lustre-ffff916143035000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff916143035000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.902s user 0m0.302s sys 0m13.710s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff916143035000.statahead_batch_max=256 llite.lustre-ffff916143035000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff916143035000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.492s user 0m0.286s sys 0m13.089s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff916143035000.batch_stats= snapshot_time: 1788288064.047200865 secs.nsecs start_time: 1788288011.132695756 secs.nsecs elapsed_time: 52.914505109 secs.nsecs subreqs per batch batches %% cum %% 1: 196 54 54 2: 47 13 67 4: 29 8 75 8: 24 6 82 16: 6 1 84 32: 15 4 88 64: 8 2 90 128: 0 0 90 256: 34 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff916143035000.statahead_batch_max=64 llite.lustre-ffff916143035000.statahead_max=128