== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:24:03 (1781627043) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats=0 llite.lustre-ffff963c91b03000.statahead_max=32 llite.lustre-ffff963c91b03000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.64 seconds: 156.35 ops/second llite.lustre-ffff963c91b03000.statahead_max=0 101 real 0m0.646s user 0m0.003s sys 0m0.254s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff963c91b03000.statahead_max=32 llite.lustre-ffff963c91b03000.statahead_max=32 101 real 0m0.425s user 0m0.003s sys 0m0.253s 'ls -l' 100 files with statahead: 1 sec statahead total: 102 statahead wrong: 2 agl total: 98 list_total: 31 fname_total: 71 hit_total: 4125 miss_total: 992 swrong=2 ewrong=2 total: 900 open/close in 1.81 seconds: 497.61 ops/second llite.lustre-ffff963c91b03000.statahead_max=0 1001 real 0m5.992s user 0m0.016s sys 0m2.350s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff963c91b03000.statahead_max=32 llite.lustre-ffff963c91b03000.statahead_max=32 1001 real 0m4.005s user 0m0.018s sys 0m1.992s 'ls -l' 1000 files with statahead: 4 sec statahead total: 103 statahead wrong: 2 agl total: 99 list_total: 32 fname_total: 71 hit_total: 5124 miss_total: 993 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 4 seconds llite.lustre-ffff963c91b03000.statahead_stats= statahead total: 103 statahead wrong: 2 agl total: 99 list_total: 32 fname_total: 71 hit_total: 5124 miss_total: 993 mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627068.270981609 secs.nsecs start_time: 1781627044.670930738 secs.nsecs elapsed_time: 23.600050871 secs.nsecs subreqs per batch batches %% cum %% 1: 4 10 10 2: 1 2 13 4: 0 0 13 8: 3 7 21 16: 23 60 81 32: 7 18 100 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627068.271039556 secs.nsecs start_time: 1781627044.671002735 secs.nsecs elapsed_time: 23.600036821 secs.nsecs subreqs per batch batches %% cum %% 1: 2 4 4 2: 0 0 4 4: 3 7 12 8: 2 4 17 16: 11 26 43 32: 23 56 100 - open/close 4869 (time 1781627080.39 total 10.00 last 486.88) - open/close 9698 (time 1781627090.39 total 20.00 last 482.81) total: 10000 open/close in 20.64 seconds: 484.60 ops/second llite.lustre-ffff963c91b03000.statahead_batch_max=0 llite.lustre-ffff963c91b03000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff963c91b03000.stats=clear mdc.lustre-MDT0001-mdc-ffff963c91b03000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.601s user 0m0.207s sys 0m43.264s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff963c91b03000.statahead_batch_max=32 llite.lustre-ffff963c91b03000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff963c91b03000.stats=clear mdc.lustre-MDT0001-mdc-ffff963c91b03000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.621s user 0m0.188s sys 0m24.498s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627188.952778963 secs.nsecs start_time: 1781627139.988641638 secs.nsecs elapsed_time: 48.964137325 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627188.952822746 secs.nsecs start_time: 1781627139.988695797 secs.nsecs elapsed_time: 48.964126949 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats=0 llite.lustre-ffff963c91b03000.statahead_max=2048 llite.lustre-ffff963c91b03000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.99 seconds: 100.65 ops/second llite.lustre-ffff963c91b03000.statahead_max=0 101 real 0m0.700s user 0m0.001s sys 0m0.279s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff963c91b03000.statahead_max=2048 llite.lustre-ffff963c91b03000.statahead_max=2048 101 real 0m0.420s user 0m0.001s sys 0m0.231s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.97 seconds: 455.85 ops/second llite.lustre-ffff963c91b03000.statahead_max=0 1001 real 0m6.263s user 0m0.021s sys 0m2.483s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff963c91b03000.statahead_max=2048 llite.lustre-ffff963c91b03000.statahead_max=2048 1001 real 0m3.360s user 0m0.016s sys 0m1.393s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff963c91b03000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627300.400927091 secs.nsecs start_time: 1781627189.782465145 secs.nsecs elapsed_time: 110.618461946 secs.nsecs subreqs per batch batches %% cum %% 1: 1 14 14 2: 0 0 14 4: 1 14 28 8: 2 28 57 16: 1 14 71 32: 0 0 71 64: 0 0 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627300.400999723 secs.nsecs start_time: 1781627189.782617509 secs.nsecs elapsed_time: 110.618382214 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 22 22 8: 2 22 44 16: 1 11 55 32: 1 11 66 64: 0 0 66 128: 1 11 77 256: 2 22 100 - open/close 4811 (time 1781627311.21 total 10.00 last 481.10) - open/close 9706 (time 1781627321.21 total 20.00 last 489.42) total: 10000 open/close in 20.59 seconds: 485.71 ops/second llite.lustre-ffff963c91b03000.statahead_batch_max=0 llite.lustre-ffff963c91b03000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff963c91b03000.stats=clear mdc.lustre-MDT0001-mdc-ffff963c91b03000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.407s user 0m0.151s sys 0m29.230s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff963c91b03000.statahead_batch_max=256 llite.lustre-ffff963c91b03000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff963c91b03000.stats=clear mdc.lustre-MDT0001-mdc-ffff963c91b03000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.020s user 0m0.229s sys 0m18.753s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627405.020343737 secs.nsecs start_time: 1781627360.499808054 secs.nsecs elapsed_time: 44.520535683 secs.nsecs subreqs per batch batches %% cum %% 1: 275 55 55 2: 78 15 71 4: 60 12 83 8: 15 3 86 16: 9 1 88 32: 13 2 91 64: 8 1 93 128: 1 0 93 256: 33 6 100 mdc.lustre-MDT0001-mdc-ffff963c91b03000.batch_stats= snapshot_time: 1781627405.020437137 secs.nsecs start_time: 1781627360.499860182 secs.nsecs elapsed_time: 44.520576955 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff963c91b03000.statahead_batch_max=64 llite.lustre-ffff963c91b03000.statahead_max=128