== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:52:04 (1783140724) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats=0 llite.lustre-ffff92e350f2a000.statahead_max=32 llite.lustre-ffff92e350f2a000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats=0 total: 100 open/close in 2.02 seconds: 49.39 ops/second llite.lustre-ffff92e350f2a000.statahead_max=0 101 real 0m1.735s user 0m0.006s sys 0m0.325s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff92e350f2a000.statahead_max=32 llite.lustre-ffff92e350f2a000.statahead_max=32 101 real 0m1.095s user 0m0.006s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 134 statahead wrong: 2 agl total: 127 list_total: 30 fname_total: 96 hit_total: 4042 miss_total: 1281 swrong=2 ewrong=2 - open/close 773 (time 1783140749.03 total 10.02 last 77.18) total: 900 open/close in 11.70 seconds: 76.90 ops/second llite.lustre-ffff92e350f2a000.statahead_max=0 1001 real 0m18.024s user 0m0.032s sys 0m3.031s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff92e350f2a000.statahead_max=32 llite.lustre-ffff92e350f2a000.statahead_max=32 1001 real 0m8.818s user 0m0.018s sys 0m1.420s 'ls -l' 1000 files with statahead: 9 sec statahead total: 135 statahead wrong: 2 agl total: 128 list_total: 31 fname_total: 96 hit_total: 5040 miss_total: 1283 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff92e350f2a000.statahead_stats= statahead total: 135 statahead wrong: 2 agl total: 128 list_total: 31 fname_total: 96 hit_total: 5040 miss_total: 1283 mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats= snapshot_time: 1783140805.758794694 secs.nsecs start_time: 1783140728.723746802 secs.nsecs elapsed_time: 77.035047892 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 802 (time 1783140818.30 total 10.01 last 80.14) - open/close 1610 (time 1783140828.31 total 20.01 last 80.74) - open/close 2428 (time 1783140838.32 total 30.02 last 81.72) - open/close 3164 (time 1783140848.32 total 40.02 last 73.60) - open/close 3946 (time 1783140858.32 total 50.03 last 78.16) - open/close 4726 (time 1783140868.32 total 60.03 last 77.98) - open/close 5455 (time 1783140878.33 total 70.04 last 72.84) - open/close 6145 (time 1783140888.34 total 80.04 last 68.98) - open/close 6922 (time 1783140898.35 total 90.06 last 77.59) - open/close 7703 (time 1783140908.35 total 100.06 last 78.09) - open/close 8433 (time 1783140918.36 total 110.07 last 72.91) - open/close 9298 (time 1783140928.37 total 120.08 last 86.46) total: 10000 open/close in 127.70 seconds: 78.31 ops/second llite.lustre-ffff92e350f2a000.statahead_batch_max=0 llite.lustre-ffff92e350f2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e350f2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.711s user 0m0.278s sys 0m14.908s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92e350f2a000.statahead_batch_max=32 llite.lustre-ffff92e350f2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92e350f2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m25.311s user 0m0.276s sys 0m14.300s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats= snapshot_time: 1783141091.417707538 secs.nsecs start_time: 1783140995.495848009 secs.nsecs elapsed_time: 95.921859529 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats=0 llite.lustre-ffff92e350f2a000.statahead_max=2048 llite.lustre-ffff92e350f2a000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats=0 total: 100 open/close in 1.51 seconds: 66.11 ops/second llite.lustre-ffff92e350f2a000.statahead_max=0 101 real 0m1.789s user 0m0.004s sys 0m0.315s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff92e350f2a000.statahead_max=2048 llite.lustre-ffff92e350f2a000.statahead_max=2048 101 real 0m0.637s user 0m0.005s sys 0m0.158s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 total: 900 open/close in 7.41 seconds: 121.52 ops/second llite.lustre-ffff92e350f2a000.statahead_max=0 1001 real 0m15.212s user 0m0.035s sys 0m2.887s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffff92e350f2a000.statahead_max=2048 llite.lustre-ffff92e350f2a000.statahead_max=2048 1001 real 0m5.313s user 0m0.025s sys 0m1.525s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff92e350f2a000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats= snapshot_time: 1783141385.669788382 secs.nsecs start_time: 1783141093.309112392 secs.nsecs elapsed_time: 292.360675990 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 3 25 58 64: 1 8 66 128: 0 0 66 256: 4 33 100 - open/close 1100 (time 1783141397.04 total 10.00 last 109.97) - open/close 2202 (time 1783141407.04 total 20.00 last 110.18) - open/close 3239 (time 1783141417.05 total 30.01 last 103.62) - open/close 4277 (time 1783141427.05 total 40.01 last 103.79) - open/close 5261 (time 1783141437.05 total 50.02 last 98.34) - open/close 6227 (time 1783141447.06 total 60.03 last 96.54) - open/close 7323 (time 1783141457.07 total 70.03 last 109.54) - open/close 8149 (time 1783141467.07 total 80.03 last 82.58) - open/close 8734 (time 1783141477.08 total 90.04 last 58.47) - open/close 9108 (time 1783141487.20 total 100.16 last 36.94) - open/close 9615 (time 1783141497.23 total 110.20 last 50.53) total: 10000 open/close in 120.04 seconds: 83.31 ops/second llite.lustre-ffff92e350f2a000.statahead_batch_max=0 llite.lustre-ffff92e350f2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e350f2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.844s user 0m0.321s sys 0m15.504s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92e350f2a000.statahead_batch_max=256 llite.lustre-ffff92e350f2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92e350f2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m48.896s user 0m0.299s sys 0m14.893s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff92e350f2a000.batch_stats= snapshot_time: 1783141641.437980178 secs.nsecs start_time: 1783141581.133301612 secs.nsecs elapsed_time: 60.304678566 secs.nsecs subreqs per batch batches %% cum %% 1: 155 49 49 2: 39 12 61 4: 28 8 70 8: 23 7 78 16: 15 4 82 32: 15 4 87 64: 4 1 88 128: 1 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff92e350f2a000.statahead_batch_max=64 llite.lustre-ffff92e350f2a000.statahead_max=128