== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:39:46 (1789335586) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats=0 llite.lustre-ffff9cfbd096f000.statahead_max=32 llite.lustre-ffff9cfbd096f000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.20 seconds: 83.10 ops/second llite.lustre-ffff9cfbd096f000.statahead_max=0 101 real 0m1.152s user 0m0.007s sys 0m0.382s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9cfbd096f000.statahead_max=32 llite.lustre-ffff9cfbd096f000.statahead_max=32 101 real 0m0.675s user 0m0.007s sys 0m0.329s 'ls -l' 100 files with statahead: 0 sec statahead total: 86 statahead wrong: 2 agl total: 82 list_total: 28 fname_total: 58 hit_total: 3740 miss_total: 1206 swrong=2 ewrong=2 total: 900 open/close in 4.35 seconds: 207.04 ops/second llite.lustre-ffff9cfbd096f000.statahead_max=0 1001 real 0m10.887s user 0m0.030s sys 0m3.485s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff9cfbd096f000.statahead_max=32 llite.lustre-ffff9cfbd096f000.statahead_max=32 1001 real 0m6.128s user 0m0.022s sys 0m2.284s 'ls -l' 1000 files with statahead: 6 sec statahead total: 87 statahead wrong: 2 agl total: 83 list_total: 29 fname_total: 58 hit_total: 4739 miss_total: 1207 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff9cfbd096f000.statahead_stats= statahead total: 87 statahead wrong: 2 agl total: 83 list_total: 29 fname_total: 58 hit_total: 4739 miss_total: 1207 mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789335632.452394616 secs.nsecs start_time: 1789335588.366597178 secs.nsecs elapsed_time: 44.085797438 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 1 2 7 4: 2 5 12 8: 2 5 17 16: 20 50 67 32: 13 32 100 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789335632.452471986 secs.nsecs start_time: 1789335588.366699488 secs.nsecs elapsed_time: 44.085772498 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 7 7 8: 3 7 15 16: 21 53 69 32: 12 30 100 - open/close 2030 (time 1789335643.66 total 10.00 last 202.98) - open/close 4091 (time 1789335653.66 total 20.01 last 206.00) - open/close 6175 (time 1789335663.66 total 30.01 last 208.32) - open/close 8272 (time 1789335673.66 total 40.01 last 209.70) total: 10000 open/close in 48.46 seconds: 206.37 ops/second llite.lustre-ffff9cfbd096f000.statahead_batch_max=0 llite.lustre-ffff9cfbd096f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.stats=clear mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.117s user 0m0.141s sys 0m28.883s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cfbd096f000.statahead_batch_max=32 llite.lustre-ffff9cfbd096f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.stats=clear mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.008s user 0m0.140s sys 0m30.021s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789335774.751069958 secs.nsecs start_time: 1789335716.540971505 secs.nsecs elapsed_time: 58.210098453 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789335774.751152715 secs.nsecs start_time: 1789335716.541046312 secs.nsecs elapsed_time: 58.210106403 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats=0 llite.lustre-ffff9cfbd096f000.statahead_max=2048 llite.lustre-ffff9cfbd096f000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.19 seconds: 84.33 ops/second llite.lustre-ffff9cfbd096f000.statahead_max=0 101 real 0m1.148s user 0m0.009s sys 0m0.382s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9cfbd096f000.statahead_max=2048 llite.lustre-ffff9cfbd096f000.statahead_max=2048 101 real 0m0.703s user 0m0.005s sys 0m0.246s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 4.49 seconds: 200.28 ops/second llite.lustre-ffff9cfbd096f000.statahead_max=0 1001 real 0m10.773s user 0m0.028s sys 0m3.357s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff9cfbd096f000.statahead_max=2048 llite.lustre-ffff9cfbd096f000.statahead_max=2048 1001 real 0m3.336s user 0m0.015s sys 0m1.276s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff9cfbd096f000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789335955.595519754 secs.nsecs start_time: 1789335776.025458234 secs.nsecs elapsed_time: 179.570061520 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 1 12 50 16: 1 12 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789335955.595623771 secs.nsecs start_time: 1789335776.025562099 secs.nsecs elapsed_time: 179.570061672 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 2 25 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 - open/close 2018 (time 1789335967.31 total 10.00 last 201.73) - open/close 4086 (time 1789335977.32 total 20.00 last 206.77) - open/close 6095 (time 1789335987.32 total 30.01 last 200.84) - open/close 8113 (time 1789335997.32 total 40.01 last 201.78) total: 10000 open/close in 49.52 seconds: 201.95 ops/second llite.lustre-ffff9cfbd096f000.statahead_batch_max=0 llite.lustre-ffff9cfbd096f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.stats=clear mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.619s user 0m0.147s sys 0m39.596s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cfbd096f000.statahead_batch_max=256 llite.lustre-ffff9cfbd096f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.stats=clear mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.511s user 0m0.112s sys 0m25.036s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789336098.407203335 secs.nsecs start_time: 1789336056.786135107 secs.nsecs elapsed_time: 41.621068228 secs.nsecs subreqs per batch batches %% cum %% 1: 140 59 59 2: 25 10 69 4: 7 2 72 8: 2 0 73 16: 1 0 73 32: 22 9 83 64: 4 1 84 128: 1 0 85 256: 35 14 100 mdc.lustre-MDT0001-mdc-ffff9cfbd096f000.batch_stats= snapshot_time: 1789336098.407243387 secs.nsecs start_time: 1789336056.786241542 secs.nsecs elapsed_time: 41.621001845 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9cfbd096f000.statahead_batch_max=64 llite.lustre-ffff9cfbd096f000.statahead_max=128