== sanity test 123ad: Verify batching statahead works correctly ========================================================== 15:23:31 (1790882611) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats=0 llite.lustre-ffff8cf417fe1000.statahead_max=32 llite.lustre-ffff8cf417fe1000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.66 seconds: 151.65 ops/second llite.lustre-ffff8cf417fe1000.statahead_max=0 101 real 0m0.616s user 0m0.006s sys 0m0.218s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff8cf417fe1000.statahead_max=32 llite.lustre-ffff8cf417fe1000.statahead_max=32 101 real 0m0.416s user 0m0.002s sys 0m0.189s 'ls -l' 100 files with statahead: 0 sec statahead total: 72 statahead wrong: 1 agl total: 66 list_total: 27 fname_total: 45 hit_total: 13719 miss_total: 204 swrong=1 ewrong=1 total: 900 open/close in 1.87 seconds: 480.62 ops/second llite.lustre-ffff8cf417fe1000.statahead_max=0 1001 real 0m5.997s user 0m0.022s sys 0m2.144s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8cf417fe1000.statahead_max=32 llite.lustre-ffff8cf417fe1000.statahead_max=32 1001 real 0m3.659s user 0m0.015s sys 0m1.683s 'ls -l' 1000 files with statahead: 4 sec statahead total: 73 statahead wrong: 1 agl total: 67 list_total: 28 fname_total: 45 hit_total: 14718 miss_total: 205 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8cf417fe1000.statahead_stats= statahead total: 73 statahead wrong: 1 agl total: 67 list_total: 28 fname_total: 45 hit_total: 14718 miss_total: 205 mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882637.842627817 secs.nsecs start_time: 1790882613.326980895 secs.nsecs elapsed_time: 24.515646922 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 3 7 10 8: 2 5 15 16: 19 48 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882637.842670136 secs.nsecs start_time: 1790882613.327046013 secs.nsecs elapsed_time: 24.515624123 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 3 7 12 16: 21 53 66 32: 13 33 100 - open/close 4327 (time 1790882648.81 total 10.00 last 432.64) - open/close 8745 (time 1790882658.81 total 20.00 last 441.65) total: 10000 open/close in 23.09 seconds: 433.11 ops/second llite.lustre-ffff8cf417fe1000.statahead_batch_max=0 llite.lustre-ffff8cf417fe1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.stats=clear mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.023s user 0m0.158s sys 0m30.267s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8cf417fe1000.statahead_batch_max=32 llite.lustre-ffff8cf417fe1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.stats=clear mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.774s user 0m0.180s sys 0m20.738s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882739.091485519 secs.nsecs start_time: 1790882697.667076645 secs.nsecs elapsed_time: 41.424408874 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882739.091526624 secs.nsecs start_time: 1790882697.667128273 secs.nsecs elapsed_time: 41.424398351 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats=0 llite.lustre-ffff8cf417fe1000.statahead_max=2048 llite.lustre-ffff8cf417fe1000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.65 seconds: 153.45 ops/second llite.lustre-ffff8cf417fe1000.statahead_max=0 101 real 0m0.666s user 0m0.002s sys 0m0.235s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8cf417fe1000.statahead_max=2048 llite.lustre-ffff8cf417fe1000.statahead_max=2048 101 real 0m0.369s user 0m0.001s sys 0m0.171s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.18 seconds: 413.06 ops/second llite.lustre-ffff8cf417fe1000.statahead_max=0 1001 real 0m7.061s user 0m0.028s sys 0m2.378s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8cf417fe1000.statahead_max=2048 llite.lustre-ffff8cf417fe1000.statahead_max=2048 1001 real 0m3.538s user 0m0.018s sys 0m1.089s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8cf417fe1000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882857.477147579 secs.nsecs start_time: 1790882739.908652923 secs.nsecs elapsed_time: 117.568494656 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 14 14 4: 2 28 42 8: 1 14 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882857.477254700 secs.nsecs start_time: 1790882739.908834180 secs.nsecs elapsed_time: 117.568420520 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 14 14 8: 3 42 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 - open/close 4400 (time 1790882868.40 total 10.00 last 439.93) - open/close 9023 (time 1790882878.41 total 20.00 last 462.21) total: 10000 open/close in 22.15 seconds: 451.56 ops/second llite.lustre-ffff8cf417fe1000.statahead_batch_max=0 llite.lustre-ffff8cf417fe1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.stats=clear mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.443s user 0m0.143s sys 0m27.026s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8cf417fe1000.statahead_batch_max=256 llite.lustre-ffff8cf417fe1000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.stats=clear mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.071s user 0m0.166s sys 0m22.698s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882952.824526250 secs.nsecs start_time: 1790882917.386814227 secs.nsecs elapsed_time: 35.437712023 secs.nsecs subreqs per batch batches %% cum %% 1: 151 54 54 2: 42 15 69 4: 20 7 76 8: 1 0 77 16: 2 0 77 32: 23 8 86 64: 2 0 87 128: 1 0 87 256: 35 12 100 mdc.lustre-MDT0001-mdc-ffff8cf417fe1000.batch_stats= snapshot_time: 1790882952.824569935 secs.nsecs start_time: 1790882917.386864059 secs.nsecs elapsed_time: 35.437705876 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8cf417fe1000.statahead_batch_max=64 llite.lustre-ffff8cf417fe1000.statahead_max=128