== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:14:43 (1783354483) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats=0 llite.lustre-ffff949cc3f5c000.statahead_max=32 llite.lustre-ffff949cc3f5c000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.63 seconds: 157.88 ops/second llite.lustre-ffff949cc3f5c000.statahead_max=0 101 real 0m0.626s user 0m0.002s sys 0m0.251s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff949cc3f5c000.statahead_max=32 llite.lustre-ffff949cc3f5c000.statahead_max=32 101 real 0m0.437s user 0m0.001s sys 0m0.231s 'ls -l' 100 files with statahead: 0 sec statahead total: 93 statahead wrong: 2 agl total: 88 list_total: 30 fname_total: 63 hit_total: 14435 miss_total: 760 swrong=2 ewrong=2 total: 900 open/close in 2.07 seconds: 434.41 ops/second llite.lustre-ffff949cc3f5c000.statahead_max=0 1001 real 0m6.312s user 0m0.025s sys 0m2.499s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff949cc3f5c000.statahead_max=32 llite.lustre-ffff949cc3f5c000.statahead_max=32 1001 real 0m4.178s user 0m0.013s sys 0m2.069s 'ls -l' 1000 files with statahead: 5 sec statahead total: 94 statahead wrong: 2 agl total: 89 list_total: 31 fname_total: 63 hit_total: 15434 miss_total: 761 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 4 seconds llite.lustre-ffff949cc3f5c000.statahead_stats= statahead total: 94 statahead wrong: 2 agl total: 89 list_total: 31 fname_total: 63 hit_total: 15434 miss_total: 761 mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354509.715488212 secs.nsecs start_time: 1783354485.160179796 secs.nsecs elapsed_time: 24.555308416 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 5 5 8: 4 10 15 16: 21 53 69 32: 12 30 100 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354509.715542163 secs.nsecs start_time: 1783354485.160244376 secs.nsecs elapsed_time: 24.555297787 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 1 2 7 4: 3 7 15 8: 2 5 20 16: 16 40 60 32: 16 40 100 - open/close 5413 (time 1783354521.61 total 10.00 last 541.22) total: 10000 open/close in 19.31 seconds: 517.84 ops/second llite.lustre-ffff949cc3f5c000.statahead_batch_max=0 llite.lustre-ffff949cc3f5c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.stats=clear mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.599s user 0m0.198s sys 0m37.134s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff949cc3f5c000.statahead_batch_max=32 llite.lustre-ffff949cc3f5c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.stats=clear mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.999s user 0m0.141s sys 0m20.623s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354614.561867231 secs.nsecs start_time: 1783354572.563592795 secs.nsecs elapsed_time: 41.998274436 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354614.561919452 secs.nsecs start_time: 1783354572.563637695 secs.nsecs elapsed_time: 41.998281757 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats=0 llite.lustre-ffff949cc3f5c000.statahead_max=2048 llite.lustre-ffff949cc3f5c000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.85 seconds: 117.63 ops/second llite.lustre-ffff949cc3f5c000.statahead_max=0 101 real 0m0.622s user 0m0.002s sys 0m0.241s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff949cc3f5c000.statahead_max=2048 llite.lustre-ffff949cc3f5c000.statahead_max=2048 101 real 0m0.324s user 0m0.002s sys 0m0.205s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.72 seconds: 523.20 ops/second llite.lustre-ffff949cc3f5c000.statahead_max=0 1001 real 0m5.695s user 0m0.020s sys 0m2.228s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff949cc3f5c000.statahead_max=2048 llite.lustre-ffff949cc3f5c000.statahead_max=2048 1001 real 0m3.225s user 0m0.013s sys 0m1.257s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 4 seconds llite.lustre-ffff949cc3f5c000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354716.788849430 secs.nsecs start_time: 1783354615.289064238 secs.nsecs elapsed_time: 101.499785192 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 42 42 16: 1 14 57 32: 1 14 71 64: 0 0 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354716.788885535 secs.nsecs start_time: 1783354615.289185503 secs.nsecs elapsed_time: 101.499700032 secs.nsecs subreqs per batch batches %% cum %% 1: 2 25 25 2: 0 0 25 4: 1 12 37 8: 2 25 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 - open/close 5287 (time 1783354727.48 total 10.00 last 528.62) total: 10000 open/close in 19.61 seconds: 509.83 ops/second llite.lustre-ffff949cc3f5c000.statahead_batch_max=0 llite.lustre-ffff949cc3f5c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.stats=clear mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.176s user 0m0.139s sys 0m27.193s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff949cc3f5c000.statahead_batch_max=256 llite.lustre-ffff949cc3f5c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.stats=clear mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.393s user 0m0.154s sys 0m19.967s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354804.636258982 secs.nsecs start_time: 1783354771.361549133 secs.nsecs elapsed_time: 33.274709849 secs.nsecs subreqs per batch batches %% cum %% 1: 422 72 72 2: 68 11 84 4: 26 4 88 8: 3 0 89 16: 5 0 90 32: 22 3 93 64: 2 0 94 128: 0 0 94 256: 34 5 100 mdc.lustre-MDT0001-mdc-ffff949cc3f5c000.batch_stats= snapshot_time: 1783354804.636297384 secs.nsecs start_time: 1783354771.361595106 secs.nsecs elapsed_time: 33.274702278 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff949cc3f5c000.statahead_batch_max=64 llite.lustre-ffff949cc3f5c000.statahead_max=128