== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:09:44 (1789355384) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats=0 llite.lustre-ffff9828b0945800.statahead_max=32 llite.lustre-ffff9828b0945800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.62 seconds: 160.74 ops/second llite.lustre-ffff9828b0945800.statahead_max=0 101 real 0m0.632s user 0m0.004s sys 0m0.259s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9828b0945800.statahead_max=32 llite.lustre-ffff9828b0945800.statahead_max=32 101 real 0m0.383s user 0m0.004s sys 0m0.253s 'ls -l' 100 files with statahead: 0 sec statahead total: 79 statahead wrong: 1 agl total: 74 list_total: 34 fname_total: 45 hit_total: 13815 miss_total: 245 swrong=1 ewrong=1 total: 900 open/close in 1.57 seconds: 572.45 ops/second llite.lustre-ffff9828b0945800.statahead_max=0 1001 real 0m5.394s user 0m0.019s sys 0m2.150s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9828b0945800.statahead_max=32 llite.lustre-ffff9828b0945800.statahead_max=32 1001 real 0m3.460s user 0m0.010s sys 0m1.719s 'ls -l' 1000 files with statahead: 3 sec statahead total: 80 statahead wrong: 1 agl total: 75 list_total: 35 fname_total: 45 hit_total: 14814 miss_total: 246 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff9828b0945800.statahead_stats= statahead total: 80 statahead wrong: 1 agl total: 75 list_total: 35 fname_total: 45 hit_total: 14814 miss_total: 246 mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355410.065348323 secs.nsecs start_time: 1789355386.100761738 secs.nsecs elapsed_time: 23.964586585 secs.nsecs subreqs per batch batches %% cum %% 1: 3 8 8 2: 0 0 8 4: 2 5 13 8: 2 5 18 16: 25 67 86 32: 5 13 100 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355410.065413803 secs.nsecs start_time: 1789355386.100827442 secs.nsecs elapsed_time: 23.964586361 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 5 5 8: 3 7 12 16: 8 20 33 32: 26 66 100 - open/close 5096 (time 1789355420.92 total 10.00 last 509.47) total: 10000 open/close in 19.29 seconds: 518.39 ops/second llite.lustre-ffff9828b0945800.statahead_batch_max=0 llite.lustre-ffff9828b0945800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9828b0945800.stats=clear mdc.lustre-MDT0001-mdc-ffff9828b0945800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.948s user 0m0.167s sys 0m30.214s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9828b0945800.statahead_batch_max=32 llite.lustre-ffff9828b0945800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9828b0945800.stats=clear mdc.lustre-MDT0001-mdc-ffff9828b0945800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.529s user 0m0.166s sys 0m23.536s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355511.566167453 secs.nsecs start_time: 1789355465.304239617 secs.nsecs elapsed_time: 46.261927836 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355511.566214824 secs.nsecs start_time: 1789355465.304312124 secs.nsecs elapsed_time: 46.261902700 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats=0 llite.lustre-ffff9828b0945800.statahead_max=2048 llite.lustre-ffff9828b0945800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.66 seconds: 151.72 ops/second llite.lustre-ffff9828b0945800.statahead_max=0 101 real 0m0.567s user 0m0.010s sys 0m0.226s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9828b0945800.statahead_max=2048 llite.lustre-ffff9828b0945800.statahead_max=2048 101 real 0m0.356s user 0m0.002s sys 0m0.193s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.80 seconds: 499.98 ops/second llite.lustre-ffff9828b0945800.statahead_max=0 1001 real 0m5.451s user 0m0.023s sys 0m2.202s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff9828b0945800.statahead_max=2048 llite.lustre-ffff9828b0945800.statahead_max=2048 1001 real 0m3.081s user 0m0.010s sys 0m1.413s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 - open/close 4798 (time 1789355631.97 total 10.00 last 479.79) total: 9000 open/close in 18.87 seconds: 476.97 ops/second llite.lustre-ffff9828b0945800.statahead_max=0 10001 real 1m3.709s user 0m0.253s sys 0m25.027s 'ls -l' 10000 files without statahead: 63 sec llite.lustre-ffff9828b0945800.statahead_max=2048 llite.lustre-ffff9828b0945800.statahead_max=2048 10001 real 0m30.327s user 0m0.171s sys 0m21.434s 'ls -l' 10000 files with statahead: 30 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 69 seconds llite.lustre-ffff9828b0945800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355818.920359826 secs.nsecs start_time: 1789355512.548331448 secs.nsecs elapsed_time: 306.372028378 secs.nsecs subreqs per batch batches %% cum %% 1: 170 71 71 2: 20 8 79 4: 11 4 84 8: 2 0 84 16: 2 0 85 32: 0 0 85 64: 1 0 86 128: 4 1 87 256: 29 12 100 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355818.920426837 secs.nsecs start_time: 1789355512.548509554 secs.nsecs elapsed_time: 306.371917283 secs.nsecs subreqs per batch batches %% cum %% 1: 141 69 69 2: 16 7 76 4: 8 3 80 8: 5 2 83 16: 0 0 83 32: 0 0 83 64: 1 0 83 128: 4 1 85 256: 29 14 100 - open/close 5040 (time 1789355829.77 total 10.00 last 503.89) total: 10000 open/close in 19.29 seconds: 518.53 ops/second llite.lustre-ffff9828b0945800.statahead_batch_max=0 llite.lustre-ffff9828b0945800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9828b0945800.stats=clear mdc.lustre-MDT0001-mdc-ffff9828b0945800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.440s user 0m0.220s sys 0m31.970s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9828b0945800.statahead_batch_max=256 llite.lustre-ffff9828b0945800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9828b0945800.stats=clear mdc.lustre-MDT0001-mdc-ffff9828b0945800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.256s user 0m0.187s sys 0m24.145s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355921.689978502 secs.nsecs start_time: 1789355880.333296002 secs.nsecs elapsed_time: 41.356682500 secs.nsecs subreqs per batch batches %% cum %% 1: 296 68 68 2: 61 14 82 4: 13 2 85 8: 3 0 85 16: 5 1 87 32: 17 3 91 64: 4 0 91 128: 0 0 91 256: 35 8 100 mdc.lustre-MDT0001-mdc-ffff9828b0945800.batch_stats= snapshot_time: 1789355921.690062154 secs.nsecs start_time: 1789355880.333359960 secs.nsecs elapsed_time: 41.356702194 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9828b0945800.statahead_batch_max=64 llite.lustre-ffff9828b0945800.statahead_max=128