== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:12:08 (1763356328) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats=0 llite.lustre-ffff9f51089a2000.statahead_max=32 llite.lustre-ffff9f51089a2000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.62 seconds: 161.18 ops/second llite.lustre-ffff9f51089a2000.statahead_max=0 101 real 0m0.654s user 0m0.003s sys 0m0.265s ls -l 100 files without statahead: 1 sec llite.lustre-ffff9f51089a2000.statahead_max=32 32 101 real 0m0.395s user 0m0.002s sys 0m0.201s ls -l 100 files with statahead: 1 sec statahead total: 65 statahead wrong: 2 agl total: 59 list_total: 29 fname_total: 34 hit_total: 34074 miss_total: 413 total: 900 open/close in 1.85 seconds: 487.08 ops/second llite.lustre-ffff9f51089a2000.statahead_max=0 1001 real 0m5.751s user 0m0.017s sys 0m2.096s ls -l 1000 files without statahead: 6 sec llite.lustre-ffff9f51089a2000.statahead_max=32 32 1001 real 0m3.653s user 0m0.013s sys 0m1.656s ls -l 1000 files with statahead: 4 sec statahead total: 66 statahead wrong: 2 agl total: 60 list_total: 30 fname_total: 34 hit_total: 35073 miss_total: 414 - open/close 4492 (time 1763356357.65 total 10.00 last 449.11) - open/close 8802 (time 1763356367.65 total 20.00 last 430.99) total: 9000 open/close in 20.45 seconds: 440.10 ops/second llite.lustre-ffff9f51089a2000.statahead_max=0 10001 real 0m55.263s user 0m0.160s sys 0m18.884s ls -l 10000 files without statahead: 55 sec llite.lustre-ffff9f51089a2000.statahead_max=32 32 10001 real 0m37.768s user 0m0.135s sys 0m16.718s ls -l 10000 files with statahead: 38 sec statahead total: 67 statahead wrong: 2 agl total: 61 list_total: 31 fname_total: 34 hit_total: 45072 miss_total: 415 ls -l done rm -r /mnt/lustre/d123ad.sanity: 63 seconds llite.lustre-ffff9f51089a2000.statahead_stats= statahead total: 67 statahead wrong: 2 agl total: 61 list_total: 31 fname_total: 34 hit_total: 45072 miss_total: 415 mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356535.533813253 secs.nsecs start_time: 1763356329.689135914 secs.nsecs elapsed_time: 205.844677339 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 2 0 0 4: 3 0 1 8: 9 2 3 16: 205 57 61 32: 135 38 100 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356535.533858488 secs.nsecs start_time: 1763356329.689188733 secs.nsecs elapsed_time: 205.844669755 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 4 1 1 8: 6 1 2 16: 192 54 57 32: 152 42 100 - open/close 3882 (time 1763356546.98 total 10.00 last 388.14) - open/close 7162 (time 1763356556.99 total 20.00 last 327.91) total: 10000 open/close in 28.84 seconds: 346.78 ops/second llite.lustre-ffff9f51089a2000.statahead_batch_max=0 llite.lustre-ffff9f51089a2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f51089a2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9f51089a2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.077s user 0m0.124s sys 0m30.190s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f51089a2000.statahead_batch_max=32 llite.lustre-ffff9f51089a2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f51089a2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9f51089a2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.681s user 0m0.126s sys 0m18.644s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356636.261104534 secs.nsecs start_time: 1763356599.241562790 secs.nsecs elapsed_time: 37.019541744 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356636.261144623 secs.nsecs start_time: 1763356599.241617333 secs.nsecs elapsed_time: 37.019527290 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats=0 llite.lustre-ffff9f51089a2000.statahead_max=2048 llite.lustre-ffff9f51089a2000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.90 seconds: 111.33 ops/second llite.lustre-ffff9f51089a2000.statahead_max=0 101 real 0m0.786s user 0m0.004s sys 0m0.274s ls -l 100 files without statahead: 1 sec llite.lustre-ffff9f51089a2000.statahead_max=2048 2048 101 real 0m0.380s user 0m0.004s sys 0m0.242s ls -l 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 total: 900 open/close in 2.23 seconds: 404.36 ops/second llite.lustre-ffff9f51089a2000.statahead_max=0 1001 real 0m8.899s user 0m0.019s sys 0m2.954s ls -l 1000 files without statahead: 9 sec llite.lustre-ffff9f51089a2000.statahead_max=2048 2048 1001 real 0m3.014s user 0m0.018s sys 0m1.387s ls -l 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 - open/close 2232 (time 1763356767.26 total 10.00 last 223.15) total: 4000 open/close in 16.89 seconds: 236.85 ops/second llite.lustre-ffff9f51089a2000.statahead_max=0 5001 real 0m45.448s user 0m0.130s sys 0m14.996s ls -l 5000 files without statahead: 46 sec llite.lustre-ffff9f51089a2000.statahead_max=2048 2048 5001 real 0m12.882s user 0m0.067s sys 0m8.301s ls -l 5000 files with statahead: 13 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 ls -l done rm -r /mnt/lustre/d123ad.sanity: 39 seconds llite.lustre-ffff9f51089a2000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356880.975596405 secs.nsecs start_time: 1763356637.040177957 secs.nsecs elapsed_time: 243.935418448 secs.nsecs subreqs per batch batches % cum % 1: 42 56 56 2: 9 12 68 4: 7 9 78 8: 0 0 78 16: 0 0 78 32: 0 0 78 64: 0 0 78 128: 2 2 81 256: 14 18 100 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356880.975732772 secs.nsecs start_time: 1763356637.040289884 secs.nsecs elapsed_time: 243.935442888 secs.nsecs subreqs per batch batches % cum % 1: 39 54 54 2: 5 6 61 4: 4 5 66 8: 4 5 72 16: 0 0 72 32: 1 1 73 64: 3 4 77 128: 0 0 77 256: 16 22 100 - open/close 2293 (time 1763356892.18 total 10.00 last 229.28) - open/close 4758 (time 1763356902.18 total 20.01 last 246.39) - open/close 7298 (time 1763356912.19 total 30.01 last 253.92) - open/close 9493 (time 1763356922.19 total 40.01 last 219.49) total: 10000 open/close in 42.34 seconds: 236.20 ops/second llite.lustre-ffff9f51089a2000.statahead_batch_max=0 llite.lustre-ffff9f51089a2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f51089a2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9f51089a2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.088s user 0m0.127s sys 0m34.287s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f51089a2000.statahead_batch_max=256 llite.lustre-ffff9f51089a2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f51089a2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9f51089a2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.465s user 0m0.129s sys 0m19.237s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356999.786519006 secs.nsecs start_time: 1763356967.676518643 secs.nsecs elapsed_time: 32.110000363 secs.nsecs subreqs per batch batches % cum % 1: 204 57 57 2: 46 13 70 4: 36 10 81 8: 5 1 82 16: 1 0 82 32: 23 6 89 64: 3 0 90 128: 0 0 90 256: 35 9 100 mdc.lustre-MDT0001-mdc-ffff9f51089a2000.batch_stats= snapshot_time: 1763356999.786561016 secs.nsecs start_time: 1763356967.676571563 secs.nsecs elapsed_time: 32.109989453 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9f51089a2000.statahead_batch_max=64 llite.lustre-ffff9f51089a2000.statahead_max=128