== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:24:12 (1781216652) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats=0 llite.lustre-ffff9a1dc3fd8000.statahead_max=32 llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats=0 total: 100 open/close in 2.45 seconds: 40.87 ops/second llite.lustre-ffff9a1dc3fd8000.statahead_max=0 101 real 0m1.808s user 0m0.003s sys 0m0.314s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a1dc3fd8000.statahead_max=32 llite.lustre-ffff9a1dc3fd8000.statahead_max=32 101 real 0m1.354s user 0m0.004s sys 0m0.182s 'ls -l' 100 files with statahead: 1 sec statahead total: 152 statahead wrong: 2 agl total: 146 list_total: 30 fname_total: 97 hit_total: 3927 miss_total: 1454 swrong=2 ewrong=2 - open/close 647 (time 1781216680.02 total 10.01 last 64.62) total: 900 open/close in 14.29 seconds: 62.98 ops/second llite.lustre-ffff9a1dc3fd8000.statahead_max=0 1001 real 0m19.302s user 0m0.030s sys 0m3.041s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9a1dc3fd8000.statahead_max=32 llite.lustre-ffff9a1dc3fd8000.statahead_max=32 1001 real 0m12.141s user 0m0.032s sys 0m1.690s 'ls -l' 1000 files with statahead: 13 sec statahead total: 153 statahead wrong: 2 agl total: 147 list_total: 31 fname_total: 97 hit_total: 4923 miss_total: 1458 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9a1dc3fd8000.statahead_stats= statahead total: 153 statahead wrong: 2 agl total: 147 list_total: 31 fname_total: 97 hit_total: 4923 miss_total: 1458 mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats= snapshot_time: 1781216754.449993249 secs.nsecs start_time: 1781216657.213631892 secs.nsecs elapsed_time: 97.236361357 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 844 (time 1781216767.50 total 10.01 last 84.33) - open/close 1666 (time 1781216777.51 total 20.01 last 82.15) - open/close 2404 (time 1781216787.52 total 30.03 last 73.69) - open/close 2981 (time 1781216797.52 total 40.03 last 57.70) - open/close 3792 (time 1781216807.53 total 50.03 last 81.09) - open/close 4699 (time 1781216817.53 total 60.03 last 90.67) - open/close 5478 (time 1781216827.55 total 70.05 last 77.75) - open/close 6372 (time 1781216837.55 total 80.06 last 89.36) - open/close 7097 (time 1781216847.56 total 90.07 last 72.43) - open/close 7802 (time 1781216857.57 total 100.07 last 70.48) - open/close 8470 (time 1781216867.59 total 110.09 last 66.66) - open/close 9217 (time 1781216877.60 total 120.10 last 74.60) total: 10000 open/close in 129.99 seconds: 76.93 ops/second llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=0 llite.lustre-ffff9a1dc3fd8000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m6.163s user 0m0.356s sys 0m15.598s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=32 llite.lustre-ffff9a1dc3fd8000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m48.493s user 0m0.333s sys 0m15.045s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats= snapshot_time: 1781217089.155089309 secs.nsecs start_time: 1781216965.360309050 secs.nsecs elapsed_time: 123.794780259 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats=0 llite.lustre-ffff9a1dc3fd8000.statahead_max=2048 llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats=0 total: 100 open/close in 2.73 seconds: 36.60 ops/second llite.lustre-ffff9a1dc3fd8000.statahead_max=0 101 real 0m2.292s user 0m0.004s sys 0m0.346s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a1dc3fd8000.statahead_max=2048 llite.lustre-ffff9a1dc3fd8000.statahead_max=2048 101 real 0m0.993s user 0m0.005s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 867 (time 1781217391.31 total 10.01 last 86.59) total: 900 open/close in 10.51 seconds: 85.62 ops/second llite.lustre-ffff9a1dc3fd8000.statahead_max=0 1001 real 0m18.923s user 0m0.028s sys 0m3.042s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9a1dc3fd8000.statahead_max=2048 llite.lustre-ffff9a1dc3fd8000.statahead_max=2048 1001 real 0m7.223s user 0m0.031s sys 0m1.427s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9a1dc3fd8000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats= snapshot_time: 1781217451.054588686 secs.nsecs start_time: 1781217092.174873770 secs.nsecs elapsed_time: 358.879714916 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 1 9 27 32: 2 18 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 832 (time 1781217463.36 total 10.00 last 83.17) - open/close 1485 (time 1781217473.38 total 20.02 last 65.22) - open/close 2244 (time 1781217483.38 total 30.02 last 75.89) - open/close 2892 (time 1781217493.38 total 40.02 last 64.78) - open/close 3571 (time 1781217503.41 total 50.05 last 67.71) - open/close 4371 (time 1781217513.41 total 60.05 last 79.98) - open/close 5161 (time 1781217523.41 total 70.05 last 78.99) - open/close 5992 (time 1781217533.41 total 80.06 last 83.06) - open/close 6779 (time 1781217543.43 total 90.07 last 78.56) - open/close 7547 (time 1781217553.44 total 100.08 last 76.74) - open/close 8209 (time 1781217563.46 total 110.10 last 66.06) - open/close 8797 (time 1781217573.50 total 120.14 last 58.59) - open/close 9440 (time 1781217583.51 total 130.15 last 64.21) total: 10000 open/close in 138.95 seconds: 71.97 ops/second llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=0 llite.lustre-ffff9a1dc3fd8000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.077s user 0m0.316s sys 0m15.796s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=256 llite.lustre-ffff9a1dc3fd8000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.779s user 0m0.342s sys 0m15.803s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a1dc3fd8000.batch_stats= snapshot_time: 1781217742.727877447 secs.nsecs start_time: 1781217662.063789252 secs.nsecs elapsed_time: 80.664088195 secs.nsecs subreqs per batch batches % cum % 1: 205 49 49 2: 67 16 66 4: 51 12 78 8: 19 4 83 16: 16 3 86 32: 15 3 90 64: 4 0 91 128: 1 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a1dc3fd8000.statahead_batch_max=64 llite.lustre-ffff9a1dc3fd8000.statahead_max=128