== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:50:13 (1781214613) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats=0 llite.lustre-ffff9790507ff000.statahead_max=32 llite.lustre-ffff9790507ff000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats=0 total: 100 open/close in 3.58 seconds: 27.93 ops/second llite.lustre-ffff9790507ff000.statahead_max=0 101 real 0m3.616s user 0m0.004s sys 0m0.320s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9790507ff000.statahead_max=32 llite.lustre-ffff9790507ff000.statahead_max=32 101 real 0m1.135s user 0m0.005s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 152 statahead wrong: 2 agl total: 146 list_total: 30 fname_total: 122 hit_total: 4574 miss_total: 1283 swrong=2 ewrong=2 - open/close 741 (time 1781214645.36 total 10.01 last 74.05) total: 900 open/close in 12.17 seconds: 73.93 ops/second llite.lustre-ffff9790507ff000.statahead_max=0 1001 real 0m19.214s user 0m0.036s sys 0m3.058s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9790507ff000.statahead_max=32 llite.lustre-ffff9790507ff000.statahead_max=32 1001 real 0m10.007s user 0m0.039s sys 0m1.494s 'ls -l' 1000 files with statahead: 10 sec statahead total: 153 statahead wrong: 2 agl total: 147 list_total: 31 fname_total: 122 hit_total: 5572 miss_total: 1285 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9790507ff000.statahead_stats= statahead total: 153 statahead wrong: 2 agl total: 147 list_total: 31 fname_total: 122 hit_total: 5572 miss_total: 1285 mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats= snapshot_time: 1781214709.830757434 secs.nsecs start_time: 1781214618.992450405 secs.nsecs elapsed_time: 90.838307029 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 836 (time 1781214722.31 total 10.00 last 83.58) - open/close 1626 (time 1781214732.33 total 20.02 last 78.89) - open/close 2529 (time 1781214742.34 total 30.02 last 90.23) - open/close 3415 (time 1781214752.34 total 40.03 last 88.54) - open/close 4141 (time 1781214762.36 total 50.05 last 72.49) - open/close 4957 (time 1781214772.37 total 60.05 last 81.54) - open/close 5764 (time 1781214782.37 total 70.05 last 80.70) - open/close 6470 (time 1781214792.37 total 80.06 last 70.57) - open/close 7127 (time 1781214802.38 total 90.06 last 65.67) - open/close 7847 (time 1781214812.38 total 100.07 last 71.94) - open/close 8650 (time 1781214822.39 total 110.07 last 80.29) - open/close 9425 (time 1781214832.39 total 120.07 last 77.49) total: 10000 open/close in 126.60 seconds: 78.99 ops/second llite.lustre-ffff9790507ff000.statahead_batch_max=0 llite.lustre-ffff9790507ff000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9790507ff000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.564s user 0m0.325s sys 0m15.302s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9790507ff000.statahead_batch_max=32 llite.lustre-ffff9790507ff000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9790507ff000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m56.578s user 0m0.296s sys 0m14.435s batched statahead RPC= hit count=9979 mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats= snapshot_time: 1781215056.152485640 secs.nsecs start_time: 1781214920.312037209 secs.nsecs elapsed_time: 135.840448431 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats=0 llite.lustre-ffff9790507ff000.statahead_max=2048 llite.lustre-ffff9790507ff000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats=0 total: 100 open/close in 3.55 seconds: 28.18 ops/second llite.lustre-ffff9790507ff000.statahead_max=0 101 real 0m1.858s user 0m0.008s sys 0m0.311s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9790507ff000.statahead_max=2048 llite.lustre-ffff9790507ff000.statahead_max=2048 101 real 0m1.254s user 0m0.004s sys 0m0.198s 'ls -l' 100 files with statahead: 2 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10078 miss_total: 22 swrong=0 ewrong=0 - open/close 828 (time 1781215370.35 total 10.00 last 82.78) total: 900 open/close in 10.99 seconds: 81.86 ops/second llite.lustre-ffff9790507ff000.statahead_max=0 1001 real 0m20.373s user 0m0.033s sys 0m3.068s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9790507ff000.statahead_max=2048 llite.lustre-ffff9790507ff000.statahead_max=2048 1001 real 0m7.428s user 0m0.031s sys 0m1.377s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9790507ff000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats= snapshot_time: 1781215436.783343202 secs.nsecs start_time: 1781215058.869916122 secs.nsecs elapsed_time: 377.913427080 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 1 10 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 701 (time 1781215449.74 total 10.00 last 70.09) - open/close 1537 (time 1781215459.74 total 20.00 last 83.58) - open/close 2328 (time 1781215469.74 total 30.01 last 79.04) - open/close 2878 (time 1781215479.75 total 40.02 last 54.96) - open/close 3773 (time 1781215489.76 total 50.03 last 89.40) - open/close 4647 (time 1781215499.77 total 60.04 last 87.34) - open/close 5477 (time 1781215509.80 total 70.07 last 82.74) - open/close 6215 (time 1781215519.80 total 80.07 last 73.77) - open/close 7034 (time 1781215529.82 total 90.08 last 81.81) - open/close 7801 (time 1781215539.83 total 100.10 last 76.60) - open/close 8577 (time 1781215549.83 total 110.10 last 77.60) - open/close 9600 (time 1781215559.83 total 120.10 last 102.27) total: 10000 open/close in 124.63 seconds: 80.24 ops/second llite.lustre-ffff9790507ff000.statahead_batch_max=0 llite.lustre-ffff9790507ff000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9790507ff000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.296s user 0m0.324s sys 0m15.340s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9790507ff000.statahead_batch_max=256 llite.lustre-ffff9790507ff000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9790507ff000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.125s user 0m0.304s sys 0m14.985s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9790507ff000.batch_stats= snapshot_time: 1781215715.580739108 secs.nsecs start_time: 1781215637.988516121 secs.nsecs elapsed_time: 77.592222987 secs.nsecs subreqs per batch batches % cum % 1: 152 47 47 2: 44 13 61 4: 41 12 73 8: 13 4 77 16: 11 3 81 32: 21 6 87 64: 5 1 89 128: 0 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9790507ff000.statahead_batch_max=64 llite.lustre-ffff9790507ff000.statahead_max=128