== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:26:09 (1781223969) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats=0 llite.lustre-ffff966b585b7800.statahead_max=32 llite.lustre-ffff966b585b7800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats=0 total: 100 open/close in 3.58 seconds: 27.90 ops/second llite.lustre-ffff966b585b7800.statahead_max=0 101 real 0m3.923s user 0m0.010s sys 0m0.418s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff966b585b7800.statahead_max=32 llite.lustre-ffff966b585b7800.statahead_max=32 101 real 0m1.714s user 0m0.007s sys 0m0.200s 'ls -l' 100 files with statahead: 1 sec statahead total: 139 statahead wrong: 2 agl total: 133 list_total: 31 fname_total: 96 hit_total: 4041 miss_total: 1426 swrong=2 ewrong=2 - open/close 571 (time 1781224004.03 total 10.01 last 57.05) total: 900 open/close in 16.26 seconds: 55.36 ops/second llite.lustre-ffff966b585b7800.statahead_max=0 1001 real 0m30.410s user 0m0.043s sys 0m3.744s 'ls -l' 1000 files without statahead: 30 sec llite.lustre-ffff966b585b7800.statahead_max=32 llite.lustre-ffff966b585b7800.statahead_max=32 1001 real 0m10.966s user 0m0.041s sys 0m1.781s 'ls -l' 1000 files with statahead: 11 sec statahead total: 140 statahead wrong: 2 agl total: 134 list_total: 32 fname_total: 96 hit_total: 5040 miss_total: 1427 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 27 seconds llite.lustre-ffff966b585b7800.statahead_stats= statahead total: 140 statahead wrong: 2 agl total: 134 list_total: 32 fname_total: 96 hit_total: 5040 miss_total: 1427 mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats= snapshot_time: 1781224094.668285691 secs.nsecs start_time: 1781223975.307130802 secs.nsecs elapsed_time: 119.361154889 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 503 (time 1781224107.45 total 10.02 last 50.21) - open/close 965 (time 1781224117.46 total 20.02 last 46.19) - open/close 1394 (time 1781224127.47 total 30.04 last 42.82) - open/close 1898 (time 1781224137.49 total 40.06 last 50.30) - open/close 2440 (time 1781224147.50 total 50.07 last 54.17) - open/close 3046 (time 1781224157.51 total 60.08 last 60.53) - open/close 3607 (time 1781224167.51 total 70.08 last 56.09) - open/close 4143 (time 1781224177.52 total 80.08 last 53.57) - open/close 4725 (time 1781224187.52 total 90.09 last 58.18) - open/close 5269 (time 1781224197.54 total 100.11 last 54.29) - open/close 5860 (time 1781224207.56 total 110.12 last 59.01) - open/close 6458 (time 1781224217.57 total 120.14 last 59.71) - open/close 7046 (time 1781224227.58 total 130.14 last 58.77) - open/close 7699 (time 1781224237.59 total 140.16 last 65.20) - open/close 8245 (time 1781224247.60 total 150.16 last 54.58) - open/close 8811 (time 1781224257.60 total 160.17 last 56.55) - open/close 9314 (time 1781224267.62 total 170.19 last 50.22) - open/close 9881 (time 1781224277.66 total 180.22 last 56.48) total: 10000 open/close in 182.88 seconds: 54.68 ops/second llite.lustre-ffff966b585b7800.statahead_batch_max=0 llite.lustre-ffff966b585b7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff966b585b7800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m17.078s user 0m0.412s sys 0m18.135s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff966b585b7800.statahead_batch_max=32 llite.lustre-ffff966b585b7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff966b585b7800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m15.703s user 0m0.374s sys 0m16.869s batched statahead RPC= hit count=9974 mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats= snapshot_time: 1781224526.204656154 secs.nsecs start_time: 1781224371.443786832 secs.nsecs elapsed_time: 154.760869322 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats=0 llite.lustre-ffff966b585b7800.statahead_max=2048 llite.lustre-ffff966b585b7800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats=0 total: 100 open/close in 4.26 seconds: 23.50 ops/second llite.lustre-ffff966b585b7800.statahead_max=0 101 real 0m2.912s user 0m0.005s sys 0m0.407s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff966b585b7800.statahead_max=2048 llite.lustre-ffff966b585b7800.statahead_max=2048 101 real 0m1.169s user 0m0.009s sys 0m0.230s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10073 miss_total: 27 swrong=0 ewrong=0 - open/close 615 (time 1781224931.84 total 10.00 last 61.47) total: 900 open/close in 14.65 seconds: 61.44 ops/second llite.lustre-ffff966b585b7800.statahead_max=0 1001 real 0m28.250s user 0m0.043s sys 0m3.490s 'ls -l' 1000 files without statahead: 28 sec llite.lustre-ffff966b585b7800.statahead_max=2048 llite.lustre-ffff966b585b7800.statahead_max=2048 1001 real 0m10.356s user 0m0.029s sys 0m1.646s 'ls -l' 1000 files with statahead: 11 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11072 miss_total: 28 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 32 seconds llite.lustre-ffff966b585b7800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11072 miss_total: 28 mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats= snapshot_time: 1781225024.662187580 secs.nsecs start_time: 1781224528.690319409 secs.nsecs elapsed_time: 495.971868171 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 511 (time 1781225037.62 total 10.02 last 50.99) - open/close 1094 (time 1781225047.63 total 20.03 last 58.25) - open/close 1662 (time 1781225057.64 total 30.04 last 56.76) - open/close 2219 (time 1781225067.65 total 40.05 last 55.62) - open/close 2769 (time 1781225077.66 total 50.06 last 54.97) - open/close 3296 (time 1781225087.67 total 60.07 last 52.64) - open/close 3825 (time 1781225097.67 total 70.07 last 52.88) - open/close 4363 (time 1781225107.70 total 80.09 last 53.67) - open/close 4880 (time 1781225117.70 total 90.10 last 51.69) - open/close 5389 (time 1781225127.70 total 100.10 last 50.90) - open/close 5940 (time 1781225137.71 total 110.11 last 55.05) - open/close 6436 (time 1781225147.75 total 120.14 last 49.42) - open/close 6955 (time 1781225157.75 total 130.15 last 51.87) - open/close 7446 (time 1781225167.76 total 140.16 last 49.06) - open/close 7922 (time 1781225177.76 total 150.16 last 47.59) - open/close 8372 (time 1781225187.79 total 160.18 last 44.89) - open/close 8860 (time 1781225197.79 total 170.19 last 48.79) - open/close 9319 (time 1781225207.82 total 180.22 last 45.77) - open/close 9857 (time 1781225217.82 total 190.22 last 53.80) total: 10000 open/close in 192.87 seconds: 51.85 ops/second llite.lustre-ffff966b585b7800.statahead_batch_max=0 llite.lustre-ffff966b585b7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff966b585b7800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m17.080s user 0m0.402s sys 0m18.584s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff966b585b7800.statahead_batch_max=256 llite.lustre-ffff966b585b7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff966b585b7800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.685s user 0m0.346s sys 0m17.601s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff966b585b7800.batch_stats= snapshot_time: 1781225390.626183320 secs.nsecs start_time: 1781225310.327836544 secs.nsecs elapsed_time: 80.298346776 secs.nsecs subreqs per batch batches % cum % 1: 195 53 53 2: 45 12 66 4: 32 8 74 8: 20 5 80 16: 14 3 84 32: 19 5 89 64: 3 0 90 128: 1 0 90 256: 34 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff966b585b7800.statahead_batch_max=64 llite.lustre-ffff966b585b7800.statahead_max=128