== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:54:34 (1787799274) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats=0 llite.lustre-ffff9fd50a093800.statahead_max=32 llite.lustre-ffff9fd50a093800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats=0 total: 100 open/close in 2.95 seconds: 33.84 ops/second llite.lustre-ffff9fd50a093800.statahead_max=0 101 real 0m2.577s user 0m0.007s sys 0m0.324s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9fd50a093800.statahead_max=32 llite.lustre-ffff9fd50a093800.statahead_max=32 101 real 0m1.124s user 0m0.009s sys 0m0.152s 'ls -l' 100 files with statahead: 2 sec statahead total: 115 statahead wrong: 2 agl total: 109 list_total: 29 fname_total: 74 hit_total: 4028 miss_total: 1604 swrong=2 ewrong=2 - open/close 803 (time 1787799302.15 total 10.01 last 80.21) total: 900 open/close in 11.32 seconds: 79.52 ops/second llite.lustre-ffff9fd50a093800.statahead_max=0 1001 real 0m20.209s user 0m0.029s sys 0m2.873s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9fd50a093800.statahead_max=32 llite.lustre-ffff9fd50a093800.statahead_max=32 1001 real 0m10.435s user 0m0.020s sys 0m1.368s 'ls -l' 1000 files with statahead: 11 sec statahead total: 116 statahead wrong: 2 agl total: 110 list_total: 30 fname_total: 74 hit_total: 5026 miss_total: 1606 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9fd50a093800.statahead_stats= statahead total: 116 statahead wrong: 2 agl total: 110 list_total: 30 fname_total: 74 hit_total: 5026 miss_total: 1606 mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats= snapshot_time: 1787799370.647751766 secs.nsecs start_time: 1787799279.102064922 secs.nsecs elapsed_time: 91.545686844 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 678 (time 1787799384.68 total 10.00 last 67.77) - open/close 1387 (time 1787799394.68 total 20.00 last 70.90) - open/close 2137 (time 1787799404.69 total 30.01 last 74.96) - open/close 2941 (time 1787799414.70 total 40.03 last 80.24) - open/close 3712 (time 1787799424.71 total 50.03 last 77.06) - open/close 4506 (time 1787799434.72 total 60.04 last 79.34) - open/close 5292 (time 1787799444.72 total 70.04 last 78.60) - open/close 6083 (time 1787799454.72 total 80.05 last 79.07) - open/close 6887 (time 1787799464.73 total 90.05 last 80.36) - open/close 7653 (time 1787799474.74 total 100.07 last 76.47) - open/close 8425 (time 1787799484.74 total 110.07 last 77.20) - open/close 9203 (time 1787799494.75 total 120.07 last 77.78) - open/close 9927 (time 1787799504.76 total 130.08 last 72.30) total: 10000 open/close in 131.07 seconds: 76.30 ops/second llite.lustre-ffff9fd50a093800.statahead_batch_max=0 llite.lustre-ffff9fd50a093800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fd50a093800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.451s user 0m0.306s sys 0m13.924s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9fd50a093800.statahead_batch_max=32 llite.lustre-ffff9fd50a093800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9fd50a093800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m33.424s user 0m0.317s sys 0m13.214s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats= snapshot_time: 1787799679.467112111 secs.nsecs start_time: 1787799575.687152295 secs.nsecs elapsed_time: 103.779959816 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats=0 llite.lustre-ffff9fd50a093800.statahead_max=2048 llite.lustre-ffff9fd50a093800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats=0 total: 100 open/close in 2.85 seconds: 35.05 ops/second llite.lustre-ffff9fd50a093800.statahead_max=0 101 real 0m2.071s user 0m0.003s sys 0m0.299s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9fd50a093800.statahead_max=2048 llite.lustre-ffff9fd50a093800.statahead_max=2048 101 real 0m0.970s user 0m0.003s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 735 (time 1787799985.08 total 10.01 last 73.46) total: 900 open/close in 12.34 seconds: 72.95 ops/second llite.lustre-ffff9fd50a093800.statahead_max=0 1001 real 0m18.118s user 0m0.033s sys 0m2.809s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9fd50a093800.statahead_max=2048 llite.lustre-ffff9fd50a093800.statahead_max=2048 1001 real 0m6.078s user 0m0.030s sys 0m1.445s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9fd50a093800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats= snapshot_time: 1787800046.025130583 secs.nsecs start_time: 1787799681.671154025 secs.nsecs elapsed_time: 364.353976558 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 765 (time 1787800059.11 total 10.01 last 76.43) - open/close 1512 (time 1787800069.12 total 20.02 last 74.61) - open/close 2240 (time 1787800079.13 total 30.03 last 72.75) - open/close 3000 (time 1787800089.14 total 40.04 last 75.92) - open/close 3771 (time 1787800099.14 total 50.04 last 77.09) - open/close 4530 (time 1787800109.15 total 60.05 last 75.82) - open/close 5172 (time 1787800119.16 total 70.06 last 64.15) - open/close 5837 (time 1787800129.17 total 80.07 last 66.45) - open/close 6534 (time 1787800139.20 total 90.09 last 69.50) - open/close 7184 (time 1787800149.21 total 100.11 last 64.90) - open/close 7693 (time 1787800159.23 total 110.13 last 50.81) - open/close 8205 (time 1787800169.23 total 120.13 last 51.17) - open/close 8859 (time 1787800179.24 total 130.13 last 65.39) - open/close 9656 (time 1787800189.26 total 140.16 last 79.49) total: 10000 open/close in 144.71 seconds: 69.10 ops/second llite.lustre-ffff9fd50a093800.statahead_batch_max=0 llite.lustre-ffff9fd50a093800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fd50a093800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.713s user 0m0.316s sys 0m14.400s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9fd50a093800.statahead_batch_max=256 llite.lustre-ffff9fd50a093800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9fd50a093800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.845s user 0m0.302s sys 0m13.344s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9fd50a093800.batch_stats= snapshot_time: 1787800329.191632913 secs.nsecs start_time: 1787800261.849995374 secs.nsecs elapsed_time: 67.341637539 secs.nsecs subreqs per batch batches %% cum %% 1: 80 38 38 2: 32 15 54 4: 19 9 63 8: 10 4 68 16: 10 4 72 32: 16 7 80 64: 4 1 82 128: 1 0 83 256: 35 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9fd50a093800.statahead_batch_max=64 llite.lustre-ffff9fd50a093800.statahead_max=128