== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:11:34 (1786831894) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats=0 llite.lustre-ffff987b58398800.statahead_max=32 llite.lustre-ffff987b58398800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats=0 total: 100 open/close in 3.14 seconds: 31.89 ops/second llite.lustre-ffff987b58398800.statahead_max=0 101 real 0m2.637s user 0m0.011s sys 0m0.374s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff987b58398800.statahead_max=32 llite.lustre-ffff987b58398800.statahead_max=32 101 real 0m1.173s user 0m0.002s sys 0m0.200s 'ls -l' 100 files with statahead: 1 sec statahead total: 128 statahead wrong: 2 agl total: 122 list_total: 30 fname_total: 98 hit_total: 3904 miss_total: 1539 swrong=2 ewrong=2 - open/close 584 (time 1786831923.63 total 10.01 last 58.34) total: 900 open/close in 15.78 seconds: 57.05 ops/second llite.lustre-ffff987b58398800.statahead_max=0 1001 real 0m23.668s user 0m0.049s sys 0m3.389s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff987b58398800.statahead_max=32 llite.lustre-ffff987b58398800.statahead_max=32 1001 real 0m11.909s user 0m0.032s sys 0m1.676s 'ls -l' 1000 files with statahead: 11 sec statahead total: 129 statahead wrong: 2 agl total: 123 list_total: 31 fname_total: 98 hit_total: 4903 miss_total: 1540 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff987b58398800.statahead_stats= statahead total: 129 statahead wrong: 2 agl total: 123 list_total: 31 fname_total: 98 hit_total: 4903 miss_total: 1540 mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats= snapshot_time: 1786832004.722746312 secs.nsecs start_time: 1786831899.916148944 secs.nsecs elapsed_time: 104.806597368 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 723 (time 1786832017.29 total 10.01 last 72.22) - open/close 1401 (time 1786832027.30 total 20.02 last 67.75) - open/close 2115 (time 1786832037.31 total 30.03 last 71.34) - open/close 2740 (time 1786832047.32 total 40.04 last 62.42) - open/close 3322 (time 1786832057.33 total 50.05 last 58.15) - open/close 3910 (time 1786832067.33 total 60.05 last 58.76) - open/close 4526 (time 1786832077.34 total 70.06 last 61.55) - open/close 5180 (time 1786832087.35 total 80.08 last 65.32) - open/close 5840 (time 1786832097.36 total 90.08 last 65.96) - open/close 6499 (time 1786832107.37 total 100.10 last 65.80) - open/close 7234 (time 1786832117.38 total 110.10 last 73.43) - open/close 7882 (time 1786832127.39 total 120.11 last 64.74) - open/close 8506 (time 1786832137.41 total 130.13 last 62.31) - open/close 9105 (time 1786832147.41 total 140.13 last 59.89) - open/close 9715 (time 1786832157.43 total 150.16 last 60.85) total: 10000 open/close in 156.81 seconds: 63.77 ops/second llite.lustre-ffff987b58398800.statahead_batch_max=0 llite.lustre-ffff987b58398800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987b58398800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m13.937s user 0m0.375s sys 0m16.362s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff987b58398800.statahead_batch_max=32 llite.lustre-ffff987b58398800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff987b58398800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m50.949s user 0m0.349s sys 0m16.736s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats= snapshot_time: 1786832382.220691180 secs.nsecs start_time: 1786832253.550085613 secs.nsecs elapsed_time: 128.670605567 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats=0 llite.lustre-ffff987b58398800.statahead_max=2048 llite.lustre-ffff987b58398800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats=0 total: 100 open/close in 3.52 seconds: 28.42 ops/second llite.lustre-ffff987b58398800.statahead_max=0 101 real 0m3.223s user 0m0.003s sys 0m0.353s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff987b58398800.statahead_max=2048 llite.lustre-ffff987b58398800.statahead_max=2048 101 real 0m0.710s user 0m0.005s sys 0m0.191s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 662 (time 1786832722.21 total 10.00 last 66.19) total: 900 open/close in 13.39 seconds: 67.19 ops/second llite.lustre-ffff987b58398800.statahead_max=0 1001 real 0m19.663s user 0m0.031s sys 0m3.218s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff987b58398800.statahead_max=2048 llite.lustre-ffff987b58398800.statahead_max=2048 1001 real 0m7.048s user 0m0.041s sys 0m1.700s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff987b58398800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats= snapshot_time: 1786832785.408032999 secs.nsecs start_time: 1786832384.721097881 secs.nsecs elapsed_time: 400.686935118 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 3 25 58 64: 1 8 66 128: 0 0 66 256: 4 33 100 - open/close 762 (time 1786832797.74 total 10.01 last 76.14) - open/close 1390 (time 1786832807.75 total 20.02 last 62.73) - open/close 2071 (time 1786832817.77 total 30.03 last 67.99) - open/close 2659 (time 1786832827.78 total 40.05 last 58.73) - open/close 3382 (time 1786832837.79 total 50.05 last 72.24) - open/close 4075 (time 1786832847.79 total 60.06 last 69.27) - open/close 4741 (time 1786832857.80 total 70.06 last 66.58) - open/close 5240 (time 1786832867.80 total 80.07 last 49.86) - open/close 5758 (time 1786832877.82 total 90.08 last 51.73) - open/close 6436 (time 1786832887.84 total 100.10 last 67.68) - open/close 7125 (time 1786832897.84 total 110.10 last 68.87) - open/close 7862 (time 1786832907.85 total 120.11 last 73.62) - open/close 8520 (time 1786832917.87 total 130.13 last 65.69) - open/close 9272 (time 1786832927.89 total 140.15 last 75.03) total: 10000 open/close in 149.92 seconds: 66.70 ops/second llite.lustre-ffff987b58398800.statahead_batch_max=0 llite.lustre-ffff987b58398800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987b58398800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.177s user 0m0.326s sys 0m15.353s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff987b58398800.statahead_batch_max=256 llite.lustre-ffff987b58398800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff987b58398800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.961s user 0m0.301s sys 0m16.372s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff987b58398800.batch_stats= snapshot_time: 1786833089.647636019 secs.nsecs start_time: 1786833019.293632732 secs.nsecs elapsed_time: 70.354003287 secs.nsecs subreqs per batch batches %% cum %% 1: 264 58 58 2: 51 11 70 4: 35 7 77 8: 32 7 84 16: 17 3 88 32: 15 3 92 64: 2 0 92 128: 0 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff987b58398800.statahead_batch_max=64 llite.lustre-ffff987b58398800.statahead_max=128