== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:16:20 (1787847380) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats=0 llite.lustre-ffff92e9d1a29000.statahead_max=32 llite.lustre-ffff92e9d1a29000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats=0 total: 100 open/close in 2.20 seconds: 45.52 ops/second llite.lustre-ffff92e9d1a29000.statahead_max=0 101 real 0m2.062s user 0m0.004s sys 0m0.291s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff92e9d1a29000.statahead_max=32 llite.lustre-ffff92e9d1a29000.statahead_max=32 101 real 0m1.016s user 0m0.006s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 118 statahead wrong: 2 agl total: 113 list_total: 29 fname_total: 89 hit_total: 4069 miss_total: 1270 swrong=2 ewrong=2 - open/close 802 (time 1787847404.50 total 10.01 last 80.13) total: 900 open/close in 11.28 seconds: 79.81 ops/second llite.lustre-ffff92e9d1a29000.statahead_max=0 1001 real 0m19.957s user 0m0.029s sys 0m2.719s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff92e9d1a29000.statahead_max=32 llite.lustre-ffff92e9d1a29000.statahead_max=32 1001 real 0m9.952s user 0m0.031s sys 0m1.339s 'ls -l' 1000 files with statahead: 10 sec statahead total: 119 statahead wrong: 2 agl total: 114 list_total: 30 fname_total: 89 hit_total: 5065 miss_total: 1274 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff92e9d1a29000.statahead_stats= statahead total: 119 statahead wrong: 2 agl total: 114 list_total: 30 fname_total: 89 hit_total: 5065 miss_total: 1274 mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats= snapshot_time: 1787847469.805884786 secs.nsecs start_time: 1787847383.946192744 secs.nsecs elapsed_time: 85.859692042 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 841 (time 1787847482.65 total 10.01 last 84.05) - open/close 1659 (time 1787847492.66 total 20.02 last 81.68) - open/close 2475 (time 1787847502.67 total 30.02 last 81.57) - open/close 3358 (time 1787847512.68 total 40.03 last 88.23) - open/close 4216 (time 1787847522.68 total 50.04 last 85.73) - open/close 4924 (time 1787847532.69 total 60.04 last 70.79) - open/close 5620 (time 1787847542.70 total 70.06 last 69.49) - open/close 6417 (time 1787847552.70 total 80.06 last 79.68) - open/close 7255 (time 1787847562.71 total 90.06 last 83.77) - open/close 8035 (time 1787847572.71 total 100.07 last 77.94) - open/close 8898 (time 1787847582.72 total 110.08 last 86.26) - open/close 9758 (time 1787847592.74 total 120.10 last 85.81) total: 10000 open/close in 122.88 seconds: 81.38 ops/second llite.lustre-ffff92e9d1a29000.statahead_batch_max=0 llite.lustre-ffff92e9d1a29000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.091s user 0m0.305s sys 0m14.125s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92e9d1a29000.statahead_batch_max=32 llite.lustre-ffff92e9d1a29000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m31.569s user 0m0.269s sys 0m12.929s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats= snapshot_time: 1787847764.828481420 secs.nsecs start_time: 1787847663.928811369 secs.nsecs elapsed_time: 100.899670051 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats=0 llite.lustre-ffff92e9d1a29000.statahead_max=2048 llite.lustre-ffff92e9d1a29000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats=0 total: 100 open/close in 2.89 seconds: 34.60 ops/second llite.lustre-ffff92e9d1a29000.statahead_max=0 101 real 0m1.624s user 0m0.006s sys 0m0.288s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff92e9d1a29000.statahead_max=2048 llite.lustre-ffff92e9d1a29000.statahead_max=2048 101 real 0m0.668s user 0m0.005s sys 0m0.152s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 - open/close 823 (time 1787848052.49 total 10.01 last 82.18) total: 900 open/close in 11.73 seconds: 76.76 ops/second llite.lustre-ffff92e9d1a29000.statahead_max=0 1001 real 0m24.440s user 0m0.033s sys 0m2.842s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff92e9d1a29000.statahead_max=2048 llite.lustre-ffff92e9d1a29000.statahead_max=2048 1001 real 0m7.207s user 0m0.031s sys 0m1.315s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff92e9d1a29000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats= snapshot_time: 1787848120.338951154 secs.nsecs start_time: 1787847767.099967660 secs.nsecs elapsed_time: 353.238983494 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 3 25 58 64: 1 8 66 128: 0 0 66 256: 4 33 100 - open/close 762 (time 1787848133.17 total 10.00 last 76.18) - open/close 1579 (time 1787848143.18 total 20.01 last 81.61) - open/close 2340 (time 1787848153.19 total 30.02 last 76.03) - open/close 3124 (time 1787848163.19 total 40.02 last 78.39) - open/close 3826 (time 1787848173.20 total 50.03 last 70.15) - open/close 4486 (time 1787848183.20 total 60.04 last 65.96) - open/close 5195 (time 1787848193.21 total 70.05 last 70.82) - open/close 6066 (time 1787848203.22 total 80.05 last 87.04) - open/close 6908 (time 1787848213.23 total 90.06 last 84.11) - open/close 7581 (time 1787848223.23 total 100.07 last 67.28) - open/close 8314 (time 1787848233.23 total 110.07 last 73.29) - open/close 9093 (time 1787848243.24 total 120.07 last 77.86) - open/close 9859 (time 1787848253.25 total 130.09 last 76.52) total: 10000 open/close in 131.83 seconds: 75.86 ops/second llite.lustre-ffff92e9d1a29000.statahead_batch_max=0 llite.lustre-ffff92e9d1a29000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.484s user 0m0.274s sys 0m14.065s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92e9d1a29000.statahead_batch_max=256 llite.lustre-ffff92e9d1a29000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.807s user 0m0.280s sys 0m14.153s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff92e9d1a29000.batch_stats= snapshot_time: 1787848376.099913831 secs.nsecs start_time: 1787848318.169180949 secs.nsecs elapsed_time: 57.930732882 secs.nsecs subreqs per batch batches %% cum %% 1: 151 44 44 2: 55 16 61 4: 38 11 72 8: 17 5 77 16: 17 5 82 32: 20 5 88 64: 4 1 89 128: 0 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff92e9d1a29000.statahead_batch_max=64 llite.lustre-ffff92e9d1a29000.statahead_max=128