== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:37:18 (1784345838) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats=0 llite.lustre-ffff92b14490a800.statahead_max=32 llite.lustre-ffff92b14490a800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats=0 total: 100 open/close in 2.16 seconds: 46.23 ops/second llite.lustre-ffff92b14490a800.statahead_max=0 101 real 0m1.881s user 0m0.002s sys 0m0.321s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff92b14490a800.statahead_max=32 llite.lustre-ffff92b14490a800.statahead_max=32 101 real 0m0.719s user 0m0.004s sys 0m0.190s 'ls -l' 100 files with statahead: 1 sec statahead total: 53 statahead wrong: 2 agl total: 49 list_total: 25 fname_total: 28 hit_total: 14550 miss_total: 1226 swrong=2 ewrong=2 - open/close 804 (time 1784345861.03 total 10.00 last 80.39) total: 900 open/close in 11.22 seconds: 80.25 ops/second llite.lustre-ffff92b14490a800.statahead_max=0 1001 real 0m18.725s user 0m0.030s sys 0m3.113s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff92b14490a800.statahead_max=32 llite.lustre-ffff92b14490a800.statahead_max=32 1001 real 0m7.434s user 0m0.031s sys 0m1.723s 'ls -l' 1000 files with statahead: 7 sec statahead total: 54 statahead wrong: 2 agl total: 50 list_total: 26 fname_total: 28 hit_total: 15546 miss_total: 1230 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff92b14490a800.statahead_stats= statahead total: 54 statahead wrong: 2 agl total: 50 list_total: 26 fname_total: 28 hit_total: 15546 miss_total: 1230 mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats= snapshot_time: 1784345914.608098029 secs.nsecs start_time: 1784345841.936500044 secs.nsecs elapsed_time: 72.671597985 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 897 (time 1784345926.46 total 10.00 last 89.70) - open/close 1768 (time 1784345936.47 total 20.01 last 86.99) - open/close 2621 (time 1784345946.47 total 30.01 last 85.29) - open/close 3443 (time 1784345956.47 total 40.02 last 82.17) - open/close 4330 (time 1784345966.48 total 50.02 last 88.68) - open/close 5185 (time 1784345976.49 total 60.03 last 85.42) - open/close 6017 (time 1784345986.49 total 70.03 last 83.20) - open/close 6899 (time 1784345996.49 total 80.03 last 88.15) - open/close 7810 (time 1784346006.49 total 90.04 last 91.08) - open/close 8645 (time 1784346016.50 total 100.05 last 83.42) - open/close 9586 (time 1784346026.51 total 110.05 last 94.06) total: 10000 open/close in 114.94 seconds: 87.00 ops/second llite.lustre-ffff92b14490a800.statahead_batch_max=0 llite.lustre-ffff92b14490a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92b14490a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.766s user 0m0.317s sys 0m20.962s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92b14490a800.statahead_batch_max=32 llite.lustre-ffff92b14490a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92b14490a800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.220s user 0m0.280s sys 0m16.527s batched statahead RPC= hit count=9989 mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats= snapshot_time: 1784346163.068634011 secs.nsecs start_time: 1784346084.892022579 secs.nsecs elapsed_time: 78.176611432 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats=0 llite.lustre-ffff92b14490a800.statahead_max=2048 llite.lustre-ffff92b14490a800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats=0 total: 100 open/close in 1.59 seconds: 62.86 ops/second llite.lustre-ffff92b14490a800.statahead_max=0 101 real 0m1.555s user 0m0.006s sys 0m0.324s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff92b14490a800.statahead_max=2048 llite.lustre-ffff92b14490a800.statahead_max=2048 101 real 0m0.517s user 0m0.004s sys 0m0.199s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10088 miss_total: 12 swrong=0 ewrong=0 total: 900 open/close in 7.94 seconds: 113.41 ops/second llite.lustre-ffff92b14490a800.statahead_max=0 1001 real 0m14.509s user 0m0.026s sys 0m2.920s 'ls -l' 1000 files without statahead: 14 sec llite.lustre-ffff92b14490a800.statahead_max=2048 llite.lustre-ffff92b14490a800.statahead_max=2048 1001 real 0m4.383s user 0m0.020s sys 0m1.532s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11087 miss_total: 13 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff92b14490a800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11087 miss_total: 13 mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats= snapshot_time: 1784346430.027164407 secs.nsecs start_time: 1784346164.974778807 secs.nsecs elapsed_time: 265.052385600 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 1139 (time 1784346441.66 total 10.00 last 113.86) - open/close 2299 (time 1784346451.67 total 20.01 last 115.90) - open/close 3423 (time 1784346461.68 total 30.02 last 112.37) - open/close 4627 (time 1784346471.68 total 40.02 last 120.30) - open/close 5836 (time 1784346481.69 total 50.02 last 120.89) - open/close 7168 (time 1784346491.69 total 60.03 last 133.19) - open/close 8452 (time 1784346501.69 total 70.03 last 128.31) - open/close 9709 (time 1784346511.70 total 80.04 last 125.63) total: 10000 open/close in 82.01 seconds: 121.93 ops/second llite.lustre-ffff92b14490a800.statahead_batch_max=0 llite.lustre-ffff92b14490a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92b14490a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.419s user 0m0.256s sys 0m25.191s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92b14490a800.statahead_batch_max=256 llite.lustre-ffff92b14490a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92b14490a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.694s user 0m0.238s sys 0m20.360s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff92b14490a800.batch_stats= snapshot_time: 1784346594.763251969 secs.nsecs start_time: 1784346553.382707521 secs.nsecs elapsed_time: 41.380544448 secs.nsecs subreqs per batch batches %% cum %% 1: 306 61 61 2: 76 15 77 4: 36 7 84 8: 15 3 87 16: 8 1 89 32: 15 3 92 64: 5 1 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff92b14490a800.statahead_batch_max=64 llite.lustre-ffff92b14490a800.statahead_max=128