== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:45:36 (1787438736) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats=0 llite.lustre-ffff9713f6326000.statahead_max=32 llite.lustre-ffff9713f6326000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats=0 total: 100 open/close in 3.29 seconds: 30.37 ops/second llite.lustre-ffff9713f6326000.statahead_max=0 101 real 0m2.432s user 0m0.004s sys 0m0.326s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9713f6326000.statahead_max=32 llite.lustre-ffff9713f6326000.statahead_max=32 101 real 0m2.055s user 0m0.003s sys 0m0.132s 'ls -l' 100 files with statahead: 2 sec statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 30 fname_total: 101 hit_total: 4527 miss_total: 1288 swrong=2 ewrong=2 - open/close 575 (time 1787438769.32 total 10.00 last 57.49) total: 900 open/close in 15.31 seconds: 58.80 ops/second llite.lustre-ffff9713f6326000.statahead_max=0 1001 real 0m22.123s user 0m0.043s sys 0m2.929s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9713f6326000.statahead_max=32 llite.lustre-ffff9713f6326000.statahead_max=32 1001 real 0m10.819s user 0m0.029s sys 0m1.293s 'ls -l' 1000 files with statahead: 11 sec statahead total: 144 statahead wrong: 2 agl total: 138 list_total: 31 fname_total: 101 hit_total: 5524 miss_total: 1291 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9713f6326000.statahead_stats= statahead total: 144 statahead wrong: 2 agl total: 138 list_total: 31 fname_total: 101 hit_total: 5524 miss_total: 1291 mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats= snapshot_time: 1787438844.513204313 secs.nsecs start_time: 1787438742.175442017 secs.nsecs elapsed_time: 102.337762296 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 670 (time 1787438857.48 total 10.01 last 66.94) - open/close 1389 (time 1787438867.49 total 20.02 last 71.82) - open/close 1992 (time 1787438877.50 total 30.03 last 60.24) - open/close 2595 (time 1787438887.52 total 40.05 last 60.18) - open/close 3282 (time 1787438897.53 total 50.06 last 68.64) - open/close 3859 (time 1787438907.53 total 60.06 last 57.68) - open/close 4339 (time 1787438917.53 total 70.06 last 47.99) - open/close 4825 (time 1787438927.54 total 80.07 last 48.57) - open/close 5360 (time 1787438937.54 total 90.07 last 53.49) - open/close 5936 (time 1787438947.55 total 100.08 last 57.52) - open/close 6599 (time 1787438957.57 total 110.10 last 66.19) - open/close 7090 (time 1787438967.57 total 120.10 last 49.09) - open/close 7516 (time 1787438977.58 total 130.11 last 42.56) - open/close 7899 (time 1787438987.59 total 140.12 last 38.28) - open/close 8327 (time 1787438997.60 total 150.13 last 42.73) - open/close 8813 (time 1787439007.60 total 160.14 last 48.59) - open/close 9563 (time 1787439017.63 total 170.16 last 74.79) total: 10000 open/close in 176.97 seconds: 56.51 ops/second llite.lustre-ffff9713f6326000.statahead_batch_max=0 llite.lustre-ffff9713f6326000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9713f6326000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.764s user 0m0.292s sys 0m13.372s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9713f6326000.statahead_batch_max=32 llite.lustre-ffff9713f6326000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9713f6326000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m50.681s user 0m0.290s sys 0m12.622s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats= snapshot_time: 1787439235.316402252 secs.nsecs start_time: 1787439112.581173927 secs.nsecs elapsed_time: 122.735228325 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats=0 llite.lustre-ffff9713f6326000.statahead_max=2048 llite.lustre-ffff9713f6326000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats=0 total: 100 open/close in 2.65 seconds: 37.75 ops/second llite.lustre-ffff9713f6326000.statahead_max=0 101 real 0m2.650s user 0m0.002s sys 0m0.364s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9713f6326000.statahead_max=2048 llite.lustre-ffff9713f6326000.statahead_max=2048 101 real 0m0.851s user 0m0.008s sys 0m0.167s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 - open/close 668 (time 1787439554.96 total 10.00 last 66.78) total: 900 open/close in 13.25 seconds: 67.92 ops/second llite.lustre-ffff9713f6326000.statahead_max=0 1001 real 0m30.739s user 0m0.046s sys 0m2.953s 'ls -l' 1000 files without statahead: 30 sec llite.lustre-ffff9713f6326000.statahead_max=2048 llite.lustre-ffff9713f6326000.statahead_max=2048 1001 real 0m5.074s user 0m0.017s sys 0m1.325s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 30 seconds llite.lustre-ffff9713f6326000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats= snapshot_time: 1787439638.830317351 secs.nsecs start_time: 1787439238.170275931 secs.nsecs elapsed_time: 400.660041420 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 712 (time 1787439651.92 total 10.01 last 71.15) - open/close 1374 (time 1787439661.95 total 20.03 last 66.03) - open/close 1907 (time 1787439671.96 total 30.05 last 53.22) - open/close 2550 (time 1787439681.97 total 40.05 last 64.27) - open/close 3086 (time 1787439691.97 total 50.06 last 53.56) - open/close 3491 (time 1787439701.98 total 60.06 last 40.49) - open/close 3804 (time 1787439711.99 total 70.07 last 31.27) - open/close 4267 (time 1787439722.00 total 80.09 last 46.22) - open/close 4788 (time 1787439732.01 total 90.10 last 52.07) - open/close 5403 (time 1787439742.02 total 100.11 last 61.44) - open/close 5934 (time 1787439752.02 total 110.11 last 53.07) - open/close 6338 (time 1787439762.04 total 120.13 last 40.33) - open/close 6924 (time 1787439772.06 total 130.15 last 58.48) - open/close 7490 (time 1787439782.07 total 140.16 last 56.54) - open/close 7994 (time 1787439792.08 total 150.17 last 50.36) - open/close 8671 (time 1787439802.09 total 160.18 last 67.63) - open/close 9269 (time 1787439812.10 total 170.19 last 59.73) total: 10000 open/close in 179.49 seconds: 55.71 ops/second llite.lustre-ffff9713f6326000.statahead_batch_max=0 llite.lustre-ffff9713f6326000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9713f6326000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.314s user 0m0.324s sys 0m13.348s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9713f6326000.statahead_batch_max=256 llite.lustre-ffff9713f6326000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9713f6326000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.376s user 0m0.282s sys 0m13.229s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9713f6326000.batch_stats= snapshot_time: 1787439962.080678965 secs.nsecs start_time: 1787439899.186943377 secs.nsecs elapsed_time: 62.893735588 secs.nsecs subreqs per batch batches %% cum %% 1: 37 26 26 2: 14 9 35 4: 14 9 45 8: 9 6 52 16: 13 9 61 32: 14 9 71 64: 3 2 73 128: 2 1 74 256: 36 25 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9713f6326000.statahead_batch_max=64 llite.lustre-ffff9713f6326000.statahead_max=128