== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:16:07 (1787393767) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats=0 llite.lustre-ffff9b0148704800.statahead_max=32 llite.lustre-ffff9b0148704800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats=0 total: 100 open/close in 2.22 seconds: 44.96 ops/second llite.lustre-ffff9b0148704800.statahead_max=0 101 real 0m2.788s user 0m0.003s sys 0m0.337s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9b0148704800.statahead_max=32 llite.lustre-ffff9b0148704800.statahead_max=32 101 real 0m1.008s user 0m0.004s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 64 hit_total: 3553 miss_total: 1741 swrong=2 ewrong=2 - open/close 740 (time 1787393794.64 total 10.06 last 73.56) total: 900 open/close in 13.78 seconds: 65.30 ops/second llite.lustre-ffff9b0148704800.statahead_max=0 1001 real 0m21.123s user 0m0.036s sys 0m2.868s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9b0148704800.statahead_max=32 llite.lustre-ffff9b0148704800.statahead_max=32 1001 real 0m10.489s user 0m0.023s sys 0m1.532s 'ls -l' 1000 files with statahead: 11 sec statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 64 hit_total: 4549 miss_total: 1745 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff9b0148704800.statahead_stats= statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 64 hit_total: 4549 miss_total: 1745 mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats= snapshot_time: 1787393862.345205531 secs.nsecs start_time: 1787393771.693493740 secs.nsecs elapsed_time: 90.651711791 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 820 (time 1787393874.48 total 10.01 last 81.93) - open/close 1669 (time 1787393884.48 total 20.01 last 84.88) - open/close 2534 (time 1787393894.49 total 30.02 last 86.45) - open/close 3427 (time 1787393904.50 total 40.03 last 89.18) - open/close 4233 (time 1787393914.52 total 50.05 last 80.46) - open/close 5076 (time 1787393924.52 total 60.05 last 84.30) - open/close 6007 (time 1787393934.52 total 70.05 last 93.06) - open/close 6750 (time 1787393944.53 total 80.06 last 74.25) - open/close 7500 (time 1787393954.53 total 90.06 last 74.96) - open/close 8388 (time 1787393964.55 total 100.08 last 88.64) - open/close 9305 (time 1787393974.56 total 110.09 last 91.63) total: 10000 open/close in 117.93 seconds: 84.80 ops/second llite.lustre-ffff9b0148704800.statahead_batch_max=0 llite.lustre-ffff9b0148704800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b0148704800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.499s user 0m0.302s sys 0m15.475s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9b0148704800.statahead_batch_max=32 llite.lustre-ffff9b0148704800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9b0148704800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m36.771s user 0m0.277s sys 0m14.261s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats= snapshot_time: 1787394167.886777834 secs.nsecs start_time: 1787394056.802254667 secs.nsecs elapsed_time: 111.084523167 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats=0 llite.lustre-ffff9b0148704800.statahead_max=2048 llite.lustre-ffff9b0148704800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats=0 total: 100 open/close in 2.68 seconds: 37.37 ops/second llite.lustre-ffff9b0148704800.statahead_max=0 101 real 0m1.685s user 0m0.005s sys 0m0.318s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9b0148704800.statahead_max=2048 llite.lustre-ffff9b0148704800.statahead_max=2048 101 real 0m1.253s user 0m0.004s sys 0m0.184s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 total: 900 open/close in 9.31 seconds: 96.67 ops/second llite.lustre-ffff9b0148704800.statahead_max=0 1001 real 0m18.985s user 0m0.032s sys 0m3.116s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9b0148704800.statahead_max=2048 llite.lustre-ffff9b0148704800.statahead_max=2048 1001 real 0m7.837s user 0m0.029s sys 0m1.424s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9b0148704800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats= snapshot_time: 1787394528.460147646 secs.nsecs start_time: 1787394170.670358974 secs.nsecs elapsed_time: 357.789788672 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 622 (time 1787394540.83 total 10.01 last 62.13) - open/close 1506 (time 1787394550.84 total 20.02 last 88.31) - open/close 2371 (time 1787394560.84 total 30.03 last 86.46) - open/close 3165 (time 1787394570.85 total 40.03 last 79.37) - open/close 3964 (time 1787394580.86 total 50.04 last 79.79) - open/close 4726 (time 1787394590.86 total 60.05 last 76.19) - open/close 5498 (time 1787394600.89 total 70.07 last 77.01) - open/close 6314 (time 1787394610.90 total 80.08 last 81.48) - open/close 7136 (time 1787394620.92 total 90.10 last 82.08) - open/close 7977 (time 1787394630.92 total 100.10 last 84.05) - open/close 8773 (time 1787394640.92 total 110.10 last 79.60) - open/close 9578 (time 1787394650.93 total 120.11 last 80.44) total: 10000 open/close in 126.22 seconds: 79.23 ops/second llite.lustre-ffff9b0148704800.statahead_batch_max=0 llite.lustre-ffff9b0148704800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b0148704800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.690s user 0m0.311s sys 0m15.728s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9b0148704800.statahead_batch_max=256 llite.lustre-ffff9b0148704800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9b0148704800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.178s user 0m0.281s sys 0m15.472s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9b0148704800.batch_stats= snapshot_time: 1787394804.535289992 secs.nsecs start_time: 1787394727.499670066 secs.nsecs elapsed_time: 77.035619926 secs.nsecs subreqs per batch batches %% cum %% 1: 261 51 51 2: 79 15 66 4: 55 10 77 8: 34 6 84 16: 29 5 90 32: 14 2 92 64: 3 0 93 128: 0 0 93 256: 33 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9b0148704800.statahead_batch_max=64 llite.lustre-ffff9b0148704800.statahead_max=128