== sanity test 123ad: Verify batching statahead works correctly ========================================================== 15:31:27 (1782761487) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats=0 llite.lustre-ffff978ec9e43000.statahead_max=32 llite.lustre-ffff978ec9e43000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats=0 total: 100 open/close in 2.30 seconds: 43.44 ops/second llite.lustre-ffff978ec9e43000.statahead_max=0 101 real 0m1.795s user 0m0.001s sys 0m0.328s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff978ec9e43000.statahead_max=32 llite.lustre-ffff978ec9e43000.statahead_max=32 101 real 0m1.034s user 0m0.004s sys 0m0.158s 'ls -l' 100 files with statahead: 1 sec statahead total: 89 statahead wrong: 2 agl total: 85 list_total: 29 fname_total: 60 hit_total: 4008 miss_total: 1607 swrong=2 ewrong=2 - open/close 790 (time 1782761514.24 total 10.00 last 78.99) total: 900 open/close in 11.64 seconds: 77.34 ops/second llite.lustre-ffff978ec9e43000.statahead_max=0 1001 real 0m20.525s user 0m0.033s sys 0m3.038s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff978ec9e43000.statahead_max=32 llite.lustre-ffff978ec9e43000.statahead_max=32 1001 real 0m11.180s user 0m0.033s sys 0m1.554s 'ls -l' 1000 files with statahead: 11 sec statahead total: 90 statahead wrong: 2 agl total: 86 list_total: 30 fname_total: 60 hit_total: 5006 miss_total: 1609 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff978ec9e43000.statahead_stats= statahead total: 90 statahead wrong: 2 agl total: 86 list_total: 30 fname_total: 60 hit_total: 5006 miss_total: 1609 mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats= snapshot_time: 1782761584.083737739 secs.nsecs start_time: 1782761492.877972003 secs.nsecs elapsed_time: 91.205765736 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 644 (time 1782761596.51 total 10.03 last 64.23) - open/close 1338 (time 1782761606.52 total 20.04 last 69.34) - open/close 2048 (time 1782761616.52 total 30.04 last 70.99) - open/close 2848 (time 1782761626.53 total 40.05 last 79.87) - open/close 3495 (time 1782761636.54 total 50.06 last 64.65) - open/close 4228 (time 1782761646.55 total 60.07 last 73.25) - open/close 5018 (time 1782761656.55 total 70.07 last 78.95) - open/close 5836 (time 1782761666.57 total 80.08 last 81.71) - open/close 6674 (time 1782761676.57 total 90.09 last 83.77) - open/close 7462 (time 1782761686.58 total 100.10 last 78.72) - open/close 8352 (time 1782761696.58 total 110.10 last 88.94) - open/close 9074 (time 1782761706.59 total 120.11 last 72.14) - open/close 9816 (time 1782761716.60 total 130.12 last 74.15) total: 10000 open/close in 132.16 seconds: 75.67 ops/second llite.lustre-ffff978ec9e43000.statahead_batch_max=0 llite.lustre-ffff978ec9e43000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff978ec9e43000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.400s user 0m0.330s sys 0m15.095s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff978ec9e43000.statahead_batch_max=32 llite.lustre-ffff978ec9e43000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff978ec9e43000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m49.669s user 0m0.312s sys 0m14.729s batched statahead RPC= hit count=9980 mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats= snapshot_time: 1782761914.271693635 secs.nsecs start_time: 1782761791.692432319 secs.nsecs elapsed_time: 122.579261316 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats=0 llite.lustre-ffff978ec9e43000.statahead_max=2048 llite.lustre-ffff978ec9e43000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats=0 total: 100 open/close in 2.90 seconds: 34.45 ops/second llite.lustre-ffff978ec9e43000.statahead_max=0 101 real 0m2.140s user 0m0.004s sys 0m0.320s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff978ec9e43000.statahead_max=2048 llite.lustre-ffff978ec9e43000.statahead_max=2048 101 real 0m0.855s user 0m0.007s sys 0m0.140s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10079 miss_total: 21 swrong=0 ewrong=0 - open/close 798 (time 1782762226.46 total 10.00 last 79.78) total: 900 open/close in 11.23 seconds: 80.13 ops/second llite.lustre-ffff978ec9e43000.statahead_max=0 1001 real 0m21.099s user 0m0.038s sys 0m3.088s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff978ec9e43000.statahead_max=2048 llite.lustre-ffff978ec9e43000.statahead_max=2048 1001 real 0m6.906s user 0m0.031s sys 0m1.463s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff978ec9e43000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats= snapshot_time: 1782762289.300078367 secs.nsecs start_time: 1782761916.827556347 secs.nsecs elapsed_time: 372.472522020 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 1 9 27 32: 3 27 54 64: 1 9 63 128: 0 0 63 256: 4 36 100 - open/close 788 (time 1782762301.66 total 10.01 last 78.72) - open/close 1586 (time 1782762311.68 total 20.03 last 79.67) - open/close 2348 (time 1782762321.68 total 30.03 last 76.18) - open/close 3055 (time 1782762331.68 total 40.03 last 70.67) - open/close 3818 (time 1782762341.69 total 50.04 last 76.27) - open/close 4389 (time 1782762351.69 total 60.04 last 57.06) - open/close 5138 (time 1782762361.70 total 70.05 last 74.87) - open/close 5772 (time 1782762371.72 total 80.07 last 63.25) - open/close 6510 (time 1782762381.75 total 90.10 last 73.59) - open/close 7281 (time 1782762391.75 total 100.10 last 77.08) - open/close 7931 (time 1782762401.76 total 110.10 last 64.98) - open/close 8743 (time 1782762411.76 total 120.11 last 81.17) - open/close 9528 (time 1782762421.76 total 130.11 last 78.49) total: 10000 open/close in 135.72 seconds: 73.68 ops/second llite.lustre-ffff978ec9e43000.statahead_batch_max=0 llite.lustre-ffff978ec9e43000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff978ec9e43000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.285s user 0m0.320s sys 0m15.087s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff978ec9e43000.statahead_batch_max=256 llite.lustre-ffff978ec9e43000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff978ec9e43000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.461s user 0m0.264s sys 0m14.994s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff978ec9e43000.batch_stats= snapshot_time: 1782762557.305853052 secs.nsecs start_time: 1782762492.650948745 secs.nsecs elapsed_time: 64.654904307 secs.nsecs subreqs per batch batches %% cum %% 1: 223 52 52 2: 58 13 66 4: 37 8 75 8: 30 7 82 16: 23 5 87 32: 17 4 91 64: 2 0 91 128: 0 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff978ec9e43000.statahead_batch_max=64 llite.lustre-ffff978ec9e43000.statahead_max=128