== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:56:24 (1788270984) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats=0 llite.lustre-ffff986011ead000.statahead_max=32 llite.lustre-ffff986011ead000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats=0 total: 100 open/close in 1.40 seconds: 71.64 ops/second llite.lustre-ffff986011ead000.statahead_max=0 101 real 0m1.368s user 0m0.004s sys 0m0.283s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff986011ead000.statahead_max=32 llite.lustre-ffff986011ead000.statahead_max=32 101 real 0m0.542s user 0m0.002s sys 0m0.170s 'ls -l' 100 files with statahead: 0 sec statahead total: 114 statahead wrong: 2 agl total: 109 list_total: 29 fname_total: 85 hit_total: 4060 miss_total: 1616 swrong=2 ewrong=2 total: 900 open/close in 6.08 seconds: 148.10 ops/second llite.lustre-ffff986011ead000.statahead_max=0 1001 real 0m11.024s user 0m0.033s sys 0m2.541s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff986011ead000.statahead_max=32 llite.lustre-ffff986011ead000.statahead_max=32 1001 real 0m3.810s user 0m0.020s sys 0m1.670s 'ls -l' 1000 files with statahead: 4 sec statahead total: 115 statahead wrong: 2 agl total: 110 list_total: 30 fname_total: 85 hit_total: 5057 miss_total: 1619 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff986011ead000.statahead_stats= statahead total: 115 statahead wrong: 2 agl total: 110 list_total: 30 fname_total: 85 hit_total: 5057 miss_total: 1619 mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats= snapshot_time: 1788271023.570962052 secs.nsecs start_time: 1788270986.207075410 secs.nsecs elapsed_time: 37.363886642 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 2295 (time 1788271035.00 total 10.01 last 229.38) - open/close 4656 (time 1788271045.00 total 20.01 last 236.06) - open/close 7190 (time 1788271055.01 total 30.01 last 253.27) - open/close 8729 (time 1788271065.01 total 40.02 last 153.84) total: 10000 open/close in 47.69 seconds: 209.71 ops/second llite.lustre-ffff986011ead000.statahead_batch_max=0 llite.lustre-ffff986011ead000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986011ead000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.797s user 0m0.218s sys 0m25.718s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff986011ead000.statahead_batch_max=32 llite.lustre-ffff986011ead000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff986011ead000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.893s user 0m0.219s sys 0m17.334s batched statahead RPC= hit count=9994 mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats= snapshot_time: 1788271147.149357925 secs.nsecs start_time: 1788271104.546327211 secs.nsecs elapsed_time: 42.603030714 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats=0 llite.lustre-ffff986011ead000.statahead_max=2048 llite.lustre-ffff986011ead000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats=0 total: 100 open/close in 0.61 seconds: 162.95 ops/second llite.lustre-ffff986011ead000.statahead_max=0 101 real 0m0.591s user 0m0.004s sys 0m0.223s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff986011ead000.statahead_max=2048 llite.lustre-ffff986011ead000.statahead_max=2048 101 real 0m0.379s user 0m0.002s sys 0m0.214s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10093 miss_total: 7 swrong=0 ewrong=0 total: 900 open/close in 1.93 seconds: 465.31 ops/second llite.lustre-ffff986011ead000.statahead_max=0 1001 real 0m5.935s user 0m0.022s sys 0m2.113s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff986011ead000.statahead_max=2048 llite.lustre-ffff986011ead000.statahead_max=2048 1001 real 0m3.562s user 0m0.029s sys 0m2.294s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11092 miss_total: 8 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff986011ead000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11092 miss_total: 8 mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats= snapshot_time: 1788271270.883135894 secs.nsecs start_time: 1788271148.060460875 secs.nsecs elapsed_time: 122.822675019 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 3008 (time 1788271281.69 total 10.00 last 300.78) - open/close 5740 (time 1788271291.69 total 20.01 last 273.04) - open/close 7501 (time 1788271301.69 total 30.01 last 176.10) - open/close 9582 (time 1788271311.69 total 40.01 last 208.08) total: 10000 open/close in 41.27 seconds: 242.31 ops/second llite.lustre-ffff986011ead000.statahead_batch_max=0 llite.lustre-ffff986011ead000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986011ead000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.705s user 0m0.218s sys 0m25.471s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff986011ead000.statahead_batch_max=256 llite.lustre-ffff986011ead000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff986011ead000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m25.490s user 0m0.188s sys 0m18.374s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff986011ead000.batch_stats= snapshot_time: 1788271376.721817799 secs.nsecs start_time: 1788271346.560667930 secs.nsecs elapsed_time: 30.161149869 secs.nsecs subreqs per batch batches %% cum %% 1: 210 59 59 2: 35 9 69 4: 37 10 79 8: 8 2 81 16: 5 1 83 32: 19 5 88 64: 5 1 90 128: 0 0 90 256: 35 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff986011ead000.statahead_batch_max=64 llite.lustre-ffff986011ead000.statahead_max=128