== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:43:51 (1743504231) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats=0 llite.lustre-ffff8f52c8c49000.statahead_max=32 llite.lustre-ffff8f52c8c49000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.85 seconds: 118.10 ops/second llite.lustre-ffff8f52c8c49000.statahead_max=0 101 real 0m0.955s user 0m0.004s sys 0m0.440s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8f52c8c49000.statahead_max=32 32 101 real 0m0.590s user 0m0.001s sys 0m0.350s ls -l 100 files with statahead: 1 sec statahead total: 106 statahead wrong: 2 agl total: 98 list_total: 33 fname_total: 68 hit_total: 21587 miss_total: 1604 total: 900 open/close in 3.57 seconds: 251.87 ops/second llite.lustre-ffff8f52c8c49000.statahead_max=0 1001 real 0m9.271s user 0m0.024s sys 0m4.087s ls -l 1000 files without statahead: 9 sec llite.lustre-ffff8f52c8c49000.statahead_max=32 32 1001 real 0m6.275s user 0m0.016s sys 0m2.847s ls -l 1000 files with statahead: 6 sec statahead total: 107 statahead wrong: 2 agl total: 99 list_total: 34 fname_total: 68 hit_total: 22586 miss_total: 1605 - open/close 2156 (time 1743504283.25 total 10.00 last 215.54) total: 4000 open/close in 18.40 seconds: 217.43 ops/second llite.lustre-ffff8f52c8c49000.statahead_max=0 5001 real 0m48.750s user 0m0.143s sys 0m20.797s ls -l 5000 files without statahead: 49 sec llite.lustre-ffff8f52c8c49000.statahead_max=32 32 5001 real 0m27.729s user 0m0.083s sys 0m12.103s ls -l 5000 files with statahead: 28 sec statahead total: 108 statahead wrong: 2 agl total: 100 list_total: 35 fname_total: 68 hit_total: 27585 miss_total: 1606 ls -l done rm -r /mnt/lustre/d123ad.sanity: 41 seconds llite.lustre-ffff8f52c8c49000.statahead_stats= statahead total: 108 statahead wrong: 2 agl total: 100 list_total: 35 fname_total: 68 hit_total: 27585 miss_total: 1606 mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743504426.182374398 secs.nsecs start_time: 1743504236.228559700 secs.nsecs elapsed_time: 189.953814698 secs.nsecs subreqs per batch batches % cum % 1: 4 2 2 2: 3 1 3 4: 3 1 5 8: 5 2 7 16: 120 60 68 32: 62 31 100 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743504426.182697958 secs.nsecs start_time: 1743504236.228830640 secs.nsecs elapsed_time: 189.953867318 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 1 0 1 4: 0 0 1 8: 6 3 4 16: 79 39 43 32: 111 56 100 - open/close 2470 (time 1743504438.01 total 10.00 last 246.94) - open/close 4936 (time 1743504448.01 total 20.00 last 246.58) - open/close 7314 (time 1743504458.01 total 30.01 last 237.73) - open/close 9850 (time 1743504468.01 total 40.01 last 253.53) total: 10000 open/close in 40.59 seconds: 246.37 ops/second llite.lustre-ffff8f52c8c49000.statahead_batch_max=0 llite.lustre-ffff8f52c8c49000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.stats=clear mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.976s user 0m0.205s sys 0m52.193s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f52c8c49000.statahead_batch_max=32 llite.lustre-ffff8f52c8c49000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.stats=clear mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.314s user 0m0.148s sys 0m26.486s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743504590.123403048 secs.nsecs start_time: 1743504528.552156805 secs.nsecs elapsed_time: 61.571246243 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743504590.123743388 secs.nsecs start_time: 1743504528.552523710 secs.nsecs elapsed_time: 61.571219678 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats=0 llite.lustre-ffff8f52c8c49000.statahead_max=2048 llite.lustre-ffff8f52c8c49000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.96 seconds: 104.70 ops/second llite.lustre-ffff8f52c8c49000.statahead_max=0 101 real 0m0.872s user 0m0.003s sys 0m0.404s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8f52c8c49000.statahead_max=2048 2048 101 real 0m0.510s user 0m0.003s sys 0m0.328s ls -l 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 total: 900 open/close in 3.70 seconds: 243.40 ops/second llite.lustre-ffff8f52c8c49000.statahead_max=0 1001 real 0m8.529s user 0m0.022s sys 0m3.658s ls -l 1000 files without statahead: 9 sec llite.lustre-ffff8f52c8c49000.statahead_max=2048 2048 1001 real 0m6.598s user 0m0.020s sys 0m3.809s ls -l 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 - open/close 2553 (time 1743504753.45 total 10.00 last 255.27) total: 4000 open/close in 15.65 seconds: 255.60 ops/second llite.lustre-ffff8f52c8c49000.statahead_max=0 5001 real 0m43.847s user 0m0.124s sys 0m18.459s ls -l 5000 files without statahead: 44 sec llite.lustre-ffff8f52c8c49000.statahead_max=2048 2048 5001 real 0m22.077s user 0m0.072s sys 0m14.521s ls -l 5000 files with statahead: 22 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 ls -l done rm -r /mnt/lustre/d123ad.sanity: 40 seconds llite.lustre-ffff8f52c8c49000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743504883.415939726 secs.nsecs start_time: 1743504592.306970013 secs.nsecs elapsed_time: 291.108969713 secs.nsecs subreqs per batch batches % cum % 1: 32 49 49 2: 8 12 61 4: 5 7 69 8: 2 3 72 16: 1 1 73 32: 1 1 75 64: 0 0 75 128: 2 3 78 256: 14 21 100 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743504883.417009952 secs.nsecs start_time: 1743504592.307478143 secs.nsecs elapsed_time: 291.109531809 secs.nsecs subreqs per batch batches % cum % 1: 38 50 50 2: 11 14 65 4: 3 4 69 8: 5 6 76 16: 1 1 77 32: 0 0 77 64: 1 1 78 128: 2 2 81 256: 14 18 100 - open/close 2441 (time 1743504895.75 total 10.00 last 244.04) - open/close 4847 (time 1743504905.75 total 20.00 last 240.54) - open/close 7300 (time 1743504915.76 total 30.01 last 245.27) - open/close 9740 (time 1743504925.76 total 40.01 last 243.97) total: 10000 open/close in 41.01 seconds: 243.85 ops/second llite.lustre-ffff8f52c8c49000.statahead_batch_max=0 llite.lustre-ffff8f52c8c49000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.stats=clear mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.021s user 0m0.237s sys 0m49.934s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f52c8c49000.statahead_batch_max=256 llite.lustre-ffff8f52c8c49000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.stats=clear mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.553s user 0m0.168s sys 0m31.538s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743505035.687612945 secs.nsecs start_time: 1743504987.699430338 secs.nsecs elapsed_time: 47.988182607 secs.nsecs subreqs per batch batches % cum % 1: 120 53 53 2: 32 14 67 4: 8 3 71 8: 3 1 72 16: 1 0 72 32: 18 8 80 64: 8 3 84 128: 0 0 84 256: 35 15 100 mdc.lustre-MDT0001-mdc-ffff8f52c8c49000.batch_stats= snapshot_time: 1743505035.687890895 secs.nsecs start_time: 1743504987.699680229 secs.nsecs elapsed_time: 47.988210666 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8f52c8c49000.statahead_batch_max=64 llite.lustre-ffff8f52c8c49000.statahead_max=128