== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:16:07 (1763352967) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats=0 llite.lustre-ffff9970585af800.statahead_max=32 llite.lustre-ffff9970585af800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.38 seconds: 72.66 ops/second llite.lustre-ffff9970585af800.statahead_max=0 101 real 0m1.357s user 0m0.005s sys 0m0.289s ls -l 100 files without statahead: 1 sec llite.lustre-ffff9970585af800.statahead_max=32 32 101 real 0m0.488s user 0m0.002s sys 0m0.190s ls -l 100 files with statahead: 0 sec statahead total: 118 statahead wrong: 1 agl total: 112 list_total: 33 fname_total: 85 hit_total: 11849 miss_total: 239 total: 900 open/close in 6.20 seconds: 145.13 ops/second llite.lustre-ffff9970585af800.statahead_max=0 1001 real 0m12.241s user 0m0.031s sys 0m2.770s ls -l 1000 files without statahead: 13 sec llite.lustre-ffff9970585af800.statahead_max=32 32 1001 real 0m4.803s user 0m0.022s sys 0m1.463s ls -l 1000 files with statahead: 4 sec statahead total: 119 statahead wrong: 1 agl total: 113 list_total: 34 fname_total: 85 hit_total: 12847 miss_total: 241 - open/close 1373 (time 1763353013.73 total 10.00 last 137.24) total: 2000 open/close in 13.45 seconds: 148.70 ops/second llite.lustre-ffff9970585af800.statahead_max=0 3001 real 0m32.229s user 0m0.099s sys 0m8.203s ls -l 3000 files without statahead: 32 sec llite.lustre-ffff9970585af800.statahead_max=32 32 3001 real 0m12.095s user 0m0.055s sys 0m4.733s ls -l 3000 files with statahead: 12 sec statahead total: 120 statahead wrong: 1 agl total: 114 list_total: 35 fname_total: 85 hit_total: 15846 miss_total: 242 ls -l done rm -r /mnt/lustre/d123ad.sanity: 31 seconds llite.lustre-ffff9970585af800.statahead_stats= statahead total: 120 statahead wrong: 1 agl total: 114 list_total: 35 fname_total: 85 hit_total: 15846 miss_total: 242 mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353099.595756564 secs.nsecs start_time: 1763352969.507500410 secs.nsecs elapsed_time: 130.088256154 secs.nsecs subreqs per batch batches % cum % 1: 2 1 1 2: 0 0 1 4: 2 1 2 8: 6 4 7 16: 79 58 65 32: 47 34 100 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353099.595825411 secs.nsecs start_time: 1763352969.507582126 secs.nsecs elapsed_time: 130.088243285 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 2 1 2 4: 3 2 4 8: 5 3 8 16: 69 50 58 32: 56 41 100 - open/close 1566 (time 1763353111.45 total 10.00 last 156.55) - open/close 3114 (time 1763353121.45 total 20.00 last 154.78) - open/close 4819 (time 1763353131.46 total 30.01 last 170.44) - open/close 6399 (time 1763353141.46 total 40.01 last 157.96) - open/close 7802 (time 1763353151.46 total 50.02 last 140.24) total: 10000 open/close in 59.94 seconds: 166.82 ops/second llite.lustre-ffff9970585af800.statahead_batch_max=0 llite.lustre-ffff9970585af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9970585af800.stats=clear mdc.lustre-MDT0001-mdc-ffff9970585af800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.701s user 0m0.235s sys 0m27.850s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9970585af800.statahead_batch_max=32 llite.lustre-ffff9970585af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9970585af800.stats=clear mdc.lustre-MDT0001-mdc-ffff9970585af800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.622s user 0m0.229s sys 0m17.289s batched statahead RPC= hit count=9991 mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353243.389547722 secs.nsecs start_time: 1763353195.277330238 secs.nsecs elapsed_time: 48.112217484 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353243.389619239 secs.nsecs start_time: 1763353195.277414812 secs.nsecs elapsed_time: 48.112204427 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats=0 llite.lustre-ffff9970585af800.statahead_max=2048 llite.lustre-ffff9970585af800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.30 seconds: 76.82 ops/second llite.lustre-ffff9970585af800.statahead_max=0 101 real 0m1.235s user 0m0.002s sys 0m0.288s ls -l 100 files without statahead: 2 sec llite.lustre-ffff9970585af800.statahead_max=2048 2048 101 real 0m0.453s user 0m0.002s sys 0m0.184s ls -l 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10090 miss_total: 10 total: 900 open/close in 5.65 seconds: 159.22 ops/second llite.lustre-ffff9970585af800.statahead_max=0 1001 real 0m11.723s user 0m0.028s sys 0m2.715s ls -l 1000 files without statahead: 11 sec llite.lustre-ffff9970585af800.statahead_max=2048 2048 1001 real 0m3.401s user 0m0.017s sys 0m1.742s ls -l 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11089 miss_total: 11 - open/close 1520 (time 1763353422.58 total 10.00 last 151.99) total: 3000 open/close in 19.81 seconds: 151.45 ops/second llite.lustre-ffff9970585af800.statahead_max=0 4001 real 0m44.475s user 0m0.146s sys 0m10.761s ls -l 4000 files without statahead: 45 sec llite.lustre-ffff9970585af800.statahead_max=2048 2048 4001 real 0m12.657s user 0m0.089s sys 0m6.928s ls -l 4000 files with statahead: 12 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 15088 miss_total: 12 ls -l done rm -r /mnt/lustre/d123ad.sanity: 38 seconds llite.lustre-ffff9970585af800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 15088 miss_total: 12 mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353535.635459659 secs.nsecs start_time: 1763353244.644711889 secs.nsecs elapsed_time: 290.990747770 secs.nsecs subreqs per batch batches % cum % 1: 80 61 61 2: 21 16 77 4: 11 8 86 8: 3 2 88 16: 2 1 90 32: 0 0 90 64: 1 0 90 128: 1 0 91 256: 11 8 100 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353535.635519413 secs.nsecs start_time: 1763353244.644844845 secs.nsecs elapsed_time: 290.990674568 secs.nsecs subreqs per batch batches % cum % 1: 78 58 58 2: 25 18 76 4: 13 9 86 8: 4 2 89 16: 0 0 89 32: 1 0 90 64: 2 1 91 128: 0 0 91 256: 11 8 100 - open/close 1903 (time 1763353546.78 total 10.00 last 190.30) - open/close 3582 (time 1763353556.79 total 20.01 last 167.81) - open/close 5284 (time 1763353566.79 total 30.01 last 170.11) - open/close 7299 (time 1763353576.79 total 40.01 last 201.48) - open/close 9241 (time 1763353586.80 total 50.01 last 194.14) total: 10000 open/close in 53.93 seconds: 185.42 ops/second llite.lustre-ffff9970585af800.statahead_batch_max=0 llite.lustre-ffff9970585af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9970585af800.stats=clear mdc.lustre-MDT0001-mdc-ffff9970585af800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.321s user 0m0.262s sys 0m25.389s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9970585af800.statahead_batch_max=256 llite.lustre-ffff9970585af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9970585af800.stats=clear mdc.lustre-MDT0001-mdc-ffff9970585af800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.487s user 0m0.213s sys 0m19.530s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353656.573690888 secs.nsecs start_time: 1763353624.728571320 secs.nsecs elapsed_time: 31.845119568 secs.nsecs subreqs per batch batches % cum % 1: 212 57 57 2: 57 15 72 4: 31 8 80 8: 10 2 83 16: 2 0 84 32: 17 4 88 64: 8 2 90 128: 0 0 90 256: 34 9 100 mdc.lustre-MDT0001-mdc-ffff9970585af800.batch_stats= snapshot_time: 1763353656.573750733 secs.nsecs start_time: 1763353624.729352765 secs.nsecs elapsed_time: 31.844397968 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9970585af800.statahead_batch_max=64 llite.lustre-ffff9970585af800.statahead_max=128