== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:36:00 (1787319360) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats=0 llite.lustre-ffff93e3af26d000.statahead_max=32 llite.lustre-ffff93e3af26d000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats=0 total: 100 open/close in 2.03 seconds: 49.25 ops/second llite.lustre-ffff93e3af26d000.statahead_max=0 101 real 0m2.538s user 0m0.006s sys 0m0.321s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff93e3af26d000.statahead_max=32 llite.lustre-ffff93e3af26d000.statahead_max=32 101 real 0m2.141s user 0m0.004s sys 0m0.191s 'ls -l' 100 files with statahead: 2 sec statahead total: 138 statahead wrong: 2 agl total: 131 list_total: 30 fname_total: 103 hit_total: 4461 miss_total: 1285 swrong=2 ewrong=2 - open/close 752 (time 1787319390.50 total 10.00 last 75.18) total: 900 open/close in 12.48 seconds: 72.10 ops/second llite.lustre-ffff93e3af26d000.statahead_max=0 1001 real 0m19.896s user 0m0.032s sys 0m3.082s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff93e3af26d000.statahead_max=32 llite.lustre-ffff93e3af26d000.statahead_max=32 1001 real 0m10.222s user 0m0.028s sys 0m1.506s 'ls -l' 1000 files with statahead: 10 sec statahead total: 139 statahead wrong: 2 agl total: 132 list_total: 31 fname_total: 103 hit_total: 5456 miss_total: 1290 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff93e3af26d000.statahead_stats= statahead total: 139 statahead wrong: 2 agl total: 132 list_total: 31 fname_total: 103 hit_total: 5456 miss_total: 1290 mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats= snapshot_time: 1787319454.930840597 secs.nsecs start_time: 1787319366.183845582 secs.nsecs elapsed_time: 88.746995015 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 618 (time 1787319467.76 total 10.01 last 61.74) - open/close 1298 (time 1787319477.76 total 20.01 last 67.99) - open/close 1888 (time 1787319487.78 total 30.03 last 58.91) - open/close 2429 (time 1787319497.80 total 40.05 last 53.95) - open/close 3207 (time 1787319507.84 total 50.09 last 77.52) - open/close 4010 (time 1787319517.85 total 60.10 last 80.25) - open/close 4862 (time 1787319527.86 total 70.11 last 85.05) - open/close 5611 (time 1787319537.88 total 80.13 last 74.76) - open/close 6483 (time 1787319547.89 total 90.14 last 87.16) - open/close 7394 (time 1787319557.91 total 100.16 last 90.92) - open/close 8236 (time 1787319567.91 total 110.16 last 84.19) - open/close 9080 (time 1787319577.92 total 120.17 last 84.32) - open/close 9981 (time 1787319587.93 total 130.18 last 89.96) total: 10000 open/close in 130.40 seconds: 76.69 ops/second llite.lustre-ffff93e3af26d000.statahead_batch_max=0 llite.lustre-ffff93e3af26d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e3af26d000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.506s user 0m0.290s sys 0m14.491s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93e3af26d000.statahead_batch_max=32 llite.lustre-ffff93e3af26d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93e3af26d000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m55.034s user 0m0.294s sys 0m14.806s batched statahead RPC= hit count=9979 mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats= snapshot_time: 1787319790.652996092 secs.nsecs start_time: 1787319662.055113711 secs.nsecs elapsed_time: 128.597882381 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats=0 llite.lustre-ffff93e3af26d000.statahead_max=2048 llite.lustre-ffff93e3af26d000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats=0 total: 100 open/close in 2.61 seconds: 38.29 ops/second llite.lustre-ffff93e3af26d000.statahead_max=0 101 real 0m1.809s user 0m0.004s sys 0m0.330s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff93e3af26d000.statahead_max=2048 llite.lustre-ffff93e3af26d000.statahead_max=2048 101 real 0m0.854s user 0m0.005s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10078 miss_total: 22 swrong=0 ewrong=0 - open/close 713 (time 1787320106.31 total 10.01 last 71.24) total: 900 open/close in 12.54 seconds: 71.77 ops/second llite.lustre-ffff93e3af26d000.statahead_max=0 1001 real 0m22.470s user 0m0.033s sys 0m3.135s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff93e3af26d000.statahead_max=2048 llite.lustre-ffff93e3af26d000.statahead_max=2048 1001 real 0m8.126s user 0m0.034s sys 0m1.421s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff93e3af26d000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats= snapshot_time: 1787320178.943787741 secs.nsecs start_time: 1787319793.476415829 secs.nsecs elapsed_time: 385.467371912 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 3 25 58 64: 1 8 66 128: 0 0 66 256: 4 33 100 - open/close 676 (time 1787320191.96 total 10.00 last 67.59) - open/close 1309 (time 1787320201.97 total 20.01 last 63.27) - open/close 2089 (time 1787320211.99 total 30.03 last 77.85) - open/close 2788 (time 1787320221.99 total 40.03 last 69.89) - open/close 3617 (time 1787320232.00 total 50.04 last 82.81) - open/close 4404 (time 1787320242.01 total 60.04 last 78.66) - open/close 5102 (time 1787320252.01 total 70.04 last 69.79) - open/close 5760 (time 1787320262.01 total 80.05 last 65.76) - open/close 6505 (time 1787320272.02 total 90.05 last 74.47) - open/close 7311 (time 1787320282.02 total 100.06 last 80.56) - open/close 8101 (time 1787320292.03 total 110.06 last 78.96) - open/close 8823 (time 1787320302.03 total 120.07 last 72.18) - open/close 9624 (time 1787320312.03 total 130.07 last 80.10) total: 10000 open/close in 135.01 seconds: 74.07 ops/second llite.lustre-ffff93e3af26d000.statahead_batch_max=0 llite.lustre-ffff93e3af26d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e3af26d000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m10.708s user 0m0.325s sys 0m15.267s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93e3af26d000.statahead_batch_max=256 llite.lustre-ffff93e3af26d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93e3af26d000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.422s user 0m0.309s sys 0m14.796s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff93e3af26d000.batch_stats= snapshot_time: 1787320472.008782454 secs.nsecs start_time: 1787320397.989136030 secs.nsecs elapsed_time: 74.019646424 secs.nsecs subreqs per batch batches %% cum %% 1: 216 53 53 2: 52 12 66 4: 38 9 75 8: 29 7 83 16: 14 3 86 32: 16 3 90 64: 4 0 91 128: 0 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff93e3af26d000.statahead_batch_max=64 llite.lustre-ffff93e3af26d000.statahead_max=128