== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:35:20 (1781620520) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats=0 llite.lustre-ffffa09345b87000.statahead_max=32 llite.lustre-ffffa09345b87000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.65 seconds: 60.44 ops/second llite.lustre-ffffa09345b87000.statahead_max=0 101 real 0m1.152s user 0m0.005s sys 0m0.309s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffffa09345b87000.statahead_max=32 llite.lustre-ffffa09345b87000.statahead_max=32 101 real 0m0.617s user 0m0.005s sys 0m0.209s 'ls -l' 100 files with statahead: 0 sec statahead total: 123 statahead wrong: 2 agl total: 117 list_total: 29 fname_total: 94 hit_total: 3743 miss_total: 1373 swrong=2 ewrong=2 total: 900 open/close in 7.55 seconds: 119.13 ops/second llite.lustre-ffffa09345b87000.statahead_max=0 1001 real 0m14.189s user 0m0.031s sys 0m3.018s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffffa09345b87000.statahead_max=32 llite.lustre-ffffa09345b87000.statahead_max=32 1001 real 0m5.203s user 0m0.022s sys 0m1.645s 'ls -l' 1000 files with statahead: 6 sec statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 94 hit_total: 4739 miss_total: 1377 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffffa09345b87000.statahead_stats= statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 94 hit_total: 4739 miss_total: 1377 mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781620573.813940033 secs.nsecs start_time: 1781620522.231665644 secs.nsecs elapsed_time: 51.582274389 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 5 12 15 16: 19 48 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781620573.813981803 secs.nsecs start_time: 1781620522.231736109 secs.nsecs elapsed_time: 51.582245694 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 5 12 15 8: 1 2 17 16: 20 50 67 32: 13 32 100 - open/close 1189 (time 1781620585.10 total 10.01 last 118.84) - open/close 2402 (time 1781620595.10 total 20.01 last 121.29) - open/close 3852 (time 1781620605.10 total 30.01 last 144.93) - open/close 5334 (time 1781620615.11 total 40.02 last 148.12) - open/close 6993 (time 1781620625.11 total 50.02 last 165.83) - open/close 8504 (time 1781620635.12 total 60.03 last 151.01) total: 10000 open/close in 68.45 seconds: 146.10 ops/second llite.lustre-ffffa09345b87000.statahead_batch_max=0 llite.lustre-ffffa09345b87000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa09345b87000.stats=clear mdc.lustre-MDT0001-mdc-ffffa09345b87000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.713s user 0m0.284s sys 0m30.814s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa09345b87000.statahead_batch_max=32 llite.lustre-ffffa09345b87000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa09345b87000.stats=clear mdc.lustre-MDT0001-mdc-ffffa09345b87000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.962s user 0m0.208s sys 0m20.992s batched statahead RPC= hit count=9990 mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781620734.721621754 secs.nsecs start_time: 1781620684.443874618 secs.nsecs elapsed_time: 50.277747136 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781620734.721681071 secs.nsecs start_time: 1781620684.443963003 secs.nsecs elapsed_time: 50.277718068 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats=0 llite.lustre-ffffa09345b87000.statahead_max=2048 llite.lustre-ffffa09345b87000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.17 seconds: 85.29 ops/second llite.lustre-ffffa09345b87000.statahead_max=0 101 real 0m1.103s user 0m0.005s sys 0m0.303s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffffa09345b87000.statahead_max=2048 llite.lustre-ffffa09345b87000.statahead_max=2048 101 real 0m0.445s user 0m0.006s sys 0m0.204s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10089 miss_total: 11 swrong=0 ewrong=0 total: 900 open/close in 5.60 seconds: 160.65 ops/second llite.lustre-ffffa09345b87000.statahead_max=0 1001 real 0m10.731s user 0m0.038s sys 0m2.943s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffffa09345b87000.statahead_max=2048 llite.lustre-ffffa09345b87000.statahead_max=2048 1001 real 0m3.331s user 0m0.015s sys 0m1.502s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11088 miss_total: 12 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffffa09345b87000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11088 miss_total: 12 mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781620902.266112003 secs.nsecs start_time: 1781620735.690071769 secs.nsecs elapsed_time: 166.576040234 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 16 16 4: 1 16 33 8: 2 33 66 16: 0 0 66 32: 0 0 66 64: 0 0 66 128: 0 0 66 256: 2 33 100 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781620902.266180461 secs.nsecs start_time: 1781620735.690226814 secs.nsecs elapsed_time: 166.575953647 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 11 11 4: 1 11 22 8: 1 11 33 16: 2 22 55 32: 0 0 55 64: 2 22 77 128: 0 0 77 256: 2 22 100 - open/close 1721 (time 1781620913.89 total 10.00 last 172.08) - open/close 3284 (time 1781620923.89 total 20.01 last 156.23) - open/close 5508 (time 1781620933.90 total 30.01 last 222.30) - open/close 7572 (time 1781620943.90 total 40.01 last 206.40) - open/close 8850 (time 1781620953.90 total 50.01 last 127.75) - open/close 9664 (time 1781620963.91 total 60.02 last 81.36) total: 10000 open/close in 63.77 seconds: 156.82 ops/second llite.lustre-ffffa09345b87000.statahead_batch_max=0 llite.lustre-ffffa09345b87000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa09345b87000.stats=clear mdc.lustre-MDT0001-mdc-ffffa09345b87000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.612s user 0m0.359s sys 0m19.326s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa09345b87000.statahead_batch_max=256 llite.lustre-ffffa09345b87000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa09345b87000.stats=clear mdc.lustre-MDT0001-mdc-ffffa09345b87000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.190s user 0m0.286s sys 0m17.683s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781621097.672117145 secs.nsecs start_time: 1781621044.265355528 secs.nsecs elapsed_time: 53.406761617 secs.nsecs subreqs per batch batches %% cum %% 1: 166 52 52 2: 48 15 67 4: 26 8 75 8: 10 3 79 16: 11 3 82 32: 18 5 88 64: 2 0 88 128: 0 0 88 256: 35 11 100 mdc.lustre-MDT0001-mdc-ffffa09345b87000.batch_stats= snapshot_time: 1781621097.672409184 secs.nsecs start_time: 1781621044.265431484 secs.nsecs elapsed_time: 53.406977700 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffffa09345b87000.statahead_batch_max=64 llite.lustre-ffffa09345b87000.statahead_max=128