== sanity test 123ad: Verify batching statahead works correctly ========================================================== 02:20:29 (1789453229) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats=0 llite.lustre-ffff89262e260000.statahead_max=32 llite.lustre-ffff89262e260000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats=0 total: 100 open/close in 2.49 seconds: 40.09 ops/second llite.lustre-ffff89262e260000.statahead_max=0 101 real 0m2.050s user 0m0.008s sys 0m0.288s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff89262e260000.statahead_max=32 llite.lustre-ffff89262e260000.statahead_max=32 101 real 0m0.865s user 0m0.005s sys 0m0.166s 'ls -l' 100 files with statahead: 1 sec statahead total: 105 statahead wrong: 2 agl total: 100 list_total: 31 fname_total: 64 hit_total: 4139 miss_total: 1497 swrong=2 ewrong=2 - open/close 755 (time 1789453254.86 total 10.01 last 75.41) total: 900 open/close in 11.75 seconds: 76.57 ops/second llite.lustre-ffff89262e260000.statahead_max=0 1001 real 0m19.339s user 0m0.037s sys 0m2.740s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff89262e260000.statahead_max=32 llite.lustre-ffff89262e260000.statahead_max=32 1001 real 0m8.157s user 0m0.016s sys 0m1.317s 'ls -l' 1000 files with statahead: 8 sec statahead total: 106 statahead wrong: 2 agl total: 101 list_total: 32 fname_total: 64 hit_total: 5138 miss_total: 1498 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff89262e260000.statahead_stats= statahead total: 106 statahead wrong: 2 agl total: 101 list_total: 32 fname_total: 64 hit_total: 5138 miss_total: 1498 mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats= snapshot_time: 1789453314.210578905 secs.nsecs start_time: 1789453233.639138398 secs.nsecs elapsed_time: 80.571440507 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 787 (time 1789453326.09 total 10.01 last 78.63) - open/close 1601 (time 1789453336.10 total 20.02 last 81.35) - open/close 2387 (time 1789453346.13 total 30.04 last 78.37) - open/close 3219 (time 1789453356.13 total 40.05 last 83.18) - open/close 4015 (time 1789453366.15 total 50.06 last 79.50) - open/close 4851 (time 1789453376.15 total 60.07 last 83.54) - open/close 5665 (time 1789453386.16 total 70.07 last 81.37) - open/close 6473 (time 1789453396.17 total 80.08 last 80.72) - open/close 7275 (time 1789453406.18 total 90.09 last 80.13) - open/close 7979 (time 1789453416.18 total 100.10 last 70.36) - open/close 8704 (time 1789453426.19 total 110.10 last 72.46) - open/close 9520 (time 1789453436.25 total 120.16 last 81.12) total: 10000 open/close in 126.04 seconds: 79.34 ops/second llite.lustre-ffff89262e260000.statahead_batch_max=0 llite.lustre-ffff89262e260000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89262e260000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.740s user 0m0.299s sys 0m15.927s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89262e260000.statahead_batch_max=32 llite.lustre-ffff89262e260000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89262e260000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m28.256s user 0m0.281s sys 0m13.662s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats= snapshot_time: 1789453596.861896482 secs.nsecs start_time: 1789453500.459095117 secs.nsecs elapsed_time: 96.402801365 secs.nsecs subreqs per batch batches %% cum %% 1: 2 0 0 2: 1 0 0 4: 0 0 0 8: 1 0 1 16: 1 0 1 32: 313 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats=0 llite.lustre-ffff89262e260000.statahead_max=2048 llite.lustre-ffff89262e260000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats=0 total: 100 open/close in 2.17 seconds: 46.12 ops/second llite.lustre-ffff89262e260000.statahead_max=0 101 real 0m2.236s user 0m0.006s sys 0m0.305s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff89262e260000.statahead_max=2048 llite.lustre-ffff89262e260000.statahead_max=2048 101 real 0m0.650s user 0m0.003s sys 0m0.187s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 808 (time 1789453869.98 total 10.00 last 80.79) total: 900 open/close in 11.04 seconds: 81.52 ops/second llite.lustre-ffff89262e260000.statahead_max=0 1001 real 0m16.853s user 0m0.037s sys 0m2.714s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff89262e260000.statahead_max=2048 llite.lustre-ffff89262e260000.statahead_max=2048 1001 real 0m5.777s user 0m0.027s sys 0m1.584s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff89262e260000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats= snapshot_time: 1789453923.588356295 secs.nsecs start_time: 1789453598.937624239 secs.nsecs elapsed_time: 324.650732056 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 727 (time 1789453935.99 total 10.03 last 72.45) - open/close 1463 (time 1789453946.00 total 20.04 last 73.56) - open/close 2270 (time 1789453956.01 total 30.05 last 80.63) - open/close 3125 (time 1789453966.02 total 40.06 last 85.40) - open/close 3983 (time 1789453976.02 total 50.06 last 85.78) - open/close 4841 (time 1789453986.03 total 60.07 last 85.70) - open/close 5662 (time 1789453996.04 total 70.08 last 82.07) - open/close 6474 (time 1789454006.04 total 80.08 last 81.20) - open/close 7306 (time 1789454016.05 total 90.09 last 83.09) - open/close 8164 (time 1789454026.06 total 100.10 last 85.71) - open/close 8994 (time 1789454036.06 total 110.10 last 82.99) - open/close 9786 (time 1789454046.06 total 120.10 last 79.19) total: 10000 open/close in 122.59 seconds: 81.57 ops/second llite.lustre-ffff89262e260000.statahead_batch_max=0 llite.lustre-ffff89262e260000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89262e260000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.884s user 0m0.322s sys 0m15.657s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89262e260000.statahead_batch_max=256 llite.lustre-ffff89262e260000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89262e260000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.674s user 0m0.277s sys 0m15.304s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff89262e260000.batch_stats= snapshot_time: 1789454162.518690621 secs.nsecs start_time: 1789454108.591583843 secs.nsecs elapsed_time: 53.927106778 secs.nsecs subreqs per batch batches %% cum %% 1: 134 46 46 2: 42 14 60 4: 31 10 71 8: 14 4 76 16: 12 4 80 32: 15 5 85 64: 6 2 87 128: 2 0 88 256: 34 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff89262e260000.statahead_batch_max=64 llite.lustre-ffff89262e260000.statahead_max=128