== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:11:47 (1787861507) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats=0 llite.lustre-ffff8e5243072800.statahead_max=32 llite.lustre-ffff8e5243072800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats=0 total: 100 open/close in 2.06 seconds: 48.61 ops/second llite.lustre-ffff8e5243072800.statahead_max=0 101 real 0m2.535s user 0m0.004s sys 0m0.314s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8e5243072800.statahead_max=32 llite.lustre-ffff8e5243072800.statahead_max=32 101 real 0m0.766s user 0m0.003s sys 0m0.146s 'ls -l' 100 files with statahead: 1 sec statahead total: 128 statahead wrong: 2 agl total: 115 list_total: 29 fname_total: 83 hit_total: 3905 miss_total: 1171 swrong=2 ewrong=2 - open/close 780 (time 1787861532.32 total 10.00 last 77.96) total: 900 open/close in 11.78 seconds: 76.43 ops/second llite.lustre-ffff8e5243072800.statahead_max=0 1001 real 0m23.113s user 0m0.038s sys 0m2.910s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff8e5243072800.statahead_max=32 llite.lustre-ffff8e5243072800.statahead_max=32 1001 real 0m9.646s user 0m0.026s sys 0m1.277s 'ls -l' 1000 files with statahead: 10 sec statahead total: 129 statahead wrong: 2 agl total: 116 list_total: 30 fname_total: 83 hit_total: 4904 miss_total: 1172 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff8e5243072800.statahead_stats= statahead total: 129 statahead wrong: 2 agl total: 116 list_total: 30 fname_total: 83 hit_total: 4904 miss_total: 1172 mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats= snapshot_time: 1787861604.530352541 secs.nsecs start_time: 1787861510.350733377 secs.nsecs elapsed_time: 94.179619164 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 698 (time 1787861617.36 total 10.00 last 69.78) - open/close 1481 (time 1787861627.36 total 20.01 last 78.27) - open/close 2104 (time 1787861637.36 total 30.01 last 62.30) - open/close 2881 (time 1787861647.37 total 40.01 last 77.65) - open/close 3705 (time 1787861657.37 total 50.02 last 82.38) - open/close 4392 (time 1787861667.38 total 60.02 last 68.66) - open/close 5107 (time 1787861677.38 total 70.03 last 71.48) - open/close 5995 (time 1787861687.38 total 80.03 last 88.76) - open/close 6719 (time 1787861697.40 total 90.04 last 72.32) - open/close 7423 (time 1787861707.40 total 100.05 last 70.36) - open/close 8109 (time 1787861717.42 total 110.06 last 68.50) - open/close 8756 (time 1787861727.42 total 120.07 last 64.65) - open/close 9453 (time 1787861737.43 total 130.07 last 69.66) total: 10000 open/close in 137.96 seconds: 72.48 ops/second llite.lustre-ffff8e5243072800.statahead_batch_max=0 llite.lustre-ffff8e5243072800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e5243072800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m11.842s user 0m0.322s sys 0m13.866s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e5243072800.statahead_batch_max=32 llite.lustre-ffff8e5243072800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e5243072800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m43.619s user 0m0.271s sys 0m13.038s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats= snapshot_time: 1787861942.892684499 secs.nsecs start_time: 1787861827.015787513 secs.nsecs elapsed_time: 115.876896986 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats=0 llite.lustre-ffff8e5243072800.statahead_max=2048 llite.lustre-ffff8e5243072800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats=0 total: 100 open/close in 2.30 seconds: 43.42 ops/second llite.lustre-ffff8e5243072800.statahead_max=0 101 real 0m2.099s user 0m0.006s sys 0m0.293s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8e5243072800.statahead_max=2048 llite.lustre-ffff8e5243072800.statahead_max=2048 101 real 0m0.812s user 0m0.003s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 803 (time 1787862235.14 total 10.01 last 80.25) total: 900 open/close in 11.31 seconds: 79.54 ops/second llite.lustre-ffff8e5243072800.statahead_max=0 1001 real 0m19.334s user 0m0.035s sys 0m2.788s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff8e5243072800.statahead_max=2048 llite.lustre-ffff8e5243072800.statahead_max=2048 1001 real 0m6.229s user 0m0.023s sys 0m1.354s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8e5243072800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats= snapshot_time: 1787862293.653610332 secs.nsecs start_time: 1787861945.285536149 secs.nsecs elapsed_time: 348.368074183 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 742 (time 1787862306.10 total 10.01 last 74.15) - open/close 1501 (time 1787862316.10 total 20.01 last 75.86) - open/close 2287 (time 1787862326.13 total 30.03 last 78.42) - open/close 3119 (time 1787862336.13 total 40.04 last 83.16) - open/close 4061 (time 1787862346.13 total 50.04 last 94.20) - open/close 4942 (time 1787862356.14 total 60.05 last 88.03) - open/close 5724 (time 1787862366.16 total 70.06 last 78.07) - open/close 6507 (time 1787862376.16 total 80.07 last 78.29) - open/close 7264 (time 1787862386.17 total 90.07 last 75.63) - open/close 8036 (time 1787862396.17 total 100.08 last 77.17) - open/close 8639 (time 1787862406.17 total 110.08 last 60.27) - open/close 9152 (time 1787862416.19 total 120.10 last 51.23) - open/close 9954 (time 1787862426.20 total 130.11 last 80.11) total: 10000 open/close in 130.56 seconds: 76.59 ops/second llite.lustre-ffff8e5243072800.statahead_batch_max=0 llite.lustre-ffff8e5243072800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e5243072800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.269s user 0m0.310s sys 0m13.682s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e5243072800.statahead_batch_max=256 llite.lustre-ffff8e5243072800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e5243072800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.130s user 0m0.314s sys 0m13.590s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e5243072800.batch_stats= snapshot_time: 1787862559.264533184 secs.nsecs start_time: 1787862500.334832653 secs.nsecs elapsed_time: 58.929700531 secs.nsecs subreqs per batch batches %% cum %% 1: 158 53 53 2: 29 9 62 4: 26 8 71 8: 15 5 76 16: 13 4 81 32: 14 4 85 64: 6 2 87 128: 2 0 88 256: 34 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e5243072800.statahead_batch_max=64 llite.lustre-ffff8e5243072800.statahead_max=128