== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:32:27 (1779100347) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats=0 llite.lustre-ffff9aa4c84ac800.statahead_max=32 llite.lustre-ffff9aa4c84ac800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats=0 total: 100 open/close in 3.26 seconds: 30.68 ops/second llite.lustre-ffff9aa4c84ac800.statahead_max=0 101 real 0m2.678s user 0m0.009s sys 0m0.365s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9aa4c84ac800.statahead_max=32 llite.lustre-ffff9aa4c84ac800.statahead_max=32 101 real 0m1.331s user 0m0.006s sys 0m0.190s 'ls -l' 100 files with statahead: 1 sec statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 30 fname_total: 91 hit_total: 4414 miss_total: 1286 swrong=2 ewrong=2 - open/close 677 (time 1779100377.19 total 10.00 last 67.67) total: 900 open/close in 13.66 seconds: 65.88 ops/second llite.lustre-ffff9aa4c84ac800.statahead_max=0 1001 real 0m22.811s user 0m0.044s sys 0m3.477s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9aa4c84ac800.statahead_max=32 llite.lustre-ffff9aa4c84ac800.statahead_max=32 1001 real 0m11.192s user 0m0.034s sys 0m1.439s 'ls -l' 1000 files with statahead: 12 sec statahead total: 136 statahead wrong: 2 agl total: 130 list_total: 31 fname_total: 91 hit_total: 5410 miss_total: 1290 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9aa4c84ac800.statahead_stats= statahead total: 136 statahead wrong: 2 agl total: 130 list_total: 31 fname_total: 91 hit_total: 5410 miss_total: 1290 mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats= snapshot_time: 1779100452.584270881 secs.nsecs start_time: 1779100352.519462250 secs.nsecs elapsed_time: 100.064808631 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 562 (time 1779100465.42 total 10.00 last 56.19) - open/close 1151 (time 1779100475.42 total 20.01 last 58.86) - open/close 1735 (time 1779100485.44 total 30.03 last 58.30) - open/close 2308 (time 1779100495.45 total 40.04 last 57.24) - open/close 2719 (time 1779100505.46 total 50.05 last 41.06) - open/close 3263 (time 1779100515.47 total 60.06 last 54.35) - open/close 3734 (time 1779100525.50 total 70.08 last 46.97) - open/close 4081 (time 1779100535.52 total 80.10 last 34.64) - open/close 4469 (time 1779100545.53 total 90.11 last 38.76) - open/close 4805 (time 1779100555.54 total 100.13 last 33.55) - open/close 5217 (time 1779100565.55 total 110.13 last 41.17) - open/close 5602 (time 1779100575.57 total 120.15 last 38.43) - open/close 6062 (time 1779100585.58 total 130.17 last 45.92) - open/close 6519 (time 1779100595.60 total 140.18 last 45.62) - open/close 7036 (time 1779100605.60 total 150.19 last 51.69) - open/close 7466 (time 1779100615.60 total 160.19 last 42.99) - open/close 7910 (time 1779100625.61 total 170.20 last 44.37) - open/close 8343 (time 1779100635.62 total 180.21 last 43.25) - open/close 8921 (time 1779100645.64 total 190.23 last 57.68) - open/close 9491 (time 1779100655.66 total 200.25 last 56.90) total: 10000 open/close in 208.26 seconds: 48.02 ops/second llite.lustre-ffff9aa4c84ac800.statahead_batch_max=0 llite.lustre-ffff9aa4c84ac800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m33.375s user 0m0.357s sys 0m17.070s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9aa4c84ac800.statahead_batch_max=32 llite.lustre-ffff9aa4c84ac800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m47.218s user 0m0.359s sys 0m15.387s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats= snapshot_time: 1779100889.950829969 secs.nsecs start_time: 1779100768.721056961 secs.nsecs elapsed_time: 121.229773008 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats=0 llite.lustre-ffff9aa4c84ac800.statahead_max=2048 llite.lustre-ffff9aa4c84ac800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats=0 total: 100 open/close in 3.28 seconds: 30.50 ops/second llite.lustre-ffff9aa4c84ac800.statahead_max=0 101 real 0m4.309s user 0m0.004s sys 0m0.382s 'ls -l' 100 files without statahead: 5 sec llite.lustre-ffff9aa4c84ac800.statahead_max=2048 llite.lustre-ffff9aa4c84ac800.statahead_max=2048 101 real 0m1.248s user 0m0.007s sys 0m0.172s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 - open/close 433 (time 1779101289.07 total 10.01 last 43.27) - open/close 885 (time 1779101299.09 total 20.03 last 45.11) total: 900 open/close in 20.24 seconds: 44.46 ops/second llite.lustre-ffff9aa4c84ac800.statahead_max=0 1001 real 0m31.503s user 0m0.041s sys 0m3.550s 'ls -l' 1000 files without statahead: 31 sec llite.lustre-ffff9aa4c84ac800.statahead_max=2048 llite.lustre-ffff9aa4c84ac800.statahead_max=2048 1001 real 0m7.759s user 0m0.035s sys 0m1.574s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9aa4c84ac800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats= snapshot_time: 1779101378.423996925 secs.nsecs start_time: 1779100892.398588700 secs.nsecs elapsed_time: 486.025408225 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 15 15 16: 2 15 30 32: 3 23 53 64: 2 15 69 128: 0 0 69 256: 4 30 100 - open/close 660 (time 1779101391.50 total 10.03 last 65.78) - open/close 1217 (time 1779101401.51 total 20.04 last 55.64) - open/close 1700 (time 1779101411.53 total 30.06 last 48.22) - open/close 2215 (time 1779101421.55 total 40.08 last 51.39) - open/close 2801 (time 1779101431.56 total 50.09 last 58.57) - open/close 3395 (time 1779101441.56 total 60.09 last 59.37) - open/close 4013 (time 1779101451.57 total 70.09 last 61.78) - open/close 4581 (time 1779101461.57 total 80.10 last 56.78) - open/close 5113 (time 1779101471.57 total 90.10 last 53.18) - open/close 5656 (time 1779101481.58 total 100.11 last 54.26) - open/close 6125 (time 1779101491.59 total 110.12 last 46.86) - open/close 6652 (time 1779101501.60 total 120.13 last 52.66) - open/close 7044 (time 1779101511.62 total 130.15 last 39.12) - open/close 7384 (time 1779101521.64 total 140.17 last 33.92) - open/close 7815 (time 1779101531.64 total 150.17 last 43.07) - open/close 8302 (time 1779101541.66 total 160.19 last 48.62) - open/close 8904 (time 1779101551.66 total 170.19 last 60.19) - open/close 9557 (time 1779101561.67 total 180.20 last 65.26) total: 10000 open/close in 189.46 seconds: 52.78 ops/second llite.lustre-ffff9aa4c84ac800.statahead_batch_max=0 llite.lustre-ffff9aa4c84ac800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m43.515s user 0m0.412s sys 0m17.761s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9aa4c84ac800.statahead_batch_max=256 llite.lustre-ffff9aa4c84ac800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.310s user 0m0.398s sys 0m17.740s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9aa4c84ac800.batch_stats= snapshot_time: 1779101785.918349710 secs.nsecs start_time: 1779101689.397724030 secs.nsecs elapsed_time: 96.520625680 secs.nsecs subreqs per batch batches % cum % 1: 182 47 47 2: 61 15 62 4: 49 12 75 8: 24 6 81 16: 21 5 87 32: 12 3 90 64: 2 0 90 128: 1 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9aa4c84ac800.statahead_batch_max=64 llite.lustre-ffff9aa4c84ac800.statahead_max=128