== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:54:49 (1788753289) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats=0 llite.lustre-ffff8ad545252800.statahead_max=32 llite.lustre-ffff8ad545252800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats=0 total: 100 open/close in 4.20 seconds: 23.79 ops/second llite.lustre-ffff8ad545252800.statahead_max=0 101 real 0m2.576s user 0m0.003s sys 0m0.310s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8ad545252800.statahead_max=32 llite.lustre-ffff8ad545252800.statahead_max=32 101 real 0m0.982s user 0m0.003s sys 0m0.154s 'ls -l' 100 files with statahead: 1 sec statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 29 fname_total: 73 hit_total: 4328 miss_total: 763 swrong=2 ewrong=2 - open/close 719 (time 1788753321.57 total 10.00 last 71.87) total: 900 open/close in 12.98 seconds: 69.36 ops/second llite.lustre-ffff8ad545252800.statahead_max=0 1001 real 0m27.719s user 0m0.039s sys 0m3.009s 'ls -l' 1000 files without statahead: 27 sec llite.lustre-ffff8ad545252800.statahead_max=32 llite.lustre-ffff8ad545252800.statahead_max=32 1001 real 0m12.827s user 0m0.026s sys 0m1.391s 'ls -l' 1000 files with statahead: 13 sec statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 73 hit_total: 5325 miss_total: 766 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff8ad545252800.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 73 hit_total: 5325 miss_total: 766 mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats= snapshot_time: 1788753403.583940188 secs.nsecs start_time: 1788753296.233118182 secs.nsecs elapsed_time: 107.350822006 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 651 (time 1788753415.86 total 10.02 last 64.98) - open/close 1197 (time 1788753425.87 total 20.03 last 54.56) - open/close 1919 (time 1788753435.87 total 30.03 last 72.17) - open/close 2643 (time 1788753445.87 total 40.03 last 72.38) - open/close 3356 (time 1788753455.89 total 50.05 last 71.20) - open/close 4042 (time 1788753465.91 total 60.07 last 68.48) - open/close 4703 (time 1788753475.91 total 70.07 last 66.08) - open/close 5307 (time 1788753485.91 total 80.07 last 60.36) - open/close 5959 (time 1788753495.93 total 90.09 last 65.08) - open/close 6471 (time 1788753505.95 total 100.11 last 51.13) - open/close 7229 (time 1788753515.96 total 110.12 last 75.72) - open/close 7870 (time 1788753525.96 total 120.13 last 64.05) - open/close 8499 (time 1788753535.97 total 130.13 last 62.90) - open/close 9085 (time 1788753545.98 total 140.14 last 58.53) - open/close 9703 (time 1788753556.00 total 150.16 last 61.68) total: 10000 open/close in 155.01 seconds: 64.51 ops/second llite.lustre-ffff8ad545252800.statahead_batch_max=0 llite.lustre-ffff8ad545252800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ad545252800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m12.049s user 0m0.336s sys 0m14.100s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ad545252800.statahead_batch_max=32 llite.lustre-ffff8ad545252800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ad545252800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m48.912s user 0m0.301s sys 0m13.264s batched statahead RPC= hit count=9977 mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats= snapshot_time: 1788753766.493625197 secs.nsecs start_time: 1788753644.612718961 secs.nsecs elapsed_time: 121.880906236 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats=0 llite.lustre-ffff8ad545252800.statahead_max=2048 llite.lustre-ffff8ad545252800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats=0 total: 100 open/close in 2.94 seconds: 34.01 ops/second llite.lustre-ffff8ad545252800.statahead_max=0 101 real 0m2.061s user 0m0.004s sys 0m0.311s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ad545252800.statahead_max=2048 llite.lustre-ffff8ad545252800.statahead_max=2048 101 real 0m1.118s user 0m0.003s sys 0m0.140s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10076 miss_total: 24 swrong=0 ewrong=0 - open/close 779 (time 1788754072.00 total 10.01 last 77.84) total: 900 open/close in 11.80 seconds: 76.24 ops/second llite.lustre-ffff8ad545252800.statahead_max=0 1001 real 0m22.550s user 0m0.047s sys 0m2.902s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff8ad545252800.statahead_max=2048 llite.lustre-ffff8ad545252800.statahead_max=2048 1001 real 0m6.628s user 0m0.030s sys 0m1.236s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8ad545252800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats= snapshot_time: 1788754138.335341645 secs.nsecs start_time: 1788753769.243196878 secs.nsecs elapsed_time: 369.092144767 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 1 10 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 827 (time 1788754150.94 total 10.01 last 82.63) - open/close 1572 (time 1788754160.95 total 20.02 last 74.39) - open/close 2432 (time 1788754170.96 total 30.03 last 85.97) - open/close 3163 (time 1788754180.97 total 40.04 last 73.03) - open/close 3893 (time 1788754190.97 total 50.04 last 72.96) - open/close 4631 (time 1788754200.97 total 60.04 last 73.78) - open/close 5446 (time 1788754210.98 total 70.06 last 81.40) - open/close 6243 (time 1788754220.99 total 80.06 last 79.68) - open/close 7015 (time 1788754231.00 total 90.07 last 77.13) - open/close 7824 (time 1788754241.01 total 100.08 last 80.82) - open/close 8626 (time 1788754251.01 total 110.08 last 80.19) - open/close 9456 (time 1788754261.01 total 120.08 last 82.98) total: 10000 open/close in 127.23 seconds: 78.59 ops/second llite.lustre-ffff8ad545252800.statahead_batch_max=0 llite.lustre-ffff8ad545252800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ad545252800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.056s user 0m0.321s sys 0m13.853s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ad545252800.statahead_batch_max=256 llite.lustre-ffff8ad545252800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ad545252800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.394s user 0m0.291s sys 0m13.400s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8ad545252800.batch_stats= snapshot_time: 1788754406.615726198 secs.nsecs start_time: 1788754342.223310385 secs.nsecs elapsed_time: 64.392415813 secs.nsecs subreqs per batch batches %% cum %% 1: 61 33 33 2: 30 16 50 4: 13 7 57 8: 12 6 64 16: 5 2 67 32: 20 11 78 64: 3 1 80 128: 0 0 80 256: 36 20 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8ad545252800.statahead_batch_max=64 llite.lustre-ffff8ad545252800.statahead_max=128