== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:13:33 (1790946813) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats=0 llite.lustre-ffffa092905f8800.statahead_max=32 llite.lustre-ffffa092905f8800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats=0 total: 100 open/close in 2.59 seconds: 38.56 ops/second llite.lustre-ffffa092905f8800.statahead_max=0 101 real 0m2.483s user 0m0.004s sys 0m0.353s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffffa092905f8800.statahead_max=32 llite.lustre-ffffa092905f8800.statahead_max=32 101 real 0m1.048s user 0m0.005s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 106 statahead wrong: 2 agl total: 100 list_total: 29 fname_total: 75 hit_total: 3994 miss_total: 1620 swrong=2 ewrong=2 - open/close 644 (time 1790946839.95 total 10.00 last 64.38) total: 900 open/close in 14.08 seconds: 63.91 ops/second llite.lustre-ffffa092905f8800.statahead_max=0 1001 real 0m25.540s user 0m0.037s sys 0m2.981s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffffa092905f8800.statahead_max=32 llite.lustre-ffffa092905f8800.statahead_max=32 1001 real 0m9.481s user 0m0.029s sys 0m1.490s 'ls -l' 1000 files with statahead: 10 sec statahead total: 107 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 75 hit_total: 4991 miss_total: 1623 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffffa092905f8800.statahead_stats= statahead total: 107 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 75 hit_total: 4991 miss_total: 1623 mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats= snapshot_time: 1790946913.317390141 secs.nsecs start_time: 1790946817.209686487 secs.nsecs elapsed_time: 96.107703654 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 663 (time 1790946925.54 total 10.01 last 66.25) - open/close 1355 (time 1790946935.54 total 20.01 last 69.18) - open/close 1963 (time 1790946945.55 total 30.02 last 60.74) - open/close 2584 (time 1790946955.56 total 40.03 last 62.03) - open/close 3222 (time 1790946965.57 total 50.04 last 63.73) - open/close 3882 (time 1790946975.57 total 60.04 last 66.00) - open/close 4542 (time 1790946985.58 total 70.05 last 65.97) - open/close 5198 (time 1790946995.58 total 80.05 last 65.58) - open/close 5858 (time 1790947005.59 total 90.06 last 65.94) - open/close 6473 (time 1790947015.60 total 100.07 last 61.42) - open/close 7080 (time 1790947025.62 total 110.08 last 60.62) - open/close 7723 (time 1790947035.62 total 120.09 last 64.28) - open/close 8346 (time 1790947045.62 total 130.09 last 62.26) - open/close 8893 (time 1790947055.63 total 140.09 last 54.70) - open/close 9438 (time 1790947065.63 total 150.09 last 54.50) total: 10000 open/close in 159.02 seconds: 62.89 ops/second llite.lustre-ffffa092905f8800.statahead_batch_max=0 llite.lustre-ffffa092905f8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa092905f8800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.237s user 0m0.389s sys 0m16.308s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa092905f8800.statahead_batch_max=32 llite.lustre-ffffa092905f8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa092905f8800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m47.957s user 0m0.357s sys 0m14.276s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats= snapshot_time: 1790947267.500714047 secs.nsecs start_time: 1790947147.714913847 secs.nsecs elapsed_time: 119.785800200 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats=0 llite.lustre-ffffa092905f8800.statahead_max=2048 llite.lustre-ffffa092905f8800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats=0 total: 100 open/close in 3.07 seconds: 32.59 ops/second llite.lustre-ffffa092905f8800.statahead_max=0 101 real 0m1.897s user 0m0.003s sys 0m0.331s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffffa092905f8800.statahead_max=2048 llite.lustre-ffffa092905f8800.statahead_max=2048 101 real 0m0.945s user 0m0.005s sys 0m0.173s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 - open/close 597 (time 1790947619.92 total 10.01 last 59.65) total: 900 open/close in 14.82 seconds: 60.73 ops/second llite.lustre-ffffa092905f8800.statahead_max=0 1001 real 0m22.334s user 0m0.043s sys 0m3.072s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffffa092905f8800.statahead_max=2048 llite.lustre-ffffa092905f8800.statahead_max=2048 1001 real 0m7.189s user 0m0.038s sys 0m1.460s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffffa092905f8800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats= snapshot_time: 1790947694.749036296 secs.nsecs start_time: 1790947269.841330057 secs.nsecs elapsed_time: 424.907706239 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 594 (time 1790947707.57 total 10.00 last 59.39) - open/close 1264 (time 1790947717.57 total 20.00 last 66.99) - open/close 1978 (time 1790947727.59 total 30.02 last 71.28) - open/close 2650 (time 1790947737.60 total 40.03 last 67.13) - open/close 3220 (time 1790947747.60 total 50.03 last 56.98) - open/close 3767 (time 1790947757.62 total 60.05 last 54.60) - open/close 4423 (time 1790947767.63 total 70.06 last 65.55) - open/close 5125 (time 1790947777.63 total 80.06 last 70.16) - open/close 5758 (time 1790947787.63 total 90.07 last 63.28) - open/close 6447 (time 1790947797.64 total 100.07 last 68.86) - open/close 7064 (time 1790947807.65 total 110.08 last 61.63) - open/close 7707 (time 1790947817.66 total 120.09 last 64.26) - open/close 8325 (time 1790947827.66 total 130.09 last 61.79) - open/close 9004 (time 1790947837.68 total 140.12 last 67.72) - open/close 9691 (time 1790947847.70 total 150.13 last 68.60) total: 10000 open/close in 155.77 seconds: 64.20 ops/second llite.lustre-ffffa092905f8800.statahead_batch_max=0 llite.lustre-ffffa092905f8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa092905f8800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.284s user 0m0.365s sys 0m15.734s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa092905f8800.statahead_batch_max=256 llite.lustre-ffffa092905f8800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa092905f8800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.636s user 0m0.338s sys 0m14.976s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffffa092905f8800.batch_stats= snapshot_time: 1790947993.690429452 secs.nsecs start_time: 1790947928.875159127 secs.nsecs elapsed_time: 64.815270325 secs.nsecs subreqs per batch batches %% cum %% 1: 57 37 37 2: 15 9 47 4: 12 7 55 8: 4 2 57 16: 9 5 63 32: 14 9 73 64: 5 3 76 128: 0 0 76 256: 36 23 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffffa092905f8800.statahead_batch_max=64 llite.lustre-ffffa092905f8800.statahead_max=128