== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:39:04 (1788802744) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats=0 llite.lustre-ffff91e376a48000.statahead_max=32 llite.lustre-ffff91e376a48000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats=0 total: 100 open/close in 2.74 seconds: 36.47 ops/second llite.lustre-ffff91e376a48000.statahead_max=0 101 real 0m1.899s user 0m0.007s sys 0m0.297s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff91e376a48000.statahead_max=32 llite.lustre-ffff91e376a48000.statahead_max=32 101 real 0m1.139s user 0m0.005s sys 0m0.159s 'ls -l' 100 files with statahead: 2 sec statahead total: 125 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 71 hit_total: 4326 miss_total: 1287 swrong=2 ewrong=2 - open/close 814 (time 1788802772.94 total 10.01 last 81.34) total: 900 open/close in 11.41 seconds: 78.85 ops/second llite.lustre-ffff91e376a48000.statahead_max=0 1001 real 0m23.722s user 0m0.033s sys 0m2.884s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff91e376a48000.statahead_max=32 llite.lustre-ffff91e376a48000.statahead_max=32 1001 real 0m8.777s user 0m0.033s sys 0m1.300s 'ls -l' 1000 files with statahead: 9 sec statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 71 hit_total: 5323 miss_total: 1290 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff91e376a48000.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 71 hit_total: 5323 miss_total: 1290 mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats= snapshot_time: 1788802846.593590033 secs.nsecs start_time: 1788802750.099560904 secs.nsecs elapsed_time: 96.494029129 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 747 (time 1788802859.73 total 10.01 last 74.61) - open/close 1513 (time 1788802869.73 total 20.01 last 76.59) - open/close 2335 (time 1788802879.74 total 30.02 last 82.11) - open/close 3100 (time 1788802889.75 total 40.03 last 76.46) - open/close 3956 (time 1788802899.75 total 50.03 last 85.58) - open/close 4691 (time 1788802909.76 total 60.04 last 73.45) - open/close 5430 (time 1788802919.76 total 70.05 last 73.84) - open/close 6209 (time 1788802929.77 total 80.05 last 77.87) - open/close 7022 (time 1788802939.77 total 90.05 last 81.28) - open/close 7793 (time 1788802949.78 total 100.06 last 77.03) - open/close 8480 (time 1788802959.78 total 110.07 last 68.67) - open/close 9108 (time 1788802969.80 total 120.08 last 62.71) - open/close 9852 (time 1788802979.81 total 130.09 last 74.34) total: 10000 open/close in 132.33 seconds: 75.57 ops/second llite.lustre-ffff91e376a48000.statahead_batch_max=0 llite.lustre-ffff91e376a48000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91e376a48000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.450s user 0m0.299s sys 0m13.821s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff91e376a48000.statahead_batch_max=32 llite.lustre-ffff91e376a48000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff91e376a48000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m37.446s user 0m0.262s sys 0m12.692s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats= snapshot_time: 1788803162.180924599 secs.nsecs start_time: 1788803053.579209421 secs.nsecs elapsed_time: 108.601715178 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats=0 llite.lustre-ffff91e376a48000.statahead_max=2048 llite.lustre-ffff91e376a48000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats=0 total: 100 open/close in 2.56 seconds: 39.06 ops/second llite.lustre-ffff91e376a48000.statahead_max=0 101 real 0m1.829s user 0m0.005s sys 0m0.295s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff91e376a48000.statahead_max=2048 llite.lustre-ffff91e376a48000.statahead_max=2048 101 real 0m1.056s user 0m0.005s sys 0m0.137s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 - open/close 799 (time 1788803445.40 total 10.01 last 79.84) total: 900 open/close in 11.45 seconds: 78.63 ops/second llite.lustre-ffff91e376a48000.statahead_max=0 1001 real 0m24.265s user 0m0.023s sys 0m2.884s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff91e376a48000.statahead_max=2048 llite.lustre-ffff91e376a48000.statahead_max=2048 1001 real 0m6.793s user 0m0.033s sys 0m1.313s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff91e376a48000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats= snapshot_time: 1788803510.477593654 secs.nsecs start_time: 1788803164.926327882 secs.nsecs elapsed_time: 345.551265772 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 957 (time 1788803522.76 total 10.00 last 95.67) - open/close 1818 (time 1788803532.76 total 20.01 last 86.08) - open/close 2682 (time 1788803542.78 total 30.02 last 86.28) - open/close 3379 (time 1788803552.78 total 40.02 last 69.69) - open/close 4300 (time 1788803562.79 total 50.03 last 92.02) - open/close 5105 (time 1788803572.79 total 60.03 last 80.47) - open/close 5974 (time 1788803582.80 total 70.04 last 86.85) - open/close 6830 (time 1788803592.80 total 80.04 last 85.59) - open/close 7603 (time 1788803602.81 total 90.05 last 77.20) - open/close 8316 (time 1788803612.81 total 100.05 last 71.30) - open/close 9067 (time 1788803622.82 total 110.06 last 75.05) - open/close 9941 (time 1788803632.82 total 120.07 last 87.34) total: 10000 open/close in 120.68 seconds: 82.86 ops/second llite.lustre-ffff91e376a48000.statahead_batch_max=0 llite.lustre-ffff91e376a48000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91e376a48000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m16.179s user 0m0.311s sys 0m14.089s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff91e376a48000.statahead_batch_max=256 llite.lustre-ffff91e376a48000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff91e376a48000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.089s user 0m0.299s sys 0m13.415s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff91e376a48000.batch_stats= snapshot_time: 1788803784.636901216 secs.nsecs start_time: 1788803720.027377275 secs.nsecs elapsed_time: 64.609523941 secs.nsecs subreqs per batch batches %% cum %% 1: 95 44 44 2: 18 8 52 4: 18 8 60 8: 12 5 66 16: 14 6 73 32: 17 7 80 64: 5 2 83 128: 1 0 83 256: 35 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff91e376a48000.statahead_batch_max=64 llite.lustre-ffff91e376a48000.statahead_max=128