== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:06:36 (1786176396) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats=0 llite.lustre-ffff95705368e800.statahead_max=32 llite.lustre-ffff95705368e800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats=0 total: 100 open/close in 3.07 seconds: 32.57 ops/second llite.lustre-ffff95705368e800.statahead_max=0 101 real 0m2.360s user 0m0.004s sys 0m0.393s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff95705368e800.statahead_max=32 llite.lustre-ffff95705368e800.statahead_max=32 101 real 0m1.380s user 0m0.005s sys 0m0.202s 'ls -l' 100 files with statahead: 2 sec statahead total: 148 statahead wrong: 1 agl total: 134 list_total: 30 fname_total: 117 hit_total: 3656 miss_total: 259 swrong=1 ewrong=1 - open/close 586 (time 1786176426.77 total 10.01 last 58.56) total: 900 open/close in 15.45 seconds: 58.24 ops/second llite.lustre-ffff95705368e800.statahead_max=0 1001 real 0m21.699s user 0m0.036s sys 0m3.419s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff95705368e800.statahead_max=32 llite.lustre-ffff95705368e800.statahead_max=32 1001 real 0m10.585s user 0m0.036s sys 0m1.635s 'ls -l' 1000 files with statahead: 11 sec statahead total: 149 statahead wrong: 1 agl total: 135 list_total: 31 fname_total: 117 hit_total: 4655 miss_total: 260 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 26 seconds llite.lustre-ffff95705368e800.statahead_stats= statahead total: 149 statahead wrong: 1 agl total: 135 list_total: 31 fname_total: 117 hit_total: 4655 miss_total: 260 mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats= snapshot_time: 1786176506.723007843 secs.nsecs start_time: 1786176402.825210556 secs.nsecs elapsed_time: 103.897797287 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 595 (time 1786176520.48 total 10.01 last 59.46) - open/close 1219 (time 1786176530.48 total 20.01 last 62.38) - open/close 1848 (time 1786176540.49 total 30.02 last 62.86) - open/close 2462 (time 1786176550.50 total 40.03 last 61.32) - open/close 3019 (time 1786176560.52 total 50.04 last 55.61) - open/close 3559 (time 1786176570.54 total 60.07 last 53.87) - open/close 4101 (time 1786176580.54 total 70.07 last 54.20) - open/close 4697 (time 1786176590.55 total 80.08 last 59.54) - open/close 5265 (time 1786176600.57 total 90.09 last 56.73) - open/close 5839 (time 1786176610.58 total 100.10 last 57.33) - open/close 6412 (time 1786176620.59 total 110.12 last 57.23) - open/close 6971 (time 1786176630.59 total 120.12 last 55.88) - open/close 7560 (time 1786176640.61 total 130.13 last 58.82) - open/close 8152 (time 1786176650.62 total 140.14 last 59.13) - open/close 8722 (time 1786176660.62 total 150.15 last 56.99) - open/close 9333 (time 1786176670.63 total 160.16 last 61.03) - open/close 9923 (time 1786176680.64 total 170.17 last 58.94) total: 10000 open/close in 171.50 seconds: 58.31 ops/second llite.lustre-ffff95705368e800.statahead_batch_max=0 llite.lustre-ffff95705368e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff95705368e800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m28.913s user 0m0.348s sys 0m17.790s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff95705368e800.statahead_batch_max=32 llite.lustre-ffff95705368e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff95705368e800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m2.207s user 0m0.352s sys 0m15.823s batched statahead RPC= hit count=9996 mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats= snapshot_time: 1786176917.580174739 secs.nsecs start_time: 1786176779.929610717 secs.nsecs elapsed_time: 137.650564022 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats=0 llite.lustre-ffff95705368e800.statahead_max=2048 llite.lustre-ffff95705368e800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats=0 total: 100 open/close in 3.60 seconds: 27.74 ops/second llite.lustre-ffff95705368e800.statahead_max=0 101 real 0m2.417s user 0m0.004s sys 0m0.349s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff95705368e800.statahead_max=2048 llite.lustre-ffff95705368e800.statahead_max=2048 101 real 0m1.382s user 0m0.003s sys 0m0.185s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10095 miss_total: 5 swrong=0 ewrong=0 - open/close 558 (time 1786177315.91 total 10.02 last 55.71) total: 900 open/close in 16.08 seconds: 55.96 ops/second llite.lustre-ffff95705368e800.statahead_max=0 1001 real 0m19.310s user 0m0.039s sys 0m3.220s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff95705368e800.statahead_max=2048 llite.lustre-ffff95705368e800.statahead_max=2048 1001 real 0m8.054s user 0m0.029s sys 0m1.483s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff95705368e800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats= snapshot_time: 1786177388.533353754 secs.nsecs start_time: 1786176920.896366153 secs.nsecs elapsed_time: 467.636987601 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 640 (time 1786177402.96 total 10.00 last 63.97) - open/close 1209 (time 1786177412.97 total 20.01 last 56.87) - open/close 1805 (time 1786177422.98 total 30.03 last 59.49) - open/close 2436 (time 1786177433.00 total 40.04 last 63.00) - open/close 2987 (time 1786177443.01 total 50.06 last 55.03) - open/close 3613 (time 1786177453.05 total 60.09 last 62.38) - open/close 4225 (time 1786177463.06 total 70.11 last 61.11) - open/close 4803 (time 1786177473.07 total 80.12 last 57.74) - open/close 5373 (time 1786177483.08 total 90.13 last 56.94) - open/close 5967 (time 1786177493.10 total 100.14 last 59.32) - open/close 6515 (time 1786177503.11 total 110.16 last 54.71) - open/close 7103 (time 1786177513.13 total 120.17 last 58.69) - open/close 7644 (time 1786177523.14 total 130.18 last 54.08) - open/close 8213 (time 1786177533.14 total 140.18 last 56.89) - open/close 8741 (time 1786177543.16 total 150.21 last 52.67) - open/close 9291 (time 1786177553.17 total 160.21 last 54.96) - open/close 9850 (time 1786177563.18 total 170.22 last 55.86) total: 10000 open/close in 172.84 seconds: 57.86 ops/second llite.lustre-ffff95705368e800.statahead_batch_max=0 llite.lustre-ffff95705368e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff95705368e800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m25.367s user 0m0.328s sys 0m16.966s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff95705368e800.statahead_batch_max=256 llite.lustre-ffff95705368e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff95705368e800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.508s user 0m0.319s sys 0m15.766s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff95705368e800.batch_stats= snapshot_time: 1786177741.850569881 secs.nsecs start_time: 1786177662.036556068 secs.nsecs elapsed_time: 79.814013813 secs.nsecs subreqs per batch batches %% cum %% 1: 151 52 52 2: 35 12 64 4: 20 6 71 8: 12 4 75 16: 16 5 81 32: 13 4 85 64: 6 2 87 128: 0 0 87 256: 35 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff95705368e800.statahead_batch_max=64 llite.lustre-ffff95705368e800.statahead_max=128