== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:01:54 (1786806114) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats=0 llite.lustre-ffff9cec097b6000.statahead_max=32 llite.lustre-ffff9cec097b6000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats=0 total: 100 open/close in 2.28 seconds: 43.84 ops/second llite.lustre-ffff9cec097b6000.statahead_max=0 101 real 0m2.188s user 0m0.003s sys 0m0.328s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9cec097b6000.statahead_max=32 llite.lustre-ffff9cec097b6000.statahead_max=32 101 real 0m0.802s user 0m0.003s sys 0m0.199s 'ls -l' 100 files with statahead: 1 sec statahead total: 103 statahead wrong: 2 agl total: 97 list_total: 31 fname_total: 65 hit_total: 4478 miss_total: 1290 swrong=2 ewrong=2 - open/close 867 (time 1786806137.78 total 10.00 last 86.69) total: 900 open/close in 10.43 seconds: 86.32 ops/second llite.lustre-ffff9cec097b6000.statahead_max=0 1001 real 0m18.144s user 0m0.027s sys 0m2.975s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff9cec097b6000.statahead_max=32 llite.lustre-ffff9cec097b6000.statahead_max=32 1001 real 0m8.344s user 0m0.035s sys 0m1.623s 'ls -l' 1000 files with statahead: 8 sec statahead total: 104 statahead wrong: 2 agl total: 98 list_total: 32 fname_total: 65 hit_total: 5477 miss_total: 1291 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff9cec097b6000.statahead_stats= statahead total: 104 statahead wrong: 2 agl total: 98 list_total: 32 fname_total: 65 hit_total: 5477 miss_total: 1291 mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats= snapshot_time: 1786806192.818130122 secs.nsecs start_time: 1786806117.634242129 secs.nsecs elapsed_time: 75.183887993 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 764 (time 1786806205.02 total 10.01 last 76.34) - open/close 1627 (time 1786806215.02 total 20.01 last 86.29) - open/close 2492 (time 1786806225.03 total 30.02 last 86.44) - open/close 3294 (time 1786806235.03 total 40.02 last 80.16) - open/close 4133 (time 1786806245.03 total 50.02 last 83.88) - open/close 5026 (time 1786806255.04 total 60.03 last 89.29) - open/close 5890 (time 1786806265.06 total 70.05 last 86.18) - open/close 6754 (time 1786806275.06 total 80.05 last 86.39) - open/close 7611 (time 1786806285.09 total 90.08 last 85.44) - open/close 8448 (time 1786806295.09 total 100.08 last 83.69) - open/close 9277 (time 1786806305.10 total 110.09 last 82.87) total: 10000 open/close in 118.84 seconds: 84.15 ops/second llite.lustre-ffff9cec097b6000.statahead_batch_max=0 llite.lustre-ffff9cec097b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cec097b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.986s user 0m0.303s sys 0m15.733s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cec097b6000.statahead_batch_max=32 llite.lustre-ffff9cec097b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cec097b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m34.085s user 0m0.297s sys 0m15.449s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats= snapshot_time: 1786806498.872682905 secs.nsecs start_time: 1786806392.530647115 secs.nsecs elapsed_time: 106.342035790 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats=0 llite.lustre-ffff9cec097b6000.statahead_max=2048 llite.lustre-ffff9cec097b6000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats=0 total: 100 open/close in 2.62 seconds: 38.10 ops/second llite.lustre-ffff9cec097b6000.statahead_max=0 101 real 0m1.809s user 0m0.003s sys 0m0.318s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9cec097b6000.statahead_max=2048 llite.lustre-ffff9cec097b6000.statahead_max=2048 101 real 0m0.864s user 0m0.003s sys 0m0.173s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 771 (time 1786806800.35 total 10.00 last 77.06) total: 900 open/close in 11.77 seconds: 76.44 ops/second llite.lustre-ffff9cec097b6000.statahead_max=0 1001 real 0m20.527s user 0m0.032s sys 0m3.068s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9cec097b6000.statahead_max=2048 llite.lustre-ffff9cec097b6000.statahead_max=2048 1001 real 0m6.997s user 0m0.031s sys 0m1.536s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9cec097b6000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats= snapshot_time: 1786806861.947234245 secs.nsecs start_time: 1786806501.242359014 secs.nsecs elapsed_time: 360.704875231 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 793 (time 1786806874.44 total 10.00 last 79.27) - open/close 1531 (time 1786806884.45 total 20.02 last 73.66) - open/close 2361 (time 1786806894.46 total 30.02 last 82.98) - open/close 3181 (time 1786806904.46 total 40.02 last 81.99) - open/close 3988 (time 1786806914.47 total 50.04 last 80.57) - open/close 4785 (time 1786806924.47 total 60.04 last 79.70) - open/close 5625 (time 1786806934.49 total 70.05 last 83.89) - open/close 6464 (time 1786806944.52 total 80.09 last 83.63) - open/close 7252 (time 1786806954.53 total 90.09 last 78.74) - open/close 8092 (time 1786806964.54 total 100.11 last 83.88) - open/close 8888 (time 1786806974.55 total 110.11 last 79.56) - open/close 9669 (time 1786806984.55 total 120.12 last 78.05) total: 10000 open/close in 124.22 seconds: 80.50 ops/second llite.lustre-ffff9cec097b6000.statahead_batch_max=0 llite.lustre-ffff9cec097b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cec097b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.624s user 0m0.283s sys 0m18.197s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cec097b6000.statahead_batch_max=256 llite.lustre-ffff9cec097b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cec097b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.173s user 0m0.280s sys 0m16.078s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9cec097b6000.batch_stats= snapshot_time: 1786807113.887973206 secs.nsecs start_time: 1786807050.040241199 secs.nsecs elapsed_time: 63.847732007 secs.nsecs subreqs per batch batches %% cum %% 1: 226 54 54 2: 60 14 69 4: 35 8 77 8: 19 4 82 16: 12 2 85 32: 20 4 90 64: 5 1 91 128: 2 0 91 256: 33 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9cec097b6000.statahead_batch_max=64 llite.lustre-ffff9cec097b6000.statahead_max=128