== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:44:52 (1786117492) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats=0 llite.lustre-ffff9e47d90a7000.statahead_max=32 llite.lustre-ffff9e47d90a7000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.69 seconds: 145.15 ops/second llite.lustre-ffff9e47d90a7000.statahead_max=0 101 real 0m0.678s user 0m0.002s sys 0m0.293s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9e47d90a7000.statahead_max=32 llite.lustre-ffff9e47d90a7000.statahead_max=32 101 real 0m0.538s user 0m0.002s sys 0m0.286s 'ls -l' 100 files with statahead: 1 sec statahead total: 94 statahead wrong: 1 agl total: 89 list_total: 28 fname_total: 65 hit_total: 14003 miss_total: 240 swrong=1 ewrong=1 total: 900 open/close in 1.94 seconds: 464.88 ops/second llite.lustre-ffff9e47d90a7000.statahead_max=0 1001 real 0m7.235s user 0m0.024s sys 0m2.710s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff9e47d90a7000.statahead_max=32 llite.lustre-ffff9e47d90a7000.statahead_max=32 1001 real 0m4.142s user 0m0.016s sys 0m1.934s 'ls -l' 1000 files with statahead: 5 sec statahead total: 95 statahead wrong: 1 agl total: 90 list_total: 29 fname_total: 65 hit_total: 15002 miss_total: 241 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff9e47d90a7000.statahead_stats= statahead total: 95 statahead wrong: 1 agl total: 90 list_total: 29 fname_total: 65 hit_total: 15002 miss_total: 241 mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117521.562766928 secs.nsecs start_time: 1786117494.444538413 secs.nsecs elapsed_time: 27.118228515 secs.nsecs subreqs per batch batches %% cum %% 1: 3 7 7 2: 1 2 9 4: 2 4 14 8: 1 2 17 16: 21 51 68 32: 13 31 100 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117521.562842508 secs.nsecs start_time: 1786117494.444600403 secs.nsecs elapsed_time: 27.118242105 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 2 5 7 8: 5 12 20 16: 20 50 70 32: 12 30 100 - open/close 4321 (time 1786117532.86 total 10.00 last 432.06) - open/close 7389 (time 1786117542.86 total 20.00 last 306.71) total: 10000 open/close in 29.33 seconds: 340.95 ops/second llite.lustre-ffff9e47d90a7000.statahead_batch_max=0 llite.lustre-ffff9e47d90a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.033s user 0m0.146s sys 0m36.747s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9e47d90a7000.statahead_batch_max=32 llite.lustre-ffff9e47d90a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.085s user 0m0.162s sys 0m24.245s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117644.766622961 secs.nsecs start_time: 1786117595.461343377 secs.nsecs elapsed_time: 49.305279584 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117644.766664394 secs.nsecs start_time: 1786117595.461395442 secs.nsecs elapsed_time: 49.305268952 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats=0 llite.lustre-ffff9e47d90a7000.statahead_max=2048 llite.lustre-ffff9e47d90a7000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.02 seconds: 97.92 ops/second llite.lustre-ffff9e47d90a7000.statahead_max=0 101 real 0m0.674s user 0m0.001s sys 0m0.279s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9e47d90a7000.statahead_max=2048 llite.lustre-ffff9e47d90a7000.statahead_max=2048 101 real 0m0.371s user 0m0.002s sys 0m0.245s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.87 seconds: 481.13 ops/second llite.lustre-ffff9e47d90a7000.statahead_max=0 1001 real 0m6.168s user 0m0.023s sys 0m2.323s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9e47d90a7000.statahead_max=2048 llite.lustre-ffff9e47d90a7000.statahead_max=2048 1001 real 0m3.759s user 0m0.019s sys 0m1.615s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff9e47d90a7000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117769.476483076 secs.nsecs start_time: 1786117645.799771259 secs.nsecs elapsed_time: 123.676711817 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 11 11 4: 2 22 33 8: 1 11 44 16: 2 22 66 32: 1 11 77 64: 0 0 77 128: 0 0 77 256: 2 22 100 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117769.476539682 secs.nsecs start_time: 1786117645.799892448 secs.nsecs elapsed_time: 123.676647234 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 11 11 8: 5 55 66 16: 0 0 66 32: 0 0 66 64: 1 11 77 128: 0 0 77 256: 2 22 100 - open/close 1719 (time 1786117780.99 total 10.00 last 171.90) - open/close 4575 (time 1786117790.99 total 20.00 last 285.56) - open/close 9489 (time 1786117800.99 total 30.00 last 491.32) total: 10000 open/close in 31.04 seconds: 322.19 ops/second llite.lustre-ffff9e47d90a7000.statahead_batch_max=0 llite.lustre-ffff9e47d90a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.887s user 0m0.150s sys 0m26.627s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9e47d90a7000.statahead_batch_max=256 llite.lustre-ffff9e47d90a7000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m25.851s user 0m0.143s sys 0m19.236s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117868.110335333 secs.nsecs start_time: 1786117836.692907072 secs.nsecs elapsed_time: 31.417428261 secs.nsecs subreqs per batch batches %% cum %% 1: 343 62 62 2: 93 16 78 4: 44 7 86 8: 11 1 88 16: 3 0 89 32: 22 3 93 64: 2 0 93 128: 0 0 93 256: 34 6 100 mdc.lustre-MDT0001-mdc-ffff9e47d90a7000.batch_stats= snapshot_time: 1786117868.110387980 secs.nsecs start_time: 1786117836.692958847 secs.nsecs elapsed_time: 31.417429133 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9e47d90a7000.statahead_batch_max=64 llite.lustre-ffff9e47d90a7000.statahead_max=128