== sanity test 123ad: Verify batching statahead works correctly ========================================================== 08:57:05 (1781614625) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats=0 llite.lustre-ffff8ee404e2f000.statahead_max=32 llite.lustre-ffff8ee404e2f000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats=0 total: 100 open/close in 1.06 seconds: 94.37 ops/second llite.lustre-ffff8ee404e2f000.statahead_max=0 101 real 0m1.040s user 0m0.005s sys 0m0.313s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8ee404e2f000.statahead_max=32 llite.lustre-ffff8ee404e2f000.statahead_max=32 101 real 0m0.432s user 0m0.002s sys 0m0.281s 'ls -l' 100 files with statahead: 0 sec statahead total: 84 statahead wrong: 1 agl total: 80 list_total: 29 fname_total: 53 hit_total: 3623 miss_total: 235 swrong=1 ewrong=1 total: 900 open/close in 3.75 seconds: 239.95 ops/second llite.lustre-ffff8ee404e2f000.statahead_max=0 1001 real 0m10.415s user 0m0.029s sys 0m3.020s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff8ee404e2f000.statahead_max=32 llite.lustre-ffff8ee404e2f000.statahead_max=32 1001 real 0m4.496s user 0m0.017s sys 0m1.953s 'ls -l' 1000 files with statahead: 5 sec statahead total: 85 statahead wrong: 1 agl total: 81 list_total: 30 fname_total: 53 hit_total: 4622 miss_total: 236 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff8ee404e2f000.statahead_stats= statahead total: 85 statahead wrong: 1 agl total: 81 list_total: 30 fname_total: 53 hit_total: 4622 miss_total: 236 mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats= snapshot_time: 1781614663.357248425 secs.nsecs start_time: 1781614627.103537283 secs.nsecs elapsed_time: 36.253711142 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 1524 (time 1781614674.38 total 10.00 last 152.37) - open/close 3114 (time 1781614684.38 total 20.00 last 158.97) - open/close 4604 (time 1781614694.39 total 30.01 last 148.97) - open/close 6408 (time 1781614704.39 total 40.01 last 180.33) - open/close 8408 (time 1781614714.39 total 50.01 last 199.96) total: 10000 open/close in 58.10 seconds: 172.13 ops/second llite.lustre-ffff8ee404e2f000.statahead_batch_max=0 llite.lustre-ffff8ee404e2f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.431s user 0m0.290s sys 0m31.636s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ee404e2f000.statahead_batch_max=32 llite.lustre-ffff8ee404e2f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.299s user 0m0.248s sys 0m22.515s batched statahead RPC= hit count=9996 mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats= snapshot_time: 1781614813.199103455 secs.nsecs start_time: 1781614760.811515643 secs.nsecs elapsed_time: 52.387587812 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats=0 llite.lustre-ffff8ee404e2f000.statahead_max=2048 llite.lustre-ffff8ee404e2f000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats=0 total: 100 open/close in 0.93 seconds: 107.34 ops/second llite.lustre-ffff8ee404e2f000.statahead_max=0 101 real 0m1.139s user 0m0.000s sys 0m0.330s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8ee404e2f000.statahead_max=2048 llite.lustre-ffff8ee404e2f000.statahead_max=2048 101 real 0m0.424s user 0m0.003s sys 0m0.255s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10095 miss_total: 5 swrong=0 ewrong=0 total: 900 open/close in 3.72 seconds: 241.97 ops/second llite.lustre-ffff8ee404e2f000.statahead_max=0 1001 real 0m9.178s user 0m0.046s sys 0m2.852s 'ls -l' 1000 files without statahead: 9 sec llite.lustre-ffff8ee404e2f000.statahead_max=2048 llite.lustre-ffff8ee404e2f000.statahead_max=2048 1001 real 0m4.073s user 0m0.012s sys 0m1.473s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff8ee404e2f000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats= snapshot_time: 1781614972.277412342 secs.nsecs start_time: 1781614814.320174452 secs.nsecs elapsed_time: 157.957237890 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 2557 (time 1781614983.22 total 10.00 last 255.68) - open/close 4981 (time 1781614993.22 total 20.00 last 242.37) - open/close 7721 (time 1781615003.22 total 30.01 last 273.90) total: 10000 open/close in 39.04 seconds: 256.14 ops/second llite.lustre-ffff8ee404e2f000.statahead_batch_max=0 llite.lustre-ffff8ee404e2f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.050s user 0m0.251s sys 0m30.518s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ee404e2f000.statahead_batch_max=256 llite.lustre-ffff8ee404e2f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.165s user 0m0.217s sys 0m23.809s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8ee404e2f000.batch_stats= snapshot_time: 1781615091.617033150 secs.nsecs start_time: 1781615052.034689829 secs.nsecs elapsed_time: 39.582343321 secs.nsecs subreqs per batch batches %% cum %% 1: 363 67 67 2: 60 11 79 4: 35 6 85 8: 11 2 87 16: 7 1 89 32: 21 3 93 64: 3 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8ee404e2f000.statahead_batch_max=64 llite.lustre-ffff8ee404e2f000.statahead_max=128