== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:33:10 (1781231590) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats=0 llite.lustre-ffffa015c8736800.statahead_max=32 llite.lustre-ffffa015c8736800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats=0 total: 100 open/close in 3.69 seconds: 27.07 ops/second llite.lustre-ffffa015c8736800.statahead_max=0 101 real 0m3.398s user 0m0.007s sys 0m0.360s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffffa015c8736800.statahead_max=32 llite.lustre-ffffa015c8736800.statahead_max=32 101 real 0m1.171s user 0m0.004s sys 0m0.192s 'ls -l' 100 files with statahead: 1 sec statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 111 hit_total: 4093 miss_total: 1286 swrong=2 ewrong=2 - open/close 567 (time 1781231621.75 total 10.01 last 56.66) total: 900 open/close in 15.83 seconds: 56.87 ops/second llite.lustre-ffffa015c8736800.statahead_max=0 1001 real 0m25.206s user 0m0.035s sys 0m3.293s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffffa015c8736800.statahead_max=32 llite.lustre-ffffa015c8736800.statahead_max=32 1001 real 0m12.522s user 0m0.037s sys 0m1.660s 'ls -l' 1000 files with statahead: 13 sec statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 111 hit_total: 5089 miss_total: 1290 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 30 seconds llite.lustre-ffffa015c8736800.statahead_stats= statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 111 hit_total: 5089 miss_total: 1290 mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats= snapshot_time: 1781231712.707759221 secs.nsecs start_time: 1781231596.236805540 secs.nsecs elapsed_time: 116.470953681 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 537 (time 1781231725.40 total 10.01 last 53.63) - open/close 1038 (time 1781231735.42 total 20.03 last 50.03) - open/close 1555 (time 1781231745.42 total 30.03 last 51.67) - open/close 2135 (time 1781231755.42 total 40.03 last 57.99) - open/close 2685 (time 1781231765.43 total 50.04 last 54.97) - open/close 3237 (time 1781231775.44 total 60.05 last 55.17) - open/close 3805 (time 1781231785.47 total 70.08 last 56.62) - open/close 4388 (time 1781231795.48 total 80.09 last 58.21) - open/close 4950 (time 1781231805.50 total 90.10 last 56.13) - open/close 5516 (time 1781231815.51 total 100.11 last 56.54) - open/close 6130 (time 1781231825.51 total 110.12 last 61.37) - open/close 6707 (time 1781231835.53 total 120.14 last 57.58) - open/close 7315 (time 1781231845.54 total 130.15 last 60.76) - open/close 7911 (time 1781231855.56 total 140.17 last 59.46) - open/close 8508 (time 1781231865.59 total 150.19 last 59.56) - open/close 9060 (time 1781231875.59 total 160.20 last 55.18) - open/close 9572 (time 1781231885.59 total 170.20 last 51.19) total: 10000 open/close in 179.75 seconds: 55.63 ops/second llite.lustre-ffffa015c8736800.statahead_batch_max=0 llite.lustre-ffffa015c8736800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa015c8736800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m14.302s user 0m0.352s sys 0m16.447s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa015c8736800.statahead_batch_max=32 llite.lustre-ffffa015c8736800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa015c8736800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m59.609s user 0m0.360s sys 0m16.274s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats= snapshot_time: 1781232119.894854322 secs.nsecs start_time: 1781231982.454797979 secs.nsecs elapsed_time: 137.440056343 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats=0 llite.lustre-ffffa015c8736800.statahead_max=2048 llite.lustre-ffffa015c8736800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats=0 total: 100 open/close in 3.90 seconds: 25.67 ops/second llite.lustre-ffffa015c8736800.statahead_max=0 101 real 0m2.872s user 0m0.009s sys 0m0.350s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffffa015c8736800.statahead_max=2048 llite.lustre-ffffa015c8736800.statahead_max=2048 101 real 0m1.185s user 0m0.002s sys 0m0.201s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 - open/close 456 (time 1781232530.50 total 10.01 last 45.53) total: 900 open/close in 18.23 seconds: 49.37 ops/second llite.lustre-ffffa015c8736800.statahead_max=0 1001 real 0m30.827s user 0m0.037s sys 0m3.685s 'ls -l' 1000 files without statahead: 30 sec llite.lustre-ffffa015c8736800.statahead_max=2048 llite.lustre-ffffa015c8736800.statahead_max=2048 1001 real 0m8.663s user 0m0.023s sys 0m1.473s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 28 seconds llite.lustre-ffffa015c8736800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats= snapshot_time: 1781232620.060374821 secs.nsecs start_time: 1781232122.996742137 secs.nsecs elapsed_time: 497.063632684 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 1 10 60 128: 0 0 60 256: 4 40 100 - open/close 519 (time 1781232633.37 total 10.01 last 51.84) - open/close 956 (time 1781232643.39 total 20.03 last 43.62) - open/close 1404 (time 1781232653.40 total 30.04 last 44.77) - open/close 1911 (time 1781232663.41 total 40.05 last 50.65) - open/close 2541 (time 1781232673.41 total 50.05 last 62.97) - open/close 3101 (time 1781232683.42 total 60.06 last 55.93) - open/close 3640 (time 1781232693.43 total 70.07 last 53.88) - open/close 4194 (time 1781232703.43 total 80.07 last 55.38) - open/close 4758 (time 1781232713.44 total 90.08 last 56.34) - open/close 5316 (time 1781232723.45 total 100.09 last 55.77) - open/close 5849 (time 1781232733.45 total 110.09 last 53.27) - open/close 6346 (time 1781232743.47 total 120.10 last 49.63) - open/close 6865 (time 1781232753.48 total 130.12 last 51.84) - open/close 7319 (time 1781232763.49 total 140.13 last 45.34) - open/close 7794 (time 1781232773.50 total 150.14 last 47.46) - open/close 8306 (time 1781232783.50 total 160.14 last 51.17) - open/close 8847 (time 1781232793.51 total 170.15 last 54.08) - open/close 9391 (time 1781232803.54 total 180.18 last 54.22) - open/close 9917 (time 1781232813.54 total 190.18 last 52.58) total: 10000 open/close in 191.78 seconds: 52.14 ops/second llite.lustre-ffffa015c8736800.statahead_batch_max=0 llite.lustre-ffffa015c8736800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa015c8736800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m17.505s user 0m0.326s sys 0m16.484s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa015c8736800.statahead_batch_max=256 llite.lustre-ffffa015c8736800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa015c8736800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.247s user 0m0.300s sys 0m16.756s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffffa015c8736800.batch_stats= snapshot_time: 1781232990.705357213 secs.nsecs start_time: 1781232904.378626440 secs.nsecs elapsed_time: 86.326730773 secs.nsecs subreqs per batch batches % cum % 1: 146 46 46 2: 50 16 62 4: 25 8 70 8: 19 6 76 16: 16 5 82 32: 15 4 86 64: 5 1 88 128: 2 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffffa015c8736800.statahead_batch_max=64 llite.lustre-ffffa015c8736800.statahead_max=128