== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:53:03 (1781239983) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats=0 llite.lustre-ffff9f90c7aeb800.statahead_max=32 llite.lustre-ffff9f90c7aeb800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats=0 total: 100 open/close in 3.01 seconds: 33.18 ops/second llite.lustre-ffff9f90c7aeb800.statahead_max=0 101 real 0m3.482s user 0m0.010s sys 0m0.413s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff9f90c7aeb800.statahead_max=32 llite.lustre-ffff9f90c7aeb800.statahead_max=32 101 real 0m1.374s user 0m0.005s sys 0m0.176s 'ls -l' 100 files with statahead: 1 sec statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 29 fname_total: 90 hit_total: 3849 miss_total: 1654 swrong=2 ewrong=2 - open/close 595 (time 1781240015.65 total 10.03 last 59.34) total: 900 open/close in 15.14 seconds: 59.46 ops/second llite.lustre-ffff9f90c7aeb800.statahead_max=0 1001 real 0m28.971s user 0m0.040s sys 0m3.467s 'ls -l' 1000 files without statahead: 29 sec llite.lustre-ffff9f90c7aeb800.statahead_max=32 llite.lustre-ffff9f90c7aeb800.statahead_max=32 1001 real 0m12.877s user 0m0.045s sys 0m1.795s 'ls -l' 1000 files with statahead: 13 sec statahead total: 121 statahead wrong: 2 agl total: 115 list_total: 30 fname_total: 90 hit_total: 4848 miss_total: 1655 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9f90c7aeb800.statahead_stats= statahead total: 121 statahead wrong: 2 agl total: 115 list_total: 30 fname_total: 90 hit_total: 4848 miss_total: 1655 mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats= snapshot_time: 1781240102.639046478 secs.nsecs start_time: 1781239988.895221047 secs.nsecs elapsed_time: 113.743825431 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 594 (time 1781240115.64 total 10.01 last 59.34) - open/close 1170 (time 1781240125.65 total 20.02 last 57.57) - open/close 1772 (time 1781240135.66 total 30.03 last 60.14) - open/close 2415 (time 1781240145.67 total 40.04 last 64.22) - open/close 3056 (time 1781240155.67 total 50.04 last 64.09) - open/close 3696 (time 1781240165.71 total 60.08 last 63.75) - open/close 4261 (time 1781240175.72 total 70.08 last 56.47) - open/close 4886 (time 1781240185.72 total 80.09 last 62.47) - open/close 5439 (time 1781240195.74 total 90.11 last 55.19) - open/close 6006 (time 1781240205.75 total 100.12 last 56.63) - open/close 6476 (time 1781240215.77 total 110.14 last 46.91) - open/close 7093 (time 1781240225.78 total 120.15 last 61.63) - open/close 7777 (time 1781240235.79 total 130.16 last 68.36) - open/close 8371 (time 1781240245.79 total 140.16 last 59.39) - open/close 8936 (time 1781240255.80 total 150.17 last 56.47) - open/close 9494 (time 1781240265.81 total 160.18 last 55.74) total: 10000 open/close in 169.00 seconds: 59.17 ops/second llite.lustre-ffff9f90c7aeb800.statahead_batch_max=0 llite.lustre-ffff9f90c7aeb800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.199s user 0m0.364s sys 0m18.150s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f90c7aeb800.statahead_batch_max=32 llite.lustre-ffff9f90c7aeb800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m1.772s user 0m0.332s sys 0m16.107s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats= snapshot_time: 1781240492.205178099 secs.nsecs start_time: 1781240355.754905312 secs.nsecs elapsed_time: 136.450272787 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats=0 llite.lustre-ffff9f90c7aeb800.statahead_max=2048 llite.lustre-ffff9f90c7aeb800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats=0 total: 100 open/close in 3.08 seconds: 32.43 ops/second llite.lustre-ffff9f90c7aeb800.statahead_max=0 101 real 0m3.273s user 0m0.008s sys 0m0.393s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff9f90c7aeb800.statahead_max=2048 llite.lustre-ffff9f90c7aeb800.statahead_max=2048 101 real 0m0.944s user 0m0.006s sys 0m0.183s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 653 (time 1781240895.02 total 10.00 last 65.28) total: 900 open/close in 14.51 seconds: 62.01 ops/second llite.lustre-ffff9f90c7aeb800.statahead_max=0 1001 real 0m28.504s user 0m0.033s sys 0m3.205s 'ls -l' 1000 files without statahead: 29 sec llite.lustre-ffff9f90c7aeb800.statahead_max=2048 llite.lustre-ffff9f90c7aeb800.statahead_max=2048 1001 real 0m6.908s user 0m0.024s sys 0m1.403s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff9f90c7aeb800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats= snapshot_time: 1781240973.149993073 secs.nsecs start_time: 1781240495.053916855 secs.nsecs elapsed_time: 478.096076218 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 0 0 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 599 (time 1781240986.02 total 10.01 last 59.81) - open/close 1143 (time 1781240996.03 total 20.03 last 54.33) - open/close 1715 (time 1781241006.04 total 30.03 last 57.19) - open/close 2274 (time 1781241016.05 total 40.04 last 55.83) - open/close 2820 (time 1781241026.07 total 50.06 last 54.49) - open/close 3398 (time 1781241036.08 total 60.07 last 57.77) - open/close 3950 (time 1781241046.08 total 70.08 last 55.16) - open/close 4532 (time 1781241056.08 total 80.08 last 58.19) - open/close 5182 (time 1781241066.10 total 90.10 last 64.87) - open/close 5811 (time 1781241076.13 total 100.12 last 62.74) - open/close 6376 (time 1781241086.14 total 110.14 last 56.42) - open/close 6939 (time 1781241096.15 total 120.14 last 56.29) - open/close 7514 (time 1781241106.15 total 130.14 last 57.49) - open/close 8113 (time 1781241116.15 total 140.14 last 59.88) - open/close 8668 (time 1781241126.15 total 150.15 last 55.47) - open/close 9214 (time 1781241136.16 total 160.15 last 54.59) - open/close 9798 (time 1781241146.16 total 170.15 last 58.38) total: 10000 open/close in 173.82 seconds: 57.53 ops/second llite.lustre-ffff9f90c7aeb800.statahead_batch_max=0 llite.lustre-ffff9f90c7aeb800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.633s user 0m0.382s sys 0m18.892s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f90c7aeb800.statahead_batch_max=256 llite.lustre-ffff9f90c7aeb800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.031s user 0m0.333s sys 0m17.381s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9f90c7aeb800.batch_stats= snapshot_time: 1781241305.617809244 secs.nsecs start_time: 1781241231.795865729 secs.nsecs elapsed_time: 73.821943515 secs.nsecs subreqs per batch batches % cum % 1: 159 47 47 2: 61 18 65 4: 37 10 76 8: 16 4 80 16: 11 3 84 32: 11 3 87 64: 8 2 89 128: 1 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9f90c7aeb800.statahead_batch_max=64 llite.lustre-ffff9f90c7aeb800.statahead_max=128