== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:40:48 (1781001648) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats=0 llite.lustre-ffff8a88d063f000.statahead_max=32 llite.lustre-ffff8a88d063f000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats=0 total: 100 open/close in 2.19 seconds: 45.62 ops/second llite.lustre-ffff8a88d063f000.statahead_max=0 101 real 0m2.117s user 0m0.005s sys 0m0.357s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a88d063f000.statahead_max=32 llite.lustre-ffff8a88d063f000.statahead_max=32 101 real 0m1.535s user 0m0.000s sys 0m0.164s 'ls -l' 100 files with statahead: 2 sec statahead total: 134 statahead wrong: 2 agl total: 128 list_total: 30 fname_total: 89 hit_total: 4236 miss_total: 773 swrong=2 ewrong=2 - open/close 790 (time 1781001675.73 total 10.03 last 78.77) total: 900 open/close in 12.19 seconds: 73.81 ops/second llite.lustre-ffff8a88d063f000.statahead_max=0 1001 real 0m26.480s user 0m0.035s sys 0m3.168s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff8a88d063f000.statahead_max=32 llite.lustre-ffff8a88d063f000.statahead_max=32 1001 real 0m11.444s user 0m0.029s sys 0m1.439s 'ls -l' 1000 files with statahead: 12 sec statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 31 fname_total: 89 hit_total: 5233 miss_total: 776 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8a88d063f000.statahead_stats= statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 31 fname_total: 89 hit_total: 5233 miss_total: 776 mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats= snapshot_time: 1781001754.948423769 secs.nsecs start_time: 1781001652.702721888 secs.nsecs elapsed_time: 102.245701881 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 1 2 4 4: 0 0 4 8: 3 7 12 16: 2 4 17 32: 34 82 100 - open/close 805 (time 1781001767.68 total 10.01 last 80.45) - open/close 1613 (time 1781001777.68 total 20.01 last 80.77) - open/close 2358 (time 1781001787.68 total 30.01 last 74.47) - open/close 3053 (time 1781001797.69 total 40.03 last 69.42) - open/close 3716 (time 1781001807.72 total 50.05 last 66.16) - open/close 4432 (time 1781001817.72 total 60.05 last 71.58) - open/close 5150 (time 1781001827.73 total 70.06 last 71.72) - open/close 5887 (time 1781001837.74 total 80.07 last 73.66) - open/close 6538 (time 1781001847.74 total 90.07 last 65.08) - open/close 7194 (time 1781001857.74 total 100.07 last 65.58) - open/close 7927 (time 1781001867.75 total 110.08 last 73.25) - open/close 8636 (time 1781001877.75 total 120.09 last 70.86) - open/close 9325 (time 1781001887.76 total 130.09 last 68.88) total: 10000 open/close in 139.24 seconds: 71.82 ops/second llite.lustre-ffff8a88d063f000.statahead_batch_max=0 llite.lustre-ffff8a88d063f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a88d063f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.730s user 0m0.318s sys 0m15.553s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a88d063f000.statahead_batch_max=32 llite.lustre-ffff8a88d063f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a88d063f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m54.121s user 0m0.325s sys 0m14.679s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats= snapshot_time: 1781002112.816492650 secs.nsecs start_time: 1781001980.545477246 secs.nsecs elapsed_time: 132.271015404 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats=0 llite.lustre-ffff8a88d063f000.statahead_max=2048 llite.lustre-ffff8a88d063f000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats=0 total: 100 open/close in 2.60 seconds: 38.43 ops/second llite.lustre-ffff8a88d063f000.statahead_max=0 101 real 0m1.905s user 0m0.008s sys 0m0.331s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a88d063f000.statahead_max=2048 llite.lustre-ffff8a88d063f000.statahead_max=2048 101 real 0m0.886s user 0m0.007s sys 0m0.153s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 707 (time 1781002439.91 total 10.01 last 70.66) total: 900 open/close in 12.66 seconds: 71.09 ops/second llite.lustre-ffff8a88d063f000.statahead_max=0 1001 real 0m25.748s user 0m0.024s sys 0m3.175s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff8a88d063f000.statahead_max=2048 llite.lustre-ffff8a88d063f000.statahead_max=2048 1001 real 0m5.343s user 0m0.017s sys 0m1.380s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8a88d063f000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats= snapshot_time: 1781002509.062884986 secs.nsecs start_time: 1781002116.679346749 secs.nsecs elapsed_time: 392.383538237 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 827 (time 1781002521.85 total 10.00 last 82.69) - open/close 1580 (time 1781002531.86 total 20.01 last 75.24) - open/close 2355 (time 1781002541.86 total 30.01 last 77.47) - open/close 3050 (time 1781002551.87 total 40.02 last 69.41) - open/close 3801 (time 1781002561.87 total 50.03 last 75.08) - open/close 4295 (time 1781002571.90 total 60.06 last 49.25) - open/close 5047 (time 1781002581.92 total 70.07 last 75.10) - open/close 5889 (time 1781002591.92 total 80.07 last 84.17) - open/close 6582 (time 1781002601.92 total 90.08 last 69.27) - open/close 7369 (time 1781002611.93 total 100.08 last 78.69) - open/close 8115 (time 1781002621.93 total 110.09 last 74.54) - open/close 8841 (time 1781002631.94 total 120.09 last 72.59) - open/close 9667 (time 1781002641.94 total 130.09 last 82.59) total: 10000 open/close in 135.14 seconds: 74.00 ops/second llite.lustre-ffff8a88d063f000.statahead_batch_max=0 llite.lustre-ffff8a88d063f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a88d063f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m10.356s user 0m0.322s sys 0m15.396s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a88d063f000.statahead_batch_max=256 llite.lustre-ffff8a88d063f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a88d063f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m6.957s user 0m0.324s sys 0m15.472s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a88d063f000.batch_stats= snapshot_time: 1781002815.252843283 secs.nsecs start_time: 1781002730.879686685 secs.nsecs elapsed_time: 84.373156598 secs.nsecs subreqs per batch batches % cum % 1: 232 46 46 2: 98 19 66 4: 69 13 79 8: 32 6 86 16: 15 3 89 32: 19 3 93 64: 1 0 93 128: 1 0 93 256: 33 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a88d063f000.statahead_batch_max=64 llite.lustre-ffff8a88d063f000.statahead_max=128