== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:13:42 (1781234022) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats=0 llite.lustre-ffff9a9287da0800.statahead_max=32 llite.lustre-ffff9a9287da0800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.50 seconds: 66.72 ops/second llite.lustre-ffff9a9287da0800.statahead_max=0 101 real 0m1.348s user 0m0.006s sys 0m0.303s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a9287da0800.statahead_max=32 llite.lustre-ffff9a9287da0800.statahead_max=32 101 real 0m0.581s user 0m0.003s sys 0m0.217s 'ls -l' 100 files with statahead: 1 sec statahead total: 95 statahead wrong: 2 agl total: 91 list_total: 28 fname_total: 52 hit_total: 3915 miss_total: 883 swrong=2 ewrong=2 total: 900 open/close in 6.87 seconds: 131.01 ops/second llite.lustre-ffff9a9287da0800.statahead_max=0 1001 real 0m12.547s user 0m0.036s sys 0m2.849s 'ls -l' 1000 files without statahead: 13 sec llite.lustre-ffff9a9287da0800.statahead_max=32 llite.lustre-ffff9a9287da0800.statahead_max=32 1001 real 0m4.682s user 0m0.020s sys 0m1.758s 'ls -l' 1000 files with statahead: 5 sec statahead total: 96 statahead wrong: 2 agl total: 92 list_total: 29 fname_total: 52 hit_total: 4913 miss_total: 885 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff9a9287da0800.statahead_stats= statahead total: 96 statahead wrong: 2 agl total: 92 list_total: 29 fname_total: 52 hit_total: 4913 miss_total: 885 mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234069.720337825 secs.nsecs start_time: 1781234024.864805715 secs.nsecs elapsed_time: 44.855532110 secs.nsecs subreqs per batch batches % cum % 1: 2 5 5 2: 0 0 5 4: 1 2 7 8: 4 10 17 16: 17 42 60 32: 16 40 100 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234069.720393189 secs.nsecs start_time: 1781234024.864875041 secs.nsecs elapsed_time: 44.855518148 secs.nsecs subreqs per batch batches % cum % 1: 2 4 4 2: 1 2 7 4: 3 7 14 8: 1 2 17 16: 22 53 70 32: 12 29 100 - open/close 1656 (time 1781234081.06 total 10.00 last 165.57) - open/close 3206 (time 1781234091.07 total 20.01 last 154.87) - open/close 4605 (time 1781234101.07 total 30.01 last 139.88) - open/close 6124 (time 1781234111.08 total 40.02 last 151.77) - open/close 7585 (time 1781234121.08 total 50.02 last 146.08) - open/close 9054 (time 1781234131.08 total 60.02 last 146.87) total: 10000 open/close in 66.17 seconds: 151.13 ops/second llite.lustre-ffff9a9287da0800.statahead_batch_max=0 llite.lustre-ffff9a9287da0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a9287da0800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a9287da0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.242s user 0m0.279s sys 0m35.197s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a9287da0800.statahead_batch_max=32 llite.lustre-ffff9a9287da0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a9287da0800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a9287da0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.684s user 0m0.222s sys 0m17.803s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234245.217749835 secs.nsecs start_time: 1781234184.057724858 secs.nsecs elapsed_time: 61.160024977 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234245.217822247 secs.nsecs start_time: 1781234184.057786192 secs.nsecs elapsed_time: 61.160036055 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats=0 llite.lustre-ffff9a9287da0800.statahead_max=2048 llite.lustre-ffff9a9287da0800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.25 seconds: 80.28 ops/second llite.lustre-ffff9a9287da0800.statahead_max=0 101 real 0m1.272s user 0m0.004s sys 0m0.309s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a9287da0800.statahead_max=2048 llite.lustre-ffff9a9287da0800.statahead_max=2048 101 real 0m0.426s user 0m0.006s sys 0m0.193s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 total: 900 open/close in 5.00 seconds: 180.07 ops/second llite.lustre-ffff9a9287da0800.statahead_max=0 1001 real 0m11.686s user 0m0.024s sys 0m2.901s 'ls -l' 1000 files without statahead: 12 sec llite.lustre-ffff9a9287da0800.statahead_max=2048 llite.lustre-ffff9a9287da0800.statahead_max=2048 1001 real 0m3.806s user 0m0.018s sys 0m1.394s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff9a9287da0800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234438.990316779 secs.nsecs start_time: 1781234246.463763856 secs.nsecs elapsed_time: 192.526552923 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 12 12 8: 3 37 50 16: 1 12 62 32: 1 12 75 64: 0 0 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234438.990405333 secs.nsecs start_time: 1781234246.463907923 secs.nsecs elapsed_time: 192.526497410 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 1 12 50 16: 1 12 62 32: 1 12 75 64: 0 0 75 128: 0 0 75 256: 2 25 100 - open/close 1664 (time 1781234450.40 total 10.00 last 166.38) - open/close 3093 (time 1781234460.40 total 20.01 last 142.84) - open/close 4741 (time 1781234470.41 total 30.01 last 164.73) - open/close 6615 (time 1781234480.41 total 40.02 last 187.30) - open/close 8261 (time 1781234490.42 total 50.02 last 164.54) - open/close 9740 (time 1781234500.42 total 60.02 last 147.87) total: 10000 open/close in 61.82 seconds: 161.77 ops/second llite.lustre-ffff9a9287da0800.statahead_batch_max=0 llite.lustre-ffff9a9287da0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a9287da0800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a9287da0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.193s user 0m0.264s sys 0m26.240s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a9287da0800.statahead_batch_max=256 llite.lustre-ffff9a9287da0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a9287da0800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a9287da0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.659s user 0m0.212s sys 0m21.542s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234578.358324236 secs.nsecs start_time: 1781234541.721557425 secs.nsecs elapsed_time: 36.636766811 secs.nsecs subreqs per batch batches % cum % 1: 299 61 61 2: 83 16 78 4: 32 6 84 8: 14 2 87 16: 1 0 87 32: 21 4 92 64: 5 1 93 128: 0 0 93 256: 34 6 100 mdc.lustre-MDT0001-mdc-ffff9a9287da0800.batch_stats= snapshot_time: 1781234578.358387838 secs.nsecs start_time: 1781234541.721635328 secs.nsecs elapsed_time: 36.636752510 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a9287da0800.statahead_batch_max=64 llite.lustre-ffff9a9287da0800.statahead_max=128