== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:17:59 (1788657479) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats=0 llite.lustre-ffff94d2899f6800.statahead_max=32 llite.lustre-ffff94d2899f6800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats=0 total: 100 open/close in 2.33 seconds: 42.88 ops/second llite.lustre-ffff94d2899f6800.statahead_max=0 101 real 0m2.170s user 0m0.006s sys 0m0.297s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff94d2899f6800.statahead_max=32 llite.lustre-ffff94d2899f6800.statahead_max=32 101 real 0m1.009s user 0m0.005s sys 0m0.162s 'ls -l' 100 files with statahead: 1 sec statahead total: 117 statahead wrong: 2 agl total: 112 list_total: 30 fname_total: 87 hit_total: 4208 miss_total: 1283 swrong=2 ewrong=2 - open/close 830 (time 1788657505.72 total 10.01 last 82.94) total: 900 open/close in 10.99 seconds: 81.92 ops/second llite.lustre-ffff94d2899f6800.statahead_max=0 1001 real 0m19.604s user 0m0.028s sys 0m2.789s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff94d2899f6800.statahead_max=32 llite.lustre-ffff94d2899f6800.statahead_max=32 1001 real 0m10.120s user 0m0.020s sys 0m1.326s 'ls -l' 1000 files with statahead: 10 sec statahead total: 118 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 87 hit_total: 5205 miss_total: 1286 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff94d2899f6800.statahead_stats= statahead total: 118 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 87 hit_total: 5205 miss_total: 1286 mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats= snapshot_time: 1788657569.511726262 secs.nsecs start_time: 1788657484.442587245 secs.nsecs elapsed_time: 85.069139017 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 776 (time 1788657582.00 total 10.01 last 77.51) - open/close 1564 (time 1788657592.00 total 20.01 last 78.80) - open/close 2421 (time 1788657602.01 total 30.03 last 85.58) - open/close 3221 (time 1788657612.03 total 40.04 last 79.87) - open/close 3981 (time 1788657622.03 total 50.04 last 75.98) - open/close 4713 (time 1788657632.04 total 60.05 last 73.14) - open/close 5463 (time 1788657642.05 total 70.07 last 74.90) - open/close 6289 (time 1788657652.06 total 80.07 last 82.56) - open/close 7109 (time 1788657662.06 total 90.07 last 82.00) - open/close 7969 (time 1788657672.06 total 100.08 last 85.94) - open/close 8762 (time 1788657682.07 total 110.08 last 79.27) - open/close 9606 (time 1788657692.07 total 120.08 last 84.39) total: 10000 open/close in 124.64 seconds: 80.23 ops/second llite.lustre-ffff94d2899f6800.statahead_batch_max=0 llite.lustre-ffff94d2899f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94d2899f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.768s user 0m0.299s sys 0m14.057s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff94d2899f6800.statahead_batch_max=32 llite.lustre-ffff94d2899f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff94d2899f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m32.096s user 0m0.290s sys 0m13.235s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats= snapshot_time: 1788657860.969376267 secs.nsecs start_time: 1788657760.696758058 secs.nsecs elapsed_time: 100.272618209 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats=0 llite.lustre-ffff94d2899f6800.statahead_max=2048 llite.lustre-ffff94d2899f6800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats=0 total: 100 open/close in 2.92 seconds: 34.29 ops/second llite.lustre-ffff94d2899f6800.statahead_max=0 101 real 0m2.673s user 0m0.001s sys 0m0.333s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff94d2899f6800.statahead_max=2048 llite.lustre-ffff94d2899f6800.statahead_max=2048 101 real 0m0.953s user 0m0.003s sys 0m0.177s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 642 (time 1788658181.79 total 10.01 last 64.14) total: 900 open/close in 13.77 seconds: 65.34 ops/second llite.lustre-ffff94d2899f6800.statahead_max=0 1001 real 0m25.551s user 0m0.039s sys 0m2.884s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff94d2899f6800.statahead_max=2048 llite.lustre-ffff94d2899f6800.statahead_max=2048 1001 real 0m6.648s user 0m0.030s sys 0m1.391s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff94d2899f6800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats= snapshot_time: 1788658252.413718497 secs.nsecs start_time: 1788657863.293582059 secs.nsecs elapsed_time: 389.120136438 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 1 8 58 128: 1 8 66 256: 4 33 100 - open/close 722 (time 1788658264.99 total 10.00 last 72.17) - open/close 1470 (time 1788658275.00 total 20.02 last 74.70) - open/close 2174 (time 1788658285.01 total 30.03 last 70.34) - open/close 2895 (time 1788658295.01 total 40.03 last 72.05) - open/close 3584 (time 1788658305.03 total 50.04 last 68.83) - open/close 4333 (time 1788658315.03 total 60.05 last 74.85) - open/close 5137 (time 1788658325.04 total 70.06 last 80.32) - open/close 5844 (time 1788658335.05 total 80.07 last 70.66) - open/close 6539 (time 1788658345.06 total 90.07 last 69.45) - open/close 7302 (time 1788658355.06 total 100.08 last 76.29) - open/close 7961 (time 1788658365.07 total 110.09 last 65.82) - open/close 8672 (time 1788658375.11 total 120.13 last 70.80) - open/close 9415 (time 1788658385.12 total 130.14 last 74.21) total: 10000 open/close in 138.10 seconds: 72.41 ops/second llite.lustre-ffff94d2899f6800.statahead_batch_max=0 llite.lustre-ffff94d2899f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94d2899f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.368s user 0m0.313s sys 0m16.106s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff94d2899f6800.statahead_batch_max=256 llite.lustre-ffff94d2899f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff94d2899f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.826s user 0m0.312s sys 0m14.881s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff94d2899f6800.batch_stats= snapshot_time: 1788658512.297791668 secs.nsecs start_time: 1788658454.548988306 secs.nsecs elapsed_time: 57.748803362 secs.nsecs subreqs per batch batches %% cum %% 1: 167 50 50 2: 41 12 63 4: 40 12 75 8: 12 3 79 16: 14 4 83 32: 15 4 87 64: 5 1 89 128: 1 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff94d2899f6800.statahead_batch_max=64 llite.lustre-ffff94d2899f6800.statahead_max=128