== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:44:09 (1786484649) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats=0 llite.lustre-ffff92cb934fe800.statahead_max=32 llite.lustre-ffff92cb934fe800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.73 seconds: 137.07 ops/second llite.lustre-ffff92cb934fe800.statahead_max=0 101 real 0m0.672s user 0m0.004s sys 0m0.252s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff92cb934fe800.statahead_max=32 llite.lustre-ffff92cb934fe800.statahead_max=32 101 real 0m0.573s user 0m0.006s sys 0m0.309s 'ls -l' 100 files with statahead: 1 sec statahead total: 105 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 75 hit_total: 4085 miss_total: 1009 swrong=2 ewrong=2 total: 900 open/close in 2.05 seconds: 439.72 ops/second llite.lustre-ffff92cb934fe800.statahead_max=0 1001 real 0m6.399s user 0m0.016s sys 0m2.418s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff92cb934fe800.statahead_max=32 llite.lustre-ffff92cb934fe800.statahead_max=32 1001 real 0m4.307s user 0m0.013s sys 0m1.942s 'ls -l' 1000 files with statahead: 4 sec statahead total: 106 statahead wrong: 2 agl total: 102 list_total: 31 fname_total: 75 hit_total: 5084 miss_total: 1010 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff92cb934fe800.statahead_stats= statahead total: 106 statahead wrong: 2 agl total: 102 list_total: 31 fname_total: 75 hit_total: 5084 miss_total: 1010 mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786484677.799542847 secs.nsecs start_time: 1786484651.383694616 secs.nsecs elapsed_time: 26.415848231 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 2 5 7 8: 3 7 15 16: 19 48 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786484677.799606797 secs.nsecs start_time: 1786484651.383778676 secs.nsecs elapsed_time: 26.415828121 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 2 5 7 8: 3 7 15 16: 19 48 64 32: 14 35 100 - open/close 4437 (time 1786484690.45 total 10.00 last 443.63) - open/close 8458 (time 1786484700.45 total 20.00 last 402.09) total: 10000 open/close in 24.16 seconds: 413.99 ops/second llite.lustre-ffff92cb934fe800.statahead_batch_max=0 llite.lustre-ffff92cb934fe800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92cb934fe800.stats=clear mdc.lustre-MDT0001-mdc-ffff92cb934fe800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.690s user 0m0.166s sys 0m35.491s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92cb934fe800.statahead_batch_max=32 llite.lustre-ffff92cb934fe800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92cb934fe800.stats=clear mdc.lustre-MDT0001-mdc-ffff92cb934fe800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.786s user 0m0.167s sys 0m25.427s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786484794.553021881 secs.nsecs start_time: 1786484745.530233165 secs.nsecs elapsed_time: 49.022788716 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786484794.553063987 secs.nsecs start_time: 1786484745.530287055 secs.nsecs elapsed_time: 49.022776932 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats=0 llite.lustre-ffff92cb934fe800.statahead_max=2048 llite.lustre-ffff92cb934fe800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.69 seconds: 145.88 ops/second llite.lustre-ffff92cb934fe800.statahead_max=0 101 real 0m0.626s user 0m0.002s sys 0m0.253s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff92cb934fe800.statahead_max=2048 llite.lustre-ffff92cb934fe800.statahead_max=2048 101 real 0m0.457s user 0m0.002s sys 0m0.262s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.90 seconds: 474.33 ops/second llite.lustre-ffff92cb934fe800.statahead_max=0 1001 real 0m6.307s user 0m0.023s sys 0m2.428s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff92cb934fe800.statahead_max=2048 llite.lustre-ffff92cb934fe800.statahead_max=2048 1001 real 0m4.672s user 0m0.014s sys 0m1.477s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff92cb934fe800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786484919.201696491 secs.nsecs start_time: 1786484795.438171976 secs.nsecs elapsed_time: 123.763524515 secs.nsecs subreqs per batch batches %% cum %% 1: 1 16 16 2: 0 0 16 4: 2 33 50 8: 1 16 66 16: 0 0 66 32: 0 0 66 64: 0 0 66 128: 0 0 66 256: 2 33 100 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786484919.201754009 secs.nsecs start_time: 1786484795.438288524 secs.nsecs elapsed_time: 123.763465485 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 25 25 8: 1 12 37 16: 1 12 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 4733 (time 1786484930.10 total 10.00 last 473.25) - open/close 9307 (time 1786484940.10 total 20.00 last 457.36) total: 10000 open/close in 21.52 seconds: 464.61 ops/second llite.lustre-ffff92cb934fe800.statahead_batch_max=0 llite.lustre-ffff92cb934fe800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92cb934fe800.stats=clear mdc.lustre-MDT0001-mdc-ffff92cb934fe800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.859s user 0m0.194s sys 0m33.515s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff92cb934fe800.statahead_batch_max=256 llite.lustre-ffff92cb934fe800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff92cb934fe800.stats=clear mdc.lustre-MDT0001-mdc-ffff92cb934fe800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.838s user 0m0.166s sys 0m22.363s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786485026.097892384 secs.nsecs start_time: 1786484985.810286580 secs.nsecs elapsed_time: 40.287605804 secs.nsecs subreqs per batch batches %% cum %% 1: 265 65 65 2: 47 11 77 4: 24 5 82 8: 8 1 84 16: 2 0 85 32: 23 5 91 64: 1 0 91 128: 0 0 91 256: 35 8 100 mdc.lustre-MDT0001-mdc-ffff92cb934fe800.batch_stats= snapshot_time: 1786485026.097942044 secs.nsecs start_time: 1786484985.810368133 secs.nsecs elapsed_time: 40.287573911 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff92cb934fe800.statahead_batch_max=64 llite.lustre-ffff92cb934fe800.statahead_max=128