== sanity-flr test 70a: flr mode fsx test ================ 07:32:36 (1788867156) Seed set to 7157 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1788867158.221074 write 0x024e7d thru 0x0330d8 (0xe25c bytes) truncating to largest ever: 0x14cad 000004 1788867158.223408 trunc from 0x0330d9 to 0x014cac (0x1e42c bytes) 000005 1788867158.247889 write 0x02e47e thru 0x036f68 (0x8aeb bytes) 000006 1788867158.250581 trunc from 0x036f69 to 0x00116c (0x35dfc bytes) 000007 1788867158.278034 read 0x0009f9 thru 0x00116c (0x774 bytes) 000008 1788867158.286646 punch from 0x000428 to 0x00116c (0xd45 bytes) 000009 1788867158.293470 write 0x00c232 thru 0x019b86 (0xd955 bytes) 000011 1788867158.295826 read 0x013d74 thru 0x015e77 (0x2104 bytes) 000013 1788867158.297241 trunc from 0x019b87 to 0x008006 (0x11b80 bytes) 000014 1788867158.315096 mapwrite 0x0099c0 thru 0x0119b7 (0x7ff8 bytes) 000015 1788867158.442547 write 0x019198 thru 0x025331 (0xc19a bytes) 000016 1788867158.449623 punch from 0x01dcb6 to 0x025331 (0x767c bytes) 000017 1788867158.486629 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x1dde2 000018 1788867159.829785 trunc from 0x025332 to 0x01dde1 (0x7550 bytes) 000019 1788867159.948668 write 0x019ac0 thru 0x029581 (0xfac2 bytes) 000021 1788867159.961525 mapread 0x01b0fc thru 0x01c450 (0x1355 bytes) 000023 1788867159.962910 punch from 0x00b04a to 0x014991 (0x9948 bytes) 000024 1788867160.001216 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29582): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29582): Mirror 2: 0xbecf7a4f (stale) CRC-32 checksum value for chunk [0, 0x29582): Mirror 1: 0xe8928d0b Mirror 3: 0xe8928d0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29582: skipped 000025 1788867161.196053 write 0x00ae3d thru 0x00f741 (0x4905 bytes) 000026 1788867161.274340 write 0x0070b0 thru 0x016fb3 (0xff04 bytes) 000027 1788867161.288177 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29582): Mirror 3: 0xe8928d0b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29582): Mirror 3: 0xe8928d0b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29582: skipped 000030 1788867161.648744 trunc from 0x029582 to 0x0176db (0x11ea6 bytes) 000031 1788867161.670474 read 0x00fd32 thru 0x014f44 (0x5213 bytes) 000032 1788867161.694955 mapread 0x00aaa7 thru 0x013b8c (0x90e6 bytes) truncating to largest ever: 0x2c51a 000034 1788867161.721266 trunc from 0x0176dc to 0x02c519 (0x14e3e bytes) 000035 1788867161.746216 punch from 0x010bc0 to 0x01d144 (0xc585 bytes) 000036 1788867161.754191 mapwrite 0x024d08 thru 0x029529 (0x4822 bytes) 000038 1788867161.850507 mapwrite 0x03fe9f thru 0x03ffff (0x161 bytes) 000040 1788867161.924463 write 0x0059e5 thru 0x012c41 (0xd25d bytes) 000041 1788867161.935579 trunc from 0x040000 to 0x00ad62 (0x3529d bytes) 000044 1788867161.960752 write 0x024910 thru 0x02cecf (0x85c0 bytes) 000045 1788867161.963120 mapwrite 0x021651 thru 0x024487 (0x2e37 bytes) 000047 1788867162.018335 read 0x00120d thru 0x0022be (0x10b2 bytes) 000048 1788867162.027619 mapwrite 0x01b4bb thru 0x0279c5 (0xc50b bytes) 000051 1788867162.074792 mapread 0x029e1e thru 0x02cecf (0x30b2 bytes) 000052 1788867162.077261 trunc from 0x02ced0 to 0x02b761 (0x176e bytes) 000054 1788867162.092840 trunc from 0x02b762 to 0x00742f (0x24332 bytes) 000056 1788867162.110384 mapread 0x00209e thru 0x006f11 (0x4e74 bytes) 000057 1788867162.112076 punch from 0x001830 to 0x004f4d (0x371e bytes) 000059 1788867162.117478 mapread 0x006577 thru 0x00742f (0xeb9 bytes) 000061 1788867162.118923 mapread 0x00492d thru 0x00742f (0x2b03 bytes) 000064 1788867162.124839 mapread 0x003419 thru 0x00742f (0x4017 bytes) 000065 1788867162.129901 read 0x001515 thru 0x00742f (0x5f1b bytes) 000067 1788867162.136534 mapread 0x006397 thru 0x00742f (0x1099 bytes) 000068 1788867162.138334 read 0x0049fc thru 0x00742f (0x2a34 bytes) 000069 1788867162.139412 read 0x0022ee thru 0x00742f (0x5142 bytes) 000070 1788867162.140358 mapread 0x000c9f thru 0x005f7b (0x52dd bytes) 000072 1788867162.142406 mapread 0x001fff thru 0x00742f (0x5431 bytes) 000073 1788867162.144176 trunc from 0x007430 to 0x027924 (0x204f5 bytes) 000076 1788867162.164469 MIRROR_RESYNC 2 mirrors 000078 1788867162.843410 mapread 0x01ef90 thru 0x021729 (0x279a bytes) 000079 1788867162.865484 read 0x022d26 thru 0x027924 (0x4bff bytes) 000083 1788867162.868994 punch from 0x01d02c to 0x027924 (0xa8f9 bytes) 000084 1788867162.948649 punch from 0x0003de to 0x001499 (0x10bc bytes) 000085 1788867162.953798 punch from 0x01ea44 to 0x027924 (0x8ee1 bytes) 000086 1788867162.958454 read 0x01f77d thru 0x027924 (0x81a8 bytes) 000087 1788867162.973343 mapwrite 0x035a05 thru 0x03ffff (0xa5fb bytes) truncating to largest ever: 0x3af39 000093 1788867163.088421 trunc from 0x040000 to 0x03af38 (0x50c7 bytes) 000094 1788867163.106001 trunc from 0x03af39 to 0x018a8f (0x224a9 bytes) 000096 1788867163.124346 mapread 0x00e324 thru 0x013408 (0x50e5 bytes) 000098 1788867163.129155 read 0x004316 thru 0x014266 (0xff51 bytes) 000100 1788867163.132078 read 0x0027af thru 0x00d3dc (0xac2e bytes) 000101 1788867163.132820 trunc from 0x018a90 to 0x01ff8a (0x74fb bytes) truncating to largest ever: 0x3cd70 000102 1788867163.152188 trunc from 0x01ff8b to 0x03cd6f (0x1cde5 bytes) 000104 1788867163.167434 mapread 0x027362 thru 0x02e467 (0x7106 bytes) 000105 1788867163.180143 punch from 0x03a5e0 to 0x03c9e7 (0x2408 bytes) 000106 1788867163.185530 trunc from 0x03cd70 to 0x0208c2 (0x1c4ad bytes) 000107 1788867163.201405 write 0x027db0 thru 0x033e70 (0xc0c1 bytes) 000108 1788867163.210983 MIRROR_RESYNC 2 mirrors 000109 1788867163.922225 write 0x0045a3 thru 0x00bbeb (0x7649 bytes) 000112 1788867163.998943 read 0x01fa41 thru 0x02db78 (0xe138 bytes) 000114 1788867164.010135 read 0x02c541 thru 0x0328a2 (0x6362 bytes) 000115 1788867164.021100 write 0x00ea58 thru 0x0101dc (0x1785 bytes) 000116 1788867164.027038 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33e71): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33e71): Mirror 3: 0x54307ef (stale) CRC-32 checksum value for chunk [0, 0x33e71): Mirror 1: 0xd802497 Mirror 4: 0xd802497 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33e71: skipped 000118 1788867165.252275 write 0x035031 thru 0x03ac7f (0x5c4f bytes) 000119 1788867165.316318 read 0x012bde thru 0x01ddca (0xb1ed bytes) 000120 1788867165.328150 write 0x00eace thru 0x00f36f (0x8a2 bytes) 000122 1788867165.339110 punch from 0x0099f1 to 0x01197e (0x7f8e bytes) 000125 1788867165.352841 trunc from 0x03ac80 to 0x008e99 (0x31de6 bytes) 000126 1788867165.410514 write 0x0165de thru 0x026104 (0xfb27 bytes) 000127 1788867165.414414 mapwrite 0x013fe1 thru 0x020cbd (0xccdd bytes) 000128 1788867165.495159 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26105): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26105): Mirror 3: 0x6570b704 (stale) Mirror 4: 0x8bdc121b (stale) CRC-32 checksum value for chunk [0, 0x26105): Mirror 1: 0xb61ae3df Mirror 5: 0xb61ae3df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26105: skipped 000131 1788867166.628897 read 0x0128ae thru 0x01d5f9 (0xad4c bytes) 000132 1788867166.640607 punch from 0x0070de to 0x011fc6 (0xaee9 bytes) 000133 1788867166.841259 write 0x03c318 thru 0x03ffff (0x3ce8 bytes) 000134 1788867166.847161 trunc from 0x040000 to 0x0348ac (0xb753 bytes) 000135 1788867166.943644 write 0x00745e thru 0x00f370 (0x7f13 bytes) 000136 1788867166.965347 punch from 0x0173d3 to 0x01c6c0 (0x52ee bytes) 000139 1788867166.982883 trunc from 0x0348ad to 0x01e176 (0x16736 bytes) 000141 1788867166.996510 mapwrite 0x005096 thru 0x00ad29 (0x5c94 bytes) 000142 1788867167.051401 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e177): Mirror 4: 0x9a3d735b (stale) Mirror 5: 0xf9b5760d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e177): Mirror 4: 0x9a3d735b (stale) Mirror 5: 0xf9b5760d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e177: skipped 000143 1788867167.326938 read 0x00010d thru 0x00d44f (0xd343 bytes) 000144 1788867167.336079 trunc from 0x01e177 to 0x013d56 (0xa420 bytes) 000145 1788867167.360339 read 0x002055 thru 0x008f2c (0x6ed8 bytes) 000148 1788867167.361902 punch from 0x013423 to 0x013d56 (0x934 bytes) 000150 1788867167.378389 MIRROR_RESYNC 3 mirrors 000151 1788867168.734603 write 0x0229d7 thru 0x022b3f (0x169 bytes) 000152 1788867168.793539 punch from 0x0228a6 to 0x022b3f (0x29a bytes) 000153 1788867168.802313 mapwrite 0x007bbf thru 0x00a92f (0x2d71 bytes) 000154 1788867168.875310 mapread 0x00b421 thru 0x01939b (0xdf7b bytes) 000156 1788867168.891473 trunc from 0x022b40 to 0x00366f (0x1f4d0 bytes) 000158 1788867168.926062 trunc from 0x003670 to 0x007283 (0x3c14 bytes) 000159 1788867168.956990 MIRROR_RESYNC 3 mirrors 000160 1788867169.787219 trunc from 0x007284 to 0x01e573 (0x172f0 bytes) 000162 1788867169.944876 trunc from 0x01e574 to 0x01bb32 (0x2a41 bytes) 000163 1788867169.991680 write 0x00eae2 thru 0x01abca (0xc0e9 bytes) 000164 1788867170.022212 read 0x00f74b thru 0x01bb32 (0xc3e8 bytes) 000165 1788867170.030638 MIRROR_RESYNC 3 mirrors 000166 1788867170.931783 write 0x02bd0d thru 0x03809e (0xc392 bytes) 000167 1788867171.003994 punch from 0x005ba6 to 0x013a32 (0xde8d bytes) 000168 1788867171.018081 read 0x01b502 thru 0x026897 (0xb396 bytes) 000171 1788867171.028889 write 0x01959d thru 0x027490 (0xdef4 bytes) 000175 1788867171.044664 punch from 0x0292d8 to 0x02ac5d (0x1986 bytes) 000176 1788867171.061683 trunc from 0x03809f to 0x016543 (0x21b5b bytes) 000177 1788867171.124542 trunc from 0x016544 to 0x03cb52 (0x2660f bytes) 000179 1788867171.165609 write 0x008d69 thru 0x017041 (0xe2d9 bytes) 000180 1788867171.184291 mapread 0x02371f thru 0x029f5e (0x6840 bytes) 000181 1788867171.212396 trunc from 0x03cb53 to 0x001feb (0x3ab67 bytes) 000182 1788867171.242380 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1fec): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fec): Mirror 4: 0x8f1ff913 (stale) Mirror 5: 0x8f1ff913 (stale) CRC-32 checksum value for chunk [0, 0x1fec): Mirror 1: 0x8f1ff913 Mirror 6: 0x8f1ff913 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fec: skipped 000183 1788867172.115229 mapread 0x001eee thru 0x001feb (0xfe bytes) 000185 1788867172.125171 write 0x00250f thru 0x0107de (0xe2d0 bytes) 000186 1788867172.275507 mapread 0x00fb28 thru 0x0107de (0xcb7 bytes) 000187 1788867172.277257 punch from 0x00d52b to 0x0107de (0x32b4 bytes) 000188 1788867172.299454 mapread 0x002226 thru 0x00aeab (0x8c86 bytes) 000190 1788867172.303005 mapread 0x00145e thru 0x002605 (0x11a8 bytes) 000192 1788867172.325292 read 0x00406f thru 0x004e3b (0xdcd bytes) 000193 1788867172.325928 trunc from 0x0107df to 0x016128 (0x594a bytes) 000194 1788867172.413023 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x16129): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16129): Mirror 4: 0x92603a60 (stale) Mirror 5: 0x92603a60 (stale) Mirror 6: 0xd1d118e7 (stale) CRC-32 checksum value for chunk [0, 0x16129): Mirror 1: 0xa85cccee Mirror 7: 0xa85cccee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16129: skipped 000195 1788867173.720508 punch from 0x0009be to 0x00477f (0x3dc2 bytes) 000196 1788867173.775976 write 0x01bf1b thru 0x01d6b2 (0x1798 bytes) 000197 1788867173.778118 punch from 0x005920 to 0x00f3ed (0x9ace bytes) 000198 1788867173.794839 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d6b3): Mirror 4: 0x2918cba6 (stale) Mirror 6: 0x76a4ad63 (stale) Mirror 7: 0xd98b2057 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d6b3): Mirror 4: 0x2918cba6 (stale) Mirror 6: 0x76a4ad63 (stale) Mirror 7: 0xd98b2057 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d6b3: skipped 000199 1788867174.232210 write 0x01e972 thru 0x01ffae (0x163d bytes) 000201 1788867174.233633 mapwrite 0x01188c thru 0x01bbca (0xa33f bytes) 000202 1788867174.325363 punch from 0x009bea to 0x0114cd (0x78e4 bytes) 000203 1788867174.337662 punch from 0x01accb to 0x01ffae (0x52e4 bytes) 000204 1788867174.345878 read 0x00dfd1 thru 0x019747 (0xb777 bytes) 000205 1788867174.365329 trunc from 0x01ffaf to 0x0162a9 (0x9d05 bytes) 000206 1788867174.385332 punch from 0x010153 to 0x0162a9 (0x6157 bytes) 000208 1788867174.398765 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x162aa): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x162aa): Mirror 4: 0xfce317f2 (stale) Mirror 6: 0xd0e7c166 (stale) Mirror 7: 0x3e8ff807 (stale) CRC-32 checksum value for chunk [0, 0x162aa): Mirror 1: 0xaeb4fbd8 Mirror 8: 0xaeb4fbd8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x162aa: skipped 000210 1788867175.737109 mapwrite 0x032a00 thru 0x03bcad (0x92ae bytes) 000212 1788867175.943586 read 0x003cc6 thru 0x007a40 (0x3d7b bytes) 000213 1788867175.954305 mapread 0x01a1bf thru 0x02985d (0xf69f bytes) 000214 1788867175.975173 read 0x02d752 thru 0x02dadc (0x38b bytes) 000215 1788867175.975792 mapread 0x00a52c thru 0x017882 (0xd357 bytes) 000216 1788867175.993087 mapwrite 0x037d6b thru 0x03b3da (0x3670 bytes) 000217 1788867176.044180 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bcae): Mirror 4: 0x2aca62d9 (stale) Mirror 7: 0x3658bf9f (stale) Mirror 8: 0x35c2d3f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bcae): Mirror 4: 0x2aca62d9 (stale) Mirror 7: 0x3658bf9f (stale) Mirror 8: 0x35c2d3f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bcae: skipped 000220 1788867176.384509 read 0x01da19 thru 0x026aa3 (0x908b bytes) 000221 1788867176.401772 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bcae): Mirror 4: 0x2aca62d9 (stale) Mirror 8: 0x35c2d3f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bcae): Mirror 4: 0x2aca62d9 (stale) Mirror 8: 0x35c2d3f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bcae: skipped 000222 1788867176.668851 read 0x015da9 thru 0x016830 (0xa88 bytes) 000224 1788867176.675158 write 0x023aca thru 0x0299ab (0x5ee2 bytes) 000225 1788867176.683821 read 0x0330e9 thru 0x03a741 (0x7659 bytes) 000227 1788867176.696292 mapwrite 0x001eba thru 0x004d09 (0x2e50 bytes) 000228 1788867176.734970 trunc from 0x03bcae to 0x00e686 (0x2d627 bytes) 000230 1788867176.751625 punch from 0x00d2e7 to 0x00e686 (0x13a0 bytes) 000232 1788867176.756257 mapread 0x007095 thru 0x00a187 (0x30f3 bytes) 000233 1788867176.757129 write 0x034f59 thru 0x039bff (0x4ca7 bytes) 000234 1788867176.764568 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39c00): Mirror 4: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c00): Mirror 4: 0xe3fc4adf (stale) Mirror 8: 0x844c45d8 (stale) CRC-32 checksum value for chunk [0, 0x39c00): Mirror 1: 0x5480ec70 Mirror 9: 0x5480ec70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c00: skipped 000236 1788867177.842520 trunc from 0x039c00 to 0x02d61c (0xc5e3 bytes) 000237 1788867177.937036 read 0x02b7a8 thru 0x02d61c (0x1e75 bytes) 000238 1788867177.942666 mapread 0x026c60 thru 0x02d61c (0x69bd bytes) 000239 1788867177.960210 read 0x018dcd thru 0x0236a2 (0xa8d6 bytes) 000241 1788867177.971278 mapread 0x01f46d thru 0x024356 (0x4eea bytes) 000242 1788867177.972297 write 0x003cc4 thru 0x009aa3 (0x5de0 bytes) 000243 1788867177.978351 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d61d): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d61d): Mirror 4: 0x62518ac3 (stale) Mirror 8: 0x62dea405 (stale) Mirror 9: 0x5cec6eb (stale) CRC-32 checksum value for chunk [0, 0x2d61d): Mirror 1: 0x498c5bf7 Mirror 10: 0x498c5bf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d61d: skipped 000244 1788867179.156627 read 0x0155f8 thru 0x015771 (0x17a bytes) 000245 1788867179.167521 mapread 0x011bb6 thru 0x0125ee (0xa39 bytes) 000249 1788867179.218404 mapread 0x0247a9 thru 0x02d61c (0x8e74 bytes) 000250 1788867179.289300 punch from 0x00d545 to 0x016731 (0x91ed bytes) 000251 1788867179.408211 trunc from 0x02d61d to 0x0192fc (0x14320 bytes) 000253 1788867179.432343 write 0x00b0eb thru 0x019747 (0xe65d bytes) 000254 1788867179.446102 mapread 0x0001ec thru 0x0053d8 (0x51ed bytes) 000255 1788867179.456761 trunc from 0x019748 to 0x01bed1 (0x278a bytes) 000256 1788867179.472448 mapread 0x009de2 thru 0x015c5e (0xbe7d bytes) 000257 1788867179.474057 punch from 0x00984e to 0x00d09b (0x384e bytes) 000258 1788867179.486932 mapwrite 0x0331ea thru 0x03ffff (0xce16 bytes) 000259 1788867179.590891 mapread 0x00517c thru 0x00e729 (0x95ae bytes) 000260 1788867179.603691 mapwrite 0x021220 thru 0x023c42 (0x2a23 bytes) 000261 1788867179.685898 mapwrite 0x0008f5 thru 0x007a28 (0x7134 bytes) 000262 1788867179.829357 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9ae44c44 (stale) Mirror 8: 0xedd6771c (stale) Mirror 9: 0x62d2dacf (stale) Mirror 10: 0x200aff10 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x25899e1 Mirror 11: 0x25899e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1788867181.208110 mapread 0x037cb1 thru 0x03ffff (0x834f bytes) 000265 1788867181.252339 mapread 0x033a13 thru 0x037a5f (0x404d bytes) 000266 1788867181.253131 trunc from 0x040000 to 0x015057 (0x2afa8 bytes) 000267 1788867181.396006 read 0x012039 thru 0x015057 (0x301f bytes) 000270 1788867181.405679 read 0x00e790 thru 0x015057 (0x68c8 bytes) 000272 1788867181.417196 write 0x03acb8 thru 0x03ffff (0x5348 bytes) 000275 1788867181.420437 punch from 0x008b5e to 0x00ca17 (0x3eba bytes) 000276 1788867181.448476 mapread 0x01850e thru 0x01f9c8 (0x74bb bytes) 000277 1788867181.460497 punch from 0x0296ca to 0x0331d9 (0x9b10 bytes) 000279 1788867181.466982 write 0x01c2e9 thru 0x027738 (0xb450 bytes) 000281 1788867181.472223 trunc from 0x040000 to 0x00f64b (0x309b4 bytes) 000283 1788867181.517914 read 0x005f0c thru 0x006d3e (0xe33 bytes) 000284 1788867181.522192 punch from 0x000300 to 0x009002 (0x8d03 bytes) 000285 1788867181.534945 mapread 0x00219f thru 0x00f64b (0xd4ad bytes) 000289 1788867181.564199 write 0x039fdd thru 0x03a57a (0x59e bytes) 000290 1788867181.583530 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a57b): Mirror 8: 0x6fe35d6a (stale) Mirror 9: 0xae4b8ec2 (stale) Mirror 10: 0x5f7312b1 (stale) Mirror 11: 0x2c28110b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a57b): Mirror 8: 0x6fe35d6a (stale) Mirror 9: 0xae4b8ec2 (stale) Mirror 10: 0x5f7312b1 (stale) Mirror 11: 0x2c28110b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a57b: skipped 000291 1788867182.113996 read 0x0082f3 thru 0x00b371 (0x307f bytes) 000294 1788867182.126338 write 0x02b5fc thru 0x039747 (0xe14c bytes) 000295 1788867182.140000 write 0x02e1af thru 0x036fe4 (0x8e36 bytes) 000297 1788867182.143112 mapread 0x0050e6 thru 0x0085d2 (0x34ed bytes) 000298 1788867182.160377 trunc from 0x03a57b to 0x038f9f (0x15db bytes) 000299 1788867182.179563 mapwrite 0x0366ef thru 0x03978b (0x309d bytes) 000300 1788867182.241805 punch from 0x00c5e8 to 0x015559 (0x8f72 bytes) 000302 1788867182.246990 write 0x00927c thru 0x00c0cb (0x2e50 bytes) 000303 1788867182.262070 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3978c): Mirror 8: 0x94a2857b (stale) Mirror 10: 0xb1b4f5e3 (stale) Mirror 11: 0xcd54b4c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3978c): Mirror 8: 0x94a2857b (stale) Mirror 10: 0xb1b4f5e3 (stale) Mirror 11: 0xcd54b4c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3978c: skipped 000304 1788867182.553595 trunc from 0x03978c to 0x02387b (0x15f10 bytes) 000305 1788867182.569503 read 0x013888 thru 0x021c9a (0xe413 bytes) 000306 1788867182.582191 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2387c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2387c): Mirror 8: 0x5e1cb3de (stale) Mirror 10: 0x5133da61 (stale) Mirror 11: 0x1cc44f54 (stale) CRC-32 checksum value for chunk [0, 0x2387c): Mirror 1: 0xf70c7378 Mirror 12: 0xf70c7378 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2387c: skipped 000307 1788867183.805760 mapwrite 0x0318ee thru 0x033ba6 (0x22b9 bytes) 000308 1788867184.031609 punch from 0x00fe7c to 0x015389 (0x550e bytes) 000309 1788867184.043368 mapwrite 0x02461a thru 0x03455d (0xff44 bytes) 000310 1788867184.189410 read 0x030228 thru 0x03455d (0x4336 bytes) 000312 1788867184.191027 punch from 0x01ccce to 0x022120 (0x5453 bytes) 000314 1788867184.201703 write 0x0245d4 thru 0x031076 (0xcaa3 bytes) 000315 1788867184.204766 write 0x00b474 thru 0x0198f4 (0xe481 bytes) 000317 1788867184.227421 mapread 0x02a80a thru 0x02a97e (0x175 bytes) 000318 1788867184.228553 trunc from 0x03455e to 0x03c392 (0x7e35 bytes) 000319 1788867184.251829 punch from 0x0183cf to 0x02781b (0xf44d bytes) 000320 1788867184.266641 trunc from 0x03c393 to 0x001e18 (0x3a57a bytes) 000321 1788867184.278657 mapread 0x00005d thru 0x001e18 (0x1dbc bytes) 000322 1788867184.284875 write 0x01ccd3 thru 0x0257c1 (0x8aef bytes) 000323 1788867184.287421 trunc from 0x0257c2 to 0x013acb (0x11cf6 bytes) 000324 1788867184.307844 mapread 0x0006d2 thru 0x0065fa (0x5f29 bytes) 000328 1788867184.316496 mapread 0x001ee1 thru 0x01128e (0xf3ae bytes) 000330 1788867184.322631 write 0x03f54f thru 0x03ffff (0xab1 bytes) 000331 1788867184.328235 MIRROR_RESYNC 5 mirrors 000332 1788867185.717140 mapwrite 0x0254a6 thru 0x02b7cc (0x6327 bytes) 000334 1788867185.932675 punch from 0x01551d to 0x020e01 (0xb8e5 bytes) 000338 1788867185.942873 trunc from 0x040000 to 0x02af06 (0x150f9 bytes) 000339 1788867185.970948 read 0x01497c thru 0x01a3cc (0x5a51 bytes) 000340 1788867185.981877 punch from 0x01847a to 0x021845 (0x93cc bytes) 000341 1788867185.993537 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2af07): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2af07): Mirror 8: 0x9391baa6 (stale) Mirror 10: 0x9391baa6 (stale) Mirror 11: 0x9391baa6 (stale) Mirror 12: 0x9391baa6 (stale) CRC-32 checksum value for chunk [0, 0x2af07): Mirror 1: 0x223f24ee Mirror 13: 0x223f24ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2af07: skipped 000342 1788867187.238405 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2af07): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2af07): Mirror 8: 0x9391baa6 (stale) Mirror 10: 0x9391baa6 (stale) Mirror 11: 0x9391baa6 (stale) Mirror 12: 0x9391baa6 (stale) CRC-32 checksum value for chunk [0, 0x2af07): Mirror 1: 0x223f24ee Mirror 13: 0x223f24ee Mirror 14: 0x223f24ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2af07: skipped 000344 1788867188.890661 write 0x026bc9 thru 0x0344e8 (0xd920 bytes) 000346 1788867189.048192 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x344e9): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x344e9): Mirror 8: 0xfa33d364 (stale) Mirror 10: 0xfa33d364 (stale) Mirror 11: 0xfa33d364 (stale) Mirror 12: 0xfa33d364 (stale) Mirror 13: 0x97ea67a4 (stale) Mirror 14: 0x97ea67a4 (stale) CRC-32 checksum value for chunk [0, 0x344e9): Mirror 1: 0x5ccb41bc Mirror 15: 0x5ccb41bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x344e9: skipped 000347 1788867190.541067 mapwrite 0x03abc8 thru 0x03ffff (0x5438 bytes) 000348 1788867190.752869 mapwrite 0x02865f thru 0x028816 (0x1b8 bytes) 000349 1788867190.803314 mapwrite 0x00f32a thru 0x01749b (0x8172 bytes) 000350 1788867190.863084 punch from 0x0194f6 to 0x025a1c (0xc527 bytes) 000351 1788867190.869180 read 0x038d8a thru 0x0397dd (0xa54 bytes) 000353 1788867190.878490 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x2b0e8040 (stale) Mirror 10: 0x2b0e8040 (stale) Mirror 11: 0x2b0e8040 (stale) Mirror 12: 0x2b0e8040 (stale) Mirror 13: 0xb97aae79 (stale) Mirror 14: 0xb97aae79 (stale) Mirror 15: 0x783fbbae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe9ed9d0e Mirror 16: 0xe9ed9d0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1788867193.041412 MIRROR_RESYNC 9 mirrors 000357 1788867196.090058 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000359 1788867196.519172 mapread 0x00be41 thru 0x01aa3c (0xebfc bytes) 000361 1788867196.548593 MIRROR_RESYNC 8 mirrors 000362 1788867197.087571 mapwrite 0x0264aa thru 0x02db68 (0x76bf bytes) 000364 1788867197.357777 mapread 0x02f4cc thru 0x030589 (0x10be bytes) 000365 1788867197.368074 read 0x02a44c thru 0x035b5c (0xb711 bytes) 000366 1788867197.369029 trunc from 0x040000 to 0x02bfd0 (0x1402f bytes) 000367 1788867197.393402 read 0x0095fc thru 0x00e15d (0x4b62 bytes) 000368 1788867197.406158 trunc from 0x02bfd1 to 0x0039e4 (0x285ec bytes) 000371 1788867197.424524 read 0x0009c2 thru 0x0039e4 (0x3023 bytes) 000372 1788867197.425154 trunc from 0x0039e5 to 0x03b311 (0x3792d bytes) 000373 1788867197.445594 mapread 0x0245ce thru 0x030bc2 (0xc5f5 bytes) 000374 1788867197.458893 punch from 0x02daee to 0x032df4 (0x5307 bytes) 000375 1788867197.477348 MIRROR_RESYNC 8 mirrors 000376 1788867200.890022 mapread 0x0109ec thru 0x011426 (0xa3b bytes) 000377 1788867200.912561 read 0x017301 thru 0x02438b (0xd08b bytes) 000382 1788867200.933041 mapwrite 0x0349a3 thru 0x034c33 (0x291 bytes) 000383 1788867201.152453 read 0x03b0f0 thru 0x03b311 (0x222 bytes) 000384 1788867201.153685 write 0x03e7ef thru 0x03ffff (0x1811 bytes) 000386 1788867201.157656 mapwrite 0x02baef thru 0x02ee46 (0x3358 bytes) 000387 1788867201.246984 mapwrite 0x035635 thru 0x03ca45 (0x7411 bytes) 000388 1788867201.314776 trunc from 0x040000 to 0x021001 (0x1effe bytes) 000391 1788867201.343664 punch from 0x018efb to 0x01d820 (0x4926 bytes) 000392 1788867201.350136 punch from 0x004f5d to 0x00f721 (0xa7c5 bytes) 000393 1788867201.356605 read 0x01d90e thru 0x021001 (0x36f4 bytes) 000396 1788867201.381355 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21002): Mirror 8: 0x4f697327 (stale) Mirror 11: 0x4f697327 (stale) Mirror 12: 0x4f697327 (stale) Mirror 13: 0x4f697327 (stale) Mirror 14: 0x4f697327 (stale) Mirror 15: 0x4f697327 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21002): Mirror 8: 0x4f697327 (stale) Mirror 11: 0x4f697327 (stale) Mirror 12: 0x4f697327 (stale) Mirror 13: 0x4f697327 (stale) Mirror 14: 0x4f697327 (stale) Mirror 15: 0x4f697327 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21002: skipped 000400 1788867201.878468 read 0x0027d6 thru 0x00f509 (0xcd34 bytes) 000401 1788867201.897975 punch from 0x01f5ae to 0x021001 (0x1a54 bytes) 000403 1788867201.904993 write 0x002112 thru 0x0040c7 (0x1fb6 bytes) 000405 1788867201.906442 read 0x0163e5 thru 0x017249 (0xe65 bytes) 000407 1788867201.922212 read 0x002a6b thru 0x00868d (0x5c23 bytes) 000408 1788867201.922953 mapwrite 0x008e6c thru 0x00e0c6 (0x525b bytes) 000409 1788867202.032743 write 0x005368 thru 0x010790 (0xb429 bytes) 000410 1788867202.035164 mapwrite 0x02a75a thru 0x0374f0 (0xcd97 bytes) 000411 1788867202.127876 mapread 0x02e829 thru 0x0374f0 (0x8cc8 bytes) 000412 1788867202.128848 trunc from 0x0374f1 to 0x036cb4 (0x83c bytes) 000418 1788867202.177292 write 0x028d90 thru 0x02a191 (0x1402 bytes) 000419 1788867202.178433 mapwrite 0x03b7d5 thru 0x03ffff (0x482b bytes) 000420 1788867202.309873 read 0x0147c1 thru 0x0233f9 (0xec39 bytes) 000421 1788867202.310902 punch from 0x018784 to 0x01a49d (0x1d1a bytes) 000422 1788867202.319309 mapwrite 0x00d2de thru 0x01a0a4 (0xcdc7 bytes) 000423 1788867202.383551 trunc from 0x040000 to 0x030df0 (0xf20f bytes) 000424 1788867202.399585 write 0x037467 thru 0x03ffff (0x8b99 bytes) 000425 1788867202.402300 read 0x03ebc4 thru 0x03ffff (0x143c bytes) 000426 1788867202.403311 punch from 0x016374 to 0x020a9f (0xa72c bytes) 000427 1788867202.416642 punch from 0x01bbd6 to 0x01ead8 (0x2f03 bytes) 000428 1788867202.430921 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000429 1788867202.955997 punch from 0x02e620 to 0x034bd1 (0x65b2 bytes) 000430 1788867202.974379 read 0x006c80 thru 0x00928a (0x260b bytes) 000431 1788867202.980512 mapread 0x01ce18 thru 0x02c51d (0xf706 bytes) 000433 1788867203.017450 mapwrite 0x03d2bf thru 0x03f661 (0x23a3 bytes) 000434 1788867203.080854 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000435 1788867203.499143 MIRROR_RESYNC 5 mirrors 000436 1788867206.048939 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000437 1788867206.349369 mapread 0x0388aa thru 0x03ffff (0x7756 bytes) 000439 1788867206.365762 write 0x00e325 thru 0x00e33f (0x1b bytes) 000441 1788867206.448339 mapread 0x00e110 thru 0x0179e9 (0x98da bytes) 000442 1788867206.457171 write 0x00a6bc thru 0x00d11a (0x2a5f bytes) 000444 1788867206.459382 write 0x00f3e3 thru 0x01e808 (0xf426 bytes) 000445 1788867206.464618 write 0x03d92e thru 0x03f62b (0x1cfe bytes) 000447 1788867206.479953 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xcb79a57f (stale) Mirror 15: 0xcb79a57f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xcb79a57f (stale) Mirror 15: 0xcb79a57f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000448 1788867206.835879 punch from 0x02c8c6 to 0x03be1f (0xf55a bytes) 000449 1788867206.842222 punch from 0x02ab56 to 0x02ac6e (0x119 bytes) 000451 1788867206.848545 punch from 0x00bbb3 to 0x015cbf (0xa10d bytes) 000452 1788867206.866915 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xcb79a57f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xcb79a57f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000453 1788867207.159156 punch from 0x026c81 to 0x036bf9 (0xff79 bytes) 000455 1788867207.169224 read 0x009622 thru 0x00cfd5 (0x39b4 bytes) 000457 1788867207.183682 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000458 1788867207.326673 trunc from 0x040000 to 0x018175 (0x27e8a bytes) 000459 1788867207.353095 trunc from 0x018176 to 0x01bfad (0x3e38 bytes) 000460 1788867207.375953 trunc from 0x01bfae to 0x02e60c (0x1265f bytes) 000461 1788867207.398994 mapwrite 0x018140 thru 0x01b4ca (0x338b bytes) 000462 1788867207.488905 punch from 0x0233a8 to 0x02e60c (0xb265 bytes) 000467 1788867207.502172 read 0x003304 thru 0x00cebe (0x9bbb bytes) 000468 1788867207.517248 MIRROR_EXTEND to 2 mirrors 000470 1788867208.462147 write 0x00cd8f thru 0x01758f (0xa801 bytes) 000471 1788867208.557405 punch from 0x02c300 to 0x02e60c (0x230d bytes) 000472 1788867208.582823 mapwrite 0x037f37 thru 0x03ffff (0x80c9 bytes) 000473 1788867208.744168 read 0x03b9cb thru 0x03ffff (0x4635 bytes) 000474 1788867208.745403 read 0x034fac thru 0x03cceb (0x7d40 bytes) 000475 1788867208.749110 mapread 0x02fdfb thru 0x033ab2 (0x3cb8 bytes) 000477 1788867208.765522 write 0x02f043 thru 0x03237e (0x333c bytes) 000478 1788867208.766479 write 0x03954c thru 0x03e4c9 (0x4f7e bytes) 000479 1788867208.778185 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd8a2736 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8ca8c61b Mirror 3: 0x8ca8c61b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000480 1788867210.135427 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000481 1788867210.409548 mapwrite 0x01a737 thru 0x0211be (0x6a88 bytes) 000483 1788867210.781158 trunc from 0x040000 to 0x010bd8 (0x2f427 bytes) 000484 1788867210.826848 mapread 0x000517 thru 0x00d0f5 (0xcbdf bytes) 000485 1788867210.842594 trunc from 0x010bd9 to 0x02c915 (0x1bd3d bytes) 000486 1788867210.861447 punch from 0x018a0e to 0x01cb67 (0x415a bytes) 000487 1788867210.867794 read 0x01e9fb thru 0x028098 (0x969e bytes) 000488 1788867210.883968 MIRROR_RESYNC 2 mirrors 000489 1788867212.130044 punch from 0x029892 to 0x02c915 (0x3084 bytes) 000490 1788867212.228868 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000491 1788867212.347334 trunc from 0x02c916 to 0x02ec99 (0x2384 bytes) 000493 1788867212.364278 mapread 0x02abf3 thru 0x02ec99 (0x40a7 bytes) 000495 1788867212.381611 punch from 0x0261cd to 0x02be78 (0x5cac bytes) 000496 1788867212.385405 trunc from 0x02ec9a to 0x00e5c0 (0x206d9 bytes) 000497 1788867212.397700 write 0x0228a0 thru 0x02df4f (0xb6b0 bytes) 000499 1788867212.399541 read 0x0293d5 thru 0x02df4f (0x4b7b bytes) 000500 1788867212.404341 write 0x008eff thru 0x017727 (0xe829 bytes) 000501 1788867212.419021 MIRROR_EXTEND to 2 mirrors 000502 1788867213.288500 mapread 0x008a35 thru 0x00e875 (0x5e41 bytes) 000504 1788867213.315922 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000505 1788867213.497200 trunc from 0x02df50 to 0x02ecd4 (0xd85 bytes) 000508 1788867213.565161 MIRROR_EXTEND to 2 mirrors 000512 1788867214.481957 punch from 0x00f9e0 to 0x01c808 (0xce29 bytes) 000513 1788867214.544697 punch from 0x002823 to 0x00f109 (0xc8e7 bytes) 000514 1788867214.549114 mapwrite 0x00aafa thru 0x01244e (0x7955 bytes) 000515 1788867214.611815 mapwrite 0x02286d thru 0x02c9a0 (0xa134 bytes) 000517 1788867214.687207 MIRROR_RESYNC 2 mirrors 000518 1788867215.734170 punch from 0x02dc6d to 0x02ecd4 (0x1068 bytes) 000519 1788867215.816298 MIRROR_RESYNC 2 mirrors 000520 1788867216.744082 mapread 0x007a36 thru 0x00ef27 (0x74f2 bytes) 000521 1788867216.763213 MIRROR_RESYNC 2 mirrors 000522 1788867217.088357 MIRROR_RESYNC 2 mirrors 000523 1788867217.463988 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000524 1788867217.619449 trunc from 0x02ecd5 to 0x01e5ad (0x10727 bytes) 000526 1788867217.648448 mapread 0x0120cc thru 0x01c581 (0xa4b6 bytes) 000529 1788867217.674255 mapwrite 0x03291b thru 0x036089 (0x376f bytes) 000534 1788867217.766754 MIRROR_EXTEND to 2 mirrors 000535 1788867218.677956 mapwrite 0x02dfe6 thru 0x038eea (0xaf05 bytes) 000537 1788867218.926759 MIRROR_RESYNC 2 mirrors 000538 1788867220.107893 read 0x0238c2 thru 0x026ef8 (0x3637 bytes) 000540 1788867220.124835 MIRROR_RESYNC 2 mirrors 000544 1788867220.603149 MIRROR_EXTEND to 3 mirrors 000545 1788867221.906030 trunc from 0x038eeb to 0x00a252 (0x2ec98 bytes) 000546 1788867222.013245 read 0x00262c thru 0x00a252 (0x7c27 bytes) 000547 1788867222.023368 punch from 0x0085ab to 0x00a252 (0x1ca8 bytes) 000548 1788867222.031123 mapwrite 0x027189 thru 0x027ee9 (0xd61 bytes) 000549 1788867222.124304 punch from 0x009ab3 to 0x0195b1 (0xfaff bytes) 000551 1788867222.133563 punch from 0x00a45d to 0x01897e (0xe522 bytes) 000552 1788867222.138987 punch from 0x017a71 to 0x020f4e (0x94de bytes) 000553 1788867222.143825 punch from 0x018e60 to 0x02791c (0xeabd bytes) 000555 1788867222.151219 read 0x0133d0 thru 0x01e630 (0xb261 bytes) 000558 1788867222.166871 punch from 0x00e092 to 0x00f5fe (0x156d bytes) 000559 1788867222.172666 punch from 0x0067c0 to 0x015f5c (0xf79d bytes) 000562 1788867222.179059 punch from 0x00ec9e to 0x014655 (0x59b8 bytes) 000563 1788867222.183187 trunc from 0x027eea to 0x031179 (0x9290 bytes) 000565 1788867222.199416 mapread 0x02b37d thru 0x02d021 (0x1ca5 bytes) 000567 1788867222.211421 trunc from 0x03117a to 0x02b5be (0x5bbb bytes) 000569 1788867222.231570 MIRROR_RESYNC 3 mirrors 000570 1788867223.782008 trunc from 0x02b5bf to 0x01778a (0x13e34 bytes) 000571 1788867223.936628 mapread 0x007527 thru 0x016609 (0xf0e3 bytes) 000572 1788867223.992161 punch from 0x01566f to 0x01778a (0x211c bytes) 000573 1788867224.000009 mapread 0x00a413 thru 0x01778a (0xd378 bytes) 000575 1788867224.015120 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1778b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1778b): Mirror 2: 0x97d83d46 (stale) Mirror 3: 0x97d83d46 (stale) CRC-32 checksum value for chunk [0, 0x1778b): Mirror 1: 0x97d83d46 Mirror 4: 0x97d83d46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1778b: skipped truncating to largest ever: 0x3e64b 000576 1788867225.166984 trunc from 0x01778b to 0x03e64a (0x26ec0 bytes) 000577 1788867225.328392 punch from 0x00483e to 0x00daf2 (0x92b5 bytes) 000578 1788867225.340080 mapwrite 0x0246fc thru 0x027e71 (0x3776 bytes) 000580 1788867225.546338 write 0x00eadd thru 0x01a5a1 (0xbac5 bytes) 000581 1788867225.600889 MIRROR_RESYNC 4 mirrors 000583 1788867227.876661 mapread 0x009248 thru 0x00bb68 (0x2921 bytes) 000584 1788867227.898525 punch from 0x01a309 to 0x01d17e (0x2e76 bytes) 000585 1788867227.981587 read 0x007b08 thru 0x00cb1f (0x5018 bytes) 000587 1788867228.008997 read 0x025db4 thru 0x033474 (0xd6c1 bytes) 000588 1788867228.023254 trunc from 0x03e64b to 0x0395d5 (0x5075 bytes) 000590 1788867228.047648 trunc from 0x0395d6 to 0x01100b (0x285ca bytes) 000591 1788867228.076687 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1100c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1100c): Mirror 2: 0xde46cbb7 (stale) Mirror 3: 0xde46cbb7 (stale) Mirror 4: 0xde46cbb7 (stale) CRC-32 checksum value for chunk [0, 0x1100c): Mirror 1: 0xde46cbb7 Mirror 5: 0xde46cbb7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1100c: skipped 000592 1788867229.342759 punch from 0x00c3c8 to 0x01100b (0x4c44 bytes) 000593 1788867229.428328 mapwrite 0x027260 thru 0x02d243 (0x5fe4 bytes) 000594 1788867229.597995 trunc from 0x02d244 to 0x01cc46 (0x105fd bytes) 000595 1788867229.623488 write 0x01f017 thru 0x0295d8 (0xa5c2 bytes) 000598 1788867229.634630 MIRROR_RESYNC 5 mirrors 000599 1788867231.563540 mapread 0x013332 thru 0x022349 (0xf018 bytes) 000600 1788867231.631391 mapwrite 0x03d88e thru 0x03ffff (0x2772 bytes) 000601 1788867231.845557 trunc from 0x040000 to 0x007165 (0x38e9a bytes) 000602 1788867231.910061 punch from 0x0022b6 to 0x004783 (0x24ce bytes) 000604 1788867231.931420 punch from 0x001809 to 0x0049bc (0x31b4 bytes) 000606 1788867231.944131 trunc from 0x007166 to 0x01d4be (0x16359 bytes) 000607 1788867231.966840 mapread 0x0088b9 thru 0x00de65 (0x55ad bytes) 000609 1788867231.990469 punch from 0x003932 to 0x011dc5 (0xe494 bytes) 000610 1788867232.014071 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1d4bf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d4bf): Mirror 2: 0x74711fa4 (stale) Mirror 3: 0x74711fa4 (stale) Mirror 4: 0x74711fa4 (stale) Mirror 5: 0x74711fa4 (stale) CRC-32 checksum value for chunk [0, 0x1d4bf): Mirror 1: 0x405c0c4b Mirror 6: 0x405c0c4b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d4bf: skipped 000613 1788867233.870504 mapwrite 0x00ede9 thru 0x015226 (0x643e bytes) 000614 1788867234.105486 punch from 0x0068d0 to 0x00bbd9 (0x530a bytes) 000615 1788867234.111898 mapread 0x016e43 thru 0x0179ee (0xbac bytes) 000616 1788867234.120380 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1d4bf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d4bf): Mirror 2: 0x74711fa4 (stale) Mirror 3: 0x74711fa4 (stale) Mirror 4: 0x74711fa4 (stale) Mirror 5: 0x74711fa4 (stale) Mirror 6: 0x405c0c4b (stale) CRC-32 checksum value for chunk [0, 0x1d4bf): Mirror 1: 0x47a89d66 Mirror 7: 0x47a89d66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d4bf: skipped 000617 1788867235.778993 punch from 0x00699b to 0x011b01 (0xb167 bytes) 000620 1788867235.892115 trunc from 0x01d4bf to 0x010faf (0xc50f bytes) 000621 1788867235.930019 trunc from 0x010fb0 to 0x00c864 (0x474b bytes) 000622 1788867235.959197 trunc from 0x00c865 to 0x002f7e (0x98e6 bytes) 000624 1788867235.987240 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f7f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f7f): Mirror 2: 0x72c861db (stale) Mirror 3: 0x72c861db (stale) Mirror 4: 0x72c861db (stale) Mirror 5: 0x72c861db (stale) Mirror 6: 0x9eb13ef2 (stale) Mirror 7: 0x9eb13ef2 (stale) CRC-32 checksum value for chunk [0, 0x2f7f): Mirror 1: 0x9eb13ef2 Mirror 8: 0x9eb13ef2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f7f: skipped 000625 1788867237.011323 write 0x02e9c4 thru 0x03357a (0x4bb7 bytes) 000626 1788867237.114142 mapwrite 0x031527 thru 0x03934f (0x7e29 bytes) 000627 1788867237.254747 punch from 0x021fd1 to 0x027a6d (0x5a9d bytes) 000628 1788867237.269856 punch from 0x019b02 to 0x022bec (0x90eb bytes) 000629 1788867237.278571 read 0x004f24 thru 0x008a60 (0x3b3d bytes) 000630 1788867237.293028 mapread 0x00e055 thru 0x00f86c (0x1818 bytes) 000633 1788867237.313133 punch from 0x02a01f to 0x02e83c (0x481e bytes) 000636 1788867237.321524 write 0x03f9e5 thru 0x03ffff (0x61b bytes) 000637 1788867237.326991 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x20372f72 (stale) Mirror 3: 0x20372f72 (stale) Mirror 4: 0x20372f72 (stale) Mirror 5: 0x20372f72 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 7: 0xa0a36c62 (stale) Mirror 8: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa4b45dd2 Mirror 9: 0xa4b45dd2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000639 1788867238.583199 read 0x03ef53 thru 0x03ffff (0x10ad bytes) 000640 1788867238.618657 trunc from 0x040000 to 0x00fe42 (0x301bd bytes) 000641 1788867238.843684 mapread 0x009851 thru 0x00fe42 (0x65f2 bytes) 000642 1788867238.865899 mapwrite 0x0245c6 thru 0x02a1f1 (0x5c2c bytes) 000643 1788867238.952761 punch from 0x00dfb3 to 0x01a29f (0xc2ed bytes) 000645 1788867238.970297 MIRROR_RESYNC 9 mirrors 000646 1788867241.964305 write 0x020fbe thru 0x02a87e (0x98c1 bytes) 000647 1788867242.064934 punch from 0x02967e to 0x02a87e (0x1201 bytes) 000648 1788867242.083766 read 0x02902b thru 0x02a87e (0x1854 bytes) 000649 1788867242.090522 mapwrite 0x0344b1 thru 0x03ffff (0xbb4f bytes) 000650 1788867242.205590 MIRROR_RESYNC 9 mirrors 000651 1788867246.163901 write 0x002a36 thru 0x00664e (0x3c19 bytes) 000654 1788867246.275473 mapread 0x03d8cc thru 0x03ffff (0x2734 bytes) 000657 1788867246.313073 punch from 0x01c645 to 0x01e8fd (0x22b9 bytes) 000660 1788867246.332249 punch from 0x001f63 to 0x004658 (0x26f6 bytes) 000662 1788867246.337923 mapread 0x01d9f9 thru 0x01ebfc (0x1204 bytes) 000663 1788867246.351689 mapread 0x015ef4 thru 0x0258ea (0xf9f7 bytes) 000664 1788867246.360951 punch from 0x03ae55 to 0x03afd9 (0x185 bytes) 000665 1788867246.366385 trunc from 0x040000 to 0x031ec5 (0xe13a bytes) 000666 1788867246.389356 mapread 0x01c60d thru 0x028203 (0xbbf7 bytes) 000668 1788867246.398880 trunc from 0x031ec6 to 0x03ca0f (0xab4a bytes) 000669 1788867246.413647 trunc from 0x03ca10 to 0x01e827 (0x1e1e8 bytes) 000671 1788867246.434802 write 0x034e4e thru 0x038785 (0x3938 bytes) 000672 1788867246.435897 mapwrite 0x02939c thru 0x02f635 (0x629a bytes) 000673 1788867246.494765 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38786): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38786): Mirror 2: 0xcc63b254 (stale) Mirror 3: 0xcc63b254 (stale) Mirror 4: 0xcc63b254 (stale) Mirror 5: 0xcc63b254 (stale) Mirror 6: 0xcc63b254 (stale) Mirror 7: 0xcc63b254 (stale) Mirror 8: 0xcc63b254 (stale) Mirror 9: 0xcc63b254 (stale) CRC-32 checksum value for chunk [0, 0x38786): Mirror 1: 0x99d97315 Mirror 10: 0x99d97315 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38786: skipped 000674 1788867248.062182 punch from 0x00cd79 to 0x00d8fd (0xb85 bytes) 000675 1788867248.248689 trunc from 0x038786 to 0x0096d5 (0x2f0b0 bytes) 000678 1788867248.272954 write 0x030045 thru 0x031355 (0x1311 bytes) 000679 1788867248.281591 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x31356): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31356): Mirror 2: 0xae9d9502 (stale) Mirror 3: 0xae9d9502 (stale) Mirror 4: 0xae9d9502 (stale) Mirror 5: 0xae9d9502 (stale) Mirror 6: 0xae9d9502 (stale) Mirror 7: 0xae9d9502 (stale) Mirror 8: 0xae9d9502 (stale) Mirror 9: 0xae9d9502 (stale) Mirror 10: 0x85cdb610 (stale) CRC-32 checksum value for chunk [0, 0x31356): Mirror 1: 0x521a5a3e Mirror 11: 0x521a5a3e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31356: skipped 000680 1788867249.889453 write 0x02fea8 thru 0x039495 (0x95ee bytes) 000683 1788867250.029006 trunc from 0x039496 to 0x03b999 (0x2504 bytes) 000684 1788867250.052094 read 0x0324da thru 0x03552a (0x3051 bytes) 000685 1788867250.052892 read 0x029f47 thru 0x02dc2d (0x3ce7 bytes) 000687 1788867250.067609 read 0x0059b4 thru 0x00eeb1 (0x94fe bytes) 000688 1788867250.068559 punch from 0x0146e4 to 0x018521 (0x3e3e bytes) 000689 1788867250.084773 mapread 0x02b720 thru 0x034f01 (0x97e2 bytes) 000690 1788867250.086038 mapread 0x000ae8 thru 0x00b137 (0xa650 bytes) 000692 1788867250.092383 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b99a): Mirror 2: 0x22bf2475 (stale) Mirror 3: 0x22bf2475 (stale) Mirror 4: 0x22bf2475 (stale) Mirror 6: 0x22bf2475 (stale) Mirror 7: 0x22bf2475 (stale) Mirror 8: 0x22bf2475 (stale) Mirror 9: 0x22bf2475 (stale) Mirror 10: 0xaf4cb44c (stale) Mirror 11: 0xe1849b11 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b99a): Mirror 2: 0x22bf2475 (stale) Mirror 3: 0x22bf2475 (stale) Mirror 4: 0x22bf2475 (stale) Mirror 6: 0x22bf2475 (stale) Mirror 7: 0x22bf2475 (stale) Mirror 8: 0x22bf2475 (stale) Mirror 9: 0x22bf2475 (stale) Mirror 10: 0xaf4cb44c (stale) Mirror 11: 0xe1849b11 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b99a: skipped 000693 1788867250.793126 read 0x02081b thru 0x027d00 (0x74e6 bytes) 000694 1788867250.806370 MIRROR_RESYNC 10 mirrors 000695 1788867255.858296 mapread 0x01c4b2 thru 0x027505 (0xb054 bytes) 000696 1788867255.914569 mapread 0x031b24 thru 0x037438 (0x5915 bytes) 000700 1788867255.925766 mapread 0x021b60 thru 0x03102e (0xf4cf bytes) 000704 1788867255.927788 mapwrite 0x00029f thru 0x007657 (0x73b9 bytes) 000705 1788867256.131315 trunc from 0x03b99a to 0x038e17 (0x2b82 bytes) 000706 1788867256.162778 punch from 0x02f9bc to 0x0320f8 (0x273d bytes) 000707 1788867256.168409 write 0x026ef2 thru 0x032164 (0xb273 bytes) 000710 1788867256.180627 write 0x02b9c8 thru 0x03a8a0 (0xeed9 bytes) 000711 1788867256.183212 write 0x009ef2 thru 0x00bc55 (0x1d64 bytes) 000712 1788867256.184947 read 0x012e26 thru 0x01b10e (0x82e9 bytes) 000713 1788867256.198586 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3a8a1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8a1): Mirror 2: 0xf4c6e13f (stale) Mirror 3: 0xf4c6e13f (stale) Mirror 4: 0xf4c6e13f (stale) Mirror 6: 0xf4c6e13f (stale) Mirror 7: 0xf4c6e13f (stale) Mirror 8: 0xf4c6e13f (stale) Mirror 9: 0xf4c6e13f (stale) Mirror 10: 0xf4c6e13f (stale) Mirror 11: 0xf4c6e13f (stale) CRC-32 checksum value for chunk [0, 0x3a8a1): Mirror 1: 0xb809751d Mirror 12: 0xb809751d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8a1: skipped 000714 1788867257.576865 trunc from 0x03a8a1 to 0x0369fa (0x3ea6 bytes) 000715 1788867257.813534 read 0x031d83 thru 0x0369fa (0x4c78 bytes) 000716 1788867257.827367 trunc from 0x0369fb to 0x00c37c (0x2a67e bytes) 000717 1788867257.879273 trunc from 0x00c37d to 0x01117d (0x4e01 bytes) 000718 1788867257.908042 mapread 0x0084f3 thru 0x01117d (0x8c8b bytes) 000719 1788867257.959473 punch from 0x0034e2 to 0x003b46 (0x665 bytes) 000720 1788867257.973512 trunc from 0x01117e to 0x012ab8 (0x193b bytes) 000722 1788867258.026385 MIRROR_RESYNC 11 mirrors 000723 1788867261.774328 read 0x00c697 thru 0x012ab8 (0x6422 bytes) 000724 1788867261.785772 write 0x017287 thru 0x024d6a (0xdae4 bytes) 000725 1788867261.926247 mapread 0x00fb44 thru 0x012bf8 (0x30b5 bytes) 000727 1788867261.966072 trunc from 0x024d6b to 0x0256bf (0x955 bytes) 000730 1788867262.008864 mapwrite 0x0171dc thru 0x019119 (0x1f3e bytes) 000731 1788867262.070501 read 0x01c5c3 thru 0x0256bf (0x90fd bytes) 000733 1788867262.080612 read 0x00e9a4 thru 0x01d6c9 (0xed26 bytes) 000734 1788867262.081334 mapwrite 0x02396d thru 0x030bc5 (0xd259 bytes) 000737 1788867262.191575 mapwrite 0x005457 thru 0x00b35e (0x5f08 bytes) 000739 1788867262.284533 mapwrite 0x0034c1 thru 0x00551b (0x205b bytes) 000740 1788867262.359005 read 0x01e618 thru 0x02739b (0x8d84 bytes) 000741 1788867262.359566 punch from 0x01033b to 0x015c2a (0x58f0 bytes) 000743 1788867262.366389 trunc from 0x030bc6 to 0x02ea33 (0x2192 bytes) 000744 1788867262.393351 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2ea34): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ea34): Mirror 2: 0x7ffb68eb (stale) Mirror 3: 0x7ffb68eb (stale) Mirror 4: 0x7ffb68eb (stale) Mirror 6: 0x7ffb68eb (stale) Mirror 7: 0x7ffb68eb (stale) Mirror 8: 0x7ffb68eb (stale) Mirror 9: 0x7ffb68eb (stale) Mirror 10: 0x7ffb68eb (stale) Mirror 11: 0x7ffb68eb (stale) Mirror 12: 0x7ffb68eb (stale) CRC-32 checksum value for chunk [0, 0x2ea34): Mirror 1: 0xcf059b55 Mirror 13: 0xcf059b55 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ea34: skipped 000745 1788867263.780499 punch from 0x0147e9 to 0x01e1fe (0x9a16 bytes) 000746 1788867263.869640 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ea34): Mirror 3: 0x7ffb68eb (stale) Mirror 4: 0x7ffb68eb (stale) Mirror 6: 0x7ffb68eb (stale) Mirror 7: 0x7ffb68eb (stale) Mirror 8: 0x7ffb68eb (stale) Mirror 9: 0x7ffb68eb (stale) Mirror 10: 0x7ffb68eb (stale) Mirror 11: 0x7ffb68eb (stale) Mirror 12: 0x7ffb68eb (stale) Mirror 13: 0xcf059b55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ea34): Mirror 3: 0x7ffb68eb (stale) Mirror 4: 0x7ffb68eb (stale) Mirror 6: 0x7ffb68eb (stale) Mirror 7: 0x7ffb68eb (stale) Mirror 8: 0x7ffb68eb (stale) Mirror 9: 0x7ffb68eb (stale) Mirror 10: 0x7ffb68eb (stale) Mirror 11: 0x7ffb68eb (stale) Mirror 12: 0x7ffb68eb (stale) Mirror 13: 0xcf059b55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ea34: skipped 000748 1788867264.654655 punch from 0x019925 to 0x024754 (0xae30 bytes) 000749 1788867264.661468 trunc from 0x02ea34 to 0x03a12d (0xb6fa bytes) 000750 1788867264.684166 mapwrite 0x00b8d5 thru 0x00c3a8 (0xad4 bytes) 000752 1788867264.750590 punch from 0x00da08 to 0x0138b8 (0x5eb1 bytes) 000754 1788867264.756583 punch from 0x0199c9 to 0x025574 (0xbbac bytes) 000755 1788867264.761612 punch from 0x029feb to 0x02d9b7 (0x39cd bytes) 000759 1788867264.771351 mapread 0x02cea4 thru 0x02ff6f (0x30cc bytes) 000760 1788867264.781507 trunc from 0x03a12e to 0x02f678 (0xaab5 bytes) 000761 1788867264.803302 read 0x01303c thru 0x015cf4 (0x2cb9 bytes) 000763 1788867264.810120 read 0x0121ca thru 0x019cf6 (0x7b2d bytes) 000765 1788867264.825789 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 8: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 12: 0x39fd616b (stale) Mirror 13: 0x97559ed9 (stale) CRC-32 checksum value for chunk [0, 0x2f679): Mirror 1: 0x641ff7bb Mirror 14: 0x641ff7bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f679: skipped 000766 1788867266.717561 mapread 0x0152fc thru 0x0154bb (0x1c0 bytes) 000767 1788867266.729036 mapread 0x00bc48 thru 0x0182d9 (0xc692 bytes) 000769 1788867266.758437 mapread 0x006f03 thru 0x00d526 (0x6624 bytes) 000772 1788867266.768203 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 8: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 13: 0x97559ed9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 8: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 13: 0x97559ed9 (stale) CRC-32 checksum value for chunk [0, 0x2f679): Mirror 1: 0x641ff7bb Mirror 14: 0x641ff7bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f679: skipped 000779 1788867268.407537 write 0x00ee1f thru 0x018fa4 (0xa186 bytes) 000780 1788867268.568166 read 0x0043c3 thru 0x007d0f (0x394d bytes) 000783 1788867268.581362 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 13: 0x97559ed9 (stale) Mirror 14: 0x641ff7bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 13: 0x97559ed9 (stale) Mirror 14: 0x641ff7bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f679: skipped 000784 1788867269.165601 read 0x00acb5 thru 0x015811 (0xab5d bytes) 000785 1788867269.180752 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 14: 0x641ff7bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f679): Mirror 3: 0x39fd616b (stale) Mirror 4: 0x39fd616b (stale) Mirror 6: 0x39fd616b (stale) Mirror 7: 0x39fd616b (stale) Mirror 9: 0x39fd616b (stale) Mirror 10: 0x39fd616b (stale) Mirror 11: 0x39fd616b (stale) Mirror 14: 0x641ff7bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f679: skipped 000786 1788867269.699053 read 0x020803 thru 0x023eec (0x36ea bytes) 000787 1788867269.705660 mapread 0x02460c thru 0x02f678 (0xb06d bytes) 000788 1788867269.726415 punch from 0x019ecc to 0x022bf0 (0x8d25 bytes) 000791 1788867269.732332 read 0x015ec3 thru 0x022a7e (0xcbbc bytes) 000792 1788867269.741515 read 0x01612e thru 0x02514e (0xf021 bytes) 000793 1788867269.742287 mapread 0x00f7a4 thru 0x0162e6 (0x6b43 bytes) 000794 1788867269.743582 trunc from 0x02f679 to 0x0291f0 (0x6488 bytes) 000795 1788867269.768927 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x291f1): Mirror 3: 0x7d38757b (stale) Mirror 4: 0x7d38757b (stale) Mirror 6: 0x7d38757b (stale) Mirror 7: 0x7d38757b (stale) Mirror 9: 0x7d38757b (stale) Mirror 10: 0x7d38757b (stale) Mirror 11: 0x7d38757b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x291f1): Mirror 3: 0x7d38757b (stale) Mirror 4: 0x7d38757b (stale) Mirror 6: 0x7d38757b (stale) Mirror 7: 0x7d38757b (stale) Mirror 9: 0x7d38757b (stale) Mirror 10: 0x7d38757b (stale) Mirror 11: 0x7d38757b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x291f1: skipped 000796 1788867270.373226 mapread 0x007b9d thru 0x016e11 (0xf275 bytes) 000797 1788867270.402964 read 0x01e228 thru 0x02200f (0x3de8 bytes) 000798 1788867270.411408 write 0x019bd9 thru 0x025a5d (0xbe85 bytes) 000800 1788867270.419199 trunc from 0x0291f1 to 0x026f03 (0x22ed bytes) 000801 1788867270.461905 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x26f04): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26f04): Mirror 3: 0x946a229c (stale) Mirror 4: 0x946a229c (stale) Mirror 6: 0x946a229c (stale) Mirror 7: 0x946a229c (stale) Mirror 9: 0x946a229c (stale) Mirror 10: 0x946a229c (stale) Mirror 11: 0x946a229c (stale) CRC-32 checksum value for chunk [0, 0x26f04): Mirror 1: 0xc79ccca6 Mirror 12: 0xc79ccca6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26f04: skipped 000802 1788867271.690415 write 0x03a459 thru 0x03a9d1 (0x579 bytes) 000804 1788867271.803315 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a9d2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a9d2): Mirror 3: 0xa3227f55 (stale) Mirror 4: 0xa3227f55 (stale) Mirror 6: 0xa3227f55 (stale) Mirror 7: 0xa3227f55 (stale) Mirror 9: 0xa3227f55 (stale) Mirror 10: 0xa3227f55 (stale) Mirror 11: 0xa3227f55 (stale) Mirror 12: 0xed1413d2 (stale) CRC-32 checksum value for chunk [0, 0x3a9d2): Mirror 1: 0xab993376 Mirror 13: 0xab993376 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a9d2: skipped 000805 1788867273.451293 trunc from 0x03a9d2 to 0x0119de (0x28ff3 bytes) 000806 1788867273.612967 mapread 0x00fb86 thru 0x0119de (0x1e59 bytes) 000807 1788867273.647297 mapwrite 0x02d697 thru 0x034e42 (0x77ac bytes) 000808 1788867273.781869 trunc from 0x034e43 to 0x017294 (0x1dbae bytes) 000811 1788867273.822214 MIRROR_RESYNC 10 mirrors 000812 1788867277.091922 read 0x002dc2 thru 0x004aff (0x1d3e bytes) 000813 1788867277.098161 write 0x025862 thru 0x02e7b8 (0x8f57 bytes) 000814 1788867277.209532 mapwrite 0x022009 thru 0x0241b4 (0x21ac bytes) 000816 1788867277.305656 mapread 0x01d386 thru 0x01f679 (0x22f4 bytes) 000817 1788867277.306518 punch from 0x005f40 to 0x01247a (0xc53b bytes) 000820 1788867277.313311 mapwrite 0x036d17 thru 0x03ffff (0x92e9 bytes) 000821 1788867277.543400 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1602955c (stale) Mirror 4: 0x1602955c (stale) Mirror 7: 0x1602955c (stale) Mirror 9: 0x1602955c (stale) Mirror 10: 0x1602955c (stale) Mirror 11: 0x1602955c (stale) Mirror 12: 0x1602955c (stale) Mirror 13: 0x1602955c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1602955c (stale) Mirror 4: 0x1602955c (stale) Mirror 7: 0x1602955c (stale) Mirror 9: 0x1602955c (stale) Mirror 10: 0x1602955c (stale) Mirror 11: 0x1602955c (stale) Mirror 12: 0x1602955c (stale) Mirror 13: 0x1602955c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000822 1788867278.141929 mapwrite 0x03dc88 thru 0x03ffff (0x2378 bytes) 000823 1788867278.282774 trunc from 0x040000 to 0x00e4e1 (0x31b1e bytes) 000825 1788867278.319535 mapwrite 0x016a4d thru 0x017044 (0x5f8 bytes) 000826 1788867278.448407 write 0x011013 thru 0x018d5d (0x7d4b bytes) 000828 1788867278.454163 write 0x013a6a thru 0x01ba2d (0x7fc4 bytes) 000830 1788867278.456163 mapwrite 0x0105a3 thru 0x01dd68 (0xd7c6 bytes) 000831 1788867278.556559 mapwrite 0x03a7a7 thru 0x03e519 (0x3d73 bytes) 000832 1788867278.633535 read 0x008c37 thru 0x016f00 (0xe2ca bytes) 000834 1788867278.644489 mapwrite 0x004907 thru 0x0088c1 (0x3fbb bytes) 000835 1788867278.812492 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e51a): Mirror 4: 0x6a506759 (stale) Mirror 7: 0x6a506759 (stale) Mirror 9: 0x6a506759 (stale) Mirror 10: 0x6a506759 (stale) Mirror 11: 0x6a506759 (stale) Mirror 12: 0x6a506759 (stale) Mirror 13: 0x6a506759 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e51a): Mirror 4: 0x6a506759 (stale) Mirror 7: 0x6a506759 (stale) Mirror 9: 0x6a506759 (stale) Mirror 10: 0x6a506759 (stale) Mirror 11: 0x6a506759 (stale) Mirror 12: 0x6a506759 (stale) Mirror 13: 0x6a506759 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e51a: skipped 000838 1788867279.647191 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e51a): Mirror 4: 0x6a506759 (stale) Mirror 7: 0x6a506759 (stale) Mirror 9: 0x6a506759 (stale) Mirror 10: 0x6a506759 (stale) Mirror 11: 0x6a506759 (stale) Mirror 13: 0x6a506759 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e51a): Mirror 4: 0x6a506759 (stale) Mirror 7: 0x6a506759 (stale) Mirror 9: 0x6a506759 (stale) Mirror 10: 0x6a506759 (stale) Mirror 11: 0x6a506759 (stale) Mirror 13: 0x6a506759 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e51a: skipped 000839 1788867280.098343 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e51a): Mirror 7: 0x6a506759 (stale) Mirror 9: 0x6a506759 (stale) Mirror 10: 0x6a506759 (stale) Mirror 11: 0x6a506759 (stale) Mirror 13: 0x6a506759 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e51a): Mirror 7: 0x6a506759 (stale) Mirror 9: 0x6a506759 (stale) Mirror 10: 0x6a506759 (stale) Mirror 11: 0x6a506759 (stale) Mirror 13: 0x6a506759 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e51a: skipped 000841 1788867280.633152 read 0x003038 thru 0x006d93 (0x3d5c bytes) 000843 1788867280.650491 mapread 0x030958 thru 0x035952 (0x4ffb bytes) 000845 1788867280.673832 trunc from 0x03e51a to 0x0118cb (0x2cc4e bytes) 000846 1788867280.700954 read 0x00e572 thru 0x0118cb (0x335a bytes) 000847 1788867280.713664 punch from 0x00f106 to 0x0118cb (0x27c6 bytes) truncating to largest ever: 0x3ffb0 000848 1788867280.720139 trunc from 0x0118cc to 0x03ffaf (0x2e6e4 bytes) 000849 1788867280.751277 mapread 0x004209 thru 0x011c72 (0xda6a bytes) 000851 1788867280.786009 mapwrite 0x01431d thru 0x0151f1 (0xed5 bytes) 000852 1788867280.852218 trunc from 0x03ffb0 to 0x023c42 (0x1c36d bytes) 000853 1788867280.875702 trunc from 0x023c43 to 0x019682 (0xa5c0 bytes) 000857 1788867280.899996 read 0x010736 thru 0x013cf2 (0x35bd bytes) 000858 1788867280.909658 MIRROR_RESYNC 6 mirrors 000860 1788867282.773223 MIRROR_RESYNC 6 mirrors 000862 1788867283.244965 mapwrite 0x01e7e0 thru 0x02d9dd (0xf1fe bytes) 000863 1788867283.414662 mapread 0x02a9fc thru 0x02d9dd (0x2fe2 bytes) 000865 1788867283.420897 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d9de): Mirror 7: 0xed7386f6 (stale) Mirror 10: 0xed7386f6 (stale) Mirror 11: 0xed7386f6 (stale) Mirror 13: 0xed7386f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d9de): Mirror 7: 0xed7386f6 (stale) Mirror 10: 0xed7386f6 (stale) Mirror 11: 0xed7386f6 (stale) Mirror 13: 0xed7386f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d9de: skipped 000867 1788867283.898330 mapread 0x0068ee thru 0x011b1b (0xb22e bytes) 000868 1788867283.926974 write 0x01f4be thru 0x026307 (0x6e4a bytes) 000869 1788867283.940184 trunc from 0x02d9de to 0x00fde5 (0x1dbf8 bytes) 000870 1788867283.965489 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfde6): Mirror 10: 0x3e57f7c8 (stale) Mirror 11: 0x3e57f7c8 (stale) Mirror 13: 0x3e57f7c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfde6): Mirror 10: 0x3e57f7c8 (stale) Mirror 11: 0x3e57f7c8 (stale) Mirror 13: 0x3e57f7c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfde6: skipped 000871 1788867284.312927 mapread 0x00d23f thru 0x00fde5 (0x2ba7 bytes) 000873 1788867284.385774 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfde6): Mirror 10: 0x3e57f7c8 (stale) Mirror 11: 0x3e57f7c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfde6): Mirror 10: 0x3e57f7c8 (stale) Mirror 11: 0x3e57f7c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfde6: skipped 000874 1788867284.788445 mapread 0x00d440 thru 0x00e34c (0xf0d bytes) 000875 1788867284.809197 trunc from 0x00fde6 to 0x026d09 (0x16f24 bytes) 000876 1788867284.831734 trunc from 0x026d0a to 0x0314f4 (0xa7eb bytes) 000877 1788867284.870215 read 0x00cda4 thru 0x01c643 (0xf8a0 bytes) 000878 1788867284.880679 mapwrite 0x01a8f5 thru 0x01c1bd (0x18c9 bytes) 000879 1788867284.943129 read 0x0048be thru 0x011f53 (0xd696 bytes) 000880 1788867284.963553 mapwrite 0x013d25 thru 0x019a25 (0x5d01 bytes) 000881 1788867285.034461 trunc from 0x0314f5 to 0x03533b (0x3e47 bytes) 000882 1788867285.072686 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3533c): Mirror 10: 0xd0353b60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3533c): Mirror 10: 0xd0353b60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3533c: skipped 000883 1788867285.490430 mapwrite 0x037dd6 thru 0x03ffff (0x822a bytes) 000884 1788867285.601738 read 0x034898 thru 0x03ffff (0xb768 bytes) 000886 1788867285.603811 mapwrite 0x000df4 thru 0x007235 (0x6442 bytes) 000887 1788867285.655905 mapwrite 0x01fd69 thru 0x028c35 (0x8ecd bytes) 000889 1788867285.722610 write 0x00ec26 thru 0x0121af (0x358a bytes) 000894 1788867285.735027 mapwrite 0x0279e4 thru 0x02b063 (0x3680 bytes) 000895 1788867285.778150 punch from 0x03bd3e to 0x03ffff (0x42c2 bytes) 000897 1788867285.783356 write 0x035c9c thru 0x03b0b3 (0x5418 bytes) 000898 1788867285.790402 mapread 0x03b171 thru 0x03ffff (0x4e8f bytes) 000899 1788867285.798932 read 0x02e126 thru 0x03cc1f (0xeafa bytes) 000900 1788867285.804672 write 0x03c956 thru 0x03ffff (0x36aa bytes) 000901 1788867285.811169 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000902 1788867285.958554 punch from 0x036fd9 to 0x03e3f7 (0x741f bytes) 000904 1788867285.968974 punch from 0x0018b1 to 0x002df2 (0x1542 bytes) 000905 1788867285.973590 mapread 0x023835 thru 0x02bb3b (0x8307 bytes) 000906 1788867285.999133 MIRROR_EXTEND to 2 mirrors 000911 1788867287.404062 mapwrite 0x01a2a4 thru 0x021923 (0x7680 bytes) 000912 1788867287.594691 mapwrite 0x00bab5 thru 0x00f3b5 (0x3901 bytes) 000913 1788867287.676021 mapread 0x012eaf thru 0x01aca4 (0x7df6 bytes) 000915 1788867287.683094 trunc from 0x040000 to 0x023e9d (0x1c162 bytes) 000916 1788867287.716969 mapread 0x009675 thru 0x00dad8 (0x4464 bytes) 000917 1788867287.719171 write 0x012c92 thru 0x0214f9 (0xe868 bytes) 000919 1788867287.722845 punch from 0x0185e8 to 0x02087c (0x8295 bytes) 000922 1788867287.741639 mapwrite 0x0246b2 thru 0x02a127 (0x5a76 bytes) 000924 1788867287.849652 write 0x02b196 thru 0x034096 (0x8f01 bytes) 000925 1788867287.852642 mapread 0x02246a thru 0x02f571 (0xd108 bytes) 000926 1788867287.864213 MIRROR_RESYNC 2 mirrors 000927 1788867289.023300 read 0x02f440 thru 0x034096 (0x4c57 bytes) 000928 1788867289.035320 mapread 0x019fb3 thru 0x0276f7 (0xd745 bytes) 000929 1788867289.066478 mapread 0x0323e7 thru 0x034096 (0x1cb0 bytes) 000932 1788867289.067893 read 0x019aef thru 0x023126 (0x9638 bytes) 000933 1788867289.075298 read 0x0048b1 thru 0x00b9f2 (0x7142 bytes) 000934 1788867289.093470 write 0x03427d thru 0x03cf7e (0x8d02 bytes) 000935 1788867289.231962 punch from 0x011835 to 0x01c66a (0xae36 bytes) 000936 1788867289.251866 read 0x0236f1 thru 0x02ffdb (0xc8eb bytes) 000938 1788867289.269789 write 0x026721 thru 0x02977b (0x305b bytes) 000940 1788867289.280782 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000943 1788867289.452740 punch from 0x0164cd to 0x01fc95 (0x97c9 bytes) 000946 1788867289.457978 write 0x00eee4 thru 0x01180c (0x2929 bytes) 000947 1788867289.471363 punch from 0x020f83 to 0x029e2e (0x8eac bytes) 000948 1788867289.481915 read 0x00220b thru 0x008c04 (0x69fa bytes) 000950 1788867289.500050 punch from 0x015ae1 to 0x0196d8 (0x3bf8 bytes) 000954 1788867289.520428 MIRROR_EXTEND to 2 mirrors 000957 1788867291.326006 punch from 0x028efb to 0x03776c (0xe872 bytes) 000958 1788867291.448826 mapwrite 0x03cf4d thru 0x03e3c0 (0x1474 bytes) 000959 1788867291.560916 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ad:0x0]: Invalid argument (22) 000960 1788867291.753774 trunc from 0x03e3c1 to 0x027c1f (0x167a1 bytes) 000962 1788867291.773694 punch from 0x024a21 to 0x027c1f (0x31ff bytes) 000963 1788867291.787549 write 0x00db83 thru 0x00e379 (0x7f7 bytes) 000965 1788867291.815864 punch from 0x017ba4 to 0x025ffc (0xe459 bytes) 000966 1788867291.826510 trunc from 0x027c20 to 0x02bb8b (0x3f6c bytes) 000967 1788867291.849862 trunc from 0x02bb8c to 0x03309e (0x7513 bytes) 000968 1788867291.865075 read 0x00576f thru 0x009c56 (0x44e8 bytes) 000969 1788867291.871827 punch from 0x0281ec to 0x02939f (0x11b4 bytes) 000970 1788867291.876932 write 0x01b373 thru 0x01df88 (0x2c16 bytes) 000973 1788867291.888078 mapwrite 0x00c723 thru 0x019870 (0xd14e bytes) 000975 1788867292.015759 mapwrite 0x03c607 thru 0x03ffff (0x39f9 bytes) 000976 1788867292.147456 mapread 0x02b8a8 thru 0x0362da (0xaa33 bytes) 000977 1788867292.167187 mapread 0x00c974 thru 0x0123e4 (0x5a71 bytes) 000978 1788867292.168536 mapwrite 0x00d168 thru 0x019307 (0xc1a0 bytes) 000981 1788867292.262697 read 0x02cb22 thru 0x032981 (0x5e60 bytes) 000983 1788867292.265464 mapwrite 0x022e7a thru 0x02f9cc (0xcb53 bytes) 000984 1788867292.367164 mapread 0x00a027 thru 0x00a2bd (0x297 bytes) 000986 1788867292.370407 read 0x02db82 thru 0x034138 (0x65b7 bytes) 000990 1788867292.376763 punch from 0x002085 to 0x004f7d (0x2ef9 bytes) 000991 1788867292.389704 MIRROR_EXTEND to 2 mirrors 000992 1788867294.004664 mapread 0x03f151 thru 0x03ffff (0xeaf bytes) 000996 1788867294.013015 write 0x007d25 thru 0x0150f3 (0xd3cf bytes) 000997 1788867294.112353 trunc from 0x040000 to 0x00655b (0x39aa4 bytes) 000999 1788867294.138093 mapwrite 0x021f94 thru 0x02e17e (0xc1eb bytes) All operations completed A-OK!