== sanity-flr test 70a: flr mode fsx test ================ 11:40:08 (1788882008) Seed set to 2009 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole skipping zero size read 000004 1788882009.506870 MIRROR_EXTEND to 2 mirrors 000005 1788882009.614501 mapwrite 0x03eb18 thru 0x03ffff (0x14e8 bytes) 000006 1788882009.655178 write 0x01c8fe thru 0x02392a (0x702d bytes) 000012 1788882009.660039 mapread 0x014333 thru 0x02286c (0xe53a bytes) 000013 1788882009.663538 punch from 0x02f24c to 0x03b5bd (0xc372 bytes) 000018 1788882009.670535 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) 000019 1788882009.707012 write 0x00429e thru 0x007010 (0x2d73 bytes) 000020 1788882009.710419 mapwrite 0x03cf9c thru 0x03ffff (0x3064 bytes) 000021 1788882009.728555 mapread 0x03146a thru 0x035382 (0x3f19 bytes) truncating to largest ever: 0x102c3 000022 1788882009.731743 trunc from 0x040000 to 0x0102c2 (0x2fd3d bytes) 000023 1788882009.736466 mapwrite 0x00ecc9 thru 0x019207 (0xa53f bytes) 000028 1788882009.760640 write 0x01427a thru 0x023a31 (0xf7b8 bytes) 000029 1788882009.761898 read 0x00add4 thru 0x015b31 (0xad5e bytes) 000030 1788882009.762440 mapwrite 0x030f18 thru 0x03b311 (0xa3fa bytes) 000031 1788882009.786708 punch from 0x03a475 to 0x03b311 (0xe9d bytes) 000033 1788882009.789239 write 0x02d44d thru 0x0399bd (0xc571 bytes) 000034 1788882009.790278 write 0x005bb4 thru 0x00eb8a (0x8fd7 bytes) 000036 1788882009.791471 read 0x02d7b1 thru 0x034f5a (0x77aa bytes) truncating to largest ever: 0x2aa64 000037 1788882009.791897 trunc from 0x03b312 to 0x02aa63 (0x108ae bytes) 000038 1788882009.796617 mapwrite 0x017421 thru 0x01e43a (0x701a bytes) 000040 1788882009.812534 punch from 0x004865 to 0x00497f (0x11b bytes) 000041 1788882009.814782 mapread 0x007e4a thru 0x016b10 (0xecc7 bytes) 000042 1788882009.815653 punch from 0x009065 to 0x0146d4 (0xb670 bytes) 000044 1788882009.818141 write 0x032689 thru 0x034390 (0x1d08 bytes) 000045 1788882009.818955 mapread 0x00d0f8 thru 0x014211 (0x711a bytes) 000046 1788882009.823218 write 0x01e84e thru 0x02ca02 (0xe1b5 bytes) 000047 1788882009.824426 trunc from 0x034391 to 0x023a15 (0x1097b bytes) 000049 1788882009.830804 punch from 0x007698 to 0x01112e (0x9a97 bytes) 000051 1788882009.835970 punch from 0x0176a0 to 0x023a15 (0xc376 bytes) 000053 1788882009.838642 punch from 0x022a91 to 0x023a15 (0xf85 bytes) 000057 1788882009.841957 write 0x02bed9 thru 0x03b65d (0xf785 bytes) 000058 1788882009.843109 trunc from 0x03b65e to 0x0196e9 (0x21f74 bytes) 000059 1788882009.848009 mapread 0x008ef9 thru 0x00e9cd (0x5ad5 bytes) 000063 1788882009.859545 read 0x00ab10 thru 0x00f0d9 (0x45ca bytes) truncating to largest ever: 0x3064c 000066 1788882009.864188 trunc from 0x0196ea to 0x03064b (0x16f62 bytes) 000067 1788882009.869360 punch from 0x01f397 to 0x025b03 (0x676d bytes) 000068 1788882009.871359 mapwrite 0x003af2 thru 0x006b92 (0x30a1 bytes) 000069 1788882009.886827 punch from 0x024d78 to 0x03064b (0xb8d4 bytes) 000070 1788882009.888925 write 0x00106b thru 0x0015c6 (0x55c bytes) 000072 1788882009.890221 write 0x0273dc thru 0x02aa96 (0x36bb bytes) 000073 1788882009.893811 write 0x021eea thru 0x022fbf (0x10d6 bytes) 000074 1788882009.894424 mapread 0x018ec1 thru 0x026ea8 (0xdfe8 bytes) 000075 1788882009.895114 read 0x00baf9 thru 0x013a46 (0x7f4e bytes) 000076 1788882009.897069 MIRROR_EXTEND to 2 mirrors 000078 1788882010.214166 read 0x019b26 thru 0x027646 (0xdb21 bytes) 000081 1788882010.222362 trunc from 0x03064c to 0x014f6f (0x1b6dc bytes) truncating to largest ever: 0x38ac4 000082 1788882010.242117 trunc from 0x014f70 to 0x038ac3 (0x23b54 bytes) 000083 1788882010.247206 mapread 0x02a911 thru 0x038ac3 (0xe1b3 bytes) 000085 1788882010.254236 mapwrite 0x0055fe thru 0x014ca6 (0xf6a9 bytes) 000087 1788882010.275044 mapread 0x01d17f thru 0x025aea (0x896c bytes) 000088 1788882010.278446 trunc from 0x038ac4 to 0x02e0a6 (0xaa1d bytes) 000089 1788882010.283298 write 0x0060af thru 0x009740 (0x3692 bytes) 000090 1788882010.283978 mapwrite 0x01c852 thru 0x021b1c (0x52cb bytes) 000091 1788882010.298792 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2e0a7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e0a7): Mirror 2: 0x81cd3e6c (stale) CRC-32 checksum value for chunk [0, 0x2e0a7): Mirror 1: 0xd6abe64e Mirror 3: 0xd6abe64e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e0a7: skipped 000093 1788882010.570914 punch from 0x02ca1c to 0x02e0a6 (0x168b bytes) 000094 1788882010.589651 write 0x01c035 thru 0x022294 (0x6260 bytes) 000096 1788882010.593289 read 0x024735 thru 0x02ac4d (0x6519 bytes) 000097 1788882010.595683 write 0x000393 thru 0x0016ef (0x135d bytes) 000099 1788882010.598548 trunc from 0x02e0a7 to 0x0080b3 (0x25ff3 bytes) 000102 1788882010.609525 write 0x0155f4 thru 0x01ba67 (0x6474 bytes) 000103 1788882010.610395 trunc from 0x01ba68 to 0x00eb06 (0xcf61 bytes) 000104 1788882010.614320 mapwrite 0x026281 thru 0x02c174 (0x5ef4 bytes) 000105 1788882010.636994 read 0x027137 thru 0x02a98f (0x3859 bytes) 000106 1788882010.637493 mapwrite 0x017931 thru 0x021560 (0x9c30 bytes) 000107 1788882010.654936 write 0x00bafa thru 0x012b12 (0x7019 bytes) 000108 1788882010.655691 write 0x004b2a thru 0x010e94 (0xc36b bytes) 000109 1788882010.656478 read 0x01af49 thru 0x01b40d (0x4c5 bytes) 000110 1788882010.656828 write 0x03c122 thru 0x03d71e (0x15fd bytes) 000113 1788882010.658078 mapwrite 0x0316de thru 0x03413c (0x2a5f bytes) 000114 1788882010.675176 read 0x0198a4 thru 0x028c7f (0xf3dc bytes) 000119 1788882010.677126 trunc from 0x03d71f to 0x022f3a (0x1a7e4 bytes) 000121 1788882010.683622 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22f3b): Mirror 3: 0x80fdab9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22f3b): Mirror 3: 0x80fdab9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22f3b: skipped 000122 1788882010.755983 read 0x01a3e6 thru 0x022f3a (0x8b55 bytes) 000125 1788882010.760034 MIRROR_RESYNC 2 mirrors 000126 1788882010.990027 read 0x00f18d thru 0x01a9bc (0xb830 bytes) 000127 1788882010.993767 MIRROR_RESYNC 2 mirrors 000128 1788882011.100526 punch from 0x00ee67 to 0x01c3d4 (0xd56e bytes) 000129 1788882011.117583 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) 000131 1788882011.157954 MIRROR_EXTEND to 2 mirrors 000132 1788882011.408003 MIRROR_EXTEND to 3 mirrors 000133 1788882011.588043 mapread 0x019700 thru 0x01cc12 (0x3513 bytes) 000134 1788882011.593359 punch from 0x014963 to 0x01f8ed (0xaf8b bytes) 000135 1788882011.613045 mapwrite 0x029f37 thru 0x03243d (0x8507 bytes) 000136 1788882011.636739 read 0x01230a thru 0x01849d (0x6194 bytes) 000138 1788882011.639523 mapwrite 0x0328c6 thru 0x0392ec (0x6a27 bytes) 000141 1788882011.659561 punch from 0x02636c to 0x029307 (0x2f9c bytes) 000144 1788882011.662096 mapread 0x026129 thru 0x029831 (0x3709 bytes) 000146 1788882011.665932 read 0x02b777 thru 0x02f4a7 (0x3d31 bytes) 000147 1788882011.666303 trunc from 0x0392ed to 0x03766e (0x1c7e bytes) 000148 1788882011.671132 read 0x01b62b thru 0x0279a5 (0xc37b bytes) 000149 1788882011.674280 punch from 0x01f68c to 0x02b6e6 (0xc05b bytes) 000151 1788882011.676424 punch from 0x036dbb to 0x03766e (0x8b4 bytes) 000152 1788882011.679711 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 1: 0x6d813139 Mirror 4: 0x6d813139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000153 1788882012.006915 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 1: 0x6d813139 Mirror 4: 0x6d813139 Mirror 5: 0x6d813139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000154 1788882012.262400 punch from 0x005161 to 0x007c50 (0x2af0 bytes) 000155 1788882012.281456 mapwrite 0x02c220 thru 0x033433 (0x7214 bytes) 000157 1788882012.302365 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) Mirror 5: 0x6d813139 (stale) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 1: 0x7ca99c70 Mirror 6: 0x7ca99c70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000158 1788882012.651865 read 0x008e34 thru 0x01081f (0x79ec bytes) 000159 1788882012.656325 write 0x021769 thru 0x026fdc (0x5874 bytes) 000160 1788882012.678463 punch from 0x0181a4 to 0x0265a4 (0xe401 bytes) 000161 1788882012.682394 read 0x02040a thru 0x02a2ca (0x9ec1 bytes) 000162 1788882012.687967 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) Mirror 6: 0x7ca99c70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) Mirror 6: 0x7ca99c70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000163 1788882012.795618 mapread 0x01b5f5 thru 0x02580d (0xa219 bytes) 000164 1788882012.801072 mapwrite 0x0019cf thru 0x00aa1e (0x9050 bytes) 000165 1788882012.820606 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) Mirror 6: 0x7ca99c70 (stale) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 1: 0x5974e4 Mirror 7: 0x5974e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000167 1788882013.148352 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) Mirror 6: 0x7ca99c70 (stale) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 1: 0x5974e4 Mirror 7: 0x5974e4 Mirror 8: 0x5974e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000168 1788882013.460706 mapread 0x02eecc thru 0x03766e (0x87a3 bytes) 000171 1788882013.476467 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3766f): Mirror 2: 0xa60f60ec (stale) Mirror 3: 0xa60f60ec (stale) Mirror 4: 0x6d813139 (stale) CRC-32 checksum value for chunk [0, 0x3766f): Mirror 1: 0x5974e4 Mirror 7: 0x5974e4 Mirror 8: 0x5974e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3766f: skipped 000172 1788882013.678228 trunc from 0x03766f to 0x004760 (0x32f0e bytes) 000173 1788882013.703625 punch from 0x0024f7 to 0x004760 (0x226a bytes) 000174 1788882013.705297 mapread 0x0044a8 thru 0x004760 (0x2b9 bytes) 000176 1788882013.708217 mapwrite 0x004c99 thru 0x008db8 (0x4120 bytes) 000177 1788882013.731898 read 0x004cbc thru 0x005cbd (0x1002 bytes) 000180 1788882013.732941 mapread 0x0055ec thru 0x008db8 (0x37cd bytes) 000181 1788882013.733780 read 0x0006b2 thru 0x0042b4 (0x3c03 bytes) 000182 1788882013.735953 mapread 0x0049ab thru 0x008db8 (0x440e bytes) 000183 1788882013.736522 mapread 0x000525 thru 0x003e42 (0x391e bytes) 000184 1788882013.738607 MIRROR_RESYNC 6 mirrors 000185 1788882014.133217 MIRROR_EXTEND to 7 mirrors 000188 1788882014.369759 mapread 0x005320 thru 0x008db8 (0x3a99 bytes) 000189 1788882014.378905 punch from 0x00365e to 0x008db8 (0x575b bytes) 000191 1788882014.399718 read 0x003499 thru 0x008db8 (0x5920 bytes) 000192 1788882014.404354 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8db9): Mirror 3: 0xc64a40cd (stale) Mirror 4: 0xc64a40cd (stale) Mirror 7: 0xc64a40cd (stale) Mirror 8: 0xc64a40cd (stale) Mirror 9: 0xc64a40cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8db9): Mirror 3: 0xc64a40cd (stale) Mirror 4: 0xc64a40cd (stale) Mirror 7: 0xc64a40cd (stale) Mirror 8: 0xc64a40cd (stale) Mirror 9: 0xc64a40cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8db9: skipped 000194 1788882014.508543 write 0x03b5d2 thru 0x03ffff (0x4a2e bytes) 000195 1788882014.510781 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x873cba52 (stale) Mirror 4: 0x873cba52 (stale) Mirror 7: 0x873cba52 (stale) Mirror 8: 0x873cba52 (stale) Mirror 9: 0x873cba52 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xaed55e29 Mirror 10: 0xaed55e29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000196 1788882014.852351 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x873cba52 (stale) Mirror 4: 0x873cba52 (stale) Mirror 7: 0x873cba52 (stale) Mirror 8: 0x873cba52 (stale) Mirror 9: 0x873cba52 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xaed55e29 Mirror 10: 0xaed55e29 Mirror 11: 0xaed55e29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000198 1788882015.166091 MIRROR_RESYNC 8 mirrors 000199 1788882015.578286 read 0x004048 thru 0x00c2ba (0x8273 bytes) 000200 1788882015.581151 read 0x0367d5 thru 0x03eed7 (0x8703 bytes) 000201 1788882015.584572 mapread 0x031a25 thru 0x038d7f (0x735b bytes) 000202 1788882015.585285 mapwrite 0x03aa1b thru 0x03ffff (0x55e5 bytes) 000203 1788882015.636071 read 0x016043 thru 0x01c8c3 (0x6881 bytes) 000204 1788882015.639797 mapread 0x00b346 thru 0x013ec5 (0x8b80 bytes) 000208 1788882015.642776 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xaed55e29 (stale) Mirror 4: 0xaed55e29 (stale) Mirror 7: 0xaed55e29 (stale) Mirror 8: 0xaed55e29 (stale) Mirror 9: 0xaed55e29 (stale) Mirror 10: 0xaed55e29 (stale) Mirror 11: 0xaed55e29 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x939ac21e Mirror 12: 0x939ac21e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000212 1788882015.961479 write 0x00f8a7 thru 0x01266c (0x2dc6 bytes) 000213 1788882015.988280 read 0x001720 thru 0x009ae5 (0x83c6 bytes) 000214 1788882015.991411 read 0x0062d9 thru 0x011afd (0xb825 bytes) 000215 1788882015.995700 write 0x03ba1a thru 0x03e8a7 (0x2e8e bytes) 000216 1788882015.996426 trunc from 0x040000 to 0x0305b5 (0xfa4a bytes) 000218 1788882016.007215 read 0x019584 thru 0x020586 (0x7003 bytes) 000219 1788882016.007764 mapwrite 0x019095 thru 0x021fcc (0x8f38 bytes) 000220 1788882016.024495 trunc from 0x0305b6 to 0x00e51c (0x22099 bytes) 000221 1788882016.030724 MIRROR_RESYNC 9 mirrors 000223 1788882016.468013 mapwrite 0x008c4c thru 0x00b7dd (0x2b92 bytes) 000225 1788882016.519689 mapread 0x00a0e2 thru 0x00e51c (0x443b bytes) 000226 1788882016.520375 mapwrite 0x02712c thru 0x0289cc (0x18a1 bytes) 000227 1788882016.539564 mapread 0x009f9a thru 0x00d3e9 (0x3450 bytes) 000228 1788882016.541449 MIRROR_RESYNC 9 mirrors 000229 1788882017.154612 trunc from 0x0289cd to 0x00c4b7 (0x1c515 bytes) 000230 1788882017.172692 write 0x0051c4 thru 0x00d4f3 (0x8330 bytes) 000232 1788882017.175325 write 0x005521 thru 0x00bb56 (0x6636 bytes) 000233 1788882017.176057 trunc from 0x00d4f4 to 0x00aa8f (0x2a64 bytes) 000234 1788882017.181871 write 0x02c022 thru 0x03bdaf (0xfd8e bytes) 000236 1788882017.183520 punch from 0x01157c to 0x016d0a (0x578f bytes) 000237 1788882017.187973 mapwrite 0x0081d9 thru 0x00e3c0 (0x61e8 bytes) 000238 1788882017.210740 trunc from 0x03bdb0 to 0x00cb3f (0x2f270 bytes) 000239 1788882017.216238 read 0x00638b thru 0x00cb3f (0x67b5 bytes) 000241 1788882017.216955 punch from 0x000f03 to 0x003f13 (0x3011 bytes) 000242 1788882017.218490 trunc from 0x00cb40 to 0x003ddc (0x8d63 bytes) 000244 1788882017.223481 mapread 0x00281f thru 0x003ddc (0x15be bytes) 000245 1788882017.226882 MIRROR_RESYNC 9 mirrors truncating to largest ever: 0x3f0db 000246 1788882017.587471 trunc from 0x003ddd to 0x03f0da (0x3b2fe bytes) 000248 1788882017.615549 MIRROR_RESYNC 9 mirrors 000249 1788882018.011145 trunc from 0x03f0db to 0x01246c (0x2cc6e bytes) 000251 1788882018.034321 punch from 0x0082be to 0x01246c (0xa1af bytes) 000253 1788882018.036511 read 0x00e43b thru 0x011629 (0x31ef bytes) 000254 1788882018.038870 mapread 0x006f5c thru 0x01246c (0xb511 bytes) 000255 1788882018.045897 mapwrite 0x010ef2 thru 0x0153ed (0x44fc bytes) 000256 1788882018.068187 read 0x00df6c thru 0x0153ed (0x7482 bytes) 000259 1788882018.069530 read 0x0148df thru 0x0153ed (0xb0f bytes) 000260 1788882018.069983 mapwrite 0x03545f thru 0x035e39 (0x9db bytes) 000261 1788882018.088782 mapwrite 0x0006ed thru 0x008988 (0x829c bytes) 000262 1788882018.103508 mapread 0x00b0e9 thru 0x010564 (0x547c bytes) 000264 1788882018.104425 write 0x01c1c7 thru 0x024259 (0x8093 bytes) 000265 1788882018.106843 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e3a): Mirror 3: 0x9a7ef9c2 (stale) Mirror 4: 0x9a7ef9c2 (stale) Mirror 7: 0x9a7ef9c2 (stale) Mirror 8: 0x9a7ef9c2 (stale) Mirror 9: 0x9a7ef9c2 (stale) Mirror 10: 0x9a7ef9c2 (stale) Mirror 11: 0x9a7ef9c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e3a): Mirror 3: 0x9a7ef9c2 (stale) Mirror 4: 0x9a7ef9c2 (stale) Mirror 7: 0x9a7ef9c2 (stale) Mirror 8: 0x9a7ef9c2 (stale) Mirror 9: 0x9a7ef9c2 (stale) Mirror 10: 0x9a7ef9c2 (stale) Mirror 11: 0x9a7ef9c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e3a: skipped 000267 1788882018.244541 mapwrite 0x022166 thru 0x02af47 (0x8de2 bytes) 000268 1788882018.263946 read 0x001b61 thru 0x005374 (0x3814 bytes) 000269 1788882018.266556 read 0x020938 thru 0x029dd0 (0x9499 bytes) 000270 1788882018.268393 MIRROR_RESYNC 8 mirrors 000273 1788882018.968367 mapwrite 0x026bb6 thru 0x031fd8 (0xb423 bytes) 000274 1788882019.028173 mapread 0x028022 thru 0x035e39 (0xde18 bytes) 000276 1788882019.029233 punch from 0x024788 to 0x02b5c7 (0x6e40 bytes) 000277 1788882019.032651 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e3a): Mirror 3: 0xd3687858 (stale) Mirror 4: 0xd3687858 (stale) Mirror 8: 0xd3687858 (stale) Mirror 9: 0xd3687858 (stale) Mirror 10: 0xd3687858 (stale) Mirror 11: 0xd3687858 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e3a): Mirror 3: 0xd3687858 (stale) Mirror 4: 0xd3687858 (stale) Mirror 8: 0xd3687858 (stale) Mirror 9: 0xd3687858 (stale) Mirror 10: 0xd3687858 (stale) Mirror 11: 0xd3687858 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e3a: skipped 000279 1788882019.160601 punch from 0x00220f to 0x00efa6 (0xcd98 bytes) 000280 1788882019.162209 read 0x035845 thru 0x035e39 (0x5f5 bytes) 000282 1788882019.164359 mapwrite 0x03f596 thru 0x03ffff (0xa6a bytes) 000283 1788882019.186245 mapwrite 0x033b6b thru 0x03f880 (0xbd16 bytes) 000284 1788882019.205544 trunc from 0x040000 to 0x025796 (0x1a869 bytes) 000285 1788882019.210173 trunc from 0x025797 to 0x003f8a (0x2180c bytes) 000286 1788882019.214730 mapread 0x000a68 thru 0x003f8a (0x3523 bytes) 000287 1788882019.217303 mapread 0x0028ac thru 0x003f8a (0x16df bytes) 000289 1788882019.218290 mapwrite 0x028b84 thru 0x02adf5 (0x2272 bytes) 000290 1788882019.238653 punch from 0x028395 to 0x02a9a8 (0x2614 bytes) 000291 1788882019.242267 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2adf6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2adf6): Mirror 3: 0xf3aea546 (stale) Mirror 4: 0xf3aea546 (stale) Mirror 8: 0xf3aea546 (stale) Mirror 9: 0xf3aea546 (stale) Mirror 10: 0xf3aea546 (stale) Mirror 11: 0xf3aea546 (stale) CRC-32 checksum value for chunk [0, 0x2adf6): Mirror 1: 0x9c0fe356 Mirror 12: 0x9c0fe356 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2adf6: skipped 000293 1788882019.532713 read 0x00750e thru 0x01198f (0xa482 bytes) 000294 1788882019.538328 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2adf6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2adf6): Mirror 3: 0xf3aea546 (stale) Mirror 4: 0xf3aea546 (stale) Mirror 8: 0xf3aea546 (stale) Mirror 9: 0xf3aea546 (stale) Mirror 10: 0xf3aea546 (stale) Mirror 11: 0xf3aea546 (stale) CRC-32 checksum value for chunk [0, 0x2adf6): Mirror 1: 0x9c0fe356 Mirror 12: 0x9c0fe356 Mirror 13: 0x9c0fe356 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2adf6: skipped 000296 1788882019.842009 mapread 0x00942b thru 0x010aff (0x76d5 bytes) 000297 1788882019.847997 punch from 0x006629 to 0x011839 (0xb211 bytes) 000298 1788882019.875311 punch from 0x008fd3 to 0x0136b6 (0xa6e4 bytes) 000300 1788882019.877723 punch from 0x029690 to 0x02adf5 (0x1766 bytes) 000301 1788882019.879669 mapwrite 0x006466 thru 0x00a797 (0x4332 bytes) 000302 1788882019.899390 write 0x0280e3 thru 0x030683 (0x85a1 bytes) 000303 1788882019.901955 mapread 0x022fc6 thru 0x026772 (0x37ad bytes) 000304 1788882019.905344 punch from 0x0004e5 to 0x00f3b4 (0xeed0 bytes) 000306 1788882019.909861 mapwrite 0x0253af thru 0x033253 (0xdea5 bytes) 000308 1788882019.939955 write 0x016ab3 thru 0x0263db (0xf929 bytes) 000309 1788882019.942831 trunc from 0x033254 to 0x003fc2 (0x2f291 bytes) 000310 1788882019.948740 mapwrite 0x03d4be thru 0x03ffff (0x2b42 bytes) 000311 1788882019.973673 write 0x008f15 thru 0x01184a (0x8936 bytes) 000312 1788882019.978010 mapread 0x009c3a thru 0x00b769 (0x1b30 bytes) 000313 1788882019.978875 punch from 0x0219e4 to 0x02a601 (0x8c1e bytes) 000315 1788882019.983206 read 0x0097e1 thru 0x0121fd (0x8a1d bytes) 000316 1788882019.985355 mapread 0x0020af thru 0x004dd6 (0x2d28 bytes) 000317 1788882019.988292 read 0x02ad34 thru 0x02d129 (0x23f6 bytes) 000318 1788882019.991832 punch from 0x00a2bd to 0x016994 (0xc6d8 bytes) 000319 1788882019.994084 mapwrite 0x038dd8 thru 0x03ffff (0x7228 bytes) 000320 1788882020.011381 read 0x01e58c thru 0x02593b (0x73b0 bytes) 000321 1788882020.012119 mapwrite 0x03db03 thru 0x03ffff (0x24fd bytes) 000323 1788882020.027109 trunc from 0x040000 to 0x0348c4 (0xb73b bytes) 000326 1788882020.033711 write 0x007ab0 thru 0x00f710 (0x7c61 bytes) 000327 1788882020.036273 punch from 0x01cf69 to 0x02bc4e (0xece6 bytes) 000328 1788882020.041247 punch from 0x01b69f to 0x027c74 (0xc5d6 bytes) 000329 1788882020.042993 mapread 0x02cbc9 thru 0x0348c4 (0x7cfc bytes) 000331 1788882020.045656 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x348c5): Mirror 3: 0xe88b2acd (stale) Mirror 8: 0xe88b2acd (stale) Mirror 9: 0xe88b2acd (stale) Mirror 10: 0xe88b2acd (stale) Mirror 11: 0xe88b2acd (stale) Mirror 12: 0x3b5ac9e3 (stale) Mirror 13: 0x3b5ac9e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348c5): Mirror 3: 0xe88b2acd (stale) Mirror 8: 0xe88b2acd (stale) Mirror 9: 0xe88b2acd (stale) Mirror 10: 0xe88b2acd (stale) Mirror 11: 0xe88b2acd (stale) Mirror 12: 0x3b5ac9e3 (stale) Mirror 13: 0x3b5ac9e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348c5: skipped 000332 1788882020.188367 MIRROR_RESYNC 8 mirrors 000333 1788882020.705914 mapwrite 0x002338 thru 0x005a8a (0x3753 bytes) 000334 1788882020.756140 trunc from 0x0348c5 to 0x016ded (0x1dad7 bytes) 000335 1788882020.761885 read 0x001c6e thru 0x00493c (0x2ccf bytes) 000336 1788882020.762370 read 0x003974 thru 0x007698 (0x3d25 bytes) 000337 1788882020.764152 MIRROR_RESYNC 8 mirrors 000338 1788882021.379255 mapread 0x0054ca thru 0x00b4fd (0x6034 bytes) 000340 1788882021.385509 punch from 0x00010b to 0x0081fd (0x80f3 bytes) 000341 1788882021.403191 trunc from 0x016dee to 0x0081d3 (0xec1a bytes) 000342 1788882021.409278 write 0x014c2a thru 0x01a6a4 (0x5a7b bytes) 000344 1788882021.410796 write 0x00f9e9 thru 0x0147dd (0x4df5 bytes) 000345 1788882021.413044 punch from 0x006e11 to 0x00d66e (0x685e bytes) 000346 1788882021.417076 mapread 0x010629 thru 0x01a6a4 (0xa07c bytes) 000348 1788882021.418167 mapread 0x00c593 thru 0x016089 (0x9af7 bytes) 000350 1788882021.422679 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1a6a5): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a6a5): Mirror 3: 0xe58bd2e3 (stale) Mirror 8: 0xe58bd2e3 (stale) Mirror 9: 0xe58bd2e3 (stale) Mirror 10: 0xe58bd2e3 (stale) Mirror 11: 0xe58bd2e3 (stale) Mirror 12: 0xe58bd2e3 (stale) Mirror 13: 0xe58bd2e3 (stale) CRC-32 checksum value for chunk [0, 0x1a6a5): Mirror 1: 0x7ad7bd6a Mirror 14: 0x7ad7bd6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a6a5: skipped 000351 1788882021.720630 punch from 0x016e59 to 0x01942a (0x25d2 bytes) 000352 1788882021.744416 read 0x016fbd thru 0x01a6a4 (0x36e8 bytes) 000353 1788882021.747324 write 0x03f89b thru 0x03ffff (0x765 bytes) 000355 1788882021.748472 mapread 0x00595a thru 0x010832 (0xaed9 bytes) 000358 1788882021.754789 mapread 0x02272b thru 0x02713c (0x4a12 bytes) 000361 1788882021.758501 mapwrite 0x030f67 thru 0x037f1f (0x6fb9 bytes) 000362 1788882021.776221 mapread 0x01e73e thru 0x028bab (0xa46e bytes) 000363 1788882021.776965 punch from 0x02b7e0 to 0x03a36b (0xeb8c bytes) 000365 1788882021.780855 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xbb12a0b1 (stale) Mirror 8: 0xbb12a0b1 (stale) Mirror 9: 0xbb12a0b1 (stale) Mirror 10: 0xbb12a0b1 (stale) Mirror 11: 0xbb12a0b1 (stale) Mirror 13: 0xbb12a0b1 (stale) Mirror 14: 0x3331425b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xbb12a0b1 (stale) Mirror 8: 0xbb12a0b1 (stale) Mirror 9: 0xbb12a0b1 (stale) Mirror 10: 0xbb12a0b1 (stale) Mirror 11: 0xbb12a0b1 (stale) Mirror 13: 0xbb12a0b1 (stale) Mirror 14: 0x3331425b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000366 1788882021.905305 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xbb12a0b1 (stale) Mirror 8: 0xbb12a0b1 (stale) Mirror 9: 0xbb12a0b1 (stale) Mirror 10: 0xbb12a0b1 (stale) Mirror 11: 0xbb12a0b1 (stale) Mirror 13: 0xbb12a0b1 (stale) Mirror 14: 0x3331425b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x120870cf Mirror 15: 0x120870cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000367 1788882022.257865 trunc from 0x040000 to 0x009bbf (0x36440 bytes) 000368 1788882022.283148 mapread 0x004fd5 thru 0x009bbf (0x4beb bytes) 000369 1788882022.289620 read 0x001d1f thru 0x0080a6 (0x6388 bytes) 000371 1788882022.291004 mapread 0x0068d0 thru 0x009bbf (0x32f0 bytes) 000372 1788882022.291960 punch from 0x00134b to 0x009bbf (0x8875 bytes) 000373 1788882022.294084 read 0x0025f8 thru 0x004162 (0x1b6b bytes) 000374 1788882022.298889 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x9bc0): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9bc0): Mirror 3: 0x472bd84d (stale) Mirror 8: 0x472bd84d (stale) Mirror 9: 0x472bd84d (stale) Mirror 10: 0x472bd84d (stale) Mirror 11: 0x472bd84d (stale) Mirror 13: 0x472bd84d (stale) Mirror 14: 0x71f0ed1 (stale) Mirror 15: 0x71f0ed1 (stale) CRC-32 checksum value for chunk [0, 0x9bc0): Mirror 1: 0x71f0ed1 Mirror 16: 0x71f0ed1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9bc0: skipped 000375 1788882022.593332 read 0x003395 thru 0x009bbf (0x682b bytes) 000376 1788882022.598709 mapwrite 0x022532 thru 0x023ac2 (0x1591 bytes) 000378 1788882022.642185 read 0x01d7b8 thru 0x023ac2 (0x630b bytes) 000381 1788882022.646933 write 0x009029 thru 0x0106fe (0x76d6 bytes) 000382 1788882022.647716 trunc from 0x023ac3 to 0x0045e0 (0x1f4e2 bytes) 000386 1788882022.655163 trunc from 0x0045e1 to 0x0082eb (0x3d0b bytes) 000387 1788882022.659193 mapwrite 0x037caf thru 0x03ffff (0x8351 bytes) 000388 1788882022.679415 write 0x0292b0 thru 0x02bf11 (0x2c62 bytes) 000389 1788882022.680109 mapread 0x037bcf thru 0x039c79 (0x20ab bytes) 000391 1788882022.681004 trunc from 0x040000 to 0x021abf (0x1e540 bytes) 000392 1788882022.685782 mapwrite 0x03dc44 thru 0x03ffff (0x23bc bytes) 000393 1788882022.706988 mapread 0x02bcff thru 0x03023d (0x453f bytes) 000394 1788882022.715587 write 0x01492d thru 0x017fd5 (0x36a9 bytes) 000395 1788882022.718415 punch from 0x02da57 to 0x03a828 (0xcdd2 bytes) 000397 1788882022.721596 write 0x01c372 thru 0x026dbd (0xaa4c bytes) 000398 1788882022.725083 mapwrite 0x018a4f thru 0x018fcb (0x57d bytes) 000399 1788882022.740853 write 0x01f348 thru 0x02bfc8 (0xcc81 bytes) 000400 1788882022.741877 trunc from 0x040000 to 0x00552d (0x3aad2 bytes) 000401 1788882022.747151 trunc from 0x00552e to 0x001c0b (0x3922 bytes) 000403 1788882022.751377 write 0x01c781 thru 0x01cd63 (0x5e3 bytes) 000404 1788882022.752052 write 0x01aa9c thru 0x01f125 (0x468a bytes) 000405 1788882022.754061 read 0x01b215 thru 0x01f125 (0x3f11 bytes) 000409 1788882022.755430 trunc from 0x01f126 to 0x0271af (0x808a bytes) 000410 1788882022.759703 write 0x01d8a4 thru 0x02c70f (0xee6c bytes) 000413 1788882022.761518 trunc from 0x02c710 to 0x01ca71 (0xfc9e bytes) 000415 1788882022.767298 MIRROR_RESYNC 10 mirrors 000417 1788882023.296316 trunc from 0x01ca72 to 0x00da8a (0xefe7 bytes) 000419 1788882023.316643 mapwrite 0x03d2c8 thru 0x03ffff (0x2d38 bytes) 000420 1788882023.340600 write 0x0237bd thru 0x02a358 (0x6b9c bytes) 000422 1788882023.345732 MIRROR_RESYNC 10 mirrors 000423 1788882024.003198 mapwrite 0x020006 thru 0x0266c4 (0x66bf bytes) 000424 1788882024.054566 mapwrite 0x029c27 thru 0x03407b (0xa455 bytes) 000425 1788882024.074801 mapwrite 0x020baf thru 0x02b316 (0xa768 bytes) 000426 1788882024.090143 mapread 0x03de85 thru 0x03ffff (0x217b bytes) 000428 1788882024.093054 read 0x03795c thru 0x03ffff (0x86a4 bytes) 000429 1788882024.093450 mapread 0x02856a thru 0x02ceea (0x4981 bytes) 000431 1788882024.094325 write 0x03dfa0 thru 0x03ffff (0x2060 bytes) 000432 1788882024.095019 mapread 0x02c0fa thru 0x03778d (0xb694 bytes) 000433 1788882024.097057 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa99aa95e (stale) Mirror 8: 0xa99aa95e (stale) Mirror 9: 0xa99aa95e (stale) Mirror 10: 0xa99aa95e (stale) Mirror 11: 0xa99aa95e (stale) Mirror 13: 0xa99aa95e (stale) Mirror 14: 0xa99aa95e (stale) Mirror 15: 0xa99aa95e (stale) Mirror 16: 0xa99aa95e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x802de8f1 Mirror 17: 0x802de8f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000434 1788882024.422625 read 0x017138 thru 0x01f602 (0x84cb bytes) 000435 1788882024.427407 read 0x02362b thru 0x02552f (0x1f05 bytes) 000436 1788882024.432666 trunc from 0x040000 to 0x003349 (0x3ccb6 bytes) 000439 1788882024.461645 mapread 0x000106 thru 0x003349 (0x3244 bytes) 000440 1788882024.469057 MIRROR_RESYNC 11 mirrors 000443 1788882024.885244 read 0x00270c thru 0x003349 (0xc3e bytes) 000444 1788882024.888424 MIRROR_RESYNC 11 mirrors 000446 1788882025.016394 MIRROR_EXTEND to 12 mirrors 000447 1788882025.217793 punch from 0x003064 to 0x003349 (0x2e6 bytes) 000449 1788882025.239899 trunc from 0x00334a to 0x00b422 (0x80d9 bytes) 000451 1788882025.250467 trunc from 0x00b423 to 0x03cad8 (0x316b6 bytes) 000452 1788882025.255210 mapwrite 0x02be9c thru 0x0395bc (0xd721 bytes) 000454 1788882025.280176 write 0x0052af thru 0x007bf6 (0x2948 bytes) 000455 1788882025.283500 mapread 0x03978d thru 0x03bdae (0x2622 bytes) 000456 1788882025.285760 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cad9): Mirror 3: 0xff1ecd4 (stale) Mirror 8: 0xff1ecd4 (stale) Mirror 9: 0xff1ecd4 (stale) Mirror 10: 0xff1ecd4 (stale) Mirror 11: 0xff1ecd4 (stale) Mirror 13: 0xff1ecd4 (stale) Mirror 15: 0xff1ecd4 (stale) Mirror 16: 0xff1ecd4 (stale) Mirror 17: 0xff1ecd4 (stale) Mirror 18: 0xff1ecd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cad9): Mirror 3: 0xff1ecd4 (stale) Mirror 8: 0xff1ecd4 (stale) Mirror 9: 0xff1ecd4 (stale) Mirror 10: 0xff1ecd4 (stale) Mirror 11: 0xff1ecd4 (stale) Mirror 13: 0xff1ecd4 (stale) Mirror 15: 0xff1ecd4 (stale) Mirror 16: 0xff1ecd4 (stale) Mirror 17: 0xff1ecd4 (stale) Mirror 18: 0xff1ecd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cad9: skipped 000457 1788882025.454694 mapread 0x005699 thru 0x00e7f1 (0x9159 bytes) 000458 1788882025.461680 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cad9): Mirror 3: 0xff1ecd4 (stale) Mirror 8: 0xff1ecd4 (stale) Mirror 9: 0xff1ecd4 (stale) Mirror 10: 0xff1ecd4 (stale) Mirror 11: 0xff1ecd4 (stale) Mirror 13: 0xff1ecd4 (stale) Mirror 15: 0xff1ecd4 (stale) Mirror 17: 0xff1ecd4 (stale) Mirror 18: 0xff1ecd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cad9): Mirror 3: 0xff1ecd4 (stale) Mirror 8: 0xff1ecd4 (stale) Mirror 9: 0xff1ecd4 (stale) Mirror 10: 0xff1ecd4 (stale) Mirror 11: 0xff1ecd4 (stale) Mirror 13: 0xff1ecd4 (stale) Mirror 15: 0xff1ecd4 (stale) Mirror 17: 0xff1ecd4 (stale) Mirror 18: 0xff1ecd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cad9: skipped 000459 1788882025.605088 mapwrite 0x031ac3 thru 0x03f031 (0xd56f bytes) 000462 1788882025.635158 write 0x023836 thru 0x02dfff (0xa7ca bytes) 000463 1788882025.639315 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f032): Mirror 8: 0xfa41bb94 (stale) Mirror 9: 0xfa41bb94 (stale) Mirror 10: 0xfa41bb94 (stale) Mirror 11: 0xfa41bb94 (stale) Mirror 13: 0xfa41bb94 (stale) Mirror 15: 0xfa41bb94 (stale) Mirror 17: 0xfa41bb94 (stale) Mirror 18: 0xfa41bb94 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f032): Mirror 8: 0xfa41bb94 (stale) Mirror 9: 0xfa41bb94 (stale) Mirror 10: 0xfa41bb94 (stale) Mirror 11: 0xfa41bb94 (stale) Mirror 13: 0xfa41bb94 (stale) Mirror 15: 0xfa41bb94 (stale) Mirror 17: 0xfa41bb94 (stale) Mirror 18: 0xfa41bb94 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f032: skipped 000464 1788882025.786504 read 0x01745f thru 0x0229d5 (0xb577 bytes) 000465 1788882025.789511 mapread 0x03d1e8 thru 0x03f031 (0x1e4a bytes) 000466 1788882025.795200 mapwrite 0x03a0d5 thru 0x03ffff (0x5f2b bytes) 000467 1788882025.817432 punch from 0x025c04 to 0x029a8f (0x3e8c bytes) 000469 1788882025.819623 read 0x021615 thru 0x0296b8 (0x80a4 bytes) 000470 1788882025.823365 mapread 0x01fe78 thru 0x026248 (0x63d1 bytes) 000471 1788882025.824091 mapwrite 0x02e76f thru 0x038c88 (0xa51a bytes) 000472 1788882025.845847 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2dcaaba3 Mirror 19: 0x2dcaaba3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000473 1788882026.240450 trunc from 0x040000 to 0x006e61 (0x3919e bytes) 000474 1788882026.266770 trunc from 0x006e62 to 0x008afe (0x1c9d bytes) 000476 1788882026.272925 mapwrite 0x0097fe thru 0x016874 (0xd077 bytes) 000478 1788882026.306661 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16875): Mirror 8: 0xc3278b83 (stale) Mirror 9: 0xc3278b83 (stale) Mirror 10: 0xc3278b83 (stale) Mirror 13: 0xc3278b83 (stale) Mirror 15: 0xc3278b83 (stale) Mirror 17: 0xc3278b83 (stale) Mirror 18: 0xc3278b83 (stale) Mirror 19: 0xf5b6e5ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16875): Mirror 8: 0xc3278b83 (stale) Mirror 9: 0xc3278b83 (stale) Mirror 10: 0xc3278b83 (stale) Mirror 13: 0xc3278b83 (stale) Mirror 15: 0xc3278b83 (stale) Mirror 17: 0xc3278b83 (stale) Mirror 18: 0xc3278b83 (stale) Mirror 19: 0xf5b6e5ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16875: skipped 000479 1788882026.433704 write 0x0273c9 thru 0x029daa (0x29e2 bytes) 000480 1788882026.434520 mapread 0x00b77e thru 0x018359 (0xcbdc bytes) 000481 1788882026.443123 mapread 0x0078d4 thru 0x00e060 (0x678d bytes) 000483 1788882026.444618 mapread 0x0288de thru 0x029daa (0x14cd bytes) 000484 1788882026.445294 write 0x03b231 thru 0x03ffff (0x4dcf bytes) 000487 1788882026.446921 mapwrite 0x01aed1 thru 0x01fd07 (0x4e37 bytes) 000488 1788882026.467125 MIRROR_RESYNC 9 mirrors 000489 1788882027.611109 read 0x0312f0 thru 0x03908d (0x7d9e bytes) 000490 1788882027.613731 read 0x03ec85 thru 0x03ffff (0x137b bytes) 000491 1788882027.616914 punch from 0x036a7d to 0x03c56e (0x5af2 bytes) 000492 1788882027.635585 mapread 0x01370f thru 0x01c1db (0x8acd bytes) 000493 1788882027.648342 punch from 0x032d2f to 0x03edef (0xc0c1 bytes) 000497 1788882027.650864 trunc from 0x040000 to 0x02dc30 (0x123cf bytes) 000499 1788882027.656635 mapread 0x018cdb thru 0x023e81 (0xb1a7 bytes) 000500 1788882027.666549 write 0x035f1f thru 0x03ffff (0xa0e1 bytes) 000501 1788882027.667618 punch from 0x0124d7 to 0x014d6d (0x2897 bytes) 000505 1788882027.672940 mapread 0x016ae3 thru 0x01b058 (0x4576 bytes) 000506 1788882027.673575 write 0x00e1eb thru 0x00ea66 (0x87c bytes) 000507 1788882027.677389 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x58d5939c (stale) Mirror 9: 0x58d5939c (stale) Mirror 10: 0x58d5939c (stale) Mirror 13: 0x58d5939c (stale) Mirror 17: 0x58d5939c (stale) Mirror 18: 0x58d5939c (stale) Mirror 19: 0x58d5939c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x58d5939c (stale) Mirror 9: 0x58d5939c (stale) Mirror 10: 0x58d5939c (stale) Mirror 13: 0x58d5939c (stale) Mirror 17: 0x58d5939c (stale) Mirror 18: 0x58d5939c (stale) Mirror 19: 0x58d5939c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000509 1788882027.809004 read 0x023fc4 thru 0x033328 (0xf365 bytes) 000510 1788882027.812092 mapwrite 0x000da2 thru 0x000db2 (0x11 bytes) 000512 1788882027.825971 write 0x0045b4 thru 0x00d998 (0x93e5 bytes) 000513 1788882027.829335 read 0x02d315 thru 0x034877 (0x7563 bytes) 000514 1788882027.832231 punch from 0x00e187 to 0x01738b (0x9205 bytes) 000515 1788882027.836054 read 0x03d393 thru 0x03ffff (0x2c6d bytes) 000516 1788882027.836522 trunc from 0x040000 to 0x03497f (0xb680 bytes) 000517 1788882027.841101 mapwrite 0x00fea3 thru 0x016c2f (0x6d8d bytes) 000518 1788882027.856974 read 0x01ee6b thru 0x02ce43 (0xdfd9 bytes) 000519 1788882027.859013 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34980): Mirror 8: 0x95f993f9 (stale) Mirror 9: 0x95f993f9 (stale) Mirror 10: 0x95f993f9 (stale) Mirror 17: 0x95f993f9 (stale) Mirror 18: 0x95f993f9 (stale) Mirror 19: 0x95f993f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34980): Mirror 8: 0x95f993f9 (stale) Mirror 9: 0x95f993f9 (stale) Mirror 10: 0x95f993f9 (stale) Mirror 17: 0x95f993f9 (stale) Mirror 18: 0x95f993f9 (stale) Mirror 19: 0x95f993f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34980: skipped 000520 1788882027.980690 read 0x025e0f thru 0x02ea5b (0x8c4d bytes) 000523 1788882027.985441 punch from 0x015bad to 0x01e3e5 (0x8839 bytes) 000524 1788882027.987224 read 0x01c12a thru 0x020af2 (0x49c9 bytes) 000526 1788882027.991293 mapwrite 0x01859d thru 0x020ed7 (0x893b bytes) 000527 1788882028.008605 mapwrite 0x001ed2 thru 0x00bfe6 (0xa115 bytes) 000528 1788882028.024792 punch from 0x00997e to 0x0152a6 (0xb929 bytes) 000529 1788882028.027099 mapread 0x02cd72 thru 0x03497f (0x7c0e bytes) 000530 1788882028.027850 punch from 0x01d5b9 to 0x025478 (0x7ec0 bytes) 000533 1788882028.030576 mapread 0x01396b thru 0x020383 (0xca19 bytes) 000535 1788882028.041646 mapread 0x0128c5 thru 0x01442f (0x1b6b bytes) 000536 1788882028.043940 punch from 0x0196a8 to 0x024394 (0xaced bytes) 000537 1788882028.047121 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x34980): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34980): Mirror 8: 0x95f993f9 (stale) Mirror 9: 0x95f993f9 (stale) Mirror 10: 0x95f993f9 (stale) Mirror 17: 0x95f993f9 (stale) Mirror 18: 0x95f993f9 (stale) Mirror 19: 0x95f993f9 (stale) CRC-32 checksum value for chunk [0, 0x34980): Mirror 1: 0x67bf7ad1 Mirror 20: 0x67bf7ad1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34980: skipped 000539 1788882028.389236 read 0x02f963 thru 0x03497f (0x501d bytes) 000542 1788882028.396974 mapwrite 0x03395d thru 0x03ffff (0xc6a3 bytes) 000544 1788882028.448006 mapread 0x00d0d0 thru 0x01ccd5 (0xfc06 bytes) 000545 1788882028.453781 mapread 0x026833 thru 0x0356c6 (0xee94 bytes) 000547 1788882028.457489 mapread 0x01396d thru 0x01684e (0x2ee2 bytes) 000549 1788882028.458997 trunc from 0x040000 to 0x0218f7 (0x1e708 bytes) 000550 1788882028.465099 read 0x01fd08 thru 0x0218f7 (0x1bf0 bytes) 000551 1788882028.465511 punch from 0x0137f6 to 0x017f20 (0x472b bytes) 000552 1788882028.467071 mapread 0x004b1f thru 0x006a40 (0x1f22 bytes) 000556 1788882028.470975 mapread 0x011756 thru 0x01572b (0x3fd6 bytes) 000557 1788882028.471674 punch from 0x009b4d to 0x0130f7 (0x95ab bytes) 000560 1788882028.474171 trunc from 0x0218f8 to 0x03eae1 (0x1d1ea bytes) 000561 1788882028.478596 trunc from 0x03eae2 to 0x029a1f (0x150c2 bytes) 000562 1788882028.482928 mapwrite 0x02ed34 thru 0x03ac3d (0xbf0a bytes) 000563 1788882028.507673 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ac3e): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ac3e): Mirror 8: 0x2c18717b (stale) Mirror 9: 0x2c18717b (stale) Mirror 10: 0x2c18717b (stale) Mirror 17: 0x2c18717b (stale) Mirror 18: 0x2c18717b (stale) Mirror 19: 0x2c18717b (stale) Mirror 20: 0xd84dde07 (stale) CRC-32 checksum value for chunk [0, 0x3ac3e): Mirror 1: 0x57c00d8b Mirror 21: 0x57c00d8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ac3e: skipped 000565 1788882028.811867 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3ac3e): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ac3e): Mirror 8: 0x2c18717b (stale) Mirror 9: 0x2c18717b (stale) Mirror 10: 0x2c18717b (stale) Mirror 17: 0x2c18717b (stale) Mirror 18: 0x2c18717b (stale) Mirror 19: 0x2c18717b (stale) Mirror 20: 0xd84dde07 (stale) CRC-32 checksum value for chunk [0, 0x3ac3e): Mirror 1: 0x57c00d8b Mirror 21: 0x57c00d8b Mirror 22: 0x57c00d8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ac3e: skipped 000566 1788882029.064421 read 0x020486 thru 0x0256bf (0x523a bytes) 000567 1788882029.067078 trunc from 0x03ac3e to 0x01fd9d (0x1aea0 bytes) 000570 1788882029.098078 punch from 0x00cbf9 to 0x01a3e4 (0xd7ec bytes) 000571 1788882029.099828 read 0x00913e thru 0x00b5ad (0x2470 bytes) 000572 1788882029.103148 write 0x00c40a thru 0x0139be (0x75b5 bytes) 000573 1788882029.103918 punch from 0x013076 to 0x0182ea (0x5275 bytes) 000576 1788882029.108091 mapread 0x01108c thru 0x0195e3 (0x8558 bytes) 000577 1788882029.116259 trunc from 0x01fd9e to 0x00a7dd (0x155c0 bytes) 000578 1788882029.123064 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa7de): Mirror 9: 0x8833413d (stale) Mirror 10: 0x8833413d (stale) Mirror 17: 0x8833413d (stale) Mirror 18: 0x8833413d (stale) Mirror 19: 0x8833413d (stale) Mirror 20: 0xed52b56a (stale) Mirror 21: 0xed52b56a (stale) Mirror 22: 0xed52b56a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa7de): Mirror 9: 0x8833413d (stale) Mirror 10: 0x8833413d (stale) Mirror 17: 0x8833413d (stale) Mirror 18: 0x8833413d (stale) Mirror 19: 0x8833413d (stale) Mirror 20: 0xed52b56a (stale) Mirror 21: 0xed52b56a (stale) Mirror 22: 0xed52b56a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa7de: skipped 000579 1788882029.234558 write 0x02d4d5 thru 0x03bcbd (0xe7e9 bytes) 000580 1788882029.235768 punch from 0x02a994 to 0x02dd5d (0x33ca bytes) 000581 1788882029.239332 mapwrite 0x02f7a9 thru 0x03cfdc (0xd834 bytes) 000582 1788882029.259400 mapwrite 0x01644d thru 0x02130b (0xaebf bytes) 000583 1788882029.278975 write 0x00330d thru 0x011d28 (0xea1c bytes) 000585 1788882029.281577 read 0x018499 thru 0x025ce2 (0xd84a bytes) 000586 1788882029.282068 write 0x029f3a thru 0x032c8d (0x8d54 bytes) 000587 1788882029.284006 mapwrite 0x029cc5 thru 0x02d04b (0x3387 bytes) 000588 1788882029.298664 mapwrite 0x01a173 thru 0x0212c8 (0x7156 bytes) 000591 1788882029.312417 mapwrite 0x000430 thru 0x003d2f (0x3900 bytes) 000594 1788882029.327166 mapwrite 0x02c188 thru 0x02c54a (0x3c3 bytes) 000595 1788882029.339151 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3cfdd): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfdd): Mirror 9: 0xc6ee2f18 (stale) Mirror 10: 0xc6ee2f18 (stale) Mirror 17: 0xc6ee2f18 (stale) Mirror 18: 0xc6ee2f18 (stale) Mirror 19: 0xc6ee2f18 (stale) Mirror 20: 0xd9005049 (stale) Mirror 21: 0x54221b38 (stale) Mirror 22: 0x54221b38 (stale) CRC-32 checksum value for chunk [0, 0x3cfdd): Mirror 1: 0xee5db76b Mirror 23: 0xee5db76b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfdd: skipped 000596 1788882029.643069 MIRROR_RESYNC 10 mirrors 000597 1788882030.295398 read 0x02f9f8 thru 0x032621 (0x2c2a bytes) 000598 1788882030.297264 mapread 0x01e38b thru 0x020c66 (0x28dc bytes) 000600 1788882030.302377 mapwrite 0x03755f thru 0x038c32 (0x16d4 bytes) 000601 1788882030.354220 write 0x0192f0 thru 0x01b0cc (0x1ddd bytes) 000602 1788882030.357636 write 0x0135e4 thru 0x01635a (0x2d77 bytes) 000603 1788882030.360931 read 0x02cf83 thru 0x033044 (0x60c2 bytes) 000605 1788882030.364963 write 0x013a49 thru 0x0233be (0xf976 bytes) 000607 1788882030.368575 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cfdd): Mirror 9: 0xee5db76b (stale) Mirror 10: 0xee5db76b (stale) Mirror 17: 0xee5db76b (stale) Mirror 18: 0xee5db76b (stale) Mirror 19: 0xee5db76b (stale) Mirror 20: 0xee5db76b (stale) Mirror 21: 0xee5db76b (stale) Mirror 22: 0xee5db76b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfdd): Mirror 9: 0xee5db76b (stale) Mirror 10: 0xee5db76b (stale) Mirror 17: 0xee5db76b (stale) Mirror 18: 0xee5db76b (stale) Mirror 19: 0xee5db76b (stale) Mirror 20: 0xee5db76b (stale) Mirror 21: 0xee5db76b (stale) Mirror 22: 0xee5db76b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfdd: skipped 000608 1788882030.516386 punch from 0x02b977 to 0x039e24 (0xe4ae bytes) 000610 1788882030.518494 mapread 0x009382 thru 0x015777 (0xc3f6 bytes) 000611 1788882030.525924 mapwrite 0x014fce thru 0x015de5 (0xe18 bytes) 000612 1788882030.539123 read 0x02f830 thru 0x03c0ba (0xc88b bytes) 000614 1788882030.542478 mapread 0x00ed2b thru 0x01c66f (0xd945 bytes) 000615 1788882030.543112 punch from 0x01097e to 0x0134fb (0x2b7e bytes) 000616 1788882030.544819 mapwrite 0x03831c thru 0x03fb39 (0x781e bytes) 000617 1788882030.568827 trunc from 0x03fb3a to 0x0075fb (0x3853e bytes) 000618 1788882030.573518 write 0x003f2f thru 0x005f69 (0x203b bytes) 000619 1788882030.575411 punch from 0x002495 to 0x005ab4 (0x3620 bytes) 000620 1788882030.578126 mapread 0x00090f thru 0x0075fb (0x6ced bytes) 000622 1788882030.581032 mapwrite 0x034746 thru 0x03ca8b (0x8346 bytes) 000626 1788882030.603372 mapwrite 0x033bcf thru 0x03fe17 (0xc249 bytes) 000628 1788882030.626267 punch from 0x037331 to 0x03fe17 (0x8ae7 bytes) 000629 1788882030.628096 write 0x020338 thru 0x024f02 (0x4bcb bytes) 000630 1788882030.631235 write 0x030ca1 thru 0x03922a (0x858a bytes) 000631 1788882030.633231 trunc from 0x03fe18 to 0x0124b0 (0x2d967 bytes) 000632 1788882030.638185 trunc from 0x0124b1 to 0x0203f4 (0xdf44 bytes) 000633 1788882030.642881 write 0x0235ee thru 0x032664 (0xf077 bytes) 000634 1788882030.645599 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x32665): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32665): Mirror 9: 0x56d3cd8 (stale) Mirror 10: 0x56d3cd8 (stale) Mirror 17: 0x56d3cd8 (stale) Mirror 18: 0x56d3cd8 (stale) Mirror 19: 0x56d3cd8 (stale) Mirror 20: 0x56d3cd8 (stale) Mirror 21: 0x56d3cd8 (stale) Mirror 22: 0x56d3cd8 (stale) CRC-32 checksum value for chunk [0, 0x32665): Mirror 1: 0x31e5ae64 Mirror 23: 0x31e5ae64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32665: skipped 000636 1788882030.958631 MIRROR_RESYNC 10 mirrors 000637 1788882031.547752 write 0x0037df thru 0x006c9f (0x34c1 bytes) 000638 1788882031.566763 write 0x03494e thru 0x03bfa9 (0x765c bytes) 000639 1788882031.567636 trunc from 0x03bfaa to 0x0360d6 (0x5ed3 bytes) 000640 1788882031.576525 trunc from 0x0360d7 to 0x029772 (0xc964 bytes) 000641 1788882031.580465 write 0x03f01b thru 0x03ffff (0xfe5 bytes) 000642 1788882031.581169 read 0x02e6ce thru 0x032ce2 (0x4615 bytes) 000643 1788882031.584529 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x85123da6 (stale) Mirror 10: 0x85123da6 (stale) Mirror 17: 0x85123da6 (stale) Mirror 18: 0x85123da6 (stale) Mirror 19: 0x85123da6 (stale) Mirror 20: 0x85123da6 (stale) Mirror 21: 0x85123da6 (stale) Mirror 22: 0x85123da6 (stale) Mirror 23: 0x85123da6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a5cb9bb Mirror 24: 0x6a5cb9bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000644 1788882031.898420 mapread 0x029bea thru 0x02fbc6 (0x5fdd bytes) 000647 1788882031.910564 read 0x026c52 thru 0x02b1e2 (0x4591 bytes) 000652 1788882031.919999 mapwrite 0x01cb08 thru 0x025cf2 (0x91eb bytes) 000653 1788882031.977318 trunc from 0x040000 to 0x02fe36 (0x101c9 bytes) 000654 1788882031.988014 punch from 0x003395 to 0x00ff59 (0xcbc5 bytes) 000655 1788882031.989608 mapread 0x01d486 thru 0x021ad8 (0x4653 bytes) 000656 1788882031.990435 mapread 0x00aa8c thru 0x00eabf (0x4034 bytes) 000657 1788882031.993389 mapread 0x020fd3 thru 0x024079 (0x30a7 bytes) 000659 1788882031.994274 mapread 0x00b71d thru 0x00c872 (0x1156 bytes) 000660 1788882031.994845 mapread 0x023f92 thru 0x02e9bd (0xaa2c bytes) 000662 1788882031.997502 mapread 0x01a268 thru 0x024e03 (0xab9c bytes) 000663 1788882031.998436 write 0x007cb6 thru 0x00af39 (0x3284 bytes) 000664 1788882031.999456 read 0x02d9b8 thru 0x02fe36 (0x247f bytes) 000666 1788882032.001618 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2fe37): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fe37): Mirror 9: 0x8ad053f4 (stale) Mirror 10: 0x8ad053f4 (stale) Mirror 17: 0x8ad053f4 (stale) Mirror 18: 0x8ad053f4 (stale) Mirror 19: 0x8ad053f4 (stale) Mirror 20: 0x8ad053f4 (stale) Mirror 21: 0x8ad053f4 (stale) Mirror 22: 0x8ad053f4 (stale) Mirror 23: 0x8ad053f4 (stale) Mirror 24: 0x1ce7f133 (stale) CRC-32 checksum value for chunk [0, 0x2fe37): Mirror 1: 0x1d88b0d8 Mirror 25: 0x1d88b0d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fe37: skipped 000667 1788882032.347241 trunc from 0x02fe37 to 0x000a26 (0x2f410 bytes) 000670 1788882032.372306 mapwrite 0x01af53 thru 0x0223aa (0x7458 bytes) 000672 1788882032.402146 MIRROR_RESYNC 12 mirrors 000673 1788882032.995148 write 0x030cbb thru 0x031606 (0x94c bytes) 000674 1788882033.014070 write 0x03f54e thru 0x03ffff (0xab2 bytes) 000675 1788882033.016191 MIRROR_RESYNC 12 mirrors 000676 1788882033.981376 MIRROR_EXTEND to 13 mirrors 000677 1788882034.209725 trunc from 0x040000 to 0x00ba5f (0x345a0 bytes) 000678 1788882034.238444 write 0x02f201 thru 0x031210 (0x2010 bytes) 000680 1788882034.239501 write 0x03e9d0 thru 0x03ffff (0x1630 bytes) 000681 1788882034.241438 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd996153 (stale) Mirror 10: 0xd996153 (stale) Mirror 17: 0xd996153 (stale) Mirror 18: 0xd996153 (stale) Mirror 19: 0xd996153 (stale) Mirror 20: 0xd996153 (stale) Mirror 21: 0xd996153 (stale) Mirror 22: 0xd996153 (stale) Mirror 24: 0xd996153 (stale) Mirror 25: 0xd996153 (stale) Mirror 26: 0xd996153 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd996153 (stale) Mirror 10: 0xd996153 (stale) Mirror 17: 0xd996153 (stale) Mirror 18: 0xd996153 (stale) Mirror 19: 0xd996153 (stale) Mirror 20: 0xd996153 (stale) Mirror 21: 0xd996153 (stale) Mirror 22: 0xd996153 (stale) Mirror 24: 0xd996153 (stale) Mirror 25: 0xd996153 (stale) Mirror 26: 0xd996153 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000683 1788882034.403542 write 0x025523 thru 0x029a62 (0x4540 bytes) 000684 1788882034.406525 mapwrite 0x02b3fe thru 0x02db90 (0x2793 bytes) 000685 1788882034.427539 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd996153 (stale) Mirror 10: 0xd996153 (stale) Mirror 17: 0xd996153 (stale) Mirror 18: 0xd996153 (stale) Mirror 19: 0xd996153 (stale) Mirror 20: 0xd996153 (stale) Mirror 21: 0xd996153 (stale) Mirror 22: 0xd996153 (stale) Mirror 24: 0xd996153 (stale) Mirror 25: 0xd996153 (stale) Mirror 26: 0xd996153 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x26fb4d69 Mirror 27: 0x26fb4d69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000687 1788882034.790185 punch from 0x003acc to 0x004613 (0xb48 bytes) 000688 1788882034.816428 MIRROR_RESYNC 13 mirrors 000689 1788882036.079161 trunc from 0x040000 to 0x031b65 (0xe49a bytes) 000690 1788882036.101236 mapwrite 0x01a485 thru 0x026af2 (0xc66e bytes) 000692 1788882036.126481 mapread 0x01dd59 thru 0x02723b (0x94e3 bytes) 000693 1788882036.127205 write 0x011783 thru 0x014d13 (0x3591 bytes) 000694 1788882036.130902 punch from 0x009bb1 to 0x017adb (0xdf2b bytes) 000695 1788882036.134425 punch from 0x02ab65 to 0x02f1d2 (0x466e bytes) 000696 1788882036.136307 trunc from 0x031b66 to 0x02861c (0x9549 bytes) 000697 1788882036.141974 punch from 0x007832 to 0x00d158 (0x5927 bytes) 000698 1788882036.143419 read 0x0107f0 thru 0x012bc7 (0x23d8 bytes) 000700 1788882036.145651 punch from 0x00f29e to 0x01e55f (0xf2c2 bytes) 000701 1788882036.148535 MIRROR_RESYNC 13 mirrors 000702 1788882036.756110 write 0x0074d8 thru 0x00eaa5 (0x75ce bytes) 000704 1788882036.778990 mapread 0x00d7e2 thru 0x013eec (0x670b bytes) 000705 1788882036.784126 mapread 0x0264fe thru 0x0281fa (0x1cfd bytes) 000706 1788882036.788018 MIRROR_RESYNC 13 mirrors 000707 1788882037.623116 trunc from 0x02861d to 0x01708a (0x11592 bytes) 000709 1788882037.644041 mapread 0x0129b3 thru 0x01708a (0x46d8 bytes) 000710 1788882037.649778 write 0x00e826 thru 0x01937b (0xab56 bytes) 000711 1788882037.650826 trunc from 0x01937c to 0x0393c5 (0x2004a bytes) 000712 1788882037.656327 mapread 0x009963 thru 0x00d091 (0x372f bytes) 000714 1788882037.659707 mapread 0x006017 thru 0x0150a4 (0xf08e bytes) 000716 1788882037.660684 mapread 0x004acb thru 0x005216 (0x74c bytes) 000717 1788882037.661225 write 0x033c94 thru 0x03c870 (0x8bdd bytes) 000719 1788882037.663833 punch from 0x01f2ec to 0x02ad7a (0xba8f bytes) 000720 1788882037.667762 mapwrite 0x0346ec thru 0x03cb6d (0x8482 bytes) 000721 1788882037.690624 trunc from 0x03cb6e to 0x027d19 (0x14e54 bytes) 000726 1788882037.697510 write 0x00794e thru 0x008614 (0xcc7 bytes) 000727 1788882037.698208 write 0x00230b thru 0x003788 (0x147e bytes) 000728 1788882037.698759 trunc from 0x027d1a to 0x00cbad (0x1b16c bytes) 000730 1788882037.704431 read 0x00203e thru 0x00cbad (0xab70 bytes) 000731 1788882037.705154 mapread 0x008b02 thru 0x00cbad (0x40ac bytes) 000732 1788882037.706136 mapread 0x003dfa thru 0x00b5d1 (0x77d8 bytes) 000733 1788882037.707105 trunc from 0x00cbae to 0x004ce2 (0x7ecb bytes) 000736 1788882037.712552 read 0x0039b1 thru 0x004ce2 (0x1332 bytes) 000738 1788882037.714698 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4ce3): Mirror 9: 0x7abfd96 (stale) Mirror 10: 0x7abfd96 (stale) Mirror 17: 0x7abfd96 (stale) Mirror 18: 0x7abfd96 (stale) Mirror 19: 0x7abfd96 (stale) Mirror 20: 0x7abfd96 (stale) Mirror 22: 0x7abfd96 (stale) Mirror 24: 0x7abfd96 (stale) Mirror 25: 0x7abfd96 (stale) Mirror 26: 0x7abfd96 (stale) Mirror 27: 0x7abfd96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4ce3): Mirror 9: 0x7abfd96 (stale) Mirror 10: 0x7abfd96 (stale) Mirror 17: 0x7abfd96 (stale) Mirror 18: 0x7abfd96 (stale) Mirror 19: 0x7abfd96 (stale) Mirror 20: 0x7abfd96 (stale) Mirror 22: 0x7abfd96 (stale) Mirror 24: 0x7abfd96 (stale) Mirror 25: 0x7abfd96 (stale) Mirror 26: 0x7abfd96 (stale) Mirror 27: 0x7abfd96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4ce3: skipped 000739 1788882037.850235 punch from 0x000bbe to 0x004ce2 (0x4125 bytes) 000741 1788882037.852174 punch from 0x0045a7 to 0x004ce2 (0x73c bytes) 000742 1788882037.853651 trunc from 0x004ce3 to 0x0137f6 (0xeb14 bytes) 000743 1788882037.859514 MIRROR_RESYNC 12 mirrors 000744 1788882038.335800 write 0x01228c thru 0x02192c (0xf6a1 bytes) 000745 1788882038.358633 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2192d): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2192d): Mirror 9: 0xa4b11fad (stale) Mirror 10: 0xa4b11fad (stale) Mirror 17: 0xa4b11fad (stale) Mirror 18: 0xa4b11fad (stale) Mirror 19: 0xa4b11fad (stale) Mirror 20: 0xa4b11fad (stale) Mirror 22: 0xa4b11fad (stale) Mirror 24: 0xa4b11fad (stale) Mirror 25: 0xa4b11fad (stale) Mirror 26: 0xa4b11fad (stale) Mirror 27: 0xa4b11fad (stale) CRC-32 checksum value for chunk [0, 0x2192d): Mirror 1: 0x5560399a Mirror 28: 0x5560399a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2192d: skipped 000746 1788882038.689898 read 0x01fa74 thru 0x02192c (0x1eb9 bytes) 000747 1788882038.693303 mapread 0x00964b thru 0x01802b (0xe9e1 bytes) 000748 1788882038.703667 trunc from 0x02192d to 0x03a445 (0x18b19 bytes) 000751 1788882038.728162 mapread 0x000a76 thru 0x00abc9 (0xa154 bytes) 000753 1788882038.731794 write 0x03ba2f thru 0x03ffff (0x45d1 bytes) 000755 1788882038.733131 mapwrite 0x016f99 thru 0x022e23 (0xbe8b bytes) 000756 1788882038.754111 write 0x020cf6 thru 0x021173 (0x47e bytes) 000757 1788882038.754839 trunc from 0x040000 to 0x03e97e (0x1681 bytes) 000760 1788882038.761077 read 0x011f07 thru 0x0157c4 (0x38be bytes) 000761 1788882038.761449 trunc from 0x03e97f to 0x03376a (0xb214 bytes) 000763 1788882038.765934 mapread 0x016293 thru 0x01e58e (0x82fc bytes) 000765 1788882038.767124 read 0x005813 thru 0x010b6c (0xb35a bytes) 000767 1788882038.768344 mapread 0x00d581 thru 0x00de8c (0x90c bytes) 000768 1788882038.769039 write 0x008e97 thru 0x015d4f (0xceb9 bytes) 000769 1788882038.769949 punch from 0x001d60 to 0x011a44 (0xfce5 bytes) 000771 1788882038.774159 trunc from 0x03376b to 0x014493 (0x1f2d7 bytes) 000772 1788882038.779694 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x14494): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14494): Mirror 9: 0x8c6fb71a (stale) Mirror 10: 0x8c6fb71a (stale) Mirror 17: 0x8c6fb71a (stale) Mirror 18: 0x8c6fb71a (stale) Mirror 19: 0x8c6fb71a (stale) Mirror 20: 0x8c6fb71a (stale) Mirror 22: 0x8c6fb71a (stale) Mirror 24: 0x8c6fb71a (stale) Mirror 25: 0x8c6fb71a (stale) Mirror 26: 0x8c6fb71a (stale) Mirror 27: 0x8c6fb71a (stale) Mirror 28: 0x8e86d593 (stale) CRC-32 checksum value for chunk [0, 0x14494): Mirror 1: 0x19639ade Mirror 29: 0x19639ade lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14494: skipped 000773 1788882039.105673 punch from 0x000d2c to 0x000f06 (0x1db bytes) 000775 1788882039.127899 trunc from 0x014494 to 0x020313 (0xbe80 bytes) 000776 1788882039.133653 write 0x007399 thru 0x00ee41 (0x7aa9 bytes) 000777 1788882039.138358 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x20314): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20314): Mirror 9: 0x56e97346 (stale) Mirror 10: 0x56e97346 (stale) Mirror 17: 0x56e97346 (stale) Mirror 18: 0x56e97346 (stale) Mirror 19: 0x56e97346 (stale) Mirror 20: 0x56e97346 (stale) Mirror 22: 0x56e97346 (stale) Mirror 24: 0x56e97346 (stale) Mirror 25: 0x56e97346 (stale) Mirror 26: 0x56e97346 (stale) Mirror 27: 0x56e97346 (stale) Mirror 28: 0xa0a1ffc5 (stale) Mirror 29: 0x85a46f4b (stale) CRC-32 checksum value for chunk [0, 0x20314): Mirror 1: 0xcf08059c Mirror 30: 0xcf08059c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20314: skipped 000779 1788882039.512580 trunc from 0x020314 to 0x0107d1 (0xfb42 bytes) 000780 1788882039.540201 read 0x00d851 thru 0x0107d1 (0x2f81 bytes) 000781 1788882039.542668 read 0x0009af thru 0x002ffa (0x264c bytes) 000782 1788882039.547099 MIRROR_RESYNC 15 mirrors 000784 1788882040.403797 mapwrite 0x0252e5 thru 0x033a06 (0xe722 bytes) 000786 1788882040.450648 write 0x029e57 thru 0x033b88 (0x9d32 bytes) 000787 1788882040.451645 punch from 0x025b33 to 0x02ffd2 (0xa4a0 bytes) 000788 1788882040.455941 read 0x0307a4 thru 0x033b88 (0x33e5 bytes) 000789 1788882040.456562 punch from 0x027c08 to 0x033b88 (0xbf81 bytes) 000790 1788882040.458289 trunc from 0x033b89 to 0x03ce77 (0x92ef bytes) 000794 1788882040.464995 read 0x027a54 thru 0x02cb0b (0x50b8 bytes) 000795 1788882040.469108 mapwrite 0x0189b2 thru 0x01b786 (0x2dd5 bytes) 000796 1788882040.482762 write 0x03998e thru 0x03ffff (0x6672 bytes) 000797 1788882040.483699 trunc from 0x040000 to 0x023a20 (0x1c5df bytes) 000804 1788882040.490246 read 0x005b64 thru 0x008139 (0x25d6 bytes) 000807 1788882040.491236 read 0x01708e thru 0x01abf3 (0x3b66 bytes) 000808 1788882040.491576 trunc from 0x023a21 to 0x03e564 (0x1ab44 bytes) 000810 1788882040.495898 mapwrite 0x03d3be thru 0x03ffff (0x2c42 bytes) 000811 1788882040.515241 trunc from 0x040000 to 0x01588f (0x2a770 bytes) 000812 1788882040.520112 write 0x0219d7 thru 0x02e458 (0xca82 bytes) 000813 1788882040.526018 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2e459): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e459): Mirror 9: 0x1a2580cb (stale) Mirror 10: 0x1a2580cb (stale) Mirror 17: 0x1a2580cb (stale) Mirror 18: 0x1a2580cb (stale) Mirror 19: 0x1a2580cb (stale) Mirror 20: 0x1a2580cb (stale) Mirror 22: 0x1a2580cb (stale) Mirror 24: 0x1a2580cb (stale) Mirror 25: 0x1a2580cb (stale) Mirror 26: 0x1a2580cb (stale) Mirror 27: 0x1a2580cb (stale) Mirror 28: 0x1a2580cb (stale) Mirror 29: 0x1a2580cb (stale) Mirror 30: 0x1a2580cb (stale) CRC-32 checksum value for chunk [0, 0x2e459): Mirror 1: 0xe347489b Mirror 31: 0xe347489b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e459: skipped 000814 1788882040.870164 mapwrite 0x004d0a thru 0x00f301 (0xa5f8 bytes) 000816 1788882040.929862 trunc from 0x02e459 to 0x0100c1 (0x1e397 bytes) 000817 1788882040.939644 trunc from 0x0100c2 to 0x02b282 (0x1b1c1 bytes) 000818 1788882040.943542 mapread 0x021981 thru 0x02b282 (0x9902 bytes) 000821 1788882040.949232 read 0x01d77b thru 0x026049 (0x88cf bytes) 000822 1788882040.949670 read 0x025831 thru 0x02b282 (0x5a52 bytes) 000823 1788882040.950045 read 0x01802f thru 0x01f79c (0x776e bytes) 000825 1788882040.953536 mapwrite 0x01ce07 thru 0x024db5 (0x7faf bytes) 000827 1788882040.968015 mapwrite 0x014175 thru 0x020dfc (0xcc88 bytes) 000829 1788882040.982759 trunc from 0x02b283 to 0x029e8f (0x13f3 bytes) 000830 1788882040.987459 trunc from 0x029e90 to 0x030547 (0x66b8 bytes) 000831 1788882040.991516 trunc from 0x030548 to 0x00520c (0x2b33b bytes) truncating to largest ever: 0x3f37a 000832 1788882040.995725 trunc from 0x00520d to 0x03f379 (0x3a16d bytes) 000836 1788882041.000503 write 0x0075d9 thru 0x015ecc (0xe8f4 bytes) 000838 1788882041.005155 write 0x01245b thru 0x020f38 (0xeade bytes) 000840 1788882041.007718 punch from 0x02f77c to 0x039aa9 (0xa32e bytes) 000841 1788882041.011467 write 0x01a29c thru 0x01d160 (0x2ec5 bytes) 000842 1788882041.012116 trunc from 0x03f37a to 0x018bc3 (0x267b6 bytes) 000843 1788882041.016370 mapread 0x010173 thru 0x012667 (0x24f5 bytes) 000846 1788882041.017555 read 0x00c671 thru 0x018bc3 (0xc553 bytes) 000850 1788882041.019439 mapwrite 0x00659d thru 0x00ecd6 (0x873a bytes) 000851 1788882041.036531 punch from 0x001a21 to 0x00fed6 (0xe4b6 bytes) 000854 1788882041.039414 mapread 0x00957e thru 0x009ef8 (0x97b bytes) 000855 1788882041.041363 punch from 0x0059e4 to 0x00ab18 (0x5135 bytes) 000858 1788882041.043788 trunc from 0x018bc4 to 0x03915b (0x20598 bytes) 000861 1788882041.049200 mapread 0x0350fc thru 0x038ec1 (0x3dc6 bytes) 000862 1788882041.052797 mapwrite 0x0052eb thru 0x00eb12 (0x9828 bytes) 000863 1788882041.078339 mapwrite 0x03c94e thru 0x03ffff (0x36b2 bytes) 000864 1788882041.096923 mapread 0x03107c thru 0x03e3b9 (0xd33e bytes) 000868 1788882041.098452 punch from 0x03d618 to 0x03ffff (0x29e8 bytes) 000869 1788882041.100389 read 0x00a112 thru 0x019df8 (0xfce7 bytes) 000870 1788882041.105080 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd91479a7 (stale) Mirror 10: 0xd91479a7 (stale) Mirror 17: 0xd91479a7 (stale) Mirror 18: 0xd91479a7 (stale) Mirror 20: 0xd91479a7 (stale) Mirror 22: 0xd91479a7 (stale) Mirror 24: 0xd91479a7 (stale) Mirror 25: 0xd91479a7 (stale) Mirror 26: 0xd91479a7 (stale) Mirror 27: 0xd91479a7 (stale) Mirror 28: 0xd91479a7 (stale) Mirror 29: 0xd91479a7 (stale) Mirror 30: 0xd91479a7 (stale) Mirror 31: 0xc47692cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd91479a7 (stale) Mirror 10: 0xd91479a7 (stale) Mirror 17: 0xd91479a7 (stale) Mirror 18: 0xd91479a7 (stale) Mirror 20: 0xd91479a7 (stale) Mirror 22: 0xd91479a7 (stale) Mirror 24: 0xd91479a7 (stale) Mirror 25: 0xd91479a7 (stale) Mirror 26: 0xd91479a7 (stale) Mirror 27: 0xd91479a7 (stale) Mirror 28: 0xd91479a7 (stale) Mirror 29: 0xd91479a7 (stale) Mirror 30: 0xd91479a7 (stale) Mirror 31: 0xc47692cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000871 1788882041.271917 write 0x0340a4 thru 0x035145 (0x10a2 bytes) 000872 1788882041.274954 mapwrite 0x00775a thru 0x011360 (0x9c07 bytes) 000874 1788882041.295239 trunc from 0x040000 to 0x02ed99 (0x11266 bytes) 000875 1788882041.299948 mapread 0x00311c thru 0x004bab (0x1a90 bytes) 000876 1788882041.300713 write 0x036491 thru 0x03da1f (0x758f bytes) 000877 1788882041.301796 punch from 0x0235ba to 0x0290e0 (0x5b27 bytes) 000878 1788882041.305456 write 0x035a13 thru 0x03ffff (0xa5ed bytes) 000879 1788882041.307281 mapread 0x03f383 thru 0x03ffff (0xc7d bytes) 000881 1788882041.308214 trunc from 0x040000 to 0x0310f1 (0xef0e bytes) 000882 1788882041.314021 MIRROR_RESYNC 15 mirrors 000883 1788882042.090012 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) 000887 1788882042.217708 punch from 0x0141d3 to 0x023aba (0xf8e8 bytes) 000888 1788882042.239339 read 0x026c9f thru 0x027268 (0x5ca bytes) 000889 1788882042.241372 write 0x022400 thru 0x02cca9 (0xa8aa bytes) 000890 1788882042.244367 mapread 0x00293d thru 0x0098af (0x6f73 bytes) 000892 1788882042.249861 mapread 0x02e69f thru 0x02f315 (0xc77 bytes) 000893 1788882042.252374 read 0x025cae thru 0x02f770 (0x9ac3 bytes) 000896 1788882042.253528 mapwrite 0x030e92 thru 0x03c48f (0xb5fe bytes) 000897 1788882042.283165 mapwrite 0x02e43d thru 0x0361c0 (0x7d84 bytes) 000898 1788882042.296929 mapread 0x01c376 thru 0x01cfd8 (0xc63 bytes) 000899 1788882042.297460 read 0x01528b thru 0x0175b3 (0x2329 bytes) 000900 1788882042.297924 mapread 0x02b395 thru 0x02bcf1 (0x95d bytes) 000901 1788882042.298433 trunc from 0x03c490 to 0x01557c (0x26f13 bytes) 000902 1788882042.303417 read 0x009504 thru 0x00a15d (0xc5a bytes) 000906 1788882042.305467 mapwrite 0x02e2db thru 0x034776 (0x649c bytes) 000907 1788882042.327852 mapwrite 0x0153b1 thru 0x01e997 (0x95e7 bytes) 000908 1788882042.342101 mapwrite 0x00d3f7 thru 0x010b61 (0x376b bytes) 000909 1788882042.354620 punch from 0x0337d5 to 0x034776 (0xfa2 bytes) 000910 1788882042.356668 punch from 0x011586 to 0x01b83e (0xa2b9 bytes) 000911 1788882042.358379 trunc from 0x034777 to 0x03e128 (0x99b2 bytes) 000912 1788882042.362654 write 0x01bed5 thru 0x01e30f (0x243b bytes) 000913 1788882042.365331 write 0x022665 thru 0x02ce33 (0xa7cf bytes) 000915 1788882042.366411 mapread 0x02ef02 thru 0x03e128 (0xf227 bytes) 000916 1788882042.369494 read 0x03a5af thru 0x03e128 (0x3b7a bytes) 000917 1788882042.369912 read 0x0057a0 thru 0x007751 (0x1fb2 bytes) 000920 1788882042.370858 read 0x01d3ab thru 0x02bde5 (0xea3b bytes) 000922 1788882042.371508 read 0x009ab7 thru 0x0169d6 (0xcf20 bytes) 000923 1788882042.374126 punch from 0x00d933 to 0x0123c4 (0x4a92 bytes) 000925 1788882042.378321 mapwrite 0x0242b9 thru 0x02a093 (0x5ddb bytes) 000926 1788882042.392512 write 0x02f4d4 thru 0x03cc43 (0xd770 bytes) 000928 1788882042.395455 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e129): Mirror 9: 0xdd060e5f (stale) Mirror 17: 0xdd060e5f (stale) Mirror 18: 0xdd060e5f (stale) Mirror 20: 0xdd060e5f (stale) Mirror 22: 0xdd060e5f (stale) Mirror 24: 0xdd060e5f (stale) Mirror 25: 0xdd060e5f (stale) Mirror 26: 0xdd060e5f (stale) Mirror 27: 0xdd060e5f (stale) Mirror 28: 0xdd060e5f (stale) Mirror 29: 0xdd060e5f (stale) Mirror 31: 0xdd060e5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e129): Mirror 9: 0xdd060e5f (stale) Mirror 17: 0xdd060e5f (stale) Mirror 18: 0xdd060e5f (stale) Mirror 20: 0xdd060e5f (stale) Mirror 22: 0xdd060e5f (stale) Mirror 24: 0xdd060e5f (stale) Mirror 25: 0xdd060e5f (stale) Mirror 26: 0xdd060e5f (stale) Mirror 27: 0xdd060e5f (stale) Mirror 28: 0xdd060e5f (stale) Mirror 29: 0xdd060e5f (stale) Mirror 31: 0xdd060e5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e129: skipped 000930 1788882042.559953 read 0x00a53f thru 0x019d2d (0xf7ef bytes) 000932 1788882042.563135 mapread 0x002b8c thru 0x009de8 (0x725d bytes) 000933 1788882042.568021 write 0x0219e8 thru 0x02e765 (0xcd7e bytes) 000934 1788882042.571056 read 0x00d96c thru 0x01713f (0x97d4 bytes) 000937 1788882042.572343 mapread 0x02c471 thru 0x0377d7 (0xb367 bytes) 000939 1788882042.576949 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e129): Mirror 9: 0xdd060e5f (stale) Mirror 18: 0xdd060e5f (stale) Mirror 20: 0xdd060e5f (stale) Mirror 22: 0xdd060e5f (stale) Mirror 24: 0xdd060e5f (stale) Mirror 25: 0xdd060e5f (stale) Mirror 26: 0xdd060e5f (stale) Mirror 27: 0xdd060e5f (stale) Mirror 28: 0xdd060e5f (stale) Mirror 29: 0xdd060e5f (stale) Mirror 31: 0xdd060e5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e129): Mirror 9: 0xdd060e5f (stale) Mirror 18: 0xdd060e5f (stale) Mirror 20: 0xdd060e5f (stale) Mirror 22: 0xdd060e5f (stale) Mirror 24: 0xdd060e5f (stale) Mirror 25: 0xdd060e5f (stale) Mirror 26: 0xdd060e5f (stale) Mirror 27: 0xdd060e5f (stale) Mirror 28: 0xdd060e5f (stale) Mirror 29: 0xdd060e5f (stale) Mirror 31: 0xdd060e5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e129: skipped 000941 1788882042.730651 mapwrite 0x022511 thru 0x0313e6 (0xeed6 bytes) 000943 1788882042.754458 mapread 0x0084a5 thru 0x0102c6 (0x7e22 bytes) 000945 1788882042.758009 mapwrite 0x006753 thru 0x0089fc (0x22aa bytes) 000946 1788882042.769988 MIRROR_RESYNC 12 mirrors 000947 1788882043.984590 punch from 0x0173f5 to 0x01998b (0x2597 bytes) 000948 1788882044.004172 mapread 0x02eba6 thru 0x035399 (0x67f4 bytes) 000949 1788882044.009465 punch from 0x01abed to 0x01fcf7 (0x510b bytes) 000950 1788882044.011114 write 0x0075c3 thru 0x00d3d3 (0x5e11 bytes) 000951 1788882044.014093 mapread 0x003558 thru 0x012f1b (0xf9c4 bytes) 000952 1788882044.018926 trunc from 0x03e129 to 0x00aadf (0x33649 bytes) 000954 1788882044.025460 mapread 0x0034ae thru 0x007171 (0x3cc4 bytes) 000955 1788882044.026427 mapwrite 0x02ec48 thru 0x03dcd4 (0xf08d bytes) 000956 1788882044.054006 mapwrite 0x013d09 thru 0x01620d (0x2505 bytes) 000958 1788882044.068834 trunc from 0x03dcd5 to 0x014d39 (0x28f9b bytes) 000960 1788882044.073962 mapread 0x00be8f thru 0x014d39 (0x8eab bytes) 000961 1788882044.076047 read 0x013d38 thru 0x014d39 (0x1002 bytes) 000962 1788882044.076397 punch from 0x00ad5e to 0x014d39 (0x9fdc bytes) 000963 1788882044.078026 read 0x006813 thru 0x00d615 (0x6e03 bytes) 000964 1788882044.080677 mapread 0x00fe87 thru 0x014d39 (0x4eb3 bytes) 000965 1788882044.081310 trunc from 0x014d3a to 0x03bee9 (0x271b0 bytes) 000968 1788882044.086095 mapread 0x033fdf thru 0x0395bb (0x55dd bytes) 000969 1788882044.091511 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3beea): Mirror 9: 0x6352c633 (stale) Mirror 18: 0x6352c633 (stale) Mirror 22: 0x6352c633 (stale) Mirror 24: 0x6352c633 (stale) Mirror 25: 0x6352c633 (stale) Mirror 26: 0x6352c633 (stale) Mirror 27: 0x6352c633 (stale) Mirror 28: 0x6352c633 (stale) Mirror 29: 0x6352c633 (stale) Mirror 31: 0x6352c633 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beea): Mirror 9: 0x6352c633 (stale) Mirror 18: 0x6352c633 (stale) Mirror 22: 0x6352c633 (stale) Mirror 24: 0x6352c633 (stale) Mirror 25: 0x6352c633 (stale) Mirror 26: 0x6352c633 (stale) Mirror 27: 0x6352c633 (stale) Mirror 28: 0x6352c633 (stale) Mirror 29: 0x6352c633 (stale) Mirror 31: 0x6352c633 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beea: skipped 000970 1788882044.249143 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x65c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3beea): Mirror 18: 0x6352c633 (stale) Mirror 22: 0x6352c633 (stale) Mirror 24: 0x6352c633 (stale) Mirror 25: 0x6352c633 (stale) Mirror 26: 0x6352c633 (stale) Mirror 27: 0x6352c633 (stale) Mirror 28: 0x6352c633 (stale) Mirror 29: 0x6352c633 (stale) Mirror 31: 0x6352c633 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beea): Mirror 18: 0x6352c633 (stale) Mirror 22: 0x6352c633 (stale) Mirror 24: 0x6352c633 (stale) Mirror 25: 0x6352c633 (stale) Mirror 26: 0x6352c633 (stale) Mirror 27: 0x6352c633 (stale) Mirror 28: 0x6352c633 (stale) Mirror 29: 0x6352c633 (stale) Mirror 31: 0x6352c633 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beea: skipped 000973 1788882044.390213 punch from 0x00f8d0 to 0x011132 (0x1863 bytes) 000974 1788882044.392074 write 0x01ebc5 thru 0x01f9d4 (0xe10 bytes) 000976 1788882044.395664 mapwrite 0x01ec0f thru 0x02bfef (0xd3e1 bytes) 000977 1788882044.419000 trunc from 0x03beea to 0x01004e (0x2be9b bytes) 000979 1788882044.424123 read 0x009f76 thru 0x00cff8 (0x3083 bytes) 000980 1788882044.427885 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1004f): Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1004f): Mirror 18: 0x1fb37802 (stale) Mirror 22: 0x1fb37802 (stale) Mirror 24: 0x1fb37802 (stale) Mirror 25: 0x1fb37802 (stale) Mirror 26: 0x1fb37802 (stale) Mirror 27: 0x1fb37802 (stale) Mirror 28: 0x1fb37802 (stale) Mirror 29: 0x1fb37802 (stale) Mirror 31: 0x1fb37802 (stale) CRC-32 checksum value for chunk [0, 0x1004f): Mirror 1: 0x7bd2a06c Mirror 32: 0x7bd2a06c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1004f: skipped 000982 1788882044.727604 MIRROR_RESYNC 11 mirrors 000983 1788882045.288256 trunc from 0x01004f to 0x036fea (0x26f9c bytes) 000984 1788882045.314179 mapwrite 0x0183cb thru 0x01a628 (0x225e bytes) 000986 1788882045.334534 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x36feb): Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36feb): Mirror 18: 0xaa856a6b (stale) Mirror 22: 0xaa856a6b (stale) Mirror 24: 0xaa856a6b (stale) Mirror 25: 0xaa856a6b (stale) Mirror 26: 0xaa856a6b (stale) Mirror 27: 0xaa856a6b (stale) Mirror 28: 0xaa856a6b (stale) Mirror 29: 0xaa856a6b (stale) Mirror 31: 0xaa856a6b (stale) Mirror 32: 0xaa856a6b (stale) CRC-32 checksum value for chunk [0, 0x36feb): Mirror 1: 0xc000cc67 Mirror 33: 0xc000cc67 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36feb: skipped 000987 1788882045.652223 trunc from 0x036feb to 0x008da2 (0x2e248 bytes) 000988 1788882045.678234 read 0x007b4e thru 0x008da2 (0x1255 bytes) 000990 1788882045.681305 read 0x002814 thru 0x0041c5 (0x19b2 bytes) 000991 1788882045.683914 trunc from 0x008da3 to 0x0018f4 (0x74ae bytes) 000992 1788882045.690702 MIRROR_RESYNC 12 mirrors 000993 1788882046.134881 punch from 0x00111b to 0x0018f4 (0x7da bytes) 000994 1788882046.155619 mapread 0x00009d thru 0x0018f4 (0x1858 bytes) 000998 1788882046.160397 mapread 0x00039c thru 0x0018f4 (0x1559 bytes) 001000 1788882046.161307 mapread 0x00149a thru 0x0018f4 (0x45b bytes) All operations completed A-OK!