== sanity-flr test 70a: flr mode fsx test ================ 07:09:15 (1789297755) Seed set to 7757 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x34240 000003 1789297757.657511 trunc from 00000000 to 0x03423f (0x34240 bytes) 000005 1789297757.670644 mapwrite 0x00d92d thru 0x013085 (0x5759 bytes) 000006 1789297757.763563 mapread 0x026bed thru 0x02d61b (0x6a2f bytes) 000008 1789297757.775182 punch from 0x01dd06 to 0x029c6c (0xbf67 bytes) 000009 1789297757.780949 write 0x00d623 thru 0x0125e5 (0x4fc3 bytes) 000011 1789297757.785180 write 0x0247ab thru 0x0256c0 (0xf16 bytes) 000013 1789297757.811505 read 0x00df90 thru 0x01ad0d (0xcd7e bytes) 000014 1789297757.825134 mapread 0x01c256 thru 0x026631 (0xa3dc bytes) 000015 1789297757.849404 trunc from 0x034240 to 0x033421 (0xe1e bytes) 000016 1789297757.887272 mapwrite 0x009f60 thru 0x013d5b (0x9dfc bytes) 000017 1789297757.949794 read 0x02ca08 thru 0x02ef61 (0x255a bytes) 000018 1789297757.950406 punch from 0x006b81 to 0x015e5b (0xf2db bytes) 000020 1789297757.959954 punch from 0x00d296 to 0x014bfd (0x7968 bytes) 000022 1789297757.977608 MIRROR_EXTEND to 2 mirrors 000024 1789297759.118234 trunc from 0x033422 to 0x00c5a9 (0x26e78 bytes) 000025 1789297759.202489 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xc5aa): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc5aa): Mirror 2: 0x5801fcba (stale) CRC-32 checksum value for chunk [0, 0xc5aa): Mirror 1: 0x5801fcba Mirror 3: 0x5801fcba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc5aa: skipped 000026 1789297760.025410 read 0x006e2c thru 0x00c5a9 (0x577e bytes) 000027 1789297760.040618 trunc from 0x00c5aa to 0x01349e (0x6ef5 bytes) truncating to largest ever: 0x3edd4 000028 1789297760.230631 trunc from 0x01349f to 0x03edd3 (0x2b935 bytes) 000029 1789297760.282691 read 0x00a3f6 thru 0x0156dd (0xb2e8 bytes) 000030 1789297760.323660 punch from 0x02046e to 0x02538f (0x4f22 bytes) 000031 1789297760.335707 write 0x02cff9 thru 0x0340d9 (0x70e1 bytes) 000032 1789297760.336913 mapwrite 0x02892d thru 0x033fe4 (0xb6b8 bytes) 000033 1789297760.474276 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3edd4): Mirror 3: 0x9d03ced8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edd4): Mirror 3: 0x9d03ced8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edd4: skipped 000034 1789297760.896813 MIRROR_RESYNC 2 mirrors 000037 1789297761.657214 trunc from 0x03edd4 to 0x014e8f (0x29f44 bytes) 000038 1789297761.719228 mapread 0x012c17 thru 0x014e8f (0x2279 bytes) 000040 1789297761.745647 trunc from 0x014e90 to 0x018834 (0x39a5 bytes) 000041 1789297761.768199 trunc from 0x018835 to 0x012a45 (0x5def bytes) 000043 1789297761.788166 mapwrite 0x0320b1 thru 0x03ac09 (0x8b59 bytes) 000044 1789297761.864698 mapwrite 0x000039 thru 0x001f7f (0x1f47 bytes) 000045 1789297761.922467 trunc from 0x03ac0a to 0x00ce49 (0x2ddc0 bytes) 000047 1789297761.946640 mapread 0x0001a9 thru 0x00a4de (0xa336 bytes) 000049 1789297761.957608 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000050 1789297762.123156 read 0x005bb4 thru 0x00aa0b (0x4e58 bytes) 000052 1789297762.132412 mapread 0x007104 thru 0x00ce49 (0x5d46 bytes) 000053 1789297762.144673 read 0x0045f8 thru 0x00ce49 (0x8852 bytes) 000054 1789297762.154165 write 0x023da8 thru 0x02eadc (0xad35 bytes) 000055 1789297762.156296 read 0x02309f thru 0x02e790 (0xb6f2 bytes) 000059 1789297762.160583 punch from 0x02499e to 0x027238 (0x289b bytes) 000061 1789297762.178543 trunc from 0x02eadd to 0x029e78 (0x4c64 bytes) 000062 1789297762.200021 write 0x03ba4e thru 0x03ffff (0x45b2 bytes) 000063 1789297762.202574 read 0x031ba7 thru 0x031df3 (0x24d bytes) 000064 1789297762.216580 trunc from 0x040000 to 0x038c12 (0x73ed bytes) 000065 1789297762.247657 write 0x025d47 thru 0x0289a0 (0x2c5a bytes) 000066 1789297762.250618 write 0x030aeb thru 0x03382d (0x2d43 bytes) 000067 1789297762.252973 mapread 0x0235ca thru 0x02bdcb (0x8802 bytes) 000069 1789297762.255795 mapread 0x0021ad thru 0x00674f (0x45a3 bytes) 000070 1789297762.256895 trunc from 0x038c13 to 0x0328c4 (0x634e bytes) 000072 1789297762.289560 read 0x026db1 thru 0x0294ac (0x26fc bytes) 000075 1789297762.291983 punch from 0x002bfe to 0x003ef6 (0x12f9 bytes) 000076 1789297762.307822 read 0x0170fa thru 0x01d2f3 (0x61fa bytes) 000077 1789297762.309493 punch from 0x0303e9 to 0x0328c4 (0x24dc bytes) 000079 1789297762.323200 mapread 0x02f2f4 thru 0x0328c4 (0x35d1 bytes) 000080 1789297762.336661 punch from 0x02e532 to 0x0328c4 (0x4393 bytes) 000081 1789297762.342586 trunc from 0x0328c5 to 0x0009be (0x31f06 bytes) 000085 1789297762.371179 mapread 0x0003a2 thru 0x000640 (0x29f bytes) 000086 1789297762.372647 punch from 0x0002ca to 0x0009be (0x6f5 bytes) 000087 1789297762.387205 MIRROR_EXTEND to 2 mirrors 000089 1789297763.013519 trunc from 0x0009bf to 0x016ce2 (0x16324 bytes) 000090 1789297763.109033 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16ce3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16ce3): Mirror 2: 0x1df5941c (stale) CRC-32 checksum value for chunk [0, 0x16ce3): Mirror 1: 0x1df5941c Mirror 3: 0x1df5941c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16ce3: skipped 000091 1789297763.926634 punch from 0x01027d to 0x0140ad (0x3e31 bytes) 000092 1789297764.002956 read 0x009597 thru 0x010118 (0x6b82 bytes) 000094 1789297764.013053 write 0x02200d thru 0x02377d (0x1771 bytes) 000097 1789297764.023734 MIRROR_RESYNC 3 mirrors 000098 1789297765.031829 mapread 0x001532 thru 0x00f503 (0xdfd2 bytes) 000099 1789297765.066518 mapwrite 0x03e0ad thru 0x03ffff (0x1f53 bytes) 000100 1789297765.300115 trunc from 0x040000 to 0x0139f5 (0x2c60a bytes) 000101 1789297765.318454 read 0x004ef5 thru 0x006dcb (0x1ed7 bytes) 000102 1789297765.324010 read 0x010f25 thru 0x012ecf (0x1fab bytes) 000103 1789297765.342780 mapwrite 0x03a9b4 thru 0x03ffff (0x564c bytes) 000106 1789297765.439739 read 0x03c9dd thru 0x03ed19 (0x233d bytes) 000107 1789297765.440729 mapread 0x004507 thru 0x0133dd (0xeed7 bytes) 000109 1789297765.443306 punch from 0x01749b to 0x01f61a (0x8180 bytes) 000110 1789297765.447275 write 0x02a733 thru 0x036e4d (0xc71b bytes) 000112 1789297765.450431 mapwrite 0x005b51 thru 0x00dbf0 (0x80a0 bytes) 000114 1789297765.579289 read 0x038397 thru 0x03ffff (0x7c69 bytes) 000115 1789297765.580530 punch from 0x019fdb to 0x0259ba (0xb9e0 bytes) 000116 1789297765.586253 write 0x010eca thru 0x014a31 (0x3b68 bytes) 000117 1789297765.587695 mapwrite 0x01712b thru 0x020c44 (0x9b1a bytes) 000119 1789297765.657831 mapwrite 0x026d5e thru 0x02960d (0x28b0 bytes) 000120 1789297765.701963 punch from 0x03b0e3 to 0x03ffff (0x4f1d bytes) 000122 1789297765.709617 trunc from 0x040000 to 0x01d0c0 (0x22f3f bytes) 000123 1789297765.736338 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d0c1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d0c1): Mirror 2: 0xc082d8ee (stale) Mirror 3: 0xc082d8ee (stale) CRC-32 checksum value for chunk [0, 0x1d0c1): Mirror 1: 0x18bde6ce Mirror 4: 0x18bde6ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d0c1: skipped 000124 1789297766.830415 write 0x036658 thru 0x03f66c (0x9015 bytes) 000125 1789297766.977143 trunc from 0x03f66d to 0x03ac35 (0x4a37 bytes) 000126 1789297767.002941 trunc from 0x03ac36 to 0x0153a5 (0x25890 bytes) 000127 1789297767.032264 punch from 0x00ea0d to 0x0153a5 (0x6999 bytes) 000128 1789297767.045310 MIRROR_RESYNC 4 mirrors 000132 1789297768.090693 MIRROR_RESYNC 4 mirrors 000133 1789297768.427578 read 0x011297 thru 0x0153a5 (0x410f bytes) 000136 1789297768.444523 trunc from 0x0153a6 to 0x01b739 (0x6394 bytes) 000137 1789297768.589466 punch from 0x01a9b1 to 0x01b739 (0xd89 bytes) 000138 1789297768.600811 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b73a): Mirror 3: 0x8eaf77fe (stale) Mirror 4: 0x8eaf77fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b73a): Mirror 3: 0x8eaf77fe (stale) Mirror 4: 0x8eaf77fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b73a: skipped 000139 1789297768.920879 mapwrite 0x01b90b thru 0x0209d9 (0x50cf bytes) 000140 1789297769.036158 write 0x0384dc thru 0x03ffff (0x7b24 bytes) 000143 1789297769.041561 punch from 0x014d73 to 0x01c6ba (0x7948 bytes) 000144 1789297769.064305 write 0x035ea4 thru 0x03ffff (0xa15c bytes) 000145 1789297769.074644 read 0x03f1ff thru 0x03ffff (0xe01 bytes) 000146 1789297769.077619 read 0x0161a2 thru 0x0228a9 (0xc708 bytes) 000147 1789297769.114314 trunc from 0x040000 to 0x019ae5 (0x2651a bytes) 000148 1789297769.145801 read 0x00d6ff thru 0x0167b0 (0x90b2 bytes) 000149 1789297769.146886 trunc from 0x019ae6 to 0x039615 (0x1fb30 bytes) 000150 1789297769.165087 write 0x010ffa thru 0x01ea6d (0xda74 bytes) 000151 1789297769.181199 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39616): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39616): Mirror 3: 0x6f397876 (stale) Mirror 4: 0x6f397876 (stale) CRC-32 checksum value for chunk [0, 0x39616): Mirror 1: 0x64420684 Mirror 5: 0x64420684 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39616: skipped 000152 1789297770.373974 read 0x035b02 thru 0x039615 (0x3b14 bytes) 000154 1789297770.402832 read 0x00cfc3 thru 0x012ad6 (0x5b14 bytes) 000155 1789297770.429744 mapwrite 0x012dea thru 0x01f45d (0xc674 bytes) 000156 1789297770.634888 write 0x039f29 thru 0x03fc71 (0x5d49 bytes) 000157 1789297770.643087 trunc from 0x03fc72 to 0x007100 (0x38b71 bytes) 000158 1789297770.717111 mapwrite 0x021359 thru 0x030a56 (0xf6fe bytes) 000159 1789297770.922691 trunc from 0x030a57 to 0x00c6c5 (0x24391 bytes) 000161 1789297770.955104 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc6c6): Mirror 4: 0xb688e3b8 (stale) Mirror 5: 0xb688e3b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc6c6): Mirror 4: 0xb688e3b8 (stale) Mirror 5: 0xb688e3b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc6c6: skipped 000164 1789297771.256034 write 0x00141d thru 0x00e953 (0xd537 bytes) 000165 1789297771.262757 punch from 0x00baf0 to 0x00e953 (0x2e64 bytes) 000166 1789297771.278252 mapread 0x006b5a thru 0x00bef8 (0x539f bytes) 000167 1789297771.290757 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xe954): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe954): Mirror 4: 0x28cc0158 (stale) Mirror 5: 0x28cc0158 (stale) CRC-32 checksum value for chunk [0, 0xe954): Mirror 1: 0xc9f3c165 Mirror 6: 0xc9f3c165 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe954: skipped 000168 1789297772.388654 MIRROR_RESYNC 4 mirrors 000169 1789297773.338736 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000170 1789297773.848786 trunc from 0x00e954 to 0x00520b (0x9748 bytes) 000171 1789297773.989661 mapread 0x00456d thru 0x004f2f (0x9c3 bytes) 000172 1789297773.998222 punch from 0x004819 to 0x00520b (0x9f3 bytes) 000175 1789297774.008186 mapwrite 0x016c68 thru 0x023c8f (0xd028 bytes) 000176 1789297774.141496 write 0x027050 thru 0x027adc (0xa8d bytes) 000177 1789297774.142466 read 0x00f3e2 thru 0x01ca26 (0xd645 bytes) 000178 1789297774.151340 write 0x00fdd3 thru 0x01806e (0x829c bytes) 000180 1789297774.156141 trunc from 0x027add to 0x01db6f (0x9f6d bytes) 000181 1789297774.177203 write 0x016450 thru 0x01fc55 (0x9806 bytes) 000182 1789297774.179446 mapread 0x0090c8 thru 0x012cc4 (0x9bfd bytes) 000183 1789297774.191093 mapread 0x01f419 thru 0x01fc55 (0x83d bytes) 000184 1789297774.192154 read 0x00b20e thru 0x011445 (0x6238 bytes) 000185 1789297774.193333 punch from 0x01ea55 to 0x01fc55 (0x1201 bytes) 000187 1789297774.207579 punch from 0x018b0e to 0x01fc55 (0x7148 bytes) 000188 1789297774.212612 mapread 0x016e25 thru 0x018cdb (0x1eb7 bytes) 000189 1789297774.222131 mapread 0x00c5cb thru 0x00ec75 (0x26ab bytes) 000190 1789297774.223331 punch from 0x00ab16 to 0x01219e (0x7689 bytes) 000191 1789297774.228806 write 0x0042df thru 0x0122ea (0xe00c bytes) 000193 1789297774.235312 punch from 0x01aa4d to 0x01fc55 (0x5209 bytes) 000194 1789297774.248311 mapread 0x006c58 thru 0x00b3ac (0x4755 bytes) 000195 1789297774.249436 read 0x015933 thru 0x01c44d (0x6b1b bytes) 000197 1789297774.263227 punch from 0x009385 to 0x00aec2 (0x1b3e bytes) 000198 1789297774.268284 mapread 0x01ecf8 thru 0x01fc55 (0xf5e bytes) 000199 1789297774.270223 write 0x008c6a thru 0x00f7da (0x6b71 bytes) 000201 1789297774.271936 punch from 0x01d066 to 0x01fc55 (0x2bf0 bytes) 000205 1789297774.285314 mapwrite 0x03d2d9 thru 0x03ffff (0x2d27 bytes) 000206 1789297774.346301 mapread 0x036fdb thru 0x03ffff (0x9025 bytes) 000207 1789297774.347742 mapwrite 0x01c9d7 thru 0x026578 (0x9ba2 bytes) 000208 1789297774.403045 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd055e669 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd055e669 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000209 1789297774.663083 read 0x02f998 thru 0x0374bc (0x7b25 bytes) 000210 1789297774.672230 read 0x0037da thru 0x00de83 (0xa6aa bytes) 000212 1789297774.684075 mapwrite 0x03dd0d thru 0x03ffff (0x22f3 bytes) 000213 1789297774.728019 MIRROR_RESYNC 2 mirrors 000214 1789297775.381437 read 0x004f25 thru 0x00cd0e (0x7dea bytes) 000215 1789297775.390309 trunc from 0x040000 to 0x0232f1 (0x1cd0e bytes) 000218 1789297775.485215 mapwrite 0x028139 thru 0x02e58d (0x6455 bytes) 000219 1789297775.612739 trunc from 0x02e58e to 0x01a8c1 (0x13ccc bytes) 000220 1789297775.646912 mapwrite 0x00523d thru 0x013258 (0xe01c bytes) 000221 1789297775.810913 mapwrite 0x019c31 thru 0x01b396 (0x1766 bytes) 000222 1789297775.964284 write 0x00b852 thru 0x015246 (0x99f5 bytes) 000223 1789297775.965457 mapread 0x01abbf thru 0x01b396 (0x7d8 bytes) 000226 1789297775.976482 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000228 1789297776.173692 read 0x01156b thru 0x019ea6 (0x893c bytes) 000229 1789297776.186220 mapread 0x006314 thru 0x0094e4 (0x31d1 bytes) 000230 1789297776.212210 punch from 0x017b60 to 0x01b396 (0x3837 bytes) 000231 1789297776.215966 punch from 0x0180c9 to 0x01afd4 (0x2f0c bytes) 000232 1789297776.222672 trunc from 0x01b397 to 0x028326 (0xcf90 bytes) 000233 1789297776.249706 mapwrite 0x00bcee thru 0x018278 (0xc58b bytes) 000235 1789297776.377749 mapwrite 0x03ad03 thru 0x03ffff (0x52fd bytes) 000236 1789297776.498519 mapread 0x01326a thru 0x01de70 (0xac07 bytes) 000237 1789297776.500273 read 0x01e7e3 thru 0x025393 (0x6bb1 bytes) 000238 1789297776.515438 punch from 0x026962 to 0x0284ab (0x1b4a bytes) 000241 1789297776.537026 trunc from 0x040000 to 0x003e58 (0x3c1a7 bytes) 000242 1789297776.570451 read 0x00234a thru 0x003e58 (0x1b0f bytes) 000243 1789297776.574094 mapread 0x00385b thru 0x003e58 (0x5fe bytes) 000245 1789297776.579656 read 0x001d7e thru 0x003e58 (0x20db bytes) 000246 1789297776.583350 write 0x03fc1b thru 0x03ffff (0x3e5 bytes) 000247 1789297776.585630 mapread 0x004d5c thru 0x006218 (0x14bd bytes) 000249 1789297776.600278 trunc from 0x040000 to 0x01f7ef (0x20810 bytes) 000252 1789297776.633058 punch from 0x0198ec to 0x01cf27 (0x363c bytes) 000253 1789297776.656451 write 0x034802 thru 0x03ffff (0xb7fe bytes) 000254 1789297776.658319 read 0x02016e thru 0x023785 (0x3618 bytes) 000255 1789297776.698589 read 0x032c8f thru 0x03ffff (0xd371 bytes) 000256 1789297776.699822 read 0x0267c5 thru 0x027b24 (0x1360 bytes) 000259 1789297776.703158 punch from 0x00725f to 0x00b648 (0x43ea bytes) 000261 1789297776.736919 mapread 0x03bf65 thru 0x03f591 (0x362d bytes) 000264 1789297776.745764 mapread 0x009f04 thru 0x018229 (0xe326 bytes) 000265 1789297776.772674 write 0x001c46 thru 0x010115 (0xe4d0 bytes) 000266 1789297776.774580 mapread 0x03c488 thru 0x03ffff (0x3b78 bytes) 000267 1789297776.777436 write 0x022fa1 thru 0x025c4b (0x2cab bytes) 000269 1789297776.780313 mapread 0x031905 thru 0x03d361 (0xba5d bytes) 000270 1789297776.781573 mapwrite 0x0220d3 thru 0x02c1b0 (0xa0de bytes) 000271 1789297776.851213 mapwrite 0x0379e1 thru 0x039b4d (0x216d bytes) 000273 1789297776.931630 mapread 0x01dd8b thru 0x0252cf (0x7545 bytes) 000275 1789297776.936714 mapread 0x038612 thru 0x03ffff (0x79ee bytes) 000276 1789297776.939084 mapwrite 0x00d04e thru 0x00ef9b (0x1f4e bytes) 000278 1789297777.042884 mapread 0x003189 thru 0x010130 (0xcfa8 bytes) 000281 1789297777.054468 punch from 0x018fc6 to 0x025aaa (0xcae5 bytes) 000282 1789297777.063615 mapwrite 0x037ef6 thru 0x03ffff (0x810a bytes) 000284 1789297777.126818 punch from 0x002eb4 to 0x011cde (0xee2b bytes) 000285 1789297777.143655 mapread 0x028305 thru 0x02f795 (0x7491 bytes) 000286 1789297777.144738 mapwrite 0x0304f9 thru 0x03b265 (0xad6d bytes) 000288 1789297777.211261 mapread 0x008921 thru 0x015b04 (0xd1e4 bytes) 000289 1789297777.288191 write 0x013412 thru 0x022ab7 (0xf6a6 bytes) 000291 1789297777.294992 punch from 0x007844 to 0x013946 (0xc103 bytes) 000294 1789297777.310330 punch from 0x02fae7 to 0x039d26 (0xa240 bytes) 000295 1789297777.314608 trunc from 0x040000 to 0x03dac1 (0x253e bytes) 000296 1789297777.332235 write 0x0002f5 thru 0x0031e3 (0x2eef bytes) 000297 1789297777.344991 write 0x031947 thru 0x03ffff (0xe6b9 bytes) 000298 1789297777.352187 punch from 0x031ce8 to 0x031e43 (0x15c bytes) 000299 1789297777.364254 mapread 0x00748c thru 0x00fb69 (0x86de bytes) 000301 1789297777.408094 mapread 0x0038a7 thru 0x0089ce (0x5128 bytes) 000302 1789297777.422725 trunc from 0x040000 to 0x03684e (0x97b1 bytes) 000304 1789297777.453022 read 0x024d1b thru 0x03276f (0xda55 bytes) 000306 1789297777.461762 trunc from 0x03684f to 0x03b3ac (0x4b5e bytes) 000307 1789297777.495111 MIRROR_EXTEND to 2 mirrors 000308 1789297778.701186 mapwrite 0x01999f thru 0x01f2e5 (0x5947 bytes) 000309 1789297778.907649 write 0x01518a thru 0x01fa4d (0xa8c4 bytes) 000311 1789297778.909758 read 0x025e11 thru 0x0287d9 (0x29c9 bytes) 000312 1789297778.937967 punch from 0x006247 to 0x012cf7 (0xcab1 bytes) 000314 1789297778.988380 trunc from 0x03b3ad to 0x01021f (0x2b18d bytes) 000315 1789297779.036471 mapread 0x0022c4 thru 0x01021f (0xdf5c bytes) 000316 1789297779.052731 trunc from 0x010220 to 0x028705 (0x184e6 bytes) 000318 1789297779.121561 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x28706): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28706): Mirror 2: 0x6f130d40 (stale) CRC-32 checksum value for chunk [0, 0x28706): Mirror 1: 0xd774e501 Mirror 3: 0xd774e501 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28706: skipped 000319 1789297780.711642 mapwrite 0x03af45 thru 0x03ffff (0x50bb bytes) 000320 1789297780.873941 write 0x018b82 thru 0x01b091 (0x2510 bytes) 000321 1789297780.882527 punch from 0x0002c3 to 0x00769c (0x73da bytes) 000323 1789297780.892165 read 0x0061d5 thru 0x015880 (0xf6ac bytes) 000324 1789297780.905191 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x659a33df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x659a33df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000325 1789297781.208376 read 0x03c052 thru 0x03db92 (0x1b41 bytes) 000326 1789297781.212260 write 0x03b2de thru 0x03ffff (0x4d22 bytes) 000329 1789297781.221476 write 0x009b22 thru 0x00ff1f (0x63fe bytes) 000330 1789297781.240122 read 0x01a7b3 thru 0x020b0f (0x635d bytes) 000331 1789297781.256927 mapread 0x00aa84 thru 0x00b89f (0xe1c bytes) 000332 1789297781.258347 read 0x003807 thru 0x00417c (0x976 bytes) 000333 1789297781.259617 read 0x017ead thru 0x0211d5 (0x9329 bytes) 000334 1789297781.266717 write 0x01a5cb thru 0x022f72 (0x89a8 bytes) 000335 1789297781.288960 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000336 1789297781.453828 mapread 0x022f6e thru 0x029662 (0x66f5 bytes) 000338 1789297781.492633 mapread 0x03179a thru 0x03d13f (0xb9a6 bytes) 000340 1789297781.532975 mapwrite 0x01f0fb thru 0x02e1e0 (0xf0e6 bytes) 000341 1789297781.592248 punch from 0x01783c to 0x025b15 (0xe2da bytes) 000342 1789297781.599071 trunc from 0x040000 to 0x03242e (0xdbd1 bytes) 000344 1789297781.628684 trunc from 0x03242f to 0x012eae (0x1f580 bytes) 000345 1789297781.648252 mapwrite 0x006301 thru 0x00d1f6 (0x6ef6 bytes) 000346 1789297781.721809 write 0x01e831 thru 0x020895 (0x2065 bytes) 000347 1789297781.723682 mapread 0x010dfd thru 0x01c078 (0xb27c bytes) 000348 1789297781.741145 read 0x0025f6 thru 0x01019e (0xdba9 bytes) 000350 1789297781.742884 trunc from 0x020896 to 0x021b13 (0x127e bytes) 000351 1789297781.763665 write 0x027095 thru 0x029a9a (0x2a06 bytes) 000353 1789297781.765609 trunc from 0x029a9b to 0x004828 (0x25272 bytes) 000354 1789297781.790909 read 0x002f90 thru 0x004828 (0x1899 bytes) 000355 1789297781.791514 mapread 0x0013d3 thru 0x0032b9 (0x1ee7 bytes) 000359 1789297781.802730 punch from 0x00210c to 0x004828 (0x271d bytes) 000360 1789297781.830392 MIRROR_EXTEND to 2 mirrors 000361 1789297782.539201 mapwrite 0x011baf thru 0x01d370 (0xb7c2 bytes) 000362 1789297782.679429 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000363 1789297782.810652 mapwrite 0x01787c thru 0x01fce8 (0x846d bytes) 000364 1789297782.881826 mapread 0x00b1f7 thru 0x017c0a (0xca14 bytes) 000366 1789297782.894766 trunc from 0x01fce9 to 0x010a5d (0xf28b bytes) 000367 1789297782.913937 mapwrite 0x003d06 thru 0x00dc6a (0x9f65 bytes) 000369 1789297782.978512 mapread 0x00bbb4 thru 0x010a5d (0x4eaa bytes) 000373 1789297782.986044 mapread 0x001399 thru 0x003e01 (0x2a69 bytes) 000374 1789297782.987199 mapwrite 0x00263e thru 0x00924b (0x6c0e bytes) 000375 1789297783.030551 mapread 0x001934 thru 0x003b46 (0x2213 bytes) 000377 1789297783.032554 trunc from 0x010a5e to 0x03bb55 (0x2b0f8 bytes) 000378 1789297783.049265 punch from 0x02cb36 to 0x03732e (0xa7f9 bytes) 000379 1789297783.053601 read 0x0084e6 thru 0x00dbc1 (0x56dc bytes) 000382 1789297783.055649 trunc from 0x03bb56 to 0x008365 (0x337f0 bytes) 000384 1789297783.070271 write 0x001f7c thru 0x0092e4 (0x7369 bytes) 000385 1789297783.072551 read 0x008d24 thru 0x0092e4 (0x5c1 bytes) 000387 1789297783.074056 read 0x004603 thru 0x0092e4 (0x4ce2 bytes) 000388 1789297783.075447 read 0x0035f8 thru 0x0092e4 (0x5ced bytes) 000389 1789297783.076473 trunc from 0x0092e5 to 0x0108db (0x75f7 bytes) 000390 1789297783.100217 punch from 0x00b88e to 0x00ec91 (0x3404 bytes) 000392 1789297783.113451 punch from 0x008e08 to 0x0100a6 (0x729f bytes) 000393 1789297783.119764 punch from 0x00968d to 0x0108db (0x724f bytes) 000394 1789297783.124626 mapwrite 0x023faf thru 0x02fa90 (0xbae2 bytes) 000395 1789297783.194694 mapread 0x012ff6 thru 0x015b02 (0x2b0d bytes) 000397 1789297783.197339 mapread 0x0156f6 thru 0x016259 (0xb64 bytes) 000400 1789297783.201147 read 0x015e1d thru 0x024fb8 (0xf19c bytes) 000401 1789297783.202308 write 0x01fa25 thru 0x027176 (0x7752 bytes) 000403 1789297783.204607 mapwrite 0x03a268 thru 0x03ffff (0x5d98 bytes) 000404 1789297783.274749 mapwrite 0x00a5c9 thru 0x00fa7e (0x54b6 bytes) 000406 1789297783.313178 read 0x03dd4f thru 0x03ffff (0x22b1 bytes) 000407 1789297783.313673 write 0x036020 thru 0x03e5e2 (0x85c3 bytes) 000408 1789297783.315166 trunc from 0x040000 to 0x009a1e (0x365e1 bytes) 000412 1789297783.331951 punch from 0x003951 to 0x006d5a (0x340a bytes) 000414 1789297783.337068 punch from 0x003cd8 to 0x009a1e (0x5d47 bytes) 000416 1789297783.341555 mapwrite 0x03df93 thru 0x03ffff (0x206d bytes) 000417 1789297783.401905 trunc from 0x040000 to 0x00e98c (0x31673 bytes) 000418 1789297783.426048 trunc from 0x00e98d to 0x03ec26 (0x3029a bytes) 000419 1789297783.442039 trunc from 0x03ec27 to 0x01f04c (0x1fbda bytes) 000421 1789297783.461003 read 0x014670 thru 0x01e593 (0x9f24 bytes) 000422 1789297783.470563 read 0x01d3ef thru 0x01f04c (0x1c5e bytes) 000423 1789297783.471302 read 0x013bf8 thru 0x01f04c (0xb455 bytes) 000424 1789297783.472222 trunc from 0x01f04d to 0x007d1f (0x1732d bytes) 000425 1789297783.493341 write 0x024fd0 thru 0x025245 (0x276 bytes) 000427 1789297783.494801 mapwrite 0x0007be thru 0x00c20c (0xba4f bytes) 000428 1789297783.607174 mapwrite 0x031d61 thru 0x03ffff (0xe29f bytes) 000431 1789297783.739650 read 0x012c73 thru 0x0228a3 (0xfc31 bytes) 000433 1789297783.741140 write 0x02d185 thru 0x0319c2 (0x483e bytes) 000434 1789297783.742603 trunc from 0x040000 to 0x028e14 (0x171eb bytes) 000435 1789297783.765808 punch from 0x0059be to 0x00dd5d (0x83a0 bytes) 000436 1789297783.770374 punch from 0x00e0e2 to 0x01221e (0x413d bytes) 000437 1789297783.774493 punch from 0x000248 to 0x007c3e (0x79f7 bytes) truncating to largest ever: 0x3feed 000438 1789297783.778801 trunc from 0x028e15 to 0x03feec (0x170d8 bytes) 000439 1789297783.793521 read 0x02f63e thru 0x032d36 (0x36f9 bytes) 000444 1789297783.805262 write 0x0374b6 thru 0x03f7e0 (0x832b bytes) 000447 1789297783.809282 read 0x01962a thru 0x02196b (0x8342 bytes) 000448 1789297783.813936 MIRROR_EXTEND to 2 mirrors 000449 1789297784.556715 trunc from 0x03feed to 0x00eb36 (0x313b6 bytes) 000450 1789297784.642147 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xeb37): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeb37): Mirror 2: 0x66c8780d (stale) CRC-32 checksum value for chunk [0, 0xeb37): Mirror 1: 0x66c8780d Mirror 3: 0x66c8780d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeb37: skipped 000451 1789297785.425505 punch from 0x000691 to 0x006c16 (0x6586 bytes) 000452 1789297785.497720 read 0x0013db thru 0x00ba9b (0xa6c1 bytes) 000453 1789297785.509960 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xeb37): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeb37): Mirror 2: 0x66c8780d (stale) Mirror 3: 0x66c8780d (stale) CRC-32 checksum value for chunk [0, 0xeb37): Mirror 1: 0x66c8780d Mirror 4: 0x66c8780d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeb37: skipped 000456 1789297786.235109 punch from 0x00727d to 0x008aa8 (0x182c bytes) 000458 1789297786.298740 read 0x006acc thru 0x00bb29 (0x505e bytes) 000459 1789297786.305201 mapwrite 0x014e19 thru 0x01c58b (0x7773 bytes) 000460 1789297786.388473 mapwrite 0x031add thru 0x03ffff (0xe523 bytes) 000461 1789297786.472207 mapwrite 0x001a9f thru 0x0088e3 (0x6e45 bytes) 000462 1789297786.598586 trunc from 0x040000 to 0x017608 (0x289f7 bytes) 000464 1789297786.622533 trunc from 0x017609 to 0x01bd74 (0x476c bytes) 000465 1789297786.649234 mapread 0x011c23 thru 0x01a8a1 (0x8c7f bytes) 000466 1789297786.655678 mapwrite 0x013485 thru 0x01fbbe (0xc73a bytes) 000467 1789297786.720232 read 0x00d4f4 thru 0x0139c6 (0x64d3 bytes) 000468 1789297786.721099 read 0x018141 thru 0x01d504 (0x53c4 bytes) 000469 1789297786.724406 mapread 0x00e616 thru 0x01bad5 (0xd4c0 bytes) 000470 1789297786.726773 punch from 0x00d0d6 to 0x0199cb (0xc8f6 bytes) 000471 1789297786.732625 mapread 0x000607 thru 0x0098ec (0x92e6 bytes) 000472 1789297786.742353 mapread 0x012ff6 thru 0x01fbbe (0xcbc9 bytes) 000473 1789297786.743734 mapwrite 0x018ec0 thru 0x020816 (0x7957 bytes) 000474 1789297786.817487 mapwrite 0x0163b8 thru 0x0165d1 (0x21a bytes) 000476 1789297786.858025 mapread 0x008457 thru 0x00c971 (0x451b bytes) 000478 1789297786.860255 punch from 0x014939 to 0x01ccc6 (0x838e bytes) 000479 1789297786.866093 mapwrite 0x03ea86 thru 0x03ffff (0x157a bytes) 000480 1789297786.938958 mapwrite 0x03ab58 thru 0x03ffff (0x54a8 bytes) 000482 1789297786.975601 mapread 0x003407 thru 0x005dda (0x29d4 bytes) 000483 1789297786.976899 punch from 0x02f9d7 to 0x030bcd (0x11f7 bytes) 000486 1789297786.985989 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x987d65f1 (stale) Mirror 4: 0x987d65f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x987d65f1 (stale) Mirror 4: 0x987d65f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000487 1789297787.283825 mapwrite 0x025bf4 thru 0x031f95 (0xc3a2 bytes) 000488 1789297787.405416 mapread 0x007500 thru 0x00a6b6 (0x31b7 bytes) 000489 1789297787.412474 read 0x00231c thru 0x00c0b4 (0x9d99 bytes) 000490 1789297787.412911 read 0x02ff78 thru 0x0357f0 (0x5879 bytes) 000491 1789297787.416994 MIRROR_RESYNC 3 mirrors 000492 1789297788.198296 trunc from 0x040000 to 0x03bd4a (0x42b5 bytes) 000494 1789297788.278654 trunc from 0x03bd4b to 0x0368ee (0x545c bytes) 000496 1789297788.301628 write 0x0223a5 thru 0x030b44 (0xe7a0 bytes) 000497 1789297788.317102 punch from 0x01b14c to 0x020f06 (0x5dbb bytes) 000499 1789297788.334683 mapread 0x01bbed thru 0x01ce48 (0x125c bytes) 000501 1789297788.348184 trunc from 0x0368ef to 0x01ec59 (0x17c95 bytes) 000503 1789297788.361973 write 0x01224b thru 0x0176f2 (0x54a8 bytes) 000504 1789297788.372165 write 0x021bab thru 0x02c643 (0xaa99 bytes) 000505 1789297788.378055 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c644): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c644): Mirror 3: 0x8417b84 (stale) Mirror 4: 0x8417b84 (stale) CRC-32 checksum value for chunk [0, 0x2c644): Mirror 1: 0xfa6b3193 Mirror 5: 0xfa6b3193 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c644: skipped 000506 1789297789.226594 trunc from 0x02c644 to 0x0372f7 (0xacb4 bytes) 000507 1789297789.305793 read 0x029030 thru 0x034594 (0xb565 bytes) 000508 1789297789.317102 punch from 0x022998 to 0x0320f8 (0xf761 bytes) 000509 1789297789.322139 write 0x021973 thru 0x0262e0 (0x496e bytes) 000511 1789297789.334063 mapwrite 0x013ddd thru 0x02072a (0xc94e bytes) 000513 1789297789.423151 punch from 0x01ae1e to 0x02a3d4 (0xf5b7 bytes) 000514 1789297789.428153 mapread 0x01d4ae thru 0x021c2f (0x4782 bytes) 000515 1789297789.437729 trunc from 0x0372f8 to 0x0195af (0x1dd48 bytes) 000516 1789297789.455138 write 0x01c80e thru 0x022bb2 (0x63a5 bytes) 000517 1789297789.456773 read 0x021f6a thru 0x022bb2 (0xc49 bytes) 000518 1789297789.457779 mapwrite 0x03188e thru 0x03d844 (0xbfb7 bytes) 000519 1789297789.532272 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d845): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d845): Mirror 3: 0x6f70f10d (stale) Mirror 4: 0x6f70f10d (stale) Mirror 5: 0x293de012 (stale) CRC-32 checksum value for chunk [0, 0x3d845): Mirror 1: 0x9bbe4e63 Mirror 6: 0x9bbe4e63 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d845: skipped 000521 1789297790.255730 mapread 0x000f18 thru 0x00436b (0x3454 bytes) 000522 1789297790.290658 trunc from 0x03d845 to 0x004d12 (0x38b32 bytes) 000523 1789297790.389439 write 0x02256a thru 0x02282a (0x2c1 bytes) 000525 1789297790.390818 punch from 0x00087d to 0x001433 (0xbb7 bytes) 000526 1789297790.399167 trunc from 0x02282b to 0x024702 (0x1ed8 bytes) 000527 1789297790.417319 trunc from 0x024703 to 0x01ab49 (0x9bb9 bytes) 000528 1789297790.436406 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ab4a): Mirror 3: 0x7f915df0 (stale) Mirror 4: 0x7f915df0 (stale) Mirror 6: 0x6064a32c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ab4a): Mirror 3: 0x7f915df0 (stale) Mirror 4: 0x7f915df0 (stale) Mirror 6: 0x6064a32c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ab4a: skipped 000529 1789297790.758044 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ab4a): Mirror 3: 0x7f915df0 (stale) Mirror 4: 0x7f915df0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ab4a): Mirror 3: 0x7f915df0 (stale) Mirror 4: 0x7f915df0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ab4a: skipped 000532 1789297791.079310 punch from 0x000f0d to 0x003c65 (0x2d59 bytes) 000534 1789297791.086418 mapwrite 0x01579c thru 0x024807 (0xf06c bytes) 000536 1789297791.221976 punch from 0x02192e to 0x0222f4 (0x9c7 bytes) 000538 1789297791.232660 mapread 0x01640d thru 0x01be44 (0x5a38 bytes) 000540 1789297791.235126 mapread 0x00a06a thru 0x00c439 (0x23d0 bytes) 000541 1789297791.252792 mapwrite 0x0151a1 thru 0x01e223 (0x9083 bytes) 000542 1789297791.308711 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24808): Mirror 4: 0x2d2a170 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24808): Mirror 4: 0x2d2a170 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24808: skipped 000543 1789297791.578061 mapwrite 0x0208ab thru 0x027a5b (0x71b1 bytes) 000544 1789297791.655798 punch from 0x021e6e to 0x0244d9 (0x266c bytes) 000545 1789297791.664413 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000548 1789297791.879726 punch from 0x00a551 to 0x017b0b (0xd5bb bytes) 000549 1789297791.890239 write 0x03b93c thru 0x03dc4a (0x230f bytes) 000550 1789297791.891473 write 0x004306 thru 0x00d486 (0x9181 bytes) 000551 1789297791.926955 mapwrite 0x00d52e thru 0x01a057 (0xcb2a bytes) 000555 1789297792.042274 punch from 0x01ae54 to 0x023a4c (0x8bf9 bytes) 000557 1789297792.056325 MIRROR_EXTEND to 2 mirrors 000559 1789297792.974088 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000561 1789297793.110928 mapwrite 0x03f868 thru 0x03ffff (0x798 bytes) 000562 1789297793.175127 write 0x0053b6 thru 0x014fa8 (0xfbf3 bytes) 000564 1789297793.186390 write 0x02c7ea thru 0x02e774 (0x1f8b bytes) 000565 1789297793.202726 trunc from 0x040000 to 0x021616 (0x1e9e9 bytes) 000566 1789297793.218506 mapwrite 0x001d62 thru 0x00af4f (0x91ee bytes) 000568 1789297793.293275 MIRROR_EXTEND to 2 mirrors 000569 1789297793.820775 read 0x012e48 thru 0x01e8fd (0xbab6 bytes) 000570 1789297793.831126 write 0x034319 thru 0x034f7c (0xc64 bytes) 000572 1789297793.887861 mapread 0x00958b thru 0x00e1d6 (0x4c4c bytes) 000573 1789297793.907292 mapwrite 0x00cecf thru 0x0120aa (0x51dc bytes) 000574 1789297793.947122 write 0x021475 thru 0x02bd20 (0xa8ac bytes) 000576 1789297793.970468 write 0x01fd85 thru 0x023335 (0x35b1 bytes) 000578 1789297793.978220 punch from 0x01cd82 to 0x02ca46 (0xfcc5 bytes) 000580 1789297793.996884 mapwrite 0x004fff thru 0x005486 (0x488 bytes) 000581 1789297794.037108 read 0x02d86c thru 0x03380b (0x5fa0 bytes) 000586 1789297794.093300 punch from 0x02f6c6 to 0x034f7c (0x58b7 bytes) 000587 1789297794.099904 mapwrite 0x01d93f thru 0x0262c5 (0x8987 bytes) 000590 1789297794.144012 mapwrite 0x024fbb thru 0x032f11 (0xdf57 bytes) 000592 1789297794.205105 trunc from 0x034f7d to 0x004fb9 (0x2ffc3 bytes) 000593 1789297794.244973 trunc from 0x004fba to 0x01c102 (0x17149 bytes) 000594 1789297794.260584 read 0x00ade6 thru 0x01246a (0x7685 bytes) 000595 1789297794.277605 write 0x006b58 thru 0x014f22 (0xe3cb bytes) 000596 1789297794.278901 mapwrite 0x02c9f5 thru 0x036a22 (0xa02e bytes) 000597 1789297794.345358 read 0x00cf62 thru 0x00f301 (0x23a0 bytes) 000598 1789297794.346323 write 0x03e696 thru 0x03ffff (0x196a bytes) 000599 1789297794.347775 punch from 0x0291b3 to 0x02ee8c (0x5cda bytes) 000601 1789297794.356240 trunc from 0x040000 to 0x022731 (0x1d8ce bytes) 000603 1789297794.373998 write 0x024cf3 thru 0x029e24 (0x5132 bytes) 000604 1789297794.375108 mapwrite 0x00af2b thru 0x00bb09 (0xbdf bytes) 000605 1789297794.423442 trunc from 0x029e25 to 0x024c6d (0x51b7 bytes) 000606 1789297794.442111 read 0x02301d thru 0x024c6d (0x1c51 bytes) 000607 1789297794.447490 mapwrite 0x03ed21 thru 0x03ffff (0x12df bytes) 000608 1789297794.534772 MIRROR_RESYNC 2 mirrors 000610 1789297795.298189 mapread 0x01cbe5 thru 0x01ec76 (0x2092 bytes) 000611 1789297795.317280 mapread 0x01c1b6 thru 0x02521a (0x9065 bytes) 000614 1789297795.318916 mapread 0x029f93 thru 0x034c11 (0xac7f bytes) 000615 1789297795.348987 MIRROR_RESYNC 2 mirrors 000617 1789297795.736807 trunc from 0x040000 to 0x01459d (0x2ba62 bytes) 000618 1789297795.819724 mapread 0x00da7e thru 0x011f24 (0x44a7 bytes) 000619 1789297795.846028 mapread 0x0071d0 thru 0x00e54f (0x7380 bytes) 000620 1789297795.862269 write 0x00f747 thru 0x0162b7 (0x6b71 bytes) 000621 1789297795.864706 write 0x02402c thru 0x031e7a (0xde4f bytes) 000622 1789297795.867941 mapwrite 0x01a589 thru 0x0275d2 (0xd04a bytes) 000623 1789297795.954304 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000625 1789297796.123313 write 0x02510b thru 0x03441f (0xf315 bytes) 000628 1789297796.131866 write 0x01ea07 thru 0x0201d3 (0x17cd bytes) 000630 1789297796.149387 read 0x002f26 thru 0x00d306 (0xa3e1 bytes) 000631 1789297796.160123 mapwrite 0x0101b9 thru 0x01709a (0x6ee2 bytes) 000633 1789297796.254331 read 0x015cda thru 0x016878 (0xb9f bytes) 000636 1789297796.264454 MIRROR_EXTEND to 2 mirrors 000639 1789297796.817466 MIRROR_EXTEND to 3 mirrors 000640 1789297797.414638 mapwrite 0x019469 thru 0x02070b (0x72a3 bytes) 000641 1789297797.582886 punch from 0x0178c1 to 0x01ed12 (0x7452 bytes) 000642 1789297797.589560 read 0x0310df thru 0x03441f (0x3341 bytes) 000643 1789297797.597775 mapwrite 0x02541d thru 0x0312ed (0xbed1 bytes) 000644 1789297797.656492 write 0x02161f thru 0x02e173 (0xcb55 bytes) 000646 1789297797.658250 read 0x00a552 thru 0x018d0c (0xe7bb bytes) 000647 1789297797.668508 write 0x01dc79 thru 0x0266df (0x8a67 bytes) 000648 1789297797.669934 write 0x021b92 thru 0x0268cb (0x4d3a bytes) 000649 1789297797.675240 MIRROR_RESYNC 3 mirrors 000650 1789297798.378046 read 0x0215eb thru 0x02e167 (0xcb7d bytes) 000651 1789297798.392631 MIRROR_RESYNC 3 mirrors 000652 1789297798.732574 trunc from 0x034420 to 0x01c5c3 (0x17e5c bytes) 000655 1789297798.800716 mapread 0x005fbb thru 0x011a4e (0xba94 bytes) 000656 1789297798.828378 mapread 0x0185d6 thru 0x01c5c3 (0x3fee bytes) 000657 1789297798.834301 read 0x008b79 thru 0x00f2ea (0x6772 bytes) 000658 1789297798.835178 mapread 0x0099bb thru 0x010e80 (0x74c6 bytes) 000659 1789297798.841215 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1c5c4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c5c4): Mirror 2: 0x262cb35d (stale) Mirror 3: 0x262cb35d (stale) CRC-32 checksum value for chunk [0, 0x1c5c4): Mirror 1: 0x262cb35d Mirror 4: 0x262cb35d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c5c4: skipped 000660 1789297799.551633 trunc from 0x01c5c4 to 0x00dde3 (0xe7e0 bytes) 000661 1789297799.645192 mapwrite 0x017a31 thru 0x01d876 (0x5e46 bytes) 000662 1789297799.727683 mapwrite 0x00fcfa thru 0x013569 (0x3870 bytes) 000663 1789297799.774822 read 0x01c5b2 thru 0x01d876 (0x12c5 bytes) 000664 1789297799.775650 mapwrite 0x0353ef thru 0x0355e0 (0x1f2 bytes) 000665 1789297799.850338 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x355e1): Mirror 3: 0x8e72cae6 (stale) Mirror 4: 0x166a67ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355e1): Mirror 3: 0x8e72cae6 (stale) Mirror 4: 0x166a67ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355e1: skipped 000667 1789297800.146501 punch from 0x0268ea to 0x029d70 (0x3487 bytes) 000668 1789297800.152128 write 0x0079eb thru 0x00a5bd (0x2bd3 bytes) 000670 1789297800.162778 write 0x01b777 thru 0x01f442 (0x3ccc bytes) 000671 1789297800.176712 mapread 0x02f760 thru 0x0355e0 (0x5e81 bytes) 000672 1789297800.200656 mapread 0x014e3d thru 0x020e88 (0xc04c bytes) 000673 1789297800.217175 mapwrite 0x01dd33 thru 0x02b4be (0xd78c bytes) 000674 1789297800.267182 punch from 0x034c5e to 0x0355e0 (0x983 bytes) 000675 1789297800.272106 read 0x00dee6 thru 0x018f4f (0xb06a bytes) 000676 1789297800.272938 mapread 0x00cf78 thru 0x012d1d (0x5da6 bytes) 000677 1789297800.281697 read 0x021665 thru 0x024bdf (0x357b bytes) 000678 1789297800.282483 mapwrite 0x024cfc thru 0x026119 (0x141e bytes) 000681 1789297800.329214 MIRROR_RESYNC 3 mirrors 000682 1789297800.951418 mapwrite 0x02efbf thru 0x03219e (0x31e0 bytes) 000684 1789297801.115694 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x355e1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355e1): Mirror 3: 0xc7693e9e (stale) Mirror 4: 0xc7693e9e (stale) CRC-32 checksum value for chunk [0, 0x355e1): Mirror 1: 0x9cccc991 Mirror 5: 0x9cccc991 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355e1: skipped 000685 1789297801.992595 mapwrite 0x03040d thru 0x03fc15 (0xf809 bytes) 000686 1789297802.185662 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fc16): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc16): Mirror 3: 0x823bdf9a (stale) Mirror 4: 0x823bdf9a (stale) Mirror 5: 0x1d4120e2 (stale) CRC-32 checksum value for chunk [0, 0x3fc16): Mirror 1: 0x8a601d97 Mirror 6: 0x8a601d97 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc16: skipped 000687 1789297803.124562 MIRROR_RESYNC 5 mirrors 000688 1789297803.962596 punch from 0x000789 to 0x00abe0 (0xa458 bytes) 000689 1789297804.058781 MIRROR_RESYNC 5 mirrors 000690 1789297804.901507 mapwrite 0x02e4cd thru 0x03aeb2 (0xc9e6 bytes) 000691 1789297805.062312 write 0x01ecb5 thru 0x027cfc (0x9048 bytes) 000692 1789297805.069772 punch from 0x02af1d to 0x03080a (0x58ee bytes) 000693 1789297805.079611 trunc from 0x03fc16 to 0x020297 (0x1f97e bytes) 000695 1789297805.101407 write 0x02305d thru 0x02f6c9 (0xc66d bytes) 000697 1789297805.105824 write 0x0351cb thru 0x03f63c (0xa472 bytes) 000698 1789297805.107273 mapread 0x01358e thru 0x0194a5 (0x5f18 bytes) 000699 1789297805.121783 mapread 0x02e2b3 thru 0x0327ac (0x44fa bytes) 000700 1789297805.144129 punch from 0x0141bd to 0x014439 (0x27d bytes) 000702 1789297805.170696 trunc from 0x03f63d to 0x01d447 (0x221f5 bytes) 000703 1789297805.189687 write 0x01a4d2 thru 0x01fcf2 (0x5821 bytes) 000704 1789297805.191745 read 0x0110a5 thru 0x0155f3 (0x454f bytes) 000705 1789297805.198704 mapread 0x007383 thru 0x015620 (0xe29e bytes) 000708 1789297805.209652 read 0x019ab3 thru 0x01f24b (0x5799 bytes) 000713 1789297805.213525 read 0x013a9f thru 0x016061 (0x25c3 bytes) 000715 1789297805.215415 mapread 0x013d40 thru 0x01b201 (0x74c2 bytes) 000716 1789297805.216777 write 0x01db26 thru 0x02c376 (0xe851 bytes) 000718 1789297805.219081 read 0x00905d thru 0x014b92 (0xbb36 bytes) 000719 1789297805.219775 mapwrite 0x034ce2 thru 0x0388d0 (0x3bef bytes) 000720 1789297805.288562 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x388d1): Mirror 4: 0xabef3127 (stale) Mirror 5: 0xabef3127 (stale) Mirror 6: 0xabef3127 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x388d1): Mirror 4: 0xabef3127 (stale) Mirror 5: 0xabef3127 (stale) Mirror 6: 0xabef3127 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x388d1: skipped 000721 1789297805.721000 punch from 0x0057ce to 0x0134c0 (0xdcf3 bytes) 000722 1789297805.725760 write 0x034738 thru 0x03dc03 (0x94cc bytes) 000723 1789297805.734793 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3dc04): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc04): Mirror 4: 0x2aa58c88 (stale) Mirror 5: 0x2aa58c88 (stale) Mirror 6: 0x2aa58c88 (stale) CRC-32 checksum value for chunk [0, 0x3dc04): Mirror 1: 0xc5d14960 Mirror 7: 0xc5d14960 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc04: skipped 000724 1789297806.849551 read 0x0129d2 thru 0x017459 (0x4a88 bytes) 000725 1789297806.866046 write 0x01336d thru 0x022dca (0xfa5e bytes) 000727 1789297806.945382 trunc from 0x03dc04 to 0x030a3a (0xd1c9 bytes) 000730 1789297806.969159 mapwrite 0x0384ca thru 0x038630 (0x167 bytes) 000731 1789297807.036899 mapread 0x02c141 thru 0x02d2a9 (0x1169 bytes) 000732 1789297807.049158 punch from 0x004065 to 0x005d8c (0x1d28 bytes) 000733 1789297807.053756 mapread 0x0088c2 thru 0x010607 (0x7d46 bytes) 000736 1789297807.068999 MIRROR_RESYNC 5 mirrors 000737 1789297808.156982 MIRROR_EXTEND to 6 mirrors 000738 1789297808.760787 write 0x015051 thru 0x021c74 (0xcc24 bytes) 000739 1789297808.823303 mapwrite 0x015173 thru 0x017c0c (0x2a9a bytes) 000740 1789297808.873735 punch from 0x0036fe to 0x00a6ef (0x6ff2 bytes) 000743 1789297808.884832 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x38631): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38631): Mirror 4: 0x31ca65f2 (stale) Mirror 5: 0x31ca65f2 (stale) Mirror 6: 0x31ca65f2 (stale) Mirror 7: 0x31ca65f2 (stale) Mirror 8: 0x31ca65f2 (stale) CRC-32 checksum value for chunk [0, 0x38631): Mirror 1: 0xcc0feae0 Mirror 9: 0xcc0feae0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38631: skipped 000745 1789297809.862261 mapwrite 0x031765 thru 0x0350b7 (0x3953 bytes) 000747 1789297810.053015 write 0x028796 thru 0x02feaa (0x7715 bytes) 000750 1789297810.082972 MIRROR_RESYNC 7 mirrors 000751 1789297812.260667 mapread 0x000ddb thru 0x00c31d (0xb543 bytes) 000753 1789297812.314226 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) 000754 1789297812.634627 mapread 0x00997f thru 0x00d0ac (0x372e bytes) 000755 1789297812.662054 read 0x00669f thru 0x0111b3 (0xab15 bytes) 000756 1789297812.662762 write 0x001a13 thru 0x00b57c (0x9b6a bytes) 000757 1789297812.759720 mapread 0x009a53 thru 0x00a268 (0x816 bytes) 000758 1789297812.761115 mapwrite 0x02c9e7 thru 0x0308e3 (0x3efd bytes) 000759 1789297812.827428 mapread 0x0357dd thru 0x038630 (0x2e54 bytes) 000761 1789297812.836723 punch from 0x00864f to 0x008814 (0x1c6 bytes) 000762 1789297812.845079 write 0x03ab8d thru 0x03ffff (0x5473 bytes) 000763 1789297812.846819 punch from 0x01f820 to 0x024348 (0x4b29 bytes) 000765 1789297812.868060 trunc from 0x040000 to 0x02ed36 (0x112c9 bytes) 000766 1789297812.893616 trunc from 0x02ed37 to 0x021a2e (0xd308 bytes) 000767 1789297812.916084 write 0x03da7b thru 0x03e243 (0x7c9 bytes) 000768 1789297812.921798 MIRROR_RESYNC 6 mirrors 000769 1789297814.254410 read 0x033f5e thru 0x0348f9 (0x99c bytes) 000772 1789297814.263422 read 0x00e163 thru 0x010515 (0x23b3 bytes) 000773 1789297814.284951 mapwrite 0x01f492 thru 0x01f577 (0xe6 bytes) 000775 1789297814.511531 punch from 0x0204f8 to 0x02768c (0x7195 bytes) 000776 1789297814.522154 mapread 0x0268ad thru 0x034e8a (0xe5de bytes) 000777 1789297814.680966 punch from 0x01bc4f to 0x026374 (0xa726 bytes) 000778 1789297814.688313 trunc from 0x03e244 to 0x034a90 (0x97b3 bytes) 000781 1789297814.729733 write 0x03922c thru 0x03eb46 (0x591b bytes) 000782 1789297814.735607 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3eb47): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb47): Mirror 5: 0x85a233c6 (stale) Mirror 6: 0x85a233c6 (stale) Mirror 7: 0x85a233c6 (stale) Mirror 8: 0x85a233c6 (stale) Mirror 9: 0x85a233c6 (stale) CRC-32 checksum value for chunk [0, 0x3eb47): Mirror 1: 0x1d539868 Mirror 10: 0x1d539868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb47: skipped 000783 1789297815.978271 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3eb47): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb47): Mirror 5: 0x85a233c6 (stale) Mirror 6: 0x85a233c6 (stale) Mirror 7: 0x85a233c6 (stale) Mirror 8: 0x85a233c6 (stale) Mirror 9: 0x85a233c6 (stale) CRC-32 checksum value for chunk [0, 0x3eb47): Mirror 1: 0x1d539868 Mirror 10: 0x1d539868 Mirror 11: 0x1d539868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb47: skipped 000784 1789297816.996053 trunc from 0x03eb47 to 0x02871d (0x16429 bytes) 000785 1789297817.078637 punch from 0x0235a7 to 0x02871d (0x5177 bytes) 000786 1789297817.088816 MIRROR_RESYNC 8 mirrors 000787 1789297818.750221 MIRROR_EXTEND to 9 mirrors 000790 1789297819.326603 write 0x019606 thru 0x01e663 (0x505e bytes) 000791 1789297819.384124 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2871e): Mirror 6: 0x67823649 (stale) Mirror 7: 0x67823649 (stale) Mirror 8: 0x67823649 (stale) Mirror 9: 0x67823649 (stale) Mirror 10: 0x67823649 (stale) Mirror 11: 0x67823649 (stale) Mirror 12: 0x67823649 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2871e): Mirror 6: 0x67823649 (stale) Mirror 7: 0x67823649 (stale) Mirror 8: 0x67823649 (stale) Mirror 9: 0x67823649 (stale) Mirror 10: 0x67823649 (stale) Mirror 11: 0x67823649 (stale) Mirror 12: 0x67823649 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2871e: skipped 000792 1789297819.808783 mapwrite 0x02992e thru 0x02be8c (0x255f bytes) 000793 1789297819.929488 punch from 0x004325 to 0x007e78 (0x3b54 bytes) 000795 1789297819.944506 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2be8d): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2be8d): Mirror 6: 0x317285ae (stale) Mirror 7: 0x317285ae (stale) Mirror 8: 0x317285ae (stale) Mirror 9: 0x317285ae (stale) Mirror 10: 0x317285ae (stale) Mirror 11: 0x317285ae (stale) Mirror 12: 0x317285ae (stale) CRC-32 checksum value for chunk [0, 0x2be8d): Mirror 1: 0x1d79172d Mirror 13: 0x1d79172d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2be8d: skipped 000796 1789297820.894436 trunc from 0x02be8d to 0x01ff2c (0xbf60 bytes) 000799 1789297821.006091 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ff2d): Mirror 6: 0x818b448a (stale) Mirror 7: 0x818b448a (stale) Mirror 8: 0x818b448a (stale) Mirror 10: 0x818b448a (stale) Mirror 11: 0x818b448a (stale) Mirror 12: 0x818b448a (stale) Mirror 13: 0x9675523e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ff2d): Mirror 6: 0x818b448a (stale) Mirror 7: 0x818b448a (stale) Mirror 8: 0x818b448a (stale) Mirror 10: 0x818b448a (stale) Mirror 11: 0x818b448a (stale) Mirror 12: 0x818b448a (stale) Mirror 13: 0x9675523e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ff2d: skipped 000801 1789297821.392799 mapwrite 0x03a995 thru 0x03d3b0 (0x2a1c bytes) 000803 1789297821.469807 MIRROR_RESYNC 8 mirrors 000804 1789297823.156411 punch from 0x00210b to 0x0100d1 (0xdfc7 bytes) 000805 1789297823.251138 write 0x0182da thru 0x0270c0 (0xede7 bytes) 000806 1789297823.266371 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3b1): Mirror 6: 0x576155b1 (stale) Mirror 7: 0x576155b1 (stale) Mirror 10: 0x576155b1 (stale) Mirror 11: 0x576155b1 (stale) Mirror 12: 0x576155b1 (stale) Mirror 13: 0x576155b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3b1): Mirror 6: 0x576155b1 (stale) Mirror 7: 0x576155b1 (stale) Mirror 10: 0x576155b1 (stale) Mirror 11: 0x576155b1 (stale) Mirror 12: 0x576155b1 (stale) Mirror 13: 0x576155b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3b1: skipped 000809 1789297824.042796 mapread 0x023f19 thru 0x02ab1f (0x6c07 bytes) 000810 1789297824.074874 write 0x02e614 thru 0x0314cb (0x2eb8 bytes) 000813 1789297824.091013 write 0x00ba12 thru 0x0198ae (0xde9d bytes) 000817 1789297824.109176 mapread 0x0112d8 thru 0x02060c (0xf335 bytes) 000818 1789297824.119385 write 0x015a75 thru 0x01fe82 (0xa40e bytes) 000820 1789297824.123713 trunc from 0x03d3b1 to 0x007f4f (0x35461 bytes) 000821 1789297824.149497 read 0x004a27 thru 0x004f67 (0x541 bytes) 000822 1789297824.160953 mapread 0x006b28 thru 0x007f4f (0x1428 bytes) 000824 1789297824.181816 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7f50): Mirror 7: 0xeda5dbb5 (stale) Mirror 10: 0xeda5dbb5 (stale) Mirror 11: 0xeda5dbb5 (stale) Mirror 12: 0xeda5dbb5 (stale) Mirror 13: 0xeda5dbb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7f50): Mirror 7: 0xeda5dbb5 (stale) Mirror 10: 0xeda5dbb5 (stale) Mirror 11: 0xeda5dbb5 (stale) Mirror 12: 0xeda5dbb5 (stale) Mirror 13: 0xeda5dbb5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7f50: skipped 000826 1789297824.718398 mapwrite 0x02e92c thru 0x02eec6 (0x59b bytes) 000829 1789297824.884642 MIRROR_RESYNC 6 mirrors 000830 1789297826.641480 read 0x01a721 thru 0x0288a4 (0xe184 bytes) 000832 1789297826.654069 punch from 0x023911 to 0x02eec6 (0xb5b6 bytes) 000833 1789297826.724194 mapwrite 0x01d650 thru 0x025c1d (0x85ce bytes) 000834 1789297826.793149 punch from 0x017adb to 0x0231dc (0xb702 bytes) 000835 1789297826.797090 mapwrite 0x033388 thru 0x0384a6 (0x511f bytes) 000836 1789297826.922619 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x384a7): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x384a7): Mirror 7: 0x51aeaa74 (stale) Mirror 10: 0x51aeaa74 (stale) Mirror 11: 0x51aeaa74 (stale) Mirror 12: 0x51aeaa74 (stale) Mirror 13: 0x51aeaa74 (stale) CRC-32 checksum value for chunk [0, 0x384a7): Mirror 1: 0xf34f05bf Mirror 14: 0xf34f05bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x384a7: skipped 000837 1789297828.186453 write 0x006324 thru 0x00f5b3 (0x9290 bytes) 000838 1789297828.332556 trunc from 0x0384a7 to 0x01bb71 (0x1c935 bytes) 000839 1789297828.361831 read 0x01b8e8 thru 0x01bb71 (0x28a bytes) 000840 1789297828.371199 punch from 0x00bebc to 0x00f532 (0x3677 bytes) 000841 1789297828.390879 write 0x038de7 thru 0x03ffff (0x7219 bytes) 000843 1789297828.393408 mapwrite 0x00c128 thru 0x00d0f2 (0xfcb bytes) 000844 1789297828.471402 mapwrite 0x039b73 thru 0x03c1d5 (0x2663 bytes) 000845 1789297828.504729 mapwrite 0x03f99b thru 0x03ffff (0x665 bytes) 000846 1789297828.540195 punch from 0x03fa28 to 0x03ffff (0x5d8 bytes) 000847 1789297828.550351 write 0x00ca23 thru 0x011608 (0x4be6 bytes) 000849 1789297828.573060 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d207438 (stale) Mirror 10: 0x8d207438 (stale) Mirror 11: 0x8d207438 (stale) Mirror 12: 0x8d207438 (stale) Mirror 13: 0x8d207438 (stale) Mirror 14: 0x1eaac3e0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x301d07dc Mirror 15: 0x301d07dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000850 1789297829.930785 trunc from 0x040000 to 0x03da95 (0x256a bytes) 000852 1789297830.035041 read 0x022425 thru 0x02fe40 (0xda1c bytes) 000853 1789297830.052169 read 0x0395be thru 0x03da95 (0x44d8 bytes) 000854 1789297830.063370 mapread 0x0312b8 thru 0x039ef0 (0x8c39 bytes) 000856 1789297830.065379 mapwrite 0x01ca25 thru 0x02b5c3 (0xeb9f bytes) 000858 1789297830.128088 read 0x02d761 thru 0x030f65 (0x3805 bytes) 000859 1789297830.129823 trunc from 0x03da96 to 0x01c302 (0x21793 bytes) 000860 1789297830.158306 write 0x0326f1 thru 0x03c371 (0x9c81 bytes) 000861 1789297830.161025 write 0x02f4ee thru 0x03130d (0x1e20 bytes) 000863 1789297830.172116 trunc from 0x03c372 to 0x01fb07 (0x1c86a bytes) 000864 1789297830.193297 write 0x03139c thru 0x033d35 (0x299a bytes) 000865 1789297830.194380 trunc from 0x033d36 to 0x03367b (0x6ba bytes) 000866 1789297830.216305 trunc from 0x03367c to 0x0213f6 (0x12285 bytes) 000867 1789297830.233331 mapwrite 0x03b974 thru 0x03ffff (0x468c bytes) 000869 1789297830.297027 mapwrite 0x01efbb thru 0x02268d (0x36d3 bytes) 000870 1789297830.375954 write 0x0035c9 thru 0x00be68 (0x88a0 bytes) 000872 1789297830.377460 mapwrite 0x0369cb thru 0x03b7d7 (0x4e0d bytes) 000873 1789297830.527317 punch from 0x02e917 to 0x03b428 (0xcb12 bytes) 000874 1789297830.537396 mapwrite 0x02f6b2 thru 0x037f33 (0x8882 bytes) 000875 1789297830.682616 write 0x013596 thru 0x01363b (0xa6 bytes) 000876 1789297830.685027 punch from 0x02a2e1 to 0x035993 (0xb6b3 bytes) 000877 1789297830.697323 punch from 0x029560 to 0x035e4e (0xc8ef bytes) 000879 1789297830.711167 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d207438 (stale) Mirror 11: 0x8d207438 (stale) Mirror 12: 0x8d207438 (stale) Mirror 13: 0x8d207438 (stale) Mirror 14: 0x1eaac3e0 (stale) Mirror 15: 0x301d07dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d207438 (stale) Mirror 11: 0x8d207438 (stale) Mirror 12: 0x8d207438 (stale) Mirror 13: 0x8d207438 (stale) Mirror 14: 0x1eaac3e0 (stale) Mirror 15: 0x301d07dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000880 1789297831.220913 mapread 0x03b753 thru 0x03ffff (0x48ad bytes) 000881 1789297831.241875 write 0x03de98 thru 0x03ffff (0x2168 bytes) 000882 1789297831.242824 mapread 0x0027ba thru 0x003ecf (0x1716 bytes) 000884 1789297831.252633 mapwrite 0x036342 thru 0x03ffff (0x9cbe bytes) 000886 1789297831.301759 mapread 0x02ffdd thru 0x03442e (0x4452 bytes) 000887 1789297831.328724 mapread 0x0038ec thru 0x010a84 (0xd199 bytes) 000888 1789297831.329760 read 0x023525 thru 0x0303c3 (0xce9f bytes) 000889 1789297831.349996 punch from 0x03b1c1 to 0x03ffff (0x4e3f bytes) 000890 1789297831.363217 write 0x03a868 thru 0x03ffff (0x5798 bytes) 000892 1789297831.371096 mapwrite 0x025f34 thru 0x0314c1 (0xb58e bytes) 000893 1789297831.483228 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d207438 (stale) Mirror 11: 0x8d207438 (stale) Mirror 12: 0x8d207438 (stale) Mirror 14: 0x1eaac3e0 (stale) Mirror 15: 0x301d07dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d207438 (stale) Mirror 11: 0x8d207438 (stale) Mirror 12: 0x8d207438 (stale) Mirror 14: 0x1eaac3e0 (stale) Mirror 15: 0x301d07dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000894 1789297831.940421 read 0x036cdf thru 0x03eee5 (0x8207 bytes) 000895 1789297831.950818 punch from 0x00a4ea to 0x013a88 (0x959f bytes) 000896 1789297831.956633 trunc from 0x040000 to 0x002e3e (0x3d1c1 bytes) 000897 1789297832.002425 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e3f): Mirror 7: 0x4255a90c (stale) Mirror 11: 0x4255a90c (stale) Mirror 14: 0x4255a90c (stale) Mirror 15: 0x4255a90c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e3f): Mirror 7: 0x4255a90c (stale) Mirror 11: 0x4255a90c (stale) Mirror 14: 0x4255a90c (stale) Mirror 15: 0x4255a90c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e3f: skipped 000898 1789297832.399009 trunc from 0x002e3f to 0x0146cc (0x1188e bytes) 000900 1789297832.413598 mapwrite 0x010355 thru 0x016fa7 (0x6c53 bytes) 000901 1789297832.495573 MIRROR_RESYNC 5 mirrors 000902 1789297833.946145 read 0x0050a7 thru 0x00efcd (0x9f27 bytes) 000905 1789297833.954944 write 0x020c18 thru 0x02e079 (0xd462 bytes) 000907 1789297833.997984 read 0x016294 thru 0x0184fc (0x2269 bytes) 000908 1789297834.004355 punch from 0x0076f5 to 0x0133f5 (0xbd01 bytes) 000909 1789297834.014073 trunc from 0x02e07a to 0x0354b1 (0x7438 bytes) 000914 1789297834.041904 mapread 0x010258 thru 0x019cb6 (0x9a5f bytes) 000915 1789297834.063659 mapread 0x00ccf8 thru 0x012021 (0x532a bytes) 000917 1789297834.082553 read 0x000dfa thru 0x005d3b (0x4f42 bytes) 000918 1789297834.087984 MIRROR_RESYNC 5 mirrors 000919 1789297835.561723 mapread 0x012c3e thru 0x01aedf (0x82a2 bytes) 000921 1789297835.585275 read 0x0224b6 thru 0x028529 (0x6074 bytes) 000924 1789297835.594422 read 0x024c14 thru 0x029152 (0x453f bytes) 000928 1789297835.609700 write 0x020de5 thru 0x02a0c2 (0x92de bytes) 000930 1789297835.662059 mapwrite 0x03815f thru 0x03ffff (0x7ea1 bytes) 000931 1789297835.803338 read 0x00fcd9 thru 0x016c8a (0x6fb2 bytes) 000933 1789297835.821378 read 0x03d8f2 thru 0x03ffff (0x270e bytes) 000934 1789297835.822008 punch from 0x0360d4 to 0x03e733 (0x8660 bytes) 000935 1789297835.825872 mapread 0x011e2e thru 0x016d1b (0x4eee bytes) 000937 1789297835.827100 mapread 0x02711b thru 0x02bb4a (0x4a30 bytes) 000938 1789297835.827976 punch from 0x0357f7 to 0x03ffff (0xa809 bytes) 000939 1789297835.835890 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8b5cebdc (stale) Mirror 11: 0x8b5cebdc (stale) Mirror 14: 0x8b5cebdc (stale) Mirror 15: 0x8b5cebdc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xee2b5dbf Mirror 16: 0xee2b5dbf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000940 1789297837.052183 punch from 0x035409 to 0x03ffff (0xabf7 bytes) 000942 1789297837.117791 mapread 0x01c13f thru 0x025f08 (0x9dca bytes) 000943 1789297837.137722 write 0x029c1f thru 0x039ad6 (0xfeb8 bytes) 000945 1789297837.150659 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8b5cebdc (stale) Mirror 11: 0x8b5cebdc (stale) Mirror 14: 0x8b5cebdc (stale) Mirror 16: 0xee2b5dbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8b5cebdc (stale) Mirror 11: 0x8b5cebdc (stale) Mirror 14: 0x8b5cebdc (stale) Mirror 16: 0xee2b5dbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000947 1789297837.560257 mapread 0x02b2d0 thru 0x02c9f4 (0x1725 bytes) 000948 1789297837.572494 punch from 0x032dc3 to 0x03e544 (0xb782 bytes) 000949 1789297837.580149 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x8b5cebdc (stale) Mirror 14: 0x8b5cebdc (stale) Mirror 16: 0xee2b5dbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x8b5cebdc (stale) Mirror 14: 0x8b5cebdc (stale) Mirror 16: 0xee2b5dbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000950 1789297837.945722 read 0x015802 thru 0x01a2c2 (0x4ac1 bytes) 000951 1789297837.956636 mapread 0x001a48 thru 0x0030bc (0x1675 bytes) 000952 1789297837.971996 mapread 0x0172ff thru 0x01959e (0x22a0 bytes) 000953 1789297837.972999 read 0x0318f1 thru 0x037857 (0x5f67 bytes) 000955 1789297837.982653 trunc from 0x040000 to 0x00317e (0x3ce81 bytes) 000957 1789297837.999673 write 0x01c7aa thru 0x028f01 (0xc758 bytes) 000958 1789297838.008235 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28f02): Mirror 11: 0x8278631e (stale) Mirror 16: 0x8b55a17e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28f02): Mirror 11: 0x8278631e (stale) Mirror 16: 0x8b55a17e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28f02: skipped 000959 1789297838.303207 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x28f02): Mirror 11: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28f02): Mirror 11: 0x8278631e (stale) Mirror 16: 0x8b55a17e (stale) CRC-32 checksum value for chunk [0, 0x28f02): Mirror 1: 0xdb971e29 Mirror 17: 0xdb971e29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28f02: skipped 000960 1789297839.379460 mapread 0x0252fa thru 0x028f01 (0x3c08 bytes) 000961 1789297839.460240 mapwrite 0x021064 thru 0x024842 (0x37df bytes) 000962 1789297839.675646 read 0x00a596 thru 0x0151e7 (0xac52 bytes) 000964 1789297839.707623 punch from 0x01618d to 0x024e22 (0xec96 bytes) 000966 1789297839.713364 write 0x002261 thru 0x00529a (0x303a bytes) 000967 1789297839.734887 mapread 0x018a91 thru 0x021050 (0x85c0 bytes) 000968 1789297839.763437 MIRROR_RESYNC 4 mirrors 000971 1789297840.831190 write 0x025135 thru 0x02bb1d (0x69e9 bytes) 000972 1789297840.891124 trunc from 0x02bb1e to 0x00ac7d (0x20ea0 bytes) 000974 1789297840.912095 trunc from 0x00ac7e to 0x0140ac (0x942f bytes) 000975 1789297840.933562 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x140ad): Mirror 11: 0x9158a2da (stale) Mirror 17: 0x9158a2da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x140ad): Mirror 11: 0x9158a2da (stale) Mirror 17: 0x9158a2da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x140ad: skipped 000976 1789297841.202493 trunc from 0x0140ad to 0x031c4c (0x1dba0 bytes) 000979 1789297841.231568 punch from 0x01d737 to 0x02a32d (0xcbf7 bytes) 000980 1789297841.239357 trunc from 0x031c4d to 0x02492f (0xd31d bytes) 000983 1789297841.274093 MIRROR_RESYNC 3 mirrors 000984 1789297842.367777 read 0x00f983 thru 0x01208f (0x270d bytes) 000985 1789297842.383820 MIRROR_RESYNC 3 mirrors 000987 1789297842.726414 trunc from 0x024930 to 0x00d106 (0x17829 bytes) 000989 1789297842.857203 read 0x002d83 thru 0x00d106 (0xa384 bytes) 000992 1789297842.870359 punch from 0x004c3f to 0x007e21 (0x31e3 bytes) 000993 1789297842.876407 mapwrite 0x00b7c0 thru 0x012ba1 (0x73e2 bytes) 000994 1789297842.993184 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c6:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12ba2): Mirror 17: 0x5d3c6d00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12ba2): Mirror 17: 0x5d3c6d00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12ba2: skipped 000995 1789297843.548322 mapwrite 0x0141dc thru 0x017574 (0x3399 bytes) 000997 1789297843.659602 trunc from 0x017575 to 0x00c366 (0xb20e bytes) 000999 1789297843.679290 punch from 0x000554 to 0x007691 (0x713e bytes) 001000 1789297843.686469 mapread 0x00477f thru 0x00c366 (0x7be8 bytes) All operations completed A-OK!