== sanity-flr test 70a: flr mode fsx test ================ 19:51:56 (1789602716) Seed set to 2718 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero length punch hole truncating to largest ever: 0x6a2f 000006 1789602718.619379 trunc from 00000000 to 0x006a2e (0x6a2f bytes) 000007 1789602718.649521 read 0x00266a thru 0x006a2e (0x43c5 bytes) truncating to largest ever: 0x247e2 000008 1789602718.664782 trunc from 0x006a2f to 0x0247e1 (0x1ddb3 bytes) 000009 1789602718.729573 write 0x015434 thru 0x019803 (0x43d0 bytes) 000010 1789602718.762256 punch from 0x01e41b to 0x01ed6d (0x953 bytes) 000012 1789602718.787168 mapwrite 0x004b54 thru 0x00a96b (0x5e18 bytes) 000013 1789602718.885186 punch from 0x01fde9 to 0x0247e1 (0x49f9 bytes) 000017 1789602718.908530 mapread 0x009172 thru 0x01815e (0xefed bytes) 000018 1789602718.925904 write 0x03f93a thru 0x03ffff (0x6c6 bytes) 000019 1789602718.928201 write 0x00ca0c thru 0x012b56 (0x614b bytes) 000021 1789602718.933229 write 0x030f75 thru 0x0311a7 (0x233 bytes) 000023 1789602718.952148 mapread 0x03055c thru 0x03773a (0x71df bytes) 000024 1789602718.964874 read 0x034743 thru 0x03ffff (0xb8bd bytes) 000025 1789602718.981221 mapread 0x0083e3 thru 0x00aa9f (0x26bd bytes) 000027 1789602718.986335 mapread 0x00fe2c thru 0x017d4a (0x7f1f bytes) 000029 1789602718.989448 read 0x02432c thru 0x025c86 (0x195b bytes) 000030 1789602718.990827 write 0x021034 thru 0x02d27a (0xc247 bytes) 000033 1789602718.995832 mapwrite 0x012529 thru 0x01efb2 (0xca8a bytes) 000034 1789602719.065394 mapwrite 0x0229fe thru 0x029c10 (0x7213 bytes) 000036 1789602719.142417 MIRROR_EXTEND to 2 mirrors 000038 1789602719.897410 mapread 0x03c0b8 thru 0x03ffff (0x3f48 bytes) 000040 1789602719.981635 mapwrite 0x025145 thru 0x02b7c6 (0x6682 bytes) 000041 1789602720.258002 trunc from 0x040000 to 0x01a585 (0x25a7a bytes) 000044 1789602720.358281 punch from 0x01a1e3 to 0x01a585 (0x3a3 bytes) 000045 1789602720.371977 write 0x00c3b0 thru 0x015ec0 (0x9b11 bytes) 000046 1789602720.422244 mapread 0x00ccc0 thru 0x0196c8 (0xca09 bytes) truncating to largest ever: 0x3f9a4 000047 1789602720.447786 trunc from 0x01a586 to 0x03f9a3 (0x2541e bytes) 000048 1789602720.494113 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f9a4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f9a4): Mirror 2: 0xa193385b (stale) CRC-32 checksum value for chunk [0, 0x3f9a4): Mirror 1: 0x4a1508ca Mirror 3: 0x4a1508ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f9a4: skipped 000049 1789602722.127743 mapread 0x018567 thru 0x019868 (0x1302 bytes) 000051 1789602722.160060 trunc from 0x03f9a4 to 0x02f150 (0x10853 bytes) 000052 1789602722.244985 mapread 0x00a97f thru 0x0159e6 (0xb068 bytes) 000057 1789602722.273237 mapwrite 0x023058 thru 0x02d054 (0x9ffd bytes) 000058 1789602722.345554 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f151): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f151): Mirror 2: 0xb9d76841 (stale) Mirror 3: 0x2425208b (stale) CRC-32 checksum value for chunk [0, 0x2f151): Mirror 1: 0x5d9d28d1 Mirror 4: 0x5d9d28d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f151: skipped 000060 1789602723.313945 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f151): Mirror 3: 0x2425208b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f151): Mirror 3: 0x2425208b (stale) CRC-32 checksum value for chunk [0, 0x2f151): Mirror 1: 0x5d9d28d1 Mirror 4: 0x5d9d28d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f151: skipped 000061 1789602723.971734 punch from 0x00a1b2 to 0x016b50 (0xc99f bytes) 000063 1789602724.068508 punch from 0x02c738 to 0x02f150 (0x2a19 bytes) 000066 1789602724.088128 mapread 0x00ad56 thru 0x01450c (0x97b7 bytes) 000067 1789602724.119802 read 0x0295da thru 0x02f150 (0x5b77 bytes) 000068 1789602724.145482 punch from 0x0032db to 0x00c224 (0x8f4a bytes) 000069 1789602724.161918 write 0x02d546 thru 0x02e164 (0xc1f bytes) 000070 1789602724.164173 trunc from 0x02f151 to 0x03d5aa (0xe45a bytes) 000071 1789602724.231226 trunc from 0x03d5ab to 0x036181 (0x7429 bytes) 000072 1789602724.273526 write 0x00b637 thru 0x014005 (0x89cf bytes) 000073 1789602724.293364 write 0x016046 thru 0x0240e1 (0xe09c bytes) 000074 1789602724.320243 read 0x00dfa7 thru 0x015aae (0x7b08 bytes) 000075 1789602724.336096 read 0x035129 thru 0x036181 (0x1059 bytes) 000077 1789602724.338390 read 0x01f7a1 thru 0x02ac87 (0xb4e7 bytes) 000081 1789602724.341890 mapwrite 0x03d814 thru 0x03fddc (0x25c9 bytes) 000083 1789602724.482298 write 0x039c7e thru 0x03ffff (0x6382 bytes) 000084 1789602724.490864 MIRROR_RESYNC 3 mirrors 000086 1789602725.869045 read 0x02546c thru 0x0345c9 (0xf15e bytes) 000087 1789602725.877153 mapread 0x022479 thru 0x0250c2 (0x2c4a bytes) 000088 1789602725.898351 punch from 0x02d131 to 0x03a0bc (0xcf8c bytes) 000089 1789602726.001637 mapwrite 0x01378d thru 0x0227d4 (0xf048 bytes) 000090 1789602726.175862 MIRROR_RESYNC 3 mirrors 000092 1789602727.718565 trunc from 0x040000 to 0x027a62 (0x1859d bytes) 000093 1789602727.803813 mapread 0x006bda thru 0x009c85 (0x30ac bytes) 000094 1789602727.830275 mapread 0x00080a thru 0x010273 (0xfa6a bytes) 000096 1789602727.837278 trunc from 0x027a63 to 0x016060 (0x11a02 bytes) 000097 1789602727.876856 trunc from 0x016061 to 0x02b906 (0x158a6 bytes) 000098 1789602727.894995 punch from 0x00b000 to 0x01616e (0xb16f bytes) 000100 1789602727.900703 mapwrite 0x007dda thru 0x008b5b (0xd82 bytes) 000103 1789602727.962947 mapwrite 0x007e90 thru 0x012068 (0xa1d9 bytes) 000104 1789602728.083284 trunc from 0x02b907 to 0x0157c0 (0x16146 bytes) 000105 1789602728.134134 mapwrite 0x006eb3 thru 0x00fd2c (0x8e7a bytes) 000106 1789602728.267996 mapread 0x00018d thru 0x00a012 (0x9e86 bytes) 000107 1789602728.270585 write 0x033605 thru 0x03ffff (0xc9fb bytes) 000108 1789602728.275848 punch from 0x034314 to 0x035b54 (0x1841 bytes) 000109 1789602728.313454 mapread 0x00b3b9 thru 0x019dcc (0xea14 bytes) 000110 1789602728.361967 read 0x015674 thru 0x015f9a (0x927 bytes) 000111 1789602728.362735 mapread 0x026176 thru 0x0358fb (0xf786 bytes) 000116 1789602728.422247 mapread 0x012042 thru 0x02115d (0xf11c bytes) 000118 1789602728.439855 read 0x03598e thru 0x03c4d1 (0x6b44 bytes) 000119 1789602728.446506 punch from 0x0342f1 to 0x03f30e (0xb01e bytes) 000121 1789602728.479248 write 0x0131d6 thru 0x01c311 (0x913c bytes) 000122 1789602728.488521 trunc from 0x040000 to 0x027258 (0x18da7 bytes) 000123 1789602728.521255 punch from 0x00317d to 0x00b93f (0x87c3 bytes) 000124 1789602728.538110 write 0x01a5bb thru 0x029afa (0xf540 bytes) 000126 1789602728.539973 trunc from 0x029afb to 0x001eb1 (0x27c49 bytes) 000128 1789602728.580031 write 0x0170e2 thru 0x01a953 (0x3872 bytes) 000129 1789602728.605159 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1a954): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a954): Mirror 3: 0x7d8452ee (stale) Mirror 4: 0x7d8452ee (stale) CRC-32 checksum value for chunk [0, 0x1a954): Mirror 1: 0x309fe7fb Mirror 5: 0x309fe7fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a954: skipped 000130 1789602729.820060 mapread 0x0057da thru 0x01013f (0xa966 bytes) 000132 1789602729.846233 read 0x00baad thru 0x015fd4 (0xa528 bytes) 000133 1789602729.856086 punch from 0x0111fa to 0x018f25 (0x7d2c bytes) 000134 1789602729.959235 mapwrite 0x00d3d6 thru 0x00fbe0 (0x280b bytes) 000136 1789602730.059067 mapwrite 0x03434f thru 0x03be15 (0x7ac7 bytes) 000137 1789602730.239478 mapwrite 0x032a93 thru 0x033082 (0x5f0 bytes) 000138 1789602730.379094 mapread 0x0025e0 thru 0x002967 (0x388 bytes) 000140 1789602730.394753 punch from 0x01d06e to 0x02a914 (0xd8a7 bytes) 000141 1789602730.422731 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3be16): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be16): Mirror 3: 0xdd8b0b8b (stale) Mirror 4: 0xdd8b0b8b (stale) Mirror 5: 0xdd10b196 (stale) CRC-32 checksum value for chunk [0, 0x3be16): Mirror 1: 0x87b68230 Mirror 6: 0x87b68230 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be16: skipped 000142 1789602731.742288 mapread 0x03a69e thru 0x03be15 (0x1778 bytes) 000144 1789602731.801576 mapread 0x03753b thru 0x03be15 (0x48db bytes) 000145 1789602731.844954 write 0x00d442 thru 0x00f453 (0x2012 bytes) 000147 1789602731.996457 read 0x00a724 thru 0x0100b3 (0x5990 bytes) 000148 1789602732.014230 punch from 0x031391 to 0x03be15 (0xaa85 bytes) 000149 1789602732.045699 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3be16): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be16): Mirror 3: 0xdd8b0b8b (stale) Mirror 4: 0xdd8b0b8b (stale) Mirror 5: 0xdd10b196 (stale) Mirror 6: 0x87b68230 (stale) CRC-32 checksum value for chunk [0, 0x3be16): Mirror 1: 0x8f12f7e0 Mirror 7: 0x8f12f7e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be16: skipped 000151 1789602734.068564 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3be16): Mirror 3: 0xdd8b0b8b (stale) Mirror 5: 0xdd10b196 (stale) Mirror 6: 0x87b68230 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be16): Mirror 3: 0xdd8b0b8b (stale) Mirror 5: 0xdd10b196 (stale) Mirror 6: 0x87b68230 (stale) CRC-32 checksum value for chunk [0, 0x3be16): Mirror 1: 0x8f12f7e0 Mirror 7: 0x8f12f7e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be16: skipped 000152 1789602734.820162 punch from 0x02f5f2 to 0x03be15 (0xc824 bytes) 000154 1789602734.983118 read 0x00285c thru 0x007a99 (0x523e bytes) 000156 1789602735.007880 trunc from 0x03be16 to 0x016875 (0x255a0 bytes) 000157 1789602735.057317 trunc from 0x016876 to 0x026ea7 (0x10632 bytes) 000158 1789602735.086882 write 0x00ce78 thru 0x01ca48 (0xfbd1 bytes) 000159 1789602735.112772 punch from 0x011e2f to 0x0189d0 (0x6ba2 bytes) 000160 1789602735.200038 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x26ea8): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ea8): Mirror 3: 0x3f4c0917 (stale) Mirror 5: 0x3ace009d (stale) Mirror 6: 0xdc3f3f (stale) Mirror 7: 0x8139c892 (stale) CRC-32 checksum value for chunk [0, 0x26ea8): Mirror 1: 0x7a4a2de8 Mirror 8: 0x7a4a2de8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ea8: skipped 000162 1789602736.784512 write 0x004016 thru 0x008cf3 (0x4cde bytes) 000163 1789602736.967974 mapwrite 0x004728 thru 0x0089c7 (0x42a0 bytes) 000164 1789602737.019497 mapwrite 0x022fb1 thru 0x03261e (0xf66e bytes) 000165 1789602737.226281 trunc from 0x03261f to 0x03978e (0x7170 bytes) 000166 1789602737.253332 mapwrite 0x014ae2 thru 0x016fe3 (0x2502 bytes) 000167 1789602737.313271 MIRROR_RESYNC 6 mirrors 000168 1789602739.359953 trunc from 0x03978f to 0x019322 (0x2046c bytes) 000169 1789602739.509039 mapread 0x00609d thru 0x0153e0 (0xf344 bytes) 000171 1789602739.558418 mapread 0x0075ac thru 0x015d5e (0xe7b3 bytes) 000172 1789602739.560816 trunc from 0x019323 to 0x0022d5 (0x1704d bytes) 000174 1789602739.593901 trunc from 0x0022d6 to 0x02a8f6 (0x28621 bytes) 000175 1789602739.623286 punch from 0x0237e1 to 0x02a8f6 (0x7116 bytes) 000179 1789602739.636790 mapwrite 0x02f05a thru 0x03e1d0 (0xf177 bytes) 000180 1789602739.836798 write 0x03aca7 thru 0x03ad97 (0xf1 bytes) 000182 1789602739.841923 MIRROR_RESYNC 6 mirrors 000183 1789602741.965820 trunc from 0x03e1d1 to 0x00724d (0x36f83 bytes) 000185 1789602742.085985 write 0x01a32f thru 0x028246 (0xdf18 bytes) 000186 1789602742.090988 punch from 0x00bd38 to 0x00f822 (0x3aeb bytes) 000187 1789602742.111829 mapwrite 0x01101f thru 0x01551c (0x44fe bytes) 000188 1789602742.214070 trunc from 0x028247 to 0x02f6da (0x7494 bytes) 000189 1789602742.243233 MIRROR_RESYNC 6 mirrors 000190 1789602744.244824 MIRROR_RESYNC 6 mirrors 000191 1789602744.673232 write 0x036f2a thru 0x03838a (0x1461 bytes) 000192 1789602744.739977 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3838b): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3838b): Mirror 3: 0xecdd224d (stale) Mirror 5: 0xecdd224d (stale) Mirror 6: 0xecdd224d (stale) Mirror 7: 0xecdd224d (stale) Mirror 8: 0xecdd224d (stale) CRC-32 checksum value for chunk [0, 0x3838b): Mirror 1: 0xaedcc181 Mirror 9: 0xaedcc181 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3838b: skipped 000193 1789602746.224094 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3838b): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3838b): Mirror 3: 0xecdd224d (stale) Mirror 5: 0xecdd224d (stale) Mirror 6: 0xecdd224d (stale) Mirror 7: 0xecdd224d (stale) Mirror 8: 0xecdd224d (stale) CRC-32 checksum value for chunk [0, 0x3838b): Mirror 1: 0xaedcc181 Mirror 9: 0xaedcc181 Mirror 10: 0xaedcc181 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3838b: skipped 000196 1789602747.394109 mapread 0x00b352 thru 0x016f1b (0xbbca bytes) 000197 1789602747.454403 punch from 0x029017 to 0x029bfd (0xbe7 bytes) 000198 1789602747.672459 mapread 0x02afe7 thru 0x035c5f (0xac79 bytes) 000199 1789602747.704690 mapwrite 0x00b7d1 thru 0x00c5ff (0xe2f bytes) 000200 1789602747.844436 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3838b): Mirror 5: 0xecdd224d (stale) Mirror 6: 0xecdd224d (stale) Mirror 7: 0xecdd224d (stale) Mirror 8: 0xecdd224d (stale) Mirror 9: 0xaedcc181 (stale) Mirror 10: 0xaedcc181 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3838b): Mirror 5: 0xecdd224d (stale) Mirror 6: 0xecdd224d (stale) Mirror 7: 0xecdd224d (stale) Mirror 8: 0xecdd224d (stale) Mirror 9: 0xaedcc181 (stale) Mirror 10: 0xaedcc181 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3838b: skipped 000201 1789602748.326147 mapread 0x00fce6 thru 0x01dab4 (0xddcf bytes) 000202 1789602748.356031 mapwrite 0x018e34 thru 0x019abb (0xc88 bytes) 000203 1789602748.405103 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3838b): Mirror 5: 0xecdd224d (stale) Mirror 6: 0xecdd224d (stale) Mirror 8: 0xecdd224d (stale) Mirror 9: 0xaedcc181 (stale) Mirror 10: 0xaedcc181 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3838b): Mirror 5: 0xecdd224d (stale) Mirror 6: 0xecdd224d (stale) Mirror 8: 0xecdd224d (stale) Mirror 9: 0xaedcc181 (stale) Mirror 10: 0xaedcc181 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3838b: skipped 000204 1789602748.935001 read 0x0330ef thru 0x03838a (0x529c bytes) 000205 1789602748.944423 write 0x03a5c6 thru 0x03ffff (0x5a3a bytes) 000208 1789602748.946684 mapwrite 0x02bf4e thru 0x03409e (0x8151 bytes) 000209 1789602749.099553 punch from 0x02fe0e to 0x032224 (0x2417 bytes) 000210 1789602749.105475 punch from 0x03f93a to 0x03ffff (0x6c6 bytes) 000211 1789602749.110501 punch from 0x02ec61 to 0x03ebbf (0xff5f bytes) 000212 1789602749.115439 read 0x003c27 thru 0x00fad3 (0xbead bytes) 000213 1789602749.139228 write 0x03be7e thru 0x03fdd9 (0x3f5c bytes) 000214 1789602749.141197 mapwrite 0x03d1c4 thru 0x03ffff (0x2e3c bytes) 000215 1789602749.235691 punch from 0x020f3d to 0x021092 (0x156 bytes) 000216 1789602749.240586 punch from 0x0262c9 to 0x032a75 (0xc7ad bytes) 000219 1789602749.247094 read 0x033b91 thru 0x03e5ff (0xaa6f bytes) 000220 1789602749.247876 read 0x0353d8 thru 0x0382db (0x2f04 bytes) 000221 1789602749.248809 mapwrite 0x02e695 thru 0x02fc37 (0x15a3 bytes) 000222 1789602749.305899 read 0x02d5a7 thru 0x03cde2 (0xf83c bytes) 000223 1789602749.306758 trunc from 0x040000 to 0x028fec (0x17013 bytes) 000224 1789602749.326714 trunc from 0x028fed to 0x00203c (0x26fb0 bytes) 000225 1789602749.356844 mapread 0x00146f thru 0x00203c (0xbce bytes) 000226 1789602749.358537 write 0x03ad16 thru 0x03ffff (0x52ea bytes) 000227 1789602749.361045 punch from 0x00e093 to 0x019604 (0xb572 bytes) 000228 1789602749.376391 write 0x001bde thru 0x00da9c (0xbebf bytes) 000230 1789602749.385830 write 0x024673 thru 0x033eff (0xf88d bytes) 000231 1789602749.412727 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x303065bb (stale) Mirror 6: 0x303065bb (stale) Mirror 8: 0x303065bb (stale) Mirror 9: 0x403ada93 (stale) Mirror 10: 0x403ada93 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x71a0eec5 Mirror 11: 0x71a0eec5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000232 1789602751.234968 trunc from 0x040000 to 0x02a1a2 (0x15e5d bytes) 000233 1789602751.356792 MIRROR_RESYNC 7 mirrors 000234 1789602753.701638 read 0x002290 thru 0x003d65 (0x1ad6 bytes) 000235 1789602753.709354 write 0x0164db thru 0x021a43 (0xb569 bytes) 000237 1789602753.803199 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a1a3): Mirror 5: 0x668f81c9 (stale) Mirror 6: 0x668f81c9 (stale) Mirror 9: 0x668f81c9 (stale) Mirror 10: 0x668f81c9 (stale) Mirror 11: 0x668f81c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a1a3): Mirror 5: 0x668f81c9 (stale) Mirror 6: 0x668f81c9 (stale) Mirror 9: 0x668f81c9 (stale) Mirror 10: 0x668f81c9 (stale) Mirror 11: 0x668f81c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a1a3: skipped 000238 1789602754.197028 write 0x03999b thru 0x03ffff (0x6665 bytes) 000239 1789602754.198336 punch from 0x02c5f2 to 0x03c3f2 (0xfe01 bytes) 000240 1789602754.214331 mapread 0x00cd99 thru 0x00f0cd (0x2335 bytes) 000241 1789602754.233948 punch from 0x01c0de to 0x020d08 (0x4c2b bytes) 000242 1789602754.238444 mapread 0x0193aa thru 0x025c01 (0xc858 bytes) 000244 1789602754.266299 MIRROR_RESYNC 6 mirrors 000246 1789602756.130263 trunc from 0x040000 to 0x02d6c4 (0x1293b bytes) 000247 1789602756.205131 mapwrite 0x01cdd0 thru 0x01f314 (0x2545 bytes) 000250 1789602756.291476 punch from 0x02d02a to 0x02d6c4 (0x69b bytes) 000252 1789602756.304116 write 0x0177a2 thru 0x01acf0 (0x354f bytes) 000255 1789602756.319715 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2d6c5): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d6c5): Mirror 5: 0x135b6b5c (stale) Mirror 6: 0x135b6b5c (stale) Mirror 9: 0x135b6b5c (stale) Mirror 10: 0x135b6b5c (stale) Mirror 11: 0x135b6b5c (stale) CRC-32 checksum value for chunk [0, 0x2d6c5): Mirror 1: 0xf7e8340a Mirror 12: 0xf7e8340a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d6c5: skipped 000259 1789602757.905271 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d6c5): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d6c5): Mirror 5: 0x135b6b5c (stale) Mirror 6: 0x135b6b5c (stale) Mirror 9: 0x135b6b5c (stale) Mirror 10: 0x135b6b5c (stale) Mirror 11: 0x135b6b5c (stale) CRC-32 checksum value for chunk [0, 0x2d6c5): Mirror 1: 0xf7e8340a Mirror 12: 0xf7e8340a Mirror 13: 0xf7e8340a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d6c5: skipped 000262 1789602759.154016 write 0x03fe1d thru 0x03ffff (0x1e3 bytes) 000263 1789602759.307541 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2a2c69eb (stale) Mirror 6: 0x2a2c69eb (stale) Mirror 9: 0x2a2c69eb (stale) Mirror 10: 0x2a2c69eb (stale) Mirror 11: 0x2a2c69eb (stale) Mirror 12: 0xffb78387 (stale) Mirror 13: 0xffb78387 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5dc4ec84 Mirror 14: 0x5dc4ec84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000265 1789602760.874175 trunc from 0x040000 to 0x0329a2 (0xd65d bytes) 000267 1789602760.991837 mapread 0x005bdf thru 0x01387d (0xdc9f bytes) 000269 1789602761.034382 mapread 0x015396 thru 0x0182ee (0x2f59 bytes) 000270 1789602761.035667 mapwrite 0x0091b8 thru 0x00f515 (0x635e bytes) 000271 1789602761.125900 punch from 0x010bfa to 0x0147c2 (0x3bc9 bytes) 000273 1789602761.141950 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x329a3): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329a3): Mirror 5: 0x802b762b (stale) Mirror 6: 0x802b762b (stale) Mirror 9: 0x802b762b (stale) Mirror 10: 0x802b762b (stale) Mirror 11: 0x802b762b (stale) Mirror 12: 0x2b9b5f5c (stale) Mirror 13: 0x2b9b5f5c (stale) Mirror 14: 0x2b9b5f5c (stale) CRC-32 checksum value for chunk [0, 0x329a3): Mirror 1: 0x13b5471 Mirror 15: 0x13b5471 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329a3: skipped 000274 1789602762.565423 MIRROR_RESYNC 10 mirrors 000275 1789602764.827058 write 0x0120d9 thru 0x015ccc (0x3bf4 bytes) 000276 1789602765.067337 write 0x03d8a8 thru 0x03ffff (0x2758 bytes) 000277 1789602765.069778 punch from 0x007514 to 0x00edbb (0x78a8 bytes) 000279 1789602765.100045 write 0x018f87 thru 0x0210f3 (0x816d bytes) 000282 1789602765.113433 mapwrite 0x0025b7 thru 0x00dccd (0xb717 bytes) 000284 1789602765.227409 write 0x011dd3 thru 0x01691e (0x4b4c bytes) 000287 1789602765.253209 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x542b96d3 (stale) Mirror 6: 0x542b96d3 (stale) Mirror 9: 0x542b96d3 (stale) Mirror 10: 0x542b96d3 (stale) Mirror 11: 0x542b96d3 (stale) Mirror 12: 0x542b96d3 (stale) Mirror 13: 0x542b96d3 (stale) Mirror 14: 0x542b96d3 (stale) Mirror 15: 0x542b96d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa96093a1 Mirror 16: 0xa96093a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000288 1789602767.074286 mapwrite 0x013836 thru 0x014c98 (0x1463 bytes) 000289 1789602767.283909 trunc from 0x040000 to 0x0396ba (0x6945 bytes) 000291 1789602767.308806 write 0x03555a thru 0x03ffff (0xaaa6 bytes) 000292 1789602767.326417 read 0x037e90 thru 0x0391be (0x132f bytes) 000293 1789602767.328505 read 0x0365be thru 0x03ffff (0x9a42 bytes) 000298 1789602767.332305 trunc from 0x040000 to 0x00a2ca (0x35d35 bytes) 000300 1789602767.400199 mapread 0x002b86 thru 0x004eb3 (0x232e bytes) 000302 1789602767.431390 punch from 0x0071a6 to 0x00a2ca (0x3125 bytes) 000303 1789602767.442566 read 0x004285 thru 0x00a2ca (0x6046 bytes) 000304 1789602767.465522 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xa2cb): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa2cb): Mirror 5: 0x983cf412 (stale) Mirror 6: 0x983cf412 (stale) Mirror 9: 0x983cf412 (stale) Mirror 10: 0x983cf412 (stale) Mirror 11: 0x983cf412 (stale) Mirror 12: 0x983cf412 (stale) Mirror 13: 0x983cf412 (stale) Mirror 14: 0x983cf412 (stale) Mirror 15: 0x983cf412 (stale) Mirror 16: 0xe86c04d6 (stale) CRC-32 checksum value for chunk [0, 0xa2cb): Mirror 1: 0x3661e948 Mirror 17: 0x3661e948 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa2cb: skipped 000306 1789602769.334137 trunc from 0x00a2cb to 0x015054 (0xad8a bytes) 000307 1789602769.584531 mapread 0x00fc4f thru 0x014a5c (0x4e0e bytes) 000308 1789602769.630287 write 0x00318e thru 0x008805 (0x5678 bytes) 000310 1789602769.644798 punch from 0x010a17 to 0x015054 (0x463e bytes) 000311 1789602769.676882 read 0x011eac thru 0x015054 (0x31a9 bytes) 000312 1789602769.706405 read 0x008d4d thru 0x009dd4 (0x1088 bytes) 000315 1789602769.723849 mapwrite 0x014721 thru 0x0166f5 (0x1fd5 bytes) 000316 1789602769.830146 read 0x00f877 thru 0x014f4b (0x56d5 bytes) 000317 1789602769.831021 trunc from 0x0166f6 to 0x00dde4 (0x8911 bytes) 000318 1789602769.859309 mapwrite 0x01e851 thru 0x024122 (0x58d2 bytes) 000319 1789602769.988760 trunc from 0x024123 to 0x026f51 (0x2e2f bytes) 000321 1789602770.030280 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26f52): Mirror 5: 0x4b228cb (stale) Mirror 9: 0x4b228cb (stale) Mirror 10: 0x4b228cb (stale) Mirror 11: 0x4b228cb (stale) Mirror 12: 0x4b228cb (stale) Mirror 13: 0x4b228cb (stale) Mirror 14: 0x4b228cb (stale) Mirror 15: 0x4b228cb (stale) Mirror 16: 0x686ea8f8 (stale) Mirror 17: 0xf140696a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26f52): Mirror 5: 0x4b228cb (stale) Mirror 9: 0x4b228cb (stale) Mirror 10: 0x4b228cb (stale) Mirror 11: 0x4b228cb (stale) Mirror 12: 0x4b228cb (stale) Mirror 13: 0x4b228cb (stale) Mirror 14: 0x4b228cb (stale) Mirror 15: 0x4b228cb (stale) Mirror 16: 0x686ea8f8 (stale) Mirror 17: 0xf140696a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26f52: skipped 000322 1789602770.824969 read 0x01023b thru 0x0163c1 (0x6187 bytes) 000323 1789602770.834188 mapwrite 0x028dee thru 0x02b85a (0x2a6d bytes) 000324 1789602770.917341 MIRROR_RESYNC 11 mirrors 000325 1789602774.115138 MIRROR_RESYNC 11 mirrors 000326 1789602775.024593 punch from 0x010137 to 0x01cd22 (0xcbec bytes) 000327 1789602775.165134 write 0x031c0f thru 0x03713b (0x552d bytes) 000329 1789602775.172114 trunc from 0x03713c to 0x014b07 (0x22634 bytes) 000330 1789602775.232745 read 0x00e5e5 thru 0x012507 (0x3f23 bytes) 000331 1789602775.246507 mapread 0x006303 thru 0x00fefb (0x9bf9 bytes) 000332 1789602775.301891 mapwrite 0x0225bc thru 0x02e36a (0xbdaf bytes) 000333 1789602775.423011 MIRROR_RESYNC 11 mirrors 000335 1789602779.145127 write 0x01e349 thru 0x02ac8f (0xc947 bytes) 000336 1789602779.256013 trunc from 0x02e36b to 0x01a891 (0x13ad9 bytes) 000337 1789602779.287314 mapwrite 0x008b43 thru 0x00a44d (0x190b bytes) 000338 1789602779.386919 trunc from 0x01a892 to 0x0064c1 (0x143d0 bytes) 000339 1789602779.425207 mapread 0x001dba thru 0x0064c1 (0x4708 bytes) 000340 1789602779.434521 trunc from 0x0064c2 to 0x00c214 (0x5d53 bytes) 000342 1789602779.467217 read 0x007097 thru 0x00c214 (0x517e bytes) 000344 1789602779.483540 punch from 0x008def to 0x00c214 (0x3426 bytes) 000345 1789602779.490824 write 0x02bdcb thru 0x03062b (0x4861 bytes) 000346 1789602779.492262 trunc from 0x03062c to 0x007ae2 (0x28b49 bytes) 000348 1789602779.552899 punch from 0x004954 to 0x007ae2 (0x318f bytes) 000349 1789602779.563070 mapwrite 0x0182cd thru 0x01eb2b (0x685f bytes) 000350 1789602779.675062 punch from 0x005712 to 0x010813 (0xb102 bytes) 000351 1789602779.684458 mapwrite 0x03a568 thru 0x03ffff (0x5a98 bytes) 000352 1789602779.784463 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x86748f43 (stale) Mirror 9: 0x86748f43 (stale) Mirror 10: 0x86748f43 (stale) Mirror 11: 0x86748f43 (stale) Mirror 12: 0x86748f43 (stale) Mirror 13: 0x86748f43 (stale) Mirror 14: 0x86748f43 (stale) Mirror 16: 0x86748f43 (stale) Mirror 17: 0x86748f43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x86748f43 (stale) Mirror 9: 0x86748f43 (stale) Mirror 10: 0x86748f43 (stale) Mirror 11: 0x86748f43 (stale) Mirror 12: 0x86748f43 (stale) Mirror 13: 0x86748f43 (stale) Mirror 14: 0x86748f43 (stale) Mirror 16: 0x86748f43 (stale) Mirror 17: 0x86748f43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000353 1789602781.010409 write 0x015742 thru 0x019e3a (0x46f9 bytes) 000359 1789602781.031520 write 0x0149b6 thru 0x0158d1 (0xf1c bytes) 000360 1789602781.042013 write 0x035415 thru 0x03fd77 (0xa963 bytes) 000361 1789602781.059551 mapread 0x0061be thru 0x00ff74 (0x9db7 bytes) 000363 1789602781.127438 mapread 0x02f0f0 thru 0x035dde (0x6cef bytes) 000364 1789602781.154509 write 0x03d33d thru 0x03ffff (0x2cc3 bytes) 000365 1789602781.165830 mapwrite 0x02bc1c thru 0x03846b (0xc850 bytes) 000366 1789602781.288025 mapwrite 0x02938f thru 0x02cdb1 (0x3a23 bytes) 000367 1789602781.370766 write 0x0374fb thru 0x03ffff (0x8b05 bytes) 000369 1789602781.375050 punch from 0x00cfcd to 0x01abda (0xdc0e bytes) 000370 1789602781.397153 mapwrite 0x00a7ad thru 0x00f797 (0x4feb bytes) 000371 1789602781.513141 mapread 0x0114d9 thru 0x019c89 (0x87b1 bytes) 000373 1789602781.530670 write 0x035240 thru 0x03f9ef (0xa7b0 bytes) 000374 1789602781.534007 mapread 0x01c9aa thru 0x01e81a (0x1e71 bytes) 000375 1789602781.552705 mapread 0x03e6f0 thru 0x03ffff (0x1910 bytes) 000376 1789602781.559584 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x86748f43 (stale) Mirror 9: 0x86748f43 (stale) Mirror 10: 0x86748f43 (stale) Mirror 11: 0x86748f43 (stale) Mirror 12: 0x86748f43 (stale) Mirror 13: 0x86748f43 (stale) Mirror 14: 0x86748f43 (stale) Mirror 16: 0x86748f43 (stale) Mirror 17: 0x86748f43 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6da345d4 Mirror 18: 0x6da345d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000377 1789602783.378408 punch from 0x0065b1 to 0x0158d1 (0xf321 bytes) 000378 1789602783.487189 trunc from 0x040000 to 0x0158c6 (0x2a739 bytes) 000379 1789602783.513081 read 0x00754e thru 0x00de7e (0x6931 bytes) 000380 1789602783.525020 mapwrite 0x03a5d2 thru 0x03ffff (0x5a2e bytes) 000381 1789602783.622465 mapread 0x02e5b1 thru 0x031194 (0x2be4 bytes) 000382 1789602783.639892 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x86748f43 (stale) Mirror 9: 0x86748f43 (stale) Mirror 10: 0x86748f43 (stale) Mirror 11: 0x86748f43 (stale) Mirror 12: 0x86748f43 (stale) Mirror 13: 0x86748f43 (stale) Mirror 14: 0x86748f43 (stale) Mirror 16: 0x86748f43 (stale) Mirror 17: 0x86748f43 (stale) Mirror 18: 0x6da345d4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7865f6db Mirror 19: 0x7865f6db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000383 1789602785.243159 trunc from 0x040000 to 0x033ba0 (0xc45f bytes) 000384 1789602785.338141 trunc from 0x033ba1 to 0x01a854 (0x1934c bytes) 000385 1789602785.385335 trunc from 0x01a855 to 0x02b949 (0x110f5 bytes) 000386 1789602785.414153 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2b94a): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b94a): Mirror 5: 0x1eadf282 (stale) Mirror 9: 0x1eadf282 (stale) Mirror 10: 0x1eadf282 (stale) Mirror 11: 0x1eadf282 (stale) Mirror 12: 0x1eadf282 (stale) Mirror 13: 0x1eadf282 (stale) Mirror 14: 0x1eadf282 (stale) Mirror 16: 0x1eadf282 (stale) Mirror 17: 0x1eadf282 (stale) Mirror 18: 0xc02867fb (stale) Mirror 19: 0x5becbca6 (stale) CRC-32 checksum value for chunk [0, 0x2b94a): Mirror 1: 0x5becbca6 Mirror 20: 0x5becbca6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b94a: skipped 000387 1789602787.178049 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2b94a): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b94a): Mirror 5: 0x1eadf282 (stale) Mirror 9: 0x1eadf282 (stale) Mirror 10: 0x1eadf282 (stale) Mirror 11: 0x1eadf282 (stale) Mirror 12: 0x1eadf282 (stale) Mirror 13: 0x1eadf282 (stale) Mirror 14: 0x1eadf282 (stale) Mirror 16: 0x1eadf282 (stale) Mirror 17: 0x1eadf282 (stale) Mirror 18: 0xc02867fb (stale) Mirror 19: 0x5becbca6 (stale) CRC-32 checksum value for chunk [0, 0x2b94a): Mirror 1: 0x5becbca6 Mirror 20: 0x5becbca6 Mirror 21: 0x5becbca6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b94a: skipped 000388 1789602789.049457 write 0x0228a3 thru 0x02eb30 (0xc28e bytes) 000389 1789602789.258846 trunc from 0x02eb31 to 0x015193 (0x1999d bytes) 000390 1789602789.296946 punch from 0x00bb20 to 0x015193 (0x9674 bytes) 000391 1789602789.312081 mapread 0x012c49 thru 0x0147b8 (0x1b70 bytes) 000392 1789602789.347437 punch from 0x00f69c to 0x015193 (0x5af8 bytes) 000394 1789602789.374092 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15194): Mirror 5: 0x732a8d64 (stale) Mirror 9: 0x732a8d64 (stale) Mirror 11: 0x732a8d64 (stale) Mirror 12: 0x732a8d64 (stale) Mirror 13: 0x732a8d64 (stale) Mirror 14: 0x732a8d64 (stale) Mirror 16: 0x732a8d64 (stale) Mirror 17: 0x732a8d64 (stale) Mirror 18: 0x86a7d9c9 (stale) Mirror 19: 0x3a9d1407 (stale) Mirror 20: 0x3a9d1407 (stale) Mirror 21: 0x3a9d1407 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15194): Mirror 5: 0x732a8d64 (stale) Mirror 9: 0x732a8d64 (stale) Mirror 11: 0x732a8d64 (stale) Mirror 12: 0x732a8d64 (stale) Mirror 13: 0x732a8d64 (stale) Mirror 14: 0x732a8d64 (stale) Mirror 16: 0x732a8d64 (stale) Mirror 17: 0x732a8d64 (stale) Mirror 18: 0x86a7d9c9 (stale) Mirror 19: 0x3a9d1407 (stale) Mirror 20: 0x3a9d1407 (stale) Mirror 21: 0x3a9d1407 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15194: skipped 000395 1789602790.424250 mapwrite 0x026ca1 thru 0x028455 (0x17b5 bytes) 000398 1789602790.528071 punch from 0x00fafd to 0x01c657 (0xcb5b bytes) 000401 1789602790.542842 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28456): Mirror 5: 0x638e4889 (stale) Mirror 11: 0x638e4889 (stale) Mirror 12: 0x638e4889 (stale) Mirror 13: 0x638e4889 (stale) Mirror 14: 0x638e4889 (stale) Mirror 16: 0x638e4889 (stale) Mirror 17: 0x638e4889 (stale) Mirror 18: 0xd317c252 (stale) Mirror 19: 0xed2d7955 (stale) Mirror 20: 0xed2d7955 (stale) Mirror 21: 0xed2d7955 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28456): Mirror 5: 0x638e4889 (stale) Mirror 11: 0x638e4889 (stale) Mirror 12: 0x638e4889 (stale) Mirror 13: 0x638e4889 (stale) Mirror 14: 0x638e4889 (stale) Mirror 16: 0x638e4889 (stale) Mirror 17: 0x638e4889 (stale) Mirror 18: 0xd317c252 (stale) Mirror 19: 0xed2d7955 (stale) Mirror 20: 0xed2d7955 (stale) Mirror 21: 0xed2d7955 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28456: skipped 000402 1789602791.487087 write 0x017350 thru 0x026ca4 (0xf955 bytes) 000404 1789602791.520334 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28456): Mirror 5: 0x638e4889 (stale) Mirror 11: 0x638e4889 (stale) Mirror 12: 0x638e4889 (stale) Mirror 13: 0x638e4889 (stale) Mirror 14: 0x638e4889 (stale) Mirror 16: 0x638e4889 (stale) Mirror 17: 0x638e4889 (stale) Mirror 18: 0xd317c252 (stale) Mirror 19: 0xed2d7955 (stale) Mirror 21: 0xed2d7955 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28456): Mirror 5: 0x638e4889 (stale) Mirror 11: 0x638e4889 (stale) Mirror 12: 0x638e4889 (stale) Mirror 13: 0x638e4889 (stale) Mirror 14: 0x638e4889 (stale) Mirror 16: 0x638e4889 (stale) Mirror 17: 0x638e4889 (stale) Mirror 18: 0xd317c252 (stale) Mirror 19: 0xed2d7955 (stale) Mirror 21: 0xed2d7955 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28456: skipped 000407 1789602792.436091 trunc from 0x028456 to 0x03eca3 (0x1684e bytes) 000408 1789602792.477077 mapwrite 0x01d58c thru 0x02296c (0x53e1 bytes) 000410 1789602792.713101 MIRROR_RESYNC 11 mirrors 000412 1789602797.436676 mapwrite 0x00e2b6 thru 0x010a4a (0x2795 bytes) 000413 1789602797.663167 mapwrite 0x0277f6 thru 0x029d7f (0x258a bytes) 000414 1789602797.798516 write 0x0125ac thru 0x016d5f (0x47b4 bytes) 000416 1789602797.802874 read 0x022fca thru 0x031a34 (0xea6b bytes) 000417 1789602797.819176 punch from 0x03e80b to 0x03eca3 (0x499 bytes) 000418 1789602797.857820 write 0x0137c6 thru 0x015f8d (0x27c8 bytes) 000419 1789602797.859989 trunc from 0x03eca4 to 0x017669 (0x2763a bytes) 000420 1789602797.921335 write 0x0257a9 thru 0x02ae4d (0x56a5 bytes) 000421 1789602797.926007 write 0x008e86 thru 0x012692 (0x980d bytes) 000424 1789602797.934635 punch from 0x012eb6 to 0x01e6fc (0xb847 bytes) 000425 1789602797.965347 read 0x02131a thru 0x02ae4d (0x9b34 bytes) 000426 1789602798.008003 trunc from 0x02ae4e to 0x00cd21 (0x1e12c bytes) 000428 1789602798.052916 mapread 0x009024 thru 0x00cd21 (0x3cfe bytes) 000429 1789602798.065399 trunc from 0x00cd22 to 0x01fb9c (0x12e7b bytes) 000430 1789602798.130980 trunc from 0x01fb9d to 0x032cec (0x13150 bytes) 000431 1789602798.162755 read 0x01e8c1 thru 0x02302f (0x476f bytes) 000432 1789602798.177263 mapread 0x01db1b thru 0x01ff23 (0x2409 bytes) 000435 1789602798.180308 trunc from 0x032ced to 0x0058bd (0x2d42f bytes) 000436 1789602798.200026 mapread 0x004b08 thru 0x0058bd (0xdb6 bytes) 000438 1789602798.207094 trunc from 0x0058be to 0x004ce8 (0xbd5 bytes) 000440 1789602798.249293 mapwrite 0x038473 thru 0x03959b (0x1129 bytes) 000441 1789602798.371246 trunc from 0x03959c to 0x033312 (0x6289 bytes) 000442 1789602798.408296 read 0x00b636 thru 0x010347 (0x4d12 bytes) 000443 1789602798.450278 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33313): Mirror 5: 0xdabd7b19 (stale) Mirror 11: 0xdabd7b19 (stale) Mirror 13: 0xdabd7b19 (stale) Mirror 14: 0xdabd7b19 (stale) Mirror 16: 0xdabd7b19 (stale) Mirror 17: 0xdabd7b19 (stale) Mirror 18: 0xdabd7b19 (stale) Mirror 19: 0xdabd7b19 (stale) Mirror 21: 0xdabd7b19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33313): Mirror 5: 0xdabd7b19 (stale) Mirror 11: 0xdabd7b19 (stale) Mirror 13: 0xdabd7b19 (stale) Mirror 14: 0xdabd7b19 (stale) Mirror 16: 0xdabd7b19 (stale) Mirror 17: 0xdabd7b19 (stale) Mirror 18: 0xdabd7b19 (stale) Mirror 19: 0xdabd7b19 (stale) Mirror 21: 0xdabd7b19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33313: skipped 000445 1789602799.388682 mapwrite 0x006485 thru 0x00fbb8 (0x9734 bytes) 000448 1789602799.489157 mapwrite 0x0339b7 thru 0x0363b5 (0x29ff bytes) 000449 1789602799.606066 mapread 0x01b547 thru 0x020c20 (0x56da bytes) 000450 1789602799.630111 write 0x01acf1 thru 0x022df3 (0x8103 bytes) 000451 1789602799.642655 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x363b6): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363b6): Mirror 5: 0xe5ac84bb (stale) Mirror 11: 0xe5ac84bb (stale) Mirror 13: 0xe5ac84bb (stale) Mirror 14: 0xe5ac84bb (stale) Mirror 16: 0xe5ac84bb (stale) Mirror 17: 0xe5ac84bb (stale) Mirror 18: 0xe5ac84bb (stale) Mirror 19: 0xe5ac84bb (stale) Mirror 21: 0xe5ac84bb (stale) CRC-32 checksum value for chunk [0, 0x363b6): Mirror 1: 0x4b80cef8 Mirror 22: 0x4b80cef8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363b6: skipped 000452 1789602801.346372 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x363b6): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363b6): Mirror 5: 0xe5ac84bb (stale) Mirror 11: 0xe5ac84bb (stale) Mirror 13: 0xe5ac84bb (stale) Mirror 14: 0xe5ac84bb (stale) Mirror 16: 0xe5ac84bb (stale) Mirror 17: 0xe5ac84bb (stale) Mirror 18: 0xe5ac84bb (stale) Mirror 19: 0xe5ac84bb (stale) Mirror 21: 0xe5ac84bb (stale) CRC-32 checksum value for chunk [0, 0x363b6): Mirror 1: 0x4b80cef8 Mirror 22: 0x4b80cef8 Mirror 23: 0x4b80cef8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363b6: skipped 000453 1789602802.859913 mapwrite 0x02b184 thru 0x039166 (0xdfe3 bytes) 000455 1789602803.110404 mapwrite 0x026187 thru 0x03381e (0xd698 bytes) 000457 1789602803.214138 punch from 0x000bfd to 0x009b7a (0x8f7e bytes) 000460 1789602803.233503 mapread 0x01c3b7 thru 0x028bad (0xc7f7 bytes) 000461 1789602803.261320 trunc from 0x039167 to 0x00c824 (0x2c942 bytes) 000462 1789602803.293054 write 0x03725a thru 0x0396f8 (0x249f bytes) 000464 1789602803.301480 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x396f9): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396f9): Mirror 5: 0xfac6de93 (stale) Mirror 11: 0xfac6de93 (stale) Mirror 13: 0xfac6de93 (stale) Mirror 14: 0xfac6de93 (stale) Mirror 16: 0xfac6de93 (stale) Mirror 17: 0xfac6de93 (stale) Mirror 18: 0xfac6de93 (stale) Mirror 19: 0xfac6de93 (stale) Mirror 21: 0xfac6de93 (stale) Mirror 22: 0x9075b29d (stale) Mirror 23: 0x9075b29d (stale) CRC-32 checksum value for chunk [0, 0x396f9): Mirror 1: 0xb58280be Mirror 24: 0xb58280be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396f9: skipped 000467 1789602805.414447 punch from 0x0392bd to 0x0396f8 (0x43c bytes) 000468 1789602805.544975 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x396f9): Mirror 5: 0xfac6de93 (stale) Mirror 11: 0xfac6de93 (stale) Mirror 13: 0xfac6de93 (stale) Mirror 14: 0xfac6de93 (stale) Mirror 16: 0xfac6de93 (stale) Mirror 17: 0xfac6de93 (stale) Mirror 19: 0xfac6de93 (stale) Mirror 21: 0xfac6de93 (stale) Mirror 22: 0x9075b29d (stale) Mirror 23: 0x9075b29d (stale) Mirror 24: 0xb58280be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396f9): Mirror 5: 0xfac6de93 (stale) Mirror 11: 0xfac6de93 (stale) Mirror 13: 0xfac6de93 (stale) Mirror 14: 0xfac6de93 (stale) Mirror 16: 0xfac6de93 (stale) Mirror 17: 0xfac6de93 (stale) Mirror 19: 0xfac6de93 (stale) Mirror 21: 0xfac6de93 (stale) Mirror 22: 0x9075b29d (stale) Mirror 23: 0x9075b29d (stale) Mirror 24: 0xb58280be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396f9: skipped 000469 1789602806.255253 punch from 0x0167ec to 0x02466c (0xde81 bytes) 000470 1789602806.263978 read 0x017b10 thru 0x01d009 (0x54fa bytes) 000471 1789602806.284116 punch from 0x018548 to 0x01f9ac (0x7465 bytes) 000472 1789602806.295822 trunc from 0x0396f9 to 0x022eb2 (0x16846 bytes) 000474 1789602806.325969 mapread 0x019938 thru 0x01ce5f (0x3528 bytes) 000475 1789602806.373344 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x22eb3): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22eb3): Mirror 5: 0x77145a5c (stale) Mirror 11: 0x77145a5c (stale) Mirror 13: 0x77145a5c (stale) Mirror 14: 0x77145a5c (stale) Mirror 16: 0x77145a5c (stale) Mirror 17: 0x77145a5c (stale) Mirror 19: 0x77145a5c (stale) Mirror 21: 0x77145a5c (stale) Mirror 22: 0x8e59f8ca (stale) Mirror 23: 0x8e59f8ca (stale) Mirror 24: 0x995f1f68 (stale) CRC-32 checksum value for chunk [0, 0x22eb3): Mirror 1: 0x995f1f68 Mirror 25: 0x995f1f68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22eb3: skipped 000476 1789602808.790135 trunc from 0x022eb3 to 0x020e32 (0x2080 bytes) 000477 1789602808.952462 read 0x010532 thru 0x016efd (0x69cc bytes) 000478 1789602808.982905 mapwrite 0x00cd8d thru 0x01c017 (0xf28b bytes) 000479 1789602809.180994 mapwrite 0x00a358 thru 0x00e96c (0x4615 bytes) 000482 1789602809.307015 mapread 0x020b18 thru 0x020e32 (0x31b bytes) 000483 1789602809.323116 write 0x019bde thru 0x025da2 (0xc1c5 bytes) 000485 1789602809.325502 mapwrite 0x013933 thru 0x022170 (0xe83e bytes) 000487 1789602809.463370 write 0x013bf4 thru 0x020f6e (0xd37b bytes) 000488 1789602809.476026 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x25da3): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25da3): Mirror 5: 0x8b8e0972 (stale) Mirror 11: 0x8b8e0972 (stale) Mirror 13: 0x8b8e0972 (stale) Mirror 14: 0x8b8e0972 (stale) Mirror 16: 0x8b8e0972 (stale) Mirror 17: 0x8b8e0972 (stale) Mirror 19: 0x8b8e0972 (stale) Mirror 21: 0x8b8e0972 (stale) Mirror 22: 0xcab6bed1 (stale) Mirror 23: 0xcab6bed1 (stale) Mirror 24: 0x6f6adb06 (stale) Mirror 25: 0x6f6adb06 (stale) CRC-32 checksum value for chunk [0, 0x25da3): Mirror 1: 0x3d1c9fef Mirror 26: 0x3d1c9fef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25da3: skipped 000489 1789602811.360132 mapwrite 0x0100cc thru 0x01783d (0x7772 bytes) 000490 1789602811.807072 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25da3): Mirror 5: 0x8b8e0972 (stale) Mirror 11: 0x8b8e0972 (stale) Mirror 13: 0x8b8e0972 (stale) Mirror 14: 0x8b8e0972 (stale) Mirror 16: 0x8b8e0972 (stale) Mirror 17: 0x8b8e0972 (stale) Mirror 21: 0x8b8e0972 (stale) Mirror 22: 0xcab6bed1 (stale) Mirror 23: 0xcab6bed1 (stale) Mirror 24: 0x6f6adb06 (stale) Mirror 25: 0x6f6adb06 (stale) Mirror 26: 0x3d1c9fef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25da3): Mirror 5: 0x8b8e0972 (stale) Mirror 11: 0x8b8e0972 (stale) Mirror 13: 0x8b8e0972 (stale) Mirror 14: 0x8b8e0972 (stale) Mirror 16: 0x8b8e0972 (stale) Mirror 17: 0x8b8e0972 (stale) Mirror 21: 0x8b8e0972 (stale) Mirror 22: 0xcab6bed1 (stale) Mirror 23: 0xcab6bed1 (stale) Mirror 24: 0x6f6adb06 (stale) Mirror 25: 0x6f6adb06 (stale) Mirror 26: 0x3d1c9fef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25da3: skipped 000491 1789602812.760992 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25da3): Mirror 5: 0x8b8e0972 (stale) Mirror 11: 0x8b8e0972 (stale) Mirror 13: 0x8b8e0972 (stale) Mirror 14: 0x8b8e0972 (stale) Mirror 17: 0x8b8e0972 (stale) Mirror 21: 0x8b8e0972 (stale) Mirror 22: 0xcab6bed1 (stale) Mirror 23: 0xcab6bed1 (stale) Mirror 24: 0x6f6adb06 (stale) Mirror 25: 0x6f6adb06 (stale) Mirror 26: 0x3d1c9fef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25da3): Mirror 5: 0x8b8e0972 (stale) Mirror 11: 0x8b8e0972 (stale) Mirror 13: 0x8b8e0972 (stale) Mirror 14: 0x8b8e0972 (stale) Mirror 17: 0x8b8e0972 (stale) Mirror 21: 0x8b8e0972 (stale) Mirror 22: 0xcab6bed1 (stale) Mirror 23: 0xcab6bed1 (stale) Mirror 24: 0x6f6adb06 (stale) Mirror 25: 0x6f6adb06 (stale) Mirror 26: 0x3d1c9fef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25da3: skipped 000493 1789602813.711922 write 0x0156f8 thru 0x025552 (0xfe5b bytes) 000494 1789602813.733941 mapwrite 0x01ed8a thru 0x021107 (0x237e bytes) 000495 1789602813.787972 write 0x02f13a thru 0x0392dc (0xa1a3 bytes) 000496 1789602813.789424 punch from 0x02e938 to 0x0392dc (0xa9a5 bytes) 000497 1789602813.813096 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392dd): Mirror 5: 0xbcd24c6c (stale) Mirror 11: 0xbcd24c6c (stale) Mirror 13: 0xbcd24c6c (stale) Mirror 14: 0xbcd24c6c (stale) Mirror 21: 0xbcd24c6c (stale) Mirror 22: 0x8958fbb4 (stale) Mirror 23: 0x8958fbb4 (stale) Mirror 24: 0xf0d5a131 (stale) Mirror 25: 0xa5753233 (stale) Mirror 26: 0x193c5a6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392dd): Mirror 5: 0xbcd24c6c (stale) Mirror 11: 0xbcd24c6c (stale) Mirror 13: 0xbcd24c6c (stale) Mirror 14: 0xbcd24c6c (stale) Mirror 21: 0xbcd24c6c (stale) Mirror 22: 0x8958fbb4 (stale) Mirror 23: 0x8958fbb4 (stale) Mirror 24: 0xf0d5a131 (stale) Mirror 25: 0xa5753233 (stale) Mirror 26: 0x193c5a6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392dd: skipped 000498 1789602814.474576 write 0x022244 thru 0x02549b (0x3258 bytes) 000499 1789602814.495688 MIRROR_RESYNC 11 mirrors 000500 1789602817.313620 write 0x011398 thru 0x011ddb (0xa44 bytes) 000501 1789602817.654987 mapwrite 0x03f055 thru 0x03ffff (0xfab bytes) 000502 1789602817.924825 write 0x035644 thru 0x039207 (0x3bc4 bytes) 000503 1789602817.958856 punch from 0x03d77f to 0x03ffff (0x2881 bytes) 000504 1789602817.986377 mapread 0x01d53b thru 0x027ed5 (0xa99b bytes) 000505 1789602818.096128 punch from 0x0358d7 to 0x03cb61 (0x728b bytes) 000507 1789602818.116290 mapwrite 0x007179 thru 0x00a5f4 (0x347c bytes) 000508 1789602818.236759 punch from 0x02e85f to 0x02f2cf (0xa71 bytes) 000510 1789602818.254343 mapwrite 0x03c367 thru 0x03ffff (0x3c99 bytes) 000512 1789602818.402822 write 0x0154a5 thru 0x020966 (0xb4c2 bytes) 000514 1789602818.416262 read 0x0309ea thru 0x032732 (0x1d49 bytes) 000515 1789602818.440543 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xead7c479 (stale) Mirror 11: 0xead7c479 (stale) Mirror 13: 0xead7c479 (stale) Mirror 14: 0xead7c479 (stale) Mirror 21: 0xead7c479 (stale) Mirror 22: 0xead7c479 (stale) Mirror 23: 0xead7c479 (stale) Mirror 24: 0xead7c479 (stale) Mirror 25: 0xead7c479 (stale) Mirror 26: 0xead7c479 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd215697 Mirror 27: 0xd215697 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000517 1789602820.084901 MIRROR_RESYNC 12 mirrors 000518 1789602823.450425 mapwrite 0x00b1b2 thru 0x018e97 (0xdce6 bytes) 000522 1789602823.804702 mapwrite 0x03fe46 thru 0x03ffff (0x1ba bytes) 000524 1789602823.949023 write 0x01dc79 thru 0x026065 (0x83ed bytes) 000525 1789602823.964459 read 0x027d7a thru 0x0307d5 (0x8a5c bytes) 000526 1789602823.977971 trunc from 0x040000 to 0x035f43 (0xa0bc bytes) 000528 1789602824.026316 mapread 0x025652 thru 0x0256ae (0x5d bytes) 000530 1789602824.030686 write 0x037c02 thru 0x03a8be (0x2cbd bytes) 000531 1789602824.032719 read 0x00a1cd thru 0x00d556 (0x338a bytes) 000532 1789602824.034305 punch from 0x033712 to 0x037cf0 (0x45df bytes) 000534 1789602824.061683 write 0x03a777 thru 0x03ffff (0x5889 bytes) 000536 1789602824.071098 punch from 0x01ccaa to 0x024881 (0x7bd8 bytes) 000538 1789602824.099690 mapread 0x02900a thru 0x0355a1 (0xc598 bytes) 000540 1789602824.125863 read 0x03d97d thru 0x03ffff (0x2683 bytes) 000541 1789602824.126488 mapread 0x01c8d7 thru 0x02883b (0xbf65 bytes) 000542 1789602824.127480 mapwrite 0x03ee59 thru 0x03ffff (0x11a7 bytes) 000543 1789602824.240291 read 0x01c3b8 thru 0x020180 (0x3dc9 bytes) 000544 1789602824.240950 mapread 0x0013db thru 0x007fb6 (0x6bdc bytes) 000545 1789602824.241875 mapwrite 0x005c17 thru 0x012dc0 (0xd1aa bytes) 000546 1789602824.401000 read 0x024e8f thru 0x02abba (0x5d2c bytes) 000548 1789602824.407215 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd215697 (stale) Mirror 11: 0xd215697 (stale) Mirror 13: 0xd215697 (stale) Mirror 14: 0xd215697 (stale) Mirror 22: 0xd215697 (stale) Mirror 23: 0xd215697 (stale) Mirror 24: 0xd215697 (stale) Mirror 25: 0xd215697 (stale) Mirror 26: 0xd215697 (stale) Mirror 27: 0xd215697 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd215697 (stale) Mirror 11: 0xd215697 (stale) Mirror 13: 0xd215697 (stale) Mirror 14: 0xd215697 (stale) Mirror 22: 0xd215697 (stale) Mirror 23: 0xd215697 (stale) Mirror 24: 0xd215697 (stale) Mirror 25: 0xd215697 (stale) Mirror 26: 0xd215697 (stale) Mirror 27: 0xd215697 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000549 1789602825.678038 mapread 0x0179a1 thru 0x01ca51 (0x50b1 bytes) 000551 1789602825.717764 write 0x024540 thru 0x032712 (0xe1d3 bytes) 000552 1789602825.739947 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd215697 (stale) Mirror 11: 0xd215697 (stale) Mirror 13: 0xd215697 (stale) Mirror 14: 0xd215697 (stale) Mirror 22: 0xd215697 (stale) Mirror 23: 0xd215697 (stale) Mirror 24: 0xd215697 (stale) Mirror 25: 0xd215697 (stale) Mirror 26: 0xd215697 (stale) Mirror 27: 0xd215697 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x54713fed Mirror 28: 0x54713fed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000553 1789602827.492929 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd215697 (stale) Mirror 11: 0xd215697 (stale) Mirror 13: 0xd215697 (stale) Mirror 14: 0xd215697 (stale) Mirror 22: 0xd215697 (stale) Mirror 23: 0xd215697 (stale) Mirror 24: 0xd215697 (stale) Mirror 25: 0xd215697 (stale) Mirror 26: 0xd215697 (stale) Mirror 27: 0xd215697 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x54713fed Mirror 28: 0x54713fed Mirror 29: 0x54713fed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000555 1789602829.357584 write 0x020652 thru 0x02b6e0 (0xb08f bytes) 000556 1789602829.687477 mapwrite 0x00a032 thru 0x0112bb (0x728a bytes) 000560 1789602829.828084 trunc from 0x040000 to 0x0083c9 (0x37c36 bytes) 000561 1789602829.880732 mapread 0x007726 thru 0x0083c9 (0xca4 bytes) 000562 1789602829.882202 mapread 0x0011c8 thru 0x0083c9 (0x7202 bytes) 000564 1789602829.891915 trunc from 0x0083ca to 0x00e608 (0x623f bytes) 000565 1789602829.930320 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0xe609): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe609): Mirror 5: 0x7cb2dac6 (stale) Mirror 11: 0x7cb2dac6 (stale) Mirror 13: 0x7cb2dac6 (stale) Mirror 14: 0x7cb2dac6 (stale) Mirror 22: 0x7cb2dac6 (stale) Mirror 23: 0x7cb2dac6 (stale) Mirror 24: 0x7cb2dac6 (stale) Mirror 25: 0x7cb2dac6 (stale) Mirror 26: 0x7cb2dac6 (stale) Mirror 27: 0x7cb2dac6 (stale) Mirror 28: 0x27040a11 (stale) Mirror 29: 0x27040a11 (stale) CRC-32 checksum value for chunk [0, 0xe609): Mirror 1: 0x942fbd9b Mirror 30: 0x942fbd9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe609: skipped 000566 1789602831.648413 read 0x000e03 thru 0x00e5f2 (0xd7f0 bytes) 000567 1789602831.665878 read 0x00a525 thru 0x00e608 (0x40e4 bytes) 000568 1789602831.666960 mapread 0x00211b thru 0x00ab98 (0x8a7e bytes) 000569 1789602831.668800 punch from 0x0045e1 to 0x00e608 (0xa028 bytes) 000571 1789602831.799997 trunc from 0x00e609 to 0x022a64 (0x1445c bytes) 000573 1789602831.834643 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x22a65): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22a65): Mirror 5: 0xebdbc9f0 (stale) Mirror 11: 0xebdbc9f0 (stale) Mirror 13: 0xebdbc9f0 (stale) Mirror 14: 0xebdbc9f0 (stale) Mirror 22: 0xebdbc9f0 (stale) Mirror 23: 0xebdbc9f0 (stale) Mirror 24: 0xebdbc9f0 (stale) Mirror 25: 0xebdbc9f0 (stale) Mirror 26: 0xebdbc9f0 (stale) Mirror 27: 0xebdbc9f0 (stale) Mirror 28: 0x1b1b0586 (stale) Mirror 29: 0x1b1b0586 (stale) Mirror 30: 0x761be30f (stale) CRC-32 checksum value for chunk [0, 0x22a65): Mirror 1: 0xf36d2e0a Mirror 31: 0xf36d2e0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22a65: skipped 000576 1789602833.567552 punch from 0x01741c to 0x01f7f9 (0x83de bytes) 000577 1789602833.679814 trunc from 0x022a65 to 0x038f28 (0x164c4 bytes) 000580 1789602833.707334 read 0x0226b3 thru 0x025f6e (0x38bc bytes) 000582 1789602833.717156 trunc from 0x038f29 to 0x01c5e4 (0x1c944 bytes) 000583 1789602833.744349 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1c5e5): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c5e5): Mirror 5: 0x7f261567 (stale) Mirror 11: 0x7f261567 (stale) Mirror 13: 0x7f261567 (stale) Mirror 14: 0x7f261567 (stale) Mirror 22: 0x7f261567 (stale) Mirror 23: 0x7f261567 (stale) Mirror 24: 0x7f261567 (stale) Mirror 25: 0x7f261567 (stale) Mirror 26: 0x7f261567 (stale) Mirror 27: 0x7f261567 (stale) Mirror 28: 0x3982dab5 (stale) Mirror 29: 0x3982dab5 (stale) Mirror 30: 0x6e1a984f (stale) Mirror 31: 0x7a9577 (stale) CRC-32 checksum value for chunk [0, 0x1c5e5): Mirror 1: 0x7a9577 Mirror 32: 0x7a9577 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c5e5: skipped 000586 1789602835.867432 trunc from 0x01c5e5 to 0x035e45 (0x19861 bytes) 000587 1789602836.206158 trunc from 0x035e46 to 0x031a00 (0x4445 bytes) 000589 1789602836.278461 mapwrite 0x02a55a thru 0x02ff4e (0x59f5 bytes) 000590 1789602836.627477 trunc from 0x031a01 to 0x02d708 (0x42f8 bytes) 000591 1789602836.677148 write 0x011eb0 thru 0x013b74 (0x1cc5 bytes) 000592 1789602836.719102 write 0x019514 thru 0x021758 (0x8245 bytes) 000593 1789602836.765912 write 0x03dd58 thru 0x03ffff (0x22a8 bytes) 000594 1789602836.769508 mapread 0x02087d thru 0x024f25 (0x46a9 bytes) 000595 1789602836.791428 mapread 0x0393d1 thru 0x03ffff (0x6c2f bytes) 000596 1789602836.805091 trunc from 0x040000 to 0x004e2b (0x3b1d4 bytes) 000598 1789602836.867492 write 0x002395 thru 0x004f38 (0x2ba4 bytes) 000599 1789602836.888055 write 0x031cc4 thru 0x03ddea (0xc127 bytes) 000600 1789602836.907812 MIRROR_RESYNC 16 mirrors 000601 1789602844.603142 MIRROR_RESYNC 16 mirrors 000602 1789602845.731899 write 0x02ba69 thru 0x032af2 (0x708a bytes) 000605 1789602845.955381 punch from 0x02bf37 to 0x02f018 (0x30e2 bytes) 000606 1789602845.992694 read 0x02d343 thru 0x033721 (0x63df bytes) 000607 1789602846.013200 mapwrite 0x00bd64 thru 0x00e12e (0x23cb bytes) 000608 1789602846.153015 punch from 0x014828 to 0x01551f (0xcf8 bytes) 000611 1789602846.159287 mapread 0x02bc6c thru 0x0337fd (0x7b92 bytes) 000612 1789602846.187964 write 0x00d451 thru 0x015ed9 (0x8a89 bytes) 000613 1789602846.200461 punch from 0x004f99 to 0x013b7f (0xebe7 bytes) 000614 1789602846.240778 punch from 0x03b04b to 0x03ddea (0x2da0 bytes) 000615 1789602846.263696 punch from 0x0353d3 to 0x03a68e (0x52bc bytes) 000616 1789602846.277779 trunc from 0x03ddeb to 0x00dbb5 (0x30235 bytes) 000618 1789602846.314945 trunc from 0x00dbb6 to 0x0282f1 (0x1a73c bytes) 000619 1789602846.346122 mapread 0x012eb4 thru 0x014997 (0x1ae4 bytes) 000623 1789602846.382183 trunc from 0x0282f2 to 0x014201 (0x140f0 bytes) 000625 1789602846.433420 mapread 0x010f7c thru 0x014201 (0x3286 bytes) 000627 1789602846.448700 mapread 0x013ac5 thru 0x014201 (0x73d bytes) 000628 1789602846.449814 punch from 0x003d0a to 0x00b22c (0x7523 bytes) 000629 1789602846.461770 write 0x02bcd6 thru 0x02d6ea (0x1a15 bytes) 000630 1789602846.465751 trunc from 0x02d6eb to 0x01b826 (0x11ec4 bytes) 000631 1789602846.509866 write 0x000b68 thru 0x005f08 (0x53a1 bytes) 000632 1789602846.542986 write 0x01feaa thru 0x02201f (0x2176 bytes) 000633 1789602846.548125 mapread 0x01bff4 thru 0x02201f (0x602c bytes) 000634 1789602846.569063 punch from 0x002fa6 to 0x00c368 (0x93c3 bytes) 000635 1789602846.618287 mapread 0x00f9a6 thru 0x01368a (0x3ce5 bytes) 000636 1789602846.626656 punch from 0x006849 to 0x0138d0 (0xd088 bytes) 000637 1789602846.645662 MIRROR_RESYNC 16 mirrors 000638 1789602850.520069 punch from 0x018c4c to 0x019e3c (0x11f1 bytes) 000642 1789602850.621196 mapread 0x00a511 thru 0x014eca (0xa9ba bytes) 000644 1789602850.648964 trunc from 0x022020 to 0x03ca5f (0x1aa40 bytes) 000645 1789602850.673105 punch from 0x00ca6b to 0x0128ed (0x5e83 bytes) 000646 1789602850.679257 write 0x01c32b thru 0x023417 (0x70ed bytes) 000647 1789602850.696565 trunc from 0x03ca60 to 0x021079 (0x1b9e6 bytes) 000648 1789602850.737161 write 0x003538 thru 0x00fecf (0xc998 bytes) 000650 1789602850.767108 write 0x00bd86 thru 0x016513 (0xa78e bytes) 000651 1789602850.787926 write 0x00bd16 thru 0x00dd84 (0x206f bytes) 000652 1789602850.788838 mapread 0x0145f5 thru 0x01916e (0x4b7a bytes) 000653 1789602850.805069 mapread 0x0047cc thru 0x00aaf6 (0x632b bytes) 000656 1789602850.811202 trunc from 0x02107a to 0x01a5ad (0x6acc bytes) 000657 1789602850.849533 mapread 0x017250 thru 0x01a5ad (0x335e bytes) 000659 1789602850.856529 write 0x005bc3 thru 0x007caa (0x20e8 bytes) 000660 1789602850.857945 write 0x008465 thru 0x017062 (0xebfe bytes) 000662 1789602850.861010 mapwrite 0x020aa0 thru 0x02aecc (0xa42d bytes) 000663 1789602851.023257 mapwrite 0x01d433 thru 0x024135 (0x6d03 bytes) 000664 1789602851.109328 MIRROR_RESYNC 16 mirrors 000666 1789602853.871726 mapread 0x014227 thru 0x023aff (0xf8d9 bytes) 000668 1789602853.899744 trunc from 0x02aecd to 0x00c3a5 (0x1eb27 bytes) 000669 1789602854.030354 mapwrite 0x01f129 thru 0x02c327 (0xd1ff bytes) 000671 1789602854.153061 mapwrite 0x005e31 thru 0x00e434 (0x8604 bytes) 000672 1789602854.217360 write 0x01fe29 thru 0x029d19 (0x9ef1 bytes) 000673 1789602854.219086 read 0x027979 thru 0x02c327 (0x49af bytes) 000674 1789602854.223680 MIRROR_RESYNC 16 mirrors 000675 1789602858.722261 mapwrite 0x03ea12 thru 0x03ffff (0x15ee bytes) 000676 1789602859.141328 punch from 0x00d213 to 0x01ce5e (0xfc4c bytes) 000678 1789602859.164265 trunc from 0x040000 to 0x0058bd (0x3a742 bytes) 000679 1789602859.214376 write 0x031903 thru 0x035783 (0x3e81 bytes) 000680 1789602859.215664 punch from 0x008d13 to 0x0166f5 (0xd9e3 bytes) 000681 1789602859.247856 trunc from 0x035784 to 0x02b104 (0xa67f bytes) 000682 1789602859.283689 MIRROR_SPLIT mirror 12 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b105): Mirror 5: 0x9bf5d933 (stale) Mirror 11: 0x9bf5d933 (stale) Mirror 13: 0x9bf5d933 (stale) Mirror 14: 0x9bf5d933 (stale) Mirror 22: 0x9bf5d933 (stale) Mirror 23: 0x9bf5d933 (stale) Mirror 24: 0x9bf5d933 (stale) Mirror 25: 0x9bf5d933 (stale) Mirror 26: 0x9bf5d933 (stale) Mirror 27: 0x9bf5d933 (stale) Mirror 28: 0x9bf5d933 (stale) Mirror 30: 0x9bf5d933 (stale) Mirror 31: 0x9bf5d933 (stale) Mirror 32: 0x9bf5d933 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b105): Mirror 5: 0x9bf5d933 (stale) Mirror 11: 0x9bf5d933 (stale) Mirror 13: 0x9bf5d933 (stale) Mirror 14: 0x9bf5d933 (stale) Mirror 22: 0x9bf5d933 (stale) Mirror 23: 0x9bf5d933 (stale) Mirror 24: 0x9bf5d933 (stale) Mirror 25: 0x9bf5d933 (stale) Mirror 26: 0x9bf5d933 (stale) Mirror 27: 0x9bf5d933 (stale) Mirror 28: 0x9bf5d933 (stale) Mirror 30: 0x9bf5d933 (stale) Mirror 31: 0x9bf5d933 (stale) Mirror 32: 0x9bf5d933 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b105: skipped 000686 1789602860.351743 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b105): Mirror 11: 0x9bf5d933 (stale) Mirror 13: 0x9bf5d933 (stale) Mirror 14: 0x9bf5d933 (stale) Mirror 22: 0x9bf5d933 (stale) Mirror 23: 0x9bf5d933 (stale) Mirror 24: 0x9bf5d933 (stale) Mirror 25: 0x9bf5d933 (stale) Mirror 26: 0x9bf5d933 (stale) Mirror 27: 0x9bf5d933 (stale) Mirror 28: 0x9bf5d933 (stale) Mirror 30: 0x9bf5d933 (stale) Mirror 31: 0x9bf5d933 (stale) Mirror 32: 0x9bf5d933 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b105): Mirror 11: 0x9bf5d933 (stale) Mirror 13: 0x9bf5d933 (stale) Mirror 14: 0x9bf5d933 (stale) Mirror 22: 0x9bf5d933 (stale) Mirror 23: 0x9bf5d933 (stale) Mirror 24: 0x9bf5d933 (stale) Mirror 25: 0x9bf5d933 (stale) Mirror 26: 0x9bf5d933 (stale) Mirror 27: 0x9bf5d933 (stale) Mirror 28: 0x9bf5d933 (stale) Mirror 30: 0x9bf5d933 (stale) Mirror 31: 0x9bf5d933 (stale) Mirror 32: 0x9bf5d933 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b105: skipped 000688 1789602861.506035 trunc from 0x02b105 to 0x00b87d (0x1f887 bytes) 000690 1789602861.550730 trunc from 0x00b87e to 0x011dea (0x656d bytes) 000692 1789602861.585489 trunc from 0x011deb to 0x01cdc3 (0xafd9 bytes) 000693 1789602861.624185 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1cdc4): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cdc4): Mirror 11: 0x2ef1cef4 (stale) Mirror 13: 0x2ef1cef4 (stale) Mirror 14: 0x2ef1cef4 (stale) Mirror 22: 0x2ef1cef4 (stale) Mirror 23: 0x2ef1cef4 (stale) Mirror 24: 0x2ef1cef4 (stale) Mirror 25: 0x2ef1cef4 (stale) Mirror 26: 0x2ef1cef4 (stale) Mirror 27: 0x2ef1cef4 (stale) Mirror 28: 0x2ef1cef4 (stale) Mirror 30: 0x2ef1cef4 (stale) Mirror 31: 0x2ef1cef4 (stale) Mirror 32: 0x2ef1cef4 (stale) CRC-32 checksum value for chunk [0, 0x1cdc4): Mirror 1: 0xb947257 Mirror 33: 0xb947257 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cdc4: skipped 000694 1789602863.729815 trunc from 0x01cdc4 to 0x020d27 (0x3f64 bytes) 000696 1789602863.830411 punch from 0x0135d2 to 0x01bc08 (0x8637 bytes) 000698 1789602863.836490 mapread 0x002334 thru 0x004cc1 (0x298e bytes) 000699 1789602863.863384 punch from 0x00a633 to 0x010d1e (0x66ec bytes) 000700 1789602863.869364 read 0x01dfb5 thru 0x020d27 (0x2d73 bytes) 000701 1789602863.877014 trunc from 0x020d28 to 0x003e16 (0x1cf11 bytes) 000702 1789602863.906370 read 0x0025d5 thru 0x003e16 (0x1842 bytes) 000704 1789602863.908049 mapread 0x0019d1 thru 0x003e16 (0x2446 bytes) 000705 1789602863.909564 read 0x00167f thru 0x0024d0 (0xe52 bytes) 000706 1789602863.910857 trunc from 0x003e17 to 0x009a09 (0x5bf3 bytes) 000709 1789602863.933874 mapwrite 0x02b33f thru 0x037f68 (0xcc2a bytes) 000710 1789602864.029912 punch from 0x006118 to 0x00c62a (0x6513 bytes) 000711 1789602864.036288 mapwrite 0x022fa9 thru 0x030dc0 (0xde18 bytes) 000712 1789602864.094409 write 0x00031b thru 0x00b60e (0xb2f4 bytes) 000713 1789602864.109993 mapwrite 0x032fbf thru 0x03b5b5 (0x85f7 bytes) 000714 1789602864.380843 MIRROR_RESYNC 15 mirrors 000715 1789602868.225408 MIRROR_EXTEND to 16 mirrors 000716 1789602869.590510 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000717 1789602870.175968 mapwrite 0x01820e thru 0x024310 (0xc103 bytes) 000719 1789602870.410871 punch from 0x00f458 to 0x0138af (0x4458 bytes) 000721 1789602870.418277 punch from 0x01f288 to 0x028e07 (0x9b80 bytes) 000722 1789602870.423879 punch from 0x027d3e to 0x02cf5a (0x521d bytes) 000723 1789602870.429491 mapread 0x01d146 thru 0x02765a (0xa515 bytes) 000725 1789602870.443177 punch from 0x004412 to 0x01082a (0xc419 bytes) 000726 1789602870.448340 punch from 0x0058b6 to 0x00d62d (0x7d78 bytes) 000727 1789602870.454073 punch from 0x0023f6 to 0x004401 (0x200c bytes) 000728 1789602870.463890 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3b5b6): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b5b6): Mirror 11: 0x98f18fe1 (stale) Mirror 13: 0x98f18fe1 (stale) Mirror 14: 0x98f18fe1 (stale) Mirror 22: 0x98f18fe1 (stale) Mirror 23: 0x98f18fe1 (stale) Mirror 24: 0x98f18fe1 (stale) Mirror 25: 0x98f18fe1 (stale) Mirror 26: 0x98f18fe1 (stale) Mirror 28: 0x98f18fe1 (stale) Mirror 30: 0x98f18fe1 (stale) Mirror 31: 0x98f18fe1 (stale) Mirror 32: 0x98f18fe1 (stale) Mirror 33: 0x98f18fe1 (stale) Mirror 34: 0x98f18fe1 (stale) CRC-32 checksum value for chunk [0, 0x3b5b6): Mirror 1: 0x841a05e7 Mirror 35: 0x841a05e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b5b6: skipped 000731 1789602872.643349 punch from 0x00a7a7 to 0x00f196 (0x49f0 bytes) 000732 1789602872.765134 mapwrite 0x00697d thru 0x00b9c5 (0x5049 bytes) 000733 1789602872.853134 mapread 0x032fd3 thru 0x03a91a (0x7948 bytes) 000734 1789602872.876184 MIRROR_RESYNC 16 mirrors 000735 1789602877.379748 trunc from 0x03b5b6 to 0x014345 (0x27270 bytes) 000736 1789602877.472238 mapread 0x012229 thru 0x012568 (0x340 bytes) 000737 1789602877.478320 trunc from 0x014346 to 0x01e8f7 (0xa5b2 bytes) 000738 1789602877.514954 mapwrite 0x02ca63 thru 0x0378d1 (0xae6f bytes) 000739 1789602877.689034 read 0x01fb19 thru 0x02e632 (0xeb1a bytes) 000740 1789602877.703217 trunc from 0x0378d2 to 0x028374 (0xf55d bytes) 000745 1789602877.735281 write 0x01711b thru 0x018fb7 (0x1e9d bytes) 000746 1789602877.749020 punch from 0x021df9 to 0x028374 (0x657c bytes) 000747 1789602877.760661 mapread 0x0160e7 thru 0x0178f7 (0x1811 bytes) 000749 1789602877.781178 write 0x02474c thru 0x0295c8 (0x4e7d bytes) 000750 1789602877.790311 mapwrite 0x03ad49 thru 0x03ffff (0x52b7 bytes) 000752 1789602877.992018 punch from 0x01ccf5 to 0x025647 (0x8953 bytes) 000753 1789602878.016588 write 0x00a7aa thru 0x00e52c (0x3d83 bytes) 000756 1789602878.042497 trunc from 0x040000 to 0x0029b3 (0x3d64c bytes) 000757 1789602878.062953 mapread 0x000513 thru 0x0029b3 (0x24a1 bytes) 000758 1789602878.069758 mapwrite 0x015d51 thru 0x024367 (0xe617 bytes) 000759 1789602878.155097 mapwrite 0x02eb34 thru 0x03bb47 (0xd014 bytes) 000760 1789602878.241428 mapread 0x02c214 thru 0x031340 (0x512d bytes) 000761 1789602878.246930 write 0x031fed thru 0x03cc46 (0xac5a bytes) 000764 1789602878.252184 write 0x001ed0 thru 0x006d00 (0x4e31 bytes) 000765 1789602878.259308 write 0x010c2d thru 0x0190e9 (0x84bd bytes) 000766 1789602878.261147 punch from 0x02c7c1 to 0x036af9 (0xa339 bytes) 000767 1789602878.284835 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc47): Mirror 11: 0x469c15ac (stale) Mirror 13: 0x469c15ac (stale) Mirror 14: 0x469c15ac (stale) Mirror 22: 0x469c15ac (stale) Mirror 23: 0x469c15ac (stale) Mirror 24: 0x469c15ac (stale) Mirror 26: 0x469c15ac (stale) Mirror 28: 0x469c15ac (stale) Mirror 30: 0x469c15ac (stale) Mirror 31: 0x469c15ac (stale) Mirror 32: 0x469c15ac (stale) Mirror 33: 0x469c15ac (stale) Mirror 34: 0x469c15ac (stale) Mirror 35: 0x469c15ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc47): Mirror 11: 0x469c15ac (stale) Mirror 13: 0x469c15ac (stale) Mirror 14: 0x469c15ac (stale) Mirror 22: 0x469c15ac (stale) Mirror 23: 0x469c15ac (stale) Mirror 24: 0x469c15ac (stale) Mirror 26: 0x469c15ac (stale) Mirror 28: 0x469c15ac (stale) Mirror 30: 0x469c15ac (stale) Mirror 31: 0x469c15ac (stale) Mirror 32: 0x469c15ac (stale) Mirror 33: 0x469c15ac (stale) Mirror 34: 0x469c15ac (stale) Mirror 35: 0x469c15ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc47: skipped 000768 1789602879.244693 mapread 0x026f16 thru 0x02d266 (0x6351 bytes) 000769 1789602879.268075 read 0x002f1e thru 0x00b37a (0x845d bytes) 000770 1789602879.278770 read 0x036832 thru 0x03cc46 (0x6415 bytes) 000771 1789602879.289917 trunc from 0x03cc47 to 0x031193 (0xbab3 bytes) 000772 1789602879.310160 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31194): Mirror 11: 0x6fcca5fe (stale) Mirror 13: 0x6fcca5fe (stale) Mirror 14: 0x6fcca5fe (stale) Mirror 23: 0x6fcca5fe (stale) Mirror 24: 0x6fcca5fe (stale) Mirror 26: 0x6fcca5fe (stale) Mirror 28: 0x6fcca5fe (stale) Mirror 30: 0x6fcca5fe (stale) Mirror 31: 0x6fcca5fe (stale) Mirror 32: 0x6fcca5fe (stale) Mirror 33: 0x6fcca5fe (stale) Mirror 34: 0x6fcca5fe (stale) Mirror 35: 0x6fcca5fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31194): Mirror 11: 0x6fcca5fe (stale) Mirror 13: 0x6fcca5fe (stale) Mirror 14: 0x6fcca5fe (stale) Mirror 23: 0x6fcca5fe (stale) Mirror 24: 0x6fcca5fe (stale) Mirror 26: 0x6fcca5fe (stale) Mirror 28: 0x6fcca5fe (stale) Mirror 30: 0x6fcca5fe (stale) Mirror 31: 0x6fcca5fe (stale) Mirror 32: 0x6fcca5fe (stale) Mirror 33: 0x6fcca5fe (stale) Mirror 34: 0x6fcca5fe (stale) Mirror 35: 0x6fcca5fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31194: skipped 000773 1789602880.058019 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x31194): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31194): Mirror 11: 0x6fcca5fe (stale) Mirror 13: 0x6fcca5fe (stale) Mirror 14: 0x6fcca5fe (stale) Mirror 23: 0x6fcca5fe (stale) Mirror 24: 0x6fcca5fe (stale) Mirror 26: 0x6fcca5fe (stale) Mirror 28: 0x6fcca5fe (stale) Mirror 30: 0x6fcca5fe (stale) Mirror 31: 0x6fcca5fe (stale) Mirror 32: 0x6fcca5fe (stale) Mirror 33: 0x6fcca5fe (stale) Mirror 34: 0x6fcca5fe (stale) Mirror 35: 0x6fcca5fe (stale) CRC-32 checksum value for chunk [0, 0x31194): Mirror 1: 0x10d06b7b Mirror 36: 0x10d06b7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31194: skipped 000774 1789602881.741325 punch from 0x0224b8 to 0x02bc3c (0x9785 bytes) 000775 1789602881.850772 write 0x0016d3 thru 0x00caa9 (0xb3d7 bytes) 000776 1789602881.861080 mapwrite 0x029d20 thru 0x0321c5 (0x84a6 bytes) 000777 1789602881.958817 punch from 0x02573f to 0x026a4f (0x1311 bytes) 000778 1789602881.964691 punch from 0x01128a to 0x018721 (0x7498 bytes) 000779 1789602881.971648 read 0x02424b thru 0x0259d5 (0x178b bytes) 000782 1789602881.981761 read 0x006fb7 thru 0x00f524 (0x856e bytes) 000784 1789602882.005530 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x321c6): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321c6): Mirror 11: 0x70318dc5 (stale) Mirror 13: 0x70318dc5 (stale) Mirror 14: 0x70318dc5 (stale) Mirror 23: 0x70318dc5 (stale) Mirror 24: 0x70318dc5 (stale) Mirror 26: 0x70318dc5 (stale) Mirror 28: 0x70318dc5 (stale) Mirror 30: 0x70318dc5 (stale) Mirror 31: 0x70318dc5 (stale) Mirror 32: 0x70318dc5 (stale) Mirror 33: 0x70318dc5 (stale) Mirror 34: 0x70318dc5 (stale) Mirror 35: 0x70318dc5 (stale) Mirror 36: 0x951176e0 (stale) CRC-32 checksum value for chunk [0, 0x321c6): Mirror 1: 0xd8101f26 Mirror 37: 0xd8101f26 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321c6: skipped 000786 1789602883.543894 read 0x003a5d thru 0x00b642 (0x7be6 bytes) 000787 1789602883.571971 mapwrite 0x036c8d thru 0x03ffff (0x9373 bytes) 000788 1789602883.890303 MIRROR_RESYNC 16 mirrors 000789 1789602886.828229 MIRROR_RESYNC 16 mirrors 000790 1789602887.943300 write 0x029d7d thru 0x02e44d (0x46d1 bytes) 000791 1789602888.064351 mapwrite 0x015737 thru 0x0256d2 (0xff9c bytes) 000792 1789602888.181475 mapread 0x0003df thru 0x00a231 (0x9e53 bytes) 000793 1789602888.198408 read 0x007b3f thru 0x0098a2 (0x1d64 bytes) 000794 1789602888.200150 mapwrite 0x00357d thru 0x012c66 (0xf6ea bytes) 000796 1789602888.252455 trunc from 0x040000 to 0x011759 (0x2e8a6 bytes) 000798 1789602888.296906 trunc from 0x01175a to 0x028769 (0x17010 bytes) 000799 1789602888.345275 read 0x028697 thru 0x028769 (0xd3 bytes) 000801 1789602888.383848 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2876a): Mirror 11: 0x8ea267ee (stale) Mirror 13: 0x8ea267ee (stale) Mirror 14: 0x8ea267ee (stale) Mirror 23: 0x8ea267ee (stale) Mirror 24: 0x8ea267ee (stale) Mirror 26: 0x8ea267ee (stale) Mirror 28: 0x8ea267ee (stale) Mirror 30: 0x8ea267ee (stale) Mirror 31: 0x8ea267ee (stale) Mirror 32: 0x8ea267ee (stale) Mirror 33: 0x8ea267ee (stale) Mirror 34: 0x8ea267ee (stale) Mirror 35: 0x8ea267ee (stale) Mirror 37: 0x8ea267ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2876a): Mirror 11: 0x8ea267ee (stale) Mirror 13: 0x8ea267ee (stale) Mirror 14: 0x8ea267ee (stale) Mirror 23: 0x8ea267ee (stale) Mirror 24: 0x8ea267ee (stale) Mirror 26: 0x8ea267ee (stale) Mirror 28: 0x8ea267ee (stale) Mirror 30: 0x8ea267ee (stale) Mirror 31: 0x8ea267ee (stale) Mirror 32: 0x8ea267ee (stale) Mirror 33: 0x8ea267ee (stale) Mirror 34: 0x8ea267ee (stale) Mirror 35: 0x8ea267ee (stale) Mirror 37: 0x8ea267ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2876a: skipped 000803 1789602889.477450 trunc from 0x02876a to 0x01232c (0x1643d bytes) 000805 1789602889.525248 mapread 0x0031cb thru 0x00db43 (0xa979 bytes) 000806 1789602889.573112 read 0x009d74 thru 0x01232c (0x85b9 bytes) 000807 1789602889.583381 trunc from 0x01232d to 0x03a9f5 (0x286c9 bytes) 000808 1789602889.615817 mapread 0x0189fc thru 0x0241f5 (0xb7fa bytes) 000810 1789602889.642965 mapwrite 0x004bd7 thru 0x012cf9 (0xe123 bytes) 000811 1789602889.762396 mapread 0x0393c3 thru 0x03a9f5 (0x1633 bytes) 000812 1789602889.771810 mapwrite 0x02d9b5 thru 0x030fce (0x361a bytes) 000813 1789602889.829186 mapwrite 0x008bce thru 0x00dad8 (0x4f0b bytes) 000814 1789602889.869853 punch from 0x0073b6 to 0x00d225 (0x5e70 bytes) 000816 1789602889.876078 read 0x01390c thru 0x01a4ff (0x6bf4 bytes) 000817 1789602889.877264 read 0x033fec thru 0x036dd2 (0x2de7 bytes) 000818 1789602889.878685 mapread 0x001eba thru 0x00942e (0x7575 bytes) 000819 1789602889.888011 trunc from 0x03a9f6 to 0x027a98 (0x12f5d bytes) 000820 1789602889.904926 punch from 0x00d5d8 to 0x00e8a8 (0x12d1 bytes) 000822 1789602889.912288 read 0x021d9d thru 0x026ef8 (0x515c bytes) 000823 1789602889.918297 MIRROR_RESYNC 15 mirrors 000825 1789602893.254706 punch from 0x007d65 to 0x0139c0 (0xbc5c bytes) 000827 1789602893.371315 MIRROR_RESYNC 15 mirrors 000828 1789602898.938416 MIRROR_SPLIT mirror 3 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000829 1789602899.660945 write 0x03e264 thru 0x03ffff (0x1d9c bytes) 000831 1789602899.767766 write 0x01c2cb thru 0x025082 (0x8db8 bytes) 000833 1789602899.802617 punch from 0x00d09c to 0x013726 (0x668b bytes) 000835 1789602899.828158 write 0x037601 thru 0x03ffff (0x89ff bytes) 000839 1789602899.839054 punch from 0x03e9bd to 0x03ffff (0x1643 bytes) 000840 1789602899.884095 punch from 0x005547 to 0x00be5d (0x6917 bytes) 000841 1789602899.894176 write 0x01ffff thru 0x02ac5c (0xac5e bytes) 000842 1789602899.908048 mapwrite 0x021636 thru 0x022acc (0x1497 bytes) 000843 1789602900.020211 mapwrite 0x017147 thru 0x022c59 (0xbb13 bytes) 000844 1789602900.096254 write 0x032cc7 thru 0x03cda6 (0xa0e0 bytes) 000845 1789602900.102356 mapread 0x020e8b thru 0x027c44 (0x6dba bytes) 000846 1789602900.104209 mapread 0x02d3e2 thru 0x0341cf (0x6dee bytes) 000847 1789602900.118995 MIRROR_RESYNC 14 mirrors 000848 1789602904.221581 trunc from 0x040000 to 0x0147ac (0x2b853 bytes) 000849 1789602904.331471 mapread 0x013e66 thru 0x0147ac (0x947 bytes) 000850 1789602904.345215 write 0x01f7ce thru 0x025a0a (0x623d bytes) 000851 1789602904.347712 mapread 0x00f576 thru 0x01495b (0x53e6 bytes) 000852 1789602904.383227 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x25a0b): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a0b): Mirror 11: 0x2c17689f (stale) Mirror 13: 0x2c17689f (stale) Mirror 23: 0x2c17689f (stale) Mirror 24: 0x2c17689f (stale) Mirror 26: 0x2c17689f (stale) Mirror 28: 0x2c17689f (stale) Mirror 30: 0x2c17689f (stale) Mirror 31: 0x2c17689f (stale) Mirror 32: 0x2c17689f (stale) Mirror 33: 0x2c17689f (stale) Mirror 34: 0x2c17689f (stale) Mirror 35: 0x2c17689f (stale) Mirror 37: 0x2c17689f (stale) CRC-32 checksum value for chunk [0, 0x25a0b): Mirror 1: 0x6005f8c6 Mirror 38: 0x6005f8c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a0b: skipped 000853 1789602905.779512 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x25a0b): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a0b): Mirror 11: 0x2c17689f (stale) Mirror 13: 0x2c17689f (stale) Mirror 23: 0x2c17689f (stale) Mirror 24: 0x2c17689f (stale) Mirror 26: 0x2c17689f (stale) Mirror 28: 0x2c17689f (stale) Mirror 30: 0x2c17689f (stale) Mirror 31: 0x2c17689f (stale) Mirror 32: 0x2c17689f (stale) Mirror 33: 0x2c17689f (stale) Mirror 34: 0x2c17689f (stale) Mirror 35: 0x2c17689f (stale) Mirror 37: 0x2c17689f (stale) CRC-32 checksum value for chunk [0, 0x25a0b): Mirror 1: 0x6005f8c6 Mirror 38: 0x6005f8c6 Mirror 39: 0x6005f8c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a0b: skipped 000854 1789602907.310428 punch from 0x02237e to 0x025a0a (0x368d bytes) 000856 1789602907.450215 trunc from 0x025a0b to 0x037287 (0x1187d bytes) 000857 1789602907.557765 write 0x037fef thru 0x03ba4a (0x3a5c bytes) 000859 1789602907.593124 mapread 0x0258c8 thru 0x0304d5 (0xac0e bytes) 000860 1789602907.653776 read 0x026ae3 thru 0x03067b (0x9b99 bytes) 000861 1789602907.654520 mapwrite 0x00aa29 thru 0x0147bc (0x9d94 bytes) 000863 1789602907.775244 mapwrite 0x0182db thru 0x01df93 (0x5cb9 bytes) 000864 1789602907.824377 write 0x015dc0 thru 0x02097b (0xabbc bytes) 000865 1789602907.851591 MIRROR_RESYNC 16 mirrors 000866 1789602912.378564 mapread 0x01c2c1 thru 0x01ecb0 (0x29f0 bytes) 000867 1789602912.399475 trunc from 0x03ba4b to 0x022704 (0x19346 bytes) 000868 1789602912.536420 punch from 0x003229 to 0x003537 (0x30f bytes) 000869 1789602912.542957 write 0x01bd0d thru 0x0242db (0x85cf bytes) 000870 1789602912.549883 mapread 0x00316f thru 0x00cba4 (0x9a36 bytes) 000871 1789602912.561489 write 0x01e589 thru 0x027dd3 (0x984b bytes) 000872 1789602912.564196 mapwrite 0x02724b thru 0x02af20 (0x3cd6 bytes) 000873 1789602912.660460 read 0x02a432 thru 0x02af20 (0xaef bytes) 000874 1789602912.661867 mapwrite 0x02f46c thru 0x037571 (0x8106 bytes) 000875 1789602912.793637 read 0x029cf6 thru 0x02bb29 (0x1e34 bytes) 000876 1789602912.799837 write 0x003263 thru 0x006be6 (0x3984 bytes) 000877 1789602912.803382 mapread 0x024636 thru 0x02ca91 (0x845c bytes) 000878 1789602912.804514 mapread 0x02489d thru 0x029ace (0x5232 bytes) 000879 1789602912.809584 mapwrite 0x017dc1 thru 0x01f51d (0x775d bytes) 000880 1789602912.928175 read 0x0002fb thru 0x004577 (0x427d bytes) 000882 1789602912.929475 punch from 0x010827 to 0x015d3e (0x5518 bytes) 000883 1789602912.939960 punch from 0x030d01 to 0x031e6a (0x116a bytes) 000884 1789602912.958633 trunc from 0x037572 to 0x02dfa4 (0x95cd bytes) 000885 1789602912.986203 trunc from 0x02dfa5 to 0x001923 (0x2c681 bytes) 000886 1789602913.046504 mapread 0x001529 thru 0x001923 (0x3fb bytes) 000888 1789602913.056146 read 0x00182b thru 0x001923 (0xf9 bytes) 000889 1789602913.057124 read 0x00091f thru 0x001923 (0x1005 bytes) 000891 1789602913.059412 punch from 0x000dbf to 0x001923 (0xb65 bytes) 000892 1789602913.074349 trunc from 0x001924 to 0x01d950 (0x1c02d bytes) 000894 1789602913.118517 write 0x006182 thru 0x006b58 (0x9d7 bytes) 000896 1789602913.152390 MIRROR_RESYNC 16 mirrors 000901 1789602916.550350 mapwrite 0x02e99a thru 0x03d0c9 (0xe730 bytes) 000902 1789602916.809419 punch from 0x035354 to 0x03d0c9 (0x7d76 bytes) 000903 1789602916.818048 write 0x02fff7 thru 0x03dd2a (0xdd34 bytes) 000904 1789602916.832463 read 0x0168c2 thru 0x025df8 (0xf537 bytes) 000906 1789602916.847917 read 0x0267d8 thru 0x034868 (0xe091 bytes) 000907 1789602916.858944 punch from 0x0330b1 to 0x034813 (0x1763 bytes) 000908 1789602916.874585 punch from 0x02915a to 0x030af8 (0x799f bytes) 000909 1789602916.879394 punch from 0x01e8ad to 0x02a5f0 (0xbd44 bytes) 000912 1789602916.888867 read 0x010db4 thru 0x01555b (0x47a8 bytes) 000915 1789602916.891434 mapwrite 0x00b6f1 thru 0x010ac0 (0x53d0 bytes) 000917 1789602916.937691 read 0x00e8b5 thru 0x016959 (0x80a5 bytes) 000918 1789602916.939093 read 0x038ef6 thru 0x03dd2a (0x4e35 bytes) 000919 1789602916.942232 punch from 0x00e7a4 to 0x013690 (0x4eed bytes) 000920 1789602916.948088 read 0x011dc6 thru 0x01f56f (0xd7aa bytes) 000922 1789602916.990741 MIRROR_SPLIT mirror 12 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd2b): Mirror 11: 0x3898b1ab (stale) Mirror 13: 0x3898b1ab (stale) Mirror 23: 0x3898b1ab (stale) Mirror 24: 0x3898b1ab (stale) Mirror 26: 0x3898b1ab (stale) Mirror 28: 0x3898b1ab (stale) Mirror 30: 0x3898b1ab (stale) Mirror 31: 0x3898b1ab (stale) Mirror 32: 0x3898b1ab (stale) Mirror 33: 0x3898b1ab (stale) Mirror 34: 0x3898b1ab (stale) Mirror 37: 0x3898b1ab (stale) Mirror 38: 0x3898b1ab (stale) Mirror 39: 0x3898b1ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd2b): Mirror 11: 0x3898b1ab (stale) Mirror 13: 0x3898b1ab (stale) Mirror 23: 0x3898b1ab (stale) Mirror 24: 0x3898b1ab (stale) Mirror 26: 0x3898b1ab (stale) Mirror 28: 0x3898b1ab (stale) Mirror 30: 0x3898b1ab (stale) Mirror 31: 0x3898b1ab (stale) Mirror 32: 0x3898b1ab (stale) Mirror 33: 0x3898b1ab (stale) Mirror 34: 0x3898b1ab (stale) Mirror 37: 0x3898b1ab (stale) Mirror 38: 0x3898b1ab (stale) Mirror 39: 0x3898b1ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd2b: skipped 000924 1789602918.048227 punch from 0x024513 to 0x028dd8 (0x48c6 bytes) 000926 1789602918.062296 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3dd2b): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) Mirror 39: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd2b): Mirror 11: 0x3898b1ab (stale) Mirror 13: 0x3898b1ab (stale) Mirror 23: 0x3898b1ab (stale) Mirror 24: 0x3898b1ab (stale) Mirror 26: 0x3898b1ab (stale) Mirror 28: 0x3898b1ab (stale) Mirror 30: 0x3898b1ab (stale) Mirror 31: 0x3898b1ab (stale) Mirror 32: 0x3898b1ab (stale) Mirror 33: 0x3898b1ab (stale) Mirror 34: 0x3898b1ab (stale) Mirror 37: 0x3898b1ab (stale) Mirror 38: 0x3898b1ab (stale) Mirror 39: 0x3898b1ab (stale) CRC-32 checksum value for chunk [0, 0x3dd2b): Mirror 1: 0x740b4245 Mirror 40: 0x740b4245 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd2b: skipped 000927 1789602920.108858 mapread 0x038bca thru 0x03dd2a (0x5161 bytes) 000928 1789602920.136089 punch from 0x0258b0 to 0x02f67f (0x9dd0 bytes) 000930 1789602920.316125 MIRROR_RESYNC 16 mirrors 000935 1789602924.950255 mapread 0x002c20 thru 0x01202e (0xf40f bytes) 000936 1789602925.011811 mapread 0x03484c thru 0x0376da (0x2e8f bytes) 000937 1789602925.041431 mapwrite 0x017357 thru 0x0260b0 (0xed5a bytes) 000938 1789602925.340774 punch from 0x026f0c to 0x029aa0 (0x2b95 bytes) 000940 1789602925.348518 mapread 0x0189bb thru 0x0254ff (0xcb45 bytes) 000941 1789602925.349587 write 0x022c57 thru 0x022f68 (0x312 bytes) 000942 1789602925.358220 MIRROR_RESYNC 16 mirrors 000943 1789602928.247332 mapwrite 0x0264da thru 0x030c60 (0xa787 bytes) 000944 1789602928.682941 trunc from 0x03dd2b to 0x010462 (0x2d8c8 bytes) 000946 1789602928.735017 read 0x0070d9 thru 0x00c264 (0x518c bytes) 000951 1789602928.770903 mapwrite 0x02b571 thru 0x031636 (0x60c6 bytes) 000953 1789602928.863114 trunc from 0x031637 to 0x01ad57 (0x168df bytes) 000954 1789602928.889864 read 0x006119 thru 0x0083e7 (0x22cf bytes) 000956 1789602928.902305 read 0x000f6f thru 0x00d731 (0xc7c3 bytes) 000957 1789602928.903491 mapread 0x015432 thru 0x01ad57 (0x5926 bytes) 000958 1789602928.909635 MIRROR_RESYNC 16 mirrors 000960 1789602932.089040 punch from 0x009f34 to 0x00bf29 (0x1ff6 bytes) 000961 1789602932.176208 mapread 0x0089cc thru 0x00e61c (0x5c51 bytes) 000962 1789602932.199522 write 0x006cb0 thru 0x012f7c (0xc2cd bytes) 000965 1789602932.206202 mapwrite 0x00edc3 thru 0x01a42a (0xb668 bytes) 000967 1789602932.293538 mapread 0x00191a thru 0x010dfe (0xf4e5 bytes) 000968 1789602932.299913 write 0x02cf80 thru 0x033b23 (0x6ba4 bytes) 000969 1789602932.301205 read 0x00b708 thru 0x019dcc (0xe6c5 bytes) 000970 1789602932.302810 trunc from 0x033b24 to 0x00bc9a (0x27e89 bytes) 000971 1789602932.324096 punch from 0x005941 to 0x00bc9a (0x635a bytes) 000975 1789602932.332530 read 0x00a221 thru 0x00bb41 (0x1921 bytes) 000976 1789602932.341351 punch from 0x006e59 to 0x00bc9a (0x4e42 bytes) 000977 1789602932.347996 trunc from 0x00bc9b to 0x036ac3 (0x2ae29 bytes) 000978 1789602932.374042 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36ac4): Mirror 13: 0xf53ad79a (stale) Mirror 23: 0xf53ad79a (stale) Mirror 24: 0xf53ad79a (stale) Mirror 26: 0xf53ad79a (stale) Mirror 28: 0xf53ad79a (stale) Mirror 30: 0xf53ad79a (stale) Mirror 31: 0xf53ad79a (stale) Mirror 32: 0xf53ad79a (stale) Mirror 33: 0xf53ad79a (stale) Mirror 34: 0xf53ad79a (stale) Mirror 37: 0xf53ad79a (stale) Mirror 38: 0xf53ad79a (stale) Mirror 39: 0xf53ad79a (stale) Mirror 40: 0xf53ad79a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36ac4): Mirror 13: 0xf53ad79a (stale) Mirror 23: 0xf53ad79a (stale) Mirror 24: 0xf53ad79a (stale) Mirror 26: 0xf53ad79a (stale) Mirror 28: 0xf53ad79a (stale) Mirror 30: 0xf53ad79a (stale) Mirror 31: 0xf53ad79a (stale) Mirror 32: 0xf53ad79a (stale) Mirror 33: 0xf53ad79a (stale) Mirror 34: 0xf53ad79a (stale) Mirror 37: 0xf53ad79a (stale) Mirror 38: 0xf53ad79a (stale) Mirror 39: 0xf53ad79a (stale) Mirror 40: 0xf53ad79a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36ac4: skipped 000979 1789602933.145334 MIRROR_RESYNC 15 mirrors 000981 1789602936.382040 MIRROR_RESYNC 15 mirrors 000982 1789602937.430067 write 0x01c076 thru 0x01cac7 (0xa52 bytes) 000983 1789602937.542307 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36ac4): Mirror 13: 0x203a1aff (stale) Mirror 23: 0x203a1aff (stale) Mirror 24: 0x203a1aff (stale) Mirror 26: 0x203a1aff (stale) Mirror 28: 0x203a1aff (stale) Mirror 30: 0x203a1aff (stale) Mirror 32: 0x203a1aff (stale) Mirror 33: 0x203a1aff (stale) Mirror 34: 0x203a1aff (stale) Mirror 37: 0x203a1aff (stale) Mirror 38: 0x203a1aff (stale) Mirror 39: 0x203a1aff (stale) Mirror 40: 0x203a1aff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36ac4): Mirror 13: 0x203a1aff (stale) Mirror 23: 0x203a1aff (stale) Mirror 24: 0x203a1aff (stale) Mirror 26: 0x203a1aff (stale) Mirror 28: 0x203a1aff (stale) Mirror 30: 0x203a1aff (stale) Mirror 32: 0x203a1aff (stale) Mirror 33: 0x203a1aff (stale) Mirror 34: 0x203a1aff (stale) Mirror 37: 0x203a1aff (stale) Mirror 38: 0x203a1aff (stale) Mirror 39: 0x203a1aff (stale) Mirror 40: 0x203a1aff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36ac4: skipped 000984 1789602938.492762 write 0x0331b8 thru 0x03c3d5 (0x921e bytes) 000985 1789602938.504559 punch from 0x024a81 to 0x027ba3 (0x3123 bytes) 000986 1789602938.542806 trunc from 0x03c3d6 to 0x01020a (0x2c1cb bytes) 000987 1789602938.564939 write 0x015be6 thru 0x01df06 (0x8321 bytes) 000988 1789602938.566480 punch from 0x00f3e5 to 0x01a89d (0xb4b9 bytes) 000991 1789602938.590224 read 0x01de23 thru 0x01df06 (0xe4 bytes) 000992 1789602938.591016 trunc from 0x01df07 to 0x02b408 (0xd502 bytes) 000993 1789602938.616701 mapwrite 0x03bfec thru 0x03c35d (0x372 bytes) 000994 1789602938.784267 MIRROR_RESYNC 14 mirrors 000996 1789602943.931322 mapread 0x00c383 thru 0x014157 (0x7dd5 bytes) 000997 1789602943.961902 mapread 0x016de2 thru 0x0196b9 (0x28d8 bytes) 000999 1789602943.972462 write 0x02d208 thru 0x034366 (0x715f bytes) All operations completed A-OK!