== sanity-flr test 70a: flr mode fsx test ================ 21:10:01 (1788484201) Seed set to 4203 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000007 1788484203.852515 mapwrite 0x019957 thru 0x01f971 (0x601b bytes) 000011 1788484203.976789 write 0x0092b2 thru 0x018064 (0xedb3 bytes) truncating to largest ever: 0x3bc61 000015 1788484203.989348 trunc from 0x01f972 to 0x03bc60 (0x1c2ef bytes) 000017 1788484204.011799 write 0x0259bb thru 0x032ce6 (0xd32c bytes) 000024 1788484204.034213 MIRROR_EXTEND to 2 mirrors 000028 1788484205.024099 MIRROR_EXTEND to 3 mirrors 000030 1788484206.065008 write 0x01bce6 thru 0x01dc27 (0x1f42 bytes) 000031 1788484206.176036 mapwrite 0x03d1d9 thru 0x03ffff (0x2e27 bytes) 000032 1788484206.361970 write 0x024d9b thru 0x033508 (0xe76e bytes) 000033 1788484206.386863 mapwrite 0x013116 thru 0x01ce7f (0x9d6a bytes) 000034 1788484206.457853 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x80bf3b2b (stale) Mirror 3: 0x80bf3b2b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x793fbf89 Mirror 4: 0x793fbf89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000036 1788484207.873695 write 0x001dac thru 0x00c5ca (0xa81f bytes) 000037 1788484207.967245 mapread 0x01af9d thru 0x021b40 (0x6ba4 bytes) 000038 1788484208.002865 trunc from 0x040000 to 0x02275e (0x1d8a1 bytes) 000039 1788484208.039947 write 0x02a6ed thru 0x0320a6 (0x79ba bytes) 000040 1788484208.047345 MIRROR_RESYNC 4 mirrors 000041 1788484209.248540 mapwrite 0x022057 thru 0x022e6e (0xe18 bytes) 000042 1788484209.494187 write 0x02a41e thru 0x030605 (0x61e8 bytes) 000044 1788484209.521603 trunc from 0x0320a7 to 0x0362aa (0x4204 bytes) 000046 1788484209.572148 mapwrite 0x00946a thru 0x018429 (0xefc0 bytes) 000047 1788484209.707825 mapread 0x033957 thru 0x0362aa (0x2954 bytes) 000049 1788484209.725707 mapread 0x0055e5 thru 0x008185 (0x2ba1 bytes) 000052 1788484209.728673 trunc from 0x0362ab to 0x00e6eb (0x27bbf bytes) 000055 1788484209.757813 MIRROR_RESYNC 4 mirrors 000056 1788484210.738871 trunc from 0x00e6ec to 0x001ef1 (0xc7fa bytes) 000057 1788484210.830879 read 0x00029e thru 0x001ef1 (0x1c54 bytes) 000059 1788484210.841953 write 0x02a402 thru 0x02c414 (0x2013 bytes) 000060 1788484210.843078 mapread 0x01259b thru 0x01bf63 (0x99c9 bytes) 000062 1788484210.864077 mapwrite 0x0203f8 thru 0x023765 (0x336e bytes) 000063 1788484210.955801 mapwrite 0x00b2db thru 0x019d11 (0xea37 bytes) 000064 1788484211.045668 read 0x02152d thru 0x02883a (0x730e bytes) 000066 1788484211.049787 trunc from 0x02c415 to 0x019667 (0x12dad bytes) 000067 1788484211.089204 trunc from 0x019668 to 0x003211 (0x16456 bytes) 000069 1788484211.116684 read 0x001467 thru 0x003211 (0x1dab bytes) 000070 1788484211.133277 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3212): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3212): Mirror 2: 0x679e33ca (stale) Mirror 3: 0x679e33ca (stale) Mirror 4: 0x679e33ca (stale) CRC-32 checksum value for chunk [0, 0x3212): Mirror 1: 0xdde58173 Mirror 5: 0xdde58173 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3212: skipped 000071 1788484212.390470 mapwrite 0x0320d4 thru 0x03f1e7 (0xd114 bytes) 000073 1788484212.781643 trunc from 0x03f1e8 to 0x00ac1b (0x345cc bytes) 000075 1788484212.823609 mapread 0x0019bc thru 0x00aa88 (0x90cd bytes) 000078 1788484212.838147 write 0x004f7c thru 0x0130ad (0xe132 bytes) 000081 1788484212.844477 read 0x0074e8 thru 0x007bb7 (0x6d0 bytes) 000082 1788484212.845787 write 0x01d915 thru 0x0253af (0x7a9b bytes) 000084 1788484212.848495 write 0x0056ed thru 0x008c01 (0x3515 bytes) 000085 1788484212.850125 write 0x03ba20 thru 0x03ffff (0x45e0 bytes) 000086 1788484212.852520 trunc from 0x040000 to 0x01bc50 (0x243af bytes) 000089 1788484212.889741 MIRROR_RESYNC 5 mirrors 000093 1788484214.459569 MIRROR_EXTEND to 6 mirrors 000094 1788484215.856363 mapwrite 0x0324be thru 0x037fa8 (0x5aeb bytes) 000096 1788484216.058403 mapwrite 0x00ba17 thru 0x01a39d (0xe987 bytes) 000097 1788484216.148695 read 0x0029f8 thru 0x011fa4 (0xf5ad bytes) 000099 1788484216.160675 mapwrite 0x02a02d thru 0x02f1cc (0x51a0 bytes) 000102 1788484216.346308 read 0x01c009 thru 0x021033 (0x502b bytes) 000103 1788484216.356749 trunc from 0x037fa9 to 0x0380c7 (0x11f bytes) 000104 1788484216.380450 mapread 0x023093 thru 0x02424f (0x11bd bytes) 000106 1788484216.381871 write 0x014623 thru 0x020488 (0xbe66 bytes) 000108 1788484216.386265 read 0x0361f8 thru 0x0380c7 (0x1ed0 bytes) 000109 1788484216.392783 trunc from 0x0380c8 to 0x0020df (0x35fe8 bytes) 000110 1788484216.430250 mapread 0x0012fc thru 0x0020df (0xde4 bytes) 000111 1788484216.435983 write 0x01d370 thru 0x023f58 (0x6be9 bytes) 000113 1788484216.439316 mapwrite 0x014d97 thru 0x01cef4 (0x815e bytes) 000114 1788484216.631784 trunc from 0x023f59 to 0x03513c (0x111e4 bytes) 000115 1788484216.670348 mapread 0x005df6 thru 0x00b580 (0x578b bytes) 000116 1788484216.730650 write 0x029da5 thru 0x031cad (0x7f09 bytes) 000117 1788484216.745240 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3513d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3513d): Mirror 2: 0x425dd30e (stale) Mirror 3: 0x425dd30e (stale) Mirror 4: 0x425dd30e (stale) Mirror 5: 0x425dd30e (stale) Mirror 6: 0x425dd30e (stale) CRC-32 checksum value for chunk [0, 0x3513d): Mirror 1: 0x58dbd2c6 Mirror 7: 0x58dbd2c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3513d: skipped 000121 1788484217.805775 read 0x02fe3f thru 0x03513c (0x52fe bytes) 000125 1788484217.824632 MIRROR_RESYNC 7 mirrors 000126 1788484219.762978 write 0x0296dc thru 0x030c02 (0x7527 bytes) 000128 1788484219.851418 read 0x01f144 thru 0x02a9e2 (0xb89f bytes) 000130 1788484219.863912 trunc from 0x03513d to 0x0228e4 (0x12858 bytes) 000131 1788484219.891862 mapwrite 0x00df42 thru 0x01634c (0x840b bytes) 000133 1788484219.988148 mapwrite 0x0119cd thru 0x01589c (0x3ed0 bytes) 000134 1788484220.045801 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x228e5): Mirror 2: 0x8ba139d9 (stale) Mirror 3: 0x8ba139d9 (stale) Mirror 4: 0x8ba139d9 (stale) Mirror 5: 0x8ba139d9 (stale) Mirror 7: 0x8ba139d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x228e5): Mirror 2: 0x8ba139d9 (stale) Mirror 3: 0x8ba139d9 (stale) Mirror 4: 0x8ba139d9 (stale) Mirror 5: 0x8ba139d9 (stale) Mirror 7: 0x8ba139d9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x228e5: skipped 000135 1788484220.460043 read 0x007803 thru 0x015364 (0xdb62 bytes) 000136 1788484220.469915 mapread 0x01a87d thru 0x01c0ae (0x1832 bytes) 000137 1788484220.491147 mapwrite 0x006e28 thru 0x00d758 (0x6931 bytes) 000139 1788484220.580862 MIRROR_RESYNC 6 mirrors 000140 1788484221.764842 write 0x002be6 thru 0x005eac (0x32c7 bytes) 000141 1788484221.890096 trunc from 0x0228e5 to 0x018ff8 (0x98ec bytes) 000145 1788484221.915325 read 0x00de5b thru 0x00e83b (0x9e1 bytes) 000148 1788484221.922902 mapwrite 0x00005c thru 0x007918 (0x78bd bytes) 000149 1788484222.063112 read 0x0037c0 thru 0x013525 (0xfd66 bytes) 000151 1788484222.077605 write 0x0086d2 thru 0x0109fb (0x832a bytes) 000153 1788484222.081181 mapwrite 0x01e601 thru 0x02e040 (0xfa40 bytes) 000154 1788484222.232239 read 0x01a148 thru 0x01aa96 (0x94f bytes) 000155 1788484222.242608 MIRROR_RESYNC 6 mirrors 000156 1788484224.181674 mapwrite 0x0047bd thru 0x00d19b (0x89df bytes) 000159 1788484224.400200 read 0x0298a7 thru 0x02e040 (0x479a bytes) 000160 1788484224.413480 mapwrite 0x028626 thru 0x02f143 (0x6b1e bytes) 000161 1788484224.526734 write 0x0147c5 thru 0x01cf2a (0x8766 bytes) 000163 1788484224.556023 write 0x00b33e thru 0x015a4c (0xa70f bytes) 000166 1788484224.565458 mapwrite 0x0258b7 thru 0x0289d6 (0x3120 bytes) 000167 1788484224.753650 write 0x003cff thru 0x009b26 (0x5e28 bytes) 000168 1788484224.756177 trunc from 0x02f144 to 0x01ac69 (0x144da bytes) 000169 1788484224.806540 mapread 0x013984 thru 0x01ac69 (0x72e6 bytes) 000170 1788484224.808801 read 0x017875 thru 0x01ac69 (0x33f5 bytes) truncating to largest ever: 0x3ed48 000172 1788484224.810988 trunc from 0x01ac6a to 0x03ed47 (0x240de bytes) 000174 1788484224.869228 mapwrite 0x004dc1 thru 0x00c03c (0x727c bytes) 000175 1788484225.077150 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ed48): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed48): Mirror 2: 0xdf9ac683 (stale) Mirror 3: 0xdf9ac683 (stale) Mirror 4: 0xdf9ac683 (stale) Mirror 5: 0xdf9ac683 (stale) Mirror 7: 0xdf9ac683 (stale) CRC-32 checksum value for chunk [0, 0x3ed48): Mirror 1: 0xff952f60 Mirror 8: 0xff952f60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed48: skipped 000177 1788484226.614389 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed48): Mirror 2: 0xdf9ac683 (stale) Mirror 3: 0xdf9ac683 (stale) Mirror 4: 0xdf9ac683 (stale) Mirror 5: 0xdf9ac683 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed48): Mirror 2: 0xdf9ac683 (stale) Mirror 3: 0xdf9ac683 (stale) Mirror 4: 0xdf9ac683 (stale) Mirror 5: 0xdf9ac683 (stale) CRC-32 checksum value for chunk [0, 0x3ed48): Mirror 1: 0xff952f60 Mirror 8: 0xff952f60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed48: skipped 000178 1788484227.587176 mapread 0x03e410 thru 0x03e4b6 (0xa7 bytes) 000181 1788484227.733917 read 0x016c3d thru 0x019518 (0x28dc bytes) 000184 1788484227.841806 mapread 0x02c365 thru 0x03560d (0x92a9 bytes) 000185 1788484227.921452 mapread 0x002c23 thru 0x0067aa (0x3b88 bytes) 000186 1788484227.961893 write 0x02b3fe thru 0x0346bc (0x92bf bytes) 000188 1788484228.081144 mapread 0x014fbb thru 0x01f7b8 (0xa7fe bytes) 000191 1788484228.111472 mapread 0x02f454 thru 0x03c18b (0xcd38 bytes) 000192 1788484228.123784 read 0x0064d1 thru 0x008dd4 (0x2904 bytes) 000193 1788484228.143478 write 0x03ef69 thru 0x03f1ef (0x287 bytes) 000196 1788484228.147045 write 0x03eb87 thru 0x03ffff (0x1479 bytes) 000197 1788484228.163805 mapread 0x0139e1 thru 0x021a1d (0xe03d bytes) 000198 1788484228.166117 trunc from 0x040000 to 0x0035ff (0x3ca00 bytes) 000200 1788484228.193687 write 0x00d6da thru 0x01d2f3 (0xfc1a bytes) 000201 1788484228.200256 MIRROR_RESYNC 6 mirrors 000204 1788484229.536423 write 0x035501 thru 0x03ffff (0xaaff bytes) 000205 1788484229.635477 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37cf00ef (stale) Mirror 3: 0x37cf00ef (stale) Mirror 4: 0x37cf00ef (stale) Mirror 5: 0x37cf00ef (stale) Mirror 8: 0x37cf00ef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5556ae30 Mirror 9: 0x5556ae30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000207 1788484231.043103 MIRROR_RESYNC 7 mirrors 000208 1788484233.101457 write 0x00df29 thru 0x00fd0b (0x1de3 bytes) 000214 1788484233.190405 mapwrite 0x020420 thru 0x025c76 (0x5857 bytes) 000215 1788484233.307935 write 0x01dbac thru 0x02ba1b (0xde70 bytes) 000217 1788484233.317210 trunc from 0x040000 to 0x01c9bb (0x23644 bytes) 000219 1788484233.350456 trunc from 0x01c9bc to 0x013082 (0x9939 bytes) 000222 1788484233.367316 write 0x0268cf thru 0x02919e (0x28d0 bytes) 000223 1788484233.373861 MIRROR_RESYNC 7 mirrors 000225 1788484236.155138 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000226 1788484236.803876 read 0x01c3f9 thru 0x028646 (0xc24e bytes) 000227 1788484236.816268 trunc from 0x02919f to 0x024c36 (0x4568 bytes) 000231 1788484236.944803 mapwrite 0x020a1c thru 0x02a6b9 (0x9c9e bytes) 000233 1788484237.076540 read 0x027ec1 thru 0x02a6b9 (0x27f9 bytes) 000234 1788484237.077616 trunc from 0x02a6ba to 0x0349e9 (0xa330 bytes) 000236 1788484237.105924 read 0x0075ce thru 0x0151ff (0xdc32 bytes) 000237 1788484237.138558 trunc from 0x0349ea to 0x0009f3 (0x33ff6 bytes) 000238 1788484237.186217 read 0x000777 thru 0x0009f3 (0x27d bytes) 000240 1788484237.187571 mapread 0x000403 thru 0x0009f3 (0x5f1 bytes) 000243 1788484237.196874 mapwrite 0x023fe3 thru 0x02e3e2 (0xa400 bytes) 000245 1788484237.326004 read 0x029d0e thru 0x02e3e2 (0x46d5 bytes) 000248 1788484237.328473 trunc from 0x02e3e3 to 0x0382c9 (0x9ee7 bytes) 000250 1788484237.359973 mapwrite 0x00ebb4 thru 0x011d8a (0x31d7 bytes) 000251 1788484237.422473 trunc from 0x0382ca to 0x01e26f (0x1a05a bytes) 000252 1788484237.439232 trunc from 0x01e270 to 0x0320ac (0x13e3d bytes) 000256 1788484237.467898 mapwrite 0x00ccfc thru 0x01a87d (0xdb82 bytes) 000257 1788484237.519112 mapwrite 0x01f299 thru 0x02e134 (0xee9c bytes) 000259 1788484237.597339 mapwrite 0x013570 thru 0x014a25 (0x14b6 bytes) 000260 1788484237.654945 mapwrite 0x028c87 thru 0x031d07 (0x9081 bytes) 000261 1788484237.708196 read 0x006f52 thru 0x01069c (0x974b bytes) 000262 1788484237.708980 mapwrite 0x01bf71 thru 0x01d273 (0x1303 bytes) 000263 1788484237.735861 mapread 0x01e7c5 thru 0x02b320 (0xcb5c bytes) 000264 1788484237.739904 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x320ad): Mirror 4: 0x3a423b0b (stale) Mirror 5: 0x3a423b0b (stale) Mirror 8: 0x3a423b0b (stale) Mirror 9: 0x3a423b0b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x320ad): Mirror 4: 0x3a423b0b (stale) Mirror 5: 0x3a423b0b (stale) Mirror 8: 0x3a423b0b (stale) Mirror 9: 0x3a423b0b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x320ad: skipped 000265 1788484238.340233 write 0x01d311 thru 0x01fb78 (0x2868 bytes) 000266 1788484238.363263 MIRROR_RESYNC 5 mirrors 000267 1788484240.422256 mapread 0x02e376 thru 0x0320ac (0x3d37 bytes) 000268 1788484240.460444 mapwrite 0x00621c thru 0x00e7e4 (0x85c9 bytes) 000269 1788484240.625960 read 0x00a56b thru 0x011490 (0x6f26 bytes) 000270 1788484240.635947 mapread 0x0025a0 thru 0x010b23 (0xe584 bytes) 000272 1788484240.638757 trunc from 0x0320ad to 0x008fa6 (0x29106 bytes) 000273 1788484240.691205 read 0x0061d7 thru 0x008fa6 (0x2dd0 bytes) 000274 1788484240.695524 mapread 0x007252 thru 0x008fa6 (0x1d55 bytes) 000277 1788484240.700978 write 0x012388 thru 0x017cbf (0x5938 bytes) 000278 1788484240.705502 mapwrite 0x00118b thru 0x01001e (0xee94 bytes) 000279 1788484240.888931 mapread 0x00b0f4 thru 0x0109ae (0x58bb bytes) 000280 1788484240.889920 trunc from 0x017cc0 to 0x015142 (0x2b7d bytes) 000282 1788484240.951129 trunc from 0x015143 to 0x02d791 (0x1864f bytes) 000283 1788484240.973463 trunc from 0x02d792 to 0x001c0b (0x2bb86 bytes) 000284 1788484241.000715 mapwrite 0x01f55c thru 0x02a19d (0xac42 bytes) 000285 1788484241.088226 mapwrite 0x01d379 thru 0x023def (0x6a77 bytes) 000287 1788484241.154839 mapwrite 0x02d6d6 thru 0x03b85a (0xe185 bytes) 000289 1788484241.259459 read 0x01cd47 thru 0x027049 (0xa303 bytes) 000290 1788484241.260428 mapwrite 0x026ef2 thru 0x02df19 (0x7028 bytes) 000293 1788484241.323909 trunc from 0x03b85b to 0x031279 (0xa5e1 bytes) 000294 1788484241.339915 trunc from 0x03127a to 0x02cc7b (0x45fe bytes) 000296 1788484241.352006 write 0x018330 thru 0x01b87d (0x354e bytes) 000297 1788484241.353255 mapwrite 0x010f01 thru 0x012bd3 (0x1cd3 bytes) 000298 1788484241.388692 trunc from 0x02cc7c to 0x00108b (0x2bbf0 bytes) 000300 1788484241.400572 mapwrite 0x0258c8 thru 0x02bf34 (0x666d bytes) 000301 1788484241.492984 read 0x0266c5 thru 0x02bf34 (0x5870 bytes) 000303 1788484241.498781 MIRROR_RESYNC 5 mirrors 000304 1788484242.958308 trunc from 0x02bf35 to 0x007ec1 (0x24073 bytes) 000311 1788484243.147474 mapwrite 0x03672d thru 0x039dd2 (0x36a6 bytes) 000313 1788484243.271327 trunc from 0x039dd3 to 0x0270e4 (0x12cee bytes) 000314 1788484243.305902 mapread 0x012c62 thru 0x01a766 (0x7b05 bytes) 000318 1788484243.353104 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x270e5): Mirror 4: 0x2ca5bdf2 (stale) Mirror 5: 0x2ca5bdf2 (stale) Mirror 9: 0x2ca5bdf2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x270e5): Mirror 4: 0x2ca5bdf2 (stale) Mirror 5: 0x2ca5bdf2 (stale) Mirror 9: 0x2ca5bdf2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x270e5: skipped 000319 1788484243.843866 trunc from 0x0270e5 to 0x031361 (0xa27d bytes) 000322 1788484243.868427 read 0x002873 thru 0x00e2c0 (0xba4e bytes) 000323 1788484243.886273 mapwrite 0x0129b4 thru 0x014fe3 (0x2630 bytes) 000325 1788484243.962516 mapread 0x005fa0 thru 0x010621 (0xa682 bytes) 000326 1788484243.968119 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31362): Mirror 5: 0x333e65d2 (stale) Mirror 9: 0x333e65d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31362): Mirror 5: 0x333e65d2 (stale) Mirror 9: 0x333e65d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31362: skipped 000327 1788484244.557005 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31362): Mirror 5: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31362): Mirror 5: 0x333e65d2 (stale) Mirror 9: 0x333e65d2 (stale) CRC-32 checksum value for chunk [0, 0x31362): Mirror 1: 0xb5006bcc Mirror 10: 0xb5006bcc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31362: skipped 000329 1788484246.398502 mapwrite 0x029032 thru 0x0325fc (0x95cb bytes) 000332 1788484246.697372 mapwrite 0x03b72d thru 0x03ffff (0x48d3 bytes) 000336 1788484246.966914 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xcb96f2f4 (stale) Mirror 9: 0xcb96f2f4 (stale) Mirror 10: 0xe97001ab (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x878b9242 Mirror 11: 0x878b9242 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000339 1788484248.923984 mapread 0x01a3a0 thru 0x02298d (0x85ee bytes) 000340 1788484248.956490 read 0x01a1a1 thru 0x022dce (0x8c2e bytes) 000342 1788484248.957932 mapwrite 0x03f70a thru 0x03ffff (0x8f6 bytes) 000343 1788484249.277878 mapread 0x033c93 thru 0x0347d9 (0xb47 bytes) 000344 1788484249.302719 read 0x03ed8a thru 0x03ffff (0x1276 bytes) 000345 1788484249.303381 write 0x01cc53 thru 0x028f9e (0xc34c bytes) 000346 1788484249.348001 read 0x0397ca thru 0x03ffff (0x6836 bytes) 000348 1788484249.356209 read 0x03e3df thru 0x03ed03 (0x925 bytes) 000349 1788484249.356883 mapwrite 0x03ee76 thru 0x03ffff (0x118a bytes) 000351 1788484249.477201 trunc from 0x040000 to 0x00022d (0x3fdd2 bytes) 000352 1788484249.540117 read 0x000219 thru 0x00022d (0x15 bytes) 000353 1788484249.540775 mapread 0x000111 thru 0x00022d (0x11d bytes) 000354 1788484249.544183 trunc from 0x00022e to 0x0137fe (0x135d1 bytes) 000355 1788484249.576358 trunc from 0x0137ff to 0x0053de (0xe420 bytes) 000356 1788484249.598634 trunc from 0x0053df to 0x026c79 (0x2189b bytes) 000360 1788484249.640197 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x26c7a): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26c7a): Mirror 5: 0x2ccac5ab (stale) Mirror 9: 0x2ccac5ab (stale) Mirror 10: 0xb4c0e1f (stale) Mirror 11: 0xb4c0e1f (stale) CRC-32 checksum value for chunk [0, 0x26c7a): Mirror 1: 0xd27f483d Mirror 12: 0xd27f483d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26c7a: skipped 000361 1788484250.874525 mapread 0x017cb3 thru 0x020b82 (0x8ed0 bytes) 000364 1788484251.004199 write 0x033c76 thru 0x0344d9 (0x864 bytes) 000365 1788484251.093558 mapwrite 0x020809 thru 0x02963f (0x8e37 bytes) 000366 1788484251.164815 mapread 0x0034d2 thru 0x007c5b (0x478a bytes) 000372 1788484251.178337 read 0x002053 thru 0x004aa7 (0x2a55 bytes) 000373 1788484251.179279 mapread 0x00ba36 thru 0x011b43 (0x610e bytes) 000374 1788484251.189377 trunc from 0x0344da to 0x007fc9 (0x2c510 bytes) 000375 1788484251.211769 mapwrite 0x01e489 thru 0x02191a (0x3492 bytes) 000378 1788484251.292781 mapread 0x00eb27 thru 0x01e5a6 (0xfa80 bytes) 000379 1788484251.303879 read 0x00df22 thru 0x010321 (0x2400 bytes) 000380 1788484251.305347 read 0x00a4c6 thru 0x00e9e8 (0x4523 bytes) 000381 1788484251.306374 read 0x016e59 thru 0x018a71 (0x1c19 bytes) 000383 1788484251.308525 trunc from 0x02191b to 0x01eaac (0x2e6e bytes) 000384 1788484251.328369 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1eaad): Mirror 5: 0x1a811f36 (stale) Mirror 9: 0x1a811f36 (stale) Mirror 10: 0xe71f2a92 (stale) Mirror 12: 0x879b2567 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eaad): Mirror 5: 0x1a811f36 (stale) Mirror 9: 0x1a811f36 (stale) Mirror 10: 0xe71f2a92 (stale) Mirror 12: 0x879b2567 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eaad: skipped 000385 1788484251.753471 mapread 0x01623c thru 0x01dff9 (0x7dbe bytes) 000387 1788484251.785078 read 0x00ecc1 thru 0x014aa8 (0x5de8 bytes) 000388 1788484251.801768 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1eaad): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eaad): Mirror 5: 0x1a811f36 (stale) Mirror 9: 0x1a811f36 (stale) Mirror 10: 0xe71f2a92 (stale) Mirror 12: 0x879b2567 (stale) CRC-32 checksum value for chunk [0, 0x1eaad): Mirror 1: 0x90c26518 Mirror 13: 0x90c26518 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eaad: skipped 000389 1788484253.277192 write 0x021a81 thru 0x022367 (0x8e7 bytes) 000390 1788484253.456676 read 0x01f710 thru 0x022367 (0x2c58 bytes) 000391 1788484253.464200 write 0x029cc3 thru 0x037ab2 (0xddf0 bytes) 000392 1788484253.473205 write 0x01bf49 thru 0x0293e6 (0xd49e bytes) 000396 1788484253.498880 write 0x004fca thru 0x00d36f (0x83a6 bytes) 000397 1788484253.509466 read 0x023f38 thru 0x0289ce (0x4a97 bytes) 000398 1788484253.511100 mapread 0x0348e8 thru 0x037ab2 (0x31cb bytes) 000400 1788484253.514135 mapread 0x03772a thru 0x037ab2 (0x389 bytes) 000401 1788484253.515694 mapwrite 0x00eb2e thru 0x01cea1 (0xe374 bytes) 000402 1788484253.688655 trunc from 0x037ab3 to 0x02c6d0 (0xb3e2 bytes) 000403 1788484253.736804 trunc from 0x02c6d1 to 0x005ff8 (0x266d8 bytes) 000404 1788484253.756118 read 0x004b18 thru 0x005ff8 (0x14e1 bytes) 000405 1788484253.757434 read 0x005008 thru 0x005ff8 (0xff1 bytes) 000409 1788484253.766321 read 0x0022d6 thru 0x005ff8 (0x3d23 bytes) 000410 1788484253.767070 mapwrite 0x00f461 thru 0x010715 (0x12b5 bytes) 000414 1788484253.896137 trunc from 0x010716 to 0x035515 (0x24e00 bytes) 000415 1788484253.948083 write 0x003e5c thru 0x00b7d0 (0x7975 bytes) 000416 1788484253.959032 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35516): Mirror 5: 0xb6e2763f (stale) Mirror 9: 0xb6e2763f (stale) Mirror 10: 0x88af5c6f (stale) Mirror 12: 0x848e70e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35516): Mirror 5: 0xb6e2763f (stale) Mirror 9: 0xb6e2763f (stale) Mirror 10: 0x88af5c6f (stale) Mirror 12: 0x848e70e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35516: skipped 000417 1788484254.667130 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35516): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35516): Mirror 5: 0xb6e2763f (stale) Mirror 9: 0xb6e2763f (stale) Mirror 10: 0x88af5c6f (stale) Mirror 12: 0x848e70e7 (stale) CRC-32 checksum value for chunk [0, 0x35516): Mirror 1: 0xb6aeba19 Mirror 13: 0xb6aeba19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35516: skipped 000418 1788484256.183393 write 0x011a74 thru 0x01cc21 (0xb1ae bytes) 000419 1788484256.268472 mapread 0x01d70d thru 0x02a023 (0xc917 bytes) 000420 1788484256.308018 mapwrite 0x0051fb thru 0x01287d (0xd683 bytes) 000422 1788484256.378655 write 0x00125d thru 0x00da81 (0xc825 bytes) 000424 1788484256.380644 mapwrite 0x014957 thru 0x01cbb0 (0x825a bytes) 000426 1788484256.435971 mapread 0x028e86 thru 0x0331f0 (0xa36b bytes) 000429 1788484256.447471 read 0x01de7f thru 0x0263d8 (0x855a bytes) 000433 1788484256.453574 mapread 0x0320a2 thru 0x035515 (0x3474 bytes) 000434 1788484256.454682 mapwrite 0x02fdbe thru 0x03422c (0x446f bytes) 000435 1788484256.505714 mapread 0x034582 thru 0x035515 (0xf94 bytes) 000436 1788484256.506903 write 0x015e67 thru 0x019c13 (0x3dad bytes) 000437 1788484256.514148 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35516): Mirror 9: 0xb6e2763f (stale) Mirror 10: 0x88af5c6f (stale) Mirror 12: 0x848e70e7 (stale) Mirror 13: 0xb6aeba19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35516): Mirror 9: 0xb6e2763f (stale) Mirror 10: 0x88af5c6f (stale) Mirror 12: 0x848e70e7 (stale) Mirror 13: 0xb6aeba19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35516: skipped 000438 1788484256.999311 trunc from 0x035516 to 0x016355 (0x1f1c0 bytes) 000442 1788484257.048284 mapread 0x0063e3 thru 0x013631 (0xd24f bytes) 000449 1788484257.104517 read 0x00d2e3 thru 0x0150bb (0x7dd9 bytes) 000451 1788484257.109513 write 0x00f4eb thru 0x015d34 (0x684a bytes) 000452 1788484257.114571 mapread 0x008f43 thru 0x013ad3 (0xab91 bytes) 000455 1788484257.121208 trunc from 0x016356 to 0x022b4b (0xc7f6 bytes) 000456 1788484257.191011 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22b4c): Mirror 10: 0xb1686818 (stale) Mirror 12: 0x845af1a6 (stale) Mirror 13: 0xc1551260 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22b4c): Mirror 10: 0xb1686818 (stale) Mirror 12: 0x845af1a6 (stale) Mirror 13: 0xc1551260 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22b4c: skipped 000459 1788484257.721498 write 0x00bbd3 thru 0x0116d1 (0x5aff bytes) 000462 1788484257.737139 write 0x01bd98 thru 0x02397d (0x7be6 bytes) 000463 1788484257.743857 write 0x034575 thru 0x03ffff (0xba8b bytes) 000464 1788484257.746914 write 0x01f491 thru 0x02cfc7 (0xdb37 bytes) 000465 1788484257.761721 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe97001ab (stale) Mirror 12: 0x8ec185e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe97001ab (stale) Mirror 12: 0x8ec185e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000466 1788484258.335010 write 0x03a14b thru 0x03ffff (0x5eb5 bytes) 000467 1788484258.343135 read 0x037206 thru 0x03ffff (0x8dfa bytes) 000468 1788484258.352049 read 0x02362e thru 0x03227d (0xec50 bytes) 000470 1788484258.367554 read 0x03dbd0 thru 0x03ffff (0x2430 bytes) 000471 1788484258.375659 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe97001ab (stale) Mirror 12: 0x8ec185e1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x49b96290 Mirror 13: 0x49b96290 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000472 1788484259.752249 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe97001ab (stale) Mirror 12: 0x8ec185e1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x49b96290 Mirror 13: 0x49b96290 Mirror 14: 0x49b96290 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000473 1788484261.200039 mapwrite 0x023d6f thru 0x025ae6 (0x1d78 bytes) 000474 1788484261.383324 read 0x01e937 thru 0x029cb6 (0xb380 bytes) 000476 1788484261.384762 mapread 0x030108 thru 0x03673f (0x6638 bytes) 000477 1788484261.398257 write 0x002e75 thru 0x004f5b (0x20e7 bytes) 000478 1788484261.421940 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x8ec185e1 (stale) Mirror 13: 0x49b96290 (stale) Mirror 14: 0x49b96290 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x8ec185e1 (stale) Mirror 13: 0x49b96290 (stale) Mirror 14: 0x49b96290 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1788484261.947247 write 0x004db1 thru 0x00624c (0x149c bytes) 000480 1788484261.966395 read 0x035f78 thru 0x03f744 (0x97cd bytes) 000481 1788484261.987223 trunc from 0x040000 to 0x00dac6 (0x32539 bytes) 000484 1788484262.102828 write 0x00d7e2 thru 0x01aaaf (0xd2ce bytes) 000485 1788484262.117056 write 0x02faaa thru 0x0393c4 (0x991b bytes) 000488 1788484262.127573 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x393c5): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393c5): Mirror 12: 0x536e565b (stale) Mirror 13: 0x322f9b5f (stale) Mirror 14: 0x322f9b5f (stale) CRC-32 checksum value for chunk [0, 0x393c5): Mirror 1: 0xd40620a3 Mirror 15: 0xd40620a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393c5: skipped 000489 1788484263.661215 trunc from 0x0393c5 to 0x017d08 (0x216bc bytes) 000490 1788484263.763796 write 0x019cb7 thru 0x023a5d (0x9da7 bytes) 000493 1788484263.772462 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23a5e): Mirror 12: 0xe3a10cc3 (stale) Mirror 13: 0x637061db (stale) Mirror 14: 0x637061db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23a5e): Mirror 12: 0xe3a10cc3 (stale) Mirror 13: 0x637061db (stale) Mirror 14: 0x637061db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23a5e: skipped 000494 1788484264.231456 write 0x0274ad thru 0x035d5f (0xe8b3 bytes) 000495 1788484264.233942 mapread 0x006290 thru 0x01392e (0xd69f bytes) 000497 1788484264.265790 mapread 0x00f85f thru 0x01efc2 (0xf764 bytes) 000498 1788484264.280265 mapwrite 0x01bf2c thru 0x024ef8 (0x8fcd bytes) 000499 1788484264.335458 trunc from 0x035d60 to 0x02862b (0xd734 bytes) 000501 1788484264.364117 mapwrite 0x0176e8 thru 0x022c18 (0xb531 bytes) 000502 1788484264.510988 mapread 0x000896 thru 0x00cc9a (0xc405 bytes) 000503 1788484264.522995 write 0x0177dc thru 0x019088 (0x18ad bytes) 000505 1788484264.526808 read 0x0115b9 thru 0x01b5df (0xa027 bytes) 000506 1788484264.528081 trunc from 0x02862c to 0x023525 (0x5106 bytes) 000507 1788484264.570418 mapwrite 0x00146e thru 0x00834a (0x6edd bytes) 000508 1788484264.693201 mapwrite 0x022cb0 thru 0x030d3b (0xe08c bytes) 000509 1788484264.815131 trunc from 0x030d3c to 0x01c21f (0x14b1c bytes) 000514 1788484264.834475 write 0x02b7ee thru 0x036e87 (0xb69a bytes) 000515 1788484264.838948 trunc from 0x036e88 to 0x01fd32 (0x17155 bytes) 000516 1788484264.859893 write 0x029eb1 thru 0x030dcd (0x6f1d bytes) 000518 1788484264.869052 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30dce): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30dce): Mirror 12: 0x8a509d7f (stale) Mirror 13: 0x574bad2c (stale) Mirror 14: 0x574bad2c (stale) CRC-32 checksum value for chunk [0, 0x30dce): Mirror 1: 0xd1db435f Mirror 15: 0xd1db435f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30dce: skipped 000519 1788484266.186438 mapread 0x01d74f thru 0x021bd5 (0x4487 bytes) 000520 1788484266.209445 trunc from 0x030dce to 0x0032bd (0x2db10 bytes) 000522 1788484266.347519 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32be): Mirror 12: 0xcd499b5d (stale) Mirror 14: 0xba5f8ed (stale) Mirror 15: 0x2d70654c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32be): Mirror 12: 0xcd499b5d (stale) Mirror 14: 0xba5f8ed (stale) Mirror 15: 0x2d70654c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32be: skipped 000524 1788484266.813856 mapwrite 0x023661 thru 0x031639 (0xdfd9 bytes) 000525 1788484266.929927 MIRROR_RESYNC 4 mirrors 000526 1788484268.797802 mapread 0x003cda thru 0x00f6f1 (0xba18 bytes) 000528 1788484268.853744 trunc from 0x03163a to 0x03e000 (0xc9c7 bytes) 000529 1788484269.105887 trunc from 0x03e001 to 0x0207cc (0x1d834 bytes) 000531 1788484269.193633 MIRROR_RESYNC 4 mirrors 000532 1788484271.169510 write 0x03f027 thru 0x03ffff (0xfd9 bytes) 000533 1788484271.236031 read 0x020cbf thru 0x02668d (0x59cf bytes) 000534 1788484271.244010 read 0x00736b thru 0x014871 (0xd507 bytes) 000535 1788484271.256564 mapread 0x0313c7 thru 0x0327a8 (0x13e2 bytes) 000536 1788484271.258996 write 0x0164ac thru 0x017d66 (0x18bb bytes) 000539 1788484271.261400 mapwrite 0x0038d7 thru 0x00490f (0x1039 bytes) 000542 1788484271.312872 write 0x03bfc3 thru 0x03ffff (0x403d bytes) 000543 1788484271.314000 trunc from 0x040000 to 0x01ffe5 (0x2001a bytes) 000544 1788484271.343089 write 0x027f4d thru 0x02fe94 (0x7f48 bytes) 000547 1788484271.348208 mapread 0x01b9fa thru 0x0220d6 (0x66dd bytes) 000548 1788484271.366107 read 0x024811 thru 0x02b842 (0x7032 bytes) 000549 1788484271.375012 write 0x002b8d thru 0x011f61 (0xf3d5 bytes) 000551 1788484271.377248 trunc from 0x02fe95 to 0x013852 (0x1c642 bytes) 000554 1788484271.396427 read 0x005a5c thru 0x009f35 (0x44da bytes) 000557 1788484271.399242 write 0x03b60c thru 0x03ffff (0x49f4 bytes) 000560 1788484271.402521 mapread 0x0214ae thru 0x02909a (0x7bed bytes) 000563 1788484271.412762 write 0x005721 thru 0x00f1fa (0x9ada bytes) 000564 1788484271.414880 write 0x038b6d thru 0x03bdcb (0x325f bytes) 000565 1788484271.416081 trunc from 0x040000 to 0x018252 (0x27dad bytes) 000566 1788484271.437267 trunc from 0x018253 to 0x002a36 (0x1581c bytes) 000567 1788484271.455262 mapwrite 0x02750a thru 0x0333ea (0xbee1 bytes) 000570 1788484271.585750 mapwrite 0x02a7e6 thru 0x02a885 (0xa0 bytes) 000572 1788484271.630836 write 0x00d293 thru 0x01d062 (0xfdd0 bytes) 000573 1788484271.642227 mapwrite 0x039321 thru 0x03ffff (0x6cdf bytes) 000574 1788484271.746322 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf802002f (stale) Mirror 14: 0xf802002f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf802002f (stale) Mirror 14: 0xf802002f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000575 1788484272.040183 mapwrite 0x03da8e thru 0x03ffff (0x2572 bytes) 000576 1788484272.127639 write 0x02704d thru 0x02b8f5 (0x48a9 bytes) 000577 1788484272.137211 write 0x0104c9 thru 0x01439c (0x3ed4 bytes) 000578 1788484272.154821 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf802002f (stale) Mirror 14: 0xf802002f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9d160d19 Mirror 15: 0x9d160d19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000581 1788484273.175729 read 0x033994 thru 0x03d691 (0x9cfe bytes) 000582 1788484273.187480 read 0x030233 thru 0x035b80 (0x594e bytes) 000584 1788484273.206817 read 0x021638 thru 0x031262 (0xfc2b bytes) 000587 1788484273.216262 write 0x01b23f thru 0x028f90 (0xdd52 bytes) 000590 1788484273.274246 trunc from 0x040000 to 0x02920c (0x16df3 bytes) 000592 1788484273.313677 trunc from 0x02920d to 0x032701 (0x94f5 bytes) 000593 1788484273.341925 mapread 0x005f3e thru 0x00bb18 (0x5bdb bytes) 000594 1788484273.343865 mapread 0x01fcd3 thru 0x0283cd (0x86fb bytes) 000595 1788484273.348958 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x32702): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32702): Mirror 12: 0x70dffa62 (stale) Mirror 14: 0x70dffa62 (stale) Mirror 15: 0x9c81ce78 (stale) CRC-32 checksum value for chunk [0, 0x32702): Mirror 1: 0x80d47102 Mirror 16: 0x80d47102 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32702: skipped 000597 1788484274.318714 write 0x018fd9 thru 0x0270f0 (0xe118 bytes) 000598 1788484274.509038 write 0x0103c9 thru 0x01210e (0x1d46 bytes) 000600 1788484274.524899 mapwrite 0x02ab3b thru 0x0343f3 (0x98b9 bytes) 000601 1788484274.803111 read 0x021d00 thru 0x026b48 (0x4e49 bytes) 000602 1788484274.803883 write 0x037853 thru 0x03fa64 (0x8212 bytes) 000603 1788484274.805307 trunc from 0x03fa65 to 0x03aac7 (0x4f9d bytes) 000604 1788484274.837160 read 0x02f361 thru 0x03aac7 (0xb767 bytes) 000605 1788484274.861355 trunc from 0x03aac8 to 0x02bfea (0xeadd bytes) 000606 1788484274.884207 write 0x00fcf7 thru 0x018e76 (0x9180 bytes) 000607 1788484274.887917 write 0x0147ed thru 0x01b064 (0x6878 bytes) 000609 1788484274.891391 write 0x035aa3 thru 0x035c8a (0x1e8 bytes) 000612 1788484274.895703 write 0x004ac8 thru 0x0140ff (0xf638 bytes) 000614 1788484274.904052 MIRROR_RESYNC 5 mirrors 000615 1788484276.288325 read 0x02ec53 thru 0x035c8a (0x7038 bytes) 000616 1788484276.317413 mapwrite 0x02b89a thru 0x03451d (0x8c84 bytes) 000617 1788484276.494380 read 0x01214e thru 0x01744b (0x52fe bytes) 000619 1788484276.512096 mapwrite 0x00e11d thru 0x013958 (0x583c bytes) 000620 1788484276.618322 mapread 0x01f12c thru 0x022da6 (0x3c7b bytes) 000625 1788484276.630148 write 0x023b69 thru 0x027451 (0x38e9 bytes) 000629 1788484276.639133 mapwrite 0x02833a thru 0x0347c5 (0xc48c bytes) 000631 1788484276.720281 MIRROR_RESYNC 5 mirrors 000632 1788484277.919292 read 0x0209dc thru 0x02d473 (0xca98 bytes) 000635 1788484277.961575 MIRROR_RESYNC 5 mirrors 000636 1788484278.632655 read 0x0006c8 thru 0x009f18 (0x9851 bytes) 000637 1788484278.654067 trunc from 0x035c8b to 0x01f75f (0x1652b bytes) 000642 1788484278.783388 MIRROR_RESYNC 5 mirrors 000643 1788484279.716503 mapwrite 0x022fec thru 0x027fa3 (0x4fb8 bytes) 000644 1788484279.918092 MIRROR_RESYNC 5 mirrors 000645 1788484280.874082 mapwrite 0x03af69 thru 0x03ffff (0x5097 bytes) 000646 1788484281.106044 trunc from 0x040000 to 0x01063f (0x2f9c0 bytes) 000647 1788484281.136010 read 0x0048c4 thru 0x007152 (0x288f bytes) 000649 1788484281.147149 trunc from 0x010640 to 0x008214 (0x842b bytes) 000651 1788484281.167158 mapwrite 0x029214 thru 0x02b64c (0x2439 bytes) 000653 1788484281.271249 MIRROR_RESYNC 5 mirrors 000654 1788484282.776853 mapwrite 0x026aab thru 0x03606d (0xf5c3 bytes) 000656 1788484283.071461 mapwrite 0x02f0c8 thru 0x03584a (0x6783 bytes) 000659 1788484283.119779 mapwrite 0x008c40 thru 0x018069 (0xf42a bytes) 000661 1788484283.240922 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3606e): Mirror 12: 0xe418900a (stale) Mirror 14: 0xe418900a (stale) Mirror 16: 0xe418900a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3606e): Mirror 12: 0xe418900a (stale) Mirror 14: 0xe418900a (stale) Mirror 16: 0xe418900a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3606e: skipped 000663 1788484283.781822 mapwrite 0x03a442 thru 0x03ffff (0x5bbe bytes) 000667 1788484283.875369 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2fdfb166 (stale) Mirror 14: 0x2fdfb166 (stale) Mirror 16: 0x2fdfb166 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd25e1b9e Mirror 17: 0xd25e1b9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000668 1788484285.205195 read 0x003756 thru 0x004694 (0xf3f bytes) 000669 1788484285.218892 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2fdfb166 (stale) Mirror 14: 0x2fdfb166 (stale) Mirror 16: 0x2fdfb166 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd25e1b9e Mirror 17: 0xd25e1b9e Mirror 18: 0xd25e1b9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000671 1788484286.211528 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2fdfb166 (stale) Mirror 14: 0x2fdfb166 (stale) Mirror 16: 0x2fdfb166 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2fdfb166 (stale) Mirror 14: 0x2fdfb166 (stale) Mirror 16: 0x2fdfb166 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd25e1b9e Mirror 18: 0xd25e1b9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000673 1788484286.830520 write 0x01cc34 thru 0x026b08 (0x9ed5 bytes) 000674 1788484286.940017 write 0x0345c8 thru 0x03ffff (0xba38 bytes) 000675 1788484286.952314 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2fdfb166 (stale) Mirror 16: 0x2fdfb166 (stale) Mirror 18: 0xd25e1b9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2fdfb166 (stale) Mirror 16: 0x2fdfb166 (stale) Mirror 18: 0xd25e1b9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000676 1788484287.473078 mapread 0x00853c thru 0x014473 (0xbf38 bytes) 000679 1788484287.521032 write 0x015dee thru 0x0194d8 (0x36eb bytes) 000680 1788484287.522510 mapwrite 0x0242d6 thru 0x02af3d (0x6c68 bytes) 000681 1788484287.612135 trunc from 0x040000 to 0x023eb1 (0x1c14e bytes) 000682 1788484287.635697 read 0x00ca05 thru 0x010385 (0x3981 bytes) 000683 1788484287.640963 mapwrite 0x0353b2 thru 0x03aca6 (0x58f5 bytes) 000684 1788484287.736847 read 0x0182d3 thru 0x026ecc (0xebfa bytes) 000685 1788484287.763920 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aca7): Mirror 16: 0x6c1768ba (stale) Mirror 18: 0x62f134cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aca7): Mirror 16: 0x6c1768ba (stale) Mirror 18: 0x62f134cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aca7: skipped 000687 1788484288.154203 trunc from 0x03aca7 to 0x034ccd (0x5fd9 bytes) 000688 1788484288.181546 write 0x03271c thru 0x03affd (0x88e2 bytes) 000689 1788484288.190014 mapwrite 0x02e87b thru 0x03b7b7 (0xcf3d bytes) 000690 1788484288.345287 read 0x009f0d thru 0x00b23c (0x1330 bytes) 000691 1788484288.362157 MIRROR_RESYNC 3 mirrors 000694 1788484289.748036 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000696 1788484290.096840 MIRROR_RESYNC 2 mirrors 000698 1788484290.523090 write 0x03be1a thru 0x03ffff (0x41e6 bytes) 000699 1788484290.684002 mapwrite 0x03bd89 thru 0x03ffff (0x4277 bytes) 000700 1788484290.790173 mapread 0x004780 thru 0x0104ae (0xbd2f bytes) 000703 1788484290.826959 trunc from 0x040000 to 0x03ce65 (0x319a bytes) 000704 1788484290.861869 mapwrite 0x00b5b1 thru 0x00f2a8 (0x3cf8 bytes) 000705 1788484290.922541 mapread 0x0260a6 thru 0x02a22f (0x418a bytes) 000707 1788484290.936773 read 0x0073b7 thru 0x00e4b4 (0x70fe bytes) 000708 1788484290.942867 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000711 1788484291.164479 MIRROR_EXTEND to 2 mirrors 000714 1788484292.090745 MIRROR_RESYNC 2 mirrors 000715 1788484292.511057 read 0x01b2bc thru 0x02a0f0 (0xee35 bytes) 000716 1788484292.557776 read 0x008bd0 thru 0x00f81e (0x6c4f bytes) 000718 1788484292.595484 mapread 0x02a601 thru 0x034c18 (0xa618 bytes) 000721 1788484292.629808 read 0x025115 thru 0x026ae7 (0x19d3 bytes) 000722 1788484292.642278 read 0x009c4c thru 0x00fb4b (0x5f00 bytes) 000723 1788484292.655473 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000724 1788484292.897485 mapwrite 0x00c991 thru 0x013dca (0x743a bytes) 000725 1788484293.057319 trunc from 0x03ce66 to 0x004c15 (0x38250 bytes) 000728 1788484293.081104 write 0x00965d thru 0x018540 (0xeee4 bytes) 000729 1788484293.084333 mapwrite 0x024d4d thru 0x02d664 (0x8918 bytes) 000731 1788484293.188751 mapwrite 0x01aa10 thru 0x02167f (0x6c70 bytes) 000732 1788484293.254761 write 0x03675e thru 0x03ffff (0x98a2 bytes) 000734 1788484293.257513 write 0x003f26 thru 0x01163d (0xd718 bytes) 000735 1788484293.271028 MIRROR_EXTEND to 2 mirrors 000737 1788484293.943483 mapread 0x001cfe thru 0x004df9 (0x30fc bytes) 000738 1788484293.972501 mapwrite 0x02a8fc thru 0x0311cc (0x68d1 bytes) 000740 1788484294.150931 read 0x008b8d thru 0x00fb6f (0x6fe3 bytes) 000741 1788484294.165557 mapwrite 0x010e13 thru 0x018d49 (0x7f37 bytes) 000744 1788484294.241689 mapread 0x0202a3 thru 0x023106 (0x2e64 bytes) 000745 1788484294.250643 trunc from 0x040000 to 0x000ada (0x3f525 bytes) 000746 1788484294.309051 read 0x00092e thru 0x000ada (0x1ad bytes) 000747 1788484294.319724 write 0x01adae thru 0x02738e (0xc5e1 bytes) 000748 1788484294.324836 trunc from 0x02738f to 0x03ba7d (0x146ef bytes) 000749 1788484294.385979 write 0x022f29 thru 0x023386 (0x45e bytes) 000751 1788484294.388218 mapread 0x025734 thru 0x032e67 (0xd734 bytes) 000752 1788484294.407990 read 0x0186c8 thru 0x02255f (0x9e98 bytes) 000753 1788484294.412954 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000757 1788484294.636990 mapwrite 0x00296b thru 0x007918 (0x4fae bytes) 000758 1788484294.712480 trunc from 0x03ba7e to 0x032a2c (0x9051 bytes) 000762 1788484294.730920 trunc from 0x032a2d to 0x00aaa4 (0x27f88 bytes) 000765 1788484294.745249 write 0x00ec03 thru 0x017765 (0x8b63 bytes) 000772 1788484294.749268 read 0x007ad1 thru 0x010a99 (0x8fc9 bytes) 000773 1788484294.753703 mapwrite 0x02ec1f thru 0x03c646 (0xda28 bytes) 000774 1788484294.800992 mapread 0x034fb2 thru 0x03a84e (0x589d bytes) 000778 1788484294.805568 trunc from 0x03c647 to 0x033e02 (0x8844 bytes) 000779 1788484294.845487 read 0x003d93 thru 0x0103e2 (0xc650 bytes) 000780 1788484294.846299 write 0x00da67 thru 0x011cf6 (0x4290 bytes) 000785 1788484294.850069 read 0x02b57e thru 0x033e02 (0x8885 bytes) 000786 1788484294.850905 read 0x02f545 thru 0x0309b5 (0x1471 bytes) 000787 1788484294.851456 write 0x006f9c thru 0x00ee82 (0x7ee7 bytes) 000788 1788484294.853187 mapread 0x0080dd thru 0x013f5a (0xbe7e bytes) 000790 1788484294.855277 mapwrite 0x02b613 thru 0x031156 (0x5b44 bytes) 000791 1788484294.926058 write 0x00f54f thru 0x018049 (0x8afb bytes) 000796 1788484294.949383 MIRROR_EXTEND to 2 mirrors 000797 1788484295.944899 read 0x00be5e thru 0x00c4f1 (0x694 bytes) 000799 1788484295.969957 write 0x023755 thru 0x02c271 (0x8b1d bytes) 000800 1788484296.087216 read 0x0016b2 thru 0x009391 (0x7ce0 bytes) 000801 1788484296.117849 read 0x00e84a thru 0x01e7fd (0xffb4 bytes) 000802 1788484296.118552 read 0x014bc0 thru 0x02106d (0xc4ae bytes) 000805 1788484296.127717 read 0x0042fc thru 0x013c0b (0xf910 bytes) 000806 1788484296.130865 write 0x0080b5 thru 0x016f50 (0xee9c bytes) 000809 1788484296.153927 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000811 1788484296.327340 mapwrite 0x00edff thru 0x01b30f (0xc511 bytes) 000812 1788484296.430003 mapread 0x031a40 thru 0x033e02 (0x23c3 bytes) 000813 1788484296.442731 mapread 0x004a60 thru 0x00ab62 (0x6103 bytes) 000814 1788484296.452981 read 0x00758d thru 0x0113d4 (0x9e48 bytes) 000815 1788484296.454013 read 0x007425 thru 0x00e059 (0x6c35 bytes) 000816 1788484296.456010 mapwrite 0x03a7dc thru 0x03f2ac (0x4ad1 bytes) 000818 1788484296.573306 write 0x01dfc3 thru 0x024570 (0x65ae bytes) 000819 1788484296.581226 MIRROR_EXTEND to 2 mirrors 000822 1788484297.990010 MIRROR_EXTEND to 3 mirrors 000823 1788484298.989289 mapread 0x03829d thru 0x03f2ac (0x7010 bytes) 000826 1788484299.019635 mapwrite 0x0393ad thru 0x03ffff (0x6c53 bytes) 000828 1788484299.176437 mapwrite 0x000ff2 thru 0x006cd1 (0x5ce0 bytes) 000829 1788484299.256494 write 0x014bed thru 0x01b327 (0x673b bytes) 000830 1788484299.279908 mapread 0x022901 thru 0x022dca (0x4ca bytes) 000831 1788484299.299223 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x53140806 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x53140806 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000832 1788484299.752432 mapwrite 0x005b65 thru 0x00bac5 (0x5f61 bytes) 000833 1788484299.951000 read 0x022c13 thru 0x0308a3 (0xdc91 bytes) 000835 1788484300.059152 read 0x0215e2 thru 0x025117 (0x3b36 bytes) 000836 1788484300.102022 mapwrite 0x02f331 thru 0x036843 (0x7513 bytes) 000837 1788484300.168790 write 0x029cd9 thru 0x02d9fd (0x3d25 bytes) 000838 1788484300.169782 trunc from 0x040000 to 0x0118a8 (0x2e757 bytes) 000841 1788484300.232474 read 0x00177d thru 0x00e7b7 (0xd03b bytes) 000842 1788484300.233122 mapread 0x001489 thru 0x00748b (0x6003 bytes) 000844 1788484300.238693 mapread 0x0089c8 thru 0x00ed13 (0x634c bytes) 000845 1788484300.240040 read 0x0090ef thru 0x0118a8 (0x87ba bytes) 000846 1788484300.273299 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000851 1788484300.533985 trunc from 0x0118a9 to 0x014934 (0x308c bytes) 000852 1788484300.580257 mapread 0x002be8 thru 0x00d93b (0xad54 bytes) 000853 1788484300.643934 write 0x023232 thru 0x02a9bb (0x778a bytes) 000856 1788484300.652457 mapwrite 0x01f626 thru 0x022174 (0x2b4f bytes) 000857 1788484300.784434 read 0x011c9c thru 0x014f92 (0x32f7 bytes) 000862 1788484300.820479 mapread 0x00bd48 thru 0x00eee6 (0x319f bytes) 000863 1788484300.821538 write 0x037953 thru 0x03ffff (0x86ad bytes) 000864 1788484300.833035 mapwrite 0x02910d thru 0x02b87a (0x276e bytes) 000865 1788484300.996245 write 0x0152b5 thru 0x01fb2b (0xa877 bytes) 000866 1788484301.029413 write 0x011aff thru 0x013118 (0x161a bytes) 000867 1788484301.033365 mapwrite 0x03c2dd thru 0x03d6f2 (0x1416 bytes) 000868 1788484301.128939 read 0x01b429 thru 0x01e56c (0x3144 bytes) 000869 1788484301.130466 mapwrite 0x03d6a8 thru 0x03ffff (0x2958 bytes) 000870 1788484301.245651 write 0x0130db thru 0x01b71f (0x8645 bytes) 000871 1788484301.248457 write 0x026d62 thru 0x031a86 (0xad25 bytes) 000872 1788484301.263517 trunc from 0x040000 to 0x006fc1 (0x3903e bytes) 000874 1788484301.291801 write 0x02583b thru 0x027251 (0x1a17 bytes) 000877 1788484301.297240 read 0x01d624 thru 0x0225aa (0x4f87 bytes) 000878 1788484301.310393 mapread 0x0191f5 thru 0x02203a (0x8e46 bytes) 000879 1788484301.311617 mapwrite 0x01b4b4 thru 0x01fe87 (0x49d4 bytes) 000881 1788484301.370818 mapwrite 0x00a118 thru 0x0124b3 (0x839c bytes) 000882 1788484301.438405 write 0x03f980 thru 0x03ffff (0x680 bytes) 000884 1788484301.441238 trunc from 0x040000 to 0x004749 (0x3b8b6 bytes) 000886 1788484301.488465 mapread 0x00276f thru 0x004749 (0x1fdb bytes) 000888 1788484301.489730 write 0x01b8eb thru 0x01fc6b (0x4381 bytes) 000889 1788484301.496963 read 0x016119 thru 0x01fc6b (0x9b53 bytes) 000894 1788484301.528756 mapread 0x004514 thru 0x0073f9 (0x2ee6 bytes) 000895 1788484301.529971 read 0x0099ff thru 0x0124c1 (0x8ac3 bytes) 000899 1788484301.538453 trunc from 0x01fc6c to 0x0090b9 (0x16bb2 bytes) 000900 1788484301.591773 MIRROR_EXTEND to 2 mirrors 000902 1788484303.135715 trunc from 0x0090ba to 0x03890b (0x2f852 bytes) 000904 1788484303.396083 mapwrite 0x03ca8d thru 0x03ffff (0x3573 bytes) 000905 1788484303.664735 mapwrite 0x01fc8e thru 0x0269f4 (0x6d67 bytes) 000906 1788484303.857711 trunc from 0x040000 to 0x034835 (0xb7ca bytes) 000907 1788484303.930846 write 0x0349be thru 0x03eebb (0xa4fe bytes) 000908 1788484303.953284 mapread 0x008e40 thru 0x018791 (0xf952 bytes) 000909 1788484304.020695 mapwrite 0x015942 thru 0x015edd (0x59c bytes) 000910 1788484304.152335 write 0x023a04 thru 0x02ff24 (0xc521 bytes) 000912 1788484304.163774 mapwrite 0x003d95 thru 0x010d9f (0xd00b bytes) 000913 1788484304.306951 read 0x01d14c thru 0x026af7 (0x99ac bytes) 000916 1788484304.315763 mapread 0x020f14 thru 0x02592f (0x4a1c bytes) 000918 1788484304.320225 mapread 0x0218fd thru 0x026601 (0x4d05 bytes) 000920 1788484304.322183 mapread 0x0267aa thru 0x02a3f2 (0x3c49 bytes) 000923 1788484304.327849 write 0x03adc5 thru 0x03ffff (0x523b bytes) 000924 1788484304.330372 mapwrite 0x03958d thru 0x0395e1 (0x55 bytes) 000925 1788484304.509703 mapwrite 0x022252 thru 0x02ded3 (0xbc82 bytes) 000926 1788484304.620464 write 0x01face thru 0x028cc6 (0x91f9 bytes) 000927 1788484304.623677 mapread 0x020c7b thru 0x02fd63 (0xf0e9 bytes) 000928 1788484304.626174 trunc from 0x040000 to 0x011134 (0x2eecb bytes) 000929 1788484304.682891 mapwrite 0x00027b thru 0x00dad5 (0xd85b bytes) 000931 1788484304.903033 trunc from 0x011135 to 0x00d365 (0x3dcf bytes) 000932 1788484304.950140 trunc from 0x00d366 to 0x037c74 (0x2a90f bytes) 000933 1788484305.015704 mapread 0x0107d7 thru 0x01371e (0x2f48 bytes) 000936 1788484305.035135 write 0x000df5 thru 0x0093c5 (0x85d1 bytes) 000937 1788484305.047512 trunc from 0x037c75 to 0x000279 (0x379fb bytes) 000939 1788484305.091551 write 0x014f53 thru 0x021def (0xce9d bytes) 000943 1788484305.139285 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21df0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21df0): Mirror 2: 0xd6f51c99 (stale) CRC-32 checksum value for chunk [0, 0x21df0): Mirror 1: 0x4bab8de8 Mirror 3: 0x4bab8de8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21df0: skipped 000944 1788484307.282487 read 0x01119b thru 0x01a11e (0x8f84 bytes) 000945 1788484307.328066 read 0x0001be thru 0x00cf44 (0xcd87 bytes) 000946 1788484307.374568 trunc from 0x021df0 to 0x01de1b (0x3fd4 bytes) 000947 1788484307.668304 mapread 0x0186b3 thru 0x01c769 (0x40b7 bytes) 000948 1788484307.742707 mapread 0x008854 thru 0x013481 (0xac2e bytes) 000950 1788484308.014020 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1de1c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1de1c): Mirror 2: 0x2b34c4b2 (stale) Mirror 3: 0xca84d20a (stale) CRC-32 checksum value for chunk [0, 0x1de1c): Mirror 1: 0xca84d20a Mirror 4: 0xca84d20a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1de1c: skipped 000951 1788484310.509299 write 0x02f03b thru 0x030345 (0x130b bytes) 000952 1788484310.701234 mapread 0x02f9e2 thru 0x030345 (0x964 bytes) 000954 1788484310.705515 mapwrite 0x03c883 thru 0x03dbc6 (0x1344 bytes) 000955 1788484310.862840 mapread 0x0105ee thru 0x01f102 (0xeb15 bytes) 000957 1788484310.948763 MIRROR_RESYNC 4 mirrors 000958 1788484313.565998 read 0x0244d3 thru 0x0307c7 (0xc2f5 bytes) 000959 1788484313.595171 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000960 1788484314.426840 read 0x037604 thru 0x03ca4b (0x5448 bytes) 000961 1788484314.464477 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000964 1788484315.327828 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000972 1788484315.770465 MIRROR_EXTEND to 2 mirrors 000974 1788484317.451229 trunc from 0x03dbc7 to 0x027943 (0x16283 bytes) 000977 1788484317.605089 mapwrite 0x006e2d thru 0x009a18 (0x2bec bytes) 000979 1788484317.777299 mapread 0x020bd5 thru 0x021e2f (0x125b bytes) 000980 1788484317.799536 read 0x0228fe thru 0x023617 (0xd1a bytes) 000981 1788484317.802011 mapwrite 0x0342e3 thru 0x03ffff (0xbd1d bytes) 000983 1788484318.034670 read 0x03fda2 thru 0x03ffff (0x25e bytes) 000984 1788484318.040763 MIRROR_RESYNC 2 mirrors 000985 1788484319.306721 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000986 1788484319.489833 write 0x02be5a thru 0x03a705 (0xe8ac bytes) 000987 1788484319.510443 trunc from 0x040000 to 0x017c06 (0x283f9 bytes) 000989 1788484319.534320 mapwrite 0x0259d2 thru 0x0275ce (0x1bfd bytes) 000990 1788484319.715909 mapread 0x007e20 thru 0x0088a5 (0xa86 bytes) 000992 1788484319.748478 trunc from 0x0275cf to 0x00eaf2 (0x18adc bytes) 000993 1788484319.792055 write 0x02b33d thru 0x033366 (0x802a bytes) 000997 1788484319.808672 write 0x02e447 thru 0x03b9d7 (0xd591 bytes) 000998 1788484319.816059 trunc from 0x03b9d8 to 0x00538d (0x3664a bytes) 000999 1788484319.847057 trunc from 0x00538e to 0x014f01 (0xfb74 bytes) 001000 1788484319.898128 write 0x0361be thru 0x03b7bd (0x5600 bytes) All operations completed A-OK!