== sanity-flr test 70a: flr mode fsx test ================ 20:55:49 (1788569749) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 9751 000001 1788569751.859187 write 0x03f8c2 thru 0x03ffff (0x73e bytes) zero_range to largest ever: 0x1d7fb 000002 1788569751.868547 trunc from 0x01655e to 0x01d7fa (0x729d bytes) 000004 1788569751.874869 write 0x039350 thru 0x03ffff (0x6cb0 bytes) 000005 1788569751.885073 fallocate 0x006b0b thru 0x00aca1 (0x4197 bytes) 000006 1788569751.897475 mapwrite 0x026ac8 thru 0x0344a6 (0xd9df bytes) 000007 1788569751.950130 punch from 0x00cb90 to 0x01bdb9 (0xf22a bytes) 000008 1788569751.956659 mapwrite 0x001d26 thru 0x003e38 (0x2113 bytes) 000009 1788569751.989726 mapwrite 0x02ac26 thru 0x02dc0c (0x2fe7 bytes) fallocating to largest ever: 0x1e19e 000010 1788569752.002064 fallocate 0x01a7a4 thru 0x01e19d (0x39fa bytes) 000011 1788569752.007426 punch from 0x031b5b to 0x033972 (0x1e18 bytes) 000012 1788569752.013304 mapwrite 0x035f35 thru 0x03a5d4 (0x46a0 bytes) 000013 1788569752.030177 read 0x03583b thru 0x03eaae (0x9274 bytes) 000014 1788569752.031252 mapread 0x007ed1 thru 0x0130d4 (0xb204 bytes) 000015 1788569752.046661 punch from 0x034f6e to 0x03ffff (0xb092 bytes) 000016 1788569752.057037 punch from 0x01ee2f to 0x02d339 (0xe50b bytes) 000017 1788569752.066574 mapwrite 0x039d9d thru 0x03ffff (0x6263 bytes) truncating to largest ever: 0x3015d 000018 1788569752.131301 trunc from 0x040000 to 0x03015c (0xfea3 bytes) 000019 1788569752.155743 read 0x0087b6 thru 0x015596 (0xcde1 bytes) 000021 1788569752.158110 mapwrite 0x033846 thru 0x038b1d (0x52d8 bytes) 000022 1788569752.225618 trunc from 0x038b1e to 0x011f5d (0x26bc0 bytes) truncating to largest ever: 0x31285 000024 1788569752.261798 trunc from 0x011f5e to 0x031284 (0x1f327 bytes) 000025 1788569752.279185 trunc from 0x031285 to 0x00c587 (0x24cfd bytes) 000026 1788569752.305993 trunc from 0x005223 to 0x00c40f (0x71ed bytes) 000027 1788569752.314297 mapread 0x002954 thru 0x0088b3 (0x5f60 bytes) 000028 1788569752.338653 trunc from 0x00a03e to 0x00c587 (0x254a bytes) 000029 1788569752.352196 MIRROR_EXTEND to 2 mirrors 000030 1788569753.093036 write 0x02317a thru 0x030be3 (0xda6a bytes) truncating to largest ever: 0x39c40 000032 1788569753.140583 trunc from 0x030be4 to 0x039c3f (0x905c bytes) 000033 1788569753.183309 mapread 0x003f46 thru 0x007c34 (0x3cef bytes) 000034 1788569753.206671 mapwrite 0x02ee51 thru 0x0391d5 (0xa385 bytes) 000035 1788569753.257498 mapread 0x01174d thru 0x01dd52 (0xc606 bytes) 000036 1788569753.310814 MIRROR_RESYNC 2 mirrors 000037 1788569754.049738 fallocate 0x016a6e thru 0x02309c (0xc62f bytes) 000039 1788569754.119110 trunc from 0x009bb3 to 0x010457 (0x68a5 bytes) 000041 1788569754.125054 trunc from 0x039c40 to 0x02fa7a (0xa1c5 bytes) 000042 1788569754.168052 punch from 0x01e3fe to 0x02cc1d (0xe820 bytes) 000043 1788569754.174103 write 0x0029bb thru 0x0082df (0x5925 bytes) 000044 1788569754.188500 MIRROR_RESYNC 2 mirrors 000045 1788569754.864088 punch from 0x02a469 to 0x02fa7a (0x5612 bytes) 000046 1788569754.894588 mapwrite 0x00985d thru 0x011b16 (0x82ba bytes) 000048 1788569754.948057 mapread 0x010a06 thru 0x017132 (0x672d bytes) 000049 1788569754.976753 mapread 0x01d1d2 thru 0x029fdf (0xce0e bytes) 000050 1788569755.005539 fallocate 0x018483 thru 0x0261c7 (0xdd45 bytes) 000051 1788569755.014008 punch from 0x002740 to 0x00b095 (0x8956 bytes) 000052 1788569755.019542 read 0x001590 thru 0x00c2e9 (0xad5a bytes) 000054 1788569755.035655 read 0x021ef7 thru 0x02586e (0x3978 bytes) 000055 1788569755.042509 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2fa7b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa7b): Mirror 2: 0xbfa56b9c (stale) CRC-32 checksum value for chunk [0, 0x2fa7b): Mirror 1: 0x6eb88595 Mirror 3: 0x6eb88595 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa7b: skipped 000056 1788569756.154397 write 0x018d1f thru 0x01d287 (0x4569 bytes) 000057 1788569756.218012 mapwrite 0x038628 thru 0x03ffff (0x79d8 bytes) 000059 1788569756.287479 mapwrite 0x009ac3 thru 0x0192d5 (0xf813 bytes) 000060 1788569756.342029 fallocate 0x00f359 thru 0x018d64 (0x9a0c bytes) 000061 1788569756.346986 trunc from 0x01d65a to 0x02c780 (0xf127 bytes) 000062 1788569756.362881 fallocate 0x00d7cb thru 0x01bfc8 (0xe7fe bytes) 000063 1788569756.383668 mapread 0x03ce83 thru 0x03ffff (0x317d bytes) 000064 1788569756.385425 trunc from 0x040000 to 0x021486 (0x1eb79 bytes) 000065 1788569756.416409 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21487): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21487): Mirror 2: 0xbf8fa7c8 (stale) Mirror 3: 0xcb687a0e (stale) CRC-32 checksum value for chunk [0, 0x21487): Mirror 1: 0x25787bce Mirror 4: 0x25787bce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21487: skipped fallocating to largest ever: 0x40000 000066 1788569757.396714 fallocate 0x03e2f5 thru 0x03ffff (0x1d0b bytes) 000067 1788569757.440967 trunc from 0x021487 to 0x017572 (0x9f14 bytes) 000069 1788569757.478516 fallocate 0x031e72 thru 0x035375 (0x3504 bytes) 000070 1788569757.497577 mapwrite 0x00587d thru 0x0152b7 (0xfa3b bytes) 000071 1788569757.597690 punch from 0x01c9fa to 0x023ea2 (0x74a9 bytes) 000072 1788569757.603665 trunc from 0x02e9a4 to 0x035375 (0x69d2 bytes) 000073 1788569757.608458 write 0x037eef thru 0x03ffff (0x8111 bytes) 000074 1788569757.610222 punch from 0x01b8de to 0x02227e (0x69a1 bytes) 000075 1788569757.617192 trunc from 0x040000 to 0x03f9e3 (0x61c bytes) 000076 1788569757.660753 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f9e4): Mirror 2: 0xf7368c07 (stale) Mirror 4: 0xdbcfc9ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f9e4): Mirror 2: 0xf7368c07 (stale) Mirror 4: 0xdbcfc9ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f9e4: skipped 000077 1788569758.150240 mapwrite 0x014dd9 thru 0x017b0f (0x2d37 bytes) 000078 1788569758.201175 trunc from 0x03f9e4 to 0x01b26b (0x24778 bytes) 000079 1788569758.226224 mapread 0x00f348 thru 0x01817a (0x8e33 bytes) 000080 1788569758.234345 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b26c): Mirror 4: 0x78e2f024 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b26c): Mirror 4: 0x78e2f024 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b26c: skipped 000081 1788569758.553027 read 0x0093d3 thru 0x013a64 (0xa692 bytes) 000082 1788569758.566634 mapread 0x0168f1 thru 0x01b26b (0x497b bytes) 000083 1788569758.592310 trunc from 0x01b26c to 0x01b53d (0x2d2 bytes) 000084 1788569758.618257 read 0x007744 thru 0x00d7c8 (0x6085 bytes) 000085 1788569758.627072 write 0x00c0a3 thru 0x017914 (0xb872 bytes) 000086 1788569758.630757 mapwrite 0x01a2c3 thru 0x01e8b0 (0x45ee bytes) 000087 1788569758.703216 write 0x006eef thru 0x010569 (0x967b bytes) 000088 1788569758.705212 mapread 0x0134ef thru 0x01e8b0 (0xb3c2 bytes) 000089 1788569758.708417 write 0x00ea03 thru 0x016369 (0x7967 bytes) 000090 1788569758.710347 trunc from 0x01e8b1 to 0x01e825 (0x8b bytes) 000091 1788569758.737076 mapwrite 0x01802f thru 0x024898 (0xc86a bytes) 000092 1788569758.809298 trunc from 0x0105f1 to 0x01dc6d (0xd67d bytes) 000093 1788569758.814878 trunc from 0x01191c to 0x01e189 (0xc86e bytes) 000094 1788569758.826318 mapwrite 0x037a51 thru 0x03ffff (0x85af bytes) 000095 1788569758.903465 fallocate 0x035b9d thru 0x03ae9e (0x5302 bytes) 000096 1788569758.909805 punch from 0x013790 to 0x01a15e (0x69cf bytes) 000097 1788569758.914911 fallocate 0x00218d thru 0x00b6bb (0x952f bytes) 000098 1788569758.920831 mapread 0x01e202 thru 0x02d5fc (0xf3fb bytes) 000099 1788569758.926981 trunc from 0x040000 to 0x0108cf (0x2f730 bytes) 000100 1788569758.956581 MIRROR_RESYNC 2 mirrors 000101 1788569759.640529 trunc from 0x0108d0 to 0x00f5c4 (0x130b bytes) 000103 1788569759.688704 write 0x016ca6 thru 0x022d1d (0xc078 bytes) 000104 1788569759.699328 punch from 0x0047fa to 0x007501 (0x2d08 bytes) 000105 1788569759.715034 trunc from 0x01398b to 0x0160fb (0x2771 bytes) 000106 1788569759.737904 mapread 0x0218a5 thru 0x022d1d (0x1479 bytes) 000107 1788569759.739357 trunc from 0x022d1e to 0x008622 (0x1a6fb bytes) 000109 1788569759.796736 write 0x01f222 thru 0x027023 (0x7e02 bytes) 000110 1788569759.802657 write 0x012d55 thru 0x01415c (0x1408 bytes) 000111 1788569759.818038 mapwrite 0x026e20 thru 0x02bba8 (0x4d89 bytes) 000112 1788569759.916035 write 0x00cc7c thru 0x00f5d4 (0x2959 bytes) 000113 1788569759.932237 write 0x0324fe thru 0x03d390 (0xae93 bytes) 000114 1788569759.935955 trunc from 0x028b47 to 0x031052 (0x850c bytes) 000115 1788569759.944189 write 0x015922 thru 0x01bee1 (0x65c0 bytes) 000116 1788569759.957904 mapread 0x012f98 thru 0x01f449 (0xc4b2 bytes) 000117 1788569759.967872 punch from 0x02a592 to 0x03615e (0xbbcd bytes) 000118 1788569759.987308 fallocate 0x0256d6 thru 0x02810e (0x2a39 bytes) 000119 1788569760.020481 fallocate 0x0195ad thru 0x01ad63 (0x17b7 bytes) 000120 1788569760.031521 trunc from 0x031b49 to 0x03d390 (0xb848 bytes) 000121 1788569760.039616 write 0x02fd88 thru 0x031d2a (0x1fa3 bytes) 000122 1788569760.055141 mapwrite 0x011a33 thru 0x020e15 (0xf3e3 bytes) 000123 1788569760.086879 trunc from 0x02ad4c to 0x031538 (0x67ed bytes) 000124 1788569760.091454 write 0x000a42 thru 0x00107b (0x63a bytes) 000125 1788569760.111147 mapread 0x003544 thru 0x00547f (0x1f3c bytes) 000126 1788569760.144269 MIRROR_RESYNC 2 mirrors 000129 1788569761.144024 trunc from 0x03d391 to 0x00dabc (0x2f8d4 bytes) 000130 1788569761.222280 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xdabd): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdabd): Mirror 4: 0x7aeff0cd (stale) CRC-32 checksum value for chunk [0, 0xdabd): Mirror 1: 0x7aeff0cd Mirror 5: 0x7aeff0cd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdabd: skipped 000131 1788569762.569297 mapwrite 0x017cba thru 0x01f859 (0x7ba0 bytes) 000132 1788569762.712518 punch from 0x00925d to 0x00a74a (0x14ee bytes) 000133 1788569762.718656 mapwrite 0x0161ad thru 0x01caf3 (0x6947 bytes) 000134 1788569762.744631 write 0x02f40a thru 0x035afa (0x66f1 bytes) 000135 1788569762.751520 trunc from 0x031e96 to 0x035afa (0x3c65 bytes) 000136 1788569762.767418 write 0x034139 thru 0x035c3a (0x1b02 bytes) 000137 1788569762.777124 mapread 0x023486 thru 0x02c023 (0x8b9e bytes) 000138 1788569762.796191 read 0x02b3e5 thru 0x035c3a (0xa856 bytes) 000139 1788569762.797586 write 0x00e54c thru 0x010fd0 (0x2a85 bytes) 000140 1788569762.811102 punch from 0x007528 to 0x00e73f (0x7218 bytes) 000141 1788569762.825860 trunc from 0x035c3b to 0x035d57 (0x11d bytes) 000142 1788569762.864615 mapwrite 0x00409f thru 0x009216 (0x5178 bytes) 000144 1788569762.900634 mapread 0x035762 thru 0x035d57 (0x5f6 bytes) 000145 1788569762.902883 mapwrite 0x031266 thru 0x03650b (0x52a6 bytes) 000146 1788569762.985201 mapread 0x02c45e thru 0x03650b (0xa0ae bytes) 000147 1788569762.993539 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3650c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3650c): Mirror 4: 0x76cd262d (stale) Mirror 5: 0x4369f297 (stale) CRC-32 checksum value for chunk [0, 0x3650c): Mirror 1: 0xeaa8bc5c Mirror 6: 0xeaa8bc5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3650c: skipped 000148 1788569764.339835 mapwrite 0x03e419 thru 0x03f040 (0xc28 bytes) 000149 1788569764.507391 trunc from 0x009b89 to 0x00eeb9 (0x5331 bytes) 000150 1788569764.519719 trunc from 0x03c81d to 0x03e96b (0x214f bytes) 000151 1788569764.529377 trunc from 0x029927 to 0x02f264 (0x593e bytes) 000152 1788569764.540739 trunc from 0x03f041 to 0x0255c8 (0x19a78 bytes) 000154 1788569764.594007 punch from 0x013774 to 0x01b586 (0x7e13 bytes) 000155 1788569764.604898 write 0x00818e thru 0x014b85 (0xc9f8 bytes) 000156 1788569764.626376 mapread 0x01ae83 thru 0x0255c8 (0xa746 bytes) 000157 1788569764.669112 trunc from 0x01525f to 0x01c927 (0x76c9 bytes) 000159 1788569764.684265 punch from 0x007992 to 0x016ce7 (0xf356 bytes) 000160 1788569764.718546 mapwrite 0x013302 thru 0x0150bf (0x1dbe bytes) 000161 1788569764.771203 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x255c9): Mirror 5: 0x1ae03f83 (stale) Mirror 6: 0xd907404a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x255c9): Mirror 5: 0x1ae03f83 (stale) Mirror 6: 0xd907404a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x255c9: skipped 000162 1788569765.227944 write 0x036391 thru 0x03ffff (0x9c6f bytes) 000163 1788569765.236511 read 0x03541b thru 0x038896 (0x347c bytes) 000164 1788569765.248950 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x361a2fba (stale) Mirror 6: 0x5a6f4094 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4e7cfa92 Mirror 7: 0x4e7cfa92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000165 1788569766.501524 trunc from 0x000d6a to 0x003b67 (0x2dfe bytes) 000166 1788569766.541450 fallocate 0x01fa5c thru 0x02064d (0xbf2 bytes) 000167 1788569766.546896 mapread 0x03ab37 thru 0x03ffff (0x54c9 bytes) 000168 1788569766.568210 trunc from 0x040000 to 0x01244f (0x2dbb0 bytes) 000169 1788569766.612390 trunc from 0x012450 to 0x00040a (0x12045 bytes) 000170 1788569766.635431 read 0x000215 thru 0x00040a (0x1f6 bytes) 000171 1788569766.648458 punch from 0x0001c6 to 0x00040a (0x245 bytes) 000172 1788569766.657267 trunc from 0x0001f4 to 0x0002e2 (0xef bytes) 000173 1788569766.662727 trunc from 0x0000a4 to 0x00040a (0x367 bytes) 000174 1788569766.672383 mapread 0x000240 thru 0x00040a (0x1cb bytes) 000175 1788569766.684057 fallocate 0x00db20 thru 0x01bbe3 (0xe0c4 bytes) 000176 1788569766.690671 punch from 0x000266 to 0x00040a (0x1a5 bytes) 000177 1788569766.695754 read 0x0000a8 thru 0x00040a (0x363 bytes) 000178 1788569766.701506 punch from 0x00006b to 0x00040a (0x3a0 bytes) 000179 1788569766.709493 read 0x000354 thru 0x00040a (0xb7 bytes) 000180 1788569766.714917 write 0x0267e0 thru 0x02d0ab (0x68cc bytes) 000181 1788569766.716577 mapread 0x02ce3a thru 0x02d0ab (0x272 bytes) 000182 1788569766.720837 fallocate 0x017d63 thru 0x02340e (0xb6ac bytes) 000183 1788569766.726305 read 0x0228a5 thru 0x02a7b6 (0x7f12 bytes) 000184 1788569766.749018 write 0x02bd8f thru 0x0341e8 (0x845a bytes) 000185 1788569766.750799 trunc from 0x0000f0 to 0x006b97 (0x6aa8 bytes) 000186 1788569766.767405 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x341e9): Mirror 6: 0xf9d83f44 (stale) Mirror 7: 0x7d675458 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341e9): Mirror 6: 0xf9d83f44 (stale) Mirror 7: 0x7d675458 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341e9: skipped 000187 1788569767.234566 fallocate 0x03d9e3 thru 0x03f28f (0x18ad bytes) 000189 1788569767.242529 read 0x019026 thru 0x0202d3 (0x72ae bytes) 000190 1788569767.258480 mapwrite 0x00f142 thru 0x013635 (0x44f4 bytes) 000191 1788569767.310590 trunc from 0x03f290 to 0x022ddb (0x1c4b4 bytes) 000192 1788569767.343586 fallocate 0x01cca3 thru 0x02ca31 (0xfd8f bytes) 000193 1788569767.351926 read 0x01c35c thru 0x022ddb (0x6a80 bytes) 000194 1788569767.393116 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22ddc): Mirror 7: 0x1b27d341 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22ddc): Mirror 7: 0x1b27d341 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22ddc: skipped 000195 1788569767.791708 read 0x01e495 thru 0x02208a (0x3bf6 bytes) 000196 1788569767.817604 read 0x00fb2f thru 0x018ac1 (0x8f93 bytes) 000197 1788569767.840683 trunc from 0x007684 to 0x017490 (0xfe0d bytes) 000198 1788569767.848120 fallocate 0x03086e thru 0x0395aa (0x8d3d bytes) 000199 1788569767.855687 read 0x009b94 thru 0x00b791 (0x1bfe bytes) 000200 1788569767.884977 write 0x005e51 thru 0x00c718 (0x68c8 bytes) 000201 1788569767.891391 trunc from 0x0395ab to 0x005ae3 (0x33ac7 bytes) 000202 1788569767.910431 trunc from 0x005a96 to 0x005ae3 (0x4e bytes) 000203 1788569767.925272 MIRROR_RESYNC 2 mirrors 000204 1788569768.750180 fallocate 0x038a8d thru 0x03f4c2 (0x6a36 bytes) 000205 1788569768.788979 punch from 0x00074c to 0x005ae3 (0x5398 bytes) 000206 1788569768.794878 read 0x0008c8 thru 0x005ae3 (0x521c bytes) 000207 1788569768.814758 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) 000208 1788569768.980696 trunc from 0x005ae4 to 0x03ccb6 (0x371d3 bytes) 000209 1788569768.999608 punch from 0x035689 to 0x03ccb6 (0x762e bytes) 000210 1788569769.004018 fallocate 0x0163ef thru 0x018a69 (0x267b bytes) 000211 1788569769.008931 write 0x03c172 thru 0x03ffff (0x3e8e bytes) 000212 1788569769.014661 mapread 0x01496c thru 0x01ce8b (0x8520 bytes) 000213 1788569769.036562 mapread 0x02d8a0 thru 0x036d80 (0x94e1 bytes) 000214 1788569769.059468 write 0x030570 thru 0x03fef6 (0xf987 bytes) 000215 1788569769.064518 trunc from 0x040000 to 0x02df4f (0x120b0 bytes) 000216 1788569769.085811 read 0x00d7a1 thru 0x01415a (0x69ba bytes) 000217 1788569769.092386 fallocate 0x0252f9 thru 0x030eb9 (0xbbc1 bytes) 000218 1788569769.103278 write 0x023b64 thru 0x02a4dc (0x6979 bytes) 000219 1788569769.128692 mapread 0x00ea8b thru 0x011a1b (0x2f91 bytes) 000222 1788569769.149716 MIRROR_EXTEND to 2 mirrors 000223 1788569769.953620 read 0x010e90 thru 0x018cfd (0x7e6e bytes) 000224 1788569769.978923 trunc from 0x030eba to 0x021b83 (0xf336 bytes) 000225 1788569770.110996 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21b84): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21b84): Mirror 2: 0xec576bfb (stale) CRC-32 checksum value for chunk [0, 0x21b84): Mirror 1: 0xec576bfb Mirror 3: 0xec576bfb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21b84: skipped 000226 1788569771.240369 mapread 0x013da6 thru 0x015638 (0x1893 bytes) 000227 1788569771.328453 fallocate 0x03f816 thru 0x03ffff (0x7ea bytes) 000229 1788569771.387579 trunc from 0x021b84 to 0x030751 (0xebce bytes) 000230 1788569771.440736 mapread 0x0226e5 thru 0x025280 (0x2b9c bytes) 000231 1788569771.458162 punch from 0x00acc3 to 0x00c1e1 (0x151f bytes) 000232 1788569771.463711 mapwrite 0x016ba5 thru 0x01a10c (0x3568 bytes) 000233 1788569771.522207 mapwrite 0x00f0f7 thru 0x00fe4f (0xd59 bytes) 000234 1788569771.549154 mapwrite 0x01e1f1 thru 0x0283bd (0xa1cd bytes) 000236 1788569771.580726 read 0x0305cd thru 0x030751 (0x185 bytes) 000237 1788569771.586631 mapwrite 0x0011a2 thru 0x010a9f (0xf8fe bytes) 000238 1788569771.617287 trunc from 0x025c5b to 0x02c882 (0x6c28 bytes) 000239 1788569771.623455 punch from 0x0172fd to 0x01c376 (0x507a bytes) 000240 1788569771.629442 mapread 0x024f34 thru 0x03056c (0xb639 bytes) 000241 1788569771.665883 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30752): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30752): Mirror 2: 0xbb34cae8 (stale) Mirror 3: 0x97dfb53f (stale) CRC-32 checksum value for chunk [0, 0x30752): Mirror 1: 0x962f3efc Mirror 4: 0x962f3efc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30752: skipped 000242 1788569772.746231 mapwrite 0x00cf75 thru 0x0107ce (0x385a bytes) 000243 1788569772.955879 read 0x026d79 thru 0x030751 (0x99d9 bytes) 000244 1788569772.968085 mapread 0x012cf9 thru 0x016e08 (0x4110 bytes) 000245 1788569772.984178 punch from 0x01e604 to 0x0240ed (0x5aea bytes) 000246 1788569772.998944 trunc from 0x030752 to 0x004269 (0x2c4e8 bytes) 000247 1788569773.063736 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x426a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x426a): Mirror 2: 0x3d5d9a52 (stale) Mirror 3: 0x3d5d9a52 (stale) Mirror 4: 0xf1c3c3dc (stale) CRC-32 checksum value for chunk [0, 0x426a): Mirror 1: 0xf1c3c3dc Mirror 5: 0xf1c3c3dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x426a: skipped 000250 1788569774.410638 read 0x0033b8 thru 0x004269 (0xeb2 bytes) 000251 1788569774.423960 mapread 0x000d87 thru 0x004269 (0x34e3 bytes) 000252 1788569774.460682 fallocate 0x03211a thru 0x03e52a (0xc411 bytes) 000253 1788569774.512138 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x426a): Mirror 2: 0x3d5d9a52 (stale) Mirror 3: 0x3d5d9a52 (stale) Mirror 4: 0xf1c3c3dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x426a): Mirror 2: 0x3d5d9a52 (stale) Mirror 3: 0x3d5d9a52 (stale) Mirror 4: 0xf1c3c3dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x426a: skipped 000255 1788569774.970161 read 0x002746 thru 0x004269 (0x1b24 bytes) 000256 1788569774.977675 trunc from 0x00426a to 0x011413 (0xd1aa bytes) 000258 1788569775.002866 read 0x0089a2 thru 0x011413 (0x8a72 bytes) 000260 1788569775.016632 write 0x02590e thru 0x0308ec (0xafdf bytes) 000261 1788569775.019594 trunc from 0x0055f6 to 0x006678 (0x1083 bytes) 000262 1788569775.026423 fallocate 0x0207eb thru 0x022489 (0x1c9f bytes) 000263 1788569775.031819 mapwrite 0x01e31a thru 0x029784 (0xb46b bytes) 000264 1788569775.071811 write 0x0117b1 thru 0x01af38 (0x9788 bytes) 000265 1788569775.078050 write 0x039589 thru 0x03ffff (0x6a77 bytes) 000266 1788569775.079455 trunc from 0x033b22 to 0x037bdd (0x40bc bytes) 000268 1788569775.092841 fallocate 0x01a5c6 thru 0x0255d3 (0xb00e bytes) 000269 1788569775.100272 mapread 0x00be20 thru 0x01285b (0x6a3c bytes) 000270 1788569775.109919 MIRROR_RESYNC 4 mirrors 000271 1788569776.264848 trunc from 0x040000 to 0x018b15 (0x274ea bytes) 000272 1788569776.392754 punch from 0x0125b5 to 0x018b15 (0x6561 bytes) 000273 1788569776.407603 mapwrite 0x01946a thru 0x02121c (0x7db3 bytes) 000275 1788569776.522141 mapwrite 0x035283 thru 0x03ffff (0xad7d bytes) 000276 1788569776.618187 trunc from 0x040000 to 0x0338f8 (0xc707 bytes) 000277 1788569776.638852 fallocate 0x03662c thru 0x03c0e5 (0x5aba bytes) 000278 1788569776.651517 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c0e6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0e6): Mirror 2: 0x3d6589e6 (stale) Mirror 3: 0x3d6589e6 (stale) Mirror 4: 0x3d6589e6 (stale) CRC-32 checksum value for chunk [0, 0x3c0e6): Mirror 1: 0x1e16518d Mirror 5: 0x1e16518d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0e6: skipped 000281 1788569777.954667 write 0x01e0ca thru 0x02cf05 (0xee3c bytes) 000283 1788569778.065655 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c0e6): Mirror 2: 0x3d6589e6 (stale) Mirror 4: 0x3d6589e6 (stale) Mirror 5: 0x1e16518d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0e6): Mirror 2: 0x3d6589e6 (stale) Mirror 4: 0x3d6589e6 (stale) Mirror 5: 0x1e16518d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0e6: skipped 000284 1788569778.713564 trunc from 0x03c0e6 to 0x00a8a1 (0x31844 bytes) 000285 1788569778.753047 read 0x006726 thru 0x009a49 (0x3324 bytes) 000287 1788569778.766688 fallocate 0x008c0f thru 0x009c8c (0x107e bytes) 000288 1788569778.785942 mapwrite 0x012b46 thru 0x0150c9 (0x2584 bytes) 000289 1788569778.858286 mapread 0x009714 thru 0x011075 (0x7962 bytes) 000290 1788569778.869105 write 0x036121 thru 0x03ffff (0x9edf bytes) 000291 1788569778.871310 mapwrite 0x00eaa3 thru 0x019d59 (0xb2b7 bytes) 000292 1788569778.910335 punch from 0x039d48 to 0x03fc79 (0x5f32 bytes) 000293 1788569778.915537 punch from 0x03f014 to 0x03ffff (0xfec bytes) 000294 1788569778.925437 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x22583bad (stale) Mirror 4: 0x22583bad (stale) Mirror 5: 0xba755efa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf94a643 Mirror 6: 0xf94a643 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000295 1788569780.232440 mapread 0x0315f0 thru 0x034b7a (0x358b bytes) 000296 1788569780.281434 fallocate 0x008f92 thru 0x010b82 (0x7bf1 bytes) 000297 1788569780.363724 mapwrite 0x02523c thru 0x029795 (0x455a bytes) 000298 1788569780.396341 mapwrite 0x01d240 thru 0x021ffc (0x4dbd bytes) 000299 1788569780.418250 trunc from 0x016d58 to 0x01d9fe (0x6ca7 bytes) 000300 1788569780.423477 write 0x02f1f7 thru 0x03cffe (0xde08 bytes) 000301 1788569780.436182 fallocate 0x034511 thru 0x03f2a9 (0xad99 bytes) 000302 1788569780.441649 punch from 0x02162c to 0x0226f6 (0x10cb bytes) 000303 1788569780.446266 trunc from 0x00a420 to 0x019632 (0xf213 bytes) 000304 1788569780.454986 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x22583bad (stale) Mirror 4: 0x22583bad (stale) Mirror 5: 0xba755efa (stale) Mirror 6: 0xf94a643 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a38af84 Mirror 7: 0x6a38af84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000305 1788569781.927332 punch from 0x001af5 to 0x00ae2b (0x9337 bytes) 000306 1788569782.007525 mapread 0x01dfa5 thru 0x020e7e (0x2eda bytes) 000307 1788569782.051560 trunc from 0x03f183 to 0x03ffff (0xe7d bytes) 000308 1788569782.072293 MIRROR_RESYNC 6 mirrors 000309 1788569784.323476 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) 000310 1788569784.938345 fallocate 0x0365ee thru 0x03c96a (0x637d bytes) 000311 1788569784.985556 punch from 0x01fc35 to 0x022a94 (0x2e60 bytes) 000313 1788569784.996806 mapread 0x025e05 thru 0x035560 (0xf75c bytes) 000314 1788569785.041049 write 0x025c17 thru 0x02d5e3 (0x79cd bytes) 000315 1788569785.046617 read 0x01214d thru 0x012e2a (0xcde bytes) 000316 1788569785.053510 punch from 0x03d6d2 to 0x03dbd8 (0x507 bytes) 000317 1788569785.060842 mapwrite 0x02bc46 thru 0x03066f (0x4a2a bytes) 000318 1788569785.089350 punch from 0x02c6eb to 0x031707 (0x501d bytes) 000319 1788569785.096188 mapwrite 0x0373ae thru 0x03ffff (0x8c52 bytes) 000320 1788569785.138574 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4ab099c6 (stale) Mirror 4: 0x4ab099c6 (stale) Mirror 5: 0x4ab099c6 (stale) Mirror 6: 0x4ab099c6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfa554e57 Mirror 7: 0xfa554e57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000321 1788569786.298442 punch from 0x02bd35 to 0x02c7f7 (0xac3 bytes) 000322 1788569786.375492 mapwrite 0x021fde thru 0x02c3de (0xa401 bytes) 000324 1788569786.461625 trunc from 0x040000 to 0x03b550 (0x4aaf bytes) 000325 1788569786.513266 write 0x0029ab thru 0x00b758 (0x8dae bytes) 000326 1788569786.526935 mapread 0x01f8d3 thru 0x026ef5 (0x7623 bytes) 000327 1788569786.529347 trunc from 0x03b551 to 0x0013b7 (0x3a199 bytes) 000328 1788569786.561043 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x13b8): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13b8): Mirror 2: 0x9f19e02c (stale) Mirror 4: 0x9f19e02c (stale) Mirror 5: 0x9f19e02c (stale) Mirror 6: 0x9f19e02c (stale) Mirror 7: 0x9f19e02c (stale) CRC-32 checksum value for chunk [0, 0x13b8): Mirror 1: 0x9f19e02c Mirror 8: 0x9f19e02c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13b8: skipped 000329 1788569787.379315 trunc from 0x0013b8 to 0x03ced1 (0x3bb1a bytes) 000330 1788569787.473643 trunc from 0x03c708 to 0x03ced1 (0x7ca bytes) 000331 1788569787.482087 mapread 0x015649 thru 0x01aa5b (0x5413 bytes) 000332 1788569787.507393 fallocate 0x00a783 thru 0x012ac4 (0x8342 bytes) 000333 1788569787.514414 read 0x029e82 thru 0x038e1f (0xef9e bytes) 000334 1788569787.527549 trunc from 0x027612 to 0x027978 (0x367 bytes) 000335 1788569787.534503 trunc from 0x03ced2 to 0x01c16a (0x20d67 bytes) 000336 1788569787.580890 write 0x03c500 thru 0x03fac8 (0x35c9 bytes) 000337 1788569787.582257 mapwrite 0x02e73a thru 0x035dd9 (0x76a0 bytes) 000338 1788569787.604652 mapwrite 0x03646a thru 0x039c89 (0x3820 bytes) 000339 1788569787.620003 read 0x01939f thru 0x01ec58 (0x58ba bytes) 000340 1788569787.626224 write 0x032850 thru 0x034948 (0x20f9 bytes) 000341 1788569787.627262 mapwrite 0x03fcb4 thru 0x03ffff (0x34c bytes) 000342 1788569787.660469 mapread 0x03a10c thru 0x03ffff (0x5ef4 bytes) 000343 1788569787.666708 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4ab099c6 (stale) Mirror 4: 0x4ab099c6 (stale) Mirror 5: 0x4ab099c6 (stale) Mirror 6: 0x4ab099c6 (stale) Mirror 7: 0xfa554e57 (stale) Mirror 8: 0xc431a963 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x49a09099 Mirror 9: 0x49a09099 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000344 1788569788.824835 fallocate 0x011ca5 thru 0x013f44 (0x22a0 bytes) 000345 1788569788.912483 mapread 0x01d0c0 thru 0x028afa (0xba3b bytes) 000347 1788569788.971515 trunc from 0x0306c8 to 0x03eb93 (0xe4cc bytes) 000348 1788569788.979214 read 0x006847 thru 0x00c771 (0x5f2b bytes) 000349 1788569788.999979 mapread 0x01e902 thru 0x0249f7 (0x60f6 bytes) 000350 1788569789.002237 write 0x01661f thru 0x01f11f (0x8b01 bytes) 000352 1788569789.020918 read 0x011120 thru 0x0159b2 (0x4893 bytes) 000353 1788569789.039366 mapwrite 0x03ac14 thru 0x03df63 (0x3350 bytes) 000354 1788569789.095950 mapread 0x009930 thru 0x014a50 (0xb121 bytes) 000355 1788569789.097103 trunc from 0x025c5f to 0x034a05 (0xeda7 bytes) 000356 1788569789.111647 trunc from 0x040000 to 0x00b987 (0x34678 bytes) 000357 1788569789.161484 punch from 0x003e31 to 0x0058ab (0x1a7b bytes) 000358 1788569789.169293 mapread 0x00ae98 thru 0x00b987 (0xaf0 bytes) 000359 1788569789.184119 trunc from 0x000ed5 to 0x00737c (0x64a8 bytes) 000360 1788569789.190314 mapwrite 0x02c2fd thru 0x0320b7 (0x5dbb bytes) 000361 1788569789.303309 trunc from 0x01125f to 0x0130f1 (0x1e93 bytes) 000362 1788569789.312079 mapread 0x0298da thru 0x0320b7 (0x87de bytes) 000363 1788569789.352083 fallocate 0x03ac80 thru 0x03ffff (0x5380 bytes) 000364 1788569789.379937 fallocate 0x00c14b thru 0x011f5f (0x5e15 bytes) 000365 1788569789.406823 trunc from 0x040000 to 0x021882 (0x1e77d bytes) 000366 1788569789.433415 write 0x03876a thru 0x03ffff (0x7896 bytes) 000367 1788569789.441896 mapwrite 0x021bd6 thru 0x0284f3 (0x691e bytes) 000368 1788569789.537391 mapread 0x02333a thru 0x02d1e3 (0x9eaa bytes) 000369 1788569789.617020 trunc from 0x040000 to 0x01f74f (0x208b0 bytes) 000370 1788569789.666292 mapwrite 0x029b2d thru 0x0326ee (0x8bc2 bytes) 000372 1788569789.915326 read 0x023a7f thru 0x0311c3 (0xd745 bytes) 000373 1788569789.932348 read 0x0314ba thru 0x0326ee (0x1235 bytes) 000374 1788569789.932967 punch from 0x02cff6 to 0x030794 (0x379f bytes) 000375 1788569789.939259 read 0x0235c3 thru 0x027226 (0x3c64 bytes) 000376 1788569789.939870 write 0x02a3b6 thru 0x033994 (0x95df bytes) 000377 1788569789.950405 mapwrite 0x004df5 thru 0x00dac5 (0x8cd1 bytes) 000378 1788569790.016346 read 0x02f818 thru 0x033994 (0x417d bytes) 000379 1788569790.017949 fallocate 0x018ea6 thru 0x0283a2 (0xf4fd bytes) 000380 1788569790.028340 mapwrite 0x03ce5d thru 0x03d23c (0x3e0 bytes) 000382 1788569790.122661 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d23d): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d23d): Mirror 2: 0x58a2701 (stale) Mirror 4: 0x58a2701 (stale) Mirror 5: 0x58a2701 (stale) Mirror 6: 0x58a2701 (stale) Mirror 7: 0x35decbdf (stale) Mirror 8: 0xecba8789 (stale) Mirror 9: 0x7edeffa7 (stale) CRC-32 checksum value for chunk [0, 0x3d23d): Mirror 1: 0x9a6066df Mirror 10: 0x9a6066df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d23d: skipped 000383 1788569791.330913 write 0x00959e thru 0x00a0b1 (0xb14 bytes) 000384 1788569791.417942 punch from 0x03884d to 0x039df5 (0x15a9 bytes) 000385 1788569791.424812 trunc from 0x03d23d to 0x02c9c4 (0x10878 bytes) 000386 1788569791.459435 fallocate 0x02720e thru 0x0329de (0xb7d1 bytes) 000387 1788569791.464946 punch from 0x024bc4 to 0x02bb97 (0x6fd4 bytes) 000388 1788569791.469893 punch from 0x01cc2f to 0x0290da (0xc4ac bytes) 000390 1788569791.482506 trunc from 0x02c9c5 to 0x00a87c (0x22148 bytes) 000392 1788569791.518382 punch from 0x0014cd to 0x0018ec (0x420 bytes) 000393 1788569791.525671 mapwrite 0x004dc9 thru 0x00de15 (0x904d bytes) 000394 1788569791.596226 trunc from 0x00ca65 to 0x00cf0d (0x4a9 bytes) 000395 1788569791.601908 mapwrite 0x00088f thru 0x009300 (0x8a72 bytes) 000396 1788569791.638857 write 0x03df92 thru 0x03ffff (0x206e bytes) 000397 1788569791.640461 punch from 0x0318d5 to 0x03d394 (0xbac0 bytes) 000398 1788569791.660179 write 0x037072 thru 0x03ffff (0x8f8e bytes) 000399 1788569791.667931 read 0x039b7e thru 0x03c9ed (0x2e70 bytes) 000400 1788569791.668568 fallocate 0x0068d5 thru 0x00f045 (0x8771 bytes) 000401 1788569791.675204 fallocate 0x01108d thru 0x014095 (0x3009 bytes) 000402 1788569791.682275 mapwrite 0x008b63 thru 0x014d5e (0xc1fc bytes) 000403 1788569791.721851 trunc from 0x027821 to 0x02cc58 (0x5438 bytes) 000404 1788569791.735180 mapread 0x02de54 thru 0x036733 (0x88e0 bytes) 000405 1788569791.770581 trunc from 0x026b57 to 0x02794f (0xdf9 bytes) 000407 1788569791.787731 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4ab099c6 (stale) Mirror 4: 0x4ab099c6 (stale) Mirror 5: 0x4ab099c6 (stale) Mirror 6: 0x4ab099c6 (stale) Mirror 7: 0xfa554e57 (stale) Mirror 8: 0xc431a963 (stale) Mirror 9: 0x49a09099 (stale) Mirror 10: 0x8579fe20 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb8cbbd42 Mirror 11: 0xb8cbbd42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000408 1788569793.225353 mapread 0x00269b thru 0x012054 (0xf9ba bytes) 000409 1788569793.282759 mapread 0x025076 thru 0x0333d2 (0xe35d bytes) 000410 1788569793.349920 fallocate 0x036a10 thru 0x03dc13 (0x7204 bytes) 000411 1788569793.388082 fallocate 0x03889c thru 0x0394f5 (0xc5a bytes) 000412 1788569793.393986 read 0x020de3 thru 0x023099 (0x22b7 bytes) 000413 1788569793.399947 punch from 0x033070 to 0x03920d (0x619e bytes) 000414 1788569793.404172 mapwrite 0x038492 thru 0x03ffff (0x7b6e bytes) 000415 1788569793.447431 trunc from 0x040000 to 0x03147c (0xeb83 bytes) 000416 1788569793.494887 mapwrite 0x000fb7 thru 0x00452c (0x3576 bytes) 000417 1788569793.526518 write 0x02db7f thru 0x0312a1 (0x3723 bytes) 000418 1788569793.531992 mapread 0x02adde thru 0x03147c (0x669f bytes) 000420 1788569793.543740 read 0x01c335 thru 0x028592 (0xc25e bytes) 000421 1788569793.552710 trunc from 0x016966 to 0x017452 (0xaed bytes) 000422 1788569793.557527 mapread 0x02874f thru 0x03147c (0x8d2e bytes) 000423 1788569793.561105 read 0x00c6f7 thru 0x01804a (0xb954 bytes) 000424 1788569793.567310 mapwrite 0x0195d6 thru 0x02647b (0xcea6 bytes) 000425 1788569793.596328 trunc from 0x03147d to 0x012361 (0x1f11b bytes) 000426 1788569793.623524 mapwrite 0x03e494 thru 0x03ffff (0x1b6c bytes) 000427 1788569793.674065 mapwrite 0x0380c7 thru 0x03ffff (0x7f39 bytes) 000428 1788569793.696299 read 0x031636 thru 0x032b5c (0x1527 bytes) 000429 1788569793.716195 fallocate 0x002649 thru 0x005f2a (0x38e2 bytes) 000430 1788569793.727944 trunc from 0x005af0 to 0x010a4c (0xaf5d bytes) 000431 1788569793.740454 mapwrite 0x005258 thru 0x006de0 (0x1b89 bytes) 000432 1788569793.772712 read 0x016fc2 thru 0x01bdcf (0x4e0e bytes) 000433 1788569793.773682 punch from 0x01d356 to 0x02b9d5 (0xe680 bytes) 000434 1788569793.778216 trunc from 0x0363d9 to 0x03f89d (0x94c5 bytes) 000435 1788569793.787187 trunc from 0x0005bf to 0x00d9ed (0xd42f bytes) 000436 1788569793.794630 punch from 0x01b35d to 0x01ca83 (0x1727 bytes) 000437 1788569793.800670 mapwrite 0x01a7e5 thru 0x0204e6 (0x5d02 bytes) 000438 1788569793.832420 fallocate 0x024eeb thru 0x02ad50 (0x5e66 bytes) 000439 1788569793.837712 mapread 0x030296 thru 0x03bfe0 (0xbd4b bytes) 000440 1788569793.840688 trunc from 0x0044fd to 0x008c35 (0x4739 bytes) 000441 1788569793.848152 punch from 0x015fff to 0x01faae (0x9ab0 bytes) 000442 1788569793.856052 read 0x00c51a thru 0x01b413 (0xeefa bytes) 000443 1788569793.869363 fallocate 0x0081cf thru 0x01068d (0x84bf bytes) 000444 1788569793.874133 fallocate 0x021ad9 thru 0x026844 (0x4d6c bytes) 000446 1788569793.885311 MIRROR_RESYNC 10 mirrors 000447 1788569797.387124 trunc from 0x040000 to 0x035a51 (0xa5ae bytes) 000448 1788569797.441301 fallocate 0x03d989 thru 0x03ffff (0x2677 bytes) 000449 1788569797.450262 write 0x02010d thru 0x021e59 (0x1d4d bytes) 000450 1788569797.476242 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc749013c (stale) Mirror 4: 0xc749013c (stale) Mirror 5: 0xc749013c (stale) Mirror 6: 0xc749013c (stale) Mirror 7: 0xc749013c (stale) Mirror 8: 0xc749013c (stale) Mirror 9: 0xc749013c (stale) Mirror 10: 0xc749013c (stale) Mirror 11: 0xc749013c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4dda45c6 Mirror 12: 0x4dda45c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000451 1788569799.308847 punch from 0x00a876 to 0x018dc2 (0xe54d bytes) 000452 1788569799.358430 write 0x034216 thru 0x03d7c4 (0x95af bytes) 000453 1788569799.376672 trunc from 0x040000 to 0x038e13 (0x71ec bytes) 000454 1788569799.430957 trunc from 0x038e14 to 0x024edd (0x13f36 bytes) 000455 1788569799.466487 write 0x01a42e thru 0x01b4db (0x10ae bytes) 000456 1788569799.480988 mapwrite 0x011f06 thru 0x01e29a (0xc395 bytes) 000457 1788569799.615618 fallocate 0x020f77 thru 0x02a476 (0x9500 bytes) 000458 1788569799.625087 trunc from 0x01fa34 to 0x0229a9 (0x2f76 bytes) 000459 1788569799.640213 mapread 0x007cb0 thru 0x00e4e3 (0x6834 bytes) 000461 1788569799.672720 trunc from 0x026809 to 0x02a476 (0x3c6e bytes) 000462 1788569799.685240 fallocate 0x0280d5 thru 0x030e30 (0x8d5c bytes) 000463 1788569799.702628 trunc from 0x02a477 to 0x010f10 (0x19566 bytes) 000464 1788569799.763148 write 0x03d6b2 thru 0x03fba7 (0x24f6 bytes) 000465 1788569799.798270 MIRROR_RESYNC 11 mirrors 000466 1788569802.664097 MIRROR_RESYNC 11 mirrors 000467 1788569803.490431 fallocate 0x0082ba thru 0x010eb4 (0x8bfb bytes) 000468 1788569803.552871 write 0x0026fd thru 0x008708 (0x600c bytes) 000469 1788569803.572238 mapwrite 0x01368f thru 0x01d1a7 (0x9b19 bytes) 000470 1788569803.629916 read 0x002ac8 thru 0x00eca9 (0xc1e2 bytes) 000471 1788569803.647752 fallocate 0x02b12c thru 0x03b08a (0xff5f bytes) 000473 1788569803.662484 fallocate 0x00ebfc thru 0x012b10 (0x3f15 bytes) 000474 1788569803.676325 MIRROR_RESYNC 11 mirrors 000475 1788569807.300132 trunc from 0x03fba8 to 0x0166b9 (0x294ee bytes) 000476 1788569807.403431 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x166ba): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x166ba): Mirror 2: 0x16725870 (stale) Mirror 4: 0x16725870 (stale) Mirror 5: 0x16725870 (stale) Mirror 6: 0x16725870 (stale) Mirror 7: 0x16725870 (stale) Mirror 8: 0x16725870 (stale) Mirror 9: 0x16725870 (stale) Mirror 10: 0x16725870 (stale) Mirror 11: 0x16725870 (stale) Mirror 12: 0x16725870 (stale) CRC-32 checksum value for chunk [0, 0x166ba): Mirror 1: 0x16725870 Mirror 13: 0x16725870 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x166ba: skipped 000477 1788569808.992721 fallocate 0x03b319 thru 0x03ffff (0x4ce7 bytes) 000478 1788569809.098686 read 0x03f70d thru 0x03ffff (0x8f3 bytes) 000479 1788569809.126431 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5396bd6 (stale) Mirror 4: 0x5396bd6 (stale) Mirror 5: 0x5396bd6 (stale) Mirror 6: 0x5396bd6 (stale) Mirror 7: 0x5396bd6 (stale) Mirror 8: 0x5396bd6 (stale) Mirror 9: 0x5396bd6 (stale) Mirror 10: 0x5396bd6 (stale) Mirror 11: 0x5396bd6 (stale) Mirror 12: 0x5396bd6 (stale) Mirror 13: 0xf896e39 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf896e39 Mirror 14: 0xf896e39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000480 1788569810.833566 MIRROR_RESYNC 13 mirrors 000481 1788569815.293973 trunc from 0x040000 to 0x03df80 (0x207f bytes) 000483 1788569815.368326 trunc from 0x03df81 to 0x00089a (0x3d6e6 bytes) 000484 1788569815.390968 mapwrite 0x024a70 thru 0x02a7c3 (0x5d54 bytes) 000485 1788569815.449867 MIRROR_RESYNC 13 mirrors 000486 1788569817.768464 trunc from 0x001799 to 0x0021ad (0xa15 bytes) 000488 1788569817.813360 mapread 0x008f7b thru 0x0123ba (0x9440 bytes) 000489 1788569817.844937 mapread 0x010b00 thru 0x01ca82 (0xbf83 bytes) 000490 1788569817.870722 write 0x00a2a4 thru 0x011ede (0x7c3b bytes) 000493 1788569817.874532 trunc from 0x023f78 to 0x02a7c3 (0x684c bytes) 000494 1788569817.887572 read 0x00e62f thru 0x00fe23 (0x17f5 bytes) 000495 1788569817.888339 trunc from 0x02a7c4 to 0x016039 (0x1478a bytes) 000496 1788569817.929263 trunc from 0x01603a to 0x02bdf6 (0x15dbd bytes) 000497 1788569817.965682 punch from 0x023840 to 0x02bdf6 (0x85b7 bytes) 000499 1788569817.985233 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 2: 0xbbdec7be (stale) Mirror 4: 0xbbdec7be (stale) Mirror 5: 0xbbdec7be (stale) Mirror 7: 0xbbdec7be (stale) Mirror 8: 0xbbdec7be (stale) Mirror 9: 0xbbdec7be (stale) Mirror 10: 0xbbdec7be (stale) Mirror 11: 0xbbdec7be (stale) Mirror 12: 0xbbdec7be (stale) Mirror 13: 0xbbdec7be (stale) Mirror 14: 0xbbdec7be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 2: 0xbbdec7be (stale) Mirror 4: 0xbbdec7be (stale) Mirror 5: 0xbbdec7be (stale) Mirror 7: 0xbbdec7be (stale) Mirror 8: 0xbbdec7be (stale) Mirror 9: 0xbbdec7be (stale) Mirror 10: 0xbbdec7be (stale) Mirror 11: 0xbbdec7be (stale) Mirror 12: 0xbbdec7be (stale) Mirror 13: 0xbbdec7be (stale) Mirror 14: 0xbbdec7be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bdf7: skipped 000502 1788569818.918758 mapread 0x0223eb thru 0x029edb (0x7af1 bytes) 000503 1788569818.953211 read 0x00e04d thru 0x01cec4 (0xee78 bytes) 000504 1788569818.997392 punch from 0x00b11f to 0x019705 (0xe5e7 bytes) 000505 1788569819.008119 punch from 0x012731 to 0x013ed2 (0x17a2 bytes) 000506 1788569819.022661 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 2: 0xbbdec7be (stale) Mirror 4: 0xbbdec7be (stale) Mirror 5: 0xbbdec7be (stale) Mirror 7: 0xbbdec7be (stale) Mirror 8: 0xbbdec7be (stale) Mirror 9: 0xbbdec7be (stale) Mirror 10: 0xbbdec7be (stale) Mirror 11: 0xbbdec7be (stale) Mirror 12: 0xbbdec7be (stale) Mirror 13: 0xbbdec7be (stale) Mirror 14: 0xbbdec7be (stale) CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 1: 0x6931734 Mirror 15: 0x6931734 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bdf7: skipped 000507 1788569820.436699 mapwrite 0x020b82 thru 0x02b3d2 (0xa851 bytes) 000509 1788569820.683414 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 2: 0xbbdec7be (stale) Mirror 5: 0xbbdec7be (stale) Mirror 7: 0xbbdec7be (stale) Mirror 8: 0xbbdec7be (stale) Mirror 9: 0xbbdec7be (stale) Mirror 10: 0xbbdec7be (stale) Mirror 11: 0xbbdec7be (stale) Mirror 12: 0xbbdec7be (stale) Mirror 13: 0xbbdec7be (stale) Mirror 14: 0xbbdec7be (stale) Mirror 15: 0x6931734 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bdf7): Mirror 2: 0xbbdec7be (stale) Mirror 5: 0xbbdec7be (stale) Mirror 7: 0xbbdec7be (stale) Mirror 8: 0xbbdec7be (stale) Mirror 9: 0xbbdec7be (stale) Mirror 10: 0xbbdec7be (stale) Mirror 11: 0xbbdec7be (stale) Mirror 12: 0xbbdec7be (stale) Mirror 13: 0xbbdec7be (stale) Mirror 14: 0xbbdec7be (stale) Mirror 15: 0x6931734 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bdf7: skipped 000510 1788569821.569428 punch from 0x01d511 to 0x027003 (0x9af3 bytes) 000511 1788569821.576497 read 0x02989f thru 0x02bdf6 (0x2558 bytes) 000512 1788569821.583449 mapread 0x001823 thru 0x006a66 (0x5244 bytes) 000513 1788569821.604523 mapwrite 0x01288e thru 0x015fc0 (0x3733 bytes) 000514 1788569821.626973 mapread 0x0008df thru 0x00e36f (0xda91 bytes) 000515 1788569821.632466 punch from 0x0246f5 to 0x02550f (0xe1b bytes) 000516 1788569821.639303 read 0x01dd71 thru 0x01fb2d (0x1dbd bytes) 000517 1788569821.649634 write 0x007bfb thru 0x00ddc4 (0x61ca bytes) 000518 1788569821.656372 write 0x01e954 thru 0x02a7de (0xbe8b bytes) 000519 1788569821.658495 write 0x0167ee thru 0x01ecf4 (0x8507 bytes) 000520 1788569821.660451 punch from 0x01bebe to 0x0221d6 (0x6319 bytes) 000521 1788569821.679050 write 0x03cf64 thru 0x03ffff (0x309c bytes) 000522 1788569821.685019 fallocate 0x0249d2 thru 0x02c1eb (0x781a bytes) 000523 1788569821.694806 trunc from 0x040000 to 0x012bae (0x2d451 bytes) 000524 1788569821.716464 read 0x006e31 thru 0x012bae (0xbd7e bytes) 000525 1788569821.721966 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12baf): Mirror 2: 0xe42b87b7 (stale) Mirror 5: 0xe42b87b7 (stale) Mirror 7: 0xe42b87b7 (stale) Mirror 8: 0xe42b87b7 (stale) Mirror 9: 0xe42b87b7 (stale) Mirror 10: 0xe42b87b7 (stale) Mirror 12: 0xe42b87b7 (stale) Mirror 13: 0xe42b87b7 (stale) Mirror 14: 0xe42b87b7 (stale) Mirror 15: 0xe17b685d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12baf): Mirror 2: 0xe42b87b7 (stale) Mirror 5: 0xe42b87b7 (stale) Mirror 7: 0xe42b87b7 (stale) Mirror 8: 0xe42b87b7 (stale) Mirror 9: 0xe42b87b7 (stale) Mirror 10: 0xe42b87b7 (stale) Mirror 12: 0xe42b87b7 (stale) Mirror 13: 0xe42b87b7 (stale) Mirror 14: 0xe42b87b7 (stale) Mirror 15: 0xe17b685d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12baf: skipped 000526 1788569822.388105 write 0x038a29 thru 0x03b78a (0x2d62 bytes) 000527 1788569822.399679 write 0x02324f thru 0x0329f0 (0xf7a2 bytes) 000528 1788569822.418715 mapwrite 0x00a88b thru 0x017912 (0xd088 bytes) 000529 1788569822.515139 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3b78b): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b78b): Mirror 2: 0x723ea990 (stale) Mirror 5: 0x723ea990 (stale) Mirror 7: 0x723ea990 (stale) Mirror 8: 0x723ea990 (stale) Mirror 9: 0x723ea990 (stale) Mirror 10: 0x723ea990 (stale) Mirror 12: 0x723ea990 (stale) Mirror 13: 0x723ea990 (stale) Mirror 14: 0x723ea990 (stale) Mirror 15: 0x87540395 (stale) CRC-32 checksum value for chunk [0, 0x3b78b): Mirror 1: 0x703a63d Mirror 16: 0x703a63d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b78b: skipped 000530 1788569823.908900 fallocate 0x010f7f thru 0x015275 (0x42f7 bytes) 000531 1788569824.008090 read 0x01061f thru 0x015399 (0x4d7b bytes) 000532 1788569824.034337 mapread 0x01a88b thru 0x027c7d (0xd3f3 bytes) 000533 1788569824.088113 mapwrite 0x0304d7 thru 0x03e87f (0xe3a9 bytes) 000534 1788569824.262265 fallocate 0x012be4 thru 0x01960d (0x6a2a bytes) 000535 1788569824.268551 fallocate 0x005d48 thru 0x007a58 (0x1d11 bytes) 000536 1788569824.273928 read 0x019ed5 thru 0x026106 (0xc232 bytes) 000537 1788569824.274794 read 0x00bb47 thru 0x00c9b4 (0xe6e bytes) 000538 1788569824.284363 read 0x029dc4 thru 0x039660 (0xf89d bytes) 000539 1788569824.285312 trunc from 0x03e880 to 0x01424e (0x2a631 bytes) 000540 1788569824.303283 trunc from 0x01424f to 0x01f0bc (0xae6e bytes) 000541 1788569824.319951 mapwrite 0x02acb5 thru 0x036159 (0xb4a5 bytes) 000542 1788569824.396398 mapread 0x02576c thru 0x031cb3 (0xc548 bytes) 000543 1788569824.399631 punch from 0x02b63e to 0x02eef0 (0x38b3 bytes) 000544 1788569824.406893 trunc from 0x02aab6 to 0x02d241 (0x278c bytes) 000545 1788569824.430454 read 0x018b71 thru 0x023e17 (0xb2a7 bytes) 000546 1788569824.436372 read 0x01390e thru 0x01d5d8 (0x9ccb bytes) 000547 1788569824.438257 mapwrite 0x03aaef thru 0x03f49c (0x49ae bytes) 000548 1788569824.518588 read 0x037be4 thru 0x03c892 (0x4caf bytes) 000549 1788569824.519284 fallocate 0x0258fc thru 0x02ea88 (0x918d bytes) 000550 1788569824.525743 punch from 0x01af77 to 0x01e621 (0x36ab bytes) 000551 1788569824.538897 fallocate 0x006129 thru 0x0071a7 (0x107f bytes) 000552 1788569824.545449 fallocate 0x02bafe thru 0x03b475 (0xf978 bytes) 000553 1788569824.552204 trunc from 0x03f49d to 0x016d1c (0x28780 bytes) 000554 1788569824.571687 write 0x00da99 thru 0x013066 (0x55ce bytes) 000555 1788569824.574738 punch from 0x00dffd to 0x016d1c (0x8d20 bytes) 000556 1788569824.596214 MIRROR_RESYNC 12 mirrors 000557 1788569827.315725 mapread 0x015287 thru 0x016d1c (0x1a96 bytes) 000558 1788569827.330217 fallocate 0x0256cf thru 0x028965 (0x3297 bytes) 000559 1788569827.397999 trunc from 0x028966 to 0x00178f (0x271d6 bytes) 000560 1788569827.419632 mapwrite 0x03a769 thru 0x03ffff (0x5897 bytes) 000561 1788569827.482329 mapread 0x02a8a8 thru 0x0395db (0xed34 bytes) 000562 1788569827.502304 trunc from 0x014249 to 0x01bf2a (0x7ce2 bytes) 000563 1788569827.520380 fallocate 0x03f017 thru 0x03ffff (0xfe9 bytes) 000565 1788569827.530584 punch from 0x030a31 to 0x03ffff (0xf5cf bytes) 000566 1788569827.539757 trunc from 0x040000 to 0x02c8f3 (0x1370c bytes) 000567 1788569827.569852 trunc from 0x02975e to 0x02c8f3 (0x3196 bytes) 000568 1788569827.577132 mapwrite 0x01576a thru 0x017957 (0x21ee bytes) 000570 1788569827.627209 write 0x00c2fa thru 0x017a72 (0xb779 bytes) 000571 1788569827.643350 trunc from 0x02c8f4 to 0x01f75c (0xd197 bytes) 000572 1788569827.669222 write 0x004a58 thru 0x00ef58 (0xa501 bytes) 000573 1788569827.678861 read 0x01a277 thru 0x01f75c (0x54e6 bytes) 000574 1788569827.691207 fallocate 0x025f18 thru 0x02ae75 (0x4f5e bytes) 000575 1788569827.697374 punch from 0x00b31b to 0x0117c8 (0x64ae bytes) 000576 1788569827.719417 punch from 0x00b7c2 to 0x01b5a3 (0xfde2 bytes) 000577 1788569827.727295 mapread 0x005734 thru 0x00e74a (0x9017 bytes) 000578 1788569827.743525 trunc from 0x014b62 to 0x01f75c (0xabfb bytes) 000579 1788569827.749697 punch from 0x008566 to 0x0155d3 (0xd06e bytes) 000580 1788569827.756314 mapread 0x004cf8 thru 0x009137 (0x4440 bytes) 000581 1788569827.769563 trunc from 0x002cac to 0x005962 (0x2cb7 bytes) 000582 1788569827.778133 trunc from 0x003a16 to 0x007c43 (0x422e bytes) 000583 1788569827.792720 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1f75d): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f75d): Mirror 2: 0x8e2874bc (stale) Mirror 5: 0x8e2874bc (stale) Mirror 7: 0x8e2874bc (stale) Mirror 8: 0x8e2874bc (stale) Mirror 9: 0x8e2874bc (stale) Mirror 10: 0x8e2874bc (stale) Mirror 12: 0x8e2874bc (stale) Mirror 13: 0x8e2874bc (stale) Mirror 14: 0x8e2874bc (stale) Mirror 15: 0x8e2874bc (stale) Mirror 16: 0x8e2874bc (stale) CRC-32 checksum value for chunk [0, 0x1f75d): Mirror 1: 0x46c0240b Mirror 17: 0x46c0240b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f75d: skipped 000584 1788569829.140924 trunc from 0x0128fc to 0x017996 (0x509b bytes) 000585 1788569829.222409 mapwrite 0x022bc0 thru 0x02652a (0x396b bytes) 000586 1788569829.313971 MIRROR_RESYNC 13 mirrors 000587 1788569833.130468 trunc from 0x02652b to 0x031f1f (0xb9f5 bytes) 000588 1788569833.185085 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31f20): Mirror 2: 0x536251f2 (stale) Mirror 5: 0x536251f2 (stale) Mirror 7: 0x536251f2 (stale) Mirror 8: 0x536251f2 (stale) Mirror 9: 0x536251f2 (stale) Mirror 10: 0x536251f2 (stale) Mirror 12: 0x536251f2 (stale) Mirror 13: 0x536251f2 (stale) Mirror 14: 0x536251f2 (stale) Mirror 15: 0x536251f2 (stale) Mirror 16: 0x536251f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31f20): Mirror 2: 0x536251f2 (stale) Mirror 5: 0x536251f2 (stale) Mirror 7: 0x536251f2 (stale) Mirror 8: 0x536251f2 (stale) Mirror 9: 0x536251f2 (stale) Mirror 10: 0x536251f2 (stale) Mirror 12: 0x536251f2 (stale) Mirror 13: 0x536251f2 (stale) Mirror 14: 0x536251f2 (stale) Mirror 15: 0x536251f2 (stale) Mirror 16: 0x536251f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31f20: skipped 000589 1788569834.236519 write 0x009a40 thru 0x016033 (0xc5f4 bytes) 000590 1788569834.263207 punch from 0x0031a5 to 0x00f2bb (0xc117 bytes) 000591 1788569834.286602 mapread 0x000894 thru 0x00bfd3 (0xb740 bytes) 000592 1788569834.353504 fallocate 0x02fd91 thru 0x03365e (0x38ce bytes) 000593 1788569834.365402 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3365f): Mirror 2: 0xd2bb0c29 (stale) Mirror 5: 0xd2bb0c29 (stale) Mirror 7: 0xd2bb0c29 (stale) Mirror 8: 0xd2bb0c29 (stale) Mirror 9: 0xd2bb0c29 (stale) Mirror 10: 0xd2bb0c29 (stale) Mirror 12: 0xd2bb0c29 (stale) Mirror 13: 0xd2bb0c29 (stale) Mirror 14: 0xd2bb0c29 (stale) Mirror 16: 0xd2bb0c29 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3365f): Mirror 2: 0xd2bb0c29 (stale) Mirror 5: 0xd2bb0c29 (stale) Mirror 7: 0xd2bb0c29 (stale) Mirror 8: 0xd2bb0c29 (stale) Mirror 9: 0xd2bb0c29 (stale) Mirror 10: 0xd2bb0c29 (stale) Mirror 12: 0xd2bb0c29 (stale) Mirror 13: 0xd2bb0c29 (stale) Mirror 14: 0xd2bb0c29 (stale) Mirror 16: 0xd2bb0c29 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3365f: skipped 000594 1788569835.039699 trunc from 0x03365f to 0x017501 (0x1c15d bytes) 000595 1788569835.063940 fallocate 0x00d73d thru 0x01a4ef (0xcdb3 bytes) 000596 1788569835.070071 mapread 0x01008a thru 0x01a4ef (0xa466 bytes) 000597 1788569835.091470 mapread 0x008e78 thru 0x0166e3 (0xd86c bytes) 000598 1788569835.101939 read 0x009fe5 thru 0x019702 (0xf71e bytes) 000599 1788569835.102831 mapread 0x00acbc thru 0x01943e (0xe783 bytes) 000600 1788569835.105131 punch from 0x000525 to 0x009f34 (0x9a10 bytes) 000601 1788569835.111484 write 0x00c61b thru 0x01ab24 (0xe50a bytes) 000602 1788569835.114128 read 0x008cd5 thru 0x01305d (0xa389 bytes) 000603 1788569835.123707 trunc from 0x01ab25 to 0x03a9ba (0x1fe96 bytes) 000604 1788569835.140701 trunc from 0x03a9bb to 0x004a18 (0x35fa2 bytes) 000605 1788569835.165722 trunc from 0x004a19 to 0x03d5e0 (0x38bc8 bytes) 000606 1788569835.185224 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d5e1): Mirror 2: 0xd9399f31 (stale) Mirror 5: 0xd9399f31 (stale) Mirror 7: 0xd9399f31 (stale) Mirror 8: 0xd9399f31 (stale) Mirror 9: 0xd9399f31 (stale) Mirror 12: 0xd9399f31 (stale) Mirror 13: 0xd9399f31 (stale) Mirror 14: 0xd9399f31 (stale) Mirror 16: 0xd9399f31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d5e1): Mirror 2: 0xd9399f31 (stale) Mirror 5: 0xd9399f31 (stale) Mirror 7: 0xd9399f31 (stale) Mirror 8: 0xd9399f31 (stale) Mirror 9: 0xd9399f31 (stale) Mirror 12: 0xd9399f31 (stale) Mirror 13: 0xd9399f31 (stale) Mirror 14: 0xd9399f31 (stale) Mirror 16: 0xd9399f31 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d5e1: skipped 000607 1788569835.774036 mapread 0x02b377 thru 0x02e80e (0x3498 bytes) 000608 1788569835.834480 fallocate 0x000079 thru 0x0002ba (0x242 bytes) 000609 1788569835.849343 write 0x01edb2 thru 0x025d3c (0x6f8b bytes) 000610 1788569835.874641 mapread 0x017c5c thru 0x024784 (0xcb29 bytes) 000611 1788569835.888516 mapread 0x036d55 thru 0x03913c (0x23e8 bytes) 000612 1788569835.899485 punch from 0x018cea to 0x01ed61 (0x6078 bytes) 000613 1788569835.915506 mapwrite 0x01176f thru 0x01df50 (0xc7e2 bytes) 000614 1788569835.968584 mapread 0x00d480 thru 0x0108cc (0x344d bytes) 000615 1788569835.983489 write 0x03e3e7 thru 0x03ffff (0x1c19 bytes) 000616 1788569835.985218 read 0x002037 thru 0x010f35 (0xeeff bytes) 000617 1788569835.991929 trunc from 0x01cd2b to 0x02a165 (0xd43b bytes) 000618 1788569835.999207 mapwrite 0x02fa42 thru 0x035b37 (0x60f6 bytes) 000619 1788569836.026063 trunc from 0x0152e5 to 0x022c08 (0xd924 bytes) 000621 1788569836.034322 fallocate 0x0280a8 thru 0x02adaa (0x2d03 bytes) 000622 1788569836.053398 punch from 0x02074a to 0x02a866 (0xa11d bytes) 000623 1788569836.069044 fallocate 0x034e66 thru 0x03ffff (0xb19a bytes) 000625 1788569836.080571 fallocate 0x00c918 thru 0x013757 (0x6e40 bytes) 000626 1788569836.094458 fallocate 0x01c619 thru 0x028d04 (0xc6ec bytes) 000627 1788569836.102698 trunc from 0x040000 to 0x013d76 (0x2c289 bytes) 000628 1788569836.170196 MIRROR_RESYNC 10 mirrors 000629 1788569838.515463 write 0x00fb91 thru 0x017137 (0x75a7 bytes) 000630 1788569838.562127 mapread 0x00de06 thru 0x017137 (0x9332 bytes) 000631 1788569838.574895 punch from 0x0132c1 to 0x014290 (0xfd0 bytes) 000632 1788569838.599510 trunc from 0x017138 to 0x02ecdf (0x17ba8 bytes) 000633 1788569838.628037 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ece0): Mirror 5: 0xbf87bb80 (stale) Mirror 7: 0xbf87bb80 (stale) Mirror 8: 0xbf87bb80 (stale) Mirror 9: 0xbf87bb80 (stale) Mirror 12: 0xbf87bb80 (stale) Mirror 13: 0xbf87bb80 (stale) Mirror 14: 0xbf87bb80 (stale) Mirror 16: 0xbf87bb80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ece0): Mirror 5: 0xbf87bb80 (stale) Mirror 7: 0xbf87bb80 (stale) Mirror 8: 0xbf87bb80 (stale) Mirror 9: 0xbf87bb80 (stale) Mirror 12: 0xbf87bb80 (stale) Mirror 13: 0xbf87bb80 (stale) Mirror 14: 0xbf87bb80 (stale) Mirror 16: 0xbf87bb80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ece0: skipped 000635 1788569839.243612 mapwrite 0x01ee3c thru 0x02a617 (0xb7dc bytes) 000636 1788569839.291047 mapwrite 0x015961 thru 0x01e608 (0x8ca8 bytes) 000637 1788569839.321022 write 0x034fd2 thru 0x036851 (0x1880 bytes) 000638 1788569839.326239 fallocate 0x031032 thru 0x03741f (0x63ee bytes) 000640 1788569839.336274 punch from 0x02ee4d to 0x03675a (0x790e bytes) 000641 1788569839.349026 punch from 0x0081ee to 0x00aaa2 (0x28b5 bytes) 000642 1788569839.353800 trunc from 0x0043c8 to 0x00d763 (0x939c bytes) 000643 1788569839.358606 read 0x02af02 thru 0x036d2e (0xbe2d bytes) 000645 1788569839.371870 write 0x00409e thru 0x00483f (0x7a2 bytes) 000646 1788569839.378749 write 0x00f3d7 thru 0x0101d3 (0xdfd bytes) 000647 1788569839.382037 trunc from 0x037420 to 0x031393 (0x608c bytes) 000648 1788569839.404688 mapwrite 0x015c82 thru 0x019d6c (0x40eb bytes) 000649 1788569839.429291 read 0x01ace6 thru 0x0212d2 (0x65ed bytes) 000650 1788569839.435967 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31394): Mirror 5: 0xcd7fe276 (stale) Mirror 7: 0xcd7fe276 (stale) Mirror 8: 0xcd7fe276 (stale) Mirror 9: 0xcd7fe276 (stale) Mirror 13: 0xcd7fe276 (stale) Mirror 14: 0xcd7fe276 (stale) Mirror 16: 0xcd7fe276 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31394): Mirror 5: 0xcd7fe276 (stale) Mirror 7: 0xcd7fe276 (stale) Mirror 8: 0xcd7fe276 (stale) Mirror 9: 0xcd7fe276 (stale) Mirror 13: 0xcd7fe276 (stale) Mirror 14: 0xcd7fe276 (stale) Mirror 16: 0xcd7fe276 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31394: skipped 000651 1788569840.036275 fallocate 0x00750e thru 0x00f736 (0x8229 bytes) 000652 1788569840.050125 punch from 0x0296e6 to 0x030e42 (0x775d bytes) 000653 1788569840.062096 mapwrite 0x008406 thru 0x00ce7f (0x4a7a bytes) 000655 1788569840.153152 punch from 0x004929 to 0x0057e5 (0xebd bytes) 000656 1788569840.173993 mapwrite 0x01d7b5 thru 0x02d43c (0xfc88 bytes) 000657 1788569840.240158 trunc from 0x031394 to 0x020e75 (0x1051e bytes) 000658 1788569840.261953 read 0x020729 thru 0x020e75 (0x74d bytes) 000661 1788569840.270254 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20e76): Mirror 5: 0x60a2e2ad (stale) Mirror 7: 0x60a2e2ad (stale) Mirror 8: 0x60a2e2ad (stale) Mirror 13: 0x60a2e2ad (stale) Mirror 14: 0x60a2e2ad (stale) Mirror 16: 0x60a2e2ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20e76): Mirror 5: 0x60a2e2ad (stale) Mirror 7: 0x60a2e2ad (stale) Mirror 8: 0x60a2e2ad (stale) Mirror 13: 0x60a2e2ad (stale) Mirror 14: 0x60a2e2ad (stale) Mirror 16: 0x60a2e2ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20e76: skipped 000662 1788569840.869113 mapwrite 0x0247f0 thru 0x02d30a (0x8b1b bytes) 000663 1788569841.019201 mapwrite 0x0295f0 thru 0x02d924 (0x4335 bytes) 000664 1788569841.097741 trunc from 0x019c4e to 0x01f8aa (0x5c5d bytes) 000665 1788569841.112367 trunc from 0x0062ad to 0x00a927 (0x467b bytes) 000666 1788569841.128676 punch from 0x018999 to 0x026858 (0xdec0 bytes) 000667 1788569841.145390 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d925): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d925): Mirror 5: 0x36baec0e (stale) Mirror 7: 0x36baec0e (stale) Mirror 8: 0x36baec0e (stale) Mirror 13: 0x36baec0e (stale) Mirror 14: 0x36baec0e (stale) Mirror 16: 0x36baec0e (stale) CRC-32 checksum value for chunk [0, 0x2d925): Mirror 1: 0xb129ced4 Mirror 17: 0xb129ced4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d925: skipped 000668 1788569842.702839 mapread 0x01c4c9 thru 0x01e7a3 (0x22db bytes) 000669 1788569842.745755 read 0x00e833 thru 0x01ca78 (0xe246 bytes) 000670 1788569842.773437 mapwrite 0x014d90 thru 0x020cb3 (0xbf24 bytes) 000671 1788569842.939469 fallocate 0x008e81 thru 0x00c0a9 (0x3229 bytes) 000672 1788569842.965043 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2d925): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d925): Mirror 5: 0x36baec0e (stale) Mirror 7: 0x36baec0e (stale) Mirror 8: 0x36baec0e (stale) Mirror 13: 0x36baec0e (stale) Mirror 14: 0x36baec0e (stale) Mirror 16: 0x36baec0e (stale) Mirror 17: 0xb129ced4 (stale) CRC-32 checksum value for chunk [0, 0x2d925): Mirror 1: 0x4a2e3460 Mirror 18: 0x4a2e3460 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d925: skipped 000673 1788569844.602550 MIRROR_RESYNC 9 mirrors 000674 1788569847.900871 fallocate 0x005d8c thru 0x00b0f2 (0x5367 bytes) 000675 1788569847.980429 mapread 0x00411c thru 0x00da0b (0x98f0 bytes) 000676 1788569848.020089 mapread 0x0058af thru 0x00f69b (0x9ded bytes) 000677 1788569848.021374 mapwrite 0x03ffda thru 0x03ffff (0x26 bytes) 000678 1788569848.099497 read 0x01b39e thru 0x01d9c5 (0x2628 bytes) 000679 1788569848.109864 mapwrite 0x004416 thru 0x005ef0 (0x1adb bytes) 000680 1788569848.135642 mapwrite 0x01a067 thru 0x025dd6 (0xbd70 bytes) 000681 1788569848.196264 fallocate 0x01d4c2 thru 0x023284 (0x5dc3 bytes) 000682 1788569848.201189 mapwrite 0x00c280 thru 0x018064 (0xbde5 bytes) 000683 1788569848.270709 trunc from 0x01ee92 to 0x02138d (0x24fc bytes) 000684 1788569848.282008 mapwrite 0x024dfd thru 0x02ce49 (0x804d bytes) 000685 1788569848.344138 read 0x0003ad thru 0x0095db (0x922f bytes) 000686 1788569848.374960 fallocate 0x0343ba thru 0x03b82b (0x7472 bytes) 000687 1788569848.386025 fallocate 0x00926f thru 0x015383 (0xc115 bytes) 000688 1788569848.393644 punch from 0x00cc29 to 0x017d80 (0xb158 bytes) 000690 1788569848.402274 read 0x0362a1 thru 0x03699d (0x6fd bytes) 000691 1788569848.404361 fallocate 0x0343fe thru 0x03bbf7 (0x77fa bytes) 000692 1788569848.409226 mapwrite 0x02dcd4 thru 0x036fc1 (0x92ee bytes) 000693 1788569848.430484 trunc from 0x01be2b to 0x026e37 (0xb00d bytes) 000694 1788569848.436307 mapread 0x01e073 thru 0x022300 (0x428e bytes) 000695 1788569848.448761 trunc from 0x02585c to 0x0345c6 (0xed6b bytes) 000697 1788569848.455190 fallocate 0x02784b thru 0x027b13 (0x2c9 bytes) 000698 1788569848.461237 trunc from 0x020140 to 0x022593 (0x2454 bytes) 000699 1788569848.467740 mapwrite 0x015ac7 thru 0x01d6d3 (0x7c0d bytes) 000700 1788569848.494516 MIRROR_RESYNC 9 mirrors 000701 1788569852.054758 fallocate 0x00592b thru 0x00c919 (0x6fef bytes) 000702 1788569852.083701 mapwrite 0x0379f6 thru 0x03ffff (0x860a bytes) 000703 1788569852.118290 mapwrite 0x0011da thru 0x009e9e (0x8cc5 bytes) 000704 1788569852.171086 fallocate 0x019d45 thru 0x01b835 (0x1af1 bytes) 000705 1788569852.180197 write 0x035ac9 thru 0x037b8a (0x20c2 bytes) 000706 1788569852.195188 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2d6a1b91 (stale) Mirror 7: 0x2d6a1b91 (stale) Mirror 13: 0x2d6a1b91 (stale) Mirror 14: 0x2d6a1b91 (stale) Mirror 16: 0x2d6a1b91 (stale) Mirror 17: 0x2d6a1b91 (stale) Mirror 18: 0x2d6a1b91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2d6a1b91 (stale) Mirror 7: 0x2d6a1b91 (stale) Mirror 13: 0x2d6a1b91 (stale) Mirror 14: 0x2d6a1b91 (stale) Mirror 16: 0x2d6a1b91 (stale) Mirror 17: 0x2d6a1b91 (stale) Mirror 18: 0x2d6a1b91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000707 1788569852.834671 mapread 0x01d65e thru 0x0256a8 (0x804b bytes) 000709 1788569852.864498 fallocate 0x017ad3 thru 0x01baed (0x401b bytes) 000710 1788569852.875265 trunc from 0x012ad1 to 0x01861e (0x5b4e bytes) 000711 1788569852.881262 read 0x00fe8e thru 0x0140b5 (0x4228 bytes) 000712 1788569852.897827 punch from 0x00ae5f to 0x01265d (0x77ff bytes) 000713 1788569852.908276 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2d6a1b91 (stale) Mirror 7: 0x2d6a1b91 (stale) Mirror 13: 0x2d6a1b91 (stale) Mirror 14: 0x2d6a1b91 (stale) Mirror 16: 0x2d6a1b91 (stale) Mirror 18: 0x2d6a1b91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2d6a1b91 (stale) Mirror 7: 0x2d6a1b91 (stale) Mirror 13: 0x2d6a1b91 (stale) Mirror 14: 0x2d6a1b91 (stale) Mirror 16: 0x2d6a1b91 (stale) Mirror 18: 0x2d6a1b91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000715 1788569853.394997 mapread 0x01df6a thru 0x01efe6 (0x107d bytes) 000716 1788569853.407131 write 0x03b837 thru 0x03ffff (0x47c9 bytes) 000719 1788569853.419109 fallocate 0x033a6c thru 0x039f3f (0x64d4 bytes) 000720 1788569853.424211 trunc from 0x040000 to 0x02b847 (0x147b8 bytes) 000721 1788569853.443899 trunc from 0x012a67 to 0x0189cf (0x5f69 bytes) 000722 1788569853.449999 mapwrite 0x01a717 thru 0x027cc8 (0xd5b2 bytes) 000723 1788569853.487136 mapwrite 0x01288e thru 0x01aaf9 (0x826c bytes) 000724 1788569853.518063 read 0x01de7a thru 0x01e981 (0xb08 bytes) 000725 1788569853.518678 mapread 0x00bdb3 thru 0x0128d6 (0x6b24 bytes) 000726 1788569853.525212 MIRROR_RESYNC 7 mirrors 000727 1788569855.092893 fallocate 0x017622 thru 0x022c1d (0xb5fc bytes) 000729 1788569855.131814 trunc from 0x02b848 to 0x0361d5 (0xa98e bytes) 000730 1788569855.168026 trunc from 0x01c704 to 0x01e93e (0x223b bytes) 000731 1788569855.173687 fallocate 0x032db1 thru 0x03c887 (0x9ad7 bytes) 000732 1788569855.179341 read 0x007f6e thru 0x00a5ed (0x2680 bytes) 000733 1788569855.188064 trunc from 0x03c888 to 0x036e8c (0x59fb bytes) 000734 1788569855.215101 mapread 0x008576 thru 0x00948c (0xf17 bytes) 000735 1788569855.216090 read 0x02755f thru 0x027c39 (0x6db bytes) 000736 1788569855.236700 trunc from 0x0094ae to 0x00e4a4 (0x4ff7 bytes) 000737 1788569855.242603 mapread 0x009546 thru 0x00a042 (0xafd bytes) 000738 1788569855.259760 mapwrite 0x031ec0 thru 0x035607 (0x3748 bytes) 000739 1788569855.294000 write 0x03060e thru 0x03b805 (0xb1f8 bytes) 000740 1788569855.296261 read 0x007190 thru 0x011a69 (0xa8da bytes) 000741 1788569855.312639 mapwrite 0x006529 thru 0x011f9d (0xba75 bytes) 000742 1788569855.393588 MIRROR_RESYNC 7 mirrors 000743 1788569857.492990 MIRROR_RESYNC 7 mirrors 000744 1788569858.203080 fallocate 0x0216b3 thru 0x024962 (0x32b0 bytes) 000745 1788569858.244453 read 0x03307f thru 0x03b805 (0x8787 bytes) 000746 1788569858.256632 mapread 0x01b1dd thru 0x025e6e (0xac92 bytes) 000747 1788569858.287137 fallocate 0x01b9e9 thru 0x0240d3 (0x86eb bytes) 000748 1788569858.293517 mapwrite 0x012d8b thru 0x0215a9 (0xe81f bytes) 000749 1788569858.356197 trunc from 0x03b806 to 0x02e0b6 (0xd74f bytes) 000750 1788569858.401157 trunc from 0x002671 to 0x0067da (0x416a bytes) 000751 1788569858.408557 read 0x024cb0 thru 0x02e0b6 (0x9407 bytes) 000752 1788569858.419752 trunc from 0x002813 to 0x00715d (0x494b bytes) 000753 1788569858.427519 punch from 0x0133ac to 0x013c2e (0x883 bytes) 000754 1788569858.435956 trunc from 0x00931c to 0x012e1e (0x9b03 bytes) 000755 1788569858.461649 MIRROR_RESYNC 7 mirrors 000757 1788569860.886988 MIRROR_RESYNC 7 mirrors 000758 1788569861.461605 mapread 0x018037 thru 0x027b81 (0xfb4b bytes) 000759 1788569861.498156 mapread 0x007dc7 thru 0x00881a (0xa54 bytes) 000760 1788569861.516575 trunc from 0x02462c to 0x02a3d2 (0x5da7 bytes) 000761 1788569861.565134 trunc from 0x00db33 to 0x0197ef (0xbcbd bytes) 000762 1788569861.574352 trunc from 0x00c6ca to 0x01c5ff (0xff36 bytes) 000763 1788569861.583183 mapread 0x00a286 thru 0x0126ba (0x8435 bytes) 000764 1788569861.598631 MIRROR_RESYNC 7 mirrors 000765 1788569863.984858 fallocate 0x032c52 thru 0x037493 (0x4842 bytes) 000766 1788569864.021235 MIRROR_RESYNC 7 mirrors 000767 1788569866.201981 trunc from 0x00a1f8 to 0x01745a (0xd263 bytes) 000768 1788569866.266183 fallocate 0x0009cb thru 0x0065f3 (0x5c29 bytes) 000770 1788569866.274258 mapwrite 0x03973f thru 0x03fc04 (0x64c6 bytes) 000771 1788569866.459669 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3fc05): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc05): Mirror 5: 0xceb02e2a (stale) Mirror 7: 0xceb02e2a (stale) Mirror 13: 0xceb02e2a (stale) Mirror 14: 0xceb02e2a (stale) Mirror 16: 0xceb02e2a (stale) Mirror 18: 0xceb02e2a (stale) CRC-32 checksum value for chunk [0, 0x3fc05): Mirror 1: 0x25b40154 Mirror 19: 0x25b40154 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc05: skipped 000772 1788569867.974042 mapread 0x035b93 thru 0x038f1f (0x338d bytes) 000774 1788569868.044674 write 0x02abc9 thru 0x036b1b (0xbf53 bytes) 000775 1788569868.120223 read 0x0235e1 thru 0x0251dc (0x1bfc bytes) 000776 1788569868.124883 mapread 0x01c4be thru 0x01e42d (0x1f70 bytes) 000777 1788569868.154020 write 0x02852c thru 0x02d0e9 (0x4bbe bytes) 000778 1788569868.159251 write 0x0151cd thru 0x01aa77 (0x58ab bytes) 000779 1788569868.160603 mapwrite 0x01d1f8 thru 0x027b3b (0xa944 bytes) 000780 1788569868.192389 mapread 0x03e5b6 thru 0x03fc04 (0x164f bytes) 000781 1788569868.207067 punch from 0x035947 to 0x03d681 (0x7d3b bytes) 000782 1788569868.214431 trunc from 0x0019e6 to 0x0022b4 (0x8cf bytes) 000783 1788569868.228041 MIRROR_RESYNC 8 mirrors 000784 1788569870.834970 trunc from 0x03fc05 to 0x023d7b (0x1be89 bytes) 000785 1788569870.885083 trunc from 0x023d7c to 0x0379f6 (0x13c7b bytes) 000786 1788569870.911720 punch from 0x01678c to 0x02136b (0xabe0 bytes) 000787 1788569870.919016 mapwrite 0x01b9d4 thru 0x021dea (0x6417 bytes) 000788 1788569870.960093 trunc from 0x0379f7 to 0x03d9e9 (0x5ff3 bytes) 000789 1788569870.980669 trunc from 0x03bb9e to 0x03d9e9 (0x1e4c bytes) 000790 1788569870.987519 punch from 0x025cee to 0x02ba5d (0x5d70 bytes) 000791 1788569870.993181 trunc from 0x03d9ea to 0x0040b9 (0x39930 bytes) 000792 1788569871.017163 MIRROR_RESYNC 8 mirrors 000793 1788569872.570184 read 0x001092 thru 0x0040b9 (0x3028 bytes) 000794 1788569872.579974 mapread 0x003f13 thru 0x0040b9 (0x1a7 bytes) 000795 1788569872.590198 MIRROR_EXTEND to 9 mirrors 000796 1788569873.680922 MIRROR_EXTEND to 10 mirrors 000797 1788569874.513334 read 0x00090c thru 0x0040b9 (0x37ae bytes) 000798 1788569874.521273 fallocate 0x014571 thru 0x015d6c (0x17fc bytes) 000799 1788569874.567967 mapread 0x010833 thru 0x0142c7 (0x3a95 bytes) 000800 1788569874.590185 mapread 0x00da84 thru 0x010335 (0x28b2 bytes) 000802 1788569874.592119 mapwrite 0x013d83 thru 0x01a558 (0x67d6 bytes) 000803 1788569874.642465 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a559): Mirror 7: 0xef37a4c4 (stale) Mirror 13: 0xef37a4c4 (stale) Mirror 14: 0xef37a4c4 (stale) Mirror 16: 0xef37a4c4 (stale) Mirror 18: 0xef37a4c4 (stale) Mirror 19: 0xef37a4c4 (stale) Mirror 20: 0xef37a4c4 (stale) Mirror 21: 0xef37a4c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a559): Mirror 7: 0xef37a4c4 (stale) Mirror 13: 0xef37a4c4 (stale) Mirror 14: 0xef37a4c4 (stale) Mirror 16: 0xef37a4c4 (stale) Mirror 18: 0xef37a4c4 (stale) Mirror 19: 0xef37a4c4 (stale) Mirror 20: 0xef37a4c4 (stale) Mirror 21: 0xef37a4c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a559: skipped 000804 1788569875.135700 punch from 0x00b774 to 0x015f0f (0xa79c bytes) 000805 1788569875.146440 punch from 0x00c8bd to 0x01a0b1 (0xd7f5 bytes) 000806 1788569875.157447 trunc from 0x00bef2 to 0x00ca8a (0xb99 bytes) 000807 1788569875.177956 punch from 0x013ad7 to 0x01a558 (0x6a82 bytes) 000808 1788569875.186810 mapwrite 0x03d13f thru 0x03ffff (0x2ec1 bytes) 000809 1788569875.288557 write 0x00bb0b thru 0x019b78 (0xe06e bytes) 000810 1788569875.321577 mapwrite 0x00445e thru 0x013c56 (0xf7f9 bytes) 000811 1788569875.364376 mapread 0x003a55 thru 0x00fd42 (0xc2ee bytes) 000812 1788569875.365912 punch from 0x01c623 to 0x024475 (0x7e53 bytes) 000814 1788569875.372899 trunc from 0x00c282 to 0x010cc3 (0x4a42 bytes) 000815 1788569875.379237 mapwrite 0x001da7 thru 0x007a16 (0x5c70 bytes) 000816 1788569875.402180 write 0x0133bc thru 0x01d959 (0xa59e bytes) 000817 1788569875.407830 read 0x0284a9 thru 0x02ddab (0x5903 bytes) 000818 1788569875.427568 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc057bbc1 (stale) Mirror 13: 0xc057bbc1 (stale) Mirror 14: 0xc057bbc1 (stale) Mirror 16: 0xc057bbc1 (stale) Mirror 18: 0xc057bbc1 (stale) Mirror 19: 0xc057bbc1 (stale) Mirror 20: 0xc057bbc1 (stale) Mirror 21: 0xc057bbc1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xffa325f7 Mirror 22: 0xffa325f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1788569876.387252 MIRROR_RESYNC 10 mirrors 000820 1788569878.478522 MIRROR_RESYNC 10 mirrors 000821 1788569879.304615 punch from 0x026f1b to 0x034c7c (0xdd62 bytes) 000822 1788569879.365320 read 0x003cd6 thru 0x01267f (0xe9aa bytes) 000823 1788569879.386137 trunc from 0x01cb71 to 0x023274 (0x6704 bytes) 000824 1788569879.400211 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xffa325f7 (stale) Mirror 13: 0xffa325f7 (stale) Mirror 16: 0xffa325f7 (stale) Mirror 18: 0xffa325f7 (stale) Mirror 19: 0xffa325f7 (stale) Mirror 20: 0xffa325f7 (stale) Mirror 21: 0xffa325f7 (stale) Mirror 22: 0xffa325f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xffa325f7 (stale) Mirror 13: 0xffa325f7 (stale) Mirror 16: 0xffa325f7 (stale) Mirror 18: 0xffa325f7 (stale) Mirror 19: 0xffa325f7 (stale) Mirror 20: 0xffa325f7 (stale) Mirror 21: 0xffa325f7 (stale) Mirror 22: 0xffa325f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000826 1788569880.211593 MIRROR_RESYNC 9 mirrors 000827 1788569882.193849 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) 000828 1788569882.595730 mapwrite 0x025f7c thru 0x02ca27 (0x6aac bytes) 000829 1788569882.721758 write 0x01ba44 thru 0x022d0a (0x72c7 bytes) 000830 1788569882.745501 fallocate 0x0053d3 thru 0x005d8d (0x9bb bytes) 000831 1788569882.760239 mapread 0x0024c4 thru 0x00b049 (0x8b86 bytes) 000832 1788569882.773924 read 0x019b61 thru 0x026686 (0xcb26 bytes) 000835 1788569882.783255 read 0x02b613 thru 0x02dfc5 (0x29b3 bytes) 000837 1788569882.785335 write 0x0000df thru 0x00615d (0x607f bytes) 000838 1788569882.805899 punch from 0x03bda9 to 0x03fdcc (0x4024 bytes) 000839 1788569882.815311 write 0x0130be thru 0x01d802 (0xa745 bytes) 000840 1788569882.832584 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6ddb63d9 (stale) Mirror 13: 0x6ddb63d9 (stale) Mirror 16: 0x6ddb63d9 (stale) Mirror 19: 0x6ddb63d9 (stale) Mirror 20: 0x6ddb63d9 (stale) Mirror 21: 0x6ddb63d9 (stale) Mirror 22: 0x6ddb63d9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x28870bf3 Mirror 23: 0x28870bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000841 1788569884.358167 mapread 0x0336b7 thru 0x03ffff (0xc949 bytes) 000842 1788569884.415944 write 0x02bbf0 thru 0x031e46 (0x6257 bytes) 000843 1788569884.503541 mapwrite 0x03a230 thru 0x03ffff (0x5dd0 bytes) 000844 1788569884.542941 mapread 0x01bc80 thru 0x02778b (0xbb0c bytes) 000845 1788569884.580946 trunc from 0x040000 to 0x022b9e (0x1d461 bytes) 000846 1788569884.617759 mapwrite 0x0265a3 thru 0x033f9d (0xd9fb bytes) 000847 1788569884.703672 read 0x01643c thru 0x021653 (0xb218 bytes) 000848 1788569884.705428 read 0x004e26 thru 0x00a44c (0x5627 bytes) 000852 1788569884.725381 read 0x002227 thru 0x00ba4a (0x9824 bytes) 000853 1788569884.727038 punch from 0x00f156 to 0x017ccf (0x8b7a bytes) 000854 1788569884.734010 trunc from 0x033f9e to 0x0276d1 (0xc8cc bytes) 000856 1788569884.754223 trunc from 0x0276d2 to 0x03e27d (0x16bac bytes) 000857 1788569884.777009 fallocate 0x00b560 thru 0x011d02 (0x67a3 bytes) 000858 1788569884.783396 trunc from 0x034290 to 0x03e27d (0x9fee bytes) 000859 1788569884.800555 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e27e): Mirror 7: 0xb2c0112d (stale) Mirror 13: 0xb2c0112d (stale) Mirror 16: 0xb2c0112d (stale) Mirror 19: 0xb2c0112d (stale) Mirror 21: 0xb2c0112d (stale) Mirror 22: 0xb2c0112d (stale) Mirror 23: 0x4c4c48cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e27e): Mirror 7: 0xb2c0112d (stale) Mirror 13: 0xb2c0112d (stale) Mirror 16: 0xb2c0112d (stale) Mirror 19: 0xb2c0112d (stale) Mirror 21: 0xb2c0112d (stale) Mirror 22: 0xb2c0112d (stale) Mirror 23: 0x4c4c48cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e27e: skipped 000860 1788569885.414496 trunc from 0x03e27e to 0x01768b (0x26bf2 bytes) 000861 1788569885.440530 write 0x0167f0 thru 0x023904 (0xd115 bytes) 000862 1788569885.448546 read 0x005545 thru 0x006a14 (0x14d0 bytes) 000863 1788569885.453758 trunc from 0x00ccde to 0x016621 (0x9944 bytes) 000865 1788569885.475274 trunc from 0x023905 to 0x00d549 (0x163bb bytes) 000866 1788569885.492957 trunc from 0x00d54a to 0x037c59 (0x2a710 bytes) 000867 1788569885.513332 trunc from 0x037c5a to 0x010c79 (0x26fe0 bytes) 000868 1788569885.535105 mapread 0x005e2e thru 0x010b1a (0xaced bytes) 000869 1788569885.559063 MIRROR_RESYNC 8 mirrors 000870 1788569887.481496 fallocate 0x01f5e3 thru 0x02b7da (0xc1f8 bytes) 000871 1788569887.548446 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x10c7a): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10c7a): Mirror 7: 0x26a56a46 (stale) Mirror 13: 0x26a56a46 (stale) Mirror 16: 0x26a56a46 (stale) Mirror 19: 0x26a56a46 (stale) Mirror 21: 0x26a56a46 (stale) Mirror 22: 0x26a56a46 (stale) Mirror 23: 0x26a56a46 (stale) CRC-32 checksum value for chunk [0, 0x10c7a): Mirror 1: 0x26a56a46 Mirror 24: 0x26a56a46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10c7a: skipped 000872 1788569888.987086 mapread 0x00fe8e thru 0x010c79 (0xdec bytes) 000873 1788569889.028849 read 0x01044e thru 0x010c79 (0x82c bytes) 000874 1788569889.039884 trunc from 0x010c7a to 0x000e76 (0xfe03 bytes) 000875 1788569889.140759 trunc from 0x000e77 to 0x01d547 (0x1c6d1 bytes) 000876 1788569889.188925 MIRROR_RESYNC 9 mirrors 000878 1788569890.991394 trunc from 0x01d548 to 0x0384e3 (0x1af9c bytes) 000879 1788569891.036489 trunc from 0x020f8a to 0x02ca8d (0xbb04 bytes) 000880 1788569891.045371 write 0x00eb13 thru 0x01b0ec (0xc5da bytes) 000881 1788569891.058517 write 0x010ceb thru 0x020a84 (0xfd9a bytes) 000882 1788569891.070505 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x384e4): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x384e4): Mirror 7: 0x9fc9c198 (stale) Mirror 13: 0x9fc9c198 (stale) Mirror 16: 0x9fc9c198 (stale) Mirror 19: 0x9fc9c198 (stale) Mirror 21: 0x9fc9c198 (stale) Mirror 22: 0x9fc9c198 (stale) Mirror 23: 0x9fc9c198 (stale) Mirror 24: 0x9fc9c198 (stale) CRC-32 checksum value for chunk [0, 0x384e4): Mirror 1: 0x705f1c36 Mirror 25: 0x705f1c36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x384e4: skipped 000883 1788569892.535343 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x384e4): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x384e4): Mirror 7: 0x9fc9c198 (stale) Mirror 13: 0x9fc9c198 (stale) Mirror 16: 0x9fc9c198 (stale) Mirror 19: 0x9fc9c198 (stale) Mirror 21: 0x9fc9c198 (stale) Mirror 22: 0x9fc9c198 (stale) Mirror 23: 0x9fc9c198 (stale) Mirror 24: 0x9fc9c198 (stale) CRC-32 checksum value for chunk [0, 0x384e4): Mirror 1: 0x705f1c36 Mirror 25: 0x705f1c36 Mirror 26: 0x705f1c36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x384e4: skipped 000884 1788569893.931529 trunc from 0x0384e4 to 0x00642e (0x320b5 bytes) 000885 1788569894.006761 write 0x02abd9 thru 0x034188 (0x95b0 bytes) 000886 1788569894.015120 MIRROR_RESYNC 11 mirrors 000887 1788569896.006591 write 0x012ef6 thru 0x014edf (0x1fea bytes) 000888 1788569896.045661 mapread 0x003fa9 thru 0x0045a1 (0x5f9 bytes) 000889 1788569896.064196 mapwrite 0x0019ee thru 0x0063f3 (0x4a06 bytes) 000890 1788569896.097262 trunc from 0x01fa46 to 0x02f0b1 (0xf66c bytes) 000891 1788569896.108160 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x34189): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34189): Mirror 7: 0x273a598c (stale) Mirror 13: 0x273a598c (stale) Mirror 16: 0x273a598c (stale) Mirror 19: 0x273a598c (stale) Mirror 21: 0x273a598c (stale) Mirror 22: 0x273a598c (stale) Mirror 23: 0x273a598c (stale) Mirror 24: 0x273a598c (stale) Mirror 25: 0x273a598c (stale) Mirror 26: 0x273a598c (stale) CRC-32 checksum value for chunk [0, 0x34189): Mirror 1: 0x138e36f0 Mirror 27: 0x138e36f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34189: skipped 000892 1788569897.161744 trunc from 0x0159d3 to 0x0170a2 (0x16d0 bytes) 000894 1788569897.224353 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x34189): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34189): Mirror 7: 0x273a598c (stale) Mirror 13: 0x273a598c (stale) Mirror 16: 0x273a598c (stale) Mirror 19: 0x273a598c (stale) Mirror 21: 0x273a598c (stale) Mirror 22: 0x273a598c (stale) Mirror 23: 0x273a598c (stale) Mirror 24: 0x273a598c (stale) Mirror 25: 0x273a598c (stale) Mirror 26: 0x273a598c (stale) Mirror 27: 0x138e36f0 (stale) CRC-32 checksum value for chunk [0, 0x34189): Mirror 1: 0x138e36f0 Mirror 28: 0x138e36f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34189: skipped 000895 1788569898.410279 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34189): Mirror 7: 0x273a598c (stale) Mirror 13: 0x273a598c (stale) Mirror 16: 0x273a598c (stale) Mirror 19: 0x273a598c (stale) Mirror 21: 0x273a598c (stale) Mirror 22: 0x273a598c (stale) Mirror 23: 0x273a598c (stale) Mirror 24: 0x273a598c (stale) Mirror 25: 0x273a598c (stale) Mirror 27: 0x138e36f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34189): Mirror 7: 0x273a598c (stale) Mirror 13: 0x273a598c (stale) Mirror 16: 0x273a598c (stale) Mirror 19: 0x273a598c (stale) Mirror 21: 0x273a598c (stale) Mirror 22: 0x273a598c (stale) Mirror 23: 0x273a598c (stale) Mirror 24: 0x273a598c (stale) Mirror 25: 0x273a598c (stale) Mirror 27: 0x138e36f0 (stale) CRC-32 checksum value for chunk [0, 0x34189): Mirror 1: 0x138e36f0 Mirror 28: 0x138e36f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34189: skipped 000896 1788569899.688162 mapwrite 0x013adf thru 0x01cb7a (0x909c bytes) 000898 1788569899.815602 write 0x02e56f thru 0x03453a (0x5fcc bytes) 000899 1788569899.852100 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3453b): Mirror 7: 0xbddcad59 (stale) Mirror 13: 0xbddcad59 (stale) Mirror 16: 0xbddcad59 (stale) Mirror 19: 0xbddcad59 (stale) Mirror 22: 0xbddcad59 (stale) Mirror 23: 0xbddcad59 (stale) Mirror 24: 0xbddcad59 (stale) Mirror 25: 0xbddcad59 (stale) Mirror 27: 0xc80776b9 (stale) Mirror 28: 0xc80776b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3453b): Mirror 7: 0xbddcad59 (stale) Mirror 13: 0xbddcad59 (stale) Mirror 16: 0xbddcad59 (stale) Mirror 19: 0xbddcad59 (stale) Mirror 22: 0xbddcad59 (stale) Mirror 23: 0xbddcad59 (stale) Mirror 24: 0xbddcad59 (stale) Mirror 25: 0xbddcad59 (stale) Mirror 27: 0xc80776b9 (stale) Mirror 28: 0xc80776b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3453b: skipped 000901 1788569900.903847 mapwrite 0x0248c3 thru 0x02f226 (0xa964 bytes) 000902 1788569901.047408 punch from 0x00f468 to 0x014bfa (0x5793 bytes) 000903 1788569901.054739 mapread 0x023533 thru 0x02c23e (0x8d0c bytes) 000904 1788569901.055905 trunc from 0x03453b to 0x0280b6 (0xc484 bytes) 000905 1788569901.100231 read 0x00b728 thru 0x018b5c (0xd435 bytes) 000906 1788569901.116553 mapread 0x017dde thru 0x01e24a (0x646d bytes) 000907 1788569901.123660 punch from 0x00c69d to 0x01a6f5 (0xe059 bytes) 000908 1788569901.132917 read 0x00e200 thru 0x0135f1 (0x53f2 bytes) 000909 1788569901.163177 punch from 0x0224dc to 0x0280b6 (0x5bdb bytes) 000910 1788569901.172919 trunc from 0x0280b7 to 0x03460e (0xc558 bytes) 000911 1788569901.194916 write 0x0019e9 thru 0x0116b6 (0xfcce bytes) 000912 1788569901.196581 write 0x00cd48 thru 0x014ca6 (0x7f5f bytes) 000913 1788569901.217828 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3460f): Mirror 7: 0xd8ba90c2 (stale) Mirror 13: 0xd8ba90c2 (stale) Mirror 16: 0xd8ba90c2 (stale) Mirror 19: 0xd8ba90c2 (stale) Mirror 23: 0xd8ba90c2 (stale) Mirror 24: 0xd8ba90c2 (stale) Mirror 25: 0xd8ba90c2 (stale) Mirror 27: 0x3b4fc66d (stale) Mirror 28: 0x3b4fc66d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3460f): Mirror 7: 0xd8ba90c2 (stale) Mirror 13: 0xd8ba90c2 (stale) Mirror 16: 0xd8ba90c2 (stale) Mirror 19: 0xd8ba90c2 (stale) Mirror 23: 0xd8ba90c2 (stale) Mirror 24: 0xd8ba90c2 (stale) Mirror 25: 0xd8ba90c2 (stale) Mirror 27: 0x3b4fc66d (stale) Mirror 28: 0x3b4fc66d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3460f: skipped 000914 1788569902.157454 punch from 0x02ca60 to 0x03186b (0x4e0c bytes) 000915 1788569902.163069 mapwrite 0x008036 thru 0x0160cf (0xe09a bytes) 000916 1788569902.225516 MIRROR_RESYNC 10 mirrors 000918 1788569905.757164 read 0x034397 thru 0x03460e (0x278 bytes) 000919 1788569905.766198 write 0x02917d thru 0x02e294 (0x5118 bytes) 000920 1788569905.816424 fallocate 0x00ce86 thru 0x00d093 (0x20e bytes) 000921 1788569905.824949 fallocate 0x00701d thru 0x016271 (0xf255 bytes) 000922 1788569905.832076 trunc from 0x00e4de to 0x010b67 (0x268a bytes) 000924 1788569905.841255 fallocate 0x00b5ed thru 0x016df7 (0xb80b bytes) 000925 1788569905.849979 fallocate 0x0339eb thru 0x03e279 (0xa88f bytes) 000926 1788569905.858057 read 0x01ec79 thru 0x02d3d0 (0xe758 bytes) 000927 1788569905.872600 mapread 0x02d9a9 thru 0x031a8e (0x40e6 bytes) 000928 1788569905.874720 fallocate 0x008a3d thru 0x010e00 (0x83c4 bytes) 000929 1788569905.881655 read 0x03a8f9 thru 0x03e279 (0x3981 bytes) 000930 1788569905.883310 mapwrite 0x034836 thru 0x03bc03 (0x73ce bytes) 000931 1788569905.913922 trunc from 0x03e27a to 0x028a10 (0x15869 bytes) 000932 1788569905.933246 punch from 0x0224c4 to 0x028a10 (0x654d bytes) 000933 1788569905.938724 write 0x03e36f thru 0x03ffff (0x1c91 bytes) 000934 1788569905.939962 mapwrite 0x00cc06 thru 0x017b4c (0xaf47 bytes) 000936 1788569905.960189 MIRROR_RESYNC 10 mirrors 000937 1788569909.034594 trunc from 0x00f09a to 0x0156ae (0x6615 bytes) 000938 1788569909.065972 punch from 0x027218 to 0x02abe3 (0x39cc bytes) 000939 1788569909.070962 punch from 0x009557 to 0x011aee (0x8598 bytes) 000940 1788569909.075031 write 0x0379f5 thru 0x03ffff (0x860b bytes) 000941 1788569909.080398 mapwrite 0x0013c1 thru 0x002886 (0x14c6 bytes) 000942 1788569909.104307 fallocate 0x03f667 thru 0x03ffff (0x999 bytes) 000943 1788569909.109741 fallocate 0x0292f6 thru 0x02addb (0x1ae6 bytes) 000945 1788569909.114978 read 0x00713f thru 0x007b5c (0xa1e bytes) 000946 1788569909.123482 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe9210a3a (stale) Mirror 13: 0xe9210a3a (stale) Mirror 16: 0xe9210a3a (stale) Mirror 19: 0xe9210a3a (stale) Mirror 23: 0xe9210a3a (stale) Mirror 25: 0xe9210a3a (stale) Mirror 27: 0xe9210a3a (stale) Mirror 28: 0xe9210a3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe9210a3a (stale) Mirror 13: 0xe9210a3a (stale) Mirror 16: 0xe9210a3a (stale) Mirror 19: 0xe9210a3a (stale) Mirror 23: 0xe9210a3a (stale) Mirror 25: 0xe9210a3a (stale) Mirror 27: 0xe9210a3a (stale) Mirror 28: 0xe9210a3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000947 1788569909.733292 trunc from 0x03828a to 0x039007 (0xd7e bytes) 000948 1788569909.745746 mapwrite 0x013ff2 thru 0x019385 (0x5394 bytes) 000949 1788569909.818575 mapread 0x01aa52 thru 0x0257fb (0xadaa bytes) 000950 1788569909.835415 trunc from 0x040000 to 0x0110a1 (0x2ef5e bytes) 000951 1788569909.855374 mapread 0x01107b thru 0x0110a1 (0x27 bytes) 000952 1788569909.856407 trunc from 0x0110a2 to 0x03326d (0x221cc bytes) 000953 1788569909.871551 punch from 0x0064de to 0x0102c7 (0x9dea bytes) 000954 1788569909.876821 trunc from 0x02c05c to 0x03326d (0x7212 bytes) 000955 1788569909.882979 mapwrite 0x025a1a thru 0x02f9de (0x9fc5 bytes) 000956 1788569909.933614 fallocate 0x028bc8 thru 0x031917 (0x8d50 bytes) 000957 1788569909.941258 trunc from 0x03326e to 0x02c5bc (0x6cb1 bytes) 000958 1788569909.961736 punch from 0x02bcba to 0x02c5bc (0x903 bytes) 000959 1788569909.967454 mapread 0x022f99 thru 0x02a915 (0x797d bytes) 000960 1788569909.969184 mapread 0x000e89 thru 0x001249 (0x3c1 bytes) 000961 1788569909.981412 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2c5bd): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c5bd): Mirror 7: 0x32f091c8 (stale) Mirror 13: 0x32f091c8 (stale) Mirror 16: 0x32f091c8 (stale) Mirror 19: 0x32f091c8 (stale) Mirror 23: 0x32f091c8 (stale) Mirror 25: 0x32f091c8 (stale) Mirror 27: 0x32f091c8 (stale) Mirror 28: 0x32f091c8 (stale) CRC-32 checksum value for chunk [0, 0x2c5bd): Mirror 1: 0x5faae228 Mirror 29: 0x5faae228 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c5bd: skipped 000963 1788569911.482634 mapwrite 0x0248a8 thru 0x02dc53 (0x93ac bytes) 000964 1788569911.683198 read 0x01f906 thru 0x02b2e4 (0xb9df bytes) 000965 1788569911.688627 punch from 0x01321f to 0x01f437 (0xc219 bytes) 000966 1788569911.695468 read 0x02db4d thru 0x02dc53 (0x107 bytes) 000967 1788569911.696290 fallocate 0x03866d thru 0x03ffff (0x7993 bytes) 000969 1788569911.703661 write 0x0199d1 thru 0x0239fd (0xa02d bytes) 000970 1788569911.735999 trunc from 0x017303 to 0x0261ff (0xeefd bytes) 000971 1788569911.774602 punch from 0x032f3e to 0x03704f (0x4112 bytes) 000972 1788569911.783667 punch from 0x01a00c to 0x01b4ff (0x14f4 bytes) 000973 1788569911.796694 write 0x02f0f0 thru 0x038b49 (0x9a5a bytes) 000974 1788569911.806286 punch from 0x02d3a2 to 0x0383d1 (0xb030 bytes) 000975 1788569911.851571 read 0x03f223 thru 0x03ffff (0xddd bytes) 000977 1788569911.857087 write 0x032fb2 thru 0x03f593 (0xc5e2 bytes) 000978 1788569911.882054 trunc from 0x000fad to 0x01066e (0xf6c2 bytes) 000979 1788569911.895620 mapwrite 0x015f60 thru 0x016149 (0x1ea bytes) 000981 1788569911.946206 mapread 0x02c422 thru 0x039c72 (0xd851 bytes) 000982 1788569911.964175 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe9210a3a (stale) Mirror 13: 0xe9210a3a (stale) Mirror 16: 0xe9210a3a (stale) Mirror 19: 0xe9210a3a (stale) Mirror 23: 0xe9210a3a (stale) Mirror 25: 0xe9210a3a (stale) Mirror 27: 0xe9210a3a (stale) Mirror 28: 0xe9210a3a (stale) Mirror 29: 0x11c2e633 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3e279274 Mirror 30: 0x3e279274 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000983 1788569913.716888 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe9210a3a (stale) Mirror 13: 0xe9210a3a (stale) Mirror 16: 0xe9210a3a (stale) Mirror 19: 0xe9210a3a (stale) Mirror 23: 0xe9210a3a (stale) Mirror 25: 0xe9210a3a (stale) Mirror 27: 0xe9210a3a (stale) Mirror 28: 0xe9210a3a (stale) Mirror 29: 0x11c2e633 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3e279274 Mirror 30: 0x3e279274 Mirror 31: 0x3e279274 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000984 1788569915.358442 write 0x024a78 thru 0x02a196 (0x571f bytes) 000985 1788569915.447446 MIRROR_RESYNC 12 mirrors 000987 1788569919.053985 mapwrite 0x0155e6 thru 0x016a48 (0x1463 bytes) 000989 1788569919.168649 mapread 0x02368b thru 0x029b11 (0x6487 bytes) 000990 1788569919.183638 punch from 0x01b781 to 0x01fd6b (0x45eb bytes) 000992 1788569919.211945 write 0x022da9 thru 0x02d437 (0xa68f bytes) 000993 1788569919.223052 fallocate 0x031ac7 thru 0x0323a4 (0x8de bytes) 000994 1788569919.234483 read 0x039036 thru 0x03b697 (0x2662 bytes) 000995 1788569919.243063 trunc from 0x017c11 to 0x01f98c (0x7d7c bytes) 000996 1788569919.265889 mapread 0x0246c6 thru 0x024cf3 (0x62e bytes) 000997 1788569919.271041 mapwrite 0x008105 thru 0x013b3a (0xba36 bytes) 000998 1788569919.369386 trunc from 0x002e7c to 0x00a086 (0x720b bytes) 000999 1788569919.378720 trunc from 0x0264dc to 0x036237 (0xfd5c bytes) 001000 1788569919.384175 mapread 0x01d4a4 thru 0x0266a4 (0x9201 bytes) All operations completed A-OK!