== sanity-flr test 70a: flr mode fsx test ================ 21:22:06 (1788571326) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 1327 000001 1788571328.375677 mapwrite 0x01473c thru 0x017b1c (0x33e1 bytes) zero_range to largest ever: 0x17b1d 000002 1788571328.474342 trunc from 0x01366c to 0x017b1c (0x44b1 bytes) 000003 1788571328.483038 mapread 0x001706 thru 0x00ad46 (0x9641 bytes) 000004 1788571328.498031 mapwrite 0x0126f2 thru 0x01a673 (0x7f82 bytes) 000005 1788571328.570968 write 0x0367ba thru 0x03a6d8 (0x3f1f bytes) truncating to largest ever: 0x2b46c 000006 1788571328.580915 trunc from 0x03a6d9 to 0x02b46b (0xf26d bytes) fallocating to largest ever: 0x2b50a 000008 1788571328.621974 fallocate 0x028dd7 thru 0x02b509 (0x2733 bytes) 000009 1788571328.631018 trunc from 0x02b50a to 0x017542 (0x13fc7 bytes) 000010 1788571328.649854 trunc from 0x012208 to 0x017542 (0x533b bytes) 000011 1788571328.657309 read 0x00f610 thru 0x017542 (0x7f33 bytes) 000012 1788571328.673832 trunc from 0x017543 to 0x004509 (0x13039 bytes) 000013 1788571328.698792 fallocate 0x00263b thru 0x00813c (0x5b02 bytes) 000014 1788571328.705020 write 0x029dec thru 0x02b4b2 (0x16c7 bytes) 000015 1788571328.707102 mapread 0x00b52f thru 0x00b538 (0xa bytes) truncating to largest ever: 0x2c600 000016 1788571328.719232 trunc from 0x02b4b3 to 0x02c5ff (0x114d bytes) 000017 1788571328.738415 trunc from 0x02c600 to 0x00593d (0x26cc2 bytes) fallocating to largest ever: 0x40000 000018 1788571328.756342 fallocate 0x032ec0 thru 0x03ffff (0xd140 bytes) 000019 1788571328.762554 punch from 0x016906 to 0x024e0d (0xe508 bytes) 000020 1788571328.767983 trunc from 0x040000 to 0x003e66 (0x3c199 bytes) 000021 1788571328.783997 mapwrite 0x025db3 thru 0x02bd7a (0x5fc8 bytes) 000022 1788571328.831026 read 0x019b17 thru 0x01e9dd (0x4ec7 bytes) 000023 1788571328.839786 mapread 0x0133fc thru 0x01b9e0 (0x85e5 bytes) 000025 1788571328.841945 mapread 0x001d3c thru 0x00bed8 (0xa19d bytes) 000028 1788571328.846101 mapwrite 0x02ebfc thru 0x0327f0 (0x3bf5 bytes) 000029 1788571328.938472 write 0x0270ca thru 0x02798e (0x8c5 bytes) 000030 1788571328.939525 trunc from 0x03279a to 0x0327f0 (0x57 bytes) 000031 1788571328.949243 mapread 0x01c301 thru 0x0214fa (0x51fa bytes) 000033 1788571328.955305 punch from 0x0205a2 to 0x02ba52 (0xb4b1 bytes) 000034 1788571328.967726 write 0x009dfd thru 0x01750f (0xd713 bytes) 000035 1788571328.974284 mapread 0x027911 thru 0x030b7b (0x926b bytes) 000036 1788571329.020582 mapwrite 0x024540 thru 0x02986b (0x532c bytes) 000037 1788571329.070995 punch from 0x021988 to 0x029d0e (0x8387 bytes) 000039 1788571329.078881 mapread 0x002422 thru 0x010318 (0xdef7 bytes) 000040 1788571329.080977 trunc from 0x0327f1 to 0x031b1c (0xcd4 bytes) 000041 1788571329.101617 trunc from 0x0218ac to 0x0282ce (0x6a23 bytes) 000042 1788571329.108435 fallocate 0x0228b9 thru 0x0323e6 (0xfb2e bytes) 000043 1788571329.115098 read 0x016372 thru 0x0167dd (0x46c bytes) 000044 1788571329.117179 mapwrite 0x034043 thru 0x03413c (0xfa bytes) 000046 1788571329.162076 mapread 0x003280 thru 0x0127ec (0xf56d bytes) 000047 1788571329.163442 read 0x029af9 thru 0x02e2a9 (0x47b1 bytes) 000048 1788571329.165426 write 0x021ce8 thru 0x02b00a (0x9323 bytes) 000049 1788571329.168363 punch from 0x006a80 to 0x006db9 (0x33a bytes) 000050 1788571329.174087 trunc from 0x01cc16 to 0x0285d1 (0xb9bc bytes) 000051 1788571329.192967 trunc from 0x03413d to 0x031448 (0x2cf4 bytes) 000052 1788571329.212740 punch from 0x029b72 to 0x03078b (0x6c1a bytes) 000053 1788571329.222774 trunc from 0x031449 to 0x016f83 (0x1a4c5 bytes) 000054 1788571329.248817 read 0x0155c8 thru 0x016775 (0x11ae bytes) 000055 1788571329.256740 MIRROR_EXTEND to 2 mirrors 000056 1788571330.093967 read 0x00a53e thru 0x016f83 (0xca46 bytes) 000057 1788571330.104965 punch from 0x00b565 to 0x011b27 (0x65c3 bytes) 000059 1788571330.155611 trunc from 0x016f84 to 0x03f64e (0x286cb bytes) 000060 1788571330.271080 MIRROR_RESYNC 2 mirrors 000061 1788571331.239812 trunc from 0x029b06 to 0x03465b (0xab56 bytes) 000062 1788571331.307058 punch from 0x03ddcf to 0x03f64e (0x1880 bytes) 000063 1788571331.320100 trunc from 0x02c59a to 0x030a09 (0x4470 bytes) 000065 1788571331.354862 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f64f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f64f): Mirror 2: 0x9dca63c7 (stale) CRC-32 checksum value for chunk [0, 0x3f64f): Mirror 1: 0x9dca63c7 Mirror 3: 0x9dca63c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f64f: skipped 000067 1788571332.613825 mapwrite 0x012257 thru 0x01ed08 (0xcab2 bytes) 000068 1788571332.815994 punch from 0x03b6a6 to 0x03f64e (0x3fa9 bytes) 000069 1788571332.824438 write 0x02a259 thru 0x036080 (0xbe28 bytes) 000070 1788571332.849798 punch from 0x01c439 to 0x02b14e (0xed16 bytes) 000071 1788571332.883164 read 0x02b6a5 thru 0x037ecd (0xc829 bytes) 000072 1788571332.899079 read 0x016bdb thru 0x01ea46 (0x7e6c bytes) 000073 1788571332.912658 punch from 0x029a8d to 0x030e74 (0x73e8 bytes) 000074 1788571332.919406 punch from 0x00526c to 0x00ca0a (0x779f bytes) 000075 1788571332.925662 write 0x01785b thru 0x01a254 (0x29fa bytes) 000076 1788571332.928237 write 0x038418 thru 0x03c61d (0x4206 bytes) 000077 1788571332.933226 read 0x007165 thru 0x013787 (0xc623 bytes) 000078 1788571332.946271 mapwrite 0x021704 thru 0x02592f (0x422c bytes) 000079 1788571332.972221 read 0x02597a thru 0x02ee83 (0x950a bytes) 000080 1788571332.974408 write 0x025d00 thru 0x0297e1 (0x3ae2 bytes) 000083 1788571332.992462 trunc from 0x03f64f to 0x03eb1c (0xb32 bytes) 000084 1788571333.022549 punch from 0x005ee8 to 0x015db6 (0xfecf bytes) 000085 1788571333.035451 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3eb1d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb1d): Mirror 2: 0x8f3194d6 (stale) Mirror 3: 0x8f3194d6 (stale) CRC-32 checksum value for chunk [0, 0x3eb1d): Mirror 1: 0xefbc60d3 Mirror 4: 0xefbc60d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb1d: skipped 000086 1788571334.204926 trunc from 0x03eb1d to 0x02b3f5 (0x13727 bytes) 000087 1788571334.255903 mapwrite 0x038599 thru 0x03ffff (0x7a67 bytes) 000088 1788571334.319087 punch from 0x02b3ac to 0x02b607 (0x25c bytes) 000089 1788571334.324039 trunc from 0x040000 to 0x0097a4 (0x3685b bytes) 000091 1788571334.340271 fallocate 0x01ce88 thru 0x01eeaa (0x2023 bytes) 000093 1788571334.346101 trunc from 0x01eeab to 0x0182fa (0x6bb0 bytes) 000094 1788571334.370608 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x182fb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x182fb): Mirror 2: 0x139d30e9 (stale) Mirror 3: 0x139d30e9 (stale) Mirror 4: 0x79e26a1f (stale) CRC-32 checksum value for chunk [0, 0x182fb): Mirror 1: 0x6a0cea5d Mirror 5: 0x6a0cea5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x182fb: skipped 000095 1788571335.194145 MIRROR_RESYNC 5 mirrors 000096 1788571336.142102 punch from 0x00a50c to 0x01377e (0x9273 bytes) 000097 1788571336.195282 mapread 0x002294 thru 0x003f8a (0x1cf7 bytes) 000098 1788571336.213766 read 0x0084de thru 0x00c4ee (0x4011 bytes) 000099 1788571336.237233 fallocate 0x0086e9 thru 0x00e846 (0x615e bytes) 000100 1788571336.252988 MIRROR_RESYNC 5 mirrors 000101 1788571337.082113 MIRROR_EXTEND to 6 mirrors 000102 1788571338.139999 trunc from 0x0182fb to 0x01a6f5 (0x23fb bytes) 000103 1788571338.241630 fallocate 0x024ad6 thru 0x029013 (0x453e bytes) 000105 1788571338.248052 mapwrite 0x0171fb thru 0x024c2f (0xda35 bytes) 000106 1788571338.344562 punch from 0x0023c5 to 0x00818b (0x5dc7 bytes) 000107 1788571338.352416 mapread 0x00c7af thru 0x011b5a (0x53ac bytes) 000108 1788571338.366604 trunc from 0x029014 to 0x036ab2 (0xda9f bytes) 000109 1788571338.397627 fallocate 0x00cc71 thru 0x010bf8 (0x3f88 bytes) 000110 1788571338.406513 punch from 0x01d91a to 0x0273db (0x9ac2 bytes) 000111 1788571338.417114 mapwrite 0x01edae thru 0x0234b7 (0x470a bytes) 000112 1788571338.454813 mapread 0x0305dd thru 0x036ab2 (0x64d6 bytes) 000113 1788571338.479423 trunc from 0x036ab3 to 0x01d5f4 (0x194be bytes) 000114 1788571338.496281 fallocate 0x029443 thru 0x02ec40 (0x57fe bytes) 000115 1788571338.502589 mapread 0x013400 thru 0x0166a4 (0x32a5 bytes) 000116 1788571338.503688 fallocate 0x035207 thru 0x03769c (0x2496 bytes) 000118 1788571338.510600 punch from 0x0245c0 to 0x02a905 (0x6346 bytes) 000119 1788571338.516166 mapread 0x020fe2 thru 0x0295eb (0x860a bytes) 000120 1788571338.541289 trunc from 0x002da7 to 0x00ad5e (0x7fb8 bytes) 000121 1788571338.547482 write 0x019e27 thru 0x027425 (0xd5ff bytes) 000122 1788571338.558084 trunc from 0x02ec41 to 0x0196a7 (0x15599 bytes) 000123 1788571338.582378 fallocate 0x03b5cf thru 0x03ceed (0x191f bytes) 000124 1788571338.588789 punch from 0x011976 to 0x0196a7 (0x7d32 bytes) 000125 1788571338.633063 trunc from 0x0196a8 to 0x00a4e3 (0xf1c4 bytes) 000126 1788571338.652088 trunc from 0x00a4e4 to 0x02942a (0x1ef47 bytes) 000127 1788571338.674851 read 0x027734 thru 0x027916 (0x1e3 bytes) 000128 1788571338.691556 write 0x03d785 thru 0x03ffff (0x287b bytes) 000129 1788571338.694739 mapread 0x03c969 thru 0x03ffff (0x3697 bytes) 000130 1788571338.713495 mapwrite 0x03c927 thru 0x03ffff (0x36d9 bytes) 000131 1788571338.739069 trunc from 0x03a456 to 0x03ffff (0x5baa bytes) 000132 1788571338.748640 mapread 0x0314a3 thru 0x03681c (0x537a bytes) 000133 1788571338.761719 read 0x037dba thru 0x03ffff (0x8246 bytes) 000134 1788571338.803683 mapread 0x02df53 thru 0x02e13f (0x1ed bytes) 000135 1788571338.811662 punch from 0x03326a to 0x035cf9 (0x2a90 bytes) 000136 1788571338.823669 trunc from 0x01fb0d to 0x02c454 (0xc948 bytes) 000137 1788571338.847532 punch from 0x031944 to 0x03995b (0x8018 bytes) 000138 1788571338.852568 read 0x02dd61 thru 0x0399bf (0xbc5f bytes) 000139 1788571338.930916 MIRROR_RESYNC 6 mirrors 000140 1788571340.158948 trunc from 0x01927d to 0x01eaea (0x586e bytes) 000141 1788571340.229559 trunc from 0x040000 to 0x017135 (0x28eca bytes) 000142 1788571340.266678 read 0x011655 thru 0x017135 (0x5ae1 bytes) 000143 1788571340.281627 mapread 0x008a34 thru 0x0102b4 (0x7881 bytes) 000144 1788571340.310649 trunc from 0x00ec37 to 0x0116d3 (0x2a9d bytes) 000145 1788571340.317371 fallocate 0x02fae6 thru 0x033bed (0x4108 bytes) 000146 1788571340.325547 mapread 0x00cabf thru 0x0152d5 (0x8817 bytes) 000147 1788571340.336347 mapwrite 0x002030 thru 0x00478c (0x275d bytes) 000149 1788571340.365158 mapread 0x023d8a thru 0x025f22 (0x2199 bytes) 000150 1788571340.381582 read 0x00285c thru 0x006b53 (0x42f8 bytes) 000152 1788571340.392605 mapwrite 0x02b54f thru 0x0357dd (0xa28f bytes) 000153 1788571340.508549 mapread 0x028bd7 thru 0x02b83e (0x2c68 bytes) 000154 1788571340.509779 trunc from 0x0357de to 0x027475 (0xe368 bytes) 000155 1788571340.535866 MIRROR_RESYNC 6 mirrors 000156 1788571342.109120 trunc from 0x01d856 to 0x027475 (0x9c20 bytes) 000157 1788571342.158658 punch from 0x00551f to 0x00c95c (0x743e bytes) 000159 1788571342.169653 fallocate 0x01d15b thru 0x027415 (0xa2bb bytes) 000160 1788571342.176563 mapwrite 0x00c72a thru 0x01b9ed (0xf2c4 bytes) 000161 1788571342.268272 trunc from 0x01db99 to 0x02301f (0x5487 bytes) 000162 1788571342.284677 mapwrite 0x029a76 thru 0x039473 (0xf9fe bytes) 000163 1788571342.496976 trunc from 0x016c54 to 0x01e98c (0x7d39 bytes) 000164 1788571342.515661 read 0x031eb5 thru 0x038fee (0x713a bytes) 000165 1788571342.521746 mapwrite 0x019c7b thru 0x026443 (0xc7c9 bytes) 000166 1788571342.610519 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39474): Mirror 2: 0xde9b62e4 (stale) Mirror 3: 0xde9b62e4 (stale) Mirror 5: 0xde9b62e4 (stale) Mirror 6: 0xde9b62e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39474): Mirror 2: 0xde9b62e4 (stale) Mirror 3: 0xde9b62e4 (stale) Mirror 5: 0xde9b62e4 (stale) Mirror 6: 0xde9b62e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39474: skipped 000167 1788571343.145551 trunc from 0x036c81 to 0x039473 (0x27f3 bytes) 000169 1788571343.154485 fallocate 0x006a79 thru 0x00d1ac (0x6734 bytes) 000170 1788571343.161667 read 0x029e3f thru 0x033a7d (0x9c3f bytes) 000171 1788571343.170538 trunc from 0x031c63 to 0x03225b (0x5f9 bytes) 000172 1788571343.176468 punch from 0x037068 to 0x039473 (0x240c bytes) 000173 1788571343.186617 MIRROR_RESYNC 5 mirrors 000176 1788571345.483447 mapwrite 0x03e188 thru 0x03efaf (0xe28 bytes) 000177 1788571345.556914 fallocate 0x004138 thru 0x0072ee (0x31b7 bytes) 000178 1788571345.564190 punch from 0x01ef4f to 0x02c1c2 (0xd274 bytes) 000179 1788571345.577201 MIRROR_RESYNC 5 mirrors 000181 1788571347.820019 mapwrite 0x0228c3 thru 0x02e805 (0xbf43 bytes) 000182 1788571347.968269 mapwrite 0x01f33f thru 0x01fadf (0x7a1 bytes) 000184 1788571348.000260 trunc from 0x03efb0 to 0x01beaf (0x23100 bytes) 000185 1788571348.041175 trunc from 0x01369c to 0x01696e (0x32d3 bytes) 000186 1788571348.047913 mapwrite 0x0184c9 thru 0x022494 (0x9fcc bytes) 000187 1788571348.101521 mapwrite 0x026e36 thru 0x02ad84 (0x3f4f bytes) 000188 1788571348.147417 mapread 0x000f39 thru 0x00af99 (0xa061 bytes) 000189 1788571348.157151 mapwrite 0x020250 thru 0x02ba79 (0xb82a bytes) 000190 1788571348.201103 mapwrite 0x0207e8 thru 0x02ffe3 (0xf7fc bytes) 000191 1788571348.251857 read 0x0165b0 thru 0x01f442 (0x8e93 bytes) 000192 1788571348.252554 fallocate 0x015ba3 thru 0x01c7b0 (0x6c0e bytes) 000193 1788571348.256834 trunc from 0x02ffe4 to 0x03a7d4 (0xa7f1 bytes) 000194 1788571348.278169 write 0x0216b2 thru 0x026b47 (0x5496 bytes) 000195 1788571348.281135 trunc from 0x026e40 to 0x031ab3 (0xac74 bytes) 000196 1788571348.298013 write 0x00c572 thru 0x01602e (0x9abd bytes) 000197 1788571348.300718 read 0x024df5 thru 0x0301c2 (0xb3ce bytes) 000198 1788571348.320342 write 0x01b71b thru 0x022e92 (0x7778 bytes) 000199 1788571348.322724 mapread 0x0208a6 thru 0x028230 (0x798b bytes) 000200 1788571348.328287 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a7d5): Mirror 2: 0x82eead8e (stale) Mirror 3: 0x82eead8e (stale) Mirror 5: 0x82eead8e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7d5): Mirror 2: 0x82eead8e (stale) Mirror 3: 0x82eead8e (stale) Mirror 5: 0x82eead8e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7d5: skipped 000201 1788571348.735841 trunc from 0x03a7d5 to 0x01b0bd (0x1f717 bytes) 000202 1788571348.758287 mapwrite 0x03ed49 thru 0x03ffff (0x12b7 bytes) 000203 1788571348.797822 mapwrite 0x037f01 thru 0x03ffff (0x80ff bytes) 000204 1788571348.824113 trunc from 0x006b55 to 0x00a571 (0x3a1d bytes) 000205 1788571348.828812 read 0x021ec5 thru 0x02a91e (0x8a5a bytes) 000206 1788571348.841595 trunc from 0x02c9da to 0x034ae0 (0x8107 bytes) 000207 1788571348.846180 mapwrite 0x0190f4 thru 0x01dc9d (0x4baa bytes) 000208 1788571348.886608 write 0x03b08c thru 0x03ffff (0x4f74 bytes) 000209 1788571348.887940 trunc from 0x023a93 to 0x02cb33 (0x90a1 bytes) 000210 1788571348.893193 punch from 0x00e199 to 0x0138a6 (0x570e bytes) 000211 1788571348.898785 mapread 0x01293b thru 0x018e73 (0x6539 bytes) 000212 1788571348.934456 fallocate 0x008f6f thru 0x013b0e (0xaba0 bytes) 000213 1788571348.942057 trunc from 0x02f5a8 to 0x03ebe6 (0xf63f bytes) 000214 1788571348.962423 read 0x02b06e thru 0x02cf3a (0x1ecd bytes) 000215 1788571348.979003 punch from 0x015d8d to 0x017a1a (0x1c8e bytes) 000216 1788571348.985953 punch from 0x00d627 to 0x014a2e (0x7408 bytes) 000217 1788571348.992192 trunc from 0x019a93 to 0x01b82d (0x1d9b bytes) 000219 1788571349.003181 fallocate 0x01c6e6 thru 0x02b70b (0xf026 bytes) 000221 1788571349.013175 punch from 0x036e6d to 0x03ffff (0x9193 bytes) 000222 1788571349.025185 read 0x01a5c9 thru 0x0248bb (0xa2f3 bytes) 000223 1788571349.042016 punch from 0x03daa3 to 0x03ffff (0x255d bytes) 000224 1788571349.047499 punch from 0x00f98f to 0x0178f6 (0x7f68 bytes) 000225 1788571349.051064 mapwrite 0x0221b5 thru 0x02b052 (0x8e9e bytes) 000226 1788571349.064925 trunc from 0x00ad1c to 0x0190db (0xe3c0 bytes) 000227 1788571349.069648 mapwrite 0x020365 thru 0x02ae0a (0xaaa6 bytes) 000228 1788571349.085688 trunc from 0x040000 to 0x016eee (0x29111 bytes) 000229 1788571349.115806 write 0x01d67f thru 0x0210f5 (0x3a77 bytes) 000230 1788571349.117155 mapread 0x017943 thru 0x0210f5 (0x97b3 bytes) 000231 1788571349.160142 mapread 0x005371 thru 0x008d55 (0x39e5 bytes) 000232 1788571349.178462 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x210f6): Mirror 3: 0xf8a2a693 (stale) Mirror 5: 0xf8a2a693 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x210f6): Mirror 3: 0xf8a2a693 (stale) Mirror 5: 0xf8a2a693 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x210f6: skipped 000233 1788571349.558370 mapread 0x00065e thru 0x006359 (0x5cfc bytes) 000234 1788571349.588182 trunc from 0x01dba0 to 0x0210f5 (0x3556 bytes) 000235 1788571349.598702 trunc from 0x0210f6 to 0x007860 (0x19895 bytes) 000236 1788571349.635067 MIRROR_RESYNC 3 mirrors 000238 1788571350.437922 fallocate 0x0364f1 thru 0x03a5df (0x40ef bytes) 000239 1788571350.468560 read 0x007346 thru 0x007860 (0x51b bytes) 000240 1788571350.475115 fallocate 0x02f1e4 thru 0x03172c (0x2549 bytes) 000241 1788571350.493583 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3172d): Mirror 5: 0x6d318154 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3172d): Mirror 5: 0x6d318154 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3172d: skipped 000242 1788571350.850150 punch from 0x00f4d2 to 0x01246b (0x2f9a bytes) 000243 1788571350.862065 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) 000244 1788571351.029957 trunc from 0x0196d1 to 0x01c11d (0x2a4d bytes) 000245 1788571351.046570 trunc from 0x03172d to 0x010743 (0x20fe9 bytes) 000246 1788571351.081649 trunc from 0x0091e7 to 0x009f5a (0xd74 bytes) 000247 1788571351.090802 write 0x03b0e9 thru 0x03d113 (0x202b bytes) 000248 1788571351.092049 mapwrite 0x023e72 thru 0x033dec (0xff7b bytes) 000249 1788571351.210770 mapread 0x0057cb thru 0x00d3cc (0x7c02 bytes) 000250 1788571351.223672 fallocate 0x03d84a thru 0x03ffff (0x27b6 bytes) 000251 1788571351.232489 fallocate 0x02057a thru 0x0220ab (0x1b32 bytes) 000252 1788571351.238348 fallocate 0x00d069 thru 0x01a37b (0xd313 bytes) 000253 1788571351.243820 trunc from 0x021339 to 0x025529 (0x41f1 bytes) 000254 1788571351.253867 trunc from 0x02ffbe to 0x0387e7 (0x882a bytes) 000255 1788571351.266957 read 0x018630 thru 0x027840 (0xf211 bytes) 000256 1788571351.312684 mapwrite 0x02e388 thru 0x03dd7a (0xf9f3 bytes) 000257 1788571351.385554 write 0x00b13d thru 0x017694 (0xc558 bytes) 000258 1788571351.395972 read 0x03749f thru 0x03f77f (0x82e1 bytes) 000260 1788571351.397291 read 0x025892 thru 0x0268e9 (0x1058 bytes) 000261 1788571351.397945 write 0x03ca10 thru 0x03ffff (0x35f0 bytes) 000262 1788571351.403381 read 0x01ed95 thru 0x02978b (0xa9f7 bytes) 000263 1788571351.408487 read 0x038c69 thru 0x03ffff (0x7397 bytes) 000264 1788571351.411275 trunc from 0x001f04 to 0x00e418 (0xc515 bytes) 000265 1788571351.448231 trunc from 0x02d98a to 0x0349fe (0x7075 bytes) 000266 1788571351.466832 write 0x0326c0 thru 0x03cc24 (0xa565 bytes) 000267 1788571351.484026 trunc from 0x035a69 to 0x03d62b (0x7bc3 bytes) 000268 1788571351.502450 mapwrite 0x0087db thru 0x00d233 (0x4a59 bytes) 000269 1788571351.537003 punch from 0x00bc58 to 0x019799 (0xdb42 bytes) 000270 1788571351.552585 MIRROR_EXTEND to 2 mirrors 000271 1788571352.695871 read 0x009a19 thru 0x00ffb7 (0x659f bytes) 000272 1788571352.716075 fallocate 0x032e12 thru 0x0332d1 (0x4c0 bytes) 000273 1788571352.811123 write 0x0386ad thru 0x039fdc (0x1930 bytes) 000274 1788571352.848843 read 0x00deea thru 0x00f9b5 (0x1acc bytes) 000275 1788571352.890099 MIRROR_RESYNC 2 mirrors 000276 1788571353.748198 mapwrite 0x01306a thru 0x021053 (0xdfea bytes) 000277 1788571353.898374 trunc from 0x040000 to 0x00f5e8 (0x30a17 bytes) 000278 1788571353.935725 MIRROR_RESYNC 2 mirrors 000279 1788571354.751082 MIRROR_RESYNC 2 mirrors 000280 1788571355.235218 trunc from 0x00f5e9 to 0x03dad4 (0x2e4ec bytes) 000281 1788571355.318470 write 0x00d074 thru 0x0156f9 (0x8686 bytes) 000282 1788571355.333666 read 0x0162b9 thru 0x021be3 (0xb92b bytes) 000283 1788571355.345399 write 0x00671a thru 0x011324 (0xac0b bytes) 000285 1788571355.351533 trunc from 0x03dad5 to 0x012342 (0x2b792 bytes) 000286 1788571355.370949 trunc from 0x012343 to 0x02268e (0x1034c bytes) 000287 1788571355.390127 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2268f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2268f): Mirror 2: 0x2a21297f (stale) CRC-32 checksum value for chunk [0, 0x2268f): Mirror 1: 0x496685cf Mirror 3: 0x496685cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2268f: skipped 000288 1788571356.146475 fallocate 0x02996d thru 0x037e8e (0xe522 bytes) 000289 1788571356.207248 mapread 0x00a95b thru 0x0115f6 (0x6c9c bytes) 000290 1788571356.282181 trunc from 0x00d00d to 0x019108 (0xc0fc bytes) 000291 1788571356.305088 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37e8f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e8f): Mirror 2: 0x90e2463d (stale) Mirror 3: 0xc0e88f86 (stale) CRC-32 checksum value for chunk [0, 0x37e8f): Mirror 1: 0x9534f200 Mirror 4: 0x9534f200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e8f: skipped 000292 1788571357.331105 trunc from 0x02181d to 0x027d28 (0x650c bytes) 000293 1788571357.374076 mapwrite 0x01b3c7 thru 0x026229 (0xae63 bytes) 000294 1788571357.437162 fallocate 0x026dd4 thru 0x035d8b (0xefb8 bytes) 000295 1788571357.442242 fallocate 0x01fa9c thru 0x022851 (0x2db6 bytes) 000296 1788571357.450260 mapread 0x00bd60 thru 0x00bfb4 (0x255 bytes) 000297 1788571357.460089 read 0x02f307 thru 0x034010 (0x4d0a bytes) 000298 1788571357.474263 fallocate 0x00ca60 thru 0x011485 (0x4a26 bytes) 000299 1788571357.482639 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37e8f): Mirror 3: 0xc0e88f86 (stale) Mirror 4: 0x9534f200 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e8f): Mirror 3: 0xc0e88f86 (stale) Mirror 4: 0x9534f200 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e8f: skipped 000300 1788571357.892154 trunc from 0x023fd8 to 0x031004 (0xd02d bytes) 000301 1788571357.897908 trunc from 0x037e8f to 0x02b537 (0xc957 bytes) 000302 1788571357.922598 trunc from 0x02b538 to 0x03e414 (0x12edd bytes) 000303 1788571357.945314 punch from 0x0016bb to 0x0099e2 (0x8328 bytes) 000304 1788571357.951664 write 0x03b02a thru 0x03ffff (0x4fd6 bytes) 000305 1788571357.961187 fallocate 0x0324ec thru 0x03ffff (0xdb14 bytes) 000306 1788571357.967449 read 0x027bb8 thru 0x02dcc4 (0x610d bytes) 000307 1788571357.977899 write 0x02fe39 thru 0x0383d6 (0x859e bytes) 000308 1788571357.988694 fallocate 0x0075b1 thru 0x011055 (0x9aa5 bytes) 000309 1788571357.993803 mapwrite 0x0350e4 thru 0x03d49a (0x83b7 bytes) 000311 1788571358.028660 trunc from 0x040000 to 0x015b42 (0x2a4bd bytes) 000313 1788571358.051262 write 0x01645f thru 0x01c6b7 (0x6259 bytes) 000314 1788571358.055173 fallocate 0x01b87c thru 0x0254a7 (0x9c2c bytes) 000315 1788571358.061065 read 0x018318 thru 0x01cfa6 (0x4c8f bytes) 000316 1788571358.062104 trunc from 0x0254a8 to 0x00eb05 (0x169a2 bytes) 000318 1788571358.078485 write 0x01bf40 thru 0x02233c (0x63fd bytes) 000319 1788571358.079926 trunc from 0x02233d to 0x03249d (0x10161 bytes) 000320 1788571358.101665 MIRROR_RESYNC 3 mirrors 000321 1788571358.943989 trunc from 0x03249e to 0x030b9a (0x1903 bytes) 000322 1788571358.975142 mapread 0x03006c thru 0x030b9a (0xb2f bytes) 000323 1788571358.982994 trunc from 0x0249d1 to 0x02abd5 (0x6205 bytes) 000324 1788571358.988166 fallocate 0x0057ff thru 0x00b88c (0x608e bytes) 000327 1788571358.995189 trunc from 0x00fd3f to 0x01ced6 (0xd198 bytes) 000328 1788571359.000464 fallocate 0x0260b3 thru 0x02c818 (0x6766 bytes) 000329 1788571359.005179 mapwrite 0x03ee44 thru 0x03ffff (0x11bc bytes) 000330 1788571359.049890 read 0x029035 thru 0x03414c (0xb118 bytes) 000331 1788571359.058095 trunc from 0x040000 to 0x00d8f8 (0x32707 bytes) 000332 1788571359.091185 write 0x00955b thru 0x0137ad (0xa253 bytes) 000333 1788571359.102069 write 0x02b187 thru 0x02ef21 (0x3d9b bytes) 000334 1788571359.105885 punch from 0x010bf6 to 0x01a248 (0x9653 bytes) 000335 1788571359.125898 mapread 0x01e750 thru 0x0213ce (0x2c7f bytes) 000336 1788571359.144253 fallocate 0x010174 thru 0x016781 (0x660e bytes) 000338 1788571359.171969 read 0x02d9e4 thru 0x02ef21 (0x153e bytes) 000340 1788571359.179745 trunc from 0x015e61 to 0x020023 (0xa1c3 bytes) 000341 1788571359.191879 trunc from 0x017b7b to 0x017d83 (0x209 bytes) 000342 1788571359.205220 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2ef22): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef22): Mirror 3: 0xeb580a7a (stale) Mirror 4: 0xeb580a7a (stale) CRC-32 checksum value for chunk [0, 0x2ef22): Mirror 1: 0x3095e2d1 Mirror 5: 0x3095e2d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef22: skipped 000343 1788571360.355515 punch from 0x007ca0 to 0x009d84 (0x20e5 bytes) 000345 1788571360.396048 trunc from 0x018c12 to 0x01b080 (0x246f bytes) 000346 1788571360.400829 trunc from 0x01475d to 0x017a9f (0x3343 bytes) 000347 1788571360.406628 write 0x00ceed thru 0x01294e (0x5a62 bytes) 000348 1788571360.426965 MIRROR_RESYNC 4 mirrors 000349 1788571361.606510 fallocate 0x00f47a thru 0x0108f7 (0x147e bytes) 000350 1788571361.648608 fallocate 0x01bf55 thru 0x02973f (0xd7eb bytes) 000351 1788571361.661912 trunc from 0x02ef22 to 0x006823 (0x286fe bytes) 000354 1788571361.688583 trunc from 0x006824 to 0x0339c5 (0x2d1a2 bytes) 000355 1788571361.724397 mapread 0x03180e thru 0x0339c5 (0x21b8 bytes) 000356 1788571361.749852 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x339c6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x339c6): Mirror 3: 0xdf943542 (stale) Mirror 4: 0xdf943542 (stale) Mirror 5: 0xdf943542 (stale) CRC-32 checksum value for chunk [0, 0x339c6): Mirror 1: 0x34fdacc0 Mirror 6: 0x34fdacc0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x339c6: skipped 000357 1788571362.784605 mapread 0x004b27 thru 0x0085c8 (0x3aa2 bytes) 000359 1788571362.841697 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x339c6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x339c6): Mirror 3: 0xdf943542 (stale) Mirror 4: 0xdf943542 (stale) Mirror 5: 0xdf943542 (stale) CRC-32 checksum value for chunk [0, 0x339c6): Mirror 1: 0x34fdacc0 Mirror 6: 0x34fdacc0 Mirror 7: 0x34fdacc0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x339c6: skipped 000360 1788571363.871387 trunc from 0x0339c6 to 0x0058df (0x2e0e6 bytes) 000361 1788571363.970952 punch from 0x001be3 to 0x0058df (0x3cfd bytes) 000362 1788571363.979587 read 0x0047b9 thru 0x0058df (0x1127 bytes) 000363 1788571363.988418 trunc from 0x0058e0 to 0x0082eb (0x2a0c bytes) 000364 1788571364.028963 fallocate 0x005315 thru 0x00a36d (0x5059 bytes) 000365 1788571364.036182 punch from 0x00890b to 0x00a36d (0x1a63 bytes) 000366 1788571364.045367 write 0x020236 thru 0x02e6dc (0xe4a7 bytes) 000367 1788571364.047779 trunc from 0x02e6dd to 0x02ec68 (0x58c bytes) 000368 1788571364.085231 trunc from 0x01ba54 to 0x028368 (0xc915 bytes) 000369 1788571364.124654 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ec69): Mirror 4: 0x86f5e1b2 (stale) Mirror 5: 0x86f5e1b2 (stale) Mirror 6: 0xdf5e4dfd (stale) Mirror 7: 0xdf5e4dfd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec69): Mirror 4: 0x86f5e1b2 (stale) Mirror 5: 0x86f5e1b2 (stale) Mirror 6: 0xdf5e4dfd (stale) Mirror 7: 0xdf5e4dfd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec69: skipped 000370 1788571364.516159 mapread 0x01f4f8 thru 0x0289c0 (0x94c9 bytes) 000371 1788571364.535845 trunc from 0x02ec69 to 0x02a73f (0x4529 bytes) 000373 1788571364.557987 read 0x028da7 thru 0x02a73f (0x1999 bytes) 000374 1788571364.563489 fallocate 0x00ee1d thru 0x0144bc (0x56a0 bytes) 000375 1788571364.568187 trunc from 0x029948 to 0x02a73f (0xdf8 bytes) 000376 1788571364.573695 mapread 0x02348d thru 0x02a73f (0x72b3 bytes) 000377 1788571364.580443 punch from 0x010b35 to 0x01c6b0 (0xbb7c bytes) 000378 1788571364.585625 mapwrite 0x01d5e3 thru 0x02d0a0 (0xfabe bytes) 000379 1788571364.628003 punch from 0x008e05 to 0x00f501 (0x66fd bytes) 000381 1788571364.633619 punch from 0x005215 to 0x00b560 (0x634c bytes) 000382 1788571364.641512 punch from 0x01431a to 0x021b49 (0xd830 bytes) 000383 1788571364.646760 punch from 0x009107 to 0x013bee (0xaae8 bytes) 000384 1788571364.652527 mapwrite 0x01bed2 thru 0x024ab7 (0x8be6 bytes) 000385 1788571364.677079 mapread 0x005e2d thru 0x00c91c (0x6af0 bytes) 000386 1788571364.686087 read 0x0017a2 thru 0x00951f (0x7d7e bytes) 000387 1788571364.687067 read 0x008ff7 thru 0x014821 (0xb82b bytes) 000388 1788571364.702211 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d0a1): Mirror 4: 0xf42e3d60 (stale) Mirror 5: 0xf42e3d60 (stale) Mirror 7: 0xa99a631a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d0a1): Mirror 4: 0xf42e3d60 (stale) Mirror 5: 0xf42e3d60 (stale) Mirror 7: 0xa99a631a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d0a1: skipped 000389 1788571365.084241 fallocate 0x0212c7 thru 0x02d2fc (0xc036 bytes) 000390 1788571365.094722 trunc from 0x00c0cf to 0x01182a (0x575c bytes) 000391 1788571365.099737 read 0x029492 thru 0x02bc09 (0x2778 bytes) 000392 1788571365.107090 mapwrite 0x0250d8 thru 0x02741e (0x2347 bytes) 000393 1788571365.138065 trunc from 0x02d0a1 to 0x037245 (0xa1a5 bytes) 000394 1788571365.165567 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37246): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37246): Mirror 4: 0x6b5e856 (stale) Mirror 5: 0x6b5e856 (stale) Mirror 7: 0x543a9b1d (stale) CRC-32 checksum value for chunk [0, 0x37246): Mirror 1: 0xe06f19af Mirror 8: 0xe06f19af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37246: skipped 000395 1788571366.023251 MIRROR_RESYNC 5 mirrors 000396 1788571367.135386 trunc from 0x023b73 to 0x032160 (0xe5ee bytes) 000397 1788571367.214114 trunc from 0x037246 to 0x02eac8 (0x877d bytes) 000398 1788571367.291727 fallocate 0x02179f thru 0x02e7bc (0xd01e bytes) 000399 1788571367.303222 fallocate 0x00ba52 thru 0x018b72 (0xd121 bytes) 000400 1788571367.311739 mapwrite 0x02840b thru 0x03539c (0xcf92 bytes) 000401 1788571367.447147 read 0x033102 thru 0x03539c (0x229b bytes) 000402 1788571367.449616 trunc from 0x02543d to 0x02924c (0x3e10 bytes) 000404 1788571367.457375 punch from 0x010e9b to 0x0139aa (0x2b10 bytes) 000405 1788571367.462117 write 0x01864b thru 0x02545d (0xce13 bytes) 000406 1788571367.474380 trunc from 0x03539d to 0x019abf (0x1b8dd bytes) 000407 1788571367.492121 read 0x015251 thru 0x019abf (0x486f bytes) 000408 1788571367.503701 mapread 0x014906 thru 0x019abf (0x51ba bytes) 000409 1788571367.506783 write 0x01c876 thru 0x025c42 (0x93cd bytes) 000410 1788571367.509844 fallocate 0x00a9c0 thru 0x0111d6 (0x6817 bytes) 000411 1788571367.519937 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25c43): Mirror 4: 0xcb37d1e8 (stale) Mirror 5: 0xcb37d1e8 (stale) Mirror 8: 0xcb37d1e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c43): Mirror 4: 0xcb37d1e8 (stale) Mirror 5: 0xcb37d1e8 (stale) Mirror 8: 0xcb37d1e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c43: skipped 000412 1788571367.990624 write 0x03ed46 thru 0x03ffff (0x12ba bytes) 000413 1788571368.009024 write 0x02b6d1 thru 0x035eda (0xa80a bytes) 000414 1788571368.023455 fallocate 0x011168 thru 0x01a850 (0x96e9 bytes) 000415 1788571368.029758 mapread 0x03b08a thru 0x03ffff (0x4f76 bytes) 000416 1788571368.047604 mapwrite 0x01bc19 thru 0x022cf9 (0x70e1 bytes) 000417 1788571368.087991 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5292f11e (stale) Mirror 5: 0x5292f11e (stale) Mirror 8: 0x5292f11e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdee45bf3 Mirror 9: 0xdee45bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000418 1788571369.462579 read 0x035022 thru 0x03ffff (0xafde bytes) 000420 1788571369.499681 fallocate 0x0368d3 thru 0x03c7ac (0x5eda bytes) 000421 1788571369.546576 read 0x03babc thru 0x03ffff (0x4544 bytes) 000422 1788571369.556448 write 0x03d7b1 thru 0x03ffff (0x284f bytes) 000423 1788571369.566082 write 0x03ccfc thru 0x03ffff (0x3304 bytes) 000424 1788571369.567624 trunc from 0x003d0b to 0x013292 (0xf588 bytes) 000425 1788571369.579926 MIRROR_RESYNC 5 mirrors 000426 1788571371.127053 punch from 0x035b28 to 0x03bc13 (0x60ec bytes) 000427 1788571371.159805 punch from 0x004a89 to 0x010ada (0xc052 bytes) 000428 1788571371.166607 mapread 0x02659d thru 0x033b0f (0xd573 bytes) 000429 1788571371.195815 mapread 0x004cd0 thru 0x006b97 (0x1ec8 bytes) 000430 1788571371.207253 mapwrite 0x009185 thru 0x010d52 (0x7bce bytes) 000431 1788571371.231660 fallocate 0x00630a thru 0x014b4e (0xe845 bytes) 000433 1788571371.238665 trunc from 0x020248 to 0x02977a (0x9533 bytes) 000434 1788571371.245884 mapread 0x022bd8 thru 0x02cf1f (0xa348 bytes) 000435 1788571371.256835 punch from 0x00404b to 0x0041b1 (0x167 bytes) 000437 1788571371.262736 trunc from 0x040000 to 0x0148d2 (0x2b72d bytes) 000438 1788571371.287629 MIRROR_RESYNC 5 mirrors 000439 1788571372.428413 trunc from 0x0148d3 to 0x0300c8 (0x1b7f6 bytes) 000440 1788571372.466306 read 0x02e935 thru 0x0300c8 (0x1794 bytes) 000441 1788571372.472710 trunc from 0x0300c9 to 0x0004c6 (0x2fc02 bytes) 000442 1788571372.496246 fallocate 0x02fc16 thru 0x03020f (0x5fa bytes) 000443 1788571372.500595 punch from 0x01483c to 0x01eb20 (0xa2e5 bytes) 000444 1788571372.504681 mapread 0x007ba7 thru 0x013228 (0xb682 bytes) 000445 1788571372.530909 trunc from 0x030210 to 0x02cd74 (0x349b bytes) 000446 1788571372.545083 mapread 0x00a75f thru 0x00d067 (0x2909 bytes) 000447 1788571372.551020 MIRROR_RESYNC 5 mirrors 000449 1788571373.342946 trunc from 0x02cd75 to 0x00aadc (0x22298 bytes) 000450 1788571373.423616 trunc from 0x004334 to 0x00aadc (0x67a9 bytes) 000451 1788571373.433400 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xaadd): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaadd): Mirror 4: 0x17422de0 (stale) Mirror 5: 0x17422de0 (stale) Mirror 8: 0x17422de0 (stale) Mirror 9: 0x17422de0 (stale) CRC-32 checksum value for chunk [0, 0xaadd): Mirror 1: 0x17422de0 Mirror 10: 0x17422de0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaadd: skipped 000453 1788571374.163749 fallocate 0x02382a thru 0x032f56 (0xf72d bytes) 000454 1788571374.208648 fallocate 0x01611a thru 0x020955 (0xa83c bytes) 000455 1788571374.215307 mapwrite 0x026e0b thru 0x034884 (0xda7a bytes) 000456 1788571374.319544 mapread 0x024bc8 thru 0x028a2f (0x3e68 bytes) 000457 1788571374.320761 fallocate 0x00b596 thru 0x011719 (0x6184 bytes) 000458 1788571374.329492 read 0x003c66 thru 0x0042f7 (0x692 bytes) 000459 1788571374.342694 mapwrite 0x017a24 thru 0x01f57d (0x7b5a bytes) 000460 1788571374.407877 trunc from 0x034885 to 0x00030c (0x34578 bytes) 000461 1788571374.435533 punch from 0x00025c to 0x00030c (0xb1 bytes) 000462 1788571374.444084 trunc from 0x00030d to 0x02abc3 (0x2a8b7 bytes) 000463 1788571374.469637 fallocate 0x02eedb thru 0x0358cd (0x69f3 bytes) 000464 1788571374.495227 trunc from 0x026cd1 to 0x0358cd (0xebfd bytes) 000465 1788571374.513209 punch from 0x0180f9 to 0x020d3a (0x8c42 bytes) 000466 1788571374.520101 fallocate 0x006382 thru 0x01251d (0xc19c bytes) 000467 1788571374.526524 punch from 0x012c7b to 0x01acb9 (0x803f bytes) 000468 1788571374.534299 punch from 0x03285d to 0x0358cd (0x3071 bytes) 000469 1788571374.545297 fallocate 0x02ef6d thru 0x035684 (0x6718 bytes) 000470 1788571374.559580 trunc from 0x0358ce to 0x02fb39 (0x5d94 bytes) 000471 1788571374.589188 trunc from 0x01dff7 to 0x025721 (0x772b bytes) 000472 1788571374.594477 mapread 0x013207 thru 0x019fc0 (0x6dba bytes) 000473 1788571374.625966 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2fb3a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fb3a): Mirror 4: 0x319b306d (stale) Mirror 5: 0x319b306d (stale) Mirror 8: 0x319b306d (stale) Mirror 9: 0x319b306d (stale) Mirror 10: 0x319b306d (stale) CRC-32 checksum value for chunk [0, 0x2fb3a): Mirror 1: 0x319b306d Mirror 11: 0x319b306d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fb3a: skipped 000474 1788571375.717449 write 0x012db0 thru 0x013eda (0x112b bytes) 000475 1788571375.773563 fallocate 0x00bd15 thru 0x00c6b7 (0x9a3 bytes) 000477 1788571375.787190 trunc from 0x02fb3a to 0x02a809 (0x5330 bytes) 000478 1788571375.814778 trunc from 0x02a80a to 0x03d9de (0x131d5 bytes) 000479 1788571375.837220 fallocate 0x00ca9d thru 0x01a4c0 (0xda24 bytes) 000480 1788571375.844001 trunc from 0x03d9df to 0x0233b6 (0x1a628 bytes) 000481 1788571375.868360 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x233b7): Mirror 4: 0xe7bdd27f (stale) Mirror 5: 0xe7bdd27f (stale) Mirror 8: 0xe7bdd27f (stale) Mirror 10: 0xe7bdd27f (stale) Mirror 11: 0xe7bdd27f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x233b7): Mirror 4: 0xe7bdd27f (stale) Mirror 5: 0xe7bdd27f (stale) Mirror 8: 0xe7bdd27f (stale) Mirror 10: 0xe7bdd27f (stale) Mirror 11: 0xe7bdd27f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x233b7: skipped 000482 1788571376.392531 MIRROR_RESYNC 6 mirrors 000483 1788571377.659245 mapwrite 0x019297 thru 0x02255a (0x92c4 bytes) 000484 1788571377.814155 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x233b7): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x233b7): Mirror 4: 0xe1c4e33 (stale) Mirror 5: 0xe1c4e33 (stale) Mirror 8: 0xe1c4e33 (stale) Mirror 10: 0xe1c4e33 (stale) Mirror 11: 0xe1c4e33 (stale) CRC-32 checksum value for chunk [0, 0x233b7): Mirror 1: 0x5aa0863a Mirror 12: 0x5aa0863a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x233b7: skipped 000485 1788571378.692955 mapread 0x01779f thru 0x0233b6 (0xbc18 bytes) 000486 1788571378.773682 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x233b7): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x233b7): Mirror 4: 0xe1c4e33 (stale) Mirror 5: 0xe1c4e33 (stale) Mirror 8: 0xe1c4e33 (stale) Mirror 10: 0xe1c4e33 (stale) Mirror 11: 0xe1c4e33 (stale) CRC-32 checksum value for chunk [0, 0x233b7): Mirror 1: 0x5aa0863a Mirror 12: 0x5aa0863a Mirror 13: 0x5aa0863a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x233b7: skipped 000488 1788571379.587550 punch from 0x01adc7 to 0x01d87b (0x2ab5 bytes) 000490 1788571379.635029 write 0x017846 thru 0x01fdaf (0x856a bytes) 000491 1788571379.650486 trunc from 0x0233b7 to 0x03d538 (0x1a182 bytes) 000492 1788571379.669042 trunc from 0x03d539 to 0x01191c (0x2bc1c bytes) 000493 1788571379.690038 punch from 0x002458 to 0x0101f1 (0xdd9a bytes) 000494 1788571379.705781 MIRROR_RESYNC 8 mirrors 000495 1788571381.444303 fallocate 0x02a8af thru 0x02f2fa (0x4a4c bytes) 000496 1788571381.528831 trunc from 0x02f2fb to 0x00541d (0x29edd bytes) 000497 1788571381.597943 punch from 0x00297b to 0x00541d (0x2aa3 bytes) 000498 1788571381.603230 trunc from 0x00541e to 0x014022 (0xec05 bytes) 000499 1788571381.629301 mapread 0x0091e2 thru 0x0116d0 (0x84ef bytes) 000500 1788571381.678012 read 0x001547 thru 0x00e3be (0xce78 bytes) 000501 1788571381.685600 mapwrite 0x014bc0 thru 0x01abdc (0x601d bytes) 000502 1788571381.767826 punch from 0x019cee to 0x01abdc (0xeef bytes) 000503 1788571381.787461 punch from 0x000972 to 0x0084a0 (0x7b2f bytes) 000504 1788571381.804407 trunc from 0x016ff6 to 0x01abdc (0x3be7 bytes) 000505 1788571381.815234 fallocate 0x022544 thru 0x023d7a (0x1837 bytes) 000506 1788571381.847017 fallocate 0x0149df thru 0x020af3 (0xc115 bytes) 000508 1788571381.869709 write 0x023163 thru 0x030371 (0xd20f bytes) 000510 1788571381.878978 read 0x022553 thru 0x0268e6 (0x4394 bytes) 000511 1788571381.896146 mapread 0x027ef9 thru 0x030371 (0x8479 bytes) 000512 1788571381.897362 read 0x005b50 thru 0x006a6a (0xf1b bytes) 000513 1788571381.918468 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30372): Mirror 4: 0x4c4834c1 (stale) Mirror 5: 0x4c4834c1 (stale) Mirror 8: 0x4c4834c1 (stale) Mirror 11: 0x4c4834c1 (stale) Mirror 12: 0x4c4834c1 (stale) Mirror 13: 0x4c4834c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30372): Mirror 4: 0x4c4834c1 (stale) Mirror 5: 0x4c4834c1 (stale) Mirror 8: 0x4c4834c1 (stale) Mirror 11: 0x4c4834c1 (stale) Mirror 12: 0x4c4834c1 (stale) Mirror 13: 0x4c4834c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30372: skipped 000514 1788571382.500308 trunc from 0x024925 to 0x02ac99 (0x6375 bytes) 000515 1788571382.507219 punch from 0x0137ec to 0x017c06 (0x441b bytes) 000516 1788571382.522706 mapwrite 0x02d816 thru 0x03501d (0x7808 bytes) 000517 1788571382.588073 trunc from 0x0278fa to 0x02f440 (0x7b47 bytes) 000518 1788571382.594732 mapread 0x032235 thru 0x03501d (0x2de9 bytes) 000519 1788571382.598962 trunc from 0x0156f6 to 0x0164e1 (0xdec bytes) 000520 1788571382.633458 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3501e): Mirror 5: 0x1dff533e (stale) Mirror 8: 0x1dff533e (stale) Mirror 11: 0x1dff533e (stale) Mirror 12: 0x1dff533e (stale) Mirror 13: 0x1dff533e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3501e): Mirror 5: 0x1dff533e (stale) Mirror 8: 0x1dff533e (stale) Mirror 11: 0x1dff533e (stale) Mirror 12: 0x1dff533e (stale) Mirror 13: 0x1dff533e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3501e: skipped 000521 1788571383.208988 mapwrite 0x037ed2 thru 0x03e48b (0x65ba bytes) 000522 1788571383.273471 mapread 0x020b64 thru 0x029853 (0x8cf0 bytes) 000524 1788571383.309527 fallocate 0x03d050 thru 0x03e209 (0x11ba bytes) 000525 1788571383.316146 mapwrite 0x00a6ad thru 0x00acca (0x61e bytes) 000526 1788571383.337597 fallocate 0x030666 thru 0x03edc7 (0xe762 bytes) 000527 1788571383.343166 mapwrite 0x02745e thru 0x031113 (0x9cb6 bytes) 000529 1788571383.368568 read 0x03c28c thru 0x03e48b (0x2200 bytes) 000530 1788571383.369682 trunc from 0x03e48c to 0x0349fc (0x9a8f bytes) 000531 1788571383.388151 fallocate 0x020684 thru 0x02f5b4 (0xef31 bytes) 000532 1788571383.397511 trunc from 0x002940 to 0x010645 (0xdd06 bytes) 000533 1788571383.407468 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x349fd): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x349fd): Mirror 5: 0x9975f223 (stale) Mirror 8: 0x9975f223 (stale) Mirror 11: 0x9975f223 (stale) Mirror 12: 0x9975f223 (stale) Mirror 13: 0x9975f223 (stale) CRC-32 checksum value for chunk [0, 0x349fd): Mirror 1: 0x2aef1278 Mirror 14: 0x2aef1278 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x349fd: skipped 000534 1788571384.524272 read 0x02121e thru 0x029aec (0x88cf bytes) 000535 1788571384.544143 punch from 0x012fec to 0x01f65e (0xc673 bytes) 000536 1788571384.586764 punch from 0x0156d8 to 0x020c6e (0xb597 bytes) 000537 1788571384.592669 trunc from 0x0349fd to 0x01b816 (0x191e6 bytes) 000538 1788571384.634786 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b817): Mirror 5: 0xe588288 (stale) Mirror 8: 0xe588288 (stale) Mirror 11: 0xe588288 (stale) Mirror 13: 0xe588288 (stale) Mirror 14: 0xe588288 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b817): Mirror 5: 0xe588288 (stale) Mirror 8: 0xe588288 (stale) Mirror 11: 0xe588288 (stale) Mirror 13: 0xe588288 (stale) Mirror 14: 0xe588288 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b817: skipped 000539 1788571384.989596 read 0x005ada thru 0x00fb95 (0xa0bc bytes) 000540 1788571384.999546 fallocate 0x00cb6d thru 0x014ac0 (0x7f54 bytes) 000541 1788571385.005217 read 0x006cfd thru 0x012b0b (0xbe0f bytes) 000542 1788571385.016467 punch from 0x0006b4 to 0x00ad7c (0xa6c9 bytes) 000544 1788571385.021850 fallocate 0x016457 thru 0x01f0d9 (0x8c83 bytes) 000545 1788571385.031595 punch from 0x01518b to 0x01b816 (0x668c bytes) 000546 1788571385.035754 trunc from 0x00bda7 to 0x00f2f7 (0x3551 bytes) 000547 1788571385.040859 mapread 0x016e24 thru 0x018ce5 (0x1ec2 bytes) 000548 1788571385.054568 mapwrite 0x001b59 thru 0x00451b (0x29c3 bytes) 000549 1788571385.088365 fallocate 0x02a083 thru 0x03459f (0xa51d bytes) 000550 1788571385.094768 write 0x02de14 thru 0x0385db (0xa7c8 bytes) 000551 1788571385.112959 read 0x00356c thru 0x01344a (0xfedf bytes) 000552 1788571385.129041 trunc from 0x01fce9 to 0x026c9f (0x6fb7 bytes) 000553 1788571385.134667 write 0x030f33 thru 0x033c83 (0x2d51 bytes) 000554 1788571385.137274 write 0x039bc9 thru 0x03aa3a (0xe72 bytes) 000555 1788571385.143875 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aa3b): Mirror 5: 0xf9235ace (stale) Mirror 8: 0xf9235ace (stale) Mirror 11: 0xf9235ace (stale) Mirror 14: 0xa8fcbb24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa3b): Mirror 5: 0xf9235ace (stale) Mirror 8: 0xf9235ace (stale) Mirror 11: 0xf9235ace (stale) Mirror 14: 0xa8fcbb24 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa3b: skipped 000556 1788571385.587218 fallocate 0x03aa3c thru 0x03ffff (0x55c4 bytes) 000557 1788571385.594073 fallocate 0x010b69 thru 0x013fb2 (0x344a bytes) 000558 1788571385.600828 trunc from 0x024e38 to 0x02e929 (0x9af2 bytes) 000559 1788571385.608532 fallocate 0x03eaed thru 0x03ffff (0x1513 bytes) 000560 1788571385.616174 trunc from 0x040000 to 0x00b415 (0x34bea bytes) 000561 1788571385.644249 trunc from 0x00b416 to 0x032327 (0x26f12 bytes) 000562 1788571385.666989 fallocate 0x03e036 thru 0x03ffff (0x1fca bytes) 000563 1788571385.679180 trunc from 0x011a48 to 0x01c08c (0xa645 bytes) 000564 1788571385.689532 trunc from 0x040000 to 0x011394 (0x2ec6b bytes) 000566 1788571385.712523 mapread 0x00c182 thru 0x011394 (0x5213 bytes) 000567 1788571385.740008 fallocate 0x00e83a thru 0x012872 (0x4039 bytes) 000568 1788571385.750236 mapwrite 0x019b99 thru 0x020bc2 (0x702a bytes) 000569 1788571385.818560 fallocate 0x020b3a thru 0x02c28e (0xb755 bytes) 000570 1788571385.825669 fallocate 0x03f31f thru 0x03f47d (0x15f bytes) 000571 1788571385.842885 MIRROR_RESYNC 5 mirrors 000572 1788571387.605002 trunc from 0x03f47e to 0x017cc6 (0x277b7 bytes) 000573 1788571387.634412 trunc from 0x017cc7 to 0x035653 (0x1d98d bytes) 000574 1788571387.653659 trunc from 0x007c6f to 0x0170e3 (0xf475 bytes) 000575 1788571387.661176 write 0x024960 thru 0x0338ed (0xef8e bytes) 000576 1788571387.672928 trunc from 0x02b8c8 to 0x02fdd7 (0x4510 bytes) 000577 1788571387.695028 write 0x0114d4 thru 0x01d259 (0xbd86 bytes) 000578 1788571387.706214 write 0x01b059 thru 0x02aaef (0xfa97 bytes) 000579 1788571387.708037 read 0x010228 thru 0x01347c (0x3255 bytes) 000580 1788571387.716720 trunc from 0x010023 to 0x01dd5e (0xdd3c bytes) 000581 1788571387.732243 mapwrite 0x03c517 thru 0x03e08a (0x1b74 bytes) 000582 1788571387.786239 write 0x0261c5 thru 0x02cbd8 (0x6a14 bytes) 000583 1788571387.793937 mapwrite 0x01388e thru 0x0229bd (0xf130 bytes) 000584 1788571387.837545 read 0x004b3c thru 0x0061eb (0x16b0 bytes) 000585 1788571387.851092 trunc from 0x03a5fe to 0x03e08a (0x3a8d bytes) 000586 1788571387.858495 mapwrite 0x01e96e thru 0x0219bc (0x304f bytes) 000587 1788571387.878861 punch from 0x0275f3 to 0x032e38 (0xb846 bytes) 000588 1788571387.887738 trunc from 0x03e08b to 0x02da52 (0x10638 bytes) 000589 1788571387.905987 fallocate 0x03daa8 thru 0x03ffff (0x2558 bytes) 000590 1788571387.918098 read 0x026544 thru 0x0274fb (0xfb8 bytes) 000591 1788571387.934449 mapread 0x025740 thru 0x02da52 (0x8313 bytes) 000592 1788571387.935658 punch from 0x01cbb7 to 0x02aa9e (0xdee8 bytes) 000593 1788571387.949884 fallocate 0x02643b thru 0x027907 (0x14cd bytes) 000594 1788571387.990646 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2da53): Mirror 8: 0x64d6e6f (stale) Mirror 11: 0x64d6e6f (stale) Mirror 14: 0x64d6e6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2da53): Mirror 8: 0x64d6e6f (stale) Mirror 11: 0x64d6e6f (stale) Mirror 14: 0x64d6e6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2da53: skipped 000595 1788571388.461051 write 0x031138 thru 0x032a8b (0x1954 bytes) 000596 1788571388.467019 punch from 0x01a61f to 0x02722e (0xcc10 bytes) 000597 1788571388.477521 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x32a8c): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a8c): Mirror 8: 0xd923944d (stale) Mirror 11: 0xd923944d (stale) Mirror 14: 0xd923944d (stale) CRC-32 checksum value for chunk [0, 0x32a8c): Mirror 1: 0x68cf7c6e Mirror 15: 0x68cf7c6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a8c: skipped 000598 1788571389.524275 trunc from 0x032a8c to 0x03f661 (0xcbd6 bytes) 000599 1788571389.617405 trunc from 0x001c0c to 0x00af0b (0x9300 bytes) 000600 1788571389.645735 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: 0x4162a2f4 (stale) Mirror 11: 0x4162a2f4 (stale) Mirror 14: 0x4162a2f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: 0x4162a2f4 (stale) Mirror 11: 0x4162a2f4 (stale) Mirror 14: 0x4162a2f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f662: skipped 000601 1788571390.009255 trunc from 0x0274e5 to 0x035b27 (0xe643 bytes) 000602 1788571390.028807 mapread 0x02267a thru 0x0241a2 (0x1b29 bytes) 000603 1788571390.062199 read 0x01b28e thru 0x021138 (0x5eab bytes) 000604 1788571390.083310 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: 0x4162a2f4 (stale) Mirror 11: 0x4162a2f4 (stale) Mirror 14: 0x4162a2f4 (stale) CRC-32 checksum value for chunk [0, 0x3f662): Mirror 1: 0xa13e25d7 Mirror 15: 0xa13e25d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f662: skipped 000605 1788571391.128681 punch from 0x017aaa to 0x02207d (0xa5d4 bytes) 000606 1788571391.177132 read 0x00d8c4 thru 0x010521 (0x2c5e bytes) 000607 1788571391.185377 write 0x03a564 thru 0x03b72b (0x11c8 bytes) 000608 1788571391.200465 mapread 0x020ea8 thru 0x023d35 (0x2e8e bytes) 000610 1788571391.227249 mapwrite 0x02f845 thru 0x03b5a8 (0xbd64 bytes) 000611 1788571391.268470 mapwrite 0x03a7c1 thru 0x03bf29 (0x1769 bytes) 000612 1788571391.281166 read 0x035ea3 thru 0x03f661 (0x97bf bytes) 000613 1788571391.282732 fallocate 0x01f9c2 thru 0x02b324 (0xb963 bytes) 000614 1788571391.288296 write 0x010dbb thru 0x013369 (0x25af bytes) 000615 1788571391.300605 write 0x02cc40 thru 0x030f62 (0x4323 bytes) 000616 1788571391.302998 mapread 0x03f178 thru 0x03f661 (0x4ea bytes) 000617 1788571391.305145 write 0x0308d7 thru 0x03e215 (0xd93f bytes) 000618 1788571391.313401 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: 0x4162a2f4 (stale) Mirror 11: 0x4162a2f4 (stale) Mirror 14: 0x4162a2f4 (stale) Mirror 15: 0xa13e25d7 (stale) CRC-32 checksum value for chunk [0, 0x3f662): Mirror 1: 0xdaaf2ac3 Mirror 16: 0xdaaf2ac3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f662: skipped 000619 1788571392.257073 fallocate 0x0164de thru 0x02310d (0xcc30 bytes) 000620 1788571392.303450 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f662): Mirror 8: 0x4162a2f4 (stale) Mirror 11: 0x4162a2f4 (stale) Mirror 14: 0x4162a2f4 (stale) Mirror 15: 0xa13e25d7 (stale) Mirror 16: 0xdaaf2ac3 (stale) CRC-32 checksum value for chunk [0, 0x3f662): Mirror 1: 0xdaaf2ac3 Mirror 17: 0xdaaf2ac3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f662: skipped 000621 1788571393.453474 mapwrite 0x030cbb thru 0x034ae3 (0x3e29 bytes) 000622 1788571393.593219 punch from 0x007380 to 0x00f2fd (0x7f7e bytes) 000623 1788571393.599982 mapwrite 0x0299e8 thru 0x0336c7 (0x9ce0 bytes) 000624 1788571393.647304 write 0x026599 thru 0x0354a0 (0xef08 bytes) 000626 1788571393.660868 write 0x038de6 thru 0x03ffff (0x721a bytes) 000627 1788571393.664463 punch from 0x000161 to 0x00d74c (0xd5ec bytes) 000628 1788571393.670912 mapwrite 0x026409 thru 0x034d28 (0xe920 bytes) 000629 1788571393.711106 trunc from 0x0347f0 to 0x03ffff (0xb810 bytes) 000630 1788571393.717475 fallocate 0x024f30 thru 0x033c13 (0xece4 bytes) 000632 1788571393.723030 trunc from 0x040000 to 0x02d56a (0x12a95 bytes) 000633 1788571393.746132 mapread 0x00551c thru 0x00bf94 (0x6a79 bytes) 000634 1788571393.758124 write 0x02d114 thru 0x03cd94 (0xfc81 bytes) 000636 1788571393.765106 write 0x00a8c8 thru 0x011b2d (0x7266 bytes) 000637 1788571393.770937 punch from 0x022988 to 0x023148 (0x7c1 bytes) 000638 1788571393.776077 mapread 0x00eb7c thru 0x01078d (0x1c12 bytes) 000639 1788571393.778920 mapwrite 0x026a11 thru 0x03179d (0xad8d bytes) 000640 1788571393.801399 read 0x02a293 thru 0x02bcdf (0x1a4d bytes) 000642 1788571393.802667 trunc from 0x030576 to 0x03cd94 (0xc81f bytes) 000643 1788571393.808118 fallocate 0x02b446 thru 0x02dafb (0x26b6 bytes) 000644 1788571393.814907 fallocate 0x00bca1 thru 0x00dd7c (0x20dc bytes) 000645 1788571393.819530 mapwrite 0x01896f thru 0x01b84c (0x2ede bytes) 000647 1788571393.850246 mapwrite 0x019051 thru 0x02121b (0x81cb bytes) 000648 1788571393.879863 mapwrite 0x03fb30 thru 0x03ffff (0x4d0 bytes) 000649 1788571393.918610 punch from 0x007a21 to 0x00d7d7 (0x5db7 bytes) 000650 1788571393.926996 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xeae24dfd (stale) Mirror 11: 0xeae24dfd (stale) Mirror 14: 0xeae24dfd (stale) Mirror 15: 0x502aaf18 (stale) Mirror 16: 0x11b14c6a (stale) Mirror 17: 0x11b14c6a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb95f6c52 Mirror 18: 0xb95f6c52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000651 1788571394.995013 write 0x021957 thru 0x02e72f (0xcdd9 bytes) 000652 1788571395.062007 fallocate 0x027350 thru 0x0307a9 (0x945a bytes) 000653 1788571395.069291 fallocate 0x0203a5 thru 0x025cd5 (0x5931 bytes) 000654 1788571395.075620 fallocate 0x00a149 thru 0x01450c (0xa3c4 bytes) 000656 1788571395.093959 mapread 0x015859 thru 0x015d07 (0x4af bytes) 000657 1788571395.108071 write 0x03f086 thru 0x03ffff (0xf7a bytes) 000658 1788571395.122653 write 0x02e291 thru 0x03cce4 (0xea54 bytes) 000659 1788571395.135017 mapread 0x01d12f thru 0x028759 (0xb62b bytes) 000660 1788571395.152386 mapread 0x005585 thru 0x014c7a (0xf6f6 bytes) 000663 1788571395.192403 write 0x029800 thru 0x02c9d9 (0x31da bytes) 000664 1788571395.201105 MIRROR_RESYNC 8 mirrors 000665 1788571397.410360 write 0x019bf3 thru 0x021945 (0x7d53 bytes) 000666 1788571397.481744 mapwrite 0x00cc2f thru 0x01c515 (0xf8e7 bytes) 000667 1788571397.572027 punch from 0x00c07c to 0x012eb7 (0x6e3c bytes) 000668 1788571397.581674 fallocate 0x015d2f thru 0x01dd09 (0x7fdb bytes) 000669 1788571397.591668 write 0x0079d2 thru 0x00ab61 (0x3190 bytes) 000670 1788571397.594435 mapread 0x03a059 thru 0x03ffff (0x5fa7 bytes) 000671 1788571397.603957 trunc from 0x033291 to 0x037790 (0x4500 bytes) 000672 1788571397.619033 MIRROR_RESYNC 8 mirrors 000673 1788571400.646345 punch from 0x010aad to 0x01768d (0x6be1 bytes) 000674 1788571400.700812 write 0x0342e5 thru 0x0368f4 (0x2610 bytes) 000675 1788571400.711188 punch from 0x004abc to 0x00cdb2 (0x82f7 bytes) 000676 1788571400.717542 mapwrite 0x035721 thru 0x03beb3 (0x6793 bytes) 000677 1788571400.747963 read 0x026492 thru 0x02b527 (0x5096 bytes) 000680 1788571400.757158 mapwrite 0x03eb10 thru 0x03ffff (0x14f0 bytes) 000681 1788571400.770410 punch from 0x0126a7 to 0x0200ff (0xda59 bytes) 000682 1788571400.775422 punch from 0x032e3a to 0x03ed4a (0xbf11 bytes) 000683 1788571400.781502 fallocate 0x02ac9a thru 0x02fe6e (0x51d5 bytes) 000684 1788571400.786177 fallocate 0x03cdcb thru 0x03e5dc (0x1812 bytes) 000685 1788571400.791095 mapwrite 0x0242ee thru 0x03091c (0xc62f bytes) 000686 1788571400.824882 fallocate 0x0178da thru 0x01b049 (0x3770 bytes) 000687 1788571400.833456 trunc from 0x0044ad to 0x005c6f (0x17c3 bytes) 000688 1788571400.838098 read 0x009757 thru 0x015d79 (0xc623 bytes) 000689 1788571400.848585 mapread 0x03c8b3 thru 0x03ffad (0x36fb bytes) 000691 1788571400.851121 write 0x030f6c thru 0x03c478 (0xb50d bytes) 000692 1788571400.852952 trunc from 0x02eab0 to 0x03698b (0x7edc bytes) 000693 1788571400.868728 write 0x0103f4 thru 0x012f08 (0x2b15 bytes) 000694 1788571400.875304 trunc from 0x040000 to 0x012383 (0x2dc7c bytes) 000695 1788571400.910523 fallocate 0x016a78 thru 0x018738 (0x1cc1 bytes) 000696 1788571400.920091 mapwrite 0x00d2dd thru 0x00d6fc (0x420 bytes) 000697 1788571400.938919 mapwrite 0x03b946 thru 0x03d8ed (0x1fa8 bytes) 000698 1788571400.984731 punch from 0x0064ee to 0x00c498 (0x5fab bytes) 000700 1788571400.990968 write 0x0045f0 thru 0x00d91a (0x932b bytes) 000701 1788571400.993191 mapread 0x03b331 thru 0x03d8ed (0x25bd bytes) 000702 1788571400.994920 mapread 0x01472b thru 0x01dbff (0x94d5 bytes) 000703 1788571401.059641 read 0x0248f5 thru 0x02cf72 (0x867e bytes) 000705 1788571401.081294 fallocate 0x004b3e thru 0x00b830 (0x6cf3 bytes) 000706 1788571401.087033 mapread 0x0190a0 thru 0x026e01 (0xdd62 bytes) 000707 1788571401.089099 read 0x0062d8 thru 0x006ad0 (0x7f9 bytes) 000708 1788571401.090412 write 0x00858b thru 0x00d8d3 (0x5349 bytes) 000709 1788571401.092296 mapread 0x0390b7 thru 0x03d8ed (0x4837 bytes) 000711 1788571401.094713 mapread 0x0347eb thru 0x03d8ed (0x9103 bytes) 000712 1788571401.096673 trunc from 0x031bde to 0x0328dc (0xcff bytes) 000713 1788571401.105446 MIRROR_RESYNC 8 mirrors 000714 1788571403.532509 mapread 0x035778 thru 0x038248 (0x2ad1 bytes) 000715 1788571403.562061 mapread 0x00a8d8 thru 0x018a6b (0xe194 bytes) 000716 1788571403.587597 fallocate 0x006e26 thru 0x008fb3 (0x218e bytes) 000717 1788571403.631090 fallocate 0x0292aa thru 0x0375b3 (0xe30a bytes) 000718 1788571403.638279 fallocate 0x014157 thru 0x02186c (0xd716 bytes) 000719 1788571403.643909 mapread 0x036912 thru 0x03998b (0x307a bytes) 000720 1788571403.658022 trunc from 0x01368d to 0x01e33d (0xacb1 bytes) 000721 1788571403.662207 write 0x0173c4 thru 0x0196b9 (0x22f6 bytes) 000722 1788571403.673697 trunc from 0x03d8ee to 0x0205bc (0x1d331 bytes) 000723 1788571403.702778 punch from 0x00355f to 0x0112fa (0xdd9c bytes) 000724 1788571403.707898 read 0x013fd3 thru 0x0178d0 (0x38fe bytes) 000725 1788571403.715291 trunc from 0x01a2f0 to 0x0205bc (0x62cd bytes) 000726 1788571403.721406 mapwrite 0x03a041 thru 0x03ffff (0x5fbf bytes) 000727 1788571403.762252 write 0x014a49 thru 0x023e4c (0xf404 bytes) 000728 1788571403.772957 mapwrite 0x01ad01 thru 0x02829c (0xd59c bytes) 000729 1788571403.803526 fallocate 0x035fa5 thru 0x03c39e (0x63fa bytes) 000730 1788571403.808578 write 0x00ebb7 thru 0x01e801 (0xfc4b bytes) 000731 1788571403.814523 punch from 0x03067b to 0x03b5fb (0xaf81 bytes) 000732 1788571403.820558 punch from 0x00376e to 0x0073f0 (0x3c83 bytes) 000733 1788571403.826019 read 0x02b76e thru 0x031789 (0x601c bytes) 000735 1788571403.861147 MIRROR_RESYNC 8 mirrors 000736 1788571405.966079 punch from 0x03cb42 to 0x03ffff (0x34be bytes) 000737 1788571406.017622 mapread 0x02ad77 thru 0x032a78 (0x7d02 bytes) 000738 1788571406.041534 trunc from 0x0091b7 to 0x00d098 (0x3ee2 bytes) 000739 1788571406.046853 read 0x003d27 thru 0x012a07 (0xece1 bytes) 000740 1788571406.059100 write 0x03e29a thru 0x03ffff (0x1d66 bytes) 000741 1788571406.071438 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x98ae01c1 (stale) Mirror 11: 0x98ae01c1 (stale) Mirror 14: 0x98ae01c1 (stale) Mirror 16: 0x98ae01c1 (stale) Mirror 17: 0x98ae01c1 (stale) Mirror 18: 0x98ae01c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x98ae01c1 (stale) Mirror 11: 0x98ae01c1 (stale) Mirror 14: 0x98ae01c1 (stale) Mirror 16: 0x98ae01c1 (stale) Mirror 17: 0x98ae01c1 (stale) Mirror 18: 0x98ae01c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000742 1788571406.687635 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x98ae01c1 (stale) Mirror 11: 0x98ae01c1 (stale) Mirror 14: 0x98ae01c1 (stale) Mirror 17: 0x98ae01c1 (stale) Mirror 18: 0x98ae01c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x98ae01c1 (stale) Mirror 11: 0x98ae01c1 (stale) Mirror 14: 0x98ae01c1 (stale) Mirror 17: 0x98ae01c1 (stale) Mirror 18: 0x98ae01c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000743 1788571407.090288 trunc from 0x008773 to 0x015db8 (0xd646 bytes) 000744 1788571407.102114 fallocate 0x00f0eb thru 0x017706 (0x861c bytes) 000745 1788571407.107569 fallocate 0x02d4f2 thru 0x039125 (0xbc34 bytes) 000746 1788571407.112570 punch from 0x010ec0 to 0x019252 (0x8393 bytes) 000747 1788571407.117873 write 0x01e788 thru 0x0261fd (0x7a76 bytes) 000748 1788571407.129846 write 0x000457 thru 0x00edf8 (0xe9a2 bytes) 000751 1788571407.141279 mapwrite 0x017215 thru 0x025b24 (0xe910 bytes) 000752 1788571407.181529 punch from 0x00590c to 0x00730c (0x1a01 bytes) 000753 1788571407.188094 mapread 0x003718 thru 0x007b55 (0x443e bytes) 000754 1788571407.204567 trunc from 0x003f41 to 0x00482c (0x8ec bytes) 000755 1788571407.210992 read 0x01e885 thru 0x025fe6 (0x7762 bytes) 000756 1788571407.212442 fallocate 0x0023f9 thru 0x007adf (0x56e7 bytes) 000757 1788571407.218514 read 0x0324fe thru 0x034868 (0x236b bytes) 000758 1788571407.236931 punch from 0x01916e to 0x020b80 (0x7a13 bytes) 000759 1788571407.246592 mapwrite 0x0086fc thru 0x0146d4 (0xbfd9 bytes) 000760 1788571407.273995 write 0x028df8 thru 0x02dd22 (0x4f2b bytes) 000761 1788571407.275650 fallocate 0x01083a thru 0x0160cd (0x5894 bytes) 000762 1788571407.281409 read 0x024c1f thru 0x02b459 (0x683b bytes) 000763 1788571407.292167 MIRROR_RESYNC 6 mirrors 000764 1788571409.696251 trunc from 0x040000 to 0x024c1f (0x1b3e0 bytes) 000765 1788571409.735413 fallocate 0x00d03b thru 0x012f84 (0x5f4a bytes) 000766 1788571409.740741 write 0x008a13 thru 0x014ad7 (0xc0c5 bytes) 000767 1788571409.751950 fallocate 0x0242ae thru 0x025876 (0x15c9 bytes) 000768 1788571409.756777 write 0x03ee49 thru 0x03ffff (0x11b7 bytes) 000770 1788571409.759647 read 0x00b191 thru 0x015d1d (0xab8d bytes) 000771 1788571409.764750 mapwrite 0x0157fe thru 0x01eefa (0x96fd bytes) 000772 1788571409.812183 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xff370af4 (stale) Mirror 11: 0xff370af4 (stale) Mirror 14: 0xff370af4 (stale) Mirror 17: 0xff370af4 (stale) Mirror 18: 0xff370af4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc470dc8d Mirror 19: 0xc470dc8d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000773 1788571410.669087 fallocate 0x00e7b5 thru 0x018ea8 (0xa6f4 bytes) 000774 1788571410.716601 mapread 0x023b54 thru 0x02627e (0x272b bytes) 000775 1788571410.737413 trunc from 0x040000 to 0x019951 (0x266ae bytes) 000776 1788571410.756595 fallocate 0x017d6f thru 0x022ec6 (0xb158 bytes) 000777 1788571410.761841 read 0x0180d7 thru 0x019951 (0x187b bytes) 000779 1788571410.768853 fallocate 0x00ee61 thru 0x0161e8 (0x7388 bytes) 000780 1788571410.773379 write 0x035455 thru 0x03f521 (0xa0cd bytes) 000781 1788571410.775558 trunc from 0x00d288 to 0x010d4f (0x3ac8 bytes) 000782 1788571410.780494 punch from 0x003e19 to 0x005274 (0x145c bytes) 000783 1788571410.789129 mapwrite 0x0223b6 thru 0x02e804 (0xc44f bytes) 000784 1788571410.832547 mapread 0x01df69 thru 0x02c875 (0xe90d bytes) 000785 1788571410.834849 mapread 0x002329 thru 0x00d219 (0xaef1 bytes) 000786 1788571410.843854 read 0x00650c thru 0x006bcb (0x6c0 bytes) 000787 1788571410.844568 punch from 0x007189 to 0x00fc47 (0x8abf bytes) 000788 1788571410.849705 write 0x02b20c thru 0x035262 (0xa057 bytes) 000789 1788571410.851136 punch from 0x02635e to 0x031173 (0xae16 bytes) 000790 1788571410.863581 fallocate 0x025aad thru 0x031991 (0xbee5 bytes) 000791 1788571410.868201 write 0x002653 thru 0x0045f6 (0x1fa4 bytes) 000793 1788571410.870657 fallocate 0x000c31 thru 0x00196f (0xd3f bytes) 000794 1788571410.875364 read 0x01d6de thru 0x020859 (0x317c bytes) 000795 1788571410.880146 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f522): Mirror 11: 0xca5ffc5e (stale) Mirror 14: 0xca5ffc5e (stale) Mirror 17: 0xca5ffc5e (stale) Mirror 18: 0xca5ffc5e (stale) Mirror 19: 0xeb73112d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f522): Mirror 11: 0xca5ffc5e (stale) Mirror 14: 0xca5ffc5e (stale) Mirror 17: 0xca5ffc5e (stale) Mirror 18: 0xca5ffc5e (stale) Mirror 19: 0xeb73112d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f522: skipped 000796 1788571411.271288 trunc from 0x03f522 to 0x0359d4 (0x9b4d bytes) 000797 1788571411.296849 trunc from 0x024c59 to 0x0300d1 (0xb479 bytes) 000798 1788571411.302307 trunc from 0x00b1ba to 0x012a5f (0x78a6 bytes) 000799 1788571411.307072 read 0x01a57c thru 0x01ca3c (0x24c1 bytes) 000800 1788571411.312621 mapwrite 0x039315 thru 0x03ffff (0x6ceb bytes) 000801 1788571411.374841 mapwrite 0x012c0c thru 0x019e75 (0x726a bytes) 000803 1788571411.412946 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xff370af4 (stale) Mirror 17: 0xff370af4 (stale) Mirror 18: 0xff370af4 (stale) Mirror 19: 0xc470dc8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xff370af4 (stale) Mirror 17: 0xff370af4 (stale) Mirror 18: 0xff370af4 (stale) Mirror 19: 0xc470dc8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1788571411.779973 punch from 0x03e89d to 0x03f2c1 (0xa25 bytes) 000805 1788571411.786018 fallocate 0x023431 thru 0x02fdce (0xc99e bytes) 000806 1788571411.791398 mapwrite 0x01a2c3 thru 0x02184d (0x758b bytes) 000807 1788571411.831576 mapread 0x00ba19 thru 0x013e3f (0x8427 bytes) 000808 1788571411.849126 mapread 0x002eba thru 0x011141 (0xe288 bytes) 000810 1788571411.856945 write 0x006e5b thru 0x010e70 (0xa016 bytes) 000811 1788571411.864069 trunc from 0x040000 to 0x0023d9 (0x3dc26 bytes) 000812 1788571411.883130 read 0x001e1b thru 0x0023d9 (0x5bf bytes) 000813 1788571411.890079 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x23da): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23da): Mirror 14: 0x7f51e6d7 (stale) Mirror 17: 0x7f51e6d7 (stale) Mirror 18: 0x7f51e6d7 (stale) Mirror 19: 0x7f51e6d7 (stale) CRC-32 checksum value for chunk [0, 0x23da): Mirror 1: 0x7f51e6d7 Mirror 20: 0x7f51e6d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23da: skipped 000814 1788571412.670221 mapwrite 0x0258b8 thru 0x030afc (0xb245 bytes) 000815 1788571412.871711 read 0x01f271 thru 0x0295d7 (0xa367 bytes) 000816 1788571412.891104 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x30afd): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30afd): Mirror 14: 0x828b92ab (stale) Mirror 17: 0x828b92ab (stale) Mirror 18: 0x828b92ab (stale) Mirror 19: 0x8b55975e (stale) Mirror 20: 0x40a76c57 (stale) CRC-32 checksum value for chunk [0, 0x30afd): Mirror 1: 0xccf3962c Mirror 21: 0xccf3962c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30afd: skipped 000817 1788571414.342304 trunc from 0x004b06 to 0x00cf38 (0x8433 bytes) 000818 1788571414.409245 punch from 0x016696 to 0x01c361 (0x5ccc bytes) 000819 1788571414.421933 mapwrite 0x02641b thru 0x027232 (0xe18 bytes) 000820 1788571414.453760 fallocate 0x003461 thru 0x00da43 (0xa5e3 bytes) 000821 1788571414.460004 trunc from 0x030afd to 0x037378 (0x687c bytes) 000822 1788571414.489377 fallocate 0x01cf43 thru 0x029848 (0xc906 bytes) 000823 1788571414.496095 punch from 0x0202f9 to 0x028cb2 (0x89ba bytes) 000825 1788571414.509595 punch from 0x00a9b2 to 0x018725 (0xdd74 bytes) 000826 1788571414.517087 write 0x03bede thru 0x03ffff (0x4122 bytes) 000827 1788571414.520922 mapread 0x023ebb thru 0x02970e (0x5854 bytes) 000828 1788571414.541822 write 0x0072f4 thru 0x00d30a (0x6017 bytes) 000829 1788571414.565471 trunc from 0x01e0c8 to 0x02c272 (0xe1ab bytes) 000831 1788571414.585008 read 0x031fdc thru 0x03a422 (0x8447 bytes) 000832 1788571414.595798 punch from 0x030a83 to 0x039c5f (0x91dd bytes) 000834 1788571414.602984 trunc from 0x033b14 to 0x03ffff (0xc4ec bytes) 000835 1788571414.615452 mapread 0x02a82e thru 0x038c22 (0xe3f5 bytes) 000836 1788571414.638194 mapwrite 0x004e18 thru 0x00e38f (0x9578 bytes) 000837 1788571414.662620 trunc from 0x040000 to 0x028197 (0x17e68 bytes) 000838 1788571414.675789 fallocate 0x0029ac thru 0x007a37 (0x508c bytes) 000839 1788571414.681790 punch from 0x01fea4 to 0x028197 (0x82f4 bytes) 000840 1788571414.692901 mapwrite 0x002663 thru 0x01178c (0xf12a bytes) 000841 1788571414.722687 read 0x013d63 thru 0x01dabd (0x9d5b bytes) 000842 1788571414.730241 fallocate 0x004c2e thru 0x00d587 (0x895a bytes) 000843 1788571414.734594 mapread 0x017fba thru 0x018fe6 (0x102d bytes) 000845 1788571414.736216 punch from 0x0269b8 to 0x028197 (0x17e0 bytes) 000846 1788571414.741294 trunc from 0x028198 to 0x03c65b (0x144c4 bytes) 000847 1788571414.759866 read 0x013760 thru 0x017730 (0x3fd1 bytes) 000848 1788571414.760703 trunc from 0x01ad48 to 0x01e70a (0x39c3 bytes) 000849 1788571414.766398 read 0x005e3b thru 0x00e1a9 (0x836f bytes) 000850 1788571414.767123 mapread 0x00ec12 thru 0x0156e6 (0x6ad5 bytes) 000851 1788571414.768306 write 0x014b9e thru 0x0163b7 (0x181a bytes) 000852 1788571414.774395 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c65c): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c65c): Mirror 14: 0x56f22dd2 (stale) Mirror 17: 0x56f22dd2 (stale) Mirror 18: 0x56f22dd2 (stale) Mirror 19: 0x91f13a3c (stale) Mirror 20: 0xb5ee2fda (stale) Mirror 21: 0xcfe08641 (stale) CRC-32 checksum value for chunk [0, 0x3c65c): Mirror 1: 0x1a9bb308 Mirror 22: 0x1a9bb308 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c65c: skipped 000854 1788571415.792602 trunc from 0x03c65c to 0x01c70b (0x1ff50 bytes) 000855 1788571415.859310 trunc from 0x01c70c to 0x026c47 (0xa53c bytes) 000856 1788571415.884726 trunc from 0x018895 to 0x01ab95 (0x2301 bytes) 000857 1788571415.891041 trunc from 0x026c48 to 0x02434b (0x28fc bytes) 000859 1788571415.912728 MIRROR_RESYNC 8 mirrors 000860 1788571417.437223 write 0x01ec61 thru 0x0220b1 (0x3451 bytes) 000861 1788571417.477945 fallocate 0x009c0b thru 0x0133c1 (0x97b7 bytes) 000862 1788571417.482838 trunc from 0x02434c to 0x03672a (0x123df bytes) 000863 1788571417.504780 trunc from 0x013dfe to 0x01d756 (0x9959 bytes) 000864 1788571417.510164 trunc from 0x03672b to 0x0396de (0x2fb4 bytes) 000865 1788571417.529714 read 0x01563e thru 0x022479 (0xce3c bytes) 000866 1788571417.541598 punch from 0x028c22 to 0x02c835 (0x3c14 bytes) 000867 1788571417.546781 mapread 0x02302d thru 0x026510 (0x34e4 bytes) 000868 1788571417.567427 mapread 0x01affe thru 0x021f6e (0x6f71 bytes) 000869 1788571417.568615 trunc from 0x03697c to 0x0396de (0x2d63 bytes) 000870 1788571417.573985 mapwrite 0x00ae21 thru 0x0158f3 (0xaad3 bytes) 000871 1788571417.612013 fallocate 0x025fb9 thru 0x02eeb1 (0x8ef9 bytes) 000872 1788571417.617988 punch from 0x0382bf to 0x0396de (0x1420 bytes) 000873 1788571417.623152 trunc from 0x00814a to 0x00df5c (0x5e13 bytes) 000874 1788571417.631742 read 0x037d29 thru 0x0396de (0x19b6 bytes) 000875 1788571417.644032 read 0x0209c5 thru 0x023e0c (0x3448 bytes) 000876 1788571417.645389 write 0x01f633 thru 0x022c0c (0x35da bytes) 000877 1788571417.651792 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x396df): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396df): Mirror 14: 0x6f37a4f0 (stale) Mirror 17: 0x6f37a4f0 (stale) Mirror 18: 0x6f37a4f0 (stale) Mirror 19: 0x6f37a4f0 (stale) Mirror 20: 0x6f37a4f0 (stale) Mirror 21: 0x6f37a4f0 (stale) Mirror 22: 0x6f37a4f0 (stale) CRC-32 checksum value for chunk [0, 0x396df): Mirror 1: 0xbfc6a0b5 Mirror 23: 0xbfc6a0b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396df: skipped 000878 1788571418.845485 fallocate 0x010fab thru 0x01d710 (0xc766 bytes) 000879 1788571418.906722 write 0x026a18 thru 0x026c7b (0x264 bytes) 000880 1788571418.918600 fallocate 0x014b51 thru 0x01ab56 (0x6006 bytes) 000882 1788571418.924936 mapread 0x0225fd thru 0x02b643 (0x9047 bytes) 000883 1788571418.948823 trunc from 0x02be68 to 0x037fea (0xc183 bytes) 000884 1788571418.958689 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x396df): Mirror 14: 0x6f37a4f0 (stale) Mirror 17: 0x6f37a4f0 (stale) Mirror 19: 0x6f37a4f0 (stale) Mirror 20: 0x6f37a4f0 (stale) Mirror 21: 0x6f37a4f0 (stale) Mirror 22: 0x6f37a4f0 (stale) Mirror 23: 0xbfc6a0b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396df): Mirror 14: 0x6f37a4f0 (stale) Mirror 17: 0x6f37a4f0 (stale) Mirror 19: 0x6f37a4f0 (stale) Mirror 20: 0x6f37a4f0 (stale) Mirror 21: 0x6f37a4f0 (stale) Mirror 22: 0x6f37a4f0 (stale) Mirror 23: 0xbfc6a0b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396df: skipped 000885 1788571419.408416 fallocate 0x000f55 thru 0x004bc1 (0x3c6d bytes) 000886 1788571419.415171 read 0x000938 thru 0x004c7b (0x4344 bytes) 000887 1788571419.427137 trunc from 0x00917f to 0x015cf9 (0xcb7b bytes) 000888 1788571419.432272 trunc from 0x03251e to 0x036b87 (0x466a bytes) 000889 1788571419.444409 mapread 0x01f892 thru 0x02e7e3 (0xef52 bytes) 000890 1788571419.472422 trunc from 0x01a7eb to 0x029733 (0xef49 bytes) 000891 1788571419.478568 read 0x01cb49 thru 0x02b481 (0xe939 bytes) 000892 1788571419.488768 write 0x03032f thru 0x03b128 (0xadfa bytes) 000893 1788571419.495528 punch from 0x0236bc to 0x02ae22 (0x7767 bytes) 000894 1788571419.502350 trunc from 0x03b129 to 0x025714 (0x15a14 bytes) 000895 1788571419.518579 trunc from 0x00b0e8 to 0x00c1d5 (0x10ee bytes) 000896 1788571419.525225 trunc from 0x0155e3 to 0x01ca95 (0x74b3 bytes) 000897 1788571419.530409 punch from 0x0197a9 to 0x019d40 (0x598 bytes) 000898 1788571419.534987 mapwrite 0x02f8ee thru 0x0321ce (0x28e1 bytes) 000899 1788571419.589434 mapwrite 0x00c636 thru 0x00d96f (0x133a bytes) 000900 1788571419.612280 write 0x007295 thru 0x014837 (0xd5a3 bytes) 000901 1788571419.614520 trunc from 0x01d862 to 0x02b25b (0xd9fa bytes) 000903 1788571419.621014 mapread 0x0248f9 thru 0x02f66e (0xad76 bytes) 000904 1788571419.678512 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: 0x4eca1c61 (stale) Mirror 17: 0x4eca1c61 (stale) Mirror 19: 0x4eca1c61 (stale) Mirror 20: 0x4eca1c61 (stale) Mirror 21: 0x4eca1c61 (stale) Mirror 22: 0x4eca1c61 (stale) Mirror 23: 0x6f900dbb (stale) CRC-32 checksum value for chunk [0, 0x321cf): Mirror 1: 0x1a6f7cba Mirror 24: 0x1a6f7cba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321cf: skipped 000905 1788571420.574045 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: 0x4eca1c61 (stale) Mirror 17: 0x4eca1c61 (stale) Mirror 19: 0x4eca1c61 (stale) Mirror 21: 0x4eca1c61 (stale) Mirror 22: 0x4eca1c61 (stale) Mirror 23: 0x6f900dbb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: 0x4eca1c61 (stale) Mirror 17: 0x4eca1c61 (stale) Mirror 19: 0x4eca1c61 (stale) Mirror 21: 0x4eca1c61 (stale) Mirror 22: 0x4eca1c61 (stale) Mirror 23: 0x6f900dbb (stale) CRC-32 checksum value for chunk [0, 0x321cf): Mirror 1: 0x1a6f7cba Mirror 24: 0x1a6f7cba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321cf: skipped 000906 1788571421.250060 mapwrite 0x00612a thru 0x00de85 (0x7d5c bytes) 000907 1788571421.348388 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: 0x4eca1c61 (stale) Mirror 17: 0x4eca1c61 (stale) Mirror 19: 0x4eca1c61 (stale) Mirror 21: 0x4eca1c61 (stale) Mirror 22: 0x4eca1c61 (stale) Mirror 24: 0x1a6f7cba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: 0x4eca1c61 (stale) Mirror 17: 0x4eca1c61 (stale) Mirror 19: 0x4eca1c61 (stale) Mirror 21: 0x4eca1c61 (stale) Mirror 22: 0x4eca1c61 (stale) Mirror 24: 0x1a6f7cba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321cf: skipped 000908 1788571421.757237 read 0x0134ed thru 0x019602 (0x6116 bytes) 000910 1788571421.768964 punch from 0x019502 to 0x026fda (0xdad9 bytes) 000911 1788571421.775422 mapread 0x01868c thru 0x01f353 (0x6cc8 bytes) 000912 1788571421.801548 mapwrite 0x008575 thru 0x00eaeb (0x6577 bytes) 000913 1788571421.838434 write 0x02b8b4 thru 0x032153 (0x68a0 bytes) 000914 1788571421.854972 mapwrite 0x0196a6 thru 0x02324f (0x9baa bytes) 000915 1788571421.886199 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321cf): Mirror 14: 0x4eca1c61 (stale) Mirror 17: 0x4eca1c61 (stale) Mirror 19: 0x4eca1c61 (stale) Mirror 21: 0x4eca1c61 (stale) Mirror 22: 0x4eca1c61 (stale) Mirror 24: 0x1a6f7cba (stale) CRC-32 checksum value for chunk [0, 0x321cf): Mirror 1: 0x65d8c1ca Mirror 25: 0x65d8c1ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321cf: skipped 000916 1788571422.869513 write 0x00fb9d thru 0x01b4d6 (0xb93a bytes) 000917 1788571422.937304 read 0x01a013 thru 0x01eeaa (0x4e98 bytes) 000919 1788571422.948559 mapread 0x00d322 thru 0x01884a (0xb529 bytes) 000920 1788571422.959974 read 0x021028 thru 0x02495e (0x3937 bytes) 000921 1788571422.993835 read 0x007a35 thru 0x011684 (0x9c50 bytes) 000922 1788571422.995252 punch from 0x0284e8 to 0x0321ce (0x9ce7 bytes) 000923 1788571423.001778 trunc from 0x029d19 to 0x0321ce (0x84b6 bytes) 000924 1788571423.007482 trunc from 0x00bdcc to 0x00c828 (0xa5d bytes) 000925 1788571423.012386 trunc from 0x002ec4 to 0x008f5b (0x6098 bytes) 000926 1788571423.018698 mapwrite 0x03c7db thru 0x03ffff (0x3825 bytes) 000928 1788571423.078372 MIRROR_RESYNC 8 mirrors 000929 1788571425.264524 mapwrite 0x0171e6 thru 0x01b685 (0x44a0 bytes) 000930 1788571425.411368 mapread 0x029df6 thru 0x02c0c6 (0x22d1 bytes) 000931 1788571425.430496 write 0x03a817 thru 0x03ffff (0x57e9 bytes) 000932 1788571425.436165 read 0x015b59 thru 0x021feb (0xc493 bytes) 000933 1788571425.451519 write 0x03e446 thru 0x03ffff (0x1bba bytes) 000934 1788571425.453155 trunc from 0x01aeea to 0x02252e (0x7645 bytes) 000935 1788571425.459890 trunc from 0x040000 to 0x00d4a1 (0x32b5e bytes) 000936 1788571425.476980 trunc from 0x00730b to 0x00d4a1 (0x6197 bytes) 000937 1788571425.483500 trunc from 0x00885a to 0x00d4a1 (0x4c48 bytes) 000938 1788571425.489112 mapwrite 0x036fd1 thru 0x03f73b (0x876b bytes) 000939 1788571425.569286 fallocate 0x02e568 thru 0x034461 (0x5efa bytes) 000940 1788571425.576478 fallocate 0x01d1b3 thru 0x022618 (0x5466 bytes) 000941 1788571425.584229 read 0x02b77f thru 0x039deb (0xe66d bytes) 000942 1788571425.596537 mapread 0x001c02 thru 0x001e1b (0x21a bytes) 000943 1788571425.602934 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f73c): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f73c): Mirror 14: 0x6639387f (stale) Mirror 17: 0x6639387f (stale) Mirror 19: 0x6639387f (stale) Mirror 21: 0x6639387f (stale) Mirror 22: 0x6639387f (stale) Mirror 24: 0x6639387f (stale) Mirror 25: 0x6639387f (stale) CRC-32 checksum value for chunk [0, 0x3f73c): Mirror 1: 0x57bc9d1d Mirror 26: 0x57bc9d1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f73c: skipped 000944 1788571426.758429 MIRROR_RESYNC 9 mirrors 000945 1788571428.456522 mapread 0x01c5d5 thru 0x0298ea (0xd316 bytes) 000946 1788571428.490512 write 0x03a862 thru 0x03e9a6 (0x4145 bytes) 000947 1788571428.549140 mapwrite 0x0214a1 thru 0x0234c0 (0x2020 bytes) 000948 1788571428.581411 trunc from 0x00b4e5 to 0x00e68a (0x31a6 bytes) 000949 1788571428.591263 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f73c): Mirror 14: 0x57bc9d1d (stale) Mirror 17: 0x57bc9d1d (stale) Mirror 19: 0x57bc9d1d (stale) Mirror 22: 0x57bc9d1d (stale) Mirror 24: 0x57bc9d1d (stale) Mirror 25: 0x57bc9d1d (stale) Mirror 26: 0x57bc9d1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f73c): Mirror 14: 0x57bc9d1d (stale) Mirror 17: 0x57bc9d1d (stale) Mirror 19: 0x57bc9d1d (stale) Mirror 22: 0x57bc9d1d (stale) Mirror 24: 0x57bc9d1d (stale) Mirror 25: 0x57bc9d1d (stale) Mirror 26: 0x57bc9d1d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f73c: skipped 000950 1788571429.147974 read 0x02382b thru 0x02ed95 (0xb56b bytes) 000951 1788571429.161880 MIRROR_RESYNC 8 mirrors 000952 1788571430.600705 mapwrite 0x017c3b thru 0x01a9ac (0x2d72 bytes) 000953 1788571430.772418 read 0x00c888 thru 0x017889 (0xb002 bytes) 000954 1788571430.787684 write 0x029f7e thru 0x033a25 (0x9aa8 bytes) 000955 1788571430.800561 punch from 0x004072 to 0x00671a (0x26a9 bytes) 000956 1788571430.807176 trunc from 0x01eb04 to 0x0243d4 (0x58d1 bytes) 000957 1788571430.813314 punch from 0x02b3e2 to 0x02b97f (0x59e bytes) 000958 1788571430.833586 trunc from 0x03f73c to 0x00e0c4 (0x31677 bytes) 000959 1788571430.857481 trunc from 0x00e0c5 to 0x01a5a8 (0xc4e4 bytes) 000960 1788571430.872797 write 0x01b115 thru 0x0262ae (0xb19a bytes) 000962 1788571430.878630 trunc from 0x02074a to 0x0262ae (0x5b65 bytes) 000963 1788571430.895971 write 0x00caf2 thru 0x010672 (0x3b81 bytes) 000964 1788571430.902303 read 0x00acdd thru 0x00f1bd (0x44e1 bytes) 000965 1788571430.913740 mapread 0x013829 thru 0x0192ee (0x5ac6 bytes) 000967 1788571430.917182 write 0x008db7 thru 0x00dbbd (0x4e07 bytes) 000968 1788571430.922869 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x262af): Mirror 17: 0xdc0fbd25 (stale) Mirror 19: 0xdc0fbd25 (stale) Mirror 22: 0xdc0fbd25 (stale) Mirror 24: 0xdc0fbd25 (stale) Mirror 25: 0xdc0fbd25 (stale) Mirror 26: 0xdc0fbd25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262af): Mirror 17: 0xdc0fbd25 (stale) Mirror 19: 0xdc0fbd25 (stale) Mirror 22: 0xdc0fbd25 (stale) Mirror 24: 0xdc0fbd25 (stale) Mirror 25: 0xdc0fbd25 (stale) Mirror 26: 0xdc0fbd25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262af: skipped 000969 1788571431.509297 trunc from 0x01e0c2 to 0x0261e4 (0x8123 bytes) 000970 1788571431.516382 trunc from 0x014e84 to 0x01a47c (0x55f9 bytes) 000971 1788571431.525411 read 0x00f606 thru 0x0182ba (0x8cb5 bytes) 000973 1788571431.536278 punch from 0x00cecb to 0x0159be (0x8af4 bytes) 000974 1788571431.542366 trunc from 0x0262af to 0x014082 (0x1222c bytes) 000975 1788571431.573167 trunc from 0x014083 to 0x03f06f (0x2afed bytes) 000976 1788571431.595856 mapread 0x03778d thru 0x03eb22 (0x7396 bytes) 000977 1788571431.622301 mapwrite 0x01948b thru 0x025b54 (0xc6ca bytes) 000979 1788571431.675702 write 0x03989a thru 0x03af50 (0x16b7 bytes) 000980 1788571431.678027 read 0x0083b9 thru 0x016724 (0xe36c bytes) 000981 1788571431.694307 MIRROR_RESYNC 7 mirrors 000982 1788571433.520314 write 0x02dd0c thru 0x02e703 (0x9f8 bytes) 000984 1788571433.568335 trunc from 0x03f070 to 0x01cafb (0x22574 bytes) 000985 1788571433.599097 mapread 0x016f68 thru 0x01cafb (0x5b94 bytes) 000986 1788571433.628492 read 0x00c3d4 thru 0x01b9ce (0xf5fb bytes) 000987 1788571433.640368 mapread 0x016ca5 thru 0x01b0b3 (0x440f bytes) 000988 1788571433.641874 mapwrite 0x0065d5 thru 0x00f1c1 (0x8bed bytes) 000989 1788571433.669049 trunc from 0x00d0da to 0x01c10a (0xf031 bytes) 000990 1788571433.673611 mapwrite 0x008647 thru 0x0165b7 (0xdf71 bytes) 000991 1788571433.722412 write 0x00ce43 thru 0x0143d8 (0x7596 bytes) 000992 1788571433.724916 read 0x00de42 thru 0x01628f (0x844e bytes) 000993 1788571433.726168 trunc from 0x01cafc to 0x036e87 (0x1a38c bytes) 000994 1788571433.742206 punch from 0x010d6a to 0x0185de (0x7875 bytes) 000995 1788571433.764241 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e88): Mirror 19: 0xd36baa3c (stale) Mirror 22: 0xd36baa3c (stale) Mirror 24: 0xd36baa3c (stale) Mirror 25: 0xd36baa3c (stale) Mirror 26: 0xd36baa3c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e88): Mirror 19: 0xd36baa3c (stale) Mirror 22: 0xd36baa3c (stale) Mirror 24: 0xd36baa3c (stale) Mirror 25: 0xd36baa3c (stale) Mirror 26: 0xd36baa3c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e88: skipped 000996 1788571434.207851 read 0x020e9f thru 0x027764 (0x68c6 bytes) 000997 1788571434.222604 fallocate 0x027b8c thru 0x02ad0b (0x3180 bytes) 000998 1788571434.231402 trunc from 0x004a08 to 0x00fd22 (0xb31b bytes) 000999 1788571434.236290 trunc from 0x036e88 to 0x009550 (0x2d937 bytes) 001000 1788571434.261038 trunc from 0x0004e0 to 0x00738b (0x6eac bytes) All operations completed A-OK!