== sanity-flr test 70a: flr mode fsx test ================ 08:40:36 (1790772036) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 2038 000001 1790772038.263868 write 0x009a64 thru 0x00f3fc (0x5999 bytes) 000002 1790772038.271750 mapread 0x00dc35 thru 0x00f3fc (0x17c8 bytes) 000003 1790772038.273264 punch from 0x0000fe to 0x00c4a9 (0xc3ac bytes) 000004 1790772038.285211 mapread 0x00f3a3 thru 0x00f3fc (0x5a bytes) fallocating to largest ever: 0xbc0a 000006 1790772038.286976 fallocate 0x006097 thru 0x00bc09 (0x5b73 bytes) 000008 1790772038.292654 trunc from 0x003eff to 0x006ef0 (0x2ff2 bytes) 000009 1790772038.300602 MIRROR_EXTEND to 2 mirrors 000010 1790772038.704131 MIRROR_RESYNC 2 mirrors 000011 1790772038.983811 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) fallocating to largest ever: 0x288d5 000012 1790772039.093835 fallocate 0x01b6c3 thru 0x0288d4 (0xd212 bytes) 000013 1790772039.107502 read 0x002957 thru 0x00c784 (0x9e2e bytes) 000015 1790772039.119492 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x33f94 000017 1790772039.666213 fallocate 0x028c9f thru 0x033f93 (0xb2f5 bytes) 000018 1790772039.701446 read 0x014649 thru 0x01fc90 (0xb648 bytes) 000019 1790772039.709801 trunc from 0x007e78 to 0x013bed (0xbd76 bytes) 000020 1790772039.722487 trunc from 0x033f94 to 0x0181fa (0x1bd99 bytes) 000021 1790772039.747427 mapwrite 0x020a8f thru 0x024890 (0x3e02 bytes) 000022 1790772039.822687 mapwrite 0x02f8b3 thru 0x03e25a (0xe9a8 bytes) 000023 1790772039.867458 mapread 0x000c9e thru 0x002492 (0x17f5 bytes) 000024 1790772039.874780 read 0x022b92 thru 0x02ced4 (0xa343 bytes) 000025 1790772039.883521 punch from 0x02364c to 0x02addc (0x7791 bytes) 000026 1790772039.887823 read 0x03dc80 thru 0x03e25a (0x5db bytes) 000027 1790772039.892013 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e25b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e25b): Mirror 2: 0x99befe27 (stale) CRC-32 checksum value for chunk [0, 0x3e25b): Mirror 1: 0x6c424e69 Mirror 3: 0x6c424e69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e25b: skipped 000029 1790772041.020638 read 0x000ba1 thru 0x00e622 (0xda82 bytes) fallocating to largest ever: 0x3a1df 000030 1790772041.032658 fallocate 0x02e095 thru 0x03a1de (0xc14a bytes) 000031 1790772041.075778 read 0x00d57d thru 0x015ec0 (0x8944 bytes) 000032 1790772041.084177 trunc from 0x038358 to 0x03e25a (0x5f03 bytes) 000033 1790772041.089209 trunc from 0x03e25b to 0x01dd4e (0x2050c bytes) 000034 1790772041.108573 read 0x01cb74 thru 0x01dd4e (0x11db bytes) 000036 1790772041.109796 write 0x012dc7 thru 0x01c613 (0x984d bytes) 000037 1790772041.112218 mapwrite 0x036b78 thru 0x03ffff (0x9488 bytes) 000038 1790772041.152748 trunc from 0x040000 to 0x00a4ee (0x35b11 bytes) 000039 1790772041.172255 fallocate 0x00bb2c thru 0x01aae9 (0xefbe bytes) 000040 1790772041.177746 trunc from 0x01aaea to 0x0170af (0x3a3a bytes) 000041 1790772041.193771 mapread 0x012581 thru 0x0170af (0x4b2f bytes) 000043 1790772041.224280 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x170b0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x170b0): Mirror 2: 0x7b91c0e4 (stale) Mirror 3: 0xfc62b1c3 (stale) CRC-32 checksum value for chunk [0, 0x170b0): Mirror 1: 0xfc62b1c3 Mirror 4: 0xfc62b1c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x170b0: skipped 000044 1790772042.252605 write 0x006ab9 thru 0x015d52 (0xf29a bytes) 000045 1790772042.384959 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x170b0): Mirror 3: 0xfc62b1c3 (stale) Mirror 4: 0xfc62b1c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x170b0): Mirror 3: 0xfc62b1c3 (stale) Mirror 4: 0xfc62b1c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x170b0: skipped 000047 1790772042.775400 mapread 0x013a70 thru 0x0170af (0x3640 bytes) 000048 1790772042.796820 mapwrite 0x00f224 thru 0x01a5a8 (0xb385 bytes) truncating to largest ever: 0x3d15c 000049 1790772042.874461 trunc from 0x01a5a9 to 0x03d15b (0x22bb3 bytes) 000050 1790772042.890682 fallocate 0x01043c thru 0x01d598 (0xd15d bytes) 000051 1790772042.896877 mapread 0x000818 thru 0x004e8a (0x4673 bytes) 000052 1790772042.906841 punch from 0x016622 to 0x018822 (0x2201 bytes) 000053 1790772042.912089 trunc from 0x009e08 to 0x01329c (0x9495 bytes) 000054 1790772042.917168 trunc from 0x01257e to 0x01f66f (0xd0f2 bytes) 000055 1790772042.922023 read 0x00edd7 thru 0x017d4a (0x8f74 bytes) 000056 1790772042.933378 trunc from 0x0044eb to 0x0115b4 (0xd0ca bytes) 000057 1790772042.938411 trunc from 0x03d15c to 0x0281f3 (0x14f68 bytes) 000058 1790772042.954840 trunc from 0x018302 to 0x01fb27 (0x7826 bytes) 000060 1790772042.960743 trunc from 0x0097f9 to 0x015eed (0xc6f5 bytes) 000061 1790772042.965654 mapwrite 0x02b253 thru 0x032b27 (0x78d5 bytes) 000062 1790772043.010798 mapread 0x011939 thru 0x014650 (0x2d18 bytes) 000063 1790772043.021994 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32b28): Mirror 3: 0x467dbd36 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32b28): Mirror 3: 0x467dbd36 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32b28: skipped 000064 1790772043.276671 trunc from 0x032b28 to 0x00e3d0 (0x24757 bytes) 000065 1790772043.300507 mapwrite 0x00605a thru 0x0154b7 (0xf45e bytes) 000066 1790772043.392219 mapread 0x012952 thru 0x0154b7 (0x2b66 bytes) 000067 1790772043.393162 punch from 0x010d00 to 0x0146e7 (0x39e8 bytes) 000068 1790772043.403880 write 0x02c556 thru 0x038a64 (0xc50f bytes) 000069 1790772043.410534 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38a65): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a65): Mirror 3: 0xb563bb6 (stale) CRC-32 checksum value for chunk [0, 0x38a65): Mirror 1: 0x7ba549c3 Mirror 4: 0x7ba549c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a65: skipped 000070 1790772044.185984 mapread 0x0326db thru 0x032b3a (0x460 bytes) 000071 1790772044.192457 mapread 0x017c92 thru 0x023c61 (0xbfd0 bytes) 000072 1790772044.217667 write 0x02040c thru 0x0269ff (0x65f4 bytes) 000073 1790772044.287356 fallocate 0x02e9b5 thru 0x035766 (0x6db2 bytes) 000074 1790772044.294099 trunc from 0x034449 to 0x038a64 (0x461c bytes) 000075 1790772044.302185 trunc from 0x038a65 to 0x005b43 (0x32f21 bytes) 000076 1790772044.357815 write 0x02a8dd thru 0x039441 (0xeb65 bytes) 000077 1790772044.366485 MIRROR_RESYNC 3 mirrors 000078 1790772045.096077 trunc from 0x00d78f to 0x018520 (0xad92 bytes) 000079 1790772045.143644 mapwrite 0x022c22 thru 0x02af76 (0x8355 bytes) 000080 1790772045.184432 read 0x038f59 thru 0x039248 (0x2f0 bytes) 000081 1790772045.190695 fallocate 0x01ecb2 thru 0x02749c (0x87eb bytes) 000082 1790772045.198714 punch from 0x023f7e to 0x02d9d6 (0x9a59 bytes) 000083 1790772045.209708 punch from 0x0168bb to 0x01adce (0x4514 bytes) fallocating to largest ever: 0x40000 000084 1790772045.216238 fallocate 0x034076 thru 0x03ffff (0xbf8a bytes) 000085 1790772045.221563 punch from 0x03c15e to 0x03ffff (0x3ea2 bytes) 000086 1790772045.236603 MIRROR_RESYNC 3 mirrors 000087 1790772045.912228 read 0x015a77 thru 0x023354 (0xd8de bytes) 000088 1790772045.928571 read 0x022ed6 thru 0x023831 (0x95c bytes) 000089 1790772045.929028 trunc from 0x01aa2e to 0x01bc17 (0x11ea bytes) 000090 1790772045.987790 mapwrite 0x0320a3 thru 0x03c9ae (0xa90c bytes) 000091 1790772046.025715 write 0x0010fe thru 0x00bd76 (0xac79 bytes) 000092 1790772046.029137 trunc from 0x040000 to 0x001cbf (0x3e340 bytes) 000093 1790772046.076998 trunc from 0x001cc0 to 0x020536 (0x1e877 bytes) 000094 1790772046.094350 write 0x00c632 thru 0x00e535 (0x1f04 bytes) 000095 1790772046.110459 read 0x005548 thru 0x01237e (0xce37 bytes) 000096 1790772046.129209 MIRROR_RESYNC 3 mirrors 000097 1790772046.996459 trunc from 0x01b085 to 0x02026a (0x51e6 bytes) 000098 1790772047.027538 punch from 0x01382d to 0x01e109 (0xa8dd bytes) 000099 1790772047.031581 punch from 0x01c050 to 0x020536 (0x44e7 bytes) 000100 1790772047.035479 punch from 0x01fcd1 to 0x020536 (0x866 bytes) 000101 1790772047.039561 punch from 0x00f4cb to 0x017894 (0x83ca bytes) 000102 1790772047.047362 punch from 0x01acef to 0x020536 (0x5848 bytes) 000103 1790772047.055000 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20537): Mirror 3: 0xc31272c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20537): Mirror 3: 0xc31272c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20537: skipped 000104 1790772047.300716 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) 000105 1790772047.414877 write 0x03f273 thru 0x03ffff (0xd8d bytes) 000106 1790772047.419617 write 0x0292ef thru 0x032d6b (0x9a7d bytes) 000108 1790772047.434447 trunc from 0x040000 to 0x030f7f (0xf080 bytes) 000109 1790772047.466771 trunc from 0x018dc8 to 0x0275a4 (0xe7dd bytes) 000110 1790772047.471280 mapwrite 0x008f22 thru 0x010f53 (0x8032 bytes) 000111 1790772047.506535 mapwrite 0x00007e thru 0x00c6fb (0xc67e bytes) 000112 1790772047.529138 mapread 0x006d97 thru 0x0084ea (0x1754 bytes) 000113 1790772047.529892 trunc from 0x030f80 to 0x001a6e (0x2f511 bytes) 000115 1790772047.549951 fallocate 0x013304 thru 0x014ba1 (0x189e bytes) 000116 1790772047.554733 write 0x030fa4 thru 0x03894d (0x79aa bytes) 000120 1790772047.558792 read 0x031703 thru 0x0328e2 (0x11e0 bytes) 000121 1790772047.568456 fallocate 0x019a9c thru 0x0217ef (0x7d54 bytes) 000123 1790772047.574164 mapread 0x0128ba thru 0x021ecc (0xf613 bytes) 000125 1790772047.589428 trunc from 0x027c19 to 0x034e79 (0xd261 bytes) 000127 1790772047.603114 read 0x008158 thru 0x017831 (0xf6da bytes) 000128 1790772047.611602 write 0x014fee thru 0x01c65a (0x766d bytes) 000129 1790772047.613257 punch from 0x011f8e to 0x01b854 (0x98c7 bytes) 000130 1790772047.625325 write 0x00f92e thru 0x01239c (0x2a6f bytes) 000131 1790772047.633465 mapwrite 0x01152a thru 0x0178d3 (0x63aa bytes) 000132 1790772047.669737 MIRROR_EXTEND to 2 mirrors 000133 1790772048.435818 fallocate 0x02bc74 thru 0x03b5f8 (0xf985 bytes) 000134 1790772048.497544 fallocate 0x0121ce thru 0x01695c (0x478f bytes) 000136 1790772048.507680 mapread 0x023df1 thru 0x02a253 (0x6463 bytes) 000137 1790772048.530960 mapwrite 0x00b84f thru 0x0128aa (0x705c bytes) 000138 1790772048.565571 write 0x03ae0e thru 0x03ffff (0x51f2 bytes) 000139 1790772048.578588 trunc from 0x040000 to 0x024beb (0x1b414 bytes) 000140 1790772048.629644 trunc from 0x024bec to 0x0034fc (0x216ef bytes) 000141 1790772048.653884 trunc from 0x001b64 to 0x0034fc (0x1999 bytes) 000143 1790772048.663792 punch from 0x000c26 to 0x002d71 (0x214c bytes) 000144 1790772048.672306 mapread 0x001240 thru 0x0034fc (0x22bd bytes) 000145 1790772048.677649 trunc from 0x002e44 to 0x0034fc (0x6b9 bytes) 000146 1790772048.681472 read 0x001b88 thru 0x0034fc (0x1975 bytes) 000147 1790772048.686764 mapread 0x0020eb thru 0x0034fc (0x1412 bytes) 000148 1790772048.687714 read 0x001765 thru 0x0034fc (0x1d98 bytes) 000149 1790772048.692365 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) 000150 1790772048.846774 read 0x0020a6 thru 0x0034fc (0x1457 bytes) 000151 1790772048.861155 write 0x009bce thru 0x018c19 (0xf04c bytes) 000152 1790772048.872792 trunc from 0x01658b to 0x018c19 (0x268f bytes) 000153 1790772048.891630 read 0x018a2f thru 0x018c19 (0x1eb bytes) 000155 1790772048.913178 mapread 0x00bcae thru 0x00fdcb (0x411e bytes) 000156 1790772048.914441 read 0x00b73f thru 0x016f44 (0xb806 bytes) 000157 1790772048.915706 mapread 0x00bd95 thru 0x014081 (0x82ed bytes) 000158 1790772048.916665 trunc from 0x016c91 to 0x01743a (0x7aa bytes) 000159 1790772048.923212 trunc from 0x018c1a to 0x009cbb (0xef5e bytes) 000162 1790772048.951813 MIRROR_EXTEND to 2 mirrors 000163 1790772049.624529 trunc from 0x009cbc to 0x033c6c (0x29fb1 bytes) 000164 1790772049.682546 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33c6d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c6d): Mirror 2: 0x189d7030 (stale) CRC-32 checksum value for chunk [0, 0x33c6d): Mirror 1: 0x189d7030 Mirror 3: 0x189d7030 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c6d: skipped 000165 1790772050.470785 punch from 0x0307be to 0x033c6c (0x34af bytes) 000166 1790772050.529817 write 0x00db3e thru 0x01805a (0xa51d bytes) 000167 1790772050.557315 trunc from 0x00718f to 0x00b479 (0x42eb bytes) 000168 1790772050.566257 write 0x01ee2a thru 0x020ef5 (0x20cc bytes) 000170 1790772050.584498 fallocate 0x0387f0 thru 0x03ffff (0x7810 bytes) 000171 1790772050.596442 mapread 0x039a62 thru 0x03ffff (0x659e bytes) 000172 1790772050.644739 fallocate 0x005dbb thru 0x00c81b (0x6a61 bytes) 000173 1790772050.657147 read 0x010644 thru 0x0143b5 (0x3d72 bytes) 000174 1790772050.662891 trunc from 0x040000 to 0x0034b3 (0x3cb4c bytes) 000175 1790772050.704682 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34b4): Mirror 2: 0x5fee28c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b4): Mirror 2: 0x5fee28c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b4: skipped 000176 1790772051.044777 MIRROR_RESYNC 2 mirrors 000177 1790772051.658466 mapread 0x002185 thru 0x0034b3 (0x132f bytes) 000178 1790772051.670508 mapwrite 0x00ba60 thru 0x012063 (0x6604 bytes) 000179 1790772051.741800 fallocate 0x00d1a4 thru 0x01a6aa (0xd507 bytes) 000180 1790772051.748442 mapread 0x011102 thru 0x012063 (0xf62 bytes) 000181 1790772051.749768 fallocate 0x020e3e thru 0x02160f (0x7d2 bytes) 000182 1790772051.755275 trunc from 0x00452d to 0x00d8ae (0x9382 bytes) 000183 1790772051.762261 mapwrite 0x0191f2 thru 0x01e979 (0x5788 bytes) 000184 1790772051.802774 write 0x00f077 thru 0x014b0a (0x5a94 bytes) 000185 1790772051.804694 mapwrite 0x015a85 thru 0x01ab2b (0x50a7 bytes) 000186 1790772051.825601 MIRROR_RESYNC 2 mirrors 000187 1790772052.358507 punch from 0x00b60e to 0x015508 (0x9efb bytes) 000189 1790772052.389453 punch from 0x00fc46 to 0x019f34 (0xa2ef bytes) 000190 1790772052.393963 trunc from 0x01e97a to 0x00a9ff (0x13f7a bytes) 000192 1790772052.415897 write 0x02a439 thru 0x030216 (0x5dde bytes) 000193 1790772052.417834 read 0x016475 thru 0x01e636 (0x81c2 bytes) 000194 1790772052.423822 mapwrite 0x00d4ba thru 0x010c48 (0x378f bytes) 000196 1790772052.456170 trunc from 0x030217 to 0x03556d (0x5357 bytes) 000197 1790772052.472800 write 0x03d51b thru 0x03ffff (0x2ae5 bytes) 000198 1790772052.474297 trunc from 0x040000 to 0x01c863 (0x2379c bytes) 000199 1790772052.487769 read 0x0163ec thru 0x01c601 (0x6216 bytes) 000200 1790772052.488614 read 0x01327f thru 0x01c863 (0x95e5 bytes) 000201 1790772052.489511 trunc from 0x00fd86 to 0x01c863 (0xcade bytes) 000202 1790772052.494591 trunc from 0x0083a0 to 0x00e676 (0x62d7 bytes) 000204 1790772052.499714 trunc from 0x01c864 to 0x03a910 (0x1e0ad bytes) 000205 1790772052.510700 mapwrite 0x006dbc thru 0x0130a5 (0xc2ea bytes) 000206 1790772052.538210 read 0x015a3f thru 0x01bfc5 (0x6587 bytes) 000208 1790772052.539399 trunc from 0x037703 to 0x03a910 (0x320e bytes) 000209 1790772052.543643 read 0x000d30 thru 0x007bf6 (0x6ec7 bytes) 000210 1790772052.544657 punch from 0x037958 to 0x03a910 (0x2fb9 bytes) 000211 1790772052.548554 mapread 0x02f01f thru 0x03a910 (0xb8f2 bytes) 000213 1790772052.555775 trunc from 0x03a911 to 0x0381d0 (0x2740 bytes) 000214 1790772052.570337 mapread 0x03093a thru 0x0314f8 (0xbbf bytes) 000215 1790772052.571313 fallocate 0x032fc7 thru 0x03adc6 (0x7e00 bytes) 000216 1790772052.576417 trunc from 0x001299 to 0x00e1b3 (0xcf1b bytes) 000217 1790772052.580319 punch from 0x016359 to 0x018c4a (0x28f2 bytes) 000218 1790772052.594761 MIRROR_RESYNC 2 mirrors 000221 1790772053.151736 punch from 0x00f066 to 0x014f42 (0x5edd bytes) 000222 1790772053.185509 read 0x007387 thru 0x007879 (0x4f3 bytes) 000223 1790772053.191517 mapwrite 0x008b77 thru 0x01630e (0xd798 bytes) 000224 1790772053.240379 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x381d1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x381d1): Mirror 2: 0xf49c5042 (stale) CRC-32 checksum value for chunk [0, 0x381d1): Mirror 1: 0x116ac65c Mirror 3: 0x116ac65c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x381d1: skipped 000225 1790772053.890316 write 0x00d45e thru 0x01310a (0x5cad bytes) 000226 1790772053.934469 mapwrite 0x03cab7 thru 0x03ffff (0x3549 bytes) 000227 1790772054.004425 mapread 0x00323c thru 0x010ad0 (0xd895 bytes) 000228 1790772054.018524 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb64f1de (stale) Mirror 3: 0x6ac150a6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1b1fdee3 Mirror 4: 0x1b1fdee3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000229 1790772054.768895 punch from 0x00d68f to 0x00fd7a (0x26ec bytes) 000230 1790772054.800714 mapread 0x03d69b thru 0x03ffff (0x2965 bytes) 000231 1790772054.816278 mapread 0x03e680 thru 0x03ffff (0x1980 bytes) 000232 1790772054.817587 write 0x00f58d thru 0x0143e4 (0x4e58 bytes) 000233 1790772054.835220 mapwrite 0x02930d thru 0x02971b (0x40f bytes) 000234 1790772054.860148 mapread 0x000dcf thru 0x00dc03 (0xce35 bytes) 000235 1790772054.868515 fallocate 0x0362be thru 0x03fbb8 (0x98fb bytes) 000236 1790772054.872820 write 0x027db7 thru 0x02e9d1 (0x6c1b bytes) 000237 1790772054.875372 read 0x02ae60 thru 0x02ee20 (0x3fc1 bytes) 000238 1790772054.876342 mapwrite 0x02951a thru 0x033c49 (0xa730 bytes) 000239 1790772054.907295 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb64f1de (stale) Mirror 3: 0x6ac150a6 (stale) Mirror 4: 0x1b1fdee3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1d5dfa6 Mirror 5: 0xc1d5dfa6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000240 1790772055.960522 trunc from 0x040000 to 0x037425 (0x8bda bytes) 000241 1790772056.023731 write 0x03a45f thru 0x03ffff (0x5ba1 bytes) 000242 1790772056.032598 read 0x02031b thru 0x025227 (0x4f0d bytes) 000244 1790772056.051638 punch from 0x0262df to 0x02c734 (0x6456 bytes) 000245 1790772056.056218 write 0x01db72 thru 0x024220 (0x66af bytes) 000246 1790772056.061049 fallocate 0x02c1ec thru 0x0361f4 (0xa009 bytes) 000248 1790772056.066484 mapread 0x0363de thru 0x03ffff (0x9c22 bytes) 000249 1790772056.082793 write 0x013581 thru 0x01d689 (0xa109 bytes) 000250 1790772056.087893 mapread 0x031ec7 thru 0x03f096 (0xd1d0 bytes) 000251 1790772056.088893 fallocate 0x02a7a8 thru 0x0330c4 (0x891d bytes) 000252 1790772056.094259 read 0x0218ec thru 0x028938 (0x704d bytes) 000253 1790772056.106592 MIRROR_RESYNC 5 mirrors 000254 1790772057.588203 trunc from 0x040000 to 0x007fe7 (0x38018 bytes) 000255 1790772057.741130 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x7fe8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7fe8): Mirror 2: 0x83144416 (stale) Mirror 3: 0x83144416 (stale) Mirror 4: 0x83144416 (stale) Mirror 5: 0x83144416 (stale) CRC-32 checksum value for chunk [0, 0x7fe8): Mirror 1: 0x83144416 Mirror 6: 0x83144416 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7fe8: skipped 000256 1790772058.757291 read 0x003652 thru 0x007fe7 (0x4996 bytes) 000257 1790772058.765661 mapwrite 0x0152d7 thru 0x020a7c (0xb7a6 bytes) 000258 1790772058.887283 write 0x03b7a6 thru 0x03ffff (0x485a bytes) 000259 1790772058.888463 trunc from 0x040000 to 0x021047 (0x1efb8 bytes) 000260 1790772058.908390 mapread 0x00a77b thru 0x017022 (0xc8a8 bytes) 000261 1790772058.926945 read 0x018b6a thru 0x021047 (0x84de bytes) 000262 1790772058.946285 trunc from 0x0048c3 to 0x00e30c (0x9a4a bytes) 000263 1790772058.951259 mapwrite 0x03258a thru 0x0341a0 (0x1c17 bytes) 000264 1790772059.003018 mapwrite 0x01062a thru 0x014925 (0x42fc bytes) 000265 1790772059.025416 write 0x003afa thru 0x012091 (0xe598 bytes) 000266 1790772059.028233 fallocate 0x01762a thru 0x0233f3 (0xbdca bytes) 000267 1790772059.033090 punch from 0x0056b3 to 0x006e53 (0x17a1 bytes) 000268 1790772059.049669 write 0x00b78e thru 0x0141d3 (0x8a46 bytes) 000269 1790772059.051866 read 0x015984 thru 0x0173bb (0x1a38 bytes) 000270 1790772059.052727 write 0x00dd77 thru 0x0192b9 (0xb543 bytes) 000271 1790772059.054742 read 0x00a07a thru 0x014fcf (0xaf56 bytes) 000273 1790772059.056574 trunc from 0x02df24 to 0x0341a0 (0x627d bytes) 000274 1790772059.060834 mapread 0x020092 thru 0x02a3d0 (0xa33f bytes) 000275 1790772059.063597 trunc from 0x0341a1 to 0x012ea1 (0x212ff bytes) 000277 1790772059.077710 mapwrite 0x01f10e thru 0x025511 (0x6404 bytes) 000278 1790772059.139699 read 0x0201ee thru 0x025511 (0x5324 bytes) 000279 1790772059.140832 read 0x002cf6 thru 0x010e1d (0xe128 bytes) 000280 1790772059.141722 mapread 0x00465a thru 0x01066b (0xc012 bytes) 000281 1790772059.143843 trunc from 0x007860 to 0x00e19e (0x693f bytes) 000282 1790772059.150749 write 0x018aa9 thru 0x02819e (0xf6f6 bytes) 000283 1790772059.157410 MIRROR_RESYNC 6 mirrors 000284 1790772060.734454 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) 000285 1790772061.204308 trunc from 0x027246 to 0x02819e (0xf59 bytes) 000286 1790772061.292128 mapread 0x027247 thru 0x02819e (0xf58 bytes) 000287 1790772061.308786 mapwrite 0x035ce8 thru 0x0361e9 (0x502 bytes) 000288 1790772061.377564 read 0x00f755 thru 0x01e919 (0xf1c5 bytes) 000289 1790772061.387569 write 0x03fcc1 thru 0x03ffff (0x33f bytes) 000290 1790772061.393047 MIRROR_RESYNC 5 mirrors 000291 1790772063.458947 read 0x022d08 thru 0x0313fe (0xe6f7 bytes) 000292 1790772063.472288 write 0x039930 thru 0x03ffff (0x66d0 bytes) 000293 1790772063.500182 read 0x03feb8 thru 0x03ffff (0x148 bytes) 000294 1790772063.500871 punch from 0x03c610 to 0x03ffff (0x39f0 bytes) 000295 1790772063.513054 write 0x000424 thru 0x006c20 (0x67fd bytes) 000296 1790772063.522427 punch from 0x000082 to 0x005c07 (0x5b86 bytes) 000297 1790772063.536252 trunc from 0x040000 to 0x023f5b (0x1c0a4 bytes) 000298 1790772063.560077 punch from 0x0015d5 to 0x010a2d (0xf459 bytes) 000299 1790772063.565395 fallocate 0x02eae0 thru 0x032613 (0x3b34 bytes) 000300 1790772063.574276 MIRROR_RESYNC 5 mirrors 000301 1790772064.738063 trunc from 0x014480 to 0x01f73c (0xb2bd bytes) 000302 1790772064.780626 trunc from 0x023f5c to 0x002231 (0x21d2a bytes) 000303 1790772064.815699 read 0x001346 thru 0x002231 (0xeec bytes) 000305 1790772064.826405 trunc from 0x0006a5 to 0x002231 (0x1b8d bytes) 000307 1790772064.835443 read 0x000c20 thru 0x002231 (0x1612 bytes) 000308 1790772064.852442 MIRROR_RESYNC 5 mirrors 000309 1790772065.565717 mapread 0x000c2b thru 0x002231 (0x1607 bytes) 000310 1790772065.577606 mapwrite 0x0234e7 thru 0x02dbca (0xa6e4 bytes) 000311 1790772065.701324 fallocate 0x018061 thru 0x022d76 (0xad16 bytes) 000312 1790772065.713292 mapwrite 0x01c709 thru 0x021b39 (0x5431 bytes) 000313 1790772065.770465 write 0x01597e thru 0x01a97a (0x4ffd bytes) 000314 1790772065.782876 write 0x01f085 thru 0x02cedb (0xde57 bytes) 000315 1790772065.784866 trunc from 0x001ef7 to 0x010c53 (0xed5d bytes) 000316 1790772065.792588 punch from 0x028200 to 0x02b325 (0x3126 bytes) 000317 1790772065.819110 mapread 0x01d121 thru 0x029489 (0xc369 bytes) 000319 1790772065.835292 trunc from 0x02dbcb to 0x03eba6 (0x10fdc bytes) 000320 1790772065.884500 trunc from 0x0340e5 to 0x036c1e (0x2b3a bytes) 000321 1790772065.888900 read 0x025a97 thru 0x034802 (0xed6c bytes) 000322 1790772065.897443 fallocate 0x00ca3b thru 0x01a268 (0xd82e bytes) 000323 1790772065.901157 fallocate 0x008882 thru 0x017b30 (0xf2af bytes) 000324 1790772065.905160 read 0x03a570 thru 0x03eba6 (0x4637 bytes) 000325 1790772065.914553 trunc from 0x013007 to 0x014e46 (0x1e40 bytes) 000326 1790772065.921436 MIRROR_RESYNC 5 mirrors 000328 1790772067.011928 write 0x0086a3 thru 0x00e756 (0x60b4 bytes) 000329 1790772067.053383 fallocate 0x005818 thru 0x00ffeb (0xa7d4 bytes) 000331 1790772067.065413 MIRROR_RESYNC 5 mirrors 000332 1790772068.302420 trunc from 0x03eba7 to 0x03b514 (0x3692 bytes) 000333 1790772068.334528 mapwrite 0x013ed7 thru 0x01c46f (0x8599 bytes) 000334 1790772068.370699 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xb11b9f61 (stale) Mirror 3: 0xb11b9f61 (stale) Mirror 4: 0xb11b9f61 (stale) Mirror 6: 0xb11b9f61 (stale) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 1: 0xdd05a99d Mirror 7: 0xdd05a99d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b515: skipped 000335 1790772069.092336 fallocate 0x010004 thru 0x012ee3 (0x2ee0 bytes) 000336 1790772069.132616 read 0x004e12 thru 0x00c2bd (0x74ac bytes) 000337 1790772069.146052 MIRROR_RESYNC 6 mirrors 000338 1790772071.055826 read 0x02b568 thru 0x02ce69 (0x1902 bytes) 000340 1790772071.062347 fallocate 0x02a0cc thru 0x039d92 (0xfcc7 bytes) 000341 1790772071.100060 trunc from 0x02c49a to 0x032470 (0x5fd7 bytes) 000342 1790772071.105406 mapwrite 0x0265bb thru 0x02d5d4 (0x701a bytes) 000343 1790772071.152333 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 4: 0xdd05a99d (stale) Mirror 6: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 4: 0xdd05a99d (stale) Mirror 6: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b515: skipped 000344 1790772071.472828 punch from 0x01b281 to 0x029e7d (0xebfd bytes) 000345 1790772071.484305 punch from 0x01bcb6 to 0x01eb56 (0x2ea1 bytes) 000346 1790772071.488785 trunc from 0x022f8e to 0x02aedf (0x7f52 bytes) 000347 1790772071.493527 punch from 0x00034f to 0x0074c4 (0x7176 bytes) 000348 1790772071.514697 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 4: 0xdd05a99d (stale) Mirror 6: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 1: 0x31833109 Mirror 8: 0x31833109 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b515: skipped 000349 1790772072.572799 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 4: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 4: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 1: 0x31833109 Mirror 8: 0x31833109 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b515: skipped 000350 1790772073.134727 mapread 0x035b92 thru 0x0397a2 (0x3c11 bytes) 000351 1790772073.201276 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b515): Mirror 2: 0xdd05a99d (stale) Mirror 7: 0xdd05a99d (stale) CRC-32 checksum value for chunk [0, 0x3b515): Mirror 1: 0x31833109 Mirror 8: 0x31833109 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b515: skipped 000352 1790772073.803845 read 0x00d5c8 thru 0x0103ab (0x2de4 bytes) 000353 1790772073.809172 write 0x01b58f thru 0x023eb4 (0x8926 bytes) 000354 1790772073.883730 punch from 0x03b402 to 0x03b514 (0x113 bytes) 000355 1790772073.892597 write 0x017069 thru 0x024afe (0xda96 bytes) 000356 1790772073.931846 read 0x02adce thru 0x030eda (0x610d bytes) 000357 1790772073.960018 mapread 0x0147d2 thru 0x0154f7 (0xd26 bytes) 000358 1790772073.963489 mapread 0x01c00b thru 0x02a635 (0xe62b bytes) 000359 1790772073.964527 read 0x0074e5 thru 0x01102f (0x9b4b bytes) 000360 1790772073.965116 trunc from 0x03b515 to 0x00b6fe (0x2fe16 bytes) 000361 1790772074.014133 trunc from 0x008527 to 0x00b6fe (0x31d8 bytes) 000362 1790772074.022601 mapread 0x00048e thru 0x00b6fe (0xb271 bytes) 000363 1790772074.035031 punch from 0x003199 to 0x00b6fe (0x8566 bytes) 000364 1790772074.049232 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xb6ff): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb6ff): Mirror 2: 0x615e523e (stale) Mirror 7: 0x615e523e (stale) Mirror 8: 0x615e523e (stale) CRC-32 checksum value for chunk [0, 0xb6ff): Mirror 1: 0xe09a6213 Mirror 9: 0xe09a6213 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb6ff: skipped 000365 1790772074.898718 write 0x02fd8b thru 0x0319d5 (0x1c4b bytes) 000366 1790772074.939850 mapwrite 0x004dfd thru 0x006bd3 (0x1dd7 bytes) 000367 1790772075.005276 trunc from 0x0319d6 to 0x00bdcc (0x25c09 bytes) 000368 1790772075.045377 trunc from 0x00bdcd to 0x002634 (0x9798 bytes) 000369 1790772075.077318 mapread 0x001cc1 thru 0x001eca (0x20a bytes) 000370 1790772075.087501 MIRROR_RESYNC 5 mirrors 000371 1790772076.025439 punch from 0x001067 to 0x002634 (0x15ce bytes) 000372 1790772076.071184 mapread 0x002421 thru 0x002634 (0x214 bytes) 000373 1790772076.076872 trunc from 0x0007d2 to 0x002634 (0x1e63 bytes) 000374 1790772076.082514 punch from 0x001164 to 0x002634 (0x14d1 bytes) 000375 1790772076.089218 mapread 0x00102f thru 0x002634 (0x1606 bytes) 000376 1790772076.114519 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2635): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2635): Mirror 2: 0xd8c88008 (stale) Mirror 7: 0xd8c88008 (stale) Mirror 8: 0xd8c88008 (stale) Mirror 9: 0xd8c88008 (stale) CRC-32 checksum value for chunk [0, 0x2635): Mirror 1: 0xd8c88008 Mirror 10: 0xd8c88008 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2635: skipped 000377 1790772076.944210 mapread 0x00129e thru 0x002634 (0x1397 bytes) 000379 1790772076.957488 fallocate 0x03ca71 thru 0x03ffff (0x358f bytes) 000380 1790772077.016074 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2635): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2635): Mirror 2: 0xd8c88008 (stale) Mirror 7: 0xd8c88008 (stale) Mirror 8: 0xd8c88008 (stale) Mirror 9: 0xd8c88008 (stale) Mirror 10: 0xd8c88008 (stale) CRC-32 checksum value for chunk [0, 0x2635): Mirror 1: 0xd8c88008 Mirror 11: 0xd8c88008 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2635: skipped 000381 1790772077.982103 mapread 0x002328 thru 0x002634 (0x30d bytes) 000382 1790772078.019518 fallocate 0x02d196 thru 0x0308aa (0x3715 bytes) 000383 1790772078.064379 fallocate 0x009cf0 thru 0x00d07b (0x338c bytes) 000384 1790772078.069066 fallocate 0x022b56 thru 0x032b51 (0xfffc bytes) 000386 1790772078.073879 write 0x03a44c thru 0x03ffff (0x5bb4 bytes) 000387 1790772078.080335 mapread 0x010aa2 thru 0x01c084 (0xb5e3 bytes) 000389 1790772078.107415 trunc from 0x040000 to 0x017474 (0x28b8b bytes) 000390 1790772078.132598 punch from 0x00ade3 to 0x013b29 (0x8d47 bytes) 000391 1790772078.137156 punch from 0x00f670 to 0x010ce8 (0x1679 bytes) 000392 1790772078.144831 trunc from 0x0100e0 to 0x017474 (0x7395 bytes) 000394 1790772078.149707 write 0x02a748 thru 0x02d85e (0x3117 bytes) 000395 1790772078.151534 punch from 0x02aae5 to 0x02c8bf (0x1ddb bytes) 000396 1790772078.160048 fallocate 0x039108 thru 0x03ffff (0x6ef8 bytes) 000397 1790772078.171452 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba85909d (stale) Mirror 7: 0xba85909d (stale) Mirror 8: 0xba85909d (stale) Mirror 9: 0xba85909d (stale) Mirror 10: 0xba85909d (stale) Mirror 11: 0xba85909d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfed4948e Mirror 12: 0xfed4948e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000398 1790772078.865407 trunc from 0x0303e0 to 0x03ffff (0xfc20 bytes) 000399 1790772078.910292 fallocate 0x00b425 thru 0x00b584 (0x160 bytes) 000400 1790772078.916072 punch from 0x0083f6 to 0x016730 (0xe33b bytes) 000401 1790772078.922616 mapread 0x00b2b4 thru 0x00da72 (0x27bf bytes) 000402 1790772078.942520 mapread 0x01dae7 thru 0x02639f (0x88b9 bytes) 000403 1790772078.960435 mapread 0x015084 thru 0x01e925 (0x98a2 bytes) 000404 1790772078.962347 fallocate 0x015cba thru 0x018ee8 (0x322f bytes) 000405 1790772078.968851 punch from 0x000d09 to 0x009803 (0x8afb bytes) 000406 1790772078.974529 write 0x009947 thru 0x010792 (0x6e4c bytes) 000407 1790772078.985312 punch from 0x017584 to 0x022134 (0xabb1 bytes) 000408 1790772078.989855 punch from 0x011ac9 to 0x019dd5 (0x830d bytes) 000409 1790772078.998416 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xba85909d (stale) Mirror 8: 0xba85909d (stale) Mirror 9: 0xba85909d (stale) Mirror 10: 0xba85909d (stale) Mirror 11: 0xba85909d (stale) Mirror 12: 0xfed4948e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xba85909d (stale) Mirror 8: 0xba85909d (stale) Mirror 9: 0xba85909d (stale) Mirror 10: 0xba85909d (stale) Mirror 11: 0xba85909d (stale) Mirror 12: 0xfed4948e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000410 1790772079.366257 trunc from 0x040000 to 0x002a64 (0x3d59b bytes) 000412 1790772079.399804 mapwrite 0x01a32c thru 0x028010 (0xdce5 bytes) 000413 1790772079.482429 mapwrite 0x01979b thru 0x027f6b (0xe7d1 bytes) 000414 1790772079.505336 read 0x023346 thru 0x028010 (0x4ccb bytes) 000415 1790772079.506531 mapread 0x01f39d thru 0x028010 (0x8c74 bytes) 000416 1790772079.507482 fallocate 0x006f93 thru 0x0138d6 (0xc944 bytes) 000417 1790772079.512227 mapread 0x018709 thru 0x02668d (0xdf85 bytes) 000418 1790772079.514229 mapread 0x00ec58 thru 0x0183ce (0x9777 bytes) 000419 1790772079.526610 trunc from 0x028011 to 0x00ac69 (0x1d3a7 bytes) 000421 1790772079.539794 trunc from 0x009352 to 0x00ac69 (0x1918 bytes) 000422 1790772079.544569 trunc from 0x00ac6a to 0x03f0cf (0x34466 bytes) 000423 1790772079.564637 read 0x024de4 thru 0x02b5c3 (0x67e0 bytes) 000424 1790772079.587307 fallocate 0x01b194 thru 0x01beb1 (0xd1e bytes) 000425 1790772079.594306 mapwrite 0x00f731 thru 0x015eeb (0x67bb bytes) 000426 1790772079.615820 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f0d0): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f0d0): Mirror 7: 0xb3addf81 (stale) Mirror 8: 0xb3addf81 (stale) Mirror 9: 0xb3addf81 (stale) Mirror 10: 0xb3addf81 (stale) Mirror 11: 0xb3addf81 (stale) Mirror 12: 0x4636e0b0 (stale) CRC-32 checksum value for chunk [0, 0x3f0d0): Mirror 1: 0x677c3304 Mirror 13: 0x677c3304 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f0d0: skipped 000427 1790772080.488499 trunc from 0x008588 to 0x015b81 (0xd5fa bytes) 000428 1790772080.524277 trunc from 0x03f0d0 to 0x01966b (0x25a64 bytes) 000429 1790772080.572448 trunc from 0x005b41 to 0x00ff49 (0xa409 bytes) 000430 1790772080.575867 fallocate 0x02dcad thru 0x03b587 (0xd8db bytes) 000431 1790772080.580048 fallocate 0x02a945 thru 0x02b4e2 (0xb9e bytes) 000432 1790772080.584038 trunc from 0x03b588 to 0x01171b (0x29e6c bytes) 000433 1790772080.595811 punch from 0x003f6f to 0x00dc5a (0x9cec bytes) 000434 1790772080.600167 write 0x0183a4 thru 0x022e8f (0xaaec bytes) 000435 1790772080.601643 write 0x022113 thru 0x02bdd6 (0x9cc4 bytes) 000436 1790772080.604502 read 0x002bda thru 0x011287 (0xe6ae bytes) 000437 1790772080.612386 trunc from 0x02bdd7 to 0x01f0f4 (0xcce2 bytes) 000438 1790772080.631433 read 0x01824e thru 0x01e6db (0x648e bytes) 000439 1790772080.632245 fallocate 0x014702 thru 0x01efe6 (0xa8e5 bytes) 000440 1790772080.637214 write 0x032a83 thru 0x036356 (0x38d4 bytes) 000441 1790772080.638298 punch from 0x012963 to 0x01fad4 (0xd172 bytes) 000442 1790772080.655641 MIRROR_RESYNC 8 mirrors 000444 1790772082.209284 MIRROR_RESYNC 8 mirrors 000445 1790772082.909769 trunc from 0x026de6 to 0x027c34 (0xe4f bytes) 000446 1790772082.951560 fallocate 0x014530 thru 0x01ceca (0x899b bytes) 000447 1790772082.963487 read 0x021ef0 thru 0x030235 (0xe346 bytes) 000448 1790772082.979063 trunc from 0x036357 to 0x0140b1 (0x222a5 bytes) 000449 1790772083.000002 read 0x00b7c5 thru 0x00f078 (0x38b4 bytes) 000450 1790772083.029246 punch from 0x009337 to 0x0140b1 (0xad7b bytes) 000451 1790772083.034838 read 0x00b280 thru 0x0135b9 (0x833a bytes) 000453 1790772083.042374 mapread 0x00d58e thru 0x010c52 (0x36c5 bytes) 000454 1790772083.043257 trunc from 0x0140b2 to 0x00bc8a (0x8427 bytes) 000455 1790772083.063745 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xbc8b): Mirror 7: 0xa78cfb50 (stale) Mirror 8: 0xa78cfb50 (stale) Mirror 9: 0xa78cfb50 (stale) Mirror 10: 0xa78cfb50 (stale) Mirror 12: 0xa78cfb50 (stale) Mirror 13: 0xa78cfb50 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbc8b): Mirror 7: 0xa78cfb50 (stale) Mirror 8: 0xa78cfb50 (stale) Mirror 9: 0xa78cfb50 (stale) Mirror 10: 0xa78cfb50 (stale) Mirror 12: 0xa78cfb50 (stale) Mirror 13: 0xa78cfb50 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbc8b: skipped 000456 1790772083.395490 write 0x03bf69 thru 0x03f293 (0x332b bytes) 000457 1790772083.400737 read 0x011982 thru 0x012d4f (0x13ce bytes) 000458 1790772083.407469 punch from 0x028724 to 0x028aa2 (0x37f bytes) 000459 1790772083.421062 fallocate 0x033f8b thru 0x03ffff (0xc075 bytes) 000460 1790772083.434438 write 0x00da28 thru 0x019791 (0xbd6a bytes) 000461 1790772083.447788 mapwrite 0x0085e1 thru 0x0129ef (0xa40f bytes) 000462 1790772083.524779 punch from 0x017875 to 0x0244f1 (0xcc7d bytes) 000463 1790772083.529113 mapread 0x03335f thru 0x03ffff (0xcca1 bytes) 000464 1790772083.543980 trunc from 0x040000 to 0x032d2e (0xd2d1 bytes) 000465 1790772083.561062 punch from 0x01ddfb to 0x02a7ee (0xc9f4 bytes) 000466 1790772083.571373 MIRROR_RESYNC 7 mirrors 000467 1790772084.627476 punch from 0x018b2a to 0x02881d (0xfcf4 bytes) 000468 1790772084.657055 mapwrite 0x005920 thru 0x00e2ff (0x89e0 bytes) 000469 1790772084.696029 mapwrite 0x02fb30 thru 0x03d288 (0xd759 bytes) 000470 1790772084.758538 read 0x003f20 thru 0x00c949 (0x8a2a bytes) 000471 1790772084.759163 fallocate 0x00b9d8 thru 0x01a6aa (0xecd3 bytes) 000472 1790772084.764381 write 0x02a538 thru 0x0333ff (0x8ec8 bytes) 000473 1790772084.766519 read 0x02b192 thru 0x032128 (0x6f97 bytes) 000474 1790772084.767139 read 0x03c209 thru 0x03d288 (0x1080 bytes) 000475 1790772084.768193 trunc from 0x03d289 to 0x01a7bd (0x22acb bytes) 000476 1790772084.786358 trunc from 0x0145df to 0x017c02 (0x3624 bytes) 000477 1790772084.791597 mapwrite 0x003cef thru 0x00b750 (0x7a62 bytes) 000478 1790772084.808588 punch from 0x00e813 to 0x01a7bd (0xbfab bytes) 000479 1790772084.819464 fallocate 0x012d73 thru 0x01f424 (0xc6b2 bytes) 000480 1790772084.825467 trunc from 0x012739 to 0x01f424 (0xccec bytes) 000481 1790772084.834878 MIRROR_RESYNC 7 mirrors 000482 1790772086.277672 trunc from 0x01f425 to 0x028c41 (0x981d bytes) 000483 1790772086.326151 trunc from 0x028c42 to 0x016439 (0x12808 bytes) 000484 1790772086.351503 mapread 0x0049cd thru 0x004b8e (0x1c2 bytes) 000485 1790772086.357143 trunc from 0x01643a to 0x022b66 (0xc72d bytes) 000486 1790772086.378440 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x22b67): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22b67): Mirror 7: 0xe33a539f (stale) Mirror 8: 0xe33a539f (stale) Mirror 9: 0xe33a539f (stale) Mirror 10: 0xe33a539f (stale) Mirror 12: 0xe33a539f (stale) Mirror 13: 0xe33a539f (stale) CRC-32 checksum value for chunk [0, 0x22b67): Mirror 1: 0xe33a539f Mirror 14: 0xe33a539f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22b67: skipped 000487 1790772087.141048 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x22b67): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22b67): Mirror 7: 0xe33a539f (stale) Mirror 8: 0xe33a539f (stale) Mirror 9: 0xe33a539f (stale) Mirror 10: 0xe33a539f (stale) Mirror 12: 0xe33a539f (stale) Mirror 13: 0xe33a539f (stale) CRC-32 checksum value for chunk [0, 0x22b67): Mirror 1: 0xe33a539f Mirror 14: 0xe33a539f Mirror 15: 0xe33a539f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22b67: skipped 000489 1790772088.140715 read 0x00af73 thru 0x01ac62 (0xfcf0 bytes) 000491 1790772088.155589 mapread 0x01d600 thru 0x022b66 (0x5567 bytes) 000492 1790772088.176186 read 0x00230e thru 0x010282 (0xdf75 bytes) 000493 1790772088.185195 fallocate 0x01c1da thru 0x01c966 (0x78d bytes) 000494 1790772088.237747 mapread 0x011cf8 thru 0x01ccc0 (0xafc9 bytes) 000495 1790772088.305172 fallocate 0x03186e thru 0x03850a (0x6c9d bytes) 000496 1790772088.310433 trunc from 0x03850b to 0x0086a8 (0x2fe62 bytes) 000497 1790772088.339638 read 0x006778 thru 0x0086a8 (0x1f31 bytes) 000498 1790772088.352573 fallocate 0x01088f thru 0x01f2ac (0xea1e bytes) 000499 1790772088.359533 punch from 0x016180 to 0x019425 (0x32a6 bytes) 000500 1790772088.374836 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1f2ad): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f2ad): Mirror 7: 0x8354eabc (stale) Mirror 8: 0x8354eabc (stale) Mirror 9: 0x8354eabc (stale) Mirror 10: 0x8354eabc (stale) Mirror 12: 0x8354eabc (stale) Mirror 13: 0x8354eabc (stale) Mirror 14: 0x8354eabc (stale) Mirror 15: 0x8354eabc (stale) CRC-32 checksum value for chunk [0, 0x1f2ad): Mirror 1: 0xa6289896 Mirror 16: 0xa6289896 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f2ad: skipped 000502 1790772089.584608 trunc from 0x014460 to 0x01d3f4 (0x8f95 bytes) 000503 1790772089.634253 read 0x016b59 thru 0x01f2ac (0x8754 bytes) 000504 1790772089.642701 write 0x036bb6 thru 0x03ffff (0x944a bytes) 000505 1790772089.647559 mapwrite 0x038228 thru 0x03bd00 (0x3ad9 bytes) 000506 1790772089.661330 punch from 0x007963 to 0x00f823 (0x7ec1 bytes) 000507 1790772089.665557 trunc from 0x00a155 to 0x00ab4d (0x9f9 bytes) 000508 1790772089.669575 trunc from 0x005091 to 0x00fc3e (0xabae bytes) 000510 1790772089.679224 trunc from 0x03f8f1 to 0x03ffff (0x70f bytes) 000512 1790772089.684112 fallocate 0x00b0d7 thru 0x00dfc8 (0x2ef2 bytes) 000513 1790772089.688991 trunc from 0x040000 to 0x02cd9c (0x13263 bytes) 000514 1790772089.735768 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cd9d): Mirror 8: 0xdd27165e (stale) Mirror 9: 0xdd27165e (stale) Mirror 10: 0xdd27165e (stale) Mirror 12: 0xdd27165e (stale) Mirror 13: 0xdd27165e (stale) Mirror 14: 0xdd27165e (stale) Mirror 15: 0xdd27165e (stale) Mirror 16: 0x9e68106a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cd9d): Mirror 8: 0xdd27165e (stale) Mirror 9: 0xdd27165e (stale) Mirror 10: 0xdd27165e (stale) Mirror 12: 0xdd27165e (stale) Mirror 13: 0xdd27165e (stale) Mirror 14: 0xdd27165e (stale) Mirror 15: 0xdd27165e (stale) Mirror 16: 0x9e68106a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cd9d: skipped 000515 1790772090.416095 trunc from 0x022d2e to 0x02cd9c (0xa06f bytes) 000516 1790772090.424270 trunc from 0x02cd9d to 0x003455 (0x29947 bytes) 000517 1790772090.462204 trunc from 0x000e69 to 0x003455 (0x25ed bytes) 000518 1790772090.467430 trunc from 0x003456 to 0x03ebe4 (0x3b78f bytes) 000519 1790772090.484579 punch from 0x003e42 to 0x00c4b3 (0x8672 bytes) 000520 1790772090.490251 punch from 0x000f31 to 0x003a06 (0x2ad6 bytes) 000521 1790772090.498883 read 0x019c4e thru 0x02281b (0x8bce bytes) 000522 1790772090.516460 punch from 0x012897 to 0x01e505 (0xbc6f bytes) 000523 1790772090.521772 punch from 0x0392b9 to 0x03b8a0 (0x25e8 bytes) 000524 1790772090.528368 mapwrite 0x014ab4 thru 0x01c233 (0x7780 bytes) 000525 1790772090.590231 punch from 0x01e916 to 0x024924 (0x600f bytes) 000526 1790772090.599017 fallocate 0x03af0d thru 0x03ffff (0x50f3 bytes) 000527 1790772090.605025 punch from 0x010a1c to 0x0144ee (0x3ad3 bytes) 000528 1790772090.618008 MIRROR_RESYNC 9 mirrors 000529 1790772093.084042 punch from 0x01a210 to 0x024fdd (0xadce bytes) 000530 1790772093.126530 mapwrite 0x0175d6 thru 0x01fa68 (0x8493 bytes) 000531 1790772093.169889 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3ebe5): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebe5): Mirror 8: 0xadfd30d7 (stale) Mirror 9: 0xadfd30d7 (stale) Mirror 10: 0xadfd30d7 (stale) Mirror 12: 0xadfd30d7 (stale) Mirror 13: 0xadfd30d7 (stale) Mirror 14: 0xadfd30d7 (stale) Mirror 15: 0xadfd30d7 (stale) Mirror 16: 0xadfd30d7 (stale) CRC-32 checksum value for chunk [0, 0x3ebe5): Mirror 1: 0x12941ac2 Mirror 17: 0x12941ac2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebe5: skipped 000533 1790772094.513492 mapread 0x01e255 thru 0x023bb1 (0x595d bytes) 000534 1790772094.575312 write 0x02a283 thru 0x02b934 (0x16b2 bytes) 000535 1790772094.687126 mapread 0x01ebbd thru 0x0202e0 (0x1724 bytes) 000536 1790772094.712495 mapread 0x0028d5 thru 0x008e61 (0x658d bytes) 000537 1790772094.740054 trunc from 0x0016b9 to 0x00f9bd (0xe305 bytes) 000538 1790772094.750594 mapwrite 0x029658 thru 0x038b10 (0xf4b9 bytes) 000539 1790772094.798147 write 0x030b31 thru 0x0314ff (0x9cf bytes) 000540 1790772094.799076 write 0x031bf7 thru 0x03f633 (0xda3d bytes) 000542 1790772094.802305 mapread 0x00686e thru 0x00c271 (0x5a04 bytes) 000543 1790772094.829782 fallocate 0x02aac7 thru 0x02bdc7 (0x1301 bytes) 000544 1790772094.842604 read 0x0241d6 thru 0x024239 (0x64 bytes) 000546 1790772094.844200 punch from 0x0324bd to 0x03ab23 (0x8667 bytes) 000547 1790772094.858130 mapwrite 0x013277 thru 0x01a1d9 (0x6f63 bytes) 000549 1790772094.890397 fallocate 0x019fcb thru 0x025ae5 (0xbb1b bytes) 000550 1790772094.895695 fallocate 0x0305a1 thru 0x0340b2 (0x3b12 bytes) 000551 1790772094.901616 mapread 0x01a21b thru 0x01c69b (0x2481 bytes) 000552 1790772094.907989 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f634): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f634): Mirror 8: 0xa5783511 (stale) Mirror 9: 0xa5783511 (stale) Mirror 10: 0xa5783511 (stale) Mirror 12: 0xa5783511 (stale) Mirror 13: 0xa5783511 (stale) Mirror 14: 0xa5783511 (stale) Mirror 15: 0xa5783511 (stale) Mirror 16: 0xa5783511 (stale) Mirror 17: 0x10814886 (stale) CRC-32 checksum value for chunk [0, 0x3f634): Mirror 1: 0x1b9782f Mirror 18: 0x1b9782f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f634: skipped 000553 1790772095.984827 write 0x02c036 thru 0x02fe45 (0x3e10 bytes) 000554 1790772096.055801 write 0x029113 thru 0x030464 (0x7352 bytes) 000555 1790772096.074566 fallocate 0x00655c thru 0x015cde (0xf783 bytes) 000556 1790772096.085128 read 0x015e64 thru 0x01c9ba (0x6b57 bytes) 000557 1790772096.117464 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f634): Mirror 8: 0xa5783511 (stale) Mirror 9: 0xa5783511 (stale) Mirror 10: 0xa5783511 (stale) Mirror 12: 0xa5783511 (stale) Mirror 13: 0xa5783511 (stale) Mirror 14: 0xa5783511 (stale) Mirror 15: 0xa5783511 (stale) Mirror 17: 0x10814886 (stale) Mirror 18: 0x1b9782f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f634): Mirror 8: 0xa5783511 (stale) Mirror 9: 0xa5783511 (stale) Mirror 10: 0xa5783511 (stale) Mirror 12: 0xa5783511 (stale) Mirror 13: 0xa5783511 (stale) Mirror 14: 0xa5783511 (stale) Mirror 15: 0xa5783511 (stale) Mirror 17: 0x10814886 (stale) Mirror 18: 0x1b9782f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f634: skipped 000558 1790772096.643975 trunc from 0x03f634 to 0x017486 (0x281ad bytes) 000559 1790772096.663374 read 0x001769 thru 0x00ae21 (0x96b9 bytes) 000560 1790772096.672100 punch from 0x01361e to 0x017486 (0x3e69 bytes) 000561 1790772096.677178 mapwrite 0x007136 thru 0x016188 (0xf053 bytes) 000562 1790772096.748850 mapwrite 0x03560a thru 0x03e08c (0x8a83 bytes) 000564 1790772096.826474 mapwrite 0x001640 thru 0x002052 (0xa13 bytes) 000565 1790772096.845140 mapwrite 0x004415 thru 0x011a9d (0xd689 bytes) 000566 1790772096.885411 mapwrite 0x03d46c thru 0x03ffff (0x2b94 bytes) 000567 1790772096.942505 mapread 0x029185 thru 0x029d70 (0xbec bytes) 000568 1790772096.958348 mapread 0x00bc5d thru 0x00c2b3 (0x657 bytes) 000569 1790772096.959166 punch from 0x026333 to 0x02d8e5 (0x75b3 bytes) 000570 1790772096.963697 fallocate 0x013337 thru 0x0162b9 (0x2f83 bytes) 000571 1790772096.968484 mapread 0x001476 thru 0x00a27a (0x8e05 bytes) 000572 1790772096.969883 write 0x024bd6 thru 0x030bcd (0xbff8 bytes) 000573 1790772096.984517 MIRROR_RESYNC 10 mirrors 000574 1790772099.680506 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) 000575 1790772100.100651 MIRROR_EXTEND to 10 mirrors 000576 1790772101.091798 trunc from 0x032f31 to 0x0333ec (0x4bc bytes) 000577 1790772101.144648 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x1d4a37a7 (stale) Mirror 9: 0x1d4a37a7 (stale) Mirror 10: 0x1d4a37a7 (stale) Mirror 12: 0x1d4a37a7 (stale) Mirror 13: 0x1d4a37a7 (stale) Mirror 14: 0x1d4a37a7 (stale) Mirror 18: 0x1d4a37a7 (stale) Mirror 19: 0x1d4a37a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x1d4a37a7 (stale) Mirror 9: 0x1d4a37a7 (stale) Mirror 10: 0x1d4a37a7 (stale) Mirror 12: 0x1d4a37a7 (stale) Mirror 13: 0x1d4a37a7 (stale) Mirror 14: 0x1d4a37a7 (stale) Mirror 18: 0x1d4a37a7 (stale) Mirror 19: 0x1d4a37a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000578 1790772101.675130 write 0x00f57a thru 0x015814 (0x629b bytes) 000579 1790772101.686745 mapwrite 0x028e39 thru 0x038bdd (0xfda5 bytes) 000580 1790772101.741338 MIRROR_RESYNC 9 mirrors 000581 1790772103.677125 read 0x00760f thru 0x008036 (0xa28 bytes) 000582 1790772103.686425 trunc from 0x019125 to 0x024097 (0xaf73 bytes) 000583 1790772103.753723 write 0x00a009 thru 0x015188 (0xb180 bytes) 000584 1790772103.767931 mapwrite 0x019f5e thru 0x0269d1 (0xca74 bytes) 000585 1790772103.840500 punch from 0x012f3f to 0x0131da (0x29c bytes) 000586 1790772103.851538 trunc from 0x040000 to 0x02f879 (0x10786 bytes) 000587 1790772103.872712 write 0x03af73 thru 0x03ffff (0x508d bytes) 000588 1790772103.874019 write 0x03e08c thru 0x03ffff (0x1f74 bytes) 000589 1790772103.875661 trunc from 0x03ad79 to 0x03ffff (0x5287 bytes) 000590 1790772103.887099 read 0x02b8bf thru 0x039d57 (0xe499 bytes) 000592 1790772103.901531 write 0x00022e thru 0x00c7f7 (0xc5ca bytes) 000593 1790772103.903093 read 0x016603 thru 0x016d06 (0x704 bytes) 000594 1790772103.904310 fallocate 0x0236e3 thru 0x023708 (0x26 bytes) 000595 1790772103.911649 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xb65e7d0 (stale) Mirror 9: 0xb65e7d0 (stale) Mirror 10: 0xb65e7d0 (stale) Mirror 12: 0xb65e7d0 (stale) Mirror 13: 0xb65e7d0 (stale) Mirror 14: 0xb65e7d0 (stale) Mirror 18: 0xb65e7d0 (stale) Mirror 19: 0xb65e7d0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x10011618 Mirror 20: 0x10011618 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000596 1790772105.045944 trunc from 0x040000 to 0x00f96e (0x30691 bytes) 000597 1790772105.091801 mapwrite 0x03754d thru 0x0380bf (0xb73 bytes) 000599 1790772105.147211 write 0x00729b thru 0x00da08 (0x676e bytes) 000600 1790772105.162021 punch from 0x033bad to 0x035d88 (0x21dc bytes) 000602 1790772105.168055 mapwrite 0x027984 thru 0x034843 (0xcec0 bytes) 000603 1790772105.212351 mapwrite 0x028430 thru 0x02940e (0xfdf bytes) 000604 1790772105.227070 read 0x015386 thru 0x0174ae (0x2129 bytes) 000605 1790772105.232785 mapread 0x032db9 thru 0x0380bf (0x5307 bytes) 000606 1790772105.240389 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x380c0): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380c0): Mirror 8: 0xa06bde77 (stale) Mirror 9: 0xa06bde77 (stale) Mirror 10: 0xa06bde77 (stale) Mirror 12: 0xa06bde77 (stale) Mirror 13: 0xa06bde77 (stale) Mirror 14: 0xa06bde77 (stale) Mirror 18: 0xa06bde77 (stale) Mirror 19: 0xa06bde77 (stale) Mirror 20: 0xb135660c (stale) CRC-32 checksum value for chunk [0, 0x380c0): Mirror 1: 0xe97ca7e Mirror 21: 0xe97ca7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380c0: skipped 000607 1790772106.088453 trunc from 0x0380c0 to 0x023573 (0x14b4c bytes) 000608 1790772106.158051 MIRROR_RESYNC 11 mirrors 000609 1790772107.885816 trunc from 0x023574 to 0x03f70b (0x1c198 bytes) 000610 1790772107.953861 mapread 0x02fed0 thru 0x03dbe8 (0xdd19 bytes) 000611 1790772108.022835 mapwrite 0x014678 thru 0x015fb8 (0x1941 bytes) 000612 1790772108.043505 trunc from 0x0298d3 to 0x037b67 (0xe295 bytes) 000613 1790772108.048045 fallocate 0x023528 thru 0x023634 (0x10d bytes) 000614 1790772108.055344 mapwrite 0x01f2a4 thru 0x025328 (0x6085 bytes) 000615 1790772108.081365 write 0x0292be thru 0x02deaf (0x4bf2 bytes) 000616 1790772108.088663 punch from 0x03c320 to 0x03f70b (0x33ec bytes) 000617 1790772108.095381 MIRROR_RESYNC 11 mirrors 000618 1790772111.194453 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) 000619 1790772111.643729 trunc from 0x03b823 to 0x03b9cd (0x1ab bytes) 000620 1790772111.682796 trunc from 0x01a4dd to 0x022e9c (0x89c0 bytes) 000621 1790772111.690430 fallocate 0x03c2d9 thru 0x03ffff (0x3d27 bytes) 000622 1790772111.694935 mapread 0x03ed17 thru 0x03ef68 (0x252 bytes) 000623 1790772111.700222 punch from 0x02351d to 0x02c9d9 (0x94bd bytes) 000624 1790772111.707307 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f70c): Mirror 8: 0x53f4e063 (stale) Mirror 9: 0x53f4e063 (stale) Mirror 10: 0x53f4e063 (stale) Mirror 12: 0x53f4e063 (stale) Mirror 13: 0x53f4e063 (stale) Mirror 14: 0x53f4e063 (stale) Mirror 18: 0x53f4e063 (stale) Mirror 21: 0x53f4e063 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f70c): Mirror 8: 0x53f4e063 (stale) Mirror 9: 0x53f4e063 (stale) Mirror 10: 0x53f4e063 (stale) Mirror 12: 0x53f4e063 (stale) Mirror 13: 0x53f4e063 (stale) Mirror 14: 0x53f4e063 (stale) Mirror 18: 0x53f4e063 (stale) Mirror 21: 0x53f4e063 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f70c: skipped 000625 1790772112.525760 trunc from 0x009a0a to 0x00fb7f (0x6176 bytes) 000626 1790772112.537361 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f70c): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f70c): Mirror 8: 0x53f4e063 (stale) Mirror 9: 0x53f4e063 (stale) Mirror 10: 0x53f4e063 (stale) Mirror 12: 0x53f4e063 (stale) Mirror 13: 0x53f4e063 (stale) Mirror 14: 0x53f4e063 (stale) Mirror 18: 0x53f4e063 (stale) Mirror 21: 0x53f4e063 (stale) CRC-32 checksum value for chunk [0, 0x3f70c): Mirror 1: 0x9612ac66 Mirror 22: 0x9612ac66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f70c: skipped 000627 1790772114.027337 read 0x0155d6 thru 0x01dd44 (0x876f bytes) 000628 1790772114.065760 trunc from 0x03bd43 to 0x03f70b (0x39c9 bytes) 000629 1790772114.188523 punch from 0x03001a to 0x03f70b (0xf6f2 bytes) 000630 1790772114.195669 punch from 0x031746 to 0x0363dd (0x4c98 bytes) 000631 1790772114.202270 trunc from 0x03f70c to 0x025534 (0x1a1d7 bytes) 000632 1790772114.248986 trunc from 0x025535 to 0x028842 (0x330e bytes) 000633 1790772114.277791 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28843): Mirror 8: 0x139e9342 (stale) Mirror 10: 0x139e9342 (stale) Mirror 12: 0x139e9342 (stale) Mirror 13: 0x139e9342 (stale) Mirror 14: 0x139e9342 (stale) Mirror 18: 0x139e9342 (stale) Mirror 21: 0x139e9342 (stale) Mirror 22: 0x5a93f06e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28843): Mirror 8: 0x139e9342 (stale) Mirror 10: 0x139e9342 (stale) Mirror 12: 0x139e9342 (stale) Mirror 13: 0x139e9342 (stale) Mirror 14: 0x139e9342 (stale) Mirror 18: 0x139e9342 (stale) Mirror 21: 0x139e9342 (stale) Mirror 22: 0x5a93f06e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28843: skipped 000635 1790772114.883398 trunc from 0x0057be to 0x015611 (0xfe54 bytes) 000636 1790772114.889837 punch from 0x01486a to 0x015a1c (0x11b3 bytes) 000637 1790772114.896405 fallocate 0x03b06a thru 0x03ffff (0x4f96 bytes) 000638 1790772114.901461 mapread 0x00ddd1 thru 0x017c73 (0x9ea3 bytes) 000639 1790772114.930465 write 0x022325 thru 0x02a794 (0x8470 bytes) 000640 1790772114.942857 fallocate 0x003903 thru 0x00f4ea (0xbbe8 bytes) 000641 1790772114.948426 trunc from 0x00f7b3 to 0x0157be (0x600c bytes) 000642 1790772114.954393 fallocate 0x0379f5 thru 0x037ef4 (0x500 bytes) 000643 1790772114.960297 read 0x019c09 thru 0x025fdf (0xc3d7 bytes) 000645 1790772114.970884 trunc from 0x021955 to 0x02a794 (0x8e40 bytes) 000646 1790772114.990414 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a795): Mirror 10: 0xce6b801c (stale) Mirror 12: 0xce6b801c (stale) Mirror 13: 0xce6b801c (stale) Mirror 14: 0xce6b801c (stale) Mirror 18: 0xce6b801c (stale) Mirror 21: 0xce6b801c (stale) Mirror 22: 0xc0807e54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a795): Mirror 10: 0xce6b801c (stale) Mirror 12: 0xce6b801c (stale) Mirror 13: 0xce6b801c (stale) Mirror 14: 0xce6b801c (stale) Mirror 18: 0xce6b801c (stale) Mirror 21: 0xce6b801c (stale) Mirror 22: 0xc0807e54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a795: skipped 000647 1790772115.707016 mapread 0x019d0c thru 0x01b1a2 (0x1497 bytes) 000648 1790772115.738409 punch from 0x0026ac to 0x007cc1 (0x5616 bytes) 000649 1790772115.754641 MIRROR_RESYNC 8 mirrors 000650 1790772117.889782 read 0x006f9c thru 0x00d1e4 (0x6249 bytes) 000651 1790772117.900354 mapread 0x029a67 thru 0x02a794 (0xd2e bytes) 000652 1790772117.910643 fallocate 0x00c91d thru 0x01a732 (0xde16 bytes) 000653 1790772117.970967 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2a795): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a795): Mirror 10: 0xb68b83e8 (stale) Mirror 12: 0xb68b83e8 (stale) Mirror 13: 0xb68b83e8 (stale) Mirror 14: 0xb68b83e8 (stale) Mirror 18: 0xb68b83e8 (stale) Mirror 21: 0xb68b83e8 (stale) Mirror 22: 0xb68b83e8 (stale) CRC-32 checksum value for chunk [0, 0x2a795): Mirror 1: 0xb68b83e8 Mirror 23: 0xb68b83e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a795: skipped 000654 1790772119.319325 trunc from 0x01a2ee to 0x028870 (0xe583 bytes) 000655 1790772119.408638 read 0x00c1c0 thru 0x010665 (0x44a6 bytes) 000656 1790772119.434203 mapwrite 0x020b83 thru 0x02cd39 (0xc1b7 bytes) 000659 1790772119.519944 write 0x0331cd thru 0x03a216 (0x704a bytes) 000660 1790772119.527544 MIRROR_RESYNC 9 mirrors 000661 1790772121.798199 punch from 0x00397f to 0x0127f5 (0xee77 bytes) 000662 1790772121.851795 MIRROR_RESYNC 9 mirrors 000663 1790772123.945826 fallocate 0x033452 thru 0x0349c3 (0x1572 bytes) 000664 1790772124.032727 trunc from 0x0078d7 to 0x013375 (0xba9f bytes) 000665 1790772124.042315 write 0x00320b thru 0x00a710 (0x7506 bytes) 000666 1790772124.054512 fallocate 0x00912f thru 0x00beb8 (0x2d8a bytes) 000667 1790772124.059836 mapread 0x015748 thru 0x01f44e (0x9d07 bytes) 000668 1790772124.079509 read 0x038dcc thru 0x03a216 (0x144b bytes) 000669 1790772124.085481 punch from 0x02b027 to 0x0398a0 (0xe87a bytes) 000670 1790772124.096458 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a217): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a217): Mirror 10: 0xb879d642 (stale) Mirror 12: 0xb879d642 (stale) Mirror 13: 0xb879d642 (stale) Mirror 14: 0xb879d642 (stale) Mirror 18: 0xb879d642 (stale) Mirror 21: 0xb879d642 (stale) Mirror 22: 0xb879d642 (stale) Mirror 23: 0xb879d642 (stale) CRC-32 checksum value for chunk [0, 0x3a217): Mirror 1: 0xab5d8101 Mirror 24: 0xab5d8101 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a217: skipped 000671 1790772125.062718 mapwrite 0x00e26e thru 0x0172cf (0x9062 bytes) 000672 1790772125.223444 trunc from 0x03a217 to 0x020c34 (0x195e2 bytes) 000673 1790772125.302053 mapread 0x00a48e thru 0x00ebbb (0x472e bytes) 000674 1790772125.306813 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20c35): Mirror 12: 0xc16d833c (stale) Mirror 13: 0xc16d833c (stale) Mirror 14: 0xc16d833c (stale) Mirror 18: 0xc16d833c (stale) Mirror 21: 0xc16d833c (stale) Mirror 22: 0xc16d833c (stale) Mirror 23: 0xc16d833c (stale) Mirror 24: 0xbc4d162b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20c35): Mirror 12: 0xc16d833c (stale) Mirror 13: 0xc16d833c (stale) Mirror 14: 0xc16d833c (stale) Mirror 18: 0xc16d833c (stale) Mirror 21: 0xc16d833c (stale) Mirror 22: 0xc16d833c (stale) Mirror 23: 0xc16d833c (stale) Mirror 24: 0xbc4d162b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20c35: skipped 000675 1790772125.734158 MIRROR_RESYNC 9 mirrors 000676 1790772127.470185 trunc from 0x013e45 to 0x01c7cf (0x898b bytes) 000677 1790772127.512170 mapread 0x01f229 thru 0x020c34 (0x1a0c bytes) 000678 1790772127.524507 write 0x02d3af thru 0x03b907 (0xe559 bytes) 000679 1790772127.527087 punch from 0x02ae40 to 0x02afbd (0x17e bytes) 000681 1790772127.540513 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b908): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b908): Mirror 12: 0xe8f8dea3 (stale) Mirror 13: 0xe8f8dea3 (stale) Mirror 14: 0xe8f8dea3 (stale) Mirror 18: 0xe8f8dea3 (stale) Mirror 21: 0xe8f8dea3 (stale) Mirror 22: 0xe8f8dea3 (stale) Mirror 23: 0xe8f8dea3 (stale) Mirror 24: 0xe8f8dea3 (stale) CRC-32 checksum value for chunk [0, 0x3b908): Mirror 1: 0xdc643c1d Mirror 25: 0xdc643c1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b908: skipped 000682 1790772128.472565 fallocate 0x037583 thru 0x037a39 (0x4b7 bytes) 000683 1790772128.507827 mapwrite 0x024878 thru 0x0259df (0x1168 bytes) 000684 1790772128.526569 trunc from 0x01bd05 to 0x01f1c9 (0x34c5 bytes) 000685 1790772128.532120 mapread 0x00625c thru 0x006fdc (0xd81 bytes) 000686 1790772128.548487 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b908): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b908): Mirror 12: 0xe8f8dea3 (stale) Mirror 13: 0xe8f8dea3 (stale) Mirror 14: 0xe8f8dea3 (stale) Mirror 18: 0xe8f8dea3 (stale) Mirror 21: 0xe8f8dea3 (stale) Mirror 22: 0xe8f8dea3 (stale) Mirror 23: 0xe8f8dea3 (stale) Mirror 24: 0xe8f8dea3 (stale) Mirror 25: 0xdc643c1d (stale) CRC-32 checksum value for chunk [0, 0x3b908): Mirror 1: 0x914d7d17 Mirror 26: 0x914d7d17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b908: skipped 000687 1790772129.705534 fallocate 0x01cacc thru 0x02359f (0x6ad4 bytes) 000688 1790772129.763811 read 0x00ae67 thru 0x00edd8 (0x3f72 bytes) 000689 1790772129.780504 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b908): Mirror 13: 0xe8f8dea3 (stale) Mirror 14: 0xe8f8dea3 (stale) Mirror 18: 0xe8f8dea3 (stale) Mirror 21: 0xe8f8dea3 (stale) Mirror 22: 0xe8f8dea3 (stale) Mirror 23: 0xe8f8dea3 (stale) Mirror 24: 0xe8f8dea3 (stale) Mirror 25: 0xdc643c1d (stale) Mirror 26: 0x914d7d17 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b908): Mirror 13: 0xe8f8dea3 (stale) Mirror 14: 0xe8f8dea3 (stale) Mirror 18: 0xe8f8dea3 (stale) Mirror 21: 0xe8f8dea3 (stale) Mirror 22: 0xe8f8dea3 (stale) Mirror 23: 0xe8f8dea3 (stale) Mirror 24: 0xe8f8dea3 (stale) Mirror 25: 0xdc643c1d (stale) Mirror 26: 0x914d7d17 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b908: skipped 000690 1790772130.421154 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b908): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b908): Mirror 13: 0xe8f8dea3 (stale) Mirror 14: 0xe8f8dea3 (stale) Mirror 18: 0xe8f8dea3 (stale) Mirror 21: 0xe8f8dea3 (stale) Mirror 22: 0xe8f8dea3 (stale) Mirror 23: 0xe8f8dea3 (stale) Mirror 24: 0xe8f8dea3 (stale) Mirror 25: 0xdc643c1d (stale) Mirror 26: 0x914d7d17 (stale) CRC-32 checksum value for chunk [0, 0x3b908): Mirror 1: 0x914d7d17 Mirror 27: 0x914d7d17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b908: skipped 000691 1790772131.493989 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3b908): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b908): Mirror 13: 0xe8f8dea3 (stale) Mirror 14: 0xe8f8dea3 (stale) Mirror 18: 0xe8f8dea3 (stale) Mirror 21: 0xe8f8dea3 (stale) Mirror 22: 0xe8f8dea3 (stale) Mirror 23: 0xe8f8dea3 (stale) Mirror 24: 0xe8f8dea3 (stale) Mirror 25: 0xdc643c1d (stale) Mirror 26: 0x914d7d17 (stale) CRC-32 checksum value for chunk [0, 0x3b908): Mirror 1: 0x914d7d17 Mirror 27: 0x914d7d17 Mirror 28: 0x914d7d17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b908: skipped 000692 1790772132.621026 write 0x021886 thru 0x02aa58 (0x91d3 bytes) 000693 1790772132.720478 fallocate 0x0036e7 thru 0x005b72 (0x248c bytes) 000694 1790772132.729458 fallocate 0x03d1b1 thru 0x03ffff (0x2e4f bytes) 000695 1790772132.745317 mapread 0x01ae5f thru 0x020ab0 (0x5c52 bytes) 000696 1790772132.800118 mapread 0x025f0c thru 0x0350a3 (0xf198 bytes) 000697 1790772132.826786 trunc from 0x040000 to 0x00f298 (0x30d67 bytes) 000698 1790772132.858389 punch from 0x00ebd2 to 0x00f298 (0x6c7 bytes) 000699 1790772132.872064 trunc from 0x00f299 to 0x03ba5b (0x2c7c3 bytes) 000700 1790772132.898602 trunc from 0x016934 to 0x01c356 (0x5a23 bytes) 000701 1790772132.903435 mapread 0x021d31 thru 0x025fbf (0x428f bytes) 000702 1790772132.919311 trunc from 0x00fb71 to 0x016e3f (0x72cf bytes) 000703 1790772132.934853 MIRROR_RESYNC 12 mirrors 000704 1790772135.189124 MIRROR_RESYNC 12 mirrors 000705 1790772135.757621 write 0x003cf9 thru 0x010a5f (0xcd67 bytes) 000706 1790772135.800786 write 0x010206 thru 0x017307 (0x7102 bytes) 000707 1790772135.809053 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3ba5c): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba5c): Mirror 13: 0xdfb4bb66 (stale) Mirror 14: 0xdfb4bb66 (stale) Mirror 18: 0xdfb4bb66 (stale) Mirror 21: 0xdfb4bb66 (stale) Mirror 22: 0xdfb4bb66 (stale) Mirror 23: 0xdfb4bb66 (stale) Mirror 24: 0xdfb4bb66 (stale) Mirror 25: 0xdfb4bb66 (stale) Mirror 26: 0xdfb4bb66 (stale) Mirror 27: 0xdfb4bb66 (stale) Mirror 28: 0xdfb4bb66 (stale) CRC-32 checksum value for chunk [0, 0x3ba5c): Mirror 1: 0xfa046856 Mirror 29: 0xfa046856 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba5c: skipped 000708 1790772136.936010 fallocate 0x01d139 thru 0x02b60e (0xe4d6 bytes) 000709 1790772136.968006 mapwrite 0x03e180 thru 0x03ffff (0x1e80 bytes) 000710 1790772137.012037 mapread 0x021a40 thru 0x02d216 (0xb7d7 bytes) 000711 1790772137.028541 write 0x0398dd thru 0x03ffff (0x6723 bytes) 000712 1790772137.033971 trunc from 0x040000 to 0x0326e9 (0xd916 bytes) 000713 1790772137.050972 trunc from 0x0326ea to 0x03f36a (0xcc81 bytes) 000714 1790772137.074226 mapwrite 0x03c1f4 thru 0x03ffff (0x3e0c bytes) 000715 1790772137.111949 write 0x0260c6 thru 0x0263c1 (0x2fc bytes) 000716 1790772137.113160 fallocate 0x01b4da thru 0x01ded3 (0x29fa bytes) 000717 1790772137.117758 trunc from 0x040000 to 0x03a6ae (0x5951 bytes) 000719 1790772137.131277 punch from 0x0173e9 to 0x01bc20 (0x4838 bytes) 000721 1790772137.138114 read 0x02247d thru 0x03130e (0xee92 bytes) 000722 1790772137.138817 read 0x0265f9 thru 0x02a4d2 (0x3eda bytes) 000723 1790772137.139792 fallocate 0x00cd62 thru 0x01b1b5 (0xe454 bytes) 000724 1790772137.144173 read 0x00363e thru 0x008e6c (0x582f bytes) 000727 1790772137.154524 write 0x01c88c thru 0x02228f (0x5a04 bytes) 000728 1790772137.155801 trunc from 0x03a6af to 0x01768d (0x23021 bytes) 000729 1790772137.168980 punch from 0x00c825 to 0x016bb6 (0xa392 bytes) 000730 1790772137.173282 trunc from 0x008afd to 0x017353 (0xe857 bytes) 000731 1790772137.178320 trunc from 0x002692 to 0x012675 (0xffe4 bytes) 000732 1790772137.182222 trunc from 0x0137f1 to 0x01768d (0x3e9d bytes) 000733 1790772137.187100 trunc from 0x01768e to 0x00478e (0x12eff bytes) 000734 1790772137.198848 mapread 0x003f19 thru 0x00478e (0x876 bytes) 000735 1790772137.212118 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x478f): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x478f): Mirror 13: 0x4206e38f (stale) Mirror 14: 0x4206e38f (stale) Mirror 18: 0x4206e38f (stale) Mirror 21: 0x4206e38f (stale) Mirror 22: 0x4206e38f (stale) Mirror 23: 0x4206e38f (stale) Mirror 24: 0x4206e38f (stale) Mirror 25: 0x4206e38f (stale) Mirror 26: 0x4206e38f (stale) Mirror 27: 0x4206e38f (stale) Mirror 28: 0x4206e38f (stale) Mirror 29: 0x6c0276d (stale) CRC-32 checksum value for chunk [0, 0x478f): Mirror 1: 0x98d7009c Mirror 30: 0x98d7009c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x478f: skipped 000736 1790772138.042074 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x478f): Mirror 13: 0x4206e38f (stale) Mirror 14: 0x4206e38f (stale) Mirror 18: 0x4206e38f (stale) Mirror 21: 0x4206e38f (stale) Mirror 23: 0x4206e38f (stale) Mirror 24: 0x4206e38f (stale) Mirror 25: 0x4206e38f (stale) Mirror 26: 0x4206e38f (stale) Mirror 27: 0x4206e38f (stale) Mirror 28: 0x4206e38f (stale) Mirror 29: 0x6c0276d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x478f): Mirror 13: 0x4206e38f (stale) Mirror 14: 0x4206e38f (stale) Mirror 18: 0x4206e38f (stale) Mirror 21: 0x4206e38f (stale) Mirror 23: 0x4206e38f (stale) Mirror 24: 0x4206e38f (stale) Mirror 25: 0x4206e38f (stale) Mirror 26: 0x4206e38f (stale) Mirror 27: 0x4206e38f (stale) Mirror 28: 0x4206e38f (stale) Mirror 29: 0x6c0276d (stale) CRC-32 checksum value for chunk [0, 0x478f): Mirror 1: 0x98d7009c Mirror 30: 0x98d7009c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x478f: skipped 000737 1790772138.904240 punch from 0x003ce6 to 0x00478e (0xaa9 bytes) 000738 1790772139.007762 fallocate 0x005c7a thru 0x0112e0 (0xb667 bytes) 000739 1790772139.025120 fallocate 0x03e765 thru 0x03fe4b (0x16e7 bytes) 000740 1790772139.038171 punch from 0x030da3 to 0x03f652 (0xe8b0 bytes) 000741 1790772139.043036 trunc from 0x032da6 to 0x035e73 (0x30ce bytes) 000742 1790772139.048084 fallocate 0x02b4b1 thru 0x0332ee (0x7e3e bytes) 000743 1790772139.054867 read 0x02da92 thru 0x033381 (0x58f0 bytes) 000745 1790772139.071138 fallocate 0x01dd66 thru 0x02bdf0 (0xe08b bytes) 000746 1790772139.077984 punch from 0x02f16b to 0x03e4a7 (0xf33d bytes) 000747 1790772139.084951 fallocate 0x03bce8 thru 0x03c41d (0x736 bytes) 000749 1790772139.096110 mapread 0x032447 thru 0x034e0f (0x29c9 bytes) 000750 1790772139.114953 mapwrite 0x01b60d thru 0x024f62 (0x9956 bytes) 000751 1790772139.150165 write 0x032e23 thru 0x035a4d (0x2c2b bytes) 000752 1790772139.156671 write 0x020984 thru 0x0299c3 (0x9040 bytes) 000753 1790772139.164325 MIRROR_RESYNC 13 mirrors 000754 1790772142.080709 fallocate 0x034b84 thru 0x03ffff (0xb47c bytes) 000755 1790772142.134306 write 0x011bad thru 0x01d3e6 (0xb83a bytes) 000756 1790772142.143651 trunc from 0x040000 to 0x01ce52 (0x231ad bytes) 000757 1790772142.165785 trunc from 0x00f431 to 0x01c4c0 (0xd090 bytes) 000758 1790772142.187616 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ce53): Mirror 13: 0x596aef6b (stale) Mirror 14: 0x596aef6b (stale) Mirror 18: 0x596aef6b (stale) Mirror 21: 0x596aef6b (stale) Mirror 23: 0x596aef6b (stale) Mirror 25: 0x596aef6b (stale) Mirror 26: 0x596aef6b (stale) Mirror 27: 0x596aef6b (stale) Mirror 28: 0x596aef6b (stale) Mirror 29: 0x596aef6b (stale) Mirror 30: 0x596aef6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce53): Mirror 13: 0x596aef6b (stale) Mirror 14: 0x596aef6b (stale) Mirror 18: 0x596aef6b (stale) Mirror 21: 0x596aef6b (stale) Mirror 23: 0x596aef6b (stale) Mirror 25: 0x596aef6b (stale) Mirror 26: 0x596aef6b (stale) Mirror 27: 0x596aef6b (stale) Mirror 28: 0x596aef6b (stale) Mirror 29: 0x596aef6b (stale) Mirror 30: 0x596aef6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce53: skipped 000759 1790772142.731229 MIRROR_RESYNC 12 mirrors 000760 1790772144.427597 mapread 0x00506e thru 0x00e0db (0x906e bytes) 000763 1790772144.447481 write 0x00ea25 thru 0x016c9f (0x827b bytes) 000764 1790772144.495617 mapwrite 0x00bc79 thru 0x018cb8 (0xd040 bytes) 000765 1790772144.537653 read 0x015004 thru 0x01ce52 (0x7e4f bytes) 000766 1790772144.538405 trunc from 0x008f10 to 0x013693 (0xa784 bytes) 000767 1790772144.545875 punch from 0x002178 to 0x009202 (0x708b bytes) 000769 1790772144.561640 MIRROR_RESYNC 12 mirrors 000770 1790772146.946591 write 0x00081d thru 0x00a7a5 (0x9f89 bytes) 000771 1790772147.040737 write 0x00441c thru 0x00cd0e (0x88f3 bytes) 000772 1790772147.057275 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1ce53): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce53): Mirror 13: 0xee6aed98 (stale) Mirror 14: 0xee6aed98 (stale) Mirror 18: 0xee6aed98 (stale) Mirror 21: 0xee6aed98 (stale) Mirror 23: 0xee6aed98 (stale) Mirror 25: 0xee6aed98 (stale) Mirror 26: 0xee6aed98 (stale) Mirror 27: 0xee6aed98 (stale) Mirror 28: 0xee6aed98 (stale) Mirror 29: 0xee6aed98 (stale) Mirror 30: 0xee6aed98 (stale) CRC-32 checksum value for chunk [0, 0x1ce53): Mirror 1: 0x3e80d975 Mirror 31: 0x3e80d975 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce53: skipped 000773 1790772148.730381 trunc from 0x00e612 to 0x0183e3 (0x9dd2 bytes) 000774 1790772148.795871 mapread 0x005f8f thru 0x012deb (0xce5d bytes) 000775 1790772148.845031 read 0x014e01 thru 0x01ce52 (0x8052 bytes) 000776 1790772148.853642 fallocate 0x03991e thru 0x03ffff (0x66e2 bytes) 000777 1790772148.872583 punch from 0x0164fe to 0x01ce52 (0x6955 bytes) 000778 1790772148.881621 mapread 0x00cc83 thru 0x012944 (0x5cc2 bytes) 000780 1790772148.885853 trunc from 0x01781a to 0x01b4dd (0x3cc4 bytes) 000782 1790772148.910621 trunc from 0x01ce53 to 0x02d2de (0x1048c bytes) 000783 1790772148.999930 mapread 0x027c72 thru 0x027e1d (0x1ac bytes) 000784 1790772149.017142 mapread 0x014637 thru 0x015ba9 (0x1573 bytes) 000785 1790772149.019597 trunc from 0x02253f to 0x02d2de (0xada0 bytes) 000786 1790772149.037200 fallocate 0x02c3f9 thru 0x037e4b (0xba53 bytes) 000788 1790772149.044401 write 0x0356db thru 0x039519 (0x3e3f bytes) 000789 1790772149.083936 mapwrite 0x001cf1 thru 0x00e050 (0xc360 bytes) 000790 1790772149.118707 trunc from 0x03951a to 0x0348fb (0x4c1e bytes) 000791 1790772149.141713 fallocate 0x00c960 thru 0x0121f0 (0x5891 bytes) 000792 1790772149.160033 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 28: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 30: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) CRC-32 checksum value for chunk [0, 0x348fc): Mirror 1: 0xe684bf0a Mirror 32: 0xe684bf0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348fc: skipped 000793 1790772150.204353 fallocate 0x01062a thru 0x01fd7f (0xf756 bytes) 000795 1790772150.286366 mapread 0x011ba8 thru 0x018507 (0x6960 bytes) 000798 1790772150.310150 write 0x02b7f0 thru 0x02fb37 (0x4348 bytes) 000799 1790772150.333041 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 30: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) Mirror 32: 0xe684bf0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 30: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) Mirror 32: 0xe684bf0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348fc: skipped 000800 1790772151.199348 fallocate 0x03b467 thru 0x03ffff (0x4b99 bytes) 000802 1790772151.204541 punch from 0x020aff to 0x02219d (0x169f bytes) 000803 1790772151.209418 trunc from 0x024028 to 0x02f55f (0xb538 bytes) 000804 1790772151.214887 read 0x023f1d thru 0x024074 (0x158 bytes) 000805 1790772151.219484 punch from 0x01680c to 0x025452 (0xec47 bytes) 000806 1790772151.227557 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) Mirror 32: 0xe684bf0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) Mirror 32: 0xe684bf0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348fc: skipped 000807 1790772151.743130 fallocate 0x018459 thru 0x021b8c (0x9734 bytes) 000808 1790772151.753647 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) Mirror 32: 0xe684bf0a (stale) CRC-32 checksum value for chunk [0, 0x348fc): Mirror 1: 0x8d656fe8 Mirror 33: 0x8d656fe8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348fc: skipped 000809 1790772152.661215 fallocate 0x028809 thru 0x030c49 (0x8441 bytes) 000812 1790772152.727596 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348fc): Mirror 13: 0xd61757e5 (stale) Mirror 14: 0xd61757e5 (stale) Mirror 18: 0xd61757e5 (stale) Mirror 21: 0xd61757e5 (stale) Mirror 23: 0xd61757e5 (stale) Mirror 25: 0xd61757e5 (stale) Mirror 26: 0xd61757e5 (stale) Mirror 27: 0xd61757e5 (stale) Mirror 29: 0xd61757e5 (stale) Mirror 31: 0xec7d4169 (stale) Mirror 32: 0xe684bf0a (stale) Mirror 33: 0x8d656fe8 (stale) CRC-32 checksum value for chunk [0, 0x348fc): Mirror 1: 0x8d656fe8 Mirror 34: 0x8d656fe8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348fc: skipped 000813 1790772153.741992 fallocate 0x027e12 thru 0x02d57b (0x576a bytes) 000814 1790772153.815377 mapread 0x00e694 thru 0x010fb5 (0x2922 bytes) 000815 1790772153.856228 mapread 0x0058d9 thru 0x00ba13 (0x613b bytes) 000816 1790772153.875238 mapwrite 0x03a87d thru 0x03ffff (0x5783 bytes) 000817 1790772153.945771 punch from 0x03bd58 to 0x03ffff (0x42a8 bytes) 000818 1790772153.951121 read 0x02366d thru 0x026dde (0x3772 bytes) 000819 1790772153.956382 write 0x01d8b1 thru 0x02d138 (0xf888 bytes) 000821 1790772153.967870 mapwrite 0x00e830 thru 0x015f68 (0x7739 bytes) 000822 1790772153.986864 mapwrite 0x008dd4 thru 0x00d8df (0x4b0c bytes) 000824 1790772154.004375 mapread 0x022f61 thru 0x027d1e (0x4dbe bytes) 000825 1790772154.005994 mapread 0x00c315 thru 0x016be9 (0xa8d5 bytes) 000826 1790772154.007386 mapwrite 0x0145d2 thru 0x020efb (0xc92a bytes) 000827 1790772154.045026 trunc from 0x040000 to 0x00c062 (0x33f9d bytes) 000828 1790772154.067581 read 0x0062c1 thru 0x00c062 (0x5da2 bytes) 000829 1790772154.081554 MIRROR_RESYNC 14 mirrors 000830 1790772155.461775 read 0x006dce thru 0x00c062 (0x5295 bytes) 000831 1790772155.478999 read 0x003ef3 thru 0x00c062 (0x8170 bytes) 000832 1790772155.486548 mapwrite 0x0219f9 thru 0x022356 (0x95e bytes) 000833 1790772155.550732 fallocate 0x038145 thru 0x03ffff (0x7ebb bytes) 000835 1790772155.557810 trunc from 0x040000 to 0x01ea47 (0x215b8 bytes) 000836 1790772155.574133 mapwrite 0x035e19 thru 0x03ffff (0xa1e7 bytes) 000837 1790772155.611733 read 0x0323ff thru 0x037bce (0x57d0 bytes) 000838 1790772155.616121 MIRROR_RESYNC 14 mirrors 000839 1790772157.781595 punch from 0x03a78b to 0x03ffff (0x5875 bytes) 000840 1790772157.824447 fallocate 0x00a8b0 thru 0x00c4b2 (0x1c03 bytes) 000841 1790772157.830058 write 0x01956c thru 0x024426 (0xaebb bytes) 000842 1790772157.842150 MIRROR_RESYNC 14 mirrors 000843 1790772160.770565 MIRROR_EXTEND to 15 mirrors 000844 1790772161.756319 trunc from 0x040000 to 0x01b9d5 (0x2462a bytes) 000845 1790772161.823847 punch from 0x003bf7 to 0x012684 (0xea8e bytes) 000846 1790772161.828650 mapread 0x008f06 thru 0x014bf4 (0xbcef bytes) 000847 1790772161.851188 fallocate 0x035e9e thru 0x03937a (0x34dd bytes) 000848 1790772161.856057 punch from 0x01f59c to 0x0285e1 (0x9046 bytes) 000849 1790772161.864534 trunc from 0x001c4e to 0x00e4c4 (0xc877 bytes) 000850 1790772161.871150 punch from 0x02aa06 to 0x02cb8c (0x2187 bytes) 000851 1790772161.875554 trunc from 0x00b259 to 0x01b047 (0xfdef bytes) 000852 1790772161.880050 write 0x02b6cc thru 0x03aaf6 (0xf42b bytes) 000853 1790772161.885954 mapread 0x03845b thru 0x038992 (0x538 bytes) 000854 1790772161.887853 trunc from 0x03aaf7 to 0x0171ed (0x23909 bytes) 000855 1790772161.908634 trunc from 0x0171ee to 0x01ea03 (0x7816 bytes) 000856 1790772161.932343 trunc from 0x0114cb to 0x01bc0f (0xa745 bytes) 000857 1790772161.941330 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1ea04): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea04): Mirror 13: 0x535e5c6b (stale) Mirror 14: 0x535e5c6b (stale) Mirror 18: 0x535e5c6b (stale) Mirror 21: 0x535e5c6b (stale) Mirror 23: 0x535e5c6b (stale) Mirror 25: 0x535e5c6b (stale) Mirror 26: 0x535e5c6b (stale) Mirror 27: 0x535e5c6b (stale) Mirror 29: 0x535e5c6b (stale) Mirror 31: 0x535e5c6b (stale) Mirror 32: 0x535e5c6b (stale) Mirror 33: 0x535e5c6b (stale) Mirror 34: 0x535e5c6b (stale) Mirror 35: 0x535e5c6b (stale) CRC-32 checksum value for chunk [0, 0x1ea04): Mirror 1: 0x3551c3fd Mirror 36: 0x3551c3fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea04: skipped 000859 1790772163.329148 mapread 0x018cb3 thru 0x01ca12 (0x3d60 bytes) 000860 1790772163.365737 read 0x016acc thru 0x01e3c6 (0x78fb bytes) 000861 1790772163.371741 write 0x0293aa thru 0x033ee2 (0xab39 bytes) 000862 1790772163.427387 mapread 0x010565 thru 0x0133c3 (0x2e5f bytes) 000863 1790772163.434125 punch from 0x00dae0 to 0x0192ef (0xb810 bytes) 000866 1790772163.440854 mapread 0x027ec4 thru 0x02be3d (0x3f7a bytes) 000867 1790772163.454848 write 0x00aacd thru 0x00ce31 (0x2365 bytes) 000868 1790772163.456588 write 0x03cd53 thru 0x03ee1f (0x20cd bytes) 000869 1790772163.459353 mapwrite 0x00d5c3 thru 0x011983 (0x43c1 bytes) 000870 1790772163.497774 trunc from 0x03ee20 to 0x028c3b (0x161e4 bytes) 000871 1790772163.515488 mapread 0x003740 thru 0x011411 (0xdcd2 bytes) 000872 1790772163.529601 MIRROR_RESYNC 16 mirrors 000874 1790772166.299698 fallocate 0x03d15f thru 0x03ffff (0x2ea1 bytes) 000876 1790772166.350169 trunc from 0x02ca73 to 0x0350eb (0x8679 bytes) 000877 1790772166.357486 read 0x01450d thru 0x01a1e7 (0x5cdb bytes) 000878 1790772166.365814 trunc from 0x01120f to 0x01fa18 (0xe80a bytes) 000881 1790772166.373102 mapread 0x02fc8a thru 0x02ffc7 (0x33e bytes) 000882 1790772166.380054 punch from 0x007ac9 to 0x011af5 (0xa02d bytes) 000883 1790772166.386643 read 0x035107 thru 0x039a84 (0x497e bytes) 000884 1790772166.406690 read 0x039629 thru 0x03ffff (0x69d7 bytes) 000885 1790772166.408889 trunc from 0x040000 to 0x031cd3 (0xe32c bytes) 000886 1790772166.456715 read 0x0070f9 thru 0x00b9da (0x48e2 bytes) 000887 1790772166.461753 mapwrite 0x00a6e5 thru 0x00bcdf (0x15fb bytes) 000888 1790772166.478978 mapread 0x029018 thru 0x031cd3 (0x8cbc bytes) 000889 1790772166.479899 fallocate 0x01ea3b thru 0x02e29d (0xf863 bytes) 000890 1790772166.492635 fallocate 0x03c248 thru 0x03ffff (0x3db8 bytes) 000891 1790772166.507859 fallocate 0x03c245 thru 0x03e9ea (0x27a6 bytes) 000892 1790772166.512397 read 0x01d817 thru 0x0210be (0x38a8 bytes) 000893 1790772166.513494 fallocate 0x016a38 thru 0x022046 (0xb60f bytes) 000894 1790772166.523164 trunc from 0x00da46 to 0x01315f (0x571a bytes) 000895 1790772166.528126 fallocate 0x03b661 thru 0x03ffff (0x499f bytes) 000896 1790772166.535691 read 0x03d1ce thru 0x03ffff (0x2e32 bytes) 000899 1790772166.561969 punch from 0x03e743 to 0x03ffff (0x18bd bytes) 000903 1790772166.569162 punch from 0x024253 to 0x029ef9 (0x5ca7 bytes) 000904 1790772166.585079 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1ac85e9f (stale) Mirror 18: 0x1ac85e9f (stale) Mirror 21: 0x1ac85e9f (stale) Mirror 23: 0x1ac85e9f (stale) Mirror 25: 0x1ac85e9f (stale) Mirror 26: 0x1ac85e9f (stale) Mirror 27: 0x1ac85e9f (stale) Mirror 29: 0x1ac85e9f (stale) Mirror 31: 0x1ac85e9f (stale) Mirror 32: 0x1ac85e9f (stale) Mirror 33: 0x1ac85e9f (stale) Mirror 34: 0x1ac85e9f (stale) Mirror 35: 0x1ac85e9f (stale) Mirror 36: 0x1ac85e9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1ac85e9f (stale) Mirror 18: 0x1ac85e9f (stale) Mirror 21: 0x1ac85e9f (stale) Mirror 23: 0x1ac85e9f (stale) Mirror 25: 0x1ac85e9f (stale) Mirror 26: 0x1ac85e9f (stale) Mirror 27: 0x1ac85e9f (stale) Mirror 29: 0x1ac85e9f (stale) Mirror 31: 0x1ac85e9f (stale) Mirror 32: 0x1ac85e9f (stale) Mirror 33: 0x1ac85e9f (stale) Mirror 34: 0x1ac85e9f (stale) Mirror 35: 0x1ac85e9f (stale) Mirror 36: 0x1ac85e9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000905 1790772167.315295 read 0x02bff7 thru 0x02c2a6 (0x2b0 bytes) 000906 1790772167.319220 trunc from 0x040000 to 0x009e9a (0x36165 bytes) 000907 1790772167.353659 mapread 0x007932 thru 0x009e9a (0x2569 bytes) 000908 1790772167.379046 trunc from 0x00078a to 0x009e9a (0x9711 bytes) 000909 1790772167.399755 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x9e9b): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9e9b): Mirror 14: 0xa32b62bb (stale) Mirror 18: 0xa32b62bb (stale) Mirror 21: 0xa32b62bb (stale) Mirror 23: 0xa32b62bb (stale) Mirror 25: 0xa32b62bb (stale) Mirror 26: 0xa32b62bb (stale) Mirror 27: 0xa32b62bb (stale) Mirror 29: 0xa32b62bb (stale) Mirror 31: 0xa32b62bb (stale) Mirror 32: 0xa32b62bb (stale) Mirror 33: 0xa32b62bb (stale) Mirror 34: 0xa32b62bb (stale) Mirror 35: 0xa32b62bb (stale) Mirror 36: 0xa32b62bb (stale) CRC-32 checksum value for chunk [0, 0x9e9b): Mirror 1: 0x12142c19 Mirror 37: 0x12142c19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9e9b: skipped 000910 1790772168.462540 punch from 0x004027 to 0x009e9a (0x5e74 bytes) 000912 1790772168.541284 trunc from 0x00357b to 0x009e9a (0x6920 bytes) 000913 1790772168.548851 trunc from 0x009e9b to 0x00c655 (0x27bb bytes) 000914 1790772168.644586 write 0x0252d4 thru 0x031468 (0xc195 bytes) 000915 1790772168.650787 trunc from 0x02a86e to 0x031468 (0x6bfb bytes) 000916 1790772168.693577 trunc from 0x031469 to 0x0342b1 (0x2e49 bytes) 000917 1790772168.728697 trunc from 0x02b136 to 0x02db6e (0x2a39 bytes) 000920 1790772168.745138 write 0x0055a0 thru 0x009ad4 (0x4535 bytes) 000921 1790772168.761364 punch from 0x01cc4c to 0x02620b (0x95c0 bytes) 000922 1790772168.769831 mapwrite 0x023c0b thru 0x02de27 (0xa21d bytes) 000923 1790772168.838131 punch from 0x0183cd to 0x021ad8 (0x970c bytes) 000924 1790772168.843584 read 0x0002c8 thru 0x000890 (0x5c9 bytes) 000925 1790772168.853555 MIRROR_RESYNC 16 mirrors 000926 1790772172.949267 punch from 0x01e367 to 0x02c9ad (0xe647 bytes) 000927 1790772172.999767 punch from 0x00bf7b to 0x016c5f (0xace5 bytes) 000928 1790772173.016800 MIRROR_RESYNC 16 mirrors 000929 1790772177.207672 read 0x0010d1 thru 0x010d4e (0xfc7e bytes) 000930 1790772177.219789 trunc from 0x0226f7 to 0x02f67e (0xcf88 bytes) 000931 1790772177.270649 mapread 0x00fc4b thru 0x01d34a (0xd700 bytes) 000932 1790772177.321139 trunc from 0x0342b2 to 0x0261ff (0xe0b2 bytes) 000933 1790772177.341644 read 0x01ed76 thru 0x0261ff (0x748a bytes) 000934 1790772177.350856 read 0x011970 thru 0x01c77b (0xae0c bytes) 000936 1790772177.352740 trunc from 0x026200 to 0x020a47 (0x57b8 bytes) 000937 1790772177.364736 mapread 0x001921 thru 0x00f849 (0xdf29 bytes) 000939 1790772177.366356 punch from 0x017e63 to 0x020a47 (0x8be5 bytes) 000940 1790772177.372634 trunc from 0x020a48 to 0x00817b (0x188cc bytes) 000941 1790772177.387749 mapwrite 0x01aa9e thru 0x021a39 (0x6f9c bytes) 000942 1790772177.428646 read 0x00e4f0 thru 0x01afa9 (0xcaba bytes) 000943 1790772177.429766 mapwrite 0x017c36 thru 0x024316 (0xc6e1 bytes) 000945 1790772177.468576 trunc from 0x024317 to 0x01c91e (0x79f8 bytes) 000946 1790772177.483435 fallocate 0x00939c thru 0x00d0b4 (0x3d19 bytes) 000947 1790772177.487697 mapread 0x002598 thru 0x011d3f (0xf7a8 bytes) 000950 1790772177.490816 write 0x000f09 thru 0x003b73 (0x2c6b bytes) 000952 1790772177.493277 read 0x017069 thru 0x01c91e (0x58b6 bytes) 000953 1790772177.494167 punch from 0x016c75 to 0x018ca1 (0x202d bytes) 000954 1790772177.499697 read 0x01113d thru 0x01c91e (0xb7e2 bytes) 000955 1790772177.507986 MIRROR_SPLIT mirror 11 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 14: 0xa7ea99b0 (stale) Mirror 18: 0xa7ea99b0 (stale) Mirror 21: 0xa7ea99b0 (stale) Mirror 23: 0xa7ea99b0 (stale) Mirror 25: 0xa7ea99b0 (stale) Mirror 26: 0xa7ea99b0 (stale) Mirror 27: 0xa7ea99b0 (stale) Mirror 29: 0xa7ea99b0 (stale) Mirror 31: 0xa7ea99b0 (stale) Mirror 32: 0xa7ea99b0 (stale) Mirror 34: 0xa7ea99b0 (stale) Mirror 35: 0xa7ea99b0 (stale) Mirror 36: 0xa7ea99b0 (stale) Mirror 37: 0xa7ea99b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 14: 0xa7ea99b0 (stale) Mirror 18: 0xa7ea99b0 (stale) Mirror 21: 0xa7ea99b0 (stale) Mirror 23: 0xa7ea99b0 (stale) Mirror 25: 0xa7ea99b0 (stale) Mirror 26: 0xa7ea99b0 (stale) Mirror 27: 0xa7ea99b0 (stale) Mirror 29: 0xa7ea99b0 (stale) Mirror 31: 0xa7ea99b0 (stale) Mirror 32: 0xa7ea99b0 (stale) Mirror 34: 0xa7ea99b0 (stale) Mirror 35: 0xa7ea99b0 (stale) Mirror 36: 0xa7ea99b0 (stale) Mirror 37: 0xa7ea99b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c91f: skipped 000956 1790772178.134258 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 14: 0xa7ea99b0 (stale) Mirror 18: 0xa7ea99b0 (stale) Mirror 21: 0xa7ea99b0 (stale) Mirror 23: 0xa7ea99b0 (stale) Mirror 25: 0xa7ea99b0 (stale) Mirror 26: 0xa7ea99b0 (stale) Mirror 27: 0xa7ea99b0 (stale) Mirror 29: 0xa7ea99b0 (stale) Mirror 31: 0xa7ea99b0 (stale) Mirror 32: 0xa7ea99b0 (stale) Mirror 34: 0xa7ea99b0 (stale) Mirror 35: 0xa7ea99b0 (stale) Mirror 36: 0xa7ea99b0 (stale) Mirror 37: 0xa7ea99b0 (stale) CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 1: 0x9a1272a Mirror 38: 0x9a1272a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c91f: skipped 000957 1790772179.491714 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 14: 0xa7ea99b0 (stale) Mirror 18: 0xa7ea99b0 (stale) Mirror 21: 0xa7ea99b0 (stale) Mirror 23: 0xa7ea99b0 (stale) Mirror 25: 0xa7ea99b0 (stale) Mirror 26: 0xa7ea99b0 (stale) Mirror 27: 0xa7ea99b0 (stale) Mirror 29: 0xa7ea99b0 (stale) Mirror 31: 0xa7ea99b0 (stale) Mirror 32: 0xa7ea99b0 (stale) Mirror 34: 0xa7ea99b0 (stale) Mirror 35: 0xa7ea99b0 (stale) Mirror 36: 0xa7ea99b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 14: 0xa7ea99b0 (stale) Mirror 18: 0xa7ea99b0 (stale) Mirror 21: 0xa7ea99b0 (stale) Mirror 23: 0xa7ea99b0 (stale) Mirror 25: 0xa7ea99b0 (stale) Mirror 26: 0xa7ea99b0 (stale) Mirror 27: 0xa7ea99b0 (stale) Mirror 29: 0xa7ea99b0 (stale) Mirror 31: 0xa7ea99b0 (stale) Mirror 32: 0xa7ea99b0 (stale) Mirror 34: 0xa7ea99b0 (stale) Mirror 35: 0xa7ea99b0 (stale) Mirror 36: 0xa7ea99b0 (stale) CRC-32 checksum value for chunk [0, 0x1c91f): Mirror 1: 0x9a1272a Mirror 38: 0x9a1272a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c91f: skipped 000958 1790772180.602787 trunc from 0x01c91f to 0x02634a (0x9a2c bytes) 000959 1790772180.710214 mapread 0x012fc5 thru 0x014b75 (0x1bb1 bytes) 000960 1790772180.743972 MIRROR_RESYNC 15 mirrors 000961 1790772184.263339 fallocate 0x008ab4 thru 0x016c52 (0xe19f bytes) 000962 1790772184.334138 read 0x0053be thru 0x00e79a (0x93dd bytes) 000963 1790772184.381449 mapwrite 0x01daab thru 0x022011 (0x4567 bytes) 000964 1790772184.455920 fallocate 0x01c376 thru 0x02893b (0xc5c6 bytes) 000965 1790772184.463795 mapwrite 0x0111e7 thru 0x015243 (0x405d bytes) 000966 1790772184.512403 write 0x02bef4 thru 0x02f481 (0x358e bytes) 000967 1790772184.513859 mapread 0x005e26 thru 0x011879 (0xba54 bytes) 000968 1790772184.519411 read 0x0213ad thru 0x025c05 (0x4859 bytes) 000969 1790772184.526370 read 0x0097bd thru 0x017ff6 (0xe83a bytes) 000970 1790772184.528110 trunc from 0x024d15 to 0x029a9a (0x4d86 bytes) 000971 1790772184.536257 trunc from 0x01c9f0 to 0x028487 (0xba98 bytes) 000972 1790772184.544239 write 0x02c461 thru 0x02f0b4 (0x2c54 bytes) 000973 1790772184.545287 punch from 0x02ec96 to 0x02f481 (0x7ec bytes) 000974 1790772184.575821 write 0x00aa89 thru 0x00cec2 (0x243a bytes) 000975 1790772184.576966 trunc from 0x017c05 to 0x01ac52 (0x304e bytes) 000977 1790772184.601853 trunc from 0x00f8a4 to 0x01963e (0x9d9b bytes) 000978 1790772184.609619 write 0x01297b thru 0x01325b (0x8e1 bytes) 000979 1790772184.619824 read 0x008e6b thru 0x00a181 (0x1317 bytes) 000980 1790772184.620784 fallocate 0x013363 thru 0x01e0bf (0xad5d bytes) 000981 1790772184.624880 mapread 0x006c7f thru 0x00e3d3 (0x7755 bytes) 000982 1790772184.629347 MIRROR_SPLIT mirror 3 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f482): Mirror 14: 0xcd26cc13 (stale) Mirror 18: 0xcd26cc13 (stale) Mirror 23: 0xcd26cc13 (stale) Mirror 25: 0xcd26cc13 (stale) Mirror 26: 0xcd26cc13 (stale) Mirror 27: 0xcd26cc13 (stale) Mirror 29: 0xcd26cc13 (stale) Mirror 31: 0xcd26cc13 (stale) Mirror 32: 0xcd26cc13 (stale) Mirror 34: 0xcd26cc13 (stale) Mirror 35: 0xcd26cc13 (stale) Mirror 36: 0xcd26cc13 (stale) Mirror 38: 0xcd26cc13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f482): Mirror 14: 0xcd26cc13 (stale) Mirror 18: 0xcd26cc13 (stale) Mirror 23: 0xcd26cc13 (stale) Mirror 25: 0xcd26cc13 (stale) Mirror 26: 0xcd26cc13 (stale) Mirror 27: 0xcd26cc13 (stale) Mirror 29: 0xcd26cc13 (stale) Mirror 31: 0xcd26cc13 (stale) Mirror 32: 0xcd26cc13 (stale) Mirror 34: 0xcd26cc13 (stale) Mirror 35: 0xcd26cc13 (stale) Mirror 36: 0xcd26cc13 (stale) Mirror 38: 0xcd26cc13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f482: skipped 000983 1790772185.507318 mapwrite 0x023898 thru 0x026e71 (0x35da bytes) 000984 1790772185.548631 mapwrite 0x030cf4 thru 0x038062 (0x736f bytes) 000985 1790772185.590438 read 0x014841 thru 0x01abdf (0x639f bytes) 000986 1790772185.598181 trunc from 0x038063 to 0x012454 (0x25c0e bytes) 000987 1790772185.610701 trunc from 0x012455 to 0x0355e4 (0x23190 bytes) 000988 1790772185.621791 punch from 0x00351a to 0x008011 (0x4af8 bytes) 000989 1790772185.636806 MIRROR_RESYNC 14 mirrors 000990 1790772188.680578 fallocate 0x009d92 thru 0x00c9c5 (0x2c34 bytes) 000991 1790772188.725158 mapread 0x03293b thru 0x0355e4 (0x2caa bytes) 000992 1790772188.742881 fallocate 0x01ff3f thru 0x022245 (0x2307 bytes) 000993 1790772188.747461 mapwrite 0x038b02 thru 0x03a6ba (0x1bb9 bytes) 000994 1790772188.786371 fallocate 0x0368ac thru 0x036d07 (0x45c bytes) 000995 1790772188.792085 trunc from 0x000d6b to 0x00c12e (0xb3c4 bytes) 000996 1790772188.797014 mapread 0x01d577 thru 0x020c68 (0x36f2 bytes) 000997 1790772188.807889 trunc from 0x03a6bb to 0x001088 (0x39632 bytes) 000998 1790772188.825075 read 0x000f3f thru 0x001088 (0x14a bytes) 000999 1790772188.830449 write 0x004cbd thru 0x00893b (0x3c7f bytes) 001000 1790772188.833877 punch from 0x007a44 to 0x00893b (0xef8 bytes) All operations completed A-OK!