== sanity-flr test 70a: flr mode fsx test ================ 12:08:49 (1772471329) Seed set to 1331 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1772471331.772481 write 0x018f00 thru 0x022d32 (0x9e33 bytes) 000002 1772471331.784259 mapwrite 0x0211bb thru 0x023b1b (0x2961 bytes) 000004 1772471331.894374 mapread 0x002c98 thru 0x00bf24 (0x928d bytes) 000005 1772471331.927555 mapwrite 0x01d2c6 thru 0x028816 (0xb551 bytes) 000008 1772471332.089390 mapread 0x019d2d thru 0x01e7fb (0x4acf bytes) 000009 1772471332.092948 mapwrite 0x00fc2d thru 0x01f032 (0xf406 bytes) 000012 1772471332.214324 mapread 0x01ab06 thru 0x022c71 (0x816c bytes) 000013 1772471332.215534 write 0x0159d3 thru 0x017c0a (0x2238 bytes) truncating to largest ever: 0x165f4 000014 1772471332.220581 trunc from 0x028817 to 0x0165f3 (0x12223 bytes) 000017 1772471332.247185 read 0x003568 thru 0x00d2fd (0x9d96 bytes) 000024 1772471332.256553 trunc from 0x0165f4 to 0x0165a1 (0x52 bytes) truncating to largest ever: 0x37fae 000025 1772471332.275667 trunc from 0x0165a2 to 0x037fad (0x21a0c bytes) 000031 1772471332.302418 write 0x003ba3 thru 0x003d11 (0x16f bytes) 000033 1772471332.304306 trunc from 0x037fae to 0x01cb4d (0x1b460 bytes) 000034 1772471332.322156 read 0x014aa0 thru 0x017abf (0x3020 bytes) 000035 1772471332.333634 trunc from 0x01cb4e to 0x00136f (0x1b7de bytes) 000036 1772471332.355889 mapread 0x00089d thru 0x000edb (0x63f bytes) 000037 1772471332.357055 read 0x0011af thru 0x00136f (0x1c1 bytes) 000038 1772471332.359492 write 0x00f9df thru 0x018f21 (0x9543 bytes) 000039 1772471332.362458 read 0x015c10 thru 0x018f21 (0x3312 bytes) 000043 1772471332.366154 mapwrite 0x000898 thru 0x00688a (0x5ff3 bytes) truncating to largest ever: 0x39ced 000045 1772471332.428496 trunc from 0x018f22 to 0x039cec (0x20dcb bytes) 000046 1772471332.447753 mapwrite 0x005a16 thru 0x01570d (0xfcf8 bytes) 000047 1772471332.506381 trunc from 0x039ced to 0x018506 (0x217e6 bytes) 000049 1772471332.549451 trunc from 0x018507 to 0x02ca84 (0x1457e bytes) 000050 1772471332.568031 trunc from 0x02ca85 to 0x004c61 (0x27e23 bytes) 000053 1772471332.594557 mapread 0x00343a thru 0x003dc3 (0x98a bytes) 000054 1772471332.595872 mapread 0x002e99 thru 0x004c61 (0x1dc9 bytes) 000055 1772471332.598532 write 0x03b998 thru 0x03ca2f (0x1098 bytes) 000059 1772471332.604281 read 0x029d7c thru 0x0313f4 (0x7679 bytes) 000061 1772471332.614636 mapread 0x002c5b thru 0x010146 (0xd4ec bytes) 000062 1772471332.616597 write 0x00fd37 thru 0x01d684 (0xd94e bytes) 000063 1772471332.618594 mapread 0x00b407 thru 0x01245d (0x7057 bytes) 000064 1772471332.620570 mapwrite 0x03ddd9 thru 0x03ffff (0x2227 bytes) 000068 1772471332.733373 read 0x01e97c thru 0x02aba6 (0xc22b bytes) 000069 1772471332.737444 write 0x02a4e6 thru 0x0315a4 (0x70bf bytes) 000070 1772471332.746806 MIRROR_EXTEND to 2 mirrors 000074 1772471333.618297 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000075 1772471333.783495 write 0x03ee4b thru 0x03ffff (0x11b5 bytes) 000076 1772471333.809402 write 0x00ee70 thru 0x01edd1 (0xff62 bytes) 000077 1772471333.824829 read 0x01e480 thru 0x026261 (0x7de2 bytes) truncating to largest ever: 0x3d25f 000078 1772471333.845513 trunc from 0x040000 to 0x03d25e (0x2da1 bytes) 000079 1772471333.883521 mapread 0x00b26e thru 0x015633 (0xa3c6 bytes) 000081 1772471333.900487 mapread 0x013d7c thru 0x0165ed (0x2872 bytes) 000083 1772471333.904416 mapread 0x017da1 thru 0x018034 (0x294 bytes) 000085 1772471333.914794 read 0x01515e thru 0x01f1e3 (0xa086 bytes) 000086 1772471333.915651 write 0x00d0ca thru 0x01ac38 (0xdb6f bytes) 000087 1772471333.925349 mapwrite 0x001941 thru 0x00dd68 (0xc428 bytes) 000091 1772471334.036345 trunc from 0x03d25f to 0x00fbb7 (0x2d6a7 bytes) 000094 1772471334.086382 write 0x0063f0 thru 0x00d61d (0x722e bytes) 000095 1772471334.088051 write 0x014952 thru 0x01754f (0x2bfe bytes) 000097 1772471334.089806 mapwrite 0x028fe9 thru 0x035f03 (0xcf1b bytes) 000098 1772471334.341543 trunc from 0x035f04 to 0x00a5c9 (0x2b93a bytes) 000099 1772471334.362310 write 0x03b0bd thru 0x03e49c (0x33e0 bytes) 000100 1772471334.366022 read 0x005e3c thru 0x014cdf (0xeea4 bytes) 000103 1772471334.375792 read 0x023993 thru 0x0283e8 (0x4a56 bytes) 000104 1772471334.376499 read 0x009e59 thru 0x00abca (0xd72 bytes) 000105 1772471334.378075 mapread 0x00c567 thru 0x016f10 (0xa9aa bytes) 000109 1772471334.382487 read 0x0252c5 thru 0x0346da (0xf416 bytes) 000110 1772471334.383532 read 0x0302e9 thru 0x03a819 (0xa531 bytes) 000111 1772471334.385241 read 0x03b0fa thru 0x03e49c (0x33a3 bytes) 000112 1772471334.386321 trunc from 0x03e49d to 0x01c190 (0x2230c bytes) 000116 1772471334.412820 write 0x019024 thru 0x0262b8 (0xd295 bytes) 000119 1772471334.423394 mapwrite 0x02abc8 thru 0x0337ac (0x8be5 bytes) 000120 1772471334.537437 mapread 0x0219ad thru 0x02961a (0x7c6e bytes) 000125 1772471334.543269 read 0x028ff2 thru 0x0337ac (0xa7bb bytes) 000126 1772471334.544490 mapread 0x00a0ee thru 0x016611 (0xc524 bytes) 000127 1772471334.548424 mapread 0x0248c4 thru 0x0337ac (0xeee9 bytes) 000129 1772471334.550308 read 0x019c31 thru 0x01c28a (0x265a bytes) 000132 1772471334.552244 mapread 0x017b40 thru 0x01cd51 (0x5212 bytes) 000133 1772471334.553315 write 0x0304e4 thru 0x035984 (0x54a1 bytes) 000135 1772471334.554899 read 0x016331 thru 0x020cf9 (0xa9c9 bytes) 000136 1772471334.555464 trunc from 0x035985 to 0x029823 (0xc161 bytes) 000137 1772471334.581211 read 0x017e1a thru 0x01e876 (0x6a5d bytes) 000138 1772471334.582247 read 0x01b3c6 thru 0x029823 (0xe45e bytes) 000139 1772471334.596402 trunc from 0x029824 to 0x02f7a1 (0x5f7e bytes) 000141 1772471334.623179 write 0x013c15 thru 0x01687e (0x2c6a bytes) 000143 1772471334.629393 mapread 0x00c98b thru 0x0159ff (0x9075 bytes) 000144 1772471334.634469 mapwrite 0x00013c thru 0x0064a0 (0x6365 bytes) 000146 1772471334.717021 read 0x0167fd thru 0x021150 (0xa954 bytes) 000147 1772471334.719393 trunc from 0x02f7a2 to 0x018adb (0x16cc6 bytes) 000151 1772471334.750368 mapwrite 0x03a78b thru 0x03ffff (0x5875 bytes) 000152 1772471334.861090 trunc from 0x040000 to 0x02dfc4 (0x1203b bytes) 000153 1772471334.889555 trunc from 0x02dfc5 to 0x01f512 (0xeab2 bytes) 000155 1772471334.922728 mapwrite 0x03bd58 thru 0x03ffff (0x42a8 bytes) 000156 1772471335.086322 trunc from 0x040000 to 0x00d0b2 (0x32f4d bytes) 000157 1772471335.131084 mapwrite 0x0216b4 thru 0x02e2e1 (0xcc2e bytes) 000160 1772471335.427999 mapread 0x01f5bb thru 0x027212 (0x7c58 bytes) 000162 1772471335.445228 mapwrite 0x007538 thru 0x0153d0 (0xde99 bytes) 000163 1772471335.568743 write 0x02f44a thru 0x03058d (0x1144 bytes) 000164 1772471335.570025 write 0x0112c9 thru 0x016033 (0x4d6b bytes) 000167 1772471335.583801 mapwrite 0x00bc73 thru 0x015df3 (0xa181 bytes) 000170 1772471335.652489 MIRROR_EXTEND to 2 mirrors 000171 1772471336.545370 mapread 0x00f69b thru 0x01b3d3 (0xbd39 bytes) 000172 1772471336.585048 mapread 0x0093de thru 0x0185ff (0xf222 bytes) 000173 1772471336.596462 read 0x018724 thru 0x018949 (0x226 bytes) 000174 1772471336.597217 mapread 0x01f4a0 thru 0x02d073 (0xdbd4 bytes) 000175 1772471336.616356 trunc from 0x03058e to 0x022296 (0xe2f7 bytes) 000176 1772471336.774549 write 0x015586 thru 0x01ba94 (0x650f bytes) 000177 1772471336.790539 mapwrite 0x036a40 thru 0x03afa2 (0x4563 bytes) 000178 1772471336.961775 write 0x01b626 thru 0x01ed97 (0x3772 bytes) 000181 1772471336.972473 mapwrite 0x036105 thru 0x03c9e9 (0x68e5 bytes) 000182 1772471337.056718 mapwrite 0x02127a thru 0x024981 (0x3708 bytes) 000185 1772471337.134204 mapread 0x0308b7 thru 0x03a936 (0xa080 bytes) 000186 1772471337.137093 read 0x0036d1 thru 0x00c92c (0x925c bytes) 000187 1772471337.165394 mapread 0x02d073 thru 0x03c9e9 (0xf977 bytes) 000188 1772471337.168392 mapread 0x037cd6 thru 0x03c9e9 (0x4d14 bytes) 000191 1772471337.171066 write 0x002b20 thru 0x00cd80 (0xa261 bytes) 000192 1772471337.176127 trunc from 0x03c9ea to 0x030bb9 (0xbe30 bytes) 000193 1772471337.200485 trunc from 0x030bba to 0x00c5aa (0x2460f bytes) 000194 1772471337.251156 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000196 1772471337.467335 mapread 0x003e2e thru 0x004be7 (0xdba bytes) 000197 1772471337.482311 mapread 0x006f6d thru 0x00c5aa (0x563e bytes) 000198 1772471337.497648 trunc from 0x00c5ab to 0x0078e0 (0x4cca bytes) 000203 1772471337.540383 MIRROR_EXTEND to 2 mirrors 000204 1772471338.291320 mapread 0x005bd8 thru 0x007256 (0x167f bytes) 000205 1772471338.335362 read 0x000528 thru 0x0078e0 (0x73b9 bytes) 000207 1772471338.346947 mapwrite 0x003621 thru 0x012a2e (0xf40e bytes) 000211 1772471338.526900 trunc from 0x012a2f to 0x03b299 (0x2886b bytes) 000212 1772471338.549641 trunc from 0x03b29a to 0x02058e (0x1ad0b bytes) 000214 1772471338.577620 read 0x001c2e thru 0x00fffc (0xe3cf bytes) 000217 1772471338.595067 mapwrite 0x01f915 thru 0x02342e (0x3b1a bytes) 000218 1772471338.687078 mapread 0x01a79f thru 0x02342e (0x8c90 bytes) 000219 1772471338.695667 MIRROR_RESYNC 2 mirrors 000221 1772471339.336504 read 0x00cc50 thru 0x01263d (0x59ee bytes) 000222 1772471339.354480 MIRROR_EXTEND to 3 mirrors 000224 1772471339.931257 MIRROR_EXTEND to 4 mirrors 000225 1772471340.478306 read 0x015d2c thru 0x01aa73 (0x4d48 bytes) 000226 1772471340.496896 read 0x001931 thru 0x00d8a4 (0xbf74 bytes) 000230 1772471340.507954 mapread 0x00a7ad thru 0x011eb2 (0x7706 bytes) 000231 1772471340.510071 mapwrite 0x02006e thru 0x029508 (0x949b bytes) 000232 1772471340.664304 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29509): Mirror 2: 0x5d8d2ea1 (stale) Mirror 3: 0x5d8d2ea1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29509): Mirror 2: 0x5d8d2ea1 (stale) Mirror 3: 0x5d8d2ea1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29509: skipped 000233 1772471340.962413 write 0x02c5d2 thru 0x02ff0e (0x393d bytes) 000234 1772471340.969874 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 2: 0x6c5fbdbf (stale) Mirror 3: 0x6c5fbdbf (stale) CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 1: 0xd097c5f4 Mirror 4: 0xd097c5f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff0f: skipped 000235 1772471341.946916 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 2: 0x6c5fbdbf (stale) Mirror 3: 0x6c5fbdbf (stale) CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 1: 0xd097c5f4 Mirror 4: 0xd097c5f4 Mirror 5: 0xd097c5f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff0f: skipped 000236 1772471342.813831 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 2: 0x6c5fbdbf (stale) Mirror 3: 0x6c5fbdbf (stale) CRC-32 checksum value for chunk [0, 0x2ff0f): Mirror 1: 0xd097c5f4 Mirror 4: 0xd097c5f4 Mirror 5: 0xd097c5f4 Mirror 6: 0xd097c5f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff0f: skipped 000237 1772471343.613816 write 0x02afab thru 0x030bf1 (0x5c47 bytes) 000238 1772471343.704183 write 0x02dafd thru 0x03a8a4 (0xcda8 bytes) 000239 1772471343.709237 trunc from 0x03a8a5 to 0x00c5a3 (0x2e301 bytes) 000240 1772471343.739197 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xc5a4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc5a4): Mirror 2: 0xa9c5da6e (stale) Mirror 3: 0xa9c5da6e (stale) Mirror 4: 0xa9c5da6e (stale) Mirror 5: 0xa9c5da6e (stale) Mirror 6: 0xa9c5da6e (stale) CRC-32 checksum value for chunk [0, 0xc5a4): Mirror 1: 0xa9c5da6e Mirror 7: 0xa9c5da6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc5a4: skipped 000241 1772471344.810661 mapwrite 0x000975 thru 0x009d26 (0x93b2 bytes) 000242 1772471345.018494 read 0x00accf thru 0x00c5a3 (0x18d5 bytes) 000245 1772471345.022085 trunc from 0x00c5a4 to 0x01007c (0x3ad9 bytes) 000247 1772471345.054596 write 0x00c6a3 thru 0x019965 (0xd2c3 bytes) 000248 1772471345.059658 mapread 0x00d010 thru 0x00ffb9 (0x2faa bytes) 000252 1772471345.063683 write 0x02007b thru 0x028dd0 (0x8d56 bytes) 000253 1772471345.066159 mapread 0x010909 thru 0x01de7d (0xd575 bytes) 000254 1772471345.087471 trunc from 0x028dd1 to 0x016008 (0x12dc8 bytes) 000257 1772471345.110286 mapread 0x00329f thru 0x011990 (0xe6f2 bytes) 000258 1772471345.111498 trunc from 0x016009 to 0x030c1e (0x1ac16 bytes) 000259 1772471345.124739 mapwrite 0x00362b thru 0x00866e (0x5044 bytes) 000263 1772471345.190732 write 0x02ce78 thru 0x036b54 (0x9cdd bytes) 000266 1772471345.211606 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36b55): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b55): Mirror 2: 0x6c8a24 (stale) Mirror 3: 0x6c8a24 (stale) Mirror 4: 0xaf94cef6 (stale) Mirror 5: 0xaf94cef6 (stale) Mirror 6: 0xaf94cef6 (stale) Mirror 7: 0x420bc61 (stale) CRC-32 checksum value for chunk [0, 0x36b55): Mirror 1: 0xe8da6223 Mirror 8: 0xe8da6223 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b55: skipped 000267 1772471346.412544 mapwrite 0x031ef7 thru 0x03e9a5 (0xcaaf bytes) 000268 1772471346.643108 read 0x033ee0 thru 0x0340c8 (0x1e9 bytes) 000269 1772471346.644000 read 0x038285 thru 0x03e9a5 (0x6721 bytes) 000274 1772471346.650606 mapwrite 0x034c76 thru 0x03ffff (0xb38a bytes) 000275 1772471346.724683 read 0x01b0d5 thru 0x01f272 (0x419e bytes) 000279 1772471346.729314 write 0x010711 thru 0x01579c (0x508c bytes) 000280 1772471346.735919 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2a1d225b (stale) Mirror 3: 0x2a1d225b (stale) Mirror 4: 0x6de6bdbe (stale) Mirror 5: 0x6de6bdbe (stale) Mirror 6: 0x6de6bdbe (stale) Mirror 7: 0xcd7fdc68 (stale) Mirror 8: 0xfdc4f777 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3dff7c3e Mirror 9: 0x3dff7c3e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000281 1772471347.882073 mapwrite 0x03879a thru 0x03a215 (0x1a7c bytes) 000283 1772471348.397850 mapread 0x03ecb7 thru 0x03ffff (0x1349 bytes) 000284 1772471348.398965 read 0x00fb85 thru 0x014a6f (0x4eeb bytes) 000285 1772471348.428667 trunc from 0x040000 to 0x026357 (0x19ca8 bytes) 000286 1772471348.498635 write 0x01f14c thru 0x02f0a7 (0xff5c bytes) 000287 1772471348.518362 read 0x000b95 thru 0x005525 (0x4991 bytes) 000288 1772471348.537526 read 0x01db84 thru 0x021dc7 (0x4244 bytes) 000289 1772471348.538596 write 0x038af4 thru 0x03ffff (0x750c bytes) 000290 1772471348.544229 read 0x02d8aa thru 0x03ae19 (0xd570 bytes) 000293 1772471348.577606 read 0x01b5a8 thru 0x01ca0d (0x1466 bytes) 000294 1772471348.579619 read 0x0292b5 thru 0x0369ea (0xd736 bytes) 000295 1772471348.593889 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2a1d225b (stale) Mirror 3: 0x2a1d225b (stale) Mirror 4: 0x6de6bdbe (stale) Mirror 5: 0x6de6bdbe (stale) Mirror 6: 0x6de6bdbe (stale) Mirror 7: 0xcd7fdc68 (stale) Mirror 8: 0xfdc4f777 (stale) Mirror 9: 0x3dff7c3e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x84a84656 Mirror 10: 0x84a84656 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000298 1772471349.664933 trunc from 0x040000 to 0x03aff8 (0x5007 bytes) 000300 1772471349.798284 read 0x01f7bb thru 0x024dd4 (0x561a bytes) 000301 1772471349.810498 mapwrite 0x00e873 thru 0x01a009 (0xb797 bytes) 000302 1772471349.918252 mapwrite 0x03732d thru 0x03e483 (0x7157 bytes) 000304 1772471349.998278 mapwrite 0x00f5e1 thru 0x016313 (0x6d33 bytes) 000308 1772471350.045191 mapread 0x000e6e thru 0x00a489 (0x961c bytes) 000309 1772471350.056037 trunc from 0x03e484 to 0x028a42 (0x15a41 bytes) 000310 1772471350.079607 mapwrite 0x02dba9 thru 0x03a9ce (0xce26 bytes) 000311 1772471350.182056 mapread 0x01d6ab thru 0x02172e (0x4084 bytes) 000312 1772471350.190739 MIRROR_RESYNC 10 mirrors 000313 1772471351.842398 read 0x03a374 thru 0x03a9ce (0x65b bytes) 000315 1772471351.847307 trunc from 0x03a9cf to 0x03888a (0x2144 bytes) 000317 1772471351.931190 trunc from 0x03888b to 0x00cda7 (0x2bae3 bytes) 000318 1772471351.952460 mapwrite 0x0232a8 thru 0x030b87 (0xd8e0 bytes) 000319 1772471352.064509 mapread 0x001eb9 thru 0x00a2e1 (0x8429 bytes) 000324 1772471352.088105 trunc from 0x030b88 to 0x026113 (0xaa74 bytes) 000326 1772471352.107998 read 0x014ed8 thru 0x01c13b (0x7264 bytes) 000327 1772471352.147574 read 0x0007f8 thru 0x007a8d (0x7296 bytes) 000328 1772471352.148371 mapread 0x0235e8 thru 0x026113 (0x2b2c bytes) 000330 1772471352.170332 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x26114): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26114): Mirror 2: 0x963ca786 (stale) Mirror 3: 0x963ca786 (stale) Mirror 4: 0x963ca786 (stale) Mirror 5: 0x963ca786 (stale) Mirror 6: 0x963ca786 (stale) Mirror 7: 0x963ca786 (stale) Mirror 8: 0x963ca786 (stale) Mirror 9: 0x963ca786 (stale) Mirror 10: 0x963ca786 (stale) CRC-32 checksum value for chunk [0, 0x26114): Mirror 1: 0xb09ce8ca Mirror 11: 0xb09ce8ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26114: skipped 000331 1772471353.170454 mapwrite 0x027aeb thru 0x028797 (0xcad bytes) 000332 1772471353.472227 mapwrite 0x0073c1 thru 0x008975 (0x15b5 bytes) 000334 1772471353.519195 MIRROR_RESYNC 11 mirrors 000336 1772471356.101127 trunc from 0x028798 to 0x035e10 (0xd679 bytes) 000337 1772471356.180242 mapwrite 0x00ba47 thru 0x01b176 (0xf730 bytes) 000338 1772471356.291075 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e11): Mirror 2: 0xc5e94980 (stale) Mirror 3: 0xc5e94980 (stale) Mirror 4: 0xc5e94980 (stale) Mirror 6: 0xc5e94980 (stale) Mirror 7: 0xc5e94980 (stale) Mirror 8: 0xc5e94980 (stale) Mirror 9: 0xc5e94980 (stale) Mirror 10: 0xc5e94980 (stale) Mirror 11: 0xc5e94980 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e11): Mirror 2: 0xc5e94980 (stale) Mirror 3: 0xc5e94980 (stale) Mirror 4: 0xc5e94980 (stale) Mirror 6: 0xc5e94980 (stale) Mirror 7: 0xc5e94980 (stale) Mirror 8: 0xc5e94980 (stale) Mirror 9: 0xc5e94980 (stale) Mirror 10: 0xc5e94980 (stale) Mirror 11: 0xc5e94980 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e11: skipped 000339 1772471357.025287 trunc from 0x035e11 to 0x019e2b (0x1bfe5 bytes) 000340 1772471357.047316 write 0x0320f1 thru 0x036aef (0x49ff bytes) 000341 1772471357.056464 MIRROR_RESYNC 10 mirrors 000343 1772471358.572920 write 0x03cb47 thru 0x03ed7c (0x2236 bytes) 000344 1772471358.702935 mapread 0x02ac30 thru 0x0300e6 (0x54b7 bytes) 000346 1772471358.739326 read 0x00d24e thru 0x01979b (0xc54e bytes) 000348 1772471358.751027 mapwrite 0x016001 thru 0x01da42 (0x7a42 bytes) 000349 1772471358.851257 write 0x02c2f3 thru 0x03b2ef (0xeffd bytes) 000350 1772471358.857726 trunc from 0x03ed7d to 0x02c12e (0x12c4e bytes) 000351 1772471358.882413 trunc from 0x02c12f to 0x02b6aa (0xa84 bytes) 000353 1772471358.906618 MIRROR_RESYNC 10 mirrors 000355 1772471360.180057 mapread 0x02ad7d thru 0x02b6aa (0x92e bytes) 000356 1772471360.197308 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000358 1772471360.795591 mapwrite 0x0011e1 thru 0x004e8c (0x3cac bytes) 000361 1772471361.028956 read 0x020123 thru 0x025cc5 (0x5ba3 bytes) 000362 1772471361.042609 write 0x0192e1 thru 0x01bf4f (0x2c6f bytes) 000363 1772471361.064989 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2b6ab): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b6ab): Mirror 2: 0xf96c4171 (stale) Mirror 3: 0xf96c4171 (stale) Mirror 4: 0xf96c4171 (stale) Mirror 7: 0xf96c4171 (stale) Mirror 8: 0xf96c4171 (stale) Mirror 9: 0xf96c4171 (stale) Mirror 10: 0xf96c4171 (stale) Mirror 11: 0xf96c4171 (stale) CRC-32 checksum value for chunk [0, 0x2b6ab): Mirror 1: 0x4b5acec Mirror 12: 0x4b5acec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b6ab: skipped 000365 1772471362.716800 trunc from 0x02b6ab to 0x0241a4 (0x7506 bytes) 000367 1772471363.024039 trunc from 0x0241a5 to 0x018556 (0xbc4e bytes) 000370 1772471363.104612 mapwrite 0x036bf1 thru 0x03ffff (0x940f bytes) 000371 1772471363.259680 MIRROR_RESYNC 10 mirrors 000373 1772471365.167415 read 0x00d259 thru 0x0161eb (0x8f93 bytes) 000374 1772471365.182452 read 0x02809f thru 0x02aa46 (0x29a8 bytes) 000376 1772471365.200531 read 0x02f066 thru 0x033556 (0x44f1 bytes) 000383 1772471365.211968 MIRROR_EXTEND to 11 mirrors 000385 1772471366.127174 mapwrite 0x004295 thru 0x005458 (0x11c4 bytes) 000386 1772471366.378888 mapread 0x035b10 thru 0x039408 (0x38f9 bytes) 000391 1772471366.396087 trunc from 0x040000 to 0x0166cb (0x29934 bytes) 000394 1772471366.424289 mapread 0x0035d6 thru 0x00d14b (0x9b76 bytes) 000395 1772471366.427475 mapread 0x00ffb4 thru 0x0166cb (0x6718 bytes) 000398 1772471366.445525 mapwrite 0x01847b thru 0x019f7d (0x1b03 bytes) 000402 1772471366.532101 mapread 0x010398 thru 0x019f7d (0x9be6 bytes) 000404 1772471366.538641 write 0x004cce thru 0x00cbfe (0x7f31 bytes) 000406 1772471366.541003 read 0x018729 thru 0x019f7d (0x1855 bytes) 000408 1772471366.544557 trunc from 0x019f7e to 0x0335c3 (0x19646 bytes) 000411 1772471366.572046 write 0x02da99 thru 0x03617c (0x86e4 bytes) 000414 1772471366.587850 trunc from 0x03617d to 0x0125bd (0x23bbf bytes) 000415 1772471366.632636 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x125be): Mirror 2: 0x8cfe2f4a (stale) Mirror 3: 0x8cfe2f4a (stale) Mirror 7: 0x8cfe2f4a (stale) Mirror 8: 0x8cfe2f4a (stale) Mirror 9: 0x8cfe2f4a (stale) Mirror 10: 0x8cfe2f4a (stale) Mirror 11: 0x8cfe2f4a (stale) Mirror 12: 0x8cfe2f4a (stale) Mirror 13: 0x8cfe2f4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x125be): Mirror 2: 0x8cfe2f4a (stale) Mirror 3: 0x8cfe2f4a (stale) Mirror 7: 0x8cfe2f4a (stale) Mirror 8: 0x8cfe2f4a (stale) Mirror 9: 0x8cfe2f4a (stale) Mirror 10: 0x8cfe2f4a (stale) Mirror 11: 0x8cfe2f4a (stale) Mirror 12: 0x8cfe2f4a (stale) Mirror 13: 0x8cfe2f4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x125be: skipped 000417 1772471367.394383 write 0x02aeeb thru 0x039f64 (0xf07a bytes) 000419 1772471367.399129 mapwrite 0x00ea1c thru 0x01bf07 (0xd4ec bytes) 000420 1772471367.587768 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x39f65): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39f65): Mirror 2: 0xc1a11e97 (stale) Mirror 3: 0xc1a11e97 (stale) Mirror 7: 0xc1a11e97 (stale) Mirror 8: 0xc1a11e97 (stale) Mirror 9: 0xc1a11e97 (stale) Mirror 10: 0xc1a11e97 (stale) Mirror 11: 0xc1a11e97 (stale) Mirror 12: 0xc1a11e97 (stale) Mirror 13: 0xc1a11e97 (stale) CRC-32 checksum value for chunk [0, 0x39f65): Mirror 1: 0x23df776 Mirror 14: 0x23df776 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39f65: skipped 000421 1772471369.039821 MIRROR_RESYNC 11 mirrors 000422 1772471371.692894 mapwrite 0x039cc6 thru 0x03ffff (0x633a bytes) 000426 1772471371.948492 read 0x02d90e thru 0x03ad03 (0xd3f6 bytes) 000427 1772471371.973791 read 0x032ba3 thru 0x03e2c0 (0xb71e bytes) 000428 1772471371.975483 read 0x015148 thru 0x0191d2 (0x408b bytes) 000429 1772471371.999538 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x207e07c9 (stale) Mirror 3: 0x207e07c9 (stale) Mirror 7: 0x207e07c9 (stale) Mirror 8: 0x207e07c9 (stale) Mirror 9: 0x207e07c9 (stale) Mirror 10: 0x207e07c9 (stale) Mirror 11: 0x207e07c9 (stale) Mirror 12: 0x207e07c9 (stale) Mirror 13: 0x207e07c9 (stale) Mirror 14: 0x207e07c9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd83429de Mirror 15: 0xd83429de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000431 1772471374.145406 write 0x0038f3 thru 0x011569 (0xdc77 bytes) 000432 1772471374.382183 mapwrite 0x0342e3 thru 0x03b650 (0x736e bytes) 000433 1772471374.539794 mapwrite 0x0393e4 thru 0x03ffff (0x6c1c bytes) 000434 1772471374.686968 mapwrite 0x0185be thru 0x01d81a (0x525d bytes) 000435 1772471374.850404 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x207e07c9 (stale) Mirror 3: 0x207e07c9 (stale) Mirror 7: 0x207e07c9 (stale) Mirror 8: 0x207e07c9 (stale) Mirror 9: 0x207e07c9 (stale) Mirror 10: 0x207e07c9 (stale) Mirror 11: 0x207e07c9 (stale) Mirror 13: 0x207e07c9 (stale) Mirror 14: 0x207e07c9 (stale) Mirror 15: 0xd83429de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x207e07c9 (stale) Mirror 3: 0x207e07c9 (stale) Mirror 7: 0x207e07c9 (stale) Mirror 8: 0x207e07c9 (stale) Mirror 9: 0x207e07c9 (stale) Mirror 10: 0x207e07c9 (stale) Mirror 11: 0x207e07c9 (stale) Mirror 13: 0x207e07c9 (stale) Mirror 14: 0x207e07c9 (stale) Mirror 15: 0xd83429de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000437 1772471375.963572 write 0x01a5b3 thru 0x020136 (0x5b84 bytes) 000439 1772471375.978365 trunc from 0x040000 to 0x02d4a9 (0x12b56 bytes) 000440 1772471375.999620 write 0x01e7ed thru 0x02891f (0xa133 bytes) 000441 1772471376.009537 mapread 0x01ed34 thru 0x02a08a (0xb357 bytes) 000444 1772471376.024585 read 0x027d12 thru 0x02d4a9 (0x5798 bytes) 000445 1772471376.025941 mapwrite 0x01c08b thru 0x01d8ee (0x1864 bytes) 000446 1772471376.074219 mapread 0x0222b0 thru 0x02c20a (0x9f5b bytes) 000447 1772471376.075962 read 0x001294 thru 0x00198d (0x6fa bytes) 000448 1772471376.086394 read 0x01c6d0 thru 0x01f012 (0x2943 bytes) 000452 1772471376.089213 read 0x002c97 thru 0x008f02 (0x626c bytes) 000453 1772471376.090633 mapread 0x0200ba thru 0x0229b6 (0x28fd bytes) 000455 1772471376.097872 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d4aa): Mirror 3: 0x8fa6c412 (stale) Mirror 7: 0x8fa6c412 (stale) Mirror 8: 0x8fa6c412 (stale) Mirror 9: 0x8fa6c412 (stale) Mirror 10: 0x8fa6c412 (stale) Mirror 11: 0x8fa6c412 (stale) Mirror 13: 0x8fa6c412 (stale) Mirror 14: 0x8fa6c412 (stale) Mirror 15: 0x8fa6c412 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d4aa): Mirror 3: 0x8fa6c412 (stale) Mirror 7: 0x8fa6c412 (stale) Mirror 8: 0x8fa6c412 (stale) Mirror 9: 0x8fa6c412 (stale) Mirror 10: 0x8fa6c412 (stale) Mirror 11: 0x8fa6c412 (stale) Mirror 13: 0x8fa6c412 (stale) Mirror 14: 0x8fa6c412 (stale) Mirror 15: 0x8fa6c412 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d4aa: skipped 000456 1772471376.802202 mapwrite 0x019532 thru 0x01f0eb (0x5bba bytes) 000457 1772471376.913506 mapwrite 0x00a076 thru 0x015e93 (0xbe1e bytes) 000461 1772471377.012453 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2d4aa): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d4aa): Mirror 3: 0x8fa6c412 (stale) Mirror 7: 0x8fa6c412 (stale) Mirror 8: 0x8fa6c412 (stale) Mirror 9: 0x8fa6c412 (stale) Mirror 10: 0x8fa6c412 (stale) Mirror 11: 0x8fa6c412 (stale) Mirror 13: 0x8fa6c412 (stale) Mirror 14: 0x8fa6c412 (stale) Mirror 15: 0x8fa6c412 (stale) CRC-32 checksum value for chunk [0, 0x2d4aa): Mirror 1: 0x38da5c73 Mirror 16: 0x38da5c73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d4aa: skipped 000463 1772471378.339736 read 0x01491a thru 0x01b2ec (0x69d3 bytes) 000464 1772471378.370640 mapread 0x00b262 thru 0x017257 (0xbff6 bytes) 000465 1772471378.434257 mapwrite 0x014cf1 thru 0x0179a8 (0x2cb8 bytes) 000466 1772471378.614949 read 0x001578 thru 0x003876 (0x22ff bytes) 000467 1772471378.630050 write 0x01b59b thru 0x021ba6 (0x660c bytes) 000468 1772471378.644906 MIRROR_RESYNC 11 mirrors 000469 1772471380.980930 write 0x033c33 thru 0x03c430 (0x87fe bytes) 000470 1772471381.120298 read 0x0341b3 thru 0x03838b (0x41d9 bytes) 000471 1772471381.126116 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c431): Mirror 3: 0x3e2601d6 (stale) Mirror 7: 0x3e2601d6 (stale) Mirror 8: 0x3e2601d6 (stale) Mirror 9: 0x3e2601d6 (stale) Mirror 11: 0x3e2601d6 (stale) Mirror 13: 0x3e2601d6 (stale) Mirror 14: 0x3e2601d6 (stale) Mirror 15: 0x3e2601d6 (stale) Mirror 16: 0x3e2601d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c431): Mirror 3: 0x3e2601d6 (stale) Mirror 7: 0x3e2601d6 (stale) Mirror 8: 0x3e2601d6 (stale) Mirror 9: 0x3e2601d6 (stale) Mirror 11: 0x3e2601d6 (stale) Mirror 13: 0x3e2601d6 (stale) Mirror 14: 0x3e2601d6 (stale) Mirror 15: 0x3e2601d6 (stale) Mirror 16: 0x3e2601d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c431: skipped 000473 1772471382.323432 mapwrite 0x003bad thru 0x0086ea (0x4b3e bytes) 000474 1772471382.467592 trunc from 0x03c431 to 0x01c0ee (0x20342 bytes) 000475 1772471382.502859 read 0x00c116 thru 0x00d2e9 (0x11d4 bytes) 000478 1772471382.524603 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1c0ef): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c0ef): Mirror 3: 0xfa273367 (stale) Mirror 7: 0xfa273367 (stale) Mirror 8: 0xfa273367 (stale) Mirror 9: 0xfa273367 (stale) Mirror 11: 0xfa273367 (stale) Mirror 13: 0xfa273367 (stale) Mirror 14: 0xfa273367 (stale) Mirror 15: 0xfa273367 (stale) Mirror 16: 0xfa273367 (stale) CRC-32 checksum value for chunk [0, 0x1c0ef): Mirror 1: 0xcf6070f1 Mirror 17: 0xcf6070f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c0ef: skipped 000484 1772471384.219923 mapwrite 0x01f305 thru 0x0224bb (0x31b7 bytes) 000485 1772471384.497533 trunc from 0x0224bc to 0x03ac3b (0x18780 bytes) 000488 1772471384.528483 write 0x015958 thru 0x01e382 (0x8a2b bytes) 000490 1772471384.541604 write 0x03ca70 thru 0x03ee83 (0x2414 bytes) 000494 1772471384.547507 trunc from 0x03ee84 to 0x035519 (0x996a bytes) 000497 1772471384.581121 trunc from 0x03551a to 0x00f0ce (0x2644b bytes) 000498 1772471384.620475 trunc from 0x00f0cf to 0x02584d (0x1677f bytes) 000500 1772471384.665078 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2584e): Mirror 3: 0x9f2be83d (stale) Mirror 7: 0x9f2be83d (stale) Mirror 8: 0x9f2be83d (stale) Mirror 9: 0x9f2be83d (stale) Mirror 11: 0x9f2be83d (stale) Mirror 13: 0x9f2be83d (stale) Mirror 14: 0x9f2be83d (stale) Mirror 15: 0x9f2be83d (stale) Mirror 16: 0x9f2be83d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2584e): Mirror 3: 0x9f2be83d (stale) Mirror 7: 0x9f2be83d (stale) Mirror 8: 0x9f2be83d (stale) Mirror 9: 0x9f2be83d (stale) Mirror 11: 0x9f2be83d (stale) Mirror 13: 0x9f2be83d (stale) Mirror 14: 0x9f2be83d (stale) Mirror 15: 0x9f2be83d (stale) Mirror 16: 0x9f2be83d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2584e: skipped 000503 1772471385.522927 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2584e): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2584e): Mirror 3: 0x9f2be83d (stale) Mirror 7: 0x9f2be83d (stale) Mirror 8: 0x9f2be83d (stale) Mirror 9: 0x9f2be83d (stale) Mirror 11: 0x9f2be83d (stale) Mirror 13: 0x9f2be83d (stale) Mirror 14: 0x9f2be83d (stale) Mirror 15: 0x9f2be83d (stale) Mirror 16: 0x9f2be83d (stale) CRC-32 checksum value for chunk [0, 0x2584e): Mirror 1: 0x24cc7823 Mirror 17: 0x24cc7823 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2584e: skipped 000506 1772471387.257457 mapread 0x01a6e7 thru 0x02382c (0x9146 bytes) 000508 1772471387.361201 mapwrite 0x016a84 thru 0x01c5dc (0x5b59 bytes) 000509 1772471387.553302 trunc from 0x02584e to 0x038c17 (0x133ca bytes) 000510 1772471387.586428 trunc from 0x038c18 to 0x02742f (0x117e8 bytes) 000514 1772471387.616539 mapwrite 0x019882 thru 0x01fd56 (0x64d5 bytes) 000515 1772471387.679346 read 0x01fc8c thru 0x026740 (0x6ab5 bytes) 000516 1772471387.680798 trunc from 0x027430 to 0x0209a2 (0x6a8d bytes) 000517 1772471387.698292 mapread 0x01cb4b thru 0x01e867 (0x1d1d bytes) 000518 1772471387.705677 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x209a3): Mirror 3: 0xba010572 (stale) Mirror 7: 0xba010572 (stale) Mirror 8: 0xba010572 (stale) Mirror 9: 0xba010572 (stale) Mirror 13: 0xba010572 (stale) Mirror 14: 0xba010572 (stale) Mirror 15: 0xba010572 (stale) Mirror 16: 0xba010572 (stale) Mirror 17: 0x4e4e4da1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x209a3): Mirror 3: 0xba010572 (stale) Mirror 7: 0xba010572 (stale) Mirror 8: 0xba010572 (stale) Mirror 9: 0xba010572 (stale) Mirror 13: 0xba010572 (stale) Mirror 14: 0xba010572 (stale) Mirror 15: 0xba010572 (stale) Mirror 16: 0xba010572 (stale) Mirror 17: 0x4e4e4da1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x209a3: skipped 000519 1772471388.245425 write 0x01738d thru 0x01d663 (0x62d7 bytes) 000520 1772471388.266573 trunc from 0x0209a3 to 0x03c16b (0x1b7c9 bytes) 000521 1772471388.294424 mapwrite 0x007ed1 thru 0x01151a (0x964a bytes) 000522 1772471388.371374 write 0x016045 thru 0x024082 (0xe03e bytes) 000524 1772471388.382017 write 0x012737 thru 0x017a78 (0x5342 bytes) 000526 1772471388.384503 mapread 0x02e22d thru 0x03b938 (0xd70c bytes) 000529 1772471388.417272 write 0x021808 thru 0x02f3c4 (0xdbbd bytes) 000530 1772471388.421257 trunc from 0x03c16c to 0x00a5d3 (0x31b98 bytes) 000531 1772471388.447261 trunc from 0x00a5d4 to 0x007fa5 (0x262e bytes) 000532 1772471388.475679 trunc from 0x007fa6 to 0x03be4b (0x33ea6 bytes) 000535 1772471388.497073 read 0x00500e thru 0x00e5b9 (0x95ac bytes) 000536 1772471388.515519 read 0x002218 thru 0x0105fc (0xe3e5 bytes) 000537 1772471388.538494 mapwrite 0x027f3d thru 0x02a1b4 (0x2278 bytes) 000539 1772471388.586685 read 0x008814 thru 0x013d69 (0xb556 bytes) 000541 1772471388.590161 trunc from 0x03be4c to 0x0198c5 (0x22586 bytes) 000543 1772471388.610318 write 0x0389f3 thru 0x03ffff (0x760d bytes) 000545 1772471388.613984 mapread 0x02d036 thru 0x033d50 (0x6d1b bytes) 000547 1772471388.626050 write 0x0083db thru 0x0089d2 (0x5f8 bytes) 000548 1772471388.627392 mapwrite 0x0287ef thru 0x02acbb (0x24cd bytes) 000549 1772471388.681296 read 0x01bc6c thru 0x01fad4 (0x3e69 bytes) 000550 1772471388.683030 write 0x03caa9 thru 0x03ffff (0x3557 bytes) 000551 1772471388.686453 mapread 0x00b950 thru 0x010dff (0x54b0 bytes) 000552 1772471388.689528 trunc from 0x040000 to 0x013bf6 (0x2c409 bytes) 000554 1772471388.709271 mapread 0x012edb thru 0x013bf6 (0xd1c bytes) 000556 1772471388.719672 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x13bf7): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13bf7): Mirror 3: 0x97771fde (stale) Mirror 7: 0x97771fde (stale) Mirror 8: 0x97771fde (stale) Mirror 9: 0x97771fde (stale) Mirror 13: 0x97771fde (stale) Mirror 14: 0x97771fde (stale) Mirror 15: 0x97771fde (stale) Mirror 16: 0x97771fde (stale) Mirror 17: 0x9d3732ed (stale) CRC-32 checksum value for chunk [0, 0x13bf7): Mirror 1: 0xc04a0301 Mirror 18: 0xc04a0301 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13bf7: skipped 000558 1772471389.640840 write 0x021a59 thru 0x02c0a2 (0xa64a bytes) 000559 1772471389.715753 trunc from 0x02c0a3 to 0x0100c9 (0x1bfd9 bytes) 000560 1772471389.745264 mapwrite 0x0177d4 thru 0x024dd8 (0xd605 bytes) 000563 1772471389.871381 mapwrite 0x017570 thru 0x01864c (0x10dd bytes) 000564 1772471389.920783 mapwrite 0x024ab0 thru 0x028405 (0x3956 bytes) 000565 1772471390.005255 mapread 0x01807d thru 0x02761e (0xf5a2 bytes) 000568 1772471390.009673 read 0x021a8d thru 0x028405 (0x6979 bytes) 000569 1772471390.010642 mapread 0x008085 thru 0x0094d9 (0x1455 bytes) 000572 1772471390.032448 mapread 0x018756 thru 0x01b0de (0x2989 bytes) 000573 1772471390.034975 mapwrite 0x02a3e8 thru 0x0398e1 (0xf4fa bytes) 000575 1772471390.139437 mapwrite 0x039851 thru 0x03ffff (0x67af bytes) 000576 1772471390.259799 read 0x0240ca thru 0x026415 (0x234c bytes) 000577 1772471390.261328 mapwrite 0x002b61 thru 0x003b08 (0xfa8 bytes) 000578 1772471390.318051 write 0x02d584 thru 0x03d1e9 (0xfc66 bytes) 000579 1772471390.319675 mapread 0x03320c thru 0x03ffff (0xcdf4 bytes) 000581 1772471390.323248 trunc from 0x040000 to 0x00f4ac (0x30b53 bytes) 000582 1772471390.336672 mapwrite 0x0030c0 thru 0x00b857 (0x8798 bytes) 000583 1772471390.407042 MIRROR_RESYNC 11 mirrors 000585 1772471392.047480 mapwrite 0x013d02 thru 0x023589 (0xf888 bytes) 000586 1772471392.237211 MIRROR_RESYNC 11 mirrors 000588 1772471394.347376 trunc from 0x02358a to 0x002595 (0x20ff4 bytes) 000589 1772471394.510894 write 0x024bdd thru 0x0304a8 (0xb8cc bytes) 000590 1772471394.536228 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x304a9): Mirror 3: 0xd3346d43 (stale) Mirror 7: 0xd3346d43 (stale) Mirror 8: 0xd3346d43 (stale) Mirror 9: 0xd3346d43 (stale) Mirror 13: 0xd3346d43 (stale) Mirror 14: 0xd3346d43 (stale) Mirror 15: 0xd3346d43 (stale) Mirror 16: 0xd3346d43 (stale) Mirror 18: 0xd3346d43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x304a9): Mirror 3: 0xd3346d43 (stale) Mirror 7: 0xd3346d43 (stale) Mirror 8: 0xd3346d43 (stale) Mirror 9: 0xd3346d43 (stale) Mirror 13: 0xd3346d43 (stale) Mirror 14: 0xd3346d43 (stale) Mirror 15: 0xd3346d43 (stale) Mirror 16: 0xd3346d43 (stale) Mirror 18: 0xd3346d43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x304a9: skipped 000593 1772471395.255541 MIRROR_RESYNC 10 mirrors 000594 1772471397.251821 trunc from 0x0304a9 to 0x0107ec (0x1fcbc bytes) 000597 1772471397.353172 mapwrite 0x03736a thru 0x03ffff (0x8c96 bytes) 000599 1772471397.484570 write 0x000c59 thru 0x010654 (0xf9fc bytes) 000603 1772471397.509911 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcc4f0c12 (stale) Mirror 7: 0xcc4f0c12 (stale) Mirror 8: 0xcc4f0c12 (stale) Mirror 9: 0xcc4f0c12 (stale) Mirror 13: 0xcc4f0c12 (stale) Mirror 14: 0xcc4f0c12 (stale) Mirror 15: 0xcc4f0c12 (stale) Mirror 18: 0xcc4f0c12 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcc4f0c12 (stale) Mirror 7: 0xcc4f0c12 (stale) Mirror 8: 0xcc4f0c12 (stale) Mirror 9: 0xcc4f0c12 (stale) Mirror 13: 0xcc4f0c12 (stale) Mirror 14: 0xcc4f0c12 (stale) Mirror 15: 0xcc4f0c12 (stale) Mirror 18: 0xcc4f0c12 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000605 1772471398.091812 write 0x035a59 thru 0x03e9d8 (0x8f80 bytes) 000606 1772471398.120939 mapwrite 0x025f78 thru 0x02e85e (0x88e7 bytes) 000608 1772471398.254617 trunc from 0x040000 to 0x00c228 (0x33dd7 bytes) 000609 1772471398.283426 read 0x00b62e thru 0x00c228 (0xbfb bytes) 000610 1772471398.293918 read 0x003694 thru 0x005c8d (0x25fa bytes) 000611 1772471398.313853 write 0x024c31 thru 0x0307d4 (0xbba4 bytes) 000612 1772471398.316055 trunc from 0x0307d5 to 0x015d7c (0x1aa58 bytes) 000614 1772471398.355807 mapread 0x006b31 thru 0x0114c0 (0xa990 bytes) 000616 1772471398.389205 write 0x02593b thru 0x027df9 (0x24bf bytes) 000617 1772471398.390443 read 0x0276a3 thru 0x027df9 (0x757 bytes) 000618 1772471398.402244 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27dfa): Mirror 7: 0x25e767 (stale) Mirror 8: 0x25e767 (stale) Mirror 9: 0x25e767 (stale) Mirror 13: 0x25e767 (stale) Mirror 14: 0x25e767 (stale) Mirror 15: 0x25e767 (stale) Mirror 18: 0x25e767 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27dfa): Mirror 7: 0x25e767 (stale) Mirror 8: 0x25e767 (stale) Mirror 9: 0x25e767 (stale) Mirror 13: 0x25e767 (stale) Mirror 14: 0x25e767 (stale) Mirror 15: 0x25e767 (stale) Mirror 18: 0x25e767 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27dfa: skipped 000620 1772471399.286090 MIRROR_RESYNC 8 mirrors 000622 1772471400.817152 mapwrite 0x003874 thru 0x011057 (0xd7e4 bytes) 000623 1772471401.033249 mapread 0x00d34b thru 0x00dd7d (0xa33 bytes) 000624 1772471401.034416 read 0x01f1a3 thru 0x0210e6 (0x1f44 bytes) 000625 1772471401.042304 mapread 0x01e17f thru 0x027df9 (0x9c7b bytes) 000627 1772471401.059974 write 0x037cdc thru 0x03ffff (0x8324 bytes) 000628 1772471401.061615 mapwrite 0x030352 thru 0x038089 (0x7d38 bytes) 000630 1772471401.164265 write 0x0174cb thru 0x0177b5 (0x2eb bytes) 000631 1772471401.173542 MIRROR_RESYNC 8 mirrors 000632 1772471402.272723 MIRROR_RESYNC 8 mirrors 000633 1772471403.096224 read 0x01280e thru 0x01c8b2 (0xa0a5 bytes) 000636 1772471403.109053 trunc from 0x040000 to 0x0095b1 (0x36a4e bytes) 000637 1772471403.270162 mapwrite 0x01dabf thru 0x027101 (0x9643 bytes) 000638 1772471403.372367 read 0x0056c8 thru 0x006ea3 (0x17dc bytes) 000639 1772471403.385078 write 0x037c0d thru 0x03ffff (0x83f3 bytes) 000644 1772471403.390852 mapwrite 0x02f136 thru 0x03e72d (0xf5f8 bytes) 000645 1772471403.445072 trunc from 0x040000 to 0x01c6eb (0x23914 bytes) 000647 1772471403.461524 mapread 0x014fe8 thru 0x015fb1 (0xfca bytes) 000648 1772471403.462535 read 0x009bd4 thru 0x00fb89 (0x5fb6 bytes) 000649 1772471403.464153 mapread 0x00854e thru 0x017666 (0xf119 bytes) 000651 1772471403.470034 trunc from 0x01c6ec to 0x01e95f (0x2274 bytes) 000652 1772471403.488346 trunc from 0x01e960 to 0x0367ac (0x17e4d bytes) 000657 1772471403.545251 read 0x02d7b1 thru 0x0334b9 (0x5d09 bytes) 000658 1772471403.580816 read 0x0296ab thru 0x035202 (0xbb58 bytes) 000660 1772471403.582610 read 0x008451 thru 0x01260b (0xa1bb bytes) 000661 1772471403.591136 write 0x02ef8c thru 0x0351ea (0x625f bytes) 000664 1772471403.598914 mapread 0x02a493 thru 0x03285a (0x83c8 bytes) 000665 1772471403.600324 trunc from 0x0367ad to 0x00d2b4 (0x294f8 bytes) 000667 1772471403.638058 mapread 0x004891 thru 0x00d2b4 (0x8a24 bytes) 000669 1772471403.643398 trunc from 0x00d2b5 to 0x02becd (0x1ec19 bytes) 000670 1772471403.669089 read 0x004b0e thru 0x004e51 (0x344 bytes) 000671 1772471403.670556 trunc from 0x02bece to 0x029385 (0x2b48 bytes) 000672 1772471403.691472 MIRROR_RESYNC 8 mirrors 000673 1772471405.353244 mapwrite 0x034482 thru 0x03b7bd (0x733c bytes) 000677 1772471405.696344 write 0x03eb78 thru 0x03ffff (0x1488 bytes) 000678 1772471405.702894 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x42c55ec3 (stale) Mirror 8: 0x42c55ec3 (stale) Mirror 9: 0x42c55ec3 (stale) Mirror 13: 0x42c55ec3 (stale) Mirror 14: 0x42c55ec3 (stale) Mirror 15: 0x42c55ec3 (stale) Mirror 18: 0x42c55ec3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x46d7d7d6 Mirror 19: 0x46d7d7d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000680 1772471407.212116 write 0x002c66 thru 0x00c992 (0x9d2d bytes) 000681 1772471407.371899 mapwrite 0x030204 thru 0x032a33 (0x2830 bytes) 000686 1772471407.524271 mapwrite 0x026a23 thru 0x0312e1 (0xa8bf bytes) 000687 1772471407.585294 mapwrite 0x02e088 thru 0x03c5e2 (0xe55b bytes) 000689 1772471407.726185 mapread 0x025f49 thru 0x030d03 (0xadbb bytes) 000694 1772471407.741154 mapread 0x0292ff thru 0x02d2a1 (0x3fa3 bytes) 000695 1772471407.747650 write 0x00c8e9 thru 0x00ecc2 (0x23da bytes) 000697 1772471407.785984 MIRROR_RESYNC 9 mirrors 000700 1772471409.473949 mapread 0x00218c thru 0x002e6d (0xce2 bytes) 000701 1772471409.481360 mapwrite 0x0073bc thru 0x01687a (0xf4bf bytes) 000702 1772471409.743343 mapwrite 0x02873d thru 0x02e084 (0x5948 bytes) 000703 1772471409.838952 MIRROR_RESYNC 9 mirrors 000706 1772471411.589320 read 0x00334e thru 0x006d0c (0x39bf bytes) 000707 1772471411.603105 trunc from 0x040000 to 0x0254bc (0x1ab43 bytes) 000708 1772471411.827139 mapwrite 0x0397c1 thru 0x03f7f6 (0x6036 bytes) 000710 1772471412.003665 mapread 0x00ff1f thru 0x01aeb0 (0xaf92 bytes) 000711 1772471412.067040 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f7f7): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f7f7): Mirror 7: 0x8d8b691d (stale) Mirror 8: 0x8d8b691d (stale) Mirror 9: 0x8d8b691d (stale) Mirror 13: 0x8d8b691d (stale) Mirror 14: 0x8d8b691d (stale) Mirror 15: 0x8d8b691d (stale) Mirror 18: 0x8d8b691d (stale) Mirror 19: 0x8d8b691d (stale) CRC-32 checksum value for chunk [0, 0x3f7f7): Mirror 1: 0x9fd3390d Mirror 20: 0x9fd3390d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f7f7: skipped 000712 1772471413.978592 mapwrite 0x03054a thru 0x038eba (0x8971 bytes) 000714 1772471414.289942 read 0x001e74 thru 0x01097c (0xeb09 bytes) 000715 1772471414.305274 mapread 0x026e29 thru 0x02a0c7 (0x329f bytes) 000716 1772471414.328031 mapread 0x03677a thru 0x0371be (0xa45 bytes) 000717 1772471414.331613 write 0x034825 thru 0x03ffff (0xb7db bytes) 000721 1772471414.344245 trunc from 0x040000 to 0x031faa (0xe055 bytes) 000724 1772471414.412543 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31fab): Mirror 7: 0x4224cdb5 (stale) Mirror 8: 0x4224cdb5 (stale) Mirror 9: 0x4224cdb5 (stale) Mirror 14: 0x4224cdb5 (stale) Mirror 15: 0x4224cdb5 (stale) Mirror 18: 0x4224cdb5 (stale) Mirror 19: 0x4224cdb5 (stale) Mirror 20: 0xcdf6d0f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fab): Mirror 7: 0x4224cdb5 (stale) Mirror 8: 0x4224cdb5 (stale) Mirror 9: 0x4224cdb5 (stale) Mirror 14: 0x4224cdb5 (stale) Mirror 15: 0x4224cdb5 (stale) Mirror 18: 0x4224cdb5 (stale) Mirror 19: 0x4224cdb5 (stale) Mirror 20: 0xcdf6d0f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fab: skipped 000725 1772471415.265197 mapread 0x00d711 thru 0x0101aa (0x2a9a bytes) 000727 1772471415.293574 mapread 0x013839 thru 0x01e8a5 (0xb06d bytes) 000728 1772471415.308214 trunc from 0x031fab to 0x02e247 (0x3d63 bytes) 000729 1772471415.337250 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e248): Mirror 7: 0xbe7315f4 (stale) Mirror 8: 0xbe7315f4 (stale) Mirror 9: 0xbe7315f4 (stale) Mirror 14: 0xbe7315f4 (stale) Mirror 18: 0xbe7315f4 (stale) Mirror 19: 0xbe7315f4 (stale) Mirror 20: 0x43d00d52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e248): Mirror 7: 0xbe7315f4 (stale) Mirror 8: 0xbe7315f4 (stale) Mirror 9: 0xbe7315f4 (stale) Mirror 14: 0xbe7315f4 (stale) Mirror 18: 0xbe7315f4 (stale) Mirror 19: 0xbe7315f4 (stale) Mirror 20: 0x43d00d52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e248: skipped 000730 1772471415.988064 trunc from 0x02e248 to 0x019bc9 (0x1467e bytes) 000731 1772471416.025459 read 0x0102f5 thru 0x019bc9 (0x98d5 bytes) 000734 1772471416.041981 mapwrite 0x021b5b thru 0x02855d (0x6a03 bytes) 000735 1772471416.257648 read 0x00bd1a thru 0x016ef6 (0xb1dd bytes) 000737 1772471416.293205 mapwrite 0x02e452 thru 0x0327ee (0x439d bytes) 000740 1772471416.427779 read 0x01ff12 thru 0x021971 (0x1a60 bytes) 000741 1772471416.428498 read 0x0004d3 thru 0x00652b (0x6059 bytes) 000743 1772471416.432085 trunc from 0x0327ef to 0x03d01f (0xa831 bytes) 000744 1772471416.461761 trunc from 0x03d020 to 0x020f08 (0x1c117 bytes) 000745 1772471416.494228 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20f09): Mirror 7: 0x93573ae7 (stale) Mirror 9: 0x93573ae7 (stale) Mirror 14: 0x93573ae7 (stale) Mirror 18: 0x93573ae7 (stale) Mirror 19: 0x93573ae7 (stale) Mirror 20: 0x93573ae7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20f09): Mirror 7: 0x93573ae7 (stale) Mirror 9: 0x93573ae7 (stale) Mirror 14: 0x93573ae7 (stale) Mirror 18: 0x93573ae7 (stale) Mirror 19: 0x93573ae7 (stale) Mirror 20: 0x93573ae7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20f09: skipped 000747 1772471417.294912 write 0x00584c thru 0x00f532 (0x9ce7 bytes) 000749 1772471417.325289 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20f09): Mirror 7: 0x93573ae7 (stale) Mirror 9: 0x93573ae7 (stale) Mirror 14: 0x93573ae7 (stale) Mirror 18: 0x93573ae7 (stale) Mirror 19: 0x93573ae7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20f09): Mirror 7: 0x93573ae7 (stale) Mirror 9: 0x93573ae7 (stale) Mirror 14: 0x93573ae7 (stale) Mirror 18: 0x93573ae7 (stale) Mirror 19: 0x93573ae7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20f09: skipped 000753 1772471418.139769 read 0x014c3c thru 0x015dfa (0x11bf bytes) 000757 1772471418.156518 write 0x0114fb thru 0x01f0f0 (0xdbf6 bytes) 000758 1772471418.169447 read 0x01cbd1 thru 0x01f846 (0x2c76 bytes) 000759 1772471418.170489 write 0x014dfd thru 0x021eb0 (0xd0b4 bytes) 000760 1772471418.173513 write 0x01b4bb thru 0x02117c (0x5cc2 bytes) 000762 1772471418.176550 mapread 0x016ce1 thru 0x01f8ba (0x8bda bytes) 000765 1772471418.180866 mapwrite 0x01eefe thru 0x02cd7e (0xde81 bytes) 000767 1772471418.336758 write 0x00502e thru 0x00e8cb (0x989e bytes) 000770 1772471418.349503 MIRROR_RESYNC 6 mirrors 000772 1772471420.000891 mapread 0x022047 thru 0x02ba17 (0x99d1 bytes) 000773 1772471420.038849 mapread 0x01d5ce thru 0x02a6a2 (0xd0d5 bytes) 000774 1772471420.040849 trunc from 0x02cd7f to 0x01c0d1 (0x10cad bytes) 000777 1772471420.210681 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c0d2): Mirror 7: 0xeb3a5f83 (stale) Mirror 9: 0xeb3a5f83 (stale) Mirror 14: 0xeb3a5f83 (stale) Mirror 18: 0xeb3a5f83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c0d2): Mirror 7: 0xeb3a5f83 (stale) Mirror 9: 0xeb3a5f83 (stale) Mirror 14: 0xeb3a5f83 (stale) Mirror 18: 0xeb3a5f83 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c0d2: skipped 000779 1772471420.994564 write 0x038434 thru 0x03d05f (0x4c2c bytes) 000781 1772471421.015834 MIRROR_RESYNC 5 mirrors 000782 1772471422.499935 trunc from 0x03d060 to 0x01593b (0x27724 bytes) 000784 1772471422.605532 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1593c): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1593c): Mirror 7: 0x8cfa249c (stale) Mirror 9: 0x8cfa249c (stale) Mirror 14: 0x8cfa249c (stale) Mirror 18: 0x8cfa249c (stale) CRC-32 checksum value for chunk [0, 0x1593c): Mirror 1: 0x8cfa249c Mirror 19: 0x8cfa249c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1593c: skipped 000785 1772471424.051045 mapread 0x00192d thru 0x00a77e (0x8e52 bytes) 000786 1772471424.124203 write 0x03fec5 thru 0x03ffff (0x13b bytes) 000788 1772471424.243655 mapread 0x011a70 thru 0x0217c5 (0xfd56 bytes) 000791 1772471424.271029 mapwrite 0x02bd6d thru 0x030b0c (0x4da0 bytes) 000793 1772471424.353867 trunc from 0x040000 to 0x0155dc (0x2aa23 bytes) 000794 1772471424.394561 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x155dd): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x155dd): Mirror 7: 0x7095a07c (stale) Mirror 9: 0x7095a07c (stale) Mirror 14: 0x7095a07c (stale) Mirror 18: 0x7095a07c (stale) Mirror 19: 0x7095a07c (stale) CRC-32 checksum value for chunk [0, 0x155dd): Mirror 1: 0x7095a07c Mirror 20: 0x7095a07c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x155dd: skipped 000796 1772471425.440854 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x155dd): Mirror 9: 0x7095a07c (stale) Mirror 14: 0x7095a07c (stale) Mirror 18: 0x7095a07c (stale) Mirror 19: 0x7095a07c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x155dd): Mirror 9: 0x7095a07c (stale) Mirror 14: 0x7095a07c (stale) Mirror 18: 0x7095a07c (stale) Mirror 19: 0x7095a07c (stale) CRC-32 checksum value for chunk [0, 0x155dd): Mirror 1: 0x7095a07c Mirror 20: 0x7095a07c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x155dd: skipped 000797 1772471426.329228 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x155dd): Mirror 9: 0x7095a07c (stale) Mirror 18: 0x7095a07c (stale) Mirror 19: 0x7095a07c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x155dd): Mirror 9: 0x7095a07c (stale) Mirror 18: 0x7095a07c (stale) Mirror 19: 0x7095a07c (stale) CRC-32 checksum value for chunk [0, 0x155dd): Mirror 1: 0x7095a07c Mirror 20: 0x7095a07c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x155dd: skipped 000798 1772471427.451986 trunc from 0x0155dd to 0x009f7f (0xb65d bytes) 000801 1772471427.614468 mapread 0x000ec8 thru 0x002d90 (0x1ec9 bytes) 000802 1772471427.640958 mapwrite 0x0207ba thru 0x02c9ef (0xc236 bytes) 000803 1772471427.760802 write 0x00da85 thru 0x01babd (0xe039 bytes) 000805 1772471427.777591 read 0x0151c7 thru 0x01fa19 (0xa853 bytes) 000806 1772471427.780769 mapread 0x01bcf8 thru 0x0292ca (0xd5d3 bytes) 000810 1772471427.789510 read 0x024c61 thru 0x02c9ef (0x7d8f bytes) 000813 1772471427.794120 trunc from 0x02c9f0 to 0x017668 (0x15387 bytes) 000814 1772471427.811832 trunc from 0x017669 to 0x026c1c (0xf5b4 bytes) 000817 1772471427.845528 mapread 0x020576 thru 0x026c1c (0x66a7 bytes) 000819 1772471427.868259 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26c1d): Mirror 9: 0x8c205396 (stale) Mirror 18: 0x8c205396 (stale) Mirror 20: 0xb0294c7a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26c1d): Mirror 9: 0x8c205396 (stale) Mirror 18: 0x8c205396 (stale) Mirror 20: 0xb0294c7a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26c1d: skipped 000820 1772471428.533379 write 0x034f3f thru 0x037e41 (0x2f03 bytes) 000822 1772471428.538406 write 0x0165b2 thru 0x01b1f9 (0x4c48 bytes) 000825 1772471428.554086 mapread 0x028454 thru 0x0333b3 (0xaf60 bytes) 000826 1772471428.583849 MIRROR_RESYNC 4 mirrors 000827 1772471429.378525 read 0x01c8cb thru 0x024778 (0x7eae bytes) 000829 1772471429.390875 trunc from 0x037e42 to 0x02ce64 (0xafdd bytes) 000830 1772471429.450379 read 0x016b5d thru 0x020712 (0x9bb6 bytes) 000831 1772471429.467470 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 9: 0xa74de5ef (stale) Mirror 18: 0xa74de5ef (stale) Mirror 20: 0xa74de5ef (stale) CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 1: 0xa74de5ef Mirror 21: 0xa74de5ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce65: skipped 000832 1772471430.494950 write 0x0233de thru 0x02bf25 (0x8b48 bytes) 000834 1772471430.693761 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 9: 0xa74de5ef (stale) Mirror 18: 0xa74de5ef (stale) Mirror 20: 0xa74de5ef (stale) Mirror 21: 0xa74de5ef (stale) CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 1: 0xc6e29308 Mirror 22: 0xc6e29308 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce65: skipped 000835 1772471432.052008 MIRROR_RESYNC 6 mirrors 000836 1772471433.509522 read 0x027b75 thru 0x02ce64 (0x52f0 bytes) 000837 1772471433.543394 MIRROR_EXTEND to 7 mirrors 000839 1772471434.220496 write 0x0000d7 thru 0x00424c (0x4176 bytes) 000843 1772471434.322437 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 9: 0xc6e29308 (stale) Mirror 18: 0xc6e29308 (stale) Mirror 20: 0xc6e29308 (stale) Mirror 21: 0xc6e29308 (stale) Mirror 23: 0xc6e29308 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce65): Mirror 9: 0xc6e29308 (stale) Mirror 18: 0xc6e29308 (stale) Mirror 20: 0xc6e29308 (stale) Mirror 21: 0xc6e29308 (stale) Mirror 23: 0xc6e29308 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce65: skipped 000845 1772471434.761882 read 0x0148c4 thru 0x016923 (0x2060 bytes) 000846 1772471434.767039 read 0x01d52b thru 0x02b871 (0xe347 bytes) 000847 1772471434.777620 mapwrite 0x00555c thru 0x00a5c0 (0x5065 bytes) 000849 1772471434.847445 write 0x021c9b thru 0x02d015 (0xb37b bytes) 000850 1772471434.850090 read 0x00fca7 thru 0x01e10b (0xe465 bytes) 000851 1772471434.851505 mapwrite 0x00455d thru 0x00a6a9 (0x614d bytes) 000852 1772471434.913353 mapread 0x016e95 thru 0x01bb68 (0x4cd4 bytes) 000856 1772471434.918480 read 0x00f6f3 thru 0x012e4c (0x375a bytes) 000861 1772471434.927780 MIRROR_RESYNC 6 mirrors 000862 1772471435.932296 write 0x02e3f0 thru 0x032085 (0x3c96 bytes) 000864 1772471436.006905 mapread 0x0302b9 thru 0x032085 (0x1dcd bytes) 000867 1772471436.011405 read 0x029f35 thru 0x032085 (0x8151 bytes) 000868 1772471436.021288 trunc from 0x032086 to 0x022f85 (0xf100 bytes) 000870 1772471436.052296 read 0x01b814 thru 0x022f85 (0x7772 bytes) 000872 1772471436.092469 mapread 0x021396 thru 0x022f85 (0x1bf0 bytes) 000873 1772471436.094265 mapread 0x0155e0 thru 0x0196ad (0x40ce bytes) 000874 1772471436.100666 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22f86): Mirror 18: 0x9e626e60 (stale) Mirror 20: 0x9e626e60 (stale) Mirror 21: 0x9e626e60 (stale) Mirror 23: 0x9e626e60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22f86): Mirror 18: 0x9e626e60 (stale) Mirror 20: 0x9e626e60 (stale) Mirror 21: 0x9e626e60 (stale) Mirror 23: 0x9e626e60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22f86: skipped 000875 1772471436.507884 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x22f86): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22f86): Mirror 18: 0x9e626e60 (stale) Mirror 20: 0x9e626e60 (stale) Mirror 21: 0x9e626e60 (stale) Mirror 23: 0x9e626e60 (stale) CRC-32 checksum value for chunk [0, 0x22f86): Mirror 1: 0x9e626e60 Mirror 24: 0x9e626e60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22f86: skipped 000879 1772471437.769782 mapwrite 0x02d9f8 thru 0x038ad7 (0xb0e0 bytes) 000880 1772471438.083641 trunc from 0x038ad8 to 0x038368 (0x76f bytes) 000882 1772471438.142607 trunc from 0x038369 to 0x00ca45 (0x2b923 bytes) 000883 1772471438.198376 mapread 0x00bd23 thru 0x00ca45 (0xd23 bytes) 000885 1772471438.232681 read 0x00bf7c thru 0x00ca45 (0xaca bytes) 000886 1772471438.234793 read 0x00065d thru 0x00401b (0x39bf bytes) 000888 1772471438.244466 write 0x0069f2 thru 0x00be11 (0x5420 bytes) 000889 1772471438.245792 mapwrite 0x03acdc thru 0x03ffff (0x5324 bytes) 000891 1772471438.383035 mapwrite 0x006311 thru 0x011593 (0xb283 bytes) 000892 1772471438.470382 read 0x03e85d thru 0x03ffff (0x17a3 bytes) 000893 1772471438.477241 MIRROR_RESYNC 6 mirrors 000894 1772471440.511221 mapwrite 0x00f9fc thru 0x011d62 (0x2367 bytes) 000898 1772471440.829832 mapread 0x01966b thru 0x01ed04 (0x569a bytes) 000899 1772471440.845952 mapread 0x013840 thru 0x015969 (0x212a bytes) 000900 1772471440.847164 trunc from 0x040000 to 0x0358d8 (0xa727 bytes) 000901 1772471440.890834 mapwrite 0x03c753 thru 0x03ffff (0x38ad bytes) 000904 1772471441.029346 mapwrite 0x03fbe6 thru 0x03ffff (0x41a bytes) 000905 1772471441.155101 write 0x02b3e9 thru 0x039de7 (0xe9ff bytes) 000907 1772471441.179404 write 0x03094f thru 0x03f8c8 (0xef7a bytes) 000908 1772471441.183353 mapread 0x022883 thru 0x026b85 (0x4303 bytes) 000910 1772471441.194299 write 0x0216a7 thru 0x02c5c5 (0xaf1f bytes) 000911 1772471441.198447 read 0x0102f1 thru 0x01ed4f (0xea5f bytes) 000912 1772471441.200049 read 0x02de21 thru 0x035f30 (0x8110 bytes) 000915 1772471441.211835 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x5c316303 (stale) Mirror 21: 0x5c316303 (stale) Mirror 23: 0x5c316303 (stale) Mirror 24: 0x5c316303 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x5c316303 (stale) Mirror 21: 0x5c316303 (stale) Mirror 23: 0x5c316303 (stale) Mirror 24: 0x5c316303 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000916 1772471441.748143 write 0x016c7f thru 0x01e9e5 (0x7d67 bytes) 000917 1772471441.768630 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x5c316303 (stale) Mirror 21: 0x5c316303 (stale) Mirror 23: 0x5c316303 (stale) Mirror 24: 0x5c316303 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf0fc7210 Mirror 25: 0xf0fc7210 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000918 1772471442.748861 trunc from 0x040000 to 0x00697d (0x39682 bytes) 000919 1772471442.873256 mapwrite 0x02afd3 thru 0x038519 (0xd547 bytes) 000920 1772471443.022250 mapwrite 0x000f5c thru 0x00b985 (0xaa2a bytes) 000923 1772471443.097607 write 0x030607 thru 0x03e257 (0xdc51 bytes) 000924 1772471443.101271 mapwrite 0x014517 thru 0x0177a7 (0x3291 bytes) 000925 1772471443.203792 read 0x0288dd thru 0x0364ca (0xdbee bytes) 000926 1772471443.204931 trunc from 0x03e258 to 0x03ca36 (0x1821 bytes) 000927 1772471443.243007 trunc from 0x03ca37 to 0x01a31d (0x22719 bytes) 000929 1772471443.268934 write 0x027cc8 thru 0x036385 (0xe6be bytes) 000931 1772471443.278272 write 0x01af8c thru 0x01d195 (0x220a bytes) 000932 1772471443.290622 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36386): Mirror 20: 0x2389a694 (stale) Mirror 21: 0x2389a694 (stale) Mirror 23: 0x2389a694 (stale) Mirror 24: 0x2389a694 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36386): Mirror 20: 0x2389a694 (stale) Mirror 21: 0x2389a694 (stale) Mirror 23: 0x2389a694 (stale) Mirror 24: 0x2389a694 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36386: skipped 000933 1772471444.151404 read 0x033cb1 thru 0x036385 (0x26d5 bytes) 000936 1772471444.173395 read 0x02776f thru 0x02f0ad (0x793f bytes) 000937 1772471444.247431 read 0x000cf0 thru 0x00d9b7 (0xccc8 bytes) 000938 1772471444.248232 mapwrite 0x01dbe2 thru 0x025dc6 (0x81e5 bytes) 000944 1772471444.374519 trunc from 0x036386 to 0x0391cd (0x2e48 bytes) 000945 1772471444.442116 write 0x03a653 thru 0x03ffff (0x59ad bytes) 000946 1772471444.449635 mapwrite 0x00562a thru 0x015368 (0xfd3f bytes) 000949 1772471444.608275 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x5c316303 (stale) Mirror 21: 0x5c316303 (stale) Mirror 23: 0x5c316303 (stale) Mirror 24: 0x5c316303 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf64662e9 Mirror 25: 0xf64662e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000951 1772471446.314911 read 0x028e42 thru 0x02cb39 (0x3cf8 bytes) 000954 1772471446.361881 mapwrite 0x03c098 thru 0x03ffff (0x3f68 bytes) 000955 1772471446.655823 trunc from 0x040000 to 0x0279e6 (0x18619 bytes) 000959 1772471446.699342 write 0x0190ca thru 0x01c618 (0x354f bytes) 000962 1772471446.731012 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x279e7): Mirror 21: 0xfdbf1a23 (stale) Mirror 23: 0xfdbf1a23 (stale) Mirror 24: 0xfdbf1a23 (stale) Mirror 25: 0x29b3a1ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x279e7): Mirror 21: 0xfdbf1a23 (stale) Mirror 23: 0xfdbf1a23 (stale) Mirror 24: 0xfdbf1a23 (stale) Mirror 25: 0x29b3a1ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x279e7: skipped 000963 1772471447.302513 mapread 0x000aa8 thru 0x0102df (0xf838 bytes) 000964 1772471447.357765 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x279e7): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x279e7): Mirror 21: 0xfdbf1a23 (stale) Mirror 23: 0xfdbf1a23 (stale) Mirror 24: 0xfdbf1a23 (stale) Mirror 25: 0x29b3a1ff (stale) CRC-32 checksum value for chunk [0, 0x279e7): Mirror 1: 0x681c1068 Mirror 26: 0x681c1068 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x279e7: skipped 000965 1772471448.767635 read 0x00dd1e thru 0x01d223 (0xf506 bytes) 000967 1772471448.798231 MIRROR_RESYNC 6 mirrors 000968 1772471449.642086 mapread 0x0099ef thru 0x011d98 (0x83aa bytes) 000971 1772471449.663947 read 0x016247 thru 0x024e02 (0xebbc bytes) 000972 1772471449.674677 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000976 1772471449.999304 write 0x0173e6 thru 0x021ad8 (0xa6f3 bytes) 000977 1772471450.092647 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x279e7): Mirror 21: 0x681c1068 (stale) Mirror 23: 0x681c1068 (stale) Mirror 25: 0x681c1068 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x279e7): Mirror 21: 0x681c1068 (stale) Mirror 23: 0x681c1068 (stale) Mirror 25: 0x681c1068 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x279e7: skipped 000978 1772471450.408569 read 0x017827 thru 0x0190c9 (0x18a3 bytes) 000985 1772471450.424524 read 0x00591d thru 0x0110b4 (0xb798 bytes) 000986 1772471450.435993 read 0x008099 thru 0x0145e4 (0xc54c bytes) 000987 1772471450.436821 mapread 0x00418d thru 0x00bdc9 (0x7c3d bytes) 000988 1772471450.438855 trunc from 0x0279e7 to 0x01d3bc (0xa62a bytes) 000989 1772471450.455042 trunc from 0x01d3bd to 0x039359 (0x1bf9d bytes) 000990 1772471450.474216 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3935a): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3935a): Mirror 21: 0x90e778ad (stale) Mirror 23: 0x90e778ad (stale) Mirror 25: 0x90e778ad (stale) CRC-32 checksum value for chunk [0, 0x3935a): Mirror 1: 0x1800decc Mirror 26: 0x1800decc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3935a: skipped 000991 1772471451.273583 mapread 0x01354f thru 0x013839 (0x2eb bytes) 000992 1772471451.309612 write 0x029ab6 thru 0x02f9e2 (0x5f2d bytes) 000993 1772471451.419023 write 0x002d57 thru 0x00d447 (0xa6f1 bytes) 000994 1772471451.431980 write 0x0086e1 thru 0x00a66c (0x1f8c bytes) 000995 1772471451.433300 trunc from 0x03935a to 0x02d142 (0xc217 bytes) 000999 1772471451.487870 mapread 0x02b3ec thru 0x02d142 (0x1d57 bytes) All operations completed A-OK!