== sanity-flr test 70a: flr mode fsx test ================ 00:12:21 (1783138341) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 8343 skipping zero size read skipping zero length punch hole skipping zero length punch hole truncating to largest ever: 0x35b02 000004 1783138343.720277 trunc from 00000000 to 0x035b01 (0x35b02 bytes) 000005 1783138343.737041 trunc from 0x035b02 to 0x00fe55 (0x25cac bytes) fallocating to largest ever: 0x3d67a 000006 1783138343.756239 fallocate 0x03c3a7 thru 0x03d679 (0x12d3 bytes) 000007 1783138343.762185 trunc from 0x00255e to 0x00c66b (0xa10e bytes) 000008 1783138343.772501 MIRROR_EXTEND to 2 mirrors 000009 1783138344.457488 write 0x03530c thru 0x03f22c (0x9f21 bytes) 000010 1783138344.501718 write 0x02bf14 thru 0x03210b (0x61f8 bytes) 000011 1783138344.515712 trunc from 0x03f22d to 0x00e447 (0x30de5 bytes) 000012 1783138344.545758 mapread 0x009312 thru 0x00e447 (0x5136 bytes) 000013 1783138344.580314 MIRROR_RESYNC 2 mirrors 000014 1783138345.316255 read 0x003001 thru 0x00d1a7 (0xa1a7 bytes) 000015 1783138345.356322 mapwrite 0x039da2 thru 0x03ffff (0x625e bytes) 000016 1783138345.499063 trunc from 0x040000 to 0x029be4 (0x1641b bytes) 000017 1783138345.524136 fallocate 0x0240e4 thru 0x02d4d5 (0x93f2 bytes) 000018 1783138345.529588 punch from 0x00296a to 0x00465d (0x1cf4 bytes) 000019 1783138345.538393 MIRROR_RESYNC 2 mirrors 000020 1783138346.110797 mapwrite 0x008c77 thru 0x01017b (0x7505 bytes) fallocating to largest ever: 0x3e662 000021 1783138346.352532 fallocate 0x030a7e thru 0x03e661 (0xdbe4 bytes) 000023 1783138346.360421 write 0x015f93 thru 0x0175dd (0x164b bytes) 000024 1783138346.390939 read 0x006c63 thru 0x00e6cf (0x7a6d bytes) 000025 1783138346.397537 MIRROR_RESYNC 2 mirrors 000026 1783138347.148399 mapread 0x01b6b0 thru 0x022df5 (0x7746 bytes) 000027 1783138347.175404 mapread 0x0107e7 thru 0x01a71a (0x9f34 bytes) 000028 1783138347.187397 mapread 0x012b68 thru 0x0221b7 (0xf650 bytes) 000029 1783138347.190405 write 0x02cffe thru 0x034ce1 (0x7ce4 bytes) 000030 1783138347.258675 punch from 0x0276cb to 0x027a89 (0x3bf bytes) 000031 1783138347.266516 read 0x013180 thru 0x014643 (0x14c4 bytes) 000032 1783138347.278404 write 0x00ce86 thru 0x01405e (0x71d9 bytes) 000033 1783138347.292284 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) fallocating to largest ever: 0x40000 000034 1783138347.570916 fallocate 0x03c4b2 thru 0x03ffff (0x3b4e bytes) 000035 1783138347.578429 read 0x023b57 thru 0x02fc44 (0xc0ee bytes) 000036 1783138347.592801 trunc from 0x01493a to 0x018ac3 (0x418a bytes) 000037 1783138347.600346 write 0x0194e8 thru 0x02147b (0x7f94 bytes) 000038 1783138347.622496 trunc from 0x040000 to 0x023ac3 (0x1c53c bytes) 000039 1783138347.690582 MIRROR_EXTEND to 2 mirrors 000040 1783138348.992773 punch from 0x0231f0 to 0x023ac3 (0x8d4 bytes) 000041 1783138349.052697 mapread 0x0174f7 thru 0x023ac3 (0xc5cd bytes) 000042 1783138349.097779 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23ac4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ac4): Mirror 2: 0x6bbf0478 (stale) CRC-32 checksum value for chunk [0, 0x23ac4): Mirror 1: 0x6bbf0478 Mirror 3: 0x6bbf0478 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ac4: skipped 000043 1783138350.684157 mapwrite 0x004207 thru 0x008103 (0x3efd bytes) 000045 1783138350.870483 fallocate 0x03a556 thru 0x03ffff (0x5aaa bytes) 000046 1783138350.895400 fallocate 0x0044e5 thru 0x007b7a (0x3696 bytes) 000047 1783138350.901477 trunc from 0x040000 to 0x02bd9f (0x14260 bytes) 000048 1783138350.932804 mapwrite 0x02433b thru 0x02993a (0x5600 bytes) 000049 1783138350.978007 trunc from 0x006e1e to 0x00b5cf (0x47b2 bytes) 000050 1783138350.985396 write 0x02481c thru 0x02a3b3 (0x5b98 bytes) 000051 1783138350.988677 punch from 0x01798c to 0x017ba3 (0x218 bytes) 000052 1783138350.999463 MIRROR_RESYNC 3 mirrors 000053 1783138352.575465 mapread 0x01da9d thru 0x022f7a (0x54de bytes) 000054 1783138352.612353 mapread 0x00012e thru 0x005705 (0x55d8 bytes) 000055 1783138352.625535 mapwrite 0x03b89d thru 0x03bd40 (0x4a4 bytes) 000056 1783138352.746528 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bd41): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd41): Mirror 2: 0x5fed3e5 (stale) Mirror 3: 0x5fed3e5 (stale) CRC-32 checksum value for chunk [0, 0x3bd41): Mirror 1: 0x4dcdb950 Mirror 4: 0x4dcdb950 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd41: skipped 000057 1783138354.354595 trunc from 0x0375f7 to 0x03bd40 (0x474a bytes) 000058 1783138354.423659 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3bd41): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd41): Mirror 2: 0x5fed3e5 (stale) Mirror 3: 0x5fed3e5 (stale) Mirror 4: 0x4dcdb950 (stale) CRC-32 checksum value for chunk [0, 0x3bd41): Mirror 1: 0x5fed3e5 Mirror 5: 0x5fed3e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd41: skipped 000059 1783138355.709983 trunc from 0x03bd41 to 0x034920 (0x7420 bytes) 000060 1783138355.769379 mapread 0x019f86 thru 0x0286fb (0xe776 bytes) 000061 1783138355.810799 trunc from 0x030162 to 0x034920 (0x47bf bytes) 000062 1783138355.819299 trunc from 0x034921 to 0x03a8c4 (0x5fa4 bytes) 000063 1783138355.844573 trunc from 0x03a8c5 to 0x015512 (0x253b2 bytes) 000064 1783138355.866623 read 0x00905e thru 0x00fd6c (0x6d0f bytes) 000065 1783138355.874576 write 0x00d41d thru 0x0106f2 (0x32d6 bytes) 000066 1783138355.880846 fallocate 0x01e342 thru 0x022559 (0x4218 bytes) 000067 1783138355.887551 mapread 0x00ac12 thru 0x013c74 (0x9063 bytes) 000068 1783138355.897252 write 0x032b1f thru 0x03ef96 (0xc478 bytes) 000070 1783138355.899624 punch from 0x000e79 to 0x002245 (0x13cd bytes) 000071 1783138355.904079 trunc from 0x031a33 to 0x037b3b (0x6109 bytes) 000072 1783138355.919637 fallocate 0x0235af thru 0x02c058 (0x8aaa bytes) 000073 1783138355.926488 trunc from 0x03ef97 to 0x004b70 (0x3a426 bytes) 000074 1783138355.947492 mapwrite 0x03f2ee thru 0x03ffff (0xd12 bytes) 000075 1783138355.985592 trunc from 0x040000 to 0x01db3b (0x224c4 bytes) 000076 1783138356.003079 write 0x026aa3 thru 0x03619d (0xf6fb bytes) 000078 1783138356.011342 fallocate 0x02fe83 thru 0x03a0a6 (0xa224 bytes) 000079 1783138356.017254 mapwrite 0x023e75 thru 0x027d99 (0x3f25 bytes) 000080 1783138356.044141 write 0x0246cc thru 0x02cf4a (0x887f bytes) 000081 1783138356.046031 mapread 0x026e87 thru 0x0348f4 (0xda6e bytes) 000082 1783138356.048307 mapwrite 0x02692f thru 0x02d1a1 (0x6873 bytes) 000083 1783138356.065120 read 0x0141f6 thru 0x022d4b (0xeb56 bytes) 000084 1783138356.077357 trunc from 0x01da00 to 0x02b48a (0xda8b bytes) 000085 1783138356.083472 punch from 0x035257 to 0x03619d (0xf47 bytes) 000087 1783138356.094064 trunc from 0x01c879 to 0x01fd2a (0x34b2 bytes) 000088 1783138356.100377 trunc from 0x03619e to 0x022623 (0x13b7a bytes) 000089 1783138356.121919 read 0x01a2db thru 0x022623 (0x8349 bytes) 000090 1783138356.134321 mapread 0x00aa7d thru 0x018388 (0xd90c bytes) 000092 1783138356.136515 mapread 0x013e12 thru 0x0204cc (0xc6bb bytes) 000093 1783138356.139948 write 0x00784e thru 0x00d742 (0x5ef5 bytes) 000094 1783138356.144188 trunc from 0x022624 to 0x03acfa (0x186d7 bytes) 000095 1783138356.169149 trunc from 0x03acfb to 0x02007b (0x1ac7f bytes) 000096 1783138356.188239 read 0x0041f9 thru 0x0096c4 (0x54cc bytes) 000097 1783138356.189363 read 0x0044e1 thru 0x011094 (0xcbb4 bytes) 000098 1783138356.191393 read 0x00b13f thru 0x00d93f (0x2801 bytes) 000100 1783138356.193158 trunc from 0x006391 to 0x00a400 (0x4070 bytes) 000101 1783138356.211309 trunc from 0x02007c to 0x02c9a3 (0xc928 bytes) 000102 1783138356.230459 trunc from 0x02c9a4 to 0x02fa5c (0x30b9 bytes) 000103 1783138356.251358 read 0x00b4db thru 0x00fa27 (0x454d bytes) 000104 1783138356.265013 MIRROR_RESYNC 5 mirrors 000105 1783138357.849199 mapread 0x0055e1 thru 0x011489 (0xbea9 bytes) 000106 1783138357.882765 trunc from 0x009934 to 0x019321 (0xf9ee bytes) 000107 1783138357.928837 punch from 0x00bfb4 to 0x018467 (0xc4b4 bytes) 000108 1783138357.933981 trunc from 0x02fa5d to 0x001de6 (0x2dc76 bytes) 000109 1783138357.959901 mapread 0x00109c thru 0x001de6 (0xd4b bytes) 000110 1783138357.967250 fallocate 0x009ae1 thru 0x00d853 (0x3d73 bytes) 000111 1783138357.978347 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd854): Mirror 2: 0xc7507fde (stale) Mirror 3: 0xc7507fde (stale) Mirror 4: 0xc7507fde (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd854): Mirror 2: 0xc7507fde (stale) Mirror 3: 0xc7507fde (stale) Mirror 4: 0xc7507fde (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd854: skipped 000112 1783138358.366130 write 0x004d73 thru 0x00da04 (0x8c92 bytes) 000113 1783138358.385260 punch from 0x0043ef to 0x00cca9 (0x88bb bytes) 000114 1783138358.410875 write 0x03f93e thru 0x03ffff (0x6c2 bytes) 000115 1783138358.412144 trunc from 0x01054a to 0x01c57b (0xc032 bytes) 000116 1783138358.418941 read 0x0339c6 thru 0x03eacb (0xb106 bytes) 000117 1783138358.427867 trunc from 0x040000 to 0x026bb2 (0x1944d bytes) 000118 1783138358.462093 MIRROR_RESYNC 4 mirrors 000119 1783138359.439891 punch from 0x01dc8f to 0x026bb2 (0x8f24 bytes) 000120 1783138359.476142 mapread 0x001500 thru 0x00f0af (0xdbb0 bytes) 000121 1783138359.503537 mapread 0x00d1cd thru 0x012ccc (0x5b00 bytes) 000122 1783138359.516843 read 0x016cea thru 0x01d357 (0x666e bytes) 000123 1783138359.524902 punch from 0x015e97 to 0x01eaea (0x8c54 bytes) 000124 1783138359.531295 punch from 0x01ea8b to 0x026bb2 (0x8128 bytes) 000125 1783138359.536598 trunc from 0x026bb3 to 0x02ce50 (0x629e bytes) 000126 1783138359.557726 punch from 0x00c573 to 0x01454b (0x7fd9 bytes) 000127 1783138359.565444 mapwrite 0x01d80c thru 0x01da4b (0x240 bytes) 000128 1783138359.594207 write 0x023094 thru 0x02ff92 (0xceff bytes) 000129 1783138359.597895 read 0x00528b thru 0x00f41c (0xa192 bytes) 000130 1783138359.609127 trunc from 0x016236 to 0x024a84 (0xe84f bytes) 000131 1783138359.627747 read 0x02773c thru 0x02ff92 (0x8857 bytes) 000132 1783138359.629067 mapwrite 0x00b522 thru 0x00dd2b (0x280a bytes) 000134 1783138359.649161 mapwrite 0x016cc4 thru 0x01ce20 (0x615d bytes) 000136 1783138359.683814 trunc from 0x0208dd to 0x02e476 (0xdb9a bytes) 000137 1783138359.692413 mapread 0x01baf6 thru 0x029006 (0xd511 bytes) 000138 1783138359.757104 trunc from 0x029c5d to 0x02ff92 (0x6336 bytes) 000139 1783138359.763928 trunc from 0x02e5e6 to 0x02ff92 (0x19ad bytes) 000140 1783138359.771538 trunc from 0x02ff93 to 0x02537c (0xac16 bytes) 000141 1783138359.798536 mapwrite 0x033b24 thru 0x03d95e (0x9e3b bytes) 000142 1783138359.855531 MIRROR_RESYNC 4 mirrors 000143 1783138361.660380 punch from 0x01a152 to 0x02909e (0xef4d bytes) 000144 1783138361.714293 write 0x010325 thru 0x019d2f (0x9a0b bytes) 000145 1783138361.727480 read 0x00f80c thru 0x0182ce (0x8ac3 bytes) 000146 1783138361.735575 mapread 0x028412 thru 0x03819b (0xfd8a bytes) 000148 1783138361.765974 read 0x01bb66 thru 0x025a76 (0x9f11 bytes) 000149 1783138361.779302 punch from 0x003a5a to 0x00c286 (0x882d bytes) 000150 1783138361.783977 mapwrite 0x01465b thru 0x0202aa (0xbc50 bytes) 000151 1783138361.808983 fallocate 0x0123f5 thru 0x01c2ea (0x9ef6 bytes) 000153 1783138361.816089 mapwrite 0x0324c2 thru 0x03ae61 (0x89a0 bytes) 000154 1783138361.856608 MIRROR_RESYNC 4 mirrors 000158 1783138363.266297 mapread 0x02bf7b thru 0x03a4cf (0xe555 bytes) 000159 1783138363.300079 write 0x0021cf thru 0x00f10b (0xcf3d bytes) 000160 1783138363.348166 read 0x005626 thru 0x00a835 (0x5210 bytes) 000161 1783138363.348880 read 0x00c643 thru 0x0129ce (0x638c bytes) 000162 1783138363.367730 mapwrite 0x012093 thru 0x01cb62 (0xaad0 bytes) 000163 1783138363.397776 trunc from 0x005f7c to 0x00cc1c (0x6ca1 bytes) 000164 1783138363.408789 mapwrite 0x0288b1 thru 0x02ac39 (0x2389 bytes) 000165 1783138363.425335 trunc from 0x03d95f to 0x033cf5 (0x9c69 bytes) 000166 1783138363.454883 trunc from 0x02870b to 0x0323a3 (0x9c99 bytes) 000167 1783138363.474843 trunc from 0x02f9ed to 0x033cf5 (0x4309 bytes) 000168 1783138363.481234 trunc from 0x00354d to 0x0119ba (0xe46e bytes) 000169 1783138363.493076 fallocate 0x01a1bc thru 0x028e65 (0xecaa bytes) 000170 1783138363.501796 write 0x0279cf thru 0x030a96 (0x90c8 bytes) 000172 1783138363.517163 trunc from 0x033cf6 to 0x025f4f (0xdda6 bytes) 000173 1783138363.536745 fallocate 0x00eda2 thru 0x017c64 (0x8ec3 bytes) 000174 1783138363.543983 fallocate 0x02c703 thru 0x0316b4 (0x4fb2 bytes) 000175 1783138363.557452 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25f50): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25f50): Mirror 2: 0x71da18e4 (stale) Mirror 3: 0x71da18e4 (stale) Mirror 4: 0x71da18e4 (stale) CRC-32 checksum value for chunk [0, 0x25f50): Mirror 1: 0x38531dba Mirror 5: 0x38531dba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25f50: skipped 000176 1783138364.454050 mapwrite 0x006025 thru 0x009327 (0x3303 bytes) 000177 1783138364.569498 trunc from 0x025f50 to 0x0132f9 (0x12c56 bytes) 000178 1783138364.628605 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x132fa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x132fa): Mirror 2: 0x39f4c60f (stale) Mirror 3: 0x39f4c60f (stale) Mirror 4: 0x39f4c60f (stale) Mirror 5: 0x3d046883 (stale) CRC-32 checksum value for chunk [0, 0x132fa): Mirror 1: 0x6a957e0f Mirror 6: 0x6a957e0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x132fa: skipped 000179 1783138365.864455 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x132fa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x132fa): Mirror 2: 0x39f4c60f (stale) Mirror 3: 0x39f4c60f (stale) Mirror 4: 0x39f4c60f (stale) Mirror 5: 0x3d046883 (stale) CRC-32 checksum value for chunk [0, 0x132fa): Mirror 1: 0x6a957e0f Mirror 6: 0x6a957e0f Mirror 7: 0x6a957e0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x132fa: skipped 000180 1783138367.053053 trunc from 0x0132fa to 0x00055f (0x12d9a bytes) 000181 1783138367.132046 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x560): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x560): Mirror 2: 0xd2a77da8 (stale) Mirror 3: 0xd2a77da8 (stale) Mirror 4: 0xd2a77da8 (stale) Mirror 5: 0xd2a77da8 (stale) Mirror 6: 0xd2a77da8 (stale) Mirror 7: 0xd2a77da8 (stale) CRC-32 checksum value for chunk [0, 0x560): Mirror 1: 0xd2a77da8 Mirror 8: 0xd2a77da8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x560: skipped 000182 1783138368.041003 mapwrite 0x00388c thru 0x0087b7 (0x4f2c bytes) 000183 1783138368.172100 punch from 0x003b14 to 0x0087b7 (0x4ca4 bytes) 000184 1783138368.188683 MIRROR_RESYNC 8 mirrors 000185 1783138370.208331 MIRROR_RESYNC 8 mirrors 000186 1783138370.776961 fallocate 0x00e221 thru 0x019f9a (0xbd7a bytes) 000187 1783138370.813241 trunc from 0x0087b8 to 0x03e78f (0x35fd8 bytes) 000188 1783138370.839481 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e790): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e790): Mirror 2: 0x5969c285 (stale) Mirror 3: 0x5969c285 (stale) Mirror 4: 0x5969c285 (stale) Mirror 5: 0x5969c285 (stale) Mirror 6: 0x5969c285 (stale) Mirror 7: 0x5969c285 (stale) Mirror 8: 0x5969c285 (stale) CRC-32 checksum value for chunk [0, 0x3e790): Mirror 1: 0x5969c285 Mirror 9: 0x5969c285 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e790: skipped 000189 1783138372.118893 trunc from 0x03e790 to 0x01f4fd (0x1f292 bytes) 000190 1783138372.205396 punch from 0x00ae33 to 0x0128f4 (0x7ac2 bytes) 000191 1783138372.213796 trunc from 0x01a02c to 0x01f4fd (0x54d2 bytes) 000192 1783138372.227381 mapwrite 0x03d184 thru 0x03ffff (0x2e7c bytes) 000193 1783138372.319390 fallocate 0x0039ec thru 0x00e772 (0xad87 bytes) 000194 1783138372.326780 mapread 0x034d86 thru 0x0387a5 (0x3a20 bytes) 000195 1783138372.341182 write 0x01796e thru 0x0241c8 (0xc85b bytes) 000196 1783138372.352883 read 0x0241f7 thru 0x029810 (0x561a bytes) 000197 1783138372.365452 trunc from 0x00d3f9 to 0x012fb3 (0x5bbb bytes) 000198 1783138372.378514 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x915ee93c (stale) Mirror 3: 0x915ee93c (stale) Mirror 4: 0x915ee93c (stale) Mirror 5: 0x915ee93c (stale) Mirror 6: 0x915ee93c (stale) Mirror 7: 0x915ee93c (stale) Mirror 8: 0x915ee93c (stale) Mirror 9: 0x915ee93c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90d8e299 Mirror 10: 0x90d8e299 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000199 1783138373.324456 mapwrite 0x00b95c thru 0x014bf0 (0x9295 bytes) 000201 1783138373.436906 mapread 0x0149fc thru 0x02342c (0xea31 bytes) 000202 1783138373.457056 trunc from 0x040000 to 0x03d47c (0x2b83 bytes) 000203 1783138373.516134 MIRROR_RESYNC 10 mirrors 000206 1783138377.130752 fallocate 0x004742 thru 0x00c6c2 (0x7f81 bytes) 000207 1783138377.186971 fallocate 0x03dd97 thru 0x03e6fd (0x967 bytes) 000210 1783138377.196712 fallocate 0x011809 thru 0x016db8 (0x55b0 bytes) 000211 1783138377.207887 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6fe): Mirror 2: 0x69b1ea28 (stale) Mirror 4: 0x69b1ea28 (stale) Mirror 5: 0x69b1ea28 (stale) Mirror 6: 0x69b1ea28 (stale) Mirror 7: 0x69b1ea28 (stale) Mirror 8: 0x69b1ea28 (stale) Mirror 9: 0x69b1ea28 (stale) Mirror 10: 0x69b1ea28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6fe): Mirror 2: 0x69b1ea28 (stale) Mirror 4: 0x69b1ea28 (stale) Mirror 5: 0x69b1ea28 (stale) Mirror 6: 0x69b1ea28 (stale) Mirror 7: 0x69b1ea28 (stale) Mirror 8: 0x69b1ea28 (stale) Mirror 9: 0x69b1ea28 (stale) Mirror 10: 0x69b1ea28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6fe: skipped 000212 1783138377.776817 trunc from 0x03e6fe to 0x028ef4 (0x15809 bytes) 000213 1783138377.801659 fallocate 0x02eb00 thru 0x03625c (0x775d bytes) 000215 1783138377.813633 punch from 0x000f8e to 0x00fe0f (0xee82 bytes) 000216 1783138377.824427 write 0x03e42b thru 0x03ffff (0x1bd5 bytes) 000217 1783138377.827866 trunc from 0x040000 to 0x0163d0 (0x29c2f bytes) 000218 1783138377.850707 read 0x004e53 thru 0x005d05 (0xeb3 bytes) 000220 1783138377.861079 punch from 0x015ab3 to 0x0163d0 (0x91e bytes) 000221 1783138377.865666 mapread 0x003548 thru 0x00f3a1 (0xbe5a bytes) 000222 1783138377.886370 mapwrite 0x01abab thru 0x01e609 (0x3a5f bytes) 000223 1783138377.928934 trunc from 0x008fad to 0x00c42d (0x3481 bytes) 000225 1783138377.935703 punch from 0x004a7a to 0x00e75b (0x9ce2 bytes) 000226 1783138377.942777 trunc from 0x003d6b to 0x00ad65 (0x6ffb bytes) 000227 1783138377.948812 mapread 0x00d5e8 thru 0x01078c (0x31a5 bytes) 000228 1783138377.959916 punch from 0x01aba5 to 0x01e609 (0x3a65 bytes) 000229 1783138377.965849 fallocate 0x029c02 thru 0x02e880 (0x4c7f bytes) 000230 1783138377.975729 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1e60a): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e60a): Mirror 2: 0x589eb1c7 (stale) Mirror 4: 0x589eb1c7 (stale) Mirror 5: 0x589eb1c7 (stale) Mirror 6: 0x589eb1c7 (stale) Mirror 7: 0x589eb1c7 (stale) Mirror 8: 0x589eb1c7 (stale) Mirror 9: 0x589eb1c7 (stale) Mirror 10: 0x589eb1c7 (stale) CRC-32 checksum value for chunk [0, 0x1e60a): Mirror 1: 0x865febb1 Mirror 11: 0x865febb1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e60a: skipped 000231 1783138379.343885 mapwrite 0x006e0f thru 0x00f7ac (0x899e bytes) 000232 1783138379.467048 write 0x01f067 thru 0x025109 (0x60a3 bytes) 000234 1783138379.477102 fallocate 0x00bcb4 thru 0x013b9e (0x7eeb bytes) 000235 1783138379.484649 mapread 0x00bc7b thru 0x00d23e (0x15c4 bytes) 000236 1783138379.485673 mapwrite 0x01442c thru 0x01f576 (0xb14b bytes) 000237 1783138379.528613 punch from 0x02070c to 0x025109 (0x49fe bytes) 000238 1783138379.534656 mapwrite 0x03a566 thru 0x03f8e6 (0x5381 bytes) 000239 1783138379.603918 punch from 0x01bbf8 to 0x01ee38 (0x3241 bytes) 000240 1783138379.615910 read 0x03abb6 thru 0x03f8e6 (0x4d31 bytes) 000241 1783138379.618360 trunc from 0x03f8e7 to 0x03da33 (0x1eb3 bytes) 000242 1783138379.640067 mapwrite 0x035538 thru 0x03ffff (0xaac8 bytes) 000243 1783138379.693631 fallocate 0x0285d7 thru 0x028d78 (0x7a2 bytes) 000244 1783138379.706702 MIRROR_RESYNC 10 mirrors 000245 1783138382.893569 write 0x03c251 thru 0x03f161 (0x2f11 bytes) 000246 1783138382.936530 fallocate 0x029cab thru 0x02a630 (0x986 bytes) 000248 1783138382.942288 fallocate 0x01da8a thru 0x024622 (0x6b99 bytes) 000249 1783138382.947142 read 0x018a9e thru 0x0202f7 (0x785a bytes) 000250 1783138382.957157 fallocate 0x00edbe thru 0x017169 (0x83ac bytes) 000251 1783138382.962618 mapread 0x00bd68 thru 0x012f33 (0x71cc bytes) 000252 1783138382.982390 trunc from 0x040000 to 0x0153ed (0x2ac12 bytes) 000253 1783138383.004930 trunc from 0x009c40 to 0x009d8b (0x14c bytes) 000254 1783138383.011583 read 0x005589 thru 0x0075ec (0x2064 bytes) 000255 1783138383.021676 trunc from 0x0153ee to 0x00b95a (0x9a93 bytes) 000256 1783138383.038121 trunc from 0x00a51c to 0x00b95a (0x143f bytes) 000257 1783138383.044447 read 0x00a6e3 thru 0x00b95a (0x1278 bytes) 000258 1783138383.050407 fallocate 0x023ab3 thru 0x02f5a3 (0xbaf1 bytes) 000259 1783138383.056928 mapread 0x00246a thru 0x006c52 (0x47e9 bytes) 000260 1783138383.058974 mapwrite 0x03a63a thru 0x03ffff (0x59c6 bytes) 000261 1783138383.108190 mapwrite 0x037f03 thru 0x03a8f4 (0x29f2 bytes) 000262 1783138383.126519 punch from 0x0081b3 to 0x017783 (0xf5d1 bytes) 000264 1783138383.132586 trunc from 0x002138 to 0x00c661 (0xa52a bytes) 000265 1783138383.137968 punch from 0x004a3a to 0x00c5ac (0x7b73 bytes) 000266 1783138383.151013 trunc from 0x040000 to 0x00b621 (0x349de bytes) 000267 1783138383.170073 fallocate 0x034b6b thru 0x03ffff (0xb495 bytes) 000269 1783138383.179932 mapread 0x00b21e thru 0x00b621 (0x404 bytes) 000270 1783138383.187023 mapread 0x00366a thru 0x00b621 (0x7fb8 bytes) 000271 1783138383.234766 fallocate 0x03ed38 thru 0x03f406 (0x6cf bytes) 000272 1783138383.241000 punch from 0x001289 to 0x0095ee (0x8366 bytes) 000273 1783138383.247031 fallocate 0x027d0c thru 0x02bb7b (0x3e70 bytes) 000274 1783138383.253550 read 0x00d8f2 thru 0x013458 (0x5b67 bytes) 000275 1783138383.283800 mapread 0x00491c thru 0x0066ae (0x1d93 bytes) 000276 1783138383.284870 punch from 0x00c9e1 to 0x018c95 (0xc2b5 bytes) 000277 1783138383.291016 mapread 0x03389c thru 0x03afe4 (0x7749 bytes) 000278 1783138383.292440 write 0x01e393 thru 0x02d275 (0xeee3 bytes) 000279 1783138383.305025 punch from 0x011d9c to 0x01b3de (0x9643 bytes) 000281 1783138383.320781 trunc from 0x03f407 to 0x011655 (0x2ddb1 bytes) 000282 1783138383.346162 mapread 0x010253 thru 0x011655 (0x1403 bytes) 000283 1783138383.358885 fallocate 0x0229f4 thru 0x029ce3 (0x72f0 bytes) 000284 1783138383.364802 read 0x0039a5 thru 0x013495 (0xfaf1 bytes) 000285 1783138383.388983 punch from 0x0133e4 to 0x022e39 (0xfa56 bytes) 000286 1783138383.396887 write 0x00d0d8 thru 0x01c3fb (0xf324 bytes) 000287 1783138383.404616 mapwrite 0x0151d0 thru 0x02039c (0xb1cd bytes) 000288 1783138383.461512 read 0x017db6 thru 0x018b57 (0xda2 bytes) 000289 1783138383.462569 punch from 0x021564 to 0x02327e (0x1d1b bytes) 000290 1783138383.467863 read 0x00591d thru 0x006e02 (0x14e6 bytes) 000291 1783138383.469846 punch from 0x00a7f2 to 0x00beb1 (0x16c0 bytes) 000293 1783138383.477494 mapwrite 0x018243 thru 0x0185f7 (0x3b5 bytes) 000294 1783138383.491941 mapwrite 0x0149ca thru 0x02203e (0xd675 bytes) 000295 1783138383.530911 mapwrite 0x00a23f thru 0x00aacb (0x88d bytes) 000296 1783138383.545197 trunc from 0x029ce4 to 0x02f843 (0x5b60 bytes) 000297 1783138383.565568 read 0x020b4c thru 0x02bcee (0xb1a3 bytes) 000298 1783138383.574252 read 0x0031c1 thru 0x008226 (0x5066 bytes) 000299 1783138383.574983 punch from 0x022995 to 0x024ec6 (0x2532 bytes) 000300 1783138383.585922 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f844): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f844): Mirror 2: 0xee988ae3 (stale) Mirror 4: 0xee988ae3 (stale) Mirror 5: 0xee988ae3 (stale) Mirror 6: 0xee988ae3 (stale) Mirror 7: 0xee988ae3 (stale) Mirror 8: 0xee988ae3 (stale) Mirror 9: 0xee988ae3 (stale) Mirror 10: 0xee988ae3 (stale) Mirror 11: 0xee988ae3 (stale) CRC-32 checksum value for chunk [0, 0x2f844): Mirror 1: 0x8c623bf0 Mirror 12: 0x8c623bf0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f844: skipped 000301 1783138384.839721 fallocate 0x015e61 thru 0x016afd (0xc9d bytes) 000302 1783138384.903407 fallocate 0x02e89b thru 0x037658 (0x8dbe bytes) 000303 1783138384.913581 read 0x016d66 thru 0x01af05 (0x41a0 bytes) 000304 1783138384.928978 mapread 0x01c3f1 thru 0x02691a (0xa52a bytes) 000305 1783138384.959091 trunc from 0x00656e to 0x016530 (0xffc3 bytes) 000306 1783138384.968483 read 0x028447 thru 0x02dcd5 (0x588f bytes) 000307 1783138384.981137 fallocate 0x00a836 thru 0x019564 (0xed2f bytes) 000308 1783138384.992856 trunc from 0x037659 to 0x03f585 (0x7f2d bytes) 000309 1783138385.035099 trunc from 0x03c47d to 0x03f585 (0x3109 bytes) 000310 1783138385.046996 read 0x003b12 thru 0x00d2ab (0x979a bytes) 000311 1783138385.051650 fallocate 0x008ef5 thru 0x01507f (0xc18b bytes) 000312 1783138385.069851 fallocate 0x007f8d thru 0x00e0f5 (0x6169 bytes) 000313 1783138385.079526 mapwrite 0x01adf7 thru 0x01c148 (0x1352 bytes) 000314 1783138385.103372 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3f586): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f586): Mirror 2: 0xadd65859 (stale) Mirror 4: 0xadd65859 (stale) Mirror 5: 0xadd65859 (stale) Mirror 6: 0xadd65859 (stale) Mirror 7: 0xadd65859 (stale) Mirror 8: 0xadd65859 (stale) Mirror 9: 0xadd65859 (stale) Mirror 10: 0xadd65859 (stale) Mirror 11: 0xadd65859 (stale) Mirror 12: 0xb61206da (stale) CRC-32 checksum value for chunk [0, 0x3f586): Mirror 1: 0xa037e48d Mirror 13: 0xa037e48d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f586: skipped 000315 1783138386.415501 fallocate 0x021c99 thru 0x02dd5a (0xc0c2 bytes) 000316 1783138386.470979 fallocate 0x02181a thru 0x0220e5 (0x8cc bytes) 000317 1783138386.477133 write 0x017ecb thru 0x025c63 (0xdd99 bytes) 000318 1783138386.500510 write 0x0056ad thru 0x00d419 (0x7d6d bytes) 000320 1783138386.519602 write 0x0098e2 thru 0x00eeb6 (0x55d5 bytes) 000321 1783138386.527657 mapwrite 0x03a3ab thru 0x03ffff (0x5c55 bytes) 000322 1783138386.631331 trunc from 0x040000 to 0x004075 (0x3bf8a bytes) 000323 1783138386.653964 punch from 0x00172b to 0x002c12 (0x14e8 bytes) 000324 1783138386.661735 trunc from 0x004076 to 0x02ae80 (0x26e0b bytes) 000325 1783138386.686001 trunc from 0x0121db to 0x016967 (0x478d bytes) 000326 1783138386.693202 mapwrite 0x01e5cf thru 0x02befa (0xd92c bytes) 000327 1783138386.766385 trunc from 0x02befb to 0x007a26 (0x244d4 bytes) 000328 1783138386.792874 trunc from 0x0020e7 to 0x007a26 (0x5940 bytes) 000329 1783138386.801987 fallocate 0x00c1f2 thru 0x016657 (0xa466 bytes) 000330 1783138386.808504 mapwrite 0x017454 thru 0x021bee (0xa79b bytes) 000331 1783138386.874011 mapread 0x00bd50 thru 0x00ca12 (0xcc3 bytes) 000332 1783138386.889130 mapwrite 0x01e5ab thru 0x02c01e (0xda74 bytes) 000333 1783138386.950372 mapread 0x009f5f thru 0x01605c (0xc0fe bytes) 000334 1783138386.952600 punch from 0x007141 to 0x0087f0 (0x16b0 bytes) 000335 1783138386.958505 read 0x02a91f thru 0x02c01e (0x1700 bytes) 000336 1783138386.959375 fallocate 0x03f374 thru 0x03ffff (0xc8c bytes) 000337 1783138386.965684 trunc from 0x01d72a to 0x0291f8 (0xbacf bytes) 000338 1783138386.971818 trunc from 0x040000 to 0x03b5e7 (0x4a18 bytes) 000339 1783138387.003523 mapwrite 0x0310e2 thru 0x03ee11 (0xdd30 bytes) 000340 1783138387.089132 MIRROR_RESYNC 12 mirrors 000341 1783138390.805026 fallocate 0x01aa38 thru 0x027856 (0xce1f bytes) 000342 1783138390.855369 trunc from 0x03ee12 to 0x01d099 (0x21d78 bytes) 000343 1783138390.878622 mapwrite 0x01f520 thru 0x02e73a (0xf21b bytes) 000344 1783138390.966777 trunc from 0x02e73b to 0x0266f9 (0x8041 bytes) 000345 1783138390.985798 mapwrite 0x01ad35 thru 0x01c7e2 (0x1aae bytes) 000346 1783138391.001186 read 0x022c28 thru 0x0266f9 (0x3ad2 bytes) 000347 1783138391.006299 MIRROR_RESYNC 12 mirrors 000348 1783138393.971113 punch from 0x0064f5 to 0x00ec16 (0x8722 bytes) 000349 1783138394.013172 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x266fa): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x266fa): Mirror 2: 0xafb0b5a7 (stale) Mirror 4: 0xafb0b5a7 (stale) Mirror 5: 0xafb0b5a7 (stale) Mirror 6: 0xafb0b5a7 (stale) Mirror 7: 0xafb0b5a7 (stale) Mirror 8: 0xafb0b5a7 (stale) Mirror 9: 0xafb0b5a7 (stale) Mirror 10: 0xafb0b5a7 (stale) Mirror 11: 0xafb0b5a7 (stale) Mirror 12: 0xafb0b5a7 (stale) Mirror 13: 0xafb0b5a7 (stale) CRC-32 checksum value for chunk [0, 0x266fa): Mirror 1: 0xafb0b5a7 Mirror 14: 0xafb0b5a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x266fa: skipped 000350 1783138395.469989 punch from 0x0045b8 to 0x00b91f (0x7368 bytes) 000351 1783138395.540974 read 0x00b454 thru 0x01982e (0xe3db bytes) 000352 1783138395.561802 trunc from 0x0266fa to 0x03db1d (0x17424 bytes) 000353 1783138395.587639 read 0x01e760 thru 0x02bd40 (0xd5e1 bytes) 000354 1783138395.600699 mapread 0x031f35 thru 0x03bd05 (0x9dd1 bytes) 000355 1783138395.607801 MIRROR_RESYNC 13 mirrors 000356 1783138398.794481 mapread 0x030eda thru 0x03db1d (0xcc44 bytes) 000357 1783138398.817408 write 0x023456 thru 0x02755d (0x4108 bytes) 000358 1783138398.853085 trunc from 0x03db1e to 0x025d7d (0x17da0 bytes) 000359 1783138398.873008 mapwrite 0x02b968 thru 0x02ebbf (0x3258 bytes) 000360 1783138398.933675 punch from 0x017d27 to 0x025ea6 (0xe180 bytes) 000361 1783138398.943401 mapwrite 0x0284d0 thru 0x02a919 (0x244a bytes) 000362 1783138398.958058 fallocate 0x01cfb7 thru 0x027d72 (0xadbc bytes) 000363 1783138398.963604 fallocate 0x012b7b thru 0x014ac4 (0x1f4a bytes) 000364 1783138398.970267 mapread 0x009032 thru 0x0117b3 (0x8782 bytes) 000365 1783138398.987462 trunc from 0x02ebc0 to 0x03708d (0x84ce bytes) 000366 1783138399.016078 trunc from 0x00d632 to 0x01613b (0x8b0a bytes) 000367 1783138399.022545 trunc from 0x03708e to 0x032113 (0x4f7a bytes) 000368 1783138399.046191 mapwrite 0x00b28e thru 0x0185ac (0xd31f bytes) 000370 1783138399.086058 trunc from 0x0256b8 to 0x02766d (0x1fb6 bytes) 000372 1783138399.095476 punch from 0x019552 to 0x021dc0 (0x886f bytes) 000373 1783138399.112169 MIRROR_RESYNC 13 mirrors 000374 1783138402.698359 punch from 0x022241 to 0x02c84b (0xa60b bytes) 000376 1783138402.745525 fallocate 0x038b8d thru 0x03ffff (0x7473 bytes) 000377 1783138402.751680 trunc from 0x01eccc to 0x025b04 (0x6e39 bytes) 000378 1783138402.759278 read 0x03be7b thru 0x03ffff (0x4185 bytes) 000380 1783138402.772176 mapread 0x008d7e thru 0x00bb2e (0x2db1 bytes) 000381 1783138402.795445 fallocate 0x03a412 thru 0x03ffff (0x5bee bytes) 000382 1783138402.804180 punch from 0x02627a to 0x02b018 (0x4d9f bytes) 000383 1783138402.811472 mapwrite 0x00ff70 thru 0x01e89c (0xe92d bytes) 000384 1783138402.864678 mapread 0x0122b2 thru 0x012a6e (0x7bd bytes) 000385 1783138402.867644 mapwrite 0x00c886 thru 0x01a44f (0xdbca bytes) 000386 1783138402.913252 mapread 0x014787 thru 0x01ca9e (0x8318 bytes) 000387 1783138402.915497 fallocate 0x00204f thru 0x00e4e7 (0xc499 bytes) 000388 1783138402.923450 write 0x01228c thru 0x017733 (0x54a8 bytes) 000389 1783138402.924823 write 0x029249 thru 0x034d3d (0xbaf5 bytes) 000390 1783138402.955056 punch from 0x0132e6 to 0x0159d0 (0x26eb bytes) 000391 1783138402.981509 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24024c06 (stale) Mirror 4: 0x24024c06 (stale) Mirror 5: 0x24024c06 (stale) Mirror 6: 0x24024c06 (stale) Mirror 8: 0x24024c06 (stale) Mirror 9: 0x24024c06 (stale) Mirror 10: 0x24024c06 (stale) Mirror 11: 0x24024c06 (stale) Mirror 12: 0x24024c06 (stale) Mirror 13: 0x24024c06 (stale) Mirror 14: 0x24024c06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24024c06 (stale) Mirror 4: 0x24024c06 (stale) Mirror 5: 0x24024c06 (stale) Mirror 6: 0x24024c06 (stale) Mirror 8: 0x24024c06 (stale) Mirror 9: 0x24024c06 (stale) Mirror 10: 0x24024c06 (stale) Mirror 11: 0x24024c06 (stale) Mirror 12: 0x24024c06 (stale) Mirror 13: 0x24024c06 (stale) Mirror 14: 0x24024c06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000392 1783138403.738682 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24024c06 (stale) Mirror 4: 0x24024c06 (stale) Mirror 5: 0x24024c06 (stale) Mirror 6: 0x24024c06 (stale) Mirror 8: 0x24024c06 (stale) Mirror 9: 0x24024c06 (stale) Mirror 10: 0x24024c06 (stale) Mirror 11: 0x24024c06 (stale) Mirror 12: 0x24024c06 (stale) Mirror 13: 0x24024c06 (stale) Mirror 14: 0x24024c06 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4fdc68b7 Mirror 15: 0x4fdc68b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000393 1783138405.062579 write 0x0018a4 thru 0x00d637 (0xbd94 bytes) 000394 1783138405.148440 mapwrite 0x01ffd7 thru 0x02220b (0x2235 bytes) 000395 1783138405.196413 read 0x006c23 thru 0x010852 (0x9c30 bytes) 000396 1783138405.203602 trunc from 0x018b9f to 0x018f68 (0x3ca bytes) 000397 1783138405.210022 punch from 0x004039 to 0x011e78 (0xde40 bytes) 000398 1783138405.215986 write 0x02d4f8 thru 0x0389ed (0xb4f6 bytes) 000399 1783138405.226464 trunc from 0x01036b to 0x012a5a (0x26f0 bytes) 000400 1783138405.232161 fallocate 0x01f931 thru 0x0229e3 (0x30b3 bytes) 000401 1783138405.237614 read 0x03aa01 thru 0x03f252 (0x4852 bytes) 000402 1783138405.248437 read 0x00cade thru 0x014571 (0x7a94 bytes) 000403 1783138405.249206 fallocate 0x03e9f2 thru 0x03ffff (0x160e bytes) 000404 1783138405.254276 trunc from 0x040000 to 0x010bf3 (0x2f40c bytes) 000405 1783138405.275525 read 0x00d1bb thru 0x010bf3 (0x3a39 bytes) 000406 1783138405.281262 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10bf4): Mirror 2: 0x2cd6c1f9 (stale) Mirror 4: 0x2cd6c1f9 (stale) Mirror 5: 0x2cd6c1f9 (stale) Mirror 6: 0x2cd6c1f9 (stale) Mirror 8: 0x2cd6c1f9 (stale) Mirror 9: 0x2cd6c1f9 (stale) Mirror 10: 0x2cd6c1f9 (stale) Mirror 11: 0x2cd6c1f9 (stale) Mirror 13: 0x2cd6c1f9 (stale) Mirror 14: 0x2cd6c1f9 (stale) Mirror 15: 0xfaec968e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10bf4): Mirror 2: 0x2cd6c1f9 (stale) Mirror 4: 0x2cd6c1f9 (stale) Mirror 5: 0x2cd6c1f9 (stale) Mirror 6: 0x2cd6c1f9 (stale) Mirror 8: 0x2cd6c1f9 (stale) Mirror 9: 0x2cd6c1f9 (stale) Mirror 10: 0x2cd6c1f9 (stale) Mirror 11: 0x2cd6c1f9 (stale) Mirror 13: 0x2cd6c1f9 (stale) Mirror 14: 0x2cd6c1f9 (stale) Mirror 15: 0xfaec968e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10bf4: skipped 000407 1783138405.849267 trunc from 0x010bf4 to 0x018fb8 (0x83c5 bytes) 000408 1783138405.875546 trunc from 0x014495 to 0x018fb8 (0x4b24 bytes) 000409 1783138405.884380 mapwrite 0x03b076 thru 0x03ffff (0x4f8a bytes) 000410 1783138405.957940 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24024c06 (stale) Mirror 5: 0x24024c06 (stale) Mirror 6: 0x24024c06 (stale) Mirror 8: 0x24024c06 (stale) Mirror 9: 0x24024c06 (stale) Mirror 10: 0x24024c06 (stale) Mirror 11: 0x24024c06 (stale) Mirror 13: 0x24024c06 (stale) Mirror 14: 0x24024c06 (stale) Mirror 15: 0x4fdc68b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24024c06 (stale) Mirror 5: 0x24024c06 (stale) Mirror 6: 0x24024c06 (stale) Mirror 8: 0x24024c06 (stale) Mirror 9: 0x24024c06 (stale) Mirror 10: 0x24024c06 (stale) Mirror 11: 0x24024c06 (stale) Mirror 13: 0x24024c06 (stale) Mirror 14: 0x24024c06 (stale) Mirror 15: 0x4fdc68b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000411 1783138406.571346 mapwrite 0x01c220 thru 0x02474f (0x8530 bytes) 000413 1783138406.610775 read 0x00c8ad thru 0x011457 (0x4bab bytes) 000414 1783138406.621806 mapwrite 0x03c1cb thru 0x03fafb (0x3931 bytes) 000415 1783138406.650377 trunc from 0x040000 to 0x03de2c (0x21d3 bytes) 000416 1783138406.677569 mapread 0x0338fd thru 0x03de2c (0xa530 bytes) 000417 1783138406.696091 mapwrite 0x00fc46 thru 0x01d4ca (0xd885 bytes) 000418 1783138406.735489 write 0x027a50 thru 0x02cbc0 (0x5171 bytes) 000419 1783138406.741925 trunc from 0x03de2d to 0x007d87 (0x360a5 bytes) 000420 1783138406.762541 punch from 0x001690 to 0x007565 (0x5ed6 bytes) 000421 1783138406.770126 trunc from 0x007d88 to 0x03ec31 (0x36eaa bytes) 000422 1783138406.812710 punch from 0x0164c3 to 0x02278a (0xc2c8 bytes) 000423 1783138406.818889 fallocate 0x0242e8 thru 0x0264b8 (0x21d1 bytes) 000424 1783138406.829585 trunc from 0x03ec32 to 0x0085d8 (0x36659 bytes) 000425 1783138406.875911 fallocate 0x004756 thru 0x007022 (0x28cd bytes) 000426 1783138406.886646 read 0x000f81 thru 0x0040ce (0x314e bytes) 000427 1783138406.911747 fallocate 0x0223a5 thru 0x02e652 (0xc2ae bytes) 000429 1783138406.923411 trunc from 0x0077b7 to 0x0085d8 (0xe22 bytes) 000430 1783138406.933080 read 0x006c4d thru 0x0085d8 (0x198c bytes) 000431 1783138406.950400 mapread 0x003897 thru 0x0085d8 (0x4d42 bytes) 000432 1783138406.955524 mapwrite 0x0225ee thru 0x029a06 (0x7419 bytes) 000433 1783138407.073051 fallocate 0x02af06 thru 0x02ef12 (0x400d bytes) 000434 1783138407.094469 MIRROR_RESYNC 11 mirrors 000437 1783138410.324460 mapwrite 0x029d28 thru 0x02f893 (0x5b6c bytes) 000438 1783138410.512660 mapwrite 0x014c61 thru 0x01fc26 (0xafc6 bytes) 000439 1783138410.587101 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f894): Mirror 2: 0x617e5850 (stale) Mirror 5: 0x617e5850 (stale) Mirror 6: 0x617e5850 (stale) Mirror 9: 0x617e5850 (stale) Mirror 10: 0x617e5850 (stale) Mirror 11: 0x617e5850 (stale) Mirror 13: 0x617e5850 (stale) Mirror 14: 0x617e5850 (stale) Mirror 15: 0x617e5850 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f894): Mirror 2: 0x617e5850 (stale) Mirror 5: 0x617e5850 (stale) Mirror 6: 0x617e5850 (stale) Mirror 9: 0x617e5850 (stale) Mirror 10: 0x617e5850 (stale) Mirror 11: 0x617e5850 (stale) Mirror 13: 0x617e5850 (stale) Mirror 14: 0x617e5850 (stale) Mirror 15: 0x617e5850 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f894: skipped 000440 1783138411.486788 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f894): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f894): Mirror 2: 0x617e5850 (stale) Mirror 5: 0x617e5850 (stale) Mirror 6: 0x617e5850 (stale) Mirror 9: 0x617e5850 (stale) Mirror 10: 0x617e5850 (stale) Mirror 11: 0x617e5850 (stale) Mirror 13: 0x617e5850 (stale) Mirror 14: 0x617e5850 (stale) Mirror 15: 0x617e5850 (stale) CRC-32 checksum value for chunk [0, 0x2f894): Mirror 1: 0x38232c1a Mirror 16: 0x38232c1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f894: skipped 000441 1783138413.212026 trunc from 0x02f894 to 0x001989 (0x2df0a bytes) 000442 1783138413.334841 trunc from 0x000f26 to 0x001989 (0xa64 bytes) 000443 1783138413.345989 fallocate 0x017f21 thru 0x020590 (0x8670 bytes) 000444 1783138413.354594 trunc from 0x00198a to 0x0302e0 (0x2e957 bytes) 000447 1783138413.397060 trunc from 0x01715a to 0x01df3f (0x6de6 bytes) 000448 1783138413.402796 mapread 0x0012bc thru 0x0042c6 (0x300b bytes) 000449 1783138413.436645 mapread 0x025545 thru 0x02ca5b (0x7517 bytes) 000450 1783138413.448860 read 0x021dbd thru 0x02b47d (0x96c1 bytes) 000451 1783138413.449891 write 0x031293 thru 0x035270 (0x3fde bytes) 000452 1783138413.452938 trunc from 0x035271 to 0x00d9ab (0x278c5 bytes) 000454 1783138413.495923 MIRROR_RESYNC 11 mirrors 000455 1783138415.631883 read 0x00b2e5 thru 0x00d9ab (0x26c7 bytes) 000457 1783138415.646127 MIRROR_RESYNC 11 mirrors 000458 1783138416.323054 trunc from 0x00a36a to 0x00d9ab (0x3642 bytes) 000459 1783138416.376009 MIRROR_RESYNC 11 mirrors 000460 1783138418.889109 write 0x01d40f thru 0x027ddc (0xa9ce bytes) 000461 1783138418.920938 punch from 0x020b6f to 0x027ddc (0x726e bytes) 000463 1783138418.949159 mapread 0x013c91 thru 0x01a897 (0x6c07 bytes) 000464 1783138418.978053 punch from 0x02333f to 0x027ddc (0x4a9e bytes) 000465 1783138418.996459 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 2: 0x58dd0921 (stale) Mirror 5: 0x58dd0921 (stale) Mirror 6: 0x58dd0921 (stale) Mirror 9: 0x58dd0921 (stale) Mirror 10: 0x58dd0921 (stale) Mirror 11: 0x58dd0921 (stale) Mirror 13: 0x58dd0921 (stale) Mirror 14: 0x58dd0921 (stale) Mirror 15: 0x58dd0921 (stale) Mirror 16: 0x58dd0921 (stale) CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 1: 0xf4af65ae Mirror 17: 0xf4af65ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ddd: skipped 000466 1783138420.387526 fallocate 0x01d96b thru 0x027c4a (0xa2e0 bytes) 000467 1783138420.445981 read 0x015fd2 thru 0x019f02 (0x3f31 bytes) 000468 1783138420.457155 mapwrite 0x01738c thru 0x026176 (0xedeb bytes) 000470 1783138420.533882 write 0x004dcc thru 0x01381c (0xea51 bytes) 000471 1783138420.574949 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 2: 0x58dd0921 (stale) Mirror 5: 0x58dd0921 (stale) Mirror 6: 0x58dd0921 (stale) Mirror 9: 0x58dd0921 (stale) Mirror 10: 0x58dd0921 (stale) Mirror 11: 0x58dd0921 (stale) Mirror 13: 0x58dd0921 (stale) Mirror 14: 0x58dd0921 (stale) Mirror 15: 0x58dd0921 (stale) Mirror 16: 0x58dd0921 (stale) Mirror 17: 0xf4af65ae (stale) CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 1: 0x555f37a6 Mirror 18: 0x555f37a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ddd: skipped 000472 1783138422.076869 read 0x003975 thru 0x008cf1 (0x537d bytes) 000473 1783138422.109139 punch from 0x0081ee to 0x00ad18 (0x2b2b bytes) 000474 1783138422.196200 trunc from 0x00032c to 0x008752 (0x8427 bytes) 000475 1783138422.208701 read 0x022386 thru 0x027ddc (0x5a57 bytes) 000476 1783138422.228369 fallocate 0x03b5d3 thru 0x03e7ad (0x31db bytes) 000477 1783138422.243671 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 2: 0x58dd0921 (stale) Mirror 5: 0x58dd0921 (stale) Mirror 6: 0x58dd0921 (stale) Mirror 9: 0x58dd0921 (stale) Mirror 10: 0x58dd0921 (stale) Mirror 11: 0x58dd0921 (stale) Mirror 13: 0x58dd0921 (stale) Mirror 15: 0x58dd0921 (stale) Mirror 16: 0x58dd0921 (stale) Mirror 17: 0xf4af65ae (stale) Mirror 18: 0x555f37a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ddd): Mirror 2: 0x58dd0921 (stale) Mirror 5: 0x58dd0921 (stale) Mirror 6: 0x58dd0921 (stale) Mirror 9: 0x58dd0921 (stale) Mirror 10: 0x58dd0921 (stale) Mirror 11: 0x58dd0921 (stale) Mirror 13: 0x58dd0921 (stale) Mirror 15: 0x58dd0921 (stale) Mirror 16: 0x58dd0921 (stale) Mirror 17: 0xf4af65ae (stale) Mirror 18: 0x555f37a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ddd: skipped 000478 1783138423.137988 mapread 0x012ee3 thru 0x014ec5 (0x1fe3 bytes) 000479 1783138423.182662 punch from 0x0099d5 to 0x01673f (0xcd6b bytes) 000480 1783138423.198924 fallocate 0x03020d thru 0x03114e (0xf42 bytes) 000481 1783138423.205992 mapwrite 0x006bdb thru 0x00fe97 (0x92bd bytes) 000482 1783138423.277102 write 0x020f93 thru 0x02b521 (0xa58f bytes) 000483 1783138423.306902 trunc from 0x02b522 to 0x013281 (0x182a0 bytes) 000484 1783138423.336834 read 0x00b33c thru 0x0114a7 (0x616c bytes) 000485 1783138423.344147 write 0x000f33 thru 0x005cfd (0x4dcb bytes) 000486 1783138423.358123 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x13282): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13282): Mirror 2: 0xa9b7a52d (stale) Mirror 5: 0xa9b7a52d (stale) Mirror 6: 0xa9b7a52d (stale) Mirror 9: 0xa9b7a52d (stale) Mirror 10: 0xa9b7a52d (stale) Mirror 11: 0xa9b7a52d (stale) Mirror 13: 0xa9b7a52d (stale) Mirror 15: 0xa9b7a52d (stale) Mirror 16: 0xa9b7a52d (stale) Mirror 17: 0xa9b7a52d (stale) Mirror 18: 0x8f764526 (stale) CRC-32 checksum value for chunk [0, 0x13282): Mirror 1: 0x73d20846 Mirror 19: 0x73d20846 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13282: skipped 000487 1783138424.553813 mapwrite 0x01a27e thru 0x023efc (0x9c7f bytes) 000488 1783138424.795480 write 0x021ebc thru 0x025d11 (0x3e56 bytes) 000489 1783138424.802710 read 0x01bfd4 thru 0x0214db (0x5508 bytes) 000490 1783138424.803609 mapwrite 0x0136fe thru 0x022518 (0xee1b bytes) 000491 1783138424.872532 mapwrite 0x011909 thru 0x01f7d5 (0xdecd bytes) 000492 1783138424.933649 trunc from 0x025d12 to 0x03b6a8 (0x15997 bytes) 000494 1783138425.007144 write 0x00fb7d thru 0x01a9b8 (0xae3c bytes) 000495 1783138425.012411 punch from 0x00087b to 0x002f81 (0x2707 bytes) 000496 1783138425.018159 fallocate 0x0229d6 thru 0x024626 (0x1c51 bytes) 000497 1783138425.024457 mapwrite 0x01aae1 thru 0x025c54 (0xb174 bytes) 000499 1783138425.081983 fallocate 0x025b02 thru 0x02b514 (0x5a13 bytes) 000500 1783138425.097638 read 0x02d0b4 thru 0x03621d (0x916a bytes) 000501 1783138425.111280 trunc from 0x033947 to 0x0384ac (0x4b66 bytes) 000502 1783138425.123426 trunc from 0x029007 to 0x036097 (0xd091 bytes) 000504 1783138425.130780 read 0x01285c thru 0x01e08d (0xb832 bytes) 000505 1783138425.131634 fallocate 0x03500b thru 0x03ffff (0xaff5 bytes) 000506 1783138425.136795 mapread 0x00714a thru 0x013fda (0xce91 bytes) 000507 1783138425.138251 write 0x039d22 thru 0x03ffff (0x62de bytes) 000508 1783138425.148100 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xc728389c (stale) Mirror 18: 0x4e5be44b (stale) Mirror 19: 0xf99c7287 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6ef42f50 Mirror 20: 0x6ef42f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000509 1783138427.073899 read 0x004a19 thru 0x00ed35 (0xa31d bytes) 000510 1783138427.110688 trunc from 0x040000 to 0x017aa2 (0x2855d bytes) 000511 1783138427.210801 punch from 0x00eff2 to 0x00f205 (0x214 bytes) 000512 1783138427.216258 trunc from 0x017aa3 to 0x0058ab (0x121f7 bytes) 000514 1783138427.243772 punch from 0x00530e to 0x0058ab (0x59e bytes) 000515 1783138427.251746 write 0x034d14 thru 0x03946e (0x475b bytes) 000516 1783138427.254844 mapread 0x00f37e thru 0x01851c (0x919f bytes) 000517 1783138427.276033 read 0x009396 thru 0x017a5a (0xe6c5 bytes) 000518 1783138427.290004 read 0x034cfa thru 0x03946e (0x4775 bytes) 000519 1783138427.291054 mapread 0x00fbd4 thru 0x013b1a (0x3f47 bytes) 000520 1783138427.304830 MIRROR_RESYNC 14 mirrors 000521 1783138430.491273 mapread 0x00cd76 thru 0x00ff4d (0x31d8 bytes) 000522 1783138430.513929 read 0x01a3e1 thru 0x0289ba (0xe5da bytes) 000523 1783138430.523877 punch from 0x007632 to 0x00db77 (0x6546 bytes) 000524 1783138430.566297 trunc from 0x03946f to 0x03f9dd (0x656f bytes) 000525 1783138430.601313 fallocate 0x010f4f thru 0x018c26 (0x7cd8 bytes) 000526 1783138430.607696 punch from 0x017952 to 0x0210e8 (0x9797 bytes) 000527 1783138430.613782 read 0x00d0df thru 0x00df5a (0xe7c bytes) 000528 1783138430.634720 mapwrite 0x03b423 thru 0x03ffff (0x4bdd bytes) 000529 1783138430.692718 fallocate 0x009ff7 thru 0x00fe9a (0x5ea4 bytes) 000530 1783138430.701146 read 0x02b8e6 thru 0x02cae1 (0x11fc bytes) 000531 1783138430.702675 trunc from 0x040000 to 0x025f6b (0x1a094 bytes) 000532 1783138430.730925 trunc from 0x025f6c to 0x00515a (0x20e11 bytes) 000533 1783138430.752796 trunc from 0x0027fe to 0x00515a (0x295d bytes) 000534 1783138430.759309 trunc from 0x00515b to 0x00e38a (0x9230 bytes) 000535 1783138430.778070 mapwrite 0x03603d thru 0x036ca9 (0xc6d bytes) 000536 1783138430.825182 trunc from 0x036caa to 0x006943 (0x30366 bytes) 000537 1783138430.844318 punch from 0x004f1b to 0x006943 (0x1a29 bytes) 000538 1783138430.852708 trunc from 0x000d2d to 0x006013 (0x52e7 bytes) 000539 1783138430.860033 trunc from 0x0042d5 to 0x006943 (0x266f bytes) 000540 1783138430.865905 mapwrite 0x01c295 thru 0x01fcca (0x3a36 bytes) 000542 1783138430.947027 mapread 0x00d407 thru 0x018065 (0xac5f bytes) 000543 1783138431.084114 mapwrite 0x0355ac thru 0x03ffff (0xaa54 bytes) 000544 1783138431.220028 punch from 0x019724 to 0x01ae8c (0x1769 bytes) 000545 1783138431.226871 read 0x028a02 thru 0x03645c (0xda5b bytes) 000546 1783138431.238143 trunc from 0x0159d8 to 0x02473b (0xed64 bytes) 000547 1783138431.243761 fallocate 0x016ec4 thru 0x0269cf (0xfb0c bytes) 000548 1783138431.248125 write 0x00a9e5 thru 0x019d0d (0xf329 bytes) 000549 1783138431.255170 write 0x038bad thru 0x03e761 (0x5bb5 bytes) 000550 1783138431.256533 fallocate 0x03a56f thru 0x03ffff (0x5a91 bytes) 000551 1783138431.263899 mapwrite 0x003d9f thru 0x00bf1b (0x817d bytes) 000552 1783138431.290844 punch from 0x02a1b8 to 0x033181 (0x8fca bytes) 000553 1783138431.298894 trunc from 0x002535 to 0x011f5d (0xfa29 bytes) 000554 1783138431.305923 write 0x0285fe thru 0x028619 (0x1c bytes) 000555 1783138431.307125 write 0x0240d7 thru 0x02c8eb (0x8815 bytes) 000556 1783138431.347296 mapwrite 0x006297 thru 0x008486 (0x21f0 bytes) 000557 1783138431.447110 mapread 0x035aae thru 0x03cb8b (0x70de bytes) 000559 1783138431.452910 punch from 0x01a268 to 0x01c7d8 (0x2571 bytes) 000560 1783138431.481344 trunc from 0x01ab18 to 0x01cbd2 (0x20bb bytes) 000561 1783138431.491947 mapwrite 0x0362b7 thru 0x03a2fe (0x4048 bytes) 000562 1783138431.547756 fallocate 0x01baea thru 0x025933 (0x9e4a bytes) 000563 1783138431.561925 write 0x01f581 thru 0x023608 (0x4088 bytes) 000565 1783138431.594387 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x715c0b49 (stale) Mirror 5: 0x715c0b49 (stale) Mirror 6: 0x715c0b49 (stale) Mirror 9: 0x715c0b49 (stale) Mirror 10: 0x715c0b49 (stale) Mirror 11: 0x715c0b49 (stale) Mirror 15: 0x715c0b49 (stale) Mirror 16: 0x715c0b49 (stale) Mirror 17: 0x715c0b49 (stale) Mirror 18: 0x715c0b49 (stale) Mirror 19: 0x715c0b49 (stale) Mirror 20: 0x715c0b49 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x715c0b49 (stale) Mirror 5: 0x715c0b49 (stale) Mirror 6: 0x715c0b49 (stale) Mirror 9: 0x715c0b49 (stale) Mirror 10: 0x715c0b49 (stale) Mirror 11: 0x715c0b49 (stale) Mirror 15: 0x715c0b49 (stale) Mirror 16: 0x715c0b49 (stale) Mirror 17: 0x715c0b49 (stale) Mirror 18: 0x715c0b49 (stale) Mirror 19: 0x715c0b49 (stale) Mirror 20: 0x715c0b49 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000567 1783138432.597729 read 0x03c435 thru 0x03ffff (0x3bcb bytes) 000568 1783138432.617585 write 0x005490 thru 0x00c740 (0x72b1 bytes) 000569 1783138432.648366 trunc from 0x040000 to 0x01d738 (0x228c7 bytes) 000570 1783138432.699988 fallocate 0x00e71c thru 0x013f8b (0x5870 bytes) 000571 1783138432.715420 mapwrite 0x03f0d5 thru 0x03ffff (0xf2b bytes) 000572 1783138432.781624 mapread 0x008327 thru 0x015cc7 (0xd9a1 bytes) 000573 1783138432.815335 trunc from 0x040000 to 0x03d0f2 (0x2f0d bytes) 000574 1783138432.859097 write 0x00bbe6 thru 0x0135ec (0x7a07 bytes) 000575 1783138432.862165 write 0x0131b6 thru 0x0174f7 (0x4342 bytes) 000576 1783138432.882640 trunc from 0x03d0f3 to 0x00b166 (0x31f8c bytes) 000577 1783138432.922651 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb167): Mirror 2: 0x3818b541 (stale) Mirror 5: 0x3818b541 (stale) Mirror 6: 0x3818b541 (stale) Mirror 9: 0x3818b541 (stale) Mirror 10: 0x3818b541 (stale) Mirror 11: 0x3818b541 (stale) Mirror 15: 0x3818b541 (stale) Mirror 17: 0x3818b541 (stale) Mirror 18: 0x3818b541 (stale) Mirror 19: 0x3818b541 (stale) Mirror 20: 0x3818b541 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb167): Mirror 2: 0x3818b541 (stale) Mirror 5: 0x3818b541 (stale) Mirror 6: 0x3818b541 (stale) Mirror 9: 0x3818b541 (stale) Mirror 10: 0x3818b541 (stale) Mirror 11: 0x3818b541 (stale) Mirror 15: 0x3818b541 (stale) Mirror 17: 0x3818b541 (stale) Mirror 18: 0x3818b541 (stale) Mirror 19: 0x3818b541 (stale) Mirror 20: 0x3818b541 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb167: skipped 000579 1783138433.579870 read 0x00348a thru 0x00af8e (0x7b05 bytes) 000580 1783138433.594820 mapread 0x00093f thru 0x00b166 (0xa828 bytes) 000581 1783138433.620734 write 0x0362e4 thru 0x03ab27 (0x4844 bytes) 000582 1783138433.628529 mapread 0x014132 thru 0x01e1cc (0xa09b bytes) 000583 1783138433.649532 punch from 0x017ac5 to 0x01f52a (0x7a66 bytes) 000584 1783138433.655245 mapread 0x0255a4 thru 0x030a79 (0xb4d6 bytes) 000585 1783138433.677202 punch from 0x0159a5 to 0x01d0da (0x7736 bytes) 000586 1783138433.682916 write 0x028653 thru 0x02ec75 (0x6623 bytes) 000587 1783138433.685558 trunc from 0x03ab28 to 0x0046cb (0x3645c bytes) 000588 1783138433.714718 punch from 0x001b3b to 0x0046cb (0x2b91 bytes) 000589 1783138433.729595 mapwrite 0x027a31 thru 0x034f94 (0xd564 bytes) 000590 1783138433.835859 fallocate 0x02eb18 thru 0x039ebe (0xb3a7 bytes) 000591 1783138433.847271 fallocate 0x022eaa thru 0x03107e (0xe1d5 bytes) 000592 1783138433.862818 fallocate 0x024f5a thru 0x02fd15 (0xadbc bytes) 000593 1783138433.869806 mapwrite 0x00859d thru 0x00b926 (0x338a bytes) 000595 1783138433.906831 mapwrite 0x0263ed thru 0x030b12 (0xa726 bytes) 000596 1783138433.997125 mapwrite 0x03fd7e thru 0x03ffff (0x282 bytes) 000597 1783138434.063919 mapread 0x039f0a thru 0x03ffff (0x60f6 bytes) 000598 1783138434.067018 mapread 0x032759 thru 0x03ffff (0xd8a7 bytes) 000599 1783138434.096291 mapread 0x018019 thru 0x0214ea (0x94d2 bytes) 000600 1783138434.129806 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x715c0b49 (stale) Mirror 5: 0x715c0b49 (stale) Mirror 6: 0x715c0b49 (stale) Mirror 9: 0x715c0b49 (stale) Mirror 10: 0x715c0b49 (stale) Mirror 11: 0x715c0b49 (stale) Mirror 15: 0x715c0b49 (stale) Mirror 17: 0x715c0b49 (stale) Mirror 18: 0x715c0b49 (stale) Mirror 19: 0x715c0b49 (stale) Mirror 20: 0x715c0b49 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x912e6e4 Mirror 21: 0x912e6e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000601 1783138435.616634 fallocate 0x005ea7 thru 0x014922 (0xea7c bytes) 000602 1783138435.691626 mapwrite 0x01b955 thru 0x01f0b9 (0x3765 bytes) 000603 1783138435.752115 mapread 0x03fba7 thru 0x03ffff (0x459 bytes) 000604 1783138435.785406 trunc from 0x02fc96 to 0x03760a (0x7975 bytes) 000605 1783138435.802155 read 0x0063df thru 0x00f6a2 (0x92c4 bytes) 000606 1783138435.818117 fallocate 0x03af45 thru 0x03ffff (0x50bb bytes) 000607 1783138435.833517 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x715c0b49 (stale) Mirror 5: 0x715c0b49 (stale) Mirror 6: 0x715c0b49 (stale) Mirror 9: 0x715c0b49 (stale) Mirror 10: 0x715c0b49 (stale) Mirror 11: 0x715c0b49 (stale) Mirror 15: 0x715c0b49 (stale) Mirror 17: 0x715c0b49 (stale) Mirror 18: 0x715c0b49 (stale) Mirror 20: 0x715c0b49 (stale) Mirror 21: 0x912e6e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x715c0b49 (stale) Mirror 5: 0x715c0b49 (stale) Mirror 6: 0x715c0b49 (stale) Mirror 9: 0x715c0b49 (stale) Mirror 10: 0x715c0b49 (stale) Mirror 11: 0x715c0b49 (stale) Mirror 15: 0x715c0b49 (stale) Mirror 17: 0x715c0b49 (stale) Mirror 18: 0x715c0b49 (stale) Mirror 20: 0x715c0b49 (stale) Mirror 21: 0x912e6e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000608 1783138436.803150 mapwrite 0x01a055 thru 0x02070a (0x66b6 bytes) 000610 1783138436.848938 mapwrite 0x026d2d thru 0x02b7a8 (0x4a7c bytes) 000611 1783138436.883934 punch from 0x0321aa to 0x03ffff (0xde56 bytes) 000612 1783138436.890110 fallocate 0x00c75e thru 0x00ce8c (0x72f bytes) 000613 1783138436.895864 fallocate 0x034fda thru 0x03ffff (0xb026 bytes) 000615 1783138436.905116 read 0x03fa09 thru 0x03ffff (0x5f7 bytes) 000616 1783138436.911854 punch from 0x0333e0 to 0x036cef (0x3910 bytes) 000617 1783138436.919599 mapread 0x003142 thru 0x00c103 (0x8fc2 bytes) 000618 1783138436.931980 trunc from 0x040000 to 0x02618f (0x19e70 bytes) 000619 1783138436.989849 read 0x019769 thru 0x0259ab (0xc243 bytes) 000620 1783138436.996641 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26190): Mirror 2: 0x9ebc5848 (stale) Mirror 5: 0x9ebc5848 (stale) Mirror 6: 0x9ebc5848 (stale) Mirror 9: 0x9ebc5848 (stale) Mirror 10: 0x9ebc5848 (stale) Mirror 15: 0x9ebc5848 (stale) Mirror 17: 0x9ebc5848 (stale) Mirror 18: 0x9ebc5848 (stale) Mirror 20: 0x9ebc5848 (stale) Mirror 21: 0x8037454c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26190): Mirror 2: 0x9ebc5848 (stale) Mirror 5: 0x9ebc5848 (stale) Mirror 6: 0x9ebc5848 (stale) Mirror 9: 0x9ebc5848 (stale) Mirror 10: 0x9ebc5848 (stale) Mirror 15: 0x9ebc5848 (stale) Mirror 17: 0x9ebc5848 (stale) Mirror 18: 0x9ebc5848 (stale) Mirror 20: 0x9ebc5848 (stale) Mirror 21: 0x8037454c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26190: skipped 000621 1783138437.837273 trunc from 0x0076ec to 0x00bccd (0x45e2 bytes) 000623 1783138437.855847 mapread 0x00dfa7 thru 0x01bdfe (0xde58 bytes) 000624 1783138437.959029 mapread 0x01ca15 thru 0x02618f (0x977b bytes) 000625 1783138437.972197 fallocate 0x024076 thru 0x030f2e (0xceb9 bytes) 000626 1783138437.977423 fallocate 0x01df42 thru 0x0271bc (0x927b bytes) 000627 1783138437.983988 mapwrite 0x015e77 thru 0x020020 (0xa1aa bytes) 000628 1783138438.048654 fallocate 0x021fee thru 0x025e58 (0x3e6b bytes) 000630 1783138438.072187 punch from 0x004927 to 0x01182d (0xcf07 bytes) 000631 1783138438.095013 read 0x019f37 thru 0x01cad7 (0x2ba1 bytes) 000632 1783138438.099587 mapread 0x00c9cc thru 0x00d757 (0xd8c bytes) 000633 1783138438.148574 trunc from 0x015528 to 0x01ed5c (0x9835 bytes) 000634 1783138438.184838 MIRROR_RESYNC 11 mirrors 000635 1783138441.665842 mapread 0x014126 thru 0x01df28 (0x9e03 bytes) 000636 1783138441.699570 mapwrite 0x01fa6c thru 0x0201d9 (0x76e bytes) 000637 1783138441.807580 punch from 0x001850 to 0x001c41 (0x3f2 bytes) 000638 1783138441.820066 trunc from 0x026190 to 0x01e8d4 (0x78bb bytes) 000639 1783138441.854590 trunc from 0x01cb6d to 0x01e8d4 (0x1d68 bytes) 000641 1783138441.868052 trunc from 0x00f67c to 0x01cff0 (0xd975 bytes) 000642 1783138441.878558 punch from 0x00fdb5 to 0x01e8d4 (0xeb20 bytes) 000643 1783138441.883753 write 0x034db5 thru 0x03b362 (0x65ae bytes) 000644 1783138441.891838 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b363): Mirror 5: 0x4e318fcb (stale) Mirror 6: 0x4e318fcb (stale) Mirror 9: 0x4e318fcb (stale) Mirror 10: 0x4e318fcb (stale) Mirror 15: 0x4e318fcb (stale) Mirror 17: 0x4e318fcb (stale) Mirror 18: 0x4e318fcb (stale) Mirror 20: 0x4e318fcb (stale) Mirror 21: 0x4e318fcb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b363): Mirror 5: 0x4e318fcb (stale) Mirror 6: 0x4e318fcb (stale) Mirror 9: 0x4e318fcb (stale) Mirror 10: 0x4e318fcb (stale) Mirror 15: 0x4e318fcb (stale) Mirror 17: 0x4e318fcb (stale) Mirror 18: 0x4e318fcb (stale) Mirror 20: 0x4e318fcb (stale) Mirror 21: 0x4e318fcb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b363: skipped 000646 1783138442.619528 read 0x028774 thru 0x02db87 (0x5414 bytes) 000647 1783138442.637804 fallocate 0x02321f thru 0x032b0b (0xf8ed bytes) 000648 1783138442.647810 trunc from 0x021331 to 0x02f793 (0xe463 bytes) 000649 1783138442.657587 mapread 0x018817 thru 0x024605 (0xbdef bytes) 000650 1783138442.701358 mapread 0x037547 thru 0x03b362 (0x3e1c bytes) 000651 1783138442.714401 mapwrite 0x013b73 thru 0x01a496 (0x6924 bytes) 000652 1783138442.738844 fallocate 0x01bc20 thru 0x027d92 (0xc173 bytes) 000653 1783138442.752028 read 0x037e84 thru 0x03b362 (0x34df bytes) 000654 1783138442.755021 write 0x02f7fc thru 0x03d4f3 (0xdcf8 bytes) 000655 1783138442.777147 mapread 0x013358 thru 0x0198ab (0x6554 bytes) 000656 1783138442.779698 trunc from 0x01f5f4 to 0x02185f (0x226c bytes) 000657 1783138442.786730 mapread 0x007809 thru 0x0118a4 (0xa09c bytes) 000658 1783138442.795953 read 0x019323 thru 0x01cbda (0x38b8 bytes) 000659 1783138442.801948 fallocate 0x032ea1 thru 0x03ffff (0xd15f bytes) 000660 1783138442.812852 write 0x012255 thru 0x01f8ae (0xd65a bytes) 000662 1783138442.838833 MIRROR_RESYNC 10 mirrors 000664 1783138445.876604 read 0x0364da thru 0x03d4f3 (0x701a bytes) 000665 1783138445.888379 read 0x009a24 thru 0x00e264 (0x4841 bytes) 000666 1783138445.926823 mapwrite 0x02b797 thru 0x03a6a7 (0xef11 bytes) 000667 1783138446.114694 write 0x038995 thru 0x03ffff (0x766b bytes) 000668 1783138446.122329 mapread 0x0294c4 thru 0x031cee (0x882b bytes) 000669 1783138446.157377 read 0x024d09 thru 0x02dc84 (0x8f7c bytes) 000670 1783138446.178693 mapread 0x004d6a thru 0x0062eb (0x1582 bytes) 000671 1783138446.187400 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x892f9c9b (stale) Mirror 6: 0x892f9c9b (stale) Mirror 9: 0x892f9c9b (stale) Mirror 10: 0x892f9c9b (stale) Mirror 15: 0x892f9c9b (stale) Mirror 17: 0x892f9c9b (stale) Mirror 18: 0x892f9c9b (stale) Mirror 20: 0x892f9c9b (stale) Mirror 21: 0x892f9c9b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa0aa6a10 Mirror 22: 0xa0aa6a10 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000672 1783138447.623007 mapwrite 0x0375f7 thru 0x03ffff (0x8a09 bytes) 000673 1783138447.835936 MIRROR_RESYNC 11 mirrors 000674 1783138450.834448 mapread 0x00fdca thru 0x01fac3 (0xfcfa bytes) 000676 1783138450.873094 trunc from 0x00a4c4 to 0x016d7d (0xc8ba bytes) 000677 1783138450.917600 fallocate 0x03a7aa thru 0x03fb4b (0x53a2 bytes) 000678 1783138450.927495 trunc from 0x040000 to 0x01d8af (0x22750 bytes) 000679 1783138450.952534 trunc from 0x0138af to 0x015035 (0x1787 bytes) 000681 1783138450.964347 fallocate 0x02810f thru 0x03148c (0x937e bytes) 000682 1783138450.982677 trunc from 0x01ea96 to 0x029f94 (0xb4ff bytes) 000683 1783138450.994522 trunc from 0x03148d to 0x020763 (0x10d29 bytes) 000684 1783138451.026397 punch from 0x0098cf to 0x00db94 (0x42c6 bytes) 000685 1783138451.034357 fallocate 0x00f728 thru 0x017ebf (0x8798 bytes) 000686 1783138451.044002 trunc from 0x020764 to 0x0260b5 (0x5952 bytes) 000687 1783138451.090675 read 0x009622 thru 0x015efe (0xc8dd bytes) 000690 1783138451.118998 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x260b6): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x260b6): Mirror 5: 0xcce9e675 (stale) Mirror 6: 0xcce9e675 (stale) Mirror 9: 0xcce9e675 (stale) Mirror 10: 0xcce9e675 (stale) Mirror 15: 0xcce9e675 (stale) Mirror 17: 0xcce9e675 (stale) Mirror 18: 0xcce9e675 (stale) Mirror 20: 0xcce9e675 (stale) Mirror 21: 0xcce9e675 (stale) Mirror 22: 0xcce9e675 (stale) CRC-32 checksum value for chunk [0, 0x260b6): Mirror 1: 0x98f60c83 Mirror 23: 0x98f60c83 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x260b6: skipped 000691 1783138452.649361 trunc from 0x0260b6 to 0x01e144 (0x7f71 bytes) 000692 1783138452.741572 mapread 0x00e2c4 thru 0x0108d0 (0x260d bytes) 000693 1783138452.761906 read 0x00be8a thru 0x0167c5 (0xa93c bytes) 000694 1783138452.762832 trunc from 0x008cfe to 0x01552a (0xc82d bytes) 000695 1783138452.768575 trunc from 0x01e145 to 0x03a506 (0x1c3c2 bytes) 000697 1783138452.792743 trunc from 0x02184d to 0x02ba74 (0xa228 bytes) 000698 1783138452.803731 MIRROR_RESYNC 12 mirrors 000699 1783138455.932854 trunc from 0x01c715 to 0x021a1b (0x5307 bytes) 000700 1783138456.031102 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a507): Mirror 5: 0xb49fe8ef (stale) Mirror 6: 0xb49fe8ef (stale) Mirror 9: 0xb49fe8ef (stale) Mirror 10: 0xb49fe8ef (stale) Mirror 15: 0xb49fe8ef (stale) Mirror 17: 0xb49fe8ef (stale) Mirror 18: 0xb49fe8ef (stale) Mirror 21: 0xb49fe8ef (stale) Mirror 22: 0xb49fe8ef (stale) Mirror 23: 0xb49fe8ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a507): Mirror 5: 0xb49fe8ef (stale) Mirror 6: 0xb49fe8ef (stale) Mirror 9: 0xb49fe8ef (stale) Mirror 10: 0xb49fe8ef (stale) Mirror 15: 0xb49fe8ef (stale) Mirror 17: 0xb49fe8ef (stale) Mirror 18: 0xb49fe8ef (stale) Mirror 21: 0xb49fe8ef (stale) Mirror 22: 0xb49fe8ef (stale) Mirror 23: 0xb49fe8ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a507: skipped 000701 1783138456.788923 fallocate 0x01119d thru 0x011806 (0x66a bytes) 000702 1783138456.797425 mapwrite 0x032970 thru 0x03ffb0 (0xd641 bytes) 000703 1783138456.907388 trunc from 0x0373a3 to 0x03854c (0x11aa bytes) 000704 1783138456.915918 mapread 0x013f7b thru 0x01af3c (0x6fc2 bytes) 000705 1783138456.930047 mapread 0x0164cd thru 0x01c098 (0x5bcc bytes) 000706 1783138456.943264 punch from 0x02666c to 0x033e74 (0xd809 bytes) 000707 1783138456.950508 read 0x02a6ee thru 0x034df3 (0xa706 bytes) 000708 1783138456.965084 punch from 0x03f6c1 to 0x03ffb0 (0x8f0 bytes) 000709 1783138456.981357 punch from 0x010b62 to 0x01656a (0x5a09 bytes) 000710 1783138456.995275 trunc from 0x03ffb1 to 0x009abb (0x364f5 bytes) 000711 1783138457.027172 punch from 0x0085ec to 0x009abb (0x14d0 bytes) 000712 1783138457.035205 read 0x002643 thru 0x009abb (0x7479 bytes) 000713 1783138457.044937 fallocate 0x012bd2 thru 0x014837 (0x1c66 bytes) 000714 1783138457.051534 read 0x0059e0 thru 0x009abb (0x40dc bytes) 000715 1783138457.056628 MIRROR_RESYNC 11 mirrors 000717 1783138459.077607 trunc from 0x009abc to 0x0231b7 (0x196fc bytes) 000718 1783138459.139560 trunc from 0x0231b8 to 0x0015c6 (0x21bf1 bytes) 000719 1783138459.184285 MIRROR_RESYNC 11 mirrors 000720 1783138460.995002 mapwrite 0x034cb3 thru 0x035ddc (0x112a bytes) 000721 1783138461.097445 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35ddd): Mirror 5: 0xfc8131d1 (stale) Mirror 6: 0xfc8131d1 (stale) Mirror 9: 0xfc8131d1 (stale) Mirror 10: 0xfc8131d1 (stale) Mirror 15: 0xfc8131d1 (stale) Mirror 17: 0xfc8131d1 (stale) Mirror 18: 0xfc8131d1 (stale) Mirror 22: 0xfc8131d1 (stale) Mirror 23: 0xfc8131d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ddd): Mirror 5: 0xfc8131d1 (stale) Mirror 6: 0xfc8131d1 (stale) Mirror 9: 0xfc8131d1 (stale) Mirror 10: 0xfc8131d1 (stale) Mirror 15: 0xfc8131d1 (stale) Mirror 17: 0xfc8131d1 (stale) Mirror 18: 0xfc8131d1 (stale) Mirror 22: 0xfc8131d1 (stale) Mirror 23: 0xfc8131d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ddd: skipped 000722 1783138461.652191 mapread 0x03080b thru 0x03580b (0x5001 bytes) 000723 1783138461.679161 punch from 0x01c4c6 to 0x025422 (0x8f5d bytes) 000724 1783138461.686945 mapread 0x02154c thru 0x021b0f (0x5c4 bytes) 000725 1783138461.700810 mapwrite 0x009001 thru 0x00fd5d (0x6d5d bytes) 000726 1783138461.746029 fallocate 0x01d167 thru 0x02683a (0x96d4 bytes) 000727 1783138461.755092 trunc from 0x035ddd to 0x024147 (0x11c95 bytes) 000728 1783138461.796863 mapwrite 0x01790c thru 0x0223da (0xaacf bytes) 000729 1783138461.849243 punch from 0x007df9 to 0x008473 (0x67b bytes) 000730 1783138461.855151 write 0x01e682 thru 0x02a48f (0xbe0e bytes) 000731 1783138461.857500 fallocate 0x00b2fd thru 0x01925f (0xdf63 bytes) 000732 1783138461.863011 mapwrite 0x00ae1b thru 0x01a997 (0xfb7d bytes) 000733 1783138461.885112 write 0x0374f3 thru 0x03ffff (0x8b0d bytes) 000735 1783138461.892996 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000736 1783138462.348310 write 0x021503 thru 0x03009b (0xeb99 bytes) 000738 1783138462.368387 trunc from 0x038c8a to 0x03ffff (0x7376 bytes) 000739 1783138462.373124 read 0x0388a3 thru 0x03ffff (0x775d bytes) 000740 1783138462.384326 fallocate 0x00629c thru 0x013e32 (0xdb97 bytes) 000741 1783138462.389455 read 0x00835e thru 0x010195 (0x7e38 bytes) 000742 1783138462.408312 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65bc8213 Mirror 24: 0x65bc8213 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000743 1783138463.405205 mapread 0x00ab65 thru 0x01739a (0xc836 bytes) 000744 1783138463.472581 trunc from 0x032752 to 0x03e012 (0xb8c1 bytes) 000745 1783138463.532334 read 0x010868 thru 0x018d11 (0x84aa bytes) 000747 1783138463.548356 read 0x0050f6 thru 0x0095b5 (0x44c0 bytes) 000749 1783138463.561092 write 0x036f19 thru 0x03f9f6 (0x8ade bytes) 000750 1783138463.567528 mapwrite 0x02a5b7 thru 0x02da67 (0x34b1 bytes) 000751 1783138463.585201 write 0x02720e thru 0x02c779 (0x556c bytes) 000753 1783138463.591925 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0x65bc8213 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x999c489b Mirror 25: 0x999c489b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000754 1783138465.069279 punch from 0x007f55 to 0x00bdee (0x3e9a bytes) 000755 1783138465.170739 mapread 0x016f9c thru 0x018fb3 (0x2018 bytes) 000757 1783138465.211339 trunc from 0x040000 to 0x03448a (0xbb75 bytes) 000758 1783138465.290788 trunc from 0x02369e to 0x02dd4c (0xa6af bytes) 000759 1783138465.303965 punch from 0x03141d to 0x03448a (0x306e bytes) 000760 1783138465.324061 mapwrite 0x02de66 thru 0x02dffa (0x195 bytes) 000761 1783138465.355932 trunc from 0x024348 to 0x02bfa1 (0x7c5a bytes) 000762 1783138465.367030 trunc from 0x021166 to 0x024d82 (0x3c1d bytes) 000764 1783138465.374931 read 0x026336 thru 0x02b5aa (0x5275 bytes) 000765 1783138465.385694 mapwrite 0x02a546 thru 0x0387e8 (0xe2a3 bytes) 000766 1783138465.468050 punch from 0x02a05d to 0x032cfd (0x8ca1 bytes) 000767 1783138465.480747 mapwrite 0x01af2d thru 0x020247 (0x531b bytes) 000768 1783138465.507331 fallocate 0x024c2d thru 0x02d2f9 (0x86cd bytes) 000769 1783138465.516990 mapwrite 0x030082 thru 0x0341f1 (0x4170 bytes) 000770 1783138465.548280 mapwrite 0x02c730 thru 0x0313a8 (0x4c79 bytes) 000771 1783138465.566264 read 0x02caec thru 0x0304d9 (0x39ee bytes) 000772 1783138465.567025 mapread 0x00846b thru 0x00b69f (0x3235 bytes) 000773 1783138465.582899 mapwrite 0x00ea29 thru 0x01e2a2 (0xf87a bytes) 000774 1783138465.614947 mapread 0x02c60e thru 0x02e299 (0x1c8c bytes) 000775 1783138465.617126 trunc from 0x0387e9 to 0x016d5b (0x21a8d bytes) 000776 1783138465.645999 trunc from 0x016d5c to 0x01ce3b (0x60e0 bytes) 000777 1783138465.677187 mapwrite 0x01fa07 thru 0x0294be (0x9ab8 bytes) 000778 1783138465.840071 fallocate 0x029039 thru 0x036d3f (0xdd07 bytes) 000779 1783138465.845846 punch from 0x0178dd to 0x0213d2 (0x9af6 bytes) 000782 1783138465.852499 fallocate 0x015902 thru 0x02144f (0xbb4e bytes) 000783 1783138465.859010 read 0x01bd27 thru 0x021e24 (0x60fe bytes) 000784 1783138465.871858 read 0x027a2f thru 0x0294be (0x1a90 bytes) 000785 1783138465.872761 punch from 0x01b211 to 0x026ddd (0xbbcd bytes) 000786 1783138465.884018 punch from 0x0008da to 0x0071a6 (0x68cd bytes) 000787 1783138465.891187 trunc from 0x01660b to 0x01ba67 (0x545d bytes) 000788 1783138465.897005 mapread 0x00d94c thru 0x01b261 (0xd916 bytes) 000789 1783138465.920527 mapread 0x00bb63 thru 0x016a12 (0xaeb0 bytes) 000790 1783138465.924029 punch from 0x022ece to 0x0294be (0x65f1 bytes) 000791 1783138465.932328 mapwrite 0x006eab thru 0x014a1b (0xdb71 bytes) 000792 1783138465.969501 read 0x027f66 thru 0x028f74 (0x100f bytes) 000793 1783138465.983536 write 0x006223 thru 0x015f48 (0xfd26 bytes) 000794 1783138465.989663 read 0x028195 thru 0x0294be (0x132a bytes) 000795 1783138465.992163 trunc from 0x0294bf to 0x00b2f7 (0x1e1c7 bytes) 000796 1783138466.020512 write 0x010ae6 thru 0x01893d (0x7e58 bytes) 000798 1783138466.028883 mapwrite 0x0294e7 thru 0x02b85a (0x2374 bytes) 000799 1783138466.095038 mapread 0x007196 thru 0x011f9f (0xae0a bytes) 000802 1783138466.101403 read 0x018115 thru 0x019323 (0x120f bytes) 000803 1783138466.103595 read 0x0069e8 thru 0x00bebe (0x54d7 bytes) 000804 1783138466.104838 fallocate 0x01c491 thru 0x02b869 (0xf3d9 bytes) 000806 1783138466.116388 read 0x02a7ee thru 0x02b869 (0x107c bytes) 000807 1783138466.126139 MIRROR_RESYNC 11 mirrors 000808 1783138469.346974 read 0x0152c6 thru 0x018fbc (0x3cf7 bytes) 000809 1783138469.352841 trunc from 0x02b86a to 0x03fb84 (0x1431b bytes) 000810 1783138469.407976 mapread 0x03f9c1 thru 0x03fb84 (0x1c4 bytes) 000811 1783138469.415328 punch from 0x02340e to 0x03336c (0xff5f bytes) 000812 1783138469.426449 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3fb85): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb85): Mirror 5: 0xbca26026 (stale) Mirror 6: 0xbca26026 (stale) Mirror 9: 0xbca26026 (stale) Mirror 10: 0xbca26026 (stale) Mirror 15: 0xbca26026 (stale) Mirror 17: 0xbca26026 (stale) Mirror 22: 0xbca26026 (stale) Mirror 23: 0xbca26026 (stale) Mirror 24: 0xbca26026 (stale) Mirror 25: 0xbca26026 (stale) CRC-32 checksum value for chunk [0, 0x3fb85): Mirror 1: 0x58ebc2cc Mirror 26: 0x58ebc2cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb85: skipped 000813 1783138470.514668 write 0x01ff5d thru 0x02c041 (0xc0e5 bytes) 000814 1783138470.631085 write 0x00f3fb thru 0x013165 (0x3d6b bytes) 000815 1783138470.647160 mapread 0x02af17 thru 0x0382a5 (0xd38f bytes) 000816 1783138470.706013 mapread 0x01ec47 thru 0x02b54f (0xc909 bytes) 000817 1783138470.729519 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb85): Mirror 5: 0xbca26026 (stale) Mirror 6: 0xbca26026 (stale) Mirror 9: 0xbca26026 (stale) Mirror 10: 0xbca26026 (stale) Mirror 15: 0xbca26026 (stale) Mirror 22: 0xbca26026 (stale) Mirror 23: 0xbca26026 (stale) Mirror 24: 0xbca26026 (stale) Mirror 25: 0xbca26026 (stale) Mirror 26: 0x58ebc2cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb85): Mirror 5: 0xbca26026 (stale) Mirror 6: 0xbca26026 (stale) Mirror 9: 0xbca26026 (stale) Mirror 10: 0xbca26026 (stale) Mirror 15: 0xbca26026 (stale) Mirror 22: 0xbca26026 (stale) Mirror 23: 0xbca26026 (stale) Mirror 24: 0xbca26026 (stale) Mirror 25: 0xbca26026 (stale) Mirror 26: 0x58ebc2cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb85: skipped 000818 1783138471.443372 write 0x029962 thru 0x036547 (0xcbe6 bytes) 000820 1783138471.460128 mapwrite 0x021d7f thru 0x02c585 (0xa807 bytes) 000821 1783138471.512119 trunc from 0x03fb85 to 0x03c3d8 (0x37ac bytes) 000822 1783138471.551921 trunc from 0x03c3d9 to 0x00491e (0x37aba bytes) 000823 1783138471.568484 mapread 0x002e64 thru 0x0047d6 (0x1973 bytes) 000824 1783138471.575567 trunc from 0x00491f to 0x0099a2 (0x5084 bytes) 000825 1783138471.592242 trunc from 0x001e1b to 0x0099a2 (0x7b88 bytes) 000826 1783138471.598315 punch from 0x009011 to 0x0099a2 (0x992 bytes) 000827 1783138471.602993 read 0x009549 thru 0x0099a2 (0x45a bytes) 000828 1783138471.611823 trunc from 0x0099a3 to 0x002be6 (0x6dbc bytes) 000829 1783138471.627030 fallocate 0x001681 thru 0x004584 (0x2f04 bytes) 000830 1783138471.632730 mapwrite 0x037275 thru 0x03bc16 (0x49a2 bytes) 000831 1783138471.677681 read 0x000085 thru 0x00594e (0x58ca bytes) 000832 1783138471.688832 punch from 0x015d6b to 0x02104f (0xb2e5 bytes) 000833 1783138471.693794 read 0x026b05 thru 0x032fa1 (0xc49d bytes) 000834 1783138471.695018 mapread 0x01dbb6 thru 0x0222d7 (0x4722 bytes) 000835 1783138471.710319 fallocate 0x00b988 thru 0x01a6bf (0xed38 bytes) 000836 1783138471.715393 mapread 0x0029d9 thru 0x00ec4c (0xc274 bytes) 000837 1783138471.717134 trunc from 0x03bc17 to 0x02cf8b (0xec8b bytes) 000838 1783138471.736090 trunc from 0x02cf8c to 0x0380fd (0xb172 bytes) 000839 1783138471.756800 write 0x00985a thru 0x0185eb (0xed92 bytes) 000840 1783138471.760950 write 0x026635 thru 0x02e89f (0x826b bytes) 000841 1783138471.773053 MIRROR_RESYNC 11 mirrors 000842 1783138474.014789 write 0x005d2b thru 0x011441 (0xb717 bytes) 000843 1783138474.075878 trunc from 0x00b170 to 0x00edfd (0x3c8e bytes) 000844 1783138474.102581 mapwrite 0x00cbaa thru 0x01b444 (0xe89b bytes) 000845 1783138474.176342 fallocate 0x03477d thru 0x03f065 (0xa8e9 bytes) 000846 1783138474.188261 mapread 0x02194c thru 0x02aa2f (0x90e4 bytes) 000847 1783138474.221562 read 0x02c2c8 thru 0x02e1b2 (0x1eeb bytes) 000848 1783138474.222309 trunc from 0x0380fe to 0x010f10 (0x271ed bytes) 000849 1783138474.253642 write 0x003b50 thru 0x00bb53 (0x8004 bytes) 000850 1783138474.259846 fallocate 0x03924f thru 0x03ffff (0x6db1 bytes) 000852 1783138474.266657 read 0x00c5c5 thru 0x010f10 (0x494c bytes) 000853 1783138474.271152 MIRROR_RESYNC 11 mirrors 000854 1783138476.190488 trunc from 0x010f11 to 0x0124a7 (0x1597 bytes) 000855 1783138476.238123 mapread 0x0071b2 thru 0x0124a7 (0xb2f6 bytes) 000856 1783138476.256463 mapread 0x0118e4 thru 0x0124a7 (0xbc4 bytes) 000857 1783138476.258167 read 0x003d51 thru 0x006e14 (0x30c4 bytes) 000858 1783138476.258894 trunc from 0x0124a8 to 0x0199f4 (0x754d bytes) 000859 1783138476.294259 mapread 0x01885a thru 0x0199c0 (0x1167 bytes) 000860 1783138476.303077 read 0x002f09 thru 0x009271 (0x6369 bytes) 000861 1783138476.303817 trunc from 0x004581 to 0x00d6e7 (0x9167 bytes) 000862 1783138476.313388 mapwrite 0x020d4d thru 0x028ba7 (0x7e5b bytes) 000863 1783138476.382087 write 0x00b137 thru 0x0100ec (0x4fb6 bytes) 000864 1783138476.383858 mapread 0x001ff4 thru 0x00c1dd (0xa1ea bytes) 000865 1783138476.385034 trunc from 0x001620 to 0x00ed7c (0xd75d bytes) 000866 1783138476.400897 mapread 0x001579 thru 0x010e00 (0xf888 bytes) 000867 1783138476.465571 trunc from 0x01291d to 0x0149f9 (0x20dd bytes) 000868 1783138476.471000 write 0x02d355 thru 0x035e21 (0x8acd bytes) 000869 1783138476.472926 mapread 0x014aca thru 0x015744 (0xc7b bytes) 000870 1783138476.484397 write 0x037973 thru 0x03ffff (0x868d bytes) 000871 1783138476.487162 trunc from 0x040000 to 0x0061e4 (0x39e1b bytes) 000872 1783138476.509105 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x61e5): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x61e5): Mirror 5: 0xdd650770 (stale) Mirror 6: 0xdd650770 (stale) Mirror 9: 0xdd650770 (stale) Mirror 10: 0xdd650770 (stale) Mirror 15: 0xdd650770 (stale) Mirror 22: 0xdd650770 (stale) Mirror 23: 0xdd650770 (stale) Mirror 24: 0xdd650770 (stale) Mirror 25: 0xdd650770 (stale) Mirror 26: 0xdd650770 (stale) CRC-32 checksum value for chunk [0, 0x61e5): Mirror 1: 0x8b1fd43b Mirror 27: 0x8b1fd43b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x61e5: skipped 000873 1783138477.416714 trunc from 0x00345f to 0x0061e4 (0x2d86 bytes) 000874 1783138477.490605 fallocate 0x00a3ed thru 0x00c30d (0x1f21 bytes) 000875 1783138477.502145 mapread 0x002eb2 thru 0x00c30d (0x945c bytes) 000876 1783138477.556530 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc30e): Mirror 5: 0x4a1af2ba (stale) Mirror 6: 0x4a1af2ba (stale) Mirror 9: 0x4a1af2ba (stale) Mirror 10: 0x4a1af2ba (stale) Mirror 15: 0x4a1af2ba (stale) Mirror 22: 0x4a1af2ba (stale) Mirror 23: 0x4a1af2ba (stale) Mirror 24: 0x4a1af2ba (stale) Mirror 25: 0x4a1af2ba (stale) Mirror 27: 0xae6a2b6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc30e): Mirror 5: 0x4a1af2ba (stale) Mirror 6: 0x4a1af2ba (stale) Mirror 9: 0x4a1af2ba (stale) Mirror 10: 0x4a1af2ba (stale) Mirror 15: 0x4a1af2ba (stale) Mirror 22: 0x4a1af2ba (stale) Mirror 23: 0x4a1af2ba (stale) Mirror 24: 0x4a1af2ba (stale) Mirror 25: 0x4a1af2ba (stale) Mirror 27: 0xae6a2b6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc30e: skipped 000877 1783138478.227824 punch from 0x00adfa to 0x00c30d (0x1514 bytes) 000878 1783138478.244950 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xc30e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc30e): Mirror 5: 0x4a1af2ba (stale) Mirror 6: 0x4a1af2ba (stale) Mirror 9: 0x4a1af2ba (stale) Mirror 10: 0x4a1af2ba (stale) Mirror 15: 0x4a1af2ba (stale) Mirror 22: 0x4a1af2ba (stale) Mirror 23: 0x4a1af2ba (stale) Mirror 24: 0x4a1af2ba (stale) Mirror 25: 0x4a1af2ba (stale) Mirror 27: 0xae6a2b6f (stale) CRC-32 checksum value for chunk [0, 0xc30e): Mirror 1: 0xae6a2b6f Mirror 28: 0xae6a2b6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc30e: skipped 000879 1783138479.851940 fallocate 0x0056eb thru 0x005a64 (0x37a bytes) 000880 1783138479.970745 trunc from 0x00c30e to 0x02a272 (0x1df65 bytes) 000881 1783138480.056013 fallocate 0x02ace9 thru 0x031bab (0x6ec3 bytes) 000882 1783138480.062900 mapread 0x00b9f6 thru 0x01056f (0x4b7a bytes) 000883 1783138480.119795 MIRROR_RESYNC 12 mirrors 000884 1783138482.657823 write 0x018ff6 thru 0x025523 (0xc52e bytes) 000885 1783138482.687939 punch from 0x023e6b to 0x02f696 (0xb82c bytes) 000886 1783138482.698892 write 0x0173f1 thru 0x023b47 (0xc757 bytes) 000887 1783138482.713017 write 0x031340 thru 0x0396d5 (0x8396 bytes) 000890 1783138482.727437 fallocate 0x01bde1 thru 0x022fe5 (0x7205 bytes) 000891 1783138482.733053 trunc from 0x0396d6 to 0x02e296 (0xb43f bytes) 000892 1783138482.763988 punch from 0x01010f to 0x0176ac (0x759e bytes) 000893 1783138482.790101 trunc from 0x02e297 to 0x013e74 (0x1a422 bytes) 000894 1783138482.817767 mapwrite 0x023bfc thru 0x032450 (0xe855 bytes) 000895 1783138482.919899 punch from 0x02c18a to 0x032450 (0x62c7 bytes) 000896 1783138482.925557 mapwrite 0x02524c thru 0x027dae (0x2b63 bytes) 000897 1783138482.938490 fallocate 0x004d0f thru 0x0100ad (0xb39f bytes) 000898 1783138482.943676 trunc from 0x032451 to 0x007e5c (0x2a5f4 bytes) 000899 1783138482.956203 mapwrite 0x01120c thru 0x01b68d (0xa482 bytes) 000900 1783138483.045404 trunc from 0x01134c to 0x01b68d (0xa342 bytes) 000901 1783138483.056161 fallocate 0x0355cc thru 0x03ffff (0xaa34 bytes) 000903 1783138483.075728 write 0x03e51b thru 0x03ffff (0x1ae5 bytes) 000904 1783138483.077279 write 0x02260a thru 0x02e205 (0xbbfc bytes) 000905 1783138483.098584 write 0x027518 thru 0x02e107 (0x6bf0 bytes) 000906 1783138483.105241 trunc from 0x040000 to 0x01ebb7 (0x21448 bytes) 000907 1783138483.140112 trunc from 0x01ebb8 to 0x034451 (0x1589a bytes) 000908 1783138483.168844 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34452): Mirror 5: 0xfad14f60 (stale) Mirror 6: 0xfad14f60 (stale) Mirror 9: 0xfad14f60 (stale) Mirror 10: 0xfad14f60 (stale) Mirror 15: 0xfad14f60 (stale) Mirror 22: 0xfad14f60 (stale) Mirror 23: 0xfad14f60 (stale) Mirror 24: 0xfad14f60 (stale) Mirror 25: 0xfad14f60 (stale) Mirror 27: 0xfad14f60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34452): Mirror 5: 0xfad14f60 (stale) Mirror 6: 0xfad14f60 (stale) Mirror 9: 0xfad14f60 (stale) Mirror 10: 0xfad14f60 (stale) Mirror 15: 0xfad14f60 (stale) Mirror 22: 0xfad14f60 (stale) Mirror 23: 0xfad14f60 (stale) Mirror 24: 0xfad14f60 (stale) Mirror 25: 0xfad14f60 (stale) Mirror 27: 0xfad14f60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34452: skipped 000909 1783138483.998757 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34452): Mirror 5: 0xfad14f60 (stale) Mirror 6: 0xfad14f60 (stale) Mirror 10: 0xfad14f60 (stale) Mirror 15: 0xfad14f60 (stale) Mirror 22: 0xfad14f60 (stale) Mirror 23: 0xfad14f60 (stale) Mirror 24: 0xfad14f60 (stale) Mirror 25: 0xfad14f60 (stale) Mirror 27: 0xfad14f60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34452): Mirror 5: 0xfad14f60 (stale) Mirror 6: 0xfad14f60 (stale) Mirror 10: 0xfad14f60 (stale) Mirror 15: 0xfad14f60 (stale) Mirror 22: 0xfad14f60 (stale) Mirror 23: 0xfad14f60 (stale) Mirror 24: 0xfad14f60 (stale) Mirror 25: 0xfad14f60 (stale) Mirror 27: 0xfad14f60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34452: skipped 000911 1783138484.740889 read 0x02f316 thru 0x034451 (0x513c bytes) 000912 1783138484.768030 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34452): Mirror 5: 0xfad14f60 (stale) Mirror 6: 0xfad14f60 (stale) Mirror 10: 0xfad14f60 (stale) Mirror 15: 0xfad14f60 (stale) Mirror 22: 0xfad14f60 (stale) Mirror 23: 0xfad14f60 (stale) Mirror 24: 0xfad14f60 (stale) Mirror 25: 0xfad14f60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34452): Mirror 5: 0xfad14f60 (stale) Mirror 6: 0xfad14f60 (stale) Mirror 10: 0xfad14f60 (stale) Mirror 15: 0xfad14f60 (stale) Mirror 22: 0xfad14f60 (stale) Mirror 23: 0xfad14f60 (stale) Mirror 24: 0xfad14f60 (stale) Mirror 25: 0xfad14f60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34452: skipped 000913 1783138485.720715 trunc from 0x034452 to 0x0080dc (0x2c375 bytes) 000914 1783138485.745065 trunc from 0x0080dd to 0x02137b (0x1929f bytes) 000915 1783138485.765522 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2137c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2137c): Mirror 5: 0x77c7b314 (stale) Mirror 6: 0x77c7b314 (stale) Mirror 10: 0x77c7b314 (stale) Mirror 15: 0x77c7b314 (stale) Mirror 22: 0x77c7b314 (stale) Mirror 23: 0x77c7b314 (stale) Mirror 24: 0x77c7b314 (stale) Mirror 25: 0x77c7b314 (stale) CRC-32 checksum value for chunk [0, 0x2137c): Mirror 1: 0x77c7b314 Mirror 26: 0x77c7b314 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2137c: skipped 000916 1783138487.046186 write 0x005cac thru 0x015408 (0xf75d bytes) 000917 1783138487.096096 punch from 0x013f73 to 0x01c56f (0x85fd bytes) 000918 1783138487.112062 mapwrite 0x02ff2b thru 0x03c403 (0xc4d9 bytes) 000919 1783138487.178620 fallocate 0x02dbcb thru 0x0370a1 (0x94d7 bytes) 000920 1783138487.185886 fallocate 0x011186 thru 0x018f70 (0x7deb bytes) 000921 1783138487.191584 trunc from 0x0221a4 to 0x02e62d (0xc48a bytes) 000922 1783138487.196832 fallocate 0x032b7b thru 0x03a9c9 (0x7e4f bytes) 000923 1783138487.202174 trunc from 0x03a4fd to 0x03c403 (0x1f07 bytes) 000925 1783138487.208656 mapwrite 0x01d303 thru 0x023396 (0x6094 bytes) 000926 1783138487.237988 fallocate 0x03ff38 thru 0x03ffff (0xc8 bytes) 000927 1783138487.243335 write 0x01737b thru 0x0269b2 (0xf638 bytes) 000928 1783138487.251026 punch from 0x031d7a to 0x036247 (0x44ce bytes) 000929 1783138487.258120 trunc from 0x03c404 to 0x02d761 (0xeca2 bytes) 000930 1783138487.277018 fallocate 0x00d5ae thru 0x01d4c8 (0xff1b bytes) 000931 1783138487.284137 mapread 0x01087d thru 0x01864a (0x7dce bytes) 000932 1783138487.290922 mapread 0x02d3d6 thru 0x02d761 (0x38c bytes) 000933 1783138487.301032 read 0x00fbea thru 0x012cbc (0x30d3 bytes) 000934 1783138487.302120 mapwrite 0x030228 thru 0x0320e5 (0x1ebe bytes) 000936 1783138487.343196 mapwrite 0x03e2a8 thru 0x03ffff (0x1d58 bytes) 000937 1783138487.390506 write 0x01a4e2 thru 0x01fefe (0x5a1d bytes) 000938 1783138487.392704 mapread 0x01d1d4 thru 0x02c4cc (0xf2f9 bytes) 000941 1783138487.396826 trunc from 0x040000 to 0x00fccb (0x30334 bytes) 000942 1783138487.416924 read 0x001aff thru 0x00e31b (0xc81d bytes) 000943 1783138487.427797 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfccc): Mirror 5: 0xda98baae (stale) Mirror 6: 0xda98baae (stale) Mirror 10: 0xda98baae (stale) Mirror 15: 0xda98baae (stale) Mirror 22: 0xda98baae (stale) Mirror 23: 0xda98baae (stale) Mirror 24: 0xda98baae (stale) Mirror 25: 0xda98baae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfccc): Mirror 5: 0xda98baae (stale) Mirror 6: 0xda98baae (stale) Mirror 10: 0xda98baae (stale) Mirror 15: 0xda98baae (stale) Mirror 22: 0xda98baae (stale) Mirror 23: 0xda98baae (stale) Mirror 24: 0xda98baae (stale) Mirror 25: 0xda98baae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfccc: skipped 000944 1783138488.113141 trunc from 0x00fccc to 0x00f258 (0xa73 bytes) 000945 1783138488.167824 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xf259): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf259): Mirror 5: 0x33aea680 (stale) Mirror 6: 0x33aea680 (stale) Mirror 10: 0x33aea680 (stale) Mirror 15: 0x33aea680 (stale) Mirror 22: 0x33aea680 (stale) Mirror 23: 0x33aea680 (stale) Mirror 24: 0x33aea680 (stale) Mirror 25: 0x33aea680 (stale) CRC-32 checksum value for chunk [0, 0xf259): Mirror 1: 0x92ba470e Mirror 26: 0x92ba470e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf259: skipped 000946 1783138490.089692 mapwrite 0x002c13 thru 0x011cf2 (0xf0e0 bytes) 000947 1783138490.201913 fallocate 0x00bd44 thru 0x01499c (0x8c59 bytes) 000948 1783138490.206632 trunc from 0x00cbb1 to 0x011cf2 (0x5142 bytes) 000949 1783138490.212573 fallocate 0x00d470 thru 0x011655 (0x41e6 bytes) 000950 1783138490.217104 punch from 0x00fb6e to 0x011cf2 (0x2185 bytes) 000951 1783138490.222749 read 0x00345d thru 0x006149 (0x2ced bytes) 000952 1783138490.223409 trunc from 0x00a86f to 0x011cf2 (0x7484 bytes) 000953 1783138490.228851 write 0x0089bd thru 0x0158b7 (0xcefb bytes) 000954 1783138490.230450 mapread 0x000049 thru 0x00b1f6 (0xb1ae bytes) 000955 1783138490.237466 punch from 0x009577 to 0x0158b7 (0xc341 bytes) 000956 1783138490.251765 write 0x0389c9 thru 0x03a14b (0x1783 bytes) 000957 1783138490.253078 write 0x009f91 thru 0x01549c (0xb50c bytes) 000958 1783138490.264545 read 0x01eee4 thru 0x021049 (0x2166 bytes) 000959 1783138490.272637 trunc from 0x03a14c to 0x03b70a (0x15bf bytes) 000960 1783138490.299673 mapwrite 0x016857 thru 0x019b2c (0x32d6 bytes) 000961 1783138490.319863 trunc from 0x010244 to 0x019fef (0x9dac bytes) 000962 1783138490.325823 fallocate 0x01f35f thru 0x021115 (0x1db7 bytes) 000963 1783138490.331816 trunc from 0x03b70b to 0x03b3c0 (0x34a bytes) 000964 1783138490.345927 fallocate 0x01d4a4 thru 0x0255b9 (0x8116 bytes) 000965 1783138490.351112 read 0x028e70 thru 0x037a85 (0xec16 bytes) 000966 1783138490.352702 fallocate 0x0323d6 thru 0x033be8 (0x1813 bytes) 000967 1783138490.357978 mapwrite 0x021cb8 thru 0x02961e (0x7967 bytes) 000968 1783138490.391474 punch from 0x031b83 to 0x03522b (0x36a9 bytes) 000969 1783138490.397971 read 0x032d72 thru 0x03b3c0 (0x864f bytes) 000970 1783138490.409627 fallocate 0x003dce thru 0x00634b (0x257e bytes) 000971 1783138490.413919 read 0x0394e3 thru 0x03b3c0 (0x1ede bytes) 000972 1783138490.414546 mapwrite 0x018b90 thru 0x020862 (0x7cd3 bytes) 000973 1783138490.431614 punch from 0x024f32 to 0x0325e3 (0xd6b2 bytes) 000974 1783138490.437144 trunc from 0x03b3c1 to 0x036e54 (0x456c bytes) 000975 1783138490.454021 punch from 0x033503 to 0x034bd7 (0x16d5 bytes) 000976 1783138490.458624 mapread 0x02003a thru 0x026a40 (0x6a07 bytes) 000977 1783138490.471467 trunc from 0x000825 to 0x009e1c (0x95f8 bytes) 000978 1783138490.476021 trunc from 0x036e55 to 0x0020d8 (0x34d7c bytes) 000979 1783138490.490489 mapread 0x001f83 thru 0x0020d8 (0x156 bytes) 000980 1783138490.511460 write 0x014718 thru 0x016213 (0x1afc bytes) 000981 1783138490.513078 fallocate 0x02924a thru 0x0297b2 (0x569 bytes) 000982 1783138490.520028 read 0x002081 thru 0x00424b (0x21cb bytes) 000983 1783138490.528096 read 0x01020a thru 0x016213 (0x600a bytes) 000985 1783138490.529415 read 0x01553e thru 0x016213 (0xcd6 bytes) 000986 1783138490.530595 read 0x0149b5 thru 0x016213 (0x185f bytes) 000987 1783138490.531146 read 0x0029e6 thru 0x00ef83 (0xc59e bytes) 000988 1783138490.535904 MIRROR_RESYNC 10 mirrors 000989 1783138492.690639 mapwrite 0x0255ff thru 0x029f9d (0x499f bytes) 000991 1783138492.987674 read 0x0086f9 thru 0x0124b4 (0x9dbc bytes) 000992 1783138493.013815 fallocate 0x01e111 thru 0x027747 (0x9637 bytes) 000994 1783138493.039926 trunc from 0x029f9e to 0x037f88 (0xdfeb bytes) 000995 1783138493.082024 trunc from 0x002a26 to 0x0128c4 (0xfe9f bytes) 000996 1783138493.091038 punch from 0x022728 to 0x02b264 (0x8b3d bytes) 000997 1783138493.102598 trunc from 0x037f89 to 0x00465d (0x3392b bytes) 000998 1783138493.133925 punch from 0x000716 to 0x003305 (0x2bf0 bytes) 000999 1783138493.142595 read 0x002150 thru 0x00465d (0x250e bytes) 001000 1783138493.163858 trunc from 0x001947 to 0x00465d (0x2d17 bytes) All operations completed A-OK!