== sanity-flr test 70a: flr mode fsx test ================ 14:06:55 (1787854015) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 4018 fallocating to largest ever: 0x40000 000001 1787854018.725001 fallocate 0x03da81 thru 0x03ffff (0x257f bytes) 000002 1787854018.737777 fallocate 0x0188e4 thru 0x021a51 (0x916e bytes) 000004 1787854018.745646 mapwrite 0x026718 thru 0x026ed6 (0x7bf bytes) 000005 1787854018.781824 trunc from 0x040000 to 0x021d9b (0x1e264 bytes) 000006 1787854018.802978 trunc from 0x00b6bd to 0x00da6d (0x23b1 bytes) 000007 1787854018.808264 fallocate 0x036f0a thru 0x03ffff (0x90f6 bytes) 000008 1787854018.815704 read 0x0369ca thru 0x03e7aa (0x7de1 bytes) 000009 1787854018.825466 punch from 0x02d125 to 0x03ba59 (0xe935 bytes) 000010 1787854018.830249 trunc from 0x040000 to 0x022500 (0x1daff bytes) 000011 1787854018.851888 trunc from 0x02012e to 0x022500 (0x23d3 bytes) 000012 1787854018.856085 fallocate 0x00934b thru 0x013d57 (0xaa0d bytes) 000015 1787854018.862895 punch from 0x02094e to 0x022500 (0x1bb3 bytes) 000016 1787854018.868035 punch from 0x0052c9 to 0x00cd85 (0x7abd bytes) 000017 1787854018.874613 mapread 0x01bda7 thru 0x022500 (0x675a bytes) 000018 1787854018.893844 trunc from 0x02039a to 0x022500 (0x2167 bytes) 000019 1787854018.902436 trunc from 0x01339e to 0x0140b6 (0xd19 bytes) 000020 1787854018.909226 trunc from 0x022501 to 0x02db7c (0xb67c bytes) 000021 1787854018.934141 mapwrite 0x002c89 thru 0x00fe39 (0xd1b1 bytes) 000022 1787854018.981300 trunc from 0x0071e0 to 0x00b319 (0x413a bytes) 000023 1787854018.989817 fallocate 0x013116 thru 0x022c0e (0xfaf9 bytes) 000024 1787854019.008528 write 0x03b6e4 thru 0x03bcf7 (0x614 bytes) 000025 1787854019.010375 write 0x00bb81 thru 0x01594c (0x9dcc bytes) 000026 1787854019.019860 trunc from 0x03a3a5 to 0x03bcf7 (0x1953 bytes) 000027 1787854019.055826 trunc from 0x03bcf8 to 0x01e04d (0x1dcaa bytes) 000029 1787854019.093881 write 0x025580 thru 0x033e0b (0xe88c bytes) 000031 1787854019.097925 write 0x003a97 thru 0x0060ea (0x2654 bytes) 000033 1787854019.106423 punch from 0x01e741 to 0x01f659 (0xf19 bytes) 000034 1787854019.116482 trunc from 0x033e0c to 0x03dc75 (0x9e6a bytes) 000035 1787854019.146595 mapread 0x001b74 thru 0x00a33b (0x87c8 bytes) 000037 1787854019.159863 punch from 0x025110 to 0x031cbb (0xcbac bytes) 000038 1787854019.186418 mapread 0x02c0f4 thru 0x02dd9f (0x1cac bytes) 000039 1787854019.200470 trunc from 0x030577 to 0x032fcb (0x2a55 bytes) 000040 1787854019.208986 mapwrite 0x037249 thru 0x03ffff (0x8db7 bytes) 000041 1787854019.313843 read 0x00643c thru 0x00d4c8 (0x708d bytes) 000042 1787854019.314453 write 0x026dd3 thru 0x02713c (0x36a bytes) 000043 1787854019.315365 write 0x01488f thru 0x01b576 (0x6ce8 bytes) 000044 1787854019.320693 fallocate 0x013ff0 thru 0x0154fd (0x150e bytes) 000045 1787854019.332566 write 0x0212f9 thru 0x029d09 (0x8a11 bytes) 000046 1787854019.356273 trunc from 0x038795 to 0x03c477 (0x3ce3 bytes) 000047 1787854019.370599 trunc from 0x0342a6 to 0x03bd24 (0x7a7f bytes) 000048 1787854019.390392 fallocate 0x001143 thru 0x00ef32 (0xddf0 bytes) 000049 1787854019.403415 fallocate 0x03b613 thru 0x03ffff (0x49ed bytes) 000050 1787854019.415352 punch from 0x03fa0c to 0x03ffff (0x5f4 bytes) 000051 1787854019.428127 punch from 0x03086f to 0x032060 (0x17f2 bytes) 000052 1787854019.434614 trunc from 0x040000 to 0x033e6c (0xc193 bytes) 000053 1787854019.500857 fallocate 0x00fd4d thru 0x00fda6 (0x5a bytes) 000054 1787854019.517462 trunc from 0x033e6d to 0x008f46 (0x2af26 bytes) 000055 1787854019.549416 mapread 0x007dda thru 0x008f46 (0x116d bytes) 000056 1787854019.550296 write 0x00cdc2 thru 0x00f326 (0x2565 bytes) 000058 1787854019.557885 mapwrite 0x018a60 thru 0x0243c4 (0xb965 bytes) 000059 1787854019.759018 trunc from 0x022c03 to 0x0243c4 (0x17c2 bytes) 000060 1787854019.764786 fallocate 0x0097bd thru 0x0196d7 (0xff1b bytes) 000062 1787854019.772462 mapwrite 0x02fa2f thru 0x03bc51 (0xc223 bytes) 000063 1787854019.961497 trunc from 0x0328e7 to 0x03bc51 (0x936b bytes) 000065 1787854019.971515 mapread 0x034c5a thru 0x039403 (0x47aa bytes) 000066 1787854020.029645 mapwrite 0x02884a thru 0x032254 (0x9a0b bytes) 000067 1787854020.148680 trunc from 0x03bc52 to 0x01345c (0x287f5 bytes) 000069 1787854020.175335 trunc from 0x01345d to 0x02e2d3 (0x1ae77 bytes) 000070 1787854020.198179 fallocate 0x009a3c thru 0x00f539 (0x5afe bytes) 000071 1787854020.206968 trunc from 0x011d73 to 0x01dd25 (0xbfb3 bytes) 000072 1787854020.215980 fallocate 0x015b17 thru 0x02228b (0xc775 bytes) 000073 1787854020.222356 mapread 0x0193b8 thru 0x01bc10 (0x2859 bytes) 000074 1787854020.241003 write 0x027c06 thru 0x029c78 (0x2073 bytes) 000075 1787854020.266987 fallocate 0x03d0fe thru 0x03ffff (0x2f02 bytes) 000076 1787854020.282119 MIRROR_EXTEND to 2 mirrors 000077 1787854021.160915 mapwrite 0x0020c4 thru 0x00c09c (0x9fd9 bytes) 000078 1787854021.256923 mapwrite 0x0223e1 thru 0x02caae (0xa6ce bytes) 000079 1787854021.302527 trunc from 0x01cf06 to 0x02ca4a (0xfb45 bytes) 000080 1787854021.315461 trunc from 0x02e2d4 to 0x03da1e (0xf74b bytes) 000081 1787854021.412153 trunc from 0x03da1f to 0x029f58 (0x13ac6 bytes) 000082 1787854021.445661 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29f59): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f59): Mirror 2: 0x1f5151c9 (stale) CRC-32 checksum value for chunk [0, 0x29f59): Mirror 1: 0xac7e6669 Mirror 3: 0xac7e6669 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f59: skipped 000083 1787854022.292709 trunc from 0x029f59 to 0x022cb8 (0x72a0 bytes) 000084 1787854022.365580 MIRROR_RESYNC 3 mirrors 000085 1787854023.055666 write 0x01a604 thru 0x025cfd (0xb6fa bytes) 000086 1787854023.094770 punch from 0x0109c5 to 0x013347 (0x2983 bytes) 000088 1787854023.100007 trunc from 0x025cfe to 0x001ce6 (0x24017 bytes) 000089 1787854023.130779 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ce7): Mirror 2: 0x9ccf5d84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce7): Mirror 2: 0x9ccf5d84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce7: skipped 000090 1787854023.388250 mapwrite 0x00c2b9 thru 0x00fc9c (0x39e4 bytes) 000091 1787854023.443917 trunc from 0x00d832 to 0x00fc9c (0x246b bytes) 000092 1787854023.449836 fallocate 0x018157 thru 0x01f1ff (0x70a9 bytes) 000093 1787854023.455048 mapwrite 0x03ba13 thru 0x03ffff (0x45ed bytes) 000094 1787854023.500672 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3eff6cd0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa2328d9d Mirror 3: 0xa2328d9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000095 1787854024.238180 punch from 0x01315b to 0x01d84a (0xa6f0 bytes) 000096 1787854024.286249 trunc from 0x040000 to 0x029c6d (0x16392 bytes) 000097 1787854024.355534 mapwrite 0x0110bd thru 0x014a17 (0x395b bytes) 000098 1787854024.422191 write 0x012baf thru 0x01f297 (0xc6e9 bytes) 000099 1787854024.433989 read 0x00798d thru 0x00f3cf (0x7a43 bytes) 000100 1787854024.450182 trunc from 0x029c6e to 0x0273ca (0x28a3 bytes) 000101 1787854024.482663 read 0x0119ed thru 0x01ec56 (0xd26a bytes) 000102 1787854024.483352 read 0x01ef3c thru 0x024e7a (0x5f3f bytes) 000103 1787854024.521268 mapread 0x012430 thru 0x01fb61 (0xd732 bytes) 000104 1787854024.541585 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x273cb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x273cb): Mirror 2: 0x532186e3 (stale) Mirror 3: 0x96d533ba (stale) CRC-32 checksum value for chunk [0, 0x273cb): Mirror 1: 0xe3db0cd8 Mirror 4: 0xe3db0cd8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x273cb: skipped 000105 1787854025.959070 trunc from 0x0009f4 to 0x006006 (0x5613 bytes) 000106 1787854026.071227 mapwrite 0x022e49 thru 0x03006f (0xd227 bytes) 000107 1787854026.249735 fallocate 0x01c387 thru 0x02b9c7 (0xf641 bytes) 000108 1787854026.260273 read 0x02e60b thru 0x03006f (0x1a65 bytes) 000109 1787854026.261186 mapread 0x024c0b thru 0x03006f (0xb465 bytes) 000110 1787854026.264754 punch from 0x012aa9 to 0x01f23a (0xc792 bytes) 000111 1787854026.274132 mapread 0x02d7bc thru 0x03006f (0x28b4 bytes) 000112 1787854026.280875 MIRROR_RESYNC 4 mirrors 000113 1787854027.634814 fallocate 0x027c62 thru 0x02d975 (0x5d14 bytes) 000114 1787854027.676766 write 0x02e68a thru 0x03631c (0x7c93 bytes) 000115 1787854027.682365 punch from 0x020d37 to 0x022d7d (0x2047 bytes) 000117 1787854027.687314 read 0x0074bc thru 0x0098ca (0x240f bytes) 000119 1787854027.698486 read 0x029770 thru 0x031468 (0x7cf9 bytes) 000120 1787854027.710310 read 0x018955 thru 0x01a495 (0x1b41 bytes) 000121 1787854027.711270 punch from 0x0071d4 to 0x016963 (0xf790 bytes) 000122 1787854027.718972 fallocate 0x033a4b thru 0x03d515 (0x9acb bytes) 000123 1787854027.739511 fallocate 0x03bb2c thru 0x03ffff (0x44d4 bytes) 000124 1787854027.745301 mapwrite 0x00bc18 thru 0x011e26 (0x620f bytes) 000125 1787854027.800088 punch from 0x03959d to 0x03ffff (0x6a63 bytes) 000126 1787854027.808558 fallocate 0x005087 thru 0x005abe (0xa38 bytes) 000127 1787854027.825085 punch from 0x003a6c to 0x0094b8 (0x5a4d bytes) 000128 1787854027.831312 trunc from 0x014ac3 to 0x01e267 (0x97a5 bytes) 000129 1787854027.836150 mapwrite 0x0224e4 thru 0x025783 (0x32a0 bytes) 000130 1787854027.857770 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xea883d6f (stale) Mirror 4: 0xea883d6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xea883d6f (stale) Mirror 4: 0xea883d6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000131 1787854028.464140 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xea883d6f (stale) Mirror 4: 0xea883d6f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x87d7f402 Mirror 5: 0x87d7f402 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000132 1787854029.305672 mapwrite 0x00ec6b thru 0x01c79e (0xdb34 bytes) 000133 1787854029.425556 mapwrite 0x038e00 thru 0x03ffff (0x7200 bytes) 000134 1787854029.451353 mapwrite 0x004e27 thru 0x007af7 (0x2cd1 bytes) 000135 1787854029.478508 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xea883d6f (stale) Mirror 4: 0xea883d6f (stale) Mirror 5: 0x87d7f402 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7c498fdf Mirror 6: 0x7c498fdf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000137 1787854030.727571 trunc from 0x040000 to 0x0074f2 (0x38b0d bytes) 000138 1787854030.788108 mapwrite 0x00d8dc thru 0x01b3d8 (0xdafd bytes) 000139 1787854030.859130 MIRROR_RESYNC 5 mirrors 000140 1787854031.936026 trunc from 0x01b3d9 to 0x02c537 (0x1115f bytes) 000141 1787854031.985663 trunc from 0x01cdb2 to 0x01dacd (0xd1c bytes) 000142 1787854031.991993 punch from 0x02b91d to 0x02c537 (0xc1b bytes) 000143 1787854031.996255 read 0x0179ed thru 0x01b4bb (0x3acf bytes) 000144 1787854032.007223 punch from 0x0283fa to 0x02c537 (0x413e bytes) 000145 1787854032.011826 mapread 0x0129b2 thru 0x01864e (0x5c9d bytes) 000146 1787854032.030755 mapwrite 0x024cab thru 0x0296bb (0x4a11 bytes) 000147 1787854032.059182 mapwrite 0x03f74a thru 0x03ffff (0x8b6 bytes) 000148 1787854032.099259 mapread 0x037577 thru 0x03ffff (0x8a89 bytes) 000150 1787854032.109938 fallocate 0x03396e thru 0x03f7ba (0xbe4d bytes) 000151 1787854032.114732 punch from 0x01ae90 to 0x01f101 (0x4272 bytes) 000152 1787854032.119979 read 0x03e981 thru 0x03fcb9 (0x1339 bytes) 000153 1787854032.120668 fallocate 0x02fd8e thru 0x03b3ce (0xb641 bytes) 000154 1787854032.125704 read 0x000795 thru 0x003d07 (0x3573 bytes) 000155 1787854032.134853 write 0x021993 thru 0x022966 (0xfd4 bytes) 000156 1787854032.135847 write 0x001280 thru 0x00869a (0x741b bytes) 000157 1787854032.141067 MIRROR_RESYNC 5 mirrors 000158 1787854033.687838 trunc from 0x00e809 to 0x01c76e (0xdf66 bytes) 000159 1787854033.720435 read 0x014a60 thru 0x01942a (0x49cb bytes) 000160 1787854033.729567 mapread 0x03ed9f thru 0x03fc5d (0xebf bytes) 000161 1787854033.739161 trunc from 0x03feb6 to 0x03ffff (0x14a bytes) 000162 1787854033.743727 mapread 0x00af17 thru 0x0172bc (0xc3a6 bytes) 000163 1787854033.762036 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x567e4d6b (stale) Mirror 4: 0x567e4d6b (stale) Mirror 5: 0x567e4d6b (stale) Mirror 6: 0x567e4d6b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x20c8cf28 Mirror 7: 0x20c8cf28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000164 1787854034.575974 fallocate 0x0061e8 thru 0x011500 (0xb319 bytes) 000165 1787854034.618041 mapwrite 0x02712f thru 0x032db5 (0xbc87 bytes) 000166 1787854034.661177 mapread 0x01d617 thru 0x02a5a1 (0xcf8b bytes) 000168 1787854034.671121 trunc from 0x00f54f to 0x0107af (0x1261 bytes) 000169 1787854034.675102 mapread 0x033613 thru 0x03e89f (0xb28d bytes) 000170 1787854034.682984 punch from 0x03388b to 0x03c21e (0x8994 bytes) 000171 1787854034.689112 trunc from 0x040000 to 0x03b208 (0x4df7 bytes) 000172 1787854034.711842 read 0x01fd9b thru 0x0223b3 (0x2619 bytes) 000173 1787854034.712578 mapwrite 0x009f12 thru 0x010992 (0x6a81 bytes) 000175 1787854034.737916 MIRROR_RESYNC 6 mirrors 000176 1787854036.158390 write 0x006b33 thru 0x00f2c9 (0x8797 bytes) 000177 1787854036.222492 trunc from 0x03b209 to 0x02bf72 (0xf296 bytes) 000178 1787854036.246505 fallocate 0x02b1d4 thru 0x036a02 (0xb82f bytes) 000179 1787854036.251428 trunc from 0x02bf73 to 0x033aa9 (0x7b37 bytes) 000180 1787854036.265158 punch from 0x02c17a to 0x0323f8 (0x627f bytes) 000182 1787854036.270044 trunc from 0x033aaa to 0x016d38 (0x1cd71 bytes) 000184 1787854036.282935 trunc from 0x016d39 to 0x02ebb7 (0x17e7f bytes) 000185 1787854036.305398 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ebb8): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebb8): Mirror 2: 0xb7834b99 (stale) Mirror 4: 0xb7834b99 (stale) Mirror 5: 0xb7834b99 (stale) Mirror 6: 0xb7834b99 (stale) Mirror 7: 0xb7834b99 (stale) CRC-32 checksum value for chunk [0, 0x2ebb8): Mirror 1: 0xa63ba6d8 Mirror 8: 0xa63ba6d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebb8: skipped 000186 1787854037.138305 read 0x024a97 thru 0x02ebb7 (0xa121 bytes) 000187 1787854037.147808 fallocate 0x0239b9 thru 0x024373 (0x9bb bytes) 000188 1787854037.188917 punch from 0x005df7 to 0x0119d8 (0xbbe2 bytes) 000189 1787854037.194479 trunc from 0x028a2b to 0x02ebb7 (0x618d bytes) 000190 1787854037.197926 mapread 0x00631f thru 0x00f2c8 (0x8faa bytes) 000191 1787854037.227496 read 0x02589a thru 0x028dab (0x3512 bytes) 000192 1787854037.252915 MIRROR_RESYNC 7 mirrors 000194 1787854038.408112 trunc from 0x017040 to 0x02607f (0xf040 bytes) 000196 1787854038.455034 mapwrite 0x0086b0 thru 0x00dd11 (0x5662 bytes) 000197 1787854038.487650 punch from 0x01d632 to 0x01ff73 (0x2942 bytes) 000198 1787854038.492617 punch from 0x00132e to 0x00721f (0x5ef2 bytes) 000199 1787854038.497518 trunc from 0x024de4 to 0x02ebb7 (0x9dd4 bytes) 000200 1787854038.502762 trunc from 0x009763 to 0x00bde4 (0x2682 bytes) 000201 1787854038.508128 mapread 0x0105be thru 0x01d789 (0xd1cc bytes) 000202 1787854038.530533 MIRROR_RESYNC 7 mirrors 000203 1787854040.105825 punch from 0x029ce7 to 0x02bc8d (0x1fa7 bytes) 000204 1787854040.151676 punch from 0x00e17d to 0x0164ea (0x836e bytes) 000205 1787854040.157590 punch from 0x01d9ea to 0x020def (0x3406 bytes) 000207 1787854040.163387 mapread 0x025f8b thru 0x02e9d1 (0x8a47 bytes) 000208 1787854040.183755 punch from 0x02a9f1 to 0x02ebb7 (0x41c7 bytes) 000209 1787854040.188609 fallocate 0x00e905 thru 0x015815 (0x6f11 bytes) 000210 1787854040.193079 trunc from 0x02ebb8 to 0x03f3e1 (0x1082a bytes) 000211 1787854040.213417 trunc from 0x03f3e2 to 0x030a5a (0xe987 bytes) 000212 1787854040.233684 trunc from 0x030a5b to 0x001d72 (0x2ece8 bytes) 000213 1787854040.252456 read 0x0014f6 thru 0x001d72 (0x87d bytes) 000214 1787854040.258797 punch from 0x0010cb to 0x001d72 (0xca8 bytes) 000216 1787854040.264232 fallocate 0x02da57 thru 0x0313d1 (0x397b bytes) 000217 1787854040.270433 punch from 0x000e3b to 0x001d72 (0xf38 bytes) 000218 1787854040.274169 read 0x00179c thru 0x001d72 (0x5d7 bytes) 000219 1787854040.277969 mapread 0x000972 thru 0x001d72 (0x1401 bytes) 000220 1787854040.282401 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1d73): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d73): Mirror 2: 0x8ac6f673 (stale) Mirror 4: 0x8ac6f673 (stale) Mirror 5: 0x8ac6f673 (stale) Mirror 6: 0x8ac6f673 (stale) Mirror 7: 0x8ac6f673 (stale) Mirror 8: 0x8ac6f673 (stale) CRC-32 checksum value for chunk [0, 0x1d73): Mirror 1: 0x5506604a Mirror 9: 0x5506604a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d73: skipped 000221 1787854040.985719 trunc from 0x00124a to 0x001d72 (0xb29 bytes) 000223 1787854041.032531 write 0x0119dc thru 0x01a939 (0x8f5e bytes) 000224 1787854041.039861 fallocate 0x020ef1 thru 0x028d18 (0x7e28 bytes) 000226 1787854041.045370 mapread 0x00878c thru 0x011f3d (0x97b2 bytes) 000227 1787854041.065876 trunc from 0x018fb9 to 0x01fa21 (0x6a69 bytes) 000228 1787854041.078402 mapwrite 0x020b15 thru 0x025012 (0x44fe bytes) 000230 1787854041.100694 punch from 0x021164 to 0x028d18 (0x7bb5 bytes) 000231 1787854041.115537 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x28d19): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28d19): Mirror 2: 0x91e803d3 (stale) Mirror 4: 0x91e803d3 (stale) Mirror 5: 0x91e803d3 (stale) Mirror 6: 0x91e803d3 (stale) Mirror 7: 0x91e803d3 (stale) Mirror 8: 0x91e803d3 (stale) Mirror 9: 0x4e177054 (stale) CRC-32 checksum value for chunk [0, 0x28d19): Mirror 1: 0x62e6e85e Mirror 10: 0x62e6e85e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28d19: skipped 000232 1787854042.060864 trunc from 0x028d19 to 0x02efb8 (0x62a0 bytes) 000233 1787854042.141593 mapwrite 0x001039 thru 0x00b800 (0xa7c8 bytes) 000235 1787854042.203905 read 0x026e70 thru 0x028b9c (0x1d2d bytes) 000236 1787854042.209122 fallocate 0x023072 thru 0x0283fb (0x538a bytes) 000237 1787854042.226754 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2efb9): Mirror 4: 0x1c548183 (stale) Mirror 5: 0x1c548183 (stale) Mirror 6: 0x1c548183 (stale) Mirror 7: 0x1c548183 (stale) Mirror 8: 0x1c548183 (stale) Mirror 9: 0x71fa67bc (stale) Mirror 10: 0x36ba6181 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efb9): Mirror 4: 0x1c548183 (stale) Mirror 5: 0x1c548183 (stale) Mirror 6: 0x1c548183 (stale) Mirror 7: 0x1c548183 (stale) Mirror 8: 0x1c548183 (stale) Mirror 9: 0x71fa67bc (stale) Mirror 10: 0x36ba6181 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efb9: skipped 000238 1787854042.805080 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2efb9): Mirror 4: 0x1c548183 (stale) Mirror 5: 0x1c548183 (stale) Mirror 6: 0x1c548183 (stale) Mirror 7: 0x1c548183 (stale) Mirror 9: 0x71fa67bc (stale) Mirror 10: 0x36ba6181 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efb9): Mirror 4: 0x1c548183 (stale) Mirror 5: 0x1c548183 (stale) Mirror 6: 0x1c548183 (stale) Mirror 7: 0x1c548183 (stale) Mirror 9: 0x71fa67bc (stale) Mirror 10: 0x36ba6181 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efb9: skipped 000239 1787854043.462896 read 0x02a745 thru 0x02efb8 (0x4874 bytes) 000240 1787854043.480093 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2efb9): Mirror 4: 0x1c548183 (stale) Mirror 5: 0x1c548183 (stale) Mirror 6: 0x1c548183 (stale) Mirror 7: 0x1c548183 (stale) Mirror 9: 0x71fa67bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efb9): Mirror 4: 0x1c548183 (stale) Mirror 5: 0x1c548183 (stale) Mirror 6: 0x1c548183 (stale) Mirror 7: 0x1c548183 (stale) Mirror 9: 0x71fa67bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efb9: skipped 000241 1787854043.954135 mapread 0x02a60c thru 0x02e1c1 (0x3bb6 bytes) 000242 1787854043.973943 trunc from 0x02efb9 to 0x008e66 (0x26152 bytes) 000243 1787854043.992702 mapread 0x000c31 thru 0x008e66 (0x8236 bytes) 000244 1787854043.998225 read 0x007f0f thru 0x008e66 (0xf58 bytes) 000245 1787854043.998780 trunc from 0x00002d to 0x0038ca (0x389e bytes) 000246 1787854044.003479 trunc from 0x0050f0 to 0x008e66 (0x3d77 bytes) 000247 1787854044.008730 trunc from 0x006cb1 to 0x007785 (0xad5 bytes) 000248 1787854044.012968 mapwrite 0x017eca thru 0x01f279 (0x73b0 bytes) 000249 1787854044.063607 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1f27a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f27a): Mirror 4: 0x549d575a (stale) Mirror 5: 0x549d575a (stale) Mirror 6: 0x549d575a (stale) Mirror 7: 0x549d575a (stale) Mirror 9: 0xe2fddcd7 (stale) CRC-32 checksum value for chunk [0, 0x1f27a): Mirror 1: 0x2307fd73 Mirror 10: 0x2307fd73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f27a: skipped 000250 1787854044.882779 fallocate 0x019608 thru 0x02296e (0x9367 bytes) 000251 1787854044.930543 punch from 0x005ab1 to 0x00e1fa (0x874a bytes) 000252 1787854044.934701 punch from 0x0124b0 to 0x01e271 (0xbdc2 bytes) 000253 1787854044.943363 read 0x01fc1a thru 0x02296e (0x2d55 bytes) 000255 1787854044.950547 fallocate 0x008427 thru 0x0100b6 (0x7c90 bytes) 000256 1787854044.954947 trunc from 0x02296f to 0x000a39 (0x21f35 bytes) 000257 1787854045.004541 fallocate 0x0186aa thru 0x027355 (0xecac bytes) 000258 1787854045.011461 fallocate 0x01d504 thru 0x025d63 (0x8860 bytes) 000259 1787854045.017776 mapread 0x025f13 thru 0x027355 (0x1443 bytes) 000260 1787854045.038551 write 0x03f552 thru 0x03ffff (0xaae bytes) 000261 1787854045.040450 trunc from 0x03ea2a to 0x03ffff (0x15d6 bytes) 000263 1787854045.049622 mapread 0x03e2f2 thru 0x03ffff (0x1d0e bytes) 000264 1787854045.059859 read 0x0290e4 thru 0x02a130 (0x104d bytes) 000265 1787854045.073548 read 0x01f83f thru 0x02a5ab (0xad6d bytes) 000267 1787854045.075296 fallocate 0x019afc thru 0x02831f (0xe824 bytes) 000268 1787854045.079932 write 0x001d46 thru 0x007375 (0x5630 bytes) 000269 1787854045.081728 read 0x00e0be thru 0x010c4c (0x2b8f bytes) 000270 1787854045.082556 punch from 0x02c6d2 to 0x02cd9f (0x6ce bytes) 000271 1787854045.088409 fallocate 0x026f04 thru 0x02b502 (0x45ff bytes) 000272 1787854045.093973 write 0x021490 thru 0x025a24 (0x4595 bytes) 000274 1787854045.095937 mapread 0x009358 thru 0x00958b (0x234 bytes) 000275 1787854045.097543 trunc from 0x040000 to 0x03a173 (0x5e8c bytes) 000276 1787854045.117510 write 0x03b061 thru 0x03ffff (0x4f9f bytes) 000277 1787854045.121798 punch from 0x00fab6 to 0x01c641 (0xcb8c bytes) 000278 1787854045.128191 trunc from 0x040000 to 0x01f3b0 (0x20c4f bytes) 000279 1787854045.155685 trunc from 0x009dac to 0x00bc19 (0x1e6e bytes) 000280 1787854045.169176 mapread 0x015132 thru 0x017496 (0x2365 bytes) 000281 1787854045.186709 write 0x0150a5 thru 0x015314 (0x270 bytes) 000282 1787854045.188867 fallocate 0x012ed3 thru 0x020f4b (0xe079 bytes) 000283 1787854045.201613 MIRROR_RESYNC 7 mirrors 000284 1787854046.961064 trunc from 0x00c033 to 0x00d9f5 (0x19c3 bytes) 000285 1787854047.010506 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1f3b1): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f3b1): Mirror 4: 0x47f686bd (stale) Mirror 5: 0x47f686bd (stale) Mirror 6: 0x47f686bd (stale) Mirror 7: 0x47f686bd (stale) Mirror 9: 0x47f686bd (stale) Mirror 10: 0x47f686bd (stale) CRC-32 checksum value for chunk [0, 0x1f3b1): Mirror 1: 0x47f686bd Mirror 11: 0x47f686bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f3b1: skipped 000286 1787854047.940953 punch from 0x014b7f to 0x01f299 (0xa71b bytes) 000287 1787854048.001686 mapwrite 0x03b8ed thru 0x03ffff (0x4713 bytes) 000288 1787854048.070305 write 0x038e5f thru 0x03b756 (0x28f8 bytes) 000289 1787854048.071736 write 0x03445c thru 0x03b54e (0x70f3 bytes) 000290 1787854048.078821 mapread 0x016ac2 thru 0x01d9b4 (0x6ef3 bytes) 000291 1787854048.088050 read 0x034a39 thru 0x03a741 (0x5d09 bytes) 000292 1787854048.090006 mapwrite 0x00cdcc thru 0x018d6f (0xbfa4 bytes) 000293 1787854048.126387 mapread 0x03c65f thru 0x03d578 (0xf1a bytes) 000294 1787854048.129697 trunc from 0x040000 to 0x036bc2 (0x943d bytes) 000295 1787854048.164452 fallocate 0x012053 thru 0x01fb51 (0xdaff bytes) 000297 1787854048.172526 fallocate 0x00891e thru 0x012f3c (0xa61f bytes) 000298 1787854048.177536 trunc from 0x029b1e to 0x035b2d (0xc010 bytes) 000299 1787854048.182970 trunc from 0x036bc3 to 0x003e64 (0x32d5e bytes) 000300 1787854048.207065 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e65): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e65): Mirror 4: 0x3035f702 (stale) Mirror 5: 0x3035f702 (stale) Mirror 6: 0x3035f702 (stale) Mirror 7: 0x3035f702 (stale) Mirror 9: 0x3035f702 (stale) Mirror 10: 0x3035f702 (stale) Mirror 11: 0x3035f702 (stale) CRC-32 checksum value for chunk [0, 0x3e65): Mirror 1: 0x3035f702 Mirror 12: 0x3035f702 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e65: skipped 000301 1787854048.982479 mapread 0x00136e thru 0x0029e1 (0x1674 bytes) 000302 1787854048.991547 trunc from 0x003e65 to 0x029feb (0x26187 bytes) 000303 1787854049.042947 mapread 0x024f91 thru 0x029feb (0x505b bytes) 000304 1787854049.052168 trunc from 0x029fec to 0x026cd3 (0x3318 bytes) 000305 1787854049.066801 read 0x01e01d thru 0x024dbd (0x6da1 bytes) 000306 1787854049.072138 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x26cd4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26cd4): Mirror 4: 0x7f1bc2eb (stale) Mirror 5: 0x7f1bc2eb (stale) Mirror 6: 0x7f1bc2eb (stale) Mirror 7: 0x7f1bc2eb (stale) Mirror 9: 0x7f1bc2eb (stale) Mirror 10: 0x7f1bc2eb (stale) Mirror 11: 0x7f1bc2eb (stale) Mirror 12: 0xc575e8e1 (stale) CRC-32 checksum value for chunk [0, 0x26cd4): Mirror 1: 0xc575e8e1 Mirror 13: 0xc575e8e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26cd4: skipped 000307 1787854049.818777 trunc from 0x026cd4 to 0x018185 (0xeb4e bytes) 000308 1787854049.904297 trunc from 0x018186 to 0x0158ec (0x2899 bytes) 000309 1787854049.943046 read 0x000afe thru 0x00a72f (0x9c32 bytes) 000310 1787854049.955408 MIRROR_RESYNC 10 mirrors 000311 1787854052.248903 mapread 0x001aa7 thru 0x00f5a9 (0xdb03 bytes) 000312 1787854052.300883 mapwrite 0x00d2f0 thru 0x01a906 (0xd617 bytes) 000314 1787854052.494875 mapwrite 0x011d83 thru 0x01ac78 (0x8ef6 bytes) 000315 1787854052.569176 mapwrite 0x02f189 thru 0x03e399 (0xf211 bytes) 000316 1787854052.675011 read 0x0188c2 thru 0x02188a (0x8fc9 bytes) 000317 1787854052.691151 trunc from 0x0115df to 0x01f36b (0xdd8d bytes) 000318 1787854052.699079 mapread 0x00840f thru 0x016e52 (0xea44 bytes) 000319 1787854052.715723 punch from 0x01c8d3 to 0x01f009 (0x2737 bytes) 000320 1787854052.724827 mapwrite 0x023755 thru 0x02b383 (0x7c2f bytes) 000321 1787854052.763720 fallocate 0x027a24 thru 0x0359af (0xdf8c bytes) 000322 1787854052.769825 mapwrite 0x02e50f thru 0x03044f (0x1f41 bytes) 000324 1787854052.795410 punch from 0x020c47 to 0x030c01 (0xffbb bytes) 000325 1787854052.804736 punch from 0x003024 to 0x00ded9 (0xaeb6 bytes) 000326 1787854052.813879 write 0x025ad0 thru 0x030e6b (0xb39c bytes) 000327 1787854052.831835 trunc from 0x00ab65 to 0x016ae7 (0xbf83 bytes) 000328 1787854052.838933 punch from 0x027c8f to 0x02fd37 (0x80a9 bytes) 000329 1787854052.857805 mapread 0x02e2e9 thru 0x0370e8 (0x8e00 bytes) 000330 1787854052.874847 fallocate 0x00eeea thru 0x01ecbc (0xfdd3 bytes) 000331 1787854052.890564 read 0x02aa38 thru 0x035acc (0xb095 bytes) 000332 1787854052.892923 read 0x03b5e6 thru 0x03e399 (0x2db4 bytes) 000334 1787854052.895728 write 0x03662e thru 0x03c920 (0x62f3 bytes) 000335 1787854052.897639 fallocate 0x00caf5 thru 0x012285 (0x5791 bytes) 000336 1787854052.904472 mapwrite 0x019108 thru 0x027d92 (0xec8b bytes) 000337 1787854052.947352 mapwrite 0x007b0c thru 0x015457 (0xd94c bytes) 000338 1787854053.004929 mapread 0x00da80 thru 0x01d30c (0xf88d bytes) 000339 1787854053.006741 mapwrite 0x00056d thru 0x00b409 (0xae9d bytes) 000340 1787854053.044650 mapread 0x026659 thru 0x02bd96 (0x573e bytes) 000341 1787854053.046718 mapwrite 0x03f063 thru 0x03ffff (0xf9d bytes) 000342 1787854053.086975 trunc from 0x027a10 to 0x03170a (0x9cfb bytes) 000343 1787854053.096133 trunc from 0x040000 to 0x00f579 (0x30a86 bytes) 000345 1787854053.118497 fallocate 0x0323c6 thru 0x0345f6 (0x2231 bytes) 000346 1787854053.126492 punch from 0x0000cb to 0x000d2c (0xc62 bytes) 000347 1787854053.139739 fallocate 0x00811d thru 0x00d751 (0x5635 bytes) 000348 1787854053.155346 MIRROR_RESYNC 10 mirrors 000349 1787854054.506507 mapread 0x008970 thru 0x00f579 (0x6c0a bytes) 000350 1787854054.530658 mapread 0x009144 thru 0x00b795 (0x2652 bytes) 000351 1787854054.531650 write 0x005de1 thru 0x006d57 (0xf77 bytes) 000352 1787854054.618921 write 0x028a84 thru 0x037a89 (0xf006 bytes) 000353 1787854054.623077 trunc from 0x0331d6 to 0x037a89 (0x48b4 bytes) 000354 1787854054.642892 read 0x004ef2 thru 0x00dbe6 (0x8cf5 bytes) 000355 1787854054.657479 mapwrite 0x018204 thru 0x019f9c (0x1d99 bytes) 000356 1787854054.684558 mapwrite 0x011b9c thru 0x011f71 (0x3d6 bytes) 000357 1787854054.700505 mapwrite 0x01c574 thru 0x026422 (0x9eaf bytes) 000359 1787854054.741420 MIRROR_RESYNC 10 mirrors 000360 1787854059.011316 punch from 0x028f8a to 0x032c05 (0x9c7c bytes) 000361 1787854059.074742 read 0x006255 thru 0x00ae1c (0x4bc8 bytes) 000362 1787854059.087530 write 0x009646 thru 0x00e0af (0x4a6a bytes) 000363 1787854059.095312 mapwrite 0x00f8ff thru 0x0172ee (0x79f0 bytes) 000364 1787854059.136715 write 0x0271e6 thru 0x02891c (0x1737 bytes) 000365 1787854059.148388 write 0x03b674 thru 0x03ffff (0x498c bytes) 000366 1787854059.154411 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xad7bcc95 (stale) Mirror 5: 0xad7bcc95 (stale) Mirror 6: 0xad7bcc95 (stale) Mirror 9: 0xad7bcc95 (stale) Mirror 10: 0xad7bcc95 (stale) Mirror 11: 0xad7bcc95 (stale) Mirror 12: 0xad7bcc95 (stale) Mirror 13: 0xad7bcc95 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xad7bcc95 (stale) Mirror 5: 0xad7bcc95 (stale) Mirror 6: 0xad7bcc95 (stale) Mirror 9: 0xad7bcc95 (stale) Mirror 10: 0xad7bcc95 (stale) Mirror 11: 0xad7bcc95 (stale) Mirror 12: 0xad7bcc95 (stale) Mirror 13: 0xad7bcc95 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000367 1787854059.772701 mapread 0x000299 thru 0x00e951 (0xe6b9 bytes) 000368 1787854059.814295 mapread 0x00aeaa thru 0x0100bc (0x5213 bytes) 000369 1787854059.815161 punch from 0x011b10 to 0x013dfd (0x22ee bytes) 000370 1787854059.819861 read 0x0055d2 thru 0x01146e (0xbe9d bytes) 000371 1787854059.833714 write 0x01b392 thru 0x01d3ea (0x2059 bytes) 000373 1787854059.857133 trunc from 0x01cbd5 to 0x01ed30 (0x215c bytes) 000374 1787854059.876922 write 0x0129f5 thru 0x021010 (0xe61c bytes) 000375 1787854059.894613 mapread 0x0014ae thru 0x00b11f (0x9c72 bytes) 000376 1787854059.896077 punch from 0x00f81f to 0x01a2cb (0xaaad bytes) 000378 1787854059.923490 read 0x03b113 thru 0x03ffff (0x4eed bytes) 000379 1787854059.934762 punch from 0x028351 to 0x03057e (0x822e bytes) 000381 1787854059.942478 mapwrite 0x03f24d thru 0x03ffff (0xdb3 bytes) 000382 1787854059.957657 mapread 0x03946e thru 0x03ccd1 (0x3864 bytes) 000383 1787854059.964080 trunc from 0x040000 to 0x03cdec (0x3213 bytes) 000384 1787854059.980641 mapwrite 0x03d57f thru 0x03ffff (0x2a81 bytes) 000385 1787854060.028139 mapread 0x0098a0 thru 0x0146a0 (0xae01 bytes) 000386 1787854060.034259 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xad7bcc95 (stale) Mirror 5: 0xad7bcc95 (stale) Mirror 6: 0xad7bcc95 (stale) Mirror 9: 0xad7bcc95 (stale) Mirror 10: 0xad7bcc95 (stale) Mirror 11: 0xad7bcc95 (stale) Mirror 12: 0xad7bcc95 (stale) Mirror 13: 0xad7bcc95 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x79cdece9 Mirror 14: 0x79cdece9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000387 1787854061.336967 punch from 0x0244db to 0x02a17b (0x5ca1 bytes) 000388 1787854061.395795 trunc from 0x040000 to 0x03bb58 (0x44a7 bytes) 000389 1787854061.460615 punch from 0x039937 to 0x03bb58 (0x2222 bytes) 000390 1787854061.466556 fallocate 0x01fdfe thru 0x02430f (0x4512 bytes) 000392 1787854061.472940 mapwrite 0x00bf57 thru 0x00f9f4 (0x3a9e bytes) 000393 1787854061.523034 mapwrite 0x023cda thru 0x02dd69 (0xa090 bytes) 000394 1787854061.586280 trunc from 0x03bb59 to 0x00b176 (0x309e2 bytes) 000395 1787854061.604542 write 0x03378f thru 0x035a78 (0x22ea bytes) 000396 1787854061.606390 mapwrite 0x01bf8f thru 0x01cd71 (0xde3 bytes) 000397 1787854061.629030 write 0x00f4df thru 0x011b91 (0x26b3 bytes) 000398 1787854061.645086 read 0x0169e1 thru 0x017d43 (0x1363 bytes) 000399 1787854061.646643 fallocate 0x020615 thru 0x022f90 (0x297c bytes) 000400 1787854061.656186 trunc from 0x035a79 to 0x03fb87 (0xa10f bytes) 000402 1787854061.681118 trunc from 0x00d4f9 to 0x015708 (0x8210 bytes) 000403 1787854061.698858 write 0x03f7db thru 0x03ffff (0x825 bytes) 000404 1787854061.706937 punch from 0x0324fe to 0x03d84b (0xb34e bytes) 000405 1787854061.715433 write 0x0122e4 thru 0x019a64 (0x7781 bytes) 000406 1787854061.724110 read 0x0210f4 thru 0x030933 (0xf840 bytes) 000407 1787854061.744584 fallocate 0x01ab18 thru 0x028586 (0xda6f bytes) 000408 1787854061.751850 trunc from 0x040000 to 0x004ab6 (0x3b549 bytes) 000409 1787854061.791018 mapwrite 0x03d0f1 thru 0x03ffff (0x2f0f bytes) 000410 1787854061.929736 trunc from 0x03b6f1 to 0x03ffff (0x490f bytes) 000411 1787854061.939063 fallocate 0x02ea04 thru 0x033e2f (0x542c bytes) 000412 1787854061.950989 mapread 0x008d62 thru 0x00f8ed (0x6b8c bytes) 000413 1787854062.068268 write 0x03db77 thru 0x03ffff (0x2489 bytes) 000414 1787854062.084173 read 0x00a96a thru 0x01233e (0x79d5 bytes) 000415 1787854062.107678 mapwrite 0x000299 thru 0x00df37 (0xdc9f bytes) 000416 1787854062.133796 punch from 0x00dcc7 to 0x0108e4 (0x2c1e bytes) 000417 1787854062.140177 fallocate 0x030ba9 thru 0x03e173 (0xd5cb bytes) 000418 1787854062.145132 write 0x02ff44 thru 0x0352b6 (0x5373 bytes) 000419 1787854062.147426 punch from 0x034012 to 0x037910 (0x38ff bytes) 000421 1787854062.163561 mapread 0x02f11c thru 0x036b60 (0x7a45 bytes) 000422 1787854062.185137 punch from 0x003095 to 0x012ce1 (0xfc4d bytes) 000423 1787854062.194635 read 0x01f135 thru 0x02c803 (0xd6cf bytes) 000424 1787854062.195418 fallocate 0x0160b8 thru 0x01e3d5 (0x831e bytes) 000425 1787854062.204994 mapwrite 0x01ea7f thru 0x021eaf (0x3431 bytes) 000426 1787854062.224556 read 0x01b8ca thru 0x02287c (0x6fb3 bytes) 000427 1787854062.225544 trunc from 0x040000 to 0x01855e (0x27aa1 bytes) 000428 1787854062.248513 mapread 0x003102 thru 0x00f9df (0xc8de bytes) 000429 1787854062.267381 punch from 0x0120b6 to 0x01388b (0x17d6 bytes) 000430 1787854062.273899 trunc from 0x012688 to 0x01855e (0x5ed7 bytes) 000431 1787854062.282666 punch from 0x0117b1 to 0x01433e (0x2b8e bytes) 000432 1787854062.291533 trunc from 0x00b2ae to 0x00b809 (0x55c bytes) 000433 1787854062.297040 mapread 0x014917 thru 0x01855e (0x3c48 bytes) 000434 1787854062.335075 read 0x016a46 thru 0x01855e (0x1b19 bytes) 000435 1787854062.335797 trunc from 0x01855f to 0x00ae4e (0xd710 bytes) 000436 1787854062.360690 mapwrite 0x00b1d4 thru 0x015599 (0xa3c6 bytes) 000438 1787854062.424091 write 0x0030a6 thru 0x007f0a (0x4e65 bytes) 000439 1787854062.432421 MIRROR_RESYNC 10 mirrors 000440 1787854064.284142 punch from 0x006dbc to 0x0145cf (0xd814 bytes) 000441 1787854064.365680 mapwrite 0x034aa4 thru 0x038424 (0x3981 bytes) 000442 1787854064.507819 fallocate 0x0024cc thru 0x002f55 (0xa8a bytes) 000444 1787854064.529056 mapwrite 0x01ecd1 thru 0x01ee9c (0x1cc bytes) 000445 1787854064.606110 punch from 0x016681 to 0x020a0e (0xa38e bytes) 000446 1787854064.615317 mapread 0x0108b4 thru 0x011042 (0x78f bytes) 000447 1787854064.644265 read 0x00ac49 thru 0x01242a (0x77e2 bytes) 000448 1787854064.644971 trunc from 0x01413b to 0x01451e (0x3e4 bytes) 000449 1787854064.656093 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x38425): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38425): Mirror 4: 0xb96ae986 (stale) Mirror 5: 0xb96ae986 (stale) Mirror 6: 0xb96ae986 (stale) Mirror 9: 0xb96ae986 (stale) Mirror 10: 0xb96ae986 (stale) Mirror 11: 0xb96ae986 (stale) Mirror 12: 0xb96ae986 (stale) Mirror 13: 0xb96ae986 (stale) Mirror 14: 0xb96ae986 (stale) CRC-32 checksum value for chunk [0, 0x38425): Mirror 1: 0x3868f486 Mirror 15: 0x3868f486 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38425: skipped 000450 1787854066.223543 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38425): Mirror 4: 0xb96ae986 (stale) Mirror 5: 0xb96ae986 (stale) Mirror 6: 0xb96ae986 (stale) Mirror 9: 0xb96ae986 (stale) Mirror 10: 0xb96ae986 (stale) Mirror 11: 0xb96ae986 (stale) Mirror 12: 0xb96ae986 (stale) Mirror 13: 0xb96ae986 (stale) Mirror 14: 0xb96ae986 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38425): Mirror 4: 0xb96ae986 (stale) Mirror 5: 0xb96ae986 (stale) Mirror 6: 0xb96ae986 (stale) Mirror 9: 0xb96ae986 (stale) Mirror 10: 0xb96ae986 (stale) Mirror 11: 0xb96ae986 (stale) Mirror 12: 0xb96ae986 (stale) Mirror 13: 0xb96ae986 (stale) Mirror 14: 0xb96ae986 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38425: skipped 000451 1787854067.009349 trunc from 0x038425 to 0x01726e (0x211b6 bytes) 000452 1787854067.113614 trunc from 0x01726f to 0x017610 (0x3a2 bytes) 000453 1787854067.153716 trunc from 0x01309d to 0x017610 (0x4574 bytes) 000454 1787854067.163014 punch from 0x015323 to 0x017610 (0x22ee bytes) 000455 1787854067.175726 fallocate 0x01f4fd thru 0x02e71c (0xf220 bytes) 000456 1787854067.190978 fallocate 0x02ca6e thru 0x03383d (0x6dd0 bytes) 000457 1787854067.198951 write 0x015673 thru 0x0254e7 (0xfe75 bytes) 000458 1787854067.217396 punch from 0x0273c1 to 0x029149 (0x1d89 bytes) 000459 1787854067.227419 read 0x0037fd thru 0x009ef4 (0x66f8 bytes) 000461 1787854067.256062 mapread 0x02c2a1 thru 0x03383d (0x759d bytes) 000462 1787854067.305846 fallocate 0x03e566 thru 0x03ffff (0x1a9a bytes) 000463 1787854067.326601 MIRROR_RESYNC 10 mirrors 000465 1787854070.689440 mapwrite 0x0156dc thru 0x0232b7 (0xdbdc bytes) 000466 1787854070.859625 read 0x0175f7 thru 0x0235d2 (0xbfdc bytes) 000467 1787854070.860515 write 0x019a03 thru 0x01e304 (0x4902 bytes) 000468 1787854070.864032 write 0x02bae5 thru 0x036161 (0xa67d bytes) 000469 1787854070.888093 trunc from 0x040000 to 0x002758 (0x3d8a7 bytes) 000470 1787854070.933975 read 0x001936 thru 0x002758 (0xe23 bytes) 000471 1787854070.942718 trunc from 0x00024b to 0x002758 (0x250e bytes) 000472 1787854070.948371 trunc from 0x002759 to 0x0187f9 (0x160a1 bytes) 000473 1787854070.963401 trunc from 0x0127bc to 0x0187f9 (0x603e bytes) 000474 1787854070.968490 fallocate 0x00f93c thru 0x01d71a (0xdddf bytes) 000475 1787854070.978065 trunc from 0x01ae8d to 0x01d71a (0x288e bytes) 000476 1787854070.985965 trunc from 0x01d71b to 0x01d7c0 (0xa6 bytes) 000477 1787854071.026986 fallocate 0x0304d2 thru 0x031b54 (0x1683 bytes) 000478 1787854071.035601 trunc from 0x031b55 to 0x03ae83 (0x932f bytes) 000479 1787854071.067079 write 0x039d5c thru 0x03b0ee (0x1393 bytes) 000480 1787854071.097366 trunc from 0x03b0ef to 0x0205c9 (0x1ab25 bytes) 000481 1787854071.123665 trunc from 0x014576 to 0x01996b (0x53f6 bytes) 000482 1787854071.133708 fallocate 0x005936 thru 0x00a916 (0x4fe1 bytes) 000483 1787854071.139876 trunc from 0x008748 to 0x014e18 (0xc6d1 bytes) 000484 1787854071.150734 trunc from 0x01b3dc to 0x01e791 (0x33b6 bytes) 000485 1787854071.159378 write 0x02cb2e thru 0x02fdcb (0x329e bytes) 000486 1787854071.160690 trunc from 0x02fdcc to 0x0394ac (0x96e1 bytes) 000487 1787854071.201862 MIRROR_RESYNC 10 mirrors 000488 1787854074.829061 mapwrite 0x004e11 thru 0x011d33 (0xcf23 bytes) 000490 1787854075.010489 trunc from 0x026440 to 0x027780 (0x1341 bytes) 000491 1787854075.060297 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x394ad): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394ad): Mirror 4: 0x9c375f09 (stale) Mirror 5: 0x9c375f09 (stale) Mirror 6: 0x9c375f09 (stale) Mirror 9: 0x9c375f09 (stale) Mirror 10: 0x9c375f09 (stale) Mirror 11: 0x9c375f09 (stale) Mirror 12: 0x9c375f09 (stale) Mirror 13: 0x9c375f09 (stale) Mirror 14: 0x9c375f09 (stale) CRC-32 checksum value for chunk [0, 0x394ad): Mirror 1: 0x7e7a0393 Mirror 15: 0x7e7a0393 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394ad: skipped 000492 1787854076.822811 mapread 0x00383d thru 0x005b5d (0x2321 bytes) 000493 1787854076.852432 trunc from 0x0394ad to 0x0372a5 (0x2207 bytes) 000494 1787854076.970493 punch from 0x03580e to 0x0372a5 (0x1a98 bytes) 000495 1787854076.976495 mapwrite 0x02fa0f thru 0x02fb42 (0x134 bytes) 000497 1787854077.002672 read 0x028c34 thru 0x03615c (0xd529 bytes) 000498 1787854077.003645 mapread 0x029b36 thru 0x034d23 (0xb1ee bytes) 000499 1787854077.005819 punch from 0x024f18 to 0x0318b2 (0xc99b bytes) 000500 1787854077.016685 MIRROR_RESYNC 11 mirrors 000501 1787854080.676801 write 0x011010 thru 0x0141d3 (0x31c4 bytes) 000502 1787854080.733382 mapwrite 0x013435 thru 0x019255 (0x5e21 bytes) 000505 1787854080.823335 write 0x01988e thru 0x01aa2c (0x119f bytes) 000506 1787854080.824530 mapwrite 0x017b9c thru 0x01fc5b (0x80c0 bytes) 000507 1787854080.886459 mapwrite 0x0129fc thru 0x01dbf8 (0xb1fd bytes) 000508 1787854080.931241 trunc from 0x0372a6 to 0x00e538 (0x28d6d bytes) 000510 1787854080.978408 write 0x028fb2 thru 0x030e5c (0x7eab bytes) 000511 1787854080.981145 write 0x035c8c thru 0x03c42f (0x67a4 bytes) 000512 1787854080.983042 trunc from 0x01763e to 0x01a42b (0x2dee bytes) 000515 1787854080.990623 mapwrite 0x030b69 thru 0x03cdc7 (0xc25f bytes) 000516 1787854081.102680 read 0x006d44 thru 0x00a85f (0x3b1c bytes) 000517 1787854081.125048 trunc from 0x03cdc8 to 0x024cc0 (0x18107 bytes) 000518 1787854081.159567 read 0x010bc7 thru 0x01e766 (0xdba0 bytes) 000519 1787854081.180135 write 0x031a78 thru 0x03a05e (0x85e7 bytes) 000521 1787854081.182223 mapwrite 0x03ff1c thru 0x03ffff (0xe4 bytes) 000522 1787854081.242120 write 0x0201a2 thru 0x022d63 (0x2bc2 bytes) 000523 1787854081.247229 write 0x01dc85 thru 0x02a93f (0xccbb bytes) 000524 1787854081.258860 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7a4500f8 (stale) Mirror 5: 0x7a4500f8 (stale) Mirror 6: 0x7a4500f8 (stale) Mirror 9: 0x7a4500f8 (stale) Mirror 10: 0x7a4500f8 (stale) Mirror 11: 0x7a4500f8 (stale) Mirror 12: 0x7a4500f8 (stale) Mirror 13: 0x7a4500f8 (stale) Mirror 14: 0x7a4500f8 (stale) Mirror 15: 0x7a4500f8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2bcd9ae2 Mirror 16: 0x2bcd9ae2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000525 1787854083.100740 fallocate 0x02ce79 thru 0x033e2b (0x6fb3 bytes) 000526 1787854083.141519 mapread 0x03b316 thru 0x03ffff (0x4cea bytes) 000527 1787854083.161157 trunc from 0x032fd1 to 0x0399ce (0x69fe bytes) 000528 1787854083.173406 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7a4500f8 (stale) Mirror 5: 0x7a4500f8 (stale) Mirror 6: 0x7a4500f8 (stale) Mirror 9: 0x7a4500f8 (stale) Mirror 10: 0x7a4500f8 (stale) Mirror 11: 0x7a4500f8 (stale) Mirror 12: 0x7a4500f8 (stale) Mirror 13: 0x7a4500f8 (stale) Mirror 14: 0x7a4500f8 (stale) Mirror 15: 0x7a4500f8 (stale) Mirror 16: 0x2bcd9ae2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8b622ba5 Mirror 17: 0x8b622ba5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000530 1787854084.381648 punch from 0x011809 to 0x01a824 (0x901c bytes) 000531 1787854084.432859 write 0x0166c5 thru 0x01ab42 (0x447e bytes) 000532 1787854084.451602 trunc from 0x040000 to 0x0048f0 (0x3b70f bytes) 000533 1787854084.480298 MIRROR_RESYNC 13 mirrors 000534 1787854087.004767 fallocate 0x02877b thru 0x032ef7 (0xa77d bytes) 000535 1787854087.051949 punch from 0x01e30c to 0x02981f (0xb514 bytes) 000536 1787854087.057134 mapread 0x010bf2 thru 0x01beee (0xb2fd bytes) 000537 1787854087.086729 write 0x023ede thru 0x0334c1 (0xf5e4 bytes) 000538 1787854087.089907 trunc from 0x0334c2 to 0x00fc62 (0x2385f bytes) 000539 1787854087.110811 trunc from 0x00421b to 0x00d99a (0x9780 bytes) 000540 1787854087.115569 trunc from 0x001a79 to 0x00430e (0x2896 bytes) 000541 1787854087.130494 MIRROR_RESYNC 13 mirrors 000542 1787854089.560743 punch from 0x0004d0 to 0x003633 (0x3164 bytes) 000543 1787854089.602680 read 0x00fbe2 thru 0x00fc62 (0x81 bytes) 000544 1787854089.607921 read 0x0023f0 thru 0x006be2 (0x47f3 bytes) 000545 1787854089.621152 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfc63): Mirror 4: 0xc07b6a0d (stale) Mirror 5: 0xc07b6a0d (stale) Mirror 6: 0xc07b6a0d (stale) Mirror 9: 0xc07b6a0d (stale) Mirror 10: 0xc07b6a0d (stale) Mirror 11: 0xc07b6a0d (stale) Mirror 12: 0xc07b6a0d (stale) Mirror 13: 0xc07b6a0d (stale) Mirror 14: 0xc07b6a0d (stale) Mirror 15: 0xc07b6a0d (stale) Mirror 17: 0xc07b6a0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfc63): Mirror 4: 0xc07b6a0d (stale) Mirror 5: 0xc07b6a0d (stale) Mirror 6: 0xc07b6a0d (stale) Mirror 9: 0xc07b6a0d (stale) Mirror 10: 0xc07b6a0d (stale) Mirror 11: 0xc07b6a0d (stale) Mirror 12: 0xc07b6a0d (stale) Mirror 13: 0xc07b6a0d (stale) Mirror 14: 0xc07b6a0d (stale) Mirror 15: 0xc07b6a0d (stale) Mirror 17: 0xc07b6a0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfc63: skipped 000546 1787854090.112866 trunc from 0x00fc63 to 0x017c00 (0x7f9e bytes) 000547 1787854090.146839 write 0x02e35b thru 0x034ec9 (0x6b6f bytes) 000548 1787854090.152629 trunc from 0x034eca to 0x005a0b (0x2f4be bytes) 000549 1787854090.178132 mapwrite 0x0257c9 thru 0x02ba54 (0x628c bytes) 000550 1787854090.247870 read 0x012eaa thru 0x01b547 (0x869e bytes) 000551 1787854090.276568 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ba55): Mirror 4: 0x188b4087 (stale) Mirror 5: 0x188b4087 (stale) Mirror 6: 0x188b4087 (stale) Mirror 10: 0x188b4087 (stale) Mirror 11: 0x188b4087 (stale) Mirror 12: 0x188b4087 (stale) Mirror 13: 0x188b4087 (stale) Mirror 14: 0x188b4087 (stale) Mirror 15: 0x188b4087 (stale) Mirror 17: 0x188b4087 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ba55): Mirror 4: 0x188b4087 (stale) Mirror 5: 0x188b4087 (stale) Mirror 6: 0x188b4087 (stale) Mirror 10: 0x188b4087 (stale) Mirror 11: 0x188b4087 (stale) Mirror 12: 0x188b4087 (stale) Mirror 13: 0x188b4087 (stale) Mirror 14: 0x188b4087 (stale) Mirror 15: 0x188b4087 (stale) Mirror 17: 0x188b4087 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ba55: skipped 000552 1787854090.964048 punch from 0x003859 to 0x00d06a (0x9812 bytes) 000553 1787854090.968276 trunc from 0x001a05 to 0x002676 (0xc72 bytes) 000554 1787854090.973324 mapwrite 0x02d30e thru 0x03cf01 (0xfbf4 bytes) 000555 1787854091.037406 mapwrite 0x0117ff thru 0x01313b (0x193d bytes) 000556 1787854091.058705 mapread 0x02c605 thru 0x036c06 (0xa602 bytes) 000557 1787854091.059928 read 0x031e39 thru 0x033c7b (0x1e43 bytes) 000558 1787854091.061011 write 0x00dd7d thru 0x01d05f (0xf2e3 bytes) 000559 1787854091.067484 write 0x01b663 thru 0x02b06e (0xfa0c bytes) 000560 1787854091.069915 read 0x03832a thru 0x03cf01 (0x4bd8 bytes) 000561 1787854091.071070 trunc from 0x03cf02 to 0x016a18 (0x264e9 bytes) 000563 1787854091.093596 read 0x00960c thru 0x016a18 (0xd40d bytes) 000564 1787854091.102836 mapread 0x0122c3 thru 0x016a18 (0x4756 bytes) 000566 1787854091.105002 mapread 0x006c36 thru 0x009834 (0x2bff bytes) 000567 1787854091.106978 trunc from 0x016a19 to 0x034491 (0x1da79 bytes) 000568 1787854091.126915 mapwrite 0x029760 thru 0x031a70 (0x8311 bytes) 000569 1787854091.153559 read 0x01c4bc thru 0x02429e (0x7de3 bytes) 000570 1787854091.154172 trunc from 0x034492 to 0x01f939 (0x14b58 bytes) 000572 1787854091.169674 write 0x01481e thru 0x019d5f (0x5542 bytes) 000573 1787854091.172657 punch from 0x00ce09 to 0x00cfca (0x1c2 bytes) 000574 1787854091.177152 trunc from 0x0103ef to 0x016749 (0x635b bytes) 000575 1787854091.189736 trunc from 0x01f93a to 0x035eec (0x165b3 bytes) 000576 1787854091.206124 read 0x013427 thru 0x022d9a (0xf974 bytes) 000577 1787854091.228569 mapwrite 0x01a043 thru 0x01cfbc (0x2f7a bytes) 000578 1787854091.240333 trunc from 0x02144d to 0x02f7d4 (0xe388 bytes) 000579 1787854091.245940 write 0x0117eb thru 0x01184e (0x64 bytes) 000580 1787854091.247164 write 0x009886 thru 0x013e3a (0xa5b5 bytes) 000581 1787854091.249043 trunc from 0x010703 to 0x014181 (0x3a7f bytes) 000582 1787854091.266178 MIRROR_RESYNC 11 mirrors 000583 1787854094.208801 mapwrite 0x038d23 thru 0x03f050 (0x632e bytes) 000584 1787854094.325148 punch from 0x029121 to 0x02f03a (0x5f1a bytes) 000585 1787854094.341557 trunc from 0x03f051 to 0x0362c0 (0x8d90 bytes) 000586 1787854094.381066 trunc from 0x0362c1 to 0x012e9d (0x23423 bytes) 000587 1787854094.436108 write 0x02d993 thru 0x0317b4 (0x3e22 bytes) 000588 1787854094.441664 trunc from 0x0310cc to 0x0317b4 (0x6e9 bytes) 000589 1787854094.470622 mapwrite 0x03f92f thru 0x03ffff (0x6d1 bytes) 000590 1787854094.524572 mapread 0x032123 thru 0x036963 (0x4841 bytes) 000591 1787854094.544706 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3c3f2722 (stale) Mirror 5: 0x3c3f2722 (stale) Mirror 6: 0x3c3f2722 (stale) Mirror 10: 0x3c3f2722 (stale) Mirror 11: 0x3c3f2722 (stale) Mirror 12: 0x3c3f2722 (stale) Mirror 13: 0x3c3f2722 (stale) Mirror 14: 0x3c3f2722 (stale) Mirror 15: 0x3c3f2722 (stale) Mirror 17: 0x3c3f2722 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x15ea251f Mirror 18: 0x15ea251f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000592 1787854095.757978 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3c3f2722 (stale) Mirror 5: 0x3c3f2722 (stale) Mirror 6: 0x3c3f2722 (stale) Mirror 10: 0x3c3f2722 (stale) Mirror 11: 0x3c3f2722 (stale) Mirror 12: 0x3c3f2722 (stale) Mirror 13: 0x3c3f2722 (stale) Mirror 14: 0x3c3f2722 (stale) Mirror 15: 0x3c3f2722 (stale) Mirror 17: 0x3c3f2722 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x15ea251f Mirror 18: 0x15ea251f Mirror 19: 0x15ea251f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000593 1787854096.932519 mapwrite 0x00a2ad thru 0x00d868 (0x35bc bytes) 000594 1787854097.049058 trunc from 0x0172a9 to 0x0189b7 (0x170f bytes) 000595 1787854097.055621 punch from 0x01f4db to 0x0231b9 (0x3cdf bytes) 000596 1787854097.062880 mapread 0x01774d thru 0x01a36b (0x2c1f bytes) 000598 1787854097.074658 mapwrite 0x005a76 thru 0x011232 (0xb7bd bytes) 000599 1787854097.101910 MIRROR_RESYNC 13 mirrors 000600 1787854100.467866 trunc from 0x040000 to 0x006a07 (0x395f8 bytes) 000601 1787854100.516425 mapwrite 0x034928 thru 0x03df2c (0x9605 bytes) 000602 1787854100.578694 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df2d): Mirror 4: 0x78a3d08f (stale) Mirror 5: 0x78a3d08f (stale) Mirror 6: 0x78a3d08f (stale) Mirror 10: 0x78a3d08f (stale) Mirror 12: 0x78a3d08f (stale) Mirror 13: 0x78a3d08f (stale) Mirror 14: 0x78a3d08f (stale) Mirror 15: 0x78a3d08f (stale) Mirror 17: 0x78a3d08f (stale) Mirror 18: 0x78a3d08f (stale) Mirror 19: 0x78a3d08f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df2d): Mirror 4: 0x78a3d08f (stale) Mirror 5: 0x78a3d08f (stale) Mirror 6: 0x78a3d08f (stale) Mirror 10: 0x78a3d08f (stale) Mirror 12: 0x78a3d08f (stale) Mirror 13: 0x78a3d08f (stale) Mirror 14: 0x78a3d08f (stale) Mirror 15: 0x78a3d08f (stale) Mirror 17: 0x78a3d08f (stale) Mirror 18: 0x78a3d08f (stale) Mirror 19: 0x78a3d08f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df2d: skipped 000603 1787854101.256131 write 0x0067da thru 0x00d739 (0x6f60 bytes) 000604 1787854101.269268 trunc from 0x03df2d to 0x023d22 (0x1a20a bytes) 000605 1787854101.285578 read 0x0234bc thru 0x023d22 (0x867 bytes) 000606 1787854101.290883 fallocate 0x005598 thru 0x012fd1 (0xda3a bytes) 000607 1787854101.295746 write 0x00ba22 thru 0x00f5c5 (0x3ba4 bytes) 000608 1787854101.306458 MIRROR_RESYNC 12 mirrors 000609 1787854103.235822 trunc from 0x023d23 to 0x0016f2 (0x22630 bytes) 000610 1787854103.318916 fallocate 0x00a6ac thru 0x01a5fd (0xff52 bytes) 000611 1787854103.326021 trunc from 0x0016f3 to 0x0215b0 (0x1febe bytes) 000612 1787854103.353152 trunc from 0x003fdd to 0x008bbc (0x4be0 bytes) 000613 1787854103.359296 fallocate 0x023d94 thru 0x027b89 (0x3df6 bytes) 000614 1787854103.364795 mapwrite 0x02db5f thru 0x02e973 (0xe15 bytes) 000615 1787854103.409786 trunc from 0x016268 to 0x025d20 (0xfab9 bytes) 000616 1787854103.415855 fallocate 0x02b9fe thru 0x03068b (0x4c8e bytes) 000617 1787854103.421874 mapread 0x005125 thru 0x009785 (0x4661 bytes) 000618 1787854103.432662 write 0x022661 thru 0x02d675 (0xb015 bytes) 000619 1787854103.439631 mapread 0x02bb0b thru 0x02d1e7 (0x16dd bytes) 000620 1787854103.440617 mapwrite 0x03be65 thru 0x03ffff (0x419b bytes) 000621 1787854103.489421 mapread 0x02bece thru 0x03b9ee (0xfb21 bytes) 000622 1787854103.503838 MIRROR_RESYNC 12 mirrors 000624 1787854105.866360 fallocate 0x00de3e thru 0x01d509 (0xf6cc bytes) 000627 1787854105.901627 mapwrite 0x00e741 thru 0x015918 (0x71d8 bytes) 000628 1787854105.942286 trunc from 0x040000 to 0x03ad73 (0x528c bytes) 000629 1787854105.965141 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: 0x1cb150 (stale) Mirror 5: 0x1cb150 (stale) Mirror 6: 0x1cb150 (stale) Mirror 10: 0x1cb150 (stale) Mirror 12: 0x1cb150 (stale) Mirror 13: 0x1cb150 (stale) Mirror 14: 0x1cb150 (stale) Mirror 15: 0x1cb150 (stale) Mirror 17: 0x1cb150 (stale) Mirror 18: 0x1cb150 (stale) Mirror 19: 0x1cb150 (stale) CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 1: 0x9b6ff858 Mirror 20: 0x9b6ff858 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad74: skipped 000630 1787854106.864491 trunc from 0x03028e to 0x03ad73 (0xaae6 bytes) 000631 1787854106.957372 punch from 0x0369e9 to 0x0383aa (0x19c2 bytes) 000632 1787854106.977401 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: 0x1cb150 (stale) Mirror 5: 0x1cb150 (stale) Mirror 6: 0x1cb150 (stale) Mirror 10: 0x1cb150 (stale) Mirror 12: 0x1cb150 (stale) Mirror 13: 0x1cb150 (stale) Mirror 14: 0x1cb150 (stale) Mirror 17: 0x1cb150 (stale) Mirror 18: 0x1cb150 (stale) Mirror 19: 0x1cb150 (stale) Mirror 20: 0x9b6ff858 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: 0x1cb150 (stale) Mirror 5: 0x1cb150 (stale) Mirror 6: 0x1cb150 (stale) Mirror 10: 0x1cb150 (stale) Mirror 12: 0x1cb150 (stale) Mirror 13: 0x1cb150 (stale) Mirror 14: 0x1cb150 (stale) Mirror 17: 0x1cb150 (stale) Mirror 18: 0x1cb150 (stale) Mirror 19: 0x1cb150 (stale) Mirror 20: 0x9b6ff858 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad74: skipped 000634 1787854107.972640 trunc from 0x039cf1 to 0x03ad73 (0x1083 bytes) 000636 1787854107.982839 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: 0x1cb150 (stale) Mirror 5: 0x1cb150 (stale) Mirror 6: 0x1cb150 (stale) Mirror 10: 0x1cb150 (stale) Mirror 12: 0x1cb150 (stale) Mirror 13: 0x1cb150 (stale) Mirror 14: 0x1cb150 (stale) Mirror 17: 0x1cb150 (stale) Mirror 18: 0x1cb150 (stale) Mirror 19: 0x1cb150 (stale) Mirror 20: 0x9b6ff858 (stale) CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 1: 0x9b6ff858 Mirror 21: 0x9b6ff858 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad74: skipped 000637 1787854108.949746 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: 0x1cb150 (stale) Mirror 5: 0x1cb150 (stale) Mirror 6: 0x1cb150 (stale) Mirror 10: 0x1cb150 (stale) Mirror 13: 0x1cb150 (stale) Mirror 14: 0x1cb150 (stale) Mirror 17: 0x1cb150 (stale) Mirror 18: 0x1cb150 (stale) Mirror 19: 0x1cb150 (stale) Mirror 20: 0x9b6ff858 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 4: 0x1cb150 (stale) Mirror 5: 0x1cb150 (stale) Mirror 6: 0x1cb150 (stale) Mirror 10: 0x1cb150 (stale) Mirror 13: 0x1cb150 (stale) Mirror 14: 0x1cb150 (stale) Mirror 17: 0x1cb150 (stale) Mirror 18: 0x1cb150 (stale) Mirror 19: 0x1cb150 (stale) Mirror 20: 0x9b6ff858 (stale) CRC-32 checksum value for chunk [0, 0x3ad74): Mirror 1: 0x9b6ff858 Mirror 21: 0x9b6ff858 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad74: skipped 000639 1787854110.325133 mapread 0x022451 thru 0x02c964 (0xa514 bytes) 000640 1787854110.359407 punch from 0x01048b to 0x01662b (0x61a1 bytes) 000641 1787854110.427873 mapread 0x01069b thru 0x010b10 (0x476 bytes) 000642 1787854110.445877 trunc from 0x024f95 to 0x02718d (0x21f9 bytes) 000643 1787854110.452387 fallocate 0x001b23 thru 0x00e47f (0xc95d bytes) 000644 1787854110.458939 trunc from 0x03ad74 to 0x00c42c (0x2e947 bytes) 000645 1787854110.493752 write 0x031012 thru 0x031cfc (0xceb bytes) 000646 1787854110.504393 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31cfd): Mirror 4: 0x36479885 (stale) Mirror 5: 0x36479885 (stale) Mirror 6: 0x36479885 (stale) Mirror 10: 0x36479885 (stale) Mirror 13: 0x36479885 (stale) Mirror 14: 0x36479885 (stale) Mirror 17: 0x36479885 (stale) Mirror 18: 0x36479885 (stale) Mirror 19: 0x36479885 (stale) Mirror 21: 0x5ed97ab4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31cfd): Mirror 4: 0x36479885 (stale) Mirror 5: 0x36479885 (stale) Mirror 6: 0x36479885 (stale) Mirror 10: 0x36479885 (stale) Mirror 13: 0x36479885 (stale) Mirror 14: 0x36479885 (stale) Mirror 17: 0x36479885 (stale) Mirror 18: 0x36479885 (stale) Mirror 19: 0x36479885 (stale) Mirror 21: 0x5ed97ab4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31cfd: skipped 000647 1787854111.129655 punch from 0x00d401 to 0x016f5d (0x9b5d bytes) 000649 1787854111.141711 mapwrite 0x02a0e6 thru 0x03572a (0xb645 bytes) 000650 1787854111.235568 trunc from 0x02b732 to 0x03572a (0x9ff9 bytes) 000651 1787854111.242293 mapread 0x0292a8 thru 0x03572a (0xc483 bytes) 000652 1787854111.259920 trunc from 0x03572b to 0x03634e (0xc24 bytes) 000653 1787854111.281074 MIRROR_RESYNC 11 mirrors 000654 1787854113.601954 trunc from 0x026850 to 0x02b779 (0x4f2a bytes) 000655 1787854113.628612 mapread 0x03064a thru 0x03634e (0x5d05 bytes) 000656 1787854113.649574 trunc from 0x03634f to 0x005b3a (0x30814 bytes) 000657 1787854113.682361 MIRROR_RESYNC 11 mirrors 000658 1787854115.654633 trunc from 0x005b3b to 0x033ae1 (0x2dfa7 bytes) 000659 1787854115.730306 fallocate 0x02fb90 thru 0x033699 (0x3b0a bytes) 000660 1787854115.748398 punch from 0x0025fd to 0x003360 (0xd64 bytes) 000661 1787854115.756705 mapwrite 0x030e6f thru 0x0357bf (0x4951 bytes) 000662 1787854115.897636 trunc from 0x0357c0 to 0x00d9df (0x27de0 bytes) 000663 1787854115.928743 mapwrite 0x0154a6 thru 0x024859 (0xf3b4 bytes) 000664 1787854116.073644 punch from 0x01abc8 to 0x01d39e (0x27d7 bytes) 000665 1787854116.092180 trunc from 0x00e35f to 0x01c5a0 (0xe242 bytes) 000666 1787854116.106989 read 0x015769 thru 0x018858 (0x30f0 bytes) 000667 1787854116.124477 punch from 0x017436 to 0x023bb8 (0xc783 bytes) 000669 1787854116.143814 fallocate 0x006be3 thru 0x00bb45 (0x4f63 bytes) 000670 1787854116.148444 write 0x02b7fe thru 0x038c2d (0xd430 bytes) 000671 1787854116.150948 fallocate 0x00b848 thru 0x00dcca (0x2483 bytes) 000672 1787854116.160357 punch from 0x02d039 to 0x03527b (0x8243 bytes) 000673 1787854116.184496 mapread 0x00fa03 thru 0x01e6a8 (0xeca6 bytes) 000674 1787854116.210611 trunc from 0x01b293 to 0x026bae (0xb91c bytes) 000675 1787854116.216275 trunc from 0x038c2e to 0x03559c (0x3691 bytes) 000676 1787854116.245013 fallocate 0x03fd6e thru 0x03fdb6 (0x49 bytes) 000677 1787854116.252302 mapread 0x039695 thru 0x03fdb6 (0x6722 bytes) 000678 1787854116.281980 mapwrite 0x014479 thru 0x01c4ad (0x8035 bytes) 000679 1787854116.351667 punch from 0x016fe0 to 0x01e38a (0x73ab bytes) 000680 1787854116.357916 trunc from 0x03fdb7 to 0x0133d6 (0x2c9e0 bytes) 000681 1787854116.374146 write 0x03d785 thru 0x03ffff (0x287b bytes) 000682 1787854116.375763 trunc from 0x02bf72 to 0x037abb (0xbb4a bytes) 000683 1787854116.380906 mapread 0x000107 thru 0x002d05 (0x2bff bytes) 000684 1787854116.388877 mapread 0x01282a thru 0x017a35 (0x520c bytes) 000686 1787854116.400602 trunc from 0x0255b7 to 0x028e76 (0x38c0 bytes) 000687 1787854116.406421 trunc from 0x024b8a to 0x02e534 (0x99ab bytes) 000688 1787854116.411309 fallocate 0x0061a3 thru 0x0073e8 (0x1246 bytes) 000689 1787854116.416100 mapread 0x036686 thru 0x03e5e0 (0x7f5b bytes) 000690 1787854116.429439 fallocate 0x009135 thru 0x011a4a (0x8916 bytes) 000691 1787854116.444919 MIRROR_RESYNC 11 mirrors 000692 1787854118.072351 fallocate 0x00d4f9 thru 0x0184f0 (0xaff8 bytes) 000693 1787854118.119761 punch from 0x011122 to 0x0139fc (0x28db bytes) 000694 1787854118.125296 mapread 0x02289a thru 0x0272bb (0x4a22 bytes) 000695 1787854118.145507 mapwrite 0x03049f thru 0x03d7ee (0xd350 bytes) 000696 1787854118.188700 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3c86b18c (stale) Mirror 5: 0x3c86b18c (stale) Mirror 6: 0x3c86b18c (stale) Mirror 10: 0x3c86b18c (stale) Mirror 13: 0x3c86b18c (stale) Mirror 14: 0x3c86b18c (stale) Mirror 17: 0x3c86b18c (stale) Mirror 18: 0x3c86b18c (stale) Mirror 21: 0x3c86b18c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3c86b18c (stale) Mirror 5: 0x3c86b18c (stale) Mirror 6: 0x3c86b18c (stale) Mirror 10: 0x3c86b18c (stale) Mirror 13: 0x3c86b18c (stale) Mirror 14: 0x3c86b18c (stale) Mirror 17: 0x3c86b18c (stale) Mirror 18: 0x3c86b18c (stale) Mirror 21: 0x3c86b18c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000698 1787854118.908259 fallocate 0x00d939 thru 0x018f30 (0xb5f8 bytes) 000699 1787854118.913603 punch from 0x03fa4a to 0x03ffff (0x5b6 bytes) 000701 1787854118.920086 trunc from 0x0087fc to 0x014d6f (0xc574 bytes) 000702 1787854118.924660 punch from 0x000384 to 0x005058 (0x4cd5 bytes) 000703 1787854118.932927 mapwrite 0x0265c0 thru 0x029e94 (0x38d5 bytes) 000704 1787854118.964889 fallocate 0x024c7c thru 0x02f4c9 (0xa84e bytes) 000705 1787854118.969134 trunc from 0x040000 to 0x0184d9 (0x27b26 bytes) 000706 1787854118.990569 fallocate 0x01001f thru 0x01db07 (0xdae9 bytes) 000707 1787854118.998417 punch from 0x012650 to 0x01bffd (0x99ae bytes) 000708 1787854119.002406 mapwrite 0x0371ab thru 0x0375c2 (0x418 bytes) 000709 1787854119.033893 punch from 0x0162dc to 0x01d708 (0x742d bytes) 000712 1787854119.040591 read 0x00a9a8 thru 0x00d861 (0x2eba bytes) 000713 1787854119.046686 punch from 0x0021f9 to 0x00942f (0x7237 bytes) 000714 1787854119.056151 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x375c3): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x375c3): Mirror 4: 0x6aec9b55 (stale) Mirror 5: 0x6aec9b55 (stale) Mirror 6: 0x6aec9b55 (stale) Mirror 10: 0x6aec9b55 (stale) Mirror 13: 0x6aec9b55 (stale) Mirror 14: 0x6aec9b55 (stale) Mirror 17: 0x6aec9b55 (stale) Mirror 18: 0x6aec9b55 (stale) Mirror 21: 0x6aec9b55 (stale) CRC-32 checksum value for chunk [0, 0x375c3): Mirror 1: 0x5e6f39b1 Mirror 22: 0x5e6f39b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x375c3: skipped 000715 1787854119.880677 write 0x02dd05 thru 0x03114a (0x3446 bytes) 000716 1787854119.938597 MIRROR_RESYNC 11 mirrors 000719 1787854121.829913 punch from 0x0103d0 to 0x013a6d (0x369e bytes) 000720 1787854121.877113 trunc from 0x004379 to 0x008d56 (0x49de bytes) 000721 1787854121.886963 punch from 0x00a77e to 0x018d08 (0xe58b bytes) 000722 1787854121.892882 read 0x014f54 thru 0x01724a (0x22f7 bytes) 000723 1787854121.901082 fallocate 0x00a8a7 thru 0x00ddd7 (0x3531 bytes) 000724 1787854121.906127 write 0x03bf7f thru 0x03ffff (0x4081 bytes) 000726 1787854121.908029 write 0x016245 thru 0x02016a (0x9f26 bytes) 000727 1787854121.916001 punch from 0x03942b to 0x03ffff (0x6bd5 bytes) 000728 1787854121.928626 read 0x03df72 thru 0x03ffff (0x208e bytes) 000729 1787854121.957808 write 0x0082bb thru 0x00c3b1 (0x40f7 bytes) 000730 1787854121.958885 read 0x03a0d4 thru 0x03ad4c (0xc79 bytes) 000731 1787854121.959464 mapwrite 0x00dd5b thru 0x013c42 (0x5ee8 bytes) 000732 1787854121.983671 write 0x0149f1 thru 0x0216ff (0xcd0f bytes) 000733 1787854121.990343 MIRROR_RESYNC 11 mirrors 000735 1787854124.844547 punch from 0x03356d to 0x033e92 (0x926 bytes) 000736 1787854124.891638 mapread 0x00400c thru 0x0067ca (0x27bf bytes) 000737 1787854124.912668 trunc from 0x0237df to 0x032a4c (0xf26e bytes) 000738 1787854124.917481 mapwrite 0x01493f thru 0x01ef0c (0xa5ce bytes) 000739 1787854124.956145 mapread 0x02a7ae thru 0x0341cb (0x9a1e bytes) 000740 1787854124.973164 trunc from 0x00c376 to 0x01496c (0x85f7 bytes) 000741 1787854124.978283 trunc from 0x040000 to 0x00a430 (0x35bcf bytes) 000742 1787854125.007487 MIRROR_RESYNC 11 mirrors 000743 1787854126.266144 write 0x0096e4 thru 0x00e0d6 (0x49f3 bytes) 000744 1787854126.309616 mapwrite 0x019826 thru 0x01fec9 (0x66a4 bytes) 000745 1787854126.372357 MIRROR_RESYNC 11 mirrors 000746 1787854129.016069 read 0x00278c thru 0x010fee (0xe863 bytes) 000747 1787854129.028478 punch from 0x001af9 to 0x00218a (0x692 bytes) 000748 1787854129.066780 trunc from 0x01feca to 0x006689 (0x19840 bytes) 000749 1787854129.097999 punch from 0x002315 to 0x00420b (0x1ef7 bytes) 000750 1787854129.102333 fallocate 0x02fd87 thru 0x03620e (0x6488 bytes) 000752 1787854129.108491 trunc from 0x034e6a to 0x03620e (0x13a5 bytes) 000753 1787854129.112474 mapwrite 0x01c93b thru 0x025542 (0x8c08 bytes) 000754 1787854129.147286 trunc from 0x03620f to 0x02f0ba (0x7154 bytes) 000755 1787854129.161788 fallocate 0x02676a thru 0x02a85a (0x40f1 bytes) 000756 1787854129.173256 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f0bb): Mirror 4: 0x84d31c9c (stale) Mirror 5: 0x84d31c9c (stale) Mirror 6: 0x84d31c9c (stale) Mirror 13: 0x84d31c9c (stale) Mirror 14: 0x84d31c9c (stale) Mirror 17: 0x84d31c9c (stale) Mirror 18: 0x84d31c9c (stale) Mirror 21: 0x84d31c9c (stale) Mirror 22: 0x84d31c9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f0bb): Mirror 4: 0x84d31c9c (stale) Mirror 5: 0x84d31c9c (stale) Mirror 6: 0x84d31c9c (stale) Mirror 13: 0x84d31c9c (stale) Mirror 14: 0x84d31c9c (stale) Mirror 17: 0x84d31c9c (stale) Mirror 18: 0x84d31c9c (stale) Mirror 21: 0x84d31c9c (stale) Mirror 22: 0x84d31c9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f0bb: skipped 000757 1787854129.762283 punch from 0x008423 to 0x00c5c1 (0x419f bytes) 000758 1787854129.777575 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f0bb): Mirror 4: 0x84d31c9c (stale) Mirror 5: 0x84d31c9c (stale) Mirror 13: 0x84d31c9c (stale) Mirror 14: 0x84d31c9c (stale) Mirror 17: 0x84d31c9c (stale) Mirror 18: 0x84d31c9c (stale) Mirror 21: 0x84d31c9c (stale) Mirror 22: 0x84d31c9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f0bb): Mirror 4: 0x84d31c9c (stale) Mirror 5: 0x84d31c9c (stale) Mirror 13: 0x84d31c9c (stale) Mirror 14: 0x84d31c9c (stale) Mirror 17: 0x84d31c9c (stale) Mirror 18: 0x84d31c9c (stale) Mirror 21: 0x84d31c9c (stale) Mirror 22: 0x84d31c9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f0bb: skipped 000759 1787854130.297396 mapread 0x02240b thru 0x02ea27 (0xc61d bytes) 000760 1787854130.319991 fallocate 0x027348 thru 0x029c13 (0x28cc bytes) 000761 1787854130.324399 trunc from 0x028d44 to 0x029090 (0x34d bytes) 000763 1787854130.329119 mapwrite 0x03cb56 thru 0x03ffff (0x34aa bytes) 000765 1787854130.364721 trunc from 0x00c864 to 0x014dde (0x857b bytes) 000766 1787854130.369181 mapwrite 0x01c0ba thru 0x026df6 (0xad3d bytes) 000767 1787854130.394770 trunc from 0x00d56c to 0x014040 (0x6ad5 bytes) 000768 1787854130.398076 fallocate 0x01e95a thru 0x028d9d (0xa444 bytes) 000769 1787854130.402421 write 0x03922a thru 0x039693 (0x46a bytes) 000771 1787854130.404120 mapread 0x018ae9 thru 0x025b46 (0xd05e bytes) 000772 1787854130.405767 punch from 0x01776d to 0x0216bb (0x9f4f bytes) 000774 1787854130.410963 fallocate 0x014cba thru 0x015a27 (0xd6e bytes) 000775 1787854130.418924 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x245c6824 (stale) Mirror 5: 0x245c6824 (stale) Mirror 13: 0x245c6824 (stale) Mirror 14: 0x245c6824 (stale) Mirror 17: 0x245c6824 (stale) Mirror 18: 0x245c6824 (stale) Mirror 22: 0x245c6824 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x245c6824 (stale) Mirror 5: 0x245c6824 (stale) Mirror 13: 0x245c6824 (stale) Mirror 14: 0x245c6824 (stale) Mirror 17: 0x245c6824 (stale) Mirror 18: 0x245c6824 (stale) Mirror 22: 0x245c6824 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000776 1787854130.832944 read 0x02e321 thru 0x037686 (0x9366 bytes) 000777 1787854130.847010 mapread 0x02b808 thru 0x02c04a (0x843 bytes) 000778 1787854130.859676 trunc from 0x01eb0c to 0x01fb08 (0xffd bytes) 000781 1787854130.865720 fallocate 0x0009b2 thru 0x008095 (0x76e4 bytes) 000782 1787854130.876424 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x245c6824 (stale) Mirror 5: 0x245c6824 (stale) Mirror 13: 0x245c6824 (stale) Mirror 14: 0x245c6824 (stale) Mirror 17: 0x245c6824 (stale) Mirror 18: 0x245c6824 (stale) Mirror 22: 0x245c6824 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41d0485e Mirror 23: 0x41d0485e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000783 1787854132.046503 read 0x020094 thru 0x0231b0 (0x311d bytes) 000784 1787854132.057488 trunc from 0x040000 to 0x01926f (0x26d90 bytes) 000785 1787854132.121430 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x19270): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19270): Mirror 4: 0xf6126acb (stale) Mirror 5: 0xf6126acb (stale) Mirror 13: 0xf6126acb (stale) Mirror 14: 0xf6126acb (stale) Mirror 17: 0xf6126acb (stale) Mirror 18: 0xf6126acb (stale) Mirror 22: 0xf6126acb (stale) Mirror 23: 0x46965be0 (stale) CRC-32 checksum value for chunk [0, 0x19270): Mirror 1: 0x46965be0 Mirror 24: 0x46965be0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19270: skipped 000786 1787854133.168318 punch from 0x00e120 to 0x01926f (0xb150 bytes) 000787 1787854133.239701 punch from 0x006bd2 to 0x013e48 (0xd277 bytes) 000788 1787854133.249928 read 0x0048e5 thru 0x00bb9f (0x72bb bytes) 000789 1787854133.261085 write 0x01c629 thru 0x029bfc (0xd5d4 bytes) 000792 1787854133.282368 trunc from 0x017f60 to 0x01d2d8 (0x5379 bytes) 000795 1787854133.308241 fallocate 0x0206c1 thru 0x02a11d (0x9a5d bytes) 000796 1787854133.321537 trunc from 0x029bfd to 0x00efdf (0x1ac1d bytes) 000797 1787854133.349536 mapwrite 0x01007d thru 0x018f02 (0x8e86 bytes) 000798 1787854133.408421 mapread 0x009d80 thru 0x016e30 (0xd0b1 bytes) 000799 1787854133.410900 read 0x018447 thru 0x018f02 (0xabc bytes) 000800 1787854133.412520 punch from 0x003fa6 to 0x004cee (0xd49 bytes) 000801 1787854133.418034 punch from 0x00e318 to 0x018f02 (0xabeb bytes) 000803 1787854133.425366 read 0x010ad0 thru 0x018f02 (0x8433 bytes) 000804 1787854133.435609 fallocate 0x035569 thru 0x036158 (0xbf0 bytes) 000805 1787854133.443429 MIRROR_RESYNC 10 mirrors 000806 1787854134.884293 fallocate 0x016872 thru 0x02643a (0xfbc9 bytes) 000807 1787854134.930418 trunc from 0x02643b to 0x0297a8 (0x336e bytes) 000808 1787854134.949627 read 0x008159 thru 0x013ff3 (0xbe9b bytes) 000809 1787854134.958819 fallocate 0x01e144 thru 0x025c25 (0x7ae2 bytes) 000810 1787854134.965401 mapwrite 0x03613e thru 0x03eb35 (0x89f8 bytes) 000811 1787854135.031826 MIRROR_RESYNC 10 mirrors 000812 1787854136.951744 mapwrite 0x038dfd thru 0x03ffff (0x7203 bytes) 000813 1787854137.028879 fallocate 0x02bc0e thru 0x030048 (0x443b bytes) 000815 1787854137.035734 mapread 0x03ca8e thru 0x03ffff (0x3572 bytes) 000817 1787854137.037020 write 0x033652 thru 0x03d366 (0x9d15 bytes) 000818 1787854137.039067 write 0x00db6d thru 0x019520 (0xb9b4 bytes) 000819 1787854137.060473 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2cbe08a3 (stale) Mirror 5: 0x2cbe08a3 (stale) Mirror 13: 0x2cbe08a3 (stale) Mirror 14: 0x2cbe08a3 (stale) Mirror 17: 0x2cbe08a3 (stale) Mirror 18: 0x2cbe08a3 (stale) Mirror 22: 0x2cbe08a3 (stale) Mirror 24: 0x2cbe08a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2cbe08a3 (stale) Mirror 5: 0x2cbe08a3 (stale) Mirror 13: 0x2cbe08a3 (stale) Mirror 14: 0x2cbe08a3 (stale) Mirror 17: 0x2cbe08a3 (stale) Mirror 18: 0x2cbe08a3 (stale) Mirror 22: 0x2cbe08a3 (stale) Mirror 24: 0x2cbe08a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000820 1787854137.545415 trunc from 0x023f36 to 0x02fb71 (0xbc3c bytes) 000821 1787854137.551269 write 0x016877 thru 0x02680c (0xff96 bytes) 000822 1787854137.567820 write 0x03ef42 thru 0x03ffff (0x10be bytes) 000823 1787854137.574407 punch from 0x010114 to 0x01d7c5 (0xd6b2 bytes) 000824 1787854137.594365 punch from 0x007945 to 0x011152 (0x980e bytes) 000825 1787854137.600245 trunc from 0x00324b to 0x00397b (0x731 bytes) 000826 1787854137.619344 MIRROR_RESYNC 9 mirrors 000827 1787854139.154462 mapwrite 0x03e466 thru 0x03ffff (0x1b9a bytes) 000828 1787854139.249730 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaeb6881a (stale) Mirror 5: 0xaeb6881a (stale) Mirror 13: 0xaeb6881a (stale) Mirror 14: 0xaeb6881a (stale) Mirror 17: 0xaeb6881a (stale) Mirror 18: 0xaeb6881a (stale) Mirror 22: 0xaeb6881a (stale) Mirror 24: 0xaeb6881a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xee9d7e48 Mirror 25: 0xee9d7e48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000829 1787854140.150294 read 0x01e56e thru 0x028349 (0x9ddc bytes) 000830 1787854140.158193 write 0x019635 thru 0x01e603 (0x4fcf bytes) 000831 1787854140.240910 mapwrite 0x01ec13 thru 0x0206d3 (0x1ac1 bytes) 000832 1787854140.273281 mapread 0x010360 thru 0x017e36 (0x7ad7 bytes) 000833 1787854140.285478 write 0x002a20 thru 0x012356 (0xf937 bytes) 000835 1787854140.295884 mapread 0x008e18 thru 0x00ffcd (0x71b6 bytes) 000836 1787854140.296596 mapread 0x00fa85 thru 0x015595 (0x5b11 bytes) 000837 1787854140.316020 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaeb6881a (stale) Mirror 5: 0xaeb6881a (stale) Mirror 13: 0xaeb6881a (stale) Mirror 14: 0xaeb6881a (stale) Mirror 17: 0xaeb6881a (stale) Mirror 18: 0xaeb6881a (stale) Mirror 22: 0xaeb6881a (stale) Mirror 24: 0xaeb6881a (stale) Mirror 25: 0xee9d7e48 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb652c2a5 Mirror 26: 0xb652c2a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000838 1787854141.210909 write 0x016a23 thru 0x019e6b (0x3449 bytes) 000839 1787854141.264384 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaeb6881a (stale) Mirror 5: 0xaeb6881a (stale) Mirror 13: 0xaeb6881a (stale) Mirror 14: 0xaeb6881a (stale) Mirror 17: 0xaeb6881a (stale) Mirror 18: 0xaeb6881a (stale) Mirror 22: 0xaeb6881a (stale) Mirror 24: 0xaeb6881a (stale) Mirror 26: 0xb652c2a5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaeb6881a (stale) Mirror 5: 0xaeb6881a (stale) Mirror 13: 0xaeb6881a (stale) Mirror 14: 0xaeb6881a (stale) Mirror 17: 0xaeb6881a (stale) Mirror 18: 0xaeb6881a (stale) Mirror 22: 0xaeb6881a (stale) Mirror 24: 0xaeb6881a (stale) Mirror 26: 0xb652c2a5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000841 1787854141.808756 write 0x00be05 thru 0x014aad (0x8ca9 bytes) 000842 1787854141.834863 MIRROR_RESYNC 10 mirrors 000843 1787854143.834535 punch from 0x01f830 to 0x02ac8b (0xb45c bytes) 000844 1787854143.875950 fallocate 0x03438b thru 0x0390dd (0x4d53 bytes) 000845 1787854143.880465 punch from 0x024dc3 to 0x02c42d (0x766b bytes) 000846 1787854143.884935 read 0x03bfa0 thru 0x03fde9 (0x3e4a bytes) 000847 1787854143.892968 punch from 0x023e98 to 0x029c0b (0x5d74 bytes) 000848 1787854143.897093 trunc from 0x040000 to 0x0001b2 (0x3fe4d bytes) 000850 1787854143.921139 mapread 0x000066 thru 0x0001b2 (0x14d bytes) 000851 1787854143.926727 mapread 0x000095 thru 0x0001b2 (0x11e bytes) 000852 1787854143.927549 read 0x00012a thru 0x0001b2 (0x89 bytes) 000853 1787854143.928052 mapwrite 0x016fac thru 0x025970 (0xe9c5 bytes) 000854 1787854143.978086 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x25971): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25971): Mirror 4: 0x40e79935 (stale) Mirror 5: 0x40e79935 (stale) Mirror 13: 0x40e79935 (stale) Mirror 14: 0x40e79935 (stale) Mirror 17: 0x40e79935 (stale) Mirror 18: 0x40e79935 (stale) Mirror 22: 0x40e79935 (stale) Mirror 24: 0x40e79935 (stale) Mirror 26: 0x40e79935 (stale) CRC-32 checksum value for chunk [0, 0x25971): Mirror 1: 0x5797d379 Mirror 27: 0x5797d379 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25971: skipped 000855 1787854144.955721 mapread 0x002eca thru 0x003f31 (0x1068 bytes) 000856 1787854144.975122 write 0x03c6e1 thru 0x03ffff (0x391f bytes) 000857 1787854145.047946 MIRROR_RESYNC 11 mirrors 000859 1787854147.229285 fallocate 0x0023e7 thru 0x01097d (0xe597 bytes) 000860 1787854147.264528 write 0x032113 thru 0x03ffff (0xdeed bytes) 000861 1787854147.281166 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6205f282 (stale) Mirror 5: 0x6205f282 (stale) Mirror 13: 0x6205f282 (stale) Mirror 14: 0x6205f282 (stale) Mirror 17: 0x6205f282 (stale) Mirror 18: 0x6205f282 (stale) Mirror 22: 0x6205f282 (stale) Mirror 24: 0x6205f282 (stale) Mirror 26: 0x6205f282 (stale) Mirror 27: 0x6205f282 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe2953cea Mirror 28: 0xe2953cea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000862 1787854148.354828 trunc from 0x040000 to 0x032c45 (0xd3ba bytes) 000863 1787854148.402040 trunc from 0x00e7dc to 0x01542c (0x6c51 bytes) 000864 1787854148.404805 trunc from 0x032c46 to 0x03be2f (0x91ea bytes) 000865 1787854148.415737 write 0x014ea7 thru 0x0170ba (0x2214 bytes) 000866 1787854148.421166 mapread 0x013955 thru 0x01e610 (0xacbc bytes) 000867 1787854148.431046 mapwrite 0x023898 thru 0x030276 (0xc9df bytes) 000868 1787854148.479555 trunc from 0x03be30 to 0x03065d (0xb7d2 bytes) 000869 1787854148.497932 mapwrite 0x005569 thru 0x010064 (0xaafc bytes) 000870 1787854148.527577 read 0x01a7ed thru 0x029a7a (0xf28e bytes) 000871 1787854148.528222 punch from 0x01555c to 0x01700b (0x1ab0 bytes) 000872 1787854148.532740 fallocate 0x029337 thru 0x0352fc (0xbfc6 bytes) 000873 1787854148.541667 trunc from 0x01cdf4 to 0x01d1fa (0x407 bytes) 000874 1787854148.546117 mapread 0x016267 thru 0x01e000 (0x7d9a bytes) 000875 1787854148.553531 trunc from 0x0352fd to 0x01d2c6 (0x18036 bytes) 000876 1787854148.566661 write 0x039524 thru 0x03cbff (0x36dc bytes) 000877 1787854148.568897 mapwrite 0x02f5b4 thru 0x031896 (0x22e3 bytes) 000878 1787854148.592726 mapread 0x00676d thru 0x014ae8 (0xe37c bytes) 000879 1787854148.594358 read 0x02534a thru 0x026692 (0x1349 bytes) 000880 1787854148.604185 punch from 0x033a65 to 0x03cbff (0x919b bytes) 000881 1787854148.609403 trunc from 0x02dddd to 0x031266 (0x348a bytes) 000882 1787854148.614446 write 0x019399 thru 0x022955 (0x95bd bytes) 000883 1787854148.616516 trunc from 0x03b397 to 0x03bbaf (0x819 bytes) 000884 1787854148.621524 mapwrite 0x00be7a thru 0x00dda3 (0x1f2a bytes) 000885 1787854148.635100 punch from 0x00f233 to 0x0112b5 (0x2083 bytes) 000886 1787854148.638827 punch from 0x01dbdf to 0x026309 (0x872b bytes) 000887 1787854148.643335 mapread 0x022eba thru 0x02d321 (0xa468 bytes) 000888 1787854148.667885 trunc from 0x023656 to 0x02d153 (0x9afe bytes) 000889 1787854148.671743 punch from 0x012c87 to 0x0214e7 (0xe861 bytes) 000890 1787854148.679628 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc00): Mirror 4: 0xa15bfc75 (stale) Mirror 5: 0xa15bfc75 (stale) Mirror 13: 0xa15bfc75 (stale) Mirror 14: 0xa15bfc75 (stale) Mirror 17: 0xa15bfc75 (stale) Mirror 18: 0xa15bfc75 (stale) Mirror 22: 0xa15bfc75 (stale) Mirror 24: 0xa15bfc75 (stale) Mirror 27: 0xa15bfc75 (stale) Mirror 28: 0xbab8c1b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc00): Mirror 4: 0xa15bfc75 (stale) Mirror 5: 0xa15bfc75 (stale) Mirror 13: 0xa15bfc75 (stale) Mirror 14: 0xa15bfc75 (stale) Mirror 17: 0xa15bfc75 (stale) Mirror 18: 0xa15bfc75 (stale) Mirror 22: 0xa15bfc75 (stale) Mirror 24: 0xa15bfc75 (stale) Mirror 27: 0xa15bfc75 (stale) Mirror 28: 0xbab8c1b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc00: skipped 000891 1787854149.192509 punch from 0x01c568 to 0x020aac (0x4545 bytes) 000892 1787854149.197225 read 0x003ea0 thru 0x007024 (0x3185 bytes) 000893 1787854149.206045 fallocate 0x025b8f thru 0x028529 (0x299b bytes) 000894 1787854149.214413 MIRROR_RESYNC 11 mirrors 000895 1787854151.439602 trunc from 0x03cc00 to 0x0293e4 (0x1381b bytes) 000896 1787854151.463697 trunc from 0x00754f to 0x013ef8 (0xc9aa bytes) 000897 1787854151.474604 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x293e5): Mirror 5: 0x43095ca7 (stale) Mirror 13: 0x43095ca7 (stale) Mirror 14: 0x43095ca7 (stale) Mirror 17: 0x43095ca7 (stale) Mirror 18: 0x43095ca7 (stale) Mirror 22: 0x43095ca7 (stale) Mirror 24: 0x43095ca7 (stale) Mirror 27: 0x43095ca7 (stale) Mirror 28: 0x43095ca7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x293e5): Mirror 5: 0x43095ca7 (stale) Mirror 13: 0x43095ca7 (stale) Mirror 14: 0x43095ca7 (stale) Mirror 17: 0x43095ca7 (stale) Mirror 18: 0x43095ca7 (stale) Mirror 22: 0x43095ca7 (stale) Mirror 24: 0x43095ca7 (stale) Mirror 27: 0x43095ca7 (stale) Mirror 28: 0x43095ca7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x293e5: skipped 000898 1787854151.884436 punch from 0x020226 to 0x029308 (0x90e3 bytes) 000900 1787854151.890087 trunc from 0x016840 to 0x023f60 (0xd721 bytes) 000901 1787854151.895153 punch from 0x0126b1 to 0x01480a (0x215a bytes) 000902 1787854151.899076 trunc from 0x00170e to 0x00f358 (0xdc4b bytes) 000903 1787854151.903736 read 0x01a7dc thru 0x025a23 (0xb248 bytes) 000904 1787854151.916619 trunc from 0x0293e5 to 0x03d34d (0x13f69 bytes) 000905 1787854151.937558 trunc from 0x03989f to 0x03d34d (0x3aaf bytes) 000906 1787854151.942960 mapwrite 0x022494 thru 0x02edf6 (0xc963 bytes) 000907 1787854151.999533 fallocate 0x01309a thru 0x01b226 (0x818d bytes) 000908 1787854152.005011 trunc from 0x024aa6 to 0x032712 (0xdc6d bytes) 000910 1787854152.011638 mapwrite 0x002550 thru 0x00344e (0xeff bytes) 000911 1787854152.034954 mapread 0x0189e3 thru 0x01c88d (0x3eab bytes) 000912 1787854152.059263 MIRROR_RESYNC 10 mirrors 000913 1787854154.301586 mapread 0x0315aa thru 0x03d34d (0xbda4 bytes) 000914 1787854154.321480 trunc from 0x03d34e to 0x02b23c (0x12111 bytes) 000915 1787854154.365412 mapread 0x01b356 thru 0x01bb6d (0x818 bytes) 000916 1787854154.372971 fallocate 0x0131b7 thru 0x01be34 (0x8c7e bytes) 000917 1787854154.377528 write 0x01b9b8 thru 0x02ad3b (0xf384 bytes) 000918 1787854154.383034 trunc from 0x0293f4 to 0x02b23c (0x1e49 bytes) 000919 1787854154.395521 mapread 0x0200d1 thru 0x027e72 (0x7da2 bytes) 000920 1787854154.396564 mapwrite 0x03869a thru 0x03bc8f (0x35f6 bytes) 000921 1787854154.434049 fallocate 0x0293b3 thru 0x02ff4a (0x6b98 bytes) 000922 1787854154.439485 read 0x027091 thru 0x02da88 (0x69f8 bytes) 000923 1787854154.448350 punch from 0x00bff9 to 0x015d9e (0x9da6 bytes) 000925 1787854154.454716 mapread 0x02fffe thru 0x037e37 (0x7e3a bytes) 000926 1787854154.460803 mapread 0x0198e0 thru 0x022034 (0x8755 bytes) 000927 1787854154.461911 trunc from 0x00e8ab to 0x0118cd (0x3023 bytes) 000928 1787854154.466529 write 0x033fb9 thru 0x03ad7e (0x6dc6 bytes) 000929 1787854154.468575 trunc from 0x03bc90 to 0x0337fc (0x8493 bytes) 000930 1787854154.482132 fallocate 0x03b27a thru 0x03ffff (0x4d86 bytes) 000931 1787854154.487687 trunc from 0x0337fd to 0x000be5 (0x32c17 bytes) 000932 1787854154.504710 fallocate 0x0387ef thru 0x03e5bc (0x5dce bytes) 000933 1787854154.511024 trunc from 0x000be6 to 0x013aa4 (0x12ebf bytes) 000934 1787854154.530705 read 0x0106b5 thru 0x013aa4 (0x33f0 bytes) 000935 1787854154.538734 trunc from 0x013aa5 to 0x0027cc (0x112d8 bytes) 000936 1787854154.550917 trunc from 0x0027cd to 0x00079f (0x202d bytes) 000937 1787854154.570512 read 0x000398 thru 0x00079f (0x408 bytes) 000938 1787854154.571842 punch from 0x00031d to 0x00079f (0x483 bytes) 000939 1787854154.576815 punch from 0x0005e9 to 0x00079f (0x1b7 bytes) 000941 1787854154.581652 trunc from 0x0007a0 to 0x028320 (0x27b81 bytes) 000942 1787854154.598065 write 0x00fe28 thru 0x0117ba (0x1993 bytes) 000943 1787854154.609131 read 0x00f211 thru 0x014923 (0x5713 bytes) 000944 1787854154.609954 fallocate 0x0063dd thru 0x00a105 (0x3d29 bytes) 000945 1787854154.614482 mapread 0x009089 thru 0x01614a (0xd0c2 bytes) 000946 1787854154.615554 mapread 0x006ad1 thru 0x011a55 (0xaf85 bytes) 000947 1787854154.616854 mapread 0x006b9f thru 0x00ea65 (0x7ec7 bytes) 000948 1787854154.617867 trunc from 0x01f012 to 0x028320 (0x930f bytes) 000949 1787854154.622406 trunc from 0x0214c1 to 0x028320 (0x6e60 bytes) 000950 1787854154.626414 mapread 0x01cfa1 thru 0x01ede9 (0x1e49 bytes) 000951 1787854154.627297 fallocate 0x002a37 thru 0x007333 (0x48fd bytes) 000952 1787854154.631878 mapwrite 0x014042 thru 0x01e877 (0xa836 bytes) 000953 1787854154.649884 fallocate 0x023a9c thru 0x024afd (0x1062 bytes) 000955 1787854154.655616 mapread 0x010c07 thru 0x01932c (0x8726 bytes) 000956 1787854154.656573 read 0x0173f6 thru 0x017830 (0x43b bytes) 000957 1787854154.657088 mapread 0x00567f thru 0x006cda (0x165c bytes) 000958 1787854154.661177 punch from 0x0081a2 to 0x015a9c (0xd8fb bytes) 000959 1787854154.667336 punch from 0x021774 to 0x025510 (0x3d9d bytes) 000960 1787854154.671942 write 0x02447d thru 0x02dfad (0x9b31 bytes) 000961 1787854154.695827 mapwrite 0x03d801 thru 0x03ffff (0x27ff bytes) 000962 1787854154.734537 trunc from 0x040000 to 0x03938f (0x6c70 bytes) 000963 1787854154.750395 trunc from 0x039390 to 0x018807 (0x20b88 bytes) 000964 1787854154.766154 trunc from 0x018808 to 0x02898f (0x10188 bytes) 000965 1787854154.787356 write 0x035988 thru 0x03ffff (0xa678 bytes) 000966 1787854154.789652 trunc from 0x0388e1 to 0x03ee2b (0x654b bytes) 000967 1787854154.806977 read 0x02dfe6 thru 0x032366 (0x4381 bytes) 000968 1787854154.815309 read 0x0290f4 thru 0x035a94 (0xc9a1 bytes) 000969 1787854154.817080 read 0x03de22 thru 0x03ffff (0x21de bytes) 000970 1787854154.821928 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x9a9bbd44 (stale) Mirror 13: 0x9a9bbd44 (stale) Mirror 14: 0x9a9bbd44 (stale) Mirror 17: 0x9a9bbd44 (stale) Mirror 18: 0x9a9bbd44 (stale) Mirror 22: 0x9a9bbd44 (stale) Mirror 24: 0x9a9bbd44 (stale) Mirror 27: 0x9a9bbd44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x9a9bbd44 (stale) Mirror 13: 0x9a9bbd44 (stale) Mirror 14: 0x9a9bbd44 (stale) Mirror 17: 0x9a9bbd44 (stale) Mirror 18: 0x9a9bbd44 (stale) Mirror 22: 0x9a9bbd44 (stale) Mirror 24: 0x9a9bbd44 (stale) Mirror 27: 0x9a9bbd44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000971 1787854155.238343 MIRROR_RESYNC 9 mirrors 000972 1787854157.667866 read 0x00d718 thru 0x00e0bf (0x9a8 bytes) 000973 1787854157.675532 mapread 0x000fc8 thru 0x00fc6a (0xeca3 bytes) 000974 1787854157.723040 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) 000975 1787854158.318399 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) 000976 1787854158.719753 fallocate 0x01f935 thru 0x02533d (0x5a09 bytes) 000977 1787854158.788819 mapread 0x003fbb thru 0x012bf2 (0xec38 bytes) 000979 1787854158.832745 trunc from 0x02fa83 to 0x02fd71 (0x2ef bytes) 000980 1787854158.848292 write 0x017853 thru 0x01d2b1 (0x5a5f bytes) 000981 1787854158.866731 trunc from 0x040000 to 0x0219c8 (0x1e637 bytes) 000982 1787854158.910647 trunc from 0x010203 to 0x012bdc (0x29da bytes) 000983 1787854158.919752 write 0x0357b0 thru 0x03b8bf (0x6110 bytes) 000984 1787854158.922536 write 0x0360c7 thru 0x0370cd (0x1007 bytes) 000986 1787854158.925869 trunc from 0x03b8c0 to 0x00d7ee (0x2e0d1 bytes) 000987 1787854158.970885 MIRROR_RESYNC 7 mirrors 000988 1787854160.185443 fallocate 0x024c6f thru 0x02ce86 (0x8218 bytes) 000989 1787854160.226945 trunc from 0x00d7ef to 0x00aabe (0x2d30 bytes) 000990 1787854160.247415 fallocate 0x00de21 thru 0x0132ab (0x548b bytes) 000991 1787854160.253337 write 0x01dfc6 thru 0x0223df (0x441a bytes) 000992 1787854160.255680 trunc from 0x00490a to 0x0147e2 (0xfed9 bytes) 000993 1787854160.260844 trunc from 0x0223e0 to 0x0399c8 (0x175e9 bytes) 000994 1787854160.284072 fallocate 0x034bce thru 0x0354a0 (0x8d3 bytes) 000995 1787854160.290287 punch from 0x0101b7 to 0x010ba7 (0x9f1 bytes) 000996 1787854160.295663 trunc from 0x015499 to 0x018479 (0x2fe1 bytes) 000998 1787854160.309985 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x399c9): Mirror 13: 0x2d04922e (stale) Mirror 14: 0x2d04922e (stale) Mirror 22: 0x2d04922e (stale) Mirror 24: 0x2d04922e (stale) Mirror 27: 0x2d04922e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399c9): Mirror 13: 0x2d04922e (stale) Mirror 14: 0x2d04922e (stale) Mirror 22: 0x2d04922e (stale) Mirror 24: 0x2d04922e (stale) Mirror 27: 0x2d04922e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399c9: skipped 000999 1787854160.794738 read 0x013aea thru 0x0207d0 (0xcce7 bytes) 001000 1787854160.804686 fallocate 0x01dd5e thru 0x01e9a7 (0xc4a bytes) All operations completed A-OK!