== sanity-flr test 70a: flr mode fsx test ================ 12:16:45 (1787847405) Seed set to 7407 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787847407.819375 write 0x016084 thru 0x01c852 (0x67cf bytes) 000003 1787847407.832372 read 0x01369b thru 0x0179a8 (0x430e bytes) truncating to largest ever: 0xd69b 000006 1787847407.852816 trunc from 0x01c853 to 0x00d69a (0xf1b8 bytes) 000008 1787847407.891836 read 0x004f11 thru 0x008ae6 (0x3bd6 bytes) 000009 1787847407.921412 read 0x00c5f4 thru 0x00d69a (0x10a7 bytes) 000012 1787847407.923085 mapread 0x005203 thru 0x00d69a (0x8498 bytes) 000017 1787847407.930539 mapread 0x000c4f thru 0x00743c (0x67ee bytes) 000019 1787847407.933704 mapread 0x00852e thru 0x00d69a (0x516d bytes) 000020 1787847407.935625 mapread 0x008da6 thru 0x00d69a (0x48f5 bytes) 000021 1787847407.937341 read 0x001588 thru 0x006813 (0x528c bytes) 000024 1787847407.950171 write 0x03ce3c thru 0x03ffff (0x31c4 bytes) 000027 1787847407.954549 mapread 0x009303 thru 0x012cf7 (0x99f5 bytes) 000028 1787847407.970639 read 0x032723 thru 0x0351d9 (0x2ab7 bytes) 000035 1787847407.977748 mapwrite 0x00c4ae thru 0x0115e1 (0x5134 bytes) 000036 1787847408.105626 write 0x004bc8 thru 0x0078d9 (0x2d12 bytes) 000037 1787847408.111019 read 0x0177f4 thru 0x017acb (0x2d8 bytes) 000038 1787847408.143013 MIRROR_EXTEND to 2 mirrors 000039 1787847409.755855 mapwrite 0x023b11 thru 0x02441a (0x90a bytes) 000042 1787847409.975862 mapwrite 0x026ebd thru 0x031808 (0xa94c bytes) 000043 1787847410.105472 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa762f766 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe957d64a Mirror 3: 0xe957d64a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1787847412.009960 read 0x001942 thru 0x00bbc0 (0xa27f bytes) truncating to largest ever: 0x1bcf0 000045 1787847412.041854 trunc from 0x040000 to 0x01bcef (0x24310 bytes) 000046 1787847412.331721 mapwrite 0x007d75 thru 0x0122c6 (0xa552 bytes) 000047 1787847412.514503 write 0x012b52 thru 0x01f228 (0xc6d7 bytes) 000048 1787847412.522464 read 0x001e23 thru 0x006aa4 (0x4c82 bytes) 000050 1787847412.536052 mapread 0x00e351 thru 0x01c81f (0xe4cf bytes) 000051 1787847412.536979 read 0x01e4a8 thru 0x01f228 (0xd81 bytes) 000052 1787847412.547249 MIRROR_RESYNC 3 mirrors 000053 1787847413.796754 mapwrite 0x0283ec thru 0x03686d (0xe482 bytes) 000054 1787847414.105997 mapwrite 0x02da13 thru 0x0318a5 (0x3e93 bytes) 000055 1787847414.167928 mapwrite 0x0104f5 thru 0x011153 (0xc5f bytes) 000056 1787847414.225844 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3686e): Mirror 2: 0x191f2ed8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3686e): Mirror 2: 0x191f2ed8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3686e: skipped 000057 1787847414.536734 mapread 0x018dec thru 0x01b2b9 (0x24ce bytes) 000058 1787847414.570746 read 0x021421 thru 0x027f2f (0x6b0f bytes) 000059 1787847414.601303 mapread 0x004b0c thru 0x00feb0 (0xb3a5 bytes) truncating to largest ever: 0x33d7f 000060 1787847414.628655 trunc from 0x03686e to 0x033d7e (0x2aef bytes) 000061 1787847414.674996 mapread 0x0218d7 thru 0x021eca (0x5f4 bytes) 000062 1787847414.679495 read 0x017744 thru 0x020583 (0x8e40 bytes) 000063 1787847414.683343 read 0x0038d9 thru 0x00a219 (0x6941 bytes) 000064 1787847414.699750 MIRROR_RESYNC 2 mirrors 000065 1787847416.218776 write 0x006419 thru 0x00e602 (0x81ea bytes) 000066 1787847416.395821 read 0x0191c8 thru 0x022770 (0x95a9 bytes) 000067 1787847416.432785 read 0x006b38 thru 0x00ddda (0x72a3 bytes) 000069 1787847416.436357 read 0x032c69 thru 0x033d7e (0x1116 bytes) 000072 1787847416.488056 mapread 0x01e767 thru 0x01eb76 (0x410 bytes) 000073 1787847416.489416 mapwrite 0x030eb1 thru 0x031878 (0x9c8 bytes) 000074 1787847416.620850 mapwrite 0x00a270 thru 0x013200 (0x8f91 bytes) 000075 1787847416.753704 trunc from 0x033d7f to 0x00228f (0x31aef bytes) 000076 1787847416.792311 trunc from 0x002290 to 0x002982 (0x6f3 bytes) 000077 1787847416.843041 mapwrite 0x02c655 thru 0x033c35 (0x75e1 bytes) 000079 1787847417.305979 mapwrite 0x00cfd1 thru 0x018725 (0xb755 bytes) 000080 1787847417.718766 mapwrite 0x0292da thru 0x0331f9 (0x9f20 bytes) 000082 1787847417.974623 read 0x02d564 thru 0x033c35 (0x66d2 bytes) 000085 1787847417.994605 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33c36): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c36): Mirror 2: 0xaa2af973 (stale) CRC-32 checksum value for chunk [0, 0x33c36): Mirror 1: 0xb12bbb5e Mirror 3: 0xb12bbb5e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c36: skipped 000086 1787847420.055234 read 0x003232 thru 0x011fed (0xedbc bytes) 000089 1787847420.089629 MIRROR_RESYNC 3 mirrors 000091 1787847421.750252 mapwrite 0x015909 thru 0x0210b2 (0xb7aa bytes) 000094 1787847422.317878 mapwrite 0x004d3e thru 0x0139dd (0xeca0 bytes) 000095 1787847422.525466 mapread 0x010d2c thru 0x012b29 (0x1dfe bytes) 000097 1787847422.526909 read 0x01c973 thru 0x0277dd (0xae6b bytes) 000099 1787847422.532148 read 0x024f7d thru 0x02657f (0x1603 bytes) 000100 1787847422.549514 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33c36): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c36): Mirror 2: 0xb12bbb5e (stale) Mirror 3: 0xb12bbb5e (stale) CRC-32 checksum value for chunk [0, 0x33c36): Mirror 1: 0x7579b150 Mirror 4: 0x7579b150 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c36: skipped 000104 1787847424.586167 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33c36): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c36): Mirror 2: 0xb12bbb5e (stale) Mirror 3: 0xb12bbb5e (stale) CRC-32 checksum value for chunk [0, 0x33c36): Mirror 1: 0x7579b150 Mirror 4: 0x7579b150 Mirror 5: 0x7579b150 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c36: skipped 000105 1787847427.175005 write 0x01c159 thru 0x01e00d (0x1eb5 bytes) 000106 1787847427.351419 mapwrite 0x02314a thru 0x025c68 (0x2b1f bytes) 000109 1787847427.505982 mapwrite 0x01b895 thru 0x0207db (0x4f47 bytes) 000113 1787847427.696856 mapread 0x02345f thru 0x026ef3 (0x3a95 bytes) 000114 1787847427.704516 write 0x0290d0 thru 0x033edc (0xae0d bytes) 000115 1787847427.721783 mapread 0x033ad8 thru 0x033edc (0x405 bytes) 000116 1787847427.728696 read 0x002149 thru 0x00ca16 (0xa8ce bytes) 000117 1787847427.759803 read 0x02b11f thru 0x032926 (0x7808 bytes) truncating to largest ever: 0x36c65 000118 1787847427.760383 trunc from 0x033edd to 0x036c64 (0x2d88 bytes) 000120 1787847427.828895 mapwrite 0x01ba3f thru 0x02980a (0xddcc bytes) 000123 1787847427.875501 mapread 0x01c017 thru 0x01d07e (0x1068 bytes) 000124 1787847427.876475 write 0x003db3 thru 0x00b9bd (0x7c0b bytes) 000126 1787847427.878403 mapread 0x02fd81 thru 0x036c64 (0x6ee4 bytes) 000127 1787847427.897949 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36c65): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36c65): Mirror 2: 0x26c06f3a (stale) Mirror 3: 0x26c06f3a (stale) Mirror 4: 0xd4cb3355 (stale) Mirror 5: 0xd4cb3355 (stale) CRC-32 checksum value for chunk [0, 0x36c65): Mirror 1: 0xd86ae9b5 Mirror 6: 0xd86ae9b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36c65: skipped 000130 1787847429.904206 mapwrite 0x00c9b0 thru 0x014e78 (0x84c9 bytes) 000131 1787847430.201978 trunc from 0x036c65 to 0x021f22 (0x14d42 bytes) 000133 1787847430.254432 write 0x02528a thru 0x02795b (0x26d2 bytes) 000134 1787847430.258622 mapwrite 0x0056d7 thru 0x0135ea (0xdf14 bytes) 000135 1787847430.423122 mapread 0x003b6a thru 0x00bb50 (0x7fe7 bytes) 000138 1787847430.434918 mapread 0x007560 thru 0x00d278 (0x5d19 bytes) 000142 1787847430.445622 trunc from 0x02795c to 0x0104a9 (0x174b2 bytes) 000143 1787847430.484929 read 0x003247 thru 0x00a660 (0x741a bytes) 000144 1787847430.489495 write 0x005218 thru 0x006549 (0x1332 bytes) 000145 1787847430.495326 trunc from 0x0104aa to 0x03434b (0x23ea2 bytes) 000146 1787847430.547589 mapread 0x0327f3 thru 0x03434b (0x1b59 bytes) 000148 1787847430.570444 read 0x013177 thru 0x01471a (0x15a4 bytes) truncating to largest ever: 0x3fa46 000149 1787847430.585510 trunc from 0x03434c to 0x03fa45 (0xb6fa bytes) 000151 1787847430.613687 read 0x03a801 thru 0x03fa45 (0x5245 bytes) 000153 1787847430.646292 mapwrite 0x03921b thru 0x03b91b (0x2701 bytes) 000154 1787847430.744050 mapread 0x02db2e thru 0x03606a (0x853d bytes) 000157 1787847430.759001 MIRROR_RESYNC 6 mirrors 000158 1787847433.325406 read 0x0229a7 thru 0x02ab1c (0x8176 bytes) 000159 1787847433.333526 mapwrite 0x01b580 thru 0x027a99 (0xc51a bytes) 000161 1787847433.516699 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fa46): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa46): Mirror 2: 0x6a853a76 (stale) Mirror 3: 0x6a853a76 (stale) Mirror 4: 0x6a853a76 (stale) Mirror 5: 0x6a853a76 (stale) Mirror 6: 0x6a853a76 (stale) CRC-32 checksum value for chunk [0, 0x3fa46): Mirror 1: 0x3dac75b8 Mirror 7: 0x3dac75b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa46: skipped 000166 1787847435.172042 read 0x01eb9f thru 0x02572e (0x6b90 bytes) 000168 1787847435.191418 mapread 0x003eed thru 0x006803 (0x2917 bytes) 000169 1787847435.232515 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa46): Mirror 3: 0x6a853a76 (stale) Mirror 4: 0x6a853a76 (stale) Mirror 5: 0x6a853a76 (stale) Mirror 6: 0x6a853a76 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa46): Mirror 3: 0x6a853a76 (stale) Mirror 4: 0x6a853a76 (stale) Mirror 5: 0x6a853a76 (stale) Mirror 6: 0x6a853a76 (stale) CRC-32 checksum value for chunk [0, 0x3fa46): Mirror 1: 0x3dac75b8 Mirror 7: 0x3dac75b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa46: skipped 000171 1787847436.542801 write 0x024c36 thru 0x02dc53 (0x901e bytes) 000174 1787847436.794676 write 0x0074d0 thru 0x0168ab (0xf3dc bytes) 000175 1787847436.815281 trunc from 0x03fa46 to 0x008373 (0x376d2 bytes) 000176 1787847436.852533 mapread 0x007bf9 thru 0x008373 (0x77b bytes) 000177 1787847436.877225 write 0x013713 thru 0x01c4f7 (0x8de5 bytes) 000180 1787847436.883597 write 0x032de6 thru 0x03ffff (0xd21a bytes) 000181 1787847436.891722 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3838eaf3 (stale) Mirror 4: 0x3838eaf3 (stale) Mirror 6: 0x3838eaf3 (stale) Mirror 7: 0xf786c1f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3838eaf3 (stale) Mirror 4: 0x3838eaf3 (stale) Mirror 6: 0x3838eaf3 (stale) Mirror 7: 0xf786c1f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000185 1787847437.578632 MIRROR_RESYNC 5 mirrors 000186 1787847440.036650 trunc from 0x040000 to 0x027313 (0x18cec bytes) 000187 1787847440.105272 MIRROR_RESYNC 5 mirrors 000188 1787847442.282193 trunc from 0x027314 to 0x022a63 (0x48b0 bytes) 000191 1787847442.372005 mapwrite 0x0018d9 thru 0x00583e (0x3f66 bytes) 000192 1787847442.428867 write 0x03abb1 thru 0x03f888 (0x4cd8 bytes) 000193 1787847442.430508 read 0x001abb thru 0x00f203 (0xd749 bytes) 000195 1787847442.435381 write 0x00b294 thru 0x011106 (0x5e73 bytes) 000196 1787847442.444912 mapwrite 0x018c23 thru 0x01bbcc (0x2faa bytes) 000200 1787847442.560089 mapwrite 0x00da84 thru 0x01a3c6 (0xc943 bytes) 000202 1787847442.643156 read 0x03cffe thru 0x03f888 (0x288b bytes) 000203 1787847442.650230 MIRROR_RESYNC 5 mirrors 000204 1787847444.444796 read 0x00b1df thru 0x00b302 (0x124 bytes) 000206 1787847444.461066 mapread 0x02dbbf thru 0x03db8a (0xffcc bytes) 000207 1787847444.504715 MIRROR_EXTEND to 6 mirrors 000208 1787847445.921622 write 0x03f464 thru 0x03ffff (0xb9c bytes) 000209 1787847446.078983 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1409bca1 (stale) Mirror 4: 0x1409bca1 (stale) Mirror 7: 0x1409bca1 (stale) Mirror 8: 0x1409bca1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1409bca1 (stale) Mirror 4: 0x1409bca1 (stale) Mirror 7: 0x1409bca1 (stale) Mirror 8: 0x1409bca1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000211 1787847446.725221 trunc from 0x040000 to 0x00cc72 (0x3338d bytes) 000219 1787847446.773940 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcc73): Mirror 4: 0xa0bdf33c (stale) Mirror 7: 0xa0bdf33c (stale) Mirror 8: 0xa0bdf33c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcc73): Mirror 4: 0xa0bdf33c (stale) Mirror 7: 0xa0bdf33c (stale) Mirror 8: 0xa0bdf33c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcc73: skipped 000220 1787847447.277117 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xcc73): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcc73): Mirror 4: 0xa0bdf33c (stale) Mirror 7: 0xa0bdf33c (stale) Mirror 8: 0xa0bdf33c (stale) CRC-32 checksum value for chunk [0, 0xcc73): Mirror 1: 0xa0bdf33c Mirror 9: 0xa0bdf33c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcc73: skipped 000223 1787847448.591646 trunc from 0x00cc73 to 0x02f204 (0x22592 bytes) 000226 1787847448.752013 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f205): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f205): Mirror 4: 0x17e2f360 (stale) Mirror 7: 0x17e2f360 (stale) Mirror 8: 0x17e2f360 (stale) Mirror 9: 0x72d305a7 (stale) CRC-32 checksum value for chunk [0, 0x2f205): Mirror 1: 0x72d305a7 Mirror 10: 0x72d305a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f205: skipped 000230 1787847450.486185 trunc from 0x02f205 to 0x010fa4 (0x1e260 bytes) 000231 1787847450.621486 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10fa5): Mirror 4: 0xcd53170f (stale) Mirror 7: 0xcd53170f (stale) Mirror 8: 0xcd53170f (stale) Mirror 10: 0xe3efd796 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10fa5): Mirror 4: 0xcd53170f (stale) Mirror 7: 0xcd53170f (stale) Mirror 8: 0xcd53170f (stale) Mirror 10: 0xe3efd796 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10fa5: skipped 000233 1787847451.002180 read 0x0093e9 thru 0x00e700 (0x5318 bytes) 000234 1787847451.013545 read 0x00002f thru 0x00b54a (0xb51c bytes) 000235 1787847451.034211 mapread 0x00f093 thru 0x010fa4 (0x1f12 bytes) 000237 1787847451.040658 write 0x000fa4 thru 0x00fdb9 (0xee16 bytes) 000241 1787847451.045301 read 0x0009e9 thru 0x00edb7 (0xe3cf bytes) 000242 1787847451.046451 trunc from 0x010fa5 to 0x003676 (0xd92e bytes) 000243 1787847451.061549 trunc from 0x003677 to 0x015f6c (0x128f6 bytes) 000244 1787847451.075193 mapwrite 0x0056e9 thru 0x014fbc (0xf8d4 bytes) 000246 1787847451.136868 mapread 0x005111 thru 0x00f058 (0x9f48 bytes) 000247 1787847451.137839 read 0x009362 thru 0x00da1e (0x46bd bytes) 000248 1787847451.142785 MIRROR_RESYNC 5 mirrors 000249 1787847452.470224 read 0x00b51f thru 0x014c45 (0x9727 bytes) 000250 1787847452.479290 read 0x008c9c thru 0x015331 (0xc696 bytes) 000251 1787847452.485844 trunc from 0x015f6d to 0x032e3c (0x1ced0 bytes) 000253 1787847452.533873 mapwrite 0x009383 thru 0x00c237 (0x2eb5 bytes) 000256 1787847452.620632 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32e3d): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32e3d): Mirror 4: 0x986c23db (stale) Mirror 7: 0x986c23db (stale) Mirror 8: 0x986c23db (stale) Mirror 10: 0x986c23db (stale) CRC-32 checksum value for chunk [0, 0x32e3d): Mirror 1: 0x5be654c3 Mirror 11: 0x5be654c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32e3d: skipped 000260 1787847453.683164 write 0x017883 thru 0x02495a (0xd0d8 bytes) 000261 1787847453.835617 read 0x0273f4 thru 0x032e3c (0xba49 bytes) 000263 1787847453.857683 mapwrite 0x01feac thru 0x021bee (0x1d43 bytes) 000265 1787847453.953038 trunc from 0x032e3d to 0x01f2d1 (0x13b6b bytes) 000269 1787847453.976378 write 0x03d6bf thru 0x03ffff (0x2941 bytes) 000272 1787847453.979155 read 0x00252f thru 0x00ef07 (0xc9d9 bytes) 000278 1787847454.003067 read 0x030757 thru 0x0363ea (0x5c94 bytes) 000280 1787847454.018784 MIRROR_RESYNC 6 mirrors 000281 1787847456.089609 mapwrite 0x01b639 thru 0x01bb13 (0x4db bytes) 000282 1787847456.337049 write 0x038c28 thru 0x03d4a4 (0x487d bytes) 000283 1787847456.363322 mapwrite 0x0065f4 thru 0x0164af (0xfebc bytes) 000284 1787847456.477223 mapwrite 0x01b70a thru 0x024986 (0x927d bytes) 000285 1787847456.574903 read 0x02910a thru 0x0362bb (0xd1b2 bytes) 000286 1787847456.601028 trunc from 0x040000 to 0x003d5c (0x3c2a3 bytes) 000287 1787847456.642080 mapread 0x00298b thru 0x003d5c (0x13d2 bytes) 000289 1787847456.645442 mapwrite 0x026a1f thru 0x03508f (0xe671 bytes) 000290 1787847456.751307 trunc from 0x035090 to 0x00873d (0x2c952 bytes) 000291 1787847456.782435 trunc from 0x00873e to 0x02b564 (0x22e27 bytes) 000292 1787847456.801016 read 0x010b9d thru 0x019553 (0x89b7 bytes) 000293 1787847456.818178 read 0x012b0c thru 0x013c41 (0x1136 bytes) 000294 1787847456.818950 read 0x00644a thru 0x00936d (0x2f24 bytes) 000296 1787847456.829159 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b565): Mirror 7: 0x44209d5a (stale) Mirror 8: 0x44209d5a (stale) Mirror 10: 0x44209d5a (stale) Mirror 11: 0x44209d5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b565): Mirror 7: 0x44209d5a (stale) Mirror 8: 0x44209d5a (stale) Mirror 10: 0x44209d5a (stale) Mirror 11: 0x44209d5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b565: skipped 000297 1787847457.368787 read 0x010477 thru 0x01ea1c (0xe5a6 bytes) 000298 1787847457.388692 read 0x00ef8b thru 0x017b71 (0x8be7 bytes) 000299 1787847457.430274 mapread 0x027bb9 thru 0x028b0a (0xf52 bytes) 000300 1787847457.431271 trunc from 0x02b565 to 0x0390d8 (0xdb74 bytes) 000305 1787847457.455136 mapread 0x0202b4 thru 0x020c9d (0x9ea bytes) 000306 1787847457.457946 mapwrite 0x013c41 thru 0x01bbc5 (0x7f85 bytes) 000307 1787847457.523425 trunc from 0x0390d9 to 0x01215a (0x26f7e bytes) 000308 1787847457.558511 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1215b): Mirror 7: 0xfe658004 (stale) Mirror 8: 0xfe658004 (stale) Mirror 10: 0xfe658004 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1215b): Mirror 7: 0xfe658004 (stale) Mirror 8: 0xfe658004 (stale) Mirror 10: 0xfe658004 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1215b: skipped 000309 1787847458.000418 write 0x024627 thru 0x02b855 (0x722f bytes) 000311 1787847458.002342 trunc from 0x02b856 to 0x034689 (0x8e34 bytes) 000312 1787847458.032452 mapread 0x023857 thru 0x02d669 (0x9e13 bytes) 000313 1787847458.067995 read 0x012303 thru 0x015817 (0x3515 bytes) 000314 1787847458.078492 mapread 0x00655b thru 0x00898a (0x2430 bytes) 000315 1787847458.097364 mapwrite 0x000ecd thru 0x009fde (0x9112 bytes) 000316 1787847458.187647 mapread 0x004b5e thru 0x004c43 (0xe6 bytes) 000319 1787847458.189513 mapread 0x02d221 thru 0x034689 (0x7469 bytes) 000320 1787847458.202326 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3468a): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3468a): Mirror 7: 0xd5cb4219 (stale) Mirror 8: 0xd5cb4219 (stale) Mirror 10: 0xd5cb4219 (stale) CRC-32 checksum value for chunk [0, 0x3468a): Mirror 1: 0x8184d772 Mirror 11: 0x8184d772 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3468a: skipped 000321 1787847460.054304 trunc from 0x03468a to 0x0206d7 (0x13fb2 bytes) 000322 1787847460.209116 read 0x00b89a thru 0x0122da (0x6a41 bytes) 000323 1787847460.221030 mapwrite 0x017e22 thru 0x0247fb (0xc9da bytes) 000326 1787847460.322852 MIRROR_RESYNC 5 mirrors 000327 1787847462.169985 mapread 0x01941a thru 0x0246d0 (0xb2b7 bytes) 000328 1787847462.213313 trunc from 0x0247fc to 0x0345f1 (0xfdf6 bytes) 000335 1787847462.390159 mapwrite 0x036c8e thru 0x0370e3 (0x456 bytes) 000336 1787847462.556076 mapwrite 0x0086ea thru 0x016a87 (0xe39e bytes) 000339 1787847462.670218 mapread 0x027bfe thru 0x02d4c4 (0x58c7 bytes) 000341 1787847462.679222 write 0x001cb6 thru 0x00278f (0xada bytes) 000344 1787847462.685355 MIRROR_RESYNC 5 mirrors 000345 1787847464.440671 mapread 0x0258ae thru 0x032ee5 (0xd638 bytes) 000346 1787847464.487358 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000348 1787847465.046234 read 0x007967 thru 0x01601c (0xe6b6 bytes) 000351 1787847465.069114 trunc from 0x0370e4 to 0x009af1 (0x2d5f2 bytes) 000355 1787847465.223625 mapwrite 0x0373a8 thru 0x03ffff (0x8c58 bytes) 000357 1787847465.343598 write 0x013b1a thru 0x01a144 (0x662b bytes) 000358 1787847465.355047 read 0x038523 thru 0x03d638 (0x5116 bytes) 000361 1787847465.357012 mapread 0x03f9f0 thru 0x03ffff (0x610 bytes) 000362 1787847465.361809 trunc from 0x040000 to 0x02be09 (0x141f6 bytes) 000363 1787847465.405274 mapread 0x0017cd thru 0x00624d (0x4a81 bytes) 000366 1787847465.427944 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2be0a): Mirror 10: 0x7d12db2e (stale) Mirror 11: 0x7d12db2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2be0a): Mirror 10: 0x7d12db2e (stale) Mirror 11: 0x7d12db2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2be0a: skipped 000367 1787847465.787150 trunc from 0x02be0a to 0x0105b8 (0x1b851 bytes) 000369 1787847465.839391 mapread 0x00086c thru 0x003030 (0x27c5 bytes) 000371 1787847465.911536 trunc from 0x0105b9 to 0x0029e4 (0xdbd4 bytes) 000372 1787847465.966383 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29e5): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29e5): Mirror 10: 0x3e7ff7a3 (stale) Mirror 11: 0x3e7ff7a3 (stale) CRC-32 checksum value for chunk [0, 0x29e5): Mirror 1: 0x3e7ff7a3 Mirror 12: 0x3e7ff7a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29e5: skipped 000373 1787847467.057358 read 0x000bca thru 0x001f94 (0x13cb bytes) 000374 1787847467.065442 trunc from 0x0029e5 to 0x007b7f (0x519b bytes) 000375 1787847467.152103 write 0x01bb4f thru 0x02a092 (0xe544 bytes) 000377 1787847467.156072 mapwrite 0x020340 thru 0x030206 (0xfec7 bytes) 000378 1787847467.261146 trunc from 0x030207 to 0x013fcb (0x1c23b bytes) 000380 1787847467.280455 trunc from 0x013fcc to 0x01fc13 (0xbc48 bytes) 000381 1787847467.300950 mapread 0x01005c thru 0x01f353 (0xf2f8 bytes) 000383 1787847467.342660 read 0x00b5fd thru 0x012a4f (0x7453 bytes) 000385 1787847467.343815 mapread 0x018846 thru 0x018e51 (0x60c bytes) 000386 1787847467.349479 mapread 0x012cb8 thru 0x01fc13 (0xcf5c bytes) 000387 1787847467.357283 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1fc14): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fc14): Mirror 10: 0x85c4d02d (stale) Mirror 11: 0x85c4d02d (stale) Mirror 12: 0xd023d38 (stale) CRC-32 checksum value for chunk [0, 0x1fc14): Mirror 1: 0xd023d38 Mirror 13: 0xd023d38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fc14: skipped 000388 1787847468.931943 trunc from 0x01fc14 to 0x00cab7 (0x1315c bytes) 000394 1787847469.127989 write 0x00e00e thru 0x013f26 (0x5f19 bytes) 000396 1787847469.133201 mapwrite 0x005545 thru 0x014e66 (0xf922 bytes) 000398 1787847469.321749 mapwrite 0x0254d5 thru 0x027216 (0x1d42 bytes) 000399 1787847469.482171 mapread 0x00efe0 thru 0x015b0d (0x6b2e bytes) 000400 1787847469.516874 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27217): Mirror 10: 0xbd7d1fa8 (stale) Mirror 12: 0xfe04a123 (stale) Mirror 13: 0xfe04a123 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27217): Mirror 10: 0xbd7d1fa8 (stale) Mirror 12: 0xfe04a123 (stale) Mirror 13: 0xfe04a123 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27217: skipped 000401 1787847470.002456 mapwrite 0x0207e3 thru 0x0248d0 (0x40ee bytes) 000403 1787847470.114200 read 0x00ada5 thru 0x01312b (0x8387 bytes) 000406 1787847470.129935 mapwrite 0x02379a thru 0x027c42 (0x44a9 bytes) 000408 1787847470.199110 mapread 0x0049b3 thru 0x00d5a5 (0x8bf3 bytes) 000409 1787847470.210133 mapread 0x010bbb thru 0x0146b0 (0x3af6 bytes) 000412 1787847470.221964 read 0x018487 thru 0x0233c0 (0xaf3a bytes) 000414 1787847470.231309 MIRROR_RESYNC 4 mirrors 000415 1787847471.653212 write 0x038f7c thru 0x03dc59 (0x4cde bytes) 000416 1787847471.732397 trunc from 0x03dc5a to 0x014e9e (0x28dbb bytes) 000417 1787847471.758902 mapread 0x0011c4 thru 0x004fd6 (0x3e13 bytes) 000420 1787847471.784808 mapread 0x009931 thru 0x014e9e (0xb56e bytes) 000421 1787847471.792616 write 0x0298da thru 0x03078e (0x6eb5 bytes) 000422 1787847471.794436 read 0x01da41 thru 0x023064 (0x5624 bytes) 000424 1787847471.803188 write 0x01c4fc thru 0x0242f5 (0x7dfa bytes) 000426 1787847471.814927 read 0x025c04 thru 0x03078e (0xab8b bytes) 000427 1787847471.829149 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3078f): Mirror 10: 0x74f319f (stale) Mirror 12: 0x74f319f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3078f): Mirror 10: 0x74f319f (stale) Mirror 12: 0x74f319f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3078f: skipped 000428 1787847472.187287 write 0x03e043 thru 0x03ffff (0x1fbd bytes) 000429 1787847472.189111 trunc from 0x040000 to 0x03eff0 (0x100f bytes) 000430 1787847472.214326 mapread 0x0184fd thru 0x01d57f (0x5083 bytes) 000433 1787847472.235911 trunc from 0x03eff1 to 0x03cc35 (0x23bb bytes) 000434 1787847472.261254 trunc from 0x03cc36 to 0x02728f (0x159a6 bytes) 000439 1787847472.291911 write 0x03a07b thru 0x03a29d (0x223 bytes) 000441 1787847472.295112 mapread 0x01eb94 thru 0x01eeaf (0x31c bytes) 000443 1787847472.296905 trunc from 0x03a29e to 0x029fe3 (0x102ba bytes) 000444 1787847472.320113 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29fe4): Mirror 10: 0x7a694eae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29fe4): Mirror 10: 0x7a694eae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29fe4: skipped 000445 1787847472.844732 mapwrite 0x035f0a thru 0x03d04e (0x7145 bytes) 000446 1787847473.042404 MIRROR_RESYNC 2 mirrors 000447 1787847474.206779 trunc from 0x03d04f to 0x009c26 (0x33428 bytes) 000448 1787847474.297174 read 0x004126 thru 0x008ce6 (0x4bc1 bytes) 000449 1787847474.310233 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000452 1787847474.486311 MIRROR_EXTEND to 2 mirrors 000453 1787847475.407422 read 0x0036be thru 0x008fa2 (0x58e5 bytes) 000456 1787847475.423170 write 0x006489 thru 0x00f003 (0x8b7b bytes) 000459 1787847475.600822 MIRROR_RESYNC 2 mirrors 000460 1787847476.315145 read 0x0083a9 thru 0x00f003 (0x6c5b bytes) 000461 1787847476.330108 trunc from 0x00f004 to 0x02dabe (0x1eabb bytes) 000462 1787847476.404838 mapread 0x01da7c thru 0x02c825 (0xedaa bytes) 000463 1787847476.430387 write 0x031ad5 thru 0x03f1e4 (0xd710 bytes) 000464 1787847476.434913 mapwrite 0x012db0 thru 0x013a3e (0xc8f bytes) 000465 1787847476.489917 write 0x03794b thru 0x039364 (0x1a1a bytes) 000466 1787847476.495407 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000467 1787847476.657710 write 0x006b6e thru 0x0161fb (0xf68e bytes) 000470 1787847476.674985 trunc from 0x03f1e5 to 0x00d3e7 (0x31dfd bytes) 000471 1787847476.696351 mapwrite 0x0027aa thru 0x0064d2 (0x3d29 bytes) 000472 1787847476.757089 MIRROR_EXTEND to 2 mirrors 000473 1787847477.607836 mapread 0x00af6c thru 0x00d3e7 (0x247c bytes) 000474 1787847477.655056 mapread 0x001ae5 thru 0x00d3e7 (0xb903 bytes) 000476 1787847477.668126 mapread 0x003b46 thru 0x0066b4 (0x2b6f bytes) 000477 1787847477.672074 mapread 0x006eba thru 0x00ccf6 (0x5e3d bytes) 000478 1787847477.676786 trunc from 0x00d3e8 to 0x001600 (0xbde7 bytes) 000481 1787847477.868358 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1601): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1601): Mirror 2: 0xff8df25c (stale) CRC-32 checksum value for chunk [0, 0x1601): Mirror 1: 0xff8df25c Mirror 3: 0xff8df25c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1601: skipped 000482 1787847479.135005 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1601): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1601): Mirror 2: 0xff8df25c (stale) CRC-32 checksum value for chunk [0, 0x1601): Mirror 1: 0xff8df25c Mirror 3: 0xff8df25c Mirror 4: 0xff8df25c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1601: skipped 000485 1787847480.403265 read 0x000240 thru 0x001600 (0x13c1 bytes) 000486 1787847480.427281 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1601): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1601): Mirror 2: 0xff8df25c (stale) CRC-32 checksum value for chunk [0, 0x1601): Mirror 1: 0xff8df25c Mirror 3: 0xff8df25c Mirror 4: 0xff8df25c Mirror 5: 0xff8df25c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1601: skipped 000487 1787847481.341159 write 0x015ee5 thru 0x0180cb (0x21e7 bytes) 000492 1787847481.582683 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x180cc): Mirror 2: 0x680f0d42 (stale) Mirror 4: 0x7b2a49d8 (stale) Mirror 5: 0x7b2a49d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x180cc): Mirror 2: 0x680f0d42 (stale) Mirror 4: 0x7b2a49d8 (stale) Mirror 5: 0x7b2a49d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x180cc: skipped 000493 1787847482.031938 trunc from 0x0180cc to 0x029d66 (0x11c9b bytes) 000497 1787847482.052047 trunc from 0x029d67 to 0x02a699 (0x933 bytes) 000500 1787847482.083710 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2a69a): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a69a): Mirror 2: 0x302220ab (stale) Mirror 4: 0x5ec97fd8 (stale) Mirror 5: 0x5ec97fd8 (stale) CRC-32 checksum value for chunk [0, 0x2a69a): Mirror 1: 0x44e66b84 Mirror 6: 0x44e66b84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a69a: skipped 000501 1787847483.909163 trunc from 0x02a69a to 0x0285ae (0x20eb bytes) 000503 1787847484.013072 mapwrite 0x001498 thru 0x002308 (0xe71 bytes) 000504 1787847484.083943 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x285af): Mirror 4: 0x979e749d (stale) Mirror 5: 0x979e749d (stale) Mirror 6: 0x15d21852 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x285af): Mirror 4: 0x979e749d (stale) Mirror 5: 0x979e749d (stale) Mirror 6: 0x15d21852 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x285af: skipped 000505 1787847484.641032 mapread 0x00c944 thru 0x011528 (0x4be5 bytes) 000507 1787847484.670195 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x285af): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x285af): Mirror 4: 0x979e749d (stale) Mirror 5: 0x979e749d (stale) Mirror 6: 0x15d21852 (stale) CRC-32 checksum value for chunk [0, 0x285af): Mirror 1: 0xae46cc2d Mirror 7: 0xae46cc2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x285af: skipped 000508 1787847485.970928 trunc from 0x0285af to 0x02624e (0x2360 bytes) 000509 1787847486.088102 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2624f): Mirror 4: 0xed692336 (stale) Mirror 5: 0xed692336 (stale) Mirror 7: 0xa09923ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2624f): Mirror 4: 0xed692336 (stale) Mirror 5: 0xed692336 (stale) Mirror 7: 0xa09923ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2624f: skipped 000511 1787847486.447643 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2624f): Mirror 5: 0xed692336 (stale) Mirror 7: 0xa09923ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2624f): Mirror 5: 0xed692336 (stale) Mirror 7: 0xa09923ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2624f: skipped 000512 1787847486.837116 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2624f): Mirror 5: 0xed692336 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2624f): Mirror 5: 0xed692336 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2624f: skipped 000513 1787847487.137238 read 0x025526 thru 0x02624e (0xd29 bytes) 000515 1787847487.145208 write 0x009a0b thru 0x0156d6 (0xbccc bytes) 000516 1787847487.158812 write 0x007462 thru 0x00e609 (0x71a8 bytes) 000519 1787847487.172213 trunc from 0x02624f to 0x007d51 (0x1e4fd bytes) 000520 1787847487.189092 write 0x03938f thru 0x03d402 (0x4074 bytes) 000521 1787847487.191673 trunc from 0x03d403 to 0x021a74 (0x1b98e bytes) 000523 1787847487.218124 mapread 0x003bcd thru 0x004dbd (0x11f1 bytes) 000527 1787847487.256202 MIRROR_RESYNC 2 mirrors 000528 1787847488.024604 mapread 0x018ff1 thru 0x021a74 (0x8a84 bytes) 000530 1787847488.069323 write 0x02557b thru 0x029026 (0x3aac bytes) 000532 1787847488.196197 mapread 0x008c0f thru 0x00dd05 (0x50f7 bytes) 000534 1787847488.217970 read 0x01b466 thru 0x021314 (0x5eaf bytes) 000535 1787847488.228212 write 0x03cee8 thru 0x03ffff (0x3118 bytes) 000536 1787847488.231961 read 0x0368a4 thru 0x03ffff (0x975c bytes) 000539 1787847488.244677 write 0x03b9b5 thru 0x03ffff (0x464b bytes) 000542 1787847488.254124 read 0x0138c7 thru 0x022398 (0xead2 bytes) 000544 1787847488.263656 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x454ad400 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbe345c52 Mirror 6: 0xbe345c52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000548 1787847489.742844 read 0x00a256 thru 0x015899 (0xb644 bytes) 000550 1787847489.757092 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000552 1787847490.137497 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000554 1787847490.327890 write 0x028c53 thru 0x0374d0 (0xe87e bytes) 000555 1787847490.388030 read 0x02167e thru 0x0233b2 (0x1d35 bytes) 000556 1787847490.400484 MIRROR_EXTEND to 2 mirrors 000557 1787847491.465202 trunc from 0x040000 to 0x037b83 (0x847c bytes) 000558 1787847491.578697 write 0x032a94 thru 0x03a7f5 (0x7d62 bytes) 000559 1787847491.587161 write 0x031b2d thru 0x03341a (0x18ee bytes) 000560 1787847491.599995 MIRROR_RESYNC 2 mirrors 000561 1787847492.652809 write 0x03a377 thru 0x03ffff (0x5c89 bytes) 000562 1787847492.804794 mapwrite 0x03ba2f thru 0x03df20 (0x24f2 bytes) 000563 1787847492.873076 mapread 0x03dead thru 0x03ffff (0x2153 bytes) 000564 1787847492.875474 read 0x01385d thru 0x01a9c4 (0x7168 bytes) 000565 1787847492.919039 MIRROR_RESYNC 2 mirrors 000566 1787847494.070116 MIRROR_EXTEND to 3 mirrors 000567 1787847495.442054 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000570 1787847495.772262 read 0x01dfb2 thru 0x01e79e (0x7ed bytes) 000572 1787847495.779624 trunc from 0x040000 to 0x00d868 (0x32797 bytes) 000578 1787847495.972511 trunc from 0x00d869 to 0x029621 (0x1bdb9 bytes) 000580 1787847496.008132 mapwrite 0x02a703 thru 0x02c5dd (0x1edb bytes) 000581 1787847496.105438 read 0x022111 thru 0x02c53b (0xa42b bytes) 000582 1787847496.123136 mapwrite 0x029f28 thru 0x02f4ce (0x55a7 bytes) 000584 1787847496.226017 read 0x022008 thru 0x022c29 (0xc22 bytes) 000585 1787847496.227102 read 0x005489 thru 0x00e286 (0x8dfe bytes) 000588 1787847496.232367 read 0x008387 thru 0x00ffd3 (0x7c4d bytes) 000589 1787847496.233917 trunc from 0x02f4cf to 0x020149 (0xf385 bytes) 000591 1787847496.253946 read 0x0017a8 thru 0x001896 (0xef bytes) 000592 1787847496.255163 write 0x0245be thru 0x02d69e (0x90e1 bytes) 000593 1787847496.257918 read 0x021999 thru 0x02d69e (0xbd06 bytes) 000595 1787847496.268693 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d69f): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d69f): Mirror 3: 0x98956653 (stale) CRC-32 checksum value for chunk [0, 0x2d69f): Mirror 1: 0x89b2b90e Mirror 4: 0x89b2b90e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d69f: skipped 000597 1787847497.387804 mapwrite 0x0164a4 thru 0x020e03 (0xa960 bytes) 000600 1787847497.596470 trunc from 0x02d69f to 0x010d94 (0x1c90a bytes) 000601 1787847497.656363 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x10d95): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10d95): Mirror 3: 0xa9e087f8 (stale) Mirror 4: 0xa9e087f8 (stale) CRC-32 checksum value for chunk [0, 0x10d95): Mirror 1: 0xa9e087f8 Mirror 5: 0xa9e087f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10d95: skipped 000603 1787847498.686657 read 0x00653b thru 0x009e12 (0x38d8 bytes) 000605 1787847498.713396 mapread 0x0029a2 thru 0x00f8c7 (0xcf26 bytes) 000606 1787847498.741089 read 0x00b0fa thru 0x010d94 (0x5c9b bytes) 000607 1787847498.741802 mapwrite 0x0264be thru 0x034427 (0xdf6a bytes) 000608 1787847498.938048 mapwrite 0x0223d7 thru 0x028864 (0x648e bytes) 000609 1787847499.066092 trunc from 0x034428 to 0x00c850 (0x27bd7 bytes) 000610 1787847499.127183 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc851): Mirror 4: 0x8a88cba7 (stale) Mirror 5: 0x8a88cba7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc851): Mirror 4: 0x8a88cba7 (stale) Mirror 5: 0x8a88cba7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc851: skipped 000611 1787847499.515122 read 0x005c71 thru 0x00c850 (0x6be0 bytes) 000613 1787847499.528351 mapread 0x00839f thru 0x00a2a2 (0x1f04 bytes) 000614 1787847499.530317 trunc from 0x00c851 to 0x03432c (0x27adc bytes) 000615 1787847499.557094 write 0x03cb26 thru 0x03ffff (0x34da bytes) 000616 1787847499.559914 write 0x02e9eb thru 0x037df6 (0x940c bytes) 000618 1787847499.572997 read 0x01c61b thru 0x01d0a0 (0xa86 bytes) 000619 1787847499.589524 MIRROR_RESYNC 3 mirrors 000621 1787847500.597099 trunc from 0x040000 to 0x00f1f2 (0x30e0d bytes) 000622 1787847500.673707 write 0x004f36 thru 0x00bb2f (0x6bfa bytes) 000624 1787847500.684764 mapread 0x00e27b thru 0x00f1f2 (0xf78 bytes) 000625 1787847500.696127 read 0x006c99 thru 0x00f1f2 (0x855a bytes) 000626 1787847500.702731 mapwrite 0x001785 thru 0x002743 (0xfbf bytes) 000628 1787847500.755011 trunc from 0x00f1f3 to 0x00c5a8 (0x2c4a bytes) 000629 1787847500.803138 read 0x006a38 thru 0x00c5a8 (0x5b71 bytes) 000630 1787847500.808895 trunc from 0x00c5a9 to 0x02989d (0x1d2f5 bytes) 000631 1787847500.857370 trunc from 0x02989e to 0x03aadc (0x1123f bytes) 000636 1787847500.900135 read 0x01081a thru 0x0152d9 (0x4ac0 bytes) 000637 1787847500.915131 write 0x0039a9 thru 0x013737 (0xfd8f bytes) 000638 1787847500.916776 write 0x005a0e thru 0x00ac0a (0x51fd bytes) 000640 1787847500.922907 trunc from 0x03aadd to 0x03d813 (0x2d37 bytes) 000642 1787847500.950530 write 0x012583 thru 0x01953b (0x6fb9 bytes) 000643 1787847500.958990 MIRROR_RESYNC 3 mirrors 000644 1787847501.905096 MIRROR_EXTEND to 4 mirrors 000648 1787847502.949212 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000649 1787847503.396924 write 0x034665 thru 0x03c802 (0x819e bytes) 000650 1787847503.473425 mapread 0x0022f5 thru 0x005f29 (0x3c35 bytes) 000651 1787847503.501191 write 0x025635 thru 0x0331c6 (0xdb92 bytes) 000652 1787847503.529927 write 0x00a52d thru 0x017ef7 (0xd9cb bytes) 000653 1787847503.543883 write 0x025232 thru 0x02e23b (0x900a bytes) 000656 1787847503.546024 trunc from 0x03d814 to 0x03d165 (0x6ae bytes) 000657 1787847503.584990 write 0x015ce6 thru 0x01e8cb (0x8be6 bytes) 000658 1787847503.594070 write 0x012fb5 thru 0x01c40c (0x9458 bytes) 000659 1787847503.595416 trunc from 0x03d166 to 0x010be5 (0x2c580 bytes) 000662 1787847503.623047 write 0x022bdb thru 0x03091e (0xdd44 bytes) 000663 1787847503.632803 MIRROR_RESYNC 3 mirrors 000666 1787847505.055899 mapread 0x0065f5 thru 0x00fed3 (0x98df bytes) 000670 1787847505.090370 trunc from 0x03091f to 0x035007 (0x46e9 bytes) 000671 1787847505.217846 write 0x03fd05 thru 0x03ffff (0x2fb bytes) 000676 1787847505.228756 mapread 0x02d78f thru 0x031529 (0x3d9b bytes) 000677 1787847505.261808 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb5a13498 (stale) Mirror 6: 0xb5a13498 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3bfb772b Mirror 7: 0x3bfb772b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1787847506.783771 mapread 0x03b702 thru 0x03ffff (0x48fe bytes) 000681 1787847506.807493 read 0x03837d thru 0x03de1f (0x5aa3 bytes) 000682 1787847506.809910 trunc from 0x040000 to 0x01177a (0x2e885 bytes) 000683 1787847506.925246 read 0x007d29 thru 0x01177a (0x9a52 bytes) 000684 1787847506.940958 trunc from 0x01177b to 0x017484 (0x5d0a bytes) 000686 1787847506.973396 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17485): Mirror 5: 0x948b5619 (stale) Mirror 7: 0x948b5619 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17485): Mirror 5: 0x948b5619 (stale) Mirror 7: 0x948b5619 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17485: skipped 000687 1787847507.671589 mapwrite 0x021bdb thru 0x029665 (0x7a8b bytes) 000688 1787847507.850640 read 0x0064f3 thru 0x010de9 (0xa8f7 bytes) 000689 1787847507.883938 mapwrite 0x0274e4 thru 0x029d44 (0x2861 bytes) 000691 1787847508.036019 trunc from 0x029d45 to 0x00d919 (0x1c42b bytes) 000693 1787847508.068060 mapwrite 0x02811d thru 0x030972 (0x8856 bytes) 000694 1787847508.182871 MIRROR_RESYNC 3 mirrors 000696 1787847509.719430 MIRROR_RESYNC 3 mirrors 000697 1787847510.218601 mapread 0x01048d thru 0x01a4c0 (0xa034 bytes) 000698 1787847510.254755 trunc from 0x030973 to 0x003414 (0x2d55e bytes) 000699 1787847510.463982 write 0x004a37 thru 0x00cae3 (0x80ad bytes) 000701 1787847510.476013 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcae4): Mirror 5: 0xba4d933e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcae4): Mirror 5: 0xba4d933e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcae4: skipped 000702 1787847510.794426 trunc from 0x00cae4 to 0x02401a (0x17537 bytes) 000703 1787847510.817870 write 0x019f55 thru 0x02850c (0xe5b8 bytes) 000705 1787847510.830126 write 0x012b39 thru 0x020edc (0xe3a4 bytes) 000707 1787847510.836690 read 0x00722e thru 0x00e119 (0x6eec bytes) 000710 1787847510.846097 mapwrite 0x023158 thru 0x02d6af (0xa558 bytes) 000711 1787847510.935387 write 0x032f99 thru 0x03d672 (0xa6da bytes) 000712 1787847510.936786 mapread 0x00c8ad thru 0x011a5a (0x51ae bytes) 000713 1787847510.950831 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d673): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d673): Mirror 5: 0x413b055 (stale) CRC-32 checksum value for chunk [0, 0x3d673): Mirror 1: 0xf7fba698 Mirror 6: 0xf7fba698 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d673: skipped 000715 1787847512.043790 read 0x0309b5 thru 0x035da5 (0x53f1 bytes) 000717 1787847512.054468 mapread 0x0368ff thru 0x03d672 (0x6d74 bytes) 000718 1787847512.081940 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d673): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d673): Mirror 5: 0x413b055 (stale) CRC-32 checksum value for chunk [0, 0x3d673): Mirror 1: 0xf7fba698 Mirror 6: 0xf7fba698 Mirror 7: 0xf7fba698 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d673: skipped 000719 1787847513.175194 write 0x022816 thru 0x02f6bf (0xceaa bytes) 000721 1787847513.414541 trunc from 0x03d673 to 0x0237cf (0x19ea3 bytes) 000722 1787847513.444802 read 0x0027b2 thru 0x008364 (0x5bb3 bytes) 000724 1787847513.455755 mapwrite 0x02769d thru 0x033a5b (0xc3bf bytes) 000725 1787847513.704937 mapread 0x012073 thru 0x01a532 (0x84c0 bytes) 000726 1787847513.728928 mapread 0x00bd8b thru 0x015068 (0x92de bytes) 000727 1787847513.733712 write 0x0093e9 thru 0x015b25 (0xc73d bytes) 000728 1787847513.741515 mapread 0x005285 thru 0x00a92b (0x56a7 bytes) 000729 1787847513.743230 trunc from 0x033a5c to 0x020d9a (0x12cc1 bytes) 000731 1787847513.772959 trunc from 0x020d9b to 0x023611 (0x2877 bytes) 000733 1787847513.800805 mapread 0x009b77 thru 0x00a91d (0xda7 bytes) 000734 1787847513.802674 mapwrite 0x02d354 thru 0x03977b (0xc428 bytes) 000736 1787847513.941801 mapwrite 0x020a32 thru 0x02af71 (0xa540 bytes) 000737 1787847514.048043 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3977c): Mirror 5: 0xce87e760 (stale) Mirror 7: 0x75c8fdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3977c): Mirror 5: 0xce87e760 (stale) Mirror 7: 0x75c8fdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3977c: skipped 000741 1787847514.441175 write 0x00d1ab thru 0x0114b1 (0x4307 bytes) 000742 1787847514.468866 MIRROR_RESYNC 3 mirrors 000743 1787847515.914449 MIRROR_EXTEND to 4 mirrors 000744 1787847516.935324 write 0x03d036 thru 0x03ffff (0x2fca bytes) 000749 1787847517.145180 write 0x0147d2 thru 0x01a491 (0x5cc0 bytes) 000752 1787847517.161555 write 0x03a776 thru 0x03ffff (0x588a bytes) 000753 1787847517.170243 write 0x020fe7 thru 0x021842 (0x85c bytes) 000754 1787847517.184486 mapread 0x000084 thru 0x00d835 (0xd7b2 bytes) 000755 1787847517.244556 MIRROR_RESYNC 4 mirrors 000757 1787847518.794054 mapwrite 0x03d293 thru 0x03ffff (0x2d6d bytes) 000759 1787847519.171388 MIRROR_RESYNC 4 mirrors 000763 1787847520.481912 mapwrite 0x007c68 thru 0x012533 (0xa8cc bytes) 000764 1787847520.813002 mapwrite 0x001346 thru 0x00b3c2 (0xa07d bytes) 000766 1787847520.948970 mapread 0x0383b7 thru 0x03fcef (0x7939 bytes) 000767 1787847520.981408 read 0x00a3b0 thru 0x00c16c (0x1dbd bytes) 000768 1787847521.001124 write 0x00f3d0 thru 0x01ba73 (0xc6a4 bytes) 000769 1787847521.013216 mapread 0x023657 thru 0x02ab8d (0x7537 bytes) 000770 1787847521.035897 mapread 0x01183c thru 0x01d741 (0xbf06 bytes) 000773 1787847521.048661 read 0x00743b thru 0x00c54e (0x5114 bytes) 000774 1787847521.050002 mapwrite 0x02006f thru 0x02bae9 (0xba7b bytes) 000775 1787847521.130169 mapread 0x035f0b thru 0x03d0c8 (0x71be bytes) 000776 1787847521.131249 mapwrite 0x00260e thru 0x006a16 (0x4409 bytes) 000777 1787847521.254102 read 0x03ef1f thru 0x03ffff (0x10e1 bytes) 000778 1787847521.257667 read 0x00e509 thru 0x01577d (0x7275 bytes) 000779 1787847521.279068 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x86721939 (stale) Mirror 7: 0x86721939 (stale) Mirror 8: 0x86721939 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x35757d1 Mirror 9: 0x35757d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000783 1787847522.829738 trunc from 0x040000 to 0x004661 (0x3b99e bytes) 000785 1787847523.068824 trunc from 0x004662 to 0x0308dd (0x2c27c bytes) 000787 1787847523.108754 mapread 0x007454 thru 0x015e21 (0xe9ce bytes) 000789 1787847523.164540 read 0x0012b0 thru 0x001c28 (0x979 bytes) 000790 1787847523.185550 mapread 0x02ca56 thru 0x02ce04 (0x3af bytes) 000791 1787847523.200411 trunc from 0x0308de to 0x03ed3b (0xe45e bytes) 000792 1787847523.241372 mapread 0x02af6d thru 0x02f148 (0x41dc bytes) 000795 1787847523.257075 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ed3c): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed3c): Mirror 5: 0xc67fea40 (stale) Mirror 7: 0xc67fea40 (stale) Mirror 8: 0xc67fea40 (stale) Mirror 9: 0x7e009213 (stale) CRC-32 checksum value for chunk [0, 0x3ed3c): Mirror 1: 0x65cd335e Mirror 10: 0x65cd335e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed3c: skipped 000799 1787847525.232801 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed3c): Mirror 5: 0xc67fea40 (stale) Mirror 7: 0xc67fea40 (stale) Mirror 8: 0xc67fea40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed3c): Mirror 5: 0xc67fea40 (stale) Mirror 7: 0xc67fea40 (stale) Mirror 8: 0xc67fea40 (stale) CRC-32 checksum value for chunk [0, 0x3ed3c): Mirror 1: 0x65cd335e Mirror 10: 0x65cd335e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed3c: skipped 000800 1787847525.873498 read 0x013918 thru 0x01e630 (0xad19 bytes) 000802 1787847525.888179 read 0x02517b thru 0x03408e (0xef14 bytes) 000804 1787847525.906952 MIRROR_RESYNC 5 mirrors 000806 1787847527.403880 mapread 0x01b644 thru 0x01c283 (0xc40 bytes) 000810 1787847527.417998 mapread 0x037d78 thru 0x03ed3b (0x6fc4 bytes) 000813 1787847527.431931 read 0x02fe20 thru 0x03ed3b (0xef1c bytes) 000814 1787847527.445378 read 0x019d62 thru 0x028e87 (0xf126 bytes) 000816 1787847527.457165 mapwrite 0x0042e8 thru 0x00fe00 (0xbb19 bytes) 000818 1787847527.744891 mapwrite 0x035ab2 thru 0x03ffff (0xa54e bytes) 000820 1787847527.931712 read 0x018c76 thru 0x01ffbc (0x7347 bytes) 000821 1787847527.944875 read 0x00a70a thru 0x00e3b3 (0x3caa bytes) 000822 1787847527.945516 read 0x005a30 thru 0x0071ec (0x17bd bytes) 000823 1787847527.957199 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x7a16bbeb (stale) Mirror 7: 0x7a16bbeb (stale) Mirror 8: 0x7a16bbeb (stale) Mirror 10: 0x7a16bbeb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6c41ac28 Mirror 11: 0x6c41ac28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000826 1787847529.437375 mapwrite 0x02d4f3 thru 0x03c7df (0xf2ed bytes) 000827 1787847529.699324 trunc from 0x040000 to 0x01fcad (0x20352 bytes) 000828 1787847529.729596 trunc from 0x01fcae to 0x03a98a (0x1acdd bytes) 000830 1787847529.755969 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a98b): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a98b): Mirror 5: 0x4ef5cda8 (stale) Mirror 7: 0x4ef5cda8 (stale) Mirror 8: 0x4ef5cda8 (stale) Mirror 10: 0x4ef5cda8 (stale) Mirror 11: 0x249135aa (stale) CRC-32 checksum value for chunk [0, 0x3a98b): Mirror 1: 0x5ad3284a Mirror 12: 0x5ad3284a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a98b: skipped 000831 1787847531.326370 trunc from 0x03a98b to 0x016111 (0x24879 bytes) 000832 1787847531.535875 trunc from 0x016112 to 0x028e18 (0x12d07 bytes) 000834 1787847531.585552 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28e19): Mirror 5: 0xb4af1bee (stale) Mirror 7: 0xb4af1bee (stale) Mirror 8: 0xb4af1bee (stale) Mirror 11: 0x3d036208 (stale) Mirror 12: 0x3d036208 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28e19): Mirror 5: 0xb4af1bee (stale) Mirror 7: 0xb4af1bee (stale) Mirror 8: 0xb4af1bee (stale) Mirror 11: 0x3d036208 (stale) Mirror 12: 0x3d036208 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28e19: skipped 000836 1787847532.253520 read 0x02214b thru 0x028e18 (0x6cce bytes) 000837 1787847532.263440 trunc from 0x028e19 to 0x030ac2 (0x7caa bytes) 000839 1787847532.277705 read 0x02ac66 thru 0x030ac2 (0x5e5d bytes) 000841 1787847532.292316 write 0x00e71e thru 0x011948 (0x322b bytes) 000843 1787847532.294913 write 0x03a142 thru 0x03b774 (0x1633 bytes) 000845 1787847532.297705 mapwrite 0x03b5e2 thru 0x03ffff (0x4a1e bytes) 000846 1787847532.366952 read 0x02cebc thru 0x02e7c5 (0x190a bytes) 000847 1787847532.368037 trunc from 0x040000 to 0x03c4ea (0x3b15 bytes) 000848 1787847532.384769 write 0x029936 thru 0x037e51 (0xe51c bytes) 000851 1787847532.388736 write 0x000400 thru 0x0052e8 (0x4ee9 bytes) 000852 1787847532.390193 write 0x039aff thru 0x03ffff (0x6501 bytes) 000854 1787847532.392956 mapread 0x017ab5 thru 0x018c6e (0x11ba bytes) 000855 1787847532.394346 write 0x02b951 thru 0x02d913 (0x1fc3 bytes) 000856 1787847532.396292 mapwrite 0x007419 thru 0x011493 (0xa07b bytes) 000859 1787847532.449322 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x7a16bbeb (stale) Mirror 7: 0x7a16bbeb (stale) Mirror 8: 0x7a16bbeb (stale) Mirror 11: 0x6c41ac28 (stale) Mirror 12: 0x7602378a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb0f6daa8 Mirror 13: 0xb0f6daa8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000861 1787847533.819321 read 0x0337c0 thru 0x03f48a (0xbccb bytes) 000865 1787847533.842452 mapwrite 0x00d1f5 thru 0x0114e3 (0x42ef bytes) 000867 1787847534.084423 trunc from 0x040000 to 0x02372b (0x1c8d4 bytes) 000870 1787847534.128770 trunc from 0x02372c to 0x03f604 (0x1bed9 bytes) 000873 1787847534.168776 trunc from 0x03f605 to 0x0051e7 (0x3a41d bytes) 000874 1787847534.233980 mapwrite 0x0321d8 thru 0x03680c (0x4635 bytes) 000875 1787847534.452326 mapread 0x0158b8 thru 0x02072f (0xae78 bytes) 000876 1787847534.505205 mapwrite 0x01598b thru 0x019f81 (0x45f7 bytes) 000878 1787847534.601138 mapread 0x0007a7 thru 0x009cb2 (0x950c bytes) 000879 1787847534.638778 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3680d): Mirror 7: 0xc5fc0194 (stale) Mirror 8: 0xc5fc0194 (stale) Mirror 11: 0xb54a2d16 (stale) Mirror 12: 0x7dcdee8 (stale) Mirror 13: 0xd01dfe6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3680d): Mirror 7: 0xc5fc0194 (stale) Mirror 8: 0xc5fc0194 (stale) Mirror 11: 0xb54a2d16 (stale) Mirror 12: 0x7dcdee8 (stale) Mirror 13: 0xd01dfe6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3680d: skipped 000880 1787847535.112796 trunc from 0x03680d to 0x01c665 (0x1a1a7 bytes) 000881 1787847535.136947 write 0x03d977 thru 0x03e253 (0x8dd bytes) 000882 1787847535.138487 mapwrite 0x030eef thru 0x032546 (0x1658 bytes) 000883 1787847535.270052 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e254): Mirror 7: 0x3595020d (stale) Mirror 8: 0x3595020d (stale) Mirror 11: 0x40e5ee5a (stale) Mirror 12: 0x108e8fdc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e254): Mirror 7: 0x3595020d (stale) Mirror 8: 0x3595020d (stale) Mirror 11: 0x40e5ee5a (stale) Mirror 12: 0x108e8fdc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e254: skipped 000884 1787847535.846473 read 0x00f75e thru 0x01131a (0x1bbd bytes) 000885 1787847535.853112 read 0x02b694 thru 0x0395d0 (0xdf3d bytes) 000886 1787847535.876153 MIRROR_RESYNC 5 mirrors 000887 1787847538.544923 read 0x00fe4d thru 0x00fecd (0x81 bytes) 000888 1787847538.551902 trunc from 0x03e254 to 0x03dc01 (0x652 bytes) 000890 1787847538.655635 mapwrite 0x03299a thru 0x033b85 (0x11ec bytes) 000891 1787847538.734932 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3dc02): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc02): Mirror 7: 0xd046bc06 (stale) Mirror 8: 0xd046bc06 (stale) Mirror 11: 0xd046bc06 (stale) Mirror 12: 0xd046bc06 (stale) CRC-32 checksum value for chunk [0, 0x3dc02): Mirror 1: 0xa44866a5 Mirror 13: 0xa44866a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc02: skipped 000892 1787847540.200985 mapwrite 0x0124e0 thru 0x014627 (0x2148 bytes) 000893 1787847540.390779 read 0x025f5c thru 0x02c8d2 (0x6977 bytes) 000896 1787847540.400682 trunc from 0x03dc02 to 0x021d19 (0x1bee8 bytes) 000897 1787847540.434804 MIRROR_RESYNC 6 mirrors 000898 1787847542.625100 mapread 0x01a544 thru 0x01b29a (0xd57 bytes) 000899 1787847542.636899 write 0x02ea1d thru 0x02ec68 (0x24c bytes) 000900 1787847542.763693 mapwrite 0x023a1b thru 0x02e087 (0xa66d bytes) 000901 1787847542.868243 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ec69): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec69): Mirror 7: 0xbfb06349 (stale) Mirror 8: 0xbfb06349 (stale) Mirror 11: 0xbfb06349 (stale) Mirror 12: 0xbfb06349 (stale) Mirror 13: 0xbfb06349 (stale) CRC-32 checksum value for chunk [0, 0x2ec69): Mirror 1: 0xc3d3742d Mirror 14: 0xc3d3742d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec69: skipped 000902 1787847544.323871 trunc from 0x02ec69 to 0x00d478 (0x217f0 bytes) 000903 1787847544.476447 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xd479): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd479): Mirror 7: 0x20d3c890 (stale) Mirror 8: 0x20d3c890 (stale) Mirror 11: 0x20d3c890 (stale) Mirror 12: 0x20d3c890 (stale) Mirror 13: 0x20d3c890 (stale) Mirror 14: 0x20d3c890 (stale) CRC-32 checksum value for chunk [0, 0xd479): Mirror 1: 0x20d3c890 Mirror 15: 0x20d3c890 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd479: skipped 000905 1787847545.900522 write 0x03b7a3 thru 0x03ffff (0x485d bytes) 000906 1787847546.016380 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc97ad70b (stale) Mirror 8: 0xc97ad70b (stale) Mirror 11: 0xc97ad70b (stale) Mirror 12: 0xc97ad70b (stale) Mirror 14: 0xd0ef8cdd (stale) Mirror 15: 0xa1972620 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc97ad70b (stale) Mirror 8: 0xc97ad70b (stale) Mirror 11: 0xc97ad70b (stale) Mirror 12: 0xc97ad70b (stale) Mirror 14: 0xd0ef8cdd (stale) Mirror 15: 0xa1972620 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000907 1787847546.812889 write 0x005ce6 thru 0x012ee4 (0xd1ff bytes) 000908 1787847546.830342 trunc from 0x040000 to 0x035334 (0xaccb bytes) 000910 1787847546.865888 write 0x03f2f1 thru 0x03ffff (0xd0f bytes) 000911 1787847546.870414 mapread 0x0239c4 thru 0x027435 (0x3a72 bytes) 000912 1787847546.904527 read 0x01202b thru 0x016542 (0x4518 bytes) 000913 1787847546.915527 mapread 0x0038e8 thru 0x00cea7 (0x95c0 bytes) 000914 1787847546.930788 write 0x005f0d thru 0x00cfd8 (0x70cc bytes) 000915 1787847546.933055 mapwrite 0x03d483 thru 0x03ffff (0x2b7d bytes) 000917 1787847547.001098 read 0x01923e thru 0x026b3a (0xd8fd bytes) 000918 1787847547.012468 mapread 0x011c41 thru 0x01db6e (0xbf2e bytes) 000921 1787847547.016683 mapwrite 0x00c1ce thru 0x00c70e (0x541 bytes) 000922 1787847547.066259 mapwrite 0x032b22 thru 0x039be0 (0x70bf bytes) 000923 1787847547.122639 mapread 0x001938 thru 0x003a03 (0x20cc bytes) 000924 1787847547.129360 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc97ad70b (stale) Mirror 8: 0xc97ad70b (stale) Mirror 11: 0xc97ad70b (stale) Mirror 12: 0xc97ad70b (stale) Mirror 14: 0xd0ef8cdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc97ad70b (stale) Mirror 8: 0xc97ad70b (stale) Mirror 11: 0xc97ad70b (stale) Mirror 12: 0xc97ad70b (stale) Mirror 14: 0xd0ef8cdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000926 1787847547.743489 trunc from 0x040000 to 0x014102 (0x2befd bytes) 000927 1787847547.771961 MIRROR_RESYNC 6 mirrors 000928 1787847549.204074 trunc from 0x014103 to 0x02650b (0x12409 bytes) 000930 1787847549.309348 read 0x00836c thru 0x00acf2 (0x2987 bytes) 000931 1787847549.320403 read 0x01abb2 thru 0x02650b (0xb95a bytes) 000934 1787847549.337369 mapwrite 0x00be31 thru 0x0104b4 (0x4684 bytes) 000936 1787847549.411796 write 0x011822 thru 0x015b67 (0x4346 bytes) 000937 1787847549.417836 write 0x01eaf1 thru 0x02d935 (0xee45 bytes) 000938 1787847549.421731 mapwrite 0x012c4e thru 0x0223c1 (0xf774 bytes) 000940 1787847549.476654 MIRROR_RESYNC 6 mirrors 000941 1787847550.864311 write 0x03f8cb thru 0x03ffff (0x735 bytes) 000943 1787847550.989806 mapread 0x02e53e thru 0x03e4c9 (0xff8c bytes) 000944 1787847551.054382 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xaf9458b5 (stale) Mirror 8: 0xaf9458b5 (stale) Mirror 11: 0xaf9458b5 (stale) Mirror 12: 0xaf9458b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xaf9458b5 (stale) Mirror 8: 0xaf9458b5 (stale) Mirror 11: 0xaf9458b5 (stale) Mirror 12: 0xaf9458b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000946 1787847551.743680 write 0x01bca7 thru 0x01c19d (0x4f7 bytes) 000948 1787847551.754461 mapread 0x012a06 thru 0x016fc0 (0x45bb bytes) 000950 1787847551.773194 trunc from 0x040000 to 0x0210a6 (0x1ef59 bytes) 000951 1787847551.789183 mapwrite 0x00c057 thru 0x00ca14 (0x9be bytes) 000953 1787847551.865955 read 0x017434 thru 0x019e38 (0x2a05 bytes) 000954 1787847551.867830 mapread 0x01c9d7 thru 0x0210a6 (0x46d0 bytes) 000955 1787847551.877031 read 0x000cdd thru 0x00632e (0x5652 bytes) 000956 1787847551.887540 mapwrite 0x0180b9 thru 0x01ae32 (0x2d7a bytes) 000957 1787847551.932498 read 0x01deda thru 0x0210a6 (0x31cd bytes) 000958 1787847551.933771 write 0x03eab2 thru 0x03f207 (0x756 bytes) 000961 1787847551.937439 read 0x02780a thru 0x03675c (0xef53 bytes) 000962 1787847551.948846 mapwrite 0x02d227 thru 0x034a2c (0x7806 bytes) 000963 1787847551.994770 write 0x0011cf thru 0x001fdc (0xe0e bytes) 000964 1787847552.000333 write 0x033bd7 thru 0x03570d (0x1b37 bytes) 000965 1787847552.003679 write 0x007135 thru 0x009b4a (0x2a16 bytes) 000966 1787847552.007667 write 0x0396d5 thru 0x03ffff (0x692b bytes) 000969 1787847552.019705 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xaf9458b5 (stale) Mirror 11: 0xaf9458b5 (stale) Mirror 12: 0xaf9458b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xaf9458b5 (stale) Mirror 11: 0xaf9458b5 (stale) Mirror 12: 0xaf9458b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000970 1787847552.451342 write 0x03562b thru 0x03f79b (0xa171 bytes) 000972 1787847552.462049 write 0x004db9 thru 0x007bea (0x2e32 bytes) 000974 1787847552.473725 write 0x0147fb thru 0x02188d (0xd093 bytes) 000976 1787847552.485273 mapread 0x031d33 thru 0x03aad3 (0x8da1 bytes) 000978 1787847552.506546 read 0x00fee7 thru 0x01d2eb (0xd405 bytes) 000980 1787847552.515610 write 0x02ee6e thru 0x030254 (0x13e7 bytes) 000982 1787847552.517703 mapread 0x01c263 thru 0x020c9c (0x4a3a bytes) 000984 1787847552.520325 trunc from 0x040000 to 0x00cb60 (0x3349f bytes) 000985 1787847552.541991 read 0x00276a thru 0x008275 (0x5b0c bytes) 000989 1787847552.551855 mapwrite 0x03b293 thru 0x03ffff (0x4d6d bytes) 000991 1787847552.637737 read 0x010598 thru 0x016f84 (0x69ed bytes) 000992 1787847552.638941 mapwrite 0x030f69 thru 0x03c0e4 (0xb17c bytes) 000994 1787847552.700527 mapwrite 0x03a81b thru 0x03ffff (0x57e5 bytes) 000995 1787847552.748362 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xaf9458b5 (stale) Mirror 11: 0xaf9458b5 (stale) Mirror 12: 0xaf9458b5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x333eba6 Mirror 13: 0x333eba6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000998 1787847553.907057 MIRROR_RESYNC 5 mirrors All operations completed A-OK!