== sanity-flr test 70a: flr mode fsx test ================ 12:37:51 (1783442271) Seed set to 2273 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1783442273.541502 write 0x024821 thru 0x030c90 (0xc470 bytes) truncating to largest ever: 0x1791b 000003 1783442273.553035 trunc from 0x030c91 to 0x01791a (0x19376 bytes) 000004 1783442273.589072 mapread 0x0147fc thru 0x01791a (0x311f bytes) 000006 1783442273.630199 mapwrite 0x026d50 thru 0x02eff4 (0x82a5 bytes) truncating to largest ever: 0x28635 000007 1783442273.753288 trunc from 0x02eff5 to 0x028634 (0x69c0 bytes) 000010 1783442273.780630 mapwrite 0x020212 thru 0x028023 (0x7e12 bytes) 000012 1783442273.850569 mapread 0x00dc10 thru 0x014f72 (0x7363 bytes) 000014 1783442273.878786 read 0x0104ed thru 0x01578b (0x529f bytes) 000015 1783442273.884595 trunc from 0x028635 to 0x01f12d (0x9507 bytes) 000016 1783442273.916361 mapwrite 0x03a95d thru 0x03ffff (0x56a3 bytes) 000017 1783442273.983500 mapwrite 0x02c4d9 thru 0x03aff0 (0xeb18 bytes) 000018 1783442274.033023 mapread 0x01a10d thru 0x0205b1 (0x64a5 bytes) 000019 1783442274.042819 write 0x02322c thru 0x02d4a3 (0xa278 bytes) 000020 1783442274.050754 write 0x01827f thru 0x027b60 (0xf8e2 bytes) 000024 1783442274.057746 read 0x0007d9 thru 0x00d174 (0xc99c bytes) 000025 1783442274.067175 trunc from 0x040000 to 0x022e07 (0x1d1f8 bytes) 000026 1783442274.082799 mapread 0x020644 thru 0x02101f (0x9dc bytes) 000028 1783442274.084813 read 0x00b200 thru 0x017546 (0xc347 bytes) 000029 1783442274.087180 read 0x01d30e thru 0x0203d0 (0x30c3 bytes) 000030 1783442274.088785 read 0x016412 thru 0x01c2de (0x5ecd bytes) 000033 1783442274.092778 mapwrite 0x036130 thru 0x03d9bc (0x788d bytes) 000035 1783442274.223567 write 0x019608 thru 0x0269c5 (0xd3be bytes) 000039 1783442274.242519 MIRROR_EXTEND to 2 mirrors 000040 1783442274.791892 trunc from 0x03d9bd to 0x0091ae (0x3480e bytes) truncating to largest ever: 0x2c86f 000041 1783442274.923326 trunc from 0x0091af to 0x02c86e (0x236c0 bytes) 000042 1783442274.946799 write 0x011315 thru 0x0161e1 (0x4ecd bytes) 000043 1783442274.960833 MIRROR_RESYNC 2 mirrors 000048 1783442275.592259 MIRROR_RESYNC 2 mirrors 000050 1783442276.016752 write 0x01eddb thru 0x027377 (0x859d bytes) 000054 1783442276.104312 mapread 0x02b2cd thru 0x02c86e (0x15a2 bytes) 000057 1783442276.116334 trunc from 0x02c86f to 0x01dd68 (0xeb06 bytes) 000058 1783442276.140434 mapread 0x017b66 thru 0x0183a5 (0x840 bytes) 000059 1783442276.152682 mapread 0x00c98f thru 0x016257 (0x98c9 bytes) 000061 1783442276.163348 read 0x01c3d9 thru 0x01dd68 (0x1990 bytes) 000062 1783442276.164232 write 0x03b708 thru 0x03c5c1 (0xeba bytes) 000063 1783442276.165828 mapread 0x001de5 thru 0x001e80 (0x9c bytes) 000064 1783442276.172814 mapread 0x026183 thru 0x0355be (0xf43c bytes) 000065 1783442276.187585 mapread 0x039dff thru 0x03c5c1 (0x27c3 bytes) 000066 1783442276.192134 mapread 0x024822 thru 0x02a400 (0x5bdf bytes) 000069 1783442276.195112 mapwrite 0x030e23 thru 0x0373e6 (0x65c4 bytes) 000070 1783442276.253657 write 0x013011 thru 0x0179ff (0x49ef bytes) 000071 1783442276.256623 write 0x030d3f thru 0x03da54 (0xcd16 bytes) 000074 1783442276.265168 mapwrite 0x0293ff thru 0x035003 (0xbc05 bytes) 000076 1783442276.348364 read 0x02b949 thru 0x02d2bb (0x1973 bytes) 000077 1783442276.349157 read 0x019d54 thru 0x01fd9c (0x6049 bytes) 000078 1783442276.357715 trunc from 0x03da55 to 0x01feef (0x1db65 bytes) 000079 1783442276.389190 mapwrite 0x034958 thru 0x03b27e (0x6927 bytes) 000082 1783442276.543216 mapread 0x0205c1 thru 0x020715 (0x155 bytes) truncating to largest ever: 0x388e1 000084 1783442276.558455 trunc from 0x03b27f to 0x0388e0 (0x299e bytes) 000085 1783442276.593943 trunc from 0x0388e1 to 0x02cd38 (0xbba8 bytes) 000088 1783442276.617105 trunc from 0x02cd39 to 0x031a74 (0x4d3c bytes) 000089 1783442276.647193 read 0x021a39 thru 0x022038 (0x600 bytes) 000090 1783442276.676230 MIRROR_RESYNC 2 mirrors 000091 1783442277.421556 MIRROR_EXTEND to 3 mirrors 000093 1783442278.086027 MIRROR_EXTEND to 4 mirrors 000096 1783442278.803173 trunc from 0x031a75 to 0x00c220 (0x25854 bytes) 000098 1783442278.934229 write 0x03ba72 thru 0x03fc25 (0x41b4 bytes) 000099 1783442278.936750 mapwrite 0x03dade thru 0x03ffff (0x2522 bytes) 000100 1783442279.012666 write 0x011b89 thru 0x01cb4b (0xafc3 bytes) 000101 1783442279.024439 trunc from 0x040000 to 0x02851f (0x17ae0 bytes) 000105 1783442279.044557 trunc from 0x028520 to 0x00408a (0x24495 bytes) 000106 1783442279.063368 write 0x028b8c thru 0x034813 (0xbc88 bytes) 000108 1783442279.068208 write 0x014e06 thru 0x01e183 (0x937e bytes) 000109 1783442279.079340 mapread 0x01ebbc thru 0x02a885 (0xbcca bytes) 000110 1783442279.098739 trunc from 0x034814 to 0x01a17f (0x1a694 bytes) 000111 1783442279.126126 read 0x010836 thru 0x018889 (0x8054 bytes) 000112 1783442279.137701 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a180): Mirror 3: 0x4088ffd4 (stale) Mirror 4: 0x4088ffd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a180): Mirror 3: 0x4088ffd4 (stale) Mirror 4: 0x4088ffd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a180: skipped 000113 1783442279.549932 trunc from 0x01a180 to 0x0373b5 (0x1d236 bytes) 000114 1783442279.582366 mapread 0x002aa2 thru 0x00bd99 (0x92f8 bytes) 000116 1783442279.628202 read 0x02cfac thru 0x034047 (0x709c bytes) 000119 1783442279.643485 trunc from 0x0373b6 to 0x00718a (0x3022b bytes) 000120 1783442279.677056 mapread 0x0043a4 thru 0x00718a (0x2de7 bytes) 000121 1783442279.678271 read 0x003c2b thru 0x00718a (0x3560 bytes) 000122 1783442279.679126 trunc from 0x00718b to 0x034982 (0x2d7f8 bytes) 000123 1783442279.693027 write 0x03aa0c thru 0x03ffff (0x55f4 bytes) 000125 1783442279.695482 mapread 0x03b6f6 thru 0x03fdc4 (0x46cf bytes) 000126 1783442279.703295 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xff104ad6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xff104ad6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000127 1783442279.940741 mapwrite 0x023ea8 thru 0x029b2d (0x5c86 bytes) 000129 1783442279.996596 mapread 0x035ac8 thru 0x03ffff (0xa538 bytes) 000130 1783442280.010283 write 0x03edab thru 0x03ffff (0x1255 bytes) 000133 1783442280.014089 trunc from 0x040000 to 0x02e2df (0x11d20 bytes) 000134 1783442280.043122 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000136 1783442280.208270 MIRROR_EXTEND to 2 mirrors 000138 1783442281.120704 trunc from 0x02e2e0 to 0x025beb (0x86f4 bytes) 000139 1783442281.245700 read 0x02012a thru 0x02332a (0x3201 bytes) 000141 1783442281.258580 read 0x01bdad thru 0x022847 (0x6a9b bytes) truncating to largest ever: 0x3af00 000144 1783442281.277722 trunc from 0x025bec to 0x03aeff (0x15314 bytes) 000148 1783442281.350349 write 0x0241b0 thru 0x0274b6 (0x3307 bytes) 000149 1783442281.367055 read 0x00d6ab thru 0x014a05 (0x735b bytes) 000150 1783442281.372980 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3af00): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af00): Mirror 2: 0x7000b200 (stale) CRC-32 checksum value for chunk [0, 0x3af00): Mirror 1: 0x56ae6a54 Mirror 3: 0x56ae6a54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af00: skipped 000152 1783442282.486390 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3af00): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af00): Mirror 2: 0x7000b200 (stale) CRC-32 checksum value for chunk [0, 0x3af00): Mirror 1: 0x56ae6a54 Mirror 3: 0x56ae6a54 Mirror 4: 0x56ae6a54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af00: skipped 000153 1783442283.732189 mapwrite 0x020bbc thru 0x026507 (0x594c bytes) 000154 1783442283.951573 read 0x0207cd thru 0x02a744 (0x9f78 bytes) 000156 1783442283.962958 trunc from 0x03af00 to 0x02560d (0x158f2 bytes) 000159 1783442283.997119 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2560e): Mirror 3: 0x17c5e95e (stale) Mirror 4: 0x17c5e95e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2560e): Mirror 3: 0x17c5e95e (stale) Mirror 4: 0x17c5e95e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2560e: skipped 000161 1783442284.363101 mapwrite 0x00db40 thru 0x015860 (0x7d21 bytes) 000162 1783442284.538230 write 0x00e5b7 thru 0x018457 (0x9ea1 bytes) 000164 1783442284.546999 read 0x016d1f thru 0x02560d (0xe8ef bytes) 000166 1783442284.575811 write 0x002788 thru 0x0041df (0x1a58 bytes) 000167 1783442284.586994 read 0x012184 thru 0x01b780 (0x95fd bytes) 000170 1783442284.594550 mapread 0x015bc3 thru 0x015e4e (0x28c bytes) 000171 1783442284.600440 write 0x000a65 thru 0x00f459 (0xe9f5 bytes) 000172 1783442284.622573 trunc from 0x02560e to 0x029340 (0x3d33 bytes) 000173 1783442284.648372 mapread 0x005369 thru 0x007bd4 (0x286c bytes) 000174 1783442284.649451 mapread 0x014b41 thru 0x01790a (0x2dca bytes) 000175 1783442284.660520 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29341): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29341): Mirror 3: 0xba8c658b (stale) Mirror 4: 0xba8c658b (stale) CRC-32 checksum value for chunk [0, 0x29341): Mirror 1: 0xd09871b2 Mirror 5: 0xd09871b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29341: skipped 000176 1783442285.645696 read 0x0038cd thru 0x011c52 (0xe386 bytes) 000178 1783442285.681054 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29341): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29341): Mirror 3: 0xba8c658b (stale) Mirror 4: 0xba8c658b (stale) CRC-32 checksum value for chunk [0, 0x29341): Mirror 1: 0xd09871b2 Mirror 5: 0xd09871b2 Mirror 6: 0xd09871b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29341: skipped 000179 1783442286.553013 trunc from 0x029341 to 0x00c77b (0x1cbc5 bytes) 000182 1783442286.674209 mapread 0x00614f thru 0x00c77b (0x662d bytes) 000183 1783442286.703385 read 0x0025b2 thru 0x00a8a1 (0x82f0 bytes) 000184 1783442286.704577 read 0x003202 thru 0x00c77b (0x957a bytes) 000187 1783442286.708139 mapread 0x009cbe thru 0x00c77b (0x2abe bytes) 000188 1783442286.709467 trunc from 0x00c77c to 0x01e2f4 (0x11b79 bytes) 000189 1783442286.728070 mapwrite 0x03c9b8 thru 0x03ffff (0x3648 bytes) 000190 1783442286.808467 mapwrite 0x01093a thru 0x01c3ac (0xba73 bytes) 000191 1783442286.869850 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89aa78d8 (stale) Mirror 4: 0x89aa78d8 (stale) Mirror 5: 0xcd3eb63c (stale) Mirror 6: 0xcd3eb63c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9a3d802b Mirror 7: 0x9a3d802b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000192 1783442287.751188 trunc from 0x040000 to 0x00b23d (0x34dc2 bytes) 000193 1783442287.879336 mapwrite 0x039a4e thru 0x03ffff (0x65b2 bytes) 000196 1783442287.977084 mapwrite 0x03a930 thru 0x03ffff (0x56d0 bytes) 000197 1783442288.082302 mapwrite 0x03a069 thru 0x03ffff (0x5f97 bytes) 000199 1783442288.222955 mapwrite 0x02ed8d thru 0x0354af (0x6723 bytes) 000200 1783442288.325673 trunc from 0x040000 to 0x00dfe2 (0x3201d bytes) 000204 1783442288.387395 write 0x00a239 thru 0x010575 (0x633d bytes) 000207 1783442288.417374 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10576): Mirror 3: 0xbf82d394 (stale) Mirror 5: 0xbd9b9ab8 (stale) Mirror 6: 0xbd9b9ab8 (stale) Mirror 7: 0x250b462 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10576): Mirror 3: 0xbf82d394 (stale) Mirror 5: 0xbd9b9ab8 (stale) Mirror 6: 0xbd9b9ab8 (stale) Mirror 7: 0x250b462 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10576: skipped 000211 1783442288.893895 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x10576): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10576): Mirror 3: 0xbf82d394 (stale) Mirror 5: 0xbd9b9ab8 (stale) Mirror 6: 0xbd9b9ab8 (stale) Mirror 7: 0x250b462 (stale) CRC-32 checksum value for chunk [0, 0x10576): Mirror 1: 0x83420cea Mirror 8: 0x83420cea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10576: skipped 000213 1783442290.047842 read 0x00deeb thru 0x010575 (0x268b bytes) 000216 1783442290.057171 mapwrite 0x025259 thru 0x0339a0 (0xe748 bytes) 000217 1783442290.336111 trunc from 0x0339a1 to 0x0155e2 (0x1e3be bytes) 000218 1783442290.366723 mapwrite 0x028164 thru 0x037175 (0xf012 bytes) 000219 1783442290.521820 trunc from 0x037176 to 0x032787 (0x49ee bytes) 000221 1783442290.546501 write 0x03422c thru 0x03ffff (0xbdd4 bytes) 000222 1783442290.549478 read 0x010308 thru 0x014618 (0x4311 bytes) 000223 1783442290.567780 mapwrite 0x0217e0 thru 0x029fcf (0x87f0 bytes) 000224 1783442290.633398 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89aa78d8 (stale) Mirror 5: 0xcd3eb63c (stale) Mirror 6: 0xcd3eb63c (stale) Mirror 7: 0x9a3d802b (stale) Mirror 8: 0x5a847045 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xed1eac2b Mirror 9: 0xed1eac2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000225 1783442291.394425 read 0x0151e9 thru 0x01e121 (0x8f39 bytes) 000227 1783442291.423417 mapread 0x018c44 thru 0x0278a1 (0xec5e bytes) 000230 1783442291.483455 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89aa78d8 (stale) Mirror 5: 0xcd3eb63c (stale) Mirror 7: 0x9a3d802b (stale) Mirror 8: 0x5a847045 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89aa78d8 (stale) Mirror 5: 0xcd3eb63c (stale) Mirror 7: 0x9a3d802b (stale) Mirror 8: 0x5a847045 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xed1eac2b Mirror 9: 0xed1eac2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000231 1783442292.033836 mapread 0x03da2d thru 0x03ffff (0x25d3 bytes) 000234 1783442292.121367 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89aa78d8 (stale) Mirror 5: 0xcd3eb63c (stale) Mirror 7: 0x9a3d802b (stale) Mirror 8: 0x5a847045 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xed1eac2b Mirror 9: 0xed1eac2b Mirror 10: 0xed1eac2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000237 1783442293.149096 MIRROR_RESYNC 7 mirrors 000241 1783442294.211021 write 0x00cd86 thru 0x016e4e (0xa0c9 bytes) 000243 1783442294.290685 mapwrite 0x00cb4c thru 0x011fcf (0x5484 bytes) 000245 1783442294.364201 read 0x01843a thru 0x01f2b7 (0x6e7e bytes) 000246 1783442294.374898 trunc from 0x040000 to 0x029fea (0x16015 bytes) 000247 1783442294.397810 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29feb): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29feb): Mirror 3: 0xaa8442eb (stale) Mirror 5: 0xaa8442eb (stale) Mirror 7: 0xaa8442eb (stale) Mirror 8: 0xaa8442eb (stale) Mirror 9: 0xaa8442eb (stale) Mirror 10: 0xaa8442eb (stale) CRC-32 checksum value for chunk [0, 0x29feb): Mirror 1: 0x92be6197 Mirror 11: 0x92be6197 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29feb: skipped 000250 1783442295.147045 read 0x00f372 thru 0x01b9ac (0xc63b bytes) 000255 1783442295.195829 read 0x01a1c8 thru 0x024f93 (0xadcc bytes) 000256 1783442295.211275 trunc from 0x029feb to 0x02cbdb (0x2bf1 bytes) 000257 1783442295.355379 trunc from 0x02cbdc to 0x007c32 (0x24fa9 bytes) 000258 1783442295.386955 mapread 0x005d30 thru 0x007c32 (0x1f03 bytes) 000259 1783442295.410434 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x7c33): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7c33): Mirror 3: 0x1c2b48b5 (stale) Mirror 5: 0x1c2b48b5 (stale) Mirror 7: 0x1c2b48b5 (stale) Mirror 8: 0x1c2b48b5 (stale) Mirror 9: 0x1c2b48b5 (stale) Mirror 10: 0x1c2b48b5 (stale) Mirror 11: 0x1c2b48b5 (stale) CRC-32 checksum value for chunk [0, 0x7c33): Mirror 1: 0x1c2b48b5 Mirror 12: 0x1c2b48b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7c33: skipped 000266 1783442296.130184 mapwrite 0x0260e6 thru 0x028f4b (0x2e66 bytes) 000267 1783442296.284481 mapread 0x027b9c thru 0x028f4b (0x13b0 bytes) 000268 1783442296.285549 mapwrite 0x00603d thru 0x006fd7 (0xf9b bytes) 000269 1783442296.338938 read 0x016136 thru 0x02428e (0xe159 bytes) 000276 1783442296.354924 write 0x02a877 thru 0x03158b (0x6d15 bytes) 000277 1783442296.364038 MIRROR_RESYNC 9 mirrors 000278 1783442297.851170 MIRROR_EXTEND to 10 mirrors 000280 1783442298.454186 mapread 0x0194ef thru 0x024a5e (0xb570 bytes) 000283 1783442298.502576 MIRROR_EXTEND to 11 mirrors 000285 1783442299.469705 mapwrite 0x02e076 thru 0x035a3e (0x79c9 bytes) 000287 1783442299.715979 mapread 0x02bf1d thru 0x02f2e4 (0x33c8 bytes) 000288 1783442299.717997 write 0x008b07 thru 0x010548 (0x7a42 bytes) 000289 1783442299.731828 write 0x016451 thru 0x01b918 (0x54c8 bytes) 000290 1783442299.750970 write 0x017131 thru 0x01be0e (0x4cde bytes) 000292 1783442299.760260 mapread 0x024c5a thru 0x030671 (0xba18 bytes) 000294 1783442299.783357 trunc from 0x035a3f to 0x00e872 (0x271cc bytes) 000295 1783442299.811926 trunc from 0x00e873 to 0x02a25f (0x1b9ed bytes) 000296 1783442299.826349 trunc from 0x02a260 to 0x03200c (0x7dad bytes) 000299 1783442299.853200 trunc from 0x03200d to 0x026104 (0xbf08 bytes) 000300 1783442299.869212 mapwrite 0x03c3db thru 0x03ffff (0x3c25 bytes) 000304 1783442299.975436 mapwrite 0x01263d thru 0x019701 (0x70c5 bytes) truncating to largest ever: 0x3e6ec 000306 1783442300.037673 trunc from 0x040000 to 0x03e6eb (0x1914 bytes) 000308 1783442300.055822 write 0x01989c thru 0x028c5a (0xf3bf bytes) 000309 1783442300.063170 write 0x01f1e8 thru 0x02386a (0x4683 bytes) 000310 1783442300.064794 trunc from 0x03e6ec to 0x017a24 (0x26cc7 bytes) 000312 1783442300.086365 mapwrite 0x0301ce thru 0x032906 (0x2739 bytes) 000313 1783442300.166874 trunc from 0x032907 to 0x00c3f4 (0x26512 bytes) 000314 1783442300.185945 mapwrite 0x01ddba thru 0x02a52f (0xc776 bytes) 000317 1783442300.308283 write 0x03668a thru 0x03ffff (0x9976 bytes) 000319 1783442300.311205 mapread 0x03c80b thru 0x03c898 (0x8e bytes) 000321 1783442300.319008 mapread 0x021684 thru 0x029c9c (0x8619 bytes) 000324 1783442300.328353 mapwrite 0x037e8e thru 0x0390c8 (0x123b bytes) 000326 1783442300.391124 read 0x02441c thru 0x0310e1 (0xccc6 bytes) 000327 1783442300.400799 trunc from 0x040000 to 0x003d49 (0x3c2b6 bytes) 000328 1783442300.427837 mapread 0x0029c8 thru 0x003d49 (0x1382 bytes) 000329 1783442300.441432 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4a): Mirror 3: 0xe8d00352 (stale) Mirror 7: 0xe8d00352 (stale) Mirror 8: 0xe8d00352 (stale) Mirror 9: 0xe8d00352 (stale) Mirror 10: 0xe8d00352 (stale) Mirror 11: 0xe8d00352 (stale) Mirror 12: 0xe8d00352 (stale) Mirror 13: 0xe8d00352 (stale) Mirror 14: 0xe8d00352 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4a): Mirror 3: 0xe8d00352 (stale) Mirror 7: 0xe8d00352 (stale) Mirror 8: 0xe8d00352 (stale) Mirror 9: 0xe8d00352 (stale) Mirror 10: 0xe8d00352 (stale) Mirror 11: 0xe8d00352 (stale) Mirror 12: 0xe8d00352 (stale) Mirror 13: 0xe8d00352 (stale) Mirror 14: 0xe8d00352 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4a: skipped 000330 1783442300.967909 write 0x004d0c thru 0x00e844 (0x9b39 bytes) 000331 1783442300.969741 mapwrite 0x01420f thru 0x0202fe (0xc0f0 bytes) 000332 1783442301.144945 mapwrite 0x0071f0 thru 0x00a0b7 (0x2ec8 bytes) 000334 1783442301.185251 mapwrite 0x035045 thru 0x03ffff (0xafbb bytes) 000336 1783442301.257662 write 0x00caa7 thru 0x012ef5 (0x644f bytes) 000337 1783442301.264186 MIRROR_RESYNC 10 mirrors 000339 1783442302.876082 write 0x032384 thru 0x03e6ad (0xc32a bytes) 000340 1783442302.960129 read 0x00a390 thru 0x015a46 (0xb6b7 bytes) 000341 1783442302.976526 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfd203210 (stale) Mirror 7: 0xfd203210 (stale) Mirror 8: 0xfd203210 (stale) Mirror 9: 0xfd203210 (stale) Mirror 10: 0xfd203210 (stale) Mirror 11: 0xfd203210 (stale) Mirror 12: 0xfd203210 (stale) Mirror 13: 0xfd203210 (stale) Mirror 14: 0xfd203210 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x16317418 Mirror 15: 0x16317418 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000346 1783442304.264186 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfd203210 (stale) Mirror 7: 0xfd203210 (stale) Mirror 9: 0xfd203210 (stale) Mirror 10: 0xfd203210 (stale) Mirror 11: 0xfd203210 (stale) Mirror 12: 0xfd203210 (stale) Mirror 13: 0xfd203210 (stale) Mirror 14: 0xfd203210 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfd203210 (stale) Mirror 7: 0xfd203210 (stale) Mirror 9: 0xfd203210 (stale) Mirror 10: 0xfd203210 (stale) Mirror 11: 0xfd203210 (stale) Mirror 12: 0xfd203210 (stale) Mirror 13: 0xfd203210 (stale) Mirror 14: 0xfd203210 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x16317418 Mirror 15: 0x16317418 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000347 1783442305.418589 trunc from 0x040000 to 0x007f3b (0x380c4 bytes) 000349 1783442305.657732 mapread 0x00347f thru 0x007f3b (0x4abd bytes) 000351 1783442305.689713 mapwrite 0x035488 thru 0x03af00 (0x5a79 bytes) 000352 1783442305.876231 write 0x015bef thru 0x0222a8 (0xc6ba bytes) 000353 1783442305.898174 read 0x006a09 thru 0x00e56c (0x7b64 bytes) 000355 1783442305.913927 read 0x0013d5 thru 0x00dca2 (0xc8ce bytes) 000356 1783442305.916117 mapread 0x0103aa thru 0x0194d1 (0x9128 bytes) 000357 1783442305.932288 read 0x00d6bd thru 0x01d509 (0xfe4d bytes) 000358 1783442305.933817 mapread 0x02cfa3 thru 0x03af00 (0xdf5e bytes) 000359 1783442305.937393 trunc from 0x03af01 to 0x001e9d (0x39063 bytes) 000361 1783442305.970464 mapread 0x000130 thru 0x001e9d (0x1d6e bytes) 000362 1783442305.972162 mapwrite 0x01da11 thru 0x0267b0 (0x8da0 bytes) 000363 1783442306.080058 mapwrite 0x031489 thru 0x03e90e (0xd486 bytes) 000365 1783442306.220932 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3e90f): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e90f): Mirror 3: 0xbec79646 (stale) Mirror 7: 0xbec79646 (stale) Mirror 9: 0xbec79646 (stale) Mirror 10: 0xbec79646 (stale) Mirror 11: 0xbec79646 (stale) Mirror 12: 0xbec79646 (stale) Mirror 13: 0xbec79646 (stale) Mirror 14: 0xbec79646 (stale) Mirror 15: 0x6c9230fa (stale) CRC-32 checksum value for chunk [0, 0x3e90f): Mirror 1: 0xbec7e449 Mirror 16: 0xbec7e449 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e90f: skipped 000367 1783442307.506997 mapwrite 0x02a678 thru 0x036743 (0xc0cc bytes) 000368 1783442307.833684 read 0x012963 thru 0x0142df (0x197d bytes) 000370 1783442307.848103 write 0x02ca5f thru 0x033667 (0x6c09 bytes) 000371 1783442307.849975 mapwrite 0x00867a thru 0x013540 (0xaec7 bytes) 000374 1783442307.947484 trunc from 0x03e90f to 0x03945f (0x54af bytes) 000375 1783442308.007809 mapread 0x00f249 thru 0x010ed7 (0x1c8f bytes) 000376 1783442308.010980 mapwrite 0x02c67f thru 0x0335c2 (0x6f44 bytes) 000377 1783442308.072698 read 0x010238 thru 0x0152c7 (0x5090 bytes) 000378 1783442308.073653 write 0x009fec thru 0x017522 (0xd537 bytes) 000380 1783442308.076813 read 0x011e15 thru 0x01d45e (0xb64a bytes) 000382 1783442308.087150 mapread 0x013649 thru 0x0160ee (0x2aa6 bytes) 000383 1783442308.088217 read 0x021d16 thru 0x0283ce (0x66b9 bytes) 000385 1783442308.089399 mapwrite 0x03c841 thru 0x03ffff (0x37bf bytes) 000386 1783442308.221887 mapread 0x034b36 thru 0x03a00c (0x54d7 bytes) truncating to largest ever: 0x3f3da 000388 1783442308.223584 trunc from 0x040000 to 0x03f3d9 (0xc26 bytes) 000392 1783442308.257014 mapwrite 0x01c2a6 thru 0x021255 (0x4fb0 bytes) 000395 1783442308.394974 read 0x0096ad thru 0x00fd21 (0x6675 bytes) 000396 1783442308.396206 write 0x03cad6 thru 0x03ffff (0x352a bytes) 000401 1783442308.401004 write 0x025992 thru 0x033e4d (0xe4bc bytes) 000402 1783442308.405781 mapread 0x0216d9 thru 0x028889 (0x71b1 bytes) 000403 1783442308.409873 trunc from 0x040000 to 0x010130 (0x2fecf bytes) 000406 1783442308.446941 mapwrite 0x02116b thru 0x02395b (0x27f1 bytes) 000410 1783442308.599659 read 0x016143 thru 0x01dfc7 (0x7e85 bytes) 000411 1783442308.602687 read 0x015faa thru 0x02395b (0xd9b2 bytes) 000412 1783442308.603467 mapread 0x023932 thru 0x02395b (0x2a bytes) 000413 1783442308.614466 MIRROR_RESYNC 11 mirrors 000415 1783442310.680494 read 0x0114b0 thru 0x019d40 (0x8891 bytes) 000416 1783442310.696742 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000417 1783442311.351876 read 0x021df3 thru 0x02393e (0x1b4c bytes) 000418 1783442311.380671 MIRROR_EXTEND to 11 mirrors 000419 1783442312.306355 read 0x0065a5 thru 0x016366 (0xfdc2 bytes) 000420 1783442312.323202 MIRROR_RESYNC 11 mirrors 000423 1783442313.177366 read 0x0173e1 thru 0x01c523 (0x5143 bytes) 000424 1783442313.191565 write 0x0205f3 thru 0x02dce6 (0xd6f4 bytes) 000427 1783442313.302426 trunc from 0x02dce7 to 0x026e7d (0x6e69 bytes) 000428 1783442313.338865 read 0x00b138 thru 0x00bfe7 (0xeb0 bytes) 000429 1783442313.360943 read 0x024bc3 thru 0x026e7d (0x22bb bytes) 000433 1783442313.366109 mapwrite 0x0325eb thru 0x0379f4 (0x540a bytes) 000434 1783442313.489290 trunc from 0x0379f5 to 0x00cbe9 (0x2ae0b bytes) 000435 1783442313.504686 mapwrite 0x012371 thru 0x01c1c8 (0x9e58 bytes) 000436 1783442313.648016 read 0x002713 thru 0x0111b5 (0xeaa3 bytes) 000437 1783442313.667291 write 0x01aad8 thru 0x0237ec (0x8d15 bytes) 000438 1783442313.671077 mapwrite 0x01b6a1 thru 0x026069 (0xa9c9 bytes) 000439 1783442313.771684 write 0x03ea02 thru 0x03f030 (0x62f bytes) 000441 1783442313.781872 MIRROR_RESYNC 11 mirrors 000442 1783442315.595449 write 0x02a305 thru 0x035916 (0xb612 bytes) 000444 1783442315.812138 mapwrite 0x0135e6 thru 0x02054f (0xcf6a bytes) 000445 1783442315.964803 read 0x02dda8 thru 0x03639f (0x85f8 bytes) 000448 1783442315.973695 trunc from 0x03f031 to 0x03d19b (0x1e95 bytes) 000451 1783442316.001014 trunc from 0x03d19c to 0x017d34 (0x25467 bytes) 000455 1783442316.041272 mapread 0x010ffe thru 0x017d34 (0x6d37 bytes) 000457 1783442316.049240 read 0x00cb96 thru 0x00d12d (0x598 bytes) 000458 1783442316.065237 read 0x002479 thru 0x00df44 (0xbacc bytes) 000460 1783442316.066660 read 0x008189 thru 0x013c9d (0xbb15 bytes) 000461 1783442316.067337 mapwrite 0x02be25 thru 0x02fbd9 (0x3db5 bytes) 000462 1783442316.165221 MIRROR_RESYNC 11 mirrors 000464 1783442317.993642 mapread 0x00e2b4 thru 0x015fd1 (0x7d1e bytes) 000465 1783442318.027006 write 0x016320 thru 0x01a1b1 (0x3e92 bytes) 000467 1783442318.183190 mapwrite 0x0072be thru 0x007de8 (0xb2b bytes) 000469 1783442318.294375 MIRROR_RESYNC 11 mirrors 000471 1783442319.813092 mapread 0x01290b thru 0x01c60b (0x9d01 bytes) 000472 1783442319.836374 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000474 1783442320.341366 mapread 0x029f65 thru 0x02bdc6 (0x1e62 bytes) 000475 1783442320.356528 mapwrite 0x01d57a thru 0x0294e8 (0xbf6f bytes) 000477 1783442320.555389 mapwrite 0x00fb3f thru 0x013968 (0x3e2a bytes) 000478 1783442320.625485 mapwrite 0x0130bd thru 0x01f7a6 (0xc6ea bytes) 000479 1783442320.691306 mapread 0x01d68c thru 0x02412d (0x6aa2 bytes) 000480 1783442320.696327 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2fbda): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fbda): Mirror 3: 0xb4f78f6e (stale) Mirror 7: 0xb4f78f6e (stale) Mirror 9: 0xb4f78f6e (stale) Mirror 10: 0xb4f78f6e (stale) Mirror 11: 0xb4f78f6e (stale) Mirror 13: 0xb4f78f6e (stale) Mirror 14: 0xb4f78f6e (stale) Mirror 15: 0xb4f78f6e (stale) Mirror 17: 0xb4f78f6e (stale) CRC-32 checksum value for chunk [0, 0x2fbda): Mirror 1: 0xad4c08c0 Mirror 18: 0xad4c08c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fbda: skipped 000481 1783442321.574009 trunc from 0x02fbda to 0x00f6a9 (0x20530 bytes) 000482 1783442321.702214 trunc from 0x00f6aa to 0x001c72 (0xda37 bytes) 000483 1783442321.731035 mapwrite 0x02730a thru 0x028b56 (0x184d bytes) 000486 1783442321.821831 write 0x00f8e9 thru 0x010b37 (0x124f bytes) 000487 1783442321.840232 read 0x0181db thru 0x0203f1 (0x8217 bytes) 000488 1783442321.858976 read 0x0283de thru 0x028b56 (0x779 bytes) 000489 1783442321.861845 mapread 0x018e8c thru 0x01fff3 (0x7168 bytes) 000490 1783442321.865506 read 0x011772 thru 0x01343f (0x1cce bytes) 000491 1783442321.878192 mapwrite 0x031fa8 thru 0x03eb23 (0xcb7c bytes) 000492 1783442321.958556 read 0x03685b thru 0x03eb23 (0x82c9 bytes) 000493 1783442321.959280 mapwrite 0x001bde thru 0x00b3d7 (0x97fa bytes) 000494 1783442322.026281 MIRROR_RESYNC 11 mirrors 000495 1783442323.725865 mapread 0x02cb78 thru 0x03b019 (0xe4a2 bytes) 000496 1783442323.780219 mapread 0x007249 thru 0x0109c3 (0x977b bytes) 000499 1783442323.798169 mapwrite 0x03034b thru 0x035453 (0x5109 bytes) 000502 1783442324.009353 trunc from 0x03eb24 to 0x033b8d (0xaf96 bytes) 000505 1783442324.039179 trunc from 0x033b8e to 0x0088ef (0x2b29e bytes) 000506 1783442324.060205 read 0x000545 thru 0x0088ef (0x83ab bytes) 000507 1783442324.073835 write 0x002fec thru 0x00d7c6 (0xa7db bytes) 000508 1783442324.076545 read 0x006245 thru 0x00d7c6 (0x7582 bytes) 000509 1783442324.078175 mapread 0x0055c3 thru 0x00c457 (0x6e95 bytes) 000513 1783442324.083696 write 0x02c7f2 thru 0x033742 (0x6f51 bytes) 000514 1783442324.086533 read 0x031968 thru 0x033742 (0x1ddb bytes) 000515 1783442324.087853 write 0x01ea8b thru 0x020a51 (0x1fc7 bytes) 000516 1783442324.103214 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x33743): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33743): Mirror 3: 0xdf519c8c (stale) Mirror 7: 0xdf519c8c (stale) Mirror 9: 0xdf519c8c (stale) Mirror 10: 0xdf519c8c (stale) Mirror 11: 0xdf519c8c (stale) Mirror 13: 0xdf519c8c (stale) Mirror 14: 0xdf519c8c (stale) Mirror 15: 0xdf519c8c (stale) Mirror 17: 0xdf519c8c (stale) Mirror 18: 0xdf519c8c (stale) CRC-32 checksum value for chunk [0, 0x33743): Mirror 1: 0x56fa10b1 Mirror 19: 0x56fa10b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33743: skipped 000517 1783442325.173419 trunc from 0x033743 to 0x0131d6 (0x2056c bytes) 000518 1783442325.396734 trunc from 0x0131d7 to 0x02e05e (0x1ae88 bytes) 000519 1783442325.421414 mapread 0x0285d9 thru 0x02e05e (0x5a86 bytes) 000521 1783442325.439149 read 0x026830 thru 0x02ccc2 (0x6493 bytes) 000523 1783442325.442543 mapread 0x00272a thru 0x002839 (0x110 bytes) 000524 1783442325.455345 read 0x02c583 thru 0x02e05e (0x1adc bytes) 000528 1783442325.464148 trunc from 0x02e05f to 0x00e9c3 (0x1f69b bytes) 000529 1783442325.486476 MIRROR_RESYNC 12 mirrors 000530 1783442327.307065 write 0x020d17 thru 0x023193 (0x247d bytes) 000531 1783442327.419458 trunc from 0x023194 to 0x006598 (0x1cbfb bytes) 000532 1783442327.455012 mapwrite 0x01d99f thru 0x01ef60 (0x15c2 bytes) 000533 1783442327.584957 read 0x016c20 thru 0x01d917 (0x6cf8 bytes) 000534 1783442327.598961 mapread 0x010a29 thru 0x01ef60 (0xe538 bytes) 000535 1783442327.614722 write 0x0049dd thru 0x00e333 (0x9957 bytes) 000536 1783442327.627573 mapwrite 0x03aeb1 thru 0x03d061 (0x21b1 bytes) 000537 1783442327.705191 trunc from 0x03d062 to 0x03a9b7 (0x26aa bytes) 000538 1783442327.720588 read 0x0195a4 thru 0x01bdea (0x2847 bytes) 000539 1783442327.721755 mapwrite 0x02fa01 thru 0x037111 (0x7711 bytes) 000540 1783442327.797355 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a9b8): Mirror 3: 0x2d1ddc38 (stale) Mirror 7: 0x2d1ddc38 (stale) Mirror 9: 0x2d1ddc38 (stale) Mirror 10: 0x2d1ddc38 (stale) Mirror 11: 0x2d1ddc38 (stale) Mirror 13: 0x2d1ddc38 (stale) Mirror 14: 0x2d1ddc38 (stale) Mirror 15: 0x2d1ddc38 (stale) Mirror 17: 0x2d1ddc38 (stale) Mirror 19: 0x2d1ddc38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a9b8): Mirror 3: 0x2d1ddc38 (stale) Mirror 7: 0x2d1ddc38 (stale) Mirror 9: 0x2d1ddc38 (stale) Mirror 10: 0x2d1ddc38 (stale) Mirror 11: 0x2d1ddc38 (stale) Mirror 13: 0x2d1ddc38 (stale) Mirror 14: 0x2d1ddc38 (stale) Mirror 15: 0x2d1ddc38 (stale) Mirror 17: 0x2d1ddc38 (stale) Mirror 19: 0x2d1ddc38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a9b8: skipped 000541 1783442328.529219 mapread 0x00dda4 thru 0x01bc1f (0xde7c bytes) 000542 1783442328.556539 write 0x03f256 thru 0x03ffff (0xdaa bytes) 000543 1783442328.564547 MIRROR_RESYNC 11 mirrors 000545 1783442330.394053 write 0x021f49 thru 0x02bd5d (0x9e15 bytes) 000548 1783442330.475155 read 0x03130d thru 0x0351f9 (0x3eed bytes) 000549 1783442330.484307 mapwrite 0x012a26 thru 0x020b58 (0xe133 bytes) 000550 1783442330.564596 trunc from 0x040000 to 0x002dcf (0x3d230 bytes) 000553 1783442330.582831 trunc from 0x002dd0 to 0x028541 (0x25772 bytes) 000554 1783442330.606133 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x28542): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28542): Mirror 3: 0xa4286eb3 (stale) Mirror 7: 0xa4286eb3 (stale) Mirror 9: 0xa4286eb3 (stale) Mirror 10: 0xa4286eb3 (stale) Mirror 11: 0xa4286eb3 (stale) Mirror 13: 0xa4286eb3 (stale) Mirror 14: 0xa4286eb3 (stale) Mirror 15: 0xa4286eb3 (stale) Mirror 17: 0xa4286eb3 (stale) Mirror 19: 0xa4286eb3 (stale) CRC-32 checksum value for chunk [0, 0x28542): Mirror 1: 0xd7e2ea59 Mirror 20: 0xd7e2ea59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28542: skipped 000555 1783442332.191962 trunc from 0x028542 to 0x014b88 (0x139b9 bytes) 000558 1783442332.302751 write 0x039a4e thru 0x039dc9 (0x37c bytes) 000560 1783442332.308249 trunc from 0x039dca to 0x017abe (0x2230b bytes) 000561 1783442332.328957 read 0x00b9f5 thru 0x017abe (0xc0ca bytes) 000563 1783442332.342567 mapwrite 0x03abf6 thru 0x03ffff (0x540a bytes) 000565 1783442332.450865 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x10c876cc (stale) Mirror 7: 0x10c876cc (stale) Mirror 9: 0x10c876cc (stale) Mirror 10: 0x10c876cc (stale) Mirror 11: 0x10c876cc (stale) Mirror 13: 0x10c876cc (stale) Mirror 14: 0x10c876cc (stale) Mirror 15: 0x10c876cc (stale) Mirror 17: 0x10c876cc (stale) Mirror 19: 0x10c876cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x10c876cc (stale) Mirror 7: 0x10c876cc (stale) Mirror 9: 0x10c876cc (stale) Mirror 10: 0x10c876cc (stale) Mirror 11: 0x10c876cc (stale) Mirror 13: 0x10c876cc (stale) Mirror 14: 0x10c876cc (stale) Mirror 15: 0x10c876cc (stale) Mirror 17: 0x10c876cc (stale) Mirror 19: 0x10c876cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000566 1783442333.305862 read 0x035c65 thru 0x0362a2 (0x63e bytes) 000567 1783442333.317657 read 0x01d28b thru 0x02b15b (0xded1 bytes) 000571 1783442333.349659 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x10c876cc (stale) Mirror 7: 0x10c876cc (stale) Mirror 9: 0x10c876cc (stale) Mirror 10: 0x10c876cc (stale) Mirror 11: 0x10c876cc (stale) Mirror 14: 0x10c876cc (stale) Mirror 15: 0x10c876cc (stale) Mirror 17: 0x10c876cc (stale) Mirror 19: 0x10c876cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x10c876cc (stale) Mirror 7: 0x10c876cc (stale) Mirror 9: 0x10c876cc (stale) Mirror 10: 0x10c876cc (stale) Mirror 11: 0x10c876cc (stale) Mirror 14: 0x10c876cc (stale) Mirror 15: 0x10c876cc (stale) Mirror 17: 0x10c876cc (stale) Mirror 19: 0x10c876cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000572 1783442333.961763 read 0x03bfe2 thru 0x03c88e (0x8ad bytes) 000575 1783442333.973020 read 0x0207e9 thru 0x02c988 (0xc1a0 bytes) 000577 1783442334.004887 read 0x007d3b thru 0x01616d (0xe433 bytes) 000579 1783442334.015078 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x10c876cc (stale) Mirror 9: 0x10c876cc (stale) Mirror 10: 0x10c876cc (stale) Mirror 11: 0x10c876cc (stale) Mirror 14: 0x10c876cc (stale) Mirror 15: 0x10c876cc (stale) Mirror 17: 0x10c876cc (stale) Mirror 19: 0x10c876cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x10c876cc (stale) Mirror 9: 0x10c876cc (stale) Mirror 10: 0x10c876cc (stale) Mirror 11: 0x10c876cc (stale) Mirror 14: 0x10c876cc (stale) Mirror 15: 0x10c876cc (stale) Mirror 17: 0x10c876cc (stale) Mirror 19: 0x10c876cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000580 1783442334.626178 write 0x003aac thru 0x008b3b (0x5090 bytes) 000582 1783442334.642401 mapwrite 0x037408 thru 0x0375f7 (0x1f0 bytes) 000583 1783442334.748538 mapread 0x034a76 thru 0x03a017 (0x55a2 bytes) 000584 1783442334.766036 read 0x007914 thru 0x00e57f (0x6c6c bytes) 000586 1783442334.775256 mapread 0x03b921 thru 0x03ffff (0x46df bytes) 000587 1783442334.782202 mapwrite 0x0006d3 thru 0x007bb2 (0x74e0 bytes) 000588 1783442334.874315 trunc from 0x040000 to 0x03a58c (0x5a73 bytes) 000589 1783442334.901797 write 0x01b23f thru 0x024c98 (0x9a5a bytes) 000590 1783442334.920674 write 0x01678e thru 0x01ab43 (0x43b6 bytes) 000591 1783442334.939046 mapread 0x0179f2 thru 0x01d83c (0x5e4b bytes) 000594 1783442334.960669 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a58d): Mirror 7: 0x8af8d2c (stale) Mirror 9: 0x8af8d2c (stale) Mirror 10: 0x8af8d2c (stale) Mirror 11: 0x8af8d2c (stale) Mirror 14: 0x8af8d2c (stale) Mirror 15: 0x8af8d2c (stale) Mirror 17: 0x8af8d2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a58d): Mirror 7: 0x8af8d2c (stale) Mirror 9: 0x8af8d2c (stale) Mirror 10: 0x8af8d2c (stale) Mirror 11: 0x8af8d2c (stale) Mirror 14: 0x8af8d2c (stale) Mirror 15: 0x8af8d2c (stale) Mirror 17: 0x8af8d2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a58d: skipped 000600 1783442335.656169 mapwrite 0x034190 thru 0x03a310 (0x6181 bytes) 000601 1783442335.723307 mapread 0x00d57e thru 0x00e6e3 (0x1166 bytes) 000602 1783442335.732643 read 0x002f3a thru 0x00e551 (0xb618 bytes) 000603 1783442335.738628 write 0x027233 thru 0x034b55 (0xd923 bytes) 000605 1783442335.745218 mapread 0x02b979 thru 0x038cc3 (0xd34b bytes) 000606 1783442335.746552 mapread 0x007678 thru 0x0076e5 (0x6e bytes) 000608 1783442335.755416 mapwrite 0x00825c thru 0x00e97a (0x671f bytes) 000609 1783442335.835219 MIRROR_RESYNC 8 mirrors 000610 1783442337.609088 mapread 0x016050 thru 0x01e07f (0x8030 bytes) 000611 1783442337.643143 MIRROR_EXTEND to 9 mirrors 000613 1783442338.453185 write 0x0372cd thru 0x037325 (0x59 bytes) 000616 1783442338.548763 trunc from 0x03a58d to 0x021076 (0x19516 bytes) 000621 1783442338.571103 mapwrite 0x02f888 thru 0x0300b6 (0x82f bytes) 000623 1783442338.650983 mapwrite 0x02263a thru 0x02305c (0xa23 bytes) 000624 1783442338.751685 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x300b7): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x300b7): Mirror 7: 0x5c81ed51 (stale) Mirror 9: 0x5c81ed51 (stale) Mirror 10: 0x5c81ed51 (stale) Mirror 11: 0x5c81ed51 (stale) Mirror 14: 0x5c81ed51 (stale) Mirror 15: 0x5c81ed51 (stale) Mirror 17: 0x5c81ed51 (stale) Mirror 18: 0x5c81ed51 (stale) CRC-32 checksum value for chunk [0, 0x300b7): Mirror 1: 0xf45dc9ce Mirror 19: 0xf45dc9ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x300b7: skipped 000625 1783442339.947154 mapwrite 0x0333e7 thru 0x03a719 (0x7333 bytes) 000626 1783442340.128945 mapread 0x038614 thru 0x03a719 (0x2106 bytes) 000627 1783442340.130031 write 0x019a7e thru 0x01d09f (0x3622 bytes) 000631 1783442340.147257 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3a71a): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a71a): Mirror 7: 0x840ba4d4 (stale) Mirror 9: 0x840ba4d4 (stale) Mirror 10: 0x840ba4d4 (stale) Mirror 11: 0x840ba4d4 (stale) Mirror 14: 0x840ba4d4 (stale) Mirror 15: 0x840ba4d4 (stale) Mirror 17: 0x840ba4d4 (stale) Mirror 18: 0x840ba4d4 (stale) Mirror 19: 0xb043787d (stale) CRC-32 checksum value for chunk [0, 0x3a71a): Mirror 1: 0x3cb25b3b Mirror 20: 0x3cb25b3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a71a: skipped 000633 1783442341.092043 write 0x00bee4 thru 0x011364 (0x5481 bytes) 000634 1783442341.181133 mapwrite 0x038d75 thru 0x039cd4 (0xf60 bytes) 000635 1783442341.240880 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a71a): Mirror 7: 0x840ba4d4 (stale) Mirror 9: 0x840ba4d4 (stale) Mirror 10: 0x840ba4d4 (stale) Mirror 11: 0x840ba4d4 (stale) Mirror 14: 0x840ba4d4 (stale) Mirror 17: 0x840ba4d4 (stale) Mirror 18: 0x840ba4d4 (stale) Mirror 19: 0xb043787d (stale) Mirror 20: 0x3cb25b3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a71a): Mirror 7: 0x840ba4d4 (stale) Mirror 9: 0x840ba4d4 (stale) Mirror 10: 0x840ba4d4 (stale) Mirror 11: 0x840ba4d4 (stale) Mirror 14: 0x840ba4d4 (stale) Mirror 17: 0x840ba4d4 (stale) Mirror 18: 0x840ba4d4 (stale) Mirror 19: 0xb043787d (stale) Mirror 20: 0x3cb25b3b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a71a: skipped 000636 1783442341.862975 mapwrite 0x018e75 thru 0x01ef29 (0x60b5 bytes) 000638 1783442341.923273 MIRROR_RESYNC 10 mirrors 000643 1783442343.873974 write 0x01756f thru 0x02107b (0x9b0d bytes) 000645 1783442343.974863 read 0x034ff0 thru 0x03682f (0x1840 bytes) 000649 1783442343.987816 read 0x0140e3 thru 0x023bfc (0xfb1a bytes) 000650 1783442343.998161 mapread 0x01ff7b thru 0x026748 (0x67ce bytes) 000651 1783442343.999921 write 0x023a5f thru 0x032ca8 (0xf24a bytes) 000652 1783442344.001489 read 0x039ac8 thru 0x03a719 (0xc52 bytes) 000654 1783442344.003505 mapwrite 0x012ee8 thru 0x017fe6 (0x50ff bytes) 000655 1783442344.102905 write 0x0140e6 thru 0x0194c0 (0x53db bytes) 000657 1783442344.116184 write 0x009c85 thru 0x00a03c (0x3b8 bytes) 000658 1783442344.119089 trunc from 0x03a71a to 0x01b347 (0x1f3d2 bytes) 000660 1783442344.157787 mapread 0x0169f2 thru 0x01b347 (0x4956 bytes) 000661 1783442344.168956 MIRROR_RESYNC 10 mirrors 000663 1783442345.941114 mapread 0x001460 thru 0x00996d (0x850e bytes) 000664 1783442345.966781 read 0x0173f8 thru 0x01b347 (0x3f50 bytes) 000666 1783442345.975955 trunc from 0x01b348 to 0x020ecc (0x5b85 bytes) 000668 1783442346.058167 mapread 0x016c8f thru 0x020ecc (0xa23e bytes) 000669 1783442346.080969 trunc from 0x020ecd to 0x00e530 (0x1299c bytes) 000670 1783442346.108082 trunc from 0x00e531 to 0x035708 (0x271d8 bytes) 000671 1783442346.121394 mapread 0x00d625 thru 0x01adaf (0xd78b bytes) 000672 1783442346.141739 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35709): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35709): Mirror 7: 0x797db199 (stale) Mirror 9: 0x797db199 (stale) Mirror 10: 0x797db199 (stale) Mirror 11: 0x797db199 (stale) Mirror 14: 0x797db199 (stale) Mirror 17: 0x797db199 (stale) Mirror 18: 0x797db199 (stale) Mirror 19: 0x797db199 (stale) Mirror 20: 0x797db199 (stale) CRC-32 checksum value for chunk [0, 0x35709): Mirror 1: 0xf655e312 Mirror 21: 0xf655e312 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35709: skipped 000673 1783442347.239430 trunc from 0x035709 to 0x029a37 (0xbcd1 bytes) 000674 1783442347.383988 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29a38): Mirror 9: 0xbd725590 (stale) Mirror 10: 0xbd725590 (stale) Mirror 11: 0xbd725590 (stale) Mirror 14: 0xbd725590 (stale) Mirror 17: 0xbd725590 (stale) Mirror 18: 0xbd725590 (stale) Mirror 19: 0xbd725590 (stale) Mirror 20: 0xbd725590 (stale) Mirror 21: 0x413f01c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29a38): Mirror 9: 0xbd725590 (stale) Mirror 10: 0xbd725590 (stale) Mirror 11: 0xbd725590 (stale) Mirror 14: 0xbd725590 (stale) Mirror 17: 0xbd725590 (stale) Mirror 18: 0xbd725590 (stale) Mirror 19: 0xbd725590 (stale) Mirror 20: 0xbd725590 (stale) Mirror 21: 0x413f01c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29a38: skipped 000675 1783442348.028941 mapwrite 0x006502 thru 0x01170f (0xb20e bytes) 000676 1783442348.164314 MIRROR_RESYNC 10 mirrors 000677 1783442349.979923 write 0x02ee70 thru 0x0314db (0x266c bytes) 000679 1783442350.118228 write 0x028459 thru 0x03632c (0xded4 bytes) 000680 1783442350.134385 mapread 0x017a64 thru 0x01e5a8 (0x6b45 bytes) 000681 1783442350.178299 write 0x02b998 thru 0x032d59 (0x73c2 bytes) 000682 1783442350.180380 write 0x02d753 thru 0x037b29 (0xa3d7 bytes) 000683 1783442350.183181 read 0x00bb52 thru 0x0129f4 (0x6ea3 bytes) 000684 1783442350.193108 trunc from 0x037b2a to 0x02e8b8 (0x9271 bytes) 000685 1783442350.230288 read 0x00bd04 thru 0x019304 (0xd601 bytes) 000687 1783442350.231668 write 0x00ab40 thru 0x01398d (0x8e4e bytes) 000688 1783442350.260006 read 0x0293fd thru 0x02ae4d (0x1a51 bytes) 000692 1783442350.268079 write 0x026a4e thru 0x0306f1 (0x9ca4 bytes) 000693 1783442350.270901 write 0x03728c thru 0x03ffff (0x8d74 bytes) 000694 1783442350.273184 mapwrite 0x02c5d3 thru 0x03557c (0x8faa bytes) 000697 1783442350.376550 read 0x00ce05 thru 0x00f8f2 (0x2aee bytes) 000698 1783442350.377757 read 0x00fb54 thru 0x016e42 (0x72ef bytes) 000701 1783442350.382257 mapwrite 0x005b40 thru 0x00e66e (0x8b2f bytes) 000703 1783442350.449285 mapread 0x0375a5 thru 0x03897b (0x13d7 bytes) 000704 1783442350.451949 mapread 0x01a970 thru 0x01e36d (0x39fe bytes) 000709 1783442350.458904 read 0x036530 thru 0x03f929 (0x93fa bytes) 000711 1783442350.461345 mapread 0x0132b2 thru 0x022683 (0xf3d2 bytes) 000712 1783442350.463293 read 0x02954c thru 0x035a34 (0xc4e9 bytes) 000713 1783442350.469225 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ef3a4b7 (stale) Mirror 10: 0x6ef3a4b7 (stale) Mirror 11: 0x6ef3a4b7 (stale) Mirror 14: 0x6ef3a4b7 (stale) Mirror 17: 0x6ef3a4b7 (stale) Mirror 18: 0x6ef3a4b7 (stale) Mirror 19: 0x6ef3a4b7 (stale) Mirror 20: 0x6ef3a4b7 (stale) Mirror 21: 0x6ef3a4b7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xff261e53 Mirror 22: 0xff261e53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000715 1783442351.470033 write 0x004310 thru 0x00c632 (0x8323 bytes) 000716 1783442351.548330 write 0x022455 thru 0x02ef5a (0xcb06 bytes) 000717 1783442351.561950 trunc from 0x040000 to 0x0025a1 (0x3da5e bytes) 000719 1783442351.604255 trunc from 0x0025a2 to 0x0261be (0x23c1d bytes) 000720 1783442351.622929 mapwrite 0x03d7b0 thru 0x03ffff (0x2850 bytes) 000721 1783442351.707136 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ef3a4b7 (stale) Mirror 10: 0x6ef3a4b7 (stale) Mirror 11: 0x6ef3a4b7 (stale) Mirror 14: 0x6ef3a4b7 (stale) Mirror 17: 0x6ef3a4b7 (stale) Mirror 18: 0x6ef3a4b7 (stale) Mirror 19: 0x6ef3a4b7 (stale) Mirror 20: 0x6ef3a4b7 (stale) Mirror 21: 0x6ef3a4b7 (stale) Mirror 22: 0xff261e53 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x889781c4 Mirror 23: 0x889781c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000722 1783442353.042246 write 0x026152 thru 0x031a89 (0xb938 bytes) 000723 1783442353.177779 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ef3a4b7 (stale) Mirror 11: 0x6ef3a4b7 (stale) Mirror 14: 0x6ef3a4b7 (stale) Mirror 17: 0x6ef3a4b7 (stale) Mirror 18: 0x6ef3a4b7 (stale) Mirror 19: 0x6ef3a4b7 (stale) Mirror 20: 0x6ef3a4b7 (stale) Mirror 21: 0x6ef3a4b7 (stale) Mirror 22: 0xff261e53 (stale) Mirror 23: 0x889781c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ef3a4b7 (stale) Mirror 11: 0x6ef3a4b7 (stale) Mirror 14: 0x6ef3a4b7 (stale) Mirror 17: 0x6ef3a4b7 (stale) Mirror 18: 0x6ef3a4b7 (stale) Mirror 19: 0x6ef3a4b7 (stale) Mirror 20: 0x6ef3a4b7 (stale) Mirror 21: 0x6ef3a4b7 (stale) Mirror 22: 0xff261e53 (stale) Mirror 23: 0x889781c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000726 1783442353.806307 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ef3a4b7 (stale) Mirror 11: 0x6ef3a4b7 (stale) Mirror 14: 0x6ef3a4b7 (stale) Mirror 17: 0x6ef3a4b7 (stale) Mirror 18: 0x6ef3a4b7 (stale) Mirror 19: 0x6ef3a4b7 (stale) Mirror 20: 0x6ef3a4b7 (stale) Mirror 21: 0x6ef3a4b7 (stale) Mirror 22: 0xff261e53 (stale) Mirror 23: 0x889781c4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb925c8c0 Mirror 24: 0xb925c8c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000729 1783442355.107082 read 0x001aaa thru 0x003aea (0x2041 bytes) 000730 1783442355.128784 trunc from 0x040000 to 0x034c4f (0xb3b0 bytes) 000731 1783442355.255581 trunc from 0x034c50 to 0x03c136 (0x74e7 bytes) 000732 1783442355.281369 write 0x0183be thru 0x01e533 (0x6176 bytes) 000733 1783442355.307529 mapwrite 0x034a0a thru 0x0387c8 (0x3dbf bytes) 000735 1783442355.451954 write 0x03da83 thru 0x03ffff (0x257d bytes) 000738 1783442355.455911 write 0x021fcf thru 0x0235e9 (0x161b bytes) 000739 1783442355.466910 read 0x027cd3 thru 0x02b29e (0x35cc bytes) 000740 1783442355.506215 read 0x001b55 thru 0x002f9f (0x144b bytes) 000741 1783442355.508763 trunc from 0x040000 to 0x038cce (0x7331 bytes) 000742 1783442355.559240 read 0x03037c thru 0x0323a0 (0x2025 bytes) 000743 1783442355.560299 trunc from 0x038ccf to 0x01cb09 (0x1c1c5 bytes) 000744 1783442355.589670 mapread 0x00f407 thru 0x01a76b (0xb365 bytes) 000746 1783442355.597344 write 0x014505 thru 0x018e01 (0x48fd bytes) 000747 1783442355.601263 mapread 0x01b8a1 thru 0x01cb09 (0x1269 bytes) 000748 1783442355.604321 write 0x009b95 thru 0x016d8f (0xd1fb bytes) 000749 1783442355.607386 write 0x028403 thru 0x033691 (0xb28f bytes) 000750 1783442355.617336 trunc from 0x033692 to 0x0002be (0x333d3 bytes) 000751 1783442355.641084 write 0x038f01 thru 0x03d4c9 (0x45c9 bytes) 000752 1783442355.643321 mapwrite 0x01bd2c thru 0x02a328 (0xe5fd bytes) 000753 1783442355.769793 trunc from 0x03d4ca to 0x036c44 (0x6885 bytes) 000754 1783442355.798790 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x36c45): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36c45): Mirror 9: 0x6c05279a (stale) Mirror 11: 0x6c05279a (stale) Mirror 14: 0x6c05279a (stale) Mirror 17: 0x6c05279a (stale) Mirror 18: 0x6c05279a (stale) Mirror 19: 0x6c05279a (stale) Mirror 20: 0x6c05279a (stale) Mirror 21: 0x6c05279a (stale) Mirror 22: 0x21f7efaa (stale) Mirror 23: 0xff592f3f (stale) Mirror 24: 0x67c54ecc (stale) CRC-32 checksum value for chunk [0, 0x36c45): Mirror 1: 0x8f1e20a8 Mirror 25: 0x8f1e20a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36c45: skipped 000755 1783442356.915978 mapread 0x005c8e thru 0x00e393 (0x8706 bytes) 000756 1783442356.952738 write 0x032a8d thru 0x035f1f (0x3493 bytes) 000757 1783442357.040676 write 0x012f5e thru 0x0134b0 (0x553 bytes) 000758 1783442357.053918 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x36c45): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36c45): Mirror 9: 0x6c05279a (stale) Mirror 11: 0x6c05279a (stale) Mirror 14: 0x6c05279a (stale) Mirror 17: 0x6c05279a (stale) Mirror 18: 0x6c05279a (stale) Mirror 19: 0x6c05279a (stale) Mirror 20: 0x6c05279a (stale) Mirror 21: 0x6c05279a (stale) Mirror 22: 0x21f7efaa (stale) Mirror 23: 0xff592f3f (stale) Mirror 24: 0x67c54ecc (stale) Mirror 25: 0x8f1e20a8 (stale) CRC-32 checksum value for chunk [0, 0x36c45): Mirror 1: 0x22ca3af3 Mirror 26: 0x22ca3af3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36c45: skipped 000767 1783442358.443181 write 0x0317bf thru 0x038a17 (0x7259 bytes) 000771 1783442358.603267 mapwrite 0x0007cc thru 0x00fdb5 (0xf5ea bytes) 000774 1783442358.681832 trunc from 0x038a18 to 0x0097d9 (0x2f23e bytes) 000775 1783442358.698395 read 0x001553 thru 0x002dc3 (0x1871 bytes) 000776 1783442358.699097 mapwrite 0x031e24 thru 0x034cf2 (0x2ecf bytes) 000779 1783442358.821550 MIRROR_RESYNC 14 mirrors 000781 1783442360.572905 mapwrite 0x026b33 thru 0x02995a (0x2e28 bytes) 000782 1783442360.750862 mapread 0x00f727 thru 0x01a63a (0xaf14 bytes) 000783 1783442360.766967 read 0x02d356 thru 0x034cf2 (0x799d bytes) 000785 1783442360.774102 write 0x021fd7 thru 0x02d9f1 (0xba1b bytes) 000788 1783442360.777426 read 0x01aae1 thru 0x0278db (0xcdfb bytes) 000791 1783442360.779782 mapread 0x013cef thru 0x0184c0 (0x47d2 bytes) 000792 1783442360.781139 trunc from 0x034cf3 to 0x021944 (0x133ae bytes) 000794 1783442360.799813 trunc from 0x021945 to 0x010a4d (0x10ef7 bytes) 000796 1783442360.815739 write 0x020e1d thru 0x02fc8c (0xee70 bytes) 000797 1783442360.820865 mapwrite 0x01c85f thru 0x0260b7 (0x9859 bytes) 000798 1783442360.940288 mapread 0x0270c6 thru 0x02d6e5 (0x6620 bytes) 000799 1783442360.947226 mapread 0x0052c2 thru 0x00c112 (0x6e51 bytes) 000802 1783442360.959496 read 0x020755 thru 0x02fb4f (0xf3fb bytes) 000804 1783442360.962073 write 0x001856 thru 0x002e04 (0x15af bytes) 000808 1783442360.968762 read 0x02b1e9 thru 0x02fc8c (0x4aa4 bytes) 000809 1783442360.970375 write 0x01e455 thru 0x02e28c (0xfe38 bytes) 000810 1783442360.972450 write 0x02d52b thru 0x0381cc (0xaca2 bytes) 000812 1783442360.975645 write 0x000d0d thru 0x003f63 (0x3257 bytes) 000813 1783442360.977656 write 0x001ac4 thru 0x00b02f (0x956c bytes) 000814 1783442360.979892 write 0x03364b thru 0x03ffff (0xc9b5 bytes) 000817 1783442360.984559 write 0x0121da thru 0x0123b9 (0x1e0 bytes) 000818 1783442360.999185 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa8847407 (stale) Mirror 11: 0xa8847407 (stale) Mirror 14: 0xa8847407 (stale) Mirror 17: 0xa8847407 (stale) Mirror 18: 0xa8847407 (stale) Mirror 19: 0xa8847407 (stale) Mirror 20: 0xa8847407 (stale) Mirror 21: 0xa8847407 (stale) Mirror 22: 0xa8847407 (stale) Mirror 23: 0xa8847407 (stale) Mirror 24: 0xa8847407 (stale) Mirror 25: 0xa8847407 (stale) Mirror 26: 0xa8847407 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xddd64da7 Mirror 27: 0xddd64da7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1783442362.735556 mapwrite 0x013004 thru 0x01a88a (0x7887 bytes) 000820 1783442362.961160 trunc from 0x040000 to 0x03c247 (0x3db8 bytes) 000821 1783442362.991793 mapwrite 0x02d55d thru 0x02e18a (0xc2e bytes) 000822 1783442363.036058 trunc from 0x03c248 to 0x024d65 (0x174e2 bytes) 000823 1783442363.051556 trunc from 0x024d66 to 0x01687a (0xe4eb bytes) 000825 1783442363.071640 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1687b): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1687b): Mirror 9: 0xe3f51225 (stale) Mirror 11: 0xe3f51225 (stale) Mirror 14: 0xe3f51225 (stale) Mirror 17: 0xe3f51225 (stale) Mirror 18: 0xe3f51225 (stale) Mirror 19: 0xe3f51225 (stale) Mirror 20: 0xe3f51225 (stale) Mirror 21: 0xe3f51225 (stale) Mirror 22: 0xe3f51225 (stale) Mirror 23: 0xe3f51225 (stale) Mirror 24: 0xe3f51225 (stale) Mirror 25: 0xe3f51225 (stale) Mirror 26: 0xe3f51225 (stale) Mirror 27: 0x89692241 (stale) CRC-32 checksum value for chunk [0, 0x1687b): Mirror 1: 0xcbd98b7b Mirror 28: 0xcbd98b7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1687b: skipped 000827 1783442364.394129 write 0x016277 thru 0x024de8 (0xeb72 bytes) 000829 1783442364.518547 mapread 0x005f8b thru 0x013b17 (0xdb8d bytes) 000832 1783442364.546011 mapwrite 0x03f816 thru 0x03ffff (0x7ea bytes) 000833 1783442364.651107 trunc from 0x040000 to 0x02eb80 (0x1147f bytes) 000835 1783442364.672791 trunc from 0x02eb81 to 0x0266d8 (0x84a8 bytes) 000838 1783442364.704835 MIRROR_RESYNC 16 mirrors 000839 1783442366.855885 write 0x0355ef thru 0x03ffff (0xaa11 bytes) 000840 1783442366.988242 mapwrite 0x02180e thru 0x02fd88 (0xe57b bytes) 000841 1783442367.080957 read 0x01ae1d thru 0x023f73 (0x9157 bytes) 000842 1783442367.086406 mapwrite 0x008498 thru 0x00cc51 (0x47ba bytes) 000843 1783442367.150477 read 0x0097f5 thru 0x016dce (0xd5da bytes) 000844 1783442367.157824 mapread 0x032bcd thru 0x03ee45 (0xc279 bytes) 000845 1783442367.159892 mapread 0x02d446 thru 0x02fa5c (0x2617 bytes) 000846 1783442367.161024 read 0x03815f thru 0x03ffff (0x7ea1 bytes) 000848 1783442367.162763 mapread 0x02b3f7 thru 0x032f76 (0x7b80 bytes) 000849 1783442367.164339 mapwrite 0x0229ee thru 0x0318c6 (0xeed9 bytes) 000850 1783442367.226846 mapwrite 0x0382c4 thru 0x03ffff (0x7d3c bytes) 000852 1783442367.329964 MIRROR_RESYNC 16 mirrors 000855 1783442369.626744 trunc from 0x040000 to 0x02afde (0x15021 bytes) 000856 1783442369.775569 trunc from 0x02afdf to 0x026eea (0x40f4 bytes) 000857 1783442369.809403 mapwrite 0x035236 thru 0x03e6e4 (0x94af bytes) 000858 1783442369.924591 write 0x0105b6 thru 0x014add (0x4528 bytes) 000860 1783442369.936419 mapwrite 0x029919 thru 0x03934d (0xfa35 bytes) 000861 1783442370.033517 write 0x03096c thru 0x032b9b (0x2230 bytes) 000862 1783442370.034590 trunc from 0x03e6e5 to 0x033ebf (0xa825 bytes) 000863 1783442370.071165 MIRROR_RESYNC 16 mirrors 000864 1783442372.317270 mapread 0x0034ba thru 0x00e162 (0xaca9 bytes) 000866 1783442372.340005 write 0x0014ba thru 0x011149 (0xfc90 bytes) 000867 1783442372.451740 read 0x026343 thru 0x029b61 (0x381f bytes) 000870 1783442372.463832 read 0x0151fd thru 0x01e2d3 (0x90d7 bytes) 000872 1783442372.476596 trunc from 0x033ec0 to 0x000933 (0x3358c bytes) 000874 1783442372.528385 trunc from 0x000934 to 0x016a11 (0x160de bytes) 000876 1783442372.553004 mapread 0x009ddb thru 0x016a11 (0xcc37 bytes) 000877 1783442372.637289 MIRROR_RESYNC 16 mirrors 000878 1783442374.662287 trunc from 0x016a12 to 0x03e134 (0x27723 bytes) 000879 1783442374.741110 write 0x00ea8e thru 0x01271e (0x3c91 bytes) 000880 1783442374.756340 read 0x013718 thru 0x01e1b5 (0xaa9e bytes) 000884 1783442374.766932 mapread 0x01a114 thru 0x02524a (0xb137 bytes) 000890 1783442374.785785 mapwrite 0x03197a thru 0x03f47b (0xdb02 bytes) 000893 1783442374.946127 mapwrite 0x00f354 thru 0x01de75 (0xeb22 bytes) 000894 1783442375.011756 write 0x00ce2e thru 0x00d79b (0x96e bytes) 000896 1783442375.022545 mapwrite 0x02df58 thru 0x039f03 (0xbfac bytes) 000897 1783442375.077278 mapwrite 0x002604 thru 0x00a549 (0x7f46 bytes) 000898 1783442375.177567 mapread 0x03919d thru 0x03f47b (0x62df bytes) 000899 1783442375.178891 trunc from 0x03f47c to 0x004e08 (0x3a673 bytes) 000900 1783442375.220487 read 0x002a55 thru 0x004e08 (0x23b4 bytes) 000902 1783442375.228671 read 0x003002 thru 0x004e08 (0x1e07 bytes) 000904 1783442375.230123 read 0x000609 thru 0x004e08 (0x4800 bytes) 000908 1783442375.249069 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4e09): Mirror 9: 0xb39d3a3e (stale) Mirror 14: 0xb39d3a3e (stale) Mirror 17: 0xb39d3a3e (stale) Mirror 18: 0xb39d3a3e (stale) Mirror 19: 0xb39d3a3e (stale) Mirror 20: 0xb39d3a3e (stale) Mirror 21: 0xb39d3a3e (stale) Mirror 22: 0xb39d3a3e (stale) Mirror 23: 0xb39d3a3e (stale) Mirror 24: 0xb39d3a3e (stale) Mirror 25: 0xb39d3a3e (stale) Mirror 26: 0xb39d3a3e (stale) Mirror 27: 0xb39d3a3e (stale) Mirror 28: 0xb39d3a3e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4e09): Mirror 9: 0xb39d3a3e (stale) Mirror 14: 0xb39d3a3e (stale) Mirror 17: 0xb39d3a3e (stale) Mirror 18: 0xb39d3a3e (stale) Mirror 19: 0xb39d3a3e (stale) Mirror 20: 0xb39d3a3e (stale) Mirror 21: 0xb39d3a3e (stale) Mirror 22: 0xb39d3a3e (stale) Mirror 23: 0xb39d3a3e (stale) Mirror 24: 0xb39d3a3e (stale) Mirror 25: 0xb39d3a3e (stale) Mirror 26: 0xb39d3a3e (stale) Mirror 27: 0xb39d3a3e (stale) Mirror 28: 0xb39d3a3e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4e09: skipped 000911 1783442375.881888 mapread 0x0047c9 thru 0x004e08 (0x640 bytes) 000912 1783442375.888463 trunc from 0x004e09 to 0x029378 (0x24570 bytes) 000914 1783442375.911014 MIRROR_RESYNC 15 mirrors 000915 1783442378.207348 mapread 0x0236ce thru 0x029378 (0x5cab bytes) 000919 1783442378.261195 mapwrite 0x02ec49 thru 0x0368dd (0x7c95 bytes) 000920 1783442378.440293 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x368de): Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368de): Mirror 9: 0xaecf071f (stale) Mirror 14: 0xaecf071f (stale) Mirror 17: 0xaecf071f (stale) Mirror 18: 0xaecf071f (stale) Mirror 19: 0xaecf071f (stale) Mirror 20: 0xaecf071f (stale) Mirror 21: 0xaecf071f (stale) Mirror 22: 0xaecf071f (stale) Mirror 23: 0xaecf071f (stale) Mirror 24: 0xaecf071f (stale) Mirror 25: 0xaecf071f (stale) Mirror 26: 0xaecf071f (stale) Mirror 27: 0xaecf071f (stale) Mirror 28: 0xaecf071f (stale) CRC-32 checksum value for chunk [0, 0x368de): Mirror 1: 0xa12ce4ae Mirror 29: 0xa12ce4ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368de: skipped 000921 1783442379.454909 mapread 0x0061ed thru 0x0124af (0xc2c3 bytes) 000923 1783442379.515465 read 0x02f1f8 thru 0x034be9 (0x59f2 bytes) 000925 1783442379.566780 mapwrite 0x026655 thru 0x031935 (0xb2e1 bytes) 000928 1783442379.808817 trunc from 0x0368de to 0x01b321 (0x1b5bc bytes) 000929 1783442379.861749 mapwrite 0x011149 thru 0x01c6b8 (0xb570 bytes) 000930 1783442379.992379 mapwrite 0x02026f thru 0x02ea14 (0xe7a6 bytes) 000931 1783442380.089020 write 0x01c8cb thru 0x026023 (0x9759 bytes) 000934 1783442380.096246 mapread 0x01bae3 thru 0x01e50f (0x2a2d bytes) 000935 1783442380.097647 trunc from 0x02ea15 to 0x023281 (0xb793 bytes) 000937 1783442380.139364 mapwrite 0x03cef8 thru 0x03ffff (0x3108 bytes) 000939 1783442380.247199 mapwrite 0x01a356 thru 0x0221ad (0x7e58 bytes) 000940 1783442380.348342 mapread 0x037acd thru 0x03ffff (0x8533 bytes) 000943 1783442380.357668 MIRROR_RESYNC 16 mirrors 000946 1783442382.753076 write 0x00f6e2 thru 0x0183e2 (0x8d01 bytes) 000948 1783442382.836100 trunc from 0x040000 to 0x0295af (0x16a50 bytes) 000949 1783442382.854278 mapwrite 0x02af7f thru 0x030b30 (0x5bb2 bytes) 000951 1783442382.939772 write 0x01e5c4 thru 0x0230da (0x4b17 bytes) 000952 1783442382.949291 mapwrite 0x01e3f3 thru 0x0251c9 (0x6dd7 bytes) 000954 1783442383.001868 mapread 0x02d9fb thru 0x030b30 (0x3136 bytes) 000956 1783442383.004690 trunc from 0x030b31 to 0x039e10 (0x92e0 bytes) 000958 1783442383.019890 write 0x028d46 thru 0x02a7fd (0x1ab8 bytes) 000959 1783442383.025536 MIRROR_SPLIT mirror 3 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e11): Mirror 9: 0x2d5cca9f (stale) Mirror 14: 0x2d5cca9f (stale) Mirror 18: 0x2d5cca9f (stale) Mirror 19: 0x2d5cca9f (stale) Mirror 20: 0x2d5cca9f (stale) Mirror 21: 0x2d5cca9f (stale) Mirror 22: 0x2d5cca9f (stale) Mirror 23: 0x2d5cca9f (stale) Mirror 24: 0x2d5cca9f (stale) Mirror 25: 0x2d5cca9f (stale) Mirror 26: 0x2d5cca9f (stale) Mirror 27: 0x2d5cca9f (stale) Mirror 28: 0x2d5cca9f (stale) Mirror 29: 0x2d5cca9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e11): Mirror 9: 0x2d5cca9f (stale) Mirror 14: 0x2d5cca9f (stale) Mirror 18: 0x2d5cca9f (stale) Mirror 19: 0x2d5cca9f (stale) Mirror 20: 0x2d5cca9f (stale) Mirror 21: 0x2d5cca9f (stale) Mirror 22: 0x2d5cca9f (stale) Mirror 23: 0x2d5cca9f (stale) Mirror 24: 0x2d5cca9f (stale) Mirror 25: 0x2d5cca9f (stale) Mirror 26: 0x2d5cca9f (stale) Mirror 27: 0x2d5cca9f (stale) Mirror 28: 0x2d5cca9f (stale) Mirror 29: 0x2d5cca9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e11: skipped 000964 1783442383.749918 read 0x02a25d thru 0x02cee3 (0x2c87 bytes) 000965 1783442383.761960 read 0x002f0d thru 0x00c6fe (0x97f2 bytes) 000967 1783442383.781928 read 0x020bb9 thru 0x02b171 (0xa5b9 bytes) 000969 1783442383.794207 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x39e11): Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e11): Mirror 9: 0x2d5cca9f (stale) Mirror 14: 0x2d5cca9f (stale) Mirror 18: 0x2d5cca9f (stale) Mirror 19: 0x2d5cca9f (stale) Mirror 20: 0x2d5cca9f (stale) Mirror 21: 0x2d5cca9f (stale) Mirror 22: 0x2d5cca9f (stale) Mirror 23: 0x2d5cca9f (stale) Mirror 24: 0x2d5cca9f (stale) Mirror 25: 0x2d5cca9f (stale) Mirror 26: 0x2d5cca9f (stale) Mirror 27: 0x2d5cca9f (stale) Mirror 28: 0x2d5cca9f (stale) Mirror 29: 0x2d5cca9f (stale) CRC-32 checksum value for chunk [0, 0x39e11): Mirror 1: 0xedb5aff2 Mirror 30: 0xedb5aff2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e11: skipped 000973 1783442385.021749 mapwrite 0x024cb9 thru 0x028c14 (0x3f5c bytes) 000975 1783442385.266171 trunc from 0x039e11 to 0x03e807 (0x49f7 bytes) 000976 1783442385.299089 mapread 0x026883 thru 0x03580c (0xef8a bytes) 000979 1783442385.312170 mapread 0x009330 thru 0x01478c (0xb45d bytes) 000980 1783442385.350637 trunc from 0x03e808 to 0x00074c (0x3e0bb bytes) 000981 1783442385.375934 mapread 0x0001fa thru 0x00074c (0x553 bytes) 000983 1783442385.385764 write 0x0172bd thru 0x022175 (0xaeb9 bytes) 000984 1783442385.390763 read 0x000e55 thru 0x001b81 (0xd2d bytes) 000985 1783442385.409178 mapread 0x01915b thru 0x01ca3e (0x38e4 bytes) 000988 1783442385.415847 read 0x00eb8a thru 0x016cf3 (0x816a bytes) 000990 1783442385.439184 mapread 0x0098e7 thru 0x011ede (0x85f8 bytes) 000991 1783442385.440403 trunc from 0x022176 to 0x01a8ad (0x78c8 bytes) 000992 1783442385.456752 write 0x01bd12 thru 0x01be94 (0x183 bytes) 000993 1783442385.457876 mapread 0x004d9a thru 0x013ecf (0xf136 bytes) 000994 1783442385.465901 MIRROR_RESYNC 16 mirrors 000998 1783442387.545236 trunc from 0x01be95 to 0x008344 (0x13b50 bytes) All operations completed A-OK!