== sanity-flr test 70a: flr mode fsx test ================ 21:28:43 (1787707723) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 7725 skipping zero length punch hole fallocating to largest ever: 0x11f50 000003 1787707726.252544 fallocate 0x0076ed thru 0x011f4f (0xa863 bytes) fallocating to largest ever: 0x2abc2 000004 1787707726.270240 fallocate 0x029580 thru 0x02abc1 (0x1642 bytes) 000005 1787707726.303244 MIRROR_EXTEND to 2 mirrors 000006 1787707727.334544 MIRROR_EXTEND to 3 mirrors 000007 1787707728.333079 mapwrite 0x0223c0 thru 0x022ca9 (0x8ea bytes) 000008 1787707728.486676 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2abc2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2abc2): Mirror 2: 0x579b134d (stale) Mirror 3: 0x579b134d (stale) CRC-32 checksum value for chunk [0, 0x2abc2): Mirror 1: 0x51b4e98e Mirror 4: 0x51b4e98e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2abc2: skipped 000010 1787707729.894048 mapwrite 0x033b2b thru 0x0394f5 (0x59cb bytes) 000011 1787707730.034177 trunc from 0x0221cb to 0x02e7ab (0xc5e1 bytes) 000012 1787707730.042066 fallocate 0x0159e8 thru 0x01ea32 (0x904b bytes) 000013 1787707730.048739 read 0x008292 thru 0x016ab1 (0xe820 bytes) 000014 1787707730.068363 mapread 0x01895c thru 0x01ea25 (0x60ca bytes) 000015 1787707730.080763 trunc from 0x01fa0e to 0x029330 (0x9923 bytes) 000016 1787707730.087740 punch from 0x01bb89 to 0x029da9 (0xe221 bytes) fallocating to largest ever: 0x32716 000017 1787707730.094016 fallocate 0x03009c thru 0x032715 (0x267a bytes) 000018 1787707730.099862 mapread 0x023f5c thru 0x02f101 (0xb1a6 bytes) 000019 1787707730.116777 read 0x031c20 thru 0x038b4e (0x6f2f bytes) 000020 1787707730.117508 write 0x01a9bd thru 0x021512 (0x6b56 bytes) 000021 1787707730.125189 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x394f6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394f6): Mirror 2: 0x3c4ba0cd (stale) Mirror 3: 0x3c4ba0cd (stale) Mirror 4: 0x230034b3 (stale) CRC-32 checksum value for chunk [0, 0x394f6): Mirror 1: 0x8de45937 Mirror 5: 0x8de45937 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394f6: skipped 000022 1787707731.148210 trunc from 0x0394f6 to 0x02ddfc (0xb6f9 bytes) 000023 1787707731.313935 mapwrite 0x012824 thru 0x021257 (0xea34 bytes) 000024 1787707731.462412 punch from 0x024a28 to 0x02534e (0x927 bytes) 000026 1787707731.472093 punch from 0x00e541 to 0x0112c5 (0x2d85 bytes) fallocating to largest ever: 0x3c96c 000027 1787707731.493116 fallocate 0x034e19 thru 0x03c96b (0x7b53 bytes) 000028 1787707731.503368 trunc from 0x00674c to 0x010cf8 (0xa5ad bytes) 000029 1787707731.533992 write 0x01ab1f thru 0x01fc63 (0x5145 bytes) 000030 1787707731.535584 mapwrite 0x00ce02 thru 0x0138c0 (0x6abf bytes) 000031 1787707731.680680 trunc from 0x02a538 to 0x02ddfc (0x38c5 bytes) 000032 1787707731.688471 mapwrite 0x012266 thru 0x01ebb3 (0xc94e bytes) 000033 1787707731.744590 read 0x000270 thru 0x00e5db (0xe36c bytes) 000034 1787707731.757001 trunc from 0x02ddfd to 0x0278ce (0x652e bytes) 000035 1787707731.807207 trunc from 0x0278cf to 0x011690 (0x1623e bytes) 000036 1787707731.843201 read 0x006a4f thru 0x008103 (0x16b5 bytes) 000037 1787707731.843805 trunc from 0x011691 to 0x00d7d4 (0x3ebc bytes) 000040 1787707731.885140 trunc from 0x00b26d to 0x00d7d4 (0x2568 bytes) 000042 1787707731.890789 write 0x020132 thru 0x023427 (0x32f6 bytes) 000043 1787707731.891983 punch from 0x00723e to 0x013c84 (0xca47 bytes) 000044 1787707731.902859 fallocate 0x01fcc7 thru 0x02e833 (0xeb6d bytes) 000045 1787707731.948101 MIRROR_RESYNC 5 mirrors 000046 1787707733.183765 trunc from 0x023428 to 0x02376d (0x346 bytes) 000047 1787707733.228080 mapwrite 0x003ce1 thru 0x00fa43 (0xbd63 bytes) 000049 1787707733.270600 punch from 0x01c405 to 0x01dc6c (0x1868 bytes) 000050 1787707733.275795 mapread 0x003218 thru 0x005aeb (0x28d4 bytes) 000051 1787707733.276834 fallocate 0x01bb1c thru 0x01f867 (0x3d4c bytes) 000052 1787707733.282097 fallocate 0x00d107 thru 0x0132a7 (0x61a1 bytes) 000053 1787707733.291550 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2376e): Mirror 3: 0x55ca0df7 (stale) Mirror 4: 0x55ca0df7 (stale) Mirror 5: 0x55ca0df7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2376e): Mirror 3: 0x55ca0df7 (stale) Mirror 4: 0x55ca0df7 (stale) Mirror 5: 0x55ca0df7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2376e: skipped 000054 1787707734.080351 trunc from 0x02376e to 0x00d0fb (0x16672 bytes) 000056 1787707734.149838 MIRROR_RESYNC 4 mirrors 000057 1787707735.292827 trunc from 0x00d0fc to 0x002191 (0xaf6a bytes) 000058 1787707735.367277 punch from 0x000fe5 to 0x002191 (0x11ad bytes) 000059 1787707735.373081 mapread 0x0015d5 thru 0x002191 (0xbbd bytes) 000060 1787707735.382745 trunc from 0x002192 to 0x000e84 (0x130d bytes) 000061 1787707735.429262 trunc from 0x0005d9 to 0x000e84 (0x8ac bytes) 000062 1787707735.451737 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xe85): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe85): Mirror 3: 0xd5bb8ad2 (stale) Mirror 4: 0xd5bb8ad2 (stale) Mirror 5: 0xd5bb8ad2 (stale) CRC-32 checksum value for chunk [0, 0xe85): Mirror 1: 0xd5bb8ad2 Mirror 6: 0xd5bb8ad2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe85: skipped 000063 1787707736.684702 mapread 0x000368 thru 0x000e84 (0xb1d bytes) 000064 1787707736.718551 read 0x000c0c thru 0x000e84 (0x279 bytes) 000065 1787707736.731118 fallocate 0x02b4db thru 0x03765a (0xc180 bytes) 000066 1787707736.797876 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3765b): Mirror 4: 0xc51c2524 (stale) Mirror 5: 0xc51c2524 (stale) Mirror 6: 0x3bd0e3ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3765b): Mirror 4: 0xc51c2524 (stale) Mirror 5: 0xc51c2524 (stale) Mirror 6: 0x3bd0e3ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3765b: skipped 000067 1787707737.252176 trunc from 0x03765b to 0x00ffc2 (0x27698 bytes) 000068 1787707737.284898 MIRROR_RESYNC 4 mirrors 000069 1787707738.090922 mapread 0x0017de thru 0x00da34 (0xc257 bytes) 000070 1787707738.117216 punch from 0x00bb46 to 0x00ffc2 (0x447d bytes) 000071 1787707738.186101 read 0x007a1b thru 0x00e95b (0x6f41 bytes) 000072 1787707738.214693 mapwrite 0x01e313 thru 0x0235ca (0x52b8 bytes) 000073 1787707738.266174 write 0x005c38 thru 0x009c0c (0x3fd5 bytes) 000074 1787707738.271176 trunc from 0x0235cb to 0x0319c1 (0xe3f7 bytes) 000075 1787707738.283521 mapread 0x01b847 thru 0x02034e (0x4b08 bytes) 000076 1787707738.284584 trunc from 0x0319c2 to 0x035344 (0x3983 bytes) 000078 1787707738.301521 read 0x020a7f thru 0x025f49 (0x54cb bytes) 000079 1787707738.318711 mapwrite 0x028495 thru 0x028721 (0x28d bytes) 000080 1787707738.339609 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35345): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35345): Mirror 4: 0x3628c2e6 (stale) Mirror 5: 0x3628c2e6 (stale) Mirror 6: 0x3628c2e6 (stale) CRC-32 checksum value for chunk [0, 0x35345): Mirror 1: 0x5d8b3876 Mirror 7: 0x5d8b3876 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35345: skipped 000082 1787707739.219877 trunc from 0x00d1cb to 0x0166ba (0x94f0 bytes) 000083 1787707739.269763 read 0x0193dc thru 0x028b16 (0xf73b bytes) 000084 1787707739.288570 read 0x034c43 thru 0x035038 (0x3f6 bytes) 000085 1787707739.318680 mapwrite 0x01d76c thru 0x02017e (0x2a13 bytes) 000087 1787707739.329167 mapread 0x01ef42 thru 0x02383b (0x48fa bytes) 000088 1787707739.329902 mapwrite 0x0281c0 thru 0x029f0b (0x1d4c bytes) 000089 1787707739.340642 punch from 0x02e16e to 0x035344 (0x71d7 bytes) 000090 1787707739.348960 MIRROR_RESYNC 5 mirrors 000091 1787707741.026545 write 0x009820 thru 0x00e850 (0x5031 bytes) 000092 1787707741.067199 mapread 0x01aa5c thru 0x0281b1 (0xd756 bytes) 000093 1787707741.106785 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35345): Mirror 4: 0x77655a25 (stale) Mirror 5: 0x77655a25 (stale) Mirror 7: 0x77655a25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35345): Mirror 4: 0x77655a25 (stale) Mirror 5: 0x77655a25 (stale) Mirror 7: 0x77655a25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35345: skipped 000094 1787707741.483494 fallocate 0x006e24 thru 0x016848 (0xfa25 bytes) 000095 1787707741.489280 mapwrite 0x0368b5 thru 0x03ffff (0x974b bytes) 000096 1787707741.576670 MIRROR_RESYNC 4 mirrors 000097 1787707743.043291 mapread 0x031a49 thru 0x03ab5d (0x9115 bytes) 000098 1787707743.059687 read 0x00a4d1 thru 0x00a8f8 (0x428 bytes) 000099 1787707743.070278 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000100 1787707743.510658 read 0x002249 thru 0x00f29d (0xd055 bytes) 000101 1787707743.524744 mapread 0x02a17b thru 0x03970f (0xf595 bytes) 000102 1787707743.554129 mapwrite 0x021f24 thru 0x02a032 (0x810f bytes) 000103 1787707743.660315 trunc from 0x040000 to 0x030c2b (0xf3d4 bytes) 000104 1787707743.693514 punch from 0x010973 to 0x01a419 (0x9aa7 bytes) 000105 1787707743.706325 mapread 0x00f788 thru 0x01c161 (0xc9da bytes) 000106 1787707743.731410 mapwrite 0x02260d thru 0x02bb31 (0x9525 bytes) 000107 1787707743.775507 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30c2c): Mirror 4: 0x26dc0a8e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30c2c): Mirror 4: 0x26dc0a8e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30c2c: skipped 000108 1787707744.207343 trunc from 0x011b77 to 0x01c155 (0xa5df bytes) 000109 1787707744.219758 MIRROR_RESYNC 2 mirrors 000110 1787707745.163234 trunc from 0x030c2c to 0x023e9f (0xcd8c bytes) 000111 1787707745.221529 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 4: 0x2b4c9716 (stale) CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 1: 0x2b4c9716 Mirror 5: 0x2b4c9716 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ea0: skipped 000112 1787707746.082087 fallocate 0x0149c9 thru 0x021068 (0xc6a0 bytes) 000113 1787707746.125999 mapread 0x0062ed thru 0x007186 (0xe9a bytes) 000114 1787707746.141038 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 4: 0x2b4c9716 (stale) Mirror 5: 0x2b4c9716 (stale) CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 1: 0x2b4c9716 Mirror 6: 0x2b4c9716 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ea0: skipped 000115 1787707747.180757 mapwrite 0x000b13 thru 0x00964e (0x8b3c bytes) 000116 1787707747.358402 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 5: 0x2b4c9716 (stale) Mirror 6: 0x2b4c9716 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ea0): Mirror 5: 0x2b4c9716 (stale) Mirror 6: 0x2b4c9716 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ea0: skipped 000117 1787707747.668874 trunc from 0x023ea0 to 0x0300ba (0xc21b bytes) fallocating to largest ever: 0x40000 000118 1787707747.689875 fallocate 0x03b414 thru 0x03ffff (0x4bec bytes) 000119 1787707747.696827 read 0x0380f4 thru 0x03d2ab (0x51b8 bytes) 000120 1787707747.706154 mapwrite 0x026cc2 thru 0x02704a (0x389 bytes) 000121 1787707747.732585 fallocate 0x016dd0 thru 0x024d01 (0xdf32 bytes) 000122 1787707747.737925 write 0x02a340 thru 0x02e14c (0x3e0d bytes) 000123 1787707747.753899 mapwrite 0x006044 thru 0x00665f (0x61c bytes) 000124 1787707747.790646 trunc from 0x040000 to 0x027760 (0x1889f bytes) 000125 1787707747.811059 mapread 0x013985 thru 0x013c31 (0x2ad bytes) 000126 1787707747.823654 trunc from 0x0174b5 to 0x01b968 (0x44b4 bytes) 000127 1787707747.828559 fallocate 0x02296f thru 0x02305c (0x6ee bytes) 000128 1787707747.834696 trunc from 0x027761 to 0x0377bd (0x1005d bytes) 000129 1787707747.854690 trunc from 0x0377be to 0x012c01 (0x24bbc bytes) 000130 1787707747.877475 read 0x00262c thru 0x007b79 (0x554e bytes) 000131 1787707747.879035 write 0x01d304 thru 0x02af0f (0xdc0c bytes) 000132 1787707747.883049 trunc from 0x02af10 to 0x033a12 (0x8b03 bytes) 000133 1787707747.904091 trunc from 0x02a165 to 0x02ca17 (0x28b3 bytes) 000135 1787707747.920411 trunc from 0x033a13 to 0x02d02f (0x69e3 bytes) 000136 1787707747.943710 MIRROR_RESYNC 3 mirrors 000137 1787707749.036002 punch from 0x025e70 to 0x02d02f (0x71c0 bytes) 000138 1787707749.067987 trunc from 0x02d030 to 0x0050c4 (0x27f6b bytes) 000139 1787707749.091765 mapread 0x0037ce thru 0x0050c4 (0x18f7 bytes) 000140 1787707749.113974 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x50c5): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x50c5): Mirror 5: 0xb8758ecf (stale) Mirror 6: 0xb8758ecf (stale) CRC-32 checksum value for chunk [0, 0x50c5): Mirror 1: 0xb8758ecf Mirror 7: 0xb8758ecf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x50c5: skipped 000141 1787707749.811124 fallocate 0x026a89 thru 0x033aa9 (0xd021 bytes) 000142 1787707749.874153 mapwrite 0x03a12d thru 0x03ffff (0x5ed3 bytes) 000143 1787707749.990593 write 0x014556 thru 0x0172e6 (0x2d91 bytes) 000144 1787707750.000988 mapwrite 0x020213 thru 0x02a8e2 (0xa6d0 bytes) 000145 1787707750.036981 trunc from 0x0374a9 to 0x03ffff (0x8b57 bytes) 000147 1787707750.042841 read 0x02322f thru 0x029c3d (0x6a0f bytes) 000148 1787707750.044761 punch from 0x011eea to 0x016345 (0x445c bytes) 000149 1787707750.051868 mapwrite 0x01f7e6 thru 0x027139 (0x7954 bytes) 000150 1787707750.067246 mapread 0x0329e5 thru 0x034f5c (0x2578 bytes) 000151 1787707750.074298 mapread 0x02ec5f thru 0x0384a6 (0x9848 bytes) 000152 1787707750.075050 trunc from 0x0068ed to 0x00f4b9 (0x8bcd bytes) 000153 1787707750.078655 fallocate 0x010aaa thru 0x0199a9 (0x8f00 bytes) 000154 1787707750.083705 read 0x0223ab thru 0x026906 (0x455c bytes) 000155 1787707750.084140 mapwrite 0x00d5db thru 0x010456 (0x2e7c bytes) 000156 1787707750.114411 punch from 0x01b543 to 0x021eb8 (0x6976 bytes) 000157 1787707750.119938 punch from 0x00bab1 to 0x00f18b (0x36db bytes) 000158 1787707750.128811 read 0x026160 thru 0x029d73 (0x3c14 bytes) 000159 1787707750.129409 mapread 0x01a9e7 thru 0x0272f5 (0xc90f bytes) 000160 1787707750.148493 read 0x033284 thru 0x03ffff (0xcd7c bytes) 000162 1787707750.149632 trunc from 0x040000 to 0x01e0d3 (0x21f2c bytes) 000163 1787707750.176896 trunc from 0x01e0d4 to 0x010b33 (0xd5a0 bytes) 000164 1787707750.203283 trunc from 0x00b7d8 to 0x010b33 (0x535c bytes) 000165 1787707750.211299 read 0x00a208 thru 0x00edde (0x4bd7 bytes) 000166 1787707750.226216 trunc from 0x010b34 to 0x03f99d (0x2ee6a bytes) 000167 1787707750.255263 mapread 0x03f693 thru 0x03f99d (0x30b bytes) 000168 1787707750.269148 trunc from 0x0191e3 to 0x02888e (0xf6ac bytes) 000169 1787707750.275965 punch from 0x0326de to 0x037aa5 (0x53c8 bytes) 000170 1787707750.282213 write 0x024ae1 thru 0x02f6e3 (0xac03 bytes) 000171 1787707750.288673 trunc from 0x03f99e to 0x00f9d2 (0x2ffcb bytes) 000172 1787707750.304631 punch from 0x0096d3 to 0x00f1ff (0x5b2d bytes) 000173 1787707750.309958 punch from 0x0012c0 to 0x00806c (0x6dad bytes) 000175 1787707750.316680 trunc from 0x00f9d3 to 0x013af9 (0x4127 bytes) 000176 1787707750.334378 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13afa): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13afa): Mirror 5: 0x1684c4ae (stale) Mirror 6: 0x1684c4ae (stale) Mirror 7: 0x9a3dcfd (stale) CRC-32 checksum value for chunk [0, 0x13afa): Mirror 1: 0x326a0156 Mirror 8: 0x326a0156 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13afa: skipped 000177 1787707751.047917 read 0x00ec25 thru 0x013af9 (0x4ed5 bytes) 000178 1787707751.068820 write 0x034799 thru 0x03564c (0xeb4 bytes) 000179 1787707751.125112 trunc from 0x018e00 to 0x0244d5 (0xb6d6 bytes) 000180 1787707751.133342 fallocate 0x02a13b thru 0x038c41 (0xeb07 bytes) 000181 1787707751.138886 mapwrite 0x0077b9 thru 0x00e96f (0x71b7 bytes) 000182 1787707751.194230 punch from 0x00d797 to 0x0174a7 (0x9d11 bytes) 000183 1787707751.202985 read 0x026eba thru 0x0343d5 (0xd51c bytes) 000184 1787707751.212840 write 0x0354eb thru 0x03bcdc (0x67f2 bytes) 000185 1787707751.214315 trunc from 0x002c82 to 0x0122d2 (0xf651 bytes) 000186 1787707751.218462 trunc from 0x03bcdd to 0x00bb53 (0x30189 bytes) 000187 1787707751.263397 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xbb54): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbb54): Mirror 5: 0x5fa1d981 (stale) Mirror 6: 0x5fa1d981 (stale) Mirror 7: 0x99e37d4a (stale) Mirror 8: 0x3b298a88 (stale) CRC-32 checksum value for chunk [0, 0xbb54): Mirror 1: 0x3b298a88 Mirror 9: 0x3b298a88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbb54: skipped 000188 1787707752.455769 punch from 0x00597b to 0x00bb53 (0x61d9 bytes) 000189 1787707752.501090 mapwrite 0x012214 thru 0x020ba3 (0xe990 bytes) 000190 1787707752.693928 trunc from 0x013f80 to 0x017755 (0x37d6 bytes) 000192 1787707752.703328 punch from 0x00a709 to 0x00db65 (0x345d bytes) 000193 1787707752.709898 read 0x009339 thru 0x0094e2 (0x1aa bytes) 000194 1787707752.719215 mapread 0x019f4d thru 0x01f624 (0x56d8 bytes) 000195 1787707752.723789 mapread 0x01dbf0 thru 0x020ba3 (0x2fb4 bytes) 000196 1787707752.724931 fallocate 0x02a728 thru 0x035c2c (0xb505 bytes) 000197 1787707752.735299 fallocate 0x03ad11 thru 0x03c64a (0x193a bytes) 000198 1787707752.741751 mapread 0x011d0d thru 0x01cc52 (0xaf46 bytes) 000199 1787707752.757816 mapread 0x0280f5 thru 0x02df8d (0x5e99 bytes) 000201 1787707752.774325 read 0x001559 thru 0x010a93 (0xf53b bytes) 000202 1787707752.795021 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35c2d): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c2d): Mirror 5: 0xb9243141 (stale) Mirror 6: 0xb9243141 (stale) Mirror 7: 0xbef87402 (stale) Mirror 8: 0xa6a43b40 (stale) Mirror 9: 0xa6a43b40 (stale) CRC-32 checksum value for chunk [0, 0x35c2d): Mirror 1: 0x2f1c161e Mirror 10: 0x2f1c161e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c2d: skipped 000203 1787707754.266014 read 0x02e1e7 thru 0x035c2c (0x7a46 bytes) 000204 1787707754.283330 punch from 0x0148e5 to 0x021247 (0xc963 bytes) 000206 1787707754.325442 fallocate 0x026bd0 thru 0x0290da (0x250b bytes) 000207 1787707754.331397 punch from 0x03083a to 0x030aa2 (0x269 bytes) 000208 1787707754.336860 mapread 0x029a6a thru 0x030767 (0x6cfe bytes) 000209 1787707754.353899 read 0x01d7d5 thru 0x02afb8 (0xd7e4 bytes) 000210 1787707754.363982 trunc from 0x035c2d to 0x016d19 (0x1ef13 bytes) 000211 1787707754.383904 punch from 0x0025ae to 0x00ae03 (0x8856 bytes) 000212 1787707754.389244 punch from 0x007fec to 0x0097ad (0x17c2 bytes) 000213 1787707754.394131 trunc from 0x016d1a to 0x0024f3 (0x14826 bytes) 000214 1787707754.408745 read 0x00028f thru 0x0024f3 (0x2265 bytes) 000215 1787707754.414594 fallocate 0x022846 thru 0x025f5d (0x3718 bytes) 000216 1787707754.424480 read 0x0001de thru 0x0024f3 (0x2316 bytes) 000217 1787707754.425720 punch from 0x00190a to 0x0024f3 (0xbea bytes) 000218 1787707754.433982 trunc from 0x000e41 to 0x0024f3 (0x16b3 bytes) 000219 1787707754.439584 read 0x000b04 thru 0x0024f3 (0x19f0 bytes) 000220 1787707754.446297 fallocate 0x039ba7 thru 0x03ffff (0x6459 bytes) 000221 1787707754.456829 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xadfdc4f6 (stale) Mirror 6: 0xadfdc4f6 (stale) Mirror 7: 0x19ad3c1b (stale) Mirror 8: 0xbf632222 (stale) Mirror 9: 0xbf632222 (stale) Mirror 10: 0x2f9e8c69 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcd3c8dd4 Mirror 11: 0xcd3c8dd4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000222 1787707755.704284 trunc from 0x027fc1 to 0x02b20f (0x324f bytes) 000223 1787707755.748473 write 0x035ccf thru 0x03f60a (0x993c bytes) 000224 1787707755.765295 read 0x000a61 thru 0x005d48 (0x52e8 bytes) 000226 1787707755.785961 read 0x023bdb thru 0x02f297 (0xb6bd bytes) 000227 1787707755.809390 fallocate 0x00cbb2 thru 0x00ef58 (0x23a7 bytes) 000228 1787707755.818241 punch from 0x0047fb to 0x00d960 (0x9166 bytes) 000229 1787707755.824042 read 0x025daf thru 0x034b25 (0xed77 bytes) 000230 1787707755.826272 trunc from 0x033d79 to 0x0351d1 (0x1459 bytes) 000231 1787707755.848746 fallocate 0x00cf39 thru 0x015e0e (0x8ed6 bytes) 000232 1787707755.862774 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xadfdc4f6 (stale) Mirror 7: 0x19ad3c1b (stale) Mirror 8: 0xbf632222 (stale) Mirror 9: 0xbf632222 (stale) Mirror 10: 0x2f9e8c69 (stale) Mirror 11: 0xcd3c8dd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xadfdc4f6 (stale) Mirror 7: 0x19ad3c1b (stale) Mirror 8: 0xbf632222 (stale) Mirror 9: 0xbf632222 (stale) Mirror 10: 0x2f9e8c69 (stale) Mirror 11: 0xcd3c8dd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000233 1787707756.499367 mapread 0x006a0d thru 0x00c51d (0x5b11 bytes) 000234 1787707756.538237 read 0x023918 thru 0x02a55b (0x6c44 bytes) 000235 1787707756.564249 write 0x01d60c thru 0x02a9c4 (0xd3b9 bytes) 000236 1787707756.603363 fallocate 0x00de70 thru 0x01db79 (0xfd0a bytes) 000237 1787707756.617723 trunc from 0x0329a7 to 0x036b32 (0x418c bytes) 000238 1787707756.636658 write 0x024b7c thru 0x03471f (0xfba4 bytes) 000239 1787707756.660973 write 0x037b83 thru 0x03c79a (0x4c18 bytes) 000240 1787707756.680927 read 0x0346d9 thru 0x03ef5a (0xa882 bytes) 000241 1787707756.712324 mapwrite 0x003d8a thru 0x00e320 (0xa597 bytes) 000242 1787707756.756834 mapread 0x02360f thru 0x02a9fe (0x73f0 bytes) 000243 1787707756.760848 punch from 0x004404 to 0x00735e (0x2f5b bytes) 000245 1787707756.777737 write 0x0073cc thru 0x01143b (0xa070 bytes) 000246 1787707756.790692 trunc from 0x040000 to 0x018bed (0x27412 bytes) 000247 1787707756.890410 mapwrite 0x02aa37 thru 0x02c82f (0x1df9 bytes) 000248 1787707757.016630 fallocate 0x0300a6 thru 0x035b78 (0x5ad3 bytes) 000249 1787707757.033455 mapwrite 0x027dad thru 0x035fcb (0xe21f bytes) 000250 1787707757.282343 mapwrite 0x025f82 thru 0x027f8f (0x200e bytes) 000251 1787707757.335307 trunc from 0x035fcc to 0x018e40 (0x1d18b bytes) 000252 1787707757.376217 mapwrite 0x019367 thru 0x023695 (0xa32f bytes) 000254 1787707757.521644 mapread 0x022de6 thru 0x023695 (0x8b0 bytes) 000255 1787707757.522577 punch from 0x0146c9 to 0x01e97a (0xa2b2 bytes) 000256 1787707757.532858 trunc from 0x023696 to 0x02e3f7 (0xad62 bytes) 000257 1787707757.557325 write 0x0230a4 thru 0x02e675 (0xb5d2 bytes) 000258 1787707757.565854 fallocate 0x01307f thru 0x022e41 (0xfdc3 bytes) 000259 1787707757.571816 write 0x0007b9 thru 0x00464c (0x3e94 bytes) 000261 1787707757.579186 punch from 0x00911c to 0x0098ee (0x7d3 bytes) 000262 1787707757.586774 mapread 0x000c6c thru 0x002416 (0x17ab bytes) 000263 1787707757.587995 read 0x017674 thru 0x023128 (0xbab5 bytes) 000264 1787707757.605525 mapwrite 0x03988e thru 0x03ffff (0x6772 bytes) 000265 1787707757.678843 trunc from 0x040000 to 0x003ad5 (0x3c52a bytes) 000266 1787707757.705469 trunc from 0x003ad6 to 0x01dfb0 (0x1a4db bytes) 000267 1787707757.722968 trunc from 0x01dfb1 to 0x031ca1 (0x13cf1 bytes) 000268 1787707757.748175 fallocate 0x03da8e thru 0x03ffff (0x2572 bytes) 000270 1787707757.756304 punch from 0x00cb28 to 0x01b12e (0xe607 bytes) 000271 1787707757.764750 read 0x01ec97 thru 0x02d179 (0xe4e3 bytes) 000272 1787707757.780265 fallocate 0x02b98c thru 0x0338c4 (0x7f39 bytes) 000273 1787707757.786317 write 0x027a11 thru 0x02b18e (0x377e bytes) 000275 1787707757.789743 punch from 0x0291e1 to 0x02a2c3 (0x10e3 bytes) 000276 1787707757.804265 trunc from 0x0138b5 to 0x014250 (0x99c bytes) 000277 1787707757.808989 trunc from 0x01f192 to 0x022512 (0x3381 bytes) 000278 1787707757.818344 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 6: 0xec028644 (stale) Mirror 7: 0xf880c25b (stale) Mirror 8: 0x22f6166e (stale) Mirror 9: 0x22f6166e (stale) Mirror 10: 0x14df20fb (stale) Mirror 11: 0xf2c7f869 (stale) CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 1: 0x67ca3ea5 Mirror 12: 0x67ca3ea5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ca2: skipped 000280 1787707758.863702 mapwrite 0x019dd7 thru 0x02246f (0x8699 bytes) 000281 1787707759.053937 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 6: 0xec028644 (stale) Mirror 7: 0xf880c25b (stale) Mirror 8: 0x22f6166e (stale) Mirror 9: 0x22f6166e (stale) Mirror 10: 0x14df20fb (stale) Mirror 11: 0xf2c7f869 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 6: 0xec028644 (stale) Mirror 7: 0xf880c25b (stale) Mirror 8: 0x22f6166e (stale) Mirror 9: 0x22f6166e (stale) Mirror 10: 0x14df20fb (stale) Mirror 11: 0xf2c7f869 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ca2: skipped 000282 1787707759.530180 fallocate 0x008580 thru 0x00b58d (0x300e bytes) 000283 1787707759.536002 write 0x026ffd thru 0x02a246 (0x324a bytes) 000284 1787707759.549659 write 0x021654 thru 0x03024d (0xebfa bytes) 000285 1787707759.559548 write 0x02a703 thru 0x035916 (0xb214 bytes) 000286 1787707759.565555 MIRROR_RESYNC 7 mirrors 000287 1787707761.023205 mapwrite 0x01950d thru 0x02276d (0x9261 bytes) 000289 1787707761.143869 trunc from 0x035917 to 0x00290d (0x33009 bytes) 000290 1787707761.169858 trunc from 0x00138b to 0x00290d (0x1583 bytes) 000291 1787707761.177724 fallocate 0x02d4b5 thru 0x02fd0c (0x2858 bytes) 000292 1787707761.183017 write 0x039eb1 thru 0x03ffff (0x614f bytes) 000293 1787707761.185847 read 0x00b55c thru 0x016040 (0xaae5 bytes) 000294 1787707761.196409 trunc from 0x040000 to 0x022eed (0x1d112 bytes) 000295 1787707761.215319 punch from 0x00f4c3 to 0x014012 (0x4b50 bytes) 000296 1787707761.221820 punch from 0x0028e7 to 0x009e8a (0x75a4 bytes) 000297 1787707761.232743 mapwrite 0x00f7dd thru 0x016809 (0x702d bytes) 000298 1787707761.283598 mapread 0x012d80 thru 0x021157 (0xe3d8 bytes) 000299 1787707761.305832 mapwrite 0x03567e thru 0x03c479 (0x6dfc bytes) 000300 1787707761.358682 trunc from 0x03c47a to 0x03b411 (0x1068 bytes) 000301 1787707761.380283 read 0x011f50 thru 0x01f3c9 (0xd47a bytes) 000302 1787707761.384933 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b412): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b412): Mirror 6: 0x3f3b4cbf (stale) Mirror 7: 0x3f3b4cbf (stale) Mirror 8: 0x3f3b4cbf (stale) Mirror 9: 0x3f3b4cbf (stale) Mirror 10: 0x3f3b4cbf (stale) Mirror 11: 0x3f3b4cbf (stale) CRC-32 checksum value for chunk [0, 0x3b412): Mirror 1: 0xd94c5e03 Mirror 12: 0xd94c5e03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b412: skipped 000304 1787707762.410320 fallocate 0x0074c0 thru 0x0089c1 (0x1502 bytes) 000306 1787707762.494613 punch from 0x02ca34 to 0x036bef (0xa1bc bytes) 000307 1787707762.506847 MIRROR_RESYNC 8 mirrors 000308 1787707764.671209 punch from 0x0040c6 to 0x00b94b (0x7886 bytes) 000309 1787707764.716044 write 0x02fdec thru 0x03d4f8 (0xd70d bytes) 000310 1787707764.727748 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4f9): Mirror 7: 0x49ce363e (stale) Mirror 8: 0x49ce363e (stale) Mirror 9: 0x49ce363e (stale) Mirror 10: 0x49ce363e (stale) Mirror 11: 0x49ce363e (stale) Mirror 12: 0x49ce363e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4f9): Mirror 7: 0x49ce363e (stale) Mirror 8: 0x49ce363e (stale) Mirror 9: 0x49ce363e (stale) Mirror 10: 0x49ce363e (stale) Mirror 11: 0x49ce363e (stale) Mirror 12: 0x49ce363e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4f9: skipped 000311 1787707765.174174 read 0x007b9c thru 0x00c3b7 (0x481c bytes) 000312 1787707765.183218 read 0x023314 thru 0x02b675 (0x8362 bytes) 000313 1787707765.198184 read 0x00dd01 thru 0x01ce76 (0xf176 bytes) 000314 1787707765.199139 mapwrite 0x03dc56 thru 0x03ffff (0x23aa bytes) 000315 1787707765.243239 MIRROR_RESYNC 7 mirrors 000317 1787707767.002764 write 0x034ef8 thru 0x03f0a5 (0xa1ae bytes) 000318 1787707767.048939 mapread 0x03cd40 thru 0x03d546 (0x807 bytes) 000319 1787707767.049964 fallocate 0x00f68c thru 0x01774d (0x80c2 bytes) 000320 1787707767.058206 trunc from 0x040000 to 0x0215d6 (0x1ea29 bytes) 000321 1787707767.100362 trunc from 0x0215d7 to 0x0227d5 (0x11ff bytes) 000322 1787707767.124106 mapread 0x017dbf thru 0x020547 (0x8789 bytes) 000323 1787707767.160380 trunc from 0x0227d6 to 0x017003 (0xb7d2 bytes) 000324 1787707767.188652 fallocate 0x016fab thru 0x023ade (0xcb34 bytes) 000325 1787707767.197601 mapread 0x010b04 thru 0x01dbb8 (0xd0b5 bytes) 000326 1787707767.221930 fallocate 0x00c45c thru 0x017e26 (0xb9cb bytes) 000327 1787707767.229287 mapread 0x022bc0 thru 0x023ade (0xf1f bytes) 000328 1787707767.238661 fallocate 0x015a50 thru 0x018f28 (0x34d9 bytes) 000329 1787707767.246242 read 0x00b8bb thru 0x017303 (0xba49 bytes) 000330 1787707767.259570 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x23adf): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23adf): Mirror 7: 0x6b1be3ea (stale) Mirror 8: 0x6b1be3ea (stale) Mirror 9: 0x6b1be3ea (stale) Mirror 10: 0x6b1be3ea (stale) Mirror 11: 0x6b1be3ea (stale) Mirror 12: 0x6b1be3ea (stale) CRC-32 checksum value for chunk [0, 0x23adf): Mirror 1: 0x6b1be3ea Mirror 13: 0x6b1be3ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23adf: skipped 000333 1787707768.390396 fallocate 0x00d3a7 thru 0x00d5c1 (0x21b bytes) 000334 1787707768.458398 trunc from 0x01957d to 0x01efd1 (0x5a55 bytes) 000336 1787707768.469232 mapread 0x00eec7 thru 0x00f444 (0x57e bytes) 000338 1787707768.487938 trunc from 0x023adf to 0x011a16 (0x120c8 bytes) 000339 1787707768.650772 write 0x037377 thru 0x03cdec (0x5a76 bytes) 000341 1787707768.659589 read 0x03b714 thru 0x03cdec (0x16d9 bytes) 000342 1787707768.667346 mapwrite 0x0238b7 thru 0x02f948 (0xc092 bytes) 000343 1787707768.756731 fallocate 0x028611 thru 0x030515 (0x7f05 bytes) 000345 1787707768.810539 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cded): Mirror 7: 0xc575e9f3 (stale) Mirror 8: 0xc575e9f3 (stale) Mirror 9: 0xc575e9f3 (stale) Mirror 10: 0xc575e9f3 (stale) Mirror 11: 0xc575e9f3 (stale) Mirror 13: 0x90284e39 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cded): Mirror 7: 0xc575e9f3 (stale) Mirror 8: 0xc575e9f3 (stale) Mirror 9: 0xc575e9f3 (stale) Mirror 10: 0xc575e9f3 (stale) Mirror 11: 0xc575e9f3 (stale) Mirror 13: 0x90284e39 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cded: skipped 000346 1787707769.511254 punch from 0x011af1 to 0x01fd79 (0xe289 bytes) 000347 1787707769.517640 mapread 0x019c57 thru 0x023a74 (0x9e1e bytes) 000348 1787707769.539366 mapread 0x01d1f8 thru 0x021fbe (0x4dc7 bytes) 000349 1787707769.544599 MIRROR_RESYNC 7 mirrors 000350 1787707772.219501 punch from 0x01a807 to 0x0217be (0x6fb8 bytes) 000351 1787707772.258817 trunc from 0x03cded to 0x01e591 (0x1e85b bytes) 000352 1787707772.284555 mapread 0x00ed64 thru 0x01cb3b (0xddd8 bytes) 000353 1787707772.349184 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e592): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e592): Mirror 7: 0xa88b8bf1 (stale) Mirror 8: 0xa88b8bf1 (stale) Mirror 9: 0xa88b8bf1 (stale) Mirror 10: 0xa88b8bf1 (stale) Mirror 11: 0xa88b8bf1 (stale) Mirror 13: 0xa88b8bf1 (stale) CRC-32 checksum value for chunk [0, 0x1e592): Mirror 1: 0xa88b8bf1 Mirror 14: 0xa88b8bf1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e592: skipped 000354 1787707773.500160 mapwrite 0x03f84d thru 0x03ffff (0x7b3 bytes) 000355 1787707773.594779 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x84529ee4 (stale) Mirror 8: 0x84529ee4 (stale) Mirror 9: 0x84529ee4 (stale) Mirror 10: 0x84529ee4 (stale) Mirror 11: 0x84529ee4 (stale) Mirror 13: 0x84529ee4 (stale) Mirror 14: 0x51e258a9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x78bd418d Mirror 15: 0x78bd418d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000356 1787707774.514097 trunc from 0x014ea9 to 0x0216ad (0xc805 bytes) 000357 1787707774.574556 trunc from 0x040000 to 0x02a44f (0x15bb0 bytes) 000359 1787707774.637844 MIRROR_RESYNC 9 mirrors 000360 1787707776.447882 MIRROR_RESYNC 9 mirrors 000361 1787707777.213010 trunc from 0x02a450 to 0x03eec0 (0x14a71 bytes) 000362 1787707777.271879 read 0x02fa66 thru 0x030e03 (0x139e bytes) 000364 1787707777.277444 mapread 0x013203 thru 0x01953e (0x633c bytes) 000366 1787707777.320321 mapwrite 0x004e59 thru 0x00cd15 (0x7ebd bytes) 000367 1787707777.380151 read 0x003e04 thru 0x00e0c8 (0xa2c5 bytes) 000368 1787707777.381117 mapwrite 0x024f95 thru 0x027752 (0x27be bytes) 000369 1787707777.410746 fallocate 0x017f5d thru 0x01f728 (0x77cc bytes) 000370 1787707777.421820 mapwrite 0x00f7cb thru 0x01dc01 (0xe437 bytes) 000371 1787707777.443224 write 0x02417c thru 0x02a26e (0x60f3 bytes) 000372 1787707777.447122 trunc from 0x03eec1 to 0x005e5b (0x39065 bytes) 000373 1787707777.510678 mapread 0x00185b thru 0x005e5b (0x4601 bytes) 000374 1787707777.511591 punch from 0x00534f to 0x005e5b (0xb0d bytes) 000375 1787707777.517864 mapwrite 0x024417 thru 0x02556c (0x1156 bytes) 000376 1787707777.590124 fallocate 0x0342e3 thru 0x03632d (0x204b bytes) 000377 1787707777.596537 trunc from 0x01062d to 0x017de7 (0x77bb bytes) 000378 1787707777.603214 punch from 0x014134 to 0x022232 (0xe0ff bytes) 000380 1787707777.611705 read 0x001f50 thru 0x0043c1 (0x2472 bytes) 000381 1787707777.617701 MIRROR_RESYNC 9 mirrors 000382 1787707779.887889 mapread 0x02486b thru 0x02556c (0xd02 bytes) 000383 1787707779.903113 fallocate 0x007348 thru 0x00bfab (0x4c64 bytes) 000384 1787707779.939507 MIRROR_RESYNC 9 mirrors 000385 1787707781.938549 trunc from 0x02556d to 0x038814 (0x132a8 bytes) 000386 1787707782.017992 trunc from 0x038815 to 0x01d541 (0x1b2d3 bytes) 000387 1787707782.040768 MIRROR_RESYNC 9 mirrors 000388 1787707783.876953 mapwrite 0x015938 thru 0x018c1d (0x32e6 bytes) 000389 1787707783.992309 mapwrite 0x001885 thru 0x00d2c0 (0xba3c bytes) 000390 1787707784.040560 fallocate 0x0075e0 thru 0x01068e (0x90af bytes) 000391 1787707784.049146 mapwrite 0x016e68 thru 0x02390e (0xcaa7 bytes) 000392 1787707784.140083 trunc from 0x0123b6 to 0x013a2a (0x1675 bytes) 000393 1787707784.144345 mapwrite 0x013dd6 thru 0x020cd2 (0xcefd bytes) 000394 1787707784.179198 punch from 0x0208bb to 0x02130e (0xa54 bytes) 000395 1787707784.183967 trunc from 0x00837d to 0x013ed6 (0xbb5a bytes) 000396 1787707784.197314 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2390f): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2390f): Mirror 7: 0x57be11e9 (stale) Mirror 8: 0x57be11e9 (stale) Mirror 9: 0x57be11e9 (stale) Mirror 10: 0x57be11e9 (stale) Mirror 11: 0x57be11e9 (stale) Mirror 13: 0x57be11e9 (stale) Mirror 14: 0x57be11e9 (stale) Mirror 15: 0x57be11e9 (stale) CRC-32 checksum value for chunk [0, 0x2390f): Mirror 1: 0xd518a61b Mirror 16: 0xd518a61b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2390f: skipped 000397 1787707785.283941 mapread 0x01fd3a thru 0x02390e (0x3bd5 bytes) 000398 1787707785.339303 write 0x0055dd thru 0x0148ff (0xf323 bytes) 000399 1787707785.413914 mapwrite 0x0159d9 thru 0x016a99 (0x10c1 bytes) 000400 1787707785.436933 trunc from 0x012d2c to 0x0208c4 (0xdb99 bytes) 000401 1787707785.443153 mapread 0x006358 thru 0x0084c3 (0x216c bytes) 000402 1787707785.448185 MIRROR_RESYNC 10 mirrors 000403 1787707787.501320 fallocate 0x0171ab thru 0x01769c (0x4f2 bytes) 000404 1787707787.624600 read 0x0099f4 thru 0x010350 (0x695d bytes) 000405 1787707787.633711 mapread 0x012f9f thru 0x01983e (0x68a0 bytes) 000406 1787707787.669917 mapread 0x0081f6 thru 0x00dc1a (0x5a25 bytes) 000407 1787707787.689342 read 0x01f762 thru 0x02390e (0x41ad bytes) 000408 1787707787.703910 mapread 0x022f47 thru 0x02390e (0x9c8 bytes) 000409 1787707787.704945 mapread 0x00fa94 thru 0x011d4e (0x22bb bytes) 000410 1787707787.706675 mapwrite 0x034111 thru 0x03ffff (0xbeef bytes) 000411 1787707787.759648 trunc from 0x02b1a9 to 0x035284 (0xa0dc bytes) 000412 1787707787.767373 write 0x00b995 thru 0x010722 (0x4d8e bytes) 000413 1787707787.784885 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x333a7436 (stale) Mirror 9: 0x333a7436 (stale) Mirror 10: 0x333a7436 (stale) Mirror 11: 0x333a7436 (stale) Mirror 13: 0x333a7436 (stale) Mirror 14: 0x333a7436 (stale) Mirror 15: 0x333a7436 (stale) Mirror 16: 0x333a7436 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x333a7436 (stale) Mirror 9: 0x333a7436 (stale) Mirror 10: 0x333a7436 (stale) Mirror 11: 0x333a7436 (stale) Mirror 13: 0x333a7436 (stale) Mirror 14: 0x333a7436 (stale) Mirror 15: 0x333a7436 (stale) Mirror 16: 0x333a7436 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000414 1787707788.539968 fallocate 0x01973e thru 0x026df9 (0xd6bc bytes) 000415 1787707788.549269 punch from 0x03473b to 0x03ffff (0xb8c5 bytes) 000416 1787707788.559220 fallocate 0x03f224 thru 0x03ffff (0xddc bytes) 000417 1787707788.566401 mapread 0x03bfdb thru 0x03ffff (0x4025 bytes) 000418 1787707788.589047 mapread 0x00ce21 thru 0x01823d (0xb41d bytes) 000419 1787707788.612128 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x333a7436 (stale) Mirror 9: 0x333a7436 (stale) Mirror 10: 0x333a7436 (stale) Mirror 11: 0x333a7436 (stale) Mirror 13: 0x333a7436 (stale) Mirror 14: 0x333a7436 (stale) Mirror 15: 0x333a7436 (stale) Mirror 16: 0x333a7436 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeae8b047 Mirror 17: 0xeae8b047 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000420 1787707789.775901 punch from 0x03a015 to 0x03ba0e (0x19fa bytes) 000421 1787707789.850784 fallocate 0x01e228 thru 0x0220fa (0x3ed3 bytes) 000422 1787707789.859360 fallocate 0x031c61 thru 0x03ffff (0xe39f bytes) 000423 1787707789.868338 mapwrite 0x0121f2 thru 0x021e6d (0xfc7c bytes) 000424 1787707789.948753 trunc from 0x003d73 to 0x011c86 (0xdf14 bytes) 000425 1787707789.957522 trunc from 0x040000 to 0x00c646 (0x339b9 bytes) 000426 1787707790.049233 trunc from 0x00c647 to 0x006d1b (0x592b bytes) 000427 1787707790.067940 punch from 0x002ce2 to 0x006d1b (0x403a bytes) 000428 1787707790.079235 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x6d1c): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6d1c): Mirror 8: 0x9d2e3c21 (stale) Mirror 9: 0x9d2e3c21 (stale) Mirror 10: 0x9d2e3c21 (stale) Mirror 11: 0x9d2e3c21 (stale) Mirror 13: 0x9d2e3c21 (stale) Mirror 14: 0x9d2e3c21 (stale) Mirror 15: 0x9d2e3c21 (stale) Mirror 16: 0x9d2e3c21 (stale) Mirror 17: 0x9d2e3c21 (stale) CRC-32 checksum value for chunk [0, 0x6d1c): Mirror 1: 0xace06465 Mirror 18: 0xace06465 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6d1c: skipped 000429 1787707791.294640 fallocate 0x01ddb0 thru 0x020fb7 (0x3208 bytes) 000431 1787707791.348725 write 0x035311 thru 0x03dd90 (0x8a80 bytes) 000432 1787707791.361220 MIRROR_RESYNC 11 mirrors 000433 1787707793.184402 trunc from 0x03dd91 to 0x005836 (0x3855a bytes) 000435 1787707793.232312 mapread 0x0030f7 thru 0x005836 (0x2740 bytes) 000436 1787707793.252838 mapread 0x001062 thru 0x005836 (0x47d5 bytes) 000437 1787707793.258200 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5837): Mirror 8: 0xc14cd924 (stale) Mirror 10: 0xc14cd924 (stale) Mirror 11: 0xc14cd924 (stale) Mirror 13: 0xc14cd924 (stale) Mirror 14: 0xc14cd924 (stale) Mirror 15: 0xc14cd924 (stale) Mirror 16: 0xc14cd924 (stale) Mirror 17: 0xc14cd924 (stale) Mirror 18: 0xc14cd924 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5837): Mirror 8: 0xc14cd924 (stale) Mirror 10: 0xc14cd924 (stale) Mirror 11: 0xc14cd924 (stale) Mirror 13: 0xc14cd924 (stale) Mirror 14: 0xc14cd924 (stale) Mirror 15: 0xc14cd924 (stale) Mirror 16: 0xc14cd924 (stale) Mirror 17: 0xc14cd924 (stale) Mirror 18: 0xc14cd924 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5837: skipped 000438 1787707793.850346 read 0x003669 thru 0x005836 (0x21ce bytes) 000439 1787707793.860284 read 0x005224 thru 0x005836 (0x613 bytes) 000441 1787707793.862069 mapread 0x001f28 thru 0x005836 (0x390f bytes) 000442 1787707793.870649 fallocate 0x032f05 thru 0x0377c1 (0x48bd bytes) 000443 1787707793.875678 write 0x033c0e thru 0x03ec42 (0xb035 bytes) 000446 1787707793.883871 mapwrite 0x0250d2 thru 0x02f598 (0xa4c7 bytes) 000447 1787707793.938223 trunc from 0x03ec43 to 0x03b850 (0x33f2 bytes) 000449 1787707793.966231 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b851): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b851): Mirror 8: 0x32af3388 (stale) Mirror 10: 0x32af3388 (stale) Mirror 11: 0x32af3388 (stale) Mirror 13: 0x32af3388 (stale) Mirror 14: 0x32af3388 (stale) Mirror 15: 0x32af3388 (stale) Mirror 16: 0x32af3388 (stale) Mirror 17: 0x32af3388 (stale) Mirror 18: 0x32af3388 (stale) CRC-32 checksum value for chunk [0, 0x3b851): Mirror 1: 0x83d7f5ae Mirror 19: 0x83d7f5ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b851: skipped 000450 1787707795.277979 write 0x030afe thru 0x037098 (0x659b bytes) 000451 1787707795.393169 MIRROR_RESYNC 11 mirrors 000452 1787707797.276885 write 0x035139 thru 0x039355 (0x421d bytes) 000453 1787707797.323489 mapwrite 0x001f95 thru 0x003dd2 (0x1e3e bytes) 000454 1787707797.360699 fallocate 0x021588 thru 0x0289cb (0x7444 bytes) 000455 1787707797.370177 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b851): Mirror 8: 0x385a870 (stale) Mirror 10: 0x385a870 (stale) Mirror 11: 0x385a870 (stale) Mirror 13: 0x385a870 (stale) Mirror 15: 0x385a870 (stale) Mirror 16: 0x385a870 (stale) Mirror 17: 0x385a870 (stale) Mirror 18: 0x385a870 (stale) Mirror 19: 0x385a870 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b851): Mirror 8: 0x385a870 (stale) Mirror 10: 0x385a870 (stale) Mirror 11: 0x385a870 (stale) Mirror 13: 0x385a870 (stale) Mirror 15: 0x385a870 (stale) Mirror 16: 0x385a870 (stale) Mirror 17: 0x385a870 (stale) Mirror 18: 0x385a870 (stale) Mirror 19: 0x385a870 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b851: skipped 000456 1787707798.254621 trunc from 0x011390 to 0x01fc7e (0xe8ef bytes) 000457 1787707798.261733 fallocate 0x00bfe7 thru 0x01bbb1 (0xfbcb bytes) 000459 1787707798.269243 trunc from 0x03b851 to 0x019177 (0x226d9 bytes) 000460 1787707798.294678 trunc from 0x00549e to 0x00717a (0x1cdd bytes) 000461 1787707798.300243 mapwrite 0x011540 thru 0x01d0ad (0xbb6e bytes) 000462 1787707798.390772 mapread 0x016a16 thru 0x01d0ad (0x6698 bytes) 000463 1787707798.391862 fallocate 0x01687a thru 0x01fe3e (0x95c5 bytes) 000464 1787707798.399758 write 0x017d12 thru 0x0274e8 (0xf7d7 bytes) 000465 1787707798.403223 read 0x0253f0 thru 0x0274e8 (0x20f9 bytes) 000466 1787707798.404525 punch from 0x01ffca to 0x0274e8 (0x751f bytes) 000468 1787707798.434788 write 0x01c1ff thru 0x02a537 (0xe339 bytes) 000469 1787707798.438106 fallocate 0x034465 thru 0x03dc80 (0x981c bytes) 000470 1787707798.444734 trunc from 0x009e12 to 0x00aa6b (0xc5a bytes) 000471 1787707798.450526 trunc from 0x016e35 to 0x01b057 (0x4223 bytes) 000472 1787707798.456617 fallocate 0x007795 thru 0x015494 (0xdd00 bytes) 000473 1787707798.462795 write 0x039827 thru 0x03ec2b (0x5405 bytes) 000474 1787707798.464730 punch from 0x03d77a to 0x03ec2b (0x14b2 bytes) 000475 1787707798.490497 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ec2c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec2c): Mirror 8: 0xad53eaa0 (stale) Mirror 10: 0xad53eaa0 (stale) Mirror 11: 0xad53eaa0 (stale) Mirror 13: 0xad53eaa0 (stale) Mirror 15: 0xad53eaa0 (stale) Mirror 16: 0xad53eaa0 (stale) Mirror 17: 0xad53eaa0 (stale) Mirror 18: 0xad53eaa0 (stale) Mirror 19: 0xad53eaa0 (stale) CRC-32 checksum value for chunk [0, 0x3ec2c): Mirror 1: 0xed1c0344 Mirror 20: 0xed1c0344 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec2c: skipped 000476 1787707799.976403 punch from 0x03201b to 0x03e348 (0xc32e bytes) 000477 1787707800.068675 MIRROR_RESYNC 11 mirrors 000479 1787707803.777453 read 0x039d54 thru 0x03ec2b (0x4ed8 bytes) 000480 1787707803.788206 fallocate 0x01745b thru 0x01c187 (0x4d2d bytes) 000481 1787707803.834009 punch from 0x03216f to 0x039269 (0x70fb bytes) 000482 1787707803.840391 trunc from 0x03ec2c to 0x03f130 (0x505 bytes) 000483 1787707803.862702 write 0x018135 thru 0x01b36f (0x323b bytes) 000484 1787707803.879890 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f131): Mirror 10: 0x570dce96 (stale) Mirror 11: 0x570dce96 (stale) Mirror 13: 0x570dce96 (stale) Mirror 15: 0x570dce96 (stale) Mirror 16: 0x570dce96 (stale) Mirror 17: 0x570dce96 (stale) Mirror 18: 0x570dce96 (stale) Mirror 19: 0x570dce96 (stale) Mirror 20: 0x570dce96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f131): Mirror 10: 0x570dce96 (stale) Mirror 11: 0x570dce96 (stale) Mirror 13: 0x570dce96 (stale) Mirror 15: 0x570dce96 (stale) Mirror 16: 0x570dce96 (stale) Mirror 17: 0x570dce96 (stale) Mirror 18: 0x570dce96 (stale) Mirror 19: 0x570dce96 (stale) Mirror 20: 0x570dce96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f131: skipped 000485 1787707804.757776 fallocate 0x00072b thru 0x006168 (0x5a3e bytes) 000486 1787707804.763320 trunc from 0x0252a4 to 0x02c2a0 (0x6ffd bytes) 000487 1787707804.780618 trunc from 0x01144c to 0x013e82 (0x2a37 bytes) 000488 1787707804.799092 read 0x022869 thru 0x02506e (0x2806 bytes) 000489 1787707804.818465 trunc from 0x026d2b to 0x02e09a (0x7370 bytes) 000490 1787707804.845658 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f131): Mirror 10: 0x570dce96 (stale) Mirror 11: 0x570dce96 (stale) Mirror 15: 0x570dce96 (stale) Mirror 16: 0x570dce96 (stale) Mirror 17: 0x570dce96 (stale) Mirror 18: 0x570dce96 (stale) Mirror 19: 0x570dce96 (stale) Mirror 20: 0x570dce96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f131): Mirror 10: 0x570dce96 (stale) Mirror 11: 0x570dce96 (stale) Mirror 15: 0x570dce96 (stale) Mirror 16: 0x570dce96 (stale) Mirror 17: 0x570dce96 (stale) Mirror 18: 0x570dce96 (stale) Mirror 19: 0x570dce96 (stale) Mirror 20: 0x570dce96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f131: skipped 000491 1787707805.476473 write 0x012ed9 thru 0x017dba (0x4ee2 bytes) 000492 1787707805.495537 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f131): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f131): Mirror 10: 0x570dce96 (stale) Mirror 11: 0x570dce96 (stale) Mirror 15: 0x570dce96 (stale) Mirror 16: 0x570dce96 (stale) Mirror 17: 0x570dce96 (stale) Mirror 18: 0x570dce96 (stale) Mirror 19: 0x570dce96 (stale) Mirror 20: 0x570dce96 (stale) CRC-32 checksum value for chunk [0, 0x3f131): Mirror 1: 0x5dc6434a Mirror 21: 0x5dc6434a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f131: skipped 000493 1787707806.614023 mapwrite 0x00f930 thru 0x01c04d (0xc71e bytes) 000494 1787707806.741188 trunc from 0x00c0c5 to 0x01680d (0xa749 bytes) 000495 1787707806.749519 fallocate 0x006140 thru 0x00a2ce (0x418f bytes) 000496 1787707806.756182 punch from 0x0350fa to 0x03987a (0x4781 bytes) 000497 1787707806.764081 punch from 0x03e995 to 0x03f130 (0x79c bytes) 000498 1787707806.772516 mapwrite 0x032a12 thru 0x03c5cf (0x9bbe bytes) 000499 1787707806.850240 mapwrite 0x007fb7 thru 0x015802 (0xd84c bytes) 000500 1787707806.908973 trunc from 0x03de0e to 0x03f130 (0x1323 bytes) 000502 1787707806.915939 mapwrite 0x00adf6 thru 0x015bd5 (0xade0 bytes) 000503 1787707806.952696 MIRROR_RESYNC 10 mirrors 000504 1787707810.051537 write 0x01926f thru 0x024268 (0xaffa bytes) 000505 1787707810.109842 trunc from 0x021f5e to 0x0226db (0x77e bytes) 000506 1787707810.123927 mapread 0x00f278 thru 0x011443 (0x21cc bytes) 000509 1787707810.145979 punch from 0x01e926 to 0x020771 (0x1e4c bytes) 000510 1787707810.152618 read 0x03b89c thru 0x03f130 (0x3895 bytes) 000511 1787707810.164042 read 0x02cfc4 thru 0x037ad1 (0xab0e bytes) 000512 1787707810.192136 fallocate 0x036b4a thru 0x03ffff (0x94b6 bytes) 000514 1787707810.198235 fallocate 0x01028a thru 0x011183 (0xefa bytes) 000515 1787707810.209447 trunc from 0x03f131 to 0x00031b (0x3ee15 bytes) 000516 1787707810.246568 fallocate 0x00e67f thru 0x01792c (0x92ae bytes) 000517 1787707810.256085 trunc from 0x01792d to 0x03b921 (0x23ff5 bytes) 000519 1787707810.277927 trunc from 0x014b6e to 0x01976f (0x4c02 bytes) 000520 1787707810.283146 write 0x0079ce thru 0x016d2a (0xf35d bytes) 000521 1787707810.296350 trunc from 0x0312b6 to 0x03137a (0xc5 bytes) 000522 1787707810.302299 write 0x035c2e thru 0x03e14a (0x851d bytes) 000523 1787707810.313276 punch from 0x0273fa to 0x0303a6 (0x8fad bytes) 000524 1787707810.319367 mapread 0x02c037 thru 0x02cd60 (0xd2a bytes) 000525 1787707810.325578 trunc from 0x027241 to 0x02a6f2 (0x34b2 bytes) 000526 1787707810.338337 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e14b): Mirror 10: 0xb731d62c (stale) Mirror 11: 0xb731d62c (stale) Mirror 15: 0xb731d62c (stale) Mirror 16: 0xb731d62c (stale) Mirror 18: 0xb731d62c (stale) Mirror 19: 0xb731d62c (stale) Mirror 20: 0xb731d62c (stale) Mirror 21: 0xb731d62c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e14b): Mirror 10: 0xb731d62c (stale) Mirror 11: 0xb731d62c (stale) Mirror 15: 0xb731d62c (stale) Mirror 16: 0xb731d62c (stale) Mirror 18: 0xb731d62c (stale) Mirror 19: 0xb731d62c (stale) Mirror 20: 0xb731d62c (stale) Mirror 21: 0xb731d62c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e14b: skipped 000529 1787707811.130729 trunc from 0x02b341 to 0x030854 (0x5514 bytes) 000530 1787707811.138066 trunc from 0x03e14b to 0x000b88 (0x3d5c2 bytes) 000531 1787707811.205354 trunc from 0x000b89 to 0x023338 (0x227b0 bytes) 000532 1787707811.259015 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23339): Mirror 11: 0x23e84d37 (stale) Mirror 15: 0x23e84d37 (stale) Mirror 16: 0x23e84d37 (stale) Mirror 18: 0x23e84d37 (stale) Mirror 19: 0x23e84d37 (stale) Mirror 20: 0x23e84d37 (stale) Mirror 21: 0x23e84d37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23339): Mirror 11: 0x23e84d37 (stale) Mirror 15: 0x23e84d37 (stale) Mirror 16: 0x23e84d37 (stale) Mirror 18: 0x23e84d37 (stale) Mirror 19: 0x23e84d37 (stale) Mirror 20: 0x23e84d37 (stale) Mirror 21: 0x23e84d37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23339: skipped 000533 1787707811.985348 read 0x004349 thru 0x004db3 (0xa6b bytes) 000534 1787707812.000083 trunc from 0x023339 to 0x02fb43 (0xc80b bytes) 000535 1787707812.034336 mapread 0x004c4f thru 0x00de26 (0x91d8 bytes) 000536 1787707812.062400 trunc from 0x02fb44 to 0x01356c (0x1c5d7 bytes) 000537 1787707812.092764 punch from 0x006379 to 0x008282 (0x1f0a bytes) 000539 1787707812.103303 punch from 0x006f4b to 0x00a26c (0x3322 bytes) 000540 1787707812.109243 read 0x00d64e thru 0x0120dd (0x4a90 bytes) 000541 1787707812.130483 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1356d): Mirror 11: 0xd7a37545 (stale) Mirror 15: 0xd7a37545 (stale) Mirror 16: 0xd7a37545 (stale) Mirror 18: 0xd7a37545 (stale) Mirror 19: 0xd7a37545 (stale) Mirror 20: 0xd7a37545 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1356d): Mirror 11: 0xd7a37545 (stale) Mirror 15: 0xd7a37545 (stale) Mirror 16: 0xd7a37545 (stale) Mirror 18: 0xd7a37545 (stale) Mirror 19: 0xd7a37545 (stale) Mirror 20: 0xd7a37545 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1356d: skipped 000542 1787707812.795010 mapwrite 0x0086e8 thru 0x00f175 (0x6a8e bytes) 000543 1787707812.869651 fallocate 0x02573f thru 0x02ba43 (0x6305 bytes) 000545 1787707812.876833 write 0x010884 thru 0x016d34 (0x64b1 bytes) 000546 1787707812.893150 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x16d35): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16d35): Mirror 11: 0x815bd9f3 (stale) Mirror 15: 0x815bd9f3 (stale) Mirror 16: 0x815bd9f3 (stale) Mirror 18: 0x815bd9f3 (stale) Mirror 19: 0x815bd9f3 (stale) Mirror 20: 0x815bd9f3 (stale) CRC-32 checksum value for chunk [0, 0x16d35): Mirror 1: 0x271b543d Mirror 21: 0x271b543d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16d35: skipped 000547 1787707814.122547 mapwrite 0x035034 thru 0x03ae72 (0x5e3f bytes) 000548 1787707814.280837 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ae73): Mirror 15: 0x360e2154 (stale) Mirror 16: 0x360e2154 (stale) Mirror 18: 0x360e2154 (stale) Mirror 19: 0x360e2154 (stale) Mirror 20: 0x360e2154 (stale) Mirror 21: 0xe7b325f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae73): Mirror 15: 0x360e2154 (stale) Mirror 16: 0x360e2154 (stale) Mirror 18: 0x360e2154 (stale) Mirror 19: 0x360e2154 (stale) Mirror 20: 0x360e2154 (stale) Mirror 21: 0xe7b325f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae73: skipped 000549 1787707814.989704 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ae73): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae73): Mirror 15: 0x360e2154 (stale) Mirror 16: 0x360e2154 (stale) Mirror 18: 0x360e2154 (stale) Mirror 19: 0x360e2154 (stale) Mirror 20: 0x360e2154 (stale) Mirror 21: 0xe7b325f8 (stale) CRC-32 checksum value for chunk [0, 0x3ae73): Mirror 1: 0x829d9d97 Mirror 22: 0x829d9d97 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae73: skipped 000551 1787707816.431203 mapwrite 0x03d55b thru 0x03ffff (0x2aa5 bytes) 000552 1787707816.585762 write 0x016cbd thru 0x024ad6 (0xde1a bytes) 000553 1787707816.620326 mapread 0x02de40 thru 0x03d307 (0xf4c8 bytes) 000555 1787707816.665129 punch from 0x00de77 to 0x0119a0 (0x3b2a bytes) 000556 1787707816.679797 punch from 0x022f22 to 0x02b84f (0x892e bytes) 000557 1787707816.724768 punch from 0x03d2ac to 0x03ffff (0x2d54 bytes) 000558 1787707816.737681 write 0x00e96a thru 0x01274c (0x3de3 bytes) 000559 1787707816.754452 mapread 0x029ab7 thru 0x02b597 (0x1ae1 bytes) 000560 1787707816.773292 mapread 0x00306d thru 0x0074bd (0x4451 bytes) 000561 1787707816.794289 trunc from 0x033060 to 0x03bdd8 (0x8d79 bytes) 000562 1787707816.806319 MIRROR_RESYNC 8 mirrors 000563 1787707819.342525 mapread 0x017c5f thru 0x019715 (0x1ab7 bytes) 000564 1787707819.377779 trunc from 0x040000 to 0x029088 (0x16f77 bytes) 000565 1787707819.472737 write 0x011ccc thru 0x014660 (0x2995 bytes) 000566 1787707819.513741 trunc from 0x00d657 to 0x01aabc (0xd466 bytes) 000567 1787707819.546187 read 0x00192d thru 0x003931 (0x2005 bytes) 000569 1787707819.574996 read 0x00f24e thru 0x01430e (0x50c1 bytes) 000570 1787707819.602250 fallocate 0x035f66 thru 0x03e947 (0x89e2 bytes) 000571 1787707819.610476 punch from 0x003a7a to 0x0071a7 (0x372e bytes) 000573 1787707819.631591 trunc from 0x029089 to 0x03f3e6 (0x1635e bytes) 000574 1787707819.673933 write 0x007b69 thru 0x014397 (0xc82f bytes) 000575 1787707819.702851 write 0x0103ad thru 0x01a38e (0x9fe2 bytes) 000576 1787707819.704124 mapwrite 0x015e55 thru 0x01bbec (0x5d98 bytes) 000577 1787707819.758383 fallocate 0x00ff95 thru 0x0142f8 (0x4364 bytes) 000578 1787707819.771784 trunc from 0x01e5db to 0x025ceb (0x7711 bytes) 000579 1787707819.782567 trunc from 0x0374b5 to 0x039d7e (0x28ca bytes) 000580 1787707819.790124 trunc from 0x03f3e7 to 0x00e83e (0x30ba8 bytes) 000581 1787707819.829836 mapwrite 0x0090b4 thru 0x014281 (0xb1ce bytes) 000582 1787707819.986772 punch from 0x00944a to 0x00ee4f (0x5a06 bytes) 000583 1787707819.998699 read 0x002031 thru 0x00567d (0x364d bytes) 000585 1787707820.007335 punch from 0x012f61 to 0x014281 (0x1321 bytes) 000586 1787707820.013290 punch from 0x010fba to 0x012ff7 (0x203e bytes) 000587 1787707820.019779 trunc from 0x00c2a8 to 0x014281 (0x7fda bytes) 000588 1787707820.026185 fallocate 0x03b329 thru 0x03d47d (0x2155 bytes) 000589 1787707820.031374 write 0x03f4fa thru 0x03ffff (0xb06 bytes) 000590 1787707820.032825 mapwrite 0x013e15 thru 0x01da9c (0x9c88 bytes) 000591 1787707820.077664 punch from 0x038221 to 0x03e844 (0x6624 bytes) 000592 1787707820.088334 trunc from 0x040000 to 0x010da1 (0x2f25e bytes) 000593 1787707820.112221 fallocate 0x01ae19 thru 0x0222a4 (0x748c bytes) 000594 1787707820.118324 mapwrite 0x02ec34 thru 0x03e506 (0xf8d3 bytes) 000595 1787707820.251366 punch from 0x00571c to 0x010b00 (0xb3e5 bytes) 000596 1787707820.257389 punch from 0x017be7 to 0x023e9d (0xc2b7 bytes) 000597 1787707820.262441 trunc from 0x03e507 to 0x004714 (0x39df2 bytes) 000598 1787707820.282868 mapread 0x00009d thru 0x004714 (0x4678 bytes) 000599 1787707820.283787 read 0x003845 thru 0x004714 (0xed0 bytes) 000601 1787707820.284789 mapwrite 0x01b53d thru 0x029e3c (0xe900 bytes) 000602 1787707820.339663 trunc from 0x004b5c to 0x00e862 (0x9d07 bytes) 000603 1787707820.345501 mapread 0x00df82 thru 0x01b8b8 (0xd937 bytes) 000604 1787707820.373694 mapwrite 0x018813 thru 0x0280e6 (0xf8d4 bytes) 000605 1787707820.419267 fallocate 0x01ffcd thru 0x02ff0e (0xff42 bytes) 000606 1787707820.457706 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x29e3d): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29e3d): Mirror 15: 0xfee51d4 (stale) Mirror 16: 0xfee51d4 (stale) Mirror 18: 0xfee51d4 (stale) Mirror 19: 0xfee51d4 (stale) Mirror 20: 0xfee51d4 (stale) Mirror 21: 0xfee51d4 (stale) Mirror 22: 0xfee51d4 (stale) CRC-32 checksum value for chunk [0, 0x29e3d): Mirror 1: 0x65a0db7 Mirror 23: 0x65a0db7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29e3d: skipped 000607 1787707821.886189 punch from 0x007433 to 0x00f85d (0x842b bytes) 000608 1787707821.941798 punch from 0x000d23 to 0x010295 (0xf573 bytes) 000609 1787707821.964353 fallocate 0x020b7f thru 0x02f4cb (0xe94d bytes) 000610 1787707821.973769 trunc from 0x0011cf to 0x0061d3 (0x5005 bytes) 000611 1787707821.984582 trunc from 0x014811 to 0x020853 (0xc043 bytes) 000612 1787707821.995604 read 0x005d62 thru 0x011d31 (0xbfd0 bytes) 000613 1787707822.014218 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x29e3d): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29e3d): Mirror 15: 0xfee51d4 (stale) Mirror 16: 0xfee51d4 (stale) Mirror 18: 0xfee51d4 (stale) Mirror 19: 0xfee51d4 (stale) Mirror 20: 0xfee51d4 (stale) Mirror 21: 0xfee51d4 (stale) Mirror 22: 0xfee51d4 (stale) Mirror 23: 0x65a0db7 (stale) CRC-32 checksum value for chunk [0, 0x29e3d): Mirror 1: 0xfc36463 Mirror 24: 0xfc36463 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29e3d: skipped 000614 1787707823.218683 read 0x021636 thru 0x0294ab (0x7e76 bytes) 000615 1787707823.241184 MIRROR_RESYNC 10 mirrors 000616 1787707824.767931 MIRROR_EXTEND to 11 mirrors 000617 1787707825.557394 punch from 0x013a27 to 0x016de7 (0x33c1 bytes) 000618 1787707825.607764 mapwrite 0x019249 thru 0x0228ce (0x9686 bytes) 000619 1787707825.703707 mapwrite 0x02375a thru 0x03187a (0xe121 bytes) 000620 1787707825.859741 write 0x00dba5 thru 0x01669f (0x8afb bytes) 000621 1787707825.882668 mapwrite 0x019e49 thru 0x01cb17 (0x2ccf bytes) 000622 1787707825.938756 mapread 0x016519 thru 0x01ecc5 (0x87ad bytes) 000623 1787707825.939681 trunc from 0x011878 to 0x0156c4 (0x3e4d bytes) 000624 1787707825.950433 punch from 0x0134ee to 0x015a4c (0x255f bytes) 000625 1787707825.958059 trunc from 0x03187b to 0x03a5ed (0x8d73 bytes) 000626 1787707825.980673 fallocate 0x010efe thru 0x015ec4 (0x4fc7 bytes) 000627 1787707825.988363 trunc from 0x03a5ee to 0x01220f (0x283de bytes) 000628 1787707826.044295 trunc from 0x00fa88 to 0x01220f (0x2788 bytes) 000629 1787707826.054736 fallocate 0x002684 thru 0x00bd32 (0x96af bytes) 000630 1787707826.086269 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12210): Mirror 15: 0xb4c0172f (stale) Mirror 16: 0xb4c0172f (stale) Mirror 18: 0xb4c0172f (stale) Mirror 19: 0xb4c0172f (stale) Mirror 20: 0xb4c0172f (stale) Mirror 22: 0xb4c0172f (stale) Mirror 23: 0xb4c0172f (stale) Mirror 24: 0xb4c0172f (stale) Mirror 25: 0xb4c0172f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12210): Mirror 15: 0xb4c0172f (stale) Mirror 16: 0xb4c0172f (stale) Mirror 18: 0xb4c0172f (stale) Mirror 19: 0xb4c0172f (stale) Mirror 20: 0xb4c0172f (stale) Mirror 22: 0xb4c0172f (stale) Mirror 23: 0xb4c0172f (stale) Mirror 24: 0xb4c0172f (stale) Mirror 25: 0xb4c0172f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12210: skipped 000631 1787707827.136718 read 0x007c48 thru 0x00e318 (0x66d1 bytes) 000632 1787707827.153269 trunc from 0x012210 to 0x02b3fd (0x191ee bytes) 000635 1787707827.176844 read 0x018905 thru 0x01d14a (0x4846 bytes) 000636 1787707827.209607 punch from 0x020f15 to 0x026956 (0x5a42 bytes) 000638 1787707827.216664 mapread 0x015451 thru 0x01c5f5 (0x71a5 bytes) 000640 1787707827.224611 trunc from 0x02b3fe to 0x02ef6b (0x3b6e bytes) 000641 1787707827.263872 trunc from 0x018b4b to 0x01aa9b (0x1f51 bytes) 000642 1787707827.269498 trunc from 0x018ced to 0x02361c (0xa930 bytes) 000643 1787707827.274233 mapwrite 0x010c45 thru 0x015095 (0x4451 bytes) 000644 1787707827.318410 trunc from 0x02ef6c to 0x00122b (0x2dd40 bytes) 000646 1787707827.386176 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x122c): Mirror 16: 0xaf9d988b (stale) Mirror 18: 0xaf9d988b (stale) Mirror 19: 0xaf9d988b (stale) Mirror 20: 0xaf9d988b (stale) Mirror 22: 0xaf9d988b (stale) Mirror 23: 0xaf9d988b (stale) Mirror 24: 0xaf9d988b (stale) Mirror 25: 0xaf9d988b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x122c): Mirror 16: 0xaf9d988b (stale) Mirror 18: 0xaf9d988b (stale) Mirror 19: 0xaf9d988b (stale) Mirror 20: 0xaf9d988b (stale) Mirror 22: 0xaf9d988b (stale) Mirror 23: 0xaf9d988b (stale) Mirror 24: 0xaf9d988b (stale) Mirror 25: 0xaf9d988b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x122c: skipped 000647 1787707828.109216 trunc from 0x00122c to 0x03f128 (0x3defd bytes) 000648 1787707828.163280 trunc from 0x03f129 to 0x00a4b6 (0x34c72 bytes) 000649 1787707828.218700 trunc from 0x00a4b7 to 0x008a26 (0x1a90 bytes) 000650 1787707828.264653 fallocate 0x007cca thru 0x015f4b (0xe282 bytes) 000651 1787707828.278232 trunc from 0x0049ce to 0x00562e (0xc61 bytes) 000652 1787707828.299301 mapwrite 0x037e3d thru 0x03f2d4 (0x7498 bytes) 000653 1787707828.398233 write 0x0010f1 thru 0x00977e (0x868e bytes) 000655 1787707828.418828 mapwrite 0x02d2a5 thru 0x035629 (0x8385 bytes) 000656 1787707828.494234 write 0x0350fd thru 0x03c1c0 (0x70c4 bytes) 000657 1787707828.496784 read 0x014bb6 thru 0x01af71 (0x63bc bytes) 000658 1787707828.512133 mapwrite 0x03ddab thru 0x03ecb8 (0xf0e bytes) 000659 1787707828.552936 mapwrite 0x01a474 thru 0x020463 (0x5ff0 bytes) 000660 1787707828.604205 mapread 0x030dc5 thru 0x03f2d4 (0xe510 bytes) 000661 1787707828.606206 write 0x033eac thru 0x034ce4 (0xe39 bytes) 000662 1787707828.618484 write 0x00a4bc thru 0x012548 (0x808d bytes) 000663 1787707828.639113 trunc from 0x019a64 to 0x02944a (0xf9e7 bytes) 000664 1787707828.651717 read 0x00076d thru 0x00acf9 (0xa58d bytes) 000665 1787707828.717259 trunc from 0x03f2d5 to 0x021f96 (0x1d33e bytes) 000666 1787707828.759465 write 0x00cf45 thru 0x015746 (0x8802 bytes) 000667 1787707828.762042 read 0x010324 thru 0x01d135 (0xce12 bytes) 000668 1787707828.772162 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x21f97): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f97): Mirror 16: 0xf784db15 (stale) Mirror 18: 0xf784db15 (stale) Mirror 19: 0xf784db15 (stale) Mirror 20: 0xf784db15 (stale) Mirror 22: 0xf784db15 (stale) Mirror 23: 0xf784db15 (stale) Mirror 24: 0xf784db15 (stale) Mirror 25: 0xf784db15 (stale) CRC-32 checksum value for chunk [0, 0x21f97): Mirror 1: 0xfcbd6436 Mirror 26: 0xfcbd6436 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f97: skipped 000669 1787707830.886165 mapread 0x01e0b8 thru 0x021f96 (0x3edf bytes) 000670 1787707830.927773 trunc from 0x021f97 to 0x025b03 (0x3b6d bytes) 000671 1787707830.998405 mapwrite 0x02d395 thru 0x03b621 (0xe28d bytes) 000672 1787707831.061532 punch from 0x00960f to 0x018a22 (0xf414 bytes) 000674 1787707831.070171 trunc from 0x00ea21 to 0x015838 (0x6e18 bytes) 000675 1787707831.085885 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b622): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b622): Mirror 16: 0x65ac14ca (stale) Mirror 18: 0x65ac14ca (stale) Mirror 19: 0x65ac14ca (stale) Mirror 20: 0x65ac14ca (stale) Mirror 22: 0x65ac14ca (stale) Mirror 23: 0x65ac14ca (stale) Mirror 24: 0x65ac14ca (stale) Mirror 25: 0x65ac14ca (stale) Mirror 26: 0x516a2fb2 (stale) CRC-32 checksum value for chunk [0, 0x3b622): Mirror 1: 0x8183f42e Mirror 27: 0x8183f42e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b622: skipped 000676 1787707832.457606 fallocate 0x008368 thru 0x011197 (0x8e30 bytes) 000677 1787707832.524892 trunc from 0x03b622 to 0x0240e3 (0x1753e bytes) 000678 1787707832.587355 fallocate 0x02b441 thru 0x039ef1 (0xeab1 bytes) 000679 1787707832.594299 mapwrite 0x032369 thru 0x0355d3 (0x326b bytes) 000680 1787707832.643860 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39ef2): Mirror 16: 0xe3dfa13c (stale) Mirror 18: 0xe3dfa13c (stale) Mirror 20: 0xe3dfa13c (stale) Mirror 22: 0xe3dfa13c (stale) Mirror 23: 0xe3dfa13c (stale) Mirror 24: 0xe3dfa13c (stale) Mirror 25: 0xe3dfa13c (stale) Mirror 26: 0x9398dc2f (stale) Mirror 27: 0xc640af6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ef2): Mirror 16: 0xe3dfa13c (stale) Mirror 18: 0xe3dfa13c (stale) Mirror 20: 0xe3dfa13c (stale) Mirror 22: 0xe3dfa13c (stale) Mirror 23: 0xe3dfa13c (stale) Mirror 24: 0xe3dfa13c (stale) Mirror 25: 0xe3dfa13c (stale) Mirror 26: 0x9398dc2f (stale) Mirror 27: 0xc640af6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ef2: skipped 000681 1787707833.409204 read 0x0355e8 thru 0x039ef1 (0x490a bytes) 000682 1787707833.419355 mapwrite 0x03e644 thru 0x03ffff (0x19bc bytes) 000683 1787707833.466698 trunc from 0x040000 to 0x0092e8 (0x36d17 bytes) 000684 1787707833.483590 trunc from 0x0092e9 to 0x021142 (0x17e5a bytes) 000685 1787707833.504865 mapwrite 0x028f3e thru 0x0372a8 (0xe36b bytes) 000686 1787707833.563174 read 0x00e340 thru 0x015416 (0x70d7 bytes) 000687 1787707833.588677 mapwrite 0x00ff5d thru 0x01c01a (0xc0be bytes) 000688 1787707833.612166 read 0x00431e thru 0x004396 (0x79 bytes) 000689 1787707833.612918 trunc from 0x0372a9 to 0x02b1ba (0xc0ee bytes) 000690 1787707833.632199 punch from 0x022f66 to 0x023a98 (0xb33 bytes) 000691 1787707833.640725 mapread 0x01f84e thru 0x025994 (0x6147 bytes) 000692 1787707833.656694 fallocate 0x0238b0 thru 0x02dcf3 (0xa444 bytes) 000693 1787707833.667829 trunc from 0x01180d to 0x01509b (0x388f bytes) 000694 1787707833.675613 trunc from 0x02b1bb to 0x024572 (0x6c48 bytes) 000695 1787707833.720459 write 0x00fe2b thru 0x01cb5f (0xcd35 bytes) 000696 1787707833.726621 mapread 0x01af6c thru 0x021048 (0x60dd bytes) 000698 1787707833.728485 read 0x01b3bf thru 0x023b42 (0x8784 bytes) 000699 1787707833.734778 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24573): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24573): Mirror 16: 0x3ccc9eb8 (stale) Mirror 18: 0x3ccc9eb8 (stale) Mirror 20: 0x3ccc9eb8 (stale) Mirror 22: 0x3ccc9eb8 (stale) Mirror 23: 0x3ccc9eb8 (stale) Mirror 24: 0x3ccc9eb8 (stale) Mirror 25: 0x3ccc9eb8 (stale) Mirror 26: 0x23424a1d (stale) Mirror 27: 0xfd7abe7d (stale) CRC-32 checksum value for chunk [0, 0x24573): Mirror 1: 0x4c1406fb Mirror 28: 0x4c1406fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24573: skipped 000700 1787707835.133579 fallocate 0x00f28a thru 0x01d20f (0xdf86 bytes) 000702 1787707835.214335 mapread 0x019b24 thru 0x01ba8e (0x1f6b bytes) 000703 1787707835.254358 mapwrite 0x02f073 thru 0x03eb49 (0xfad7 bytes) 000705 1787707835.337144 trunc from 0x0205ab to 0x025f62 (0x59b8 bytes) 000706 1787707835.343022 trunc from 0x01c856 to 0x01d307 (0xab2 bytes) 000707 1787707835.348819 trunc from 0x038bab to 0x03eb49 (0x5f9f bytes) 000708 1787707835.363753 fallocate 0x015be0 thru 0x023c2d (0xe04e bytes) 000710 1787707835.371568 trunc from 0x03eb4a to 0x0359f8 (0x9151 bytes) 000711 1787707835.388061 mapread 0x01d765 thru 0x01dd37 (0x5d3 bytes) 000712 1787707835.397202 mapwrite 0x01828a thru 0x019d48 (0x1abf bytes) 000713 1787707835.409549 trunc from 0x01cd1e to 0x01d708 (0x9eb bytes) 000714 1787707835.419539 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x359f9): Mirror 16: 0xf0139917 (stale) Mirror 18: 0xf0139917 (stale) Mirror 20: 0xf0139917 (stale) Mirror 22: 0xf0139917 (stale) Mirror 23: 0xf0139917 (stale) Mirror 24: 0xf0139917 (stale) Mirror 25: 0xf0139917 (stale) Mirror 27: 0xfd24f1df (stale) Mirror 28: 0x5f30b4a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x359f9): Mirror 16: 0xf0139917 (stale) Mirror 18: 0xf0139917 (stale) Mirror 20: 0xf0139917 (stale) Mirror 22: 0xf0139917 (stale) Mirror 23: 0xf0139917 (stale) Mirror 24: 0xf0139917 (stale) Mirror 25: 0xf0139917 (stale) Mirror 27: 0xfd24f1df (stale) Mirror 28: 0x5f30b4a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x359f9: skipped 000715 1787707836.109826 mapread 0x00c10b thru 0x00dbf3 (0x1ae9 bytes) 000716 1787707836.129599 fallocate 0x00ff24 thru 0x013122 (0x31ff bytes) 000717 1787707836.158376 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x359f9): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x359f9): Mirror 16: 0xf0139917 (stale) Mirror 18: 0xf0139917 (stale) Mirror 20: 0xf0139917 (stale) Mirror 22: 0xf0139917 (stale) Mirror 23: 0xf0139917 (stale) Mirror 24: 0xf0139917 (stale) Mirror 25: 0xf0139917 (stale) Mirror 27: 0xfd24f1df (stale) Mirror 28: 0x5f30b4a1 (stale) CRC-32 checksum value for chunk [0, 0x359f9): Mirror 1: 0xd12759e4 Mirror 29: 0xd12759e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x359f9: skipped 000718 1787707837.884575 write 0x00abe1 thru 0x00b996 (0xdb6 bytes) 000719 1787707838.006325 read 0x024050 thru 0x02ba2e (0x79df bytes) 000720 1787707838.046717 mapwrite 0x0155b9 thru 0x0235d9 (0xe021 bytes) 000721 1787707838.165554 read 0x024e9b thru 0x02ed4f (0x9eb5 bytes) 000722 1787707838.190122 mapwrite 0x035cb2 thru 0x03ac4f (0x4f9e bytes) 000723 1787707838.253013 read 0x00ef5d thru 0x01a078 (0xb11c bytes) 000724 1787707838.259910 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ac50): Mirror 18: 0x27015176 (stale) Mirror 20: 0x27015176 (stale) Mirror 22: 0x27015176 (stale) Mirror 23: 0x27015176 (stale) Mirror 24: 0x27015176 (stale) Mirror 25: 0x27015176 (stale) Mirror 27: 0x1bc1ebc7 (stale) Mirror 28: 0xd204c8d1 (stale) Mirror 29: 0xb642e380 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ac50): Mirror 18: 0x27015176 (stale) Mirror 20: 0x27015176 (stale) Mirror 22: 0x27015176 (stale) Mirror 23: 0x27015176 (stale) Mirror 24: 0x27015176 (stale) Mirror 25: 0x27015176 (stale) Mirror 27: 0x1bc1ebc7 (stale) Mirror 28: 0xd204c8d1 (stale) Mirror 29: 0xb642e380 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ac50: skipped 000725 1787707839.029067 trunc from 0x03ac50 to 0x02d233 (0xda1c bytes) 000727 1787707839.051561 fallocate 0x02297c thru 0x02b9fe (0x9083 bytes) 000728 1787707839.059689 read 0x0168fc thru 0x025ede (0xf5e3 bytes) 000729 1787707839.078207 mapread 0x021f74 thru 0x02b69f (0x972c bytes) 000730 1787707839.097377 punch from 0x0067da to 0x0101b2 (0x99d9 bytes) 000731 1787707839.103350 trunc from 0x01098f to 0x02008c (0xf6fe bytes) 000733 1787707839.113981 MIRROR_RESYNC 10 mirrors 000734 1787707841.893098 trunc from 0x02d234 to 0x015517 (0x17d1c bytes) 000735 1787707841.938211 mapwrite 0x026f0a thru 0x031d61 (0xae58 bytes) 000736 1787707842.025860 read 0x008a47 thru 0x011c2f (0x91e9 bytes) 000737 1787707842.036328 fallocate 0x021de5 thru 0x031912 (0xfb2e bytes) 000738 1787707842.042069 write 0x03a71c thru 0x03ffff (0x58e4 bytes) 000740 1787707842.044862 read 0x018d5b thru 0x01f7df (0x6a85 bytes) 000741 1787707842.057742 punch from 0x01401f to 0x0144f7 (0x4d9 bytes) 000742 1787707842.062322 punch from 0x00b84c to 0x0122fb (0x6ab0 bytes) 000744 1787707842.069227 fallocate 0x03e328 thru 0x03ffff (0x1cd8 bytes) 000745 1787707842.075156 punch from 0x00c45e to 0x0131bb (0x6d5e bytes) 000746 1787707842.081104 trunc from 0x00f511 to 0x01804c (0x8b3c bytes) 000747 1787707842.085917 write 0x005f5e thru 0x006f79 (0x101c bytes) 000748 1787707842.087138 mapwrite 0x03f401 thru 0x03ffff (0xbff bytes) 000749 1787707842.112552 write 0x01d311 thru 0x0240fd (0x6ded bytes) 000750 1787707842.113461 punch from 0x039b7d to 0x03ffff (0x6483 bytes) 000751 1787707842.119370 trunc from 0x040000 to 0x01be0d (0x241f2 bytes) 000752 1787707842.137585 fallocate 0x02a6e6 thru 0x02b918 (0x1233 bytes) 000753 1787707842.149170 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1be0e): Mirror 18: 0x8557e878 (stale) Mirror 20: 0x8557e878 (stale) Mirror 22: 0x8557e878 (stale) Mirror 23: 0x8557e878 (stale) Mirror 24: 0x8557e878 (stale) Mirror 27: 0x8557e878 (stale) Mirror 28: 0x8557e878 (stale) Mirror 29: 0x8557e878 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1be0e): Mirror 18: 0x8557e878 (stale) Mirror 20: 0x8557e878 (stale) Mirror 22: 0x8557e878 (stale) Mirror 23: 0x8557e878 (stale) Mirror 24: 0x8557e878 (stale) Mirror 27: 0x8557e878 (stale) Mirror 28: 0x8557e878 (stale) Mirror 29: 0x8557e878 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1be0e: skipped 000755 1787707842.941849 read 0x00dfa4 thru 0x01919a (0xb1f7 bytes) 000756 1787707842.951799 mapwrite 0x028acc thru 0x031f7b (0x94b0 bytes) 000757 1787707843.032162 trunc from 0x031f7c to 0x02709f (0xaedc bytes) 000758 1787707843.070582 mapread 0x007e1d thru 0x00c2a2 (0x4486 bytes) 000759 1787707843.110973 trunc from 0x0270a0 to 0x018f88 (0xe117 bytes) 000760 1787707843.137199 mapwrite 0x015ed2 thru 0x02130a (0xb439 bytes) 000761 1787707843.235464 trunc from 0x02130b to 0x02a4dc (0x91d2 bytes) 000762 1787707843.256659 mapwrite 0x03e305 thru 0x03ffff (0x1cfb bytes) 000763 1787707843.320049 mapwrite 0x035bef thru 0x03ffff (0xa411 bytes) 000764 1787707843.388322 fallocate 0x00d3a6 thru 0x014fb3 (0x7c0e bytes) 000765 1787707843.394281 mapwrite 0x013adf thru 0x015bda (0x20fc bytes) 000766 1787707843.407536 trunc from 0x040000 to 0x037925 (0x86da bytes) 000767 1787707843.423361 write 0x023ed2 thru 0x033d52 (0xfe81 bytes) 000768 1787707843.431872 trunc from 0x02af8b to 0x02e343 (0x33b9 bytes) 000769 1787707843.446034 read 0x01518b thru 0x01d595 (0x840b bytes) 000770 1787707843.451299 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37926): Mirror 18: 0xe41ecae2 (stale) Mirror 22: 0xe41ecae2 (stale) Mirror 23: 0xe41ecae2 (stale) Mirror 24: 0xe41ecae2 (stale) Mirror 27: 0xe41ecae2 (stale) Mirror 28: 0xe41ecae2 (stale) Mirror 29: 0xe41ecae2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37926): Mirror 18: 0xe41ecae2 (stale) Mirror 22: 0xe41ecae2 (stale) Mirror 23: 0xe41ecae2 (stale) Mirror 24: 0xe41ecae2 (stale) Mirror 27: 0xe41ecae2 (stale) Mirror 28: 0xe41ecae2 (stale) Mirror 29: 0xe41ecae2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37926: skipped 000771 1787707844.080167 mapwrite 0x027e2f thru 0x029f31 (0x2103 bytes) 000772 1787707844.121969 punch from 0x030a86 to 0x0378cc (0x6e47 bytes) 000773 1787707844.129852 punch from 0x026cb6 to 0x0332c9 (0xc614 bytes) 000774 1787707844.144524 trunc from 0x037926 to 0x019bf0 (0x1dd35 bytes) 000775 1787707844.186333 mapread 0x004f80 thru 0x0080d4 (0x3155 bytes) 000776 1787707844.206808 punch from 0x0175ee to 0x019bf0 (0x2603 bytes) 000777 1787707844.212727 write 0x0012ca thru 0x00990b (0x8642 bytes) 000778 1787707844.213897 trunc from 0x007bc3 to 0x013986 (0xbdc4 bytes) 000780 1787707844.229997 write 0x0196fe thru 0x020987 (0x728a bytes) 000781 1787707844.236569 mapwrite 0x009460 thru 0x01161b (0x81bc bytes) 000782 1787707844.292544 punch from 0x00c942 to 0x019856 (0xcf15 bytes) 000783 1787707844.300877 mapwrite 0x01d938 thru 0x022cf7 (0x53c0 bytes) 000784 1787707844.409044 punch from 0x00c1b3 to 0x0187c0 (0xc60e bytes) 000785 1787707844.423013 mapwrite 0x0212e3 thru 0x02fa21 (0xe73f bytes) 000786 1787707844.517076 read 0x02717b thru 0x02fa21 (0x88a7 bytes) 000787 1787707844.521315 mapwrite 0x032721 thru 0x038fa4 (0x6884 bytes) 000788 1787707844.596548 read 0x000c78 thru 0x008735 (0x7abe bytes) 000789 1787707844.607944 trunc from 0x0341f0 to 0x038fa4 (0x4db5 bytes) 000790 1787707844.616906 trunc from 0x038fa5 to 0x02f1bd (0x9de7 bytes) 000791 1787707844.658999 trunc from 0x02f1be to 0x0115e1 (0x1dbdc bytes) 000792 1787707844.684771 fallocate 0x03ecf9 thru 0x03ffff (0x1307 bytes) 000793 1787707844.689507 read 0x02d176 thru 0x02e009 (0xe94 bytes) 000794 1787707844.699454 mapwrite 0x008a3f thru 0x00a785 (0x1d47 bytes) 000795 1787707844.714166 mapread 0x022b82 thru 0x026a7c (0x3efb bytes) 000796 1787707844.715393 read 0x03e27a thru 0x03ffff (0x1d86 bytes) 000797 1787707844.720882 MIRROR_RESYNC 8 mirrors 000798 1787707845.904117 trunc from 0x03d5b1 to 0x03ffff (0x2a4f bytes) 000799 1787707845.949934 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x20b852a2 (stale) Mirror 23: 0x20b852a2 (stale) Mirror 24: 0x20b852a2 (stale) Mirror 27: 0x20b852a2 (stale) Mirror 28: 0x20b852a2 (stale) Mirror 29: 0x20b852a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x20b852a2 (stale) Mirror 23: 0x20b852a2 (stale) Mirror 24: 0x20b852a2 (stale) Mirror 27: 0x20b852a2 (stale) Mirror 28: 0x20b852a2 (stale) Mirror 29: 0x20b852a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000800 1787707846.438312 trunc from 0x00ce73 to 0x01a23e (0xd3cc bytes) 000801 1787707846.444893 trunc from 0x0329d2 to 0x03bd50 (0x937f bytes) 000802 1787707846.453998 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x20b852a2 (stale) Mirror 23: 0x20b852a2 (stale) Mirror 24: 0x20b852a2 (stale) Mirror 27: 0x20b852a2 (stale) Mirror 29: 0x20b852a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x20b852a2 (stale) Mirror 23: 0x20b852a2 (stale) Mirror 24: 0x20b852a2 (stale) Mirror 27: 0x20b852a2 (stale) Mirror 29: 0x20b852a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1787707846.920287 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x20b852a2 (stale) Mirror 23: 0x20b852a2 (stale) Mirror 24: 0x20b852a2 (stale) Mirror 27: 0x20b852a2 (stale) Mirror 29: 0x20b852a2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x20b852a2 Mirror 30: 0x20b852a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000805 1787707847.832848 read 0x00aed6 thru 0x00cf3b (0x2066 bytes) 000806 1787707847.847965 fallocate 0x0108e3 thru 0x01addc (0xa4fa bytes) 000807 1787707847.899102 trunc from 0x021e10 to 0x02f50e (0xd6ff bytes) 000808 1787707847.904745 trunc from 0x031dd7 to 0x0342d7 (0x2501 bytes) 000809 1787707847.909908 read 0x01426c thru 0x01dcb2 (0x9a47 bytes) 000810 1787707847.924382 trunc from 0x040000 to 0x010201 (0x2fdfe bytes) 000811 1787707847.949279 write 0x00e174 thru 0x0111cb (0x3058 bytes) 000812 1787707847.950686 punch from 0x0095fc to 0x00d1c2 (0x3bc7 bytes) 000813 1787707847.957164 write 0x02882b thru 0x0304bc (0x7c92 bytes) 000814 1787707847.962920 MIRROR_RESYNC 7 mirrors 000815 1787707849.692834 trunc from 0x028bba to 0x029efa (0x1341 bytes) 000816 1787707849.755371 MIRROR_RESYNC 7 mirrors 000817 1787707851.696605 fallocate 0x033e89 thru 0x035c15 (0x1d8d bytes) 000818 1787707851.751981 read 0x021f51 thru 0x02a642 (0x86f2 bytes) 000819 1787707851.774564 mapwrite 0x00bcd6 thru 0x016965 (0xac90 bytes) 000820 1787707851.906039 trunc from 0x0304bd to 0x0315eb (0x112f bytes) 000822 1787707851.943104 punch from 0x03095e to 0x0315eb (0xc8e bytes) 000823 1787707851.950800 write 0x025770 thru 0x029a6b (0x42fc bytes) 000824 1787707851.952780 write 0x000516 thru 0x00bc95 (0xb780 bytes) 000826 1787707851.961741 trunc from 0x0111d2 to 0x016a0b (0x583a bytes) 000827 1787707851.972793 punch from 0x025c13 to 0x030662 (0xaa50 bytes) 000828 1787707852.048664 MIRROR_RESYNC 7 mirrors 000829 1787707855.092019 trunc from 0x00c6fd to 0x00e894 (0x2198 bytes) 000830 1787707855.162063 trunc from 0x0315ec to 0x02cf79 (0x4672 bytes) 000831 1787707855.237735 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2cf7a): Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cf7a): Mirror 18: 0x93800e48 (stale) Mirror 23: 0x93800e48 (stale) Mirror 24: 0x93800e48 (stale) Mirror 27: 0x93800e48 (stale) Mirror 29: 0x93800e48 (stale) Mirror 30: 0x93800e48 (stale) CRC-32 checksum value for chunk [0, 0x2cf7a): Mirror 1: 0x5ae55f06 Mirror 31: 0x5ae55f06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cf7a: skipped 000832 1787707856.591903 mapwrite 0x0053a3 thru 0x00b878 (0x64d6 bytes) 000833 1787707856.745258 trunc from 0x01f83a to 0x026cdd (0x74a4 bytes) 000834 1787707856.760681 punch from 0x002f25 to 0x00fbfc (0xccd8 bytes) 000835 1787707856.775320 mapread 0x019a25 thru 0x01ec80 (0x525c bytes) 000836 1787707856.792958 trunc from 0x005e2c to 0x014236 (0xe40b bytes) 000837 1787707856.808720 punch from 0x01623f to 0x020910 (0xa6d2 bytes) 000838 1787707856.828815 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cf7a): Mirror 18: 0x93800e48 (stale) Mirror 23: 0x93800e48 (stale) Mirror 24: 0x93800e48 (stale) Mirror 27: 0x93800e48 (stale) Mirror 29: 0x93800e48 (stale) Mirror 31: 0x5ae55f06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cf7a): Mirror 18: 0x93800e48 (stale) Mirror 23: 0x93800e48 (stale) Mirror 24: 0x93800e48 (stale) Mirror 27: 0x93800e48 (stale) Mirror 29: 0x93800e48 (stale) Mirror 31: 0x5ae55f06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cf7a: skipped 000839 1787707857.458260 mapread 0x01a6de thru 0x01eb18 (0x443b bytes) 000840 1787707857.485790 trunc from 0x020782 to 0x02b32b (0xabaa bytes) 000841 1787707857.492744 mapread 0x009e34 thru 0x014731 (0xa8fe bytes) 000842 1787707857.512022 mapwrite 0x009b73 thru 0x014686 (0xab14 bytes) 000843 1787707857.541579 trunc from 0x02cf7a to 0x01bda3 (0x111d6 bytes) 000844 1787707857.600054 read 0x012c02 thru 0x01bda3 (0x91a2 bytes) 000845 1787707857.608562 MIRROR_RESYNC 7 mirrors 000847 1787707859.302298 trunc from 0x01bda4 to 0x036e11 (0x1b06e bytes) 000849 1787707859.363014 punch from 0x02df7c to 0x02f1c2 (0x1247 bytes) 000850 1787707859.372039 fallocate 0x01cb20 thru 0x02bd1d (0xf1fe bytes) 000851 1787707859.378006 punch from 0x019940 to 0x022922 (0x8fe3 bytes) 000852 1787707859.382536 mapread 0x016990 thru 0x0243cc (0xda3d bytes) 000853 1787707859.415847 fallocate 0x03fc1f thru 0x03ffff (0x3e1 bytes) 000855 1787707859.426727 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e12): Mirror 18: 0xa52fe37c (stale) Mirror 24: 0xa52fe37c (stale) Mirror 27: 0xa52fe37c (stale) Mirror 29: 0xa52fe37c (stale) Mirror 31: 0xa52fe37c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e12): Mirror 18: 0xa52fe37c (stale) Mirror 24: 0xa52fe37c (stale) Mirror 27: 0xa52fe37c (stale) Mirror 29: 0xa52fe37c (stale) Mirror 31: 0xa52fe37c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e12: skipped 000856 1787707859.840291 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x36e12): Mirror 18: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e12): Mirror 18: 0xa52fe37c (stale) Mirror 24: 0xa52fe37c (stale) Mirror 27: 0xa52fe37c (stale) Mirror 29: 0xa52fe37c (stale) Mirror 31: 0xa52fe37c (stale) CRC-32 checksum value for chunk [0, 0x36e12): Mirror 1: 0xa52fe37c Mirror 32: 0xa52fe37c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e12: skipped 000857 1787707861.211006 fallocate 0x012cc1 thru 0x018da4 (0x60e4 bytes) 000858 1787707861.253891 mapread 0x018a5b thru 0x0284b7 (0xfa5d bytes) 000859 1787707861.296856 read 0x027dd9 thru 0x033332 (0xb55a bytes) 000860 1787707861.306861 read 0x016829 thru 0x01771b (0xef3 bytes) 000861 1787707861.312156 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36e12): Mirror 18: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e12): Mirror 18: 0xa52fe37c (stale) Mirror 24: 0xa52fe37c (stale) Mirror 27: 0xa52fe37c (stale) Mirror 29: 0xa52fe37c (stale) Mirror 31: 0xa52fe37c (stale) Mirror 32: 0xa52fe37c (stale) CRC-32 checksum value for chunk [0, 0x36e12): Mirror 1: 0xa52fe37c Mirror 33: 0xa52fe37c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e12: skipped 000862 1787707862.663978 trunc from 0x036e12 to 0x010656 (0x267bb bytes) 000863 1787707862.762846 punch from 0x000733 to 0x00f8d3 (0xf1a1 bytes) 000864 1787707862.772180 mapread 0x00482e thru 0x010656 (0xbe29 bytes) 000865 1787707862.794374 mapwrite 0x03a89e thru 0x03f773 (0x4ed6 bytes) 000866 1787707862.924322 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f774): Mirror 18: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f774): Mirror 18: 0x990c1317 (stale) Mirror 24: 0x990c1317 (stale) Mirror 27: 0x990c1317 (stale) Mirror 29: 0x990c1317 (stale) Mirror 31: 0x990c1317 (stale) Mirror 32: 0x990c1317 (stale) Mirror 33: 0x990c1317 (stale) CRC-32 checksum value for chunk [0, 0x3f774): Mirror 1: 0x84890d7e Mirror 34: 0x84890d7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f774: skipped 000867 1787707864.541042 mapwrite 0x00ef7e thru 0x00f401 (0x484 bytes) 000869 1787707864.688045 trunc from 0x03f774 to 0x019e2c (0x25947 bytes) 000870 1787707864.717920 write 0x02c310 thru 0x035bad (0x989e bytes) 000872 1787707864.721079 trunc from 0x011423 to 0x0118b8 (0x496 bytes) 000873 1787707864.725624 fallocate 0x03d3c1 thru 0x03ffff (0x2c3f bytes) 000874 1787707864.735228 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35bae): Mirror 18: 0x111bfc04 (stale) Mirror 24: 0x111bfc04 (stale) Mirror 27: 0x111bfc04 (stale) Mirror 29: 0x111bfc04 (stale) Mirror 31: 0x111bfc04 (stale) Mirror 32: 0x111bfc04 (stale) Mirror 33: 0x111bfc04 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35bae): Mirror 18: 0x111bfc04 (stale) Mirror 24: 0x111bfc04 (stale) Mirror 27: 0x111bfc04 (stale) Mirror 29: 0x111bfc04 (stale) Mirror 31: 0x111bfc04 (stale) Mirror 32: 0x111bfc04 (stale) Mirror 33: 0x111bfc04 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35bae: skipped 000875 1787707865.488101 punch from 0x0037be to 0x01241f (0xec62 bytes) 000876 1787707865.496341 write 0x02cad6 thru 0x02df37 (0x1462 bytes) 000877 1787707865.513460 write 0x008c74 thru 0x01096b (0x7cf8 bytes) 000878 1787707865.525985 write 0x037e41 thru 0x03ffff (0x81bf bytes) 000879 1787707865.527466 punch from 0x029550 to 0x02b0f5 (0x1ba6 bytes) 000880 1787707865.544700 trunc from 0x040000 to 0x01eaaf (0x21550 bytes) 000881 1787707865.565104 fallocate 0x031422 thru 0x03facd (0xe6ac bytes) 000882 1787707865.577796 MIRROR_RESYNC 8 mirrors 000883 1787707867.587779 mapread 0x00dd34 thru 0x0123c4 (0x4691 bytes) 000884 1787707867.651909 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000885 1787707868.406750 mapwrite 0x037dfe thru 0x038ddf (0xfe2 bytes) 000886 1787707868.531457 punch from 0x008cd4 to 0x00c327 (0x3654 bytes) 000887 1787707868.544955 mapwrite 0x0185c5 thru 0x027625 (0xf061 bytes) 000888 1787707868.643493 trunc from 0x038de0 to 0x03ccf3 (0x3f14 bytes) 000889 1787707868.678486 read 0x00c358 thru 0x014cc6 (0x896f bytes) 000890 1787707868.705949 mapread 0x0068d9 thru 0x00e412 (0x7b3a bytes) 000891 1787707868.736690 write 0x00c290 thru 0x011545 (0x52b6 bytes) 000892 1787707868.744392 punch from 0x02a9ee to 0x02f453 (0x4a66 bytes) 000893 1787707868.759443 mapread 0x01babe thru 0x024f78 (0x94bb bytes) 000894 1787707868.761888 trunc from 0x021a47 to 0x0295b5 (0x7b6f bytes) 000895 1787707868.770674 trunc from 0x03ccf4 to 0x02d05c (0xfc97 bytes) 000896 1787707868.792356 mapread 0x0197cd thru 0x022d8d (0x95c1 bytes) 000897 1787707868.837921 read 0x029cec thru 0x02d05c (0x3371 bytes) 000898 1787707868.861337 mapread 0x003070 thru 0x00fcaa (0xcc3b bytes) 000899 1787707868.863852 mapread 0x016fec thru 0x02087e (0x9893 bytes) 000900 1787707868.876339 trunc from 0x02d05d to 0x0299ae (0x36ae bytes) 000901 1787707868.901932 fallocate 0x011122 thru 0x01fa71 (0xe950 bytes) 000902 1787707868.914381 trunc from 0x0299af to 0x01f0d2 (0xa8dc bytes) 000903 1787707868.986775 punch from 0x0105db to 0x019af6 (0x951c bytes) 000904 1787707869.046754 write 0x0071da thru 0x00dba9 (0x69d0 bytes) 000905 1787707869.060564 fallocate 0x03a3dd thru 0x03c165 (0x1d89 bytes) 000907 1787707869.086494 trunc from 0x03c166 to 0x022f13 (0x19252 bytes) 000910 1787707869.140485 fallocate 0x001936 thru 0x0057d0 (0x3e9b bytes) 000911 1787707869.163659 MIRROR_RESYNC 7 mirrors 000912 1787707872.426797 trunc from 0x022f14 to 0x01f203 (0x3d10 bytes) 000913 1787707872.541873 mapread 0x0112c3 thru 0x01e470 (0xd1ae bytes) 000914 1787707872.595200 write 0x02c02b thru 0x0387f6 (0xc7cc bytes) 000916 1787707872.597299 fallocate 0x005b4d thru 0x01492a (0xedde bytes) 000917 1787707872.629331 write 0x03f93b thru 0x03ffff (0x6c5 bytes) 000918 1787707872.630364 trunc from 0x040000 to 0x03ce18 (0x31e7 bytes) 000919 1787707872.667304 punch from 0x00a2d1 to 0x00b292 (0xfc2 bytes) 000920 1787707872.675258 punch from 0x00cc2a to 0x0150ce (0x84a5 bytes) 000921 1787707872.681907 trunc from 0x00b33c to 0x017398 (0xc05d bytes) 000922 1787707872.691990 write 0x000dcf thru 0x0059a7 (0x4bd9 bytes) 000923 1787707872.700821 mapwrite 0x012310 thru 0x01dd80 (0xba71 bytes) 000924 1787707872.748239 fallocate 0x03d7e1 thru 0x03ffff (0x281f bytes) 000926 1787707872.768530 mapread 0x018627 thru 0x02216d (0x9b47 bytes) 000927 1787707872.797326 write 0x031edc thru 0x03feaa (0xdfcf bytes) 000928 1787707872.807596 punch from 0x03e488 to 0x03ffff (0x1b78 bytes) 000929 1787707872.842627 write 0x01db70 thru 0x027741 (0x9bd2 bytes) 000930 1787707872.844585 write 0x011acb thru 0x01ae84 (0x93ba bytes) 000931 1787707872.860071 fallocate 0x01ba0f thru 0x026a77 (0xb069 bytes) 000933 1787707872.872081 punch from 0x00ea86 to 0x015737 (0x6cb2 bytes) 000934 1787707872.919106 trunc from 0x040000 to 0x037f28 (0x80d7 bytes) 000937 1787707872.957316 fallocate 0x00dce7 thru 0x00f1c9 (0x14e3 bytes) 000938 1787707872.969682 read 0x00c20a thru 0x013010 (0x6e07 bytes) 000939 1787707872.984440 trunc from 0x016ccc to 0x0240b0 (0xd3e5 bytes) 000940 1787707873.016195 trunc from 0x037f29 to 0x032838 (0x56f0 bytes) 000941 1787707873.061885 mapread 0x0040ee thru 0x009903 (0x5816 bytes) 000943 1787707873.082664 fallocate 0x00e07a thru 0x0191c5 (0xb14c bytes) 000944 1787707873.091794 mapread 0x02e25f thru 0x032838 (0x45da bytes) 000945 1787707873.115237 mapwrite 0x035138 thru 0x03d18b (0x8054 bytes) 000946 1787707873.240905 punch from 0x0177b3 to 0x02339c (0xbbea bytes) 000947 1787707873.254946 read 0x034c5c thru 0x03b976 (0x6d1b bytes) 000948 1787707873.265957 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d18c): Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d18c): Mirror 24: 0xa99ead25 (stale) Mirror 27: 0xa99ead25 (stale) Mirror 29: 0xa99ead25 (stale) Mirror 31: 0xa99ead25 (stale) Mirror 32: 0xa99ead25 (stale) Mirror 33: 0xa99ead25 (stale) CRC-32 checksum value for chunk [0, 0x3d18c): Mirror 1: 0x5a170708 Mirror 34: 0x5a170708 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d18c: skipped 000949 1787707874.635263 punch from 0x03a6d9 to 0x03d18b (0x2ab3 bytes) 000950 1787707874.702375 write 0x001d25 thru 0x008f75 (0x7251 bytes) 000951 1787707874.731766 punch from 0x0078d7 to 0x00c49a (0x4bc4 bytes) 000952 1787707874.768701 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d18c): Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d18c): Mirror 24: 0xa99ead25 (stale) Mirror 27: 0xa99ead25 (stale) Mirror 29: 0xa99ead25 (stale) Mirror 31: 0xa99ead25 (stale) Mirror 32: 0xa99ead25 (stale) Mirror 33: 0xa99ead25 (stale) Mirror 34: 0x5a170708 (stale) CRC-32 checksum value for chunk [0, 0x3d18c): Mirror 1: 0x82352b42 Mirror 35: 0x82352b42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d18c: skipped 000953 1787707876.495283 mapread 0x0143a4 thru 0x022282 (0xdedf bytes) 000954 1787707876.574112 trunc from 0x00420b to 0x013a83 (0xf879 bytes) 000955 1787707876.638893 punch from 0x0049e7 to 0x0132ac (0xe8c6 bytes) 000956 1787707876.645027 trunc from 0x00c8a0 to 0x019d7f (0xd4e0 bytes) 000958 1787707876.653635 mapwrite 0x003d0f thru 0x00ea5a (0xad4c bytes) 000959 1787707876.691186 punch from 0x0043de to 0x00ee9a (0xaabd bytes) 000960 1787707876.698548 mapwrite 0x01467d thru 0x017572 (0x2ef6 bytes) 000961 1787707876.742651 MIRROR_RESYNC 9 mirrors 000962 1787707881.340287 write 0x01b5a3 thru 0x023147 (0x7ba5 bytes) 000963 1787707881.420324 punch from 0x02aaf2 to 0x039eb1 (0xf3c0 bytes) 000964 1787707881.426016 write 0x00a572 thru 0x014574 (0xa003 bytes) 000965 1787707881.436918 read 0x00c3b4 thru 0x010e5e (0x4aab bytes) 000966 1787707881.437769 write 0x007671 thru 0x01698c (0xf31c bytes) 000967 1787707881.449163 punch from 0x00d943 to 0x0172a9 (0x9967 bytes) 000968 1787707881.470768 mapwrite 0x006a60 thru 0x008802 (0x1da3 bytes) 000971 1787707881.501358 trunc from 0x03d18c to 0x03dbcd (0xa42 bytes) 000972 1787707881.544047 write 0x03e65a thru 0x03ffff (0x19a6 bytes) 000973 1787707881.546850 write 0x031584 thru 0x03b7bb (0xa238 bytes) 000974 1787707881.571640 fallocate 0x01c667 thru 0x028c1d (0xc5b7 bytes) 000975 1787707881.581972 punch from 0x01e932 to 0x029e39 (0xb508 bytes) 000976 1787707881.591303 mapwrite 0x039550 thru 0x03ffff (0x6ab0 bytes) 000977 1787707881.662614 punch from 0x028362 to 0x036a8b (0xe72a bytes) 000978 1787707881.688922 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xb521b30f (stale) Mirror 27: 0xb521b30f (stale) Mirror 29: 0xb521b30f (stale) Mirror 31: 0xb521b30f (stale) Mirror 32: 0xb521b30f (stale) Mirror 33: 0xb521b30f (stale) Mirror 34: 0xb521b30f (stale) Mirror 35: 0xb521b30f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5aec6222 Mirror 36: 0x5aec6222 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000980 1787707883.431140 trunc from 0x005b00 to 0x00c46e (0x696f bytes) 000981 1787707883.510485 write 0x02d65d thru 0x036013 (0x89b7 bytes) 000982 1787707883.560909 write 0x002c01 thru 0x009da2 (0x71a2 bytes) 000983 1787707883.574731 mapwrite 0x0202aa thru 0x029d81 (0x9ad8 bytes) 000984 1787707883.662362 mapread 0x017929 thru 0x018f4e (0x1626 bytes) 000985 1787707883.700898 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xb521b30f (stale) Mirror 27: 0xb521b30f (stale) Mirror 29: 0xb521b30f (stale) Mirror 31: 0xb521b30f (stale) Mirror 32: 0xb521b30f (stale) Mirror 33: 0xb521b30f (stale) Mirror 34: 0xb521b30f (stale) Mirror 35: 0xb521b30f (stale) Mirror 36: 0x5aec6222 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa6c5195d Mirror 37: 0xa6c5195d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000986 1787707885.721939 trunc from 0x040000 to 0x001931 (0x3e6ce bytes) 000987 1787707885.776970 write 0x03ecb6 thru 0x03ffff (0x134a bytes) 000988 1787707885.783098 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xb521b30f (stale) Mirror 27: 0xb521b30f (stale) Mirror 29: 0xb521b30f (stale) Mirror 31: 0xb521b30f (stale) Mirror 32: 0xb521b30f (stale) Mirror 33: 0xb521b30f (stale) Mirror 34: 0xb521b30f (stale) Mirror 35: 0xb521b30f (stale) Mirror 36: 0x5aec6222 (stale) Mirror 37: 0xa6c5195d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd88b4c03 Mirror 38: 0xd88b4c03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000989 1787707887.158882 mapwrite 0x015f82 thru 0x01d05e (0x70dd bytes) 000990 1787707887.269717 write 0x01fd49 thru 0x02c8ca (0xcb82 bytes) 000992 1787707887.301042 trunc from 0x040000 to 0x019f8f (0x26070 bytes) 000993 1787707887.323509 write 0x01531c thru 0x02093d (0xb622 bytes) 000994 1787707887.326054 write 0x0295d7 thru 0x03553a (0xbf64 bytes) 000995 1787707887.328993 trunc from 0x03553b to 0x02880a (0xcd30 bytes) 000996 1787707887.357864 mapwrite 0x0015a5 thru 0x002099 (0xaf5 bytes) 000997 1787707887.388803 trunc from 0x02880b to 0x03b87c (0x13072 bytes) 000998 1787707887.413897 mapwrite 0x03b03f thru 0x03f510 (0x44d2 bytes) 000999 1787707887.465463 trunc from 0x03f511 to 0x01dfb6 (0x2155a bytes) 001000 1787707887.496198 mapread 0x010a5e thru 0x017020 (0x65c3 bytes) All operations completed A-OK!