== sanity-flr test 70a: flr mode fsx test ================ 19:20:34 (1788391234) Seed set to 1235 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1788391236.050304 write 0x03ea8e thru 0x03ffff (0x1572 bytes) 000005 1788391236.055645 mapread 0x0159ed thru 0x01fae6 (0xa0fa bytes) 000006 1788391236.084744 mapread 0x012c97 thru 0x01991a (0x6c84 bytes) 000007 1788391236.086671 mapread 0x021768 thru 0x022e04 (0x169d bytes) truncating to largest ever: 0x1e910 000009 1788391236.097609 trunc from 0x040000 to 0x01e90f (0x216f0 bytes) 000010 1788391236.133193 trunc from 0x01e910 to 0x00d4f7 (0x11418 bytes) 000011 1788391236.152206 read 0x00cf34 thru 0x00d4f7 (0x5c4 bytes) 000012 1788391236.165634 mapread 0x00439f thru 0x00d4f7 (0x9159 bytes) 000014 1788391236.179455 write 0x00bce8 thru 0x01a81b (0xeb34 bytes) 000015 1788391236.182724 mapread 0x00c878 thru 0x01a81b (0xdfa4 bytes) 000017 1788391236.189061 mapwrite 0x034e2f thru 0x03612c (0x12fe bytes) 000019 1788391236.339358 trunc from 0x03612d to 0x0026e3 (0x33a49 bytes) truncating to largest ever: 0x37ba3 000020 1788391236.372840 trunc from 0x0026e4 to 0x037ba2 (0x354bf bytes) 000021 1788391236.397215 mapread 0x00471c thru 0x008a65 (0x434a bytes) 000024 1788391236.410567 read 0x018ab5 thru 0x01a1d8 (0x1724 bytes) 000025 1788391236.424625 mapwrite 0x038ce2 thru 0x03ffff (0x731e bytes) truncating to largest ever: 0x3d338 000026 1788391236.519566 trunc from 0x040000 to 0x03d337 (0x2cc8 bytes) 000027 1788391236.550680 mapread 0x01f261 thru 0x022232 (0x2fd2 bytes) 000028 1788391236.553111 mapread 0x0120fa thru 0x01b97e (0x9885 bytes) 000030 1788391236.556268 trunc from 0x03d338 to 0x03383d (0x9afa bytes) 000032 1788391236.577701 mapread 0x01e7eb thru 0x0258b9 (0x70cf bytes) 000033 1788391236.580908 mapwrite 0x038ba4 thru 0x03c1c7 (0x3624 bytes) 000034 1788391236.696601 mapread 0x00afd6 thru 0x0134c4 (0x84ef bytes) 000035 1788391236.697925 read 0x036eb5 thru 0x03c1c7 (0x5313 bytes) 000037 1788391236.710296 read 0x01c6b0 thru 0x02b96e (0xf2bf bytes) 000038 1788391236.711154 mapread 0x0129fa thru 0x01a035 (0x763c bytes) 000039 1788391236.722510 MIRROR_EXTEND to 2 mirrors 000040 1788391237.534808 MIRROR_RESYNC 2 mirrors 000041 1788391237.898715 mapread 0x002d93 thru 0x005ca9 (0x2f17 bytes) 000043 1788391237.931525 trunc from 0x03c1c8 to 0x02dbba (0xe60d bytes) 000044 1788391238.006543 mapwrite 0x009995 thru 0x00ab01 (0x116d bytes) 000045 1788391238.072628 trunc from 0x02dbbb to 0x00dcdc (0x1fede bytes) 000046 1788391238.095293 mapread 0x006a69 thru 0x007f1b (0x14b3 bytes) 000047 1788391238.096918 write 0x02d6f5 thru 0x0336d8 (0x5fe4 bytes) 000048 1788391238.104556 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x336d9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x336d9): Mirror 2: 0x3dedc64b (stale) CRC-32 checksum value for chunk [0, 0x336d9): Mirror 1: 0x4529d873 Mirror 3: 0x4529d873 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x336d9: skipped 000049 1788391239.057622 read 0x01e1d3 thru 0x02d3b4 (0xf1e2 bytes) 000051 1788391239.085953 trunc from 0x0336d9 to 0x035e3a (0x2762 bytes) 000053 1788391239.224081 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35e3b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e3b): Mirror 2: 0x839144f6 (stale) Mirror 3: 0xa0ad66dd (stale) CRC-32 checksum value for chunk [0, 0x35e3b): Mirror 1: 0xa0ad66dd Mirror 4: 0xa0ad66dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e3b: skipped 000054 1788391240.223519 mapread 0x01fe59 thru 0x0231fc (0x33a4 bytes) 000056 1788391240.249374 trunc from 0x035e3b to 0x01d34e (0x18aec bytes) 000057 1788391240.357948 read 0x00a8f6 thru 0x0162cc (0xb9d7 bytes) 000060 1788391240.371375 write 0x0169b9 thru 0x01ec3f (0x8287 bytes) 000061 1788391240.374634 punch from 0x00f3e0 to 0x01acf9 (0xb91a bytes) 000063 1788391240.395400 punch from 0x015947 to 0x019b9b (0x4255 bytes) 000064 1788391240.403554 mapread 0x00edc6 thru 0x019c48 (0xae83 bytes) 000065 1788391240.427633 trunc from 0x01ec40 to 0x00987d (0x153c2 bytes) 000066 1788391240.448490 write 0x0145f7 thru 0x022f23 (0xe92d bytes) 000067 1788391240.450728 trunc from 0x022f24 to 0x02331c (0x3f9 bytes) 000068 1788391240.471532 write 0x00ded5 thru 0x013a3b (0x5b67 bytes) 000069 1788391240.494074 MIRROR_RESYNC 4 mirrors 000070 1788391241.379474 read 0x012981 thru 0x01f026 (0xc6a6 bytes) 000071 1788391241.391846 read 0x000e02 thru 0x002b9f (0x1d9e bytes) 000072 1788391241.402059 mapread 0x00b6e8 thru 0x018bfa (0xd513 bytes) 000073 1788391241.403096 punch from 0x020a23 to 0x02331c (0x28fa bytes) 000074 1788391241.469548 mapread 0x00da64 thru 0x017e65 (0xa402 bytes) 000078 1788391241.528006 read 0x018fae thru 0x01f8d0 (0x6923 bytes) 000080 1788391241.537381 read 0x010e3b thru 0x01b6a8 (0xa86e bytes) 000081 1788391241.544206 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2331d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2331d): Mirror 2: 0x23b13848 (stale) Mirror 3: 0x23b13848 (stale) Mirror 4: 0x23b13848 (stale) CRC-32 checksum value for chunk [0, 0x2331d): Mirror 1: 0xaf2c861a Mirror 5: 0xaf2c861a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2331d: skipped 000083 1788391242.388488 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2331d): Mirror 3: 0x23b13848 (stale) Mirror 4: 0x23b13848 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2331d): Mirror 3: 0x23b13848 (stale) Mirror 4: 0x23b13848 (stale) CRC-32 checksum value for chunk [0, 0x2331d): Mirror 1: 0xaf2c861a Mirror 5: 0xaf2c861a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2331d: skipped 000084 1788391242.993658 write 0x03078f thru 0x03b2df (0xab51 bytes) 000085 1788391243.091037 write 0x0332ee thru 0x03977a (0x648d bytes) 000086 1788391243.092183 read 0x0260da thru 0x026f19 (0xe40 bytes) 000088 1788391243.100631 trunc from 0x03b2e0 to 0x01a24e (0x21091 bytes) 000089 1788391243.121385 punch from 0x00c288 to 0x018c9b (0xca14 bytes) 000090 1788391243.132235 punch from 0x00c192 to 0x00d064 (0xed3 bytes) 000092 1788391243.141718 write 0x03a8ff thru 0x03caf4 (0x21f6 bytes) 000094 1788391243.153327 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3caf5): Mirror 3: 0xd662fd6e (stale) Mirror 4: 0xd662fd6e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3caf5): Mirror 3: 0xd662fd6e (stale) Mirror 4: 0xd662fd6e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3caf5: skipped 000097 1788391243.538500 punch from 0x02d00f to 0x031dc6 (0x4db8 bytes) 000098 1788391243.544259 mapread 0x0282a3 thru 0x034568 (0xc2c6 bytes) 000099 1788391243.579837 MIRROR_RESYNC 3 mirrors 000105 1788391244.438491 write 0x019288 thru 0x027244 (0xdfbd bytes) 000107 1788391244.525584 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3caf5): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3caf5): Mirror 3: 0x20495607 (stale) Mirror 4: 0x20495607 (stale) CRC-32 checksum value for chunk [0, 0x3caf5): Mirror 1: 0x4c502f41 Mirror 5: 0x4c502f41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3caf5: skipped 000108 1788391245.320815 read 0x019752 thru 0x0250c2 (0xb971 bytes) 000111 1788391245.331485 punch from 0x03be32 to 0x03caf4 (0xcc3 bytes) 000115 1788391245.399883 mapwrite 0x03571a thru 0x03ffff (0xa8e6 bytes) 000116 1788391245.517929 write 0x0071bf thru 0x017102 (0xff44 bytes) 000119 1788391245.532531 write 0x00c6a4 thru 0x018014 (0xb971 bytes) 000120 1788391245.540432 mapread 0x01c64a thru 0x01fae2 (0x3499 bytes) 000121 1788391245.552994 mapread 0x02a988 thru 0x037d74 (0xd3ed bytes) 000122 1788391245.568262 read 0x01bfc3 thru 0x02738a (0xb3c8 bytes) 000125 1788391245.569950 mapread 0x027926 thru 0x02e677 (0x6d52 bytes) 000126 1788391245.573039 trunc from 0x040000 to 0x00494b (0x3b6b4 bytes) 000128 1788391245.597905 mapread 0x003e78 thru 0x00494b (0xad4 bytes) 000129 1788391245.612001 mapread 0x003983 thru 0x00494b (0xfc9 bytes) 000130 1788391245.612864 mapwrite 0x0120e6 thru 0x019e9e (0x7db9 bytes) 000135 1788391245.737023 read 0x00d96b thru 0x0102f6 (0x298c bytes) 000136 1788391245.737923 read 0x01567f thru 0x019e9e (0x4820 bytes) 000139 1788391245.740317 punch from 0x00472b to 0x00ae59 (0x672f bytes) 000140 1788391245.756186 punch from 0x015317 to 0x018f04 (0x3bee bytes) 000144 1788391245.763910 write 0x0292b4 thru 0x02b558 (0x22a5 bytes) 000145 1788391245.772669 MIRROR_RESYNC 4 mirrors 000147 1788391246.715058 write 0x02992c thru 0x02ac87 (0x135c bytes) 000148 1788391246.840170 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b559): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b559): Mirror 3: 0x80d99851 (stale) Mirror 4: 0x80d99851 (stale) Mirror 5: 0x80d99851 (stale) CRC-32 checksum value for chunk [0, 0x2b559): Mirror 1: 0x26eafb68 Mirror 6: 0x26eafb68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b559: skipped 000149 1788391247.779535 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2b559): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b559): Mirror 3: 0x80d99851 (stale) Mirror 4: 0x80d99851 (stale) Mirror 5: 0x80d99851 (stale) CRC-32 checksum value for chunk [0, 0x2b559): Mirror 1: 0x26eafb68 Mirror 6: 0x26eafb68 Mirror 7: 0x26eafb68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b559: skipped 000150 1788391248.603702 punch from 0x019c3b to 0x01e998 (0x4d5e bytes) 000152 1788391248.693659 MIRROR_RESYNC 6 mirrors 000153 1788391249.736353 trunc from 0x02b559 to 0x0377ff (0xc2a7 bytes) 000154 1788391249.812838 MIRROR_RESYNC 6 mirrors 000155 1788391251.092383 read 0x00606f thru 0x01230c (0xc29e bytes) 000156 1788391251.102259 punch from 0x01795e to 0x01894e (0xff1 bytes) 000157 1788391251.200896 mapread 0x034405 thru 0x0377ff (0x33fb bytes) 000158 1788391251.249359 punch from 0x016b37 to 0x02052d (0x99f7 bytes) 000162 1788391251.260441 punch from 0x00ce41 to 0x01b303 (0xe4c3 bytes) 000164 1788391251.267377 punch from 0x036811 to 0x0377ff (0xfef bytes) 000167 1788391251.275588 mapread 0x012156 thru 0x01b1e7 (0x9092 bytes) 000168 1788391251.325164 trunc from 0x037800 to 0x02f456 (0x83a9 bytes) 000169 1788391251.349218 mapread 0x01c8da thru 0x029b57 (0xd27e bytes) 000170 1788391251.361375 read 0x00d741 thru 0x01c52d (0xeded bytes) 000171 1788391251.362254 trunc from 0x02f457 to 0x0235ba (0xbe9c bytes) 000172 1788391251.387998 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x235bb): Mirror 3: 0x8da9d755 (stale) Mirror 4: 0x8da9d755 (stale) Mirror 5: 0x8da9d755 (stale) Mirror 7: 0x8da9d755 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x235bb): Mirror 3: 0x8da9d755 (stale) Mirror 4: 0x8da9d755 (stale) Mirror 5: 0x8da9d755 (stale) Mirror 7: 0x8da9d755 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x235bb: skipped 000173 1788391251.827170 read 0x01ebda thru 0x022314 (0x373b bytes) 000175 1788391251.842028 mapread 0x0093ef thru 0x00f605 (0x6217 bytes) 000177 1788391251.870678 punch from 0x005c55 to 0x01552b (0xf8d7 bytes) 000178 1788391251.881152 write 0x01c32e thru 0x028833 (0xc506 bytes) 000179 1788391251.890654 mapread 0x015308 thru 0x022288 (0xcf81 bytes) 000180 1788391251.904325 mapwrite 0x02b196 thru 0x035773 (0xa5de bytes) 000181 1788391252.012093 trunc from 0x035774 to 0x00ba8b (0x29ce8 bytes) 000185 1788391252.039001 MIRROR_RESYNC 5 mirrors 000186 1788391252.983547 trunc from 0x00ba8c to 0x005990 (0x60fb bytes) 000187 1788391253.067864 punch from 0x0025d4 to 0x005990 (0x33bd bytes) 000188 1788391253.076592 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: 0xb1b1cf43 (stale) Mirror 4: 0xb1b1cf43 (stale) Mirror 5: 0xb1b1cf43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: 0xb1b1cf43 (stale) Mirror 4: 0xb1b1cf43 (stale) Mirror 5: 0xb1b1cf43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5991: skipped 000190 1788391253.422608 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: 0xb1b1cf43 (stale) Mirror 4: 0xb1b1cf43 (stale) Mirror 5: 0xb1b1cf43 (stale) CRC-32 checksum value for chunk [0, 0x5991): Mirror 1: 0xb1b1cf43 Mirror 6: 0xb1b1cf43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5991: skipped 000191 1788391254.369649 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: 0xb1b1cf43 (stale) Mirror 4: 0xb1b1cf43 (stale) Mirror 5: 0xb1b1cf43 (stale) CRC-32 checksum value for chunk [0, 0x5991): Mirror 1: 0xb1b1cf43 Mirror 6: 0xb1b1cf43 Mirror 7: 0xb1b1cf43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5991: skipped 000192 1788391255.267540 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: 0xb1b1cf43 (stale) Mirror 4: 0xb1b1cf43 (stale) Mirror 5: 0xb1b1cf43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5991): Mirror 3: 0xb1b1cf43 (stale) Mirror 4: 0xb1b1cf43 (stale) Mirror 5: 0xb1b1cf43 (stale) CRC-32 checksum value for chunk [0, 0x5991): Mirror 1: 0xb1b1cf43 Mirror 6: 0xb1b1cf43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5991: skipped 000194 1788391255.771473 MIRROR_RESYNC 5 mirrors 000195 1788391256.585330 MIRROR_RESYNC 5 mirrors 000196 1788391256.940325 read 0x00079f thru 0x004d39 (0x459b bytes) 000198 1788391256.956173 write 0x021d4f thru 0x024a97 (0x2d49 bytes) 000199 1788391257.038653 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x24a98): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24a98): Mirror 3: 0xeb0a0d16 (stale) Mirror 4: 0xeb0a0d16 (stale) Mirror 5: 0xeb0a0d16 (stale) Mirror 6: 0xeb0a0d16 (stale) CRC-32 checksum value for chunk [0, 0x24a98): Mirror 1: 0xeb817741 Mirror 7: 0xeb817741 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24a98: skipped 000200 1788391258.020317 mapwrite 0x034a16 thru 0x03ffff (0xb5ea bytes) 000203 1788391258.205213 write 0x017a8f thru 0x02572f (0xdca1 bytes) 000204 1788391258.230438 read 0x0302ba thru 0x032c39 (0x2980 bytes) 000205 1788391258.231078 mapwrite 0x02a431 thru 0x0326fc (0x82cc bytes) 000206 1788391258.319144 trunc from 0x040000 to 0x0097c8 (0x36837 bytes) 000208 1788391258.344563 mapread 0x006d3d thru 0x0097c8 (0x2a8c bytes) 000211 1788391258.364445 write 0x038363 thru 0x03dc37 (0x58d5 bytes) 000212 1788391258.365954 read 0x0211a7 thru 0x025856 (0x46b0 bytes) 000214 1788391258.376516 mapread 0x004c2b thru 0x007322 (0x26f8 bytes) 000215 1788391258.377399 mapread 0x00b5ce thru 0x015a8e (0xa4c1 bytes) 000216 1788391258.378167 write 0x023163 thru 0x026227 (0x30c5 bytes) 000217 1788391258.379268 trunc from 0x03dc38 to 0x038d3d (0x4efa bytes) 000218 1788391258.417171 mapwrite 0x03d393 thru 0x03ffff (0x2c6d bytes) 000219 1788391258.507738 mapread 0x020811 thru 0x02b2c2 (0xaab2 bytes) 000221 1788391258.509554 mapwrite 0x02bbf2 thru 0x02dd1d (0x212c bytes) 000225 1788391258.564296 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000226 1788391258.909491 punch from 0x0290d9 to 0x0374b5 (0xe3dd bytes) 000227 1788391258.914465 mapwrite 0x01705f thru 0x020d3c (0x9cde bytes) 000230 1788391259.022146 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000231 1788391259.350543 mapwrite 0x00318d thru 0x007f46 (0x4dba bytes) 000232 1788391259.436930 trunc from 0x040000 to 0x008d5b (0x372a4 bytes) 000233 1788391259.456277 mapread 0x0064f2 thru 0x008d5b (0x286a bytes) 000234 1788391259.457582 write 0x012e5c thru 0x01a18b (0x7330 bytes) 000235 1788391259.460308 write 0x0295cb thru 0x0366dc (0xd112 bytes) 000236 1788391259.466254 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x366dd): Mirror 3: 0xccfc1b29 (stale) Mirror 5: 0xccfc1b29 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366dd): Mirror 3: 0xccfc1b29 (stale) Mirror 5: 0xccfc1b29 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366dd: skipped 000238 1788391259.768988 mapwrite 0x0086c7 thru 0x00f299 (0x6bd3 bytes) 000240 1788391259.849988 punch from 0x024ad9 to 0x030bb6 (0xc0de bytes) 000241 1788391259.860989 punch from 0x003350 to 0x0117e3 (0xe494 bytes) 000242 1788391259.865137 write 0x034a5c thru 0x03ffff (0xb5a4 bytes) 000244 1788391259.870695 mapwrite 0x0093e1 thru 0x00b33d (0x1f5d bytes) 000245 1788391259.918627 read 0x02c392 thru 0x030018 (0x3c87 bytes) 000246 1788391259.929702 MIRROR_RESYNC 3 mirrors 000247 1788391260.647613 punch from 0x0066e4 to 0x009138 (0x2a55 bytes) 000248 1788391260.707796 read 0x019eb0 thru 0x01b689 (0x17da bytes) 000249 1788391260.718359 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9d9aff0d (stale) Mirror 5: 0x9d9aff0d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9d9aff0d Mirror 6: 0x9d9aff0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000253 1788391261.423206 punch from 0x02eb17 to 0x0325ad (0x3a97 bytes) 000257 1788391261.497340 trunc from 0x040000 to 0x028fec (0x17013 bytes) 000259 1788391261.538487 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28fed): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28fed): Mirror 3: 0x87e62fe0 (stale) Mirror 5: 0x87e62fe0 (stale) Mirror 6: 0x87e62fe0 (stale) CRC-32 checksum value for chunk [0, 0x28fed): Mirror 1: 0x87e62fe0 Mirror 7: 0x87e62fe0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28fed: skipped 000261 1788391262.306641 read 0x01895a thru 0x026e78 (0xe51f bytes) 000262 1788391262.323176 read 0x004b70 thru 0x010288 (0xb719 bytes) 000263 1788391262.347627 mapread 0x00eb31 thru 0x017397 (0x8867 bytes) 000264 1788391262.367481 punch from 0x022791 to 0x028fec (0x685c bytes) 000265 1788391262.449636 write 0x00fb3d thru 0x0136cf (0x3b93 bytes) 000266 1788391262.459312 mapwrite 0x015dbc thru 0x01d6f1 (0x7936 bytes) 000267 1788391262.572690 trunc from 0x028fed to 0x03ac8c (0x11ca0 bytes) 000268 1788391262.601139 trunc from 0x03ac8d to 0x011670 (0x2961c bytes) 000269 1788391262.620428 write 0x02d34c thru 0x03bf39 (0xebee bytes) 000270 1788391262.625903 mapwrite 0x0180e6 thru 0x01a20c (0x2127 bytes) 000272 1788391262.695400 trunc from 0x03bf3a to 0x035598 (0x69a1 bytes) 000273 1788391262.714508 read 0x01666c thru 0x0251d3 (0xeb68 bytes) 000275 1788391262.746051 trunc from 0x035599 to 0x0081ad (0x2d3eb bytes) 000276 1788391262.760725 mapwrite 0x0114b4 thru 0x01fde0 (0xe92d bytes) 000277 1788391262.919438 write 0x02cc8e thru 0x034f59 (0x82cc bytes) 000279 1788391262.922130 write 0x030e88 thru 0x039f5b (0x90d4 bytes) 000282 1788391262.926380 punch from 0x010cf7 to 0x01f60a (0xe914 bytes) 000285 1788391262.942675 write 0x021370 thru 0x028864 (0x74f5 bytes) 000288 1788391262.956805 punch from 0x02eb38 to 0x032125 (0x35ee bytes) 000289 1788391262.982444 write 0x0325be thru 0x03bd06 (0x9749 bytes) 000290 1788391262.989418 punch from 0x023197 to 0x029229 (0x6093 bytes) 000293 1788391263.008598 read 0x0169a3 thru 0x01d732 (0x6d90 bytes) 000294 1788391263.016149 trunc from 0x03bd07 to 0x018902 (0x23404 bytes) 000295 1788391263.030691 write 0x00ec42 thru 0x01e717 (0xfad6 bytes) 000296 1788391263.032815 trunc from 0x01e718 to 0x029b47 (0xb430 bytes) 000297 1788391263.051487 read 0x0240dd thru 0x029b47 (0x5a6b bytes) 000298 1788391263.073883 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29b48): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b48): Mirror 3: 0xaa9d3678 (stale) Mirror 5: 0xaa9d3678 (stale) Mirror 6: 0xaa9d3678 (stale) Mirror 7: 0xaa9d3678 (stale) CRC-32 checksum value for chunk [0, 0x29b48): Mirror 1: 0x7f1dcc2e Mirror 8: 0x7f1dcc2e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b48: skipped 000300 1788391264.094834 trunc from 0x029b48 to 0x036adc (0xcf95 bytes) 000301 1788391264.215098 mapwrite 0x001ccc thru 0x011742 (0xfa77 bytes) 000302 1788391264.323336 mapwrite 0x001285 thru 0x00ed13 (0xda8f bytes) truncating to largest ever: 0x3fdfe 000304 1788391264.365809 trunc from 0x036add to 0x03fdfd (0x9321 bytes) 000305 1788391264.398065 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fdfe): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fdfe): Mirror 3: 0x93021687 (stale) Mirror 5: 0x93021687 (stale) Mirror 6: 0x93021687 (stale) Mirror 7: 0x3fa346da (stale) Mirror 8: 0xe4e7b54e (stale) CRC-32 checksum value for chunk [0, 0x3fdfe): Mirror 1: 0xd60a89be Mirror 9: 0xd60a89be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fdfe: skipped 000306 1788391265.440928 write 0x02d3c4 thru 0x036024 (0x8c61 bytes) 000308 1788391265.521143 read 0x02908a thru 0x02b75d (0x26d4 bytes) 000310 1788391265.532509 write 0x0259bf thru 0x0330c3 (0xd705 bytes) 000311 1788391265.541175 mapwrite 0x019285 thru 0x02001d (0x6d99 bytes) 000312 1788391265.624594 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fdfe): Mirror 3: 0x93021687 (stale) Mirror 5: 0x93021687 (stale) Mirror 6: 0x93021687 (stale) Mirror 7: 0x3fa346da (stale) Mirror 8: 0xe4e7b54e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fdfe): Mirror 3: 0x93021687 (stale) Mirror 5: 0x93021687 (stale) Mirror 6: 0x93021687 (stale) Mirror 7: 0x3fa346da (stale) Mirror 8: 0xe4e7b54e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fdfe: skipped 000313 1788391266.030208 read 0x02fef5 thru 0x031612 (0x171e bytes) 000314 1788391266.037363 read 0x011c2e thru 0x01e424 (0xc7f7 bytes) 000316 1788391266.049939 punch from 0x03ec68 to 0x03fdfd (0x1196 bytes) 000317 1788391266.058071 write 0x03036c thru 0x03ffff (0xfc94 bytes) 000318 1788391266.061179 punch from 0x00fae5 to 0x012ba4 (0x30c0 bytes) 000319 1788391266.074836 punch from 0x0223d0 to 0x025978 (0x35a9 bytes) 000320 1788391266.079514 read 0x01dd99 thru 0x029822 (0xba8a bytes) 000322 1788391266.089582 trunc from 0x040000 to 0x00d7a5 (0x3285a bytes) 000324 1788391266.118919 write 0x037591 thru 0x03ffff (0x8a6f bytes) 000326 1788391266.122371 write 0x024e03 thru 0x028178 (0x3376 bytes) 000327 1788391266.136997 write 0x02e078 thru 0x0328d2 (0x485b bytes) 000328 1788391266.153163 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9d9aff0d (stale) Mirror 5: 0x9d9aff0d (stale) Mirror 6: 0x9d9aff0d (stale) Mirror 7: 0xd1001c87 (stale) Mirror 8: 0xcc4b5297 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe19f54c4 Mirror 9: 0xe19f54c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000329 1788391267.133840 punch from 0x017034 to 0x02442a (0xd3f7 bytes) 000332 1788391267.210594 write 0x037d45 thru 0x03ce2a (0x50e6 bytes) 000334 1788391267.224117 punch from 0x03c646 to 0x03d7b0 (0x116b bytes) 000339 1788391267.243478 trunc from 0x040000 to 0x039512 (0x6aed bytes) 000340 1788391267.287477 mapwrite 0x03e568 thru 0x03ffff (0x1a98 bytes) 000341 1788391267.366165 read 0x03c952 thru 0x03ffff (0x36ae bytes) 000344 1788391267.376235 read 0x01e696 thru 0x02d094 (0xe9ff bytes) 000345 1788391267.393492 mapread 0x00b815 thru 0x01239d (0x6b89 bytes) 000346 1788391267.394511 mapread 0x0135ea thru 0x01a293 (0x6caa bytes) 000347 1788391267.401105 MIRROR_RESYNC 7 mirrors 000350 1788391269.058996 punch from 0x00ffc4 to 0x0172c9 (0x7306 bytes) 000351 1788391269.128505 read 0x00fd25 thru 0x016646 (0x6922 bytes) 000352 1788391269.139705 write 0x026b58 thru 0x032857 (0xbd00 bytes) 000354 1788391269.153914 write 0x017349 thru 0x025a97 (0xe74f bytes) 000358 1788391269.183828 MIRROR_RESYNC 7 mirrors 000359 1788391270.210789 trunc from 0x040000 to 0x00c68d (0x33972 bytes) 000363 1788391270.319098 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc68e): Mirror 3: 0x504f0672 (stale) Mirror 5: 0x504f0672 (stale) Mirror 6: 0x504f0672 (stale) Mirror 7: 0x504f0672 (stale) Mirror 9: 0x504f0672 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc68e): Mirror 3: 0x504f0672 (stale) Mirror 5: 0x504f0672 (stale) Mirror 6: 0x504f0672 (stale) Mirror 7: 0x504f0672 (stale) Mirror 9: 0x504f0672 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc68e: skipped 000365 1788391270.735065 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xc68e): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc68e): Mirror 3: 0x504f0672 (stale) Mirror 5: 0x504f0672 (stale) Mirror 6: 0x504f0672 (stale) Mirror 7: 0x504f0672 (stale) Mirror 9: 0x504f0672 (stale) CRC-32 checksum value for chunk [0, 0xc68e): Mirror 1: 0x504f0672 Mirror 10: 0x504f0672 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc68e: skipped 000366 1788391271.565836 mapwrite 0x0302b5 thru 0x03c07f (0xbdcb bytes) 000368 1788391271.756594 mapread 0x0238c9 thru 0x02f9db (0xc113 bytes) 000369 1788391271.781954 read 0x00667d thru 0x012106 (0xba8a bytes) 000370 1788391271.799232 trunc from 0x03c080 to 0x016980 (0x256ff bytes) 000371 1788391271.837562 mapread 0x010c67 thru 0x011f35 (0x12cf bytes) 000372 1788391271.838589 punch from 0x00ff39 to 0x0162b8 (0x6380 bytes) 000374 1788391271.849393 punch from 0x00f455 to 0x016980 (0x752c bytes) 000376 1788391271.859992 write 0x003442 thru 0x012ba3 (0xf762 bytes) 000378 1788391271.871350 punch from 0x001352 to 0x00f770 (0xe41f bytes) 000381 1788391271.885958 write 0x03dba0 thru 0x03ffff (0x2460 bytes) 000382 1788391271.887305 mapwrite 0x01f047 thru 0x02e572 (0xf52c bytes) 000383 1788391271.959484 punch from 0x01f774 to 0x02da2a (0xe2b7 bytes) 000384 1788391271.965184 punch from 0x00dd59 to 0x01c545 (0xe7ed bytes) 000385 1788391271.972083 mapwrite 0x003a16 thru 0x007fc9 (0x45b4 bytes) 000387 1788391272.033020 read 0x02a5ef thru 0x033e10 (0x9822 bytes) 000388 1788391272.054388 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x821c0fd0 (stale) Mirror 5: 0x821c0fd0 (stale) Mirror 6: 0x821c0fd0 (stale) Mirror 7: 0x821c0fd0 (stale) Mirror 9: 0x821c0fd0 (stale) Mirror 10: 0x31b11eda (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x84e4f86a Mirror 11: 0x84e4f86a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000389 1788391272.914483 mapread 0x02fb8b thru 0x030390 (0x806 bytes) 000390 1788391272.927738 mapwrite 0x00e3b7 thru 0x011da3 (0x39ed bytes) 000392 1788391273.061872 write 0x014d6a thru 0x01f3cb (0xa662 bytes) 000393 1788391273.067254 mapwrite 0x01ba2c thru 0x026e7e (0xb453 bytes) 000396 1788391273.129330 mapread 0x02a860 thru 0x031985 (0x7126 bytes) 000398 1788391273.138171 trunc from 0x040000 to 0x01eaed (0x21512 bytes) 000400 1788391273.163575 write 0x0350bd thru 0x0372cf (0x2213 bytes) 000401 1788391273.164938 write 0x01c65c thru 0x023b9a (0x753f bytes) 000402 1788391273.177677 punch from 0x004645 to 0x0139b8 (0xf374 bytes) 000403 1788391273.197080 mapread 0x02a328 thru 0x0372cf (0xcfa8 bytes) 000405 1788391273.212790 write 0x0099aa thru 0x00f9aa (0x6001 bytes) 000406 1788391273.222176 write 0x031156 thru 0x03865c (0x7507 bytes) 000407 1788391273.230072 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3865d): Mirror 3: 0xb1a1420f (stale) Mirror 5: 0xb1a1420f (stale) Mirror 6: 0xb1a1420f (stale) Mirror 7: 0xb1a1420f (stale) Mirror 9: 0xb1a1420f (stale) Mirror 10: 0xbea1675a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3865d): Mirror 3: 0xb1a1420f (stale) Mirror 5: 0xb1a1420f (stale) Mirror 6: 0xb1a1420f (stale) Mirror 7: 0xb1a1420f (stale) Mirror 9: 0xb1a1420f (stale) Mirror 10: 0xbea1675a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3865d: skipped 000409 1788391273.685560 write 0x025fe8 thru 0x029e73 (0x3e8c bytes) 000410 1788391273.699974 trunc from 0x03865d to 0x03a300 (0x1ca4 bytes) 000412 1788391273.724380 mapwrite 0x02a22e thru 0x037087 (0xce5a bytes) 000414 1788391273.829586 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: 0x30bcf6 (stale) Mirror 5: 0x30bcf6 (stale) Mirror 6: 0x30bcf6 (stale) Mirror 7: 0x30bcf6 (stale) Mirror 9: 0x30bcf6 (stale) Mirror 10: 0xb11cee30 (stale) CRC-32 checksum value for chunk [0, 0x3a301): Mirror 1: 0xba2de608 Mirror 11: 0xba2de608 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a301: skipped 000416 1788391274.772191 MIRROR_RESYNC 8 mirrors 000418 1788391276.034056 MIRROR_EXTEND to 9 mirrors 000419 1788391276.703303 mapwrite 0x02b4ca thru 0x038ed8 (0xda0f bytes) 000420 1788391276.893921 mapwrite 0x0140d5 thru 0x021f27 (0xde53 bytes) 000421 1788391276.970088 write 0x007502 thru 0x00e21e (0x6d1d bytes) 000422 1788391276.974696 mapread 0x00ea4a thru 0x013729 (0x4ce0 bytes) 000423 1788391276.976398 read 0x0071f2 thru 0x014f13 (0xdd22 bytes) 000424 1788391276.977509 mapwrite 0x01c15d thru 0x024220 (0x80c4 bytes) 000425 1788391277.046558 punch from 0x0345bf to 0x03a300 (0x5d42 bytes) 000426 1788391277.056049 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: 0xba2de608 (stale) Mirror 5: 0xba2de608 (stale) Mirror 6: 0xba2de608 (stale) Mirror 7: 0xba2de608 (stale) Mirror 9: 0xba2de608 (stale) Mirror 10: 0xba2de608 (stale) Mirror 11: 0xba2de608 (stale) Mirror 12: 0xba2de608 (stale) CRC-32 checksum value for chunk [0, 0x3a301): Mirror 1: 0x2afb9954 Mirror 13: 0x2afb9954 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a301: skipped 000428 1788391277.989953 mapwrite 0x00ed74 thru 0x010265 (0x14f2 bytes) 000429 1788391278.173765 write 0x024d87 thru 0x02935a (0x45d4 bytes) 000431 1788391278.187996 write 0x01cf42 thru 0x01e277 (0x1336 bytes) 000432 1788391278.207225 MIRROR_RESYNC 10 mirrors 000433 1788391279.471289 punch from 0x015c87 to 0x01cb85 (0x6eff bytes) 000434 1788391279.547907 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: 0x88c50042 (stale) Mirror 5: 0x88c50042 (stale) Mirror 6: 0x88c50042 (stale) Mirror 7: 0x88c50042 (stale) Mirror 10: 0x88c50042 (stale) Mirror 11: 0x88c50042 (stale) Mirror 12: 0x88c50042 (stale) Mirror 13: 0x88c50042 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: 0x88c50042 (stale) Mirror 5: 0x88c50042 (stale) Mirror 6: 0x88c50042 (stale) Mirror 7: 0x88c50042 (stale) Mirror 10: 0x88c50042 (stale) Mirror 11: 0x88c50042 (stale) Mirror 12: 0x88c50042 (stale) Mirror 13: 0x88c50042 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a301: skipped 000436 1788391280.049103 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a301): Mirror 3: 0x88c50042 (stale) Mirror 5: 0x88c50042 (stale) Mirror 6: 0x88c50042 (stale) Mirror 7: 0x88c50042 (stale) Mirror 10: 0x88c50042 (stale) Mirror 11: 0x88c50042 (stale) Mirror 12: 0x88c50042 (stale) Mirror 13: 0x88c50042 (stale) CRC-32 checksum value for chunk [0, 0x3a301): Mirror 1: 0x1ffe2b0a Mirror 14: 0x1ffe2b0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a301: skipped 000438 1788391280.961567 trunc from 0x03a301 to 0x00dfde (0x2c322 bytes) 000439 1788391281.055413 punch from 0x00b174 to 0x00dfde (0x2e6b bytes) 000440 1788391281.061070 write 0x02405d thru 0x02b004 (0x6fa8 bytes) 000441 1788391281.066002 trunc from 0x02b005 to 0x033c14 (0x8c10 bytes) 000442 1788391281.097184 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33c15): Mirror 5: 0x7197a127 (stale) Mirror 6: 0x7197a127 (stale) Mirror 7: 0x7197a127 (stale) Mirror 10: 0x7197a127 (stale) Mirror 11: 0x7197a127 (stale) Mirror 12: 0x7197a127 (stale) Mirror 13: 0x7197a127 (stale) Mirror 14: 0xf161eacd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c15): Mirror 5: 0x7197a127 (stale) Mirror 6: 0x7197a127 (stale) Mirror 7: 0x7197a127 (stale) Mirror 10: 0x7197a127 (stale) Mirror 11: 0x7197a127 (stale) Mirror 12: 0x7197a127 (stale) Mirror 13: 0x7197a127 (stale) Mirror 14: 0xf161eacd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c15: skipped 000445 1788391281.635963 mapwrite 0x023c50 thru 0x033087 (0xf438 bytes) 000446 1788391281.735870 write 0x038606 thru 0x03f28b (0x6c86 bytes) 000449 1788391281.739194 trunc from 0x03f28c to 0x03d241 (0x204a bytes) 000450 1788391281.757027 read 0x02388b thru 0x02bd68 (0x84de bytes) 000451 1788391281.758014 mapwrite 0x024ea7 thru 0x028d5c (0x3eb6 bytes) 000452 1788391281.816147 punch from 0x01051b to 0x016c86 (0x676c bytes) 000453 1788391281.823230 trunc from 0x03d242 to 0x02a672 (0x12bcf bytes) 000456 1788391281.846037 trunc from 0x02a673 to 0x00f45a (0x1b218 bytes) 000457 1788391281.869624 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xf45b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf45b): Mirror 5: 0xb77d5bff (stale) Mirror 6: 0xb77d5bff (stale) Mirror 7: 0xb77d5bff (stale) Mirror 10: 0xb77d5bff (stale) Mirror 11: 0xb77d5bff (stale) Mirror 12: 0xb77d5bff (stale) Mirror 13: 0xb77d5bff (stale) Mirror 14: 0xb77d5bff (stale) CRC-32 checksum value for chunk [0, 0xf45b): Mirror 1: 0xd79a6aff Mirror 15: 0xd79a6aff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf45b: skipped 000458 1788391282.902127 read 0x006fb3 thru 0x00f45a (0x84a8 bytes) 000460 1788391282.934732 trunc from 0x00f45b to 0x009ca0 (0x57ba bytes) 000461 1788391283.011727 read 0x002129 thru 0x009ca0 (0x7b78 bytes) 000462 1788391283.020002 punch from 0x003c3d to 0x009ca0 (0x6064 bytes) 000463 1788391283.026532 read 0x00040c thru 0x009ca0 (0x9895 bytes) 000464 1788391283.038552 read 0x000a7f thru 0x003e6d (0x33ef bytes) 000466 1788391283.039573 trunc from 0x009ca1 to 0x00f1fe (0x555e bytes) 000469 1788391283.058724 punch from 0x001ef8 to 0x0099ec (0x7af5 bytes) 000470 1788391283.063488 read 0x00156f thru 0x00dc49 (0xc6db bytes) 000471 1788391283.071203 trunc from 0x00f1ff to 0x014fee (0x5df0 bytes) 000472 1788391283.089652 write 0x036a14 thru 0x03ffff (0x95ec bytes) 000475 1788391283.092539 write 0x00cbf2 thru 0x0142be (0x76cd bytes) 000476 1788391283.100471 mapwrite 0x00d14a thru 0x017363 (0xa21a bytes) 000477 1788391283.161510 read 0x00e8aa thru 0x01cbda (0xe331 bytes) 000478 1788391283.162189 mapread 0x006821 thru 0x00d058 (0x6838 bytes) 000479 1788391283.163023 punch from 0x002edb to 0x00cb76 (0x9c9c bytes) 000480 1788391283.172434 read 0x02a837 thru 0x02ff31 (0x56fb bytes) 000483 1788391283.174089 trunc from 0x040000 to 0x02d63e (0x129c1 bytes) 000485 1788391283.201563 read 0x02520b thru 0x027211 (0x2007 bytes) 000487 1788391283.203417 mapwrite 0x017e0c thru 0x01c6aa (0x489f bytes) 000490 1788391283.286906 read 0x018b7b thru 0x028a62 (0xfee8 bytes) 000491 1788391283.287687 write 0x02c3df thru 0x03c273 (0xfe95 bytes) 000492 1788391283.304017 MIRROR_RESYNC 10 mirrors 000493 1788391284.735486 MIRROR_RESYNC 10 mirrors 000495 1788391285.218899 mapwrite 0x030649 thru 0x036257 (0x5c0f bytes) 000496 1788391285.391337 mapread 0x01bffc thru 0x021254 (0x5259 bytes) 000497 1788391285.404316 punch from 0x01cac6 to 0x020fd1 (0x450c bytes) 000498 1788391285.417111 mapwrite 0x01e6be thru 0x02e542 (0xfe85 bytes) 000500 1788391285.483294 trunc from 0x03c274 to 0x03173a (0xab39 bytes) 000501 1788391285.508601 mapread 0x019451 thru 0x0243c4 (0xaf74 bytes) 000502 1788391285.510110 punch from 0x00d28b to 0x015597 (0x830d bytes) 000503 1788391285.514640 mapread 0x0155e2 thru 0x01ffdd (0xa9fc bytes) 000504 1788391285.527195 trunc from 0x03173b to 0x0170db (0x1a65f bytes) 000505 1788391285.549801 trunc from 0x0170dc to 0x02c01a (0x14f3f bytes) 000506 1788391285.569793 mapwrite 0x03cbea thru 0x03f202 (0x2619 bytes) 000507 1788391285.644329 punch from 0x01c827 to 0x026583 (0x9d5d bytes) 000508 1788391285.648239 trunc from 0x03f203 to 0x003df7 (0x3b40b bytes) 000509 1788391285.664943 write 0x00a1f4 thru 0x0153fa (0xb207 bytes) 000510 1788391285.667098 trunc from 0x0153fb to 0x038c09 (0x2380f bytes) 000511 1788391285.691516 punch from 0x005a29 to 0x00b5c1 (0x5b99 bytes) 000512 1788391285.715514 mapread 0x006ebf thru 0x011de8 (0xaf2a bytes) 000514 1788391285.738483 mapread 0x02ee6f thru 0x038549 (0x96db bytes) 000515 1788391285.766627 mapwrite 0x01437f thru 0x01ad6b (0x69ed bytes) 000516 1788391285.823481 write 0x016a0d thru 0x01a718 (0x3d0c bytes) 000517 1788391285.824505 trunc from 0x038c0a to 0x0300dd (0x8b2c bytes) 000518 1788391285.839666 write 0x000fdc thru 0x005208 (0x422d bytes) 000519 1788391285.847099 punch from 0x0233c9 to 0x02ab61 (0x7799 bytes) 000520 1788391285.863033 trunc from 0x0300de to 0x03dde8 (0xdd0b bytes) 000521 1788391285.880112 mapwrite 0x015b39 thru 0x01a6fc (0x4bc4 bytes) 000522 1788391285.931045 mapread 0x03dd44 thru 0x03dde8 (0xa5 bytes) 000523 1788391285.948412 mapwrite 0x02b071 thru 0x038c16 (0xdba6 bytes) 000524 1788391286.016223 punch from 0x03b454 to 0x03dde8 (0x2995 bytes) 000526 1788391286.023888 mapread 0x028fe4 thru 0x02e7b6 (0x57d3 bytes) 000528 1788391286.044458 MIRROR_RESYNC 10 mirrors 000529 1788391287.329809 MIRROR_EXTEND to 11 mirrors 000531 1788391288.129308 mapread 0x025e4f thru 0x02a036 (0x41e8 bytes) 000532 1788391288.149882 read 0x033f2a thru 0x03a52b (0x6602 bytes) 000533 1788391288.164209 read 0x03bea0 thru 0x03dde8 (0x1f49 bytes) 000534 1788391288.178201 MIRROR_RESYNC 11 mirrors 000535 1788391288.788685 mapwrite 0x0333c4 thru 0x03a865 (0x74a2 bytes) 000536 1788391288.963183 write 0x007345 thru 0x008490 (0x114c bytes) 000537 1788391288.974120 write 0x00a0eb thru 0x00a159 (0x6f bytes) 000538 1788391288.984427 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3dde9): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dde9): Mirror 5: 0xa6ada1c2 (stale) Mirror 6: 0xa6ada1c2 (stale) Mirror 7: 0xa6ada1c2 (stale) Mirror 10: 0xa6ada1c2 (stale) Mirror 11: 0xa6ada1c2 (stale) Mirror 12: 0xa6ada1c2 (stale) Mirror 13: 0xa6ada1c2 (stale) Mirror 14: 0xa6ada1c2 (stale) Mirror 15: 0xa6ada1c2 (stale) Mirror 16: 0xa6ada1c2 (stale) CRC-32 checksum value for chunk [0, 0x3dde9): Mirror 1: 0x74c8f1a7 Mirror 17: 0x74c8f1a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dde9: skipped 000540 1788391290.026866 trunc from 0x03dde9 to 0x02446d (0x1997b bytes) 000541 1788391290.119177 mapread 0x021b5b thru 0x02446d (0x2913 bytes) 000542 1788391290.143419 punch from 0x004901 to 0x004949 (0x49 bytes) 000543 1788391290.149701 punch from 0x0025fc to 0x007f80 (0x5985 bytes) 000544 1788391290.162372 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2446e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2446e): Mirror 5: 0xfd9a1c53 (stale) Mirror 6: 0xfd9a1c53 (stale) Mirror 7: 0xfd9a1c53 (stale) Mirror 10: 0xfd9a1c53 (stale) Mirror 11: 0xfd9a1c53 (stale) Mirror 12: 0xfd9a1c53 (stale) Mirror 13: 0xfd9a1c53 (stale) Mirror 14: 0xfd9a1c53 (stale) Mirror 15: 0xfd9a1c53 (stale) Mirror 16: 0xfd9a1c53 (stale) Mirror 17: 0x45f8f2f0 (stale) CRC-32 checksum value for chunk [0, 0x2446e): Mirror 1: 0x1a5b1ea5 Mirror 18: 0x1a5b1ea5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2446e: skipped 000545 1788391291.142892 trunc from 0x02446e to 0x0189a0 (0xbacd bytes) 000547 1788391291.258445 MIRROR_RESYNC 13 mirrors 000548 1788391292.863521 trunc from 0x0189a1 to 0x03b18d (0x227ed bytes) 000550 1788391292.966366 trunc from 0x03b18e to 0x008a80 (0x3270d bytes) 000551 1788391292.999109 mapwrite 0x00de61 thru 0x014ac5 (0x6c65 bytes) 000552 1788391293.163252 mapread 0x00be16 thru 0x011f28 (0x6113 bytes) 000553 1788391293.164632 read 0x0140fb thru 0x014ac5 (0x9cb bytes) 000554 1788391293.177139 MIRROR_RESYNC 13 mirrors 000556 1788391294.916551 read 0x00c208 thru 0x012080 (0x5e79 bytes) 000557 1788391294.931514 mapwrite 0x02d406 thru 0x03221a (0x4e15 bytes) 000558 1788391295.137088 mapread 0x000e64 thru 0x010c02 (0xfd9f bytes) 000559 1788391295.161050 mapread 0x0315e0 thru 0x03221a (0xc3b bytes) 000560 1788391295.162068 punch from 0x0009d3 to 0x002761 (0x1d8f bytes) 000562 1788391295.170614 mapread 0x0147d7 thru 0x01f8e5 (0xb10f bytes) 000563 1788391295.180613 punch from 0x0252fe to 0x030efb (0xbbfe bytes) 000564 1788391295.186998 punch from 0x01199e to 0x014fa7 (0x360a bytes) 000565 1788391295.191724 read 0x021a16 thru 0x028e02 (0x73ed bytes) 000566 1788391295.204273 write 0x020c8a thru 0x02d11d (0xc494 bytes) 000567 1788391295.205699 mapwrite 0x0018e6 thru 0x001cbe (0x3d9 bytes) 000568 1788391295.269857 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3221b): Mirror 6: 0x9fd3f760 (stale) Mirror 7: 0x9fd3f760 (stale) Mirror 10: 0x9fd3f760 (stale) Mirror 11: 0x9fd3f760 (stale) Mirror 12: 0x9fd3f760 (stale) Mirror 13: 0x9fd3f760 (stale) Mirror 14: 0x9fd3f760 (stale) Mirror 15: 0x9fd3f760 (stale) Mirror 16: 0x9fd3f760 (stale) Mirror 17: 0x9fd3f760 (stale) Mirror 18: 0x9fd3f760 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3221b): Mirror 6: 0x9fd3f760 (stale) Mirror 7: 0x9fd3f760 (stale) Mirror 10: 0x9fd3f760 (stale) Mirror 11: 0x9fd3f760 (stale) Mirror 12: 0x9fd3f760 (stale) Mirror 13: 0x9fd3f760 (stale) Mirror 14: 0x9fd3f760 (stale) Mirror 15: 0x9fd3f760 (stale) Mirror 16: 0x9fd3f760 (stale) Mirror 17: 0x9fd3f760 (stale) Mirror 18: 0x9fd3f760 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3221b: skipped 000569 1788391295.819781 mapread 0x0073c3 thru 0x00cf2b (0x5b69 bytes) 000570 1788391295.849264 mapread 0x02521a thru 0x029874 (0x465b bytes) 000571 1788391295.862436 trunc from 0x03221b to 0x03030b (0x1f0f bytes) 000572 1788391295.878334 trunc from 0x03030c to 0x0245e6 (0xbd25 bytes) 000574 1788391295.894640 trunc from 0x0245e7 to 0x000147 (0x2449f bytes) 000575 1788391295.911558 read 0x00007e thru 0x000147 (0xca bytes) 000577 1788391295.918425 mapwrite 0x031157 thru 0x038b27 (0x79d1 bytes) 000578 1788391296.020865 mapread 0x00c883 thru 0x01c0a4 (0xf822 bytes) 000579 1788391296.041276 read 0x0196d8 thru 0x021a58 (0x8381 bytes) 000580 1788391296.055610 write 0x00c71f thru 0x014fa3 (0x8885 bytes) 000581 1788391296.059880 trunc from 0x038b28 to 0x0243ae (0x14779 bytes) 000582 1788391296.099275 MIRROR_RESYNC 12 mirrors 000583 1788391298.238124 write 0x02f225 thru 0x0363f3 (0x71cf bytes) 000585 1788391298.335393 trunc from 0x0363f4 to 0x00e93d (0x27ab6 bytes) 000586 1788391298.368673 MIRROR_RESYNC 12 mirrors 000587 1788391299.941494 mapwrite 0x016b62 thru 0x01b130 (0x45cf bytes) 000589 1788391300.113371 mapread 0x0153e3 thru 0x01b130 (0x5d4e bytes) 000590 1788391300.114843 punch from 0x00e327 to 0x01b130 (0xce0a bytes) 000591 1788391300.121626 read 0x01022f thru 0x011074 (0xe46 bytes) 000592 1788391300.128076 read 0x0195b1 thru 0x01b130 (0x1b80 bytes) 000594 1788391300.139124 read 0x016563 thru 0x01b130 (0x4bce bytes) 000598 1788391300.142138 read 0x018fe3 thru 0x01b130 (0x214e bytes) 000601 1788391300.148048 write 0x026776 thru 0x02e042 (0x78cd bytes) 000602 1788391300.151394 read 0x023055 thru 0x02a3f6 (0x73a2 bytes) 000604 1788391300.180632 punch from 0x0248dd to 0x02e042 (0x9766 bytes) 000605 1788391300.206506 mapread 0x000d79 thru 0x00e25c (0xd4e4 bytes) 000606 1788391300.208398 read 0x016c43 thru 0x01e61e (0x79dc bytes) 000607 1788391300.209679 punch from 0x023562 to 0x026351 (0x2df0 bytes) 000608 1788391300.219030 mapwrite 0x0157f3 thru 0x024e78 (0xf686 bytes) 000609 1788391300.285365 read 0x000695 thru 0x0050eb (0x4a57 bytes) 000610 1788391300.286119 write 0x0170cc thru 0x01ced5 (0x5e0a bytes) 000611 1788391300.288318 mapread 0x01c79e thru 0x021553 (0x4db6 bytes) 000612 1788391300.289466 punch from 0x01527b to 0x023ad9 (0xe85f bytes) 000613 1788391300.303284 read 0x017485 thru 0x01f64e (0x81ca bytes) 000615 1788391300.324822 mapread 0x02a4a9 thru 0x02e042 (0x3b9a bytes) 000616 1788391300.325904 trunc from 0x02e043 to 0x010113 (0x1df2f bytes) 000618 1788391300.357018 mapread 0x00aa04 thru 0x00e2cd (0x38ca bytes) 000619 1788391300.358043 write 0x021f5e thru 0x03179d (0xf840 bytes) 000620 1788391300.373226 MIRROR_RESYNC 12 mirrors 000621 1788391302.055144 mapread 0x020a0f thru 0x020c0d (0x1ff bytes) 000622 1788391302.060955 trunc from 0x03179e to 0x02075d (0x11040 bytes) 000623 1788391302.153333 mapwrite 0x01c9d2 thru 0x02a5cd (0xdbfc bytes) 000624 1788391302.264731 punch from 0x0297d1 to 0x02a5cd (0xdfd bytes) 000625 1788391302.271674 read 0x010151 thru 0x0136ad (0x355d bytes) 000626 1788391302.285543 mapwrite 0x030f2e thru 0x038c24 (0x7cf7 bytes) 000628 1788391302.386850 mapread 0x0010bf thru 0x00b785 (0xa6c7 bytes) 000629 1788391302.404702 mapread 0x0037ae thru 0x00bef1 (0x8744 bytes) 000630 1788391302.410574 mapread 0x029816 thru 0x034fec (0xb7d7 bytes) 000631 1788391302.412312 trunc from 0x038c25 to 0x03ba4f (0x2e2b bytes) 000634 1788391302.442223 write 0x038abf thru 0x03ffff (0x7541 bytes) 000635 1788391302.443876 write 0x02741c thru 0x02a852 (0x3437 bytes) 000636 1788391302.444847 write 0x003f00 thru 0x01129b (0xd39c bytes) 000638 1788391302.447856 mapread 0x00d120 thru 0x01021c (0x30fd bytes) 000639 1788391302.449024 trunc from 0x040000 to 0x03d0ae (0x2f51 bytes) 000641 1788391302.488035 MIRROR_RESYNC 12 mirrors 000642 1788391304.224089 MIRROR_RESYNC 12 mirrors 000644 1788391304.827085 write 0x01e52f thru 0x02599c (0x746e bytes) 000645 1788391304.897118 mapread 0x01a4f2 thru 0x01f110 (0x4c1f bytes) 000646 1788391304.916600 mapwrite 0x0116e2 thru 0x0151b9 (0x3ad8 bytes) 000647 1788391304.982430 mapread 0x03837d thru 0x03d0ae (0x4d32 bytes) 000648 1788391304.993085 mapread 0x006158 thru 0x012bb6 (0xca5f bytes) 000650 1788391305.011835 punch from 0x01f75b to 0x02c5ae (0xce54 bytes) 000651 1788391305.017354 punch from 0x02d309 to 0x0305ee (0x32e6 bytes) 000652 1788391305.023656 punch from 0x02d86e to 0x02e39b (0xb2e bytes) 000653 1788391305.030000 mapwrite 0x011577 thru 0x011bbe (0x648 bytes) 000655 1788391305.073846 MIRROR_RESYNC 12 mirrors 000656 1788391306.633898 punch from 0x02feda to 0x03d0ae (0xd1d5 bytes) 000658 1788391306.707828 read 0x018e0e thru 0x019685 (0x878 bytes) 000660 1788391306.736399 read 0x01fc72 thru 0x02cf3f (0xd2ce bytes) 000661 1788391306.757399 read 0x0125f8 thru 0x01c8c5 (0xa2ce bytes) 000662 1788391306.758110 read 0x029dfc thru 0x02d27e (0x3483 bytes) 000664 1788391306.759365 mapread 0x021f3d thru 0x02cb7d (0xac41 bytes) 000665 1788391306.760482 trunc from 0x03d0af to 0x036dc4 (0x62ea bytes) 000666 1788391306.790697 read 0x00a1df thru 0x00b396 (0x11b8 bytes) 000667 1788391306.791356 trunc from 0x036dc5 to 0x00e500 (0x288c4 bytes) 000669 1788391306.809599 mapwrite 0x03ea43 thru 0x03ffff (0x15bd bytes) 000673 1788391306.928269 write 0x03aa71 thru 0x03ffff (0x558f bytes) 000675 1788391306.929920 punch from 0x001183 to 0x00a92f (0x97ad bytes) 000677 1788391306.941058 mapread 0x03364f thru 0x0359e9 (0x239b bytes) 000678 1788391306.948563 MIRROR_RESYNC 12 mirrors 000679 1788391309.532055 write 0x02e7e2 thru 0x0394f1 (0xad10 bytes) 000680 1788391309.601322 write 0x027080 thru 0x02d8c6 (0x6847 bytes) 000681 1788391309.613038 trunc from 0x040000 to 0x0066a0 (0x3995f bytes) 000682 1788391309.653563 MIRROR_RESYNC 12 mirrors 000683 1788391311.060360 mapwrite 0x00e3b1 thru 0x0103f7 (0x2047 bytes) 000684 1788391311.218216 read 0x000ad4 thru 0x00f8f3 (0xee20 bytes) 000685 1788391311.237146 MIRROR_RESYNC 12 mirrors 000687 1788391312.665118 MIRROR_RESYNC 12 mirrors 000688 1788391313.217551 punch from 0x00a939 to 0x0103f7 (0x5abf bytes) 000689 1788391313.308258 MIRROR_RESYNC 12 mirrors 000690 1788391315.217809 read 0x009fe8 thru 0x0103f7 (0x6410 bytes) 000691 1788391315.226955 trunc from 0x0103f8 to 0x02cecf (0x1cad8 bytes) 000692 1788391315.301946 MIRROR_RESYNC 12 mirrors 000693 1788391317.654651 read 0x02b274 thru 0x02b78b (0x518 bytes) 000694 1788391317.666090 read 0x00d1d5 thru 0x0139f8 (0x6824 bytes) 000696 1788391317.686873 MIRROR_EXTEND to 13 mirrors 000698 1788391318.680078 punch from 0x01652d to 0x01e02e (0x7b02 bytes) 000699 1788391318.777075 punch from 0x029664 to 0x02a04c (0x9e9 bytes) 000700 1788391318.783517 write 0x021a10 thru 0x02e890 (0xce81 bytes) 000701 1788391318.794051 read 0x0033c9 thru 0x008d44 (0x597c bytes) 000702 1788391318.813157 MIRROR_RESYNC 13 mirrors 000703 1788391321.412413 write 0x017101 thru 0x024f86 (0xde86 bytes) 000704 1788391321.477341 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e891): Mirror 6: 0xe9af78fb (stale) Mirror 7: 0xe9af78fb (stale) Mirror 10: 0xe9af78fb (stale) Mirror 11: 0xe9af78fb (stale) Mirror 12: 0xe9af78fb (stale) Mirror 13: 0xe9af78fb (stale) Mirror 14: 0xe9af78fb (stale) Mirror 15: 0xe9af78fb (stale) Mirror 16: 0xe9af78fb (stale) Mirror 17: 0xe9af78fb (stale) Mirror 19: 0xe9af78fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e891): Mirror 6: 0xe9af78fb (stale) Mirror 7: 0xe9af78fb (stale) Mirror 10: 0xe9af78fb (stale) Mirror 11: 0xe9af78fb (stale) Mirror 12: 0xe9af78fb (stale) Mirror 13: 0xe9af78fb (stale) Mirror 14: 0xe9af78fb (stale) Mirror 15: 0xe9af78fb (stale) Mirror 16: 0xe9af78fb (stale) Mirror 17: 0xe9af78fb (stale) Mirror 19: 0xe9af78fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e891: skipped 000705 1788391322.178446 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e891): Mirror 7: 0xe9af78fb (stale) Mirror 10: 0xe9af78fb (stale) Mirror 11: 0xe9af78fb (stale) Mirror 12: 0xe9af78fb (stale) Mirror 13: 0xe9af78fb (stale) Mirror 14: 0xe9af78fb (stale) Mirror 15: 0xe9af78fb (stale) Mirror 16: 0xe9af78fb (stale) Mirror 17: 0xe9af78fb (stale) Mirror 19: 0xe9af78fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e891): Mirror 7: 0xe9af78fb (stale) Mirror 10: 0xe9af78fb (stale) Mirror 11: 0xe9af78fb (stale) Mirror 12: 0xe9af78fb (stale) Mirror 13: 0xe9af78fb (stale) Mirror 14: 0xe9af78fb (stale) Mirror 15: 0xe9af78fb (stale) Mirror 16: 0xe9af78fb (stale) Mirror 17: 0xe9af78fb (stale) Mirror 19: 0xe9af78fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e891: skipped 000708 1788391322.834687 mapread 0x01bcd7 thru 0x02126b (0x5595 bytes) 000709 1788391322.860054 read 0x021265 thru 0x02bf74 (0xad10 bytes) 000712 1788391322.875039 trunc from 0x02e891 to 0x02b985 (0x2f0b bytes) 000713 1788391322.895893 trunc from 0x02b986 to 0x0084ee (0x23497 bytes) 000717 1788391322.919776 mapwrite 0x026139 thru 0x02c6a0 (0x6568 bytes) 000718 1788391323.006526 mapwrite 0x025fe7 thru 0x0305d5 (0xa5ef bytes) 000719 1788391323.143053 write 0x0236db thru 0x027ccc (0x45f2 bytes) 000720 1788391323.145071 mapread 0x01efe1 thru 0x01f9e3 (0xa03 bytes) 000722 1788391323.156701 write 0x01876c thru 0x022738 (0x9fcd bytes) 000723 1788391323.159401 read 0x0111ed thru 0x01c706 (0xb51a bytes) 000725 1788391323.197123 MIRROR_RESYNC 11 mirrors 000726 1788391324.875433 mapread 0x01db66 thru 0x020c58 (0x30f3 bytes) 000727 1788391324.902287 read 0x02bf53 thru 0x0305d5 (0x4683 bytes) 000729 1788391324.915974 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) 000730 1788391325.414289 mapread 0x00dc44 thru 0x010924 (0x2ce1 bytes) 000731 1788391325.433183 mapwrite 0x031fc9 thru 0x03f578 (0xd5b0 bytes) 000733 1788391325.611209 trunc from 0x03f579 to 0x004c48 (0x3a930 bytes) 000734 1788391325.642405 mapwrite 0x00d959 thru 0x01c7ac (0xee54 bytes) 000736 1788391325.739078 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1c7ad): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c7ad): Mirror 7: 0x1f9f8a3e (stale) Mirror 10: 0x1f9f8a3e (stale) Mirror 11: 0x1f9f8a3e (stale) Mirror 12: 0x1f9f8a3e (stale) Mirror 14: 0x1f9f8a3e (stale) Mirror 15: 0x1f9f8a3e (stale) Mirror 16: 0x1f9f8a3e (stale) Mirror 17: 0x1f9f8a3e (stale) Mirror 19: 0x1f9f8a3e (stale) CRC-32 checksum value for chunk [0, 0x1c7ad): Mirror 1: 0x887bdf36 Mirror 20: 0x887bdf36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c7ad: skipped 000739 1788391326.808605 write 0x0122f2 thru 0x01419b (0x1eaa bytes) 000742 1788391326.920704 mapread 0x019fc3 thru 0x01c7ac (0x27ea bytes) 000745 1788391326.956612 mapwrite 0x0246ea thru 0x02d763 (0x907a bytes) 000746 1788391327.091886 mapwrite 0x02d034 thru 0x0304cf (0x349c bytes) 000747 1788391327.170028 trunc from 0x0304d0 to 0x026aa5 (0x9a2a bytes) 000748 1788391327.188403 write 0x011d47 thru 0x019ec1 (0x817b bytes) 000750 1788391327.199732 punch from 0x018e46 to 0x026aa5 (0xdc60 bytes) 000751 1788391327.218672 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26aa6): Mirror 7: 0x18943dd4 (stale) Mirror 10: 0x18943dd4 (stale) Mirror 11: 0x18943dd4 (stale) Mirror 12: 0x18943dd4 (stale) Mirror 14: 0x18943dd4 (stale) Mirror 15: 0x18943dd4 (stale) Mirror 17: 0x18943dd4 (stale) Mirror 19: 0x18943dd4 (stale) Mirror 20: 0x2a12c078 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26aa6): Mirror 7: 0x18943dd4 (stale) Mirror 10: 0x18943dd4 (stale) Mirror 11: 0x18943dd4 (stale) Mirror 12: 0x18943dd4 (stale) Mirror 14: 0x18943dd4 (stale) Mirror 15: 0x18943dd4 (stale) Mirror 17: 0x18943dd4 (stale) Mirror 19: 0x18943dd4 (stale) Mirror 20: 0x2a12c078 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26aa6: skipped 000753 1788391327.800538 write 0x03f832 thru 0x03ffff (0x7ce bytes) 000754 1788391327.806128 trunc from 0x040000 to 0x0356bd (0xa942 bytes) 000755 1788391327.833905 mapread 0x0234d2 thru 0x026689 (0x31b8 bytes) 000756 1788391327.863723 trunc from 0x0356be to 0x02c4dd (0x91e0 bytes) 000758 1788391327.886528 trunc from 0x02c4de to 0x034fa0 (0x8ac3 bytes) 000759 1788391327.915402 read 0x02229d thru 0x02fccd (0xda31 bytes) 000760 1788391327.924556 mapwrite 0x013f1b thru 0x01646c (0x2552 bytes) 000761 1788391328.008520 punch from 0x01453d to 0x01714e (0x2c12 bytes) 000763 1788391328.021221 read 0x033247 thru 0x034fa0 (0x1d5a bytes) 000764 1788391328.040467 read 0x029f05 thru 0x034fa0 (0xb09c bytes) 000765 1788391328.041366 punch from 0x003a14 to 0x006f29 (0x3516 bytes) 000766 1788391328.047647 mapwrite 0x02ef45 thru 0x03ae70 (0xbf2c bytes) 000769 1788391328.158388 write 0x0377cb thru 0x03ffff (0x8835 bytes) 000770 1788391328.167550 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf7d346e8 (stale) Mirror 10: 0xf7d346e8 (stale) Mirror 11: 0xf7d346e8 (stale) Mirror 12: 0xf7d346e8 (stale) Mirror 14: 0xf7d346e8 (stale) Mirror 15: 0xf7d346e8 (stale) Mirror 17: 0xf7d346e8 (stale) Mirror 20: 0x9e96e4c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf7d346e8 (stale) Mirror 10: 0xf7d346e8 (stale) Mirror 11: 0xf7d346e8 (stale) Mirror 12: 0xf7d346e8 (stale) Mirror 14: 0xf7d346e8 (stale) Mirror 15: 0xf7d346e8 (stale) Mirror 17: 0xf7d346e8 (stale) Mirror 20: 0x9e96e4c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000772 1788391328.730132 MIRROR_RESYNC 9 mirrors 000773 1788391330.254371 mapwrite 0x0342f6 thru 0x03ffff (0xbd0a bytes) 000774 1788391330.425579 read 0x027875 thru 0x035da2 (0xe52e bytes) 000775 1788391330.439857 punch from 0x00cac5 to 0x01c2d2 (0xf80e bytes) 000776 1788391330.464592 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xff8a0288 (stale) Mirror 10: 0xff8a0288 (stale) Mirror 11: 0xff8a0288 (stale) Mirror 12: 0xff8a0288 (stale) Mirror 14: 0xff8a0288 (stale) Mirror 15: 0xff8a0288 (stale) Mirror 17: 0xff8a0288 (stale) Mirror 20: 0xff8a0288 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x82ca348b Mirror 21: 0x82ca348b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000777 1788391331.530170 mapwrite 0x03ac6a thru 0x03f3df (0x4776 bytes) 000778 1788391331.768477 trunc from 0x040000 to 0x02d6b5 (0x1294a bytes) 000779 1788391331.808575 mapread 0x01269b thru 0x01adba (0x8720 bytes) 000781 1788391331.824298 trunc from 0x02d6b6 to 0x0045e6 (0x290cf bytes) 000782 1788391331.845426 write 0x0300b7 thru 0x03c508 (0xc452 bytes) 000787 1788391331.850993 read 0x00e16f thru 0x0129fc (0x488e bytes) 000788 1788391331.863620 mapread 0x0254f3 thru 0x0280d9 (0x2be7 bytes) 000790 1788391331.889898 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c509): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c509): Mirror 7: 0x2fad6e5c (stale) Mirror 10: 0x2fad6e5c (stale) Mirror 11: 0x2fad6e5c (stale) Mirror 12: 0x2fad6e5c (stale) Mirror 14: 0x2fad6e5c (stale) Mirror 15: 0x2fad6e5c (stale) Mirror 17: 0x2fad6e5c (stale) Mirror 20: 0x2fad6e5c (stale) Mirror 21: 0x7b238f47 (stale) CRC-32 checksum value for chunk [0, 0x3c509): Mirror 1: 0x7f65ac7 Mirror 22: 0x7f65ac7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c509: skipped 000791 1788391332.975893 write 0x03ed4e thru 0x03ffff (0x12b2 bytes) 000792 1788391333.065948 mapread 0x00f6d2 thru 0x017391 (0x7cc0 bytes) 000793 1788391333.105381 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xff8a0288 (stale) Mirror 10: 0xff8a0288 (stale) Mirror 11: 0xff8a0288 (stale) Mirror 12: 0xff8a0288 (stale) Mirror 14: 0xff8a0288 (stale) Mirror 15: 0xff8a0288 (stale) Mirror 17: 0xff8a0288 (stale) Mirror 20: 0xff8a0288 (stale) Mirror 21: 0x82ca348b (stale) Mirror 22: 0xf124dfec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7b7815b7 Mirror 23: 0x7b7815b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000795 1788391334.256023 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xff8a0288 (stale) Mirror 10: 0xff8a0288 (stale) Mirror 11: 0xff8a0288 (stale) Mirror 12: 0xff8a0288 (stale) Mirror 14: 0xff8a0288 (stale) Mirror 15: 0xff8a0288 (stale) Mirror 17: 0xff8a0288 (stale) Mirror 20: 0xff8a0288 (stale) Mirror 21: 0x82ca348b (stale) Mirror 22: 0xf124dfec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7b7815b7 Mirror 23: 0x7b7815b7 Mirror 24: 0x7b7815b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000796 1788391335.415872 mapwrite 0x036377 thru 0x03ffff (0x9c89 bytes) 000797 1788391335.611039 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xff8a0288 (stale) Mirror 10: 0xff8a0288 (stale) Mirror 11: 0xff8a0288 (stale) Mirror 12: 0xff8a0288 (stale) Mirror 14: 0xff8a0288 (stale) Mirror 15: 0xff8a0288 (stale) Mirror 17: 0xff8a0288 (stale) Mirror 20: 0xff8a0288 (stale) Mirror 21: 0x82ca348b (stale) Mirror 22: 0xf124dfec (stale) Mirror 24: 0x7b7815b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xff8a0288 (stale) Mirror 10: 0xff8a0288 (stale) Mirror 11: 0xff8a0288 (stale) Mirror 12: 0xff8a0288 (stale) Mirror 14: 0xff8a0288 (stale) Mirror 15: 0xff8a0288 (stale) Mirror 17: 0xff8a0288 (stale) Mirror 20: 0xff8a0288 (stale) Mirror 21: 0x82ca348b (stale) Mirror 22: 0xf124dfec (stale) Mirror 24: 0x7b7815b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000798 1788391336.349183 read 0x021220 thru 0x024551 (0x3332 bytes) 000799 1788391336.359409 trunc from 0x040000 to 0x0068f6 (0x39709 bytes) 000800 1788391336.429226 punch from 0x001285 to 0x001981 (0x6fd bytes) 000801 1788391336.436706 read 0x0011d1 thru 0x0068f6 (0x5726 bytes) 000803 1788391336.456708 read 0x0033fb thru 0x0068f6 (0x34fc bytes) 000804 1788391336.457663 mapread 0x001f7a thru 0x0068f6 (0x497d bytes) 000805 1788391336.459185 mapread 0x0054ba thru 0x006080 (0xbc7 bytes) 000806 1788391336.461892 punch from 0x0026df to 0x0068f6 (0x4218 bytes) 000808 1788391336.472006 write 0x03788d thru 0x03f6f8 (0x7e6c bytes) 000812 1788391336.477876 punch from 0x00d281 to 0x01bb66 (0xe8e6 bytes) 000813 1788391336.492134 mapwrite 0x00c602 thru 0x015db5 (0x97b4 bytes) 000814 1788391336.548780 punch from 0x0316ce to 0x031d8f (0x6c2 bytes) 000816 1788391336.555344 write 0x001af8 thru 0x004559 (0x2a62 bytes) 000817 1788391336.556683 mapread 0x016865 thru 0x01a7fe (0x3f9a bytes) 000818 1788391336.558187 write 0x009951 thru 0x00a65d (0xd0d bytes) 000820 1788391336.559645 mapwrite 0x016ad1 thru 0x01f767 (0x8c97 bytes) 000822 1788391336.628584 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3f6f9): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6f9): Mirror 7: 0x11bb4d8f (stale) Mirror 10: 0x11bb4d8f (stale) Mirror 11: 0x11bb4d8f (stale) Mirror 12: 0x11bb4d8f (stale) Mirror 14: 0x11bb4d8f (stale) Mirror 15: 0x11bb4d8f (stale) Mirror 17: 0x11bb4d8f (stale) Mirror 20: 0x11bb4d8f (stale) Mirror 21: 0xb7a26c22 (stale) Mirror 22: 0x31a1b719 (stale) Mirror 24: 0xfc5646fe (stale) CRC-32 checksum value for chunk [0, 0x3f6f9): Mirror 1: 0x6c73c638 Mirror 25: 0x6c73c638 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6f9: skipped 000823 1788391337.857836 read 0x038a69 thru 0x03f6f8 (0x6c90 bytes) 000824 1788391337.885566 mapwrite 0x022221 thru 0x030df7 (0xebd7 bytes) 000825 1788391338.131027 trunc from 0x03f6f9 to 0x026713 (0x18fe5 bytes) 000826 1788391338.162155 read 0x00ef99 thru 0x01697c (0x79e4 bytes) 000827 1788391338.187195 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26714): Mirror 7: 0x7f803c7a (stale) Mirror 10: 0x7f803c7a (stale) Mirror 11: 0x7f803c7a (stale) Mirror 12: 0x7f803c7a (stale) Mirror 14: 0x7f803c7a (stale) Mirror 15: 0x7f803c7a (stale) Mirror 17: 0x7f803c7a (stale) Mirror 20: 0x7f803c7a (stale) Mirror 22: 0x806a0050 (stale) Mirror 24: 0x806a0050 (stale) Mirror 25: 0xebceefd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26714): Mirror 7: 0x7f803c7a (stale) Mirror 10: 0x7f803c7a (stale) Mirror 11: 0x7f803c7a (stale) Mirror 12: 0x7f803c7a (stale) Mirror 14: 0x7f803c7a (stale) Mirror 15: 0x7f803c7a (stale) Mirror 17: 0x7f803c7a (stale) Mirror 20: 0x7f803c7a (stale) Mirror 22: 0x806a0050 (stale) Mirror 24: 0x806a0050 (stale) Mirror 25: 0xebceefd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26714: skipped 000829 1788391338.883357 punch from 0x005265 to 0x013d52 (0xeaee bytes) 000831 1788391338.891519 mapread 0x01166a thru 0x01442d (0x2dc4 bytes) 000832 1788391338.922148 read 0x00bd4b thru 0x00ec27 (0x2edd bytes) 000834 1788391338.932399 mapread 0x001afb thru 0x004b1e (0x3024 bytes) 000835 1788391338.945479 mapread 0x01fce8 thru 0x0204d3 (0x7ec bytes) 000836 1788391338.954147 punch from 0x006298 to 0x013120 (0xce89 bytes) 000837 1788391338.962681 mapread 0x0257bb thru 0x026713 (0xf59 bytes) 000839 1788391338.964847 write 0x03d740 thru 0x03ffff (0x28c0 bytes) 000840 1788391338.966341 read 0x03011b thru 0x03d58e (0xd474 bytes) 000842 1788391338.987583 MIRROR_RESYNC 12 mirrors 000843 1788391340.871303 mapread 0x03b80f thru 0x03ffff (0x47f1 bytes) 000845 1788391340.892639 mapwrite 0x030da1 thru 0x031f70 (0x11d0 bytes) 000846 1788391341.058384 mapread 0x027bfb thru 0x02909e (0x14a4 bytes) 000847 1788391341.081360 punch from 0x020502 to 0x02a85e (0xa35d bytes) 000848 1788391341.089187 write 0x009588 thru 0x00a617 (0x1090 bytes) 000850 1788391341.101964 punch from 0x00cc73 to 0x01414b (0x74d9 bytes) 000851 1788391341.112255 punch from 0x009664 to 0x0162f9 (0xcc96 bytes) 000852 1788391341.118057 mapread 0x0115c1 thru 0x01cf71 (0xb9b1 bytes) 000853 1788391341.143425 punch from 0x024f70 to 0x02756f (0x2600 bytes) 000856 1788391341.159494 read 0x01f69c thru 0x02ae1e (0xb783 bytes) 000857 1788391341.168995 mapread 0x01a457 thru 0x02312b (0x8cd5 bytes) 000858 1788391341.170276 read 0x02bd3b thru 0x037ab7 (0xbd7d bytes) 000859 1788391341.175611 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf15958cd (stale) Mirror 10: 0xf15958cd (stale) Mirror 11: 0xf15958cd (stale) Mirror 12: 0xf15958cd (stale) Mirror 14: 0xf15958cd (stale) Mirror 15: 0xf15958cd (stale) Mirror 17: 0xf15958cd (stale) Mirror 20: 0xf15958cd (stale) Mirror 22: 0xf15958cd (stale) Mirror 24: 0xf15958cd (stale) Mirror 25: 0xf15958cd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd5948d2e Mirror 26: 0xd5948d2e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000861 1788391342.314817 trunc from 0x040000 to 0x0005e3 (0x3fa1c bytes) 000862 1788391342.450870 mapwrite 0x034274 thru 0x03c823 (0x85b0 bytes) 000863 1788391342.572252 read 0x0311cf thru 0x03b66a (0xa49c bytes) 000866 1788391342.574070 read 0x03768a thru 0x03c823 (0x519a bytes) 000867 1788391342.575202 write 0x025253 thru 0x026d04 (0x1ab2 bytes) 000869 1788391342.595212 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3c824): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c824): Mirror 7: 0xd6abf424 (stale) Mirror 10: 0xd6abf424 (stale) Mirror 11: 0xd6abf424 (stale) Mirror 12: 0xd6abf424 (stale) Mirror 14: 0xd6abf424 (stale) Mirror 15: 0xd6abf424 (stale) Mirror 17: 0xd6abf424 (stale) Mirror 20: 0xd6abf424 (stale) Mirror 22: 0xd6abf424 (stale) Mirror 24: 0xd6abf424 (stale) Mirror 25: 0xd6abf424 (stale) Mirror 26: 0x92850b3f (stale) CRC-32 checksum value for chunk [0, 0x3c824): Mirror 1: 0xf2e58f Mirror 27: 0xf2e58f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c824: skipped 000870 1788391343.923458 punch from 0x000981 to 0x005f1b (0x559b bytes) 000871 1788391344.034521 MIRROR_RESYNC 14 mirrors 000872 1788391347.087191 mapwrite 0x013ed2 thru 0x0223a8 (0xe4d7 bytes) 000873 1788391347.267726 punch from 0x00e420 to 0x01d2a8 (0xee89 bytes) 000874 1788391347.279732 read 0x022955 thru 0x026d27 (0x43d3 bytes) 000876 1788391347.287192 mapread 0x012665 thru 0x017ba5 (0x5541 bytes) 000877 1788391347.296934 trunc from 0x03c824 to 0x00057a (0x3c2a9 bytes) 000879 1788391347.319613 punch from 0x00014e to 0x00057a (0x42d bytes) 000880 1788391347.330325 punch from 0x0002d5 to 0x00057a (0x2a6 bytes) 000881 1788391347.338265 mapread 0x00041d thru 0x00057a (0x15e bytes) 000883 1788391347.357266 read 0x0002cf thru 0x00057a (0x2ac bytes) 000886 1788391347.359998 trunc from 0x00057b to 0x03eab2 (0x3e538 bytes) 000889 1788391347.390417 trunc from 0x03eab3 to 0x0278ae (0x17204 bytes) 000890 1788391347.412202 mapread 0x00dc37 thru 0x010819 (0x2be3 bytes) 000892 1788391347.433816 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x278af): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x278af): Mirror 7: 0x77b0e419 (stale) Mirror 10: 0x77b0e419 (stale) Mirror 11: 0x77b0e419 (stale) Mirror 12: 0x77b0e419 (stale) Mirror 14: 0x77b0e419 (stale) Mirror 15: 0x77b0e419 (stale) Mirror 17: 0x77b0e419 (stale) Mirror 20: 0x77b0e419 (stale) Mirror 22: 0x77b0e419 (stale) Mirror 24: 0x77b0e419 (stale) Mirror 25: 0x77b0e419 (stale) Mirror 26: 0x77b0e419 (stale) Mirror 27: 0x77b0e419 (stale) CRC-32 checksum value for chunk [0, 0x278af): Mirror 1: 0xff73b046 Mirror 28: 0xff73b046 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x278af: skipped 000894 1788391348.698003 mapwrite 0x018e3d thru 0x024f37 (0xc0fb bytes) 000895 1788391348.932941 write 0x002acf thru 0x0100bc (0xd5ee bytes) 000897 1788391348.944750 trunc from 0x0278af to 0x01872c (0xf182 bytes) 000898 1788391349.014247 read 0x00786b thru 0x00ca92 (0x5228 bytes) 000902 1788391349.018850 mapwrite 0x0111ab thru 0x01256d (0x13c3 bytes) 000903 1788391349.082359 mapwrite 0x00b413 thru 0x00c63a (0x1228 bytes) 000904 1788391349.121929 write 0x007109 thru 0x015728 (0xe620 bytes) 000905 1788391349.124333 mapwrite 0x03b031 thru 0x03fc68 (0x4c38 bytes) 000906 1788391349.207223 write 0x01371d thru 0x021ee5 (0xe7c9 bytes) 000907 1788391349.221248 punch from 0x034841 to 0x03efb0 (0xa770 bytes) 000908 1788391349.238601 punch from 0x030623 to 0x035a2c (0x540a bytes) 000909 1788391349.247483 trunc from 0x03fc69 to 0x0003dd (0x3f88b bytes) 000910 1788391349.275844 write 0x039d7f thru 0x03ffff (0x6281 bytes) 000911 1788391349.277201 mapwrite 0x01a5cc thru 0x01fb57 (0x558c bytes) 000912 1788391349.371601 read 0x005b39 thru 0x0122ff (0xc7c7 bytes) 000913 1788391349.396216 punch from 0x00f02a to 0x01cb92 (0xdb69 bytes) 000915 1788391349.407197 write 0x004330 thru 0x006ef6 (0x2bc7 bytes) 000917 1788391349.411584 trunc from 0x040000 to 0x0091e9 (0x36e16 bytes) 000918 1788391349.442490 write 0x014d9f thru 0x01f095 (0xa2f7 bytes) 000919 1788391349.456167 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1f096): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f096): Mirror 7: 0x85ac6b21 (stale) Mirror 10: 0x85ac6b21 (stale) Mirror 11: 0x85ac6b21 (stale) Mirror 12: 0x85ac6b21 (stale) Mirror 14: 0x85ac6b21 (stale) Mirror 15: 0x85ac6b21 (stale) Mirror 17: 0x85ac6b21 (stale) Mirror 20: 0x85ac6b21 (stale) Mirror 22: 0x85ac6b21 (stale) Mirror 24: 0x85ac6b21 (stale) Mirror 25: 0x85ac6b21 (stale) Mirror 26: 0x85ac6b21 (stale) Mirror 27: 0x85ac6b21 (stale) Mirror 28: 0x85ac6b21 (stale) CRC-32 checksum value for chunk [0, 0x1f096): Mirror 1: 0x86dda81c Mirror 29: 0x86dda81c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f096: skipped 000921 1788391350.408604 trunc from 0x01f096 to 0x00ef04 (0x10191 bytes) 000923 1788391350.543946 write 0x02f9b5 thru 0x039f63 (0xa5af bytes) 000924 1788391350.550494 punch from 0x01ca50 to 0x02b4ec (0xea9d bytes) 000926 1788391350.576283 trunc from 0x039f64 to 0x009a91 (0x304d2 bytes) 000928 1788391350.595566 mapread 0x0073e3 thru 0x009a91 (0x26af bytes) 000929 1788391350.614356 mapwrite 0x01b980 thru 0x029bb4 (0xe235 bytes) 000930 1788391350.705029 trunc from 0x029bb5 to 0x006f31 (0x22c83 bytes) 000931 1788391350.720100 trunc from 0x006f32 to 0x007c6e (0xd3d bytes) 000932 1788391350.741273 write 0x03fddd thru 0x03ffff (0x223 bytes) 000934 1788391350.742903 write 0x02b4bb thru 0x039192 (0xdcd8 bytes) 000935 1788391350.759580 mapread 0x007294 thru 0x0152f6 (0xe063 bytes) 000936 1788391350.775304 mapwrite 0x000d32 thru 0x00c3aa (0xb679 bytes) 000938 1788391350.857214 mapwrite 0x02270c thru 0x03015b (0xda50 bytes) 000939 1788391350.927487 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf51d941b (stale) Mirror 10: 0xf51d941b (stale) Mirror 11: 0xf51d941b (stale) Mirror 12: 0xf51d941b (stale) Mirror 14: 0xf51d941b (stale) Mirror 15: 0xf51d941b (stale) Mirror 17: 0xf51d941b (stale) Mirror 20: 0xf51d941b (stale) Mirror 24: 0xf51d941b (stale) Mirror 25: 0xf51d941b (stale) Mirror 26: 0xf51d941b (stale) Mirror 27: 0xf51d941b (stale) Mirror 28: 0xe20eea22 (stale) Mirror 29: 0x597de46e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf51d941b (stale) Mirror 10: 0xf51d941b (stale) Mirror 11: 0xf51d941b (stale) Mirror 12: 0xf51d941b (stale) Mirror 14: 0xf51d941b (stale) Mirror 15: 0xf51d941b (stale) Mirror 17: 0xf51d941b (stale) Mirror 20: 0xf51d941b (stale) Mirror 24: 0xf51d941b (stale) Mirror 25: 0xf51d941b (stale) Mirror 26: 0xf51d941b (stale) Mirror 27: 0xf51d941b (stale) Mirror 28: 0xe20eea22 (stale) Mirror 29: 0x597de46e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000940 1788391351.716152 read 0x02a305 thru 0x02f6da (0x53d6 bytes) 000941 1788391351.730419 mapread 0x028ebe thru 0x0304a7 (0x75ea bytes) 000942 1788391351.780946 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf51d941b (stale) Mirror 10: 0xf51d941b (stale) Mirror 11: 0xf51d941b (stale) Mirror 12: 0xf51d941b (stale) Mirror 14: 0xf51d941b (stale) Mirror 15: 0xf51d941b (stale) Mirror 17: 0xf51d941b (stale) Mirror 20: 0xf51d941b (stale) Mirror 24: 0xf51d941b (stale) Mirror 25: 0xf51d941b (stale) Mirror 26: 0xf51d941b (stale) Mirror 27: 0xf51d941b (stale) Mirror 28: 0xe20eea22 (stale) Mirror 29: 0x597de46e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x72fe79fc Mirror 30: 0x72fe79fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000943 1788391353.073263 trunc from 0x040000 to 0x00a3e5 (0x35c1a bytes) 000944 1788391353.177980 read 0x002306 thru 0x00a3e5 (0x80e0 bytes) 000945 1788391353.192742 mapwrite 0x01dd9c thru 0x01e7af (0xa14 bytes) 000946 1788391353.271334 mapread 0x00bfa6 thru 0x0147bd (0x8818 bytes) 000947 1788391353.293296 punch from 0x0125c5 to 0x01449c (0x1ed8 bytes) 000948 1788391353.310259 MIRROR_RESYNC 16 mirrors 000949 1788391355.554176 trunc from 0x01e7b0 to 0x003304 (0x1b4ab bytes) 000950 1788391355.662879 MIRROR_SPLIT mirror 3 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3305): Mirror 7: 0x4f71396a (stale) Mirror 10: 0x4f71396a (stale) Mirror 12: 0x4f71396a (stale) Mirror 14: 0x4f71396a (stale) Mirror 15: 0x4f71396a (stale) Mirror 17: 0x4f71396a (stale) Mirror 20: 0x4f71396a (stale) Mirror 24: 0x4f71396a (stale) Mirror 25: 0x4f71396a (stale) Mirror 26: 0x4f71396a (stale) Mirror 27: 0x4f71396a (stale) Mirror 28: 0x4f71396a (stale) Mirror 29: 0x4f71396a (stale) Mirror 30: 0x4f71396a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3305): Mirror 7: 0x4f71396a (stale) Mirror 10: 0x4f71396a (stale) Mirror 12: 0x4f71396a (stale) Mirror 14: 0x4f71396a (stale) Mirror 15: 0x4f71396a (stale) Mirror 17: 0x4f71396a (stale) Mirror 20: 0x4f71396a (stale) Mirror 24: 0x4f71396a (stale) Mirror 25: 0x4f71396a (stale) Mirror 26: 0x4f71396a (stale) Mirror 27: 0x4f71396a (stale) Mirror 28: 0x4f71396a (stale) Mirror 29: 0x4f71396a (stale) Mirror 30: 0x4f71396a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3305: skipped 000951 1788391356.113035 punch from 0x000408 to 0x003304 (0x2efd bytes) 000953 1788391356.121696 mapwrite 0x02ee57 thru 0x0304c6 (0x1670 bytes) 000954 1788391356.231082 mapwrite 0x02c23e thru 0x038557 (0xc31a bytes) 000956 1788391356.328387 punch from 0x002299 to 0x00685b (0x45c3 bytes) 000958 1788391356.341258 read 0x02af74 thru 0x02bc22 (0xcaf bytes) 000959 1788391356.341882 trunc from 0x038558 to 0x01a41d (0x1e13a bytes) 000960 1788391356.358028 write 0x002642 thru 0x004e2c (0x27eb bytes) 000961 1788391356.367661 mapwrite 0x02d3ee thru 0x035f71 (0x8b84 bytes) 000962 1788391356.467770 write 0x029f80 thru 0x03006d (0x60ee bytes) 000964 1788391356.469819 mapwrite 0x03d946 thru 0x03ffff (0x26ba bytes) 000965 1788391356.594555 MIRROR_RESYNC 15 mirrors 000966 1788391359.633308 punch from 0x021dfd to 0x031189 (0xf38d bytes) 000967 1788391359.709690 punch from 0x012b87 to 0x021b8b (0xf005 bytes) 000968 1788391359.719937 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9fe2703b (stale) Mirror 10: 0x9fe2703b (stale) Mirror 12: 0x9fe2703b (stale) Mirror 14: 0x9fe2703b (stale) Mirror 15: 0x9fe2703b (stale) Mirror 17: 0x9fe2703b (stale) Mirror 20: 0x9fe2703b (stale) Mirror 24: 0x9fe2703b (stale) Mirror 25: 0x9fe2703b (stale) Mirror 26: 0x9fe2703b (stale) Mirror 27: 0x9fe2703b (stale) Mirror 28: 0x9fe2703b (stale) Mirror 29: 0x9fe2703b (stale) Mirror 30: 0x9fe2703b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6359af73 Mirror 31: 0x6359af73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1788391360.984874 write 0x010b6b thru 0x016739 (0x5bcf bytes) 000971 1788391361.070003 write 0x004654 thru 0x00ca03 (0x83b0 bytes) 000973 1788391361.080331 punch from 0x01845d to 0x01f064 (0x6c08 bytes) 000974 1788391361.092475 write 0x03fe96 thru 0x03ffff (0x16a bytes) 000975 1788391361.097674 mapread 0x026c13 thru 0x02e936 (0x7d24 bytes) 000976 1788391361.132574 MIRROR_SPLIT mirror 6 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9fe2703b (stale) Mirror 10: 0x9fe2703b (stale) Mirror 12: 0x9fe2703b (stale) Mirror 14: 0x9fe2703b (stale) Mirror 15: 0x9fe2703b (stale) Mirror 20: 0x9fe2703b (stale) Mirror 24: 0x9fe2703b (stale) Mirror 25: 0x9fe2703b (stale) Mirror 26: 0x9fe2703b (stale) Mirror 27: 0x9fe2703b (stale) Mirror 28: 0x9fe2703b (stale) Mirror 29: 0x9fe2703b (stale) Mirror 30: 0x9fe2703b (stale) Mirror 31: 0x6359af73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9fe2703b (stale) Mirror 10: 0x9fe2703b (stale) Mirror 12: 0x9fe2703b (stale) Mirror 14: 0x9fe2703b (stale) Mirror 15: 0x9fe2703b (stale) Mirror 20: 0x9fe2703b (stale) Mirror 24: 0x9fe2703b (stale) Mirror 25: 0x9fe2703b (stale) Mirror 26: 0x9fe2703b (stale) Mirror 27: 0x9fe2703b (stale) Mirror 28: 0x9fe2703b (stale) Mirror 29: 0x9fe2703b (stale) Mirror 30: 0x9fe2703b (stale) Mirror 31: 0x6359af73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000977 1788391361.850620 MIRROR_RESYNC 15 mirrors 000980 1788391364.133688 mapread 0x02d6d1 thru 0x03594b (0x827b bytes) 000981 1788391364.153454 mapwrite 0x033d06 thru 0x03fd07 (0xc002 bytes) 000983 1788391364.312268 mapwrite 0x01ace6 thru 0x01d03c (0x2357 bytes) 000984 1788391364.392124 write 0x036c21 thru 0x039b88 (0x2f68 bytes) 000985 1788391364.393134 read 0x00e07f thru 0x0183be (0xa340 bytes) 000987 1788391364.404146 write 0x02278a thru 0x022a9a (0x311 bytes) 000988 1788391364.405146 trunc from 0x040000 to 0x002433 (0x3dbcc bytes) 000989 1788391364.442956 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2434): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2434): Mirror 7: 0x592c1da6 (stale) Mirror 10: 0x592c1da6 (stale) Mirror 12: 0x592c1da6 (stale) Mirror 14: 0x592c1da6 (stale) Mirror 15: 0x592c1da6 (stale) Mirror 20: 0x592c1da6 (stale) Mirror 24: 0x592c1da6 (stale) Mirror 25: 0x592c1da6 (stale) Mirror 26: 0x592c1da6 (stale) Mirror 27: 0x592c1da6 (stale) Mirror 28: 0x592c1da6 (stale) Mirror 29: 0x592c1da6 (stale) Mirror 30: 0x592c1da6 (stale) Mirror 31: 0x592c1da6 (stale) CRC-32 checksum value for chunk [0, 0x2434): Mirror 1: 0x592c1da6 Mirror 32: 0x592c1da6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2434: skipped 000990 1788391365.237555 mapread 0x000e0f thru 0x002433 (0x1625 bytes) 000991 1788391365.255488 mapread 0x001c77 thru 0x002433 (0x7bd bytes) 000992 1788391365.256687 read 0x0001d2 thru 0x002433 (0x2262 bytes) 000993 1788391365.258152 read 0x00070b thru 0x0021ad (0x1aa3 bytes) 000995 1788391365.258940 mapread 0x000901 thru 0x002433 (0x1b33 bytes) 000996 1788391365.259638 mapwrite 0x0309a8 thru 0x034bc1 (0x421a bytes) 000998 1788391365.494223 mapwrite 0x03bc7d thru 0x03ffff (0x4383 bytes) 000999 1788391365.585956 trunc from 0x040000 to 0x025241 (0x1adbe bytes) 001000 1788391365.611716 trunc from 0x025242 to 0x03f606 (0x1a3c5 bytes) All operations completed A-OK!