== sanity-flr test 70a: flr mode fsx test ================ 11:57:06 (1772470626) Seed set to 628 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1772470628.834250 MIRROR_EXTEND to 2 mirrors skipping zero size read 000004 1772470629.590707 write 0x00325c thru 0x00866d (0x5412 bytes) 000007 1772470629.772909 mapwrite 0x00559e thru 0x00b7c8 (0x622b bytes) truncating to largest ever: 0x2ecc6 000008 1772470629.924717 trunc from 0x00b7c9 to 0x02ecc5 (0x234fd bytes) 000009 1772470629.961755 read 0x0170a1 thru 0x0183ae (0x130e bytes) 000011 1772470629.981809 read 0x017583 thru 0x01ecdd (0x775b bytes) 000012 1772470630.010791 trunc from 0x02ecc6 to 0x00b652 (0x23673 bytes) 000013 1772470630.032630 trunc from 0x00b653 to 0x0241c9 (0x18b77 bytes) 000014 1772470630.055853 trunc from 0x0241ca to 0x01e8d8 (0x58f1 bytes) 000015 1772470630.082103 mapread 0x00acc7 thru 0x0133f4 (0x872e bytes) 000019 1772470630.158966 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1e8d9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e8d9): Mirror 2: 0x76c70c37 (stale) CRC-32 checksum value for chunk [0, 0x1e8d9): Mirror 1: 0x715c2863 Mirror 3: 0x715c2863 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e8d9: skipped 000020 1772470630.904798 read 0x00ece5 thru 0x013d27 (0x5043 bytes) 000021 1772470630.922270 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e8d9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e8d9): Mirror 2: 0x76c70c37 (stale) CRC-32 checksum value for chunk [0, 0x1e8d9): Mirror 1: 0x715c2863 Mirror 3: 0x715c2863 Mirror 4: 0x715c2863 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e8d9: skipped truncating to largest ever: 0x3b5a4 000022 1772470631.757706 trunc from 0x01e8d9 to 0x03b5a3 (0x1cccb bytes) 000024 1772470631.834514 mapread 0x028b56 thru 0x028b85 (0x30 bytes) 000025 1772470631.840613 read 0x005cae thru 0x00976a (0x3abd bytes) 000026 1772470631.847642 trunc from 0x03b5a4 to 0x0167fc (0x24da7 bytes) 000027 1772470631.865293 mapwrite 0x032633 thru 0x035c97 (0x3665 bytes) 000031 1772470631.934471 trunc from 0x035c98 to 0x02f507 (0x6790 bytes) 000032 1772470631.951711 mapread 0x00e2f8 thru 0x0127e7 (0x44f0 bytes) 000033 1772470631.962155 write 0x03b7ea thru 0x03ffff (0x4816 bytes) 000034 1772470631.963734 write 0x0194bf thru 0x021f47 (0x8a89 bytes) 000035 1772470631.972643 mapread 0x032925 thru 0x0388fd (0x5fd9 bytes) 000039 1772470631.987482 MIRROR_RESYNC 4 mirrors 000040 1772470632.867811 trunc from 0x040000 to 0x013ecd (0x2c132 bytes) 000042 1772470632.945539 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13ece): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ece): Mirror 2: 0x651fccdb (stale) Mirror 3: 0x651fccdb (stale) Mirror 4: 0x651fccdb (stale) CRC-32 checksum value for chunk [0, 0x13ece): Mirror 1: 0x651fccdb Mirror 5: 0x651fccdb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ece: skipped 000045 1772470633.639000 read 0x005e86 thru 0x00d183 (0x72fe bytes) 000047 1772470633.661185 mapwrite 0x0211ae thru 0x0218e2 (0x735 bytes) 000049 1772470633.804861 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x218e3): Mirror 2: 0x91b7c1c0 (stale) Mirror 4: 0x91b7c1c0 (stale) Mirror 5: 0xc05ab0ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x218e3): Mirror 2: 0x91b7c1c0 (stale) Mirror 4: 0x91b7c1c0 (stale) Mirror 5: 0xc05ab0ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x218e3: skipped 000050 1772470634.198857 mapwrite 0x0208ac thru 0x0222a3 (0x19f8 bytes) 000051 1772470634.271776 mapread 0x01d3f2 thru 0x01d6a6 (0x2b5 bytes) 000055 1772470634.274693 trunc from 0x0222a4 to 0x02a31b (0x8078 bytes) 000056 1772470634.289618 mapread 0x01711c thru 0x0224b7 (0xb39c bytes) 000057 1772470634.300868 trunc from 0x02a31c to 0x013826 (0x16af5 bytes) 000059 1772470634.325188 read 0x0119f6 thru 0x011c2d (0x238 bytes) 000060 1772470634.329758 MIRROR_RESYNC 4 mirrors 000061 1772470634.996058 write 0x026653 thru 0x02eac3 (0x8471 bytes) 000063 1772470635.047714 mapwrite 0x0029af thru 0x007276 (0x48c8 bytes) 000066 1772470635.134989 MIRROR_RESYNC 4 mirrors 000067 1772470635.897140 read 0x00b29b thru 0x00fd50 (0x4ab6 bytes) 000068 1772470635.918632 mapread 0x02d2ac thru 0x02eac3 (0x1818 bytes) 000070 1772470635.929625 mapread 0x01a026 thru 0x01e47a (0x4455 bytes) 000071 1772470635.946574 write 0x02b1f2 thru 0x039fda (0xede9 bytes) 000072 1772470636.021254 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x39fdb): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39fdb): Mirror 2: 0xb70f3b34 (stale) Mirror 4: 0xb70f3b34 (stale) Mirror 5: 0xb70f3b34 (stale) CRC-32 checksum value for chunk [0, 0x39fdb): Mirror 1: 0x94fa37ce Mirror 6: 0x94fa37ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39fdb: skipped 000073 1772470636.776830 trunc from 0x039fdb to 0x02103a (0x18fa0 bytes) 000075 1772470636.861864 trunc from 0x02103b to 0x02f627 (0xe5ed bytes) 000077 1772470636.888636 mapwrite 0x01f50f thru 0x02097a (0x146c bytes) 000078 1772470636.951882 write 0x039b59 thru 0x03ffff (0x64a7 bytes) 000080 1772470636.960427 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xda9e0108 (stale) Mirror 4: 0xda9e0108 (stale) Mirror 5: 0xda9e0108 (stale) Mirror 6: 0xec703bd5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa04e6fad Mirror 7: 0xa04e6fad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000082 1772470637.782311 read 0x022383 thru 0x024dda (0x2a58 bytes) 000083 1772470637.792935 mapwrite 0x02f90e thru 0x03a873 (0xaf66 bytes) 000086 1772470637.974811 mapread 0x0184ea thru 0x01efa4 (0x6abb bytes) 000087 1772470637.993025 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xda9e0108 (stale) Mirror 4: 0xda9e0108 (stale) Mirror 5: 0xda9e0108 (stale) Mirror 6: 0xec703bd5 (stale) Mirror 7: 0xa04e6fad (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x38ba8699 Mirror 8: 0x38ba8699 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000089 1772470638.892956 write 0x03df01 thru 0x03ffff (0x20ff bytes) 000090 1772470638.960482 mapread 0x02ada3 thru 0x0395ab (0xe809 bytes) 000091 1772470638.982709 write 0x020c62 thru 0x021c0a (0xfa9 bytes) 000092 1772470638.991955 trunc from 0x040000 to 0x006140 (0x39ebf bytes) 000093 1772470639.012535 trunc from 0x006141 to 0x006757 (0x617 bytes) 000094 1772470639.028802 mapread 0x000171 thru 0x006757 (0x65e7 bytes) 000095 1772470639.040831 read 0x005082 thru 0x006757 (0x16d6 bytes) 000096 1772470639.041843 read 0x001b4a thru 0x006757 (0x4c0e bytes) 000097 1772470639.043279 trunc from 0x006758 to 0x0053f8 (0x135f bytes) 000098 1772470639.061501 trunc from 0x0053f9 to 0x00040a (0x4fee bytes) 000101 1772470639.081508 mapwrite 0x03d93f thru 0x03ffff (0x26c1 bytes) 000102 1772470639.166659 mapread 0x01f54d thru 0x02afe7 (0xba9b bytes) 000105 1772470639.170482 mapwrite 0x0186b5 thru 0x027901 (0xf24d bytes) 000106 1772470639.217435 write 0x007922 thru 0x00ef85 (0x7664 bytes) 000107 1772470639.219551 mapwrite 0x0029fb thru 0x00cdd5 (0xa3db bytes) 000108 1772470639.266171 trunc from 0x040000 to 0x03aaa5 (0x555a bytes) 000109 1772470639.295609 mapread 0x00bf92 thru 0x012618 (0x6687 bytes) 000110 1772470639.296825 mapread 0x017407 thru 0x01fc6c (0x8866 bytes) 000111 1772470639.306757 MIRROR_RESYNC 7 mirrors 000115 1772470640.398757 MIRROR_RESYNC 7 mirrors 000118 1772470641.014552 MIRROR_EXTEND to 8 mirrors 000119 1772470641.647406 mapwrite 0x030295 thru 0x038d5d (0x8ac9 bytes) 000120 1772470641.854347 write 0x00a052 thru 0x015c69 (0xbc18 bytes) 000123 1772470641.869533 write 0x03bd72 thru 0x03ffff (0x428e bytes) 000124 1772470641.871244 write 0x016175 thru 0x0174ca (0x1356 bytes) 000125 1772470641.885125 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa254018d (stale) Mirror 4: 0xa254018d (stale) Mirror 5: 0xa254018d (stale) Mirror 6: 0xa254018d (stale) Mirror 7: 0xa254018d (stale) Mirror 8: 0xa254018d (stale) Mirror 9: 0xa254018d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x861c0b91 Mirror 10: 0x861c0b91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000127 1772470642.954168 mapwrite 0x033815 thru 0x03ffff (0xc7eb bytes) 000130 1772470643.148116 read 0x01c21f thru 0x02a2bf (0xe0a1 bytes) 000131 1772470643.159150 mapwrite 0x027ef8 thru 0x02ed20 (0x6e29 bytes) 000133 1772470643.209430 write 0x03680d thru 0x03ffff (0x97f3 bytes) 000134 1772470643.210606 mapwrite 0x022d74 thru 0x02f7a0 (0xca2d bytes) 000136 1772470643.256709 write 0x01ea8f thru 0x02d476 (0xe9e8 bytes) 000140 1772470643.262131 write 0x00a9a6 thru 0x0173a2 (0xc9fd bytes) 000141 1772470643.275750 write 0x0216ce thru 0x02d284 (0xbbb7 bytes) 000142 1772470643.277535 mapread 0x006e4a thru 0x011884 (0xaa3b bytes) 000145 1772470643.281464 write 0x03dba4 thru 0x03ffff (0x245c bytes) 000146 1772470643.283167 read 0x028fd5 thru 0x032c49 (0x9c75 bytes) 000147 1772470643.284296 write 0x01ecb1 thru 0x02df75 (0xf2c5 bytes) 000148 1772470643.287198 mapread 0x011629 thru 0x020fe2 (0xf9ba bytes) 000149 1772470643.298147 mapwrite 0x027f9b thru 0x02851c (0x582 bytes) 000150 1772470643.345760 mapwrite 0x003926 thru 0x010e13 (0xd4ee bytes) 000151 1772470643.416048 write 0x03d7f6 thru 0x03ffff (0x280a bytes) 000152 1772470643.417789 read 0x0170b8 thru 0x0257e7 (0xe730 bytes) 000153 1772470643.418787 write 0x01b692 thru 0x021120 (0x5a8f bytes) 000154 1772470643.421241 read 0x00e6f1 thru 0x0162ab (0x7bbb bytes) 000157 1772470643.437009 MIRROR_RESYNC 9 mirrors 000160 1772470644.825860 mapread 0x02cda0 thru 0x039b5a (0xcdbb bytes) 000162 1772470644.859738 trunc from 0x040000 to 0x008233 (0x37dcc bytes) 000163 1772470644.942809 MIRROR_RESYNC 9 mirrors 000164 1772470646.146403 MIRROR_EXTEND to 10 mirrors 000165 1772470646.802245 MIRROR_EXTEND to 11 mirrors 000166 1772470647.628872 MIRROR_RESYNC 11 mirrors 000169 1772470648.140430 mapwrite 0x016d1d thru 0x019ef9 (0x31dd bytes) 000170 1772470648.369455 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19efa): Mirror 2: 0x1b13c833 (stale) Mirror 4: 0x1b13c833 (stale) Mirror 5: 0x1b13c833 (stale) Mirror 6: 0x1b13c833 (stale) Mirror 7: 0x1b13c833 (stale) Mirror 8: 0x1b13c833 (stale) Mirror 9: 0x1b13c833 (stale) Mirror 10: 0x1b13c833 (stale) Mirror 12: 0x1b13c833 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19efa): Mirror 2: 0x1b13c833 (stale) Mirror 4: 0x1b13c833 (stale) Mirror 5: 0x1b13c833 (stale) Mirror 6: 0x1b13c833 (stale) Mirror 7: 0x1b13c833 (stale) Mirror 8: 0x1b13c833 (stale) Mirror 9: 0x1b13c833 (stale) Mirror 10: 0x1b13c833 (stale) Mirror 12: 0x1b13c833 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19efa: skipped 000171 1772470648.981300 read 0x00437a thru 0x012e45 (0xeacc bytes) 000174 1772470648.994881 mapwrite 0x005181 thru 0x00f3fe (0xa27e bytes) 000176 1772470649.044392 write 0x029a37 thru 0x0383a9 (0xe973 bytes) 000177 1772470649.046853 trunc from 0x0383aa to 0x010b90 (0x27819 bytes) 000179 1772470649.068904 trunc from 0x010b91 to 0x017afc (0x6f6c bytes) 000181 1772470649.093828 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17afd): Mirror 2: 0x65ef3ce1 (stale) Mirror 4: 0x65ef3ce1 (stale) Mirror 6: 0x65ef3ce1 (stale) Mirror 7: 0x65ef3ce1 (stale) Mirror 8: 0x65ef3ce1 (stale) Mirror 9: 0x65ef3ce1 (stale) Mirror 10: 0x65ef3ce1 (stale) Mirror 12: 0x65ef3ce1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17afd): Mirror 2: 0x65ef3ce1 (stale) Mirror 4: 0x65ef3ce1 (stale) Mirror 6: 0x65ef3ce1 (stale) Mirror 7: 0x65ef3ce1 (stale) Mirror 8: 0x65ef3ce1 (stale) Mirror 9: 0x65ef3ce1 (stale) Mirror 10: 0x65ef3ce1 (stale) Mirror 12: 0x65ef3ce1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17afd: skipped 000182 1772470649.498750 trunc from 0x017afd to 0x02a131 (0x12635 bytes) 000183 1772470649.526173 MIRROR_RESYNC 9 mirrors 000184 1772470650.738776 write 0x0096f4 thru 0x017d41 (0xe64e bytes) 000185 1772470650.792704 mapwrite 0x009882 thru 0x009b86 (0x305 bytes) 000186 1772470650.857770 write 0x019522 thru 0x021eb6 (0x8995 bytes) 000187 1772470650.877331 mapread 0x01c8d5 thru 0x020aa1 (0x41cd bytes) 000190 1772470650.881632 read 0x004f64 thru 0x0096f9 (0x4796 bytes) 000195 1772470650.894725 mapwrite 0x0074bf thru 0x00dc6b (0x67ad bytes) 000197 1772470650.959447 trunc from 0x02a132 to 0x01946a (0x10cc7 bytes) 000198 1772470650.983320 mapwrite 0x02d5f5 thru 0x033b3e (0x654a bytes) 000199 1772470651.051404 mapwrite 0x015dba thru 0x01acd0 (0x4f17 bytes) 000201 1772470651.112442 write 0x012870 thru 0x01b395 (0x8b26 bytes) 000202 1772470651.113787 mapwrite 0x010f3a thru 0x01860f (0x76d6 bytes) 000203 1772470651.186626 mapwrite 0x00ce74 thru 0x0198bb (0xca48 bytes) 000205 1772470651.244678 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33b3f): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b3f): Mirror 2: 0x1c2c1c2c (stale) Mirror 4: 0x1c2c1c2c (stale) Mirror 6: 0x1c2c1c2c (stale) Mirror 7: 0x1c2c1c2c (stale) Mirror 8: 0x1c2c1c2c (stale) Mirror 9: 0x1c2c1c2c (stale) Mirror 10: 0x1c2c1c2c (stale) Mirror 12: 0x1c2c1c2c (stale) CRC-32 checksum value for chunk [0, 0x33b3f): Mirror 1: 0xede77634 Mirror 13: 0xede77634 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b3f: skipped 000206 1772470652.158179 mapread 0x02d72a thru 0x033b3e (0x6415 bytes) 000207 1772470652.201416 MIRROR_RESYNC 10 mirrors 000208 1772470653.697350 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) 000212 1772470654.108714 mapread 0x028037 thru 0x033b3e (0xbb08 bytes) 000214 1772470654.132551 mapread 0x015935 thru 0x018ab7 (0x3183 bytes) 000217 1772470654.142982 write 0x012d7c thru 0x012ea0 (0x125 bytes) 000221 1772470654.251353 read 0x00298c thru 0x004e06 (0x247b bytes) 000222 1772470654.258134 trunc from 0x033b3f to 0x011cbf (0x21e7f bytes) 000223 1772470654.299759 read 0x00553e thru 0x011cbf (0xc782 bytes) 000226 1772470654.310913 mapread 0x004da0 thru 0x0058f6 (0xb57 bytes) 000227 1772470654.312284 write 0x02baea thru 0x037344 (0xb85b bytes) 000228 1772470654.314549 mapwrite 0x025910 thru 0x02d65c (0x7d4d bytes) 000233 1772470654.397615 mapwrite 0x0368d4 thru 0x03af71 (0x469e bytes) 000234 1772470654.461339 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3af72): Mirror 2: 0x45c41eaa (stale) Mirror 4: 0x45c41eaa (stale) Mirror 6: 0x45c41eaa (stale) Mirror 7: 0x45c41eaa (stale) Mirror 8: 0x45c41eaa (stale) Mirror 9: 0x45c41eaa (stale) Mirror 12: 0x45c41eaa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af72): Mirror 2: 0x45c41eaa (stale) Mirror 4: 0x45c41eaa (stale) Mirror 6: 0x45c41eaa (stale) Mirror 7: 0x45c41eaa (stale) Mirror 8: 0x45c41eaa (stale) Mirror 9: 0x45c41eaa (stale) Mirror 12: 0x45c41eaa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af72: skipped 000237 1772470654.890173 mapwrite 0x033f74 thru 0x038cfd (0x4d8a bytes) 000240 1772470654.956350 read 0x01e62e thru 0x02d7d4 (0xf1a7 bytes) 000241 1772470654.972802 mapread 0x039c0b thru 0x03af71 (0x1367 bytes) 000249 1772470654.980220 mapread 0x02f393 thru 0x0363f4 (0x7062 bytes) 000251 1772470654.982305 read 0x004666 thru 0x00c39d (0x7d38 bytes) 000254 1772470655.004034 read 0x01e4d5 thru 0x026cce (0x87fa bytes) 000256 1772470655.005646 mapwrite 0x01e4bd thru 0x020ac3 (0x2607 bytes) 000257 1772470655.044572 read 0x02f101 thru 0x034337 (0x5237 bytes) 000258 1772470655.045718 mapwrite 0x020717 thru 0x021b85 (0x146f bytes) 000261 1772470655.095221 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3af72): Mirror 2: 0x45c41eaa (stale) Mirror 4: 0x45c41eaa (stale) Mirror 6: 0x45c41eaa (stale) Mirror 8: 0x45c41eaa (stale) Mirror 9: 0x45c41eaa (stale) Mirror 12: 0x45c41eaa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af72): Mirror 2: 0x45c41eaa (stale) Mirror 4: 0x45c41eaa (stale) Mirror 6: 0x45c41eaa (stale) Mirror 8: 0x45c41eaa (stale) Mirror 9: 0x45c41eaa (stale) Mirror 12: 0x45c41eaa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af72: skipped 000263 1772470655.504561 write 0x01d7d6 thru 0x0286fa (0xaf25 bytes) 000264 1772470655.516925 write 0x00a843 thru 0x0111e9 (0x69a7 bytes) 000266 1772470655.534118 MIRROR_RESYNC 7 mirrors 000267 1772470656.793030 trunc from 0x03af72 to 0x01e0f4 (0x1ce7d bytes) 000268 1772470656.870273 read 0x00e123 thru 0x012a12 (0x48f0 bytes) 000269 1772470656.881923 MIRROR_RESYNC 7 mirrors 000270 1772470657.876769 read 0x01d8e9 thru 0x01e0f4 (0x80c bytes) 000271 1772470657.882003 write 0x02e4f1 thru 0x030ce1 (0x27f1 bytes) 000273 1772470657.968742 mapwrite 0x03402f thru 0x038019 (0x3feb bytes) 000275 1772470658.153709 trunc from 0x03801a to 0x0022ef (0x35d2a bytes) 000276 1772470658.182830 trunc from 0x0022f0 to 0x011d85 (0xfa96 bytes) 000277 1772470658.221855 mapwrite 0x0287af thru 0x03552d (0xcd7f bytes) 000278 1772470658.331765 write 0x00a7be thru 0x016f7a (0xc7bd bytes) 000281 1772470658.354641 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3552e): Mirror 2: 0x467d6901 (stale) Mirror 4: 0x467d6901 (stale) Mirror 6: 0x467d6901 (stale) Mirror 8: 0x467d6901 (stale) Mirror 12: 0x467d6901 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3552e): Mirror 2: 0x467d6901 (stale) Mirror 4: 0x467d6901 (stale) Mirror 6: 0x467d6901 (stale) Mirror 8: 0x467d6901 (stale) Mirror 12: 0x467d6901 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3552e: skipped 000282 1772470658.755841 mapwrite 0x035901 thru 0x035a4d (0x14d bytes) 000284 1772470658.818951 mapread 0x0003ea thru 0x008af3 (0x870a bytes) 000285 1772470658.838742 write 0x01ccbe thru 0x01f7ac (0x2aef bytes) 000288 1772470658.854656 mapwrite 0x0398bc thru 0x03f752 (0x5e97 bytes) 000290 1772470658.941715 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f753): Mirror 2: 0xd7817195 (stale) Mirror 4: 0xd7817195 (stale) Mirror 6: 0xd7817195 (stale) Mirror 8: 0xd7817195 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f753): Mirror 2: 0xd7817195 (stale) Mirror 4: 0xd7817195 (stale) Mirror 6: 0xd7817195 (stale) Mirror 8: 0xd7817195 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f753: skipped 000291 1772470659.303142 trunc from 0x03f753 to 0x00d861 (0x31ef1 bytes) 000292 1772470659.330014 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd862): Mirror 4: 0x2684fdd4 (stale) Mirror 6: 0x2684fdd4 (stale) Mirror 8: 0x2684fdd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd862): Mirror 4: 0x2684fdd4 (stale) Mirror 6: 0x2684fdd4 (stale) Mirror 8: 0x2684fdd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd862: skipped 000294 1772470659.668759 write 0x023a6f thru 0x0304cd (0xca5f bytes) 000297 1772470659.673902 write 0x017f89 thru 0x01a050 (0x20c8 bytes) 000298 1772470659.684340 mapread 0x01db25 thru 0x02046e (0x294a bytes) 000299 1772470659.691951 read 0x0053d1 thru 0x00af5b (0x5b8b bytes) 000300 1772470659.701728 mapwrite 0x039115 thru 0x03ffff (0x6eeb bytes) 000301 1772470659.786990 write 0x024194 thru 0x02a51b (0x6388 bytes) 000302 1772470659.794397 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x254b0a9d (stale) Mirror 6: 0x254b0a9d (stale) Mirror 8: 0x254b0a9d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x733a1440 Mirror 9: 0x733a1440 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000304 1772470660.541420 read 0x02a222 thru 0x03782c (0xd60b bytes) 000305 1772470660.561194 read 0x039953 thru 0x03d667 (0x3d15 bytes) 000306 1772470660.576650 mapread 0x03bd4b thru 0x03ffff (0x42b5 bytes) 000308 1772470660.597178 write 0x021fca thru 0x023c13 (0x1c4a bytes) 000309 1772470660.681469 MIRROR_RESYNC 5 mirrors 000311 1772470661.421597 trunc from 0x040000 to 0x0364b7 (0x9b48 bytes) 000314 1772470661.480597 trunc from 0x0364b8 to 0x009736 (0x2cd81 bytes) 000315 1772470661.499860 mapread 0x0055dd thru 0x006aa8 (0x14cc bytes) 000316 1772470661.508981 write 0x01776c thru 0x023f5a (0xc7ef bytes) 000319 1772470661.514307 mapwrite 0x02b98d thru 0x037baf (0xc223 bytes) 000320 1772470661.588640 MIRROR_RESYNC 5 mirrors 000322 1772470662.302232 write 0x038e19 thru 0x03ffff (0x71e7 bytes) 000323 1772470662.355189 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5fae4b98 (stale) Mirror 6: 0x5fae4b98 (stale) Mirror 8: 0x5fae4b98 (stale) Mirror 9: 0x5fae4b98 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2f09198 Mirror 10: 0x2f09198 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000325 1772470663.099984 read 0x0250ae thru 0x03408d (0xefe0 bytes) 000329 1772470663.137435 mapwrite 0x007c7a thru 0x00d088 (0x540f bytes) 000331 1772470663.292653 mapwrite 0x008a89 thru 0x016b7b (0xe0f3 bytes) 000332 1772470663.346992 mapwrite 0x00a8e9 thru 0x00effa (0x4712 bytes) 000333 1772470663.389001 mapwrite 0x024c39 thru 0x02c429 (0x77f1 bytes) 000334 1772470663.437048 trunc from 0x040000 to 0x01a256 (0x25da9 bytes) 000336 1772470663.454589 write 0x012f31 thru 0x01588a (0x295a bytes) 000338 1772470663.457673 mapread 0x009884 thru 0x014daa (0xb527 bytes) 000339 1772470663.459610 write 0x000925 thru 0x00ac10 (0xa2ec bytes) 000341 1772470663.469701 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1a257): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a257): Mirror 4: 0xa4d2bc51 (stale) Mirror 6: 0xa4d2bc51 (stale) Mirror 8: 0xa4d2bc51 (stale) Mirror 9: 0xa4d2bc51 (stale) Mirror 10: 0xa4d2bc51 (stale) CRC-32 checksum value for chunk [0, 0x1a257): Mirror 1: 0xec282403 Mirror 11: 0xec282403 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a257: skipped 000343 1772470664.115627 write 0x02ce3b thru 0x02e450 (0x1616 bytes) 000344 1772470664.185545 mapwrite 0x03c41d thru 0x03ffff (0x3be3 bytes) 000347 1772470664.295403 mapwrite 0x01262b thru 0x01b27c (0x8c52 bytes) 000353 1772470664.367611 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5fae4b98 (stale) Mirror 6: 0x5fae4b98 (stale) Mirror 8: 0x5fae4b98 (stale) Mirror 9: 0x5fae4b98 (stale) Mirror 10: 0x2f09198 (stale) Mirror 11: 0xaaad508f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc28dcb1d Mirror 12: 0xc28dcb1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000355 1772470665.088732 mapread 0x00fa06 thru 0x01a648 (0xac43 bytes) 000357 1772470665.126644 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5fae4b98 (stale) Mirror 6: 0x5fae4b98 (stale) Mirror 8: 0x5fae4b98 (stale) Mirror 9: 0x5fae4b98 (stale) Mirror 10: 0x2f09198 (stale) Mirror 11: 0xaaad508f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc28dcb1d Mirror 12: 0xc28dcb1d Mirror 13: 0xc28dcb1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000358 1772470665.935159 trunc from 0x040000 to 0x026b90 (0x1946f bytes) 000360 1772470666.037185 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x26b91): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26b91): Mirror 4: 0xbeae051f (stale) Mirror 6: 0xbeae051f (stale) Mirror 8: 0xbeae051f (stale) Mirror 9: 0xbeae051f (stale) Mirror 10: 0xbeae051f (stale) Mirror 11: 0xa932837c (stale) Mirror 12: 0x4d5d6bb0 (stale) Mirror 13: 0x4d5d6bb0 (stale) CRC-32 checksum value for chunk [0, 0x26b91): Mirror 1: 0x4d5d6bb0 Mirror 14: 0x4d5d6bb0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26b91: skipped 000361 1772470666.800056 mapread 0x022d94 thru 0x02593f (0x2bac bytes) 000362 1772470666.829049 trunc from 0x026b91 to 0x004461 (0x2272f bytes) 000364 1772470666.915926 read 0x001c1d thru 0x001c9e (0x82 bytes) 000365 1772470666.925062 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x4462): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4462): Mirror 4: 0xef6e851d (stale) Mirror 6: 0xef6e851d (stale) Mirror 8: 0xef6e851d (stale) Mirror 9: 0xef6e851d (stale) Mirror 10: 0xef6e851d (stale) Mirror 11: 0x6277f87 (stale) Mirror 12: 0x6277f87 (stale) Mirror 13: 0x6277f87 (stale) Mirror 14: 0x6277f87 (stale) CRC-32 checksum value for chunk [0, 0x4462): Mirror 1: 0x6277f87 Mirror 15: 0x6277f87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4462: skipped 000367 1772470667.703741 trunc from 0x004462 to 0x01510a (0x10ca9 bytes) 000368 1772470667.790768 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1510b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1510b): Mirror 4: 0x483dea40 (stale) Mirror 6: 0x483dea40 (stale) Mirror 8: 0x483dea40 (stale) Mirror 9: 0x483dea40 (stale) Mirror 10: 0x483dea40 (stale) Mirror 11: 0x61274f9f (stale) Mirror 12: 0xc44c21ed (stale) Mirror 13: 0xc44c21ed (stale) Mirror 14: 0xc44c21ed (stale) Mirror 15: 0xf8b2b7de (stale) CRC-32 checksum value for chunk [0, 0x1510b): Mirror 1: 0xf8b2b7de Mirror 16: 0xf8b2b7de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1510b: skipped 000369 1772470668.640731 read 0x003d03 thru 0x00fe66 (0xc164 bytes) 000370 1772470668.661870 read 0x0041fd thru 0x010a22 (0xc826 bytes) 000371 1772470668.676537 mapwrite 0x031f80 thru 0x03ffff (0xe080 bytes) 000373 1772470668.834454 mapwrite 0x00134f thru 0x0084a6 (0x7158 bytes) 000374 1772470668.927952 write 0x015954 thru 0x01643d (0xaea bytes) 000376 1772470668.934128 mapwrite 0x033be4 thru 0x03ffff (0xc41c bytes) 000380 1772470668.979480 mapwrite 0x02131c thru 0x0256ed (0x43d2 bytes) 000382 1772470669.025487 trunc from 0x040000 to 0x02bcf1 (0x1430e bytes) 000383 1772470669.044473 trunc from 0x02bcf2 to 0x019364 (0x1298d bytes) 000384 1772470669.061267 read 0x008bd6 thru 0x00c82a (0x3c55 bytes) 000388 1772470669.071906 mapread 0x008537 thru 0x012a22 (0xa4ec bytes) 000389 1772470669.077852 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x19365): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19365): Mirror 4: 0xc3852413 (stale) Mirror 6: 0xc3852413 (stale) Mirror 8: 0xc3852413 (stale) Mirror 9: 0xc3852413 (stale) Mirror 10: 0xc3852413 (stale) Mirror 11: 0xf67dafb3 (stale) Mirror 12: 0x437bd7e9 (stale) Mirror 13: 0x437bd7e9 (stale) Mirror 14: 0x437bd7e9 (stale) Mirror 15: 0x4c01fd59 (stale) Mirror 16: 0x4c01fd59 (stale) CRC-32 checksum value for chunk [0, 0x19365): Mirror 1: 0xb7b36b61 Mirror 17: 0xb7b36b61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19365: skipped 000390 1772470669.809814 mapwrite 0x00f7ee thru 0x0158e1 (0x60f4 bytes) 000392 1772470669.983811 trunc from 0x019365 to 0x02310f (0x9dab bytes) 000394 1772470670.035544 mapwrite 0x0107f4 thru 0x01e162 (0xd96f bytes) 000396 1772470670.103326 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23110): Mirror 6: 0xea19c27e (stale) Mirror 8: 0xea19c27e (stale) Mirror 9: 0xea19c27e (stale) Mirror 10: 0xea19c27e (stale) Mirror 11: 0x2ec81914 (stale) Mirror 12: 0x3cddf920 (stale) Mirror 13: 0x3cddf920 (stale) Mirror 14: 0x3cddf920 (stale) Mirror 15: 0x3a278898 (stale) Mirror 16: 0x3a278898 (stale) Mirror 17: 0x4a8ea318 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23110): Mirror 6: 0xea19c27e (stale) Mirror 8: 0xea19c27e (stale) Mirror 9: 0xea19c27e (stale) Mirror 10: 0xea19c27e (stale) Mirror 11: 0x2ec81914 (stale) Mirror 12: 0x3cddf920 (stale) Mirror 13: 0x3cddf920 (stale) Mirror 14: 0x3cddf920 (stale) Mirror 15: 0x3a278898 (stale) Mirror 16: 0x3a278898 (stale) Mirror 17: 0x4a8ea318 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23110: skipped 000397 1772470670.630052 mapread 0x01898d thru 0x02310f (0xa783 bytes) 000398 1772470670.656721 read 0x00d385 thru 0x01c14d (0xedc9 bytes) 000399 1772470670.664006 trunc from 0x023110 to 0x036fd8 (0x13ec9 bytes) 000401 1772470670.679822 trunc from 0x036fd9 to 0x00b9a7 (0x2b631 bytes) 000402 1772470670.700824 mapread 0x005846 thru 0x00b9a7 (0x6162 bytes) 000403 1772470670.709976 trunc from 0x00b9a8 to 0x0192ef (0xd948 bytes) 000404 1772470670.727781 trunc from 0x0192f0 to 0x0149ab (0x4944 bytes) 000407 1772470670.748249 write 0x005954 thru 0x00ce09 (0x74b6 bytes) 000408 1772470670.756259 read 0x00f153 thru 0x0149ab (0x5859 bytes) 000409 1772470670.767611 read 0x00fba6 thru 0x0149ab (0x4e06 bytes) 000410 1772470670.768843 trunc from 0x0149ac to 0x010e7c (0x3b2f bytes) 000411 1772470670.789042 read 0x002ef9 thru 0x010e7c (0xdf84 bytes) 000412 1772470670.794921 MIRROR_RESYNC 12 mirrors 000414 1772470672.345861 read 0x001b2f thru 0x0071b3 (0x5685 bytes) 000415 1772470672.361558 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) 000417 1772470672.763875 trunc from 0x010e7d to 0x016328 (0x54ac bytes) 000418 1772470672.864598 trunc from 0x016329 to 0x025845 (0xf51d bytes) 000419 1772470672.885387 mapread 0x0049f2 thru 0x00ec78 (0xa287 bytes) 000421 1772470672.907771 trunc from 0x025846 to 0x031fae (0xc769 bytes) 000426 1772470672.934867 read 0x000685 thru 0x00f640 (0xefbc bytes) 000428 1772470672.941898 mapread 0x02f221 thru 0x031fae (0x2d8e bytes) 000430 1772470672.952969 mapwrite 0x027d76 thru 0x03211a (0xa3a5 bytes) 000432 1772470673.121226 read 0x00ba48 thru 0x016ec5 (0xb47e bytes) 000433 1772470673.132950 trunc from 0x03211b to 0x038ea1 (0x6d87 bytes) 000437 1772470673.155772 mapwrite 0x032b65 thru 0x034eff (0x239b bytes) 000438 1772470673.203434 write 0x00cd43 thru 0x019866 (0xcb24 bytes) 000440 1772470673.206489 trunc from 0x038ea2 to 0x003f25 (0x34f7c bytes) 000441 1772470673.224569 trunc from 0x003f26 to 0x0105d3 (0xc6ae bytes) 000442 1772470673.248699 MIRROR_RESYNC 11 mirrors 000445 1772470674.787418 mapwrite 0x03bca7 thru 0x03d85c (0x1bb6 bytes) 000447 1772470674.989420 mapwrite 0x01dce9 thru 0x028f61 (0xb279 bytes) 000448 1772470675.106753 trunc from 0x03d85d to 0x0046e7 (0x39175 bytes) 000449 1772470675.150644 mapwrite 0x01eac8 thru 0x01f869 (0xda2 bytes) 000451 1772470675.266524 write 0x0216ff thru 0x026aba (0x53bc bytes) 000453 1772470675.274778 mapwrite 0x02cd97 thru 0x03476a (0x79d4 bytes) 000454 1772470675.416738 write 0x0288e4 thru 0x029437 (0xb54 bytes) 000456 1772470675.423985 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3476b): Mirror 8: 0xb694df54 (stale) Mirror 9: 0xb694df54 (stale) Mirror 10: 0xb694df54 (stale) Mirror 11: 0xb694df54 (stale) Mirror 12: 0xb694df54 (stale) Mirror 13: 0xb694df54 (stale) Mirror 14: 0xb694df54 (stale) Mirror 16: 0xb694df54 (stale) Mirror 17: 0xb694df54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3476b): Mirror 8: 0xb694df54 (stale) Mirror 9: 0xb694df54 (stale) Mirror 10: 0xb694df54 (stale) Mirror 11: 0xb694df54 (stale) Mirror 12: 0xb694df54 (stale) Mirror 13: 0xb694df54 (stale) Mirror 14: 0xb694df54 (stale) Mirror 16: 0xb694df54 (stale) Mirror 17: 0xb694df54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3476b: skipped 000457 1772470676.175936 write 0x00c90c thru 0x01596b (0x9060 bytes) 000458 1772470676.204805 mapread 0x00866f thru 0x017fae (0xf940 bytes) 000462 1772470676.260931 mapread 0x02f981 thru 0x03476a (0x4dea bytes) 000463 1772470676.283364 mapread 0x02e424 thru 0x03476a (0x6347 bytes) 000464 1772470676.303062 MIRROR_RESYNC 10 mirrors 000466 1772470678.312569 mapwrite 0x012f3f thru 0x0143ff (0x14c1 bytes) 000467 1772470678.497113 read 0x01df31 thru 0x028943 (0xaa13 bytes) 000468 1772470678.510472 mapwrite 0x030733 thru 0x03174e (0x101c bytes) 000472 1772470678.554036 trunc from 0x03476b to 0x02295d (0x11e0d bytes) 000473 1772470678.571773 read 0x0117c5 thru 0x0187cd (0x7009 bytes) 000478 1772470678.577717 read 0x0120a0 thru 0x02080b (0xe76c bytes) 000479 1772470678.593703 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2295e): Mirror 8: 0xf8896fce (stale) Mirror 9: 0xf8896fce (stale) Mirror 10: 0xf8896fce (stale) Mirror 11: 0xf8896fce (stale) Mirror 13: 0xf8896fce (stale) Mirror 14: 0xf8896fce (stale) Mirror 16: 0xf8896fce (stale) Mirror 17: 0xf8896fce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2295e): Mirror 8: 0xf8896fce (stale) Mirror 9: 0xf8896fce (stale) Mirror 10: 0xf8896fce (stale) Mirror 11: 0xf8896fce (stale) Mirror 13: 0xf8896fce (stale) Mirror 14: 0xf8896fce (stale) Mirror 16: 0xf8896fce (stale) Mirror 17: 0xf8896fce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2295e: skipped 000480 1772470679.140965 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2295e): Mirror 8: 0xf8896fce (stale) Mirror 9: 0xf8896fce (stale) Mirror 11: 0xf8896fce (stale) Mirror 13: 0xf8896fce (stale) Mirror 14: 0xf8896fce (stale) Mirror 16: 0xf8896fce (stale) Mirror 17: 0xf8896fce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2295e): Mirror 8: 0xf8896fce (stale) Mirror 9: 0xf8896fce (stale) Mirror 11: 0xf8896fce (stale) Mirror 13: 0xf8896fce (stale) Mirror 14: 0xf8896fce (stale) Mirror 16: 0xf8896fce (stale) Mirror 17: 0xf8896fce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2295e: skipped 000482 1772470679.541919 mapwrite 0x021479 thru 0x02ff4e (0xead6 bytes) 000483 1772470679.640778 read 0x01f09f thru 0x023190 (0x40f2 bytes) 000484 1772470679.647994 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff4f): Mirror 8: 0x71f6d6a8 (stale) Mirror 9: 0x71f6d6a8 (stale) Mirror 13: 0x71f6d6a8 (stale) Mirror 14: 0x71f6d6a8 (stale) Mirror 16: 0x71f6d6a8 (stale) Mirror 17: 0x71f6d6a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff4f): Mirror 8: 0x71f6d6a8 (stale) Mirror 9: 0x71f6d6a8 (stale) Mirror 13: 0x71f6d6a8 (stale) Mirror 14: 0x71f6d6a8 (stale) Mirror 16: 0x71f6d6a8 (stale) Mirror 17: 0x71f6d6a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff4f: skipped 000485 1772470680.163218 write 0x036ae4 thru 0x03ffff (0x951c bytes) 000486 1772470680.164633 write 0x03ea93 thru 0x03ffff (0x156d bytes) 000487 1772470680.168457 read 0x024579 thru 0x026aaa (0x2532 bytes) 000492 1772470680.183768 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x35506d79 (stale) Mirror 9: 0x35506d79 (stale) Mirror 13: 0x35506d79 (stale) Mirror 14: 0x35506d79 (stale) Mirror 16: 0x35506d79 (stale) Mirror 17: 0x35506d79 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbe6c4711 Mirror 18: 0xbe6c4711 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000493 1772470681.133962 mapwrite 0x0117db thru 0x01613e (0x4964 bytes) 000495 1772470681.318776 trunc from 0x040000 to 0x02f7ca (0x10835 bytes) 000496 1772470681.366211 write 0x00bf91 thru 0x00c253 (0x2c3 bytes) 000499 1772470681.368770 read 0x00b0eb thru 0x013413 (0x8329 bytes) 000500 1772470681.374444 read 0x026b74 thru 0x02f7ca (0x8c57 bytes) 000501 1772470681.389538 mapwrite 0x0279ce thru 0x0282d4 (0x907 bytes) 000503 1772470681.437304 trunc from 0x02f7cb to 0x00ae5d (0x2496d bytes) 000504 1772470681.464572 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xae5e): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae5e): Mirror 8: 0x1cad2054 (stale) Mirror 9: 0x1cad2054 (stale) Mirror 13: 0x1cad2054 (stale) Mirror 14: 0x1cad2054 (stale) Mirror 16: 0x1cad2054 (stale) Mirror 17: 0x1cad2054 (stale) Mirror 18: 0x1cad2054 (stale) CRC-32 checksum value for chunk [0, 0xae5e): Mirror 1: 0x1cad2054 Mirror 19: 0x1cad2054 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae5e: skipped 000506 1772470682.176457 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xae5e): Mirror 8: 0x1cad2054 (stale) Mirror 13: 0x1cad2054 (stale) Mirror 14: 0x1cad2054 (stale) Mirror 16: 0x1cad2054 (stale) Mirror 17: 0x1cad2054 (stale) Mirror 18: 0x1cad2054 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae5e): Mirror 8: 0x1cad2054 (stale) Mirror 13: 0x1cad2054 (stale) Mirror 14: 0x1cad2054 (stale) Mirror 16: 0x1cad2054 (stale) Mirror 17: 0x1cad2054 (stale) Mirror 18: 0x1cad2054 (stale) CRC-32 checksum value for chunk [0, 0xae5e): Mirror 1: 0x1cad2054 Mirror 19: 0x1cad2054 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae5e: skipped 000509 1772470683.022213 mapread 0x000b31 thru 0x0028a5 (0x1d75 bytes) 000511 1772470683.122816 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xae5e): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae5e): Mirror 8: 0x1cad2054 (stale) Mirror 13: 0x1cad2054 (stale) Mirror 14: 0x1cad2054 (stale) Mirror 16: 0x1cad2054 (stale) Mirror 17: 0x1cad2054 (stale) Mirror 18: 0x1cad2054 (stale) CRC-32 checksum value for chunk [0, 0xae5e): Mirror 1: 0x1cad2054 Mirror 19: 0x1cad2054 Mirror 20: 0x1cad2054 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae5e: skipped 000513 1772470684.088391 mapwrite 0x01fdca thru 0x02ec07 (0xee3e bytes) 000515 1772470684.317677 mapwrite 0x01bf49 thru 0x01fc60 (0x3d18 bytes) 000517 1772470684.386428 trunc from 0x02ec08 to 0x01a2b7 (0x14950 bytes) 000519 1772470684.420783 read 0x000ee8 thru 0x00ce4c (0xbf65 bytes) 000521 1772470684.434869 mapread 0x004002 thru 0x00dd7b (0x9d7a bytes) 000522 1772470684.451380 write 0x023652 thru 0x02c031 (0x89e0 bytes) 000526 1772470684.468923 read 0x019e27 thru 0x02080a (0x69e4 bytes) 000528 1772470684.496588 mapwrite 0x031f52 thru 0x0392b1 (0x7360 bytes) 000529 1772470684.634397 write 0x018231 thru 0x021615 (0x93e5 bytes) 000533 1772470684.645837 read 0x027e91 thru 0x034cc5 (0xce35 bytes) 000535 1772470684.660999 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x392b2): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392b2): Mirror 8: 0xaf528469 (stale) Mirror 13: 0xaf528469 (stale) Mirror 14: 0xaf528469 (stale) Mirror 16: 0xaf528469 (stale) Mirror 17: 0xaf528469 (stale) Mirror 18: 0xb1413dfe (stale) Mirror 19: 0xd5ebe381 (stale) Mirror 20: 0xd5ebe381 (stale) CRC-32 checksum value for chunk [0, 0x392b2): Mirror 1: 0x95f53b70 Mirror 21: 0x95f53b70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392b2: skipped 000538 1772470686.036866 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392b2): Mirror 8: 0xaf528469 (stale) Mirror 13: 0xaf528469 (stale) Mirror 14: 0xaf528469 (stale) Mirror 16: 0xaf528469 (stale) Mirror 17: 0xaf528469 (stale) Mirror 18: 0xb1413dfe (stale) Mirror 19: 0xd5ebe381 (stale) Mirror 20: 0xd5ebe381 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392b2): Mirror 8: 0xaf528469 (stale) Mirror 13: 0xaf528469 (stale) Mirror 14: 0xaf528469 (stale) Mirror 16: 0xaf528469 (stale) Mirror 17: 0xaf528469 (stale) Mirror 18: 0xb1413dfe (stale) Mirror 19: 0xd5ebe381 (stale) Mirror 20: 0xd5ebe381 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392b2: skipped 000539 1772470686.588863 write 0x00c63c thru 0x011943 (0x5308 bytes) 000540 1772470686.609330 mapread 0x0000e7 thru 0x004746 (0x4660 bytes) 000541 1772470686.618243 trunc from 0x0392b2 to 0x033985 (0x592c bytes) 000542 1772470686.638722 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33986): Mirror 8: 0x7a93359f (stale) Mirror 13: 0x7a93359f (stale) Mirror 14: 0x7a93359f (stale) Mirror 16: 0x7a93359f (stale) Mirror 17: 0x7a93359f (stale) Mirror 18: 0x3f2353ba (stale) Mirror 20: 0xde3710cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33986): Mirror 8: 0x7a93359f (stale) Mirror 13: 0x7a93359f (stale) Mirror 14: 0x7a93359f (stale) Mirror 16: 0x7a93359f (stale) Mirror 17: 0x7a93359f (stale) Mirror 18: 0x3f2353ba (stale) Mirror 20: 0xde3710cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33986: skipped 000544 1772470687.039617 mapwrite 0x0332f5 thru 0x03efea (0xbcf6 bytes) 000546 1772470687.137276 write 0x03b350 thru 0x03d3cf (0x2080 bytes) 000550 1772470687.146230 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3efeb): Mirror 8: 0x279d81c1 (stale) Mirror 13: 0x279d81c1 (stale) Mirror 14: 0x279d81c1 (stale) Mirror 16: 0x279d81c1 (stale) Mirror 17: 0x279d81c1 (stale) Mirror 18: 0xaa9583d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efeb): Mirror 8: 0x279d81c1 (stale) Mirror 13: 0x279d81c1 (stale) Mirror 14: 0x279d81c1 (stale) Mirror 16: 0x279d81c1 (stale) Mirror 17: 0x279d81c1 (stale) Mirror 18: 0xaa9583d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efeb: skipped 000551 1772470687.585746 read 0x029042 thru 0x037f12 (0xeed1 bytes) 000552 1772470687.601466 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3efeb): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efeb): Mirror 8: 0x279d81c1 (stale) Mirror 13: 0x279d81c1 (stale) Mirror 14: 0x279d81c1 (stale) Mirror 16: 0x279d81c1 (stale) Mirror 17: 0x279d81c1 (stale) Mirror 18: 0xaa9583d1 (stale) CRC-32 checksum value for chunk [0, 0x3efeb): Mirror 1: 0x52913383 Mirror 19: 0x52913383 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efeb: skipped 000553 1772470688.435550 trunc from 0x03efeb to 0x02b31c (0x13cce bytes) 000554 1772470688.553995 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2b31d): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b31d): Mirror 8: 0xa590ced9 (stale) Mirror 13: 0xa590ced9 (stale) Mirror 14: 0xa590ced9 (stale) Mirror 16: 0xa590ced9 (stale) Mirror 17: 0xa590ced9 (stale) Mirror 18: 0xc57e64a7 (stale) Mirror 19: 0xff990141 (stale) CRC-32 checksum value for chunk [0, 0x2b31d): Mirror 1: 0xff990141 Mirror 20: 0xff990141 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b31d: skipped 000557 1772470689.407246 mapread 0x01a548 thru 0x020b26 (0x65df bytes) 000558 1772470689.442510 MIRROR_RESYNC 9 mirrors 000566 1772470690.520950 trunc from 0x02b31d to 0x02c850 (0x1534 bytes) 000567 1772470690.632039 mapwrite 0x00092d thru 0x009fa0 (0x9674 bytes) 000569 1772470690.729380 mapread 0x0237bc thru 0x02c850 (0x9095 bytes) 000570 1772470690.747162 read 0x01a1ea thru 0x023d67 (0x9b7e bytes) 000571 1772470690.754197 mapwrite 0x01940e thru 0x0203db (0x6fce bytes) 000576 1772470690.827572 write 0x0183bb thru 0x0265b5 (0xe1fb bytes) 000577 1772470690.830482 mapwrite 0x00d18b thru 0x00d758 (0x5ce bytes) 000579 1772470690.890355 mapwrite 0x006ade thru 0x00d8d2 (0x6df5 bytes) 000582 1772470690.946152 trunc from 0x02c851 to 0x02ae15 (0x1a3b bytes) 000583 1772470690.973670 MIRROR_RESYNC 9 mirrors 000584 1772470692.311914 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) 000585 1772470692.621980 write 0x0107df thru 0x015318 (0x4b3a bytes) 000586 1772470692.680433 write 0x01be7a thru 0x02a0ba (0xe241 bytes) 000590 1772470692.696147 trunc from 0x02ae16 to 0x018ee6 (0x11f2f bytes) 000592 1772470692.725473 mapread 0x011507 thru 0x012298 (0xd92 bytes) 000593 1772470692.727341 write 0x00272d thru 0x0122de (0xfbb2 bytes) truncating to largest ever: 0x3f945 000595 1772470692.743920 trunc from 0x018ee7 to 0x03f944 (0x26a5e bytes) 000596 1772470692.774624 mapread 0x021c87 thru 0x02de05 (0xc17f bytes) 000597 1772470692.797134 mapwrite 0x014f44 thru 0x02418c (0xf249 bytes) 000599 1772470692.859444 mapread 0x01767e thru 0x01a858 (0x31db bytes) 000600 1772470692.860666 trunc from 0x03f945 to 0x03670f (0x9235 bytes) 000603 1772470692.880879 write 0x026770 thru 0x02d8c1 (0x7152 bytes) 000604 1772470692.882998 mapread 0x01ffa5 thru 0x029dc2 (0x9e1e bytes) 000605 1772470692.885489 read 0x007fca thru 0x0164b0 (0xe4e7 bytes) 000606 1772470692.886315 mapwrite 0x01fcff thru 0x02e929 (0xec2b bytes) 000607 1772470692.938911 MIRROR_RESYNC 8 mirrors 000608 1772470693.933562 mapread 0x00e098 thru 0x01d821 (0xf78a bytes) 000612 1772470693.960317 write 0x0220e4 thru 0x026540 (0x445d bytes) 000613 1772470694.030587 mapwrite 0x00f8c2 thru 0x011d9f (0x24de bytes) 000614 1772470694.093818 write 0x01db8b thru 0x02d6fe (0xfb74 bytes) 000615 1772470694.100044 mapwrite 0x003320 thru 0x00d71e (0xa3ff bytes) 000616 1772470694.153504 MIRROR_RESYNC 8 mirrors 000618 1772470695.131663 MIRROR_RESYNC 8 mirrors 000619 1772470695.538881 mapread 0x00debf thru 0x016938 (0x8a7a bytes) 000620 1772470695.557140 mapwrite 0x02561d thru 0x02bcb9 (0x669d bytes) 000622 1772470695.710384 write 0x00cbaa thru 0x017bae (0xb005 bytes) 000624 1772470695.729241 mapread 0x009cee thru 0x014c37 (0xaf4a bytes) 000626 1772470695.731858 mapread 0x025218 thru 0x033c62 (0xea4b bytes) 000628 1772470695.746272 MIRROR_RESYNC 8 mirrors 000629 1772470696.806723 trunc from 0x036710 to 0x01d521 (0x191ee bytes) 000630 1772470696.867667 write 0x024924 thru 0x02ca56 (0x8133 bytes) 000631 1772470696.869142 mapread 0x0023c0 thru 0x009599 (0x71da bytes) 000634 1772470696.892480 mapwrite 0x014bc2 thru 0x016fc5 (0x2404 bytes) 000636 1772470696.956735 MIRROR_RESYNC 8 mirrors 000641 1772470698.087772 trunc from 0x02ca57 to 0x001d64 (0x2acf2 bytes) 000644 1772470698.184493 read 0x000f59 thru 0x001b60 (0xc08 bytes) 000648 1772470698.194629 mapread 0x0004a6 thru 0x001d64 (0x18bf bytes) 000649 1772470698.196458 read 0x001728 thru 0x001d64 (0x63d bytes) 000650 1772470698.198499 mapwrite 0x03007d thru 0x03eca1 (0xec25 bytes) 000653 1772470698.343518 mapwrite 0x01beac thru 0x0273ec (0xb541 bytes) 000655 1772470698.408704 read 0x0069c1 thru 0x010dac (0xa3ec bytes) 000656 1772470698.409452 write 0x007fbe thru 0x014089 (0xc0cc bytes) 000659 1772470698.414543 read 0x001c82 thru 0x009bf8 (0x7f77 bytes) 000661 1772470698.416778 write 0x007591 thru 0x00c1b3 (0x4c23 bytes) 000663 1772470698.429217 MIRROR_RESYNC 8 mirrors 000664 1772470700.117346 mapwrite 0x00c24b thru 0x0150f8 (0x8eae bytes) 000666 1772470700.381504 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3eca2): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eca2): Mirror 8: 0xebd116d8 (stale) Mirror 13: 0xebd116d8 (stale) Mirror 14: 0xebd116d8 (stale) Mirror 16: 0xebd116d8 (stale) Mirror 17: 0xebd116d8 (stale) Mirror 19: 0xebd116d8 (stale) Mirror 20: 0xebd116d8 (stale) CRC-32 checksum value for chunk [0, 0x3eca2): Mirror 1: 0x74fb6fba Mirror 21: 0x74fb6fba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eca2: skipped 000669 1772470701.471043 mapread 0x003b7a thru 0x00ff62 (0xc3e9 bytes) 000670 1772470701.503355 trunc from 0x03eca2 to 0x02aff6 (0x13cab bytes) 000671 1772470701.591661 write 0x03fc90 thru 0x03ff08 (0x279 bytes) 000672 1772470701.595544 read 0x01e30f thru 0x022b19 (0x480b bytes) 000673 1772470701.602800 mapread 0x02b067 thru 0x03acf8 (0xfc92 bytes) 000675 1772470701.619730 trunc from 0x03ff09 to 0x0126d9 (0x2d82f bytes) 000676 1772470701.637820 read 0x005ae5 thru 0x00f5d8 (0x9af4 bytes) 000677 1772470701.651308 mapread 0x00c3a3 thru 0x00e386 (0x1fe4 bytes) 000678 1772470701.656749 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x126da): Mirror 8: 0xfff030fe (stale) Mirror 14: 0xfff030fe (stale) Mirror 16: 0xfff030fe (stale) Mirror 17: 0xfff030fe (stale) Mirror 19: 0xfff030fe (stale) Mirror 20: 0xfff030fe (stale) Mirror 21: 0x5ce5a782 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x126da): Mirror 8: 0xfff030fe (stale) Mirror 14: 0xfff030fe (stale) Mirror 16: 0xfff030fe (stale) Mirror 17: 0xfff030fe (stale) Mirror 19: 0xfff030fe (stale) Mirror 20: 0xfff030fe (stale) Mirror 21: 0x5ce5a782 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x126da: skipped 000679 1772470702.047193 trunc from 0x0126da to 0x0231de (0x10b05 bytes) 000680 1772470702.072595 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x231df): Mirror 8: 0x78a762a7 (stale) Mirror 14: 0x78a762a7 (stale) Mirror 16: 0x78a762a7 (stale) Mirror 17: 0x78a762a7 (stale) Mirror 20: 0x78a762a7 (stale) Mirror 21: 0x6fb5030d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x231df): Mirror 8: 0x78a762a7 (stale) Mirror 14: 0x78a762a7 (stale) Mirror 16: 0x78a762a7 (stale) Mirror 17: 0x78a762a7 (stale) Mirror 20: 0x78a762a7 (stale) Mirror 21: 0x6fb5030d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x231df: skipped 000682 1772470702.484934 mapwrite 0x02227c thru 0x02d6a5 (0xb42a bytes) 000683 1772470702.574680 write 0x00fcf6 thru 0x01bfaa (0xc2b5 bytes) 000684 1772470702.588715 write 0x026608 thru 0x02b3e0 (0x4dd9 bytes) 000686 1772470702.591988 mapread 0x0023bf thru 0x00f011 (0xcc53 bytes) 000687 1772470702.611330 mapwrite 0x02652e thru 0x0324ef (0xbfc2 bytes) 000688 1772470702.685270 MIRROR_RESYNC 7 mirrors 000689 1772470704.158528 mapread 0x00bf61 thru 0x0145b1 (0x8651 bytes) 000690 1772470704.181094 write 0x023fb8 thru 0x033f4c (0xff95 bytes) 000691 1772470704.253811 trunc from 0x033f4d to 0x0179d9 (0x1c573 bytes) 000692 1772470704.275261 write 0x034ba3 thru 0x03c23f (0x769d bytes) 000693 1772470704.277929 read 0x021246 thru 0x02d69f (0xc45a bytes) 000694 1772470704.285933 mapwrite 0x01c047 thru 0x01d696 (0x1650 bytes) 000698 1772470704.355331 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c240): Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c240): Mirror 8: 0x3821bcbc (stale) Mirror 14: 0x3821bcbc (stale) Mirror 16: 0x3821bcbc (stale) Mirror 17: 0x3821bcbc (stale) Mirror 20: 0x3821bcbc (stale) Mirror 21: 0x3821bcbc (stale) CRC-32 checksum value for chunk [0, 0x3c240): Mirror 1: 0x88507e34 Mirror 22: 0x88507e34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c240: skipped 000700 1772470705.187704 read 0x035ab2 thru 0x03b591 (0x5ae0 bytes) 000702 1772470705.205198 write 0x00fa98 thru 0x015e14 (0x637d bytes) 000705 1772470705.294867 write 0x0349a4 thru 0x03fec2 (0xb51f bytes) 000707 1772470705.307896 read 0x036954 thru 0x03fec2 (0x956f bytes) 000710 1772470705.310829 mapwrite 0x037be2 thru 0x03ffff (0x841e bytes) 000711 1772470705.416339 mapread 0x000634 thru 0x00e42a (0xddf7 bytes) 000713 1772470705.440530 mapread 0x0044d6 thru 0x0120c3 (0xdbee bytes) 000714 1772470705.446298 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x658b6376 (stale) Mirror 14: 0x658b6376 (stale) Mirror 16: 0x658b6376 (stale) Mirror 17: 0x658b6376 (stale) Mirror 20: 0x658b6376 (stale) Mirror 21: 0x658b6376 (stale) Mirror 22: 0xe523f739 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3650a68d Mirror 23: 0x3650a68d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000716 1772470706.363245 write 0x017cf0 thru 0x0239f7 (0xbd08 bytes) 000718 1772470706.484694 trunc from 0x040000 to 0x004c18 (0x3b3e7 bytes) 000720 1772470706.544269 write 0x01c4fd thru 0x02087d (0x4381 bytes) 000722 1772470706.554610 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2087e): Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2087e): Mirror 8: 0xe70405ff (stale) Mirror 14: 0xe70405ff (stale) Mirror 16: 0xe70405ff (stale) Mirror 17: 0xe70405ff (stale) Mirror 20: 0xe70405ff (stale) Mirror 21: 0xe70405ff (stale) Mirror 22: 0x90260046 (stale) Mirror 23: 0xef98719b (stale) CRC-32 checksum value for chunk [0, 0x2087e): Mirror 1: 0x7aa67dec Mirror 24: 0x7aa67dec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2087e: skipped 000724 1772470707.443652 mapwrite 0x021209 thru 0x024fc4 (0x3dbc bytes) 000725 1772470707.632820 read 0x024e98 thru 0x024fc4 (0x12d bytes) 000727 1772470707.635391 mapread 0x022448 thru 0x024fc4 (0x2b7d bytes) 000728 1772470707.637358 trunc from 0x024fc5 to 0x010e52 (0x14172 bytes) 000730 1772470707.663727 trunc from 0x010e53 to 0x01b322 (0xa4d0 bytes) 000731 1772470707.687588 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b323): Mirror 14: 0xe37f78af (stale) Mirror 16: 0xe37f78af (stale) Mirror 17: 0xe37f78af (stale) Mirror 20: 0xe37f78af (stale) Mirror 21: 0xe37f78af (stale) Mirror 22: 0xc2f0ef99 (stale) Mirror 23: 0xb4431a27 (stale) Mirror 24: 0x9573e27d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b323): Mirror 14: 0xe37f78af (stale) Mirror 16: 0xe37f78af (stale) Mirror 17: 0xe37f78af (stale) Mirror 20: 0xe37f78af (stale) Mirror 21: 0xe37f78af (stale) Mirror 22: 0xc2f0ef99 (stale) Mirror 23: 0xb4431a27 (stale) Mirror 24: 0x9573e27d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b323: skipped 000732 1772470708.070891 write 0x031cb0 thru 0x03d60b (0xb95c bytes) 000733 1772470708.074831 write 0x01ef29 thru 0x02917e (0xa256 bytes) 000734 1772470708.091959 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d60c): Mirror 14: 0x10cc73a8 (stale) Mirror 16: 0x10cc73a8 (stale) Mirror 17: 0x10cc73a8 (stale) Mirror 20: 0x10cc73a8 (stale) Mirror 22: 0xb323fdbf (stale) Mirror 23: 0x6aea6944 (stale) Mirror 24: 0xafa626c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d60c): Mirror 14: 0x10cc73a8 (stale) Mirror 16: 0x10cc73a8 (stale) Mirror 17: 0x10cc73a8 (stale) Mirror 20: 0x10cc73a8 (stale) Mirror 22: 0xb323fdbf (stale) Mirror 23: 0x6aea6944 (stale) Mirror 24: 0xafa626c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d60c: skipped 000737 1772470708.611331 mapwrite 0x00ad70 thru 0x00e106 (0x3397 bytes) 000738 1772470708.736154 trunc from 0x03d60c to 0x029483 (0x14188 bytes) 000740 1772470708.775144 write 0x019f36 thru 0x02749a (0xd565 bytes) 000741 1772470708.822937 MIRROR_RESYNC 8 mirrors 000742 1772470710.494234 read 0x0114ef thru 0x01bd43 (0xa855 bytes) 000744 1772470710.509940 trunc from 0x029484 to 0x01077d (0x18d06 bytes) 000745 1772470710.681747 write 0x007598 thru 0x015639 (0xe0a2 bytes) 000747 1772470710.695113 mapwrite 0x0013d2 thru 0x00a583 (0x91b2 bytes) 000748 1772470710.779412 mapread 0x00e6b2 thru 0x011b40 (0x348f bytes) 000749 1772470710.786379 MIRROR_RESYNC 8 mirrors 000750 1772470711.943832 mapwrite 0x038298 thru 0x03d789 (0x54f2 bytes) 000751 1772470712.075633 mapwrite 0x00b453 thru 0x0129d5 (0x7583 bytes) 000753 1772470712.129969 read 0x0356e6 thru 0x03578e (0xa9 bytes) 000754 1772470712.131008 write 0x03fcd5 thru 0x03ff9f (0x2cb bytes) 000756 1772470712.135934 read 0x014b71 thru 0x015423 (0x8b3 bytes) 000757 1772470712.152325 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ffa0): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffa0): Mirror 14: 0x3e9f553 (stale) Mirror 16: 0x3e9f553 (stale) Mirror 17: 0x3e9f553 (stale) Mirror 20: 0x3e9f553 (stale) Mirror 22: 0x3e9f553 (stale) Mirror 23: 0x3e9f553 (stale) Mirror 24: 0x3e9f553 (stale) CRC-32 checksum value for chunk [0, 0x3ffa0): Mirror 1: 0x3bf2895a Mirror 25: 0x3bf2895a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffa0: skipped 000760 1772470713.201761 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ffa0): Mirror 14: 0x3e9f553 (stale) Mirror 16: 0x3e9f553 (stale) Mirror 17: 0x3e9f553 (stale) Mirror 20: 0x3e9f553 (stale) Mirror 22: 0x3e9f553 (stale) Mirror 23: 0x3e9f553 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffa0): Mirror 14: 0x3e9f553 (stale) Mirror 16: 0x3e9f553 (stale) Mirror 17: 0x3e9f553 (stale) Mirror 20: 0x3e9f553 (stale) Mirror 22: 0x3e9f553 (stale) Mirror 23: 0x3e9f553 (stale) CRC-32 checksum value for chunk [0, 0x3ffa0): Mirror 1: 0x3bf2895a Mirror 25: 0x3bf2895a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffa0: skipped 000761 1772470713.906791 mapwrite 0x027a3f thru 0x029d21 (0x22e3 bytes) 000762 1772470714.104878 write 0x03ed57 thru 0x03ffff (0x12a9 bytes) 000763 1772470714.117916 mapwrite 0x00a921 thru 0x00c452 (0x1b32 bytes) 000765 1772470714.189487 mapwrite 0x030c8d thru 0x03a4e5 (0x9859 bytes) 000766 1772470714.280467 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x5b146f12 (stale) Mirror 16: 0x5b146f12 (stale) Mirror 17: 0x5b146f12 (stale) Mirror 20: 0x5b146f12 (stale) Mirror 22: 0x5b146f12 (stale) Mirror 23: 0x5b146f12 (stale) Mirror 25: 0x5bb46fe5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbcc9efd6 Mirror 26: 0xbcc9efd6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000768 1772470715.471711 trunc from 0x040000 to 0x01af51 (0x250ae bytes) 000771 1772470715.601785 mapread 0x0198e4 thru 0x01af51 (0x166e bytes) 000772 1772470715.611902 mapread 0x00488c thru 0x00c8f2 (0x8067 bytes) 000773 1772470715.623993 mapread 0x00bb7d thru 0x011114 (0x5598 bytes) 000776 1772470715.634630 mapwrite 0x0122c8 thru 0x012361 (0x9a bytes) 000777 1772470715.678021 read 0x003dcf thru 0x0117b8 (0xd9ea bytes) 000779 1772470715.680493 write 0x01f748 thru 0x029bfd (0xa4b6 bytes) 000781 1772470715.684623 trunc from 0x029bfe to 0x007645 (0x225b8 bytes) 000782 1772470715.713036 write 0x00ec1d thru 0x019336 (0xa71a bytes) 000783 1772470715.714676 trunc from 0x019337 to 0x00fa6c (0x98ca bytes) 000786 1772470715.736747 write 0x023c1e thru 0x02e81d (0xac00 bytes) 000787 1772470715.739657 read 0x0225f2 thru 0x027332 (0x4d41 bytes) 000788 1772470715.748991 mapwrite 0x033d05 thru 0x03fd81 (0xc07d bytes) 000790 1772470715.820815 read 0x0150fb thru 0x01f583 (0xa489 bytes) 000793 1772470715.832178 MIRROR_RESYNC 9 mirrors 000794 1772470717.503758 MIRROR_RESYNC 9 mirrors 000797 1772470717.980790 trunc from 0x03fd82 to 0x013593 (0x2c7ee bytes) 000799 1772470718.051324 MIRROR_RESYNC 9 mirrors 000801 1772470719.415611 mapwrite 0x019e6a thru 0x01e7f6 (0x498d bytes) 000803 1772470719.559722 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1e7f7): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e7f7): Mirror 14: 0x6b0295cc (stale) Mirror 16: 0x6b0295cc (stale) Mirror 17: 0x6b0295cc (stale) Mirror 20: 0x6b0295cc (stale) Mirror 22: 0x6b0295cc (stale) Mirror 23: 0x6b0295cc (stale) Mirror 25: 0x6b0295cc (stale) Mirror 26: 0x6b0295cc (stale) CRC-32 checksum value for chunk [0, 0x1e7f7): Mirror 1: 0xdbae7317 Mirror 27: 0xdbae7317 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e7f7: skipped 000805 1772470720.200169 write 0x03fe4a thru 0x03ff4b (0x102 bytes) 000806 1772470720.271251 write 0x026854 thru 0x033c29 (0xd3d6 bytes) 000807 1772470720.281008 mapwrite 0x01dea5 thru 0x02cb8a (0xece6 bytes) 000808 1772470720.341245 MIRROR_RESYNC 10 mirrors 000811 1772470721.600243 write 0x00de11 thru 0x01c08a (0xe27a bytes) 000813 1772470721.663164 trunc from 0x03ff4c to 0x020112 (0x1fe39 bytes) 000816 1772470721.686333 write 0x009083 thru 0x015e86 (0xce04 bytes) 000817 1772470721.698384 write 0x012598 thru 0x01e3eb (0xbe54 bytes) 000822 1772470721.707551 read 0x018c9f thru 0x018caf (0x11 bytes) 000823 1772470721.708612 write 0x0234a6 thru 0x02b8df (0x843a bytes) 000826 1772470721.712154 read 0x002d47 thru 0x004a03 (0x1cbd bytes) 000827 1772470721.712965 mapwrite 0x010459 thru 0x01cbe0 (0xc788 bytes) 000828 1772470721.764893 read 0x01ab75 thru 0x01d64c (0x2ad8 bytes) 000830 1772470721.766873 trunc from 0x02b8e0 to 0x030a92 (0x51b3 bytes) 000831 1772470721.782888 write 0x033931 thru 0x03d56f (0x9c3f bytes) 000832 1772470721.785867 trunc from 0x03d570 to 0x00ee9d (0x2e6d2 bytes) 000833 1772470721.802744 write 0x037b3f thru 0x03ffff (0x84c1 bytes) 000837 1772470721.812004 trunc from 0x040000 to 0x028ee0 (0x1711f bytes) 000839 1772470721.844394 mapwrite 0x019bd2 thru 0x0244e8 (0xa917 bytes) 000840 1772470721.889647 mapwrite 0x039ee4 thru 0x03ffff (0x611c bytes) 000842 1772470721.975525 read 0x02e3ec thru 0x032da9 (0x49be bytes) 000843 1772470721.976462 read 0x03e9b8 thru 0x03ffff (0x1648 bytes) 000844 1772470721.982371 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x31b003e9 (stale) Mirror 16: 0x31b003e9 (stale) Mirror 17: 0x31b003e9 (stale) Mirror 20: 0x31b003e9 (stale) Mirror 22: 0x31b003e9 (stale) Mirror 23: 0x31b003e9 (stale) Mirror 25: 0x31b003e9 (stale) Mirror 27: 0x31b003e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x31b003e9 (stale) Mirror 16: 0x31b003e9 (stale) Mirror 17: 0x31b003e9 (stale) Mirror 20: 0x31b003e9 (stale) Mirror 22: 0x31b003e9 (stale) Mirror 23: 0x31b003e9 (stale) Mirror 25: 0x31b003e9 (stale) Mirror 27: 0x31b003e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000845 1772470722.565147 mapread 0x02bef2 thru 0x033bd0 (0x7cdf bytes) 000847 1772470722.592501 write 0x0071ed thru 0x00eb83 (0x7997 bytes) 000848 1772470722.608621 trunc from 0x040000 to 0x0328f8 (0xd707 bytes) 000850 1772470722.634188 mapwrite 0x03014b thru 0x03d6f5 (0xd5ab bytes) 000851 1772470722.774142 read 0x01c0ef thru 0x01d4c5 (0x13d7 bytes) 000853 1772470722.788046 read 0x01fc6a thru 0x02669c (0x6a33 bytes) 000855 1772470722.825909 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d6f6): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6f6): Mirror 14: 0xc2b6bf4c (stale) Mirror 16: 0xc2b6bf4c (stale) Mirror 17: 0xc2b6bf4c (stale) Mirror 20: 0xc2b6bf4c (stale) Mirror 22: 0xc2b6bf4c (stale) Mirror 23: 0xc2b6bf4c (stale) Mirror 25: 0xc2b6bf4c (stale) Mirror 27: 0xc2b6bf4c (stale) CRC-32 checksum value for chunk [0, 0x3d6f6): Mirror 1: 0x616b6e02 Mirror 28: 0x616b6e02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6f6: skipped 000856 1772470724.285817 trunc from 0x03d6f6 to 0x024fb4 (0x18741 bytes) 000859 1772470724.435358 mapwrite 0x022bde thru 0x02b997 (0x8dba bytes) 000861 1772470724.573686 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b998): Mirror 14: 0x29b7c1ef (stale) Mirror 16: 0x29b7c1ef (stale) Mirror 17: 0x29b7c1ef (stale) Mirror 20: 0x29b7c1ef (stale) Mirror 22: 0x29b7c1ef (stale) Mirror 25: 0x29b7c1ef (stale) Mirror 27: 0x29b7c1ef (stale) Mirror 28: 0xb0cb9374 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b998): Mirror 14: 0x29b7c1ef (stale) Mirror 16: 0x29b7c1ef (stale) Mirror 17: 0x29b7c1ef (stale) Mirror 20: 0x29b7c1ef (stale) Mirror 22: 0x29b7c1ef (stale) Mirror 25: 0x29b7c1ef (stale) Mirror 27: 0x29b7c1ef (stale) Mirror 28: 0xb0cb9374 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b998: skipped 000864 1772470725.202033 mapwrite 0x01486f thru 0x02195c (0xd0ee bytes) 000865 1772470725.314520 trunc from 0x02b998 to 0x0204a4 (0xb4f3 bytes) 000869 1772470725.368450 mapread 0x01806e thru 0x018702 (0x695 bytes) 000870 1772470725.378993 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x204a5): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x204a5): Mirror 14: 0x9e7c255e (stale) Mirror 16: 0x9e7c255e (stale) Mirror 17: 0x9e7c255e (stale) Mirror 20: 0x9e7c255e (stale) Mirror 22: 0x9e7c255e (stale) Mirror 25: 0x9e7c255e (stale) Mirror 27: 0x9e7c255e (stale) Mirror 28: 0x13010174 (stale) CRC-32 checksum value for chunk [0, 0x204a5): Mirror 1: 0xf199ed7f Mirror 29: 0xf199ed7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x204a5: skipped 000871 1772470726.481213 mapwrite 0x03d808 thru 0x03ffff (0x27f8 bytes) 000872 1772470726.947844 trunc from 0x040000 to 0x028076 (0x17f89 bytes) 000873 1772470726.980749 read 0x00aef3 thru 0x00d2e2 (0x23f0 bytes) 000876 1772470726.995830 trunc from 0x028077 to 0x00734e (0x20d28 bytes) 000877 1772470727.035475 MIRROR_RESYNC 10 mirrors 000878 1772470728.886434 mapwrite 0x01145e thru 0x01df9f (0xcb42 bytes) 000879 1772470729.066103 read 0x00eee9 thru 0x01237b (0x3493 bytes) 000881 1772470729.067957 write 0x03a679 thru 0x03b59a (0xf22 bytes) truncating to largest ever: 0x3ff31 000883 1772470729.071330 trunc from 0x03b59b to 0x03ff30 (0x4996 bytes) 000884 1772470729.097008 write 0x02ac3b thru 0x0399ad (0xed73 bytes) 000886 1772470729.123523 mapwrite 0x005755 thru 0x015331 (0xfbdd bytes) 000887 1772470729.211966 trunc from 0x03ff31 to 0x03e481 (0x1aaf bytes) 000888 1772470729.253272 MIRROR_RESYNC 10 mirrors 000889 1772470731.171543 mapread 0x02dc69 thru 0x03d1cb (0xf563 bytes) 000890 1772470731.275960 mapread 0x003058 thru 0x00bb8d (0x8b36 bytes) 000891 1772470731.328489 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) 000892 1772470731.868787 mapwrite 0x017b52 thru 0x0211a5 (0x9654 bytes) 000893 1772470732.085610 read 0x017431 thru 0x023da9 (0xc979 bytes) 000894 1772470732.086503 read 0x00bdfb thru 0x01a052 (0xe258 bytes) 000896 1772470732.113353 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e482): Mirror 16: 0x6435fd64 (stale) Mirror 17: 0x6435fd64 (stale) Mirror 20: 0x6435fd64 (stale) Mirror 22: 0x6435fd64 (stale) Mirror 27: 0x6435fd64 (stale) Mirror 28: 0x6435fd64 (stale) Mirror 29: 0x6435fd64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e482): Mirror 16: 0x6435fd64 (stale) Mirror 17: 0x6435fd64 (stale) Mirror 20: 0x6435fd64 (stale) Mirror 22: 0x6435fd64 (stale) Mirror 27: 0x6435fd64 (stale) Mirror 28: 0x6435fd64 (stale) Mirror 29: 0x6435fd64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e482: skipped 000899 1772470732.810293 mapread 0x00e455 thru 0x016270 (0x7e1c bytes) 000900 1772470732.877199 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e482): Mirror 17: 0x6435fd64 (stale) Mirror 20: 0x6435fd64 (stale) Mirror 22: 0x6435fd64 (stale) Mirror 27: 0x6435fd64 (stale) Mirror 28: 0x6435fd64 (stale) Mirror 29: 0x6435fd64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e482): Mirror 17: 0x6435fd64 (stale) Mirror 20: 0x6435fd64 (stale) Mirror 22: 0x6435fd64 (stale) Mirror 27: 0x6435fd64 (stale) Mirror 28: 0x6435fd64 (stale) Mirror 29: 0x6435fd64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e482: skipped 000901 1772470733.558731 mapread 0x02f0b9 thru 0x03748b (0x83d3 bytes) 000902 1772470733.601673 trunc from 0x03e482 to 0x017496 (0x26feb bytes) 000903 1772470733.629294 trunc from 0x017497 to 0x02f8de (0x18448 bytes) 000907 1772470733.662309 read 0x0109e4 thru 0x0163eb (0x5a08 bytes) 000908 1772470733.674847 trunc from 0x02f8df to 0x03ff1a (0x1063c bytes) 000909 1772470733.696978 mapwrite 0x025dc9 thru 0x028102 (0x233a bytes) 000910 1772470733.785198 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ff1b): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ff1b): Mirror 17: 0x1cb0427e (stale) Mirror 20: 0x1cb0427e (stale) Mirror 22: 0x1cb0427e (stale) Mirror 27: 0x1cb0427e (stale) Mirror 28: 0x1cb0427e (stale) Mirror 29: 0x1cb0427e (stale) CRC-32 checksum value for chunk [0, 0x3ff1b): Mirror 1: 0x2934a6a4 Mirror 30: 0x2934a6a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ff1b: skipped 000911 1772470735.289943 read 0x00988f thru 0x016e17 (0xd589 bytes) 000913 1772470735.319990 trunc from 0x03ff1b to 0x0181d1 (0x27d49 bytes) 000914 1772470735.495845 mapread 0x00527e thru 0x008636 (0x33b9 bytes) 000916 1772470735.554828 mapwrite 0x028b32 thru 0x031e38 (0x9307 bytes) 000918 1772470735.683536 MIRROR_RESYNC 8 mirrors 000919 1772470737.295056 mapwrite 0x01ce42 thru 0x02a230 (0xd3ef bytes) 000920 1772470737.526399 mapread 0x029842 thru 0x031e38 (0x85f7 bytes) 000922 1772470737.541523 write 0x02d985 thru 0x036d45 (0x93c1 bytes) 000924 1772470737.545919 mapwrite 0x0278ed thru 0x03751e (0xfc32 bytes) 000927 1772470737.696949 write 0x036111 thru 0x037020 (0xf10 bytes) 000928 1772470737.698613 mapwrite 0x02057f thru 0x0208da (0x35c bytes) 000929 1772470737.768010 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3751f): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3751f): Mirror 17: 0xbc24a520 (stale) Mirror 20: 0xbc24a520 (stale) Mirror 22: 0xbc24a520 (stale) Mirror 27: 0xbc24a520 (stale) Mirror 28: 0xbc24a520 (stale) Mirror 29: 0xbc24a520 (stale) Mirror 30: 0xbc24a520 (stale) CRC-32 checksum value for chunk [0, 0x3751f): Mirror 1: 0xc2015e2b Mirror 31: 0xc2015e2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3751f: skipped 000930 1772470738.993097 write 0x02b42d thru 0x0362e9 (0xaebd bytes) 000932 1772470739.100851 mapread 0x007b52 thru 0x010fbf (0x946e bytes) 000933 1772470739.116636 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3751f): Mirror 20: 0xbc24a520 (stale) Mirror 22: 0xbc24a520 (stale) Mirror 27: 0xbc24a520 (stale) Mirror 28: 0xbc24a520 (stale) Mirror 29: 0xbc24a520 (stale) Mirror 30: 0xbc24a520 (stale) Mirror 31: 0xc2015e2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3751f): Mirror 20: 0xbc24a520 (stale) Mirror 22: 0xbc24a520 (stale) Mirror 27: 0xbc24a520 (stale) Mirror 28: 0xbc24a520 (stale) Mirror 29: 0xbc24a520 (stale) Mirror 30: 0xbc24a520 (stale) Mirror 31: 0xc2015e2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3751f: skipped 000934 1772470739.645718 write 0x018337 thru 0x023b40 (0xb80a bytes) 000935 1772470739.656988 read 0x02399a thru 0x0328f3 (0xef5a bytes) 000936 1772470739.670439 write 0x015015 thru 0x01ad15 (0x5d01 bytes) 000938 1772470739.679892 read 0x000967 thru 0x00e0f2 (0xd78c bytes) 000940 1772470739.703746 write 0x028e3e thru 0x02c2fb (0x34be bytes) 000941 1772470739.706679 read 0x033ef0 thru 0x036c15 (0x2d26 bytes) 000942 1772470739.708061 mapwrite 0x01a459 thru 0x01ec20 (0x47c8 bytes) 000944 1772470739.769880 read 0x036105 thru 0x03751e (0x141a bytes) 000947 1772470739.773883 read 0x0156ed thru 0x0200e5 (0xa9f9 bytes) 000948 1772470739.781782 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3751f): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3751f): Mirror 20: 0xbc24a520 (stale) Mirror 22: 0xbc24a520 (stale) Mirror 27: 0xbc24a520 (stale) Mirror 28: 0xbc24a520 (stale) Mirror 29: 0xbc24a520 (stale) Mirror 30: 0xbc24a520 (stale) Mirror 31: 0xc2015e2b (stale) CRC-32 checksum value for chunk [0, 0x3751f): Mirror 1: 0x16aa059 Mirror 32: 0x16aa059 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3751f: skipped 000949 1772470740.964537 MIRROR_RESYNC 9 mirrors 000951 1772470742.173712 read 0x00c247 thru 0x0176c7 (0xb481 bytes) 000952 1772470742.182780 trunc from 0x03751f to 0x01675b (0x20dc3 bytes) 000953 1772470742.266841 mapread 0x008796 thru 0x00af2b (0x2796 bytes) 000955 1772470742.292368 read 0x00665a thru 0x011cce (0xb675 bytes) 000958 1772470742.295544 mapread 0x00efa9 thru 0x01675b (0x77b3 bytes) 000959 1772470742.307238 trunc from 0x01675c to 0x022764 (0xc009 bytes) 000961 1772470742.337263 read 0x00a9c2 thru 0x00e398 (0x39d7 bytes) 000962 1772470742.338588 mapwrite 0x03e76d thru 0x03ffff (0x1893 bytes) 000965 1772470742.429930 mapwrite 0x029d34 thru 0x02ba83 (0x1d50 bytes) 000970 1772470742.479650 trunc from 0x040000 to 0x00bbf0 (0x3440f bytes) 000971 1772470742.502832 write 0x033fdb thru 0x03e76f (0xa795 bytes) 000972 1772470742.506312 mapwrite 0x03c00c thru 0x03ffff (0x3ff4 bytes) 000973 1772470742.601421 read 0x003b34 thru 0x006676 (0x2b43 bytes) 000975 1772470742.602876 mapwrite 0x0221a1 thru 0x02ecbb (0xcb1b bytes) 000978 1772470742.683163 mapwrite 0x03d993 thru 0x03ffff (0x266d bytes) 000979 1772470742.727981 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x22f87a9f (stale) Mirror 22: 0x22f87a9f (stale) Mirror 27: 0x22f87a9f (stale) Mirror 28: 0x22f87a9f (stale) Mirror 29: 0x22f87a9f (stale) Mirror 31: 0x22f87a9f (stale) Mirror 32: 0x22f87a9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x22f87a9f (stale) Mirror 22: 0x22f87a9f (stale) Mirror 27: 0x22f87a9f (stale) Mirror 28: 0x22f87a9f (stale) Mirror 29: 0x22f87a9f (stale) Mirror 31: 0x22f87a9f (stale) Mirror 32: 0x22f87a9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000984 1772470743.290306 trunc from 0x040000 to 0x01d8df (0x22720 bytes) 000985 1772470743.313179 mapread 0x00b6a3 thru 0x018818 (0xd176 bytes) 000987 1772470743.354753 mapwrite 0x00d3ad thru 0x016054 (0x8ca8 bytes) 000988 1772470743.426978 mapwrite 0x028bc1 thru 0x02d2f1 (0x4731 bytes) 000990 1772470743.508200 read 0x011921 thru 0x0161d6 (0x48b6 bytes) 000991 1772470743.508894 read 0x0237f3 thru 0x02582c (0x203a bytes) 000992 1772470743.509536 write 0x01943d thru 0x027fad (0xeb71 bytes) 000993 1772470743.513558 trunc from 0x02d2f2 to 0x02e5ff (0x130e bytes) 000994 1772470743.528292 read 0x01d297 thru 0x027dc9 (0xab33 bytes) 000996 1772470743.529647 trunc from 0x02e600 to 0x02f966 (0x1367 bytes) 000997 1772470743.543877 mapwrite 0x0282bc thru 0x02cd61 (0x4aa6 bytes) 000998 1772470743.604165 trunc from 0x02f967 to 0x00204f (0x2d917 bytes) 000999 1772470743.632298 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x177:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2050): Mirror 22: 0x710b34a1 (stale) Mirror 27: 0x710b34a1 (stale) Mirror 28: 0x710b34a1 (stale) Mirror 29: 0x710b34a1 (stale) Mirror 31: 0x710b34a1 (stale) Mirror 32: 0x710b34a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2050): Mirror 22: 0x710b34a1 (stale) Mirror 27: 0x710b34a1 (stale) Mirror 28: 0x710b34a1 (stale) Mirror 29: 0x710b34a1 (stale) Mirror 31: 0x710b34a1 (stale) Mirror 32: 0x710b34a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2050: skipped 001000 1772470744.071989 write 0x021c81 thru 0x02954e (0x78ce bytes) All operations completed A-OK!