== sanity-flr test 70a: flr mode fsx test ================ 05:39:40 (1765103980) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 3981 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1765103981.762512 mapwrite 0x01e552 thru 0x01fa21 (0x14d0 bytes) truncating to largest ever: 0x20677 000004 1765103981.860850 trunc from 0x01fa22 to 0x020676 (0xc55 bytes) 000006 1765103981.879322 write 0x0201ac thru 0x020977 (0x7cc bytes) truncating to largest ever: 0x37c15 000007 1765103981.886992 trunc from 0x020978 to 0x037c14 (0x1729d bytes) 000008 1765103981.904172 write 0x030c0f thru 0x0350b4 (0x44a6 bytes) 000010 1765103981.918967 trunc from 0x037c15 to 0x01196e (0x262a6 bytes) 000011 1765103981.938008 write 0x032b75 thru 0x034b23 (0x1faf bytes) 000012 1765103981.939078 mapread 0x01b838 thru 0x028de0 (0xd5a9 bytes) 000013 1765103981.961325 read 0x02e8fb thru 0x034b23 (0x6229 bytes) 000014 1765103981.966504 trunc from 0x034b24 to 0x00e96c (0x261b7 bytes) 000016 1765103981.984658 mapwrite 0x020711 thru 0x02c708 (0xbff8 bytes) 000018 1765103982.120686 mapwrite 0x00a6e9 thru 0x00d4b4 (0x2dcc bytes) 000019 1765103982.190624 mapwrite 0x038ec4 thru 0x03ea44 (0x5b81 bytes) 000021 1765103982.285548 trunc from 0x03ea45 to 0x016d56 (0x27cee bytes) 000023 1765103982.302025 trunc from 0x016d57 to 0x01bbd6 (0x4e80 bytes) 000026 1765103982.321576 write 0x03f912 thru 0x03ffff (0x6ee bytes) 000028 1765103982.322827 mapwrite 0x030de5 thru 0x033997 (0x2bb3 bytes) 000029 1765103982.377813 trunc from 0x040000 to 0x0159c2 (0x2a63d bytes) 000030 1765103982.397213 read 0x005eed thru 0x010100 (0xa214 bytes) 000034 1765103982.398978 mapread 0x00aace thru 0x00f553 (0x4a86 bytes) 000036 1765103982.411392 MIRROR_EXTEND to 2 mirrors 000039 1765103982.975130 MIRROR_EXTEND to 3 mirrors 000040 1765103983.556071 read 0x0159b9 thru 0x0159c2 (0xa bytes) truncating to largest ever: 0x391ed 000043 1765103983.586049 trunc from 0x0159c3 to 0x0391ec (0x2382a bytes) 000045 1765103983.659061 trunc from 0x0391ed to 0x01e3ee (0x1adfe bytes) 000046 1765103983.693112 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e3ef): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e3ef): Mirror 2: 0xd0e5497e (stale) Mirror 3: 0xd0e5497e (stale) CRC-32 checksum value for chunk [0, 0x1e3ef): Mirror 1: 0xd0e5497e Mirror 4: 0xd0e5497e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e3ef: skipped 000047 1765103984.449888 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e3ef): Mirror 3: 0xd0e5497e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e3ef): Mirror 3: 0xd0e5497e (stale) CRC-32 checksum value for chunk [0, 0x1e3ef): Mirror 1: 0xd0e5497e Mirror 4: 0xd0e5497e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e3ef: skipped 000049 1765103984.974389 write 0x0394ad thru 0x03ffff (0x6b53 bytes) 000050 1765103985.071315 mapwrite 0x030620 thru 0x037f2f (0x7910 bytes) 000052 1765103985.172877 read 0x01fab0 thru 0x02387c (0x3dcd bytes) 000053 1765103985.188513 mapread 0x02ba34 thru 0x03a6de (0xecab bytes) 000057 1765103985.190937 mapwrite 0x03e384 thru 0x03ffff (0x1c7c bytes) 000058 1765103985.232121 mapread 0x0334d1 thru 0x03e135 (0xac65 bytes) 000059 1765103985.233199 trunc from 0x040000 to 0x00e0d4 (0x31f2b bytes) 000062 1765103985.261642 trunc from 0x00e0d5 to 0x02ea5a (0x20986 bytes) 000064 1765103985.293818 write 0x0050e0 thru 0x00852a (0x344b bytes) 000065 1765103985.309459 trunc from 0x02ea5b to 0x00bc45 (0x22e15 bytes) 000069 1765103985.334493 read 0x00906a thru 0x009790 (0x727 bytes) 000071 1765103985.335564 write 0x00466d thru 0x0083d1 (0x3d65 bytes) 000072 1765103985.338058 mapwrite 0x02fd94 thru 0x03235d (0x25ca bytes) 000073 1765103985.412924 mapread 0x031acb thru 0x03235d (0x893 bytes) 000074 1765103985.414256 mapwrite 0x0046ba thru 0x00cfa6 (0x88ed bytes) 000075 1765103985.458211 read 0x031e06 thru 0x03235d (0x558 bytes) 000076 1765103985.458829 trunc from 0x03235e to 0x01734a (0x1b013 bytes) 000081 1765103985.478577 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1734b): Mirror 4: 0x98393c87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1734b): Mirror 4: 0x98393c87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1734b: skipped 000083 1765103985.762969 mapread 0x00cf40 thru 0x015cd8 (0x8d99 bytes) 000086 1765103985.786365 write 0x008717 thru 0x0160e7 (0xd9d1 bytes) 000087 1765103985.793725 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1734b): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1734b): Mirror 4: 0x98393c87 (stale) CRC-32 checksum value for chunk [0, 0x1734b): Mirror 1: 0x11b7248c Mirror 5: 0x11b7248c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1734b: skipped 000088 1765103986.459633 write 0x023189 thru 0x0254fb (0x2373 bytes) 000090 1765103986.530451 read 0x003e27 thru 0x00811b (0x42f5 bytes) 000091 1765103986.541938 mapread 0x00cca1 thru 0x014e51 (0x81b1 bytes) 000092 1765103986.570624 trunc from 0x0254fc to 0x01782d (0xdcce bytes) 000093 1765103986.592291 mapread 0x01455e thru 0x01721c (0x2cbf bytes) 000096 1765103986.607638 write 0x0283fc thru 0x034577 (0xc17c bytes) 000097 1765103986.608890 trunc from 0x034578 to 0x016c2f (0x1d948 bytes) 000098 1765103986.631935 mapwrite 0x00216f thru 0x004b12 (0x29a4 bytes) 000099 1765103986.687309 trunc from 0x016c30 to 0x02c4bf (0x15890 bytes) 000101 1765103986.711343 trunc from 0x02c4c0 to 0x02839e (0x4121 bytes) 000106 1765103986.744756 trunc from 0x02839f to 0x021586 (0x6e18 bytes) 000107 1765103986.763670 mapwrite 0x033f48 thru 0x03ffff (0xc0b8 bytes) 000112 1765103986.855935 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcf7ac460 (stale) Mirror 5: 0x66995953 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8127406 Mirror 6: 0x8127406 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000113 1765103987.577599 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcf7ac460 (stale) Mirror 5: 0x66995953 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8127406 Mirror 6: 0x8127406 Mirror 7: 0x8127406 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000114 1765103988.236627 MIRROR_RESYNC 5 mirrors 000115 1765103988.873108 trunc from 0x040000 to 0x0135c4 (0x2ca3b bytes) 000118 1765103988.946105 write 0x0346a1 thru 0x03ffff (0xb95f bytes) 000120 1765103988.947961 write 0x01b0a3 thru 0x0282fc (0xd25a bytes) 000121 1765103988.959268 write 0x02925d thru 0x02aab2 (0x1856 bytes) 000122 1765103988.967782 mapread 0x019605 thru 0x026057 (0xca53 bytes) 000124 1765103988.975865 write 0x01455a thru 0x01b623 (0x70ca bytes) 000125 1765103988.977969 mapwrite 0x0260a9 thru 0x035636 (0xf58e bytes) 000127 1765103989.038338 trunc from 0x040000 to 0x0251b0 (0x1ae4f bytes) 000129 1765103989.062778 trunc from 0x0251b1 to 0x02efa3 (0x9df3 bytes) 000131 1765103989.082304 write 0x012767 thru 0x01fbb2 (0xd44c bytes) 000132 1765103989.084075 read 0x022d61 thru 0x02efa3 (0xc243 bytes) 000134 1765103989.100645 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2efa4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efa4): Mirror 4: 0x42b2a7e5 (stale) Mirror 5: 0x42b2a7e5 (stale) Mirror 6: 0x42b2a7e5 (stale) Mirror 7: 0x42b2a7e5 (stale) CRC-32 checksum value for chunk [0, 0x2efa4): Mirror 1: 0x967c62b5 Mirror 8: 0x967c62b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efa4: skipped 000135 1765103989.676338 write 0x01b449 thru 0x023d30 (0x88e8 bytes) 000138 1765103989.743946 mapread 0x0240c7 thru 0x02aee2 (0x6e1c bytes) 000141 1765103989.756084 read 0x01be0d thru 0x0233b9 (0x75ad bytes) 000142 1765103989.756720 write 0x01e7fa thru 0x024e11 (0x6618 bytes) 000143 1765103989.757714 mapread 0x01637e thru 0x01ae97 (0x4b1a bytes) 000144 1765103989.774502 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2efa4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efa4): Mirror 4: 0x42b2a7e5 (stale) Mirror 5: 0x42b2a7e5 (stale) Mirror 6: 0x42b2a7e5 (stale) Mirror 7: 0x42b2a7e5 (stale) Mirror 8: 0x967c62b5 (stale) CRC-32 checksum value for chunk [0, 0x2efa4): Mirror 1: 0x6442cc75 Mirror 9: 0x6442cc75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efa4: skipped 000145 1765103990.453949 mapwrite 0x023c9a thru 0x03040a (0xc771 bytes) 000146 1765103990.596236 MIRROR_RESYNC 7 mirrors 000147 1765103991.639208 read 0x02558e thru 0x02f021 (0x9a94 bytes) 000149 1765103991.658300 trunc from 0x03040b to 0x02c087 (0x4383 bytes) 000150 1765103991.752838 read 0x01fe78 thru 0x0218ac (0x1a35 bytes) 000151 1765103991.768631 mapwrite 0x00773f thru 0x014abe (0xd380 bytes) 000154 1765103991.834309 read 0x01d37e thru 0x02b7d7 (0xe45a bytes) truncating to largest ever: 0x3d7ea 000155 1765103991.835489 trunc from 0x02c088 to 0x03d7e9 (0x11762 bytes) 000157 1765103991.871887 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 4: 0x243372af (stale) Mirror 5: 0x243372af (stale) Mirror 6: 0x243372af (stale) Mirror 7: 0x243372af (stale) Mirror 8: 0x243372af (stale) Mirror 9: 0x243372af (stale) CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 1: 0x827a5c8c Mirror 10: 0x827a5c8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7ea: skipped 000160 1765103992.617021 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 4: 0x243372af (stale) Mirror 5: 0x243372af (stale) Mirror 6: 0x243372af (stale) Mirror 7: 0x243372af (stale) Mirror 8: 0x243372af (stale) Mirror 9: 0x243372af (stale) CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 1: 0x827a5c8c Mirror 10: 0x827a5c8c Mirror 11: 0x827a5c8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7ea: skipped 000163 1765103993.427806 trunc from 0x03d7ea to 0x004bb0 (0x38c39 bytes) 000164 1765103993.497272 MIRROR_RESYNC 9 mirrors 000166 1765103994.757197 MIRROR_RESYNC 9 mirrors 000168 1765103995.165165 mapwrite 0x002134 thru 0x00e819 (0xc6e6 bytes) 000170 1765103995.333610 trunc from 0x00e81a to 0x0126db (0x3ec2 bytes) 000172 1765103995.369217 mapwrite 0x03bb85 thru 0x03beba (0x336 bytes) 000173 1765103995.441046 write 0x03bdd8 thru 0x03ffff (0x4228 bytes) 000174 1765103995.442064 read 0x005fc4 thru 0x01221f (0xc25c bytes) 000175 1765103995.448138 read 0x010e89 thru 0x019138 (0x82b0 bytes) 000176 1765103995.462213 read 0x03377e thru 0x03fe00 (0xc683 bytes) 000177 1765103995.462834 mapwrite 0x03dddc thru 0x03ffff (0x2224 bytes) 000180 1765103995.514008 read 0x0211a6 thru 0x026dce (0x5c29 bytes) 000181 1765103995.527590 read 0x013cca thru 0x018b4a (0x4e81 bytes) 000182 1765103995.534490 MIRROR_RESYNC 9 mirrors 000184 1765103996.699991 write 0x02fbb0 thru 0x0393c8 (0x9819 bytes) 000186 1765103996.764162 mapwrite 0x038c62 thru 0x03ffff (0x739e bytes) 000188 1765103996.833935 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb8a3a2b4 (stale) Mirror 6: 0xb8a3a2b4 (stale) Mirror 7: 0xb8a3a2b4 (stale) Mirror 8: 0xb8a3a2b4 (stale) Mirror 9: 0xb8a3a2b4 (stale) Mirror 10: 0xb8a3a2b4 (stale) Mirror 11: 0xb8a3a2b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb8a3a2b4 (stale) Mirror 6: 0xb8a3a2b4 (stale) Mirror 7: 0xb8a3a2b4 (stale) Mirror 8: 0xb8a3a2b4 (stale) Mirror 9: 0xb8a3a2b4 (stale) Mirror 10: 0xb8a3a2b4 (stale) Mirror 11: 0xb8a3a2b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000189 1765103997.258142 read 0x0352c6 thru 0x03ffff (0xad3a bytes) 000194 1765103997.268619 write 0x01990c thru 0x022fd1 (0x96c6 bytes) 000196 1765103997.284436 write 0x00e6fd thru 0x01beef (0xd7f3 bytes) 000197 1765103997.295403 mapread 0x0030ec thru 0x0037b3 (0x6c8 bytes) 000199 1765103997.314503 MIRROR_RESYNC 8 mirrors 000200 1765103998.286034 write 0x020e1f thru 0x02f259 (0xe43b bytes) 000201 1765103998.356328 mapwrite 0x001d88 thru 0x008d8a (0x7003 bytes) 000202 1765103998.413086 trunc from 0x040000 to 0x025abe (0x1a541 bytes) 000204 1765103998.457317 MIRROR_RESYNC 8 mirrors 000209 1765103999.457340 write 0x033aa3 thru 0x037d15 (0x4273 bytes) 000211 1765103999.497804 write 0x032eb0 thru 0x03ffff (0xd150 bytes) 000212 1765103999.501997 write 0x03e312 thru 0x03ffff (0x1cee bytes) 000214 1765103999.503171 read 0x005130 thru 0x0142c9 (0xf19a bytes) 000215 1765103999.513424 mapread 0x0071f2 thru 0x012127 (0xaf36 bytes) 000217 1765103999.514704 mapread 0x000eac thru 0x00176b (0x8c0 bytes) 000221 1765103999.525360 trunc from 0x040000 to 0x03d184 (0x2e7b bytes) 000222 1765103999.548052 mapwrite 0x014f2a thru 0x0213ed (0xc4c4 bytes) 000223 1765103999.628996 trunc from 0x03d185 to 0x037251 (0x5f33 bytes) 000226 1765103999.649442 write 0x0201e9 thru 0x02b3f4 (0xb20c bytes) 000227 1765103999.667882 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x37252): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37252): Mirror 5: 0x7a556da6 (stale) Mirror 6: 0x7a556da6 (stale) Mirror 7: 0x7a556da6 (stale) Mirror 8: 0x7a556da6 (stale) Mirror 9: 0x7a556da6 (stale) Mirror 10: 0x7a556da6 (stale) Mirror 11: 0x7a556da6 (stale) CRC-32 checksum value for chunk [0, 0x37252): Mirror 1: 0xd2686eb3 Mirror 12: 0xd2686eb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37252: skipped 000228 1765104000.314504 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37252): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37252): Mirror 5: 0x7a556da6 (stale) Mirror 6: 0x7a556da6 (stale) Mirror 7: 0x7a556da6 (stale) Mirror 8: 0x7a556da6 (stale) Mirror 9: 0x7a556da6 (stale) Mirror 10: 0x7a556da6 (stale) Mirror 11: 0x7a556da6 (stale) CRC-32 checksum value for chunk [0, 0x37252): Mirror 1: 0xd2686eb3 Mirror 12: 0xd2686eb3 Mirror 13: 0xd2686eb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37252: skipped 000231 1765104001.126649 mapwrite 0x0132b8 thru 0x01d5a3 (0xa2ec bytes) 000232 1765104001.325652 write 0x000993 thru 0x00c857 (0xbec5 bytes) 000233 1765104001.332292 mapread 0x027636 thru 0x028f33 (0x18fe bytes) 000236 1765104001.346784 MIRROR_RESYNC 10 mirrors 000237 1765104002.601128 read 0x01ace5 thru 0x02582d (0xab49 bytes) 000238 1765104002.610998 trunc from 0x037252 to 0x00bbf7 (0x2b65a bytes) 000240 1765104002.704805 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xbbf8): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbbf8): Mirror 5: 0x6ca3fc4 (stale) Mirror 6: 0x6ca3fc4 (stale) Mirror 7: 0x6ca3fc4 (stale) Mirror 8: 0x6ca3fc4 (stale) Mirror 9: 0x6ca3fc4 (stale) Mirror 10: 0x6ca3fc4 (stale) Mirror 11: 0x6ca3fc4 (stale) Mirror 12: 0x6ca3fc4 (stale) Mirror 13: 0x6ca3fc4 (stale) CRC-32 checksum value for chunk [0, 0xbbf8): Mirror 1: 0x6ca3fc4 Mirror 14: 0x6ca3fc4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbbf8: skipped 000242 1765104003.522811 read 0x006c16 thru 0x007dc7 (0x11b2 bytes) 000243 1765104003.536883 trunc from 0x00bbf8 to 0x00f474 (0x387d bytes) 000244 1765104003.610845 MIRROR_RESYNC 11 mirrors 000245 1765104004.999415 mapwrite 0x02d02c thru 0x03443c (0x7411 bytes) 000246 1765104005.162822 MIRROR_RESYNC 11 mirrors 000248 1765104006.342470 write 0x01891f thru 0x01c8e9 (0x3fcb bytes) 000251 1765104006.420718 mapwrite 0x0305a2 thru 0x0324c8 (0x1f27 bytes) 000254 1765104006.477782 read 0x023116 thru 0x02cf3e (0x9e29 bytes) 000255 1765104006.489732 write 0x016f6c thru 0x01ab6e (0x3c03 bytes) 000256 1765104006.502771 write 0x00ea9a thru 0x01b80e (0xcd75 bytes) 000257 1765104006.516763 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3443d): Mirror 6: 0xaa2a482c (stale) Mirror 7: 0xaa2a482c (stale) Mirror 8: 0xaa2a482c (stale) Mirror 9: 0xaa2a482c (stale) Mirror 10: 0xaa2a482c (stale) Mirror 11: 0xaa2a482c (stale) Mirror 12: 0xaa2a482c (stale) Mirror 13: 0xaa2a482c (stale) Mirror 14: 0xaa2a482c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3443d): Mirror 6: 0xaa2a482c (stale) Mirror 7: 0xaa2a482c (stale) Mirror 8: 0xaa2a482c (stale) Mirror 9: 0xaa2a482c (stale) Mirror 10: 0xaa2a482c (stale) Mirror 11: 0xaa2a482c (stale) Mirror 12: 0xaa2a482c (stale) Mirror 13: 0xaa2a482c (stale) Mirror 14: 0xaa2a482c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3443d: skipped 000259 1765104006.961599 mapread 0x03365e thru 0x03443c (0xddf bytes) 000260 1765104006.975208 trunc from 0x03443d to 0x014039 (0x20403 bytes) 000262 1765104007.001857 mapwrite 0x01aa64 thru 0x026007 (0xb5a4 bytes) 000263 1765104007.082032 trunc from 0x026008 to 0x030d41 (0xad3a bytes) 000264 1765104007.101848 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x30d42): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d42): Mirror 6: 0x8337eb0c (stale) Mirror 7: 0x8337eb0c (stale) Mirror 8: 0x8337eb0c (stale) Mirror 9: 0x8337eb0c (stale) Mirror 10: 0x8337eb0c (stale) Mirror 11: 0x8337eb0c (stale) Mirror 12: 0x8337eb0c (stale) Mirror 13: 0x8337eb0c (stale) Mirror 14: 0x8337eb0c (stale) CRC-32 checksum value for chunk [0, 0x30d42): Mirror 1: 0x1252ff9d Mirror 15: 0x1252ff9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d42: skipped 000265 1765104007.946190 trunc from 0x030d42 to 0x033636 (0x28f5 bytes) 000267 1765104008.023165 mapwrite 0x02b72d thru 0x02c4bd (0xd91 bytes) 000273 1765104008.088679 trunc from 0x033637 to 0x01ed28 (0x1490e bytes) 000274 1765104008.110976 trunc from 0x01ed29 to 0x014f58 (0x9dd0 bytes) 000275 1765104008.130481 MIRROR_RESYNC 11 mirrors 000276 1765104009.549628 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) 000277 1765104009.991482 trunc from 0x014f59 to 0x02582d (0x108d5 bytes) 000278 1765104010.119973 trunc from 0x02582e to 0x01f3b7 (0x6476 bytes) 000279 1765104010.162046 write 0x03974b thru 0x03b557 (0x1e0d bytes) 000280 1765104010.163268 write 0x02292d thru 0x02e60c (0xbce0 bytes) 000285 1765104010.178800 trunc from 0x03b558 to 0x02bd1b (0xf83c bytes) 000287 1765104010.198236 mapwrite 0x0245c6 thru 0x02d050 (0x8a8b bytes) 000288 1765104010.270781 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2d051): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d051): Mirror 6: 0xc15aa2d6 (stale) Mirror 7: 0xc15aa2d6 (stale) Mirror 8: 0xc15aa2d6 (stale) Mirror 9: 0xc15aa2d6 (stale) Mirror 10: 0xc15aa2d6 (stale) Mirror 11: 0xc15aa2d6 (stale) Mirror 12: 0xc15aa2d6 (stale) Mirror 14: 0xc15aa2d6 (stale) Mirror 15: 0xc15aa2d6 (stale) CRC-32 checksum value for chunk [0, 0x2d051): Mirror 1: 0xc22f0abb Mirror 16: 0xc22f0abb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d051: skipped 000289 1765104011.099164 MIRROR_RESYNC 11 mirrors 000292 1765104012.515710 write 0x0284a9 thru 0x03178f (0x92e7 bytes) 000295 1765104012.595615 read 0x00ba10 thru 0x0129a3 (0x6f94 bytes) 000297 1765104012.605494 write 0x016012 thru 0x019d1b (0x3d0a bytes) 000299 1765104012.621042 mapwrite 0x03f8b0 thru 0x03ffff (0x750 bytes) 000300 1765104012.717507 mapread 0x029c97 thru 0x0306af (0x6a19 bytes) 000302 1765104012.726170 MIRROR_RESYNC 11 mirrors 000303 1765104014.131860 mapread 0x02eca7 thru 0x0310d9 (0x2433 bytes) 000304 1765104014.150349 trunc from 0x040000 to 0x025362 (0x1ac9d bytes) 000305 1765104014.219202 mapwrite 0x01166f thru 0x01ee04 (0xd796 bytes) 000306 1765104014.280876 mapread 0x0176e3 thru 0x02217a (0xaa98 bytes) 000307 1765104014.281976 read 0x013407 thru 0x01ff8f (0xcb89 bytes) 000310 1765104014.283286 read 0x01644a thru 0x025362 (0xef19 bytes) 000312 1765104014.303726 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25363): Mirror 6: 0x85578f78 (stale) Mirror 7: 0x85578f78 (stale) Mirror 8: 0x85578f78 (stale) Mirror 9: 0x85578f78 (stale) Mirror 10: 0x85578f78 (stale) Mirror 11: 0x85578f78 (stale) Mirror 12: 0x85578f78 (stale) Mirror 14: 0x85578f78 (stale) Mirror 16: 0x85578f78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25363): Mirror 6: 0x85578f78 (stale) Mirror 7: 0x85578f78 (stale) Mirror 8: 0x85578f78 (stale) Mirror 9: 0x85578f78 (stale) Mirror 10: 0x85578f78 (stale) Mirror 11: 0x85578f78 (stale) Mirror 12: 0x85578f78 (stale) Mirror 14: 0x85578f78 (stale) Mirror 16: 0x85578f78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25363: skipped 000314 1765104014.780713 mapread 0x013151 thru 0x0177c0 (0x4670 bytes) 000317 1765104014.803638 read 0x0232e5 thru 0x025362 (0x207e bytes) 000320 1765104014.810942 mapread 0x0067b4 thru 0x00aafd (0x434a bytes) 000322 1765104014.830598 write 0x00c9e9 thru 0x016905 (0x9f1d bytes) 000323 1765104014.831931 read 0x010a14 thru 0x01448d (0x3a7a bytes) 000324 1765104014.832483 trunc from 0x025363 to 0x03b7e7 (0x16485 bytes) 000325 1765104014.858596 write 0x0327ab thru 0x035be7 (0x343d bytes) 000327 1765104014.869038 mapwrite 0x000359 thru 0x00edb6 (0xea5e bytes) 000328 1765104014.924427 mapread 0x0067c2 thru 0x00a6a6 (0x3ee5 bytes) 000329 1765104014.925956 write 0x0005f2 thru 0x00733d (0x6d4c bytes) 000330 1765104014.928477 trunc from 0x03b7e8 to 0x02002f (0x1b7b8 bytes) 000332 1765104014.944430 write 0x020db7 thru 0x027234 (0x647e bytes) 000333 1765104014.945831 mapwrite 0x034bf4 thru 0x03dd82 (0x918f bytes) 000334 1765104015.103975 write 0x025666 thru 0x0328da (0xd275 bytes) 000335 1765104015.114516 mapread 0x02bffc thru 0x03a1d3 (0xe1d8 bytes) 000339 1765104015.128346 mapwrite 0x016ecf thru 0x01ed6c (0x7e9e bytes) 000341 1765104015.198016 mapwrite 0x0035db thru 0x00af85 (0x79ab bytes) 000342 1765104015.282592 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: 0x71cac79d (stale) Mirror 7: 0x71cac79d (stale) Mirror 8: 0x71cac79d (stale) Mirror 9: 0x71cac79d (stale) Mirror 10: 0x71cac79d (stale) Mirror 12: 0x71cac79d (stale) Mirror 14: 0x71cac79d (stale) Mirror 16: 0x71cac79d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: 0x71cac79d (stale) Mirror 7: 0x71cac79d (stale) Mirror 8: 0x71cac79d (stale) Mirror 9: 0x71cac79d (stale) Mirror 10: 0x71cac79d (stale) Mirror 12: 0x71cac79d (stale) Mirror 14: 0x71cac79d (stale) Mirror 16: 0x71cac79d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd83: skipped 000348 1765104015.800217 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: 0x71cac79d (stale) Mirror 7: 0x71cac79d (stale) Mirror 8: 0x71cac79d (stale) Mirror 9: 0x71cac79d (stale) Mirror 10: 0x71cac79d (stale) Mirror 12: 0x71cac79d (stale) Mirror 14: 0x71cac79d (stale) Mirror 16: 0x71cac79d (stale) CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 1: 0x1b777176 Mirror 17: 0x1b777176 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd83: skipped 000350 1765104016.742327 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: 0x71cac79d (stale) Mirror 7: 0x71cac79d (stale) Mirror 8: 0x71cac79d (stale) Mirror 9: 0x71cac79d (stale) Mirror 12: 0x71cac79d (stale) Mirror 14: 0x71cac79d (stale) Mirror 16: 0x71cac79d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: 0x71cac79d (stale) Mirror 7: 0x71cac79d (stale) Mirror 8: 0x71cac79d (stale) Mirror 9: 0x71cac79d (stale) Mirror 12: 0x71cac79d (stale) Mirror 14: 0x71cac79d (stale) Mirror 16: 0x71cac79d (stale) CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 1: 0x1b777176 Mirror 17: 0x1b777176 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd83: skipped 000356 1765104017.761116 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 6: 0x71cac79d (stale) Mirror 7: 0x71cac79d (stale) Mirror 8: 0x71cac79d (stale) Mirror 9: 0x71cac79d (stale) Mirror 12: 0x71cac79d (stale) Mirror 14: 0x71cac79d (stale) Mirror 16: 0x71cac79d (stale) CRC-32 checksum value for chunk [0, 0x3dd83): Mirror 1: 0x1b777176 Mirror 17: 0x1b777176 Mirror 18: 0x1b777176 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd83: skipped 000359 1765104018.655807 write 0x011499 thru 0x01668a (0x51f2 bytes) 000360 1765104018.751077 write 0x00f4ed thru 0x017e7b (0x898f bytes) 000361 1765104018.766780 mapwrite 0x00e94b thru 0x010007 (0x16bd bytes) 000362 1765104018.826819 mapread 0x01af66 thru 0x026cbd (0xbd58 bytes) 000363 1765104018.848480 mapread 0x013d69 thru 0x01b15a (0x73f2 bytes) 000364 1765104018.849574 mapread 0x02068a thru 0x021830 (0x11a7 bytes) 000366 1765104018.856998 MIRROR_RESYNC 10 mirrors 000367 1765104020.136916 read 0x0038da thru 0x009547 (0x5c6e bytes) 000368 1765104020.153112 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) 000369 1765104020.536289 MIRROR_EXTEND to 10 mirrors 000370 1765104021.180424 trunc from 0x03dd83 to 0x01426f (0x29b13 bytes) 000371 1765104021.280032 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x14270): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14270): Mirror 6: 0x37b0da52 (stale) Mirror 7: 0x37b0da52 (stale) Mirror 8: 0x37b0da52 (stale) Mirror 9: 0x37b0da52 (stale) Mirror 12: 0x37b0da52 (stale) Mirror 14: 0x37b0da52 (stale) Mirror 16: 0x37b0da52 (stale) Mirror 17: 0x37b0da52 (stale) Mirror 18: 0x37b0da52 (stale) CRC-32 checksum value for chunk [0, 0x14270): Mirror 1: 0x37b0da52 Mirror 19: 0x37b0da52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14270: skipped 000372 1765104022.156337 mapread 0x01289d thru 0x01426f (0x19d3 bytes) 000373 1765104022.195804 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14270): Mirror 6: 0x37b0da52 (stale) Mirror 7: 0x37b0da52 (stale) Mirror 8: 0x37b0da52 (stale) Mirror 9: 0x37b0da52 (stale) Mirror 12: 0x37b0da52 (stale) Mirror 14: 0x37b0da52 (stale) Mirror 17: 0x37b0da52 (stale) Mirror 18: 0x37b0da52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14270): Mirror 6: 0x37b0da52 (stale) Mirror 7: 0x37b0da52 (stale) Mirror 8: 0x37b0da52 (stale) Mirror 9: 0x37b0da52 (stale) Mirror 12: 0x37b0da52 (stale) Mirror 14: 0x37b0da52 (stale) Mirror 17: 0x37b0da52 (stale) Mirror 18: 0x37b0da52 (stale) CRC-32 checksum value for chunk [0, 0x14270): Mirror 1: 0x37b0da52 Mirror 19: 0x37b0da52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14270: skipped 000374 1765104023.204768 mapread 0x00f087 thru 0x01426f (0x51e9 bytes) 000376 1765104023.277353 mapread 0x00913c thru 0x013a7e (0xa943 bytes) 000378 1765104023.344095 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x14270): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14270): Mirror 6: 0x37b0da52 (stale) Mirror 7: 0x37b0da52 (stale) Mirror 8: 0x37b0da52 (stale) Mirror 9: 0x37b0da52 (stale) Mirror 12: 0x37b0da52 (stale) Mirror 14: 0x37b0da52 (stale) Mirror 17: 0x37b0da52 (stale) Mirror 18: 0x37b0da52 (stale) CRC-32 checksum value for chunk [0, 0x14270): Mirror 1: 0x37b0da52 Mirror 19: 0x37b0da52 Mirror 20: 0x37b0da52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14270: skipped 000380 1765104024.242930 trunc from 0x014270 to 0x02aeb3 (0x16c44 bytes) 000382 1765104024.336380 mapread 0x016f04 thru 0x02578d (0xe88a bytes) 000384 1765104024.371196 trunc from 0x02aeb4 to 0x023004 (0x7eaf bytes) 000385 1765104024.398572 mapwrite 0x00efba thru 0x0114c7 (0x250e bytes) 000387 1765104024.455441 trunc from 0x023005 to 0x00e217 (0x14ded bytes) 000388 1765104024.489964 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xe218): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe218): Mirror 6: 0xb9ce3f69 (stale) Mirror 7: 0xb9ce3f69 (stale) Mirror 8: 0xb9ce3f69 (stale) Mirror 9: 0xb9ce3f69 (stale) Mirror 12: 0xb9ce3f69 (stale) Mirror 14: 0xb9ce3f69 (stale) Mirror 17: 0xb9ce3f69 (stale) Mirror 18: 0xb9ce3f69 (stale) Mirror 19: 0xb9ce3f69 (stale) Mirror 20: 0xb9ce3f69 (stale) CRC-32 checksum value for chunk [0, 0xe218): Mirror 1: 0xb9ce3f69 Mirror 21: 0xb9ce3f69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe218: skipped 000389 1765104025.414266 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xe218): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe218): Mirror 6: 0xb9ce3f69 (stale) Mirror 7: 0xb9ce3f69 (stale) Mirror 8: 0xb9ce3f69 (stale) Mirror 9: 0xb9ce3f69 (stale) Mirror 12: 0xb9ce3f69 (stale) Mirror 14: 0xb9ce3f69 (stale) Mirror 17: 0xb9ce3f69 (stale) Mirror 18: 0xb9ce3f69 (stale) Mirror 19: 0xb9ce3f69 (stale) Mirror 20: 0xb9ce3f69 (stale) CRC-32 checksum value for chunk [0, 0xe218): Mirror 1: 0xb9ce3f69 Mirror 21: 0xb9ce3f69 Mirror 22: 0xb9ce3f69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe218: skipped 000390 1765104026.348809 trunc from 0x00e218 to 0x03a17c (0x2bf65 bytes) 000392 1765104026.450394 trunc from 0x03a17d to 0x03ab66 (0x9ea bytes) 000394 1765104026.482907 mapwrite 0x029525 thru 0x02e35d (0x4e39 bytes) 000396 1765104026.632027 write 0x01f9c2 thru 0x02a216 (0xa855 bytes) 000397 1765104026.641114 mapread 0x00703c thru 0x01501d (0xdfe2 bytes) 000399 1765104026.658469 read 0x023310 thru 0x027c3f (0x4930 bytes) 000400 1765104026.659611 mapread 0x02184f thru 0x0261e6 (0x4998 bytes) 000402 1765104026.661402 mapwrite 0x0061f9 thru 0x011182 (0xaf8a bytes) 000404 1765104026.748870 write 0x03d174 thru 0x03ffff (0x2e8c bytes) 000405 1765104026.750924 read 0x01d805 thru 0x02d3ac (0xfba8 bytes) 000407 1765104026.759992 MIRROR_RESYNC 13 mirrors 000408 1765104028.718173 mapwrite 0x0142ae thru 0x01c280 (0x7fd3 bytes) 000409 1765104028.933220 mapread 0x02933b thru 0x0382c9 (0xef8f bytes) 000410 1765104028.971198 read 0x026a1a thru 0x0338df (0xcec6 bytes) 000413 1765104028.972876 trunc from 0x040000 to 0x0187e3 (0x2781c bytes) 000414 1765104029.007628 read 0x0127c9 thru 0x014bee (0x2426 bytes) 000416 1765104029.008828 trunc from 0x0187e4 to 0x00451e (0x142c5 bytes) 000420 1765104029.026512 read 0x002461 thru 0x00451e (0x20be bytes) 000422 1765104029.036550 mapwrite 0x0095af thru 0x00adf2 (0x1844 bytes) 000424 1765104029.106275 mapwrite 0x022223 thru 0x0293f2 (0x71d0 bytes) 000425 1765104029.291433 trunc from 0x0293f3 to 0x027c7b (0x1777 bytes) 000428 1765104029.314707 mapread 0x01f2f6 thru 0x024adc (0x57e7 bytes) 000429 1765104029.315633 write 0x00260a thru 0x01027f (0xdc76 bytes) 000430 1765104029.317372 mapwrite 0x03a5fc thru 0x03ffff (0x5a04 bytes) 000431 1765104029.410697 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x62a403a6 (stale) Mirror 7: 0x62a403a6 (stale) Mirror 8: 0x62a403a6 (stale) Mirror 9: 0x62a403a6 (stale) Mirror 12: 0x62a403a6 (stale) Mirror 14: 0x62a403a6 (stale) Mirror 17: 0x62a403a6 (stale) Mirror 18: 0x62a403a6 (stale) Mirror 19: 0x62a403a6 (stale) Mirror 21: 0x62a403a6 (stale) Mirror 22: 0x62a403a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x62a403a6 (stale) Mirror 7: 0x62a403a6 (stale) Mirror 8: 0x62a403a6 (stale) Mirror 9: 0x62a403a6 (stale) Mirror 12: 0x62a403a6 (stale) Mirror 14: 0x62a403a6 (stale) Mirror 17: 0x62a403a6 (stale) Mirror 18: 0x62a403a6 (stale) Mirror 19: 0x62a403a6 (stale) Mirror 21: 0x62a403a6 (stale) Mirror 22: 0x62a403a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000432 1765104030.082784 read 0x03531c thru 0x03d6ed (0x83d2 bytes) 000434 1765104030.093159 read 0x009bfc thru 0x018efd (0xf302 bytes) 000435 1765104030.109580 mapread 0x037532 thru 0x03ffff (0x8ace bytes) 000436 1765104030.120614 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x62a403a6 (stale) Mirror 7: 0x62a403a6 (stale) Mirror 8: 0x62a403a6 (stale) Mirror 9: 0x62a403a6 (stale) Mirror 12: 0x62a403a6 (stale) Mirror 14: 0x62a403a6 (stale) Mirror 17: 0x62a403a6 (stale) Mirror 18: 0x62a403a6 (stale) Mirror 19: 0x62a403a6 (stale) Mirror 21: 0x62a403a6 (stale) Mirror 22: 0x62a403a6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc81a9dc Mirror 23: 0xc81a9dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000437 1765104031.217634 trunc from 0x040000 to 0x00fc2c (0x303d3 bytes) 000439 1765104031.323267 mapread 0x009dee thru 0x00e600 (0x4813 bytes) 000441 1765104031.349993 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfc2d): Mirror 6: 0xe70ce2c0 (stale) Mirror 7: 0xe70ce2c0 (stale) Mirror 8: 0xe70ce2c0 (stale) Mirror 9: 0xe70ce2c0 (stale) Mirror 12: 0xe70ce2c0 (stale) Mirror 14: 0xe70ce2c0 (stale) Mirror 17: 0xe70ce2c0 (stale) Mirror 18: 0xe70ce2c0 (stale) Mirror 19: 0xe70ce2c0 (stale) Mirror 21: 0xe70ce2c0 (stale) Mirror 23: 0xae8ddf21 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfc2d): Mirror 6: 0xe70ce2c0 (stale) Mirror 7: 0xe70ce2c0 (stale) Mirror 8: 0xe70ce2c0 (stale) Mirror 9: 0xe70ce2c0 (stale) Mirror 12: 0xe70ce2c0 (stale) Mirror 14: 0xe70ce2c0 (stale) Mirror 17: 0xe70ce2c0 (stale) Mirror 18: 0xe70ce2c0 (stale) Mirror 19: 0xe70ce2c0 (stale) Mirror 21: 0xe70ce2c0 (stale) Mirror 23: 0xae8ddf21 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfc2d: skipped 000442 1765104031.917069 write 0x0291d4 thru 0x0358f2 (0xc71f bytes) 000443 1765104031.924137 MIRROR_RESYNC 12 mirrors 000444 1765104033.793315 trunc from 0x0358f3 to 0x013363 (0x2258f bytes) 000445 1765104033.876489 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13364): Mirror 6: 0xd9bf3b94 (stale) Mirror 7: 0xd9bf3b94 (stale) Mirror 8: 0xd9bf3b94 (stale) Mirror 9: 0xd9bf3b94 (stale) Mirror 12: 0xd9bf3b94 (stale) Mirror 17: 0xd9bf3b94 (stale) Mirror 18: 0xd9bf3b94 (stale) Mirror 19: 0xd9bf3b94 (stale) Mirror 21: 0xd9bf3b94 (stale) Mirror 23: 0xd9bf3b94 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13364): Mirror 6: 0xd9bf3b94 (stale) Mirror 7: 0xd9bf3b94 (stale) Mirror 8: 0xd9bf3b94 (stale) Mirror 9: 0xd9bf3b94 (stale) Mirror 12: 0xd9bf3b94 (stale) Mirror 17: 0xd9bf3b94 (stale) Mirror 18: 0xd9bf3b94 (stale) Mirror 19: 0xd9bf3b94 (stale) Mirror 21: 0xd9bf3b94 (stale) Mirror 23: 0xd9bf3b94 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13364: skipped 000448 1765104034.411366 read 0x005404 thru 0x00dbd9 (0x87d6 bytes) 000451 1765104034.431101 write 0x03c4a2 thru 0x03ffff (0x3b5e bytes) 000454 1765104034.443662 read 0x03bc5f thru 0x03ffff (0x43a1 bytes) 000455 1765104034.470047 mapwrite 0x02372d thru 0x0294c8 (0x5d9c bytes) 000456 1765104034.553212 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x46f4795a (stale) Mirror 7: 0x46f4795a (stale) Mirror 8: 0x46f4795a (stale) Mirror 9: 0x46f4795a (stale) Mirror 12: 0x46f4795a (stale) Mirror 17: 0x46f4795a (stale) Mirror 18: 0x46f4795a (stale) Mirror 19: 0x46f4795a (stale) Mirror 21: 0x46f4795a (stale) Mirror 23: 0x46f4795a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb32ad909 Mirror 24: 0xb32ad909 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000457 1765104035.521311 read 0x007259 thru 0x010838 (0x95e0 bytes) 000458 1765104035.531281 mapread 0x02b803 thru 0x036fb3 (0xb7b1 bytes) 000459 1765104035.559562 mapwrite 0x034a2e thru 0x03ffff (0xb5d2 bytes) 000460 1765104035.751748 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x46f4795a (stale) Mirror 7: 0x46f4795a (stale) Mirror 8: 0x46f4795a (stale) Mirror 9: 0x46f4795a (stale) Mirror 12: 0x46f4795a (stale) Mirror 17: 0x46f4795a (stale) Mirror 18: 0x46f4795a (stale) Mirror 21: 0x46f4795a (stale) Mirror 23: 0x46f4795a (stale) Mirror 24: 0xb32ad909 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x46f4795a (stale) Mirror 7: 0x46f4795a (stale) Mirror 8: 0x46f4795a (stale) Mirror 9: 0x46f4795a (stale) Mirror 12: 0x46f4795a (stale) Mirror 17: 0x46f4795a (stale) Mirror 18: 0x46f4795a (stale) Mirror 21: 0x46f4795a (stale) Mirror 23: 0x46f4795a (stale) Mirror 24: 0xb32ad909 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000461 1765104036.310835 mapread 0x012d7c thru 0x021df7 (0xf07c bytes) 000463 1765104036.356432 write 0x00de09 thru 0x01bb8e (0xdd86 bytes) 000464 1765104036.357883 read 0x0175ee thru 0x026159 (0xeb6c bytes) 000465 1765104036.367659 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x46f4795a (stale) Mirror 8: 0x46f4795a (stale) Mirror 9: 0x46f4795a (stale) Mirror 12: 0x46f4795a (stale) Mirror 17: 0x46f4795a (stale) Mirror 18: 0x46f4795a (stale) Mirror 21: 0x46f4795a (stale) Mirror 23: 0x46f4795a (stale) Mirror 24: 0xb32ad909 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x46f4795a (stale) Mirror 8: 0x46f4795a (stale) Mirror 9: 0x46f4795a (stale) Mirror 12: 0x46f4795a (stale) Mirror 17: 0x46f4795a (stale) Mirror 18: 0x46f4795a (stale) Mirror 21: 0x46f4795a (stale) Mirror 23: 0x46f4795a (stale) Mirror 24: 0xb32ad909 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000467 1765104036.997155 write 0x033a60 thru 0x03b095 (0x7636 bytes) 000468 1765104037.019285 mapread 0x00ecf0 thru 0x01e506 (0xf817 bytes) 000469 1765104037.039928 read 0x020294 thru 0x02a809 (0xa576 bytes) 000472 1765104037.049095 read 0x005ec4 thru 0x0085fc (0x2739 bytes) 000473 1765104037.060621 read 0x031712 thru 0x03e838 (0xd127 bytes) 000474 1765104037.061228 trunc from 0x040000 to 0x03062a (0xf9d5 bytes) 000475 1765104037.114682 mapread 0x02c6d8 thru 0x03062a (0x3f53 bytes) 000478 1765104037.116457 read 0x0064b5 thru 0x00c063 (0x5baf bytes) 000479 1765104037.117050 mapread 0x00754d thru 0x0171ed (0xfca1 bytes) 000480 1765104037.126971 MIRROR_RESYNC 10 mirrors 000481 1765104038.680934 write 0x010474 thru 0x010918 (0x4a5 bytes) 000482 1765104038.770389 write 0x021c10 thru 0x023a3e (0x1e2f bytes) 000483 1765104038.797865 mapwrite 0x039a87 thru 0x03c06a (0x25e4 bytes) 000484 1765104038.904977 trunc from 0x03c06b to 0x037469 (0x4c01 bytes) 000485 1765104038.923715 mapread 0x00b39c thru 0x00c438 (0x109d bytes) 000486 1765104038.935393 mapwrite 0x012ad1 thru 0x0155a2 (0x2ad2 bytes) 000488 1765104038.991191 mapread 0x01c0e4 thru 0x020f94 (0x4eb1 bytes) 000489 1765104038.992030 read 0x02bee2 thru 0x037469 (0xb588 bytes) 000490 1765104039.008099 write 0x015d62 thru 0x01e88d (0x8b2c bytes) 000493 1765104039.011819 read 0x0020c0 thru 0x011b28 (0xfa69 bytes) 000495 1765104039.019796 trunc from 0x03746a to 0x03c983 (0x551a bytes) 000496 1765104039.036897 mapwrite 0x00f0fe thru 0x015c95 (0x6b98 bytes) 000497 1765104039.082065 MIRROR_RESYNC 10 mirrors 000498 1765104040.229740 write 0x00de1a thru 0x0119e9 (0x3bd0 bytes) 000501 1765104040.316291 trunc from 0x03c984 to 0x037116 (0x586d bytes) 000504 1765104040.364860 read 0x028bdb thru 0x03649c (0xd8c2 bytes) 000505 1765104040.377787 read 0x024fd2 thru 0x02e4ae (0x94dd bytes) 000506 1765104040.391904 mapwrite 0x00bbaa thru 0x00bdf4 (0x24b bytes) 000507 1765104040.437372 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x37117): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37117): Mirror 7: 0xab70c9e8 (stale) Mirror 8: 0xab70c9e8 (stale) Mirror 9: 0xab70c9e8 (stale) Mirror 12: 0xab70c9e8 (stale) Mirror 17: 0xab70c9e8 (stale) Mirror 18: 0xab70c9e8 (stale) Mirror 21: 0xab70c9e8 (stale) Mirror 23: 0xab70c9e8 (stale) Mirror 24: 0xab70c9e8 (stale) CRC-32 checksum value for chunk [0, 0x37117): Mirror 1: 0xb524782c Mirror 25: 0xb524782c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37117: skipped 000508 1765104041.250880 mapread 0x035ff1 thru 0x037116 (0x1126 bytes) 000509 1765104041.292757 mapwrite 0x00f68a thru 0x0175f0 (0x7f67 bytes) 000512 1765104041.520910 trunc from 0x037117 to 0x006bd3 (0x30543 bytes) 000513 1765104041.592140 mapread 0x005b92 thru 0x006bd3 (0x1042 bytes) 000514 1765104041.609224 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x6bd4): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6bd4): Mirror 7: 0x62e1fbb (stale) Mirror 8: 0x62e1fbb (stale) Mirror 9: 0x62e1fbb (stale) Mirror 12: 0x62e1fbb (stale) Mirror 17: 0x62e1fbb (stale) Mirror 18: 0x62e1fbb (stale) Mirror 21: 0x62e1fbb (stale) Mirror 23: 0x62e1fbb (stale) Mirror 24: 0x62e1fbb (stale) Mirror 25: 0x62e1fbb (stale) CRC-32 checksum value for chunk [0, 0x6bd4): Mirror 1: 0x62e1fbb Mirror 26: 0x62e1fbb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6bd4: skipped 000517 1765104042.466640 read 0x00090a thru 0x006bd3 (0x62ca bytes) 000518 1765104042.481257 mapread 0x0055e9 thru 0x006bd3 (0x15eb bytes) 000519 1765104042.495200 mapwrite 0x025e81 thru 0x033c63 (0xdde3 bytes) 000521 1765104042.685311 mapwrite 0x02a60f thru 0x036daf (0xc7a1 bytes) 000522 1765104042.768580 read 0x01a647 thru 0x01f0d5 (0x4a8f bytes) 000523 1765104042.782061 write 0x0386cd thru 0x0392d6 (0xc0a bytes) 000525 1765104042.783716 write 0x021a62 thru 0x02ea96 (0xd035 bytes) 000526 1765104042.789382 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x392d7): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392d7): Mirror 7: 0xb2af07cf (stale) Mirror 8: 0xb2af07cf (stale) Mirror 9: 0xb2af07cf (stale) Mirror 12: 0xb2af07cf (stale) Mirror 17: 0xb2af07cf (stale) Mirror 18: 0xb2af07cf (stale) Mirror 21: 0xb2af07cf (stale) Mirror 23: 0xb2af07cf (stale) Mirror 24: 0xb2af07cf (stale) Mirror 25: 0x22d9dc20 (stale) Mirror 26: 0x205f9946 (stale) CRC-32 checksum value for chunk [0, 0x392d7): Mirror 1: 0x2b19ee6b Mirror 27: 0x2b19ee6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392d7: skipped 000528 1765104043.864459 read 0x02140a thru 0x027dab (0x69a2 bytes) 000529 1765104043.888190 write 0x03bbf3 thru 0x03d078 (0x1486 bytes) 000532 1765104043.962049 trunc from 0x03d079 to 0x0223ee (0x1ac8a bytes) 000533 1765104043.990509 write 0x0312df thru 0x03ecf5 (0xda17 bytes) 000534 1765104043.992924 write 0x03673d thru 0x03f610 (0x8ed4 bytes) 000535 1765104043.995197 write 0x014644 thru 0x022c53 (0xe610 bytes) 000537 1765104044.008947 mapwrite 0x037f49 thru 0x03e239 (0x62f1 bytes) 000538 1765104044.061846 mapread 0x022077 thru 0x030cf8 (0xec82 bytes) 000539 1765104044.078863 trunc from 0x03f611 to 0x001b96 (0x3da7a bytes) 000542 1765104044.097301 trunc from 0x001b97 to 0x03863a (0x36aa4 bytes) 000543 1765104044.116926 mapwrite 0x012451 thru 0x014cfe (0x28ae bytes) 000544 1765104044.179497 mapwrite 0x007174 thru 0x010a7d (0x990a bytes) 000545 1765104044.236201 trunc from 0x03863b to 0x028ba1 (0xfa99 bytes) 000546 1765104044.263680 write 0x015162 thru 0x0221ab (0xd04a bytes) 000547 1765104044.272159 write 0x010c5a thru 0x01bc25 (0xafcc bytes) 000548 1765104044.273477 mapwrite 0x00ac83 thru 0x00d840 (0x2bbe bytes) 000552 1765104044.345262 write 0x0031c8 thru 0x003f55 (0xd8e bytes) 000553 1765104044.346292 write 0x014d35 thru 0x0243f7 (0xf6c3 bytes) 000556 1765104044.369638 trunc from 0x028ba2 to 0x014aa5 (0x140fc bytes) 000557 1765104044.402673 write 0x00589f thru 0x015190 (0xf8f2 bytes) 000560 1765104044.410437 mapread 0x01119b thru 0x015190 (0x3ff6 bytes) 000565 1765104044.432287 MIRROR_RESYNC 13 mirrors 000567 1765104046.205623 mapread 0x00825c thru 0x012fcc (0xad71 bytes) 000568 1765104046.234864 trunc from 0x015191 to 0x03bca1 (0x26b11 bytes) 000569 1765104046.332140 read 0x01cd43 thru 0x0264ee (0x97ac bytes) 000570 1765104046.346897 MIRROR_RESYNC 13 mirrors 000571 1765104047.923986 read 0x03240f thru 0x03bca1 (0x9893 bytes) 000572 1765104047.940125 write 0x0194b7 thru 0x01f60f (0x6159 bytes) 000573 1765104048.027874 MIRROR_RESYNC 13 mirrors 000574 1765104049.496797 mapread 0x0034e8 thru 0x00d299 (0x9db2 bytes) 000575 1765104049.526218 write 0x01b39f thru 0x027c7d (0xc8df bytes) 000576 1765104049.654418 trunc from 0x03bca2 to 0x01f28a (0x1ca17 bytes) 000577 1765104049.685067 mapwrite 0x02bead thru 0x033407 (0x755b bytes) 000578 1765104049.806714 trunc from 0x033408 to 0x01c1d1 (0x17236 bytes) 000579 1765104049.823654 mapread 0x01320e thru 0x01c1d1 (0x8fc4 bytes) 000580 1765104049.833341 mapwrite 0x033406 thru 0x035665 (0x2260 bytes) 000581 1765104049.912168 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35666): Mirror 7: 0xe51d04b2 (stale) Mirror 8: 0xe51d04b2 (stale) Mirror 9: 0xe51d04b2 (stale) Mirror 12: 0xe51d04b2 (stale) Mirror 17: 0xe51d04b2 (stale) Mirror 18: 0xe51d04b2 (stale) Mirror 21: 0xe51d04b2 (stale) Mirror 23: 0xe51d04b2 (stale) Mirror 25: 0xe51d04b2 (stale) Mirror 26: 0xe51d04b2 (stale) Mirror 27: 0xe51d04b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35666): Mirror 7: 0xe51d04b2 (stale) Mirror 8: 0xe51d04b2 (stale) Mirror 9: 0xe51d04b2 (stale) Mirror 12: 0xe51d04b2 (stale) Mirror 17: 0xe51d04b2 (stale) Mirror 18: 0xe51d04b2 (stale) Mirror 21: 0xe51d04b2 (stale) Mirror 23: 0xe51d04b2 (stale) Mirror 25: 0xe51d04b2 (stale) Mirror 26: 0xe51d04b2 (stale) Mirror 27: 0xe51d04b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35666: skipped 000582 1765104050.502409 mapwrite 0x019114 thru 0x0215bd (0x84aa bytes) 000583 1765104050.584826 MIRROR_RESYNC 12 mirrors 000588 1765104051.821649 mapread 0x00705d thru 0x00fc27 (0x8bcb bytes) 000591 1765104051.840641 trunc from 0x035666 to 0x02a1f8 (0xb46d bytes) 000594 1765104051.929060 trunc from 0x02a1f9 to 0x037e31 (0xdc39 bytes) 000595 1765104051.954352 trunc from 0x037e32 to 0x01d8ae (0x1a583 bytes) 000596 1765104051.979093 mapread 0x001d47 thru 0x00b2bd (0x9577 bytes) 000597 1765104052.007824 write 0x00a3ef thru 0x00bd7d (0x198f bytes) 000599 1765104052.009438 mapread 0x0112f9 thru 0x0186a2 (0x73aa bytes) 000601 1765104052.031112 MIRROR_RESYNC 12 mirrors 000602 1765104053.444701 write 0x006706 thru 0x013bf8 (0xd4f3 bytes) 000604 1765104053.521078 mapread 0x012f42 thru 0x01c48b (0x954a bytes) 000605 1765104053.529362 write 0x01710c thru 0x02051d (0x9412 bytes) 000606 1765104053.530823 trunc from 0x02051e to 0x02103f (0xb22 bytes) 000608 1765104053.557839 MIRROR_RESYNC 12 mirrors 000610 1765104054.828946 write 0x00064c thru 0x005be5 (0x559a bytes) 000612 1765104054.890702 mapread 0x00fdb1 thru 0x0108ff (0xb4f bytes) 000613 1765104054.901903 write 0x0218bb thru 0x02bb42 (0xa288 bytes) 000614 1765104054.914104 mapread 0x014f7a thru 0x01c96d (0x79f4 bytes) 000615 1765104054.920976 mapwrite 0x03595d thru 0x03ffff (0xa6a3 bytes) 000617 1765104055.031286 mapwrite 0x032e9e thru 0x037807 (0x496a bytes) 000619 1765104055.073067 MIRROR_RESYNC 12 mirrors 000620 1765104056.298734 trunc from 0x040000 to 0x014d75 (0x2b28a bytes) 000621 1765104056.382228 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x14d76): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14d76): Mirror 7: 0xf5af965d (stale) Mirror 8: 0xf5af965d (stale) Mirror 9: 0xf5af965d (stale) Mirror 12: 0xf5af965d (stale) Mirror 17: 0xf5af965d (stale) Mirror 18: 0xf5af965d (stale) Mirror 21: 0xf5af965d (stale) Mirror 23: 0xf5af965d (stale) Mirror 25: 0xf5af965d (stale) Mirror 26: 0xf5af965d (stale) Mirror 27: 0xf5af965d (stale) CRC-32 checksum value for chunk [0, 0x14d76): Mirror 1: 0xf5af965d Mirror 28: 0xf5af965d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14d76: skipped 000624 1765104057.299428 write 0x01005a thru 0x014ead (0x4e54 bytes) 000625 1765104057.378222 read 0x013cb8 thru 0x014ead (0x11f6 bytes) 000629 1765104057.380092 trunc from 0x014eae to 0x009a05 (0xb4a8 bytes) 000631 1765104057.405789 write 0x007489 thru 0x011446 (0x9fbe bytes) 000635 1765104057.414989 write 0x025e9f thru 0x027866 (0x19c8 bytes) 000636 1765104057.421295 MIRROR_RESYNC 13 mirrors 000639 1765104058.967211 MIRROR_EXTEND to 14 mirrors 000640 1765104059.752551 mapread 0x01c8ef thru 0x0236ae (0x6dc0 bytes) 000641 1765104059.782278 mapwrite 0x03dab3 thru 0x03ffff (0x254d bytes) 000642 1765104059.971070 mapread 0x031fd1 thru 0x03545f (0x348f bytes) 000643 1765104059.985285 read 0x03285b thru 0x03d4c2 (0xac68 bytes) 000644 1765104059.985869 mapread 0x00e0ff thru 0x00e258 (0x15a bytes) 000646 1765104060.003325 read 0x024bdb thru 0x030829 (0xbc4f bytes) 000647 1765104060.015184 mapwrite 0x007588 thru 0x010c57 (0x96d0 bytes) 000648 1765104060.061996 mapread 0x023d8e thru 0x029cd1 (0x5f44 bytes) 000649 1765104060.068122 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2ea4c704 (stale) Mirror 8: 0x2ea4c704 (stale) Mirror 9: 0x2ea4c704 (stale) Mirror 12: 0x2ea4c704 (stale) Mirror 17: 0x2ea4c704 (stale) Mirror 18: 0x2ea4c704 (stale) Mirror 21: 0x2ea4c704 (stale) Mirror 23: 0x2ea4c704 (stale) Mirror 25: 0x2ea4c704 (stale) Mirror 26: 0x2ea4c704 (stale) Mirror 27: 0x2ea4c704 (stale) Mirror 29: 0x2ea4c704 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2ea4c704 (stale) Mirror 8: 0x2ea4c704 (stale) Mirror 9: 0x2ea4c704 (stale) Mirror 12: 0x2ea4c704 (stale) Mirror 17: 0x2ea4c704 (stale) Mirror 18: 0x2ea4c704 (stale) Mirror 21: 0x2ea4c704 (stale) Mirror 23: 0x2ea4c704 (stale) Mirror 25: 0x2ea4c704 (stale) Mirror 26: 0x2ea4c704 (stale) Mirror 27: 0x2ea4c704 (stale) Mirror 29: 0x2ea4c704 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000651 1765104060.713895 read 0x021e86 thru 0x0234c1 (0x163c bytes) 000652 1765104060.725368 mapread 0x03cf01 thru 0x03ffff (0x30ff bytes) 000653 1765104060.753591 read 0x00c97f thru 0x00ef9d (0x261f bytes) 000654 1765104060.776164 trunc from 0x040000 to 0x013a45 (0x2c5ba bytes) 000659 1765104060.797801 read 0x011dcd thru 0x013a45 (0x1c79 bytes) 000661 1765104060.806387 trunc from 0x013a46 to 0x0344eb (0x20aa6 bytes) 000662 1765104060.833573 MIRROR_RESYNC 13 mirrors 000663 1765104062.541907 write 0x039547 thru 0x03ffff (0x6ab9 bytes) 000667 1765104062.635237 read 0x00674a thru 0x00d400 (0x6cb7 bytes) 000668 1765104062.650978 trunc from 0x040000 to 0x000901 (0x3f6fe bytes) 000671 1765104062.689375 mapwrite 0x034dcb thru 0x0377e0 (0x2a16 bytes) 000672 1765104062.783145 trunc from 0x0377e1 to 0x02f115 (0x86cb bytes) 000673 1765104062.817310 mapread 0x028fc4 thru 0x02f115 (0x6152 bytes) 000677 1765104062.836908 write 0x00835e thru 0x00b073 (0x2d16 bytes) 000678 1765104062.848801 read 0x0140b2 thru 0x01a790 (0x66df bytes) 000680 1765104062.863113 read 0x028353 thru 0x02ce55 (0x4b03 bytes) 000681 1765104062.863683 trunc from 0x02f116 to 0x02d41a (0x1cfb bytes) 000684 1765104062.885170 mapread 0x00e2c3 thru 0x014f7e (0x6cbc bytes) 000685 1765104062.886011 mapread 0x003fb5 thru 0x011cb5 (0xdd01 bytes) 000686 1765104062.886830 mapwrite 0x015a92 thru 0x022fb2 (0xd521 bytes) 000687 1765104062.944246 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2d41b): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d41b): Mirror 7: 0xdfc5b52c (stale) Mirror 8: 0xdfc5b52c (stale) Mirror 9: 0xdfc5b52c (stale) Mirror 12: 0xdfc5b52c (stale) Mirror 17: 0xdfc5b52c (stale) Mirror 18: 0xdfc5b52c (stale) Mirror 21: 0xdfc5b52c (stale) Mirror 23: 0xdfc5b52c (stale) Mirror 25: 0xdfc5b52c (stale) Mirror 26: 0xdfc5b52c (stale) Mirror 27: 0xdfc5b52c (stale) Mirror 29: 0xdfc5b52c (stale) CRC-32 checksum value for chunk [0, 0x2d41b): Mirror 1: 0x86250288 Mirror 30: 0x86250288 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d41b: skipped 000689 1765104064.156804 MIRROR_RESYNC 14 mirrors 000690 1765104066.173860 trunc from 0x02d41b to 0x01e6a1 (0xed79 bytes) 000691 1765104066.280331 mapwrite 0x006d0a thru 0x0159ca (0xecc1 bytes) 000692 1765104066.366590 read 0x00a843 thru 0x0168f5 (0xc0b3 bytes) 000698 1765104066.373187 mapwrite 0x03930b thru 0x03ffff (0x6cf5 bytes) 000699 1765104066.450322 mapwrite 0x0039c4 thru 0x007b65 (0x41a2 bytes) 000700 1765104066.520734 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9ab523f1 (stale) Mirror 8: 0x9ab523f1 (stale) Mirror 9: 0x9ab523f1 (stale) Mirror 12: 0x9ab523f1 (stale) Mirror 17: 0x9ab523f1 (stale) Mirror 18: 0x9ab523f1 (stale) Mirror 21: 0x9ab523f1 (stale) Mirror 23: 0x9ab523f1 (stale) Mirror 25: 0x9ab523f1 (stale) Mirror 26: 0x9ab523f1 (stale) Mirror 27: 0x9ab523f1 (stale) Mirror 29: 0x9ab523f1 (stale) Mirror 30: 0x9ab523f1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x616eff73 Mirror 31: 0x616eff73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000702 1765104067.586715 read 0x016283 thru 0x024246 (0xdfc4 bytes) 000703 1765104067.599311 trunc from 0x040000 to 0x03a0e2 (0x5f1d bytes) 000705 1765104067.723466 mapread 0x00f2c3 thru 0x01ac2c (0xb96a bytes) 000706 1765104067.747401 read 0x02bb20 thru 0x032113 (0x65f4 bytes) 000707 1765104067.758265 write 0x039cf1 thru 0x03ffff (0x630f bytes) 000709 1765104067.762356 write 0x004e6c thru 0x00dd20 (0x8eb5 bytes) 000710 1765104067.767688 read 0x005c96 thru 0x0110ad (0xb418 bytes) 000711 1765104067.769236 read 0x001e66 thru 0x00509d (0x3238 bytes) 000713 1765104067.773486 read 0x01853c thru 0x01edc3 (0x6888 bytes) 000714 1765104067.774156 read 0x00d90f thru 0x0132fd (0x59ef bytes) 000715 1765104067.774757 read 0x00bccc thru 0x016817 (0xab4c bytes) 000716 1765104067.775302 mapwrite 0x01ea58 thru 0x02dc1a (0xf1c3 bytes) 000718 1765104067.828478 write 0x0366e8 thru 0x03ffff (0x9918 bytes) 000719 1765104067.841633 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9ab523f1 (stale) Mirror 8: 0x9ab523f1 (stale) Mirror 9: 0x9ab523f1 (stale) Mirror 12: 0x9ab523f1 (stale) Mirror 17: 0x9ab523f1 (stale) Mirror 18: 0x9ab523f1 (stale) Mirror 21: 0x9ab523f1 (stale) Mirror 23: 0x9ab523f1 (stale) Mirror 25: 0x9ab523f1 (stale) Mirror 26: 0x9ab523f1 (stale) Mirror 27: 0x9ab523f1 (stale) Mirror 29: 0x9ab523f1 (stale) Mirror 30: 0x9ab523f1 (stale) Mirror 31: 0x616eff73 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x82837f04 Mirror 32: 0x82837f04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000725 1765104068.759260 read 0x03e72a thru 0x03ffff (0x18d6 bytes) 000726 1765104068.768423 mapwrite 0x023a75 thru 0x025c85 (0x2211 bytes) 000727 1765104068.947872 mapwrite 0x012676 thru 0x019f58 (0x78e3 bytes) 000728 1765104068.997267 mapread 0x00dd9f thru 0x014913 (0x6b75 bytes) 000732 1765104068.999769 read 0x00d6eb thru 0x0195da (0xbef0 bytes) 000734 1765104069.001223 trunc from 0x040000 to 0x038ad9 (0x7526 bytes) 000735 1765104069.014195 mapwrite 0x022a14 thru 0x026b83 (0x4170 bytes) 000737 1765104069.058405 write 0x02ac93 thru 0x038827 (0xdb95 bytes) 000739 1765104069.070029 write 0x01ad7b thru 0x028e34 (0xe0ba bytes) 000741 1765104069.072074 trunc from 0x038ada to 0x0289f9 (0x100e0 bytes) 000742 1765104069.090492 write 0x011428 thru 0x01c07e (0xac57 bytes) 000744 1765104069.092807 write 0x01f3c8 thru 0x022373 (0x2fac bytes) 000746 1765104069.094596 read 0x027094 thru 0x0289f9 (0x1966 bytes) 000749 1765104069.097369 write 0x0137d3 thru 0x01bb54 (0x8382 bytes) 000750 1765104069.099852 trunc from 0x0289fa to 0x036265 (0xd86c bytes) 000759 1765104069.127655 read 0x0285ab thru 0x02a0b0 (0x1b06 bytes) 000760 1765104069.134240 mapwrite 0x03ea22 thru 0x03ffff (0x15de bytes) 000762 1765104069.234910 mapread 0x00e048 thru 0x01881d (0xa7d6 bytes) 000764 1765104069.236479 mapwrite 0x03c7d6 thru 0x03ffff (0x382a bytes) 000768 1765104069.285418 MIRROR_RESYNC 16 mirrors 000769 1765104071.226493 mapwrite 0x01aa8c thru 0x01f817 (0x4d8c bytes) 000770 1765104071.385833 read 0x00cd6e thru 0x011f94 (0x5227 bytes) 000771 1765104071.394745 write 0x031308 thru 0x03a5c3 (0x92bc bytes) 000773 1765104071.411776 mapwrite 0x0334d9 thru 0x03ffff (0xcb27 bytes) 000775 1765104071.470172 write 0x02b697 thru 0x030712 (0x507c bytes) 000776 1765104071.471162 mapwrite 0x004459 thru 0x01295f (0xe507 bytes) 000779 1765104071.539569 mapread 0x026033 thru 0x027825 (0x17f3 bytes) 000780 1765104071.549398 mapread 0x03cb13 thru 0x03ffff (0x34ed bytes) 000782 1765104071.550685 mapwrite 0x0026fd thru 0x00efe6 (0xc8ea bytes) 000783 1765104071.614036 mapwrite 0x03dd66 thru 0x03ffff (0x229a bytes) 000785 1765104071.666630 trunc from 0x040000 to 0x01b0c2 (0x24f3d bytes) 000790 1765104071.700487 read 0x004846 thru 0x01132f (0xcaea bytes) 000791 1765104071.712970 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b0c3): Mirror 7: 0xda2c000d (stale) Mirror 9: 0xda2c000d (stale) Mirror 12: 0xda2c000d (stale) Mirror 17: 0xda2c000d (stale) Mirror 18: 0xda2c000d (stale) Mirror 21: 0xda2c000d (stale) Mirror 23: 0xda2c000d (stale) Mirror 25: 0xda2c000d (stale) Mirror 26: 0xda2c000d (stale) Mirror 27: 0xda2c000d (stale) Mirror 29: 0xda2c000d (stale) Mirror 30: 0xda2c000d (stale) Mirror 31: 0xda2c000d (stale) Mirror 32: 0xda2c000d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b0c3): Mirror 7: 0xda2c000d (stale) Mirror 9: 0xda2c000d (stale) Mirror 12: 0xda2c000d (stale) Mirror 17: 0xda2c000d (stale) Mirror 18: 0xda2c000d (stale) Mirror 21: 0xda2c000d (stale) Mirror 23: 0xda2c000d (stale) Mirror 25: 0xda2c000d (stale) Mirror 26: 0xda2c000d (stale) Mirror 27: 0xda2c000d (stale) Mirror 29: 0xda2c000d (stale) Mirror 30: 0xda2c000d (stale) Mirror 31: 0xda2c000d (stale) Mirror 32: 0xda2c000d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b0c3: skipped 000793 1765104072.494927 mapwrite 0x021d07 thru 0x0255fa (0x38f4 bytes) 000794 1765104072.581503 write 0x03b93a thru 0x03ffff (0x46c6 bytes) 000795 1765104072.582856 mapwrite 0x020713 thru 0x029dd3 (0x96c1 bytes) 000796 1765104072.653311 write 0x01560d thru 0x017e7a (0x286e bytes) 000798 1765104072.666904 read 0x006f1a thru 0x00908b (0x2172 bytes) 000799 1765104072.677287 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x38a73faa (stale) Mirror 9: 0x38a73faa (stale) Mirror 12: 0x38a73faa (stale) Mirror 17: 0x38a73faa (stale) Mirror 18: 0x38a73faa (stale) Mirror 23: 0x38a73faa (stale) Mirror 25: 0x38a73faa (stale) Mirror 26: 0x38a73faa (stale) Mirror 27: 0x38a73faa (stale) Mirror 29: 0x38a73faa (stale) Mirror 30: 0x38a73faa (stale) Mirror 31: 0x38a73faa (stale) Mirror 32: 0x38a73faa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x38a73faa (stale) Mirror 9: 0x38a73faa (stale) Mirror 12: 0x38a73faa (stale) Mirror 17: 0x38a73faa (stale) Mirror 18: 0x38a73faa (stale) Mirror 23: 0x38a73faa (stale) Mirror 25: 0x38a73faa (stale) Mirror 26: 0x38a73faa (stale) Mirror 27: 0x38a73faa (stale) Mirror 29: 0x38a73faa (stale) Mirror 30: 0x38a73faa (stale) Mirror 31: 0x38a73faa (stale) Mirror 32: 0x38a73faa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000802 1765104073.408091 read 0x032b60 thru 0x037a31 (0x4ed2 bytes) 000803 1765104073.416099 read 0x027003 thru 0x02da89 (0x6a87 bytes) 000804 1765104073.432206 read 0x03607d thru 0x037024 (0xfa8 bytes) 000806 1765104073.433186 read 0x03e3b5 thru 0x03ffff (0x1c4b bytes) 000809 1765104073.434566 trunc from 0x040000 to 0x03bb25 (0x44da bytes) 000810 1765104073.458034 mapwrite 0x016b35 thru 0x026792 (0xfc5e bytes) 000814 1765104073.516109 mapwrite 0x008e65 thru 0x0185bb (0xf757 bytes) 000816 1765104073.574845 trunc from 0x03bb26 to 0x03c7cb (0xca6 bytes) 000818 1765104073.606272 trunc from 0x03c7cc to 0x01bec0 (0x2090b bytes) 000819 1765104073.623154 mapread 0x011209 thru 0x012113 (0xf0b bytes) 000825 1765104073.629335 trunc from 0x01bec1 to 0x008d3c (0x13184 bytes) 000826 1765104073.652683 mapread 0x003eec thru 0x005f90 (0x20a5 bytes) 000827 1765104073.653505 read 0x004c2c thru 0x008d3c (0x4111 bytes) 000828 1765104073.654048 mapread 0x007c1e thru 0x008d3c (0x111f bytes) 000829 1765104073.661019 MIRROR_RESYNC 14 mirrors 000830 1765104075.289500 trunc from 0x008d3d to 0x004a8d (0x42af bytes) 000831 1765104075.377640 trunc from 0x004a8e to 0x024df2 (0x20365 bytes) 000832 1765104075.406694 MIRROR_RESYNC 14 mirrors 000833 1765104077.016362 trunc from 0x024df3 to 0x02492b (0x4c7 bytes) 000834 1765104077.099363 trunc from 0x02492c to 0x003769 (0x211c2 bytes) 000835 1765104077.128300 write 0x0362f8 thru 0x03ffff (0x9d08 bytes) 000836 1765104077.130275 mapwrite 0x0303e8 thru 0x03aacd (0xa6e6 bytes) 000838 1765104077.218443 mapwrite 0x00c100 thru 0x017512 (0xb413 bytes) 000839 1765104077.295569 read 0x0214a6 thru 0x024869 (0x33c4 bytes) 000840 1765104077.302135 write 0x037649 thru 0x0381c7 (0xb7f bytes) 000841 1765104077.303199 mapread 0x02587e thru 0x026a7d (0x1200 bytes) 000848 1765104077.319221 mapwrite 0x01744f thru 0x01b35c (0x3f0e bytes) truncating to largest ever: 0x3e7e5 000849 1765104077.366631 trunc from 0x040000 to 0x03e7e4 (0x181b bytes) 000850 1765104077.393673 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 7: 0xc09d1fa4 (stale) Mirror 9: 0xc09d1fa4 (stale) Mirror 12: 0xc09d1fa4 (stale) Mirror 17: 0xc09d1fa4 (stale) Mirror 18: 0xc09d1fa4 (stale) Mirror 23: 0xc09d1fa4 (stale) Mirror 25: 0xc09d1fa4 (stale) Mirror 26: 0xc09d1fa4 (stale) Mirror 27: 0xc09d1fa4 (stale) Mirror 29: 0xc09d1fa4 (stale) Mirror 30: 0xc09d1fa4 (stale) Mirror 31: 0xc09d1fa4 (stale) Mirror 32: 0xc09d1fa4 (stale) CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 1: 0x6b24daf7 Mirror 33: 0x6b24daf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7e5: skipped 000853 1765104078.344413 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 7: 0xc09d1fa4 (stale) Mirror 9: 0xc09d1fa4 (stale) Mirror 12: 0xc09d1fa4 (stale) Mirror 17: 0xc09d1fa4 (stale) Mirror 18: 0xc09d1fa4 (stale) Mirror 23: 0xc09d1fa4 (stale) Mirror 25: 0xc09d1fa4 (stale) Mirror 27: 0xc09d1fa4 (stale) Mirror 29: 0xc09d1fa4 (stale) Mirror 30: 0xc09d1fa4 (stale) Mirror 31: 0xc09d1fa4 (stale) Mirror 32: 0xc09d1fa4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 7: 0xc09d1fa4 (stale) Mirror 9: 0xc09d1fa4 (stale) Mirror 12: 0xc09d1fa4 (stale) Mirror 17: 0xc09d1fa4 (stale) Mirror 18: 0xc09d1fa4 (stale) Mirror 23: 0xc09d1fa4 (stale) Mirror 25: 0xc09d1fa4 (stale) Mirror 27: 0xc09d1fa4 (stale) Mirror 29: 0xc09d1fa4 (stale) Mirror 30: 0xc09d1fa4 (stale) Mirror 31: 0xc09d1fa4 (stale) Mirror 32: 0xc09d1fa4 (stale) CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 1: 0x6b24daf7 Mirror 33: 0x6b24daf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7e5: skipped 000860 1765104079.019283 MIRROR_SPLIT mirror 11 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 7: 0xc09d1fa4 (stale) Mirror 9: 0xc09d1fa4 (stale) Mirror 12: 0xc09d1fa4 (stale) Mirror 17: 0xc09d1fa4 (stale) Mirror 18: 0xc09d1fa4 (stale) Mirror 23: 0xc09d1fa4 (stale) Mirror 25: 0xc09d1fa4 (stale) Mirror 27: 0xc09d1fa4 (stale) Mirror 29: 0xc09d1fa4 (stale) Mirror 30: 0xc09d1fa4 (stale) Mirror 32: 0xc09d1fa4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 7: 0xc09d1fa4 (stale) Mirror 9: 0xc09d1fa4 (stale) Mirror 12: 0xc09d1fa4 (stale) Mirror 17: 0xc09d1fa4 (stale) Mirror 18: 0xc09d1fa4 (stale) Mirror 23: 0xc09d1fa4 (stale) Mirror 25: 0xc09d1fa4 (stale) Mirror 27: 0xc09d1fa4 (stale) Mirror 29: 0xc09d1fa4 (stale) Mirror 30: 0xc09d1fa4 (stale) Mirror 32: 0xc09d1fa4 (stale) CRC-32 checksum value for chunk [0, 0x3e7e5): Mirror 1: 0x6b24daf7 Mirror 33: 0x6b24daf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7e5: skipped 000862 1765104079.812469 write 0x013fe2 thru 0x014f0e (0xf2d bytes) 000865 1765104079.886586 mapread 0x036735 thru 0x03e7e4 (0x80b0 bytes) 000866 1765104079.903326 write 0x0006c8 thru 0x0047c6 (0x40ff bytes) 000867 1765104079.923106 write 0x03ec68 thru 0x03ffff (0x1398 bytes) 000869 1765104079.929585 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x27c03be5 (stale) Mirror 9: 0x27c03be5 (stale) Mirror 12: 0x27c03be5 (stale) Mirror 17: 0x27c03be5 (stale) Mirror 18: 0x27c03be5 (stale) Mirror 23: 0x27c03be5 (stale) Mirror 25: 0x27c03be5 (stale) Mirror 27: 0x27c03be5 (stale) Mirror 29: 0x27c03be5 (stale) Mirror 30: 0x27c03be5 (stale) Mirror 32: 0x27c03be5 (stale) Mirror 33: 0x219a65ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6df6fdce Mirror 34: 0x6df6fdce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000872 1765104080.701580 write 0x037ac1 thru 0x0383c8 (0x908 bytes) 000873 1765104080.805845 mapread 0x032fd4 thru 0x03b7e7 (0x8814 bytes) 000875 1765104080.837469 read 0x02ecfb thru 0x032660 (0x3966 bytes) 000876 1765104080.838102 read 0x028add thru 0x0368a4 (0xddc8 bytes) 000878 1765104080.859350 trunc from 0x040000 to 0x035757 (0xa8a8 bytes) 000879 1765104080.879908 mapread 0x01c6f8 thru 0x01d7a4 (0x10ad bytes) 000880 1765104080.881917 mapread 0x02a29f thru 0x02faad (0x580f bytes) 000881 1765104080.884042 trunc from 0x035758 to 0x016c88 (0x1eacf bytes) 000882 1765104080.900387 mapread 0x00d68b thru 0x016c88 (0x95fe bytes) 000883 1765104080.901252 mapread 0x009bae thru 0x00ae26 (0x1279 bytes) 000884 1765104080.901914 trunc from 0x016c89 to 0x010a31 (0x6257 bytes) 000887 1765104080.948868 read 0x004f53 thru 0x00cd6a (0x7e18 bytes) 000888 1765104080.949618 mapread 0x00d780 thru 0x010a31 (0x32b2 bytes) 000889 1765104080.950785 mapwrite 0x02df43 thru 0x030263 (0x2321 bytes) 000891 1765104081.025921 write 0x03536c thru 0x03c7cf (0x7464 bytes) 000893 1765104081.027433 mapwrite 0x03379d thru 0x03b57a (0x7dde bytes) 000894 1765104081.083397 read 0x0269df thru 0x0363c3 (0xf9e5 bytes) 000895 1765104081.084116 read 0x03860d thru 0x03c7cf (0x41c3 bytes) 000896 1765104081.084683 read 0x01a941 thru 0x01e1de (0x389e bytes) 000897 1765104081.088997 MIRROR_SPLIT mirror 11 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c7d0): Mirror 7: 0x806cdcae (stale) Mirror 9: 0x806cdcae (stale) Mirror 12: 0x806cdcae (stale) Mirror 17: 0x806cdcae (stale) Mirror 18: 0x806cdcae (stale) Mirror 23: 0x806cdcae (stale) Mirror 25: 0x806cdcae (stale) Mirror 27: 0x806cdcae (stale) Mirror 29: 0x806cdcae (stale) Mirror 30: 0x806cdcae (stale) Mirror 33: 0x592c41ab (stale) Mirror 34: 0x42d4b1c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7d0): Mirror 7: 0x806cdcae (stale) Mirror 9: 0x806cdcae (stale) Mirror 12: 0x806cdcae (stale) Mirror 17: 0x806cdcae (stale) Mirror 18: 0x806cdcae (stale) Mirror 23: 0x806cdcae (stale) Mirror 25: 0x806cdcae (stale) Mirror 27: 0x806cdcae (stale) Mirror 29: 0x806cdcae (stale) Mirror 30: 0x806cdcae (stale) Mirror 33: 0x592c41ab (stale) Mirror 34: 0x42d4b1c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7d0: skipped 000900 1765104081.736618 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c7d0): Mirror 7: 0x806cdcae (stale) Mirror 9: 0x806cdcae (stale) Mirror 12: 0x806cdcae (stale) Mirror 17: 0x806cdcae (stale) Mirror 18: 0x806cdcae (stale) Mirror 23: 0x806cdcae (stale) Mirror 25: 0x806cdcae (stale) Mirror 27: 0x806cdcae (stale) Mirror 29: 0x806cdcae (stale) Mirror 30: 0x806cdcae (stale) Mirror 33: 0x592c41ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7d0): Mirror 7: 0x806cdcae (stale) Mirror 9: 0x806cdcae (stale) Mirror 12: 0x806cdcae (stale) Mirror 17: 0x806cdcae (stale) Mirror 18: 0x806cdcae (stale) Mirror 23: 0x806cdcae (stale) Mirror 25: 0x806cdcae (stale) Mirror 27: 0x806cdcae (stale) Mirror 29: 0x806cdcae (stale) Mirror 30: 0x806cdcae (stale) Mirror 33: 0x592c41ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7d0: skipped 000904 1765104082.239890 trunc from 0x03c7d0 to 0x004832 (0x37f9d bytes) 000906 1765104082.261285 mapread 0x000705 thru 0x0040fe (0x39fa bytes) 000907 1765104082.289301 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4833): Mirror 7: 0xc46f3a73 (stale) Mirror 9: 0xc46f3a73 (stale) Mirror 12: 0xc46f3a73 (stale) Mirror 17: 0xc46f3a73 (stale) Mirror 18: 0xc46f3a73 (stale) Mirror 23: 0xc46f3a73 (stale) Mirror 27: 0xc46f3a73 (stale) Mirror 29: 0xc46f3a73 (stale) Mirror 30: 0xc46f3a73 (stale) Mirror 33: 0x6fea6305 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4833): Mirror 7: 0xc46f3a73 (stale) Mirror 9: 0xc46f3a73 (stale) Mirror 12: 0xc46f3a73 (stale) Mirror 17: 0xc46f3a73 (stale) Mirror 18: 0xc46f3a73 (stale) Mirror 23: 0xc46f3a73 (stale) Mirror 27: 0xc46f3a73 (stale) Mirror 29: 0xc46f3a73 (stale) Mirror 30: 0xc46f3a73 (stale) Mirror 33: 0x6fea6305 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4833: skipped 000908 1765104082.688356 mapread 0x000a4b thru 0x001826 (0xddc bytes) 000909 1765104082.706286 trunc from 0x004833 to 0x035e2c (0x315fa bytes) 000910 1765104082.730283 mapwrite 0x035352 thru 0x03ffff (0xacae bytes) 000911 1765104082.824177 mapread 0x00aff9 thru 0x013f33 (0x8f3b bytes) 000912 1765104082.845436 mapwrite 0x0188cf thru 0x01d346 (0x4a78 bytes) 000913 1765104082.889921 mapread 0x03ffe6 thru 0x03ffff (0x1a bytes) 000914 1765104082.890904 write 0x0045c3 thru 0x00ba83 (0x74c1 bytes) 000915 1765104082.892139 mapread 0x03b5eb thru 0x03ffff (0x4a15 bytes) 000916 1765104082.893040 mapread 0x0056de thru 0x005e7a (0x79d bytes) 000918 1765104082.895266 mapwrite 0x03fd8a thru 0x03ffff (0x276 bytes) 000919 1765104082.933467 MIRROR_RESYNC 11 mirrors 000921 1765104084.176211 read 0x003908 thru 0x011317 (0xda10 bytes) 000922 1765104084.182183 write 0x00886a thru 0x00f739 (0x6ed0 bytes) 000923 1765104084.242082 read 0x030f4a thru 0x036796 (0x584d bytes) 000926 1765104084.255253 mapwrite 0x016417 thru 0x01ddaa (0x7994 bytes) 000928 1765104084.307699 MIRROR_RESYNC 11 mirrors 000931 1765104085.583368 write 0x03f1d7 thru 0x03ffff (0xe29 bytes) 000932 1765104085.657395 trunc from 0x040000 to 0x02410d (0x1bef2 bytes) 000933 1765104085.676267 mapread 0x007416 thru 0x013bc4 (0xc7af bytes) 000934 1765104085.690517 read 0x00f5f9 thru 0x01433e (0x4d46 bytes) 000937 1765104085.691999 mapread 0x00f9f8 thru 0x01b030 (0xb639 bytes) 000938 1765104085.700006 write 0x030eb2 thru 0x037e88 (0x6fd7 bytes) 000940 1765104085.701560 trunc from 0x037e89 to 0x02238b (0x15afd bytes) 000941 1765104085.714840 trunc from 0x02238c to 0x0146d9 (0xdcb2 bytes) 000942 1765104085.727026 trunc from 0x0146da to 0x01d498 (0x8dbf bytes) 000944 1765104085.745711 mapread 0x01b8af thru 0x01d498 (0x1bea bytes) 000945 1765104085.755001 write 0x00674c thru 0x010bea (0xa49f bytes) 000946 1765104085.757761 write 0x0140ae thru 0x01e74a (0xa69d bytes) 000947 1765104085.760068 mapwrite 0x00660e thru 0x010e0b (0xa7fe bytes) 000948 1765104085.827751 mapwrite 0x002079 thru 0x00a272 (0x81fa bytes) 000949 1765104085.863264 trunc from 0x01e74b to 0x006112 (0x18638 bytes) 000951 1765104085.885611 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6113): Mirror 9: 0x3e936ddb (stale) Mirror 12: 0x3e936ddb (stale) Mirror 17: 0x3e936ddb (stale) Mirror 18: 0x3e936ddb (stale) Mirror 23: 0x3e936ddb (stale) Mirror 27: 0x3e936ddb (stale) Mirror 29: 0x3e936ddb (stale) Mirror 30: 0x3e936ddb (stale) Mirror 33: 0x3e936ddb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6113): Mirror 9: 0x3e936ddb (stale) Mirror 12: 0x3e936ddb (stale) Mirror 17: 0x3e936ddb (stale) Mirror 18: 0x3e936ddb (stale) Mirror 23: 0x3e936ddb (stale) Mirror 27: 0x3e936ddb (stale) Mirror 29: 0x3e936ddb (stale) Mirror 30: 0x3e936ddb (stale) Mirror 33: 0x3e936ddb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6113: skipped 000952 1765104086.334043 write 0x006f4d thru 0x010388 (0x943c bytes) 000953 1765104086.358677 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x10389): Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10389): Mirror 9: 0x9023318e (stale) Mirror 12: 0x9023318e (stale) Mirror 17: 0x9023318e (stale) Mirror 18: 0x9023318e (stale) Mirror 23: 0x9023318e (stale) Mirror 27: 0x9023318e (stale) Mirror 29: 0x9023318e (stale) Mirror 30: 0x9023318e (stale) Mirror 33: 0x9023318e (stale) CRC-32 checksum value for chunk [0, 0x10389): Mirror 1: 0xd39b774a Mirror 34: 0xd39b774a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10389: skipped 000954 1765104087.055045 write 0x01083d thru 0x018e90 (0x8654 bytes) 000958 1765104087.137026 mapread 0x001b83 thru 0x00697a (0x4df8 bytes) 000959 1765104087.157974 read 0x00b840 thru 0x018ccb (0xd48c bytes) 000960 1765104087.165424 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x18e91): Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18e91): Mirror 9: 0xacfa1c2e (stale) Mirror 12: 0xacfa1c2e (stale) Mirror 17: 0xacfa1c2e (stale) Mirror 18: 0xacfa1c2e (stale) Mirror 23: 0xacfa1c2e (stale) Mirror 27: 0xacfa1c2e (stale) Mirror 29: 0xacfa1c2e (stale) Mirror 30: 0xacfa1c2e (stale) Mirror 33: 0xacfa1c2e (stale) Mirror 34: 0x2cdd2140 (stale) CRC-32 checksum value for chunk [0, 0x18e91): Mirror 1: 0xe0165f57 Mirror 35: 0xe0165f57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18e91: skipped 000961 1765104087.931933 mapread 0x0083ac thru 0x00b197 (0x2dec bytes) 000962 1765104087.974878 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18e91): Mirror 9: 0xacfa1c2e (stale) Mirror 12: 0xacfa1c2e (stale) Mirror 17: 0xacfa1c2e (stale) Mirror 23: 0xacfa1c2e (stale) Mirror 27: 0xacfa1c2e (stale) Mirror 29: 0xacfa1c2e (stale) Mirror 30: 0xacfa1c2e (stale) Mirror 33: 0xacfa1c2e (stale) Mirror 34: 0x2cdd2140 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18e91): Mirror 9: 0xacfa1c2e (stale) Mirror 12: 0xacfa1c2e (stale) Mirror 17: 0xacfa1c2e (stale) Mirror 23: 0xacfa1c2e (stale) Mirror 27: 0xacfa1c2e (stale) Mirror 29: 0xacfa1c2e (stale) Mirror 30: 0xacfa1c2e (stale) Mirror 33: 0xacfa1c2e (stale) Mirror 34: 0x2cdd2140 (stale) CRC-32 checksum value for chunk [0, 0x18e91): Mirror 1: 0xe0165f57 Mirror 35: 0xe0165f57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18e91: skipped 000964 1765104088.660862 mapwrite 0x03ec69 thru 0x03ffff (0x1397 bytes) 000965 1765104088.848706 read 0x01d145 thru 0x02a8fb (0xd7b7 bytes) 000966 1765104088.859850 trunc from 0x040000 to 0x00e7d1 (0x3182e bytes) 000967 1765104088.888639 write 0x027c42 thru 0x0320fd (0xa4bc bytes) 000968 1765104088.890263 read 0x004ff1 thru 0x014b15 (0xfb25 bytes) 000969 1765104088.900373 mapwrite 0x038210 thru 0x03ffff (0x7df0 bytes) 000973 1765104088.977723 mapread 0x019cf3 thru 0x01e77f (0x4a8d bytes) 000975 1765104088.979117 write 0x004d82 thru 0x010fd7 (0xc256 bytes) 000977 1765104088.986121 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x70597a73 (stale) Mirror 12: 0x70597a73 (stale) Mirror 17: 0x70597a73 (stale) Mirror 23: 0x70597a73 (stale) Mirror 27: 0x70597a73 (stale) Mirror 29: 0x70597a73 (stale) Mirror 30: 0x70597a73 (stale) Mirror 33: 0x70597a73 (stale) Mirror 34: 0x557bb70b (stale) Mirror 35: 0x83924b7d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b1f7055 Mirror 36: 0x9b1f7055 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000979 1765104089.887164 mapread 0x03619b thru 0x03ffff (0x9e65 bytes) 000980 1765104089.927654 MIRROR_RESYNC 12 mirrors 000981 1765104091.212752 MIRROR_RESYNC 12 mirrors 000982 1765104091.723649 write 0x00db87 thru 0x00ffdc (0x2456 bytes) 000984 1765104091.830947 write 0x02c489 thru 0x02f3b2 (0x2f2a bytes) 000985 1765104091.845018 trunc from 0x040000 to 0x00b86c (0x34793 bytes) 000986 1765104091.867501 write 0x026799 thru 0x0338e3 (0xd14b bytes) 000987 1765104091.879328 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1af:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x338e4): Mirror 9: 0xc6f847da (stale) Mirror 12: 0xc6f847da (stale) Mirror 17: 0xc6f847da (stale) Mirror 23: 0xc6f847da (stale) Mirror 27: 0xc6f847da (stale) Mirror 29: 0xc6f847da (stale) Mirror 30: 0xc6f847da (stale) Mirror 33: 0xc6f847da (stale) Mirror 34: 0xc6f847da (stale) Mirror 36: 0xc6f847da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x338e4): Mirror 9: 0xc6f847da (stale) Mirror 12: 0xc6f847da (stale) Mirror 17: 0xc6f847da (stale) Mirror 23: 0xc6f847da (stale) Mirror 27: 0xc6f847da (stale) Mirror 29: 0xc6f847da (stale) Mirror 30: 0xc6f847da (stale) Mirror 33: 0xc6f847da (stale) Mirror 34: 0xc6f847da (stale) Mirror 36: 0xc6f847da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x338e4: skipped 000989 1765104092.425348 read 0x02fef4 thru 0x0338e3 (0x39f0 bytes) 000990 1765104092.449556 MIRROR_RESYNC 11 mirrors 000991 1765104093.708319 MIRROR_EXTEND to 12 mirrors 000993 1765104094.385988 mapread 0x022b96 thru 0x02813d (0x55a8 bytes) 000995 1765104094.408933 read 0x009c41 thru 0x015c42 (0xc002 bytes) 000996 1765104094.428490 trunc from 0x0338e4 to 0x00ceb7 (0x26a2c bytes) 000997 1765104094.521037 trunc from 0x00ceb8 to 0x0055aa (0x790d bytes) 000998 1765104094.548575 read 0x002f7c thru 0x0055aa (0x262f bytes) All operations completed A-OK!