== sanity-flr test 70a: flr mode fsx test ================ 12:34:28 (1788626068) Seed set to 6070 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1788626071.144514 MIRROR_EXTEND to 2 mirrors skipping zero length punch hole skipping zero length punch hole skipping zero length punch hole truncating to largest ever: 0x15f8d 000009 1788626071.893695 trunc from 00000000 to 0x015f8c (0x15f8d bytes) 000010 1788626071.986738 mapwrite 0x011924 thru 0x012b7a (0x1257 bytes) 000013 1788626072.130730 read 0x005537 thru 0x010ee1 (0xb9ab bytes) 000015 1788626072.174268 read 0x00c04a thru 0x00d8af (0x1866 bytes) 000016 1788626072.174938 read 0x00779f thru 0x00d30c (0x5b6e bytes) 000018 1788626072.181950 punch from 0x014508 to 0x015f8c (0x1a85 bytes) 000019 1788626072.196879 punch from 0x00e2ea to 0x015f8c (0x7ca3 bytes) 000020 1788626072.214981 write 0x02c952 thru 0x02e2bf (0x196e bytes) 000022 1788626072.223204 write 0x025a2f thru 0x02aa45 (0x5017 bytes) 000024 1788626072.252322 read 0x01d2e6 thru 0x02bbe3 (0xe8fe bytes) 000025 1788626072.255315 mapread 0x010688 thru 0x016fa0 (0x6919 bytes) 000027 1788626072.257773 mapwrite 0x01cfbf thru 0x023020 (0x6062 bytes) 000028 1788626072.364907 mapread 0x02614e thru 0x02e2bf (0x8172 bytes) 000031 1788626072.377003 write 0x02ae49 thru 0x0335e6 (0x879e bytes) 000032 1788626072.381646 write 0x01dac3 thru 0x023480 (0x59be bytes) 000033 1788626072.384629 read 0x009544 thru 0x00daa8 (0x4565 bytes) 000035 1788626072.386910 read 0x00d058 thru 0x01229f (0x5248 bytes) 000038 1788626072.394052 mapread 0x0254e8 thru 0x02d143 (0x7c5c bytes) 000039 1788626072.398830 punch from 0x005408 to 0x006d12 (0x190b bytes) 000040 1788626072.468793 read 0x01e8fa thru 0x02b766 (0xce6d bytes) 000041 1788626072.474096 read 0x010447 thru 0x01d314 (0xcece bytes) 000046 1788626072.483574 read 0x032863 thru 0x0335e6 (0xd84 bytes) 000047 1788626072.488967 trunc from 0x0335e7 to 0x0121f3 (0x213f3 bytes) 000049 1788626072.563135 mapread 0x010cf0 thru 0x0121f3 (0x1504 bytes) 000050 1788626072.571905 mapwrite 0x00a8ff thru 0x00c103 (0x1805 bytes) 000052 1788626072.731212 mapread 0x00e0b7 thru 0x0121f3 (0x413d bytes) truncating to largest ever: 0x25ecb 000054 1788626072.738962 trunc from 0x0121f4 to 0x025eca (0x13cd7 bytes) 000055 1788626072.794667 MIRROR_RESYNC 2 mirrors 000056 1788626074.255811 write 0x03d49d thru 0x03ffff (0x2b63 bytes) 000057 1788626074.357152 write 0x024156 thru 0x0248b3 (0x75e bytes) 000059 1788626074.364726 read 0x03b6e0 thru 0x03bf82 (0x8a3 bytes) 000060 1788626074.370419 punch from 0x019f73 to 0x0233ac (0x943a bytes) 000061 1788626074.384783 punch from 0x00e95a to 0x014191 (0x5838 bytes) 000062 1788626074.391449 read 0x0130d3 thru 0x01f2f1 (0xc21f bytes) 000064 1788626074.412697 MIRROR_RESYNC 2 mirrors 000065 1788626075.242916 write 0x00f065 thru 0x011082 (0x201e bytes) 000066 1788626075.331460 mapread 0x02b4ab thru 0x038dea (0xd940 bytes) 000067 1788626075.371714 punch from 0x01b029 to 0x020c8b (0x5c63 bytes) 000069 1788626075.381155 punch from 0x037b55 to 0x03cfb7 (0x5463 bytes) 000070 1788626075.403213 MIRROR_RESYNC 2 mirrors 000071 1788626076.715413 mapwrite 0x001a0a thru 0x00914e (0x7745 bytes) truncating to largest ever: 0x36292 000075 1788626076.894917 trunc from 0x040000 to 0x036291 (0x9d6e bytes) 000078 1788626076.934358 write 0x02d8a8 thru 0x032e83 (0x55dc bytes) 000079 1788626076.948588 mapwrite 0x01b859 thru 0x022524 (0x6ccc bytes) 000080 1788626077.024154 trunc from 0x036292 to 0x018ae2 (0x1d7af bytes) 000081 1788626077.051835 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x18ae3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18ae3): Mirror 2: 0xebc24aa3 (stale) CRC-32 checksum value for chunk [0, 0x18ae3): Mirror 1: 0xce55f11a Mirror 3: 0xce55f11a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18ae3: skipped 000082 1788626078.177990 trunc from 0x018ae3 to 0x0139ac (0x5136 bytes) 000083 1788626078.348108 punch from 0x00d518 to 0x0139ac (0x6495 bytes) 000084 1788626078.354004 read 0x00910f thru 0x0139ac (0xa89e bytes) 000085 1788626078.365453 mapwrite 0x0346d8 thru 0x03e7a9 (0xa0d2 bytes) 000088 1788626078.583671 write 0x0302a2 thru 0x03606e (0x5dcd bytes) 000090 1788626078.585801 write 0x0263e4 thru 0x02af7b (0x4b98 bytes) 000095 1788626078.602857 punch from 0x002d8e to 0x00b2b3 (0x8526 bytes) 000096 1788626078.624065 write 0x00e7fa thru 0x00fd3e (0x1545 bytes) 000098 1788626078.629140 mapwrite 0x017e01 thru 0x025e90 (0xe090 bytes) 000099 1788626078.732380 trunc from 0x03e7aa to 0x019145 (0x25664 bytes) 000103 1788626078.762443 write 0x03aae2 thru 0x03ffff (0x551e bytes) 000104 1788626078.766477 trunc from 0x040000 to 0x018045 (0x27fba bytes) 000105 1788626078.789645 mapread 0x00b77a thru 0x0156cc (0x9f53 bytes) 000107 1788626078.805698 MIRROR_RESYNC 3 mirrors 000109 1788626080.472606 trunc from 0x018046 to 0x007aa2 (0x105a3 bytes) 000110 1788626080.601408 mapwrite 0x0259fa thru 0x03251b (0xcb22 bytes) 000111 1788626080.791918 trunc from 0x03251c to 0x001bbc (0x3095f bytes) 000112 1788626080.821920 mapread 0x0014f0 thru 0x001bbc (0x6cd bytes) 000115 1788626080.833313 punch from 0x00140c to 0x001bbc (0x7b1 bytes) 000117 1788626080.845431 write 0x010e06 thru 0x01760a (0x6805 bytes) 000120 1788626080.859068 mapwrite 0x00e537 thru 0x01e4a4 (0xff6e bytes) truncating to largest ever: 0x386dc 000121 1788626081.022451 trunc from 0x01e4a5 to 0x0386db (0x1a237 bytes) 000124 1788626081.064281 write 0x00df11 thru 0x01a078 (0xc168 bytes) 000125 1788626081.071065 punch from 0x02091c to 0x020995 (0x7a bytes) 000126 1788626081.094481 trunc from 0x0386dc to 0x02fe8f (0x884c bytes) 000127 1788626081.139393 write 0x005044 thru 0x013de8 (0xeda5 bytes) 000128 1788626081.148245 trunc from 0x02fe90 to 0x01ce0a (0x13085 bytes) 000129 1788626081.184147 MIRROR_RESYNC 3 mirrors 000130 1788626082.784408 punch from 0x0111bd to 0x0185ed (0x7431 bytes) 000132 1788626082.874988 trunc from 0x01ce0b to 0x015b52 (0x72b8 bytes) 000133 1788626082.912175 punch from 0x007f5b to 0x00e78c (0x6832 bytes) 000134 1788626082.937944 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x15b53): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15b53): Mirror 2: 0x47ee2018 (stale) Mirror 3: 0x47ee2018 (stale) CRC-32 checksum value for chunk [0, 0x15b53): Mirror 1: 0x11a26e2f Mirror 4: 0x11a26e2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15b53: skipped 000136 1788626084.515702 punch from 0x00014c to 0x008551 (0x8406 bytes) 000138 1788626084.656148 write 0x00b883 thru 0x012357 (0x6ad5 bytes) 000139 1788626084.670393 mapwrite 0x00a4bb thru 0x011672 (0x71b8 bytes) 000140 1788626084.769230 mapread 0x010fbe thru 0x015b52 (0x4b95 bytes) 000141 1788626084.798492 punch from 0x006933 to 0x00d636 (0x6d04 bytes) 000142 1788626084.812397 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x15b53): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15b53): Mirror 2: 0x47ee2018 (stale) Mirror 3: 0x47ee2018 (stale) Mirror 4: 0x11a26e2f (stale) CRC-32 checksum value for chunk [0, 0x15b53): Mirror 1: 0xc3d3a378 Mirror 5: 0xc3d3a378 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15b53: skipped 000143 1788626086.230044 trunc from 0x015b53 to 0x0107ea (0x5368 bytes) 000145 1788626086.379207 punch from 0x008e9a to 0x0107ea (0x7951 bytes) 000146 1788626086.394020 mapwrite 0x00f89d thru 0x0191ed (0x9951 bytes) 000147 1788626086.511795 write 0x033c12 thru 0x03e4cf (0xa8be bytes) 000148 1788626086.514574 read 0x015803 thru 0x024370 (0xeb6e bytes) 000149 1788626086.526457 write 0x0192e2 thru 0x0240af (0xadce bytes) 000150 1788626086.527936 write 0x03ed2b thru 0x03ffff (0x12d5 bytes) 000151 1788626086.531865 trunc from 0x040000 to 0x001b56 (0x3e4a9 bytes) 000153 1788626086.579621 write 0x033801 thru 0x03ffff (0xc7ff bytes) 000156 1788626086.589722 trunc from 0x040000 to 0x013741 (0x2c8be bytes) 000157 1788626086.635468 trunc from 0x013742 to 0x02834a (0x14c09 bytes) 000158 1788626086.660049 write 0x03e1e1 thru 0x03ffff (0x1e1f bytes) 000159 1788626086.661297 read 0x009b38 thru 0x017dfa (0xe2c3 bytes) 000160 1788626086.680892 write 0x007f4a thru 0x00de94 (0x5f4b bytes) 000161 1788626086.687984 punch from 0x01b5aa to 0x023405 (0x7e5c bytes) 000164 1788626086.723131 read 0x014fa7 thru 0x016daa (0x1e04 bytes) 000167 1788626086.725170 write 0x039057 thru 0x03de73 (0x4e1d bytes) 000169 1788626086.750162 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xec65f807 (stale) Mirror 4: 0x5cb1acd2 (stale) Mirror 5: 0x8f4b7288 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xec65f807 (stale) Mirror 4: 0x5cb1acd2 (stale) Mirror 5: 0x8f4b7288 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000170 1788626087.281991 read 0x03d014 thru 0x03f832 (0x281f bytes) 000173 1788626087.296792 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xec65f807 (stale) Mirror 4: 0x5cb1acd2 (stale) Mirror 5: 0x8f4b7288 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c2738fa Mirror 6: 0x9c2738fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000174 1788626088.970840 punch from 0x015439 to 0x01ff73 (0xab3b bytes) 000175 1788626089.088018 punch from 0x03feca to 0x03ffff (0x136 bytes) 000176 1788626089.094512 punch from 0x006058 to 0x00b535 (0x54de bytes) 000177 1788626089.100723 mapwrite 0x0156e7 thru 0x02255e (0xce78 bytes) 000180 1788626089.211780 read 0x03ae5c thru 0x03d79e (0x2943 bytes) 000181 1788626089.228183 trunc from 0x040000 to 0x00e754 (0x318ab bytes) 000182 1788626089.269496 MIRROR_RESYNC 5 mirrors 000183 1788626091.525404 read 0x00316b thru 0x00583b (0x26d1 bytes) 000184 1788626091.533178 write 0x02710b thru 0x03425a (0xd150 bytes) 000185 1788626091.639874 MIRROR_RESYNC 5 mirrors 000188 1788626094.142430 mapwrite 0x004949 thru 0x010127 (0xb7df bytes) 000189 1788626094.397952 trunc from 0x03425b to 0x019561 (0x1acf9 bytes) 000190 1788626094.432780 MIRROR_RESYNC 5 mirrors 000192 1788626096.252933 mapread 0x012936 thru 0x0138be (0xf89 bytes) 000194 1788626096.264423 trunc from 0x019562 to 0x010895 (0x8ccc bytes) 000195 1788626096.327728 write 0x009205 thru 0x016ab7 (0xd8b3 bytes) 000196 1788626096.336399 trunc from 0x016ab8 to 0x00f168 (0x794f bytes) 000197 1788626096.371364 mapread 0x0002b5 thru 0x00d9a3 (0xd6ef bytes) 000198 1788626096.380688 mapwrite 0x0067e3 thru 0x00e9f8 (0x8216 bytes) 000199 1788626096.430204 mapwrite 0x00c1a5 thru 0x012c86 (0x6ae2 bytes) 000200 1788626096.556907 mapread 0x001beb thru 0x001e4d (0x263 bytes) 000202 1788626096.559433 mapwrite 0x0346c9 thru 0x0348a9 (0x1e1 bytes) 000204 1788626096.661954 punch from 0x0042c7 to 0x004ca4 (0x9de bytes) 000208 1788626096.680978 write 0x03c6ec thru 0x03ffff (0x3914 bytes) 000209 1788626096.686747 read 0x01f59f thru 0x026654 (0x70b6 bytes) 000210 1788626096.697603 read 0x00200f thru 0x00940d (0x73ff bytes) 000211 1788626096.718840 mapread 0x023397 thru 0x02d95f (0xa5c9 bytes) 000212 1788626096.725852 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x347c55b5 (stale) Mirror 5: 0x347c55b5 (stale) Mirror 6: 0x347c55b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x347c55b5 (stale) Mirror 5: 0x347c55b5 (stale) Mirror 6: 0x347c55b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped truncating to largest ever: 0x3b848 000213 1788626097.170693 trunc from 0x040000 to 0x03b847 (0x47b8 bytes) 000214 1788626097.205761 mapwrite 0x0289c5 thru 0x02d868 (0x4ea4 bytes) 000215 1788626097.325968 trunc from 0x03b848 to 0x006379 (0x354ce bytes) 000216 1788626097.351290 punch from 0x004995 to 0x006379 (0x19e5 bytes) 000217 1788626097.361883 read 0x005f83 thru 0x006379 (0x3f7 bytes) 000218 1788626097.369641 read 0x0056ab thru 0x006379 (0xccf bytes) 000219 1788626097.370402 trunc from 0x00637a to 0x024dfe (0x1ea85 bytes) 000220 1788626097.399842 write 0x011977 thru 0x01d6bb (0xbd45 bytes) 000222 1788626097.420004 write 0x02ba78 thru 0x030ca7 (0x5230 bytes) 000223 1788626097.421179 punch from 0x018b13 to 0x01d958 (0x4e46 bytes) 000225 1788626097.444351 MIRROR_RESYNC 4 mirrors 000226 1788626100.375269 write 0x029600 thru 0x0322f3 (0x8cf4 bytes) 000227 1788626100.537678 trunc from 0x0322f4 to 0x009556 (0x28d9d bytes) 000228 1788626100.580659 mapwrite 0x0215f8 thru 0x0233af (0x1db8 bytes) 000229 1788626100.690840 punch from 0x010ccc to 0x020870 (0xfba5 bytes) 000230 1788626100.698469 write 0x018a4e thru 0x01dd2a (0x52dd bytes) 000231 1788626100.713212 mapwrite 0x02f402 thru 0x03c470 (0xd06f bytes) 000233 1788626100.860700 mapwrite 0x03b95b thru 0x03ffff (0x46a5 bytes) 000235 1788626100.981025 mapread 0x009b25 thru 0x013aaf (0x9f8b bytes) 000236 1788626101.027016 write 0x00a0ad thru 0x0118a8 (0x77fc bytes) 000238 1788626101.031700 write 0x00bfb0 thru 0x00c9f4 (0xa45 bytes) 000239 1788626101.033190 mapread 0x03bd6e thru 0x03ffff (0x4292 bytes) 000240 1788626101.041709 MIRROR_RESYNC 4 mirrors 000242 1788626104.134768 mapwrite 0x01df47 thru 0x024b78 (0x6c32 bytes) 000243 1788626104.329794 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) Mirror 6: 0x3dcb15f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) Mirror 6: 0x3dcb15f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000246 1788626104.746342 punch from 0x00fca5 to 0x014bb3 (0x4f0f bytes) 000248 1788626104.756457 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) Mirror 6: 0x3dcb15f9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2487f998 Mirror 7: 0x2487f998 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000249 1788626106.117595 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) Mirror 6: 0x3dcb15f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) Mirror 6: 0x3dcb15f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000250 1788626106.461026 trunc from 0x040000 to 0x0149d8 (0x2b627 bytes) 000252 1788626106.503598 mapwrite 0x036631 thru 0x03ffff (0x99cf bytes) 000253 1788626106.594330 mapwrite 0x03777d thru 0x03d4f5 (0x5d79 bytes) 000255 1788626106.673441 mapread 0x011573 thru 0x020676 (0xf104 bytes) 000256 1788626106.689057 punch from 0x01f325 to 0x020bc4 (0x18a0 bytes) 000258 1788626106.694775 write 0x00c364 thru 0x012901 (0x659e bytes) 000259 1788626106.699839 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000260 1788626107.028707 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3dcb15f9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xed1d8485 Mirror 5: 0xed1d8485 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000262 1788626108.294622 punch from 0x0379d4 to 0x038ff3 (0x1620 bytes) 000263 1788626108.384362 read 0x0337b7 thru 0x03ffff (0xc849 bytes) 000264 1788626108.392399 read 0x00979a thru 0x00f8c8 (0x612f bytes) 000265 1788626108.404597 read 0x003995 thru 0x012a43 (0xf0af bytes) 000266 1788626108.405556 write 0x01c080 thru 0x02bbcc (0xfb4d bytes) 000267 1788626108.408515 mapwrite 0x021916 thru 0x02a3dc (0x8ac7 bytes) 000268 1788626108.455574 read 0x017789 thru 0x01dc13 (0x648b bytes) 000270 1788626108.456871 trunc from 0x040000 to 0x010b42 (0x2f4bd bytes) truncating to largest ever: 0x3cce3 000272 1788626108.476804 trunc from 0x010b43 to 0x03cce2 (0x2c1a0 bytes) 000275 1788626108.500705 punch from 0x03a977 to 0x03cce2 (0x236c bytes) 000276 1788626108.507527 mapwrite 0x025d90 thru 0x02f23a (0x94ab bytes) 000280 1788626108.587028 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cce3): Mirror 5: 0x52c089e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cce3): Mirror 5: 0x52c089e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cce3: skipped 000281 1788626108.893844 trunc from 0x03cce3 to 0x026f82 (0x15d60 bytes) 000283 1788626108.917460 punch from 0x00bf58 to 0x019b48 (0xdbf1 bytes) 000285 1788626108.926357 mapwrite 0x039c6c thru 0x03ffff (0x6394 bytes) 000286 1788626109.034614 trunc from 0x040000 to 0x029060 (0x16f9f bytes) 000287 1788626109.068688 read 0x014005 thru 0x018180 (0x417c bytes) 000288 1788626109.084409 punch from 0x007d7a to 0x00c435 (0x46bc bytes) 000289 1788626109.103536 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29061): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29061): Mirror 5: 0x9d8cd835 (stale) CRC-32 checksum value for chunk [0, 0x29061): Mirror 1: 0x5a3ee547 Mirror 6: 0x5a3ee547 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29061: skipped 000291 1788626111.127693 mapwrite 0x00ecda thru 0x010920 (0x1c47 bytes) 000292 1788626111.375555 write 0x01a5d3 thru 0x01f891 (0x52bf bytes) 000293 1788626111.386045 mapwrite 0x011a62 thru 0x014e8c (0x342b bytes) 000294 1788626111.442497 trunc from 0x029061 to 0x03b869 (0x12809 bytes) 000295 1788626111.465150 mapwrite 0x035f41 thru 0x03ffff (0xa0bf bytes) 000296 1788626111.560195 write 0x015bef thru 0x020f3a (0xb34c bytes) 000302 1788626111.576822 trunc from 0x040000 to 0x015ac1 (0x2a53e bytes) 000303 1788626111.602852 punch from 0x004470 to 0x00f7e2 (0xb373 bytes) 000304 1788626111.612377 mapwrite 0x00ecfa thru 0x0182af (0x95b6 bytes) 000306 1788626111.699829 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x182b0): Mirror 5: 0xdad7b90f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x182b0): Mirror 5: 0xdad7b90f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x182b0: skipped 000307 1788626112.090972 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x182b0): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x182b0): Mirror 5: 0xdad7b90f (stale) CRC-32 checksum value for chunk [0, 0x182b0): Mirror 1: 0xf9ce6469 Mirror 6: 0xf9ce6469 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x182b0: skipped 000309 1788626113.196654 mapread 0x006de9 thru 0x00830c (0x1524 bytes) 000314 1788626113.266927 punch from 0x009156 to 0x013287 (0xa132 bytes) 000316 1788626113.334298 mapwrite 0x003dd5 thru 0x00448b (0x6b7 bytes) 000320 1788626113.404880 write 0x035c6b thru 0x03ffff (0xa395 bytes) 000321 1788626113.407507 trunc from 0x040000 to 0x0212c1 (0x1ed3e bytes) 000323 1788626113.438601 trunc from 0x0212c2 to 0x03994d (0x1868c bytes) 000325 1788626113.453639 read 0x020570 thru 0x02cc44 (0xc6d5 bytes) 000326 1788626113.461890 mapread 0x01ba6d thru 0x021c6d (0x6201 bytes) 000327 1788626113.471162 mapwrite 0x011c9b thru 0x01ec15 (0xcf7b bytes) 000330 1788626113.552437 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3994e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3994e): Mirror 5: 0x2b1e5774 (stale) Mirror 6: 0xd9f41394 (stale) CRC-32 checksum value for chunk [0, 0x3994e): Mirror 1: 0xa3beabb4 Mirror 7: 0xa3beabb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3994e: skipped 000331 1788626114.918488 trunc from 0x03994e to 0x018061 (0x218ec bytes) 000332 1788626115.057985 trunc from 0x018062 to 0x024671 (0xc610 bytes) 000333 1788626115.108829 read 0x01d6c0 thru 0x01fae7 (0x2428 bytes) 000337 1788626115.126768 punch from 0x013cc1 to 0x020a8d (0xcdcd bytes) 000339 1788626115.139236 read 0x0047cb thru 0x0094f2 (0x4d28 bytes) 000342 1788626115.159494 write 0x035193 thru 0x03cdbb (0x7c29 bytes) 000343 1788626115.161763 trunc from 0x03cdbc to 0x01cbea (0x201d1 bytes) 000346 1788626115.187961 trunc from 0x01cbeb to 0x031bd2 (0x14fe8 bytes) 000347 1788626115.206800 mapread 0x02dd21 thru 0x031bd2 (0x3eb2 bytes) 000349 1788626115.221825 read 0x006c3a thru 0x013199 (0xc560 bytes) 000351 1788626115.225194 punch from 0x01b62b to 0x01c9f6 (0x13cc bytes) 000352 1788626115.235339 punch from 0x00491a to 0x0077a0 (0x2e87 bytes) 000356 1788626115.241746 read 0x01ac8e thru 0x026d50 (0xc0c3 bytes) 000357 1788626115.258792 mapwrite 0x015089 thru 0x022d05 (0xdc7d bytes) 000358 1788626115.321791 read 0x01a337 thru 0x01b420 (0x10ea bytes) 000359 1788626115.322408 mapread 0x02cf12 thru 0x02e61e (0x170d bytes) 000360 1788626115.323218 write 0x02e2fb thru 0x031d9a (0x3aa0 bytes) 000361 1788626115.325750 punch from 0x022160 to 0x02b8b0 (0x9751 bytes) 000362 1788626115.339912 read 0x021e33 thru 0x0288e0 (0x6aae bytes) 000363 1788626115.351503 mapwrite 0x0399b0 thru 0x03cbcb (0x321c bytes) 000364 1788626115.445930 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3cbcc): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbcc): Mirror 5: 0x4b10032c (stale) Mirror 6: 0x93707655 (stale) Mirror 7: 0x59cfcb83 (stale) CRC-32 checksum value for chunk [0, 0x3cbcc): Mirror 1: 0x86e78fd3 Mirror 8: 0x86e78fd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbcc: skipped 000365 1788626116.994654 punch from 0x003387 to 0x00f3bd (0xc037 bytes) 000366 1788626117.159588 mapread 0x01b799 thru 0x01bbff (0x467 bytes) 000367 1788626117.168308 write 0x01929f thru 0x0267ba (0xd51c bytes) 000368 1788626117.188670 write 0x018f89 thru 0x01c1ad (0x3225 bytes) 000369 1788626117.202871 trunc from 0x03cbcc to 0x002dcd (0x39dfe bytes) 000370 1788626117.249724 write 0x011e64 thru 0x0165bb (0x4758 bytes) 000371 1788626117.250841 punch from 0x009a14 to 0x00eb86 (0x5173 bytes) 000372 1788626117.294015 punch from 0x011f02 to 0x0165bb (0x46ba bytes) 000375 1788626117.305783 read 0x00f127 thru 0x010edf (0x1db9 bytes) 000376 1788626117.316471 punch from 0x007d1a to 0x00a093 (0x237a bytes) 000378 1788626117.329837 mapwrite 0x01f837 thru 0x02e6a8 (0xee72 bytes) 000379 1788626117.469758 write 0x00fa05 thru 0x01bff7 (0xc5f3 bytes) 000380 1788626117.474397 trunc from 0x02e6a9 to 0x022ef7 (0xb7b1 bytes) 000382 1788626117.530408 write 0x034377 thru 0x03cdfd (0x8a87 bytes) 000383 1788626117.541654 read 0x028842 thru 0x02c73e (0x3efd bytes) 000384 1788626117.561595 trunc from 0x03cdfe to 0x027831 (0x155cc bytes) 000385 1788626117.601950 trunc from 0x027832 to 0x038c30 (0x113ff bytes) 000388 1788626117.671835 trunc from 0x038c31 to 0x01c93c (0x1c2f4 bytes) 000390 1788626117.728477 mapwrite 0x0135a2 thru 0x01c50c (0x8f6b bytes) 000391 1788626117.814392 mapwrite 0x006c81 thru 0x0148c0 (0xdc40 bytes) 000392 1788626117.891869 read 0x00119b thru 0x003291 (0x20f7 bytes) 000393 1788626117.893401 write 0x03efbe thru 0x03ffff (0x1042 bytes) 000395 1788626117.903756 mapwrite 0x018ba4 thru 0x020abb (0x7f18 bytes) 000397 1788626118.048800 mapwrite 0x027309 thru 0x029b10 (0x2808 bytes) 000399 1788626118.150567 punch from 0x0019c2 to 0x00a636 (0x8c75 bytes) 000400 1788626118.165397 write 0x02d690 thru 0x03d373 (0xfce4 bytes) 000401 1788626118.167115 mapwrite 0x026297 thru 0x02d0fc (0x6e66 bytes) 000402 1788626118.247290 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xed1d8485 (stale) Mirror 6: 0xcbcfccce (stale) Mirror 8: 0x61a31b3f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xed1d8485 (stale) Mirror 6: 0xcbcfccce (stale) Mirror 8: 0x61a31b3f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000403 1788626118.640990 punch from 0x003cb2 to 0x00f0e6 (0xb435 bytes) 000404 1788626118.646824 mapwrite 0x0185df thru 0x020aeb (0x850d bytes) 000405 1788626118.739171 mapread 0x017b87 thru 0x02260a (0xaa84 bytes) 000406 1788626118.741072 mapread 0x03f5a7 thru 0x03ffff (0xa59 bytes) 000407 1788626118.751606 trunc from 0x040000 to 0x02a788 (0x15877 bytes) 000409 1788626118.785589 MIRROR_RESYNC 4 mirrors 000410 1788626120.564781 mapread 0x00a2d2 thru 0x013cef (0x9a1e bytes) 000411 1788626120.592357 trunc from 0x02a789 to 0x031ae0 (0x7358 bytes) 000412 1788626120.698316 punch from 0x02d261 to 0x031ae0 (0x4880 bytes) 000416 1788626120.708499 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31ae1): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ae1): Mirror 5: 0x5128b4b2 (stale) Mirror 6: 0x5128b4b2 (stale) Mirror 8: 0x5128b4b2 (stale) CRC-32 checksum value for chunk [0, 0x31ae1): Mirror 1: 0x5128b4b2 Mirror 9: 0x5128b4b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ae1: skipped 000417 1788626122.413998 trunc from 0x031ae1 to 0x000fe0 (0x30b00 bytes) 000418 1788626122.497990 mapread 0x000065 thru 0x000fe0 (0xf7c bytes) 000420 1788626122.506535 trunc from 0x000fe1 to 0x0361b0 (0x351d0 bytes) 000421 1788626122.542803 write 0x01c057 thru 0x02b35b (0xf305 bytes) 000422 1788626122.556690 punch from 0x028c73 to 0x02c8f0 (0x3c7e bytes) 000423 1788626122.585675 punch from 0x02c6d6 to 0x0361b0 (0x9adb bytes) 000427 1788626122.599726 mapwrite 0x000a43 thru 0x0051a8 (0x4766 bytes) 000429 1788626122.686130 write 0x02d0f2 thru 0x032a4a (0x5959 bytes) 000431 1788626122.700713 write 0x02b673 thru 0x033b05 (0x8493 bytes) 000432 1788626122.715858 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x361b1): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x361b1): Mirror 5: 0xf308eec0 (stale) Mirror 6: 0xf308eec0 (stale) Mirror 8: 0xf308eec0 (stale) Mirror 9: 0xf308eec0 (stale) CRC-32 checksum value for chunk [0, 0x361b1): Mirror 1: 0xcc971f0a Mirror 10: 0xcc971f0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x361b1: skipped 000433 1788626124.509718 mapread 0x028160 thru 0x029af7 (0x1998 bytes) 000434 1788626124.587438 read 0x01bab8 thru 0x01efa9 (0x34f2 bytes) 000435 1788626124.648667 mapwrite 0x022ea0 thru 0x02a20c (0x736d bytes) 000436 1788626125.033538 write 0x00e250 thru 0x01333d (0x50ee bytes) 000438 1788626125.054244 write 0x00391b thru 0x004876 (0xf5c bytes) 000440 1788626125.078821 mapread 0x0236dd thru 0x025725 (0x2049 bytes) 000442 1788626125.081698 trunc from 0x0361b1 to 0x023ddf (0x123d1 bytes) 000446 1788626125.166730 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x23de0): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23de0): Mirror 5: 0xe2b0f391 (stale) Mirror 6: 0xe2b0f391 (stale) Mirror 8: 0xe2b0f391 (stale) Mirror 9: 0xe2b0f391 (stale) Mirror 10: 0x25cd1159 (stale) CRC-32 checksum value for chunk [0, 0x23de0): Mirror 1: 0x8c59a177 Mirror 11: 0x8c59a177 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23de0: skipped 000447 1788626126.920776 trunc from 0x023de0 to 0x02125d (0x2b82 bytes) 000448 1788626127.043360 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2125e): Mirror 5: 0x62aed622 (stale) Mirror 6: 0x62aed622 (stale) Mirror 8: 0x62aed622 (stale) Mirror 10: 0x41ca1d67 (stale) Mirror 11: 0x6e5178a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2125e): Mirror 5: 0x62aed622 (stale) Mirror 6: 0x62aed622 (stale) Mirror 8: 0x62aed622 (stale) Mirror 10: 0x41ca1d67 (stale) Mirror 11: 0x6e5178a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2125e: skipped 000450 1788626127.482462 read 0x01f2ef thru 0x02125d (0x1f6f bytes) 000451 1788626127.490549 write 0x0115c2 thru 0x01ae80 (0x98bf bytes) 000452 1788626127.513029 write 0x0099e9 thru 0x00b188 (0x17a0 bytes) 000453 1788626127.532160 punch from 0x004210 to 0x0109be (0xc7af bytes) 000454 1788626127.576154 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2125e): Mirror 5: 0x62aed622 (stale) Mirror 8: 0x62aed622 (stale) Mirror 10: 0x41ca1d67 (stale) Mirror 11: 0x6e5178a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2125e): Mirror 5: 0x62aed622 (stale) Mirror 8: 0x62aed622 (stale) Mirror 10: 0x41ca1d67 (stale) Mirror 11: 0x6e5178a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2125e: skipped 000457 1788626128.022997 read 0x01aa14 thru 0x02125d (0x684a bytes) 000458 1788626128.044399 read 0x00db25 thru 0x011e2b (0x4307 bytes) 000461 1788626128.058167 punch from 0x01ec67 to 0x01ec6b (0x5 bytes) 000463 1788626128.065455 mapread 0x00503d thru 0x012675 (0xd639 bytes) 000464 1788626128.067102 trunc from 0x02125e to 0x025833 (0x45d6 bytes) 000469 1788626128.095994 write 0x02e90c thru 0x03038c (0x1a81 bytes) 000470 1788626128.098179 mapread 0x028d54 thru 0x03038c (0x7639 bytes) 000471 1788626128.111048 punch from 0x02d9c5 to 0x03038c (0x29c8 bytes) 000472 1788626128.143375 mapread 0x020531 thru 0x027283 (0x6d53 bytes) 000475 1788626128.151587 MIRROR_RESYNC 5 mirrors 000476 1788626130.760362 trunc from 0x03038d to 0x011351 (0x1f03b bytes) truncating to largest ever: 0x3ddac 000478 1788626130.823526 trunc from 0x011352 to 0x03ddab (0x2ca5a bytes) 000479 1788626130.844235 read 0x015f58 thru 0x0207f3 (0xa89c bytes) 000480 1788626130.852890 trunc from 0x03ddac to 0x011db3 (0x2bff8 bytes) 000481 1788626130.877726 read 0x0058dc thru 0x00d32c (0x7a51 bytes) 000482 1788626130.885461 punch from 0x0038c0 to 0x01008c (0xc7cd bytes) 000483 1788626130.894494 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11db4): Mirror 5: 0xa65a51fd (stale) Mirror 8: 0xa65a51fd (stale) Mirror 10: 0xa65a51fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11db4): Mirror 5: 0xa65a51fd (stale) Mirror 8: 0xa65a51fd (stale) Mirror 10: 0xa65a51fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11db4: skipped 000484 1788626131.368490 mapwrite 0x02511d thru 0x02ec54 (0x9b38 bytes) 000485 1788626131.568358 punch from 0x00bf7e to 0x011d57 (0x5dda bytes) 000487 1788626131.613439 mapread 0x010ac9 thru 0x011ede (0x1416 bytes) 000488 1788626131.658859 write 0x0171c8 thru 0x026537 (0xf370 bytes) 000490 1788626131.665955 write 0x029411 thru 0x035655 (0xc245 bytes) 000492 1788626131.676131 write 0x01425e thru 0x020192 (0xbf35 bytes) 000493 1788626131.684844 write 0x02e0a3 thru 0x03bc59 (0xdbb7 bytes) 000494 1788626131.695502 mapread 0x02e0e0 thru 0x0317a6 (0x36c7 bytes) 000495 1788626131.699343 mapwrite 0x03b9a7 thru 0x03fa54 (0x40ae bytes) 000496 1788626131.887764 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa55): Mirror 5: 0x9c65cb66 (stale) Mirror 10: 0x9c65cb66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa55): Mirror 5: 0x9c65cb66 (stale) Mirror 10: 0x9c65cb66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa55: skipped 000497 1788626132.540595 read 0x01e9bd thru 0x02db10 (0xf154 bytes) 000498 1788626132.554376 read 0x0026da thru 0x00494e (0x2275 bytes) 000499 1788626132.570006 read 0x01fc94 thru 0x020ff4 (0x1361 bytes) 000500 1788626132.570599 read 0x031949 thru 0x03e2e2 (0xc99a bytes) 000502 1788626132.571657 punch from 0x03ca32 to 0x03fa54 (0x3023 bytes) 000503 1788626132.577632 trunc from 0x03fa55 to 0x01a7cb (0x25289 bytes) 000506 1788626132.596317 read 0x0195a9 thru 0x01a7cb (0x1223 bytes) 000507 1788626132.597065 trunc from 0x01a7cc to 0x010cae (0x9b1d bytes) 000509 1788626132.617958 write 0x03f933 thru 0x03ffff (0x6cd bytes) 000510 1788626132.618977 mapread 0x00947f thru 0x00cf2a (0x3aac bytes) 000511 1788626132.622993 mapread 0x015a48 thru 0x02047b (0xaa34 bytes) 000512 1788626132.633019 punch from 0x024f8b to 0x0333fa (0xe470 bytes) 000514 1788626132.650593 write 0x00834a thru 0x010855 (0x850c bytes) 000515 1788626132.664422 MIRROR_RESYNC 3 mirrors 000516 1788626134.833639 write 0x01e6dd thru 0x02035d (0x1c81 bytes) 000517 1788626134.893070 trunc from 0x040000 to 0x0049d8 (0x3b627 bytes) 000518 1788626134.927869 mapread 0x002562 thru 0x0049d8 (0x2477 bytes) 000519 1788626134.951372 trunc from 0x0049d9 to 0x03ae54 (0x3647c bytes) 000522 1788626134.987778 read 0x020a7c thru 0x02ffb6 (0xf53b bytes) 000527 1788626135.014210 read 0x02733b thru 0x029c7c (0x2942 bytes) 000529 1788626135.015348 write 0x030821 thru 0x03c0fe (0xb8de bytes) 000530 1788626135.069399 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c0ff): Mirror 5: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0ff): Mirror 5: 0x2f632391 (stale) Mirror 10: 0x2f632391 (stale) CRC-32 checksum value for chunk [0, 0x3c0ff): Mirror 1: 0xf50e1471 Mirror 11: 0xf50e1471 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0ff: skipped 000531 1788626136.297654 mapwrite 0x021b4f thru 0x022140 (0x5f2 bytes) 000532 1788626136.427509 mapwrite 0x019443 thru 0x01bfe0 (0x2b9e bytes) 000533 1788626136.482019 write 0x02d550 thru 0x033f39 (0x69ea bytes) 000534 1788626136.495344 trunc from 0x03c0ff to 0x01ccfc (0x1f402 bytes) 000535 1788626136.558720 mapwrite 0x00d206 thru 0x00ec6a (0x1a65 bytes) 000536 1788626136.616937 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ccfd): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ccfd): Mirror 5: 0xccb67dbf (stale) Mirror 10: 0xccb67dbf (stale) Mirror 11: 0x9e7b4fca (stale) CRC-32 checksum value for chunk [0, 0x1ccfd): Mirror 1: 0x70c3685d Mirror 12: 0x70c3685d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ccfd: skipped 000537 1788626138.357554 mapwrite 0x01ee5a thru 0x021d24 (0x2ecb bytes) 000539 1788626138.614556 read 0x01316b thru 0x0205f3 (0xd489 bytes) 000540 1788626138.624221 write 0x001d96 thru 0x00e308 (0xc573 bytes) 000542 1788626138.669367 trunc from 0x021d25 to 0x03d0a4 (0x1b380 bytes) 000544 1788626138.813507 MIRROR_RESYNC 5 mirrors 000545 1788626141.077699 mapread 0x0152b4 thru 0x02442e (0xf17b bytes) 000546 1788626141.121754 write 0x001dfc thru 0x00aa93 (0x8c98 bytes) 000548 1788626141.249840 punch from 0x03544f to 0x03d0a4 (0x7c56 bytes) 000549 1788626141.274429 punch from 0x02cd8e to 0x039819 (0xca8c bytes) 000553 1788626141.303592 read 0x030646 thru 0x030ebb (0x876 bytes) 000554 1788626141.311693 write 0x00eb38 thru 0x0160fe (0x75c7 bytes) 000555 1788626141.329935 punch from 0x03187e to 0x03d0a4 (0xb827 bytes) 000556 1788626141.358802 write 0x01c5b7 thru 0x028ae4 (0xc52e bytes) 000557 1788626141.398503 punch from 0x023506 to 0x031de8 (0xe8e3 bytes) 000560 1788626141.415502 punch from 0x031d79 to 0x03d0a4 (0xb32c bytes) 000562 1788626141.427496 write 0x00d53b thru 0x01a909 (0xd3cf bytes) 000563 1788626141.448353 mapread 0x0070b3 thru 0x010b77 (0x9ac5 bytes) 000564 1788626141.464431 punch from 0x01aaa7 to 0x0247ad (0x9d07 bytes) 000565 1788626141.499578 punch from 0x01e7b9 to 0x025f60 (0x77a8 bytes) 000567 1788626141.517711 trunc from 0x03d0a5 to 0x00272c (0x3a978 bytes) 000568 1788626141.568960 punch from 0x00023a to 0x002094 (0x1e5b bytes) 000569 1788626141.579013 write 0x02d368 thru 0x036a45 (0x96de bytes) 000571 1788626141.591965 mapread 0x00b452 thru 0x00bcc0 (0x86f bytes) 000572 1788626141.610502 trunc from 0x036a46 to 0x034e7f (0x1bc6 bytes) 000573 1788626141.647287 trunc from 0x034e80 to 0x007ec5 (0x2cfba bytes) 000574 1788626141.675242 write 0x01c047 thru 0x02ba9f (0xfa59 bytes) 000576 1788626141.681349 mapread 0x01cbe8 thru 0x024dd7 (0x81f0 bytes) 000579 1788626141.693779 punch from 0x026165 to 0x02ba9f (0x593b bytes) 000582 1788626141.748744 read 0x02a740 thru 0x02ba9f (0x1360 bytes) 000583 1788626141.763308 write 0x02340e thru 0x030ff7 (0xdbea bytes) 000584 1788626141.766242 punch from 0x012f02 to 0x016d55 (0x3e54 bytes) 000585 1788626141.804573 mapwrite 0x0365e5 thru 0x03928d (0x2ca9 bytes) 000586 1788626141.971050 mapwrite 0x0025a1 thru 0x00ddf6 (0xb856 bytes) 000587 1788626142.145922 MIRROR_RESYNC 5 mirrors 000588 1788626144.819815 read 0x02469c thru 0x02c6d5 (0x803a bytes) 000591 1788626144.835757 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) 000592 1788626145.366999 mapread 0x008ea8 thru 0x015382 (0xc4db bytes) 000593 1788626145.420730 trunc from 0x03928e to 0x018ad3 (0x207ba bytes) 000594 1788626145.588354 write 0x03c398 thru 0x03ffff (0x3c68 bytes) 000595 1788626145.591666 trunc from 0x040000 to 0x01e14d (0x21eb2 bytes) 000596 1788626145.620670 read 0x0115d9 thru 0x0188b7 (0x72df bytes) 000599 1788626145.635411 punch from 0x0080c7 to 0x012951 (0xa88b bytes) 000600 1788626145.642902 mapwrite 0x0166a8 thru 0x01713f (0xa98 bytes) 000601 1788626145.719770 read 0x0011d3 thru 0x0043de (0x320c bytes) 000602 1788626145.741743 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1e14e): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e14e): Mirror 5: 0xdfd21a7f (stale) Mirror 10: 0xdfd21a7f (stale) Mirror 11: 0xdfd21a7f (stale) CRC-32 checksum value for chunk [0, 0x1e14e): Mirror 1: 0x8977b412 Mirror 12: 0x8977b412 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e14e: skipped 000605 1788626147.400637 mapwrite 0x02af83 thru 0x032778 (0x77f6 bytes) 000609 1788626147.586214 read 0x00be11 thru 0x014763 (0x8953 bytes) 000610 1788626147.596240 read 0x010399 thru 0x01e831 (0xe499 bytes) 000611 1788626147.607022 trunc from 0x032779 to 0x003e96 (0x2e8e2 bytes) 000612 1788626147.667792 write 0x022a65 thru 0x02e2af (0xb84b bytes) 000613 1788626147.675681 mapwrite 0x021a10 thru 0x02ab69 (0x915a bytes) 000614 1788626147.852541 mapread 0x005e78 thru 0x011b23 (0xbcac bytes) 000616 1788626148.007249 mapwrite 0x024a89 thru 0x02b4e5 (0x6a5d bytes) 000617 1788626148.113064 mapwrite 0x01cc7a thru 0x0271ee (0xa575 bytes) 000619 1788626148.267222 punch from 0x0165a4 to 0x01b536 (0x4f93 bytes) 000620 1788626148.277552 trunc from 0x02e2b0 to 0x0289b8 (0x58f7 bytes) 000621 1788626148.299671 read 0x00bcc4 thru 0x016ddd (0xb11a bytes) 000622 1788626148.322775 mapwrite 0x035b0e thru 0x03ffff (0xa4f2 bytes) 000623 1788626148.439904 punch from 0x00121b to 0x009f1e (0x8d04 bytes) 000624 1788626148.451724 trunc from 0x040000 to 0x02405f (0x1bfa0 bytes) 000625 1788626148.476760 punch from 0x000c45 to 0x000f5b (0x317 bytes) 000626 1788626148.489745 write 0x0368ef thru 0x03dea3 (0x75b5 bytes) 000627 1788626148.493386 punch from 0x0271be to 0x02b04f (0x3e92 bytes) 000628 1788626148.523585 mapwrite 0x0231ec thru 0x027dae (0x4bc3 bytes) 000629 1788626148.618761 mapread 0x003671 thru 0x00f519 (0xbea9 bytes) 000630 1788626148.661186 mapwrite 0x037b91 thru 0x03e043 (0x64b3 bytes) 000634 1788626148.789342 mapwrite 0x0247e8 thru 0x02eb8f (0xa3a8 bytes) 000635 1788626148.923672 punch from 0x01f4b0 to 0x026cd1 (0x7822 bytes) 000637 1788626148.934974 mapwrite 0x01e7b5 thru 0x027964 (0x91b0 bytes) 000638 1788626149.215632 trunc from 0x03e044 to 0x01547f (0x28bc4 bytes) 000640 1788626149.237276 trunc from 0x015480 to 0x00d627 (0x7e58 bytes) 000641 1788626149.285252 punch from 0x00a3a7 to 0x00d627 (0x3281 bytes) 000642 1788626149.297778 read 0x003a70 thru 0x0045f3 (0xb84 bytes) 000645 1788626149.314449 punch from 0x003134 to 0x003f00 (0xdcd bytes) 000646 1788626149.332754 read 0x009533 thru 0x00ceaa (0x3978 bytes) 000647 1788626149.346189 mapwrite 0x01213f thru 0x01b794 (0x9656 bytes) 000648 1788626149.506619 mapwrite 0x00cc22 thru 0x01a17d (0xd55c bytes) 000649 1788626149.646118 punch from 0x00b2b7 to 0x019cec (0xea36 bytes) 000650 1788626149.656526 mapwrite 0x02de01 thru 0x02e7dc (0x9dc bytes) 000651 1788626149.807260 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e7dd): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7dd): Mirror 5: 0xffabba3b (stale) Mirror 10: 0xffabba3b (stale) Mirror 11: 0xffabba3b (stale) Mirror 12: 0x2dd5f8ae (stale) CRC-32 checksum value for chunk [0, 0x2e7dd): Mirror 1: 0xba1ccde9 Mirror 13: 0xba1ccde9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7dd: skipped 000652 1788626151.586707 punch from 0x01921d to 0x0206dd (0x74c1 bytes) 000653 1788626151.682853 mapwrite 0x01a6b5 thru 0x01c2e2 (0x1c2e bytes) 000654 1788626151.840610 MIRROR_RESYNC 6 mirrors 000656 1788626154.837693 write 0x00c1f4 thru 0x00f41b (0x3228 bytes) 000657 1788626154.957897 mapwrite 0x000072 thru 0x00f968 (0xf8f7 bytes) 000659 1788626155.038928 mapread 0x01cb72 thru 0x0222ab (0x573a bytes) 000661 1788626155.051506 mapwrite 0x0352fb thru 0x0356a5 (0x3ab bytes) 000662 1788626155.139467 MIRROR_RESYNC 6 mirrors 000664 1788626157.501058 MIRROR_EXTEND to 7 mirrors 000665 1788626158.427633 punch from 0x006923 to 0x0121de (0xb8bc bytes) 000666 1788626158.520353 punch from 0x01d214 to 0x028a2e (0xb81b bytes) 000667 1788626158.531019 mapwrite 0x001422 thru 0x00b72f (0xa30e bytes) 000668 1788626158.608623 mapwrite 0x038999 thru 0x03ffff (0x7667 bytes) 000669 1788626158.693546 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8fc4ad2d (stale) Mirror 11: 0x8fc4ad2d (stale) Mirror 12: 0x8fc4ad2d (stale) Mirror 13: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8fc4ad2d (stale) Mirror 11: 0x8fc4ad2d (stale) Mirror 12: 0x8fc4ad2d (stale) Mirror 13: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000670 1788626159.218890 punch from 0x02e7d8 to 0x037834 (0x905d bytes) 000673 1788626159.231052 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8fc4ad2d (stale) Mirror 12: 0x8fc4ad2d (stale) Mirror 13: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8fc4ad2d (stale) Mirror 12: 0x8fc4ad2d (stale) Mirror 13: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000674 1788626159.781788 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8fc4ad2d (stale) Mirror 12: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8fc4ad2d (stale) Mirror 12: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000676 1788626160.253924 read 0x028c0e thru 0x02e92a (0x5d1d bytes) 000677 1788626160.280366 write 0x00f961 thru 0x01dd63 (0xe403 bytes) 000678 1788626160.300005 mapread 0x032fad thru 0x03730e (0x4362 bytes) 000679 1788626160.348549 write 0x0072c5 thru 0x012ff5 (0xbd31 bytes) 000682 1788626160.356838 trunc from 0x040000 to 0x013cb0 (0x2c34f bytes) 000684 1788626160.379855 mapwrite 0x01751c thru 0x01d8ea (0x63cf bytes) 000685 1788626160.501196 mapwrite 0x00c7f5 thru 0x01249e (0x5caa bytes) 000686 1788626160.553300 mapread 0x00f74d thru 0x01a3dd (0xac91 bytes) 000687 1788626160.555037 mapwrite 0x00d427 thru 0x0193fd (0xbfd7 bytes) 000690 1788626160.661296 trunc from 0x01d8eb to 0x012462 (0xb488 bytes) 000691 1788626160.695367 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x12463): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12463): Mirror 10: 0xd5dc8e5d (stale) Mirror 12: 0xd5dc8e5d (stale) Mirror 14: 0xd5dc8e5d (stale) CRC-32 checksum value for chunk [0, 0x12463): Mirror 1: 0xd4eb0e6a Mirror 15: 0xd4eb0e6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12463: skipped 000692 1788626162.097570 trunc from 0x012463 to 0x008e10 (0x9652 bytes) 000693 1788626162.270867 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8e11): Mirror 12: 0x488a6872 (stale) Mirror 14: 0x488a6872 (stale) Mirror 15: 0x1986f023 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8e11): Mirror 12: 0x488a6872 (stale) Mirror 14: 0x488a6872 (stale) Mirror 15: 0x1986f023 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8e11: skipped 000694 1788626162.789695 mapwrite 0x006f25 thru 0x010f75 (0xa051 bytes) 000695 1788626163.039602 punch from 0x002e7c to 0x0053fe (0x2583 bytes) 000696 1788626163.047810 mapread 0x005e61 thru 0x00f98b (0x9b2b bytes) 000697 1788626163.061372 punch from 0x0066e7 to 0x00b2f7 (0x4c11 bytes) 000699 1788626163.092969 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x10f76): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10f76): Mirror 12: 0xe14b7357 (stale) Mirror 14: 0xe14b7357 (stale) Mirror 15: 0x149b1f50 (stale) CRC-32 checksum value for chunk [0, 0x10f76): Mirror 1: 0x1e4ba2da Mirror 16: 0x1e4ba2da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10f76: skipped 000700 1788626164.576706 read 0x007b0b thru 0x00f120 (0x7616 bytes) 000702 1788626164.608713 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x10f76): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10f76): Mirror 12: 0xe14b7357 (stale) Mirror 14: 0xe14b7357 (stale) Mirror 15: 0x149b1f50 (stale) CRC-32 checksum value for chunk [0, 0x10f76): Mirror 1: 0x1e4ba2da Mirror 16: 0x1e4ba2da Mirror 17: 0x1e4ba2da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10f76: skipped 000703 1788626165.889511 trunc from 0x010f76 to 0x015438 (0x44c3 bytes) 000705 1788626166.017032 write 0x0166ba thru 0x0169e0 (0x327 bytes) 000706 1788626166.018395 mapwrite 0x000af9 thru 0x00d344 (0xc84c bytes) 000707 1788626166.143223 punch from 0x01652b to 0x0169e0 (0x4b6 bytes) 000709 1788626166.149844 trunc from 0x0169e1 to 0x026ebd (0x104dd bytes) 000710 1788626166.171444 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x26ebe): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ebe): Mirror 12: 0x2bfdd72b (stale) Mirror 14: 0x2bfdd72b (stale) Mirror 15: 0x592fd449 (stale) Mirror 16: 0x8ce6f4aa (stale) Mirror 17: 0x8ce6f4aa (stale) CRC-32 checksum value for chunk [0, 0x26ebe): Mirror 1: 0x7843be87 Mirror 18: 0x7843be87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ebe: skipped 000711 1788626167.501943 read 0x0234ed thru 0x026ebd (0x39d1 bytes) 000712 1788626167.535616 mapread 0x00ee43 thru 0x018992 (0x9b50 bytes) 000714 1788626167.609713 trunc from 0x026ebe to 0x009593 (0x1d92a bytes) 000716 1788626167.703743 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x9594): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9594): Mirror 12: 0xc91a623 (stale) Mirror 14: 0xc91a623 (stale) Mirror 15: 0xccb4860e (stale) Mirror 16: 0x4042e56f (stale) Mirror 17: 0x4042e56f (stale) Mirror 18: 0x3cbda5c1 (stale) CRC-32 checksum value for chunk [0, 0x9594): Mirror 1: 0x3cbda5c1 Mirror 19: 0x3cbda5c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9594: skipped 000717 1788626169.172729 mapwrite 0x030af7 thru 0x038b57 (0x8061 bytes) 000719 1788626169.394404 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38b58): Mirror 12: 0x124836a3 (stale) Mirror 14: 0x124836a3 (stale) Mirror 15: 0x93e4eee4 (stale) Mirror 16: 0xde9ebd57 (stale) Mirror 18: 0xf24c47ed (stale) Mirror 19: 0xff0796e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38b58): Mirror 12: 0x124836a3 (stale) Mirror 14: 0x124836a3 (stale) Mirror 15: 0x93e4eee4 (stale) Mirror 16: 0xde9ebd57 (stale) Mirror 18: 0xf24c47ed (stale) Mirror 19: 0xff0796e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38b58: skipped 000721 1788626169.857140 mapwrite 0x022fd1 thru 0x0267d7 (0x3807 bytes) 000722 1788626169.956477 trunc from 0x038b58 to 0x010b06 (0x28051 bytes) 000724 1788626169.993052 mapwrite 0x03eaf9 thru 0x03ffff (0x1507 bytes) 000725 1788626170.125177 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) Mirror 15: 0x63566f28 (stale) Mirror 16: 0xf1a8e1af (stale) Mirror 19: 0xda5f4372 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x8fc4ad2d (stale) Mirror 14: 0x8fc4ad2d (stale) Mirror 15: 0x63566f28 (stale) Mirror 16: 0xf1a8e1af (stale) Mirror 19: 0xda5f4372 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000726 1788626170.732223 write 0x002937 thru 0x0123a2 (0xfa6c bytes) 000727 1788626170.750911 mapread 0x0130d2 thru 0x015766 (0x2695 bytes) 000728 1788626170.772656 mapwrite 0x0230dd thru 0x028d97 (0x5cbb bytes) 000730 1788626170.871459 punch from 0x020cde to 0x02efdb (0xe2fe bytes) 000732 1788626170.884469 trunc from 0x040000 to 0x00f93f (0x306c0 bytes) 000733 1788626170.907413 trunc from 0x00f940 to 0x013a1a (0x40db bytes) 000736 1788626170.935954 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x13a1b): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13a1b): Mirror 12: 0x2376b0a3 (stale) Mirror 14: 0x2376b0a3 (stale) Mirror 15: 0xe1571b96 (stale) Mirror 16: 0x48c743a4 (stale) Mirror 19: 0x84f097c0 (stale) CRC-32 checksum value for chunk [0, 0x13a1b): Mirror 1: 0xf51cd0d8 Mirror 20: 0xf51cd0d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13a1b: skipped 000737 1788626172.622133 write 0x013b81 thru 0x01d43a (0x98ba bytes) 000739 1788626172.718545 write 0x0257d9 thru 0x02bb90 (0x63b8 bytes) 000741 1788626172.723427 punch from 0x026155 to 0x02bb90 (0x5a3c bytes) 000742 1788626172.769710 trunc from 0x02bb91 to 0x0130d7 (0x18ab9 bytes) 000744 1788626172.809687 mapread 0x003031 thru 0x009ca8 (0x6c78 bytes) 000746 1788626172.869772 mapwrite 0x03066c thru 0x0320d7 (0x1a6c bytes) 000747 1788626172.993938 punch from 0x02c3e5 to 0x02ffcb (0x3be7 bytes) 000748 1788626173.002763 trunc from 0x0320d8 to 0x027cdc (0xa3fb bytes) 000749 1788626173.035056 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x27cdd): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27cdd): Mirror 12: 0x875a8d12 (stale) Mirror 14: 0x875a8d12 (stale) Mirror 15: 0xfa2bd77a (stale) Mirror 16: 0xc9f21c3f (stale) Mirror 19: 0x74e75920 (stale) Mirror 20: 0xb8de966f (stale) CRC-32 checksum value for chunk [0, 0x27cdd): Mirror 1: 0xb8de966f Mirror 21: 0xb8de966f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27cdd: skipped 000750 1788626174.704551 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27cdd): Mirror 12: 0x875a8d12 (stale) Mirror 15: 0xfa2bd77a (stale) Mirror 16: 0xc9f21c3f (stale) Mirror 19: 0x74e75920 (stale) Mirror 20: 0xb8de966f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27cdd): Mirror 12: 0x875a8d12 (stale) Mirror 15: 0xfa2bd77a (stale) Mirror 16: 0xc9f21c3f (stale) Mirror 19: 0x74e75920 (stale) Mirror 20: 0xb8de966f (stale) CRC-32 checksum value for chunk [0, 0x27cdd): Mirror 1: 0xb8de966f Mirror 21: 0xb8de966f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27cdd: skipped 000752 1788626175.860431 mapwrite 0x002130 thru 0x003c32 (0x1b03 bytes) 000753 1788626176.192225 trunc from 0x027cdd to 0x02b439 (0x375d bytes) 000754 1788626176.226628 mapread 0x0061d2 thru 0x00ff2c (0x9d5b bytes) 000755 1788626176.228953 write 0x03dfd2 thru 0x03ffff (0x202e bytes) 000756 1788626176.231589 punch from 0x033e05 to 0x037b0f (0x3d0b bytes) 000757 1788626176.248542 read 0x03340c thru 0x03b0fd (0x7cf2 bytes) 000758 1788626176.258049 punch from 0x03e5a0 to 0x03ffff (0x1a60 bytes) 000759 1788626176.266476 mapread 0x00e0fb thru 0x0153a8 (0x72ae bytes) 000760 1788626176.276777 write 0x00a548 thru 0x017bd9 (0xd692 bytes) 000761 1788626176.278051 punch from 0x0396e2 to 0x03fdd2 (0x66f1 bytes) 000763 1788626176.300606 read 0x00efc6 thru 0x01a1ca (0xb205 bytes) 000764 1788626176.319812 trunc from 0x040000 to 0x0391ba (0x6e45 bytes) 000765 1788626176.337921 punch from 0x0209e9 to 0x027274 (0x688c bytes) 000766 1788626176.344604 trunc from 0x0391bb to 0x000a55 (0x38765 bytes) 000767 1788626176.363333 MIRROR_RESYNC 7 mirrors 000768 1788626177.818697 mapwrite 0x0269cf thru 0x02ad18 (0x434a bytes) 000769 1788626177.984618 mapread 0x018c5f thru 0x0282a5 (0xf647 bytes) 000772 1788626177.998254 write 0x01bbbf thru 0x027725 (0xbb67 bytes) 000773 1788626178.000392 mapread 0x009101 thru 0x016e4f (0xdd4f bytes) 000774 1788626178.011189 write 0x03080d thru 0x03f5f5 (0xede9 bytes) 000776 1788626178.014714 mapread 0x02e9d5 thru 0x03d177 (0xe7a3 bytes) 000777 1788626178.042280 MIRROR_RESYNC 7 mirrors 000780 1788626180.736267 trunc from 0x03f5f6 to 0x03d3d2 (0x2223 bytes) 000781 1788626180.888569 read 0x02e684 thru 0x034907 (0x6284 bytes) 000783 1788626180.920209 mapwrite 0x03eda8 thru 0x03ffff (0x1258 bytes) 000786 1788626181.117811 punch from 0x02a639 to 0x033e09 (0x97d1 bytes) 000787 1788626181.141408 mapread 0x01f6ac thru 0x024c16 (0x556b bytes) 000788 1788626181.160769 read 0x03f4ba thru 0x03ffff (0xb46 bytes) 000789 1788626181.162420 mapread 0x03704a thru 0x038f6f (0x1f26 bytes) 000790 1788626181.178841 read 0x037f2b thru 0x03ffff (0x80d5 bytes) 000791 1788626181.188042 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x4e5320e3 (stale) Mirror 16: 0x4e5320e3 (stale) Mirror 19: 0x4e5320e3 (stale) Mirror 20: 0x4e5320e3 (stale) Mirror 21: 0x4e5320e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x4e5320e3 (stale) Mirror 16: 0x4e5320e3 (stale) Mirror 19: 0x4e5320e3 (stale) Mirror 20: 0x4e5320e3 (stale) Mirror 21: 0x4e5320e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000792 1788626181.769053 mapwrite 0x0096ee thru 0x0190bc (0xf9cf bytes) 000793 1788626181.908220 mapread 0x025941 thru 0x02bc42 (0x6302 bytes) 000795 1788626181.927550 write 0x0032ed thru 0x00db17 (0xa82b bytes) 000796 1788626181.936254 mapread 0x01e2ce thru 0x0247a0 (0x64d3 bytes) 000799 1788626181.939750 punch from 0x0148ed to 0x01c4b3 (0x7bc7 bytes) 000800 1788626181.966309 trunc from 0x040000 to 0x00ca0b (0x335f4 bytes) 000802 1788626182.023627 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xca0c): Mirror 15: 0xebb3176b (stale) Mirror 16: 0xebb3176b (stale) Mirror 20: 0xebb3176b (stale) Mirror 21: 0xebb3176b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xca0c): Mirror 15: 0xebb3176b (stale) Mirror 16: 0xebb3176b (stale) Mirror 20: 0xebb3176b (stale) Mirror 21: 0xebb3176b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xca0c: skipped 000803 1788626182.471291 read 0x008b3b thru 0x00ca0b (0x3ed1 bytes) 000807 1788626182.492537 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xca0c): Mirror 15: 0xebb3176b (stale) Mirror 20: 0xebb3176b (stale) Mirror 21: 0xebb3176b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xca0c): Mirror 15: 0xebb3176b (stale) Mirror 20: 0xebb3176b (stale) Mirror 21: 0xebb3176b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xca0c: skipped 000809 1788626183.020701 mapwrite 0x038d89 thru 0x03e716 (0x598e bytes) 000811 1788626183.126454 punch from 0x01700f to 0x0203a9 (0x939b bytes) 000812 1788626183.132601 punch from 0x014c18 to 0x01aaa7 (0x5e90 bytes) 000813 1788626183.139130 trunc from 0x03e717 to 0x01b4bd (0x23259 bytes) 000814 1788626183.163665 trunc from 0x01b4be to 0x010fbc (0xa501 bytes) 000815 1788626183.188341 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x10fbd): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10fbd): Mirror 15: 0xa52e8269 (stale) Mirror 20: 0xa52e8269 (stale) Mirror 21: 0xa52e8269 (stale) CRC-32 checksum value for chunk [0, 0x10fbd): Mirror 1: 0x1a6201fa Mirror 22: 0x1a6201fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10fbd: skipped 000816 1788626184.919634 punch from 0x0092e6 to 0x010fbc (0x7cd7 bytes) 000819 1788626185.045498 punch from 0x00544f to 0x010bef (0xb7a1 bytes) 000821 1788626185.052458 mapwrite 0x008269 thru 0x015f6d (0xdd05 bytes) 000822 1788626185.179460 mapread 0x004a46 thru 0x00818f (0x374a bytes) 000823 1788626185.180522 trunc from 0x015f6e to 0x00229c (0x13cd1 bytes) 000824 1788626185.197258 read 0x00134b thru 0x00229c (0xf52 bytes) 000826 1788626185.204053 punch from 0x001660 to 0x00229c (0xc3d bytes) 000827 1788626185.211139 read 0x0001c4 thru 0x00229c (0x20d9 bytes) 000829 1788626185.222198 punch from 0x00208a to 0x00229c (0x213 bytes) 000830 1788626185.231552 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x229d): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x229d): Mirror 15: 0x3e2bc288 (stale) Mirror 20: 0x3e2bc288 (stale) Mirror 21: 0x3e2bc288 (stale) Mirror 22: 0x3e2bc288 (stale) CRC-32 checksum value for chunk [0, 0x229d): Mirror 1: 0x3e2bc288 Mirror 23: 0x3e2bc288 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x229d: skipped truncating to largest ever: 0x3ee50 000831 1788626186.518432 trunc from 0x00229d to 0x03ee4f (0x3cbb3 bytes) 000832 1788626186.691131 punch from 0x0105ca to 0x019454 (0x8e8b bytes) 000833 1788626186.697474 write 0x03cf79 thru 0x03d116 (0x19e bytes) 000834 1788626186.709853 mapread 0x00d1cf thru 0x0100dc (0x2f0e bytes) 000835 1788626186.733352 mapread 0x01f996 thru 0x02e79c (0xee07 bytes) 000836 1788626186.757813 mapwrite 0x008c9d thru 0x015a9a (0xcdfe bytes) 000837 1788626186.830451 mapwrite 0x00e1fd thru 0x014ad0 (0x68d4 bytes) 000838 1788626186.897979 mapread 0x011a3a thru 0x01c28a (0xa851 bytes) 000839 1788626186.900228 read 0x02aa8d thru 0x0379c3 (0xcf37 bytes) 000841 1788626186.920587 read 0x023dcb thru 0x025492 (0x16c8 bytes) 000842 1788626186.921394 mapwrite 0x00824c thru 0x014f79 (0xcd2e bytes) 000843 1788626187.012821 read 0x02a9c0 thru 0x039311 (0xe952 bytes) 000844 1788626187.026831 read 0x02bca2 thru 0x0389f9 (0xcd58 bytes) 000848 1788626187.034395 trunc from 0x03ee50 to 0x019822 (0x2562d bytes) 000849 1788626187.109863 punch from 0x00bf35 to 0x0170ae (0xb17a bytes) 000853 1788626187.135935 write 0x03cb2c thru 0x03ec2a (0x20ff bytes) 000854 1788626187.137330 write 0x036c86 thru 0x03ffff (0x937a bytes) 000855 1788626187.157860 mapwrite 0x013e52 thru 0x017e4f (0x3ffe bytes) 000856 1788626187.207409 mapread 0x036a92 thru 0x03ffff (0x956e bytes) 000857 1788626187.209322 read 0x0305aa thru 0x036c79 (0x66d0 bytes) 000858 1788626187.215135 mapread 0x02f48e thru 0x03919f (0x9d12 bytes) 000861 1788626187.225911 trunc from 0x040000 to 0x036247 (0x9db8 bytes) 000862 1788626187.278327 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36248): Mirror 20: 0x61e89801 (stale) Mirror 21: 0x61e89801 (stale) Mirror 22: 0xec659c70 (stale) Mirror 23: 0x2c350cf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36248): Mirror 20: 0x61e89801 (stale) Mirror 21: 0x61e89801 (stale) Mirror 22: 0xec659c70 (stale) Mirror 23: 0x2c350cf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36248: skipped 000863 1788626187.939010 punch from 0x02e943 to 0x035127 (0x67e5 bytes) 000866 1788626187.967489 punch from 0x0186ca to 0x01e2a8 (0x5bdf bytes) 000873 1788626187.989309 write 0x02ff2b thru 0x032fe1 (0x30b7 bytes) 000874 1788626188.031743 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36248): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36248): Mirror 20: 0x61e89801 (stale) Mirror 21: 0x61e89801 (stale) Mirror 22: 0xec659c70 (stale) Mirror 23: 0x2c350cf9 (stale) CRC-32 checksum value for chunk [0, 0x36248): Mirror 1: 0xa865bf7b Mirror 24: 0xa865bf7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36248: skipped 000876 1788626190.061642 read 0x02a644 thru 0x02bd55 (0x1712 bytes) truncating to largest ever: 0x3fd08 000877 1788626190.079738 trunc from 0x036248 to 0x03fd07 (0x9ac0 bytes) 000878 1788626190.223698 mapread 0x0185c7 thru 0x01b02b (0x2a65 bytes) 000879 1788626190.256916 write 0x001684 thru 0x009a42 (0x83bf bytes) 000882 1788626190.272823 trunc from 0x03fd08 to 0x002adf (0x3d228 bytes) 000885 1788626190.312028 mapread 0x000930 thru 0x0019a8 (0x1079 bytes) 000886 1788626190.330770 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ae0): Mirror 20: 0x2066709e (stale) Mirror 21: 0x2066709e (stale) Mirror 23: 0x2066709e (stale) Mirror 24: 0x2066709e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ae0): Mirror 20: 0x2066709e (stale) Mirror 21: 0x2066709e (stale) Mirror 23: 0x2066709e (stale) Mirror 24: 0x2066709e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ae0: skipped 000887 1788626190.872226 trunc from 0x002ae0 to 0x01aed6 (0x183f7 bytes) 000888 1788626190.896974 punch from 0x00a94b to 0x0143f8 (0x9aae bytes) 000889 1788626190.904420 trunc from 0x01aed7 to 0x010014 (0xaec2 bytes) 000890 1788626190.935962 punch from 0x00fcf9 to 0x010014 (0x31c bytes) 000891 1788626190.942844 mapwrite 0x01e2ed thru 0x02d938 (0xf64c bytes) 000892 1788626191.165829 write 0x016d18 thru 0x01dace (0x6db7 bytes) 000893 1788626191.184814 mapwrite 0x03c2da thru 0x03ffff (0x3d26 bytes) 000894 1788626191.300927 write 0x018069 thru 0x02673d (0xe6d5 bytes) 000895 1788626191.304996 mapread 0x0392d4 thru 0x03dd0a (0x4a37 bytes) 000896 1788626191.306952 mapwrite 0x01abe2 thru 0x0221d3 (0x75f2 bytes) 000897 1788626191.362227 read 0x03a84a thru 0x03f7bb (0x4f72 bytes) 000898 1788626191.363839 punch from 0x038c69 to 0x03cd96 (0x412e bytes) 000899 1788626191.371425 mapwrite 0x03b405 thru 0x03ffff (0x4bfb bytes) 000900 1788626191.428042 write 0x0161f8 thru 0x025037 (0xee40 bytes) 000902 1788626191.442569 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x4e5320e3 (stale) Mirror 23: 0x22b89300 (stale) Mirror 24: 0x36bffbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x4e5320e3 (stale) Mirror 23: 0x22b89300 (stale) Mirror 24: 0x36bffbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000903 1788626192.200713 read 0x035ba6 thru 0x03f52f (0x998a bytes) 000905 1788626192.217602 mapwrite 0x024435 thru 0x02efdc (0xaba8 bytes) 000907 1788626192.366563 mapwrite 0x037623 thru 0x03ffff (0x89dd bytes) 000908 1788626192.501103 mapwrite 0x015cdc thru 0x015fef (0x314 bytes) 000909 1788626192.580357 mapread 0x03d4fa thru 0x03ffff (0x2b06 bytes) 000910 1788626192.581862 punch from 0x01d957 to 0x028f3f (0xb5e9 bytes) 000911 1788626192.587543 mapwrite 0x01fe5f thru 0x02a47b (0xa61d bytes) 000912 1788626192.661507 MIRROR_RESYNC 4 mirrors 000914 1788626195.281722 mapread 0x03fe87 thru 0x03ffff (0x179 bytes) 000915 1788626195.290494 trunc from 0x040000 to 0x03b169 (0x4e96 bytes) 000918 1788626195.475770 read 0x0235ea thru 0x02e9ce (0xb3e5 bytes) 000920 1788626195.500491 punch from 0x021b64 to 0x02a004 (0x84a1 bytes) 000922 1788626195.516802 write 0x01a619 thru 0x02220e (0x7bf6 bytes) 000925 1788626195.548674 trunc from 0x03b16a to 0x01688c (0x248dd bytes) 000927 1788626195.595257 mapread 0x015955 thru 0x01688c (0xf38 bytes) 000928 1788626195.622788 trunc from 0x01688d to 0x01c38b (0x5aff bytes) 000929 1788626195.643262 trunc from 0x01c38c to 0x01bec4 (0x4c7 bytes) 000930 1788626195.678728 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1bec5): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bec5): Mirror 21: 0xda42ea1e (stale) Mirror 23: 0xda42ea1e (stale) Mirror 24: 0xda42ea1e (stale) CRC-32 checksum value for chunk [0, 0x1bec5): Mirror 1: 0x1e80b90d Mirror 25: 0x1e80b90d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bec5: skipped 000932 1788626197.211516 punch from 0x00d4c2 to 0x018a5f (0xb59e bytes) 000933 1788626197.289015 mapwrite 0x01cf33 thru 0x024103 (0x71d1 bytes) 000935 1788626197.383448 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24104): Mirror 21: 0xbfdb63cd (stale) Mirror 23: 0xbfdb63cd (stale) Mirror 25: 0x8725a718 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24104): Mirror 21: 0xbfdb63cd (stale) Mirror 23: 0xbfdb63cd (stale) Mirror 25: 0x8725a718 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24104: skipped 000936 1788626197.864415 mapwrite 0x0074e4 thru 0x00bb40 (0x465d bytes) 000937 1788626198.010563 mapwrite 0x00176b thru 0x002e6e (0x1704 bytes) 000943 1788626198.117462 mapread 0x01804a thru 0x018c89 (0xc40 bytes) 000945 1788626198.147984 MIRROR_RESYNC 4 mirrors 000946 1788626199.998659 punch from 0x016dd2 to 0x0206de (0x990d bytes) 000947 1788626200.106141 mapwrite 0x02e538 thru 0x036eea (0x89b3 bytes) 000948 1788626200.276491 mapwrite 0x01528f thru 0x0166ba (0x142c bytes) 000949 1788626200.353635 mapread 0x006f77 thru 0x012e79 (0xbf03 bytes) 000951 1788626200.369999 write 0x0136f3 thru 0x015a23 (0x2331 bytes) 000952 1788626200.373798 write 0x01471e thru 0x023de4 (0xf6c7 bytes) 000953 1788626200.389257 trunc from 0x036eeb to 0x02230c (0x14bde bytes) 000954 1788626200.420347 mapread 0x017df2 thru 0x01f12b (0x733a bytes) 000956 1788626200.421927 mapread 0x009f2f thru 0x018197 (0xe269 bytes) 000957 1788626200.425040 write 0x035092 thru 0x03509c (0xb bytes) 000958 1788626200.433564 MIRROR_RESYNC 4 mirrors 000959 1788626203.102555 read 0x01bb29 thru 0x02915b (0xd633 bytes) 000960 1788626203.116553 punch from 0x0045fd to 0x014278 (0xfc7c bytes) 000962 1788626203.185572 mapwrite 0x01de94 thru 0x024ba7 (0x6d14 bytes) 000963 1788626203.291806 write 0x012793 thru 0x019184 (0x69f2 bytes) 000964 1788626203.309983 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x168:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3509d): Mirror 23: 0x4f43de0c (stale) Mirror 25: 0x4f43de0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3509d): Mirror 23: 0x4f43de0c (stale) Mirror 25: 0x4f43de0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3509d: skipped 000965 1788626203.757371 write 0x03a3a0 thru 0x03ffff (0x5c60 bytes) 000966 1788626203.758801 punch from 0x0075e9 to 0x00e125 (0x6b3d bytes) 000967 1788626203.810954 write 0x0386c3 thru 0x03a6b7 (0x1ff5 bytes) 000969 1788626203.827765 mapwrite 0x02a08d thru 0x02d191 (0x3105 bytes) 000970 1788626203.985890 mapwrite 0x03ab73 thru 0x03ffff (0x548d bytes) 000971 1788626204.041498 trunc from 0x040000 to 0x025ee9 (0x1a116 bytes) 000972 1788626204.074874 punch from 0x02190a to 0x025ee9 (0x45e0 bytes) 000973 1788626204.097066 mapread 0x006a39 thru 0x006c24 (0x1ec bytes) 000974 1788626204.113861 punch from 0x007cc9 to 0x010cc9 (0x9001 bytes) 000975 1788626204.120949 mapread 0x01da2a thru 0x025ee9 (0x84c0 bytes) 000976 1788626204.143652 punch from 0x0089e8 to 0x014bfe (0xc217 bytes) 000977 1788626204.158764 mapread 0x004876 thru 0x013e91 (0xf61c bytes) 000979 1788626204.195921 mapread 0x01ce2e thru 0x020bb9 (0x3d8c bytes) 000980 1788626204.199560 punch from 0x015926 to 0x0231ae (0xd889 bytes) 000983 1788626204.210882 read 0x014dae thru 0x01a4c5 (0x5718 bytes) 000984 1788626204.238183 trunc from 0x025eea to 0x032aea (0xcc01 bytes) 000985 1788626204.261615 punch from 0x00e541 to 0x017076 (0x8b36 bytes) 000986 1788626204.266681 mapread 0x009c8c thru 0x013528 (0x989d bytes) 000988 1788626204.287851 punch from 0x016b44 to 0x02671b (0xfbd8 bytes) 000991 1788626204.295657 trunc from 0x032aeb to 0x02c230 (0x68ba bytes) 000992 1788626204.345165 write 0x01c211 thru 0x02aa17 (0xe807 bytes) 000994 1788626204.361553 mapread 0x02b54b thru 0x02c230 (0xce6 bytes) 000995 1788626204.375580 read 0x027636 thru 0x02b1fb (0x3bc6 bytes) 000997 1788626204.382740 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c231): Mirror 23: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c231): Mirror 23: 0xf6ce4df5 (stale) Mirror 25: 0xf6ce4df5 (stale) CRC-32 checksum value for chunk [0, 0x2c231): Mirror 1: 0xfb557035 Mirror 26: 0xfb557035 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c231: skipped 000998 1788626205.849967 write 0x024106 thru 0x03122b (0xd126 bytes) 000999 1788626206.001906 punch from 0x00bfe5 to 0x00f9af (0x39cb bytes) 001000 1788626206.047925 read 0x00aa5b thru 0x00e2fb (0x38a1 bytes) All operations completed A-OK!