== sanity-flr test 70a: flr mode fsx test ================ 07:02:24 (1789124544) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 4546 skipping zero size read 000002 1789124546.982007 mapwrite 0x00f793 thru 0x0126f8 (0x2f66 bytes) zero_range to largest ever: 0xde9c 000003 1789124547.093691 trunc from 0x004069 to 0x00de9b (0x9e33 bytes) zero_range to largest ever: 0x126f9 000004 1789124547.103945 trunc from 0x00f75a to 0x0126f8 (0x2f9f bytes) 000005 1789124547.117067 mapread 0x00ba0c thru 0x00dcce (0x22c3 bytes) 000006 1789124547.142089 mapwrite 0x03d03e thru 0x03ffff (0x2fc2 bytes) 000008 1789124547.225586 write 0x014c62 thru 0x023474 (0xe813 bytes) 000010 1789124547.267353 MIRROR_EXTEND to 2 mirrors 000011 1789124548.439791 read 0x01fcd9 thru 0x02775d (0x7a85 bytes) 000013 1789124548.466272 mapwrite 0x003e45 thru 0x01395f (0xfb1b bytes) truncating to largest ever: 0x1591a 000014 1789124548.635255 trunc from 0x040000 to 0x015919 (0x2a6e6 bytes) 000015 1789124548.686500 mapread 0x003249 thru 0x012e9e (0xfc56 bytes) 000016 1789124548.688155 mapread 0x00fd5b thru 0x015919 (0x5bbf bytes) 000017 1789124548.696985 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1591a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1591a): Mirror 2: 0x44d5435d (stale) CRC-32 checksum value for chunk [0, 0x1591a): Mirror 1: 0x625c4d8d Mirror 3: 0x625c4d8d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1591a: skipped 000018 1789124549.793383 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1591a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1591a): Mirror 2: 0x44d5435d (stale) CRC-32 checksum value for chunk [0, 0x1591a): Mirror 1: 0x625c4d8d Mirror 3: 0x625c4d8d Mirror 4: 0x625c4d8d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1591a: skipped 000019 1789124551.040929 write 0x03898c thru 0x03c4dd (0x3b52 bytes) fallocating to largest ever: 0x29590 000020 1789124551.116283 fallocate 0x0249a7 thru 0x02958f (0x4be9 bytes) 000021 1789124551.127528 mapwrite 0x02c6f0 thru 0x030098 (0x39a9 bytes) 000022 1789124551.172701 read 0x013bfc thru 0x0195ba (0x59bf bytes) 000023 1789124551.192417 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 2: 0xfa65ef3b (stale) Mirror 3: 0x1fef4099 (stale) Mirror 4: 0x1fef4099 (stale) CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 1: 0x6980ad1b Mirror 5: 0x6980ad1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4de: skipped 000024 1789124552.394690 trunc from 0x007f13 to 0x01000a (0x80f8 bytes) 000025 1789124552.460171 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 2: 0xfa65ef3b (stale) Mirror 3: 0x1fef4099 (stale) Mirror 4: 0x1fef4099 (stale) Mirror 5: 0x6980ad1b (stale) CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 1: 0xbbadee93 Mirror 6: 0xbbadee93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4de: skipped 000026 1789124554.069591 write 0x01bfe6 thru 0x027174 (0xb18f bytes) 000027 1789124554.168181 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 2: 0xfa65ef3b (stale) Mirror 3: 0x1fef4099 (stale) Mirror 5: 0x6980ad1b (stale) Mirror 6: 0xbbadee93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4de): Mirror 2: 0xfa65ef3b (stale) Mirror 3: 0x1fef4099 (stale) Mirror 5: 0x6980ad1b (stale) Mirror 6: 0xbbadee93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4de: skipped 000028 1789124554.754190 mapread 0x000972 thru 0x0088ea (0x7f79 bytes) 000029 1789124554.785306 read 0x038c71 thru 0x03c4dd (0x386d bytes) 000030 1789124554.794799 punch from 0x01282a to 0x015ed3 (0x36aa bytes) 000031 1789124554.800729 trunc from 0x03c4de to 0x0253c8 (0x17115 bytes) fallocating to largest ever: 0x3eebf 000032 1789124554.820241 fallocate 0x03cedb thru 0x03eebe (0x1fe4 bytes) 000033 1789124554.826928 punch from 0x013623 to 0x01ea84 (0xb462 bytes) 000034 1789124554.833437 write 0x0078ec thru 0x016ab6 (0xf1cb bytes) 000035 1789124554.839617 trunc from 0x006120 to 0x00a61c (0x44fd bytes) 000036 1789124554.859356 mapwrite 0x0168e2 thru 0x023c3f (0xd35e bytes) 000037 1789124554.939486 trunc from 0x01763e to 0x01a101 (0x2ac4 bytes) 000038 1789124554.947524 trunc from 0x004e60 to 0x006d6b (0x1f0c bytes) 000039 1789124554.960504 mapread 0x009692 thru 0x013563 (0x9ed2 bytes) 000040 1789124554.994988 write 0x03835e thru 0x03bb18 (0x37bb bytes) 000041 1789124554.996047 mapwrite 0x0395f8 thru 0x03ffff (0x6a08 bytes) 000042 1789124555.073472 punch from 0x010f5f to 0x01a975 (0x9a17 bytes) 000043 1789124555.101963 trunc from 0x040000 to 0x030a7b (0xf584 bytes) 000044 1789124555.137820 write 0x0312fc thru 0x039455 (0x815a bytes) 000045 1789124555.147344 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39456): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39456): Mirror 2: 0x9f54be4f (stale) Mirror 3: 0x340f517a (stale) Mirror 5: 0xc0313288 (stale) Mirror 6: 0xf9e47c (stale) CRC-32 checksum value for chunk [0, 0x39456): Mirror 1: 0xeb2ac56d Mirror 7: 0xeb2ac56d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39456: skipped 000046 1789124556.677394 read 0x02976e thru 0x02bfce (0x2861 bytes) 000047 1789124556.683963 trunc from 0x039456 to 0x00ea4a (0x2aa0b bytes) 000048 1789124556.812766 mapread 0x00e170 thru 0x00ea4a (0x8db bytes) 000049 1789124556.834394 mapread 0x000197 thru 0x00e76b (0xe5d5 bytes) 000050 1789124556.868300 punch from 0x005ac8 to 0x006b08 (0x1041 bytes) 000051 1789124556.877968 fallocate 0x0024b9 thru 0x003df2 (0x193a bytes) 000052 1789124556.887203 mapread 0x005ca2 thru 0x00ccfe (0x705d bytes) 000054 1789124556.902777 trunc from 0x00ea4b to 0x0014ff (0xd54b bytes) 000055 1789124556.928321 trunc from 0x001500 to 0x004a14 (0x3515 bytes) 000056 1789124556.945555 trunc from 0x003e34 to 0x004a14 (0xbe1 bytes) 000058 1789124556.953825 mapread 0x0048b6 thru 0x004a14 (0x15f bytes) 000059 1789124556.961394 read 0x0032c1 thru 0x004a14 (0x1754 bytes) 000060 1789124556.963313 trunc from 0x000e83 to 0x004a14 (0x3b92 bytes) 000061 1789124556.974365 fallocate 0x0227e7 thru 0x024507 (0x1d21 bytes) 000062 1789124556.980103 fallocate 0x02dd54 thru 0x03653f (0x87ec bytes) 000063 1789124556.993501 read 0x002ce3 thru 0x004a14 (0x1d32 bytes) 000064 1789124557.006618 mapwrite 0x007174 thru 0x00b35a (0x41e7 bytes) 000065 1789124557.056196 mapread 0x00a819 thru 0x00b35a (0xb42 bytes) 000066 1789124557.057452 read 0x009f86 thru 0x00b35a (0x13d5 bytes) 000067 1789124557.059197 punch from 0x004e63 to 0x00b35a (0x64f8 bytes) 000068 1789124557.065350 trunc from 0x001995 to 0x0021d8 (0x844 bytes) 000069 1789124557.071308 write 0x038fd5 thru 0x03ffff (0x702b bytes) 000070 1789124557.075485 mapread 0x02286f thru 0x031765 (0xeef7 bytes) fallocating to largest ever: 0x40000 000071 1789124557.098322 fallocate 0x03d111 thru 0x03ffff (0x2eef bytes) 000072 1789124557.103123 fallocate 0x0340cd thru 0x03e594 (0xa4c8 bytes) 000073 1789124557.110070 read 0x017c26 thru 0x0188ff (0xcda bytes) 000074 1789124557.111451 trunc from 0x040000 to 0x02afcd (0x15032 bytes) 000075 1789124557.133140 punch from 0x0074e6 to 0x013231 (0xbd4c bytes) 000076 1789124557.139456 mapwrite 0x021fe0 thru 0x023598 (0x15b9 bytes) 000077 1789124557.152461 trunc from 0x02afce to 0x0058c6 (0x25707 bytes) 000079 1789124557.171666 punch from 0x003913 to 0x0058c6 (0x1fb4 bytes) 000080 1789124557.177788 mapwrite 0x024fb7 thru 0x029589 (0x45d3 bytes) 000081 1789124557.222419 mapwrite 0x029e46 thru 0x02aed8 (0x1093 bytes) 000082 1789124557.260117 punch from 0x00bdb4 to 0x010f80 (0x51cd bytes) 000083 1789124557.267129 write 0x03421c thru 0x03c528 (0x830d bytes) 000084 1789124557.271083 punch from 0x029282 to 0x036be8 (0xd967 bytes) 000085 1789124557.291565 read 0x01f74a thru 0x02ad99 (0xb650 bytes) 000086 1789124557.312065 mapwrite 0x025627 thru 0x033b78 (0xe552 bytes) 000087 1789124557.364445 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c529): Mirror 2: 0x9c7b8e97 (stale) Mirror 3: 0x8b656b4d (stale) Mirror 5: 0xb60ff4be (stale) Mirror 6: 0xce604ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c529): Mirror 2: 0x9c7b8e97 (stale) Mirror 3: 0x8b656b4d (stale) Mirror 5: 0xb60ff4be (stale) Mirror 6: 0xce604ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c529: skipped 000089 1789124558.081854 punch from 0x030b88 to 0x03c528 (0xb9a1 bytes) 000090 1789124558.090345 mapread 0x03c207 thru 0x03c528 (0x322 bytes) 000091 1789124558.099431 write 0x01b8ce thru 0x025890 (0x9fc3 bytes) 000092 1789124558.119247 trunc from 0x004177 to 0x00dc65 (0x9aef bytes) 000093 1789124558.126084 fallocate 0x01b040 thru 0x023c95 (0x8c56 bytes) 000094 1789124558.135519 trunc from 0x03c529 to 0x02b020 (0x11508 bytes) 000095 1789124558.168314 mapread 0x004f87 thru 0x00a999 (0x5a13 bytes) 000096 1789124558.195357 fallocate 0x00ae89 thru 0x015125 (0xa29d bytes) 000097 1789124558.219208 trunc from 0x02b021 to 0x0241f9 (0x6e27 bytes) 000098 1789124558.246265 trunc from 0x01b815 to 0x0209ea (0x51d6 bytes) 000099 1789124558.272154 mapwrite 0x001247 thru 0x00b39d (0xa157 bytes) 000100 1789124558.303209 punch from 0x0100c6 to 0x012289 (0x21c4 bytes) 000101 1789124558.308061 mapwrite 0x039af4 thru 0x03ffff (0x650c bytes) 000102 1789124558.420545 trunc from 0x03f386 to 0x03ffff (0xc7a bytes) 000103 1789124558.448384 fallocate 0x02cd62 thru 0x033b28 (0x6dc7 bytes) 000104 1789124558.462151 trunc from 0x02b30b to 0x033996 (0x868c bytes) 000105 1789124558.469836 mapread 0x02faf0 thru 0x02fe3e (0x34f bytes) 000106 1789124558.501673 mapread 0x02d9d1 thru 0x032ba2 (0x51d2 bytes) 000107 1789124558.508550 mapwrite 0x000e40 thru 0x0018c2 (0xa83 bytes) 000108 1789124558.560186 fallocate 0x004ea1 thru 0x009f24 (0x5084 bytes) 000111 1789124558.585267 fallocate 0x02bfc1 thru 0x0314c8 (0x5508 bytes) 000112 1789124558.594968 write 0x01a7bb thru 0x01aac3 (0x309 bytes) 000113 1789124558.619185 mapwrite 0x022971 thru 0x0260f1 (0x3781 bytes) 000114 1789124558.673003 trunc from 0x0034a8 to 0x00c9b8 (0x9511 bytes) 000115 1789124558.680543 fallocate 0x024b6b thru 0x030d5f (0xc1f5 bytes) 000116 1789124558.688000 write 0x030432 thru 0x034f63 (0x4b32 bytes) 000117 1789124558.689062 mapwrite 0x00d3cf thru 0x00eb2d (0x175f bytes) 000118 1789124558.712169 trunc from 0x03e7f8 to 0x03eb44 (0x34d bytes) 000119 1789124558.723750 read 0x021c3c thru 0x02698e (0x4d53 bytes) 000120 1789124558.725343 trunc from 0x0324e3 to 0x03dc21 (0xb73f bytes) 000121 1789124558.734189 punch from 0x01a7c4 to 0x0210c1 (0x68fe bytes) 000122 1789124558.746553 fallocate 0x02a08e thru 0x02b1c4 (0x1137 bytes) 000123 1789124558.757757 trunc from 0x0225aa to 0x023528 (0xf7f bytes) 000124 1789124558.770619 mapread 0x0224ec thru 0x02ec49 (0xc75e bytes) 000125 1789124558.785692 trunc from 0x019004 to 0x022436 (0x9433 bytes) 000126 1789124558.802741 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa6d837ec (stale) Mirror 3: 0xaa9649c6 (stale) Mirror 5: 0x3b5d1669 (stale) Mirror 6: 0x644db1a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6ff4d6b1 Mirror 7: 0x6ff4d6b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000127 1789124559.929634 write 0x001185 thru 0x00d2fb (0xc177 bytes) 000128 1789124560.044068 read 0x00ecfb thru 0x00f684 (0x98a bytes) 000129 1789124560.050596 write 0x031aac thru 0x0372e9 (0x583e bytes) 000130 1789124560.070107 write 0x035cf6 thru 0x03ffff (0xa30a bytes) 000131 1789124560.081358 write 0x0257f6 thru 0x02709c (0x18a7 bytes) 000132 1789124560.107776 mapread 0x010be8 thru 0x0209b7 (0xfdd0 bytes) 000133 1789124560.174251 punch from 0x01ecaa to 0x02adfe (0xc155 bytes) 000134 1789124560.232420 write 0x00172a thru 0x0025ba (0xe91 bytes) 000135 1789124560.233400 trunc from 0x040000 to 0x031049 (0xefb6 bytes) 000136 1789124560.281656 write 0x01093e thru 0x01e13d (0xd800 bytes) 000137 1789124560.337303 punch from 0x03015e to 0x031049 (0xeec bytes) 000138 1789124560.356401 mapread 0x001944 thru 0x00b788 (0x9e45 bytes) 000139 1789124560.359441 mapread 0x00df39 thru 0x01714c (0x9214 bytes) 000140 1789124560.361514 mapwrite 0x0118a2 thru 0x01a8a9 (0x9008 bytes) 000142 1789124560.413740 fallocate 0x026c9a thru 0x02b2a8 (0x460f bytes) 000143 1789124560.426095 read 0x015df9 thru 0x024b5b (0xed63 bytes) 000144 1789124560.462290 mapread 0x016b7e thru 0x020062 (0x94e5 bytes) 000145 1789124560.465692 write 0x0201eb thru 0x02abba (0xa9d0 bytes) 000146 1789124560.468105 mapwrite 0x00a997 thru 0x011f37 (0x75a1 bytes) 000147 1789124560.506829 trunc from 0x00bafd to 0x0168eb (0xadef bytes) 000148 1789124560.521939 fallocate 0x00074d thru 0x002e6f (0x2723 bytes) 000149 1789124560.534310 punch from 0x01c232 to 0x0243dc (0x81ab bytes) 000150 1789124560.547814 fallocate 0x0157fe thru 0x01ef74 (0x9777 bytes) 000151 1789124560.559270 mapread 0x0235a4 thru 0x023d23 (0x780 bytes) 000152 1789124560.574670 MIRROR_RESYNC 6 mirrors 000153 1789124562.598474 mapread 0x02013e thru 0x02e54f (0xe412 bytes) 000154 1789124562.624206 fallocate 0x004f43 thru 0x012d0a (0xddc8 bytes) 000155 1789124562.671490 punch from 0x01163a to 0x015dc9 (0x4790 bytes) 000156 1789124562.688232 mapwrite 0x0110aa thru 0x01aa0d (0x9964 bytes) 000157 1789124562.781243 write 0x02c2b3 thru 0x0337dc (0x752a bytes) 000158 1789124562.796633 read 0x0064ef thru 0x013ce2 (0xd7f4 bytes) 000159 1789124562.810353 mapread 0x02a485 thru 0x0335d4 (0x9150 bytes) 000160 1789124562.832470 read 0x01e65a thru 0x02413b (0x5ae2 bytes) 000161 1789124562.834740 punch from 0x023585 to 0x02d131 (0x9bad bytes) 000162 1789124562.868151 fallocate 0x005b5d thru 0x00fc44 (0xa0e8 bytes) 000164 1789124562.879473 punch from 0x02352a to 0x033437 (0xff0e bytes) 000165 1789124562.886974 punch from 0x024e65 to 0x02869a (0x3836 bytes) 000166 1789124562.899461 MIRROR_RESYNC 6 mirrors 000167 1789124564.876003 trunc from 0x00d0f6 to 0x01701d (0x9f28 bytes) 000168 1789124564.915074 punch from 0x00be50 to 0x0162ba (0xa46b bytes) 000170 1789124564.923753 mapwrite 0x02cb91 thru 0x02db28 (0xf98 bytes) 000172 1789124564.950149 punch from 0x009d22 to 0x00b451 (0x1730 bytes) 000173 1789124564.955620 trunc from 0x00d132 to 0x00d26a (0x139 bytes) 000175 1789124564.961076 trunc from 0x0337dd to 0x0285d2 (0xb20a bytes) 000176 1789124564.981774 mapwrite 0x00fdbc thru 0x01b8e4 (0xbb29 bytes) 000177 1789124565.028671 punch from 0x024987 to 0x0285d2 (0x3c4c bytes) 000178 1789124565.033833 punch from 0x018273 to 0x01dfb1 (0x5d3f bytes) 000179 1789124565.039148 trunc from 0x003f11 to 0x009211 (0x5301 bytes) 000180 1789124565.044419 punch from 0x0281ac to 0x0285d2 (0x427 bytes) 000182 1789124565.053991 read 0x003af3 thru 0x009bf2 (0x6100 bytes) 000183 1789124565.063223 trunc from 0x017b1f to 0x01cebc (0x539e bytes) 000184 1789124565.068109 mapwrite 0x019f47 thru 0x02371a (0x97d4 bytes) 000186 1789124565.107394 punch from 0x0273b5 to 0x0285d2 (0x121e bytes) 000187 1789124565.111756 trunc from 0x010cd2 to 0x01f7b6 (0xeae5 bytes) 000189 1789124565.118638 read 0x01fb7f thru 0x0285d2 (0x8a54 bytes) 000190 1789124565.133651 mapwrite 0x030ef0 thru 0x039e53 (0x8f64 bytes) 000192 1789124565.183200 punch from 0x02505b to 0x02bba8 (0x6b4e bytes) 000194 1789124565.189052 read 0x038c6f thru 0x039e53 (0x11e5 bytes) 000195 1789124565.189834 fallocate 0x0339df thru 0x0391bf (0x57e1 bytes) 000197 1789124565.194921 trunc from 0x039e54 to 0x03f058 (0x5205 bytes) 000198 1789124565.209491 trunc from 0x03f059 to 0x00e4c1 (0x30b97 bytes) 000199 1789124565.229343 mapwrite 0x00580f thru 0x014067 (0xe859 bytes) 000200 1789124565.274814 mapread 0x00be7e thru 0x00d560 (0x16e3 bytes) 000201 1789124565.275715 punch from 0x00b080 to 0x011bc5 (0x6b46 bytes) 000202 1789124565.281339 read 0x007e3f thru 0x00fd21 (0x7ee3 bytes) 000203 1789124565.296617 trunc from 0x014068 to 0x014819 (0x7b2 bytes) 000204 1789124565.332831 mapwrite 0x02b92a thru 0x02e00d (0x26e4 bytes) 000205 1789124565.473186 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e00e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e00e): Mirror 2: 0x4a9a5ae (stale) Mirror 3: 0x4a9a5ae (stale) Mirror 5: 0x4a9a5ae (stale) Mirror 6: 0x4a9a5ae (stale) Mirror 7: 0x4a9a5ae (stale) CRC-32 checksum value for chunk [0, 0x2e00e): Mirror 1: 0xb7416c6 Mirror 8: 0xb7416c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e00e: skipped 000206 1789124566.927629 mapwrite 0x00da5b thru 0x01c9ed (0xef93 bytes) 000207 1789124567.147426 mapwrite 0x03e091 thru 0x03ffff (0x1f6f bytes) 000208 1789124567.216275 fallocate 0x03a004 thru 0x03ffff (0x5ffc bytes) 000209 1789124567.234128 MIRROR_RESYNC 7 mirrors 000210 1789124570.070852 mapread 0x01e1ab thru 0x01fe59 (0x1caf bytes) 000212 1789124570.082158 mapwrite 0x019e55 thru 0x0213d4 (0x7580 bytes) 000213 1789124570.172278 trunc from 0x00d37e to 0x013093 (0x5d16 bytes) 000214 1789124570.183794 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbad18488 (stale) Mirror 3: 0xbad18488 (stale) Mirror 5: 0xbad18488 (stale) Mirror 6: 0xbad18488 (stale) Mirror 7: 0xbad18488 (stale) Mirror 8: 0xbad18488 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc757b7dd Mirror 9: 0xc757b7dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000215 1789124571.493995 trunc from 0x02046f to 0x021c59 (0x17eb bytes) 000216 1789124571.547298 mapread 0x033623 thru 0x03f9c9 (0xc3a7 bytes) 000217 1789124571.603904 trunc from 0x033f07 to 0x036b99 (0x2c93 bytes) 000218 1789124571.613784 read 0x010c10 thru 0x01f369 (0xe75a bytes) 000219 1789124571.631796 trunc from 0x0391c7 to 0x03c13d (0x2f77 bytes) 000220 1789124571.641695 write 0x02f716 thru 0x035d7b (0x6666 bytes) 000222 1789124571.653935 mapread 0x01f6d4 thru 0x025f6d (0x689a bytes) 000223 1789124571.666818 mapwrite 0x015226 thru 0x021fbb (0xcd96 bytes) 000224 1789124571.720742 mapwrite 0x033ff4 thru 0x03ffff (0xc00c bytes) 000225 1789124571.778208 trunc from 0x040000 to 0x00f847 (0x307b8 bytes) 000226 1789124571.813495 punch from 0x0030ae to 0x00f847 (0xc79a bytes) 000227 1789124571.820271 trunc from 0x00f848 to 0x022268 (0x12a21 bytes) 000228 1789124571.850533 mapread 0x00764a thru 0x013b65 (0xc51c bytes) 000229 1789124571.883734 trunc from 0x022269 to 0x036b1f (0x148b7 bytes) 000230 1789124571.905842 fallocate 0x0084c1 thru 0x008aa4 (0x5e4 bytes) 000231 1789124571.925179 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x36b20): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b20): Mirror 2: 0x3564fcbc (stale) Mirror 3: 0x3564fcbc (stale) Mirror 5: 0x3564fcbc (stale) Mirror 6: 0x3564fcbc (stale) Mirror 7: 0x3564fcbc (stale) Mirror 8: 0x3564fcbc (stale) Mirror 9: 0x1eac9ce3 (stale) CRC-32 checksum value for chunk [0, 0x36b20): Mirror 1: 0xb3eae865 Mirror 10: 0xb3eae865 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b20: skipped 000232 1789124573.293008 trunc from 0x036b20 to 0x0026fa (0x34425 bytes) 000234 1789124573.429669 read 0x0002fc thru 0x00063b (0x340 bytes) 000235 1789124573.442280 fallocate 0x03c458 thru 0x03ffff (0x3ba8 bytes) 000236 1789124573.452199 write 0x01ca1d thru 0x025fa8 (0x958c bytes) 000237 1789124573.454690 fallocate 0x006920 thru 0x014b17 (0xe1f8 bytes) 000238 1789124573.461215 fallocate 0x030aaa thru 0x03ffff (0xf556 bytes) 000240 1789124573.471231 mapwrite 0x02f41d thru 0x0332d4 (0x3eb8 bytes) 000241 1789124573.514278 punch from 0x00ffce to 0x01c0b4 (0xc0e7 bytes) 000242 1789124573.520084 trunc from 0x0098ed to 0x017940 (0xe054 bytes) 000243 1789124573.527218 read 0x035479 thru 0x03ffff (0xab87 bytes) 000244 1789124573.550025 read 0x00f238 thru 0x01eac6 (0xf88f bytes) 000245 1789124573.551158 read 0x01492c thru 0x022373 (0xda48 bytes) 000246 1789124573.553232 punch from 0x01518e to 0x024029 (0xee9c bytes) 000247 1789124573.561425 trunc from 0x0329d2 to 0x03e210 (0xb83f bytes) 000248 1789124573.568291 read 0x03fc72 thru 0x03ffff (0x38e bytes) 000249 1789124573.568974 trunc from 0x0195e4 to 0x01ca4b (0x3468 bytes) 000250 1789124573.581205 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbad18488 (stale) Mirror 3: 0xbad18488 (stale) Mirror 6: 0xbad18488 (stale) Mirror 7: 0xbad18488 (stale) Mirror 8: 0xbad18488 (stale) Mirror 9: 0xc757b7dd (stale) Mirror 10: 0x6cc4cd5e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbad18488 (stale) Mirror 3: 0xbad18488 (stale) Mirror 6: 0xbad18488 (stale) Mirror 7: 0xbad18488 (stale) Mirror 8: 0xbad18488 (stale) Mirror 9: 0xc757b7dd (stale) Mirror 10: 0x6cc4cd5e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000252 1789124574.272788 punch from 0x038366 to 0x03aff8 (0x2c93 bytes) 000253 1789124574.279199 fallocate 0x023ffe thru 0x031d9a (0xdd9d bytes) 000254 1789124574.286355 mapwrite 0x01880a thru 0x019a52 (0x1249 bytes) 000255 1789124574.325659 punch from 0x032a0b to 0x0349e2 (0x1fd8 bytes) 000256 1789124574.333488 trunc from 0x040000 to 0x00470c (0x3b8f3 bytes) 000257 1789124574.411063 trunc from 0x000893 to 0x00470c (0x3e7a bytes) 000258 1789124574.433997 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x470d): Mirror 2: 0xce9d3b5e (stale) Mirror 3: 0xce9d3b5e (stale) Mirror 6: 0xce9d3b5e (stale) Mirror 7: 0xce9d3b5e (stale) Mirror 8: 0xce9d3b5e (stale) Mirror 10: 0x4590eabd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x470d): Mirror 2: 0xce9d3b5e (stale) Mirror 3: 0xce9d3b5e (stale) Mirror 6: 0xce9d3b5e (stale) Mirror 7: 0xce9d3b5e (stale) Mirror 8: 0xce9d3b5e (stale) Mirror 10: 0x4590eabd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x470d: skipped 000259 1789124575.127116 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x470d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x470d): Mirror 2: 0xce9d3b5e (stale) Mirror 3: 0xce9d3b5e (stale) Mirror 6: 0xce9d3b5e (stale) Mirror 7: 0xce9d3b5e (stale) Mirror 8: 0xce9d3b5e (stale) Mirror 10: 0x4590eabd (stale) CRC-32 checksum value for chunk [0, 0x470d): Mirror 1: 0x448d7c0b Mirror 11: 0x448d7c0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x470d: skipped 000260 1789124576.288932 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x470d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x470d): Mirror 2: 0xce9d3b5e (stale) Mirror 3: 0xce9d3b5e (stale) Mirror 6: 0xce9d3b5e (stale) Mirror 7: 0xce9d3b5e (stale) Mirror 8: 0xce9d3b5e (stale) Mirror 10: 0x4590eabd (stale) CRC-32 checksum value for chunk [0, 0x470d): Mirror 1: 0x448d7c0b Mirror 11: 0x448d7c0b Mirror 12: 0x448d7c0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x470d: skipped 000261 1789124577.445837 trunc from 0x00470d to 0x003c82 (0xa8a bytes) 000262 1789124577.525526 mapread 0x0021b2 thru 0x003c82 (0x1ad1 bytes) 000263 1789124577.540386 trunc from 0x003c83 to 0x003069 (0xc19 bytes) 000264 1789124577.572806 mapread 0x0003f0 thru 0x003069 (0x2c7a bytes) 000265 1789124577.587247 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x306a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306a): Mirror 2: 0xd9dc3d20 (stale) Mirror 3: 0xd9dc3d20 (stale) Mirror 6: 0xd9dc3d20 (stale) Mirror 7: 0xd9dc3d20 (stale) Mirror 8: 0xd9dc3d20 (stale) Mirror 10: 0xd9dc3d20 (stale) Mirror 11: 0xc404cffd (stale) Mirror 12: 0xc404cffd (stale) CRC-32 checksum value for chunk [0, 0x306a): Mirror 1: 0xc404cffd Mirror 13: 0xc404cffd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306a: skipped 000266 1789124578.667355 read 0x0005cd thru 0x000b6d (0x5a1 bytes) 000267 1789124578.673824 read 0x000ac9 thru 0x003069 (0x25a1 bytes) 000268 1789124578.682035 trunc from 0x00306a to 0x00c60a (0x95a1 bytes) 000269 1789124578.749082 write 0x0334dd thru 0x03dd8e (0xa8b2 bytes) 000270 1789124578.767976 MIRROR_RESYNC 10 mirrors 000271 1789124580.767809 mapwrite 0x00d768 thru 0x01b959 (0xe1f2 bytes) 000272 1789124580.931410 fallocate 0x03d9f1 thru 0x03ffff (0x260f bytes) 000273 1789124580.943586 write 0x021d29 thru 0x025235 (0x350d bytes) 000274 1789124580.960737 mapwrite 0x01e966 thru 0x026c94 (0x832f bytes) 000275 1789124581.001283 read 0x00b27f thru 0x0196f1 (0xe473 bytes) 000276 1789124581.002063 trunc from 0x00013a to 0x0069ba (0x6881 bytes) 000277 1789124581.014020 mapwrite 0x01b092 thru 0x027159 (0xc0c8 bytes) 000278 1789124581.046652 mapread 0x00eae0 thru 0x010246 (0x1767 bytes) 000279 1789124581.047846 trunc from 0x0108af to 0x01c5b8 (0xbd0a bytes) 000280 1789124581.053786 fallocate 0x0132d8 thru 0x01d192 (0x9ebb bytes) 000281 1789124581.062906 mapwrite 0x036e89 thru 0x03af83 (0x40fb bytes) 000282 1789124581.100041 fallocate 0x008809 thru 0x011f47 (0x973f bytes) 000283 1789124581.106447 fallocate 0x01689f thru 0x01e63d (0x7d9f bytes) 000284 1789124581.114647 mapwrite 0x034fed thru 0x03d643 (0x8657 bytes) 000285 1789124581.139817 MIRROR_RESYNC 10 mirrors 000286 1789124584.240552 MIRROR_RESYNC 10 mirrors 000287 1789124585.208338 mapwrite 0x02ced3 thru 0x031338 (0x4466 bytes) 000288 1789124585.356629 mapread 0x0334ad thru 0x034f3c (0x1a90 bytes) 000289 1789124585.357692 mapwrite 0x01206c thru 0x01e597 (0xc52c bytes) 000290 1789124585.415593 punch from 0x02194a to 0x02d0ac (0xb763 bytes) 000291 1789124585.421860 punch from 0x02db26 to 0x031654 (0x3b2f bytes) 000292 1789124585.427358 trunc from 0x027219 to 0x02df98 (0x6d80 bytes) 000293 1789124585.434350 trunc from 0x008a1d to 0x0126ee (0x9cd2 bytes) 000294 1789124585.439676 mapread 0x025b97 thru 0x027d76 (0x21e0 bytes) 000295 1789124585.450913 trunc from 0x013439 to 0x022eea (0xfab2 bytes) 000296 1789124585.456218 punch from 0x016f89 to 0x017779 (0x7f1 bytes) 000297 1789124585.469427 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 2: 0x9c48eecf (stale) Mirror 3: 0x9c48eecf (stale) Mirror 6: 0x9c48eecf (stale) Mirror 7: 0x9c48eecf (stale) Mirror 8: 0x9c48eecf (stale) Mirror 10: 0x9c48eecf (stale) Mirror 11: 0x9c48eecf (stale) Mirror 12: 0x9c48eecf (stale) Mirror 13: 0x9c48eecf (stale) CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 1: 0x246e1a20 Mirror 14: 0x246e1a20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd8f: skipped 000298 1789124587.007784 write 0x013246 thru 0x01bd39 (0x8af4 bytes) 000299 1789124587.081864 trunc from 0x0100af to 0x01ee43 (0xed95 bytes) 000300 1789124587.099270 mapread 0x01ff1e thru 0x0201ca (0x2ad bytes) 000301 1789124587.109865 punch from 0x01b178 to 0x02a88b (0xf714 bytes) 000302 1789124587.115675 fallocate 0x02e646 thru 0x03b812 (0xd1cd bytes) 000303 1789124587.128609 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 2: 0x9c48eecf (stale) Mirror 3: 0x9c48eecf (stale) Mirror 6: 0x9c48eecf (stale) Mirror 7: 0x9c48eecf (stale) Mirror 8: 0x9c48eecf (stale) Mirror 10: 0x9c48eecf (stale) Mirror 11: 0x9c48eecf (stale) Mirror 12: 0x9c48eecf (stale) Mirror 13: 0x9c48eecf (stale) Mirror 14: 0x246e1a20 (stale) CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 1: 0x4a7dc55c Mirror 15: 0x4a7dc55c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd8f: skipped 000305 1789124588.502307 mapread 0x012d4e thru 0x01f33f (0xc5f2 bytes) 000306 1789124588.561282 read 0x002e2b thru 0x00ede0 (0xbfb6 bytes) 000307 1789124588.583638 trunc from 0x00499f to 0x01369f (0xed01 bytes) 000308 1789124588.694373 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 2: 0x9c48eecf (stale) Mirror 3: 0x9c48eecf (stale) Mirror 6: 0x9c48eecf (stale) Mirror 8: 0x9c48eecf (stale) Mirror 10: 0x9c48eecf (stale) Mirror 11: 0x9c48eecf (stale) Mirror 12: 0x9c48eecf (stale) Mirror 13: 0x9c48eecf (stale) Mirror 14: 0x246e1a20 (stale) Mirror 15: 0x4a7dc55c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd8f): Mirror 2: 0x9c48eecf (stale) Mirror 3: 0x9c48eecf (stale) Mirror 6: 0x9c48eecf (stale) Mirror 8: 0x9c48eecf (stale) Mirror 10: 0x9c48eecf (stale) Mirror 11: 0x9c48eecf (stale) Mirror 12: 0x9c48eecf (stale) Mirror 13: 0x9c48eecf (stale) Mirror 14: 0x246e1a20 (stale) Mirror 15: 0x4a7dc55c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd8f: skipped 000309 1789124589.617177 trunc from 0x01a2ef to 0x026d1b (0xca2d bytes) 000310 1789124589.624860 fallocate 0x028dd3 thru 0x033345 (0xa573 bytes) 000311 1789124589.629237 read 0x01ed51 thru 0x02da9a (0xed4a bytes) 000312 1789124589.639769 punch from 0x039990 to 0x03dd8e (0x43ff bytes) 000313 1789124589.648162 mapread 0x01fd54 thru 0x02c4e8 (0xc795 bytes) 000314 1789124589.651332 punch from 0x0226ca to 0x025428 (0x2d5f bytes) 000315 1789124589.661701 trunc from 0x0254bf to 0x02b2fc (0x5e3e bytes) 000316 1789124589.674637 punch from 0x028c1a to 0x032537 (0x991e bytes) 000317 1789124589.682474 trunc from 0x03dd8f to 0x032e5e (0xaf30 bytes) 000318 1789124589.757551 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x32e5f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32e5f): Mirror 2: 0xe7d81206 (stale) Mirror 3: 0xe7d81206 (stale) Mirror 6: 0xe7d81206 (stale) Mirror 8: 0xe7d81206 (stale) Mirror 10: 0xe7d81206 (stale) Mirror 11: 0xe7d81206 (stale) Mirror 12: 0xe7d81206 (stale) Mirror 13: 0xe7d81206 (stale) Mirror 14: 0x12e81ab2 (stale) Mirror 15: 0x174e13f5 (stale) CRC-32 checksum value for chunk [0, 0x32e5f): Mirror 1: 0x174e13f5 Mirror 16: 0x174e13f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32e5f: skipped 000320 1789124591.517381 trunc from 0x009e77 to 0x0151c2 (0xb34c bytes) 000322 1789124591.609832 fallocate 0x00f66f thru 0x01ca6e (0xd400 bytes) 000323 1789124591.630824 trunc from 0x032e5f to 0x02a1fc (0x8c62 bytes) 000324 1789124591.691527 mapwrite 0x018b07 thru 0x02279d (0x9c97 bytes) 000325 1789124591.792244 write 0x03cccb thru 0x03ffff (0x3335 bytes) 000326 1789124591.797731 write 0x00a2f5 thru 0x012bd7 (0x88e3 bytes) 000327 1789124591.856004 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x48976345 (stale) Mirror 3: 0x48976345 (stale) Mirror 6: 0x48976345 (stale) Mirror 10: 0x48976345 (stale) Mirror 11: 0x48976345 (stale) Mirror 12: 0x48976345 (stale) Mirror 13: 0x48976345 (stale) Mirror 14: 0x73e5d780 (stale) Mirror 15: 0xda09ccc1 (stale) Mirror 16: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x48976345 (stale) Mirror 3: 0x48976345 (stale) Mirror 6: 0x48976345 (stale) Mirror 10: 0x48976345 (stale) Mirror 11: 0x48976345 (stale) Mirror 12: 0x48976345 (stale) Mirror 13: 0x48976345 (stale) Mirror 14: 0x73e5d780 (stale) Mirror 15: 0xda09ccc1 (stale) Mirror 16: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000328 1789124592.643256 fallocate 0x00e832 thru 0x018b19 (0xa2e8 bytes) 000329 1789124592.650123 fallocate 0x011fca thru 0x020e41 (0xee78 bytes) 000331 1789124592.657088 punch from 0x006b7b to 0x00cc21 (0x60a7 bytes) 000332 1789124592.664464 write 0x000da8 thru 0x0036ce (0x2927 bytes) 000333 1789124592.688803 fallocate 0x0182ee thru 0x023b0e (0xb821 bytes) 000334 1789124592.693850 read 0x015a21 thru 0x0219f2 (0xbfd2 bytes) 000335 1789124592.709457 MIRROR_RESYNC 11 mirrors 000336 1789124595.807202 read 0x009aea thru 0x00cc6b (0x3182 bytes) 000337 1789124595.816233 mapread 0x0318e9 thru 0x03c7d3 (0xaeeb bytes) 000338 1789124595.842552 punch from 0x03118f to 0x0328f9 (0x176b bytes) 000339 1789124595.882350 trunc from 0x040000 to 0x02092d (0x1f6d2 bytes) 000340 1789124595.905763 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2092e): Mirror 2: 0xb149abc0 (stale) Mirror 6: 0xb149abc0 (stale) Mirror 10: 0xb149abc0 (stale) Mirror 11: 0xb149abc0 (stale) Mirror 12: 0xb149abc0 (stale) Mirror 13: 0xb149abc0 (stale) Mirror 14: 0xb149abc0 (stale) Mirror 15: 0xb149abc0 (stale) Mirror 16: 0xb149abc0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2092e): Mirror 2: 0xb149abc0 (stale) Mirror 6: 0xb149abc0 (stale) Mirror 10: 0xb149abc0 (stale) Mirror 11: 0xb149abc0 (stale) Mirror 12: 0xb149abc0 (stale) Mirror 13: 0xb149abc0 (stale) Mirror 14: 0xb149abc0 (stale) Mirror 15: 0xb149abc0 (stale) Mirror 16: 0xb149abc0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2092e: skipped 000341 1789124596.426617 write 0x01f069 thru 0x020337 (0x12cf bytes) 000343 1789124596.448391 trunc from 0x02092e to 0x021abd (0x1190 bytes) 000344 1789124596.465373 mapwrite 0x01ade4 thru 0x024b3d (0x9d5a bytes) 000345 1789124596.531161 trunc from 0x007d9a to 0x015d1a (0xdf81 bytes) 000346 1789124596.536388 mapread 0x0096fe thru 0x013466 (0x9d69 bytes) 000347 1789124596.553747 mapwrite 0x03c6af thru 0x03ffff (0x3951 bytes) 000348 1789124596.596326 MIRROR_RESYNC 10 mirrors 000349 1789124598.676312 read 0x032184 thru 0x035603 (0x3480 bytes) 000350 1789124598.682730 write 0x01e5e6 thru 0x02b496 (0xceb1 bytes) 000351 1789124598.740322 read 0x014cc7 thru 0x020c11 (0xbf4b bytes) 000353 1789124598.758051 write 0x03666a thru 0x03754d (0xee4 bytes) 000354 1789124598.759837 write 0x01bcdd thru 0x01e577 (0x289b bytes) 000355 1789124598.761912 mapread 0x02a17e thru 0x0362f3 (0xc176 bytes) 000357 1789124598.764428 mapwrite 0x013348 thru 0x017479 (0x4132 bytes) 000358 1789124598.818632 read 0x0177c9 thru 0x01f4f8 (0x7d30 bytes) 000359 1789124598.820420 punch from 0x009e85 to 0x00de6c (0x3fe8 bytes) 000360 1789124598.828228 fallocate 0x031587 thru 0x038891 (0x730b bytes) 000362 1789124598.837463 trunc from 0x03290c to 0x03777a (0x4e6f bytes) 000363 1789124598.847396 mapread 0x036f82 thru 0x03ffff (0x907e bytes) 000364 1789124598.873702 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4d16e2c9 (stale) Mirror 6: 0x4d16e2c9 (stale) Mirror 10: 0x4d16e2c9 (stale) Mirror 11: 0x4d16e2c9 (stale) Mirror 12: 0x4d16e2c9 (stale) Mirror 13: 0x4d16e2c9 (stale) Mirror 14: 0x4d16e2c9 (stale) Mirror 15: 0x4d16e2c9 (stale) Mirror 16: 0x4d16e2c9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd8dfe64f Mirror 17: 0xd8dfe64f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000365 1789124600.598046 trunc from 0x040000 to 0x016afa (0x29505 bytes) 000366 1789124600.673268 fallocate 0x00207f thru 0x0091d1 (0x7153 bytes) 000367 1789124600.697620 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16afb): Mirror 2: 0xd3616e99 (stale) Mirror 6: 0xd3616e99 (stale) Mirror 10: 0xd3616e99 (stale) Mirror 11: 0xd3616e99 (stale) Mirror 13: 0xd3616e99 (stale) Mirror 14: 0xd3616e99 (stale) Mirror 15: 0xd3616e99 (stale) Mirror 16: 0xd3616e99 (stale) Mirror 17: 0x2a8fe87c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16afb): Mirror 2: 0xd3616e99 (stale) Mirror 6: 0xd3616e99 (stale) Mirror 10: 0xd3616e99 (stale) Mirror 11: 0xd3616e99 (stale) Mirror 13: 0xd3616e99 (stale) Mirror 14: 0xd3616e99 (stale) Mirror 15: 0xd3616e99 (stale) Mirror 16: 0xd3616e99 (stale) Mirror 17: 0x2a8fe87c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16afb: skipped 000368 1789124601.499276 write 0x00b0e8 thru 0x014b4a (0x9a63 bytes) 000369 1789124601.515693 mapwrite 0x00bf6c thru 0x01bb93 (0xfc28 bytes) 000370 1789124601.600468 fallocate 0x013a6d thru 0x0219bb (0xdf4f bytes) 000371 1789124601.619840 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bb94): Mirror 2: 0x4669bc2 (stale) Mirror 6: 0x4669bc2 (stale) Mirror 10: 0x4669bc2 (stale) Mirror 11: 0x4669bc2 (stale) Mirror 13: 0x4669bc2 (stale) Mirror 14: 0x4669bc2 (stale) Mirror 16: 0x4669bc2 (stale) Mirror 17: 0xd4ab5761 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bb94): Mirror 2: 0x4669bc2 (stale) Mirror 6: 0x4669bc2 (stale) Mirror 10: 0x4669bc2 (stale) Mirror 11: 0x4669bc2 (stale) Mirror 13: 0x4669bc2 (stale) Mirror 14: 0x4669bc2 (stale) Mirror 16: 0x4669bc2 (stale) Mirror 17: 0xd4ab5761 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bb94: skipped 000372 1789124602.414766 trunc from 0x01bb94 to 0x03eb44 (0x22fb1 bytes) 000373 1789124602.443768 trunc from 0x03a198 to 0x03eb44 (0x49ad bytes) 000374 1789124602.450762 read 0x01d408 thru 0x01f33c (0x1f35 bytes) 000375 1789124602.458129 write 0x03ae7c thru 0x03fb4c (0x4cd1 bytes) 000376 1789124602.467615 trunc from 0x02f8fa to 0x03eba7 (0xf2ae bytes) 000377 1789124602.488561 fallocate 0x026461 thru 0x02f806 (0x93a6 bytes) 000378 1789124602.498333 trunc from 0x03fb4d to 0x023199 (0x1c9b3 bytes) 000379 1789124602.516989 mapread 0x00df62 thru 0x010093 (0x2132 bytes) 000380 1789124602.539775 mapwrite 0x03fd14 thru 0x03ffff (0x2ec bytes) 000381 1789124602.591610 mapread 0x03db04 thru 0x03ffff (0x24fc bytes) 000382 1789124602.592662 trunc from 0x040000 to 0x00145d (0x3eba2 bytes) 000385 1789124602.611006 trunc from 0x00145e to 0x00caff (0xb6a2 bytes) 000386 1789124602.625582 write 0x0261e0 thru 0x035181 (0xefa2 bytes) 000387 1789124602.629271 mapread 0x02d654 thru 0x02ef03 (0x18b0 bytes) 000388 1789124602.630356 read 0x013254 thru 0x01c2ff (0x90ac bytes) 000389 1789124602.645763 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35182): Mirror 2: 0xdd50da9a (stale) Mirror 6: 0xdd50da9a (stale) Mirror 10: 0xdd50da9a (stale) Mirror 11: 0xdd50da9a (stale) Mirror 13: 0xdd50da9a (stale) Mirror 14: 0xdd50da9a (stale) Mirror 16: 0xdd50da9a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35182): Mirror 2: 0xdd50da9a (stale) Mirror 6: 0xdd50da9a (stale) Mirror 10: 0xdd50da9a (stale) Mirror 11: 0xdd50da9a (stale) Mirror 13: 0xdd50da9a (stale) Mirror 14: 0xdd50da9a (stale) Mirror 16: 0xdd50da9a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35182: skipped 000390 1789124603.257617 trunc from 0x035182 to 0x0335cb (0x1bb6 bytes) 000391 1789124603.289417 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x335cc): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335cc): Mirror 2: 0x377fa7d (stale) Mirror 6: 0x377fa7d (stale) Mirror 10: 0x377fa7d (stale) Mirror 11: 0x377fa7d (stale) Mirror 13: 0x377fa7d (stale) Mirror 14: 0x377fa7d (stale) Mirror 16: 0x377fa7d (stale) CRC-32 checksum value for chunk [0, 0x335cc): Mirror 1: 0x95bea375 Mirror 17: 0x95bea375 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335cc: skipped 000392 1789124604.703748 MIRROR_RESYNC 9 mirrors 000393 1789124606.391720 write 0x02ba08 thru 0x02fc81 (0x427a bytes) 000394 1789124606.444833 punch from 0x028c2d to 0x0330e9 (0xa4bd bytes) 000396 1789124606.456709 punch from 0x00215e to 0x002e0d (0xcb0 bytes) 000397 1789124606.461680 write 0x0397dd thru 0x03ffff (0x6823 bytes) 000398 1789124606.464717 read 0x009cd6 thru 0x00d3b0 (0x36db bytes) 000399 1789124606.489258 read 0x0241f8 thru 0x02bd52 (0x7b5b bytes) 000400 1789124606.517296 punch from 0x03a6d8 to 0x03ffff (0x5928 bytes) 000401 1789124606.556946 trunc from 0x01992c to 0x022d4d (0x9422 bytes) 000402 1789124606.572064 punch from 0x03570b to 0x03adca (0x56c0 bytes) 000403 1789124606.582676 trunc from 0x00b813 to 0x01aa7f (0xf26d bytes) 000404 1789124606.593826 read 0x013796 thru 0x01af56 (0x77c1 bytes) 000406 1789124606.624688 mapread 0x00b133 thru 0x00cfe1 (0x1eaf bytes) 000407 1789124606.625981 punch from 0x00f0b1 to 0x017b18 (0x8a68 bytes) 000408 1789124606.647037 read 0x00b14c thru 0x010e01 (0x5cb6 bytes) 000409 1789124606.660297 punch from 0x011532 to 0x01e466 (0xcf35 bytes) 000410 1789124606.666607 punch from 0x019646 to 0x027c35 (0xe5f0 bytes) 000411 1789124606.675582 fallocate 0x00b63e thru 0x01743b (0xbdfe bytes) 000412 1789124606.693872 write 0x025f40 thru 0x0350d9 (0xf19a bytes) 000413 1789124606.705911 fallocate 0x023601 thru 0x02d006 (0x9a06 bytes) 000414 1789124606.729122 trunc from 0x040000 to 0x00d6ae (0x32951 bytes) 000415 1789124606.781277 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xd6af): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd6af): Mirror 2: 0x62b84fe9 (stale) Mirror 6: 0x62b84fe9 (stale) Mirror 10: 0x62b84fe9 (stale) Mirror 11: 0x62b84fe9 (stale) Mirror 13: 0x62b84fe9 (stale) Mirror 14: 0x62b84fe9 (stale) Mirror 16: 0x62b84fe9 (stale) Mirror 17: 0x62b84fe9 (stale) CRC-32 checksum value for chunk [0, 0xd6af): Mirror 1: 0x62b84fe9 Mirror 18: 0x62b84fe9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd6af: skipped 000416 1789124608.176798 mapread 0x001823 thru 0x00a5cd (0x8dab bytes) 000417 1789124608.201707 mapread 0x008975 thru 0x00d6ae (0x4d3a bytes) 000418 1789124608.202379 read 0x000ad4 thru 0x00d6ae (0xcbdb bytes) 000419 1789124608.218185 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xd6af): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd6af): Mirror 2: 0x62b84fe9 (stale) Mirror 6: 0x62b84fe9 (stale) Mirror 10: 0x62b84fe9 (stale) Mirror 11: 0x62b84fe9 (stale) Mirror 13: 0x62b84fe9 (stale) Mirror 14: 0x62b84fe9 (stale) Mirror 16: 0x62b84fe9 (stale) Mirror 17: 0x62b84fe9 (stale) CRC-32 checksum value for chunk [0, 0xd6af): Mirror 1: 0x62b84fe9 Mirror 18: 0x62b84fe9 Mirror 19: 0x62b84fe9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd6af: skipped 000420 1789124609.572416 write 0x01bf82 thru 0x021400 (0x547f bytes) 000421 1789124609.652629 mapwrite 0x021376 thru 0x025a71 (0x46fc bytes) 000422 1789124609.775506 trunc from 0x025a72 to 0x0270d8 (0x1667 bytes) 000423 1789124609.818275 fallocate 0x001506 thru 0x007140 (0x5c3b bytes) 000424 1789124609.834458 write 0x02514b thru 0x029b6a (0x4a20 bytes) 000425 1789124609.836368 trunc from 0x006674 to 0x00ebee (0x857b bytes) 000426 1789124609.857471 write 0x00b323 thru 0x00e9a4 (0x3682 bytes) 000428 1789124609.899620 punch from 0x0228db to 0x029b6a (0x7290 bytes) 000429 1789124609.921808 mapwrite 0x019d6c thru 0x028940 (0xebd5 bytes) 000430 1789124610.047244 mapread 0x00fe91 thru 0x015dd3 (0x5f43 bytes) 000432 1789124610.080142 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29b6b): Mirror 6: 0xa7d61873 (stale) Mirror 10: 0xa7d61873 (stale) Mirror 11: 0xa7d61873 (stale) Mirror 13: 0xa7d61873 (stale) Mirror 14: 0xa7d61873 (stale) Mirror 16: 0xa7d61873 (stale) Mirror 17: 0xa7d61873 (stale) Mirror 18: 0x49c8f172 (stale) Mirror 19: 0x49c8f172 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b6b): Mirror 6: 0xa7d61873 (stale) Mirror 10: 0xa7d61873 (stale) Mirror 11: 0xa7d61873 (stale) Mirror 13: 0xa7d61873 (stale) Mirror 14: 0xa7d61873 (stale) Mirror 16: 0xa7d61873 (stale) Mirror 17: 0xa7d61873 (stale) Mirror 18: 0x49c8f172 (stale) Mirror 19: 0x49c8f172 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b6b: skipped 000433 1789124611.097932 read 0x0117a1 thru 0x01c7d7 (0xb037 bytes) 000434 1789124611.118085 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x29b6b): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b6b): Mirror 6: 0xa7d61873 (stale) Mirror 10: 0xa7d61873 (stale) Mirror 11: 0xa7d61873 (stale) Mirror 13: 0xa7d61873 (stale) Mirror 14: 0xa7d61873 (stale) Mirror 16: 0xa7d61873 (stale) Mirror 17: 0xa7d61873 (stale) Mirror 18: 0x49c8f172 (stale) Mirror 19: 0x49c8f172 (stale) CRC-32 checksum value for chunk [0, 0x29b6b): Mirror 1: 0xaf94fc66 Mirror 20: 0xaf94fc66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b6b: skipped 000435 1789124612.617569 punch from 0x003b1c to 0x006869 (0x2d4e bytes) 000436 1789124612.674801 mapread 0x024b5a thru 0x029b6a (0x5011 bytes) 000437 1789124612.700395 punch from 0x018929 to 0x0232be (0xa996 bytes) 000438 1789124612.707230 trunc from 0x0042e1 to 0x00733d (0x305d bytes) 000439 1789124612.713410 mapwrite 0x00082a thru 0x00b028 (0xa7ff bytes) 000440 1789124612.760836 mapwrite 0x0242fd thru 0x02f61a (0xb31e bytes) 000441 1789124612.837482 mapwrite 0x004b64 thru 0x008fba (0x4457 bytes) 000442 1789124612.865380 write 0x01aeb3 thru 0x01c016 (0x1164 bytes) 000443 1789124612.877777 punch from 0x00fd38 to 0x0190b0 (0x9379 bytes) 000445 1789124612.895286 trunc from 0x00436e to 0x004979 (0x60c bytes) 000446 1789124612.907335 write 0x02511d thru 0x025f81 (0xe65 bytes) 000447 1789124612.914668 write 0x032591 thru 0x03c7b1 (0xa221 bytes) 000448 1789124612.918804 trunc from 0x014e56 to 0x0222aa (0xd455 bytes) 000449 1789124612.946796 trunc from 0x022cb2 to 0x027c38 (0x4f87 bytes) 000450 1789124612.955781 fallocate 0x03a987 thru 0x03f168 (0x47e2 bytes) 000451 1789124612.963051 trunc from 0x01c55d to 0x029a57 (0xd4fb bytes) 000452 1789124612.970804 mapwrite 0x038fbd thru 0x03ffff (0x7043 bytes) 000453 1789124613.053422 fallocate 0x02ea17 thru 0x03073a (0x1d24 bytes) 000454 1789124613.073384 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa39ea0cc (stale) Mirror 10: 0xa39ea0cc (stale) Mirror 11: 0xa39ea0cc (stale) Mirror 13: 0xa39ea0cc (stale) Mirror 14: 0xa39ea0cc (stale) Mirror 16: 0xa39ea0cc (stale) Mirror 17: 0xa39ea0cc (stale) Mirror 18: 0xc761fdaf (stale) Mirror 19: 0xc761fdaf (stale) Mirror 20: 0xaa3915f8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb3dd4c07 Mirror 21: 0xb3dd4c07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000457 1789124615.510637 trunc from 0x03408b to 0x03deea (0x9e60 bytes) 000458 1789124615.611281 mapread 0x005558 thru 0x009472 (0x3f1b bytes) 000460 1789124615.665733 trunc from 0x01ef26 to 0x023c7f (0x4d5a bytes) 000461 1789124615.671743 trunc from 0x02e051 to 0x0340ab (0x605b bytes) 000462 1789124615.684766 mapread 0x00bf22 thru 0x0161da (0xa2b9 bytes) 000463 1789124615.708207 trunc from 0x040000 to 0x03901d (0x6fe2 bytes) 000464 1789124615.764682 mapwrite 0x0163b7 thru 0x021a20 (0xb66a bytes) 000465 1789124615.810395 fallocate 0x0134e4 thru 0x0198e9 (0x6406 bytes) 000466 1789124615.819144 write 0x036f46 thru 0x03ffff (0x90ba bytes) 000469 1789124615.831155 mapwrite 0x002efc thru 0x010a95 (0xdb9a bytes) 000470 1789124615.906509 write 0x00fb84 thru 0x01346e (0x38eb bytes) 000471 1789124615.917841 MIRROR_RESYNC 12 mirrors 000472 1789124621.894282 mapwrite 0x02d6ce thru 0x035c79 (0x85ac bytes) 000473 1789124621.998392 punch from 0x0222aa to 0x029121 (0x6e78 bytes) 000474 1789124622.008770 mapread 0x022d43 thru 0x0289d1 (0x5c8f bytes) 000475 1789124622.032750 fallocate 0x0259ce thru 0x02732c (0x195f bytes) 000476 1789124622.051774 read 0x01cc74 thru 0x01e280 (0x160d bytes) 000477 1789124622.058449 mapread 0x0257d0 thru 0x02d484 (0x7cb5 bytes) 000478 1789124622.070302 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 10: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 13: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 18: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x73ecaeb5 Mirror 22: 0x73ecaeb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1789124624.213659 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 10: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 13: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 10: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 13: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x73ecaeb5 Mirror 22: 0x73ecaeb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000480 1789124625.342925 punch from 0x016aa7 to 0x026306 (0xf860 bytes) 000481 1789124625.414431 mapwrite 0x0083e5 thru 0x017923 (0xf53f bytes) 000482 1789124625.506146 read 0x03485d thru 0x03ffff (0xb7a3 bytes) 000483 1789124625.538613 trunc from 0x021d6e to 0x022f7f (0x1212 bytes) 000484 1789124625.546131 fallocate 0x023c24 thru 0x02fffd (0xc3da bytes) 000486 1789124625.559948 write 0x01a275 thru 0x0288c8 (0xe654 bytes) 000487 1789124625.576106 mapwrite 0x00dbe1 thru 0x0195e0 (0xba00 bytes) 000489 1789124625.638752 write 0x0010ca thru 0x00d02d (0xbf64 bytes) 000490 1789124625.648925 write 0x02a789 thru 0x030cf2 (0x656a bytes) 000491 1789124625.695624 fallocate 0x02a487 thru 0x03006f (0x5be9 bytes) 000492 1789124625.711961 fallocate 0x00d945 thru 0x016b80 (0x923c bytes) 000493 1789124625.730969 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 10: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 13: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) Mirror 22: 0x73ecaeb5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x61e8a8ac Mirror 23: 0x61e8a8ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000494 1789124626.517259 fallocate 0x02902d thru 0x02ac8a (0x1c5e bytes) 000495 1789124626.579176 trunc from 0x033c15 to 0x03ffff (0xc3eb bytes) 000496 1789124626.588178 mapwrite 0x033aff thru 0x03ffff (0xc501 bytes) 000497 1789124626.638797 read 0x0346a3 thru 0x03d9ee (0x934c bytes) 000498 1789124626.639841 trunc from 0x040000 to 0x014a77 (0x2b588 bytes) 000499 1789124626.722540 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x14a78): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14a78): Mirror 6: 0x4f233680 (stale) Mirror 10: 0x4f233680 (stale) Mirror 11: 0x4f233680 (stale) Mirror 13: 0x4f233680 (stale) Mirror 14: 0x4f233680 (stale) Mirror 16: 0x4f233680 (stale) Mirror 17: 0x4f233680 (stale) Mirror 19: 0x4f233680 (stale) Mirror 20: 0x4f233680 (stale) Mirror 21: 0x4f233680 (stale) Mirror 22: 0x4f233680 (stale) Mirror 23: 0xc7a3eb2a (stale) CRC-32 checksum value for chunk [0, 0x14a78): Mirror 1: 0xc7a3eb2a Mirror 24: 0xc7a3eb2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14a78: skipped 000500 1789124628.043302 mapread 0x003c52 thru 0x013236 (0xf5e5 bytes) 000501 1789124628.078474 trunc from 0x014a78 to 0x00b6ad (0x93ca bytes) 000502 1789124628.160517 MIRROR_SPLIT mirror 2 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb6ae): Mirror 6: 0x23153f4a (stale) Mirror 11: 0x23153f4a (stale) Mirror 13: 0x23153f4a (stale) Mirror 14: 0x23153f4a (stale) Mirror 16: 0x23153f4a (stale) Mirror 17: 0x23153f4a (stale) Mirror 19: 0x23153f4a (stale) Mirror 20: 0x23153f4a (stale) Mirror 21: 0x23153f4a (stale) Mirror 22: 0x23153f4a (stale) Mirror 23: 0x6d357a3c (stale) Mirror 24: 0x6d357a3c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb6ae): Mirror 6: 0x23153f4a (stale) Mirror 11: 0x23153f4a (stale) Mirror 13: 0x23153f4a (stale) Mirror 14: 0x23153f4a (stale) Mirror 16: 0x23153f4a (stale) Mirror 17: 0x23153f4a (stale) Mirror 19: 0x23153f4a (stale) Mirror 20: 0x23153f4a (stale) Mirror 21: 0x23153f4a (stale) Mirror 22: 0x23153f4a (stale) Mirror 23: 0x6d357a3c (stale) Mirror 24: 0x6d357a3c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb6ae: skipped 000504 1789124628.932848 trunc from 0x0059bc to 0x006e10 (0x1455 bytes) 000505 1789124628.938817 trunc from 0x00b6ae to 0x01f2fb (0x13c4e bytes) 000506 1789124628.986001 write 0x01b716 thru 0x024f2d (0x9818 bytes) 000507 1789124629.003440 mapwrite 0x011b7e thru 0x018a2c (0x6eaf bytes) 000508 1789124629.132903 trunc from 0x024f2e to 0x01db8b (0x73a2 bytes) 000509 1789124629.171390 read 0x015cc9 thru 0x01db8b (0x7ec3 bytes) 000510 1789124629.172059 trunc from 0x0194c0 to 0x01bce0 (0x2821 bytes) 000511 1789124629.184114 trunc from 0x01db8c to 0x008dcc (0x14dbf bytes) 000512 1789124629.203029 read 0x0019c5 thru 0x008dcc (0x7408 bytes) 000514 1789124629.240297 read 0x003506 thru 0x0079d3 (0x44ce bytes) 000515 1789124629.240860 mapwrite 0x0375d0 thru 0x03ffff (0x8a30 bytes) 000516 1789124629.322128 trunc from 0x007097 to 0x012854 (0xb7be bytes) 000517 1789124629.356389 punch from 0x03770a to 0x03ffff (0x88f6 bytes) 000518 1789124629.363587 write 0x0017a3 thru 0x00b65e (0x9ebc bytes) 000519 1789124629.385920 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) Mirror 22: 0x73ecaeb5 (stale) Mirror 23: 0x61e8a8ac (stale) Mirror 24: 0x3f7714b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) Mirror 22: 0x73ecaeb5 (stale) Mirror 23: 0x61e8a8ac (stale) Mirror 24: 0x3f7714b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000522 1789124630.371989 write 0x007c70 thru 0x00e769 (0x6afa bytes) 000523 1789124630.401752 read 0x021cf6 thru 0x0239b6 (0x1cc1 bytes) 000524 1789124630.415425 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x807d47e0 (stale) Mirror 11: 0x807d47e0 (stale) Mirror 14: 0x807d47e0 (stale) Mirror 16: 0x807d47e0 (stale) Mirror 17: 0x807d47e0 (stale) Mirror 19: 0x807d47e0 (stale) Mirror 20: 0x807d47e0 (stale) Mirror 21: 0x807d47e0 (stale) Mirror 22: 0x73ecaeb5 (stale) Mirror 23: 0x61e8a8ac (stale) Mirror 24: 0x3f7714b5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa2f8376c Mirror 25: 0xa2f8376c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000525 1789124632.585166 fallocate 0x0269a1 thru 0x02f35e (0x89be bytes) 000526 1789124632.699692 MIRROR_RESYNC 13 mirrors 000527 1789124636.875058 trunc from 0x01afbf to 0x0225c1 (0x7603 bytes) 000528 1789124636.933519 write 0x03e14d thru 0x03ffff (0x1eb3 bytes) 000529 1789124636.947063 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa2f8376c (stale) Mirror 11: 0xa2f8376c (stale) Mirror 14: 0xa2f8376c (stale) Mirror 16: 0xa2f8376c (stale) Mirror 19: 0xa2f8376c (stale) Mirror 20: 0xa2f8376c (stale) Mirror 21: 0xa2f8376c (stale) Mirror 22: 0xa2f8376c (stale) Mirror 23: 0xa2f8376c (stale) Mirror 24: 0xa2f8376c (stale) Mirror 25: 0xa2f8376c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa2f8376c (stale) Mirror 11: 0xa2f8376c (stale) Mirror 14: 0xa2f8376c (stale) Mirror 16: 0xa2f8376c (stale) Mirror 19: 0xa2f8376c (stale) Mirror 20: 0xa2f8376c (stale) Mirror 21: 0xa2f8376c (stale) Mirror 22: 0xa2f8376c (stale) Mirror 23: 0xa2f8376c (stale) Mirror 24: 0xa2f8376c (stale) Mirror 25: 0xa2f8376c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000530 1789124638.132616 write 0x020b7d thru 0x029346 (0x87ca bytes) 000531 1789124638.172668 mapwrite 0x00de01 thru 0x00e8bb (0xabb bytes) 000532 1789124638.248394 punch from 0x021e84 to 0x024487 (0x2604 bytes) 000533 1789124638.276668 write 0x01b2eb thru 0x0282a2 (0xcfb8 bytes) 000534 1789124638.310531 mapwrite 0x02d40a thru 0x02e4ca (0x10c1 bytes) 000535 1789124638.403958 read 0x0085b0 thru 0x010bb3 (0x8604 bytes) 000536 1789124638.447619 fallocate 0x011368 thru 0x01fa3e (0xe6d7 bytes) 000537 1789124638.455462 write 0x039159 thru 0x03a660 (0x1508 bytes) 000538 1789124638.466622 fallocate 0x018dfb thru 0x01c212 (0x3418 bytes) 000541 1789124638.478120 mapread 0x039874 thru 0x03ffff (0x678c bytes) 000542 1789124638.493000 write 0x00527d thru 0x010143 (0xaec7 bytes) 000543 1789124638.499455 mapread 0x000b3e thru 0x00acfe (0xa1c1 bytes) 000544 1789124638.515023 trunc from 0x040000 to 0x008eef (0x37110 bytes) 000545 1789124638.539812 read 0x0087f4 thru 0x008eef (0x6fc bytes) 000546 1789124638.540467 trunc from 0x008ef0 to 0x01a772 (0x11883 bytes) 000547 1789124638.560628 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1a773): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a773): Mirror 6: 0x19d7d081 (stale) Mirror 11: 0x19d7d081 (stale) Mirror 14: 0x19d7d081 (stale) Mirror 16: 0x19d7d081 (stale) Mirror 19: 0x19d7d081 (stale) Mirror 20: 0x19d7d081 (stale) Mirror 21: 0x19d7d081 (stale) Mirror 22: 0x19d7d081 (stale) Mirror 23: 0x19d7d081 (stale) Mirror 24: 0x19d7d081 (stale) Mirror 25: 0x19d7d081 (stale) CRC-32 checksum value for chunk [0, 0x1a773): Mirror 1: 0x104920f2 Mirror 26: 0x104920f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a773: skipped 000548 1789124640.680437 write 0x016b92 thru 0x02697b (0xfdea bytes) 000549 1789124640.833765 fallocate 0x032569 thru 0x033d81 (0x1819 bytes) 000551 1789124640.847089 trunc from 0x02697c to 0x019420 (0xd55b bytes) 000553 1789124640.924212 trunc from 0x019421 to 0x02f31c (0x15efc bytes) 000554 1789124640.945044 read 0x001aec thru 0x011655 (0xfb6a bytes) 000555 1789124640.967027 mapwrite 0x0285df thru 0x02d45b (0x4e7d bytes) 000556 1789124641.024287 trunc from 0x013e7c to 0x01d3ea (0x956f bytes) 000557 1789124641.030010 write 0x009839 thru 0x0144db (0xaca3 bytes) 000558 1789124641.044321 punch from 0x005444 to 0x007a2c (0x25e9 bytes) 000559 1789124641.059186 trunc from 0x02f31d to 0x02ecd4 (0x648 bytes) 000560 1789124641.113733 mapread 0x01cf5c thru 0x01d068 (0x10d bytes) 000561 1789124641.141391 trunc from 0x01714a to 0x023aef (0xc9a6 bytes) 000562 1789124641.168208 trunc from 0x00bc3c to 0x017e0c (0xc1d1 bytes) 000565 1789124641.219016 trunc from 0x02ecd5 to 0x00a321 (0x249b3 bytes) 000567 1789124641.244998 fallocate 0x027f4a thru 0x02fc7b (0x7d32 bytes) 000568 1789124641.292822 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fc7c): Mirror 6: 0x43abf9d6 (stale) Mirror 11: 0x43abf9d6 (stale) Mirror 14: 0x43abf9d6 (stale) Mirror 16: 0x43abf9d6 (stale) Mirror 19: 0x43abf9d6 (stale) Mirror 20: 0x43abf9d6 (stale) Mirror 21: 0x43abf9d6 (stale) Mirror 22: 0x43abf9d6 (stale) Mirror 23: 0x43abf9d6 (stale) Mirror 25: 0x43abf9d6 (stale) Mirror 26: 0xf786a2ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc7c): Mirror 6: 0x43abf9d6 (stale) Mirror 11: 0x43abf9d6 (stale) Mirror 14: 0x43abf9d6 (stale) Mirror 16: 0x43abf9d6 (stale) Mirror 19: 0x43abf9d6 (stale) Mirror 20: 0x43abf9d6 (stale) Mirror 21: 0x43abf9d6 (stale) Mirror 22: 0x43abf9d6 (stale) Mirror 23: 0x43abf9d6 (stale) Mirror 25: 0x43abf9d6 (stale) Mirror 26: 0xf786a2ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc7c: skipped 000569 1789124642.452021 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2fc7c): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc7c): Mirror 6: 0x43abf9d6 (stale) Mirror 11: 0x43abf9d6 (stale) Mirror 14: 0x43abf9d6 (stale) Mirror 16: 0x43abf9d6 (stale) Mirror 19: 0x43abf9d6 (stale) Mirror 20: 0x43abf9d6 (stale) Mirror 21: 0x43abf9d6 (stale) Mirror 22: 0x43abf9d6 (stale) Mirror 23: 0x43abf9d6 (stale) Mirror 25: 0x43abf9d6 (stale) Mirror 26: 0xf786a2ec (stale) CRC-32 checksum value for chunk [0, 0x2fc7c): Mirror 1: 0x26df69fb Mirror 27: 0x26df69fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc7c: skipped 000570 1789124644.133405 fallocate 0x0127e8 thru 0x016bf2 (0x440b bytes) 000571 1789124644.189678 write 0x03b9f8 thru 0x03eb05 (0x310e bytes) 000572 1789124644.195329 fallocate 0x03d517 thru 0x03ffff (0x2ae9 bytes) 000573 1789124644.200657 mapwrite 0x013f54 thru 0x01bf5d (0x800a bytes) 000574 1789124644.244826 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa2f8376c (stale) Mirror 11: 0xa2f8376c (stale) Mirror 14: 0xa2f8376c (stale) Mirror 16: 0xa2f8376c (stale) Mirror 19: 0xa2f8376c (stale) Mirror 20: 0xa2f8376c (stale) Mirror 21: 0xa2f8376c (stale) Mirror 22: 0xa2f8376c (stale) Mirror 23: 0xa2f8376c (stale) Mirror 25: 0xa2f8376c (stale) Mirror 26: 0x7077cdda (stale) Mirror 27: 0xbecc14aa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5abcb90c Mirror 28: 0x5abcb90c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000575 1789124645.656383 punch from 0x004ea2 to 0x0053bd (0x51c bytes) 000576 1789124645.731190 mapwrite 0x024bf1 thru 0x02d210 (0x8620 bytes) 000577 1789124645.790848 punch from 0x033da3 to 0x03ca3a (0x8c98 bytes) 000578 1789124645.807154 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa2f8376c (stale) Mirror 11: 0xa2f8376c (stale) Mirror 14: 0xa2f8376c (stale) Mirror 16: 0xa2f8376c (stale) Mirror 19: 0xa2f8376c (stale) Mirror 20: 0xa2f8376c (stale) Mirror 21: 0xa2f8376c (stale) Mirror 22: 0xa2f8376c (stale) Mirror 23: 0xa2f8376c (stale) Mirror 25: 0xa2f8376c (stale) Mirror 26: 0x7077cdda (stale) Mirror 27: 0xbecc14aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa2f8376c (stale) Mirror 11: 0xa2f8376c (stale) Mirror 14: 0xa2f8376c (stale) Mirror 16: 0xa2f8376c (stale) Mirror 19: 0xa2f8376c (stale) Mirror 20: 0xa2f8376c (stale) Mirror 21: 0xa2f8376c (stale) Mirror 22: 0xa2f8376c (stale) Mirror 23: 0xa2f8376c (stale) Mirror 25: 0xa2f8376c (stale) Mirror 26: 0x7077cdda (stale) Mirror 27: 0xbecc14aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000579 1789124646.733868 trunc from 0x040000 to 0x00b09d (0x34f62 bytes) 000580 1789124646.780244 fallocate 0x010c2b thru 0x0169e0 (0x5db6 bytes) 000581 1789124646.792072 trunc from 0x000919 to 0x00b09d (0xa785 bytes) 000582 1789124646.799636 read 0x001c84 thru 0x002bac (0xf29 bytes) 000583 1789124646.811675 mapwrite 0x037cdb thru 0x0397ff (0x1b25 bytes) 000584 1789124646.881563 mapwrite 0x00f95b thru 0x013897 (0x3f3d bytes) 000585 1789124646.920696 mapwrite 0x03159c thru 0x03c503 (0xaf68 bytes) 000587 1789124647.010091 trunc from 0x019c74 to 0x01afe0 (0x136d bytes) 000588 1789124647.016669 fallocate 0x00dc43 thru 0x00e794 (0xb52 bytes) 000589 1789124647.022824 mapwrite 0x032fa3 thru 0x03a9e8 (0x7a46 bytes) 000590 1789124647.049064 fallocate 0x02644a thru 0x028304 (0x1ebb bytes) 000591 1789124647.062394 MIRROR_RESYNC 13 mirrors 000595 1789124650.520335 MIRROR_EXTEND to 14 mirrors 000596 1789124651.643389 trunc from 0x012a9d to 0x01d24b (0xa7af bytes) 000597 1789124651.682839 write 0x038631 thru 0x03ffff (0x79cf bytes) 000598 1789124651.700301 read 0x0226fd thru 0x0239b9 (0x12bd bytes) 000600 1789124651.716073 MIRROR_RESYNC 14 mirrors 000601 1789124655.249071 fallocate 0x03bfa4 thru 0x03ffff (0x405c bytes) 000602 1789124655.295998 trunc from 0x021bda to 0x0316a5 (0xfacc bytes) 000603 1789124655.311247 read 0x023c8a thru 0x030436 (0xc7ad bytes) 000604 1789124655.327949 trunc from 0x03434e to 0x03ffff (0xbcb2 bytes) 000605 1789124655.354575 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x94018312 (stale) Mirror 11: 0x94018312 (stale) Mirror 14: 0x94018312 (stale) Mirror 16: 0x94018312 (stale) Mirror 19: 0x94018312 (stale) Mirror 20: 0x94018312 (stale) Mirror 21: 0x94018312 (stale) Mirror 22: 0x94018312 (stale) Mirror 23: 0x94018312 (stale) Mirror 25: 0x94018312 (stale) Mirror 26: 0x94018312 (stale) Mirror 27: 0x94018312 (stale) Mirror 28: 0x94018312 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xca154017 Mirror 29: 0xca154017 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000606 1789124657.373266 punch from 0x006d0c to 0x015381 (0xe676 bytes) 000607 1789124657.479833 trunc from 0x040000 to 0x0229d1 (0x1d62e bytes) 000608 1789124657.550589 read 0x005fb8 thru 0x014ca2 (0xeceb bytes) 000609 1789124657.588123 MIRROR_RESYNC 15 mirrors 000610 1789124660.124079 punch from 0x01d754 to 0x0229d1 (0x527e bytes) 000612 1789124660.183707 mapwrite 0x004124 thru 0x00481b (0x6f8 bytes) 000613 1789124660.208269 trunc from 0x0150ac to 0x0162f3 (0x1248 bytes) 000614 1789124660.215241 fallocate 0x02157b thru 0x030a9a (0xf520 bytes) 000615 1789124660.224267 trunc from 0x00ade4 to 0x01accd (0xfeea bytes) 000616 1789124660.232316 fallocate 0x01635f thru 0x023440 (0xd0e2 bytes) 000617 1789124660.238316 fallocate 0x02c3b4 thru 0x0395d9 (0xd226 bytes) 000618 1789124660.245978 mapwrite 0x025661 thru 0x02f8a4 (0xa244 bytes) 000619 1789124660.298836 trunc from 0x022ca3 to 0x026786 (0x3ae4 bytes) 000620 1789124660.321656 trunc from 0x019b3a to 0x02523f (0xb706 bytes) 000621 1789124660.339133 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x395da): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395da): Mirror 6: 0xf4a6ab6 (stale) Mirror 11: 0xf4a6ab6 (stale) Mirror 14: 0xf4a6ab6 (stale) Mirror 16: 0xf4a6ab6 (stale) Mirror 19: 0xf4a6ab6 (stale) Mirror 20: 0xf4a6ab6 (stale) Mirror 21: 0xf4a6ab6 (stale) Mirror 22: 0xf4a6ab6 (stale) Mirror 23: 0xf4a6ab6 (stale) Mirror 25: 0xf4a6ab6 (stale) Mirror 26: 0xf4a6ab6 (stale) Mirror 27: 0xf4a6ab6 (stale) Mirror 28: 0xf4a6ab6 (stale) Mirror 29: 0xf4a6ab6 (stale) CRC-32 checksum value for chunk [0, 0x395da): Mirror 1: 0x79a99e32 Mirror 30: 0x79a99e32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395da: skipped 000622 1789124661.953734 fallocate 0x03446a thru 0x038662 (0x41f9 bytes) 000623 1789124662.014421 write 0x039bf1 thru 0x03ffff (0x640f bytes) 000624 1789124662.027118 write 0x01b661 thru 0x021f4e (0x68ee bytes) 000625 1789124662.041622 punch from 0x013bfe to 0x018982 (0x4d85 bytes) 000627 1789124662.051519 mapread 0x010a29 thru 0x01c349 (0xb921 bytes) 000629 1789124662.089875 punch from 0x03292e to 0x039250 (0x6923 bytes) 000630 1789124662.108787 trunc from 0x012b34 to 0x018fda (0x64a7 bytes) 000631 1789124662.117483 punch from 0x01b623 to 0x020000 (0x49de bytes) 000632 1789124662.134345 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f89fb6a (stale) Mirror 11: 0x5f89fb6a (stale) Mirror 14: 0x5f89fb6a (stale) Mirror 16: 0x5f89fb6a (stale) Mirror 19: 0x5f89fb6a (stale) Mirror 20: 0x5f89fb6a (stale) Mirror 21: 0x5f89fb6a (stale) Mirror 22: 0x5f89fb6a (stale) Mirror 23: 0x5f89fb6a (stale) Mirror 25: 0x5f89fb6a (stale) Mirror 26: 0x5f89fb6a (stale) Mirror 27: 0x5f89fb6a (stale) Mirror 29: 0x5f89fb6a (stale) Mirror 30: 0x1596cdd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f89fb6a (stale) Mirror 11: 0x5f89fb6a (stale) Mirror 14: 0x5f89fb6a (stale) Mirror 16: 0x5f89fb6a (stale) Mirror 19: 0x5f89fb6a (stale) Mirror 20: 0x5f89fb6a (stale) Mirror 21: 0x5f89fb6a (stale) Mirror 22: 0x5f89fb6a (stale) Mirror 23: 0x5f89fb6a (stale) Mirror 25: 0x5f89fb6a (stale) Mirror 26: 0x5f89fb6a (stale) Mirror 27: 0x5f89fb6a (stale) Mirror 29: 0x5f89fb6a (stale) Mirror 30: 0x1596cdd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000633 1789124663.051051 trunc from 0x037ce9 to 0x038c38 (0xf50 bytes) 000635 1789124663.062403 trunc from 0x011664 to 0x01310b (0x1aa8 bytes) 000636 1789124663.068436 mapread 0x00b893 thru 0x016114 (0xa882 bytes) 000637 1789124663.107947 punch from 0x02ac93 to 0x02f15a (0x44c8 bytes) 000638 1789124663.115844 trunc from 0x040000 to 0x004c02 (0x3b3fd bytes) 000639 1789124663.145369 punch from 0x00015f to 0x004c02 (0x4aa4 bytes) 000640 1789124663.152558 punch from 0x00384f to 0x004c02 (0x13b4 bytes) 000641 1789124663.158635 write 0x00d2d0 thru 0x01adf0 (0xdb21 bytes) 000642 1789124663.162165 punch from 0x005143 to 0x0055c8 (0x486 bytes) 000643 1789124663.166602 write 0x012021 thru 0x0156f6 (0x36d6 bytes) 000644 1789124663.169157 read 0x010570 thru 0x0184e3 (0x7f74 bytes) 000645 1789124663.169930 trunc from 0x00bd24 to 0x018fb8 (0xd295 bytes) 000646 1789124663.192837 trunc from 0x01adf1 to 0x00b40e (0xf9e2 bytes) 000647 1789124663.213385 write 0x019c69 thru 0x026094 (0xc42c bytes) 000648 1789124663.216529 mapread 0x01d78b thru 0x01ee69 (0x16df bytes) 000649 1789124663.225654 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26095): Mirror 6: 0xac74b792 (stale) Mirror 11: 0xac74b792 (stale) Mirror 14: 0xac74b792 (stale) Mirror 16: 0xac74b792 (stale) Mirror 19: 0xac74b792 (stale) Mirror 20: 0xac74b792 (stale) Mirror 21: 0xac74b792 (stale) Mirror 23: 0xac74b792 (stale) Mirror 25: 0xac74b792 (stale) Mirror 26: 0xac74b792 (stale) Mirror 27: 0xac74b792 (stale) Mirror 29: 0xac74b792 (stale) Mirror 30: 0x12778ee7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26095): Mirror 6: 0xac74b792 (stale) Mirror 11: 0xac74b792 (stale) Mirror 14: 0xac74b792 (stale) Mirror 16: 0xac74b792 (stale) Mirror 19: 0xac74b792 (stale) Mirror 20: 0xac74b792 (stale) Mirror 21: 0xac74b792 (stale) Mirror 23: 0xac74b792 (stale) Mirror 25: 0xac74b792 (stale) Mirror 26: 0xac74b792 (stale) Mirror 27: 0xac74b792 (stale) Mirror 29: 0xac74b792 (stale) Mirror 30: 0x12778ee7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26095: skipped 000650 1789124664.091027 trunc from 0x026095 to 0x020cf2 (0x53a2 bytes) 000651 1789124664.118086 trunc from 0x020cf3 to 0x03628d (0x1559b bytes) 000652 1789124664.143392 mapwrite 0x0032a3 thru 0x011ee6 (0xec44 bytes) 000653 1789124664.199233 mapwrite 0x00865e thru 0x011fde (0x9981 bytes) 000655 1789124664.219517 punch from 0x00d2e8 to 0x013e0b (0x6b24 bytes) 000656 1789124664.250187 MIRROR_RESYNC 14 mirrors 000658 1789124668.689058 write 0x03604d thru 0x037f5b (0x1f0f bytes) 000659 1789124668.758520 trunc from 0x021823 to 0x02bf39 (0xa717 bytes) 000661 1789124668.777251 MIRROR_RESYNC 14 mirrors 000662 1789124673.290813 fallocate 0x00aecf thru 0x01a9f6 (0xfb28 bytes) 000663 1789124673.354538 punch from 0x013dc7 to 0x01e5b0 (0xa7ea bytes) 000665 1789124673.363640 trunc from 0x013ede to 0x01f2f0 (0xb413 bytes) 000666 1789124673.370212 read 0x017d3b thru 0x0272d5 (0xf59b bytes) 000667 1789124673.386350 punch from 0x02dbf9 to 0x037f5b (0xa363 bytes) 000669 1789124673.393629 fallocate 0x02d64a thru 0x037412 (0x9dc9 bytes) 000671 1789124673.399528 fallocate 0x01afd4 thru 0x024f89 (0x9fb6 bytes) 000672 1789124673.413632 punch from 0x018b19 to 0x023682 (0xab6a bytes) 000673 1789124673.421723 read 0x00940f thru 0x016afb (0xd6ed bytes) 000674 1789124673.442401 punch from 0x00c26c to 0x01b07a (0xee0f bytes) 000675 1789124673.448655 trunc from 0x004ad4 to 0x007e06 (0x3333 bytes) 000676 1789124673.461724 mapread 0x00a718 thru 0x0126d0 (0x7fb9 bytes) 000677 1789124673.530465 trunc from 0x01a4cf to 0x0224c0 (0x7ff2 bytes) 000678 1789124673.539797 trunc from 0x037f5c to 0x01c4c2 (0x1ba99 bytes) 000680 1789124673.565916 mapwrite 0x0188d6 thru 0x01cdd2 (0x44fd bytes) 000681 1789124673.705175 mapwrite 0x015f5f thru 0x017d92 (0x1e34 bytes) 000682 1789124673.746416 trunc from 0x00f6e2 to 0x014c19 (0x5538 bytes) 000683 1789124673.754435 mapwrite 0x036817 thru 0x03ffff (0x97e9 bytes) 000684 1789124673.816290 punch from 0x0046be to 0x011c51 (0xd594 bytes) 000685 1789124673.824257 mapread 0x02c830 thru 0x0397a3 (0xcf74 bytes) 000686 1789124673.882312 trunc from 0x01f08d to 0x01f2d2 (0x246 bytes) 000687 1789124673.888048 punch from 0x0068e6 to 0x012c71 (0xc38c bytes) 000688 1789124673.893293 mapwrite 0x03a03e thru 0x03ffff (0x5fc2 bytes) 000689 1789124673.915725 punch from 0x028d13 to 0x035d4f (0xd03d bytes) 000690 1789124673.920799 read 0x021e60 thru 0x031743 (0xf8e4 bytes) 000691 1789124673.953462 fallocate 0x032768 thru 0x03820d (0x5aa6 bytes) 000692 1789124673.978968 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5719ac42 (stale) Mirror 11: 0x5719ac42 (stale) Mirror 14: 0x5719ac42 (stale) Mirror 16: 0x5719ac42 (stale) Mirror 19: 0x5719ac42 (stale) Mirror 21: 0x5719ac42 (stale) Mirror 23: 0x5719ac42 (stale) Mirror 25: 0x5719ac42 (stale) Mirror 26: 0x5719ac42 (stale) Mirror 27: 0x5719ac42 (stale) Mirror 29: 0x5719ac42 (stale) Mirror 30: 0x5719ac42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5719ac42 (stale) Mirror 11: 0x5719ac42 (stale) Mirror 14: 0x5719ac42 (stale) Mirror 16: 0x5719ac42 (stale) Mirror 19: 0x5719ac42 (stale) Mirror 21: 0x5719ac42 (stale) Mirror 23: 0x5719ac42 (stale) Mirror 25: 0x5719ac42 (stale) Mirror 26: 0x5719ac42 (stale) Mirror 27: 0x5719ac42 (stale) Mirror 29: 0x5719ac42 (stale) Mirror 30: 0x5719ac42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000694 1789124674.775540 fallocate 0x036369 thru 0x03ffff (0x9c97 bytes) 000695 1789124674.780380 trunc from 0x03de4c to 0x03ffff (0x21b4 bytes) 000696 1789124674.792380 mapread 0x03f0b6 thru 0x03ffff (0xf4a bytes) 000697 1789124674.803694 mapread 0x0268b7 thru 0x0347eb (0xdf35 bytes) 000699 1789124674.860650 mapwrite 0x0087c5 thru 0x00d0f1 (0x492d bytes) 000700 1789124674.906581 trunc from 0x040000 to 0x00b687 (0x34978 bytes) 000701 1789124674.937822 write 0x01cc89 thru 0x01def3 (0x126b bytes) 000702 1789124674.940360 mapwrite 0x00b8dd thru 0x01b4f2 (0xfc16 bytes) 000703 1789124674.995013 mapread 0x00cba1 thru 0x00f5bd (0x2a1d bytes) 000704 1789124674.996552 fallocate 0x01337a thru 0x014775 (0x13fc bytes) 000705 1789124675.004029 read 0x00caa4 thru 0x0199ff (0xcf5c bytes) 000706 1789124675.006037 mapwrite 0x0189ea thru 0x019cf1 (0x1308 bytes) 000708 1789124675.027851 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1def4): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1def4): Mirror 6: 0xc7e31f62 (stale) Mirror 11: 0xc7e31f62 (stale) Mirror 14: 0xc7e31f62 (stale) Mirror 16: 0xc7e31f62 (stale) Mirror 19: 0xc7e31f62 (stale) Mirror 21: 0xc7e31f62 (stale) Mirror 23: 0xc7e31f62 (stale) Mirror 25: 0xc7e31f62 (stale) Mirror 26: 0xc7e31f62 (stale) Mirror 27: 0xc7e31f62 (stale) Mirror 29: 0xc7e31f62 (stale) Mirror 30: 0xc7e31f62 (stale) CRC-32 checksum value for chunk [0, 0x1def4): Mirror 1: 0xcd29e044 Mirror 31: 0xcd29e044 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1def4: skipped 000709 1789124676.381537 write 0x006fa7 thru 0x00db7a (0x6bd4 bytes) 000710 1789124676.471539 trunc from 0x01def4 to 0x0135c5 (0xa92e bytes) 000711 1789124676.524152 punch from 0x00402e to 0x0127c2 (0xe795 bytes) 000712 1789124676.538586 mapwrite 0x01c0e2 thru 0x022254 (0x6173 bytes) 000713 1789124676.600773 mapread 0x013df2 thru 0x01d088 (0x9297 bytes) 000714 1789124676.613035 mapread 0x01fae3 thru 0x022254 (0x2772 bytes) 000716 1789124676.615582 punch from 0x0022f2 to 0x0121b0 (0xfebf bytes) 000717 1789124676.621394 read 0x006292 thru 0x00b926 (0x5695 bytes) 000718 1789124676.632112 read 0x0187f4 thru 0x022133 (0x9940 bytes) 000719 1789124676.632786 mapread 0x014c11 thru 0x022254 (0xd644 bytes) 000720 1789124676.633842 mapread 0x021a67 thru 0x022254 (0x7ee bytes) 000721 1789124676.635824 mapread 0x01c8e0 thru 0x0211d9 (0x48fa bytes) 000722 1789124676.637213 mapwrite 0x03dc19 thru 0x03ffff (0x23e7 bytes) 000723 1789124676.695063 trunc from 0x0080f0 to 0x016061 (0xdf72 bytes) 000724 1789124676.702330 read 0x03b3ec thru 0x03ffff (0x4c14 bytes) 000725 1789124676.703585 fallocate 0x000058 thru 0x000ea6 (0xe4f bytes) 000726 1789124676.712459 punch from 0x00aeae to 0x010af5 (0x5c48 bytes) 000727 1789124676.719410 trunc from 0x040000 to 0x027840 (0x187bf bytes) 000728 1789124676.748293 mapread 0x005554 thru 0x0149f2 (0xf49f bytes) 000729 1789124676.763652 mapwrite 0x0033d4 thru 0x00632c (0x2f59 bytes) 000730 1789124676.796406 trunc from 0x027841 to 0x00b23f (0x1c601 bytes) 000731 1789124676.818661 trunc from 0x00b240 to 0x0051af (0x6090 bytes) 000732 1789124676.839388 read 0x00208e thru 0x0051af (0x3122 bytes) 000733 1789124676.840727 fallocate 0x03a951 thru 0x03ff5f (0x560f bytes) 000734 1789124676.859246 MIRROR_RESYNC 14 mirrors 000735 1789124680.021311 MIRROR_RESYNC 14 mirrors 000736 1789124681.098960 mapwrite 0x008611 thru 0x00a5fc (0x1fec bytes) 000738 1789124681.254157 write 0x00f567 thru 0x01b116 (0xbbb0 bytes) 000739 1789124681.291176 MIRROR_RESYNC 14 mirrors 000740 1789124685.903368 mapread 0x000e3d thru 0x006702 (0x58c6 bytes) 000741 1789124685.929721 read 0x03ecfa thru 0x03ff5f (0x1266 bytes) 000742 1789124685.935175 punch from 0x03dca2 to 0x03ff5f (0x22be bytes) 000743 1789124685.982215 write 0x0076b4 thru 0x007cef (0x63c bytes) 000744 1789124685.988320 fallocate 0x008f88 thru 0x016989 (0xda02 bytes) 000745 1789124685.992843 trunc from 0x01acbf to 0x027997 (0xccd9 bytes) 000746 1789124685.998707 trunc from 0x01b18d to 0x023b99 (0x8a0d bytes) 000747 1789124686.004200 mapwrite 0x02d13d thru 0x02e52b (0x13ef bytes) 000748 1789124686.029455 trunc from 0x03556b to 0x03a453 (0x4ee9 bytes) 000749 1789124686.038391 fallocate 0x01c02c thru 0x01f04c (0x3021 bytes) 000750 1789124686.043132 read 0x03176a thru 0x03708b (0x5922 bytes) 000751 1789124686.076336 write 0x02b8dd thru 0x03860e (0xcd32 bytes) 000752 1789124686.078450 mapread 0x006001 thru 0x009858 (0x3858 bytes) 000753 1789124686.080137 mapread 0x004c93 thru 0x00aaaa (0x5e18 bytes) 000754 1789124686.081384 trunc from 0x03ff60 to 0x0176d6 (0x28889 bytes) 000756 1789124686.110561 trunc from 0x00cc16 to 0x0176d6 (0xaac1 bytes) 000757 1789124686.117318 fallocate 0x023098 thru 0x0239f8 (0x961 bytes) 000759 1789124686.123666 mapread 0x00e4ef thru 0x01528e (0x6da0 bytes) 000760 1789124686.160672 mapwrite 0x021f9d thru 0x02e67c (0xc6e0 bytes) 000761 1789124686.268593 mapwrite 0x03989a thru 0x03ffff (0x6766 bytes) 000762 1789124686.361785 mapwrite 0x02380c thru 0x02945a (0x5c4f bytes) 000763 1789124686.430086 MIRROR_RESYNC 14 mirrors 000764 1789124691.934296 mapread 0x0195c6 thru 0x02541c (0xbe57 bytes) 000765 1789124691.964772 mapwrite 0x008f1b thru 0x00ee5f (0x5f45 bytes) 000766 1789124692.101183 mapread 0x03fe65 thru 0x03ffff (0x19b bytes) 000767 1789124692.121401 mapwrite 0x023017 thru 0x0300d8 (0xd0c2 bytes) 000768 1789124692.191295 punch from 0x00f3c7 to 0x01581b (0x6455 bytes) 000769 1789124692.199568 trunc from 0x03a796 to 0x03e1bb (0x3a26 bytes) 000770 1789124692.211155 mapwrite 0x00f207 thru 0x01414b (0x4f45 bytes) 000771 1789124692.280788 mapread 0x035e24 thru 0x0373ba (0x1597 bytes) 000772 1789124692.292777 read 0x018354 thru 0x021624 (0x92d1 bytes) 000773 1789124692.305336 mapread 0x01e91a thru 0x021097 (0x277e bytes) 000774 1789124692.306743 trunc from 0x040000 to 0x0124a6 (0x2db59 bytes) 000775 1789124692.340754 read 0x00a0ad thru 0x0124a6 (0x83fa bytes) 000776 1789124692.342675 trunc from 0x0124a7 to 0x03b2e9 (0x28e43 bytes) 000778 1789124692.372352 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3b2ea): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2ea): Mirror 6: 0xf034077e (stale) Mirror 11: 0xf034077e (stale) Mirror 14: 0xf034077e (stale) Mirror 16: 0xf034077e (stale) Mirror 19: 0xf034077e (stale) Mirror 21: 0xf034077e (stale) Mirror 23: 0xf034077e (stale) Mirror 25: 0xf034077e (stale) Mirror 26: 0xf034077e (stale) Mirror 27: 0xf034077e (stale) Mirror 29: 0xf034077e (stale) Mirror 30: 0xf034077e (stale) Mirror 31: 0xf034077e (stale) CRC-32 checksum value for chunk [0, 0x3b2ea): Mirror 1: 0xe2f54777 Mirror 32: 0xe2f54777 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2ea: skipped 000779 1789124693.874813 MIRROR_RESYNC 15 mirrors 000780 1789124697.973256 MIRROR_EXTEND to 16 mirrors 000781 1789124699.284682 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000782 1789124699.963581 mapwrite 0x00cae1 thru 0x00eb0e (0x202e bytes) 000783 1789124700.109551 mapwrite 0x022604 thru 0x02bbb0 (0x95ad bytes) 000784 1789124700.186086 punch from 0x0114d6 to 0x012452 (0xf7d bytes) 000785 1789124700.191376 write 0x00e72d thru 0x01af52 (0xc826 bytes) 000786 1789124700.203179 read 0x024c64 thru 0x024d6a (0x107 bytes) 000787 1789124700.204336 fallocate 0x030170 thru 0x03612c (0x5fbd bytes) 000788 1789124700.216135 read 0x0262ba thru 0x0332c8 (0xd00f bytes) 000789 1789124700.217025 mapwrite 0x019981 thru 0x02891d (0xef9d bytes) 000790 1789124700.267630 mapwrite 0x0086a9 thru 0x0158f1 (0xd249 bytes) 000792 1789124700.303575 fallocate 0x0024c9 thru 0x002676 (0x1ae bytes) 000793 1789124700.309585 fallocate 0x03ba33 thru 0x03ffff (0x45cd bytes) 000794 1789124700.314691 fallocate 0x00e12b thru 0x00ebdd (0xab3 bytes) 000795 1789124700.319859 trunc from 0x00cb78 to 0x012944 (0x5dcd bytes) 000796 1789124700.325817 punch from 0x02f6c2 to 0x03b2e9 (0xbc28 bytes) 000797 1789124700.331546 read 0x00c23d thru 0x01b54f (0xf313 bytes) 000798 1789124700.342747 fallocate 0x03fb83 thru 0x03ffff (0x47d bytes) 000799 1789124700.347691 punch from 0x03cccb to 0x03ffff (0x3335 bytes) 000800 1789124700.352061 trunc from 0x02b638 to 0x02cd42 (0x170b bytes) 000801 1789124700.357201 fallocate 0x0383ef thru 0x03ffff (0x7c11 bytes) 000802 1789124700.362260 trunc from 0x010e61 to 0x014301 (0x34a1 bytes) 000803 1789124700.368092 mapwrite 0x036a42 thru 0x039fcd (0x358c bytes) 000804 1789124700.384377 read 0x02d6b1 thru 0x039676 (0xbfc6 bytes) 000805 1789124700.385277 read 0x031d35 thru 0x039be3 (0x7eaf bytes) 000806 1789124700.387052 fallocate 0x00f5fc thru 0x01e2cf (0xecd4 bytes) 000807 1789124700.393119 read 0x025f85 thru 0x02671b (0x797 bytes) 000808 1789124700.393691 punch from 0x004a5f to 0x007c91 (0x3233 bytes) 000809 1789124700.399516 mapwrite 0x02ac92 thru 0x03880a (0xdb79 bytes) 000810 1789124700.429607 mapread 0x03ef67 thru 0x03ffff (0x1099 bytes) 000811 1789124700.430745 fallocate 0x01d2d2 thru 0x01ebd9 (0x1908 bytes) 000813 1789124700.437370 trunc from 0x040000 to 0x0379af (0x8650 bytes) 000814 1789124700.466173 trunc from 0x00fd38 to 0x016735 (0x69fe bytes) 000815 1789124700.471962 trunc from 0x0379b0 to 0x006f60 (0x30a4f bytes) 000816 1789124700.488568 read 0x001a2c thru 0x006f60 (0x5535 bytes) 000817 1789124700.490133 read 0x00521d thru 0x006f60 (0x1d44 bytes) 000818 1789124700.492784 punch from 0x00582f to 0x006f60 (0x1732 bytes) 000819 1789124700.498022 trunc from 0x006f61 to 0x012588 (0xb628 bytes) 000820 1789124700.517670 trunc from 0x012589 to 0x02002f (0xdaa7 bytes) 000821 1789124700.541086 punch from 0x000c4c to 0x00ab3b (0x9ef0 bytes) 000822 1789124700.546459 fallocate 0x03e049 thru 0x03f09b (0x1053 bytes) 000823 1789124700.552305 mapwrite 0x0173e8 thru 0x01c6d0 (0x52e9 bytes) 000824 1789124700.588460 fallocate 0x031a1e thru 0x03f92c (0xdf0f bytes) 000825 1789124700.594195 write 0x01f533 thru 0x02f223 (0xfcf1 bytes) 000826 1789124700.596447 mapwrite 0x036f99 thru 0x03e0d5 (0x713d bytes) 000827 1789124700.619127 punch from 0x014582 to 0x01ed88 (0xa807 bytes) 000828 1789124700.625208 trunc from 0x03f92d to 0x00a97a (0x34fb2 bytes) 000829 1789124700.656813 punch from 0x0050e3 to 0x00a97a (0x5898 bytes) 000831 1789124700.668133 read 0x002d69 thru 0x0047c8 (0x1a60 bytes) 000832 1789124700.668979 mapwrite 0x037435 thru 0x03ee48 (0x7a14 bytes) 000833 1789124700.747103 trunc from 0x00b5ff to 0x018084 (0xca86 bytes) 000834 1789124700.751641 trunc from 0x03ee49 to 0x036540 (0x8908 bytes) 000835 1789124700.767611 read 0x0300fb thru 0x030837 (0x73d bytes) 000836 1789124700.770076 mapread 0x023381 thru 0x03117d (0xddfd bytes) 000837 1789124700.771662 read 0x00e8c9 thru 0x01362a (0x4d62 bytes) 000838 1789124700.783850 mapread 0x02f5a7 thru 0x031243 (0x1c9d bytes) 000839 1789124700.786299 punch from 0x007ab1 to 0x012cd6 (0xb226 bytes) 000841 1789124700.822005 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36541): Mirror 6: 0xb28eed34 (stale) Mirror 14: 0xb28eed34 (stale) Mirror 16: 0xb28eed34 (stale) Mirror 19: 0xb28eed34 (stale) Mirror 21: 0xb28eed34 (stale) Mirror 23: 0xb28eed34 (stale) Mirror 25: 0xb28eed34 (stale) Mirror 26: 0xb28eed34 (stale) Mirror 27: 0xb28eed34 (stale) Mirror 30: 0xb28eed34 (stale) Mirror 31: 0xb28eed34 (stale) Mirror 32: 0xb28eed34 (stale) Mirror 33: 0xb28eed34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36541): Mirror 6: 0xb28eed34 (stale) Mirror 14: 0xb28eed34 (stale) Mirror 16: 0xb28eed34 (stale) Mirror 19: 0xb28eed34 (stale) Mirror 21: 0xb28eed34 (stale) Mirror 23: 0xb28eed34 (stale) Mirror 25: 0xb28eed34 (stale) Mirror 26: 0xb28eed34 (stale) Mirror 27: 0xb28eed34 (stale) Mirror 30: 0xb28eed34 (stale) Mirror 31: 0xb28eed34 (stale) Mirror 32: 0xb28eed34 (stale) Mirror 33: 0xb28eed34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36541: skipped 000842 1789124701.909762 write 0x02501d thru 0x030f24 (0xbf08 bytes) 000843 1789124701.926674 trunc from 0x02cbcd to 0x0325a0 (0x59d4 bytes) 000844 1789124701.940775 mapread 0x027aa4 thru 0x030b01 (0x905e bytes) 000845 1789124701.965139 mapwrite 0x02132c thru 0x02aa9e (0x9773 bytes) 000846 1789124702.000189 trunc from 0x036541 to 0x030c25 (0x591b bytes) 000847 1789124702.017241 read 0x00f7f0 thru 0x01e3d6 (0xebe7 bytes) 000848 1789124702.028195 mapwrite 0x03fad3 thru 0x03ffff (0x52d bytes) 000849 1789124702.066248 mapwrite 0x02cc1c thru 0x02ed3e (0x2123 bytes) 000850 1789124702.099658 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb88211d (stale) Mirror 14: 0xb88211d (stale) Mirror 16: 0xb88211d (stale) Mirror 19: 0xb88211d (stale) Mirror 21: 0xb88211d (stale) Mirror 23: 0xb88211d (stale) Mirror 25: 0xb88211d (stale) Mirror 26: 0xb88211d (stale) Mirror 27: 0xb88211d (stale) Mirror 30: 0xb88211d (stale) Mirror 31: 0xb88211d (stale) Mirror 32: 0xb88211d (stale) Mirror 33: 0xb88211d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3486e71f Mirror 34: 0x3486e71f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000851 1789124703.563749 trunc from 0x03c01e to 0x03ffff (0x3fe2 bytes) 000852 1789124703.613158 mapwrite 0x01e679 thru 0x020703 (0x208b bytes) 000853 1789124703.666385 punch from 0x030849 to 0x0374b8 (0x6c70 bytes) 000854 1789124703.671579 trunc from 0x040000 to 0x0014de (0x3eb21 bytes) 000855 1789124703.727520 punch from 0x0012a1 to 0x0014de (0x23e bytes) 000856 1789124703.735961 write 0x021de7 thru 0x02df6b (0xc185 bytes) 000857 1789124703.738810 read 0x0196ae thru 0x01d30b (0x3c5e bytes) 000858 1789124703.748465 mapwrite 0x032eaa thru 0x03e62d (0xb784 bytes) 000859 1789124703.821210 fallocate 0x00eb8b thru 0x016080 (0x74f6 bytes) 000860 1789124703.836465 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e62e): Mirror 6: 0x3bc3efd7 (stale) Mirror 14: 0x3bc3efd7 (stale) Mirror 16: 0x3bc3efd7 (stale) Mirror 19: 0x3bc3efd7 (stale) Mirror 23: 0x3bc3efd7 (stale) Mirror 25: 0x3bc3efd7 (stale) Mirror 26: 0x3bc3efd7 (stale) Mirror 27: 0x3bc3efd7 (stale) Mirror 30: 0x3bc3efd7 (stale) Mirror 31: 0x3bc3efd7 (stale) Mirror 32: 0x3bc3efd7 (stale) Mirror 33: 0x3bc3efd7 (stale) Mirror 34: 0xd30d17cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e62e): Mirror 6: 0x3bc3efd7 (stale) Mirror 14: 0x3bc3efd7 (stale) Mirror 16: 0x3bc3efd7 (stale) Mirror 19: 0x3bc3efd7 (stale) Mirror 23: 0x3bc3efd7 (stale) Mirror 25: 0x3bc3efd7 (stale) Mirror 26: 0x3bc3efd7 (stale) Mirror 27: 0x3bc3efd7 (stale) Mirror 30: 0x3bc3efd7 (stale) Mirror 31: 0x3bc3efd7 (stale) Mirror 32: 0x3bc3efd7 (stale) Mirror 33: 0x3bc3efd7 (stale) Mirror 34: 0xd30d17cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e62e: skipped 000861 1789124704.659569 trunc from 0x03d444 to 0x03e62d (0x11ea bytes) 000862 1789124704.671337 trunc from 0x03e62e to 0x03190b (0xcd22 bytes) 000863 1789124704.733819 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3190c): Mirror 6: 0x1e4f57b3 (stale) Mirror 14: 0x1e4f57b3 (stale) Mirror 16: 0x1e4f57b3 (stale) Mirror 19: 0x1e4f57b3 (stale) Mirror 23: 0x1e4f57b3 (stale) Mirror 25: 0x1e4f57b3 (stale) Mirror 26: 0x1e4f57b3 (stale) Mirror 27: 0x1e4f57b3 (stale) Mirror 30: 0x1e4f57b3 (stale) Mirror 31: 0x1e4f57b3 (stale) Mirror 32: 0x1e4f57b3 (stale) Mirror 34: 0xe9cfd6c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3190c): Mirror 6: 0x1e4f57b3 (stale) Mirror 14: 0x1e4f57b3 (stale) Mirror 16: 0x1e4f57b3 (stale) Mirror 19: 0x1e4f57b3 (stale) Mirror 23: 0x1e4f57b3 (stale) Mirror 25: 0x1e4f57b3 (stale) Mirror 26: 0x1e4f57b3 (stale) Mirror 27: 0x1e4f57b3 (stale) Mirror 30: 0x1e4f57b3 (stale) Mirror 31: 0x1e4f57b3 (stale) Mirror 32: 0x1e4f57b3 (stale) Mirror 34: 0xe9cfd6c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3190c: skipped 000864 1789124705.601634 fallocate 0x01b283 thru 0x021518 (0x6296 bytes) 000865 1789124705.607526 mapread 0x02819f thru 0x030e17 (0x8c79 bytes) 000866 1789124705.629133 mapwrite 0x01d10e thru 0x01ff4b (0x2e3e bytes) 000867 1789124705.660035 MIRROR_RESYNC 13 mirrors 000869 1789124709.074535 mapread 0x0041de thru 0x00d5f6 (0x9419 bytes) 000870 1789124709.113007 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000871 1789124709.829782 trunc from 0x03190c to 0x0185cd (0x1933e bytes) 000873 1789124709.919700 punch from 0x018169 to 0x0185cd (0x465 bytes) 000874 1789124709.935818 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x185ce): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x185ce): Mirror 6: 0x54555ca5 (stale) Mirror 14: 0x54555ca5 (stale) Mirror 16: 0x54555ca5 (stale) Mirror 19: 0x54555ca5 (stale) Mirror 23: 0x54555ca5 (stale) Mirror 25: 0x54555ca5 (stale) Mirror 26: 0x54555ca5 (stale) Mirror 27: 0x54555ca5 (stale) Mirror 30: 0x54555ca5 (stale) Mirror 31: 0x54555ca5 (stale) Mirror 34: 0x54555ca5 (stale) CRC-32 checksum value for chunk [0, 0x185ce): Mirror 1: 0x54555ca5 Mirror 35: 0x54555ca5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x185ce: skipped 000875 1789124711.532708 fallocate 0x00834f thru 0x011db0 (0x9a62 bytes) 000876 1789124711.634423 mapwrite 0x00d8a4 thru 0x01252a (0x4c87 bytes) 000877 1789124711.684404 MIRROR_RESYNC 13 mirrors 000878 1789124714.700808 punch from 0x004955 to 0x011873 (0xcf1f bytes) 000879 1789124714.771105 write 0x01507d thru 0x01d290 (0x8214 bytes) 000880 1789124714.783104 read 0x01ca6a thru 0x01d290 (0x827 bytes) 000881 1789124714.784836 read 0x01bb52 thru 0x01d290 (0x173f bytes) 000882 1789124714.787433 trunc from 0x016f25 to 0x01d290 (0x636c bytes) 000883 1789124714.812499 write 0x007955 thru 0x016c2e (0xf2da bytes) 000884 1789124714.838363 write 0x02207d thru 0x02ce28 (0xadac bytes) 000887 1789124714.844342 write 0x0087f7 thru 0x0173e6 (0xebf0 bytes) 000889 1789124714.849246 mapwrite 0x03aa25 thru 0x03fede (0x54ba bytes) 000890 1789124714.928631 mapread 0x03a698 thru 0x03fede (0x5847 bytes) 000891 1789124714.929647 punch from 0x028521 to 0x02b5c8 (0x30a8 bytes) 000892 1789124714.937591 write 0x0272e4 thru 0x02b2bf (0x3fdc bytes) 000894 1789124714.950694 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3fedf): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fedf): Mirror 6: 0xccfab4fa (stale) Mirror 14: 0xccfab4fa (stale) Mirror 16: 0xccfab4fa (stale) Mirror 19: 0xccfab4fa (stale) Mirror 23: 0xccfab4fa (stale) Mirror 25: 0xccfab4fa (stale) Mirror 26: 0xccfab4fa (stale) Mirror 27: 0xccfab4fa (stale) Mirror 30: 0xccfab4fa (stale) Mirror 31: 0xccfab4fa (stale) Mirror 34: 0xccfab4fa (stale) Mirror 35: 0xccfab4fa (stale) CRC-32 checksum value for chunk [0, 0x3fedf): Mirror 1: 0x5f598860 Mirror 36: 0x5f598860 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fedf: skipped 000896 1789124717.135506 mapwrite 0x0257c0 thru 0x02badc (0x631d bytes) 000897 1789124717.264553 MIRROR_RESYNC 14 mirrors 000898 1789124721.972333 fallocate 0x004c46 thru 0x007669 (0x2a24 bytes) 000899 1789124722.052392 fallocate 0x001953 thru 0x00bf41 (0xa5ef bytes) 000901 1789124722.063296 fallocate 0x028e95 thru 0x028f3f (0xab bytes) 000902 1789124722.069714 write 0x0367a4 thru 0x03d6bd (0x6f1a bytes) 000903 1789124722.090392 write 0x01ab95 thru 0x01fcdb (0x5147 bytes) 000904 1789124722.115787 MIRROR_RESYNC 14 mirrors 000905 1789124727.468619 trunc from 0x01899a to 0x02769d (0xed04 bytes) 000906 1789124727.519796 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3fedf): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fedf): Mirror 6: 0x3685d3f5 (stale) Mirror 14: 0x3685d3f5 (stale) Mirror 16: 0x3685d3f5 (stale) Mirror 19: 0x3685d3f5 (stale) Mirror 23: 0x3685d3f5 (stale) Mirror 25: 0x3685d3f5 (stale) Mirror 26: 0x3685d3f5 (stale) Mirror 27: 0x3685d3f5 (stale) Mirror 30: 0x3685d3f5 (stale) Mirror 31: 0x3685d3f5 (stale) Mirror 34: 0x3685d3f5 (stale) Mirror 35: 0x3685d3f5 (stale) Mirror 36: 0x3685d3f5 (stale) CRC-32 checksum value for chunk [0, 0x3fedf): Mirror 1: 0xabfcb3a5 Mirror 37: 0xabfcb3a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fedf: skipped 000907 1789124729.289191 mapread 0x00b4b4 thru 0x00b4d3 (0x20 bytes) 000908 1789124729.302265 trunc from 0x0110b7 to 0x01c239 (0xb183 bytes) 000909 1789124729.374211 MIRROR_RESYNC 15 mirrors 000910 1789124734.421059 trunc from 0x03fedf to 0x021bfc (0x1e2e2 bytes) 000911 1789124734.516282 fallocate 0x02af03 thru 0x02c84e (0x194c bytes) 000912 1789124734.523031 punch from 0x009b2d to 0x00f635 (0x5b09 bytes) 000913 1789124734.529251 fallocate 0x039caa thru 0x03ffff (0x6356 bytes) 000914 1789124734.536874 fallocate 0x020829 thru 0x02141c (0xbf4 bytes) 000915 1789124734.543050 trunc from 0x040000 to 0x026f8c (0x19073 bytes) 000917 1789124734.568799 mapwrite 0x00c883 thru 0x00d499 (0xc17 bytes) 000918 1789124734.595065 mapread 0x00d732 thru 0x01464e (0x6f1d bytes) 000919 1789124734.605793 punch from 0x014bf4 to 0x015e23 (0x1230 bytes) 000920 1789124734.611791 mapread 0x01589c thru 0x0250df (0xf844 bytes) 000921 1789124734.632667 write 0x008035 thru 0x00a9f3 (0x29bf bytes) 000922 1789124734.634648 punch from 0x025d29 to 0x026f8c (0x1264 bytes) 000923 1789124734.644207 mapread 0x0055d8 thru 0x00b6ef (0x6118 bytes) 000924 1789124734.655480 trunc from 0x01650b to 0x0167c8 (0x2be bytes) 000925 1789124734.661493 punch from 0x0136e1 to 0x01e875 (0xb195 bytes) 000926 1789124734.667767 write 0x027bdd thru 0x02fa8a (0x7eae bytes) 000927 1789124734.677502 MIRROR_RESYNC 15 mirrors 000928 1789124740.984159 mapwrite 0x030f78 thru 0x03140d (0x496 bytes) 000929 1789124741.075563 MIRROR_RESYNC 15 mirrors 000930 1789124746.930186 mapread 0x018962 thru 0x01f090 (0x672f bytes) 000931 1789124746.963407 mapread 0x01d172 thru 0x0285c4 (0xb453 bytes) 000932 1789124746.978745 trunc from 0x01711c to 0x020852 (0x9737 bytes) 000933 1789124747.056864 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3140e): Mirror 6: 0xf1c5f55d (stale) Mirror 14: 0xf1c5f55d (stale) Mirror 16: 0xf1c5f55d (stale) Mirror 19: 0xf1c5f55d (stale) Mirror 23: 0xf1c5f55d (stale) Mirror 25: 0xf1c5f55d (stale) Mirror 26: 0xf1c5f55d (stale) Mirror 30: 0xf1c5f55d (stale) Mirror 31: 0xf1c5f55d (stale) Mirror 34: 0xf1c5f55d (stale) Mirror 35: 0xf1c5f55d (stale) Mirror 36: 0xf1c5f55d (stale) Mirror 37: 0xf1c5f55d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3140e): Mirror 6: 0xf1c5f55d (stale) Mirror 14: 0xf1c5f55d (stale) Mirror 16: 0xf1c5f55d (stale) Mirror 19: 0xf1c5f55d (stale) Mirror 23: 0xf1c5f55d (stale) Mirror 25: 0xf1c5f55d (stale) Mirror 26: 0xf1c5f55d (stale) Mirror 30: 0xf1c5f55d (stale) Mirror 31: 0xf1c5f55d (stale) Mirror 34: 0xf1c5f55d (stale) Mirror 35: 0xf1c5f55d (stale) Mirror 36: 0xf1c5f55d (stale) Mirror 37: 0xf1c5f55d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3140e: skipped 000934 1789124747.914664 trunc from 0x03140e to 0x033049 (0x1c3c bytes) 000935 1789124747.952332 read 0x00d166 thru 0x0121db (0x5076 bytes) 000936 1789124747.965995 mapread 0x00822e thru 0x00c219 (0x3fec bytes) 000937 1789124747.989037 read 0x001256 thru 0x003cf0 (0x2a9b bytes) 000938 1789124748.002030 punch from 0x010cf6 to 0x01cb94 (0xbe9f bytes) 000939 1789124748.007848 write 0x02f29d thru 0x039956 (0xa6ba bytes) 000940 1789124748.011023 punch from 0x020542 to 0x028521 (0x7fe0 bytes) 000941 1789124748.016615 fallocate 0x035fbc thru 0x038a79 (0x2abe bytes) 000942 1789124748.024711 write 0x00469e thru 0x01229b (0xdbfe bytes) 000943 1789124748.032632 mapwrite 0x02076c thru 0x02782d (0x70c2 bytes) 000944 1789124748.129778 read 0x02d098 thru 0x0348b4 (0x781d bytes) 000945 1789124748.132817 read 0x019126 thru 0x023ead (0xad88 bytes) 000947 1789124748.160982 mapwrite 0x01107b thru 0x0146e3 (0x3669 bytes) 000948 1789124748.179425 trunc from 0x00c196 to 0x017a14 (0xb87f bytes) 000949 1789124748.183810 trunc from 0x039957 to 0x031750 (0x8206 bytes) 000950 1789124748.199409 write 0x016b67 thru 0x01d4f8 (0x6992 bytes) 000951 1789124748.216620 MIRROR_RESYNC 14 mirrors 000952 1789124753.121263 trunc from 0x031751 to 0x007d4c (0x29a04 bytes) 000953 1789124753.179491 fallocate 0x001532 thru 0x008934 (0x7403 bytes) 000954 1789124753.192130 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x8935): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8935): Mirror 6: 0x414e5610 (stale) Mirror 14: 0x414e5610 (stale) Mirror 16: 0x414e5610 (stale) Mirror 19: 0x414e5610 (stale) Mirror 23: 0x414e5610 (stale) Mirror 25: 0x414e5610 (stale) Mirror 26: 0x414e5610 (stale) Mirror 30: 0x414e5610 (stale) Mirror 31: 0x414e5610 (stale) Mirror 34: 0x414e5610 (stale) Mirror 35: 0x414e5610 (stale) Mirror 36: 0x414e5610 (stale) Mirror 37: 0x414e5610 (stale) CRC-32 checksum value for chunk [0, 0x8935): Mirror 1: 0xe198ffc6 Mirror 38: 0xe198ffc6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8935: skipped 000955 1789124755.224700 trunc from 0x0074ec to 0x008934 (0x1449 bytes) 000956 1789124755.321550 trunc from 0x007bff to 0x008934 (0xd36 bytes) 000958 1789124755.339617 fallocate 0x03f148 thru 0x03ffff (0xeb8 bytes) 000959 1789124755.351479 mapread 0x0339c3 thru 0x03ffff (0xc63d bytes) 000960 1789124755.423504 mapread 0x01857c thru 0x0283cd (0xfe52 bytes) 000961 1789124755.459638 trunc from 0x03747e to 0x03b8fd (0x4480 bytes) 000963 1789124755.468024 punch from 0x01e093 to 0x022751 (0x46bf bytes) 000964 1789124755.481154 fallocate 0x03d19f thru 0x03ffff (0x2e61 bytes) 000965 1789124755.497415 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf7cfbe65 (stale) Mirror 14: 0xf7cfbe65 (stale) Mirror 16: 0xf7cfbe65 (stale) Mirror 19: 0xf7cfbe65 (stale) Mirror 23: 0xf7cfbe65 (stale) Mirror 25: 0xf7cfbe65 (stale) Mirror 26: 0xf7cfbe65 (stale) Mirror 31: 0xf7cfbe65 (stale) Mirror 34: 0xf7cfbe65 (stale) Mirror 35: 0xf7cfbe65 (stale) Mirror 36: 0xf7cfbe65 (stale) Mirror 37: 0xf7cfbe65 (stale) Mirror 38: 0x55ca5bd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf7cfbe65 (stale) Mirror 14: 0xf7cfbe65 (stale) Mirror 16: 0xf7cfbe65 (stale) Mirror 19: 0xf7cfbe65 (stale) Mirror 23: 0xf7cfbe65 (stale) Mirror 25: 0xf7cfbe65 (stale) Mirror 26: 0xf7cfbe65 (stale) Mirror 31: 0xf7cfbe65 (stale) Mirror 34: 0xf7cfbe65 (stale) Mirror 35: 0xf7cfbe65 (stale) Mirror 36: 0xf7cfbe65 (stale) Mirror 37: 0xf7cfbe65 (stale) Mirror 38: 0x55ca5bd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000966 1789124756.592620 trunc from 0x040000 to 0x037dbc (0x8243 bytes) 000968 1789124756.641675 punch from 0x01ad3c to 0x026989 (0xbc4e bytes) 000969 1789124756.656188 MIRROR_RESYNC 14 mirrors 000971 1789124759.946648 fallocate 0x006445 thru 0x015a75 (0xf631 bytes) 000972 1789124760.028772 fallocate 0x033c9a thru 0x03eca2 (0xb009 bytes) 000973 1789124760.033772 trunc from 0x03eca3 to 0x027d1b (0x16f87 bytes) 000974 1789124760.091524 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x27d1c): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27d1c): Mirror 6: 0xaaf4185e (stale) Mirror 14: 0xaaf4185e (stale) Mirror 16: 0xaaf4185e (stale) Mirror 19: 0xaaf4185e (stale) Mirror 23: 0xaaf4185e (stale) Mirror 25: 0xaaf4185e (stale) Mirror 26: 0xaaf4185e (stale) Mirror 31: 0xaaf4185e (stale) Mirror 34: 0xaaf4185e (stale) Mirror 35: 0xaaf4185e (stale) Mirror 36: 0xaaf4185e (stale) Mirror 37: 0xaaf4185e (stale) Mirror 38: 0xaaf4185e (stale) CRC-32 checksum value for chunk [0, 0x27d1c): Mirror 1: 0xaaf4185e Mirror 39: 0xaaf4185e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27d1c: skipped 000975 1789124761.656774 mapread 0x0095fd thru 0x0113ee (0x7df2 bytes) 000976 1789124761.690724 mapread 0x02259e thru 0x026c7b (0x46de bytes) 000977 1789124761.706063 trunc from 0x027d1c to 0x00e6b0 (0x1966b bytes) 000978 1789124761.821477 fallocate 0x03b6f9 thru 0x03ffff (0x4907 bytes) 000979 1789124761.826859 punch from 0x00a967 to 0x00be53 (0x14ed bytes) 000980 1789124761.832038 read 0x00c43b thru 0x00c4e3 (0xa9 bytes) 000981 1789124761.843492 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0xe6b1): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) Mirror 39: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe6b1): Mirror 6: 0x13722d60 (stale) Mirror 14: 0x13722d60 (stale) Mirror 16: 0x13722d60 (stale) Mirror 19: 0x13722d60 (stale) Mirror 23: 0x13722d60 (stale) Mirror 25: 0x13722d60 (stale) Mirror 26: 0x13722d60 (stale) Mirror 31: 0x13722d60 (stale) Mirror 34: 0x13722d60 (stale) Mirror 35: 0x13722d60 (stale) Mirror 36: 0x13722d60 (stale) Mirror 37: 0x13722d60 (stale) Mirror 38: 0x13722d60 (stale) Mirror 39: 0x13722d60 (stale) CRC-32 checksum value for chunk [0, 0xe6b1): Mirror 1: 0x13722d60 Mirror 40: 0x13722d60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe6b1: skipped 000982 1789124763.320642 punch from 0x00aeba to 0x00e6b0 (0x37f7 bytes) 000983 1789124763.391439 read 0x00055f thru 0x0094c0 (0x8f62 bytes) 000984 1789124763.403810 write 0x00d5fa thru 0x00f79f (0x21a6 bytes) 000985 1789124763.417611 trunc from 0x00f7a0 to 0x01a85b (0xb0bc bytes) 000986 1789124763.455514 mapread 0x011b93 thru 0x015faa (0x4418 bytes) 000987 1789124763.499308 trunc from 0x01a85c to 0x031cd1 (0x17476 bytes) 000989 1789124763.567334 MIRROR_RESYNC 16 mirrors 000990 1789124768.021474 read 0x02f194 thru 0x031cd1 (0x2b3e bytes) 000991 1789124768.044108 MIRROR_SPLIT mirror 10 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000992 1789124768.818316 MIRROR_RESYNC 15 mirrors 000993 1789124769.735140 mapwrite 0x03c336 thru 0x03d029 (0xcf4 bytes) 000994 1789124769.844850 mapwrite 0x02676b thru 0x032a7a (0xc310 bytes) 000995 1789124769.912613 punch from 0x012ef5 to 0x01f659 (0xc765 bytes) 000996 1789124769.923176 mapwrite 0x036a59 thru 0x03ffff (0x95a7 bytes) 000997 1789124770.021344 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5ecf35a (stale) Mirror 14: 0x5ecf35a (stale) Mirror 16: 0x5ecf35a (stale) Mirror 19: 0x5ecf35a (stale) Mirror 23: 0x5ecf35a (stale) Mirror 25: 0x5ecf35a (stale) Mirror 26: 0x5ecf35a (stale) Mirror 31: 0x5ecf35a (stale) Mirror 34: 0x5ecf35a (stale) Mirror 36: 0x5ecf35a (stale) Mirror 38: 0x5ecf35a (stale) Mirror 39: 0x5ecf35a (stale) Mirror 40: 0x5ecf35a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5ecf35a (stale) Mirror 14: 0x5ecf35a (stale) Mirror 16: 0x5ecf35a (stale) Mirror 19: 0x5ecf35a (stale) Mirror 23: 0x5ecf35a (stale) Mirror 25: 0x5ecf35a (stale) Mirror 26: 0x5ecf35a (stale) Mirror 31: 0x5ecf35a (stale) Mirror 34: 0x5ecf35a (stale) Mirror 36: 0x5ecf35a (stale) Mirror 38: 0x5ecf35a (stale) Mirror 39: 0x5ecf35a (stale) Mirror 40: 0x5ecf35a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000999 1789124771.020453 trunc from 0x033d7f to 0x03b477 (0x76f9 bytes) 001000 1789124771.025654 mapread 0x0300e6 thru 0x037079 (0x6f94 bytes) All operations completed A-OK!