== sanity-flr test 70a: flr mode fsx test ================ 07:46:38 (1784288798) Seed set to 8798 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000004 1784288798.924742 write 0x002773 thru 0x00413c (0x19ca bytes) 000005 1784288798.925938 write 0x0285d3 thru 0x037844 (0xf272 bytes) 000007 1784288798.930360 mapwrite 0x00d9aa thru 0x01d5d0 (0xfc27 bytes) 000008 1784288798.963666 read 0x00efd1 thru 0x012aec (0x3b1c bytes) truncating to largest ever: 0x1ba24 000010 1784288798.964618 trunc from 0x037845 to 0x01ba23 (0x1be21 bytes) 000012 1784288798.975341 MIRROR_EXTEND to 2 mirrors 000014 1784288799.210778 mapread 0x00d2ef thru 0x0150b2 (0x7dc4 bytes) 000015 1784288799.220458 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000016 1784288799.277323 mapread 0x01061c thru 0x01612c (0x5b11 bytes) 000017 1784288799.287284 read 0x01963b thru 0x01ba23 (0x23e9 bytes) 000019 1784288799.290616 read 0x0025b2 thru 0x003595 (0xfe4 bytes) 000020 1784288799.295305 mapwrite 0x0282ed thru 0x02fbf2 (0x7906 bytes) 000023 1784288799.330762 mapwrite 0x004d2c thru 0x010a2e (0xbd03 bytes) 000024 1784288799.380969 mapread 0x00097d thru 0x007e4f (0x74d3 bytes) 000028 1784288799.390639 mapwrite 0x00a39c thru 0x012881 (0x84e6 bytes) 000029 1784288799.413492 mapwrite 0x007046 thru 0x0085a5 (0x1560 bytes) truncating to largest ever: 0x2688c 000030 1784288799.429149 trunc from 0x02fbf3 to 0x02688b (0x9367 bytes) 000033 1784288799.439287 trunc from 0x02688c to 0x018cf5 (0xdb96 bytes) 000034 1784288799.447170 write 0x028aa2 thru 0x03512f (0xc68e bytes) 000035 1784288799.448671 write 0x0197fb thru 0x027517 (0xdd1d bytes) 000038 1784288799.454821 read 0x013228 thru 0x020eb5 (0xdc8e bytes) 000039 1784288799.458606 mapwrite 0x014bc1 thru 0x01aa50 (0x5e90 bytes) 000040 1784288799.478403 mapwrite 0x02f3db thru 0x032da4 (0x39ca bytes) 000044 1784288799.496183 write 0x000ab8 thru 0x000f2a (0x473 bytes) 000045 1784288799.496984 mapwrite 0x0187d7 thru 0x01b43d (0x2c67 bytes) 000046 1784288799.511977 write 0x00c54a thru 0x011174 (0x4c2b bytes) 000049 1784288799.514068 write 0x029675 thru 0x03848f (0xee1b bytes) 000050 1784288799.515358 read 0x00b9ee thru 0x00eaa6 (0x30b9 bytes) 000052 1784288799.516560 read 0x0128f7 thru 0x014b51 (0x225b bytes) 000053 1784288799.517189 trunc from 0x038490 to 0x023346 (0x15149 bytes) 000055 1784288799.524368 mapread 0x0026fa thru 0x0095bf (0x6ec6 bytes) 000057 1784288799.525616 trunc from 0x023347 to 0x01f6f1 (0x3c55 bytes) 000061 1784288799.533037 mapwrite 0x037df0 thru 0x03ffff (0x8210 bytes) 000062 1784288799.558967 read 0x035e60 thru 0x03aba5 (0x4d46 bytes) 000063 1784288799.559602 mapread 0x00f4ac thru 0x019a53 (0xa5a8 bytes) 000066 1784288799.562230 write 0x011f1b thru 0x018249 (0x632f bytes) truncating to largest ever: 0x3a857 000068 1784288799.563765 trunc from 0x040000 to 0x03a856 (0x57a9 bytes) 000070 1784288799.571895 trunc from 0x03a857 to 0x02d971 (0xcee5 bytes) 000071 1784288799.578693 mapread 0x007fd2 thru 0x00bac0 (0x3aef bytes) 000072 1784288799.579703 trunc from 0x02d972 to 0x034e4b (0x74da bytes) 000075 1784288799.586850 write 0x0271c7 thru 0x0333bc (0xc1f6 bytes) 000081 1784288799.593640 read 0x031b58 thru 0x034e4b (0x32f4 bytes) 000082 1784288799.596864 trunc from 0x034e4c to 0x032eeb (0x1f60 bytes) truncating to largest ever: 0x3aff2 000084 1784288799.603325 trunc from 0x032eec to 0x03aff1 (0x8106 bytes) 000086 1784288799.609804 trunc from 0x03aff2 to 0x031b8c (0x9465 bytes) 000090 1784288799.617874 write 0x039a3b thru 0x03ffff (0x65c5 bytes) 000091 1784288799.621479 MIRROR_EXTEND to 2 mirrors 000093 1784288799.832600 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000094 1784288799.883072 trunc from 0x040000 to 0x0249c5 (0x1b63a bytes) 000095 1784288799.900996 mapread 0x006009 thru 0x008640 (0x2638 bytes) 000096 1784288799.909456 mapwrite 0x008f6d thru 0x00e1a1 (0x5235 bytes) 000102 1784288799.937596 write 0x039c1b thru 0x03ffff (0x63e5 bytes) 000103 1784288799.938768 trunc from 0x040000 to 0x035b95 (0xa46a bytes) 000104 1784288799.946472 mapread 0x003058 thru 0x011040 (0xdfe9 bytes) 000107 1784288799.952217 write 0x01eb1e thru 0x02e8e5 (0xfdc8 bytes) 000109 1784288799.958780 mapread 0x00d53a thru 0x012d36 (0x57fd bytes) 000112 1784288799.960903 write 0x01e135 thru 0x0277d9 (0x96a5 bytes) truncating to largest ever: 0x3da88 000113 1784288799.962211 trunc from 0x035b96 to 0x03da87 (0x7ef2 bytes) 000114 1784288799.970400 read 0x01d345 thru 0x021a70 (0x472c bytes) 000115 1784288799.974122 write 0x00e065 thru 0x01bd34 (0xdcd0 bytes) 000117 1784288799.977897 trunc from 0x03da88 to 0x030134 (0xd953 bytes) 000118 1784288799.985590 trunc from 0x030135 to 0x01ca73 (0x136c1 bytes) 000120 1784288799.993504 mapread 0x00e150 thru 0x011162 (0x3013 bytes) 000122 1784288799.995078 read 0x0125d6 thru 0x01b5f7 (0x9022 bytes) 000125 1784288799.996815 mapwrite 0x01d246 thru 0x0204e0 (0x329b bytes) 000127 1784288800.033139 trunc from 0x0204e1 to 0x0296e5 (0x9205 bytes) 000128 1784288800.039805 read 0x00f3cb thru 0x016019 (0x6c4f bytes) 000129 1784288800.040362 mapwrite 0x002275 thru 0x0051a9 (0x2f35 bytes) 000130 1784288800.059287 trunc from 0x0296e6 to 0x0273b8 (0x232d bytes) 000132 1784288800.066128 mapread 0x0126b0 thru 0x01a427 (0x7d78 bytes) 000136 1784288800.068169 mapread 0x011218 thru 0x015f3a (0x4d23 bytes) 000138 1784288800.069267 mapread 0x015b40 thru 0x01fb20 (0x9fe1 bytes) 000139 1784288800.070113 trunc from 0x0273b9 to 0x00d1cd (0x1a1eb bytes) 000140 1784288800.076039 trunc from 0x00d1ce to 0x027e54 (0x1ac87 bytes) 000143 1784288800.082562 mapwrite 0x026505 thru 0x02829b (0x1d97 bytes) 000145 1784288800.107503 mapwrite 0x02a675 thru 0x02f553 (0x4edf bytes) 000152 1784288800.135888 trunc from 0x02f554 to 0x0116f9 (0x1de5a bytes) 000153 1784288800.145139 mapread 0x00838c thru 0x00e423 (0x6098 bytes) 000154 1784288800.146259 read 0x007ccd thru 0x0116f9 (0x9a2d bytes) 000159 1784288800.148958 mapwrite 0x00aa9f thru 0x011da9 (0x730b bytes) 000161 1784288800.179135 mapwrite 0x021c98 thru 0x030718 (0xea81 bytes) 000164 1784288800.216663 mapwrite 0x01c69d thru 0x026cc7 (0xa62b bytes) 000165 1784288800.235079 write 0x032ea4 thru 0x037d41 (0x4e9e bytes) 000168 1784288800.237255 mapwrite 0x00c7f0 thru 0x01a199 (0xd9aa bytes) 000171 1784288800.261651 read 0x00dbdb thru 0x0179b9 (0x9ddf bytes) 000173 1784288800.262530 mapwrite 0x036631 thru 0x03ffff (0x99cf bytes) 000175 1784288800.293322 write 0x010692 thru 0x015e94 (0x5803 bytes) 000177 1784288800.294637 read 0x00837d thru 0x0091bb (0xe3f bytes) 000179 1784288800.295692 trunc from 0x040000 to 0x00a8b7 (0x35748 bytes) 000180 1784288800.301921 read 0x002092 thru 0x00a8b7 (0x8826 bytes) 000182 1784288800.303148 read 0x009b42 thru 0x00a8b7 (0xd76 bytes) 000187 1784288800.305248 write 0x016ad6 thru 0x0224f6 (0xba21 bytes) 000188 1784288800.306166 mapwrite 0x02d500 thru 0x032a1c (0x551d bytes) 000190 1784288800.336976 MIRROR_EXTEND to 2 mirrors 000191 1784288800.523081 write 0x02361b thru 0x02f038 (0xba1e bytes) 000192 1784288800.557933 read 0x029097 thru 0x032a1c (0x9986 bytes) 000194 1784288800.563262 trunc from 0x032a1d to 0x004ef7 (0x2db25 bytes) 000195 1784288800.586699 read 0x0000e9 thru 0x004ef7 (0x4e0f bytes) 000196 1784288800.590630 read 0x003833 thru 0x004ef7 (0x16c5 bytes) 000197 1784288800.591305 read 0x0015e3 thru 0x004ef7 (0x3915 bytes) 000198 1784288800.591907 trunc from 0x004ef8 to 0x02ee0f (0x29f18 bytes) 000199 1784288800.599073 write 0x02a3a7 thru 0x0347d6 (0xa430 bytes) 000201 1784288800.605016 mapread 0x029893 thru 0x0347d6 (0xaf44 bytes) 000202 1784288800.605979 mapwrite 0x01deb8 thru 0x01e565 (0x6ae bytes) 000203 1784288800.626631 trunc from 0x0347d7 to 0x02a8e9 (0x9eed bytes) 000204 1784288800.632492 read 0x018ae9 thru 0x019d5b (0x1273 bytes) 000206 1784288800.633594 mapread 0x001c36 thru 0x005334 (0x36ff bytes) 000207 1784288800.634268 mapread 0x00daba thru 0x00f1af (0x16f6 bytes) 000209 1784288800.635291 mapread 0x00faad thru 0x01a25c (0xa7b0 bytes) 000212 1784288800.637030 mapread 0x0172c2 thru 0x0263ec (0xf12b bytes) 000213 1784288800.643894 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a8ea): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8ea): Mirror 2: 0x8f6d21bb (stale) CRC-32 checksum value for chunk [0, 0x2a8ea): Mirror 1: 0xab2d686d Mirror 3: 0xab2d686d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8ea: skipped 000214 1784288800.885775 trunc from 0x02a8ea to 0x0189d2 (0x11f17 bytes) 000216 1784288800.922510 trunc from 0x0189d3 to 0x02d718 (0x14d46 bytes) 000217 1784288800.932051 mapread 0x0098f5 thru 0x00be5e (0x256a bytes) 000219 1784288800.941367 read 0x014560 thru 0x0181d8 (0x3c79 bytes) 000220 1784288800.945997 trunc from 0x02d719 to 0x01b724 (0x11ff4 bytes) 000223 1784288800.957441 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b725): Mirror 3: 0x25638386 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b725): Mirror 3: 0x25638386 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b725: skipped 000224 1784288801.057657 trunc from 0x01b725 to 0x00006e (0x1b6b6 bytes) 000225 1784288801.065662 mapwrite 0x01f547 thru 0x02a69c (0xb156 bytes) 000226 1784288801.105959 write 0x026105 thru 0x02bc1f (0x5b1b bytes) 000227 1784288801.106772 mapwrite 0x0288f1 thru 0x02d2f1 (0x4a01 bytes) 000228 1784288801.134024 mapwrite 0x0161f0 thru 0x02227d (0xc08e bytes) 000231 1784288801.158626 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d2f2): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d2f2): Mirror 3: 0x8ad2fb13 (stale) CRC-32 checksum value for chunk [0, 0x2d2f2): Mirror 1: 0x58cb1ff8 Mirror 4: 0x58cb1ff8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d2f2: skipped 000232 1784288801.427117 mapwrite 0x00ee77 thru 0x01bc51 (0xcddb bytes) 000233 1784288801.494805 read 0x00904d thru 0x00e497 (0x544b bytes) 000235 1784288801.496001 write 0x0301e5 thru 0x0342fe (0x411a bytes) 000238 1784288801.498156 read 0x001b2a thru 0x008b8a (0x7061 bytes) 000239 1784288801.502394 read 0x0179cf thru 0x0189aa (0xfdc bytes) 000241 1784288801.503494 write 0x011589 thru 0x01a232 (0x8caa bytes) 000244 1784288801.505646 trunc from 0x0342ff to 0x0317cd (0x2b31 bytes) 000248 1784288801.524080 trunc from 0x0317ce to 0x02fd40 (0x1a8d bytes) 000250 1784288801.531883 mapwrite 0x00a22c thru 0x015232 (0xb007 bytes) 000251 1784288801.559072 mapwrite 0x0397c5 thru 0x03ffff (0x683b bytes) 000253 1784288801.587407 trunc from 0x040000 to 0x00474f (0x3b8b0 bytes) 000255 1784288801.597696 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x4750): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4750): Mirror 3: 0x6d4b3248 (stale) Mirror 4: 0xff47f397 (stale) CRC-32 checksum value for chunk [0, 0x4750): Mirror 1: 0xff47f397 Mirror 5: 0xff47f397 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4750: skipped 000256 1784288801.844685 read 0x0045f9 thru 0x00474f (0x157 bytes) 000257 1784288801.847509 read 0x0015ed thru 0x00474f (0x3163 bytes) 000258 1784288801.849939 mapwrite 0x02570f thru 0x028c40 (0x3532 bytes) 000259 1784288801.903302 trunc from 0x028c41 to 0x03bda2 (0x13162 bytes) 000261 1784288801.912282 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bda3): Mirror 3: 0xa4ddf10b (stale) Mirror 4: 0xc14e97dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bda3): Mirror 3: 0xa4ddf10b (stale) Mirror 4: 0xc14e97dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bda3: skipped 000262 1784288802.034862 write 0x019baf thru 0x025419 (0xb86b bytes) 000263 1784288802.038797 read 0x031309 thru 0x035ac1 (0x47b9 bytes) 000266 1784288802.043259 mapwrite 0x0247a6 thru 0x02a67c (0x5ed7 bytes) 000267 1784288802.070889 read 0x01ec48 thru 0x02579b (0x6b54 bytes) 000268 1784288802.071521 read 0x001035 thru 0x0092a8 (0x8274 bytes) 000269 1784288802.076190 mapread 0x0215bd thru 0x029977 (0x83bb bytes) 000270 1784288802.077302 mapread 0x03330d thru 0x03bda2 (0x8a96 bytes) 000271 1784288802.078331 read 0x000205 thru 0x00394a (0x3746 bytes) 000272 1784288802.078742 mapread 0x02e643 thru 0x0344ef (0x5ead bytes) 000274 1784288802.079862 mapread 0x012f07 thru 0x01d8f0 (0xa9ea bytes) 000275 1784288802.080825 read 0x025bc7 thru 0x02d782 (0x7bbc bytes) 000276 1784288802.081346 write 0x018b21 thru 0x01c8a1 (0x3d81 bytes) 000277 1784288802.082213 write 0x038cba thru 0x03ffff (0x7346 bytes) 000278 1784288802.083173 write 0x03992a thru 0x03ffff (0x66d6 bytes) 000279 1784288802.084019 trunc from 0x040000 to 0x032522 (0xdadd bytes) 000281 1784288802.091089 mapread 0x00e87f thru 0x014220 (0x59a2 bytes) 000284 1784288802.095542 MIRROR_RESYNC 3 mirrors 000285 1784288802.337114 read 0x0264dd thru 0x032522 (0xc046 bytes) 000286 1784288802.341297 trunc from 0x032523 to 0x027232 (0xb2f0 bytes) 000287 1784288802.380425 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27233): Mirror 4: 0x15e94daf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27233): Mirror 4: 0x15e94daf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27233: skipped 000290 1784288802.487657 trunc from 0x027233 to 0x013cc7 (0x1356b bytes) 000291 1784288802.493845 read 0x004205 thru 0x012204 (0xe000 bytes) 000293 1784288802.498114 write 0x01d9b2 thru 0x024e6b (0x74ba bytes) 000295 1784288802.499879 write 0x00b9e2 thru 0x00bc47 (0x266 bytes) 000297 1784288802.501220 read 0x01883f thru 0x021ee4 (0x96a6 bytes) 000299 1784288802.505417 write 0x00d302 thru 0x01b9b7 (0xe6b6 bytes) 000300 1784288802.506633 write 0x02676f thru 0x03094a (0xa1dc bytes) 000301 1784288802.507719 trunc from 0x03094b to 0x013a0c (0x1cf3e bytes) 000302 1784288802.513892 mapread 0x00caee thru 0x01108b (0x459e bytes) 000304 1784288802.514958 trunc from 0x013a0d to 0x008bb7 (0xae55 bytes) 000305 1784288802.524046 MIRROR_RESYNC 2 mirrors 000306 1784288802.710432 mapwrite 0x031a22 thru 0x035f21 (0x4500 bytes) 000307 1784288802.767022 mapwrite 0x032f1a thru 0x033711 (0x7f8 bytes) 000308 1784288802.782785 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35f22): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f22): Mirror 4: 0xc1aebe0d (stale) CRC-32 checksum value for chunk [0, 0x35f22): Mirror 1: 0x595e10ed Mirror 5: 0x595e10ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f22: skipped 000309 1784288803.019276 write 0x01bf89 thru 0x01cfb8 (0x1030 bytes) 000310 1784288803.048882 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35f22): Mirror 5: 0x595e10ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f22): Mirror 5: 0x595e10ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f22: skipped 000312 1784288803.138024 mapread 0x014cea thru 0x015e65 (0x117c bytes) 000313 1784288803.142902 read 0x00b04d thru 0x013a07 (0x89bb bytes) 000314 1784288803.146841 trunc from 0x035f22 to 0x004c7e (0x312a3 bytes) 000315 1784288803.158885 read 0x000ba8 thru 0x004c7e (0x40d7 bytes) 000316 1784288803.161841 trunc from 0x004c7f to 0x00a382 (0x5704 bytes) 000317 1784288803.167847 write 0x01620b thru 0x0177a1 (0x1597 bytes) 000318 1784288803.168890 mapread 0x00d935 thru 0x0177a1 (0x9e6d bytes) 000319 1784288803.173182 mapwrite 0x00237d thru 0x00c1d6 (0x9e5a bytes) 000322 1784288803.192455 read 0x0143d2 thru 0x0177a1 (0x33d0 bytes) 000323 1784288803.195221 MIRROR_RESYNC 2 mirrors 000324 1784288803.402471 read 0x00c642 thru 0x015a7c (0x943b bytes) 000325 1784288803.405630 trunc from 0x0177a2 to 0x01bc2f (0x448e bytes) 000326 1784288803.435455 mapread 0x0070d0 thru 0x00b60d (0x453e bytes) 000327 1784288803.442501 mapread 0x018a3f thru 0x01bc2f (0x31f1 bytes) 000328 1784288803.446689 read 0x006283 thru 0x007740 (0x14be bytes) 000329 1784288803.447348 write 0x005082 thru 0x01374c (0xe6cb bytes) 000330 1784288803.448321 mapread 0x00498a thru 0x00e4b9 (0x9b30 bytes) 000331 1784288803.451346 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000335 1784288803.501336 trunc from 0x01bc30 to 0x0082a1 (0x1398e bytes) 000341 1784288803.511226 trunc from 0x0082a2 to 0x0355f9 (0x2d358 bytes) 000342 1784288803.517072 read 0x01b090 thru 0x02828e (0xd1ff bytes) 000346 1784288803.524322 MIRROR_EXTEND to 2 mirrors 000347 1784288803.714756 write 0x032d76 thru 0x039e5e (0x70e9 bytes) 000351 1784288803.745469 mapwrite 0x02b43b thru 0x034e3e (0x9a04 bytes) 000352 1784288803.771580 mapread 0x0009a1 thru 0x002d61 (0x23c1 bytes) 000353 1784288803.776028 read 0x0125ea thru 0x0133e8 (0xdff bytes) 000355 1784288803.778911 mapwrite 0x018ae3 thru 0x018d14 (0x232 bytes) 000357 1784288803.795310 write 0x02c29b thru 0x02c47a (0x1e0 bytes) 000358 1784288803.796310 mapread 0x039b3d thru 0x039e5e (0x322 bytes) 000364 1784288803.800046 mapwrite 0x000ffa thru 0x002ad1 (0x1ad8 bytes) 000368 1784288803.818224 write 0x036251 thru 0x03db44 (0x78f4 bytes) 000369 1784288803.819294 read 0x0293f1 thru 0x036a64 (0xd674 bytes) 000373 1784288803.820955 read 0x02e245 thru 0x036233 (0x7fef bytes) 000375 1784288803.823892 MIRROR_RESYNC 2 mirrors 000376 1784288804.020145 mapread 0x01400b thru 0x01b4fb (0x74f1 bytes) 000377 1784288804.029259 MIRROR_RESYNC 2 mirrors 000378 1784288804.164849 write 0x00f75d thru 0x01a39f (0xac43 bytes) 000379 1784288804.185767 mapread 0x00b567 thru 0x011300 (0x5d9a bytes) 000381 1784288804.193013 read 0x01f347 thru 0x02130a (0x1fc4 bytes) 000382 1784288804.196650 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000383 1784288804.243931 read 0x026232 thru 0x02e86e (0x863d bytes) 000384 1784288804.247672 mapwrite 0x0064f6 thru 0x008316 (0x1e21 bytes) 000385 1784288804.267928 mapread 0x03583e thru 0x03db44 (0x8307 bytes) 000386 1784288804.271910 mapwrite 0x00c85f thru 0x0152a2 (0x8a44 bytes) 000387 1784288804.292140 write 0x02c89a thru 0x03a1dc (0xd943 bytes) 000390 1784288804.294781 read 0x00597d thru 0x00dd61 (0x83e5 bytes) 000391 1784288804.295477 mapread 0x0281ab thru 0x031f12 (0x9d68 bytes) 000394 1784288804.298001 mapwrite 0x03c679 thru 0x03d2a6 (0xc2e bytes) 000397 1784288804.317671 trunc from 0x03db45 to 0x033bc4 (0x9f80 bytes) 000398 1784288804.334868 mapwrite 0x0337d4 thru 0x0375f4 (0x3e21 bytes) 000399 1784288804.361870 mapwrite 0x03541e thru 0x03ffff (0xabe2 bytes) 000400 1784288804.387623 read 0x029fbc thru 0x032f76 (0x8fbb bytes) 000401 1784288804.388249 trunc from 0x040000 to 0x024276 (0x1bd89 bytes) 000403 1784288804.394437 trunc from 0x024277 to 0x0162a2 (0xdfd4 bytes) 000405 1784288804.400544 mapread 0x012029 thru 0x0162a2 (0x427a bytes) 000406 1784288804.401586 write 0x00d842 thru 0x01491f (0x70de bytes) 000407 1784288804.402567 trunc from 0x0162a3 to 0x033e34 (0x1db92 bytes) 000411 1784288804.410022 trunc from 0x033e35 to 0x0257ea (0xe64a bytes) 000413 1784288804.416117 write 0x0144c2 thru 0x01af1e (0x6a5d bytes) 000414 1784288804.418757 read 0x009ad0 thru 0x00d5dd (0x3b0e bytes) 000415 1784288804.419396 write 0x03427a thru 0x03ab58 (0x68df bytes) 000417 1784288804.421457 mapread 0x01fc6a thru 0x02ca34 (0xcdcb bytes) 000418 1784288804.425620 read 0x02f4cc thru 0x032f7d (0x3ab2 bytes) 000420 1784288804.426808 mapread 0x013ecd thru 0x013f37 (0x6b bytes) 000421 1784288804.427559 write 0x01691c thru 0x0237c2 (0xcea7 bytes) 000422 1784288804.428732 write 0x027306 thru 0x02d71f (0x641a bytes) 000426 1784288804.431226 trunc from 0x03ab59 to 0x02068a (0x1a4ce bytes) 000427 1784288804.437766 trunc from 0x02068b to 0x039bca (0x19540 bytes) 000430 1784288804.444946 mapwrite 0x0002cf thru 0x006c8f (0x69c1 bytes) 000431 1784288804.460836 mapread 0x00753e thru 0x00d5bd (0x6080 bytes) 000433 1784288804.461900 read 0x0191ff thru 0x023238 (0xa03a bytes) 000437 1784288804.467098 trunc from 0x039bcb to 0x033018 (0x6bb2 bytes) 000438 1784288804.472682 mapwrite 0x03bc52 thru 0x03ffff (0x43ae bytes) 000439 1784288804.495520 write 0x0296ef thru 0x034abc (0xb3ce bytes) truncating to largest ever: 0x3dc43 000442 1784288804.499275 trunc from 0x040000 to 0x03dc42 (0x23bd bytes) 000444 1784288804.505308 read 0x022e0e thru 0x0291a0 (0x6393 bytes) 000445 1784288804.505912 trunc from 0x03dc43 to 0x01a75c (0x234e6 bytes) 000446 1784288804.511015 write 0x037648 thru 0x03ffff (0x89b8 bytes) 000449 1784288804.513091 trunc from 0x040000 to 0x0360a7 (0x9f58 bytes) 000450 1784288804.518760 mapwrite 0x00249c thru 0x0123f4 (0xff59 bytes) 000451 1784288804.541884 read 0x0088ff thru 0x0113df (0x8ae1 bytes) 000452 1784288804.542547 mapread 0x01dc2f thru 0x02d1cf (0xf5a1 bytes) 000453 1784288804.548116 trunc from 0x0360a8 to 0x03492d (0x177a bytes) 000455 1784288804.556148 mapread 0x02cc9e thru 0x03492d (0x7c90 bytes) 000457 1784288804.557911 mapread 0x0006ab thru 0x00fc15 (0xf56b bytes) 000459 1784288804.559866 read 0x0156fa thru 0x0184fd (0x2e04 bytes) 000461 1784288804.561018 mapread 0x02e868 thru 0x03492d (0x60c6 bytes) 000465 1784288804.563839 mapwrite 0x02c79d thru 0x02e55e (0x1dc2 bytes) 000467 1784288804.583971 mapwrite 0x009139 thru 0x0139e2 (0xa8aa bytes) 000468 1784288804.600834 trunc from 0x03492e to 0x00f973 (0x24fba bytes) 000470 1784288804.607732 mapread 0x00d882 thru 0x00f973 (0x20f2 bytes) 000472 1784288804.609287 mapread 0x00482b thru 0x00601d (0x17f3 bytes) 000473 1784288804.610248 mapwrite 0x03fdd3 thru 0x03ffff (0x22d bytes) 000475 1784288804.644040 write 0x0261d2 thru 0x028aa7 (0x28d6 bytes) 000476 1784288804.644965 trunc from 0x040000 to 0x00c378 (0x33c87 bytes) 000477 1784288804.651665 write 0x02653e thru 0x02d9cb (0x748e bytes) 000479 1784288804.653629 mapread 0x01d512 thru 0x029e66 (0xc955 bytes) 000480 1784288804.670386 mapread 0x01d52d thru 0x01ee50 (0x1924 bytes) 000481 1784288804.671249 mapwrite 0x00de1e thru 0x01cded (0xefd0 bytes) 000482 1784288804.714972 MIRROR_EXTEND to 2 mirrors 000484 1784288804.886469 write 0x01be13 thru 0x029854 (0xda42 bytes) 000485 1784288804.916635 mapwrite 0x01a99c thru 0x026878 (0xbedd bytes) 000486 1784288804.937626 read 0x016b36 thru 0x02632e (0xf7f9 bytes) 000487 1784288804.940763 trunc from 0x02d9cc to 0x000fa6 (0x2ca25 bytes) 000488 1784288804.956084 read 0x000c79 thru 0x000fa6 (0x32e bytes) 000489 1784288804.958581 mapwrite 0x004cdb thru 0x007c2a (0x2f50 bytes) 000490 1784288804.983517 write 0x02669a thru 0x030cf3 (0xa65a bytes) 000491 1784288804.986885 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x30cf4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30cf4): Mirror 2: 0xa9dea6cd (stale) CRC-32 checksum value for chunk [0, 0x30cf4): Mirror 1: 0x8007ac06 Mirror 3: 0x8007ac06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30cf4: skipped 000494 1784288805.234037 mapwrite 0x0349a6 thru 0x03ffff (0xb65a bytes) 000496 1784288805.285178 read 0x028617 thru 0x02882b (0x215 bytes) 000500 1784288805.288870 mapwrite 0x0303be thru 0x035478 (0x50bb bytes) 000502 1784288805.304284 read 0x007ee6 thru 0x012bcd (0xace8 bytes) 000503 1784288805.310466 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7cfaf4c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7cfaf4c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000504 1784288805.408440 mapread 0x009996 thru 0x00bd9c (0x2407 bytes) 000505 1784288805.417839 read 0x033dc9 thru 0x0345b4 (0x7ec bytes) 000506 1784288805.420563 mapwrite 0x03ddbc thru 0x03ffff (0x2244 bytes) 000507 1784288805.441950 trunc from 0x040000 to 0x031eb6 (0xe149 bytes) 000508 1784288805.450775 MIRROR_RESYNC 2 mirrors 000510 1784288805.637564 write 0x00edbb thru 0x017228 (0x846e bytes) 000511 1784288805.659764 read 0x01ac02 thru 0x025534 (0xa933 bytes) 000512 1784288805.663070 read 0x009cf4 thru 0x0185b7 (0xe8c4 bytes) 000513 1784288805.666589 read 0x0190de thru 0x02705f (0xdf82 bytes) 000515 1784288805.667595 mapread 0x01da02 thru 0x02bec9 (0xe4c8 bytes) 000516 1784288805.668489 read 0x02b18f thru 0x031eb6 (0x6d28 bytes) 000517 1784288805.668988 mapread 0x00acc2 thru 0x00d42f (0x276e bytes) 000518 1784288805.669634 mapwrite 0x00afd2 thru 0x018ca1 (0xdcd0 bytes) 000519 1784288805.687024 mapread 0x0120ab thru 0x018b25 (0x6a7b bytes) 000521 1784288805.688305 mapwrite 0x0096a6 thru 0x016cbc (0xd617 bytes) 000522 1784288805.704207 mapread 0x01bcac thru 0x021216 (0x556b bytes) 000523 1784288805.707202 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000526 1784288805.754376 trunc from 0x031eb7 to 0x03d0d9 (0xb223 bytes) 000528 1784288805.766267 mapread 0x0076f9 thru 0x0159b2 (0xe2ba bytes) 000529 1784288805.777064 write 0x01d767 thru 0x025c9c (0x8536 bytes) 000530 1784288805.780895 trunc from 0x03d0da to 0x0021d7 (0x3af02 bytes) 000531 1784288805.786931 trunc from 0x0021d8 to 0x01ab0f (0x18938 bytes) 000532 1784288805.792137 trunc from 0x01ab10 to 0x00917e (0x11991 bytes) 000534 1784288805.797291 mapwrite 0x01015c thru 0x01169e (0x1543 bytes) 000535 1784288805.817646 trunc from 0x01169f to 0x011344 (0x35a bytes) 000536 1784288805.823885 mapread 0x0014d0 thru 0x00e64d (0xd17e bytes) 000538 1784288805.830425 MIRROR_EXTEND to 2 mirrors 000539 1784288806.002653 mapwrite 0x02d5b7 thru 0x03b7d9 (0xe223 bytes) 000540 1784288806.057808 MIRROR_RESYNC 2 mirrors 000542 1784288806.235190 MIRROR_EXTEND to 3 mirrors 000543 1784288806.411882 MIRROR_EXTEND to 4 mirrors 000548 1784288806.592957 mapread 0x027b82 thru 0x02c7a2 (0x4c21 bytes) 000549 1784288806.601138 MIRROR_EXTEND to 5 mirrors 000550 1784288806.784389 mapread 0x007398 thru 0x008e3a (0x1aa3 bytes) 000551 1784288806.789980 mapwrite 0x008bdb thru 0x017ba8 (0xefce bytes) 000553 1784288806.849468 read 0x039c58 thru 0x03b7d9 (0x1b82 bytes) 000554 1784288806.852139 write 0x018749 thru 0x020e75 (0x872d bytes) 000555 1784288806.854794 read 0x037067 thru 0x03b7d9 (0x4773 bytes) 000559 1784288806.861494 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 2: 0xcdbb915d (stale) Mirror 3: 0xcdbb915d (stale) Mirror 4: 0xcdbb915d (stale) Mirror 5: 0xcdbb915d (stale) CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 1: 0x4907c15e Mirror 6: 0x4907c15e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7da: skipped 000560 1784288807.161367 mapread 0x015fca thru 0x023eae (0xdee5 bytes) 000561 1784288807.174420 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 2: 0xcdbb915d (stale) Mirror 3: 0xcdbb915d (stale) Mirror 4: 0xcdbb915d (stale) Mirror 5: 0xcdbb915d (stale) CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 1: 0x4907c15e Mirror 6: 0x4907c15e Mirror 7: 0x4907c15e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7da: skipped 000562 1784288807.457292 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 2: 0xcdbb915d (stale) Mirror 3: 0xcdbb915d (stale) Mirror 4: 0xcdbb915d (stale) Mirror 5: 0xcdbb915d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 2: 0xcdbb915d (stale) Mirror 3: 0xcdbb915d (stale) Mirror 4: 0xcdbb915d (stale) Mirror 5: 0xcdbb915d (stale) CRC-32 checksum value for chunk [0, 0x3b7da): Mirror 1: 0x4907c15e Mirror 6: 0x4907c15e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7da: skipped 000564 1784288807.665997 write 0x00a8ea thru 0x00ec8c (0x43a3 bytes) 000566 1784288807.699322 trunc from 0x03b7da to 0x03cfb7 (0x17de bytes) 000568 1784288807.715526 mapread 0x012f2a thru 0x01f848 (0xc91f bytes) 000569 1784288807.727931 mapwrite 0x0054f1 thru 0x00ac51 (0x5761 bytes) 000570 1784288807.753568 mapread 0x00fb41 thru 0x019e78 (0xa338 bytes) 000573 1784288807.755471 mapwrite 0x03fe31 thru 0x03ffff (0x1cf bytes) 000576 1784288807.784469 trunc from 0x040000 to 0x01d12b (0x22ed4 bytes) 000577 1784288807.791512 trunc from 0x01d12c to 0x03447b (0x17350 bytes) 000579 1784288807.799098 trunc from 0x03447c to 0x01664b (0x1de30 bytes) 000580 1784288807.805657 write 0x0273a4 thru 0x031f20 (0xab7d bytes) 000583 1784288807.807975 mapread 0x0193fa thru 0x0237a0 (0xa3a7 bytes) 000584 1784288807.814827 read 0x010743 thru 0x013b80 (0x343e bytes) 000585 1784288807.815403 mapwrite 0x03350e thru 0x038a9c (0x558f bytes) 000586 1784288807.843011 mapread 0x026e21 thru 0x036886 (0xfa66 bytes) 000587 1784288807.845968 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38a9d): Mirror 2: 0x583d1f8 (stale) Mirror 4: 0x583d1f8 (stale) Mirror 5: 0x583d1f8 (stale) Mirror 6: 0xf3a2e0c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a9d): Mirror 2: 0x583d1f8 (stale) Mirror 4: 0x583d1f8 (stale) Mirror 5: 0x583d1f8 (stale) Mirror 6: 0xf3a2e0c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a9d: skipped 000592 1784288807.967588 read 0x02d15e thru 0x030de4 (0x3c87 bytes) 000595 1784288807.971058 read 0x033a92 thru 0x038a9c (0x500b bytes) 000596 1784288807.974895 write 0x03e0e6 thru 0x03ffff (0x1f1a bytes) 000597 1784288807.975898 mapwrite 0x006d0a thru 0x00cc50 (0x5f47 bytes) 000598 1784288807.990892 trunc from 0x040000 to 0x0337a4 (0xc85b bytes) 000599 1784288807.995953 read 0x01b74e thru 0x02a458 (0xed0b bytes) 000600 1784288807.996463 mapread 0x011f50 thru 0x021105 (0xf1b6 bytes) 000607 1784288808.000322 trunc from 0x0337a5 to 0x00b195 (0x2860f bytes) 000608 1784288808.006395 read 0x00a5d8 thru 0x00b195 (0xbbe bytes) 000611 1784288808.008100 mapread 0x00aed0 thru 0x00b195 (0x2c6 bytes) 000615 1784288808.010075 mapread 0x0053fe thru 0x00b195 (0x5d98 bytes) 000616 1784288808.013812 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb196): Mirror 4: 0xf52a166d (stale) Mirror 5: 0xf52a166d (stale) Mirror 6: 0xbe3d4184 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb196): Mirror 4: 0xf52a166d (stale) Mirror 5: 0xf52a166d (stale) Mirror 6: 0xbe3d4184 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb196: skipped 000618 1784288808.129892 write 0x01c266 thru 0x024401 (0x819c bytes) 000620 1784288808.134153 MIRROR_RESYNC 4 mirrors 000621 1784288808.411591 write 0x037dee thru 0x03f1e3 (0x73f6 bytes) 000622 1784288808.435027 read 0x0377dc thru 0x03f1e3 (0x7a08 bytes) 000624 1784288808.436101 trunc from 0x03f1e4 to 0x030b44 (0xe69f bytes) 000626 1784288808.445781 write 0x036d16 thru 0x03ffff (0x92ea bytes) 000627 1784288808.447202 mapwrite 0x02c22e thru 0x02f2a1 (0x3074 bytes) 000628 1784288808.473113 read 0x00f9db thru 0x01a057 (0xa67d bytes) 000629 1784288808.477965 trunc from 0x040000 to 0x00e615 (0x319ea bytes) 000630 1784288808.484829 mapread 0x00672d thru 0x00e615 (0x7ee9 bytes) 000632 1784288808.488254 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe616): Mirror 4: 0xc2b8fdfb (stale) Mirror 6: 0xc2b8fdfb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe616): Mirror 4: 0xc2b8fdfb (stale) Mirror 6: 0xc2b8fdfb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe616: skipped 000635 1784288808.587216 mapread 0x00c160 thru 0x00c62b (0x4cc bytes) 000637 1784288808.590496 write 0x018402 thru 0x01b7aa (0x33a9 bytes) 000638 1784288808.591499 trunc from 0x01b7ab to 0x01b995 (0x1eb bytes) 000639 1784288808.596645 mapwrite 0x00d275 thru 0x019052 (0xbdde bytes) 000641 1784288808.623476 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1b996): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b996): Mirror 4: 0xe1df697 (stale) Mirror 6: 0xe1df697 (stale) CRC-32 checksum value for chunk [0, 0x1b996): Mirror 1: 0xf485108 Mirror 7: 0xf485108 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b996: skipped 000647 1784288808.856179 read 0x019cae thru 0x01b995 (0x1ce8 bytes) 000648 1784288808.859450 mapwrite 0x012431 thru 0x016843 (0x4413 bytes) 000649 1784288808.924483 trunc from 0x01b996 to 0x01e726 (0x2d91 bytes) 000651 1784288808.939692 write 0x016a46 thru 0x017294 (0x84f bytes) 000652 1784288808.943305 MIRROR_RESYNC 4 mirrors 000654 1784288809.218823 mapwrite 0x0077de thru 0x010944 (0x9167 bytes) 000656 1784288809.278561 read 0x01b9c7 thru 0x01e726 (0x2d60 bytes) 000658 1784288809.281979 read 0x009d1d thru 0x013f84 (0xa268 bytes) 000661 1784288809.286023 trunc from 0x01e727 to 0x0347ee (0x160c8 bytes) 000663 1784288809.294841 MIRROR_RESYNC 4 mirrors 000665 1784288809.531117 read 0x020f7c thru 0x024333 (0x33b8 bytes) 000666 1784288809.534415 trunc from 0x0347ef to 0x01df13 (0x168db bytes) 000667 1784288809.562436 trunc from 0x01df14 to 0x03c5b7 (0x1e6a4 bytes) 000668 1784288809.568963 trunc from 0x03c5b8 to 0x01d3d3 (0x1f1e4 bytes) 000669 1784288809.574586 trunc from 0x01d3d4 to 0x00d84c (0xfb87 bytes) 000670 1784288809.581309 write 0x03b8df thru 0x03ffff (0x4721 bytes) 000671 1784288809.582599 trunc from 0x040000 to 0x02b815 (0x147ea bytes) 000672 1784288809.588214 read 0x01e2bd thru 0x01e9d0 (0x714 bytes) 000673 1784288809.593075 mapread 0x00b217 thru 0x015541 (0xa32b bytes) 000675 1784288809.596949 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b816): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b816): Mirror 4: 0x73e24d0c (stale) Mirror 6: 0x73e24d0c (stale) Mirror 7: 0x73e24d0c (stale) CRC-32 checksum value for chunk [0, 0x2b816): Mirror 1: 0x59c96ba6 Mirror 8: 0x59c96ba6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b816: skipped 000676 1784288809.850195 read 0x028d51 thru 0x02b815 (0x2ac5 bytes) 000677 1784288809.853525 write 0x02a128 thru 0x0306a8 (0x6581 bytes) 000678 1784288809.877375 mapwrite 0x03a5ca thru 0x03c3ae (0x1de5 bytes) 000682 1784288809.911024 write 0x0305b4 thru 0x030b43 (0x590 bytes) 000683 1784288809.911642 read 0x0080c1 thru 0x00b530 (0x3470 bytes) 000684 1784288809.915736 write 0x0318c2 thru 0x038f3c (0x767b bytes) 000685 1784288809.918517 MIRROR_RESYNC 5 mirrors 000686 1784288810.207100 trunc from 0x03c3af to 0x03c4ee (0x140 bytes) 000688 1784288810.227478 mapwrite 0x014724 thru 0x015ef4 (0x17d1 bytes) 000689 1784288810.245397 write 0x00476a thru 0x0074c8 (0x2d5f bytes) 000691 1784288810.250327 trunc from 0x03c4ef to 0x00467d (0x37e71 bytes) 000693 1784288810.259312 mapwrite 0x016773 thru 0x024d80 (0xe60e bytes) 000696 1784288810.292864 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24d81): Mirror 4: 0xad91ec71 (stale) Mirror 6: 0xad91ec71 (stale) Mirror 7: 0xad91ec71 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d81): Mirror 4: 0xad91ec71 (stale) Mirror 6: 0xad91ec71 (stale) Mirror 7: 0xad91ec71 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d81: skipped 000699 1784288810.406433 MIRROR_RESYNC 4 mirrors 000701 1784288810.652307 trunc from 0x024d81 to 0x0279a6 (0x2c26 bytes) 000705 1784288810.682218 read 0x0024b6 thru 0x00384e (0x1399 bytes) 000706 1784288810.685323 mapwrite 0x0374b8 thru 0x03ffff (0x8b48 bytes) 000707 1784288810.720976 mapwrite 0x02129a thru 0x024950 (0x36b7 bytes) 000708 1784288810.740754 read 0x03582d thru 0x03d4a9 (0x7c7d bytes) 000709 1784288810.741402 mapwrite 0x006c72 thru 0x00db85 (0x6f14 bytes) 000710 1784288810.762618 mapread 0x02639d thru 0x029d68 (0x39cc bytes) 000714 1784288810.764829 mapwrite 0x0214e9 thru 0x025898 (0x43b0 bytes) 000718 1784288810.784058 MIRROR_RESYNC 4 mirrors 000719 1784288811.013637 mapwrite 0x037685 thru 0x03ffff (0x897b bytes) 000724 1784288811.068648 mapread 0x0119ee thru 0x019494 (0x7aa7 bytes) 000726 1784288811.073304 read 0x01d528 thru 0x022907 (0x53e0 bytes) 000727 1784288811.076945 mapread 0x02b76c thru 0x0370ef (0xb984 bytes) 000728 1784288811.083384 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xffc3ef35 (stale) Mirror 6: 0xffc3ef35 (stale) Mirror 7: 0xffc3ef35 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7a6f9443 Mirror 8: 0x7a6f9443 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000729 1784288811.362203 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xffc3ef35 (stale) Mirror 6: 0xffc3ef35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xffc3ef35 (stale) Mirror 6: 0xffc3ef35 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7a6f9443 Mirror 8: 0x7a6f9443 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000732 1784288811.535228 write 0x03f016 thru 0x03f448 (0x433 bytes) 000733 1784288811.558388 trunc from 0x040000 to 0x020279 (0x1fd86 bytes) 000734 1784288811.571661 read 0x00d4f7 thru 0x0157b6 (0x82c0 bytes) 000737 1784288811.575911 write 0x017552 thru 0x01be43 (0x48f2 bytes) 000739 1784288811.580852 read 0x013371 thru 0x01349c (0x12c bytes) 000740 1784288811.581499 read 0x008fb3 thru 0x00e72a (0x5778 bytes) 000741 1784288811.585636 mapread 0x00c9f0 thru 0x0151a8 (0x87b9 bytes) 000742 1784288811.587197 trunc from 0x02027a to 0x031529 (0x112b0 bytes) 000743 1784288811.592922 write 0x00c07d thru 0x0153ee (0x9372 bytes) 000747 1784288811.595311 read 0x003840 thru 0x00883f (0x5000 bytes) 000749 1784288811.596380 mapread 0x018ccf thru 0x027cab (0xefdd bytes) 000751 1784288811.601163 write 0x00af9c thru 0x01581c (0xa881 bytes) 000753 1784288811.606091 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3152a): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3152a): Mirror 4: 0x3de5f812 (stale) Mirror 6: 0x3de5f812 (stale) Mirror 8: 0x3de5f812 (stale) CRC-32 checksum value for chunk [0, 0x3152a): Mirror 1: 0x3ca7006c Mirror 9: 0x3ca7006c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3152a: skipped 000755 1784288811.850934 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3152a): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3152a): Mirror 4: 0x3de5f812 (stale) Mirror 6: 0x3de5f812 (stale) Mirror 8: 0x3de5f812 (stale) CRC-32 checksum value for chunk [0, 0x3152a): Mirror 1: 0x3ca7006c Mirror 9: 0x3ca7006c Mirror 10: 0x3ca7006c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3152a: skipped 000758 1784288812.101085 trunc from 0x03152a to 0x012689 (0x1eea0 bytes) 000759 1784288812.138166 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1268a): Mirror 4: 0x2c0c7a15 (stale) Mirror 6: 0x2c0c7a15 (stale) Mirror 8: 0x2c0c7a15 (stale) Mirror 9: 0xfd6c49b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1268a): Mirror 4: 0x2c0c7a15 (stale) Mirror 6: 0x2c0c7a15 (stale) Mirror 8: 0x2c0c7a15 (stale) Mirror 9: 0xfd6c49b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1268a: skipped 000762 1784288812.268086 MIRROR_RESYNC 5 mirrors 000763 1784288812.547788 read 0x00903e thru 0x00d84a (0x480d bytes) 000765 1784288812.551896 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000766 1784288812.662445 mapread 0x01103c thru 0x012689 (0x164e bytes) 000769 1784288812.668306 write 0x02c080 thru 0x030344 (0x42c5 bytes) 000770 1784288812.693231 read 0x00318b thru 0x005366 (0x21dc bytes) 000771 1784288812.696538 trunc from 0x030345 to 0x0137ca (0x1cb7a bytes) 000773 1784288812.705185 read 0x00cef0 thru 0x0119fe (0x4b0f bytes) 000774 1784288812.708758 write 0x02c405 thru 0x0314ac (0x50a8 bytes) 000776 1784288812.710366 trunc from 0x0314ad to 0x00a858 (0x26c54 bytes) 000777 1784288812.715841 mapread 0x0037c5 thru 0x00a858 (0x7094 bytes) 000778 1784288812.716720 read 0x005f3c thru 0x00a858 (0x491d bytes) 000779 1784288812.717297 mapwrite 0x034c28 thru 0x03ffff (0xb3d8 bytes) 000780 1784288812.754070 read 0x02fd1e thru 0x03a85f (0xab42 bytes) 000782 1784288812.755064 write 0x00fcdc thru 0x019a74 (0x9d99 bytes) 000783 1784288812.756295 read 0x019434 thru 0x026e7d (0xda4a bytes) 000784 1784288812.756923 mapread 0x0040ae thru 0x0125f0 (0xe543 bytes) 000785 1784288812.757838 mapwrite 0x02087d thru 0x020ac1 (0x245 bytes) 000786 1784288812.774776 read 0x002325 thru 0x00fdbd (0xda99 bytes) 000787 1784288812.775387 mapwrite 0x0380ac thru 0x03f703 (0x7658 bytes) 000788 1784288812.792926 write 0x012f42 thru 0x018ee8 (0x5fa7 bytes) 000790 1784288812.794733 mapwrite 0x03df6d thru 0x03ffff (0x2093 bytes) 000791 1784288812.813804 trunc from 0x040000 to 0x02560e (0x1a9f1 bytes) 000793 1784288812.821728 mapread 0x00609f thru 0x00b04b (0x4fad bytes) 000794 1784288812.822641 write 0x02c36d thru 0x034ab9 (0x874d bytes) 000795 1784288812.823777 trunc from 0x034aba to 0x0140b7 (0x20a02 bytes) 000796 1784288812.830602 trunc from 0x0140b8 to 0x000615 (0x13aa2 bytes) 000798 1784288812.839526 MIRROR_RESYNC 4 mirrors 000799 1784288813.059250 mapwrite 0x01748e thru 0x01829e (0xe11 bytes) 000800 1784288813.108565 mapwrite 0x002121 thru 0x006342 (0x4222 bytes) 000801 1784288813.130649 mapread 0x00017f thru 0x008575 (0x83f7 bytes) 000803 1784288813.134149 read 0x013681 thru 0x01829e (0x4c1e bytes) 000806 1784288813.139856 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1829f): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1829f): Mirror 4: 0x64234a49 (stale) Mirror 6: 0x64234a49 (stale) Mirror 8: 0x64234a49 (stale) CRC-32 checksum value for chunk [0, 0x1829f): Mirror 1: 0x58bcc5d7 Mirror 9: 0x58bcc5d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1829f: skipped 000807 1784288813.376565 trunc from 0x01829f to 0x032bbe (0x1a920 bytes) 000809 1784288813.412846 mapread 0x00d86d thru 0x017c31 (0xa3c5 bytes) 000811 1784288813.422908 mapread 0x02bc9f thru 0x02d11b (0x147d bytes) 000812 1784288813.429031 write 0x002557 thru 0x006cba (0x4764 bytes) 000813 1784288813.433268 mapwrite 0x01ff86 thru 0x02c18c (0xc207 bytes) 000814 1784288813.457083 read 0x01d7e5 thru 0x023538 (0x5d54 bytes) 000815 1784288813.457735 mapwrite 0x0390c8 thru 0x03a869 (0x17a2 bytes) 000817 1784288813.482265 read 0x01d117 thru 0x027df9 (0xace3 bytes) 000819 1784288813.483310 mapwrite 0x01e6b3 thru 0x02da15 (0xf363 bytes) 000820 1784288813.501330 read 0x00f6b9 thru 0x01e0dc (0xea24 bytes) 000822 1784288813.502573 mapwrite 0x0245c2 thru 0x02d0b4 (0x8af3 bytes) 000823 1784288813.517791 mapwrite 0x01bf5e thru 0x022b0f (0x6bb2 bytes) 000824 1784288813.537049 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a86a): Mirror 6: 0xa43a8ea (stale) Mirror 8: 0xa43a8ea (stale) Mirror 9: 0xad617a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a86a): Mirror 6: 0xa43a8ea (stale) Mirror 8: 0xa43a8ea (stale) Mirror 9: 0xad617a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a86a: skipped 000825 1784288813.653404 mapread 0x02d888 thru 0x031e26 (0x459f bytes) 000826 1784288813.658743 mapwrite 0x01db27 thru 0x02262c (0x4b06 bytes) 000827 1784288813.673056 mapread 0x002f5b thru 0x005224 (0x22ca bytes) 000829 1784288813.678282 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a86a): Mirror 8: 0xa43a8ea (stale) Mirror 9: 0xad617a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a86a): Mirror 8: 0xa43a8ea (stale) Mirror 9: 0xad617a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a86a: skipped 000830 1784288813.783450 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a86a): Mirror 8: 0xa43a8ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a86a): Mirror 8: 0xa43a8ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a86a: skipped 000831 1784288813.879947 trunc from 0x03a86a to 0x0355ef (0x527a bytes) 000832 1784288813.886085 mapread 0x0068ba thru 0x00bd79 (0x54c0 bytes) 000833 1784288813.893812 read 0x0114a9 thru 0x01db1d (0xc675 bytes) 000835 1784288813.897865 mapread 0x00d2be thru 0x00f0a5 (0x1de8 bytes) 000836 1784288813.898880 trunc from 0x0355f0 to 0x02786b (0xdd84 bytes) 000839 1784288813.908235 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2786c): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2786c): Mirror 8: 0x6635eacf (stale) CRC-32 checksum value for chunk [0, 0x2786c): Mirror 1: 0x2555616e Mirror 9: 0x2555616e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2786c: skipped 000840 1784288814.168432 trunc from 0x02786c to 0x01905c (0xe80f bytes) 000841 1784288814.200945 write 0x012382 thru 0x0162cc (0x3f4b bytes) 000842 1784288814.204545 trunc from 0x01905d to 0x00600b (0x13051 bytes) 000843 1784288814.212828 read 0x001e8a thru 0x00339f (0x1516 bytes) 000844 1784288814.218131 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x600c): Mirror 9: 0x3d28d6eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x600c): Mirror 9: 0x3d28d6eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x600c: skipped 000845 1784288814.307651 mapwrite 0x02131c thru 0x02ae5f (0x9b44 bytes) 000846 1784288814.341431 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000847 1784288814.384304 write 0x00b48d thru 0x018680 (0xd1f4 bytes) 000850 1784288814.389170 mapwrite 0x03ff51 thru 0x03ffff (0xaf bytes) 000852 1784288814.412696 mapwrite 0x020b88 thru 0x029b11 (0x8f8a bytes) 000853 1784288814.434211 write 0x004fad thru 0x011c06 (0xcc5a bytes) 000855 1784288814.438003 trunc from 0x040000 to 0x006394 (0x39c6b bytes) 000857 1784288814.444976 trunc from 0x006395 to 0x009cf8 (0x3964 bytes) 000860 1784288814.451386 read 0x00696e thru 0x009cf8 (0x338b bytes) 000862 1784288814.454608 mapread 0x0060fe thru 0x009cf8 (0x3bfb bytes) 000863 1784288814.457491 MIRROR_EXTEND to 2 mirrors 000864 1784288814.644548 trunc from 0x009cf9 to 0x022d63 (0x1906b bytes) 000865 1784288814.673509 write 0x01a5b7 thru 0x01e0db (0x3b25 bytes) 000866 1784288814.677122 read 0x00c458 thru 0x0148b5 (0x845e bytes) 000867 1784288814.679992 trunc from 0x022d64 to 0x01f2f3 (0x3a70 bytes) 000868 1784288814.686665 mapwrite 0x020255 thru 0x02afd8 (0xad84 bytes) 000872 1784288814.720877 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2afd9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2afd9): Mirror 2: 0x957557d7 (stale) CRC-32 checksum value for chunk [0, 0x2afd9): Mirror 1: 0x324c7209 Mirror 3: 0x324c7209 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2afd9: skipped truncating to largest ever: 0x3e1bb 000873 1784288814.946683 trunc from 0x02afd9 to 0x03e1ba (0x131e2 bytes) 000874 1784288814.972956 read 0x014b64 thru 0x01b0b6 (0x6553 bytes) 000875 1784288814.976172 mapread 0x03245c thru 0x03e1ba (0xbd5f bytes) 000877 1784288814.987871 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e1bb): Mirror 3: 0xdc68bfdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e1bb): Mirror 3: 0xdc68bfdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e1bb: skipped 000878 1784288815.088202 trunc from 0x03e1bb to 0x031ce5 (0xc4d5 bytes) 000880 1784288815.095529 trunc from 0x031ce6 to 0x024d05 (0xcfe0 bytes) 000884 1784288815.103969 trunc from 0x024d06 to 0x009739 (0x1b5cc bytes) 000886 1784288815.111816 mapread 0x0064af thru 0x009739 (0x328b bytes) 000888 1784288815.119505 mapwrite 0x03595a thru 0x038d0e (0x33b5 bytes) 000889 1784288815.144321 trunc from 0x038d0f to 0x014793 (0x2457b bytes) 000893 1784288815.151648 write 0x013c87 thru 0x01e9d3 (0xad4d bytes) 000896 1784288815.155636 mapread 0x004d3e thru 0x0130df (0xe3a2 bytes) 000899 1784288815.161609 trunc from 0x01e9d4 to 0x0177e5 (0x71ee bytes) 000901 1784288815.169394 write 0x00bd6e thru 0x01352a (0x77bd bytes) 000902 1784288815.170681 read 0x00be04 thru 0x00e25f (0x245c bytes) 000904 1784288815.171665 read 0x0120ae thru 0x01678a (0x46dd bytes) 000905 1784288815.172274 write 0x027585 thru 0x036161 (0xebdd bytes) 000910 1784288815.178064 MIRROR_RESYNC 2 mirrors 000911 1784288815.401034 trunc from 0x036162 to 0x01e616 (0x17b4b bytes) 000912 1784288815.430390 write 0x012600 thru 0x019728 (0x7129 bytes) 000913 1784288815.436676 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1e617): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e617): Mirror 3: 0xb23ff6cc (stale) CRC-32 checksum value for chunk [0, 0x1e617): Mirror 1: 0x43ae6aa7 Mirror 4: 0x43ae6aa7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e617: skipped 000915 1784288815.688091 read 0x00c6fe thru 0x018e10 (0xc713 bytes) 000917 1784288815.693992 read 0x0044ac thru 0x0094ac (0x5001 bytes) 000918 1784288815.700126 mapread 0x00865a thru 0x0151c1 (0xcb68 bytes) 000920 1784288815.705935 mapread 0x019769 thru 0x01e616 (0x4eae bytes) 000921 1784288815.709266 mapwrite 0x019e07 thru 0x01aa80 (0xc7a bytes) 000922 1784288815.769177 mapwrite 0x024e8f thru 0x02cd0c (0x7e7e bytes) 000923 1784288815.810206 trunc from 0x02cd0d to 0x014fd3 (0x17d39 bytes) 000924 1784288815.816465 read 0x0120db thru 0x014fd3 (0x2ef9 bytes) 000925 1784288815.821104 write 0x035448 thru 0x03ffff (0xabb8 bytes) 000927 1784288815.823062 mapread 0x0213de thru 0x02bd07 (0xa92a bytes) 000929 1784288815.828670 mapread 0x039e4c thru 0x03ffff (0x61b4 bytes) 000930 1784288815.829649 mapread 0x00aa91 thru 0x010bde (0x614e bytes) 000931 1784288815.832901 MIRROR_RESYNC 3 mirrors 000932 1784288816.073659 MIRROR_RESYNC 3 mirrors 000934 1784288816.226101 MIRROR_EXTEND to 4 mirrors 000935 1784288816.444685 read 0x031a4c thru 0x036bc3 (0x5178 bytes) 000939 1784288816.448648 read 0x03f750 thru 0x03ffff (0x8b0 bytes) 000940 1784288816.454236 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000941 1784288816.560330 read 0x02d195 thru 0x0362bc (0x9128 bytes) 000942 1784288816.564216 trunc from 0x040000 to 0x01f183 (0x20e7c bytes) 000943 1784288816.603772 read 0x01604f thru 0x01ec29 (0x8bdb bytes) 000944 1784288816.607513 read 0x01a78d thru 0x01bad9 (0x134d bytes) 000946 1784288816.608525 mapread 0x00ed90 thru 0x01abf9 (0xbe6a bytes) 000947 1784288816.609618 mapread 0x00d6f7 thru 0x010213 (0x2b1d bytes) 000948 1784288816.610269 write 0x026fbb thru 0x0358ae (0xe8f4 bytes) 000950 1784288816.612165 trunc from 0x0358af to 0x0043b6 (0x314f8 bytes) 000955 1784288816.623687 trunc from 0x0043b7 to 0x0109a2 (0xc5ec bytes) 000956 1784288816.631283 trunc from 0x0109a3 to 0x03cb8e (0x2c1ec bytes) 000957 1784288816.640063 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cb8f): Mirror 4: 0x9eee7c8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb8f): Mirror 4: 0x9eee7c8a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb8f: skipped 000958 1784288816.735169 trunc from 0x03cb8f to 0x03d487 (0x8f9 bytes) 000959 1784288816.740264 mapread 0x0384d9 thru 0x03d487 (0x4faf bytes) 000960 1784288816.747470 mapwrite 0x004474 thru 0x0116fb (0xd288 bytes) 000961 1784288816.772457 mapwrite 0x02cbc9 thru 0x031481 (0x48b9 bytes) 000963 1784288816.794426 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000964 1784288816.843138 mapread 0x039a06 thru 0x03d487 (0x3a82 bytes) 000969 1784288816.855168 trunc from 0x03d488 to 0x004e6a (0x3861d bytes) 000970 1784288816.871209 MIRROR_EXTEND to 2 mirrors 000972 1784288817.060120 read 0x0014f0 thru 0x004e6a (0x397b bytes) 000974 1784288817.062673 read 0x0024cd thru 0x002664 (0x198 bytes) 000976 1784288817.063301 trunc from 0x004e6b to 0x030c0c (0x2bda2 bytes) 000978 1784288817.091654 read 0x02f15e thru 0x030c0c (0x1aaf bytes) 000980 1784288817.095367 write 0x03d8cb thru 0x03ffff (0x2735 bytes) 000981 1784288817.097776 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4f4:0x0]: Invalid argument (22) 000982 1784288817.142917 mapwrite 0x007ec0 thru 0x009299 (0x13da bytes) 000986 1784288817.168778 write 0x0171e9 thru 0x026eb8 (0xfcd0 bytes) 000987 1784288817.178553 MIRROR_EXTEND to 2 mirrors 000989 1784288817.366096 trunc from 0x040000 to 0x003cb4 (0x3c34b bytes) 000990 1784288817.391494 write 0x001351 thru 0x010a98 (0xf748 bytes) 000991 1784288817.394457 write 0x020a2a thru 0x027448 (0x6a1f bytes) 000992 1784288817.397575 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27449): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27449): Mirror 2: 0x83852a95 (stale) CRC-32 checksum value for chunk [0, 0x27449): Mirror 1: 0x699bc0fa Mirror 3: 0x699bc0fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27449: skipped 000993 1784288817.631058 mapwrite 0x0314c7 thru 0x0341be (0x2cf8 bytes) 000995 1784288817.682885 read 0x022034 thru 0x02cecf (0xae9c bytes) 000996 1784288817.687923 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x341bf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341bf): Mirror 2: 0xf86af790 (stale) Mirror 3: 0xa4b202c (stale) CRC-32 checksum value for chunk [0, 0x341bf): Mirror 1: 0x8f2deac6 Mirror 4: 0x8f2deac6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341bf: skipped 000997 1784288817.926765 read 0x0046b9 thru 0x00814b (0x3a93 bytes) 000999 1784288817.930382 mapread 0x00cdd5 thru 0x015ce6 (0x8f12 bytes) 001000 1784288817.936069 write 0x03da5f thru 0x03ffff (0x25a1 bytes) All operations completed A-OK!