== sanity-flr test 70a: flr mode fsx test ================ 08:51:34 (1787835094) Seed set to 5096 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1787835096.439439 write 0x028b7e thru 0x0334e4 (0xa967 bytes) 000004 1787835096.442851 mapwrite 0x01c8e2 thru 0x029353 (0xca72 bytes) 000006 1787835096.569043 mapread 0x031325 thru 0x0334e4 (0x21c0 bytes) 000007 1787835096.579003 MIRROR_EXTEND to 2 mirrors 000008 1787835097.333770 mapwrite 0x02f734 thru 0x03d4bc (0xdd89 bytes) 000009 1787835097.541063 mapread 0x03b924 thru 0x03d4bc (0x1b99 bytes) 000010 1787835097.542994 read 0x026ed5 thru 0x031f92 (0xb0be bytes) 000011 1787835097.549704 mapwrite 0x03b0e2 thru 0x03da8f (0x29ae bytes) 000012 1787835097.667264 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x24a8a 000013 1787835098.523841 trunc from 0x03da90 to 0x024a89 (0x19006 bytes) 000014 1787835098.607795 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000015 1787835098.802708 trunc from 0x024a8a to 0x01cec0 (0x7bc9 bytes) 000018 1787835098.820286 read 0x0144fb thru 0x01cec0 (0x89c6 bytes) 000019 1787835098.830294 write 0x0219ac thru 0x02e603 (0xcc58 bytes) 000021 1787835098.836707 mapread 0x00e2ac thru 0x017584 (0x92d9 bytes) 000025 1787835098.867848 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x387b9 000026 1787835099.628079 trunc from 0x02e604 to 0x0387b8 (0xa1b5 bytes) 000030 1787835099.717792 trunc from 0x0387b9 to 0x01377a (0x2503e bytes) 000031 1787835099.743338 mapwrite 0x037999 thru 0x03ffff (0x8667 bytes) 000033 1787835099.840789 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000036 1787835100.061102 trunc from 0x040000 to 0x012e8a (0x2d175 bytes) 000038 1787835100.093063 MIRROR_EXTEND to 2 mirrors 000040 1787835100.944904 MIRROR_RESYNC 2 mirrors 000042 1787835101.375315 mapread 0x011b82 thru 0x012e8a (0x1309 bytes) 000044 1787835101.392330 write 0x032857 thru 0x03d054 (0xa7fe bytes) 000045 1787835101.470884 mapwrite 0x02ea56 thru 0x0350ae (0x6659 bytes) 000046 1787835101.555528 mapwrite 0x0096ab thru 0x00e8fc (0x5252 bytes) 000051 1787835101.622436 mapread 0x0293b8 thru 0x02ee39 (0x5a82 bytes) 000054 1787835101.624414 read 0x0312b1 thru 0x034c7b (0x39cb bytes) 000057 1787835101.627986 trunc from 0x03d055 to 0x02be27 (0x1122d bytes) 000058 1787835101.667005 read 0x00e9c4 thru 0x00f069 (0x6a6 bytes) 000059 1787835101.667650 read 0x022028 thru 0x0233ee (0x13c7 bytes) 000060 1787835101.688195 trunc from 0x02be28 to 0x03486e (0x8a47 bytes) 000061 1787835101.715837 read 0x024c9e thru 0x028663 (0x39c6 bytes) 000062 1787835101.716676 mapwrite 0x02cf9d thru 0x03432e (0x7392 bytes) 000063 1787835101.800045 mapread 0x0056d3 thru 0x005769 (0x97 bytes) 000064 1787835101.801479 trunc from 0x03486f to 0x02c49a (0x83d4 bytes) 000065 1787835101.822035 read 0x017773 thru 0x01ab84 (0x3412 bytes) 000066 1787835101.824478 read 0x00842f thru 0x014771 (0xc343 bytes) 000067 1787835101.831230 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c49b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c49b): Mirror 2: 0xd1e8002b (stale) CRC-32 checksum value for chunk [0, 0x2c49b): Mirror 1: 0x61210f99 Mirror 3: 0x61210f99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c49b: skipped 000068 1787835102.927012 trunc from 0x02c49b to 0x0265a5 (0x5ef5 bytes) 000070 1787835103.041205 mapread 0x002212 thru 0x002d67 (0xb56 bytes) 000071 1787835103.049785 mapread 0x019273 thru 0x0245b0 (0xb33e bytes) 000073 1787835103.075886 read 0x00dbc0 thru 0x0156e6 (0x7b27 bytes) 000074 1787835103.087649 mapwrite 0x030378 thru 0x03c1b9 (0xbe42 bytes) 000076 1787835103.173627 mapwrite 0x01ac05 thru 0x026808 (0xbc04 bytes) 000077 1787835103.227678 write 00000000 thru 0x0033b3 (0x33b4 bytes) 000079 1787835103.239357 read 0x019bce thru 0x01c153 (0x2586 bytes) 000080 1787835103.240346 mapread 0x025412 thru 0x029719 (0x4308 bytes) 000081 1787835103.253258 read 0x03bb34 thru 0x03c1b9 (0x686 bytes) 000082 1787835103.253895 write 0x006b99 thru 0x007e06 (0x126e bytes) 000084 1787835103.256764 mapwrite 0x02588c thru 0x02688c (0x1001 bytes) 000085 1787835103.324095 read 0x01ae8a thru 0x01c989 (0x1b00 bytes) 000086 1787835103.324967 mapwrite 0x0398f0 thru 0x03ffff (0x6710 bytes) 000087 1787835103.407674 read 0x011d95 thru 0x0192d1 (0x753d bytes) 000088 1787835103.412845 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1ccc90e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1ccc90e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000089 1787835103.790647 read 0x02453a thru 0x02fee0 (0xb9a7 bytes) 000090 1787835103.812882 read 0x0136b5 thru 0x01b884 (0x81d0 bytes) 000092 1787835103.827929 write 0x016c07 thru 0x0197eb (0x2be5 bytes) 000094 1787835103.830788 trunc from 0x040000 to 0x023cd4 (0x1c32b bytes) 000095 1787835103.868351 read 0x013e9d thru 0x018770 (0x48d4 bytes) 000097 1787835103.871012 mapwrite 0x0395f5 thru 0x03aa29 (0x1435 bytes) 000098 1787835104.068797 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3aa2a): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa2a): Mirror 3: 0x94103469 (stale) CRC-32 checksum value for chunk [0, 0x3aa2a): Mirror 1: 0xcf25dc3 Mirror 4: 0xcf25dc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa2a: skipped 000100 1787835105.097154 mapwrite 0x00c729 thru 0x0138fe (0x71d6 bytes) 000101 1787835105.307625 mapread 0x032424 thru 0x03aa29 (0x8606 bytes) 000102 1787835105.331691 mapwrite 0x00c079 thru 0x015467 (0x93ef bytes) 000104 1787835105.414484 write 0x036700 thru 0x037c69 (0x156a bytes) 000106 1787835105.415937 mapread 0x03a7f9 thru 0x03aa29 (0x231 bytes) 000107 1787835105.421549 write 0x01cb0b thru 0x02a2c0 (0xd7b6 bytes) 000108 1787835105.431855 mapread 0x002eea thru 0x00a62e (0x7745 bytes) 000109 1787835105.452027 mapwrite 0x002925 thru 0x008e89 (0x6565 bytes) 000110 1787835105.519756 mapwrite 0x02f608 thru 0x030b9c (0x1595 bytes) 000111 1787835105.561957 read 0x009fa2 thru 0x00b727 (0x1786 bytes) 000113 1787835105.564684 read 0x020e47 thru 0x0303a9 (0xf563 bytes) 000116 1787835105.566676 mapwrite 0x02f04f thru 0x03e038 (0xefea bytes) 000117 1787835105.679535 write 0x01e3d2 thru 0x01fe1b (0x1a4a bytes) 000118 1787835105.680607 trunc from 0x03e039 to 0x02202f (0x1c009 bytes) 000119 1787835105.704205 trunc from 0x022030 to 0x027e69 (0x5e3a bytes) 000120 1787835105.724821 write 0x0147e5 thru 0x024595 (0xfdb1 bytes) 000121 1787835105.732938 trunc from 0x027e6a to 0x024b3e (0x332b bytes) 000122 1787835105.750411 trunc from 0x024b3f to 0x02eda9 (0xa26b bytes) 000123 1787835105.776234 read 0x011fbb thru 0x0204c8 (0xe50e bytes) truncating to largest ever: 0x3d724 000127 1787835105.779667 trunc from 0x02edaa to 0x03d723 (0xe97a bytes) 000129 1787835105.814403 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d724): Mirror 3: 0xef6408e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d724): Mirror 3: 0xef6408e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d724: skipped 000130 1787835106.320106 read 0x002d9d thru 0x003221 (0x485 bytes) 000131 1787835106.337926 mapread 0x00e85b thru 0x010a77 (0x221d bytes) 000132 1787835106.379248 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000134 1787835106.538844 MIRROR_EXTEND to 2 mirrors 000137 1787835107.529076 read 0x03cbfe thru 0x03d723 (0xb26 bytes) 000140 1787835107.548782 read 0x012e78 thru 0x016e6a (0x3ff3 bytes) 000141 1787835107.583989 trunc from 0x03d724 to 0x00db53 (0x2fbd0 bytes) 000142 1787835107.714716 mapwrite 0x03c36c thru 0x03ffff (0x3c94 bytes) 000143 1787835107.878369 mapread 0x02995e thru 0x0359af (0xc052 bytes) 000146 1787835107.972928 write 0x002bd0 thru 0x00f994 (0xcdc5 bytes) 000150 1787835107.986709 read 0x0234e6 thru 0x02c7f8 (0x9313 bytes) 000155 1787835108.000530 mapread 0x01173e thru 0x01627c (0x4b3f bytes) 000158 1787835108.003468 mapwrite 0x0341e1 thru 0x03abed (0x6a0d bytes) 000159 1787835108.091023 mapwrite 0x03654e thru 0x03ffff (0x9ab2 bytes) 000161 1787835108.161848 mapwrite 0x0336b6 thru 0x035677 (0x1fc2 bytes) 000163 1787835108.214841 read 0x015578 thru 0x01b9f9 (0x6482 bytes) 000168 1787835108.225592 write 0x0110be thru 0x013e97 (0x2dda bytes) 000169 1787835108.229996 read 0x02d45f thru 0x03c7eb (0xf38d bytes) truncating to largest ever: 0x3da05 000171 1787835108.232577 trunc from 0x040000 to 0x03da04 (0x25fb bytes) 000175 1787835108.269744 trunc from 0x03da05 to 0x0168b6 (0x2714e bytes) 000177 1787835108.299661 write 0x02bf4a thru 0x03825b (0xc312 bytes) 000180 1787835108.311722 trunc from 0x03825c to 0x036dff (0x145c bytes) 000183 1787835108.355362 trunc from 0x036e00 to 0x00ac3e (0x2c1c1 bytes) 000186 1787835108.382076 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000189 1787835108.709873 trunc from 0x00ac3f to 0x02c7f7 (0x21bb9 bytes) 000190 1787835108.748775 MIRROR_EXTEND to 2 mirrors 000191 1787835110.105127 mapwrite 0x032b35 thru 0x035d6f (0x323b bytes) 000192 1787835110.301248 mapread 0x0193cd thru 0x0254b4 (0xc0e8 bytes) 000193 1787835110.328422 read 0x00aaf6 thru 0x00cd11 (0x221c bytes) 000195 1787835110.342825 MIRROR_RESYNC 2 mirrors 000197 1787835111.330402 mapread 0x010372 thru 0x012515 (0x21a4 bytes) 000198 1787835111.369851 mapread 0x02658c thru 0x033d72 (0xd7e7 bytes) 000199 1787835111.410529 read 0x01ef3f thru 0x02dd18 (0xedda bytes) 000200 1787835111.423668 write 0x03a6f1 thru 0x03ffff (0x590f bytes) 000202 1787835111.553654 read 0x02c3e0 thru 0x036d33 (0xa954 bytes) 000203 1787835111.581201 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000204 1787835111.800765 trunc from 0x040000 to 0x015309 (0x2acf6 bytes) 000205 1787835111.871606 MIRROR_EXTEND to 2 mirrors 000211 1787835113.136331 read 0x00bdb2 thru 0x00e11d (0x236c bytes) 000212 1787835113.147052 read 0x00a386 thru 0x015309 (0xaf84 bytes) 000213 1787835113.175109 trunc from 0x01530a to 0x0174fa (0x21f1 bytes) 000215 1787835113.369768 mapread 0x00a0db thru 0x0174fa (0xd420 bytes) 000216 1787835113.507737 write 0x01ff49 thru 0x026027 (0x60df bytes) 000217 1787835113.521452 mapread 0x0112e6 thru 0x016a42 (0x575d bytes) 000218 1787835113.523372 trunc from 0x026028 to 0x034d41 (0xed1a bytes) 000222 1787835113.605763 read 0x00158a thru 0x003caa (0x2721 bytes) 000223 1787835113.654544 MIRROR_RESYNC 2 mirrors 000225 1787835114.525233 mapread 0x02d4dd thru 0x034d41 (0x7865 bytes) 000226 1787835114.564385 MIRROR_RESYNC 2 mirrors 000227 1787835115.008633 mapread 0x02d7d4 thru 0x02fa4e (0x227b bytes) 000229 1787835115.010545 mapwrite 0x02f291 thru 0x03c5a0 (0xd310 bytes) 000230 1787835115.232850 read 0x015882 thru 0x02580f (0xff8e bytes) 000231 1787835115.276571 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c5a1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c5a1): Mirror 2: 0xfdfea03c (stale) CRC-32 checksum value for chunk [0, 0x3c5a1): Mirror 1: 0xccb815dd Mirror 3: 0xccb815dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c5a1: skipped 000232 1787835116.390115 read 0x0331f8 thru 0x03c5a0 (0x93a9 bytes) 000233 1787835116.401839 mapwrite 0x00c35b thru 0x010c46 (0x48ec bytes) 000235 1787835116.698077 trunc from 0x03c5a1 to 0x01f0df (0x1d4c1 bytes) 000236 1787835116.774683 trunc from 0x01f0e0 to 0x009001 (0x160de bytes) 000239 1787835116.820783 mapread 0x004a8f thru 0x00604a (0x15bc bytes) 000241 1787835116.841350 mapwrite 0x02bca8 thru 0x031242 (0x559b bytes) 000243 1787835116.947971 mapwrite 0x03caa3 thru 0x03ffff (0x355d bytes) 000246 1787835117.028602 mapwrite 0x039360 thru 0x03ffff (0x6ca0 bytes) 000247 1787835117.071468 mapread 0x02e2e0 thru 0x02f20b (0xf2c bytes) 000248 1787835117.072566 mapread 0x0143be thru 0x01b897 (0x74da bytes) 000249 1787835117.084744 mapwrite 0x038ee0 thru 0x03cca3 (0x3dc4 bytes) 000250 1787835117.130692 mapwrite 0x014321 thru 0x01af7d (0x6c5d bytes) 000251 1787835117.174052 mapread 0x012651 thru 0x01cfb9 (0xa969 bytes) 000252 1787835117.175220 read 0x0179c6 thru 0x01aa3b (0x3076 bytes) 000257 1787835117.179682 mapwrite 0x0035b3 thru 0x008c8f (0x56dd bytes) 000261 1787835117.240279 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdc6afc97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdc6afc97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000262 1787835117.658579 mapread 0x00df4f thru 0x01082e (0x28e0 bytes) 000263 1787835117.693382 mapread 0x030913 thru 0x03da0e (0xd0fc bytes) 000264 1787835117.741450 mapwrite 0x03ae9c thru 0x03f59f (0x4704 bytes) 000267 1787835117.818794 read 0x009e52 thru 0x00b3f0 (0x159f bytes) 000270 1787835117.822559 trunc from 0x040000 to 0x00ce3b (0x331c4 bytes) 000271 1787835117.847938 trunc from 0x00ce3c to 0x01518b (0x8350 bytes) 000276 1787835117.869557 read 0x007e6b thru 0x00a88c (0x2a22 bytes) 000277 1787835117.881101 write 0x014162 thru 0x021f5b (0xddfa bytes) 000278 1787835117.883649 mapread 0x010af4 thru 0x020a6e (0xff7b bytes) 000279 1787835117.889860 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21f5c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f5c): Mirror 3: 0x6bacc453 (stale) CRC-32 checksum value for chunk [0, 0x21f5c): Mirror 1: 0x8bd033af Mirror 4: 0x8bd033af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f5c: skipped 000280 1787835119.282376 write 0x008208 thru 0x00e70a (0x6503 bytes) 000281 1787835119.489798 mapread 0x00d68c thru 0x00f659 (0x1fce bytes) 000283 1787835119.513266 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21f5c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f5c): Mirror 3: 0x6bacc453 (stale) Mirror 4: 0x8bd033af (stale) CRC-32 checksum value for chunk [0, 0x21f5c): Mirror 1: 0xec622fc3 Mirror 5: 0xec622fc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f5c: skipped 000284 1787835120.912705 write 0x019fa4 thru 0x023d5f (0x9dbc bytes) 000287 1787835121.026001 write 0x02a6bb thru 0x039392 (0xecd8 bytes) 000289 1787835121.034216 mapwrite 0x0167c5 thru 0x01bbbf (0x53fb bytes) 000290 1787835121.187116 mapwrite 0x00dee0 thru 0x017ce2 (0x9e03 bytes) 000291 1787835121.293583 read 0x020d4b thru 0x0272a8 (0x655e bytes) 000293 1787835121.310420 trunc from 0x039393 to 0x014d24 (0x2466e bytes) 000297 1787835121.343348 read 0x0069a8 thru 0x0120b5 (0xb70e bytes) 000300 1787835121.348627 mapwrite 0x02be06 thru 0x02d5dc (0x17d7 bytes) 000301 1787835121.464346 mapwrite 0x02cc9f thru 0x0317b8 (0x4b1a bytes) 000303 1787835121.534285 write 0x037afa thru 0x03fe85 (0x838c bytes) 000304 1787835121.536939 mapread 0x026f46 thru 0x035f29 (0xefe4 bytes) 000305 1787835121.545678 write 0x00d105 thru 0x010bf2 (0x3aee bytes) 000306 1787835121.556039 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe86): Mirror 3: 0x4bb193a9 (stale) Mirror 4: 0x26c4c431 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe86): Mirror 3: 0x4bb193a9 (stale) Mirror 4: 0x26c4c431 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe86: skipped 000307 1787835121.931058 mapwrite 0x01c234 thru 0x01ddc5 (0x1b92 bytes) 000308 1787835121.977441 write 0x0265f5 thru 0x02c2bf (0x5ccb bytes) 000309 1787835121.988456 trunc from 0x03fe86 to 0x01fe50 (0x20035 bytes) 000311 1787835122.006673 trunc from 0x01fe51 to 0x029dac (0x9f5c bytes) 000312 1787835122.023355 mapread 0x021810 thru 0x029dac (0x859d bytes) 000313 1787835122.037738 MIRROR_RESYNC 3 mirrors 000314 1787835123.236411 write 0x00e1df thru 0x019861 (0xb683 bytes) 000315 1787835123.395848 read 0x0137b8 thru 0x0174f2 (0x3d3b bytes) 000316 1787835123.396694 mapwrite 0x004dbf thru 0x010e12 (0xc054 bytes) 000317 1787835123.491283 write 0x00b8ba thru 0x012678 (0x6dbf bytes) 000319 1787835123.495006 write 0x0121a6 thru 0x01dca6 (0xbb01 bytes) 000320 1787835123.503009 read 0x027236 thru 0x029dac (0x2b77 bytes) 000322 1787835123.514612 mapwrite 0x00a246 thru 0x014097 (0x9e52 bytes) 000323 1787835123.557936 trunc from 0x029dad to 0x03aae5 (0x10d39 bytes) 000327 1787835123.624318 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3aae6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aae6): Mirror 3: 0xf607025 (stale) Mirror 4: 0xf607025 (stale) CRC-32 checksum value for chunk [0, 0x3aae6): Mirror 1: 0xb48190cb Mirror 5: 0xb48190cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aae6: skipped 000328 1787835124.905350 mapwrite 0x0211a5 thru 0x02d27c (0xc0d8 bytes) 000329 1787835125.116324 MIRROR_RESYNC 4 mirrors 000332 1787835126.170480 read 0x01a9d1 thru 0x02a96e (0xff9e bytes) 000335 1787835126.212369 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000336 1787835126.589207 mapread 0x012135 thru 0x015386 (0x3252 bytes) 000337 1787835126.624531 trunc from 0x03aae6 to 0x029843 (0x112a2 bytes) 000338 1787835126.788255 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29844): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29844): Mirror 3: 0xbef0833a (stale) Mirror 4: 0xbef0833a (stale) CRC-32 checksum value for chunk [0, 0x29844): Mirror 1: 0xbef0833a Mirror 5: 0xbef0833a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29844: skipped 000340 1787835127.894498 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29844): Mirror 4: 0xbef0833a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29844): Mirror 4: 0xbef0833a (stale) CRC-32 checksum value for chunk [0, 0x29844): Mirror 1: 0xbef0833a Mirror 5: 0xbef0833a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29844: skipped 000341 1787835128.518630 read 0x01700a thru 0x01c5d9 (0x55d0 bytes) 000342 1787835128.538487 write 0x02a708 thru 0x0365fa (0xbef3 bytes) 000343 1787835128.652833 trunc from 0x0365fb to 0x00d835 (0x28dc5 bytes) 000345 1787835128.691714 write 0x02ab8d thru 0x0305ed (0x5a61 bytes) 000347 1787835128.694637 trunc from 0x0305ee to 0x0304ee (0xff bytes) 000348 1787835128.724086 mapwrite 0x033bf3 thru 0x03ffff (0xc40d bytes) 000351 1787835128.834899 write 0x0263a1 thru 0x02c85a (0x64ba bytes) 000353 1787835128.842525 mapread 0x01c8cb thru 0x02bd7b (0xf4b1 bytes) 000354 1787835128.868734 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc26b0031 (stale) Mirror 5: 0x725f20f7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb66e9906 Mirror 6: 0xb66e9906 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000355 1787835130.224920 trunc from 0x040000 to 0x00f002 (0x30ffd bytes) 000357 1787835130.343049 mapwrite 0x02a6fc thru 0x03339f (0x8ca4 bytes) 000358 1787835130.471916 mapwrite 0x03a114 thru 0x03fcea (0x5bd7 bytes) 000359 1787835130.612634 write 0x0389b7 thru 0x03aa15 (0x205f bytes) 000360 1787835130.616721 write 0x020ae8 thru 0x029307 (0x8820 bytes) 000363 1787835130.630872 trunc from 0x03fceb to 0x0083ed (0x378fd bytes) 000365 1787835130.687483 mapwrite 0x00ce63 thru 0x01ac0b (0xdda9 bytes) 000366 1787835130.798279 read 0x00f1d7 thru 0x019c4c (0xaa76 bytes) 000367 1787835130.799092 read 0x012ea7 thru 0x01ac0b (0x7d65 bytes) 000368 1787835130.800848 mapwrite 0x0207ea thru 0x02e948 (0xe15f bytes) 000369 1787835130.988032 mapwrite 0x011925 thru 0x013899 (0x1f75 bytes) 000370 1787835131.067889 read 0x0066bc thru 0x01574c (0xf091 bytes) 000371 1787835131.068781 mapread 0x029a57 thru 0x02e948 (0x4ef2 bytes) 000373 1787835131.077408 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e949): Mirror 4: 0xfe9d3718 (stale) Mirror 6: 0x3210ef7a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e949): Mirror 4: 0xfe9d3718 (stale) Mirror 6: 0x3210ef7a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e949: skipped 000374 1787835131.671546 mapwrite 0x00222a thru 0x00f302 (0xd0d9 bytes) 000377 1787835131.841070 mapwrite 0x0320db thru 0x03c65e (0xa584 bytes) 000379 1787835131.982261 trunc from 0x03c65f to 0x000ef8 (0x3b766 bytes) 000380 1787835132.012627 write 0x02b665 thru 0x02d637 (0x1fd3 bytes) 000384 1787835132.017170 mapwrite 0x01eef4 thru 0x022fa2 (0x40af bytes) 000385 1787835132.086988 mapread 0x0291e2 thru 0x02d637 (0x4456 bytes) 000387 1787835132.095849 read 0x0107f3 thru 0x01fe6f (0xf67d bytes) 000391 1787835132.108042 mapread 0x0260ee thru 0x02d637 (0x754a bytes) 000392 1787835132.109321 mapwrite 0x01fae1 thru 0x02d1a4 (0xd6c4 bytes) 000393 1787835132.154331 trunc from 0x02d638 to 0x026a19 (0x6c1e bytes) 000394 1787835132.170716 mapread 0x00368c thru 0x00c050 (0x89c5 bytes) 000396 1787835132.183112 write 0x024779 thru 0x029d02 (0x558a bytes) 000397 1787835132.185433 write 0x000ea8 thru 0x002217 (0x1370 bytes) 000398 1787835132.203791 MIRROR_RESYNC 3 mirrors 000399 1787835133.494740 mapread 0x0228e7 thru 0x029d02 (0x741c bytes) 000403 1787835133.565224 MIRROR_RESYNC 3 mirrors 000404 1787835134.186551 MIRROR_EXTEND to 4 mirrors 000405 1787835135.177700 mapwrite 0x023e9e thru 0x031432 (0xd595 bytes) 000406 1787835135.494683 write 0x0020fd thru 0x002c2c (0xb30 bytes) 000407 1787835135.501457 mapwrite 0x01bb4f thru 0x02351c (0x79ce bytes) 000409 1787835135.556041 write 0x008afc thru 0x017b75 (0xf07a bytes) 000411 1787835135.563324 mapwrite 0x029b4f thru 0x0303b9 (0x686b bytes) 000412 1787835135.621514 mapread 0x022726 thru 0x023eeb (0x17c6 bytes) 000413 1787835135.623336 mapwrite 0x02b7e8 thru 0x02c92c (0x1145 bytes) 000415 1787835135.670773 mapread 0x015bba thru 0x01eae5 (0x8f2c bytes) 000416 1787835135.673320 write 0x015585 thru 0x021efe (0xc97a bytes) 000417 1787835135.676167 write 0x00af4f thru 0x017a19 (0xcacb bytes) 000418 1787835135.678398 mapwrite 0x00f89e thru 0x0112d3 (0x1a36 bytes) 000419 1787835135.720745 trunc from 0x031433 to 0x00f811 (0x21c21 bytes) 000422 1787835135.742357 mapwrite 0x0134a5 thru 0x020c3b (0xd797 bytes) 000426 1787835135.885760 mapread 0x001fb8 thru 0x01151e (0xf567 bytes) 000428 1787835135.900939 trunc from 0x020c3c to 0x03a774 (0x19b39 bytes) 000430 1787835135.938280 trunc from 0x03a775 to 0x01597d (0x24df7 bytes) 000431 1787835135.979760 write 0x029180 thru 0x029764 (0x5e5 bytes) 000432 1787835135.988760 write 0x013a76 thru 0x01d1c0 (0x974b bytes) 000435 1787835136.005901 mapread 0x0104aa thru 0x01f069 (0xebc0 bytes) 000436 1787835136.018801 mapread 0x0064de thru 0x00cde6 (0x6909 bytes) 000440 1787835136.031984 read 0x00e853 thru 0x01819e (0x994c bytes) 000441 1787835136.045586 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29765): Mirror 6: 0xe53c39d3 (stale) Mirror 7: 0xe53c39d3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29765): Mirror 6: 0xe53c39d3 (stale) Mirror 7: 0xe53c39d3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29765: skipped 000443 1787835136.461015 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29765): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29765): Mirror 6: 0xe53c39d3 (stale) Mirror 7: 0xe53c39d3 (stale) CRC-32 checksum value for chunk [0, 0x29765): Mirror 1: 0x8775f565 Mirror 8: 0x8775f565 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29765: skipped 000446 1787835137.732920 mapread 0x024ca7 thru 0x029176 (0x44d0 bytes) 000447 1787835137.785015 read 0x01bdb4 thru 0x0203bf (0x460c bytes) 000448 1787835137.803863 mapwrite 0x0279a1 thru 0x03542d (0xda8d bytes) 000451 1787835138.123623 mapread 0x024a0f thru 0x026743 (0x1d35 bytes) 000452 1787835138.125279 mapwrite 0x006365 thru 0x012ebc (0xcb58 bytes) 000453 1787835138.226473 write 0x034761 thru 0x03af0e (0x67ae bytes) 000456 1787835138.230452 mapread 0x021495 thru 0x02f03b (0xdba7 bytes) 000457 1787835138.233438 write 0x002848 thru 0x00aee8 (0x86a1 bytes) 000458 1787835138.239574 mapread 0x018f16 thru 0x01a621 (0x170c bytes) 000460 1787835138.280468 mapread 0x009f41 thru 0x00a9c6 (0xa86 bytes) 000467 1787835138.300419 trunc from 0x03af0f to 0x0052bf (0x35c4f bytes) 000470 1787835138.339019 read 0x001dd4 thru 0x0052bf (0x34ec bytes) 000471 1787835138.339926 read 0x0011a5 thru 0x0052bf (0x411b bytes) 000472 1787835138.341327 mapwrite 0x001c97 thru 0x00e732 (0xca9c bytes) 000474 1787835138.519585 mapread 0x003352 thru 0x00e167 (0xae16 bytes) 000475 1787835138.528777 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe733): Mirror 6: 0x343c3f8d (stale) Mirror 8: 0x2bd21503 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe733): Mirror 6: 0x343c3f8d (stale) Mirror 8: 0x2bd21503 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe733: skipped 000476 1787835139.096023 trunc from 0x00e733 to 0x01f70d (0x10fdb bytes) 000478 1787835139.140118 mapwrite 0x00b612 thru 0x019a58 (0xe447 bytes) 000480 1787835139.344802 trunc from 0x01f70e to 0x027b98 (0x848b bytes) 000482 1787835139.378560 read 0x01a24c thru 0x024a94 (0xa849 bytes) 000483 1787835139.401492 mapread 0x015661 thru 0x0200b8 (0xaa58 bytes) 000484 1787835139.411068 MIRROR_RESYNC 3 mirrors 000486 1787835140.720630 read 0x01bf66 thru 0x0203e4 (0x447f bytes) 000487 1787835140.732893 trunc from 0x027b99 to 0x0310f2 (0x955a bytes) 000489 1787835140.829317 read 0x002ab6 thru 0x009c81 (0x71cc bytes) 000491 1787835140.843628 write 0x03f58c thru 0x03ffff (0xa74 bytes) 000492 1787835140.855895 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5eef7b25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5eef7b25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000494 1787835141.206157 read 0x03776b thru 0x03ffff (0x8895 bytes) 000495 1787835141.217986 mapwrite 0x0092c6 thru 0x00954d (0x288 bytes) 000496 1787835141.264046 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000501 1787835141.438806 mapwrite 0x031bc6 thru 0x033ca4 (0x20df bytes) 000503 1787835141.494287 mapwrite 0x02919f thru 0x03604d (0xceaf bytes) 000504 1787835141.552855 trunc from 0x040000 to 0x02ddbe (0x12241 bytes) 000505 1787835141.570680 mapread 0x026f2c thru 0x02ddbe (0x6e93 bytes) 000507 1787835141.573371 write 0x032b9f thru 0x039b7d (0x6fdf bytes) 000508 1787835141.575699 read 0x023c5e thru 0x033023 (0xf3c6 bytes) 000511 1787835141.583023 mapread 0x0291e8 thru 0x03645d (0xd276 bytes) 000512 1787835141.584575 mapread 0x003532 thru 0x0108cc (0xd39b bytes) 000513 1787835141.594372 read 0x02b160 thru 0x02fb48 (0x49e9 bytes) 000514 1787835141.599491 MIRROR_EXTEND to 2 mirrors 000517 1787835142.197964 mapwrite 0x01a628 thru 0x01e20d (0x3be6 bytes) 000518 1787835142.428015 MIRROR_RESYNC 2 mirrors 000519 1787835143.454104 write 0x028f12 thru 0x032347 (0x9436 bytes) 000521 1787835143.540909 trunc from 0x039b7e to 0x029c57 (0xff26 bytes) 000522 1787835143.562620 mapwrite 0x02421a thru 0x033545 (0xf32c bytes) 000527 1787835143.672385 write 0x01362e thru 0x01aa72 (0x7445 bytes) 000528 1787835143.687661 read 0x0111d2 thru 0x01c64c (0xb47b bytes) 000529 1787835143.699994 write 0x0290b4 thru 0x03683e (0xd78b bytes) 000531 1787835143.703852 mapread 0x025121 thru 0x0267c5 (0x16a5 bytes) 000532 1787835143.704883 write 0x03237f thru 0x035bcd (0x384f bytes) 000533 1787835143.706340 write 0x0154d5 thru 0x020a95 (0xb5c1 bytes) 000534 1787835143.708079 read 0x0025a9 thru 0x00517e (0x2bd6 bytes) 000535 1787835143.717815 mapwrite 0x012026 thru 0x013b1d (0x1af8 bytes) 000536 1787835143.760477 MIRROR_RESYNC 2 mirrors 000537 1787835144.659871 mapwrite 0x03a3e7 thru 0x03c197 (0x1db1 bytes) 000538 1787835144.831552 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000539 1787835144.997843 read 0x004e99 thru 0x011ed6 (0xd03e bytes) 000541 1787835145.012055 trunc from 0x03c198 to 0x00ba59 (0x3073e bytes) 000542 1787835145.033745 trunc from 0x00ba5a to 0x000291 (0xb7c8 bytes) 000544 1787835145.052095 write 0x00b611 thru 0x012739 (0x7129 bytes) 000547 1787835145.060035 MIRROR_EXTEND to 2 mirrors 000548 1787835145.928099 mapwrite 0x03df33 thru 0x03ffff (0x20cd bytes) 000549 1787835146.201880 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x46e92961 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x26adb627 Mirror 3: 0x26adb627 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000552 1787835147.497838 write 0x03f8c9 thru 0x03ffff (0x737 bytes) 000553 1787835147.680951 mapread 0x00917b thru 0x00b454 (0x22da bytes) 000554 1787835147.712904 mapwrite 0x031e05 thru 0x03ffff (0xe1fb bytes) 000556 1787835147.803628 read 0x025005 thru 0x034cea (0xfce6 bytes) 000557 1787835147.833427 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x46e92961 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x46e92961 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000558 1787835148.317026 mapread 0x00355f thru 0x00402a (0xacc bytes) 000559 1787835148.342310 write 0x00f0f3 thru 0x011559 (0x2467 bytes) 000560 1787835148.363710 mapwrite 0x02c724 thru 0x038f10 (0xc7ed bytes) 000562 1787835148.494293 mapread 0x03f396 thru 0x03ffff (0xc6a bytes) 000564 1787835148.510454 mapwrite 0x03b30b thru 0x03ffff (0x4cf5 bytes) 000567 1787835148.644755 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x46e92961 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeb8cbc7f Mirror 3: 0xeb8cbc7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000570 1787835150.001523 trunc from 0x040000 to 0x022920 (0x1d6df bytes) 000571 1787835150.097996 mapwrite 0x03f90b thru 0x03ffff (0x6f5 bytes) 000572 1787835150.202473 mapread 0x031da5 thru 0x03ffff (0xe25b bytes) 000573 1787835150.235431 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xeb8cbc7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xeb8cbc7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000574 1787835150.611923 mapwrite 0x02802d thru 0x028be5 (0xbb9 bytes) 000577 1787835150.690974 mapwrite 0x001790 thru 0x007fa8 (0x6819 bytes) 000578 1787835150.828046 mapwrite 0x023b4d thru 0x030d90 (0xd244 bytes) 000579 1787835150.924419 write 0x02ceba thru 0x036149 (0x9290 bytes) 000580 1787835150.939656 mapwrite 0x01c07e thru 0x022238 (0x61bb bytes) 000582 1787835151.017037 mapwrite 0x00490b thru 0x007ce3 (0x33d9 bytes) 000584 1787835151.065319 write 0x03f2ee thru 0x03ffff (0xd12 bytes) 000585 1787835151.071100 write 0x022ff6 thru 0x025cf2 (0x2cfd bytes) 000586 1787835151.072330 mapwrite 0x0293b0 thru 0x02d6f5 (0x4346 bytes) 000587 1787835151.133764 trunc from 0x040000 to 0x01dfb4 (0x2204b bytes) 000589 1787835151.167819 mapread 0x0181cd thru 0x01abbc (0x29f0 bytes) 000590 1787835151.187380 write 0x01376a thru 0x019345 (0x5bdc bytes) 000591 1787835151.190718 mapread 0x01688f thru 0x01dfb4 (0x7726 bytes) 000592 1787835151.199279 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1dfb5): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dfb5): Mirror 3: 0x4633eea2 (stale) CRC-32 checksum value for chunk [0, 0x1dfb5): Mirror 1: 0x2be83bfe Mirror 4: 0x2be83bfe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dfb5: skipped 000593 1787835152.671917 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000594 1787835153.251285 write 0x02885d thru 0x028c5f (0x403 bytes) 000595 1787835153.427637 mapread 0x00bd24 thru 0x00de7f (0x215c bytes) 000596 1787835153.492694 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000597 1787835153.718806 write 0x02d8b4 thru 0x02e990 (0x10dd bytes) 000598 1787835153.722221 read 0x02c563 thru 0x02e990 (0x242e bytes) 000599 1787835153.730026 mapread 0x0295bb thru 0x02e990 (0x53d6 bytes) 000600 1787835153.760940 read 0x00b082 thru 0x00d7b1 (0x2730 bytes) 000601 1787835153.791104 read 0x00c014 thru 0x013d78 (0x7d65 bytes) 000605 1787835153.798227 mapread 0x01c329 thru 0x02a037 (0xdd0f bytes) 000606 1787835153.816612 MIRROR_EXTEND to 2 mirrors 000608 1787835155.160349 MIRROR_EXTEND to 3 mirrors 000610 1787835156.219743 trunc from 0x02e991 to 0x01970f (0x15281 bytes) 000612 1787835156.330878 read 0x013d1a thru 0x01970f (0x59f6 bytes) 000613 1787835156.343122 write 0x0323cc thru 0x0382bf (0x5ef4 bytes) 000614 1787835156.345118 read 0x01ed8e thru 0x022bc1 (0x3e34 bytes) 000615 1787835156.356826 trunc from 0x0382c0 to 0x01066e (0x27c51 bytes) 000616 1787835156.376218 write 0x0083c0 thru 0x017fd9 (0xfc1a bytes) 000617 1787835156.391884 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17fda): Mirror 3: 0x758ac661 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17fda): Mirror 3: 0x758ac661 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17fda: skipped 000619 1787835156.736018 write 0x01c33c thru 0x02344b (0x7110 bytes) 000621 1787835156.740645 read 0x00917c thru 0x0124d7 (0x935c bytes) 000622 1787835156.758659 mapwrite 0x003565 thru 0x010da3 (0xd83f bytes) 000625 1787835156.948329 read 0x004166 thru 0x004e5c (0xcf7 bytes) 000630 1787835156.956815 mapwrite 0x022c6f thru 0x02eeda (0xc26c bytes) 000631 1787835157.100721 trunc from 0x02eedb to 0x02a025 (0x4eb5 bytes) 000635 1787835157.131517 trunc from 0x02a026 to 0x003a7a (0x265ab bytes) 000636 1787835157.183234 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a7b): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7b): Mirror 3: 0xf64ad8f9 (stale) CRC-32 checksum value for chunk [0, 0x3a7b): Mirror 1: 0x6ab4dff2 Mirror 4: 0x6ab4dff2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7b: skipped 000637 1787835158.413974 mapread 0x000994 thru 0x002b55 (0x21c2 bytes) 000640 1787835158.453216 mapwrite 0x00a943 thru 0x00e4b0 (0x3b6e bytes) 000642 1787835158.808331 read 0x008f3a thru 0x00e4b0 (0x5577 bytes) 000643 1787835158.808959 write 0x026b61 thru 0x0362fb (0xf79b bytes) 000644 1787835158.812736 trunc from 0x0362fc to 0x000809 (0x35af2 bytes) 000645 1787835158.866668 mapread 0x000152 thru 0x000809 (0x6b8 bytes) 000646 1787835158.878711 write 0x000876 thru 0x010810 (0xff9b bytes) 000647 1787835158.885893 mapwrite 0x014197 thru 0x01b1c3 (0x702d bytes) 000648 1787835159.029870 mapwrite 0x01ef8d thru 0x029b47 (0xabbb bytes) 000650 1787835159.167664 read 0x006fe3 thru 0x014c69 (0xdc87 bytes) 000654 1787835159.171288 mapwrite 0x027205 thru 0x02e21f (0x701b bytes) 000655 1787835159.343805 trunc from 0x02e220 to 0x031e08 (0x3be9 bytes) 000656 1787835159.388266 write 0x03f6f5 thru 0x03ffff (0x90b bytes) 000657 1787835159.389313 trunc from 0x040000 to 0x01a4b9 (0x25b46 bytes) 000659 1787835159.419621 write 0x006a5e thru 0x00bfef (0x5592 bytes) 000661 1787835159.422267 mapwrite 0x00a39c thru 0x00d18c (0x2df1 bytes) 000662 1787835159.532309 mapwrite 0x014281 thru 0x021394 (0xd114 bytes) 000664 1787835159.708544 read 0x01dcb6 thru 0x01f664 (0x19af bytes) 000667 1787835159.713729 mapwrite 0x00634e thru 0x00cb1a (0x67cd bytes) 000668 1787835159.819088 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21395): Mirror 4: 0xa201560b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21395): Mirror 4: 0xa201560b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21395: skipped 000669 1787835160.264703 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000671 1787835160.445727 mapwrite 0x0231c9 thru 0x02cc11 (0x9a49 bytes) 000673 1787835160.657089 trunc from 0x02cc12 to 0x01026b (0x1c9a6 bytes) 000675 1787835160.691627 mapread 0x00b855 thru 0x01026b (0x4a17 bytes) 000679 1787835160.728583 mapwrite 0x03f99d thru 0x03ffff (0x663 bytes) 000681 1787835160.857884 mapread 0x0212d5 thru 0x02977e (0x84aa bytes) 000684 1787835160.892785 mapread 0x018e33 thru 0x02614e (0xd31c bytes) 000685 1787835160.926016 read 0x008832 thru 0x0176f7 (0xeec6 bytes) 000686 1787835160.926850 trunc from 0x040000 to 0x02ec23 (0x113dc bytes) 000687 1787835160.956300 mapread 0x0236ea thru 0x028ed1 (0x57e8 bytes) 000690 1787835160.963632 mapread 0x004b9c thru 0x0134c7 (0xe92c bytes) 000691 1787835160.978174 read 0x00113e thru 0x00645c (0x531f bytes) 000692 1787835160.991828 write 0x02a043 thru 0x038170 (0xe12e bytes) 000693 1787835161.005696 write 0x022b04 thru 0x030429 (0xd926 bytes) 000694 1787835161.008814 trunc from 0x038171 to 0x0037cf (0x349a1 bytes) 000696 1787835161.050897 trunc from 0x0037d0 to 0x019330 (0x15b61 bytes) 000697 1787835161.103574 mapwrite 0x014ea1 thru 0x0193cd (0x452d bytes) 000698 1787835161.225044 MIRROR_EXTEND to 2 mirrors 000700 1787835161.977291 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000704 1787835162.144313 trunc from 0x0193ce to 0x01f846 (0x6479 bytes) 000706 1787835162.214064 write 0x02715d thru 0x032207 (0xb0ab bytes) 000710 1787835162.221713 mapwrite 0x00b1cc thru 0x00d923 (0x2758 bytes) 000712 1787835162.320265 write 0x022065 thru 0x02259f (0x53b bytes) 000713 1787835162.328876 write 0x0254ff thru 0x031780 (0xc282 bytes) 000714 1787835162.332021 mapread 0x01314c thru 0x01e9ce (0xb883 bytes) 000716 1787835162.344653 mapread 0x013d4f thru 0x014219 (0x4cb bytes) 000718 1787835162.346830 mapwrite 0x0321a3 thru 0x0355c0 (0x341e bytes) 000721 1787835162.429862 mapread 0x003651 thru 0x004830 (0x11e0 bytes) 000723 1787835162.441640 read 0x00775c thru 0x00a159 (0x29fe bytes) 000724 1787835162.443122 read 0x023672 thru 0x02afdc (0x796b bytes) 000725 1787835162.444272 write 0x00c2fd thru 0x0129e6 (0x66ea bytes) 000726 1787835162.446527 mapread 0x014e5e thru 0x01aada (0x5c7d bytes) 000727 1787835162.448264 write 0x024839 thru 0x02eab6 (0xa27e bytes) 000728 1787835162.449918 read 0x0339d6 thru 0x0355c0 (0x1beb bytes) 000729 1787835162.451223 trunc from 0x0355c1 to 0x017552 (0x1e06e bytes) 000730 1787835162.473949 mapwrite 0x018e4d thru 0x01cff0 (0x41a4 bytes) 000733 1787835162.555263 mapwrite 0x00fc0f thru 0x019c0e (0xa000 bytes) 000734 1787835162.657968 read 0x016fde thru 0x01cff0 (0x6013 bytes) 000736 1787835162.677053 MIRROR_EXTEND to 2 mirrors 000738 1787835163.531766 trunc from 0x01cff1 to 0x01522a (0x7dc6 bytes) 000740 1787835163.699080 mapread 0x00516b thru 0x0096fb (0x4591 bytes) 000742 1787835163.750523 write 0x03c11a thru 0x03ffff (0x3ee6 bytes) 000744 1787835163.762863 trunc from 0x040000 to 0x0183e4 (0x27c1b bytes) 000745 1787835163.800698 mapwrite 0x024ccd thru 0x025f29 (0x125d bytes) 000748 1787835163.982775 mapwrite 0x03474d thru 0x03d921 (0x91d5 bytes) 000750 1787835164.106818 read 0x006cf4 thru 0x00926a (0x2577 bytes) 000751 1787835164.110176 write 0x01a034 thru 0x0224a4 (0x8471 bytes) 000752 1787835164.129213 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d922): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d922): Mirror 2: 0xffb55772 (stale) CRC-32 checksum value for chunk [0, 0x3d922): Mirror 1: 0x82bee645 Mirror 3: 0x82bee645 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d922: skipped 000753 1787835165.606790 trunc from 0x03d922 to 0x03a51f (0x3402 bytes) 000755 1787835165.771696 mapwrite 0x00caee thru 0x012321 (0x5834 bytes) 000756 1787835165.835505 write 0x03c6e6 thru 0x03ffff (0x391a bytes) 000757 1787835165.836793 write 0x00e732 thru 0x010b2e (0x23fd bytes) 000760 1787835165.840088 mapwrite 0x03c291 thru 0x03ffff (0x3d6f bytes) 000761 1787835165.880733 read 0x036bbe thru 0x03a8a0 (0x3ce3 bytes) 000762 1787835165.891060 mapread 0x00b21c thru 0x0170ed (0xbed2 bytes) 000763 1787835165.901963 write 0x030df5 thru 0x036dfb (0x6007 bytes) 000764 1787835165.917672 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x33307802 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x33307802 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000766 1787835166.366606 mapread 0x009b4b thru 0x00ce7d (0x3333 bytes) 000767 1787835166.414476 mapwrite 0x02d8dd thru 0x03a179 (0xc89d bytes) 000768 1787835166.507187 mapwrite 0x011297 thru 0x01d871 (0xc5db bytes) 000769 1787835166.618260 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x33307802 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x163b6cbf Mirror 4: 0x163b6cbf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000770 1787835167.869675 read 0x02a678 thru 0x036ea0 (0xc829 bytes) 000773 1787835167.891122 mapwrite 0x00c1ca thru 0x01bde9 (0xfc20 bytes) 000776 1787835168.278699 mapwrite 0x0244e9 thru 0x032a36 (0xe54e bytes) 000777 1787835168.442970 mapread 0x01cea2 thru 0x02b0e7 (0xe246 bytes) 000780 1787835168.449320 trunc from 0x040000 to 0x01f01e (0x20fe1 bytes) 000783 1787835168.486376 write 0x01b4c7 thru 0x026674 (0xb1ae bytes) 000784 1787835168.491895 trunc from 0x026675 to 0x02c17f (0x5b0b bytes) 000785 1787835168.556062 mapwrite 0x004064 thru 0x00cbc8 (0x8b65 bytes) 000787 1787835168.705478 read 0x020b61 thru 0x02c17f (0xb61f bytes) 000789 1787835168.720529 read 0x010842 thru 0x019539 (0x8cf8 bytes) 000790 1787835168.727854 MIRROR_RESYNC 3 mirrors 000792 1787835170.170984 read 0x003012 thru 0x00369a (0x689 bytes) 000794 1787835170.177822 mapread 0x012b21 thru 0x019e92 (0x7372 bytes) 000797 1787835170.247386 MIRROR_EXTEND to 4 mirrors 000799 1787835171.121536 read 0x01c5fe thru 0x029b57 (0xd55a bytes) 000801 1787835171.134647 mapread 0x015669 thru 0x01f493 (0x9e2b bytes) 000803 1787835171.153070 trunc from 0x02c180 to 0x032e07 (0x6c88 bytes) 000805 1787835171.233607 read 0x027356 thru 0x02865e (0x1309 bytes) 000806 1787835171.258355 read 0x01fc3d thru 0x02a6bb (0xaa7f bytes) 000809 1787835171.261553 write 0x0350e2 thru 0x03ffff (0xaf1e bytes) 000811 1787835171.264694 read 0x00ba7f thru 0x016187 (0xa709 bytes) 000812 1787835171.265911 mapwrite 0x034569 thru 0x03d234 (0x8ccc bytes) 000813 1787835171.312796 mapread 0x00d7c1 thru 0x0171aa (0x99ea bytes) 000815 1787835171.315816 trunc from 0x040000 to 0x00e15f (0x31ea0 bytes) 000817 1787835171.346975 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe160): Mirror 4: 0xc5f149c7 (stale) Mirror 5: 0xc5f149c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe160): Mirror 4: 0xc5f149c7 (stale) Mirror 5: 0xc5f149c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe160: skipped 000818 1787835171.730716 read 0x00b681 thru 0x00e15f (0x2adf bytes) 000820 1787835171.743756 trunc from 0x00e160 to 0x028a8d (0x1a92e bytes) 000823 1787835171.767599 trunc from 0x028a8e to 0x03cfcc (0x1453f bytes) 000825 1787835171.787552 trunc from 0x03cfcd to 0x039b04 (0x34c8 bytes) 000826 1787835171.803585 mapwrite 0x026dc6 thru 0x036500 (0xf73b bytes) 000827 1787835171.895403 read 0x02f6f0 thru 0x039b04 (0xa415 bytes) 000829 1787835171.899333 read 0x013a78 thru 0x017c6a (0x41f3 bytes) 000830 1787835171.915959 mapwrite 0x00e636 thru 0x01e230 (0xfbfb bytes) 000833 1787835172.004484 mapread 0x023073 thru 0x025f68 (0x2ef6 bytes) 000835 1787835172.007448 read 0x01512c thru 0x017c00 (0x2ad5 bytes) 000837 1787835172.012126 mapwrite 0x028be5 thru 0x029122 (0x53e bytes) 000839 1787835172.052362 mapwrite 0x0107e1 thru 0x015edd (0x56fd bytes) 000840 1787835172.114113 mapwrite 0x0296b4 thru 0x02bd36 (0x2683 bytes) 000841 1787835172.157080 trunc from 0x039b05 to 0x021997 (0x1816d bytes) 000842 1787835172.180664 trunc from 0x021998 to 0x02a0bc (0x8725 bytes) 000844 1787835172.204270 trunc from 0x02a0bd to 0x026c5a (0x3462 bytes) 000845 1787835172.234536 MIRROR_RESYNC 3 mirrors 000846 1787835173.473566 read 0x01983d thru 0x01a1c5 (0x989 bytes) 000847 1787835173.482356 MIRROR_EXTEND to 4 mirrors 000848 1787835174.552997 mapread 0x007104 thru 0x008976 (0x1873 bytes) 000850 1787835174.587483 mapread 0x022136 thru 0x026c5a (0x4b25 bytes) 000851 1787835174.604886 write 0x019e15 thru 0x0244bd (0xa6a9 bytes) 000852 1787835174.735863 write 0x00f2a1 thru 0x01d4cd (0xe22d bytes) 000856 1787835174.745652 mapread 0x0043c3 thru 0x012f47 (0xeb85 bytes) 000857 1787835174.756908 write 0x01793e thru 0x01c1f6 (0x48b9 bytes) 000862 1787835174.761457 write 0x01cff0 thru 0x01fe54 (0x2e65 bytes) 000863 1787835174.764066 read 0x00f5b3 thru 0x01eb47 (0xf595 bytes) 000867 1787835174.769728 write 0x0242c8 thru 0x02a627 (0x6360 bytes) 000868 1787835174.771553 mapwrite 0x03885e thru 0x03a548 (0x1ceb bytes) 000869 1787835174.885648 mapwrite 0x01116a thru 0x0139c5 (0x285c bytes) 000870 1787835174.950184 mapwrite 0x034118 thru 0x0343ba (0x2a3 bytes) 000872 1787835175.038899 MIRROR_RESYNC 4 mirrors 000873 1787835176.232494 mapread 0x039581 thru 0x03a548 (0xfc8 bytes) 000875 1787835176.259665 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000876 1787835176.772845 read 0x0332a3 thru 0x03a548 (0x72a6 bytes) truncating to largest ever: 0x3df28 000877 1787835176.784008 trunc from 0x03a549 to 0x03df27 (0x39df bytes) 000880 1787835176.894363 read 0x026a54 thru 0x02ce26 (0x63d3 bytes) 000882 1787835176.919326 read 0x02658c thru 0x02aec0 (0x4935 bytes) 000883 1787835176.920270 write 0x014240 thru 0x014f3f (0xd00 bytes) 000884 1787835176.922004 read 0x01fcbc thru 0x020018 (0x35d bytes) 000887 1787835176.925853 trunc from 0x03df28 to 0x025f40 (0x17fe7 bytes) 000889 1787835176.955987 trunc from 0x025f41 to 0x03d3a3 (0x17463 bytes) 000892 1787835176.978989 read 0x01199e thru 0x012717 (0xd7a bytes) 000893 1787835176.980469 read 0x018df1 thru 0x0237b3 (0xa9c3 bytes) 000895 1787835176.982424 read 0x022c78 thru 0x030712 (0xda9b bytes) 000896 1787835177.001742 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3a4): Mirror 5: 0x73e8af2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3a4): Mirror 5: 0x73e8af2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3a4: skipped 000897 1787835177.355772 trunc from 0x03d3a4 to 0x0315aa (0xbdf9 bytes) 000899 1787835177.376535 mapread 0x014b18 thru 0x020cdf (0xc1c8 bytes) 000900 1787835177.413491 write 0x02b54d thru 0x032dbc (0x7870 bytes) 000901 1787835177.428879 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32dbd): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32dbd): Mirror 5: 0x5f8d359d (stale) CRC-32 checksum value for chunk [0, 0x32dbd): Mirror 1: 0x91e74cc Mirror 6: 0x91e74cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32dbd: skipped 000902 1787835179.083600 read 0x025e03 thru 0x028260 (0x245e bytes) 000903 1787835179.101556 trunc from 0x032dbd to 0x0299de (0x93de bytes) 000905 1787835179.298023 write 0x00cd06 thru 0x017999 (0xac94 bytes) 000907 1787835179.338680 mapread 0x01c838 thru 0x0200d0 (0x3899 bytes) 000908 1787835179.379422 mapwrite 0x0138b1 thru 0x01ce76 (0x95c6 bytes) 000909 1787835179.534525 MIRROR_RESYNC 3 mirrors 000910 1787835180.705438 mapread 0x01ed8f thru 0x0299de (0xac50 bytes) 000911 1787835180.750959 read 0x005271 thru 0x00e7f0 (0x9580 bytes) 000913 1787835180.777330 mapwrite 0x00aa5a thru 0x01709a (0xc641 bytes) 000914 1787835180.997937 write 0x02bbc3 thru 0x039655 (0xda93 bytes) 000915 1787835181.018795 trunc from 0x039656 to 0x03283b (0x6e1a bytes) 000916 1787835181.067220 read 0x032736 thru 0x03283b (0x106 bytes) 000917 1787835181.076363 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3283c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3283c): Mirror 5: 0x4d55bbb0 (stale) Mirror 6: 0x4d55bbb0 (stale) CRC-32 checksum value for chunk [0, 0x3283c): Mirror 1: 0xabe55777 Mirror 7: 0xabe55777 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3283c: skipped 000918 1787835182.407421 read 0x013111 thru 0x01bac4 (0x89b4 bytes) 000919 1787835182.435741 write 0x006fb4 thru 0x015af2 (0xeb3f bytes) 000920 1787835182.539723 read 0x01d0a2 thru 0x027981 (0xa8e0 bytes) 000921 1787835182.564196 trunc from 0x03283c to 0x029a98 (0x8da3 bytes) 000922 1787835182.628059 mapwrite 0x01e267 thru 0x023f5c (0x5cf6 bytes) 000923 1787835182.712250 write 0x0132c0 thru 0x014c7d (0x19be bytes) 000924 1787835182.715293 write 0x00ffaa thru 0x01e4f1 (0xe548 bytes) 000925 1787835182.717991 write 0x01a986 thru 0x01f7e7 (0x4e62 bytes) 000930 1787835182.729925 MIRROR_RESYNC 4 mirrors 000932 1787835184.408801 mapread 0x01240a thru 0x01447d (0x2074 bytes) 000933 1787835184.435261 trunc from 0x029a99 to 0x02fd70 (0x62d8 bytes) 000934 1787835184.538884 trunc from 0x02fd71 to 0x033d99 (0x4029 bytes) 000935 1787835184.573787 mapwrite 0x037ab1 thru 0x03a3d5 (0x2925 bytes) 000936 1787835184.741813 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3d6): Mirror 5: 0x282c5bee (stale) Mirror 6: 0x282c5bee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3d6): Mirror 5: 0x282c5bee (stale) Mirror 6: 0x282c5bee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3d6: skipped 000937 1787835185.168033 mapwrite 0x031cae thru 0x03b8a8 (0x9bfb bytes) 000938 1787835185.279877 mapwrite 0x016ce1 thru 0x01b0a6 (0x43c6 bytes) 000939 1787835185.374158 mapwrite 0x014daf thru 0x014f77 (0x1c9 bytes) 000942 1787835185.442539 mapwrite 0x01120e thru 0x01f603 (0xe3f6 bytes) 000943 1787835185.521297 read 0x01fb28 thru 0x02974d (0x9c26 bytes) 000946 1787835185.534950 mapwrite 0x03dc74 thru 0x03ef1d (0x12aa bytes) 000947 1787835185.645554 read 0x03bfa8 thru 0x03ef1d (0x2f76 bytes) 000948 1787835185.647788 read 0x019a97 thru 0x01cfc5 (0x352f bytes) 000950 1787835185.649551 read 0x027882 thru 0x02dd71 (0x64f0 bytes) 000951 1787835185.651821 mapwrite 0x0170f2 thru 0x01ae9d (0x3dac bytes) 000952 1787835185.732318 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ef1e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef1e): Mirror 5: 0x59b6091d (stale) Mirror 6: 0x59b6091d (stale) CRC-32 checksum value for chunk [0, 0x3ef1e): Mirror 1: 0x8549f9d8 Mirror 7: 0x8549f9d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef1e: skipped 000954 1787835187.406596 mapread 0x006dd9 thru 0x0165e2 (0xf80a bytes) 000955 1787835187.511402 mapread 0x031578 thru 0x035640 (0x40c9 bytes) 000957 1787835187.542044 read 0x03896b thru 0x03ef1d (0x65b3 bytes) 000959 1787835187.572265 write 0x017201 thru 0x02450c (0xd30c bytes) 000961 1787835187.838052 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef1e): Mirror 5: 0x59b6091d (stale) Mirror 6: 0x59b6091d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef1e): Mirror 5: 0x59b6091d (stale) Mirror 6: 0x59b6091d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef1e: skipped 000962 1787835188.503927 mapwrite 0x00479f thru 0x00a5ae (0x5e10 bytes) 000963 1787835188.575367 write 0x03fff7 thru 0x03ffff (0x9 bytes) 000967 1787835188.585912 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x6e940025 (stale) Mirror 6: 0x6e940025 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x64e90e9 Mirror 7: 0x64e90e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1787835190.109737 MIRROR_RESYNC 4 mirrors 000972 1787835191.556583 mapread 0x028a5a thru 0x0328b0 (0x9e57 bytes) 000973 1787835191.591303 write 0x03a69d thru 0x03ffff (0x5963 bytes) 000975 1787835191.786475 trunc from 0x040000 to 0x01e383 (0x21c7c bytes) 000976 1787835191.832205 mapwrite 0x024d2b thru 0x031c0b (0xcee1 bytes) 000978 1787835192.062793 write 0x01c06e thru 0x01df45 (0x1ed8 bytes) 000979 1787835192.078116 mapread 0x02c033 thru 0x031c0b (0x5bd9 bytes) 000980 1787835192.092482 MIRROR_RESYNC 4 mirrors 000982 1787835194.300801 MIRROR_RESYNC 4 mirrors 000983 1787835195.200864 write 0x019735 thru 0x01c4f1 (0x2dbd bytes) 000985 1787835195.333084 trunc from 0x031c0c to 0x0282ea (0x9921 bytes) 000987 1787835195.368604 mapwrite 0x026553 thru 0x0355d9 (0xf087 bytes) 000988 1787835195.573988 mapwrite 0x037044 thru 0x03ffff (0x8fbc bytes) 000989 1787835195.665022 mapread 0x012684 thru 0x0126c9 (0x46 bytes) 000991 1787835195.677473 trunc from 0x040000 to 0x037ed8 (0x8127 bytes) 000993 1787835195.709907 write 0x02cbcd thru 0x02f05c (0x2490 bytes) 000994 1787835195.713210 mapwrite 0x0114fd thru 0x01429b (0x2d9f bytes) 000995 1787835195.829401 mapread 0x00c8dc thru 0x01a68a (0xddaf bytes) 000997 1787835195.867398 MIRROR_RESYNC 4 mirrors 000999 1787835197.425709 write 0x031f8c thru 0x03dc03 (0xbc78 bytes) All operations completed A-OK!