== sanity-flr test 70a: flr mode fsx test ================ 15:23:08 (1787340188) Seed set to 190 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x7b68 000001 1787340190.994835 trunc from 00000000 to 0x007b67 (0x7b68 bytes) 000002 1787340191.049980 write 0x0240bf thru 0x02c01b (0x7f5d bytes) truncating to largest ever: 0x18d75 000003 1787340191.059414 trunc from 0x02c01c to 0x018d74 (0x132a7 bytes) 000004 1787340191.076509 read 0x008206 thru 0x00e31b (0x6116 bytes) truncating to largest ever: 0x3d8d0 000005 1787340191.098528 trunc from 0x018d75 to 0x03d8cf (0x24b5b bytes) 000006 1787340191.146100 mapwrite 0x03b951 thru 0x03ffff (0x46af bytes) 000007 1787340191.381483 write 0x01dba6 thru 0x02b293 (0xd6ee bytes) 000011 1787340191.408766 trunc from 0x040000 to 0x02d527 (0x12ad8 bytes) 000013 1787340191.443782 read 0x0211ff thru 0x02d527 (0xc329 bytes) 000014 1787340191.456325 read 0x000256 thru 0x006962 (0x670d bytes) 000015 1787340191.456968 mapread 0x0253aa thru 0x028ad6 (0x372d bytes) 000017 1787340191.458350 mapread 0x008072 thru 0x01767e (0xf60d bytes) 000022 1787340191.473551 mapwrite 0x010bc7 thru 0x020472 (0xf8ac bytes) 000023 1787340191.595860 read 0x000ee8 thru 0x002d51 (0x1e6a bytes) 000024 1787340191.596576 read 0x00b4a6 thru 0x01b0c4 (0xfc1f bytes) 000025 1787340191.603327 read 0x0006d4 thru 0x00ef91 (0xe8be bytes) 000026 1787340191.604433 read 0x00e9db thru 0x01cf0a (0xe530 bytes) 000027 1787340191.612350 mapread 0x02a1fd thru 0x02d527 (0x332b bytes) 000031 1787340191.614588 trunc from 0x02d528 to 0x004594 (0x28f93 bytes) 000033 1787340191.656973 read 0x000b62 thru 0x004594 (0x3a33 bytes) 000034 1787340191.657571 mapread 0x000414 thru 0x004594 (0x4181 bytes) 000035 1787340191.658386 write 0x00b51b thru 0x00c93b (0x1421 bytes) 000036 1787340191.669879 mapread 0x006116 thru 0x00c93b (0x6826 bytes) 000037 1787340191.707721 mapwrite 0x03336c thru 0x03d5bb (0xa250 bytes) 000038 1787340191.877939 mapread 0x02b40d thru 0x034372 (0x8f66 bytes) 000039 1787340191.879078 mapwrite 0x024bd9 thru 0x033ca5 (0xf0cd bytes) 000043 1787340191.995858 read 0x0377a0 thru 0x03bee1 (0x4742 bytes) 000045 1787340191.996849 write 0x0332a4 thru 0x038f10 (0x5c6d bytes) 000046 1787340192.005508 trunc from 0x03d5bc to 0x0101fb (0x2d3c0 bytes) 000047 1787340192.040154 write 0x01184e thru 0x01d2fa (0xbaad bytes) 000048 1787340192.048747 write 0x020cbb thru 0x02a251 (0x9597 bytes) 000050 1787340192.064064 mapread 0x003e19 thru 0x00da8d (0x9c75 bytes) 000052 1787340192.067083 trunc from 0x02a252 to 0x00c744 (0x1db0d bytes) 000053 1787340192.106612 read 0x0026f8 thru 0x0093d4 (0x6cdd bytes) 000055 1787340192.107832 read 0x007ba9 thru 0x00b428 (0x3880 bytes) 000056 1787340192.108446 read 0x00157d thru 0x005dec (0x4870 bytes) 000057 1787340192.108937 read 0x004b37 thru 0x006a71 (0x1f3b bytes) 000058 1787340192.117672 mapwrite 0x0053ed thru 0x0072c7 (0x1edb bytes) 000059 1787340192.212848 write 0x03b630 thru 0x03ffff (0x49d0 bytes) 000061 1787340192.222557 write 0x0159e6 thru 0x01d0ef (0x770a bytes) 000062 1787340192.254526 read 0x0141da thru 0x0234a4 (0xf2cb bytes) 000063 1787340192.255524 trunc from 0x040000 to 0x02d206 (0x12df9 bytes) 000064 1787340192.290615 trunc from 0x02d207 to 0x022d53 (0xa4b3 bytes) 000065 1787340192.325917 mapread 0x019c15 thru 0x021460 (0x784c bytes) 000066 1787340192.327267 write 0x029d99 thru 0x02e369 (0x45d1 bytes) 000067 1787340192.334826 mapread 0x01f5f3 thru 0x0242b5 (0x4cc3 bytes) 000068 1787340192.352552 mapread 0x02a61e thru 0x02e369 (0x3d4c bytes) 000069 1787340192.353493 write 0x037c5b thru 0x03ffff (0x83a5 bytes) 000070 1787340192.354811 write 0x03064f thru 0x038ce5 (0x8697 bytes) 000071 1787340192.377879 mapwrite 0x0339cf thru 0x039879 (0x5eab bytes) 000072 1787340192.514790 mapread 0x02b50a thru 0x02e962 (0x3459 bytes) 000073 1787340192.515602 trunc from 0x040000 to 0x02265b (0x1d9a4 bytes) 000074 1787340192.563969 write 0x026d2e thru 0x02a793 (0x3a66 bytes) 000075 1787340192.568620 write 0x0341d5 thru 0x03af67 (0x6d93 bytes) 000076 1787340192.576682 trunc from 0x03af68 to 0x00b8d1 (0x2f696 bytes) 000077 1787340192.620587 write 0x03f62f thru 0x03fff2 (0x9c4 bytes) 000078 1787340192.622181 write 0x03eed8 thru 0x03ffff (0x1128 bytes) 000081 1787340192.632724 mapread 0x01418c thru 0x016a51 (0x28c6 bytes) 000084 1787340192.661293 write 0x00337c thru 0x0040bd (0xd42 bytes) 000085 1787340192.671316 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3e90a 000086 1787340194.857748 trunc from 0x040000 to 0x03e909 (0x16f6 bytes) 000088 1787340195.039394 mapread 0x03b888 thru 0x03e909 (0x3082 bytes) 000089 1787340195.092072 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000093 1787340195.468839 trunc from 0x03e90a to 0x0139d0 (0x2af39 bytes) 000094 1787340195.531919 mapwrite 0x02f3ac thru 0x03bebe (0xcb13 bytes) 000095 1787340195.724041 MIRROR_EXTEND to 2 mirrors 000096 1787340197.033823 trunc from 0x03bebf to 0x004a3e (0x37480 bytes) 000098 1787340197.170948 MIRROR_RESYNC 2 mirrors 000099 1787340197.970373 mapread 0x00112d thru 0x004a3e (0x3912 bytes) 000100 1787340197.985541 read 0x000bce thru 0x004a3e (0x3e71 bytes) 000101 1787340197.991100 write 0x00aef6 thru 0x00d2ac (0x23b7 bytes) 000102 1787340198.065416 mapwrite 0x00d9e1 thru 0x01d64f (0xfc6f bytes) 000106 1787340198.205183 trunc from 0x01d650 to 0x023d39 (0x66ea bytes) 000108 1787340198.227835 write 0x03b394 thru 0x03ffff (0x4c6c bytes) 000110 1787340198.231319 mapwrite 0x02d929 thru 0x033284 (0x595c bytes) 000112 1787340198.352909 mapread 0x00eb58 thru 0x01e06c (0xf515 bytes) 000115 1787340198.364275 write 0x012a41 thru 0x0187b5 (0x5d75 bytes) 000118 1787340198.367985 write 0x02ad06 thru 0x035ebe (0xb1b9 bytes) 000122 1787340198.381471 read 0x03d453 thru 0x03ffff (0x2bad bytes) 000123 1787340198.382349 mapread 0x015ca8 thru 0x021391 (0xb6ea bytes) 000124 1787340198.389385 trunc from 0x040000 to 0x03364e (0xc9b1 bytes) 000125 1787340198.412289 trunc from 0x03364f to 0x00d2fc (0x26352 bytes) 000126 1787340198.434802 trunc from 0x00d2fd to 0x0360a3 (0x28da7 bytes) 000127 1787340198.455962 trunc from 0x0360a4 to 0x008efa (0x2d1a9 bytes) 000128 1787340198.480801 read 0x00196c thru 0x008efa (0x758f bytes) 000130 1787340198.492044 read 0x001057 thru 0x001612 (0x5bc bytes) 000131 1787340198.498054 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x8efb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8efb): Mirror 2: 0x2bf6a3e (stale) CRC-32 checksum value for chunk [0, 0x8efb): Mirror 1: 0x2bf6a3e Mirror 3: 0x2bf6a3e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8efb: skipped 000132 1787340199.938867 mapwrite 0x00f958 thru 0x018bc5 (0x926e bytes) 000134 1787340200.346254 mapwrite 0x0048f2 thru 0x014288 (0xf997 bytes) 000135 1787340200.613191 mapwrite 0x009c6b thru 0x015496 (0xb82c bytes) 000138 1787340200.885309 mapwrite 0x02223d thru 0x031db5 (0xfb79 bytes) 000141 1787340201.017597 trunc from 0x031db6 to 0x00e9af (0x23406 bytes) 000143 1787340201.056358 mapwrite 0x022021 thru 0x025d80 (0x3d60 bytes) 000145 1787340201.261376 mapwrite 0x00a1f6 thru 0x010363 (0x616e bytes) 000146 1787340201.388079 mapwrite 0x017e62 thru 0x0245d3 (0xc772 bytes) 000147 1787340201.483289 trunc from 0x025d81 to 0x010779 (0x15607 bytes) 000148 1787340201.504793 read 0x00089b thru 0x010354 (0xfaba bytes) 000151 1787340201.516491 mapread 0x00554f thru 0x010779 (0xb22b bytes) 000152 1787340201.520174 write 0x02d5ae thru 0x0358b8 (0x830b bytes) 000155 1787340201.529047 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x358b9): Mirror 3: 0x32155d96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358b9): Mirror 3: 0x32155d96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358b9: skipped 000158 1787340202.263329 mapwrite 0x02a892 thru 0x037d5a (0xd4c9 bytes) 000159 1787340202.549700 write 0x003a13 thru 0x00bd1f (0x830d bytes) 000160 1787340202.581328 write 0x0257cf thru 0x028272 (0x2aa4 bytes) 000161 1787340202.582754 mapwrite 0x00779a thru 0x008c7e (0x14e5 bytes) 000163 1787340202.754291 write 0x0380ba thru 0x03ffff (0x7f46 bytes) 000164 1787340202.755642 write 0x02e37d thru 0x034195 (0x5e19 bytes) 000168 1787340202.761425 mapread 0x019f34 thru 0x01a05d (0x12a bytes) 000171 1787340202.777953 mapread 0x0079e0 thru 0x014406 (0xca27 bytes) 000172 1787340202.833909 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000175 1787340203.062383 trunc from 0x040000 to 0x02371a (0x1c8e5 bytes) 000176 1787340203.084212 mapwrite 0x020446 thru 0x02d825 (0xd3e0 bytes) 000179 1787340203.359955 MIRROR_EXTEND to 2 mirrors 000182 1787340204.537718 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000183 1787340204.741192 mapwrite 0x0071f4 thru 0x015175 (0xdf82 bytes) 000185 1787340204.878149 read 0x01a247 thru 0x027c75 (0xda2f bytes) 000186 1787340204.898838 MIRROR_EXTEND to 2 mirrors 000187 1787340206.035215 write 0x01bd3b thru 0x022192 (0x6458 bytes) 000189 1787340206.137759 write 0x01d08f thru 0x021684 (0x45f6 bytes) 000191 1787340206.144638 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d826): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d826): Mirror 2: 0xc3bdf366 (stale) CRC-32 checksum value for chunk [0, 0x2d826): Mirror 1: 0x33d1794d Mirror 3: 0x33d1794d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d826: skipped 000192 1787340207.933010 MIRROR_RESYNC 3 mirrors 000193 1787340209.392979 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000194 1787340209.880908 trunc from 0x02d826 to 0x02a902 (0x2f23 bytes) 000195 1787340210.017882 mapwrite 0x002459 thru 0x00c194 (0x9d3c bytes) 000196 1787340210.192951 mapread 0x0202f9 thru 0x02a902 (0xa60a bytes) 000197 1787340210.255075 trunc from 0x02a903 to 0x019449 (0x114b9 bytes) 000199 1787340210.319053 trunc from 0x01944a to 0x016e7d (0x25cc bytes) 000200 1787340210.369303 mapwrite 0x00014a thru 0x00ddb6 (0xdc6d bytes) 000201 1787340210.654333 mapread 0x0081a1 thru 0x014e20 (0xcc80 bytes) 000202 1787340210.708855 MIRROR_RESYNC 2 mirrors 000203 1787340212.793749 mapread 0x00fbc1 thru 0x016e7d (0x72bd bytes) 000205 1787340212.845901 write 0x007492 thru 0x008b0d (0x167c bytes) 000206 1787340212.955165 mapread 0x010bb8 thru 0x01158f (0x9d8 bytes) 000207 1787340212.975015 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16e7e): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16e7e): Mirror 3: 0xeefa47fc (stale) CRC-32 checksum value for chunk [0, 0x16e7e): Mirror 1: 0xcdf85ab1 Mirror 4: 0xcdf85ab1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16e7e: skipped 000208 1787340215.122876 read 0x006f63 thru 0x01218c (0xb22a bytes) 000209 1787340215.223682 mapwrite 0x02acf6 thru 0x03a237 (0xf542 bytes) 000210 1787340215.620867 read 0x02f05e thru 0x03a237 (0xb1da bytes) 000212 1787340215.627433 trunc from 0x03a238 to 0x01770e (0x22b29 bytes) 000213 1787340215.696760 MIRROR_RESYNC 3 mirrors 000214 1787340217.456346 mapwrite 0x00069d thru 0x00b0a1 (0xaa05 bytes) 000215 1787340217.812476 write 0x005156 thru 0x00633d (0x11e8 bytes) 000216 1787340217.813576 trunc from 0x01770f to 0x033bbf (0x1c4b1 bytes) 000217 1787340217.886799 mapread 0x004705 thru 0x0092ab (0x4ba7 bytes) 000218 1787340217.887796 read 0x028f29 thru 0x033bbf (0xac97 bytes) 000221 1787340217.913958 read 0x025fa5 thru 0x031876 (0xb8d2 bytes) 000223 1787340217.960166 trunc from 0x033bc0 to 0x01b1aa (0x18a15 bytes) 000224 1787340217.992936 mapwrite 0x0283db thru 0x034621 (0xc247 bytes) 000225 1787340218.251881 mapwrite 0x01e5b0 thru 0x022bf4 (0x4645 bytes) 000227 1787340218.375861 mapread 0x023f56 thru 0x02dd7b (0x9e26 bytes) 000229 1787340218.405634 mapwrite 0x034827 thru 0x03fa0a (0xb1e4 bytes) 000230 1787340218.559892 mapread 0x02aa43 thru 0x03680f (0xbdcd bytes) 000232 1787340218.562591 write 0x0313ec thru 0x034a93 (0x36a8 bytes) 000234 1787340218.564873 trunc from 0x03fa0b to 0x01c8c1 (0x23149 bytes) 000235 1787340218.585861 write 0x016e59 thru 0x01ffe1 (0x9189 bytes) 000237 1787340218.597095 MIRROR_RESYNC 3 mirrors 000238 1787340219.814786 mapwrite 0x033417 thru 0x03fb6c (0xc756 bytes) 000239 1787340219.979678 mapwrite 0x01c442 thru 0x027eb2 (0xba71 bytes) 000240 1787340220.084839 mapread 0x038d07 thru 0x03b398 (0x2692 bytes) 000241 1787340220.085907 write 0x0205c5 thru 0x0304f9 (0xff35 bytes) 000242 1787340220.089173 write 0x0390a8 thru 0x03ffff (0x6f58 bytes) 000243 1787340220.090566 mapread 0x018c1b thru 0x026340 (0xd726 bytes) 000244 1787340220.098379 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb7879bf (stale) Mirror 4: 0xb7879bf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa9b0075c Mirror 5: 0xa9b0075c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000245 1787340221.795603 trunc from 0x040000 to 0x024562 (0x1ba9d bytes) 000246 1787340221.902914 write 0x02de4a thru 0x03095b (0x2b12 bytes) 000247 1787340221.905352 mapwrite 0x02d315 thru 0x036b3a (0x9826 bytes) 000250 1787340222.042933 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36b3b): Mirror 3: 0x29ac2866 (stale) Mirror 4: 0x29ac2866 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b3b): Mirror 3: 0x29ac2866 (stale) Mirror 4: 0x29ac2866 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b3b: skipped 000251 1787340222.501964 read 0x036899 thru 0x036b3a (0x2a2 bytes) 000252 1787340222.512995 trunc from 0x036b3b to 0x022019 (0x14b21 bytes) 000254 1787340222.539804 mapwrite 0x001649 thru 0x00d092 (0xba4a bytes) 000257 1787340222.647441 mapread 0x01f82c thru 0x022019 (0x27ee bytes) 000258 1787340222.667334 read 0x01de89 thru 0x022019 (0x4191 bytes) 000261 1787340222.669851 read 0x01838b thru 0x01b8ae (0x3524 bytes) 000263 1787340222.670791 write 0x00e1c2 thru 0x00e4de (0x31d bytes) 000268 1787340222.673561 trunc from 0x02201a to 0x018d22 (0x92f7 bytes) 000269 1787340222.702606 trunc from 0x018d23 to 0x012077 (0x6cab bytes) 000272 1787340222.723991 write 0x005935 thru 0x00a282 (0x494e bytes) 000276 1787340222.729508 mapwrite 0x0169d6 thru 0x01d382 (0x69ad bytes) 000277 1787340222.847376 mapread 0x002410 thru 0x00dcdb (0xb8cc bytes) 000278 1787340222.848396 mapread 0x0128e8 thru 0x016b53 (0x426c bytes) 000279 1787340222.849221 trunc from 0x01d383 to 0x0366a9 (0x19327 bytes) 000280 1787340222.872589 mapwrite 0x03fb28 thru 0x03ffff (0x4d8 bytes) 000281 1787340222.966512 MIRROR_RESYNC 3 mirrors 000284 1787340224.641490 MIRROR_RESYNC 3 mirrors 000286 1787340224.938796 mapread 0x00857c thru 0x011047 (0x8acc bytes) 000288 1787340224.959663 read 0x0284cf thru 0x031dab (0x98dd bytes) 000289 1787340224.970061 read 0x0046f7 thru 0x004914 (0x21e bytes) 000290 1787340224.976783 MIRROR_RESYNC 3 mirrors 000291 1787340225.469151 read 0x004275 thru 0x010758 (0xc4e4 bytes) 000292 1787340225.469599 mapread 0x011ac7 thru 0x016a3b (0x4f75 bytes) 000295 1787340225.503445 mapread 0x024e66 thru 0x0282e5 (0x3480 bytes) 000297 1787340225.542774 mapread 0x02456b thru 0x02ee54 (0xa8ea bytes) truncating to largest ever: 0x3f891 000300 1787340225.544762 trunc from 0x040000 to 0x03f890 (0x76f bytes) 000301 1787340225.655834 mapread 0x039cf0 thru 0x03f890 (0x5ba1 bytes) 000303 1787340225.668953 write 0x029217 thru 0x02b181 (0x1f6b bytes) 000305 1787340225.684586 write 0x031e7d thru 0x0335df (0x1763 bytes) 000306 1787340225.710866 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f891): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f891): Mirror 3: 0x113138b0 (stale) Mirror 4: 0x113138b0 (stale) CRC-32 checksum value for chunk [0, 0x3f891): Mirror 1: 0x88d4fac8 Mirror 5: 0x88d4fac8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f891: skipped 000308 1787340227.771429 mapread 0x037cc9 thru 0x03e5e0 (0x6918 bytes) 000309 1787340227.834394 trunc from 0x03f891 to 0x01f782 (0x2010e bytes) 000310 1787340227.984569 write 0x0014a8 thru 0x006f79 (0x5ad2 bytes) 000311 1787340228.008926 read 0x005860 thru 0x00d020 (0x77c1 bytes) 000312 1787340228.024771 mapread 0x018abf thru 0x01f782 (0x6cc4 bytes) 000313 1787340228.036738 trunc from 0x01f783 to 0x00098d (0x1edf5 bytes) 000315 1787340228.082586 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x98e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x98e): Mirror 3: 0xce9e01fb (stale) Mirror 4: 0xce9e01fb (stale) Mirror 5: 0xce9e01fb (stale) CRC-32 checksum value for chunk [0, 0x98e): Mirror 1: 0xce9e01fb Mirror 6: 0xce9e01fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x98e: skipped 000316 1787340228.977375 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x98e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x98e): Mirror 3: 0xce9e01fb (stale) Mirror 4: 0xce9e01fb (stale) Mirror 5: 0xce9e01fb (stale) CRC-32 checksum value for chunk [0, 0x98e): Mirror 1: 0xce9e01fb Mirror 6: 0xce9e01fb Mirror 7: 0xce9e01fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x98e: skipped 000317 1787340229.936242 mapread 0x00006a thru 0x00098d (0x924 bytes) 000318 1787340229.951485 read 0x0006bc thru 0x00098d (0x2d2 bytes) 000319 1787340229.952020 mapread 0x00032c thru 0x00098d (0x662 bytes) 000320 1787340229.955857 mapwrite 0x02c50d thru 0x02ce45 (0x939 bytes) 000321 1787340230.290092 trunc from 0x02ce46 to 0x01de34 (0xf011 bytes) 000326 1787340230.335901 trunc from 0x01de35 to 0x0060ef (0x17d45 bytes) 000329 1787340230.387882 MIRROR_RESYNC 6 mirrors 000331 1787340232.118575 write 0x028265 thru 0x02f3e2 (0x717e bytes) 000335 1787340232.182746 trunc from 0x02f3e3 to 0x033dd3 (0x49f1 bytes) 000336 1787340232.201651 write 0x020dba thru 0x02a0fa (0x9341 bytes) 000337 1787340232.208825 read 0x004fd1 thru 0x006aaf (0x1adf bytes) 000338 1787340232.215895 mapwrite 0x00f590 thru 0x01094d (0x13be bytes) 000339 1787340232.292669 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 4: 0x9fc39744 (stale) Mirror 5: 0x9fc39744 (stale) Mirror 6: 0x9fc39744 (stale) Mirror 7: 0x9fc39744 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 4: 0x9fc39744 (stale) Mirror 5: 0x9fc39744 (stale) Mirror 6: 0x9fc39744 (stale) Mirror 7: 0x9fc39744 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dd4: skipped 000341 1787340232.765078 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 4: 0x9fc39744 (stale) Mirror 5: 0x9fc39744 (stale) Mirror 6: 0x9fc39744 (stale) Mirror 7: 0x9fc39744 (stale) CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 1: 0xd784fdbd Mirror 8: 0xd784fdbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dd4: skipped 000343 1787340234.572338 mapread 0x013bbd thru 0x018bab (0x4fef bytes) 000345 1787340234.639916 trunc from 0x033dd4 to 0x022cd0 (0x11103 bytes) 000346 1787340234.796523 mapread 0x00eb33 thru 0x01ab4c (0xc01a bytes) 000347 1787340234.833750 MIRROR_RESYNC 6 mirrors 000348 1787340237.539513 mapread 0x01afc4 thru 0x01b6ce (0x70b bytes) 000349 1787340237.551264 mapwrite 0x01466a thru 0x018089 (0x3a20 bytes) 000350 1787340237.836944 mapwrite 0x03510c thru 0x03bc57 (0x6b4c bytes) 000355 1787340237.926659 read 0x016a55 thru 0x01c53c (0x5ae8 bytes) 000356 1787340237.927746 write 0x009744 thru 0x010be5 (0x74a2 bytes) 000357 1787340237.935758 mapwrite 0x029ca8 thru 0x031b18 (0x7e71 bytes) 000359 1787340238.026420 write 0x01f730 thru 0x02ef76 (0xf847 bytes) 000361 1787340238.054053 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3bc58): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc58): Mirror 4: 0x91804486 (stale) Mirror 5: 0x91804486 (stale) Mirror 6: 0x91804486 (stale) Mirror 7: 0x91804486 (stale) Mirror 8: 0x91804486 (stale) CRC-32 checksum value for chunk [0, 0x3bc58): Mirror 1: 0x771f2b6f Mirror 9: 0x771f2b6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc58: skipped 000363 1787340240.414326 trunc from 0x03bc58 to 0x02cc85 (0xefd2 bytes) 000364 1787340240.618818 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cc86): Mirror 4: 0x413a3eba (stale) Mirror 5: 0x413a3eba (stale) Mirror 6: 0x413a3eba (stale) Mirror 8: 0x413a3eba (stale) Mirror 9: 0x578a3b9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cc86): Mirror 4: 0x413a3eba (stale) Mirror 5: 0x413a3eba (stale) Mirror 6: 0x413a3eba (stale) Mirror 8: 0x413a3eba (stale) Mirror 9: 0x578a3b9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cc86: skipped 000365 1787340241.348264 mapread 0x0259fa thru 0x02b174 (0x577b bytes) 000366 1787340241.378803 write 0x0084fe thru 0x0122bc (0x9dbf bytes) 000368 1787340241.401585 trunc from 0x02cc86 to 0x017f89 (0x14cfc bytes) 000369 1787340241.439670 read 0x0076d2 thru 0x016d5a (0xf689 bytes) 000372 1787340241.455763 read 0x00ede1 thru 0x017f89 (0x91a9 bytes) 000373 1787340241.471627 mapwrite 0x022c83 thru 0x026e3b (0x41b9 bytes) 000374 1787340241.702630 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26e3c): Mirror 4: 0x9502abd (stale) Mirror 6: 0x9502abd (stale) Mirror 8: 0x9502abd (stale) Mirror 9: 0xc7638833 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26e3c): Mirror 4: 0x9502abd (stale) Mirror 6: 0x9502abd (stale) Mirror 8: 0x9502abd (stale) Mirror 9: 0xc7638833 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26e3c: skipped 000375 1787340242.295338 trunc from 0x026e3c to 0x03a21a (0x133df bytes) 000377 1787340242.324457 mapwrite 0x024c0a thru 0x034384 (0xf77b bytes) 000378 1787340242.427167 write 0x029cc6 thru 0x02c42b (0x2766 bytes) 000380 1787340242.428708 read 0x00492c thru 0x00d077 (0x874c bytes) 000381 1787340242.446228 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a21b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a21b): Mirror 4: 0xee44ee9a (stale) Mirror 6: 0xee44ee9a (stale) Mirror 8: 0xee44ee9a (stale) Mirror 9: 0x2396aba7 (stale) CRC-32 checksum value for chunk [0, 0x3a21b): Mirror 1: 0x1f0ca52a Mirror 10: 0x1f0ca52a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a21b: skipped 000382 1787340244.402583 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a21b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a21b): Mirror 4: 0xee44ee9a (stale) Mirror 6: 0xee44ee9a (stale) Mirror 8: 0xee44ee9a (stale) Mirror 9: 0x2396aba7 (stale) CRC-32 checksum value for chunk [0, 0x3a21b): Mirror 1: 0x1f0ca52a Mirror 10: 0x1f0ca52a Mirror 11: 0x1f0ca52a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a21b: skipped 000383 1787340245.399421 write 0x00cba2 thru 0x00f445 (0x28a4 bytes) 000386 1787340245.534838 mapread 0x021f75 thru 0x02cdfd (0xae89 bytes) 000387 1787340245.579736 mapread 0x01c02c thru 0x0203b9 (0x438e bytes) 000389 1787340245.581148 mapwrite 0x00b61f thru 0x00ff8e (0x4970 bytes) 000392 1787340245.746551 mapwrite 0x039508 thru 0x03e79e (0x5297 bytes) 000393 1787340245.946622 read 0x023bae thru 0x02ed7b (0xb1ce bytes) 000394 1787340245.964593 trunc from 0x03e79f to 0x037bdb (0x6bc3 bytes) 000396 1787340246.018500 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37bdc): Mirror 4: 0xc547afb4 (stale) Mirror 8: 0xc547afb4 (stale) Mirror 9: 0xd3a5e4f2 (stale) Mirror 10: 0xdfe851ef (stale) Mirror 11: 0xdfe851ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37bdc): Mirror 4: 0xc547afb4 (stale) Mirror 8: 0xc547afb4 (stale) Mirror 9: 0xd3a5e4f2 (stale) Mirror 10: 0xdfe851ef (stale) Mirror 11: 0xdfe851ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37bdc: skipped 000397 1787340246.563634 read 0x015567 thru 0x01beb9 (0x6953 bytes) 000399 1787340246.577505 mapwrite 0x00a52b thru 0x011b4a (0x7620 bytes) 000402 1787340246.647247 mapread 0x027ced thru 0x02a54e (0x2862 bytes) 000404 1787340246.657709 read 0x014159 thru 0x01a454 (0x62fc bytes) 000410 1787340246.660582 trunc from 0x037bdc to 0x0329eb (0x51f0 bytes) 000413 1787340246.689477 trunc from 0x0329ec to 0x03ebb6 (0xc1cb bytes) 000414 1787340246.715696 read 0x00b702 thru 0x012cc6 (0x75c5 bytes) 000417 1787340246.717450 trunc from 0x03ebb7 to 0x015b19 (0x2909d bytes) 000418 1787340246.737365 trunc from 0x015b1a to 0x03734d (0x21834 bytes) 000420 1787340246.756796 mapread 0x01136c thru 0x016269 (0x4efe bytes) 000421 1787340246.773133 read 0x0222ef thru 0x023a3a (0x174c bytes) 000422 1787340246.773655 mapwrite 0x03176c thru 0x03621c (0x4ab1 bytes) 000423 1787340246.907985 mapread 0x0095f7 thru 0x00e80e (0x5218 bytes) 000424 1787340246.909049 read 0x017559 thru 0x0187f5 (0x129d bytes) 000427 1787340246.913151 trunc from 0x03734e to 0x00cb44 (0x2a809 bytes) 000428 1787340246.961474 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcb45): Mirror 8: 0x9fbe30cc (stale) Mirror 9: 0x727fea69 (stale) Mirror 10: 0x8bec57f0 (stale) Mirror 11: 0x8bec57f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcb45): Mirror 8: 0x9fbe30cc (stale) Mirror 9: 0x727fea69 (stale) Mirror 10: 0x8bec57f0 (stale) Mirror 11: 0x8bec57f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcb45: skipped 000430 1787340247.602611 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcb45): Mirror 9: 0x727fea69 (stale) Mirror 10: 0x8bec57f0 (stale) Mirror 11: 0x8bec57f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcb45): Mirror 9: 0x727fea69 (stale) Mirror 10: 0x8bec57f0 (stale) Mirror 11: 0x8bec57f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcb45: skipped 000431 1787340247.982717 mapwrite 0x024ff7 thru 0x027743 (0x274d bytes) 000432 1787340248.092565 mapwrite 0x0001cc thru 0x007a92 (0x78c7 bytes) 000433 1787340248.182206 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27744): Mirror 9: 0xdb31f972 (stale) Mirror 11: 0x91b7db54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27744): Mirror 9: 0xdb31f972 (stale) Mirror 11: 0x91b7db54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27744: skipped 000434 1787340248.756948 write 0x0005ae thru 0x00c1a0 (0xbbf3 bytes) 000435 1787340248.784515 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27744): Mirror 11: 0x91b7db54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27744): Mirror 11: 0x91b7db54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27744: skipped 000436 1787340249.285765 read 0x004401 thru 0x00831d (0x3f1d bytes) 000437 1787340249.316766 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000438 1787340249.519716 trunc from 0x027744 to 0x03d70f (0x15fcc bytes) 000440 1787340249.545997 trunc from 0x03d710 to 0x015735 (0x27fda bytes) 000441 1787340249.586272 MIRROR_EXTEND to 2 mirrors 000444 1787340250.879669 mapread 0x012633 thru 0x015735 (0x3103 bytes) 000447 1787340250.909577 mapread 0x002cdb thru 0x006f39 (0x425f bytes) 000448 1787340250.919733 mapread 0x011f1a thru 0x015735 (0x381c bytes) 000451 1787340250.925395 mapread 0x005f35 thru 0x011c17 (0xbce3 bytes) 000452 1787340250.928078 write 0x020947 thru 0x022602 (0x1cbc bytes) 000454 1787340251.110324 read 0x00691e thru 0x0150c1 (0xe7a4 bytes) 000456 1787340251.140088 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x22603): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22603): Mirror 2: 0x93886f24 (stale) CRC-32 checksum value for chunk [0, 0x22603): Mirror 1: 0x7e566586 Mirror 3: 0x7e566586 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22603: skipped 000459 1787340252.408950 trunc from 0x022603 to 0x02bdab (0x97a9 bytes) 000461 1787340252.547899 read 0x021e18 thru 0x026f61 (0x514a bytes) 000462 1787340252.569769 MIRROR_RESYNC 3 mirrors 000464 1787340253.848743 write 0x036e7a thru 0x03df60 (0x70e7 bytes) 000468 1787340253.950319 mapwrite 0x0267ae thru 0x0314eb (0xad3e bytes) 000469 1787340254.121345 mapwrite 0x00c03c thru 0x00d6eb (0x16b0 bytes) 000470 1787340254.267692 mapwrite 0x012a9f thru 0x0200d1 (0xd633 bytes) 000471 1787340254.381492 mapread 0x011b95 thru 0x017663 (0x5acf bytes) 000473 1787340254.393378 MIRROR_RESYNC 3 mirrors 000475 1787340256.021287 mapwrite 0x00f95d thru 0x012e77 (0x351b bytes) 000476 1787340256.216663 trunc from 0x03df61 to 0x02b06b (0x12ef5 bytes) 000477 1787340256.266890 mapread 0x0007e3 thru 0x00538c (0x4baa bytes) 000478 1787340256.278644 read 0x00a44b thru 0x011cf8 (0x78ae bytes) 000479 1787340256.281981 trunc from 0x02b06c to 0x02d705 (0x269a bytes) 000481 1787340256.314056 read 0x027587 thru 0x02d705 (0x617f bytes) 000482 1787340256.336505 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d706): Mirror 2: 0xc3fd1b74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d706): Mirror 2: 0xc3fd1b74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d706: skipped 000483 1787340256.804041 read 0x02b411 thru 0x02d705 (0x22f5 bytes) 000484 1787340256.818546 write 0x027980 thru 0x030928 (0x8fa9 bytes) 000486 1787340256.832297 MIRROR_RESYNC 2 mirrors 000489 1787340257.996919 trunc from 0x030929 to 0x02509e (0xb88a bytes) 000493 1787340258.047489 write 0x03d86c thru 0x03ffff (0x2794 bytes) 000495 1787340258.048774 read 0x03eee2 thru 0x03ffff (0x111e bytes) 000496 1787340258.053332 MIRROR_RESYNC 2 mirrors 000497 1787340259.248425 trunc from 0x040000 to 0x01dd79 (0x22286 bytes) 000498 1787340259.378595 mapwrite 0x01fb54 thru 0x025059 (0x5506 bytes) 000499 1787340259.513274 trunc from 0x02505a to 0x016c7b (0xe3de bytes) 000500 1787340259.556393 mapwrite 0x038336 thru 0x03e93f (0x660a bytes) 000502 1787340259.752803 write 0x01b38f thru 0x026936 (0xb5a8 bytes) 000503 1787340259.769563 write 0x02b5a8 thru 0x03a4bc (0xef15 bytes) 000504 1787340259.788031 MIRROR_RESYNC 2 mirrors 000505 1787340261.168097 read 0x03e300 thru 0x03e93f (0x640 bytes) 000506 1787340261.173566 mapwrite 0x018590 thru 0x01e781 (0x61f2 bytes) 000507 1787340261.357087 trunc from 0x03e940 to 0x006d0f (0x37c30 bytes) 000508 1787340261.401408 mapwrite 0x03d1d1 thru 0x03ffff (0x2e2f bytes) 000509 1787340261.471148 read 0x003347 thru 0x007791 (0x444b bytes) 000510 1787340261.491065 read 0x00f1bf thru 0x014eca (0x5d0c bytes) 000512 1787340261.492526 mapread 0x01dcde thru 0x02897a (0xac9d bytes) 000513 1787340261.498860 MIRROR_RESYNC 2 mirrors 000514 1787340262.693487 read 0x022a35 thru 0x02d1a3 (0xa76f bytes) 000515 1787340262.714421 write 0x000283 thru 0x00d733 (0xd4b1 bytes) 000516 1787340262.853609 mapread 0x031d9e thru 0x032daf (0x1012 bytes) 000517 1787340262.871751 mapwrite 0x01a1fc thru 0x01c2ea (0x20ef bytes) 000519 1787340263.002663 read 0x0382d8 thru 0x03ffff (0x7d28 bytes) 000520 1787340263.017566 trunc from 0x040000 to 0x01ef10 (0x210ef bytes) 000521 1787340263.039213 read 0x003fb0 thru 0x00cfb3 (0x9004 bytes) 000522 1787340263.040166 trunc from 0x01ef11 to 0x025d22 (0x6e12 bytes) 000523 1787340263.059554 read 0x01571c thru 0x02143f (0xbd24 bytes) 000524 1787340263.069035 write 0x0107be thru 0x015d70 (0x55b3 bytes) 000525 1787340263.070376 write 0x01e41d thru 0x0266fb (0x82df bytes) 000526 1787340263.072385 write 0x00dc7b thru 0x01326b (0x55f1 bytes) 000529 1787340263.075544 write 0x010f05 thru 0x0189e3 (0x7adf bytes) 000531 1787340263.077973 trunc from 0x0266fc to 0x039016 (0x1291b bytes) 000533 1787340263.099790 trunc from 0x039017 to 0x029717 (0xf8ff bytes) 000534 1787340263.127415 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29718): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29718): Mirror 2: 0x99f0d7f7 (stale) CRC-32 checksum value for chunk [0, 0x29718): Mirror 1: 0x50216f13 Mirror 3: 0x50216f13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29718: skipped 000538 1787340264.454556 trunc from 0x029718 to 0x007042 (0x226d5 bytes) 000541 1787340264.665880 mapwrite 0x0167c9 thru 0x025a65 (0xf29d bytes) 000542 1787340264.806185 MIRROR_RESYNC 3 mirrors 000543 1787340266.006721 MIRROR_RESYNC 3 mirrors 000545 1787340266.517775 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000547 1787340267.044282 MIRROR_EXTEND to 3 mirrors 000548 1787340268.416465 mapwrite 0x019654 thru 0x021474 (0x7e21 bytes) 000549 1787340268.600023 mapread 0x00cccf thru 0x00f928 (0x2c5a bytes) 000550 1787340268.612096 write 0x036ca9 thru 0x03d16a (0x64c2 bytes) 000551 1787340268.619041 MIRROR_RESYNC 3 mirrors 000553 1787340270.062397 read 0x013eb1 thru 0x01c6a4 (0x87f4 bytes) 000554 1787340270.093894 MIRROR_EXTEND to 4 mirrors 000557 1787340271.289279 trunc from 0x03d16b to 0x00223e (0x3af2c bytes) 000559 1787340271.371614 read 0x00102d thru 0x00223e (0x1212 bytes) 000560 1787340271.378217 mapread 0x001069 thru 0x00223e (0x11d6 bytes) 000561 1787340271.379784 read 0x000d0f thru 0x00223e (0x1530 bytes) 000565 1787340271.387588 write 0x006d04 thru 0x00c55d (0x585a bytes) 000566 1787340271.388972 trunc from 0x00c55e to 0x00d956 (0x13f9 bytes) 000569 1787340271.406811 trunc from 0x00d957 to 0x02d824 (0x1fece bytes) 000570 1787340271.420967 mapwrite 0x03cef6 thru 0x03f85e (0x2969 bytes) 000571 1787340271.543821 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f85f): Mirror 3: 0x14ece1e4 (stale) Mirror 5: 0x14ece1e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f85f): Mirror 3: 0x14ece1e4 (stale) Mirror 5: 0x14ece1e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f85f: skipped 000572 1787340272.071167 mapread 0x02d5f3 thru 0x03920d (0xbc1b bytes) 000573 1787340272.137854 read 0x02246e thru 0x03176d (0xf300 bytes) 000576 1787340272.155081 MIRROR_RESYNC 3 mirrors 000577 1787340273.629082 MIRROR_RESYNC 3 mirrors 000578 1787340274.164234 mapread 0x0348b4 thru 0x03b56d (0x6cba bytes) 000579 1787340274.191170 trunc from 0x03f85f to 0x006c41 (0x38c1d bytes) 000581 1787340274.302946 mapwrite 0x03ed13 thru 0x03ffff (0x12ed bytes) 000582 1787340274.412638 read 0x01d650 thru 0x025c9b (0x864c bytes) 000584 1787340274.427977 read 0x02fc3f thru 0x038809 (0x8bcb bytes) 000585 1787340274.448076 mapwrite 0x03f347 thru 0x03ffff (0xcb9 bytes) 000588 1787340274.509879 MIRROR_RESYNC 3 mirrors 000589 1787340275.858041 trunc from 0x040000 to 0x029781 (0x1687e bytes) 000590 1787340275.954680 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29782): Mirror 3: 0x77f8964 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29782): Mirror 3: 0x77f8964 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29782: skipped 000592 1787340276.229271 read 0x0101e1 thru 0x013c41 (0x3a61 bytes) 000593 1787340276.235684 mapwrite 0x004f91 thru 0x00e7b4 (0x9824 bytes) 000594 1787340276.314731 mapwrite 0x0051c3 thru 0x009e2a (0x4c68 bytes) 000596 1787340276.370879 mapread 0x01ba67 thru 0x01d76e (0x1d08 bytes) 000598 1787340276.394162 write 0x029b8a thru 0x02e134 (0x45ab bytes) 000599 1787340276.401185 read 0x0160f2 thru 0x02169b (0xb5aa bytes) 000600 1787340276.402306 trunc from 0x02e135 to 0x033652 (0x551e bytes) 000604 1787340276.425194 read 0x002354 thru 0x005503 (0x31b0 bytes) 000605 1787340276.426682 read 0x019723 thru 0x01a2f5 (0xbd3 bytes) 000606 1787340276.427689 mapwrite 0x0114aa thru 0x012deb (0x1942 bytes) 000607 1787340276.484189 trunc from 0x033653 to 0x031e47 (0x180b bytes) 000609 1787340276.501860 mapwrite 0x013779 thru 0x02370b (0xff93 bytes) 000614 1787340276.563971 mapread 0x0225c1 thru 0x02d0fb (0xab3b bytes) 000615 1787340276.574925 read 0x007e64 thru 0x008ac5 (0xc62 bytes) 000616 1787340276.575744 trunc from 0x031e48 to 0x02f004 (0x2e43 bytes) 000617 1787340276.592002 mapwrite 0x00367c thru 0x00ed9d (0xb722 bytes) 000619 1787340276.650854 mapwrite 0x026503 thru 0x028bc0 (0x26be bytes) 000620 1787340276.701863 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f005): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f005): Mirror 3: 0x32f1115d (stale) CRC-32 checksum value for chunk [0, 0x2f005): Mirror 1: 0x6a5e52b0 Mirror 4: 0x6a5e52b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f005: skipped 000622 1787340278.197427 mapwrite 0x03a37c thru 0x03ffff (0x5c84 bytes) 000623 1787340278.428398 mapwrite 0x009658 thru 0x00ce86 (0x382f bytes) 000624 1787340278.555557 read 0x000b76 thru 0x010ab0 (0xff3b bytes) 000625 1787340278.566570 mapwrite 0x01e8c5 thru 0x01fa76 (0x11b2 bytes) 000626 1787340278.652986 mapread 0x000aa2 thru 0x0050a5 (0x4604 bytes) 000628 1787340278.654545 read 0x039873 thru 0x03ffff (0x678d bytes) 000629 1787340278.662827 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdd36ad78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdd36ad78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000631 1787340279.103720 read 0x01d08c thru 0x021de3 (0x4d58 bytes) 000632 1787340279.127093 MIRROR_RESYNC 2 mirrors 000633 1787340280.201732 MIRROR_RESYNC 2 mirrors 000634 1787340280.859009 write 0x01dc41 thru 0x02be72 (0xe232 bytes) 000635 1787340280.947733 mapread 0x038db3 thru 0x03ffff (0x724d bytes) 000636 1787340280.968036 trunc from 0x040000 to 0x00f190 (0x30e6f bytes) 000638 1787340281.003498 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000639 1787340281.137992 read 0x000c00 thru 0x001057 (0x458 bytes) 000640 1787340281.146551 write 0x03075d thru 0x0328ec (0x2190 bytes) 000641 1787340281.148512 trunc from 0x0328ed to 0x030220 (0x26cc bytes) 000642 1787340281.171521 read 0x01ed93 thru 0x02a823 (0xba91 bytes) 000643 1787340281.184914 trunc from 0x030221 to 0x02f1fa (0x1026 bytes) 000644 1787340281.209572 write 0x01f295 thru 0x021e0b (0x2b77 bytes) 000647 1787340281.213845 mapwrite 0x018ddf thru 0x01b5e3 (0x2805 bytes) 000648 1787340281.260817 write 0x00e7f1 thru 0x012cca (0x44da bytes) 000649 1787340281.262964 mapwrite 0x02c64f thru 0x03c3a5 (0xfd57 bytes) 000650 1787340281.338836 trunc from 0x03c3a6 to 0x0201ee (0x1c1b7 bytes) 000653 1787340281.365608 mapread 0x00d769 thru 0x01260a (0x4ea2 bytes) 000655 1787340281.367797 trunc from 0x0201ef to 0x03168b (0x1149d bytes) 000657 1787340281.384045 write 0x007dea thru 0x008039 (0x250 bytes) 000658 1787340281.385544 read 0x0300ae thru 0x03168b (0x15de bytes) 000659 1787340281.395090 mapwrite 0x03cb4e thru 0x03ffff (0x34b2 bytes) 000660 1787340281.492321 read 0x039a48 thru 0x03ffff (0x65b8 bytes) 000661 1787340281.495342 mapwrite 0x0397e4 thru 0x03ffff (0x681c bytes) 000664 1787340281.556568 mapread 0x01f2ed thru 0x02b02c (0xbd40 bytes) 000666 1787340281.558440 mapread 0x01a30a thru 0x020ca0 (0x6997 bytes) 000669 1787340281.562839 mapread 0x008f22 thru 0x0106d7 (0x77b6 bytes) 000670 1787340281.564649 read 0x01b6c6 thru 0x027f1c (0xc857 bytes) 000671 1787340281.565848 trunc from 0x040000 to 0x01512b (0x2aed4 bytes) 000672 1787340281.588733 read 0x010999 thru 0x01512b (0x4793 bytes) 000674 1787340281.592643 write 0x00744d thru 0x00bb8a (0x473e bytes) 000675 1787340281.593899 mapwrite 0x00bec9 thru 0x012916 (0x6a4e bytes) 000676 1787340281.641765 mapread 0x010601 thru 0x01512b (0x4b2b bytes) 000681 1787340281.646958 mapwrite 0x03bfc4 thru 0x03ffff (0x403c bytes) 000682 1787340281.723070 read 0x002640 thru 0x00ff12 (0xd8d3 bytes) 000684 1787340281.724527 mapwrite 0x0149b6 thru 0x01674d (0x1d98 bytes) 000685 1787340281.765592 write 0x027cf2 thru 0x02df11 (0x6220 bytes) 000687 1787340281.767385 read 0x025428 thru 0x031c05 (0xc7de bytes) 000689 1787340281.771593 read 0x0290a4 thru 0x02c277 (0x31d4 bytes) 000690 1787340281.772234 mapwrite 0x02e30d thru 0x038f2a (0xac1e bytes) 000691 1787340281.907359 trunc from 0x040000 to 0x006829 (0x397d6 bytes) 000693 1787340281.952967 write 0x02dcd1 thru 0x033be5 (0x5f15 bytes) 000694 1787340281.956756 mapread 0x00829f thru 0x00cbff (0x4961 bytes) 000695 1787340281.980201 mapwrite 0x0192a8 thru 0x028f03 (0xfc5c bytes) 000696 1787340282.094279 mapread 0x01110d thru 0x0175d6 (0x64ca bytes) 000698 1787340282.095774 mapread 0x00aa06 thru 0x0155fa (0xabf5 bytes) 000701 1787340282.099846 write 0x034643 thru 0x03e907 (0xa2c5 bytes) 000702 1787340282.105093 mapread 0x020c04 thru 0x0255dc (0x49d9 bytes) 000703 1787340282.110670 write 0x001c44 thru 0x00e0cd (0xc48a bytes) 000704 1787340282.117020 write 0x021ee6 thru 0x022ada (0xbf5 bytes) 000705 1787340282.119061 read 0x032a47 thru 0x03e907 (0xbec1 bytes) 000706 1787340282.121436 mapread 0x0141a4 thru 0x016fe9 (0x2e46 bytes) 000710 1787340282.135008 mapread 0x000533 thru 0x00d569 (0xd037 bytes) 000712 1787340282.145006 mapwrite 0x02c04f thru 0x02d572 (0x1524 bytes) 000714 1787340282.281951 read 0x0251bd thru 0x028371 (0x31b5 bytes) 000718 1787340282.288554 mapwrite 0x00ae39 thru 0x0140a1 (0x9269 bytes) 000720 1787340282.387841 trunc from 0x03e908 to 0x014e9e (0x29a69 bytes) 000724 1787340282.461630 write 0x00d040 thru 0x00e9bf (0x1980 bytes) 000725 1787340282.463703 trunc from 0x014e9f to 0x00a8f3 (0xa5ab bytes) 000730 1787340282.520420 read 0x000aab thru 0x005805 (0x4d5b bytes) 000731 1787340282.521518 mapwrite 0x002f01 thru 0x012c7b (0xfd7b bytes) 000732 1787340282.618474 mapread 0x006d4a thru 0x012c7b (0xbf32 bytes) 000733 1787340282.620599 mapread 0x0089c8 thru 0x00d9b3 (0x4fec bytes) 000737 1787340282.627659 mapwrite 0x00e9c7 thru 0x0168f2 (0x7f2c bytes) 000738 1787340282.772662 trunc from 0x0168f3 to 0x000bde (0x15d14 bytes) 000739 1787340282.813319 mapwrite 0x0308d9 thru 0x036c88 (0x63b0 bytes) 000740 1787340282.938658 write 0x02d3f3 thru 0x03bb52 (0xe760 bytes) 000742 1787340282.943666 read 0x020251 thru 0x0250d8 (0x4e88 bytes) 000744 1787340282.944933 read 0x031b30 thru 0x03bb52 (0xa023 bytes) 000746 1787340282.948321 trunc from 0x03bb53 to 0x032650 (0x9502 bytes) 000747 1787340282.965695 mapread 0x01b850 thru 0x02513e (0x98ef bytes) 000748 1787340282.967692 trunc from 0x032651 to 0x018287 (0x1a3c9 bytes) 000750 1787340282.984601 read 0x004fbd thru 0x00a6ff (0x5743 bytes) 000752 1787340282.995932 trunc from 0x018288 to 0x00d7fb (0xaa8c bytes) 000753 1787340283.012572 write 0x011e3b thru 0x01ca4e (0xac14 bytes) 000754 1787340283.016133 mapread 0x003032 thru 0x00636b (0x333a bytes) 000755 1787340283.017909 read 0x014712 thru 0x01a726 (0x6015 bytes) 000759 1787340283.025482 mapwrite 0x0168eb thru 0x01d341 (0x6a57 bytes) 000761 1787340283.099520 trunc from 0x01d342 to 0x03c160 (0x1ee1f bytes) 000762 1787340283.117537 mapwrite 0x003f06 thru 0x00e9c9 (0xaac4 bytes) 000763 1787340283.166641 mapread 0x003b57 thru 0x00b110 (0x75ba bytes) 000764 1787340283.168573 trunc from 0x03c161 to 0x003eb7 (0x382a9 bytes) 000765 1787340283.185551 read 0x000678 thru 0x003eb7 (0x3840 bytes) 000766 1787340283.187751 write 0x01048a thru 0x017d61 (0x78d8 bytes) 000767 1787340283.189892 write 0x03b382 thru 0x03ffff (0x4c7e bytes) 000769 1787340283.193626 trunc from 0x040000 to 0x03de8f (0x2170 bytes) 000770 1787340283.212994 mapread 0x02d95e thru 0x036542 (0x8be5 bytes) 000771 1787340283.224783 read 0x019928 thru 0x02701b (0xd6f4 bytes) 000772 1787340283.225647 write 0x01c173 thru 0x022dde (0x6c6c bytes) 000773 1787340283.227529 mapwrite 0x029c33 thru 0x039a33 (0xfe01 bytes) 000775 1787340283.334865 write 0x0132c8 thru 0x013935 (0x66e bytes) 000778 1787340283.343039 write 0x00451d thru 0x00c9dc (0x84c0 bytes) 000784 1787340283.370986 write 0x03634e thru 0x03fc41 (0x98f4 bytes) 000786 1787340283.380143 mapread 0x00d4df thru 0x01172b (0x424d bytes) 000788 1787340283.384996 read 0x001c3d thru 0x00ea47 (0xce0b bytes) 000791 1787340283.394543 read 0x0376e2 thru 0x03d5a0 (0x5ebf bytes) 000792 1787340283.395263 trunc from 0x03fc42 to 0x021346 (0x1e8fb bytes) 000793 1787340283.436551 MIRROR_EXTEND to 2 mirrors 000794 1787340284.491733 mapread 0x018bd3 thru 0x021346 (0x8774 bytes) 000796 1787340284.526510 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000797 1787340284.828817 read 0x014713 thru 0x01ead3 (0xa3c1 bytes) 000802 1787340284.861980 mapread 0x00a3f2 thru 0x01458a (0xa199 bytes) 000805 1787340284.901423 trunc from 0x021347 to 0x017113 (0xa233 bytes) 000806 1787340284.962058 trunc from 0x017114 to 0x00204f (0x150c4 bytes) 000807 1787340285.010796 trunc from 0x002050 to 0x03005d (0x2e00e bytes) 000809 1787340285.049423 read 0x0291f5 thru 0x02bc48 (0x2a54 bytes) 000810 1787340285.070467 trunc from 0x03005e to 0x00e991 (0x216cc bytes) 000811 1787340285.095054 write 0x017cf9 thru 0x01949b (0x17a3 bytes) 000812 1787340285.099078 mapread 0x003007 thru 0x00493b (0x1935 bytes) 000817 1787340285.115137 mapwrite 0x03dcb4 thru 0x03ffff (0x234c bytes) 000819 1787340285.278696 mapwrite 0x002ade thru 0x008827 (0x5d4a bytes) 000821 1787340285.349089 mapwrite 0x035bed thru 0x038a72 (0x2e86 bytes) 000823 1787340285.474022 trunc from 0x040000 to 0x00b5df (0x34a20 bytes) 000826 1787340285.508378 read 0x002c51 thru 0x00b5df (0x898f bytes) 000827 1787340285.509099 trunc from 0x00b5e0 to 0x033135 (0x27b56 bytes) 000831 1787340285.539979 mapread 0x016aae thru 0x023246 (0xc799 bytes) 000832 1787340285.556440 mapread 0x01704c thru 0x020124 (0x90d9 bytes) 000833 1787340285.557954 mapwrite 0x024c1d thru 0x030641 (0xba25 bytes) 000834 1787340285.608435 mapwrite 0x0017a0 thru 0x00ed7d (0xd5de bytes) 000835 1787340285.659675 mapread 0x025b28 thru 0x02ac2f (0x5108 bytes) 000836 1787340285.660740 mapread 0x02d22d thru 0x033135 (0x5f09 bytes) 000837 1787340285.661682 read 0x00a4a2 thru 0x00d252 (0x2db1 bytes) 000840 1787340285.664990 write 0x02f968 thru 0x0366a1 (0x6d3a bytes) 000841 1787340285.667412 read 0x0039e5 thru 0x00823a (0x4856 bytes) 000843 1787340285.669017 trunc from 0x0366a2 to 0x000c37 (0x35a6a bytes) 000844 1787340285.687750 read 0x000165 thru 0x000c37 (0xad3 bytes) 000847 1787340285.690985 trunc from 0x000c38 to 0x003b08 (0x2ed1 bytes) 000848 1787340285.710881 write 0x00cb48 thru 0x01123a (0x46f3 bytes) 000853 1787340285.718484 mapwrite 0x02919f thru 0x030a13 (0x7875 bytes) 000854 1787340285.868502 mapwrite 0x03b360 thru 0x03ffff (0x4ca0 bytes) 000856 1787340285.969092 mapread 0x03dd56 thru 0x03ffff (0x22aa bytes) 000859 1787340285.989628 MIRROR_EXTEND to 2 mirrors 000862 1787340287.291761 read 0x01fab1 thru 0x02a83a (0xad8a bytes) 000863 1787340287.300310 read 0x039324 thru 0x03e2f8 (0x4fd5 bytes) 000864 1787340287.312542 mapwrite 0x03668a thru 0x03e048 (0x79bf bytes) 000865 1787340287.494718 mapwrite 0x03e152 thru 0x03ffff (0x1eae bytes) 000866 1787340287.536004 mapread 0x03be20 thru 0x03ffff (0x41e0 bytes) 000867 1787340287.537953 mapread 0x038b91 thru 0x03ffff (0x746f bytes) 000868 1787340287.544472 MIRROR_RESYNC 2 mirrors 000870 1787340288.594722 write 0x00e8b7 thru 0x016f46 (0x8690 bytes) 000871 1787340288.671421 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6e8cf47a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb72df0f0 Mirror 3: 0xb72df0f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000872 1787340290.213710 read 0x0009a3 thru 0x00f769 (0xedc7 bytes) 000875 1787340290.270060 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6e8cf47a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb72df0f0 Mirror 3: 0xb72df0f0 Mirror 4: 0xb72df0f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000876 1787340291.139991 mapwrite 0x00f9f4 thru 0x017098 (0x76a5 bytes) 000877 1787340291.346623 trunc from 0x040000 to 0x03395b (0xc6a4 bytes) 000878 1787340291.369748 read 0x019775 thru 0x028d06 (0xf592 bytes) 000881 1787340291.398153 MIRROR_RESYNC 4 mirrors 000882 1787340293.192800 read 0x02a560 thru 0x03395b (0x93fc bytes) 000883 1787340293.202631 mapwrite 0x020062 thru 0x021308 (0x12a7 bytes) 000884 1787340293.352924 mapread 0x021763 thru 0x023ef1 (0x278f bytes) 000886 1787340293.356561 trunc from 0x03395c to 0x02fca0 (0x3cbb bytes) 000888 1787340293.390705 mapwrite 0x0118c9 thru 0x018758 (0x6e90 bytes) 000889 1787340293.498905 trunc from 0x02fca1 to 0x0249c9 (0xb2d7 bytes) 000890 1787340293.526929 mapwrite 0x033273 thru 0x03e80b (0xb599 bytes) 000892 1787340293.633691 mapwrite 0x02b566 thru 0x033f71 (0x8a0c bytes) 000893 1787340293.681323 write 0x0309cd thru 0x03bce3 (0xb317 bytes) 000894 1787340293.682692 mapread 0x01d633 thru 0x01ef22 (0x18f0 bytes) 000895 1787340293.688301 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e80c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e80c): Mirror 2: 0x48e3ce30 (stale) Mirror 3: 0x48e3ce30 (stale) Mirror 4: 0x48e3ce30 (stale) CRC-32 checksum value for chunk [0, 0x3e80c): Mirror 1: 0xa6e4a53 Mirror 5: 0xa6e4a53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e80c: skipped 000896 1787340295.190614 mapread 0x026255 thru 0x02affa (0x4da6 bytes) 000897 1787340295.302631 trunc from 0x03e80c to 0x0017db (0x3d030 bytes) 000898 1787340295.427815 mapread 0x000363 thru 0x0017db (0x1479 bytes) 000900 1787340295.435551 read 0x001639 thru 0x001796 (0x15e bytes) 000905 1787340295.439861 read 0x00168c thru 0x0017db (0x150 bytes) 000906 1787340295.441422 read 0x001035 thru 0x0017db (0x7a7 bytes) 000907 1787340295.449474 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17dc): Mirror 2: 0x479394b4 (stale) Mirror 4: 0x479394b4 (stale) Mirror 5: 0x479394b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17dc): Mirror 2: 0x479394b4 (stale) Mirror 4: 0x479394b4 (stale) Mirror 5: 0x479394b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17dc: skipped 000910 1787340295.812449 mapwrite 0x00b2a8 thru 0x016b69 (0xb8c2 bytes) 000911 1787340295.908268 mapwrite 0x034d38 thru 0x035575 (0x83e bytes) 000913 1787340295.989845 MIRROR_RESYNC 4 mirrors 000914 1787340297.199254 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000915 1787340297.492631 mapwrite 0x00f7e2 thru 0x01f099 (0xf8b8 bytes) 000916 1787340297.715076 mapwrite 0x0255b4 thru 0x02a64f (0x509c bytes) 000918 1787340297.782182 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35576): Mirror 5: 0x34999f55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35576): Mirror 5: 0x34999f55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35576: skipped 000920 1787340298.060441 trunc from 0x035576 to 0x02d1ba (0x83bb bytes) 000922 1787340298.087781 write 0x016648 thru 0x02538b (0xed44 bytes) 000923 1787340298.098774 trunc from 0x02d1bb to 0x0005a3 (0x2cc17 bytes) 000925 1787340298.120561 mapread 0x000409 thru 0x0005a3 (0x19b bytes) 000926 1787340298.130566 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000928 1787340298.266854 trunc from 0x0005a4 to 0x037619 (0x37076 bytes) 000929 1787340298.285336 mapread 0x021b85 thru 0x02d738 (0xbbb4 bytes) 000932 1787340298.312577 mapread 0x02f294 thru 0x037619 (0x8386 bytes) 000933 1787340298.319667 read 0x011ea6 thru 0x017b09 (0x5c64 bytes) 000935 1787340298.332813 MIRROR_EXTEND to 2 mirrors 000936 1787340299.100900 mapwrite 0x00ec45 thru 0x01b990 (0xcd4c bytes) 000937 1787340299.333304 mapwrite 0x00bc0e thru 0x00d0f3 (0x14e6 bytes) 000939 1787340299.373218 write 0x00ee5e thru 0x019f43 (0xb0e6 bytes) 000940 1787340299.382516 MIRROR_RESYNC 2 mirrors 000941 1787340300.610672 read 0x011a34 thru 0x019414 (0x79e1 bytes) 000942 1787340300.619566 mapwrite 0x003844 thru 0x011d54 (0xe511 bytes) 000943 1787340300.783702 write 0x0317df thru 0x033a7b (0x229d bytes) 000947 1787340300.797685 read 0x022501 thru 0x02b5a3 (0x90a3 bytes) 000949 1787340300.814354 trunc from 0x03761a to 0x033cfd (0x391c bytes) 000951 1787340300.844360 MIRROR_RESYNC 2 mirrors 000952 1787340301.807134 trunc from 0x033cfe to 0x0286cf (0xb62e bytes) 000953 1787340301.969076 trunc from 0x0286d0 to 0x037995 (0xf2c6 bytes) 000954 1787340301.996301 mapwrite 0x0074d4 thru 0x00e9df (0x750c bytes) 000955 1787340302.067517 read 0x0017d0 thru 0x004de4 (0x3615 bytes) 000957 1787340302.077672 mapread 0x035895 thru 0x037995 (0x2101 bytes) 000958 1787340302.090257 mapread 0x00a45e thru 0x018a05 (0xe5a8 bytes) 000960 1787340302.099861 mapwrite 0x03f052 thru 0x03ffff (0xfae bytes) 000961 1787340302.177212 MIRROR_RESYNC 2 mirrors 000962 1787340303.224961 trunc from 0x040000 to 0x03787b (0x8784 bytes) 000963 1787340303.335348 trunc from 0x03787c to 0x023de4 (0x13a97 bytes) 000965 1787340303.356640 trunc from 0x023de5 to 0x01ba82 (0x8362 bytes) 000967 1787340303.371903 read 0x002ebd thru 0x006713 (0x3857 bytes) 000969 1787340303.382077 trunc from 0x01ba83 to 0x00f2e4 (0xc79e bytes) 000970 1787340303.403559 MIRROR_RESYNC 2 mirrors 000972 1787340304.329844 write 0x01cd8c thru 0x021308 (0x457d bytes) 000973 1787340304.388318 read 0x01c090 thru 0x021308 (0x5279 bytes) 000974 1787340304.389324 read 0x0017e4 thru 0x00f3d5 (0xdbf2 bytes) 000975 1787340304.400272 write 0x0046aa thru 0x00a779 (0x60d0 bytes) 000976 1787340304.405651 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000977 1787340304.565507 mapread 0x00d455 thru 0x01c5b5 (0xf161 bytes) 000980 1787340304.598098 write 0x02a857 thru 0x0330a7 (0x8851 bytes) 000981 1787340304.601975 mapread 0x02e7ac thru 0x0330a7 (0x48fc bytes) 000982 1787340304.603301 mapwrite 0x02f356 thru 0x02fae7 (0x792 bytes) 000983 1787340304.655166 read 0x00bcbb thru 0x0187db (0xcb21 bytes) 000984 1787340304.655871 mapwrite 0x036118 thru 0x03ba5c (0x5945 bytes) 000985 1787340304.730615 mapwrite 0x01bcbb thru 0x028597 (0xc8dd bytes) 000987 1787340304.808625 write 0x021a18 thru 0x028d1e (0x7307 bytes) 000988 1787340304.810707 trunc from 0x03ba5d to 0x028aaf (0x12fad bytes) 000990 1787340304.835937 read 0x0175f2 thru 0x01baaf (0x44be bytes) 000991 1787340304.837442 read 0x00ef4a thru 0x01afdc (0xc093 bytes) 000992 1787340304.839916 mapread 0x00b154 thru 0x00bdd7 (0xc84 bytes) 000994 1787340304.842646 mapwrite 0x01431a thru 0x01a008 (0x5cef bytes) 000997 1787340304.913205 mapwrite 0x02a10d thru 0x030550 (0x6444 bytes) 000998 1787340305.013340 MIRROR_EXTEND to 2 mirrors All operations completed A-OK!