== sanity-flr test 70a: flr mode fsx test ================ 05:23:04 (1788600184) Seed set to 186 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x25b0e 000003 1788600187.125869 trunc from 00000000 to 0x025b0d (0x25b0e bytes) 000004 1788600187.170964 mapwrite 0x003c07 thru 0x0058bf (0x1cb9 bytes) 000008 1788600187.280796 mapwrite 0x03f6e0 thru 0x03ffff (0x920 bytes) 000009 1788600187.435396 trunc from 0x040000 to 0x0138b4 (0x2c74b bytes) 000010 1788600187.466240 read 0x00195f thru 0x004bf5 (0x3297 bytes) 000011 1788600187.467362 mapwrite 0x037aa0 thru 0x03ba78 (0x3fd9 bytes) 000013 1788600187.574615 read 0x035bb2 thru 0x03ba78 (0x5ec7 bytes) 000014 1788600187.575344 mapwrite 0x030050 thru 0x03fc7a (0xfc2b bytes) 000018 1788600187.676797 write 0x01df42 thru 0x02495c (0x6a1b bytes) truncating to largest ever: 0x2c0a7 000024 1788600187.686600 trunc from 0x03fc7b to 0x02c0a6 (0x13bd4 bytes) truncating to largest ever: 0x3af52 000027 1788600187.714633 trunc from 0x02c0a7 to 0x03af51 (0xeeab bytes) 000029 1788600187.737964 trunc from 0x03af52 to 0x00c58d (0x2e9c4 bytes) 000030 1788600187.759986 mapwrite 0x0300c3 thru 0x03e264 (0xe1a2 bytes) 000031 1788600187.952850 read 0x001699 thru 0x006e95 (0x57fd bytes) 000035 1788600187.956655 mapwrite 0x0331d3 thru 0x0357d7 (0x2605 bytes) 000037 1788600188.001197 read 0x0011a8 thru 0x00ad44 (0x9b9d bytes) 000039 1788600188.006926 write 0x02c5c1 thru 0x0317ed (0x522d bytes) 000040 1788600188.032252 trunc from 0x03e265 to 0x0250ad (0x191b7 bytes) 000041 1788600188.083047 mapread 0x01714f thru 0x01fe2b (0x8cdd bytes) 000042 1788600188.094278 MIRROR_EXTEND to 2 mirrors 000043 1788600188.975524 mapwrite 0x01d583 thru 0x023da4 (0x6822 bytes) 000044 1788600189.160259 read 0x00f0da thru 0x00f77f (0x6a6 bytes) 000045 1788600189.168390 mapread 0x0172b1 thru 0x01cb1f (0x586f bytes) 000046 1788600189.169759 read 0x0096f5 thru 0x019314 (0xfc20 bytes) 000048 1788600189.186398 write 0x00e4e9 thru 0x01c626 (0xe13e bytes) 000049 1788600189.191415 read 0x0120d1 thru 0x0210a1 (0xefd1 bytes) 000050 1788600189.192625 write 0x033cb9 thru 0x0366be (0x2a06 bytes) 000052 1788600189.202766 MIRROR_RESYNC 2 mirrors 000057 1788600190.078169 read 0x0047d5 thru 0x007370 (0x2b9c bytes) 000060 1788600190.089068 read 0x022922 thru 0x02d5f2 (0xacd1 bytes) 000062 1788600190.103174 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000064 1788600190.235781 read 0x003a44 thru 0x004fbb (0x1578 bytes) 000066 1788600190.243481 mapwrite 0x0345d4 thru 0x036a8f (0x24bc bytes) 000071 1788600190.464868 mapwrite 0x025765 thru 0x02994d (0x41e9 bytes) 000074 1788600190.586993 mapwrite 0x00353e thru 0x00c640 (0x9103 bytes) 000075 1788600190.721612 read 0x01e39c thru 0x023ca3 (0x5908 bytes) 000078 1788600190.723783 mapread 0x024ed0 thru 0x032963 (0xda94 bytes) 000079 1788600190.739214 trunc from 0x036a90 to 0x02ba73 (0xb01c bytes) 000081 1788600190.756751 mapread 0x0264bb thru 0x02ba73 (0x55b9 bytes) 000083 1788600190.771931 MIRROR_EXTEND to 2 mirrors 000085 1788600191.777518 mapread 0x0012af thru 0x0091ae (0x7f00 bytes) 000087 1788600191.874667 write 0x00670b thru 0x008cb3 (0x25a9 bytes) 000088 1788600192.081095 trunc from 0x02ba74 to 0x026d3d (0x4d36 bytes) 000089 1788600192.125085 write 0x0219a9 thru 0x02f030 (0xd688 bytes) 000091 1788600192.165635 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x3be6b 000092 1788600192.969500 trunc from 0x02f031 to 0x03be6a (0xce3a bytes) truncating to largest ever: 0x3c472 000093 1788600193.037412 trunc from 0x03be6b to 0x03c471 (0x607 bytes) 000095 1788600193.060508 write 0x035152 thru 0x03bed9 (0x6d88 bytes) 000096 1788600193.071865 write 0x039dca thru 0x03ffff (0x6236 bytes) 000097 1788600193.073107 mapread 0x03bdb2 thru 0x03ffff (0x424e bytes) 000098 1788600193.074140 mapwrite 0x011535 thru 0x01a974 (0x9440 bytes) 000099 1788600193.218564 trunc from 0x040000 to 0x0370a0 (0x8f5f bytes) 000100 1788600193.285649 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x370a1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x370a1): Mirror 2: 0xa2a282de (stale) CRC-32 checksum value for chunk [0, 0x370a1): Mirror 1: 0xcda241f0 Mirror 3: 0xcda241f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x370a1: skipped 000101 1788600194.221964 trunc from 0x0370a1 to 0x02d9da (0x96c6 bytes) 000102 1788600194.312724 write 0x013dc8 thru 0x01b473 (0x76ac bytes) 000103 1788600194.323042 mapread 0x021515 thru 0x027bee (0x66da bytes) 000106 1788600194.335778 mapwrite 0x017c98 thru 0x0207a9 (0x8b12 bytes) 000107 1788600194.382649 trunc from 0x02d9db to 0x01f6de (0xe2fc bytes) 000109 1788600194.427772 MIRROR_RESYNC 3 mirrors 000110 1788600195.268624 read 0x00d95c thru 0x0180bd (0xa762 bytes) 000111 1788600195.280751 mapread 0x003f39 thru 0x0074b8 (0x3580 bytes) 000112 1788600195.322184 MIRROR_RESYNC 3 mirrors 000113 1788600195.759738 write 0x001f47 thru 0x011eb0 (0xff6a bytes) 000115 1788600195.910626 mapread 0x01d3d5 thru 0x01f6de (0x230a bytes) 000116 1788600195.939142 mapread 0x004358 thru 0x007f27 (0x3bd0 bytes) 000117 1788600195.940248 mapread 0x0023a2 thru 0x002cba (0x919 bytes) 000120 1788600195.957424 mapread 0x01cc51 thru 0x01f6de (0x2a8e bytes) 000122 1788600195.967239 read 0x002657 thru 0x0070f7 (0x4aa1 bytes) 000123 1788600195.968298 mapwrite 0x0201f9 thru 0x021c41 (0x1a49 bytes) 000124 1788600196.261718 write 0x035f82 thru 0x03ffff (0xa07e bytes) 000126 1788600196.267964 mapread 0x01a5a8 thru 0x01e948 (0x43a1 bytes) 000127 1788600196.275394 mapwrite 0x0330e8 thru 0x03b85d (0x8776 bytes) 000131 1788600196.549525 trunc from 0x040000 to 0x00142b (0x3ebd4 bytes) 000132 1788600196.621766 write 0x03fb1c thru 0x03ffff (0x4e4 bytes) 000133 1788600196.622920 mapread 0x03a833 thru 0x03ffff (0x57cd bytes) 000134 1788600196.655517 trunc from 0x040000 to 0x0027da (0x3d825 bytes) 000135 1788600196.706130 write 0x02d16d thru 0x03ccc2 (0xfb56 bytes) 000137 1788600196.708411 write 0x03c477 thru 0x03ffff (0x3b89 bytes) 000138 1788600196.715855 trunc from 0x040000 to 0x01d510 (0x22aef bytes) 000140 1788600196.761211 write 0x00ff6c thru 0x01d3d9 (0xd46e bytes) 000143 1788600196.814260 mapread 0x00e69d thru 0x015035 (0x6999 bytes) 000144 1788600196.816419 mapread 0x00a573 thru 0x0147ac (0xa23a bytes) 000147 1788600196.828234 mapread 0x016b96 thru 0x017313 (0x77e bytes) 000149 1788600196.832765 mapread 0x00ede3 thru 0x00fb50 (0xd6e bytes) 000151 1788600196.836698 trunc from 0x01d511 to 0x0236f7 (0x61e7 bytes) 000153 1788600196.871367 trunc from 0x0236f8 to 0x00a442 (0x192b5 bytes) 000154 1788600196.914057 mapread 0x00301c thru 0x00a442 (0x7427 bytes) 000155 1788600196.950036 MIRROR_RESYNC 3 mirrors 000156 1788600198.402852 mapwrite 0x03eaa1 thru 0x03ffff (0x155f bytes) 000157 1788600198.573489 write 0x004d3c thru 0x00bd33 (0x6ff8 bytes) 000158 1788600198.590374 write 0x00aef9 thru 0x012494 (0x759c bytes) 000159 1788600198.604851 mapwrite 0x01be74 thru 0x01d341 (0x14ce bytes) 000161 1788600198.786734 write 0x00197f thru 0x0096e5 (0x7d67 bytes) 000162 1788600198.789127 trunc from 0x040000 to 0x034e83 (0xb17c bytes) 000163 1788600198.850037 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34e84): Mirror 2: 0x6025b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e84): Mirror 2: 0x6025b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e84: skipped 000166 1788600199.192148 read 0x00df46 thru 0x01310c (0x51c7 bytes) 000167 1788600199.206019 read 0x0203ca thru 0x024da1 (0x49d8 bytes) 000172 1788600199.224728 read 0x021972 thru 0x024d42 (0x33d1 bytes) 000173 1788600199.229270 trunc from 0x034e84 to 0x018f05 (0x1bf7e bytes) 000174 1788600199.258499 read 0x00f55c thru 0x00f5bc (0x61 bytes) 000175 1788600199.260115 write 0x035e21 thru 0x03def5 (0x80d5 bytes) 000181 1788600199.270408 trunc from 0x03def6 to 0x01e3ad (0x1fb48 bytes) 000183 1788600199.293243 trunc from 0x01e3ae to 0x01c5f9 (0x1db4 bytes) 000184 1788600199.356851 MIRROR_RESYNC 2 mirrors 000185 1788600200.181497 trunc from 0x01c5fa to 0x0001a0 (0x1c459 bytes) 000186 1788600200.323494 trunc from 0x0001a1 to 0x0319f5 (0x31855 bytes) 000187 1788600200.354347 read 0x014ef1 thru 0x01f806 (0xa916 bytes) 000188 1788600200.364168 trunc from 0x0319f6 to 0x0334e3 (0x1aee bytes) 000191 1788600200.384389 trunc from 0x0334e4 to 0x01a869 (0x18c7a bytes) 000192 1788600200.420484 mapread 0x00f12a thru 0x015620 (0x64f7 bytes) 000193 1788600200.437924 mapwrite 0x03e2f0 thru 0x03ffff (0x1d10 bytes) 000200 1788600200.518385 trunc from 0x040000 to 0x013f34 (0x2c0cb bytes) 000203 1788600200.541842 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000205 1788600200.700638 write 0x00ca11 thru 0x013c64 (0x7254 bytes) 000207 1788600200.716027 mapwrite 0x02dca9 thru 0x030f57 (0x32af bytes) 000208 1788600200.789274 read 0x02cb3c thru 0x030f57 (0x441c bytes) 000209 1788600200.790316 mapread 0x00f711 thru 0x011613 (0x1f03 bytes) 000210 1788600200.792521 mapwrite 0x033639 thru 0x03c7e1 (0x91a9 bytes) 000212 1788600200.869104 trunc from 0x03c7e2 to 0x037331 (0x54b0 bytes) 000213 1788600200.888297 read 0x0179c6 thru 0x01e89f (0x6eda bytes) 000214 1788600200.897633 write 0x0394d3 thru 0x03ffff (0x6b2d bytes) 000216 1788600200.907064 MIRROR_EXTEND to 2 mirrors 000217 1788600201.597619 read 0x01697d thru 0x017852 (0xed6 bytes) 000218 1788600201.635243 MIRROR_EXTEND to 3 mirrors 000220 1788600202.433966 write 0x00433c thru 0x008c39 (0x48fe bytes) 000221 1788600202.563164 trunc from 0x040000 to 0x009166 (0x36e99 bytes) 000222 1788600202.598787 mapread 0x0051ee thru 0x009166 (0x3f79 bytes) 000223 1788600202.606297 read 0x001b3a thru 0x007283 (0x574a bytes) 000225 1788600202.615052 mapread 0x007ada thru 0x009166 (0x168d bytes) 000226 1788600202.616154 read 0x008c7f thru 0x009166 (0x4e8 bytes) 000227 1788600202.616976 mapread 0x004923 thru 0x006b2c (0x220a bytes) 000228 1788600202.617894 mapwrite 0x0238de thru 0x028990 (0x50b3 bytes) 000229 1788600202.675639 mapread 0x0277cf thru 0x028990 (0x11c2 bytes) 000231 1788600202.677038 mapwrite 0x01b537 thru 0x01c716 (0x11e0 bytes) 000233 1788600202.729830 mapread 0x01be7e thru 0x02204f (0x61d2 bytes) 000234 1788600202.731081 trunc from 0x028991 to 0x0301e1 (0x7851 bytes) 000235 1788600202.750990 mapwrite 0x01f36e thru 0x020c86 (0x1919 bytes) 000236 1788600202.800812 read 0x018fb2 thru 0x01d5ee (0x463d bytes) 000237 1788600202.801882 mapread 0x02e31b thru 0x0301e1 (0x1ec7 bytes) 000238 1788600202.812136 mapread 0x027f07 thru 0x02c971 (0x4a6b bytes) 000239 1788600202.813844 read 0x008728 thru 0x016f92 (0xe86b bytes) 000245 1788600202.819397 write 0x0052de thru 0x00d9cb (0x86ee bytes) 000248 1788600202.823022 read 0x01a835 thru 0x01e8d8 (0x40a4 bytes) 000249 1788600202.824620 mapread 0x001ee3 thru 0x00d9c5 (0xbae3 bytes) 000250 1788600202.826416 read 0x02e83c thru 0x0301e1 (0x19a6 bytes) 000252 1788600202.827784 trunc from 0x0301e2 to 0x02ff8c (0x255 bytes) 000253 1788600202.857992 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff8d): Mirror 3: 0x4698bbc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff8d): Mirror 3: 0x4698bbc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff8d: skipped 000255 1788600203.120609 write 0x0016c1 thru 0x004d83 (0x36c3 bytes) 000256 1788600203.130637 mapwrite 0x011709 thru 0x01ad01 (0x95f9 bytes) 000257 1788600203.191759 read 0x00e780 thru 0x01a576 (0xbdf7 bytes) 000258 1788600203.192514 read 0x0146af thru 0x01b4b0 (0x6e02 bytes) 000259 1788600203.193421 write 0x032fa9 thru 0x03e1b9 (0xb211 bytes) 000261 1788600203.196384 mapwrite 0x03999c thru 0x03ffff (0x6664 bytes) 000262 1788600203.261335 mapread 0x001bcb thru 0x004b24 (0x2f5a bytes) 000263 1788600203.262594 trunc from 0x040000 to 0x0189bf (0x27640 bytes) 000264 1788600203.276782 read 0x016cff thru 0x0189bf (0x1cc1 bytes) 000265 1788600203.277527 read 0x01162a thru 0x0189bf (0x7396 bytes) 000266 1788600203.279191 write 0x01b783 thru 0x025c38 (0xa4b6 bytes) 000267 1788600203.281958 mapwrite 0x022220 thru 0x02a6bb (0x849c bytes) 000269 1788600203.368968 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a6bc): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a6bc): Mirror 3: 0x540b9f1d (stale) CRC-32 checksum value for chunk [0, 0x2a6bc): Mirror 1: 0x2a5169ef Mirror 4: 0x2a5169ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a6bc: skipped 000273 1788600203.977106 MIRROR_RESYNC 3 mirrors 000274 1788600204.741650 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000275 1788600205.128094 MIRROR_RESYNC 2 mirrors 000277 1788600205.557362 read 0x01fe70 thru 0x0223ab (0x253c bytes) 000278 1788600205.574188 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000280 1788600205.708165 trunc from 0x02a6bc to 0x02d230 (0x2b75 bytes) 000286 1788600205.745183 mapread 0x012e15 thru 0x01ec8b (0xbe77 bytes) 000287 1788600205.772565 mapwrite 0x031f27 thru 0x03ea8b (0xcb65 bytes) 000288 1788600205.902361 write 0x01fb5c thru 0x02a0a4 (0xa549 bytes) 000289 1788600205.903669 write 0x007ac2 thru 0x00b81b (0x3d5a bytes) 000294 1788600205.925222 mapwrite 0x031b99 thru 0x032789 (0xbf1 bytes) 000295 1788600206.021216 mapread 0x035383 thru 0x03ea8b (0x9709 bytes) 000296 1788600206.022341 read 0x021cd0 thru 0x02533f (0x3670 bytes) 000298 1788600206.024754 trunc from 0x03ea8c to 0x03b5af (0x34dc bytes) 000300 1788600206.073390 MIRROR_EXTEND to 2 mirrors 000303 1788600207.151577 write 0x000e06 thru 0x001b5c (0xd57 bytes) 000304 1788600207.240199 read 0x00f355 thru 0x01875f (0x940b bytes) 000305 1788600207.247660 read 0x023850 thru 0x024d29 (0x14da bytes) 000306 1788600207.258283 write 0x00d1d7 thru 0x016478 (0x92a2 bytes) 000307 1788600207.259497 write 0x00c5e8 thru 0x013cb3 (0x76cc bytes) 000309 1788600207.261923 write 0x03bd8d thru 0x03d893 (0x1b07 bytes) 000310 1788600207.268407 MIRROR_RESYNC 2 mirrors 000311 1788600207.821134 mapread 0x006f4c thru 0x00ec8f (0x7d44 bytes) 000312 1788600207.847114 mapread 0x0035de thru 0x00add8 (0x77fb bytes) 000314 1788600207.850432 mapwrite 0x0058ab thru 0x0071f6 (0x194c bytes) 000318 1788600208.128261 mapread 0x008657 thru 0x00be86 (0x3830 bytes) 000319 1788600208.138222 write 0x014eea thru 0x01dbff (0x8d16 bytes) 000320 1788600208.160879 read 0x006d95 thru 0x00e805 (0x7a71 bytes) 000321 1788600208.170058 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d894): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d894): Mirror 2: 0x96f8057c (stale) CRC-32 checksum value for chunk [0, 0x3d894): Mirror 1: 0x2b4cd13f Mirror 3: 0x2b4cd13f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d894: skipped 000324 1788600208.939751 mapwrite 0x012192 thru 0x01dc0a (0xba79 bytes) 000325 1788600209.269230 write 0x0360ef thru 0x03e428 (0x833a bytes) 000326 1788600209.284648 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e429): Mirror 3: 0x1275075c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e429): Mirror 3: 0x1275075c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e429: skipped 000327 1788600209.692137 mapwrite 0x008aaa thru 0x00e1f3 (0x574a bytes) 000328 1788600209.773898 mapread 0x02db13 thru 0x03501d (0x750b bytes) 000329 1788600209.789382 write 0x03cd06 thru 0x03fa38 (0x2d33 bytes) 000330 1788600209.799482 read 0x03e2d3 thru 0x03fa38 (0x1766 bytes) 000331 1788600209.800197 mapwrite 0x03dae5 thru 0x03ffff (0x251b bytes) 000333 1788600209.928487 read 0x032b45 thru 0x03ffff (0xd4bb bytes) 000334 1788600209.929272 write 0x00d30a thru 0x0120d6 (0x4dcd bytes) 000335 1788600209.932399 trunc from 0x040000 to 0x017181 (0x28e7e bytes) 000336 1788600209.959268 mapwrite 0x033a5c thru 0x03cf1a (0x94bf bytes) 000340 1788600210.052004 MIRROR_RESYNC 2 mirrors 000342 1788600210.668742 write 0x011486 thru 0x017fde (0x6b59 bytes) 000344 1788600210.730989 mapwrite 0x004bb2 thru 0x00b3ae (0x67fd bytes) 000346 1788600210.798454 read 0x00049a thru 0x0097fe (0x9365 bytes) 000348 1788600210.810702 MIRROR_RESYNC 2 mirrors 000351 1788600211.535195 MIRROR_EXTEND to 3 mirrors 000353 1788600212.489467 write 0x0151b7 thru 0x01ce93 (0x7cdd bytes) 000354 1788600212.690703 trunc from 0x03cf1b to 0x013f7e (0x28f9c bytes) 000355 1788600212.722147 mapread 0x00cc7c thru 0x013f7e (0x7303 bytes) 000356 1788600212.733649 mapread 0x00e6da thru 0x013f7e (0x58a5 bytes) 000357 1788600212.736422 write 0x002534 thru 0x00a5c8 (0x8095 bytes) 000358 1788600212.755623 MIRROR_RESYNC 3 mirrors 000359 1788600213.804724 MIRROR_RESYNC 3 mirrors 000360 1788600214.500264 mapread 0x003780 thru 0x00b107 (0x7988 bytes) 000361 1788600214.533911 trunc from 0x013f7f to 0x000b33 (0x1344b bytes) 000362 1788600214.698381 mapwrite 0x00b2f1 thru 0x016ebe (0xbbce bytes) 000366 1788600214.844316 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16ebf): Mirror 4: 0xf73d6e84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16ebf): Mirror 4: 0xf73d6e84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16ebf: skipped 000367 1788600215.290885 mapread 0x001a33 thru 0x00d299 (0xb867 bytes) 000368 1788600215.333123 MIRROR_RESYNC 2 mirrors 000369 1788600216.328159 trunc from 0x016ebf to 0x01b226 (0x4368 bytes) 000370 1788600216.484441 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000372 1788600216.680733 write 0x02e8e2 thru 0x03de3e (0xf55d bytes) 000373 1788600216.692093 mapwrite 0x016a3f thru 0x01f0af (0x8671 bytes) 000374 1788600216.793962 write 0x021c63 thru 0x023f50 (0x22ee bytes) 000375 1788600216.819332 trunc from 0x03de3f to 0x0079dd (0x36461 bytes) 000376 1788600216.844938 read 0x000f95 thru 0x0079dd (0x6a49 bytes) 000378 1788600216.853913 mapread 0x002d81 thru 0x0079dd (0x4c5d bytes) 000379 1788600216.855129 mapwrite 0x00caa2 thru 0x019648 (0xcba7 bytes) 000380 1788600216.967156 read 0x00e23b thru 0x019648 (0xb40e bytes) 000382 1788600216.971971 mapwrite 0x0200eb thru 0x021add (0x19f3 bytes) 000383 1788600217.166979 mapwrite 0x0048e4 thru 0x00f5e6 (0xad03 bytes) 000384 1788600217.244705 trunc from 0x021ade to 0x00f2c0 (0x1281d bytes) 000387 1788600217.272836 mapwrite 0x02141a thru 0x023507 (0x20ee bytes) 000388 1788600217.377930 trunc from 0x023508 to 0x02e4ba (0xafb3 bytes) 000390 1788600217.409082 write 0x00ec90 thru 0x015303 (0x6674 bytes) 000393 1788600217.440309 read 0x00429d thru 0x006600 (0x2364 bytes) 000395 1788600217.442236 mapread 0x005493 thru 0x00b0b9 (0x5c27 bytes) 000396 1788600217.445222 trunc from 0x02e4bb to 0x030c86 (0x27cc bytes) 000397 1788600217.464217 write 0x0352fb thru 0x03ea42 (0x9748 bytes) 000398 1788600217.476017 MIRROR_EXTEND to 2 mirrors 000399 1788600218.632901 write 0x01a275 thru 0x022a59 (0x87e5 bytes) 000400 1788600218.739502 mapread 0x02550e thru 0x029e71 (0x4964 bytes) 000401 1788600218.756207 read 0x03418e thru 0x03ea42 (0xa8b5 bytes) 000402 1788600218.764977 trunc from 0x03ea43 to 0x00ead2 (0x2ff70 bytes) 000404 1788600218.790293 mapwrite 0x0132f4 thru 0x01a2e1 (0x6fee bytes) 000405 1788600218.889381 mapwrite 0x0123ea thru 0x0126f1 (0x308 bytes) 000406 1788600218.963980 write 0x011742 thru 0x013f23 (0x27e2 bytes) 000408 1788600218.974457 read 0x016eb0 thru 0x01a2e1 (0x3432 bytes) 000409 1788600218.978032 read 0x015fc3 thru 0x01a2e1 (0x431f bytes) 000411 1788600218.984160 mapwrite 0x0030f2 thru 0x00a0ad (0x6fbc bytes) 000412 1788600219.171089 write 0x02f079 thru 0x03d591 (0xe519 bytes) 000413 1788600219.172835 write 0x02e755 thru 0x039887 (0xb133 bytes) 000414 1788600219.202694 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d592): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d592): Mirror 2: 0x8ec07fb9 (stale) CRC-32 checksum value for chunk [0, 0x3d592): Mirror 1: 0xf56644d9 Mirror 3: 0xf56644d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d592: skipped 000415 1788600220.807256 write 0x01f98c thru 0x02a40e (0xaa83 bytes) 000416 1788600220.978867 read 0x00ac67 thru 0x0164b5 (0xb84f bytes) 000418 1788600220.996498 mapread 0x03077f thru 0x0379df (0x7261 bytes) 000419 1788600221.013020 mapwrite 0x00d926 thru 0x00de56 (0x531 bytes) 000420 1788600221.103212 MIRROR_RESYNC 3 mirrors 000421 1788600222.056850 mapwrite 0x0126fe thru 0x01e3ca (0xbccd bytes) 000422 1788600222.356088 write 0x01a967 thru 0x02518c (0xa826 bytes) 000423 1788600222.369094 mapread 0x001a72 thru 0x00887a (0x6e09 bytes) 000424 1788600222.387084 write 0x0335b8 thru 0x036caf (0x36f8 bytes) 000427 1788600222.425802 trunc from 0x03d592 to 0x032f08 (0xa689 bytes) 000428 1788600222.533346 read 0x03154b thru 0x032f08 (0x19be bytes) 000429 1788600222.537509 write 0x0363ce thru 0x03c9ce (0x6601 bytes) 000430 1788600222.544518 write 0x00c1b5 thru 0x01afb6 (0xee02 bytes) 000431 1788600222.560608 write 0x00ea0d thru 0x0187a5 (0x9d99 bytes) 000432 1788600222.574484 mapwrite 0x00aec1 thru 0x014d45 (0x9e85 bytes) 000434 1788600222.694214 MIRROR_RESYNC 3 mirrors 000436 1788600223.767710 read 0x017e33 thru 0x026ebe (0xf08c bytes) 000437 1788600223.784254 mapread 0x00f820 thru 0x01349b (0x3c7c bytes) 000438 1788600223.812401 MIRROR_RESYNC 3 mirrors 000439 1788600224.430417 write 0x03f87d thru 0x03ffff (0x783 bytes) 000443 1788600224.702046 mapread 0x007536 thru 0x016ec4 (0xf98f bytes) 000444 1788600224.764698 trunc from 0x040000 to 0x01e5c7 (0x21a38 bytes) 000445 1788600224.815713 trunc from 0x01e5c8 to 0x028574 (0x9fad bytes) 000446 1788600224.866429 read 0x01cfe0 thru 0x024d36 (0x7d57 bytes) 000447 1788600224.907150 MIRROR_RESYNC 3 mirrors 000448 1788600225.845921 mapread 0x0188aa thru 0x018f39 (0x690 bytes) 000452 1788600225.861364 read 0x01136f thru 0x01493a (0x35cc bytes) 000453 1788600225.882924 trunc from 0x028575 to 0x0354cd (0xcf59 bytes) 000454 1788600226.099752 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x354ce): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354ce): Mirror 2: 0xf02804c4 (stale) Mirror 3: 0xf02804c4 (stale) CRC-32 checksum value for chunk [0, 0x354ce): Mirror 1: 0xf02804c4 Mirror 4: 0xf02804c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354ce: skipped 000456 1788600227.794470 write 0x02f3a3 thru 0x0340ae (0x4d0c bytes) 000458 1788600227.892740 mapwrite 0x02260a thru 0x0315c3 (0xefba bytes) 000459 1788600228.009920 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x354ce): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354ce): Mirror 2: 0xf02804c4 (stale) Mirror 3: 0xf02804c4 (stale) Mirror 4: 0xf02804c4 (stale) CRC-32 checksum value for chunk [0, 0x354ce): Mirror 1: 0xb0b839f4 Mirror 5: 0xb0b839f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354ce: skipped 000460 1788600229.076044 mapread 0x004647 thru 0x008c5e (0x4618 bytes) 000465 1788600229.180119 mapread 0x0057bf thru 0x0066da (0xf1c bytes) 000466 1788600229.205007 trunc from 0x0354ce to 0x034fd4 (0x4f9 bytes) 000467 1788600229.384197 read 0x008889 thru 0x012e81 (0xa5f9 bytes) 000468 1788600229.397500 mapread 0x028bfb thru 0x032975 (0x9d7b bytes) 000469 1788600229.443410 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x34fd5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34fd5): Mirror 2: 0x7cf99a60 (stale) Mirror 3: 0x7cf99a60 (stale) Mirror 4: 0x7cf99a60 (stale) Mirror 5: 0xed7c9422 (stale) CRC-32 checksum value for chunk [0, 0x34fd5): Mirror 1: 0xed7c9422 Mirror 6: 0xed7c9422 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34fd5: skipped 000472 1788600230.773250 mapread 0x01b4a5 thru 0x022e5e (0x79ba bytes) 000474 1788600230.828374 read 0x0200fe thru 0x020372 (0x275 bytes) 000476 1788600230.841917 read 0x00225b thru 0x0066bb (0x4461 bytes) 000478 1788600230.865060 read 0x00b1b4 thru 0x012e52 (0x7c9f bytes) 000479 1788600230.871860 trunc from 0x034fd5 to 0x024cf6 (0x102de bytes) 000480 1788600231.060799 mapwrite 0x02b842 thru 0x039bb6 (0xe375 bytes) 000481 1788600231.189597 mapread 0x00d030 thru 0x00ecf7 (0x1cc8 bytes) 000482 1788600231.190812 read 0x00c8c2 thru 0x01af03 (0xe642 bytes) 000484 1788600231.195847 read 0x03934b thru 0x039bb6 (0x86c bytes) truncating to largest ever: 0x3d89c 000485 1788600231.198436 trunc from 0x039bb7 to 0x03d89b (0x3ce5 bytes) 000487 1788600231.235789 trunc from 0x03d89c to 0x01c65d (0x2123e bytes) 000489 1788600231.285450 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1c65e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c65e): Mirror 2: 0x2055760 (stale) Mirror 3: 0x2055760 (stale) Mirror 4: 0x2055760 (stale) Mirror 5: 0x2055760 (stale) Mirror 6: 0x2055760 (stale) CRC-32 checksum value for chunk [0, 0x1c65e): Mirror 1: 0x2055760 Mirror 7: 0x2055760 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c65e: skipped 000490 1788600232.503257 write 0x03e453 thru 0x03ffff (0x1bad bytes) 000491 1788600232.675295 mapread 0x003b29 thru 0x009645 (0x5b1d bytes) 000493 1788600232.714407 read 0x0244de thru 0x02c783 (0x82a6 bytes) 000494 1788600232.724331 write 0x02c3e8 thru 0x02f1d3 (0x2dec bytes) 000495 1788600232.741893 write 0x016b41 thru 0x0190b5 (0x2575 bytes) 000498 1788600232.767497 write 0x01a2c3 thru 0x0208eb (0x6629 bytes) 000499 1788600232.787154 trunc from 0x040000 to 0x030016 (0xffe9 bytes) 000503 1788600232.840199 write 0x007669 thru 0x00839b (0xd33 bytes) 000504 1788600232.841727 write 0x02e36d thru 0x038925 (0xa5b9 bytes) 000505 1788600232.844752 mapread 0x01822c thru 0x01aae6 (0x28bb bytes) 000506 1788600232.860800 MIRROR_RESYNC 7 mirrors 000508 1788600234.556920 MIRROR_RESYNC 7 mirrors 000509 1788600235.331085 write 0x036528 thru 0x03eaaf (0x8588 bytes) 000511 1788600235.415377 mapwrite 0x02391b thru 0x02dc80 (0xa366 bytes) 000512 1788600235.519288 mapread 0x00f4df thru 0x012b7e (0x36a0 bytes) 000513 1788600235.554994 read 0x02e9b0 thru 0x038b7d (0xa1ce bytes) 000515 1788600235.556345 trunc from 0x03eab0 to 0x01b4d8 (0x235d7 bytes) 000517 1788600235.589694 mapread 0x018ded thru 0x01b4d8 (0x26ec bytes) 000524 1788600235.619874 read 0x01289e thru 0x01b4d8 (0x8c3b bytes) 000527 1788600235.625207 mapwrite 0x02f693 thru 0x03b392 (0xbd00 bytes) 000528 1788600235.747178 read 0x015ffc thru 0x024753 (0xe758 bytes) 000531 1788600235.749592 mapwrite 0x027035 thru 0x0368c7 (0xf893 bytes) 000532 1788600235.830978 write 0x01b5de thru 0x02986b (0xe28e bytes) 000533 1788600235.839274 write 0x0393b3 thru 0x03a91a (0x1568 bytes) 000534 1788600235.845237 write 0x02d4d3 thru 0x02f8ab (0x23d9 bytes) 000537 1788600235.866319 MIRROR_RESYNC 7 mirrors 000538 1788600237.356222 trunc from 0x03b393 to 0x0225a3 (0x18def bytes) 000540 1788600237.441167 trunc from 0x0225a4 to 0x03babe (0x1951b bytes) 000542 1788600237.465770 write 0x03751b thru 0x03ba67 (0x454d bytes) 000543 1788600237.476367 mapread 0x02acaf thru 0x039111 (0xe463 bytes) 000545 1788600237.493835 read 0x03908e thru 0x03babe (0x2a31 bytes) 000547 1788600237.495175 mapwrite 0x02e3a6 thru 0x039cdd (0xb938 bytes) 000549 1788600237.560703 mapread 0x01e893 thru 0x028525 (0x9c93 bytes) 000550 1788600237.574946 write 0x0148c6 thru 0x020c3e (0xc379 bytes) 000554 1788600237.587908 mapread 0x01e9ca thru 0x01fe8a (0x14c1 bytes) 000555 1788600237.593188 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3babf): Mirror 2: 0x631a8a47 (stale) Mirror 4: 0x631a8a47 (stale) Mirror 5: 0x631a8a47 (stale) Mirror 6: 0x631a8a47 (stale) Mirror 7: 0x631a8a47 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3babf): Mirror 2: 0x631a8a47 (stale) Mirror 4: 0x631a8a47 (stale) Mirror 5: 0x631a8a47 (stale) Mirror 6: 0x631a8a47 (stale) Mirror 7: 0x631a8a47 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3babf: skipped 000557 1788600238.030377 trunc from 0x03babf to 0x013f26 (0x27b98 bytes) 000559 1788600238.055884 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13f27): Mirror 2: 0xe3d23d7 (stale) Mirror 5: 0xe3d23d7 (stale) Mirror 6: 0xe3d23d7 (stale) Mirror 7: 0xe3d23d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13f27): Mirror 2: 0xe3d23d7 (stale) Mirror 5: 0xe3d23d7 (stale) Mirror 6: 0xe3d23d7 (stale) Mirror 7: 0xe3d23d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13f27: skipped 000560 1788600238.524974 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13f27): Mirror 5: 0xe3d23d7 (stale) Mirror 6: 0xe3d23d7 (stale) Mirror 7: 0xe3d23d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13f27): Mirror 5: 0xe3d23d7 (stale) Mirror 6: 0xe3d23d7 (stale) Mirror 7: 0xe3d23d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13f27: skipped 000561 1788600238.867236 write 0x03cae2 thru 0x03ffff (0x351e bytes) 000563 1788600238.869101 read 0x010c90 thru 0x01115e (0x4cf bytes) 000566 1788600238.879356 read 0x0181e7 thru 0x02602f (0xde49 bytes) 000567 1788600238.889879 read 0x038319 thru 0x03bb85 (0x386d bytes) 000568 1788600238.895010 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd29c714b (stale) Mirror 7: 0xd29c714b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd29c714b (stale) Mirror 7: 0xd29c714b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000569 1788600239.283203 write 0x014376 thru 0x016dd9 (0x2a64 bytes) 000571 1788600239.294206 mapread 0x009264 thru 0x00bb74 (0x2911 bytes) 000574 1788600239.308732 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd29c714b (stale) Mirror 7: 0xd29c714b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x13073c97 Mirror 8: 0x13073c97 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000578 1788600240.226259 MIRROR_RESYNC 4 mirrors 000581 1788600241.129785 read 0x00d1cf thru 0x01296e (0x57a0 bytes) 000582 1788600241.140058 write 0x03e867 thru 0x03ffff (0x1799 bytes) 000583 1788600241.225755 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x13073c97 (stale) Mirror 7: 0x13073c97 (stale) Mirror 8: 0x13073c97 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2646fd1b Mirror 9: 0x2646fd1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000587 1788600242.330437 MIRROR_RESYNC 5 mirrors 000588 1788600243.468181 mapwrite 0x019740 thru 0x022d00 (0x95c1 bytes) 000589 1788600243.644765 trunc from 0x040000 to 0x00c262 (0x33d9d bytes) 000590 1788600243.683770 MIRROR_RESYNC 5 mirrors 000591 1788600244.905253 mapwrite 0x02856f thru 0x02e84a (0x62dc bytes) 000596 1788600245.065606 write 0x0031bc thru 0x00c70c (0x9551 bytes) 000597 1788600245.077470 mapread 0x0151dd thru 0x01fb5e (0xa982 bytes) 000599 1788600245.098086 trunc from 0x02e84b to 0x016c52 (0x17bf8 bytes) 000600 1788600245.120030 mapwrite 0x01daa9 thru 0x025fc2 (0x851a bytes) 000602 1788600245.201989 trunc from 0x025fc3 to 0x008bb4 (0x1d40e bytes) 000603 1788600245.231184 write 0x027080 thru 0x035aab (0xea2c bytes) 000604 1788600245.234001 read 0x016388 thru 0x01dbcc (0x7845 bytes) 000605 1788600245.241871 mapread 0x007bca thru 0x00be3a (0x4271 bytes) 000606 1788600245.252295 trunc from 0x035aac to 0x007b10 (0x2df9b bytes) 000607 1788600245.289398 mapwrite 0x01df4e thru 0x02247d (0x4530 bytes) 000610 1788600245.385511 mapwrite 0x00993f thru 0x016cac (0xd36e bytes) 000611 1788600245.490058 read 0x00ccf5 thru 0x0101e2 (0x34ee bytes) 000613 1788600245.498949 mapwrite 0x026e56 thru 0x034c68 (0xde13 bytes) 000616 1788600245.603667 MIRROR_RESYNC 5 mirrors 000617 1788600246.696495 trunc from 0x034c69 to 0x0005fb (0x3466d bytes) 000620 1788600246.828405 read 0x000096 thru 0x0005fb (0x566 bytes) 000622 1788600246.839885 mapwrite 0x02706d thru 0x0303ac (0x9340 bytes) 000624 1788600246.999617 mapread 0x0220f4 thru 0x02d3fd (0xb30a bytes) 000625 1788600247.000935 read 0x022f07 thru 0x02bbbf (0x8cb9 bytes) 000627 1788600247.004385 write 0x02b25a thru 0x02f746 (0x44ed bytes) 000632 1788600247.011944 write 0x01a9bd thru 0x02102c (0x6670 bytes) 000634 1788600247.033283 write 0x008de6 thru 0x018633 (0xf84e bytes) 000635 1788600247.035935 mapread 0x0072bb thru 0x013bf3 (0xc939 bytes) 000637 1788600247.038085 mapread 0x02be67 thru 0x0303ac (0x4546 bytes) 000638 1788600247.043455 read 0x016126 thru 0x01761a (0x14f5 bytes) 000639 1788600247.044324 mapread 0x000d59 thru 0x00d94f (0xcbf7 bytes) 000640 1788600247.050090 read 0x02e013 thru 0x0303ac (0x239a bytes) 000644 1788600247.056314 mapwrite 0x024786 thru 0x029a50 (0x52cb bytes) 000646 1788600247.137638 read 0x009d48 thru 0x0117f1 (0x7aaa bytes) 000648 1788600247.139512 mapwrite 0x004ec1 thru 0x00eac2 (0x9c02 bytes) 000649 1788600247.248449 mapread 0x02458f thru 0x0303ac (0xbe1e bytes) 000650 1788600247.251319 mapread 0x01d14d thru 0x02bf43 (0xedf7 bytes) 000651 1788600247.256189 trunc from 0x0303ad to 0x019505 (0x16ea7 bytes) 000652 1788600247.287389 mapwrite 0x0265d1 thru 0x02a6e3 (0x4113 bytes) truncating to largest ever: 0x3f7f0 000653 1788600247.368053 trunc from 0x02a6e4 to 0x03f7ef (0x1510c bytes) truncating to largest ever: 0x3fe00 000654 1788600247.392706 trunc from 0x03f7f0 to 0x03fdff (0x610 bytes) 000655 1788600247.417789 read 0x03f50f thru 0x03fdff (0x8f1 bytes) 000657 1788600247.436003 mapwrite 0x0010c6 thru 0x010392 (0xf2cd bytes) 000659 1788600247.496343 read 0x01243a thru 0x017563 (0x512a bytes) 000660 1788600247.503109 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe00): Mirror 6: 0x685de81a (stale) Mirror 7: 0x685de81a (stale) Mirror 8: 0x685de81a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe00): Mirror 6: 0x685de81a (stale) Mirror 7: 0x685de81a (stale) Mirror 8: 0x685de81a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe00: skipped 000662 1788600247.908097 read 0x0233c8 thru 0x023435 (0x6e bytes) 000663 1788600247.918440 write 0x01688e thru 0x020adb (0xa24e bytes) 000664 1788600247.932916 mapwrite 0x00cdee thru 0x010d45 (0x3f58 bytes) 000665 1788600248.005019 mapwrite 0x0043e8 thru 0x004a63 (0x67c bytes) 000667 1788600248.056744 trunc from 0x03fe00 to 0x03e6ac (0x1753 bytes) 000668 1788600248.076464 trunc from 0x03e6ad to 0x004f5d (0x3974f bytes) 000669 1788600248.096449 read 0x002b36 thru 0x004f5d (0x2428 bytes) 000670 1788600248.103172 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x4f5e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4f5e): Mirror 6: 0x68d4873f (stale) Mirror 7: 0x68d4873f (stale) Mirror 8: 0x68d4873f (stale) CRC-32 checksum value for chunk [0, 0x4f5e): Mirror 1: 0x369dd0a3 Mirror 9: 0x369dd0a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4f5e: skipped 000671 1788600248.932709 write 0x01af7c thru 0x022e3c (0x7ec1 bytes) 000672 1788600249.018687 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22e3d): Mirror 6: 0x879936f7 (stale) Mirror 8: 0x879936f7 (stale) Mirror 9: 0x7a1a305d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22e3d): Mirror 6: 0x879936f7 (stale) Mirror 8: 0x879936f7 (stale) Mirror 9: 0x7a1a305d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22e3d: skipped 000673 1788600249.437643 mapread 0x007806 thru 0x0175da (0xfdd5 bytes) 000676 1788600249.509123 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22e3d): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22e3d): Mirror 6: 0x879936f7 (stale) Mirror 8: 0x879936f7 (stale) Mirror 9: 0x7a1a305d (stale) CRC-32 checksum value for chunk [0, 0x22e3d): Mirror 1: 0x6cedc5e5 Mirror 10: 0x6cedc5e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22e3d: skipped 000677 1788600250.552393 write 0x03056f thru 0x037977 (0x7409 bytes) 000679 1788600250.735961 read 0x00e6b8 thru 0x01b82d (0xd176 bytes) 000680 1788600250.766192 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37978): Mirror 8: 0x5fea9572 (stale) Mirror 9: 0xd58be2e6 (stale) Mirror 10: 0x55cca764 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37978): Mirror 8: 0x5fea9572 (stale) Mirror 9: 0xd58be2e6 (stale) Mirror 10: 0x55cca764 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37978: skipped 000681 1788600251.544320 mapwrite 0x034bfe thru 0x03fd0d (0xb110 bytes) 000682 1788600251.795837 write 0x03bb85 thru 0x03ffff (0x447b bytes) 000683 1788600251.799782 trunc from 0x040000 to 0x032c77 (0xd388 bytes) 000685 1788600251.832351 write 0x00a7d3 thru 0x013b35 (0x9363 bytes) 000687 1788600251.858330 read 0x02845e thru 0x02c1a7 (0x3d4a bytes) 000688 1788600251.885141 write 0x03cbdf thru 0x03f7e1 (0x2c03 bytes) 000689 1788600251.887188 write 0x007102 thru 0x014b88 (0xda87 bytes) 000690 1788600251.914153 mapread 0x00eb00 thru 0x019299 (0xa79a bytes) 000692 1788600251.919088 write 0x018c88 thru 0x0258d8 (0xcc51 bytes) 000693 1788600251.929285 mapwrite 0x0224ba thru 0x0256c1 (0x3208 bytes) 000694 1788600252.003848 mapwrite 0x03458c thru 0x03a910 (0x6385 bytes) 000697 1788600252.088730 read 0x0107f5 thru 0x0152f9 (0x4b05 bytes) 000698 1788600252.093984 mapread 0x00ce3d thru 0x0180b2 (0xb276 bytes) 000699 1788600252.102076 read 0x0213f0 thru 0x025597 (0x41a8 bytes) 000700 1788600252.103435 read 0x024c7a thru 0x032374 (0xd6fb bytes) 000701 1788600252.115616 mapread 0x012bf9 thru 0x020fcb (0xe3d3 bytes) 000702 1788600252.117335 read 0x01a562 thru 0x01e4c3 (0x3f62 bytes) 000703 1788600252.119197 write 0x00deae thru 0x01b071 (0xd1c4 bytes) 000707 1788600252.131365 write 0x01d7fa thru 0x02ce4e (0xf655 bytes) 000709 1788600252.137387 trunc from 0x03f7e2 to 0x024e39 (0x1a9a8 bytes) 000710 1788600252.164397 mapread 0x01772a thru 0x01a8af (0x3186 bytes) 000711 1788600252.172708 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24e3a): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24e3a): Mirror 8: 0xb8129110 (stale) Mirror 9: 0x4a07c2bf (stale) Mirror 10: 0x112047ee (stale) CRC-32 checksum value for chunk [0, 0x24e3a): Mirror 1: 0x7f9e861 Mirror 11: 0x7f9e861 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24e3a: skipped 000712 1788600253.363266 write 0x0254d3 thru 0x02d846 (0x8374 bytes) 000713 1788600253.471153 read 0x023b9d thru 0x02d846 (0x9caa bytes) 000716 1788600253.480470 read 0x003f2e thru 0x007219 (0x32ec bytes) 000717 1788600253.491908 trunc from 0x02d847 to 0x028058 (0x57ee bytes) 000718 1788600253.550945 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28059): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28059): Mirror 8: 0x476bb4d2 (stale) Mirror 9: 0xc6fce8c0 (stale) Mirror 10: 0xe9542245 (stale) Mirror 11: 0xb7a70721 (stale) CRC-32 checksum value for chunk [0, 0x28059): Mirror 1: 0xa62152e8 Mirror 12: 0xa62152e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28059: skipped 000721 1788600254.843473 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x28059): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28059): Mirror 8: 0x476bb4d2 (stale) Mirror 9: 0xc6fce8c0 (stale) Mirror 10: 0xe9542245 (stale) Mirror 11: 0xb7a70721 (stale) CRC-32 checksum value for chunk [0, 0x28059): Mirror 1: 0xa62152e8 Mirror 12: 0xa62152e8 Mirror 13: 0xa62152e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28059: skipped 000722 1788600256.065488 trunc from 0x028059 to 0x03f0d8 (0x17080 bytes) 000725 1788600256.139980 mapwrite 0x015233 thru 0x016ef1 (0x1cbf bytes) 000728 1788600256.215480 trunc from 0x03f0d9 to 0x019ddc (0x252fc bytes) 000729 1788600256.251055 mapread 0x0184b7 thru 0x019ddc (0x1926 bytes) 000730 1788600256.283943 mapwrite 0x00018d thru 0x00c006 (0xbe7a bytes) 000731 1788600256.356198 write 0x0127dd thru 0x0179c1 (0x51e5 bytes) 000733 1788600256.358028 read 0x008a59 thru 0x00bfa2 (0x354a bytes) 000735 1788600256.366656 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19ddd): Mirror 8: 0x16a5a0fa (stale) Mirror 9: 0xb0d01540 (stale) Mirror 11: 0x849d10e3 (stale) Mirror 12: 0x849d10e3 (stale) Mirror 13: 0x849d10e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19ddd): Mirror 8: 0x16a5a0fa (stale) Mirror 9: 0xb0d01540 (stale) Mirror 11: 0x849d10e3 (stale) Mirror 12: 0x849d10e3 (stale) Mirror 13: 0x849d10e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19ddd: skipped 000736 1788600257.315974 write 0x01cc4e thru 0x0211f0 (0x45a3 bytes) 000739 1788600257.327474 read 0x0070ee thru 0x00c85b (0x576e bytes) 000740 1788600257.368902 mapread 0x01439c thru 0x01c4a6 (0x810b bytes) 000742 1788600257.448948 read 0x0153d6 thru 0x01b339 (0x5f64 bytes) 000743 1788600257.449748 mapread 0x017e40 thru 0x020709 (0x88ca bytes) 000746 1788600257.473961 mapread 0x01a493 thru 0x01effd (0x4b6b bytes) 000747 1788600257.492738 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x211f1): Mirror 8: 0x74bbd152 (stale) Mirror 9: 0x53730777 (stale) Mirror 11: 0x2efa9c3d (stale) Mirror 13: 0x2efa9c3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x211f1): Mirror 8: 0x74bbd152 (stale) Mirror 9: 0x53730777 (stale) Mirror 11: 0x2efa9c3d (stale) Mirror 13: 0x2efa9c3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x211f1: skipped 000751 1788600258.301414 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x211f1): Mirror 8: 0x74bbd152 (stale) Mirror 11: 0x2efa9c3d (stale) Mirror 13: 0x2efa9c3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x211f1): Mirror 8: 0x74bbd152 (stale) Mirror 11: 0x2efa9c3d (stale) Mirror 13: 0x2efa9c3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x211f1: skipped 000753 1788600259.004451 mapread 0x00b4c1 thru 0x00ce2e (0x196e bytes) 000754 1788600259.026727 write 0x017e76 thru 0x0266db (0xe866 bytes) 000755 1788600259.052440 write 0x015908 thru 0x025352 (0xfa4b bytes) 000756 1788600259.060181 trunc from 0x0266dc to 0x0002de (0x263fd bytes) 000757 1788600259.103993 read 0x000037 thru 0x0002de (0x2a8 bytes) 000758 1788600259.138915 MIRROR_RESYNC 4 mirrors 000759 1788600260.264154 write 0x00d133 thru 0x015ba4 (0x8a72 bytes) 000760 1788600260.457507 trunc from 0x015ba5 to 0x03fb47 (0x29fa3 bytes) 000761 1788600260.595640 write 0x01c8bb thru 0x01e633 (0x1d79 bytes) 000764 1788600260.639680 MIRROR_RESYNC 4 mirrors 000765 1788600261.861306 write 0x02a4c4 thru 0x03141f (0x6f5c bytes) 000766 1788600262.081494 mapread 0x0252de thru 0x0288de (0x3601 bytes) 000767 1788600262.108410 trunc from 0x03fb48 to 0x00f588 (0x305bf bytes) 000770 1788600262.163102 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xf589): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf589): Mirror 8: 0xae3fc2f9 (stale) Mirror 11: 0xae3fc2f9 (stale) Mirror 13: 0xae3fc2f9 (stale) CRC-32 checksum value for chunk [0, 0xf589): Mirror 1: 0xae3fc2f9 Mirror 14: 0xae3fc2f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf589: skipped 000772 1788600264.203967 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xf589): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf589): Mirror 8: 0xae3fc2f9 (stale) Mirror 11: 0xae3fc2f9 (stale) Mirror 13: 0xae3fc2f9 (stale) CRC-32 checksum value for chunk [0, 0xf589): Mirror 1: 0xae3fc2f9 Mirror 14: 0xae3fc2f9 Mirror 15: 0xae3fc2f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf589: skipped 000774 1788600265.311150 write 0x02d7fa thru 0x03c844 (0xf04b bytes) 000775 1788600265.375676 read 0x0314f9 thru 0x035f67 (0x4a6f bytes) 000778 1788600265.378253 write 0x0048d8 thru 0x00eb6b (0xa294 bytes) 000781 1788600265.398595 trunc from 0x03c845 to 0x005452 (0x373f2 bytes) 000783 1788600265.464226 trunc from 0x005453 to 0x00b37d (0x5f2b bytes) 000785 1788600265.530134 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb37e): Mirror 8: 0x37abceca (stale) Mirror 11: 0x37abceca (stale) Mirror 14: 0x37abceca (stale) Mirror 15: 0x37abceca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb37e): Mirror 8: 0x37abceca (stale) Mirror 11: 0x37abceca (stale) Mirror 14: 0x37abceca (stale) Mirror 15: 0x37abceca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb37e: skipped 000786 1788600266.217265 mapwrite 0x01796f thru 0x017a11 (0xa3 bytes) 000787 1788600266.305439 mapread 0x012b14 thru 0x017a11 (0x4efe bytes) 000788 1788600266.331987 mapwrite 0x021460 thru 0x027a57 (0x65f8 bytes) 000790 1788600266.442205 write 0x0056cb thru 0x00a89d (0x51d3 bytes) 000792 1788600266.462031 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27a58): Mirror 11: 0xe967f16 (stale) Mirror 14: 0x5989e09b (stale) Mirror 15: 0x5989e09b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27a58): Mirror 11: 0xe967f16 (stale) Mirror 14: 0x5989e09b (stale) Mirror 15: 0x5989e09b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27a58: skipped 000796 1788600267.379134 mapread 0x001ea1 thru 0x00764c (0x57ac bytes) 000799 1788600267.401432 mapwrite 0x004c8d thru 0x00586a (0xbde bytes) 000804 1788600267.446396 mapread 0x020e04 thru 0x027a57 (0x6c54 bytes) 000805 1788600267.457952 write 0x0037fb thru 0x00ab0f (0x7315 bytes) 000806 1788600267.459454 read 0x003e05 thru 0x00f308 (0xb504 bytes) 000807 1788600267.461392 mapwrite 0x008a0b thru 0x0120d0 (0x96c6 bytes) 000808 1788600267.561501 mapread 0x012789 thru 0x01f072 (0xc8ea bytes) 000812 1788600267.574967 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27a58): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27a58): Mirror 11: 0xe967f16 (stale) Mirror 14: 0x5989e09b (stale) Mirror 15: 0x5989e09b (stale) CRC-32 checksum value for chunk [0, 0x27a58): Mirror 1: 0x4558e7c Mirror 16: 0x4558e7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27a58: skipped 000813 1788600269.058724 write 0x01c87e thru 0x01f427 (0x2baa bytes) 000815 1788600269.260419 mapwrite 0x03c0db thru 0x03e0ba (0x1fe0 bytes) 000816 1788600269.353077 mapread 0x0335b9 thru 0x03e0ba (0xab02 bytes) 000817 1788600269.364268 mapwrite 0x02ed28 thru 0x031575 (0x284e bytes) 000818 1788600269.423133 mapread 0x02f153 thru 0x036108 (0x6fb6 bytes) 000819 1788600269.425214 trunc from 0x03e0bb to 0x00d004 (0x310b6 bytes) 000822 1788600269.456366 MIRROR_RESYNC 5 mirrors 000823 1788600270.951329 trunc from 0x00d005 to 0x01c5f6 (0xf5f2 bytes) 000826 1788600271.082819 mapread 0x0193f2 thru 0x01c5f6 (0x3205 bytes) 000827 1788600271.124907 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1c5f7): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c5f7): Mirror 11: 0x7dc0b229 (stale) Mirror 14: 0x7dc0b229 (stale) Mirror 15: 0x7dc0b229 (stale) Mirror 16: 0x7dc0b229 (stale) CRC-32 checksum value for chunk [0, 0x1c5f7): Mirror 1: 0x7dc0b229 Mirror 17: 0x7dc0b229 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c5f7: skipped 000828 1788600272.456568 trunc from 0x01c5f7 to 0x03705f (0x1aa69 bytes) 000829 1788600272.620226 read 0x02c02d thru 0x0351a5 (0x9179 bytes) 000830 1788600272.630068 mapread 0x01e2ca thru 0x021bd3 (0x390a bytes) 000831 1788600272.650821 mapread 0x02090a thru 0x024bf3 (0x42ea bytes) 000832 1788600272.652329 write 0x01e00e thru 0x025492 (0x7485 bytes) 000834 1788600272.655613 mapwrite 0x00c26c thru 0x0132db (0x7070 bytes) 000835 1788600272.734471 write 0x0349c3 thru 0x0371d9 (0x2817 bytes) 000836 1788600272.748485 trunc from 0x0371da to 0x014fd5 (0x22204 bytes) 000837 1788600272.785253 trunc from 0x014fd6 to 0x023ef1 (0xef1c bytes) 000838 1788600272.814870 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23ef2): Mirror 11: 0x906eecb0 (stale) Mirror 15: 0x906eecb0 (stale) Mirror 16: 0x906eecb0 (stale) Mirror 17: 0x906eecb0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ef2): Mirror 11: 0x906eecb0 (stale) Mirror 15: 0x906eecb0 (stale) Mirror 16: 0x906eecb0 (stale) Mirror 17: 0x906eecb0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ef2: skipped 000840 1788600273.241281 read 0x01f187 thru 0x023ef1 (0x4d6b bytes) 000842 1788600273.252990 read 0x010079 thru 0x0134ea (0x3472 bytes) 000843 1788600273.264433 write 0x00c27f thru 0x0137b7 (0x7539 bytes) 000844 1788600273.265792 read 0x020047 thru 0x023ef1 (0x3eab bytes) 000845 1788600273.267699 read 0x01ca85 thru 0x01d7d9 (0xd55 bytes) 000847 1788600273.269562 write 0x016093 thru 0x0190cc (0x303a bytes) 000848 1788600273.271865 write 0x022819 thru 0x026408 (0x3bf0 bytes) 000851 1788600273.278765 mapread 0x00d5e2 thru 0x01081a (0x3239 bytes) 000854 1788600273.281980 mapwrite 0x021071 thru 0x028183 (0x7113 bytes) 000855 1788600273.374448 mapwrite 0x029cd8 thru 0x02d3a9 (0x36d2 bytes) 000856 1788600273.455053 write 0x03811e thru 0x03ffff (0x7ee2 bytes) 000857 1788600273.458065 write 0x0270c7 thru 0x0331ed (0xc127 bytes) 000858 1788600273.466297 read 0x02cc93 thru 0x03ac3d (0xdfab bytes) 000859 1788600273.472840 write 0x02b085 thru 0x037f87 (0xcf03 bytes) 000860 1788600273.475332 read 0x013a5c thru 0x01a567 (0x6b0c bytes) 000861 1788600273.476817 mapwrite 0x0095ae thru 0x010b64 (0x75b7 bytes) 000863 1788600273.563236 mapwrite 0x01cdc6 thru 0x01d2ff (0x53a bytes) 000864 1788600273.651939 mapread 0x021255 thru 0x0248ec (0x3698 bytes) 000866 1788600273.656443 trunc from 0x040000 to 0x013153 (0x2ceac bytes) 000867 1788600273.686156 trunc from 0x013154 to 0x0177ea (0x4697 bytes) 000868 1788600273.705197 MIRROR_RESYNC 5 mirrors 000869 1788600274.865388 mapwrite 0x0063d8 thru 0x00664f (0x278 bytes) 000871 1788600275.044886 mapread 0x0021a8 thru 0x00bcd5 (0x9b2e bytes) 000872 1788600275.058614 read 0x009f3a thru 0x00cbcd (0x2c94 bytes) 000873 1788600275.059662 write 0x00d628 thru 0x012f03 (0x58dc bytes) 000875 1788600275.069898 trunc from 0x0177eb to 0x006a6c (0x10d7e bytes) 000876 1788600275.108640 read 0x00220b thru 0x0067c2 (0x45b8 bytes) 000877 1788600275.109498 write 0x01d855 thru 0x0295eb (0xbd97 bytes) 000878 1788600275.116860 read 0x00056f thru 0x00fa47 (0xf4d9 bytes) 000880 1788600275.126483 read 0x00a8a5 thru 0x015b75 (0xb2d1 bytes) 000881 1788600275.127186 trunc from 0x0295ec to 0x02d725 (0x413a bytes) 000882 1788600275.145687 mapwrite 0x03e665 thru 0x03ffff (0x199b bytes) 000883 1788600275.239748 read 0x013af6 thru 0x0165fd (0x2b08 bytes) 000885 1788600275.241853 trunc from 0x040000 to 0x0370aa (0x8f55 bytes) 000887 1788600275.281165 write 0x025de6 thru 0x03386a (0xda85 bytes) 000889 1788600275.291388 read 0x0088cc thru 0x00afa4 (0x26d9 bytes) 000892 1788600275.299058 trunc from 0x0370ab to 0x02f07a (0x8030 bytes) 000893 1788600275.338850 trunc from 0x02f07b to 0x01d415 (0x11c65 bytes) 000895 1788600275.367961 trunc from 0x01d416 to 0x03f164 (0x21d4f bytes) 000897 1788600275.403965 MIRROR_RESYNC 5 mirrors 000899 1788600276.466177 mapread 0x02541a thru 0x02f5f2 (0xa1d9 bytes) 000900 1788600276.493467 mapread 0x016476 thru 0x0249e4 (0xe56f bytes) 000902 1788600276.512408 mapread 0x0274ea thru 0x0298cf (0x23e6 bytes) 000903 1788600276.520171 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000904 1788600276.990422 write 0x013a9a thru 0x017ada (0x4041 bytes) 000905 1788600277.095709 MIRROR_RESYNC 4 mirrors 000906 1788600278.624257 mapread 0x000acc thru 0x006e55 (0x638a bytes) 000907 1788600278.679737 write 0x017334 thru 0x01ba00 (0x46cd bytes) 000908 1788600278.782445 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f165): Mirror 11: 0x20fbce90 (stale) Mirror 15: 0x20fbce90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f165): Mirror 11: 0x20fbce90 (stale) Mirror 15: 0x20fbce90 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f165: skipped 000912 1788600279.182185 trunc from 0x03f165 to 0x027c66 (0x174fe bytes) 000915 1788600279.222090 MIRROR_RESYNC 3 mirrors 000917 1788600280.251000 mapread 0x00fc51 thru 0x011e00 (0x21b0 bytes) 000924 1788600280.299209 mapread 0x016492 thru 0x01f71c (0x928b bytes) 000925 1788600280.316919 read 0x0205cd thru 0x027c66 (0x769a bytes) 000928 1788600280.342124 read 0x00f243 thru 0x0167c0 (0x757e bytes) 000929 1788600280.343000 read 0x0111a6 thru 0x015d62 (0x4bbd bytes) 000932 1788600280.344170 trunc from 0x027c67 to 0x029fdb (0x2375 bytes) 000933 1788600280.450124 write 0x01740e thru 0x020109 (0x8cfc bytes) 000934 1788600280.466967 mapwrite 0x00dfc3 thru 0x01120d (0x324b bytes) 000936 1788600280.555428 write 0x01a52f thru 0x01d5b5 (0x3087 bytes) 000937 1788600280.558165 read 0x0102fa thru 0x01fb2c (0xf833 bytes) 000938 1788600280.562431 mapread 0x0107ad thru 0x012b4c (0x23a0 bytes) 000939 1788600280.571287 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 11: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 11: 0x11b68e1f (stale) Mirror 15: 0x11b68e1f (stale) CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 1: 0x63686988 Mirror 16: 0x63686988 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29fdc: skipped 000941 1788600281.748461 write 0x017a15 thru 0x0219bb (0x9fa7 bytes) 000942 1788600281.848353 mapread 0x0271c7 thru 0x029fdb (0x2e15 bytes) 000945 1788600281.866468 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 11: 0x11b68e1f (stale) Mirror 15: 0x11b68e1f (stale) Mirror 16: 0x63686988 (stale) CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 1: 0x67fc523f Mirror 17: 0x67fc523f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29fdc: skipped 000946 1788600283.082236 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 11: 0x11b68e1f (stale) Mirror 15: 0x11b68e1f (stale) Mirror 16: 0x63686988 (stale) CRC-32 checksum value for chunk [0, 0x29fdc): Mirror 1: 0x67fc523f Mirror 17: 0x67fc523f Mirror 18: 0x67fc523f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29fdc: skipped 000948 1788600284.572620 MIRROR_RESYNC 6 mirrors 000949 1788600285.688940 write 0x0254d1 thru 0x027211 (0x1d41 bytes) 000951 1788600285.850988 read 0x00b368 thru 0x00e757 (0x33f0 bytes) 000952 1788600285.861633 write 0x026a00 thru 0x02da2b (0x702c bytes) 000953 1788600285.863955 read 0x0008e6 thru 0x00d410 (0xcb2b bytes) 000954 1788600285.877662 trunc from 0x02da2c to 0x01a079 (0x139b2 bytes) 000955 1788600285.908172 mapwrite 0x018bff thru 0x023f06 (0xb308 bytes) 000959 1788600286.054217 write 0x01ab82 thru 0x01c025 (0x14a4 bytes) 000962 1788600286.064787 trunc from 0x023f07 to 0x02da20 (0x9b1a bytes) 000963 1788600286.100204 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2da21): Mirror 11: 0x4fb478d7 (stale) Mirror 15: 0x4fb478d7 (stale) Mirror 16: 0x4fb478d7 (stale) Mirror 18: 0x4fb478d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2da21): Mirror 11: 0x4fb478d7 (stale) Mirror 15: 0x4fb478d7 (stale) Mirror 16: 0x4fb478d7 (stale) Mirror 18: 0x4fb478d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2da21: skipped 000966 1788600286.717827 mapwrite 0x022433 thru 0x028150 (0x5d1e bytes) 000968 1788600286.835330 mapwrite 0x005c4c thru 0x00fa05 (0x9dba bytes) 000969 1788600286.969808 write 0x026880 thru 0x032589 (0xbd0a bytes) 000970 1788600286.977259 trunc from 0x03258a to 0x03b136 (0x8bad bytes) 000972 1788600287.012856 write 0x02fae9 thru 0x037bd3 (0x80eb bytes) 000973 1788600287.019812 read 0x02134f thru 0x025528 (0x41da bytes) 000974 1788600287.023451 mapread 0x008beb thru 0x00e955 (0x5d6b bytes) 000975 1788600287.052806 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b137): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b137): Mirror 11: 0x41c24fac (stale) Mirror 15: 0x41c24fac (stale) Mirror 16: 0x41c24fac (stale) Mirror 18: 0x41c24fac (stale) CRC-32 checksum value for chunk [0, 0x3b137): Mirror 1: 0xaa0ef039 Mirror 19: 0xaa0ef039 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b137: skipped 000976 1788600288.166722 mapread 0x018d67 thru 0x01baf3 (0x2d8d bytes) 000977 1788600288.194266 write 0x002183 thru 0x00a3bb (0x8239 bytes) truncating to largest ever: 0x3fee8 000978 1788600288.302837 trunc from 0x03b137 to 0x03fee7 (0x4db1 bytes) 000980 1788600288.355684 mapwrite 0x01c28e thru 0x028758 (0xc4cb bytes) 000982 1788600288.460509 write 0x00634f thru 0x015556 (0xf208 bytes) 000983 1788600288.463854 write 0x021489 thru 0x021d2d (0x8a5 bytes) 000985 1788600288.466515 write 0x035b68 thru 0x037253 (0x16ec bytes) 000990 1788600288.484510 read 0x01c66c thru 0x01d127 (0xabc bytes) 000991 1788600288.491261 mapwrite 0x0370eb thru 0x03df45 (0x6e5b bytes) 000993 1788600288.546757 MIRROR_RESYNC 6 mirrors 000995 1788600289.644752 mapwrite 0x00e0c4 thru 0x012dcc (0x4d09 bytes) 000997 1788600289.842212 read 0x005f7b thru 0x00e784 (0x880a bytes) 000998 1788600289.852973 read 0x030093 thru 0x032a1e (0x298c bytes) 001000 1788600289.864327 mapread 0x01436e thru 0x019dc9 (0x5a5c bytes) All operations completed A-OK!