== sanity-flr test 70a: flr mode fsx test ================ 03:56:04 (1787385364) Seed set to 5366 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787385366.334600 mapwrite 0x0193a0 thru 0x0261b0 (0xce11 bytes) 000003 1787385366.532550 write 0x02539b thru 0x027cfd (0x2963 bytes) 000004 1787385366.533659 read 0x006712 thru 0x008fd0 (0x28bf bytes) truncating to largest ever: 0xfbf6 000005 1787385366.539530 trunc from 0x027cfe to 0x00fbf5 (0x18108 bytes) 000009 1787385366.561436 read 0x009cab thru 0x00d28e (0x35e4 bytes) 000010 1787385366.578052 write 0x020753 thru 0x023ac9 (0x3377 bytes) 000011 1787385366.579456 read 0x00df12 thru 0x00ff48 (0x2037 bytes) 000014 1787385366.585914 write 0x021fe2 thru 0x0261ae (0x41cd bytes) 000016 1787385366.593913 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3b62a 000018 1787385367.262335 trunc from 0x0261af to 0x03b629 (0x1547b bytes) 000023 1787385367.399695 write 0x01148c thru 0x015a2e (0x45a3 bytes) 000024 1787385367.410448 read 0x02cc53 thru 0x037a94 (0xae42 bytes) 000027 1787385367.419818 write 0x011132 thru 0x01e8eb (0xd7ba bytes) 000029 1787385367.425360 read 0x006db7 thru 0x014520 (0xd76a bytes) 000030 1787385367.437076 write 0x03ef6a thru 0x03ffff (0x1096 bytes) 000032 1787385367.439217 read 0x01d63f thru 0x01e352 (0xd14 bytes) 000034 1787385367.440510 mapwrite 0x0221ce thru 0x02eb7f (0xc9b2 bytes) 000035 1787385367.508978 write 0x01a80e thru 0x027464 (0xcc57 bytes) 000036 1787385367.523579 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa781bab (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x25bf7f12 Mirror 3: 0x25bf7f12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000037 1787385368.623259 read 0x01ab64 thru 0x01fda8 (0x5245 bytes) 000041 1787385368.642669 mapread 0x017369 thru 0x021088 (0x9d20 bytes) 000044 1787385368.693046 MIRROR_RESYNC 3 mirrors 000047 1787385369.408433 mapwrite 0x02ba76 thru 0x036bd2 (0xb15d bytes) 000048 1787385369.555101 write 0x017b56 thru 0x0223c5 (0xa870 bytes) 000051 1787385369.576473 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x25bf7f12 (stale) Mirror 3: 0x25bf7f12 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5a3799bb Mirror 4: 0x5a3799bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000053 1787385370.561005 trunc from 0x040000 to 0x031cb8 (0xe347 bytes) 000059 1787385370.708461 read 0x022a0c thru 0x030c19 (0xe20e bytes) 000060 1787385370.736841 mapread 0x0041a8 thru 0x007d37 (0x3b90 bytes) 000061 1787385370.792771 read 0x0204d2 thru 0x021c17 (0x1746 bytes) 000062 1787385370.835911 mapwrite 0x0121ee thru 0x0151ca (0x2fdd bytes) 000063 1787385370.912101 mapwrite 0x01a3b9 thru 0x01ca43 (0x268b bytes) 000067 1787385371.001684 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31cb9): Mirror 2: 0xc0a137a1 (stale) Mirror 3: 0xc0a137a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31cb9): Mirror 2: 0xc0a137a1 (stale) Mirror 3: 0xc0a137a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31cb9: skipped 000068 1787385371.536704 mapwrite 0x022f7e thru 0x02af01 (0x7f84 bytes) 000070 1787385371.700626 mapread 0x0028d8 thru 0x010f21 (0xe64a bytes) 000071 1787385371.721759 write 0x001808 thru 0x0040c2 (0x28bb bytes) 000072 1787385371.735712 trunc from 0x031cb9 to 0x01a048 (0x17c70 bytes) 000073 1787385371.783502 trunc from 0x01a049 to 0x02806f (0xe027 bytes) 000074 1787385371.815085 write 0x01622b thru 0x018642 (0x2418 bytes) 000076 1787385371.843410 mapread 0x011e75 thru 0x019628 (0x77b4 bytes) 000077 1787385371.859399 trunc from 0x028070 to 0x021c5f (0x6410 bytes) 000078 1787385371.887742 mapread 0x014d4e thru 0x01b782 (0x6a35 bytes) 000079 1787385371.899355 mapwrite 0x00c395 thru 0x00ccb3 (0x91f bytes) 000080 1787385371.979426 trunc from 0x021c60 to 0x00258d (0x1f6d2 bytes) 000084 1787385372.010510 MIRROR_RESYNC 3 mirrors 000085 1787385372.967918 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000087 1787385373.384003 read 0x001b7d thru 0x00258d (0xa11 bytes) 000088 1787385373.395501 trunc from 0x00258e to 0x027a0b (0x2547e bytes) 000089 1787385373.478196 mapread 0x02333c thru 0x0235c1 (0x286 bytes) 000090 1787385373.487114 mapwrite 0x026a59 thru 0x035b1e (0xf0c6 bytes) 000091 1787385373.688221 write 0x01c7c6 thru 0x01df08 (0x1743 bytes) 000093 1787385373.710335 read 0x004ce0 thru 0x010e88 (0xc1a9 bytes) 000094 1787385373.730212 mapread 0x018e55 thru 0x028bf5 (0xfda1 bytes) 000095 1787385373.732377 read 0x020999 thru 0x02e1e6 (0xd84e bytes) 000096 1787385373.733458 mapwrite 0x00f4cb thru 0x018e68 (0x999e bytes) 000097 1787385373.788882 mapread 0x0111ab thru 0x01f294 (0xe0ea bytes) 000100 1787385373.792554 trunc from 0x035b1f to 0x03afce (0x54b0 bytes) 000102 1787385373.812719 read 0x00c46f thru 0x019943 (0xd4d5 bytes) 000105 1787385373.815280 trunc from 0x03afcf to 0x01ad4d (0x20281 bytes) 000106 1787385373.837499 MIRROR_RESYNC 2 mirrors 000107 1787385374.579415 read 0x0121d6 thru 0x01ad4d (0x8b78 bytes) 000108 1787385374.588972 mapwrite 0x01285a thru 0x01c5e0 (0x9d87 bytes) 000109 1787385374.780900 MIRROR_RESYNC 2 mirrors 000111 1787385375.469383 trunc from 0x01c5e1 to 0x02d372 (0x10d92 bytes) 000112 1787385375.551058 mapread 0x019803 thru 0x0235cb (0x9dc9 bytes) 000113 1787385375.591870 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000114 1787385375.768759 read 0x01ba0a thru 0x0239f5 (0x7fec bytes) 000115 1787385375.783126 mapwrite 0x02a1b2 thru 0x02ea10 (0x485f bytes) 000117 1787385375.862797 mapwrite 0x009ee8 thru 0x015c8b (0xbda4 bytes) 000120 1787385375.984372 read 0x018778 thru 0x02608a (0xd913 bytes) 000122 1787385376.002685 mapread 0x007643 thru 0x00bebc (0x487a bytes) 000124 1787385376.004994 write 0x0233ca thru 0x029af3 (0x672a bytes) 000126 1787385376.007032 mapread 0x025cdb thru 0x02a4a0 (0x47c6 bytes) 000127 1787385376.008506 read 0x020916 thru 0x029931 (0x901c bytes) 000128 1787385376.009406 read 0x014f92 thru 0x01b0f1 (0x6160 bytes) 000129 1787385376.010367 write 0x000703 thru 0x001cda (0x15d8 bytes) 000132 1787385376.012881 trunc from 0x02ea11 to 0x0222f8 (0xc718 bytes) 000135 1787385376.033529 mapread 0x010c1e thru 0x01217d (0x1560 bytes) 000136 1787385376.035317 trunc from 0x0222f9 to 0x01ce90 (0x5468 bytes) 000137 1787385376.059252 mapread 0x009a3e thru 0x00f608 (0x5bcb bytes) 000138 1787385376.061733 write 0x0095c1 thru 0x0108b8 (0x72f8 bytes) 000140 1787385376.065729 mapwrite 0x02b4c8 thru 0x035507 (0xa040 bytes) 000144 1787385376.193493 read 0x014337 thru 0x01a4c0 (0x618a bytes) 000145 1787385376.194423 write 0x011b39 thru 0x021b23 (0xffeb bytes) 000146 1787385376.196826 mapread 0x01274e thru 0x01f961 (0xd214 bytes) 000147 1787385376.198551 read 0x0034fe thru 0x00bf8c (0x8a8f bytes) 000148 1787385376.200577 mapwrite 0x002578 thru 0x008493 (0x5f1c bytes) 000149 1787385376.272024 trunc from 0x035508 to 0x03227e (0x3289 bytes) 000151 1787385376.309439 write 0x01695b thru 0x0263f3 (0xfa99 bytes) 000152 1787385376.311655 mapread 0x0315cb thru 0x03227e (0xcb4 bytes) 000153 1787385376.321448 MIRROR_EXTEND to 2 mirrors 000154 1787385377.137358 read 0x01dc3a thru 0x01dfa0 (0x367 bytes) 000157 1787385377.162018 trunc from 0x03227f to 0x0070be (0x2b1c0 bytes) 000158 1787385377.271416 trunc from 0x0070bf to 0x01fa8b (0x189cd bytes) 000159 1787385377.291973 write 0x03b068 thru 0x03ced3 (0x1e6c bytes) 000161 1787385377.297938 write 0x034d40 thru 0x03ffff (0xb2c0 bytes) 000163 1787385377.309211 write 0x01edd2 thru 0x01fe5e (0x108d bytes) 000164 1787385377.321330 write 0x03ed23 thru 0x03ffff (0x12dd bytes) 000165 1787385377.323443 mapread 0x0274db thru 0x02c4c5 (0x4feb bytes) 000167 1787385377.345324 mapwrite 0x015dd9 thru 0x01ecba (0x8ee2 bytes) 000168 1787385377.438809 read 0x00f57a thru 0x016c3e (0x76c5 bytes) 000169 1787385377.439649 write 0x036f38 thru 0x03963d (0x2706 bytes) 000171 1787385377.441615 trunc from 0x040000 to 0x02c84e (0x137b1 bytes) 000173 1787385377.466825 mapread 0x005cf4 thru 0x00e691 (0x899e bytes) 000174 1787385377.492825 mapread 0x001599 thru 0x002d9b (0x1803 bytes) 000176 1787385377.499507 mapread 0x0053c1 thru 0x00641c (0x105c bytes) 000177 1787385377.504998 mapwrite 0x03c214 thru 0x03c88c (0x679 bytes) 000178 1787385377.601324 mapwrite 0x03bbc9 thru 0x03e964 (0x2d9c bytes) 000179 1787385377.679245 read 0x0100dc thru 0x01a4ad (0xa3d2 bytes) 000180 1787385377.680078 mapwrite 0x00c526 thru 0x010a18 (0x44f3 bytes) 000181 1787385377.737242 mapwrite 0x0277c2 thru 0x034b7b (0xd3ba bytes) 000182 1787385377.811605 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000183 1787385378.043632 read 0x001ff5 thru 0x00b217 (0x9223 bytes) 000187 1787385378.055701 mapwrite 0x007737 thru 0x00dae3 (0x63ad bytes) 000188 1787385378.146265 mapread 0x03989a thru 0x03e964 (0x50cb bytes) 000190 1787385378.157403 mapread 0x0367a5 thru 0x03e964 (0x81c0 bytes) 000192 1787385378.165641 mapwrite 0x000bef thru 0x005f5c (0x536e bytes) 000193 1787385378.219257 mapread 0x019e7d thru 0x01d862 (0x39e6 bytes) 000196 1787385378.229759 write 0x03957c thru 0x03ff97 (0x6a1c bytes) 000197 1787385378.232487 write 0x00f09d thru 0x0149ec (0x5950 bytes) 000200 1787385378.236408 mapwrite 0x00edd9 thru 0x011bec (0x2e14 bytes) 000203 1787385378.299238 read 0x00aba4 thru 0x00f52d (0x498a bytes) 000205 1787385378.301303 trunc from 0x03ff98 to 0x019f24 (0x26073 bytes) 000207 1787385378.334365 read 0x001cc2 thru 0x00ac4b (0x8f8a bytes) 000209 1787385378.337277 mapread 0x0059cc thru 0x00da0e (0x8043 bytes) 000211 1787385378.344434 mapwrite 0x017c61 thru 0x01da37 (0x5dd7 bytes) 000212 1787385378.447084 trunc from 0x01da38 to 0x025bc0 (0x8189 bytes) 000214 1787385378.474598 mapread 0x005665 thru 0x0109d1 (0xb36d bytes) 000216 1787385378.479382 write 0x02e2a0 thru 0x035014 (0x6d75 bytes) 000217 1787385378.482179 mapread 0x004cba thru 0x00a206 (0x554d bytes) 000219 1787385378.485916 write 0x032b00 thru 0x033d56 (0x1257 bytes) 000220 1787385378.492278 MIRROR_EXTEND to 2 mirrors 000224 1787385379.262195 trunc from 0x035015 to 0x023b1f (0x114f5 bytes) 000225 1787385379.378956 trunc from 0x023b20 to 0x01c938 (0x71e7 bytes) 000226 1787385379.410692 read 0x002129 thru 0x0048e0 (0x27b8 bytes) 000228 1787385379.421678 trunc from 0x01c939 to 0x01e78d (0x1e55 bytes) 000229 1787385379.444782 mapwrite 0x00cd99 thru 0x017dd3 (0xb03b bytes) 000230 1787385379.545409 mapwrite 0x028c0c thru 0x036c9d (0xe092 bytes) 000231 1787385379.623542 trunc from 0x036c9e to 0x00f3ac (0x278f1 bytes) 000232 1787385379.642520 write 0x01613b thru 0x018498 (0x235e bytes) 000234 1787385379.646975 read 0x00afa9 thru 0x011be1 (0x6c39 bytes) 000235 1787385379.656896 mapread 0x00ac57 thru 0x0162bc (0xb666 bytes) 000236 1787385379.659542 read 0x00ab30 thru 0x018498 (0xd969 bytes) 000237 1787385379.665449 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x18499): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18499): Mirror 2: 0xd3b6f3d (stale) CRC-32 checksum value for chunk [0, 0x18499): Mirror 1: 0x6e359d76 Mirror 3: 0x6e359d76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18499: skipped 000238 1787385380.501421 mapwrite 0x02677d thru 0x02ff2e (0x97b2 bytes) 000239 1787385380.757242 trunc from 0x02ff2f to 0x0201a9 (0xfd85 bytes) 000241 1787385380.799529 MIRROR_RESYNC 3 mirrors 000243 1787385381.664629 trunc from 0x0201aa to 0x000bc6 (0x1f5e3 bytes) 000244 1787385381.731201 read 0x0000a1 thru 0x000bc6 (0xb26 bytes) 000245 1787385381.736414 trunc from 0x000bc7 to 0x003e97 (0x32d1 bytes) 000246 1787385381.761228 mapread 0x001b18 thru 0x003e97 (0x2380 bytes) 000247 1787385381.780618 mapread 0x002873 thru 0x003e97 (0x1625 bytes) 000248 1787385381.782309 mapread 0x0035a9 thru 0x003e97 (0x8ef bytes) 000250 1787385381.785393 read 0x00140a thru 0x003e97 (0x2a8e bytes) 000251 1787385381.786687 read 0x000cc3 thru 0x003e97 (0x31d5 bytes) 000252 1787385381.788553 read 0x002280 thru 0x003e97 (0x1c18 bytes) 000253 1787385381.790473 mapread 0x001bbd thru 0x003e97 (0x22db bytes) 000255 1787385381.799153 mapwrite 0x024f45 thru 0x031eda (0xcf96 bytes) 000258 1787385381.890488 MIRROR_RESYNC 3 mirrors 000260 1787385382.538082 read 0x01d542 thru 0x022f8d (0x5a4c bytes) 000261 1787385382.551401 trunc from 0x031edb to 0x03a97a (0x8aa0 bytes) 000263 1787385382.630284 mapread 0x02bd44 thru 0x032252 (0x650f bytes) 000264 1787385382.659174 mapread 0x020f80 thru 0x0283cd (0x744e bytes) 000265 1787385382.673110 mapread 0x02db17 thru 0x032947 (0x4e31 bytes) 000268 1787385382.676443 mapread 0x01d823 thru 0x020741 (0x2f1f bytes) 000273 1787385382.689885 MIRROR_RESYNC 3 mirrors 000274 1787385383.433806 trunc from 0x03a97b to 0x019b2b (0x20e4f bytes) 000277 1787385383.536025 mapwrite 0x017957 thru 0x027897 (0xff41 bytes) 000278 1787385383.709170 trunc from 0x027898 to 0x01d8b9 (0x9fde bytes) 000279 1787385383.731863 mapread 0x009978 thru 0x009afd (0x186 bytes) 000280 1787385383.749785 mapwrite 0x0345ca thru 0x03ffff (0xba36 bytes) 000281 1787385383.853646 write 0x0209cb thru 0x02bbdc (0xb212 bytes) 000284 1787385383.873419 mapwrite 0x03bc04 thru 0x03ffff (0x43fc bytes) 000285 1787385383.948200 read 0x035736 thru 0x03ffff (0xa8ca bytes) 000287 1787385383.955734 mapread 0x00d84d thru 0x01b868 (0xe01c bytes) 000288 1787385383.960221 write 0x039460 thru 0x03ffff (0x6ba0 bytes) 000290 1787385383.963446 mapread 0x028038 thru 0x029724 (0x16ed bytes) 000292 1787385383.966186 read 0x030c9e thru 0x0399b4 (0x8d17 bytes) 000293 1787385383.967647 mapwrite 0x02d80d thru 0x039ebd (0xc6b1 bytes) 000295 1787385384.034907 mapwrite 0x03785b thru 0x03d904 (0x60aa bytes) 000296 1787385384.114630 mapread 0x03c4de thru 0x03ffff (0x3b22 bytes) 000299 1787385384.120412 trunc from 0x040000 to 0x01ceac (0x23153 bytes) 000301 1787385384.145816 write 0x0237aa thru 0x026443 (0x2c9a bytes) 000302 1787385384.152619 MIRROR_RESYNC 3 mirrors 000303 1787385384.818625 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000304 1787385385.102844 mapwrite 0x0051fb thru 0x006d59 (0x1b5f bytes) 000306 1787385385.273261 mapread 0x023211 thru 0x026443 (0x3233 bytes) 000307 1787385385.300534 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000308 1787385385.455627 mapwrite 0x02ef43 thru 0x0354e4 (0x65a2 bytes) 000309 1787385385.605540 MIRROR_EXTEND to 2 mirrors 000310 1787385386.232544 write 0x036288 thru 0x036ca9 (0xa22 bytes) 000312 1787385386.337675 read 0x011a0b thru 0x0163fa (0x49f0 bytes) 000316 1787385386.352246 MIRROR_RESYNC 2 mirrors 000321 1787385387.032318 mapread 0x00ace8 thru 0x00f8c6 (0x4bdf bytes) 000322 1787385387.060576 write 0x03071d thru 0x032082 (0x1966 bytes) 000323 1787385387.145287 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000324 1787385387.277715 trunc from 0x036caa to 0x032863 (0x4446 bytes) 000325 1787385387.316945 mapread 0x012b77 thru 0x018cfc (0x6186 bytes) 000326 1787385387.333543 trunc from 0x032864 to 0x00f947 (0x22f1c bytes) 000327 1787385387.352270 write 0x032db2 thru 0x03edf2 (0xc041 bytes) 000330 1787385387.356475 mapread 0x00b29f thru 0x00cbe1 (0x1943 bytes) 000331 1787385387.374292 write 0x019775 thru 0x02546f (0xbcfb bytes) 000332 1787385387.387031 mapwrite 0x02ffa8 thru 0x0316e1 (0x173a bytes) 000335 1787385387.483432 write 0x029b35 thru 0x02fa64 (0x5f30 bytes) 000336 1787385387.485180 mapwrite 0x0170d8 thru 0x01845c (0x1385 bytes) 000337 1787385387.554286 read 0x01874a thru 0x01a7ff (0x20b6 bytes) 000338 1787385387.555581 read 0x01a267 thru 0x022e7a (0x8c14 bytes) 000339 1787385387.558116 read 0x03c828 thru 0x03ed88 (0x2561 bytes) 000340 1787385387.559693 read 0x027a8d thru 0x02a129 (0x269d bytes) 000342 1787385387.573427 mapwrite 0x02e48f thru 0x037532 (0x90a4 bytes) 000343 1787385387.618536 trunc from 0x03edf3 to 0x00655e (0x38894 bytes) 000344 1787385387.646205 trunc from 0x00655f to 0x031ee0 (0x2b982 bytes) 000347 1787385387.685006 trunc from 0x031ee1 to 0x001e6b (0x30075 bytes) 000349 1787385387.719817 mapread 0x000d42 thru 0x001e6b (0x112a bytes) 000350 1787385387.720952 write 0x00e549 thru 0x017214 (0x8ccc bytes) 000351 1787385387.723751 trunc from 0x017215 to 0x018c8f (0x1a7b bytes) 000353 1787385387.745177 write 0x011b97 thru 0x0142c7 (0x2731 bytes) 000358 1787385387.750105 mapread 0x016b45 thru 0x018c8f (0x214b bytes) 000359 1787385387.755233 write 0x02f316 thru 0x03ccce (0xd9b9 bytes) 000362 1787385387.759149 mapread 0x008e0b thru 0x011e36 (0x902c bytes) 000363 1787385387.787388 mapwrite 0x032872 thru 0x03ffff (0xd78e bytes) 000365 1787385387.918456 write 0x011692 thru 0x01f241 (0xdbb0 bytes) 000366 1787385387.931781 write 0x032a75 thru 0x03c72d (0x9cb9 bytes) 000367 1787385387.934680 trunc from 0x040000 to 0x0005f2 (0x3fa0d bytes) 000369 1787385387.989525 write 0x03ee1f thru 0x03ffff (0x11e1 bytes) 000370 1787385387.992632 trunc from 0x040000 to 0x01cb12 (0x234ed bytes) 000373 1787385388.045793 MIRROR_EXTEND to 2 mirrors 000374 1787385388.806677 read 0x00af37 thru 0x00db6d (0x2c37 bytes) 000375 1787385388.824373 mapwrite 0x0130f9 thru 0x01ef97 (0xbe9f bytes) 000376 1787385389.025420 read 0x0100a3 thru 0x015a09 (0x5967 bytes) 000377 1787385389.027802 mapread 0x01be94 thru 0x01ef97 (0x3104 bytes) 000378 1787385389.030556 trunc from 0x01ef98 to 0x0047e4 (0x1a7b3 bytes) 000381 1787385389.064608 write 0x017cdb thru 0x026583 (0xe8a9 bytes) 000382 1787385389.069177 write 0x02c7b6 thru 0x035a4c (0x9297 bytes) 000384 1787385389.072827 read 0x019624 thru 0x024c19 (0xb5f6 bytes) 000386 1787385389.075658 trunc from 0x035a4d to 0x032b36 (0x2f16 bytes) 000387 1787385389.096221 mapread 0x006aca thru 0x00d7da (0x6d11 bytes) 000388 1787385389.114516 mapread 0x005844 thru 0x0074b8 (0x1c75 bytes) 000389 1787385389.116822 write 0x03b719 thru 0x03ffff (0x48e7 bytes) 000390 1787385389.119412 read 0x00645a thru 0x00f5da (0x9181 bytes) 000392 1787385389.126778 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1483d431 Mirror 3: 0x1483d431 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000393 1787385389.945760 trunc from 0x040000 to 0x035247 (0xadb8 bytes) 000394 1787385390.057355 mapread 0x021773 thru 0x026883 (0x5111 bytes) 000397 1787385390.082553 read 0x02f051 thru 0x0343bf (0x536f bytes) 000398 1787385390.092175 read 0x02e371 thru 0x035247 (0x6ed7 bytes) 000399 1787385390.101349 read 0x00acf7 thru 0x00d36e (0x2678 bytes) 000403 1787385390.107255 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35248): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35248): Mirror 2: 0x5e135c48 (stale) Mirror 3: 0xc3a45ec0 (stale) CRC-32 checksum value for chunk [0, 0x35248): Mirror 1: 0xc3a45ec0 Mirror 4: 0xc3a45ec0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35248: skipped 000406 1787385391.003658 write 0x02be5c thru 0x0397e2 (0xd987 bytes) 000407 1787385391.070634 mapread 0x013306 thru 0x01f66e (0xc369 bytes) truncating to largest ever: 0x3f02c 000409 1787385391.097684 trunc from 0x0397e3 to 0x03f02b (0x5849 bytes) 000411 1787385391.118982 read 0x012c93 thru 0x01afd0 (0x833e bytes) 000412 1787385391.124099 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f02c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f02c): Mirror 2: 0xada96232 (stale) Mirror 3: 0x9c467cdf (stale) Mirror 4: 0x3ff284c6 (stale) CRC-32 checksum value for chunk [0, 0x3f02c): Mirror 1: 0x41f51222 Mirror 5: 0x41f51222 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f02c: skipped 000413 1787385391.799747 mapwrite 0x006c0f thru 0x011b1a (0xaf0c bytes) 000414 1787385392.055773 write 0x003143 thru 0x00b23a (0x80f8 bytes) 000416 1787385392.059632 trunc from 0x03f02c to 0x03d9ec (0x163f bytes) 000417 1787385392.104173 mapread 0x035405 thru 0x03b57a (0x6176 bytes) 000418 1787385392.113601 mapwrite 0x011a69 thru 0x017cdd (0x6275 bytes) 000420 1787385392.164184 write 0x02978b thru 0x035c1a (0xc490 bytes) 000421 1787385392.173345 mapwrite 0x0273f1 thru 0x02bc21 (0x4831 bytes) 000424 1787385392.286901 mapwrite 0x0271ee thru 0x033f63 (0xcd76 bytes) 000425 1787385392.363582 mapwrite 0x002f63 thru 0x0040d1 (0x116f bytes) 000427 1787385392.402634 mapwrite 0x012985 thru 0x0211a1 (0xe81d bytes) 000428 1787385392.465635 mapread 0x01b784 thru 0x020c9a (0x5517 bytes) 000429 1787385392.467055 trunc from 0x03d9ed to 0x031af1 (0xbefb bytes) 000433 1787385392.490872 mapwrite 0x02caca thru 0x02f5a7 (0x2ade bytes) 000434 1787385392.528773 write 0x009b98 thru 0x013ec6 (0xa32f bytes) 000435 1787385392.530788 mapwrite 0x0262e4 thru 0x034fdc (0xecf9 bytes) 000436 1787385392.611872 write 0x00b0d9 thru 0x00e9ec (0x3914 bytes) 000439 1787385392.615535 trunc from 0x034fdd to 0x01c1b2 (0x18e2a bytes) 000440 1787385392.646034 write 0x02d99a thru 0x02ee9a (0x1501 bytes) 000441 1787385392.649823 mapwrite 0x03e112 thru 0x03e5e6 (0x4d5 bytes) 000444 1787385392.729983 write 0x00d74a thru 0x00f196 (0x1a4d bytes) 000446 1787385392.735212 trunc from 0x03e5e7 to 0x0180a2 (0x26544 bytes) 000448 1787385392.754054 read 0x00fb94 thru 0x017d59 (0x81c6 bytes) 000449 1787385392.756249 mapwrite 0x02577a thru 0x0286e8 (0x2f6f bytes) 000450 1787385392.839344 read 0x007621 thru 0x00f06d (0x7a4d bytes) 000451 1787385392.841644 mapwrite 0x006ec2 thru 0x01669b (0xf7da bytes) 000452 1787385392.933728 write 0x006fa0 thru 0x013b2a (0xcb8b bytes) 000453 1787385392.935595 write 0x0250fc thru 0x03100a (0xbf0f bytes) 000455 1787385392.939152 mapwrite 0x0059e7 thru 0x00aae3 (0x50fd bytes) 000456 1787385392.990245 trunc from 0x03100b to 0x029a66 (0x75a4 bytes) 000458 1787385393.007463 mapwrite 0x012393 thru 0x021c97 (0xf905 bytes) 000460 1787385393.082869 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29a67): Mirror 2: 0x1c464972 (stale) Mirror 4: 0x343dea88 (stale) Mirror 5: 0x343dea88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29a67): Mirror 2: 0x1c464972 (stale) Mirror 4: 0x343dea88 (stale) Mirror 5: 0x343dea88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29a67: skipped 000461 1787385393.555748 mapwrite 0x03ae1e thru 0x03c156 (0x1339 bytes) 000463 1787385393.639676 read 0x01b6ce thru 0x022598 (0x6ecb bytes) 000464 1787385393.648512 mapwrite 0x01f8cf thru 0x0272aa (0x79dc bytes) 000465 1787385393.716386 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c157): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c157): Mirror 2: 0x253c232d (stale) Mirror 4: 0x8a1141e4 (stale) Mirror 5: 0xd50d8c0f (stale) CRC-32 checksum value for chunk [0, 0x3c157): Mirror 1: 0x539b5993 Mirror 6: 0x539b5993 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c157: skipped 000466 1787385394.979660 write 0x01015f thru 0x01d707 (0xd5a9 bytes) 000468 1787385395.075832 mapread 0x014ac4 thru 0x0225c8 (0xdb05 bytes) 000473 1787385395.120499 mapwrite 0x03c71c thru 0x03ffff (0x38e4 bytes) 000475 1787385395.277857 mapwrite 0x030bf0 thru 0x03da09 (0xce1a bytes) 000476 1787385395.348691 mapwrite 0x023229 thru 0x02a6e5 (0x74bd bytes) 000477 1787385395.427422 read 0x00ce77 thru 0x0154bd (0x8647 bytes) 000478 1787385395.444883 mapread 0x001b3d thru 0x003fed (0x24b1 bytes) 000479 1787385395.477823 read 0x0335e1 thru 0x03d97e (0xa39e bytes) 000480 1787385395.499145 MIRROR_RESYNC 5 mirrors 000481 1787385396.673421 mapread 0x020f25 thru 0x0294e2 (0x85be bytes) 000482 1787385396.698585 write 0x0017a5 thru 0x003840 (0x209c bytes) 000483 1787385396.830366 trunc from 0x040000 to 0x009c85 (0x3637a bytes) 000484 1787385396.858563 mapwrite 0x0144ec thru 0x01c426 (0x7f3b bytes) 000485 1787385396.927345 write 0x01d57c thru 0x02b3f9 (0xde7e bytes) 000486 1787385396.934595 write 0x03fbb2 thru 0x03ffff (0x44e bytes) 000487 1787385396.937149 write 0x00871c thru 0x00e9d0 (0x62b5 bytes) 000488 1787385396.943884 read 0x03639d thru 0x03ffff (0x9c63 bytes) 000489 1787385396.952105 write 0x004c98 thru 0x007029 (0x2392 bytes) 000490 1787385396.963797 read 0x0035ef thru 0x00703f (0x3a51 bytes) 000493 1787385396.966833 read 0x0159bb thru 0x021c46 (0xc28c bytes) 000494 1787385396.967832 mapwrite 0x009c23 thru 0x015fd7 (0xc3b5 bytes) 000495 1787385397.045044 trunc from 0x040000 to 0x002b00 (0x3d4ff bytes) 000496 1787385397.077417 trunc from 0x002b01 to 0x001f32 (0xbce bytes) 000499 1787385397.105776 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f33): Mirror 2: 0xa15cb5ba (stale) Mirror 5: 0xa15cb5ba (stale) Mirror 6: 0xa15cb5ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f33): Mirror 2: 0xa15cb5ba (stale) Mirror 5: 0xa15cb5ba (stale) Mirror 6: 0xa15cb5ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f33: skipped 000502 1787385397.464565 write 0x015e92 thru 0x01d958 (0x7ac7 bytes) 000504 1787385397.472427 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1d959): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d959): Mirror 2: 0x168e1ac5 (stale) Mirror 5: 0x168e1ac5 (stale) Mirror 6: 0x168e1ac5 (stale) CRC-32 checksum value for chunk [0, 0x1d959): Mirror 1: 0x21285e21 Mirror 7: 0x21285e21 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d959: skipped 000505 1787385398.502035 write 0x03bb9c thru 0x03ffff (0x4464 bytes) 000510 1787385398.651649 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf8e01841 (stale) Mirror 5: 0xf8e01841 (stale) Mirror 6: 0xf8e01841 (stale) Mirror 7: 0xbfc7670b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb8b3c5d9 Mirror 8: 0xb8b3c5d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1787385399.826878 trunc from 0x040000 to 0x007267 (0x38d98 bytes) 000514 1787385399.968486 mapwrite 0x001cf0 thru 0x0062c4 (0x45d5 bytes) 000515 1787385400.073850 write 0x014afe thru 0x01f641 (0xab44 bytes) 000516 1787385400.079251 read 0x01619a thru 0x01bfe8 (0x5e4f bytes) 000517 1787385400.080887 write 0x02d550 thru 0x03cc4e (0xf6ff bytes) 000518 1787385400.084020 mapread 0x03173b thru 0x03bde5 (0xa6ab bytes) 000519 1787385400.086321 read 0x027a57 thru 0x032878 (0xae22 bytes) 000520 1787385400.098041 mapread 0x01211e thru 0x013774 (0x1657 bytes) 000521 1787385400.100126 mapwrite 0x023431 thru 0x03291d (0xf4ed bytes) 000522 1787385400.270866 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc4f): Mirror 5: 0xea5eec63 (stale) Mirror 6: 0xea5eec63 (stale) Mirror 7: 0xce12ccf5 (stale) Mirror 8: 0x791c89c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc4f): Mirror 5: 0xea5eec63 (stale) Mirror 6: 0xea5eec63 (stale) Mirror 7: 0xce12ccf5 (stale) Mirror 8: 0x791c89c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc4f: skipped 000525 1787385400.733202 read 0x0178bf thru 0x01ee52 (0x7594 bytes) 000526 1787385400.745291 mapread 0x008bd8 thru 0x00d553 (0x497c bytes) 000528 1787385400.768172 mapread 0x01fc33 thru 0x021c41 (0x200f bytes) 000529 1787385400.781129 read 0x02ebb1 thru 0x03b5f5 (0xca45 bytes) 000530 1787385400.793119 mapread 0x00a99e thru 0x00f37d (0x49e0 bytes) 000532 1787385400.796210 trunc from 0x03cc4f to 0x02fa48 (0xd206 bytes) 000535 1787385400.835240 mapread 0x018eb3 thru 0x01e7b9 (0x5907 bytes) 000536 1787385400.838695 mapread 0x02de53 thru 0x02fa48 (0x1bf6 bytes) 000537 1787385400.840088 write 0x03a396 thru 0x03ffff (0x5c6a bytes) 000539 1787385400.847183 write 0x024cf1 thru 0x033389 (0xe699 bytes) 000541 1787385400.855728 mapwrite 0x03319e thru 0x036691 (0x34f4 bytes) 000542 1787385400.934822 mapwrite 0x032e7a thru 0x037795 (0x491c bytes) 000544 1787385400.981842 write 0x013040 thru 0x01f0da (0xc09b bytes) 000545 1787385400.989296 trunc from 0x040000 to 0x0187db (0x27824 bytes) 000547 1787385401.034756 write 0x0175f1 thru 0x0263ae (0xedbe bytes) 000548 1787385401.040834 write 0x0105b7 thru 0x01d1c7 (0xcc11 bytes) 000549 1787385401.044168 mapread 0x00fc7b thru 0x01d9f8 (0xdd7e bytes) 000551 1787385401.048315 read 0x005d96 thru 0x015583 (0xf7ee bytes) 000555 1787385401.062086 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x263af): Mirror 5: 0x9fcc42f8 (stale) Mirror 7: 0x1eb6a2a (stale) Mirror 8: 0x1eb6a2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x263af): Mirror 5: 0x9fcc42f8 (stale) Mirror 7: 0x1eb6a2a (stale) Mirror 8: 0x1eb6a2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x263af: skipped 000556 1787385401.547425 trunc from 0x0263af to 0x03177d (0xb3cf bytes) 000557 1787385401.575561 mapread 0x00a812 thru 0x00bc53 (0x1442 bytes) 000558 1787385401.597521 read 0x00d93b thru 0x01a9c7 (0xd08d bytes) 000559 1787385401.621178 write 0x009a77 thru 0x0102e6 (0x6870 bytes) 000560 1787385401.637612 mapwrite 0x01f0fb thru 0x028c0c (0x9b12 bytes) 000561 1787385401.772460 trunc from 0x03177e to 0x03e60e (0xce91 bytes) 000562 1787385401.799148 mapwrite 0x003796 thru 0x004943 (0x11ae bytes) 000563 1787385401.874318 write 0x0255b8 thru 0x027ae8 (0x2531 bytes) 000565 1787385401.878384 mapread 0x01a75a thru 0x023db3 (0x965a bytes) 000566 1787385401.880293 trunc from 0x03e60f to 0x0342ee (0xa320 bytes) 000567 1787385401.905580 mapwrite 0x016c86 thru 0x01d4b4 (0x682f bytes) 000568 1787385401.978729 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342ef): Mirror 7: 0xbc3d7bda (stale) Mirror 8: 0xbc3d7bda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342ef): Mirror 7: 0xbc3d7bda (stale) Mirror 8: 0xbc3d7bda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342ef: skipped 000571 1787385402.388816 write 0x021a88 thru 0x02cf62 (0xb4db bytes) 000573 1787385402.401860 mapwrite 0x01eb6a thru 0x01f147 (0x5de bytes) 000574 1787385402.496158 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342ef): Mirror 7: 0xbc3d7bda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342ef): Mirror 7: 0xbc3d7bda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342ef: skipped 000576 1787385402.906578 mapwrite 0x031d73 thru 0x0324cd (0x75b bytes) 000578 1787385402.960044 write 0x03b257 thru 0x03da65 (0x280f bytes) 000580 1787385402.963245 mapread 0x02050c thru 0x02b397 (0xae8c bytes) 000583 1787385402.984219 write 0x009ccd thru 0x015621 (0xb955 bytes) 000584 1787385402.998987 trunc from 0x03da66 to 0x00ca0f (0x31056 bytes) 000585 1787385403.028300 mapread 0x001192 thru 0x00adec (0x9c5b bytes) 000586 1787385403.043528 mapwrite 0x01761c thru 0x0257fb (0xe1e0 bytes) 000587 1787385403.136126 mapread 0x01f3bf thru 0x0257fb (0x643d bytes) 000588 1787385403.137452 trunc from 0x0257fc to 0x00a7e5 (0x1b016 bytes) 000589 1787385403.166792 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xa7e6): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa7e6): Mirror 7: 0x76cb2cd2 (stale) CRC-32 checksum value for chunk [0, 0xa7e6): Mirror 1: 0xf30cc629 Mirror 8: 0xf30cc629 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa7e6: skipped 000590 1787385404.323606 read 0x007c17 thru 0x009956 (0x1d40 bytes) 000591 1787385404.340309 trunc from 0x00a7e6 to 0x012e6a (0x8685 bytes) 000593 1787385404.460899 write 0x0316f5 thru 0x03ffff (0xe90b bytes) 000594 1787385404.464285 trunc from 0x040000 to 0x01ab0b (0x254f4 bytes) 000598 1787385404.494395 write 0x005864 thru 0x013070 (0xd80d bytes) 000600 1787385404.505907 mapwrite 0x02468b thru 0x029ab9 (0x542f bytes) 000602 1787385404.582098 read 0x010d28 thru 0x018aad (0x7d86 bytes) 000604 1787385404.593744 mapread 0x011cb0 thru 0x016f5c (0x52ad bytes) 000606 1787385404.597769 write 0x024fd1 thru 0x02ddda (0x8e0a bytes) 000613 1787385404.611406 MIRROR_RESYNC 3 mirrors 000616 1787385405.523841 write 0x01e03b thru 0x021f59 (0x3f1f bytes) 000617 1787385405.588129 mapread 0x00d2cf thru 0x00ef06 (0x1c38 bytes) 000619 1787385405.602688 MIRROR_RESYNC 3 mirrors 000620 1787385406.361671 mapread 0x00b442 thru 0x014921 (0x94e0 bytes) 000621 1787385406.382881 read 0x01d342 thru 0x028cbe (0xb97d bytes) 000623 1787385406.396464 mapread 0x006731 thru 0x00b47a (0x4d4a bytes) 000624 1787385406.401197 MIRROR_EXTEND to 4 mirrors 000626 1787385407.078556 read 0x00ebb4 thru 0x010fad (0x23fa bytes) 000627 1787385407.083792 read 0x01fc7a thru 0x021ee5 (0x226c bytes) 000628 1787385407.097208 trunc from 0x02dddb to 0x02dd8a (0x50 bytes) 000630 1787385407.176069 write 0x03d08c thru 0x03ffff (0x2f74 bytes) 000632 1787385407.179245 mapwrite 0x00b028 thru 0x00bd82 (0xd5b bytes) 000633 1787385407.263302 trunc from 0x040000 to 0x01586c (0x2a793 bytes) 000637 1787385407.292001 read 0x00e079 thru 0x01586c (0x77f4 bytes) 000642 1787385407.307316 mapwrite 0x034cdf thru 0x03e5fa (0x991c bytes) 000644 1787385407.405012 mapwrite 0x009206 thru 0x017743 (0xe53e bytes) 000645 1787385407.481232 mapread 0x038734 thru 0x03e5fa (0x5ec7 bytes) 000648 1787385407.486537 mapread 0x003ff3 thru 0x005ab6 (0x1ac4 bytes) 000653 1787385407.493894 trunc from 0x03e5fb to 0x031422 (0xd1d8 bytes) 000654 1787385407.525762 mapwrite 0x021956 thru 0x02e4b3 (0xcb5e bytes) 000655 1787385407.605793 mapread 0x000048 thru 0x00baae (0xba67 bytes) 000656 1787385407.607868 read 0x023602 thru 0x031422 (0xde21 bytes) 000657 1787385407.609509 trunc from 0x031423 to 0x01420a (0x1d218 bytes) 000661 1787385407.645585 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1420b): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1420b): Mirror 7: 0x58e3aea5 (stale) Mirror 8: 0x58e3aea5 (stale) Mirror 9: 0x58e3aea5 (stale) CRC-32 checksum value for chunk [0, 0x1420b): Mirror 1: 0xcab32ada Mirror 10: 0xcab32ada lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1420b: skipped 000663 1787385408.709288 mapwrite 0x021d83 thru 0x02baa5 (0x9d23 bytes) 000664 1787385409.032484 read 0x01859c thru 0x022698 (0xa0fd bytes) 000665 1787385409.051321 mapwrite 0x02f8a2 thru 0x032200 (0x295f bytes) 000668 1787385409.235400 write 0x012ddc thru 0x01a072 (0x7297 bytes) 000671 1787385409.246136 write 0x022ca2 thru 0x028ec7 (0x6226 bytes) 000672 1787385409.261995 write 0x000fd6 thru 0x00fdef (0xee1a bytes) 000673 1787385409.280567 mapwrite 0x03a647 thru 0x03dfb2 (0x396c bytes) 000675 1787385409.376609 mapread 0x011c47 thru 0x01b7c4 (0x9b7e bytes) 000677 1787385409.402198 MIRROR_RESYNC 5 mirrors 000679 1787385410.640579 read 0x03b8df thru 0x03dfb2 (0x26d4 bytes) 000680 1787385410.646410 read 0x024f96 thru 0x0304a4 (0xb50f bytes) 000681 1787385410.666029 mapread 0x0225d1 thru 0x022ffa (0xa2a bytes) 000682 1787385410.671568 mapread 0x02449a thru 0x028305 (0x3e6c bytes) 000684 1787385410.677496 trunc from 0x03dfb3 to 0x012a38 (0x2b57a bytes) 000688 1787385410.799065 mapwrite 0x00a2f6 thru 0x01097a (0x6685 bytes) 000689 1787385410.894988 mapread 0x0010c9 thru 0x0106fa (0xf632 bytes) 000695 1787385410.966314 mapwrite 0x03ac3a thru 0x03ffff (0x53c6 bytes) 000697 1787385411.119226 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe961c5d6 (stale) Mirror 9: 0xe961c5d6 (stale) Mirror 10: 0xe961c5d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe961c5d6 (stale) Mirror 9: 0xe961c5d6 (stale) Mirror 10: 0xe961c5d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000699 1787385411.535145 mapwrite 0x030f23 thru 0x0394e6 (0x85c4 bytes) 000700 1787385411.620804 mapwrite 0x029209 thru 0x02c1a9 (0x2fa1 bytes) 000704 1787385411.682478 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe961c5d6 (stale) Mirror 9: 0xe961c5d6 (stale) Mirror 10: 0xe961c5d6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x69fe7a72 Mirror 11: 0x69fe7a72 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000706 1787385412.365679 write 0x02b79e thru 0x0352b2 (0x9b15 bytes) 000708 1787385412.454470 mapwrite 0x032bd0 thru 0x03ffff (0xd430 bytes) 000709 1787385412.527501 read 0x033051 thru 0x0363e7 (0x3397 bytes) 000710 1787385412.528768 mapread 0x02f708 thru 0x03346c (0x3d65 bytes) 000711 1787385412.530533 mapwrite 0x038f7e thru 0x03ffff (0x7082 bytes) 000715 1787385412.569311 write 0x029209 thru 0x02fd0d (0x6b05 bytes) 000716 1787385412.575868 trunc from 0x040000 to 0x030cb9 (0xf346 bytes) 000718 1787385412.618783 read 0x014a17 thru 0x0161af (0x1799 bytes) 000719 1787385412.629549 mapread 0x005019 thru 0x0136a9 (0xe691 bytes) truncating to largest ever: 0x3f3eb 000721 1787385412.634260 trunc from 0x030cba to 0x03f3ea (0xe731 bytes) 000722 1787385412.656216 trunc from 0x03f3eb to 0x0279e1 (0x17a09 bytes) 000723 1787385412.676827 mapwrite 0x0229aa thru 0x026b2c (0x4183 bytes) 000724 1787385412.719208 read 0x01d918 thru 0x024b11 (0x71fa bytes) 000726 1787385412.721978 trunc from 0x0279e2 to 0x038b9e (0x111bd bytes) 000728 1787385412.743689 mapread 0x02e10c thru 0x0304ce (0x23c3 bytes) 000730 1787385412.756243 trunc from 0x038b9f to 0x01bd33 (0x1ce6b bytes) 000732 1787385412.780439 read 0x011618 thru 0x012ebe (0x18a7 bytes) 000733 1787385412.781805 mapread 0x00546c thru 0x00b346 (0x5edb bytes) 000734 1787385412.788068 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1bd34): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd34): Mirror 7: 0x6328844c (stale) Mirror 9: 0x6328844c (stale) Mirror 10: 0x6328844c (stale) Mirror 11: 0xbcea4904 (stale) CRC-32 checksum value for chunk [0, 0x1bd34): Mirror 1: 0xbcea4904 Mirror 12: 0xbcea4904 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd34: skipped 000735 1787385413.543209 trunc from 0x01bd34 to 0x0151c6 (0x6b6d bytes) 000738 1787385413.658490 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x151c7): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151c7): Mirror 7: 0x6e64c33a (stale) Mirror 9: 0x6e64c33a (stale) Mirror 10: 0x6e64c33a (stale) Mirror 11: 0x1a0da308 (stale) Mirror 12: 0x1a0da308 (stale) CRC-32 checksum value for chunk [0, 0x151c7): Mirror 1: 0x1a0da308 Mirror 13: 0x1a0da308 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151c7: skipped 000740 1787385414.720529 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x151c7): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151c7): Mirror 7: 0x6e64c33a (stale) Mirror 9: 0x6e64c33a (stale) Mirror 10: 0x6e64c33a (stale) Mirror 11: 0x1a0da308 (stale) Mirror 12: 0x1a0da308 (stale) CRC-32 checksum value for chunk [0, 0x151c7): Mirror 1: 0x1a0da308 Mirror 13: 0x1a0da308 Mirror 14: 0x1a0da308 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151c7: skipped 000741 1787385416.042439 trunc from 0x0151c7 to 0x0208b4 (0xb6ee bytes) 000743 1787385416.151498 mapread 0x0130fd thru 0x01bddb (0x8cdf bytes) 000744 1787385416.177569 read 0x00a855 thru 0x00f1d3 (0x497f bytes) 000745 1787385416.189219 write 0x03cb7a thru 0x03ffff (0x3486 bytes) 000748 1787385416.193371 write 0x02fb71 thru 0x02fbb5 (0x45 bytes) 000749 1787385416.199642 trunc from 0x040000 to 0x01233a (0x2dcc5 bytes) 000750 1787385416.218506 mapwrite 0x030b57 thru 0x0323b2 (0x185c bytes) 000751 1787385416.284398 mapwrite 0x000327 thru 0x000be0 (0x8ba bytes) 000752 1787385416.341578 write 0x00048f thru 0x006b3c (0x66ae bytes) 000753 1787385416.342914 write 0x021aa8 thru 0x02f783 (0xdcdc bytes) 000754 1787385416.363174 read 0x022982 thru 0x0232c5 (0x944 bytes) 000755 1787385416.365623 mapread 0x006817 thru 0x013a43 (0xd22d bytes) 000757 1787385416.392509 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x323b3): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x323b3): Mirror 7: 0x928f4b84 (stale) Mirror 9: 0x928f4b84 (stale) Mirror 10: 0x928f4b84 (stale) Mirror 11: 0x3fa5032c (stale) Mirror 12: 0x88f755a2 (stale) Mirror 13: 0x88f755a2 (stale) Mirror 14: 0x88f755a2 (stale) CRC-32 checksum value for chunk [0, 0x323b3): Mirror 1: 0x86023dfb Mirror 15: 0x86023dfb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x323b3: skipped 000760 1787385417.309767 mapwrite 0x016f51 thru 0x01a988 (0x3a38 bytes) 000763 1787385417.583821 MIRROR_RESYNC 9 mirrors 000765 1787385419.477610 mapwrite 0x034648 thru 0x03c242 (0x7bfb bytes) 000767 1787385419.665326 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3c243): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c243): Mirror 7: 0x543cc7f2 (stale) Mirror 9: 0x543cc7f2 (stale) Mirror 10: 0x543cc7f2 (stale) Mirror 11: 0x543cc7f2 (stale) Mirror 12: 0x543cc7f2 (stale) Mirror 13: 0x543cc7f2 (stale) Mirror 14: 0x543cc7f2 (stale) Mirror 15: 0x543cc7f2 (stale) CRC-32 checksum value for chunk [0, 0x3c243): Mirror 1: 0x3e798452 Mirror 16: 0x3e798452 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c243: skipped 000768 1787385421.140439 read 0x0039eb thru 0x0066df (0x2cf5 bytes) 000769 1787385421.179506 write 0x01d976 thru 0x0274d8 (0x9b63 bytes) 000770 1787385421.331835 mapwrite 0x02b1aa thru 0x030661 (0x54b8 bytes) 000771 1787385421.496547 read 0x03395a thru 0x03c242 (0x88e9 bytes) 000772 1787385421.539067 mapwrite 0x019734 thru 0x027da5 (0xe672 bytes) 000773 1787385421.644811 read 0x00066e thru 0x00e553 (0xdee6 bytes) 000775 1787385421.646251 write 0x02a6ce thru 0x03954d (0xee80 bytes) 000776 1787385421.649716 write 0x01c53a thru 0x020ab2 (0x4579 bytes) 000777 1787385421.652125 read 0x0116b1 thru 0x017e1c (0x676c bytes) 000778 1787385421.654100 mapread 0x035511 thru 0x03c242 (0x6d32 bytes) 000779 1787385421.656606 trunc from 0x03c243 to 0x026d54 (0x154ee bytes) 000780 1787385421.706385 trunc from 0x026d55 to 0x02e391 (0x763d bytes) 000782 1787385421.730753 mapwrite 0x00bdae thru 0x01862b (0xc87e bytes) 000784 1787385421.823289 trunc from 0x02e392 to 0x02665d (0x7d34 bytes) 000785 1787385421.854456 trunc from 0x02665e to 0x023623 (0x303a bytes) 000786 1787385421.879684 mapwrite 0x01ec08 thru 0x026676 (0x7a6f bytes) 000789 1787385422.012040 MIRROR_RESYNC 10 mirrors 000791 1787385424.105142 write 0x01c1d8 thru 0x02147c (0x52a5 bytes) 000793 1787385424.281763 mapwrite 0x032334 thru 0x03f20e (0xcedb bytes) 000794 1787385424.495229 write 0x03d1f2 thru 0x03e18f (0xf9e bytes) 000795 1787385424.505127 mapread 0x0164d7 thru 0x01acb3 (0x47dd bytes) 000796 1787385424.517918 trunc from 0x03f20f to 0x01ca48 (0x227c6 bytes) 000797 1787385424.557056 trunc from 0x01ca49 to 0x016d9b (0x5cad bytes) 000798 1787385424.600745 trunc from 0x016d9c to 0x0055fc (0x1179f bytes) 000799 1787385424.647285 read 0x003770 thru 0x0055fc (0x1e8d bytes) 000800 1787385424.661845 read 0x000071 thru 0x0055fc (0x558c bytes) 000801 1787385424.685854 write 0x039938 thru 0x03c68d (0x2d56 bytes) 000803 1787385424.692709 write 0x00e899 thru 0x018343 (0x9aab bytes) 000804 1787385424.725236 mapwrite 0x03e72f thru 0x03ffff (0x18d1 bytes) 000805 1787385424.901670 trunc from 0x040000 to 0x016728 (0x298d7 bytes) 000808 1787385424.953800 write 0x00bdb6 thru 0x01034e (0x4599 bytes) 000810 1787385424.957062 read 0x0035ad thru 0x012a98 (0xf4ec bytes) 000814 1787385424.968770 MIRROR_RESYNC 10 mirrors 000815 1787385426.826210 mapwrite 0x02fede thru 0x0360bc (0x61df bytes) 000816 1787385427.005418 write 0x015898 thru 0x01f6a4 (0x9e0d bytes) 000819 1787385427.018753 trunc from 0x0360bd to 0x02b755 (0xa967 bytes) 000821 1787385427.047221 read 0x008486 thru 0x01269e (0xa219 bytes) 000826 1787385427.058881 mapwrite 0x00652a thru 0x00d2cc (0x6da3 bytes) 000827 1787385427.120372 trunc from 0x02b756 to 0x01fbf7 (0xbb5e bytes) 000828 1787385427.148880 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fbf8): Mirror 9: 0x8d9b2b6a (stale) Mirror 10: 0x8d9b2b6a (stale) Mirror 11: 0x8d9b2b6a (stale) Mirror 12: 0x8d9b2b6a (stale) Mirror 13: 0x8d9b2b6a (stale) Mirror 14: 0x8d9b2b6a (stale) Mirror 15: 0x8d9b2b6a (stale) Mirror 16: 0x8d9b2b6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fbf8): Mirror 9: 0x8d9b2b6a (stale) Mirror 10: 0x8d9b2b6a (stale) Mirror 11: 0x8d9b2b6a (stale) Mirror 12: 0x8d9b2b6a (stale) Mirror 13: 0x8d9b2b6a (stale) Mirror 14: 0x8d9b2b6a (stale) Mirror 15: 0x8d9b2b6a (stale) Mirror 16: 0x8d9b2b6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fbf8: skipped 000830 1787385427.759902 write 0x0390f7 thru 0x03ffff (0x6f09 bytes) 000831 1787385427.762208 write 0x0187b3 thru 0x01bcc0 (0x350e bytes) 000832 1787385427.772305 mapread 0x02f3ee thru 0x0374fa (0x810d bytes) 000833 1787385427.789746 write 0x0111e4 thru 0x011ca2 (0xabf bytes) 000834 1787385427.795705 write 0x010a16 thru 0x01dac9 (0xd0b4 bytes) 000835 1787385427.805882 trunc from 0x040000 to 0x029cb1 (0x1634e bytes) 000836 1787385427.822270 read 0x019d08 thru 0x024632 (0xa92b bytes) 000837 1787385427.832542 read 0x005c97 thru 0x0123d6 (0xc740 bytes) 000838 1787385427.841676 read 0x027af0 thru 0x029cb1 (0x21c2 bytes) 000839 1787385427.842553 trunc from 0x029cb2 to 0x025691 (0x4620 bytes) 000840 1787385427.860321 read 0x000e9c thru 0x0015e0 (0x745 bytes) 000841 1787385427.862178 read 0x00ab4f thru 0x014e07 (0xa2b9 bytes) 000842 1787385427.863733 write 0x02ec43 thru 0x030ba3 (0x1f61 bytes) 000844 1787385427.866596 mapwrite 0x01a36b thru 0x022836 (0x84cc bytes) 000845 1787385427.916027 mapread 0x00d49f thru 0x00ed62 (0x18c4 bytes) 000846 1787385427.918009 read 0x00984e thru 0x00bd79 (0x252c bytes) 000847 1787385427.919986 write 0x0162f1 thru 0x024381 (0xe091 bytes) 000852 1787385427.928174 trunc from 0x030ba4 to 0x03804f (0x74ac bytes) 000853 1787385427.959408 write 0x0306e0 thru 0x03107b (0x99c bytes) 000856 1787385427.979339 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38050): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38050): Mirror 9: 0xd2d7b572 (stale) Mirror 10: 0xd2d7b572 (stale) Mirror 11: 0xd2d7b572 (stale) Mirror 12: 0xd2d7b572 (stale) Mirror 13: 0xd2d7b572 (stale) Mirror 14: 0xd2d7b572 (stale) Mirror 15: 0xd2d7b572 (stale) Mirror 16: 0xd2d7b572 (stale) CRC-32 checksum value for chunk [0, 0x38050): Mirror 1: 0xd5dceab8 Mirror 17: 0xd5dceab8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38050: skipped 000858 1787385429.368412 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x38050): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38050): Mirror 9: 0xd2d7b572 (stale) Mirror 10: 0xd2d7b572 (stale) Mirror 11: 0xd2d7b572 (stale) Mirror 12: 0xd2d7b572 (stale) Mirror 13: 0xd2d7b572 (stale) Mirror 14: 0xd2d7b572 (stale) Mirror 15: 0xd2d7b572 (stale) Mirror 16: 0xd2d7b572 (stale) CRC-32 checksum value for chunk [0, 0x38050): Mirror 1: 0xd5dceab8 Mirror 17: 0xd5dceab8 Mirror 18: 0xd5dceab8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38050: skipped 000860 1787385430.767089 mapread 0x000277 thru 0x00d431 (0xd1bb bytes) 000861 1787385430.803142 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38050): Mirror 9: 0xd2d7b572 (stale) Mirror 10: 0xd2d7b572 (stale) Mirror 11: 0xd2d7b572 (stale) Mirror 12: 0xd2d7b572 (stale) Mirror 13: 0xd2d7b572 (stale) Mirror 14: 0xd2d7b572 (stale) Mirror 15: 0xd2d7b572 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38050): Mirror 9: 0xd2d7b572 (stale) Mirror 10: 0xd2d7b572 (stale) Mirror 11: 0xd2d7b572 (stale) Mirror 12: 0xd2d7b572 (stale) Mirror 13: 0xd2d7b572 (stale) Mirror 14: 0xd2d7b572 (stale) Mirror 15: 0xd2d7b572 (stale) CRC-32 checksum value for chunk [0, 0x38050): Mirror 1: 0xd5dceab8 Mirror 17: 0xd5dceab8 Mirror 18: 0xd5dceab8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38050: skipped 000862 1787385431.746977 trunc from 0x038050 to 0x01c871 (0x1b7de bytes) 000863 1787385431.879360 MIRROR_RESYNC 10 mirrors 000864 1787385433.870261 mapread 0x008988 thru 0x00d934 (0x4fad bytes) 000866 1787385433.908199 read 0x0101d1 thru 0x0126b5 (0x24e5 bytes) 000869 1787385433.909182 write 0x018d66 thru 0x0260e3 (0xd37e bytes) 000871 1787385434.076809 mapwrite 0x023a01 thru 0x027d84 (0x4384 bytes) 000879 1787385434.186289 trunc from 0x027d85 to 0x03548c (0xd708 bytes) 000881 1787385434.225378 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3548d): Mirror 10: 0xf08d778b (stale) Mirror 11: 0xf08d778b (stale) Mirror 12: 0xf08d778b (stale) Mirror 13: 0xf08d778b (stale) Mirror 14: 0xf08d778b (stale) Mirror 15: 0xf08d778b (stale) Mirror 17: 0xf08d778b (stale) Mirror 18: 0xf08d778b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3548d): Mirror 10: 0xf08d778b (stale) Mirror 11: 0xf08d778b (stale) Mirror 12: 0xf08d778b (stale) Mirror 13: 0xf08d778b (stale) Mirror 14: 0xf08d778b (stale) Mirror 15: 0xf08d778b (stale) Mirror 17: 0xf08d778b (stale) Mirror 18: 0xf08d778b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3548d: skipped 000882 1787385434.724061 mapread 0x02fca7 thru 0x03548c (0x57e6 bytes) 000883 1787385434.744323 read 0x034a20 thru 0x03548c (0xa6d bytes) 000884 1787385434.747774 write 0x0252db thru 0x032f15 (0xdc3b bytes) 000886 1787385434.756203 write 0x009e5a thru 0x011b9c (0x7d43 bytes) 000887 1787385434.768394 mapread 0x016585 thru 0x01a551 (0x3fcd bytes) 000890 1787385434.778162 read 0x017a20 thru 0x018241 (0x822 bytes) 000892 1787385434.781670 write 0x00049d thru 0x00c0dc (0xbc40 bytes) 000893 1787385434.793371 read 0x00a0e4 thru 0x015a49 (0xb966 bytes) 000896 1787385434.796327 mapwrite 0x012a7b thru 0x017a8b (0x5011 bytes) 000898 1787385434.858750 mapwrite 0x0254fa thru 0x02f261 (0x9d68 bytes) 000900 1787385434.902395 read 0x031daa thru 0x03548c (0x36e3 bytes) 000902 1787385434.909148 MIRROR_RESYNC 9 mirrors 000903 1787385436.377458 MIRROR_RESYNC 9 mirrors 000904 1787385436.970791 write 0x020aa2 thru 0x022503 (0x1a62 bytes) 000905 1787385437.036800 trunc from 0x03548d to 0x00a127 (0x2b365 bytes) 000907 1787385437.057475 read 0x007736 thru 0x00a127 (0x29f2 bytes) 000908 1787385437.067899 read 0x00153d thru 0x00307a (0x1b3e bytes) 000910 1787385437.082184 trunc from 0x00a128 to 0x02149b (0x17374 bytes) 000911 1787385437.110091 MIRROR_RESYNC 9 mirrors 000912 1787385438.398183 read 0x007638 thru 0x00ca92 (0x545b bytes) 000914 1787385438.414755 read 0x00d4ef thru 0x0183b2 (0xaec4 bytes) 000916 1787385438.437712 write 0x02a150 thru 0x039e9a (0xfd4b bytes) 000918 1787385438.536607 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e9b): Mirror 11: 0x3c21207e (stale) Mirror 12: 0x3c21207e (stale) Mirror 13: 0x3c21207e (stale) Mirror 14: 0x3c21207e (stale) Mirror 15: 0x3c21207e (stale) Mirror 17: 0x3c21207e (stale) Mirror 18: 0x3c21207e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e9b): Mirror 11: 0x3c21207e (stale) Mirror 12: 0x3c21207e (stale) Mirror 13: 0x3c21207e (stale) Mirror 14: 0x3c21207e (stale) Mirror 15: 0x3c21207e (stale) Mirror 17: 0x3c21207e (stale) Mirror 18: 0x3c21207e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e9b: skipped 000919 1787385439.194162 write 0x02a091 thru 0x02a5ac (0x51c bytes) 000920 1787385439.201900 read 0x02505b thru 0x028264 (0x320a bytes) 000922 1787385439.214489 MIRROR_RESYNC 8 mirrors 000923 1787385441.119384 trunc from 0x039e9b to 0x0273f6 (0x12aa4 bytes) 000924 1787385441.272589 read 0x0070d5 thru 0x00dfcb (0x6ef7 bytes) 000925 1787385441.286676 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x273f7): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x273f7): Mirror 11: 0x45127582 (stale) Mirror 12: 0x45127582 (stale) Mirror 13: 0x45127582 (stale) Mirror 14: 0x45127582 (stale) Mirror 15: 0x45127582 (stale) Mirror 17: 0x45127582 (stale) Mirror 18: 0x45127582 (stale) CRC-32 checksum value for chunk [0, 0x273f7): Mirror 1: 0x45127582 Mirror 19: 0x45127582 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x273f7: skipped 000926 1787385442.375711 mapwrite 0x031e42 thru 0x032b40 (0xcff bytes) 000930 1787385442.538365 trunc from 0x032b41 to 0x00f961 (0x231df bytes) 000931 1787385442.578337 mapread 0x0038f2 thru 0x00d8d6 (0x9fe5 bytes) 000932 1787385442.603850 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf962): Mirror 12: 0x270d6f69 (stale) Mirror 13: 0x270d6f69 (stale) Mirror 14: 0x270d6f69 (stale) Mirror 15: 0x270d6f69 (stale) Mirror 17: 0x270d6f69 (stale) Mirror 18: 0x270d6f69 (stale) Mirror 19: 0x270d6f69 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf962): Mirror 12: 0x270d6f69 (stale) Mirror 13: 0x270d6f69 (stale) Mirror 14: 0x270d6f69 (stale) Mirror 15: 0x270d6f69 (stale) Mirror 17: 0x270d6f69 (stale) Mirror 18: 0x270d6f69 (stale) Mirror 19: 0x270d6f69 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf962: skipped 000933 1787385443.218546 read 0x0091b4 thru 0x00f961 (0x67ae bytes) 000934 1787385443.228093 mapwrite 0x0110b8 thru 0x0148f5 (0x383e bytes) 000935 1787385443.305370 write 0x00e7a5 thru 0x01822b (0x9a87 bytes) 000937 1787385443.308493 mapread 0x016ad4 thru 0x01822b (0x1758 bytes) 000938 1787385443.314426 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1822c): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1822c): Mirror 12: 0x9d5d943b (stale) Mirror 13: 0x9d5d943b (stale) Mirror 14: 0x9d5d943b (stale) Mirror 15: 0x9d5d943b (stale) Mirror 17: 0x9d5d943b (stale) Mirror 18: 0x9d5d943b (stale) Mirror 19: 0x9d5d943b (stale) CRC-32 checksum value for chunk [0, 0x1822c): Mirror 1: 0x6c150a4e Mirror 20: 0x6c150a4e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1822c: skipped 000939 1787385444.213434 trunc from 0x01822c to 0x021df8 (0x9bcd bytes) 000940 1787385444.346141 write 0x00eff8 thru 0x01a2d7 (0xb2e0 bytes) 000942 1787385444.361327 mapwrite 0x034b88 thru 0x03b32d (0x67a6 bytes) 000943 1787385444.499462 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b32e): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b32e): Mirror 12: 0x7f4cdbae (stale) Mirror 13: 0x7f4cdbae (stale) Mirror 14: 0x7f4cdbae (stale) Mirror 15: 0x7f4cdbae (stale) Mirror 17: 0x7f4cdbae (stale) Mirror 18: 0x7f4cdbae (stale) Mirror 19: 0xeb6dffe6 (stale) Mirror 20: 0xf63660b9 (stale) CRC-32 checksum value for chunk [0, 0x3b32e): Mirror 1: 0xafc25424 Mirror 21: 0xafc25424 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b32e: skipped 000944 1787385445.405561 write 0x02f6d0 thru 0x03e068 (0xe999 bytes) 000945 1787385445.490633 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e069): Mirror 13: 0xba53096 (stale) Mirror 14: 0xba53096 (stale) Mirror 15: 0xba53096 (stale) Mirror 17: 0xba53096 (stale) Mirror 18: 0xba53096 (stale) Mirror 19: 0xd1916402 (stale) Mirror 20: 0xea6eabb7 (stale) Mirror 21: 0x45b6a5b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e069): Mirror 13: 0xba53096 (stale) Mirror 14: 0xba53096 (stale) Mirror 15: 0xba53096 (stale) Mirror 17: 0xba53096 (stale) Mirror 18: 0xba53096 (stale) Mirror 19: 0xd1916402 (stale) Mirror 20: 0xea6eabb7 (stale) Mirror 21: 0x45b6a5b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e069: skipped 000948 1787385446.304014 MIRROR_RESYNC 9 mirrors 000949 1787385448.099999 trunc from 0x03e069 to 0x0248a8 (0x197c0 bytes) 000950 1787385448.182777 trunc from 0x0248a9 to 0x00bf3c (0x1896c bytes) 000951 1787385448.216374 mapread 0x0046e0 thru 0x00b6b2 (0x6fd3 bytes) 000952 1787385448.243611 mapread 0x00b3bd thru 0x00bf3c (0xb80 bytes) 000953 1787385448.247342 trunc from 0x00bf3d to 0x00a007 (0x1f35 bytes) 000954 1787385448.268610 write 0x03176b thru 0x037076 (0x590c bytes) 000956 1787385448.272758 write 0x019f04 thru 0x0236a8 (0x97a5 bytes) 000957 1787385448.286480 trunc from 0x037077 to 0x02925b (0xde1b bytes) 000958 1787385448.305896 mapwrite 0x02084e thru 0x02c53d (0xbcf0 bytes) 000959 1787385448.398702 MIRROR_RESYNC 9 mirrors 000965 1787385449.824431 MIRROR_RESYNC 9 mirrors 000967 1787385450.461545 mapread 0x008ada thru 0x00f3bc (0x68e3 bytes) 000968 1787385450.480097 mapread 0x00dd86 thru 0x01548b (0x7706 bytes) 000970 1787385450.490158 mapwrite 0x022176 thru 0x02f32f (0xd1ba bytes) 000971 1787385450.675186 mapread 0x019849 thru 0x0220f3 (0x88ab bytes) 000973 1787385450.690783 read 0x02e6ef thru 0x02f32f (0xc41 bytes) 000976 1787385450.697241 read 0x01a9c0 thru 0x02a232 (0xf873 bytes) 000978 1787385450.701255 mapwrite 0x032412 thru 0x03ffff (0xdbee bytes) 000979 1787385450.794152 mapwrite 0x013392 thru 0x019d6b (0x69da bytes) 000980 1787385450.848642 write 0x02b19e thru 0x03a6b6 (0xf519 bytes) 000983 1787385450.854482 trunc from 0x040000 to 0x024477 (0x1bb88 bytes) 000986 1787385450.874567 mapwrite 0x01aee3 thru 0x021df9 (0x6f17 bytes) 000988 1787385450.938484 read 0x0145db thru 0x0211c2 (0xcbe8 bytes) 000989 1787385450.939491 mapread 0x0104fe thru 0x0155da (0x50dd bytes) 000990 1787385450.941657 write 0x03d3fc thru 0x03ffff (0x2c04 bytes) 000993 1787385450.945639 mapread 0x02075e thru 0x02b601 (0xaea4 bytes) 000995 1787385450.958602 trunc from 0x040000 to 0x0073c1 (0x38c3e bytes) 000998 1787385450.980267 mapwrite 0x018906 thru 0x021d2e (0x9429 bytes) 000999 1787385451.097457 write 0x01fe20 thru 0x02bbe0 (0xbdc1 bytes) All operations completed A-OK!