== sanity-flr test 70a: flr mode fsx test ================ 20:37:12 (1782866232) Seed set to 6232 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002 1782866232.875282 write 0x02bd25 thru 0x036540 (0xa81c bytes) 000005 1782866232.877195 write 0x00dbb7 thru 0x018260 (0xa6aa bytes) 000006 1782866232.881785 read 0x02ba17 thru 0x036540 (0xab2a bytes) 000007 1782866232.882443 mapwrite 0x016007 thru 0x01602a (0x24 bytes) 000008 1782866232.900903 read 0x026d15 thru 0x03092e (0x9c1a bytes) truncating to largest ever: 0x31cb3 000009 1782866232.905354 trunc from 0x036541 to 0x031cb2 (0x488e bytes) 000010 1782866232.910500 trunc from 0x031cb3 to 0x02a1b9 (0x7af9 bytes) 000014 1782866232.916218 read 0x01eaa6 thru 0x028e3a (0xa395 bytes) 000015 1782866232.916909 read 0x01f1f9 thru 0x0229e8 (0x37f0 bytes) 000017 1782866232.918093 write 0x02eced thru 0x037435 (0x8749 bytes) 000019 1782866232.919387 trunc from 0x037436 to 0x025de0 (0x11655 bytes) 000024 1782866232.925517 write 0x0365b1 thru 0x03ffff (0x9a4f bytes) 000025 1782866232.926714 write 0x034d6a thru 0x03ffff (0xb296 bytes) 000026 1782866232.929722 read 0x018a85 thru 0x02125a (0x87d6 bytes) 000027 1782866232.930368 read 0x024399 thru 0x02c710 (0x8378 bytes) 000028 1782866232.930966 trunc from 0x040000 to 0x023afe (0x1c501 bytes) 000029 1782866232.935146 mapread 0x0169b8 thru 0x01c030 (0x5679 bytes) 000034 1782866232.938481 write 0x02cb8b thru 0x034d66 (0x81dc bytes) 000035 1782866232.939364 read 0x031157 thru 0x034d66 (0x3c10 bytes) 000037 1782866232.940207 read 0x02ec24 thru 0x032dab (0x4188 bytes) 000041 1782866232.941797 mapread 0x02be68 thru 0x02e367 (0x2500 bytes) 000043 1782866232.945326 mapwrite 0x02c12e thru 0x02cf0c (0xddf bytes) 000049 1782866232.961885 mapwrite 0x001335 thru 0x009f2a (0x8bf6 bytes) 000051 1782866232.976675 read 0x003623 thru 0x008e65 (0x5843 bytes) 000052 1782866232.977229 trunc from 0x034d67 to 0x02e1d9 (0x6b8d bytes) 000053 1782866232.986060 mapwrite 0x0179d8 thru 0x01cdff (0x5428 bytes) truncating to largest ever: 0x3ad28 000054 1782866233.000757 trunc from 0x02e1da to 0x03ad27 (0xcb4e bytes) 000058 1782866233.007575 trunc from 0x03ad28 to 0x00dec0 (0x2ce67 bytes) 000059 1782866233.012389 read 0x0083ae thru 0x00dec0 (0x5b13 bytes) 000060 1782866233.012833 write 0x03e1a6 thru 0x03ffff (0x1e5a bytes) 000061 1782866233.013496 mapread 0x036349 thru 0x03ffff (0x9cb7 bytes) 000064 1782866233.017826 read 0x03b422 thru 0x03ffff (0x4bde bytes) 000066 1782866233.018533 mapread 0x03a281 thru 0x03ffff (0x5d7f bytes) 000067 1782866233.019122 mapwrite 0x033bd9 thru 0x03f22f (0xb657 bytes) 000069 1782866233.034002 mapread 0x000a67 thru 0x002d07 (0x22a1 bytes) 000070 1782866233.034928 read 0x038389 thru 0x03ffff (0x7c77 bytes) 000072 1782866233.036406 write 0x006926 thru 0x008b5a (0x2235 bytes) 000073 1782866233.037367 mapwrite 0x01cafd thru 0x027384 (0xa888 bytes) 000075 1782866233.052545 read 0x01e42f thru 0x02e26d (0xfe3f bytes) 000076 1782866233.053074 trunc from 0x040000 to 0x000d37 (0x3f2c8 bytes) 000079 1782866233.061311 MIRROR_EXTEND to 2 mirrors 000081 1782866233.240145 write 0x031353 thru 0x03aaa4 (0x9752 bytes) 000085 1782866233.263757 trunc from 0x03aaa5 to 0x02d321 (0xd783 bytes) 000086 1782866233.269726 read 0x00fd3f thru 0x01072d (0x9ef bytes) 000087 1782866233.271641 mapread 0x00f1cb thru 0x011880 (0x26b6 bytes) 000088 1782866233.273544 trunc from 0x02d322 to 0x028457 (0x4eca bytes) 000089 1782866233.277609 write 0x01ccfb thru 0x02af7f (0xe285 bytes) 000090 1782866233.280912 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2af80): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2af80): Mirror 2: 0x43fd52c4 (stale) CRC-32 checksum value for chunk [0, 0x2af80): Mirror 1: 0x390913ba Mirror 3: 0x390913ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2af80: skipped 000092 1782866233.486251 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2af80): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2af80): Mirror 2: 0x43fd52c4 (stale) CRC-32 checksum value for chunk [0, 0x2af80): Mirror 1: 0x390913ba Mirror 3: 0x390913ba Mirror 4: 0x390913ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2af80: skipped 000094 1782866233.702213 mapread 0x021c27 thru 0x02af7f (0x9359 bytes) 000095 1782866233.709012 mapread 0x027527 thru 0x02af7f (0x3a59 bytes) 000096 1782866233.712389 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) 000097 1782866233.801961 mapwrite 0x03aed1 thru 0x03ffff (0x512f bytes) 000098 1782866233.844613 read 0x0163da thru 0x021ab5 (0xb6dc bytes) 000100 1782866233.847808 mapread 0x02c703 thru 0x034a14 (0x8312 bytes) 000101 1782866233.850663 read 0x029cea thru 0x03968b (0xf9a2 bytes) 000102 1782866233.851089 mapwrite 0x001460 thru 0x00ef6d (0xdb0e bytes) 000103 1782866233.868157 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe8c1eb7b (stale) Mirror 4: 0xe8c1eb7b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3d2be004 Mirror 5: 0x3d2be004 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000105 1782866234.080991 mapread 0x036087 thru 0x03bb3a (0x5ab4 bytes) 000109 1782866234.091540 write 0x01471c thru 0x024041 (0xf926 bytes) 000111 1782866234.113985 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe8c1eb7b (stale) Mirror 4: 0xe8c1eb7b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe8c1eb7b (stale) Mirror 4: 0xe8c1eb7b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000115 1782866234.199424 mapwrite 0x019edc thru 0x01c09b (0x21c0 bytes) 000116 1782866234.226320 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe8c1eb7b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe8c1eb7b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000117 1782866234.299887 read 0x005c5c thru 0x00b804 (0x5ba9 bytes) 000118 1782866234.302960 write 0x00b5e5 thru 0x0182f5 (0xcd11 bytes) 000119 1782866234.305284 mapread 0x00afa8 thru 0x00d9e0 (0x2a39 bytes) 000121 1782866234.306779 read 0x036fa8 thru 0x03f208 (0x8261 bytes) 000123 1782866234.311045 mapwrite 0x027551 thru 0x028baa (0x165a bytes) 000124 1782866234.323669 write 0x038e35 thru 0x039b86 (0xd52 bytes) 000125 1782866234.326301 MIRROR_RESYNC 2 mirrors 000128 1782866234.497738 write 0x01d292 thru 0x026c9d (0x9a0c bytes) 000131 1782866234.519717 mapread 0x032619 thru 0x036f78 (0x4960 bytes) 000132 1782866234.525937 mapwrite 0x035783 thru 0x0385b9 (0x2e37 bytes) 000134 1782866234.541655 trunc from 0x040000 to 0x01496c (0x2b693 bytes) 000136 1782866234.554630 read 0x00755e thru 0x00ca02 (0x54a5 bytes) 000137 1782866234.557407 write 0x002465 thru 0x003a4e (0x15ea bytes) 000139 1782866234.560993 read 0x01127f thru 0x0137df (0x2561 bytes) 000141 1782866234.564270 mapwrite 0x0177d1 thru 0x024575 (0xcda5 bytes) 000144 1782866234.593752 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x24576): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24576): Mirror 3: 0x1eb9833b (stale) CRC-32 checksum value for chunk [0, 0x24576): Mirror 1: 0x5a1471bf Mirror 4: 0x5a1471bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24576: skipped 000147 1782866234.788087 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24576): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24576): Mirror 3: 0x1eb9833b (stale) CRC-32 checksum value for chunk [0, 0x24576): Mirror 1: 0x5a1471bf Mirror 4: 0x5a1471bf Mirror 5: 0x5a1471bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24576: skipped 000148 1782866234.976053 mapwrite 0x017121 thru 0x01d12c (0x600c bytes) 000149 1782866235.028504 mapwrite 0x0329f0 thru 0x03527c (0x288d bytes) 000153 1782866235.056568 read 0x02516f thru 0x029f32 (0x4dc4 bytes) 000154 1782866235.059504 mapread 0x00cf3e thru 0x00e436 (0x14f9 bytes) 000155 1782866235.062667 trunc from 0x03527d to 0x02522c (0x10050 bytes) 000156 1782866235.067219 mapwrite 0x030735 thru 0x03788b (0x7157 bytes) 000159 1782866235.089071 MIRROR_RESYNC 4 mirrors 000161 1782866235.290190 trunc from 0x03788c to 0x00b0b9 (0x2c7d2 bytes) 000162 1782866235.314783 write 0x020fc4 thru 0x024a02 (0x3a3f bytes) 000163 1782866235.315831 write 0x002a86 thru 0x008580 (0x5afb bytes) 000164 1782866235.319391 mapwrite 0x02bfb3 thru 0x02d56c (0x15ba bytes) 000165 1782866235.344629 trunc from 0x02d56d to 0x00c9b3 (0x20bb9 bytes) 000167 1782866235.350109 mapwrite 0x022dad thru 0x02aeb0 (0x8104 bytes) 000168 1782866235.374852 trunc from 0x02aeb1 to 0x03087d (0x59cd bytes) truncating to largest ever: 0x3f28d 000169 1782866235.380730 trunc from 0x03087e to 0x03f28c (0xea0f bytes) 000170 1782866235.385563 read 0x014e4b thru 0x0183a9 (0x355f bytes) 000171 1782866235.388633 trunc from 0x03f28d to 0x024178 (0x1b114 bytes) 000172 1782866235.392971 trunc from 0x024179 to 0x02b89b (0x7723 bytes) 000174 1782866235.397545 write 0x027280 thru 0x0367ff (0xf580 bytes) 000177 1782866235.401203 write 0x00fca1 thru 0x01cee8 (0xd248 bytes) 000181 1782866235.404447 write 0x019e84 thru 0x0228c4 (0x8a41 bytes) 000182 1782866235.406669 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36800): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36800): Mirror 3: 0x7f694036 (stale) Mirror 4: 0x7f694036 (stale) Mirror 5: 0x7f694036 (stale) CRC-32 checksum value for chunk [0, 0x36800): Mirror 1: 0x16d9eab5 Mirror 6: 0x16d9eab5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36800: skipped 000183 1782866235.614293 trunc from 0x036800 to 0x00179e (0x35061 bytes) 000185 1782866235.637725 read 0x000360 thru 0x00179e (0x143f bytes) 000187 1782866235.643005 trunc from 0x00179f to 0x014632 (0x12e94 bytes) 000188 1782866235.648458 write 0x0045ef thru 0x013610 (0xf022 bytes) 000189 1782866235.652360 mapwrite 0x0265cb thru 0x02d02c (0x6a62 bytes) 000190 1782866235.675942 mapwrite 0x010c15 thru 0x0202e4 (0xf6d0 bytes) 000192 1782866235.693541 mapwrite 0x029ae3 thru 0x0397f9 (0xfd17 bytes) 000193 1782866235.716966 write 0x010d04 thru 0x012594 (0x1891 bytes) 000194 1782866235.717791 trunc from 0x0397fa to 0x02a137 (0xf6c2 bytes) 000195 1782866235.722023 trunc from 0x02a138 to 0x03e098 (0x13f61 bytes) 000197 1782866235.726069 mapwrite 0x027caf thru 0x037816 (0xfb68 bytes) 000199 1782866235.746599 read 0x02fb7a thru 0x0313ec (0x1873 bytes) 000200 1782866235.747195 mapwrite 0x037308 thru 0x03ffff (0x8cf8 bytes) 000202 1782866235.765870 write 0x02f642 thru 0x038736 (0x90f5 bytes) 000205 1782866235.767472 mapwrite 0x012672 thru 0x013c0d (0x159c bytes) 000206 1782866235.778695 mapread 0x032f0b thru 0x034845 (0x193b bytes) 000207 1782866235.780764 MIRROR_RESYNC 5 mirrors 000209 1782866236.003881 read 0x024f63 thru 0x03268d (0xd72b bytes) 000210 1782866236.006933 trunc from 0x040000 to 0x018d70 (0x2728f bytes) 000211 1782866236.031943 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18d71): Mirror 4: 0xfcca8f5e (stale) Mirror 5: 0xfcca8f5e (stale) Mirror 6: 0xfcca8f5e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18d71): Mirror 4: 0xfcca8f5e (stale) Mirror 5: 0xfcca8f5e (stale) Mirror 6: 0xfcca8f5e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18d71: skipped 000212 1782866236.119970 write 0x036b4d thru 0x03ffff (0x94b3 bytes) 000216 1782866236.124154 MIRROR_RESYNC 4 mirrors 000218 1782866236.329052 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) 000219 1782866236.417315 MIRROR_RESYNC 3 mirrors 000221 1782866236.530751 write 0x02c8b4 thru 0x033659 (0x6da6 bytes) 000222 1782866236.550044 mapread 0x038939 thru 0x03a6cc (0x1d94 bytes) 000224 1782866236.555697 mapread 0x02890c thru 0x02e3a9 (0x5a9e bytes) 000226 1782866236.559564 trunc from 0x040000 to 0x018244 (0x27dbb bytes) 000227 1782866236.565472 read 0x00e9b1 thru 0x016696 (0x7ce6 bytes) 000228 1782866236.569460 MIRROR_RESYNC 3 mirrors 000229 1782866236.733946 read 0x006bf4 thru 0x010ed8 (0xa2e5 bytes) 000233 1782866236.739220 mapread 0x015f6e thru 0x018244 (0x22d7 bytes) 000234 1782866236.743382 read 0x00c484 thru 0x00f35c (0x2ed9 bytes) 000235 1782866236.743647 write 0x0233ff thru 0x028393 (0x4f95 bytes) 000238 1782866236.762528 MIRROR_RESYNC 3 mirrors 000239 1782866236.939316 write 0x039849 thru 0x03ffff (0x67b7 bytes) 000240 1782866236.954964 mapread 0x02fce0 thru 0x03abb1 (0xaed2 bytes) 000241 1782866236.961155 MIRROR_RESYNC 3 mirrors 000244 1782866237.146052 mapread 0x0250b5 thru 0x027504 (0x2450 bytes) 000245 1782866237.152114 read 0x00d0ea thru 0x013c40 (0x6b57 bytes) 000246 1782866237.154894 mapwrite 0x027815 thru 0x02f307 (0x7af3 bytes) 000247 1782866237.202967 mapread 0x02f47e thru 0x033b02 (0x4685 bytes) 000248 1782866237.205909 mapread 0x0205ba thru 0x027cb7 (0x76fe bytes) 000250 1782866237.206984 mapwrite 0x02ec6e thru 0x035060 (0x63f3 bytes) 000251 1782866237.220159 write 0x0026b1 thru 0x008a38 (0x6388 bytes) 000252 1782866237.224267 trunc from 0x040000 to 0x02c61d (0x139e2 bytes) 000256 1782866237.231996 write 0x01200b thru 0x01677b (0x4771 bytes) 000257 1782866237.236952 MIRROR_RESYNC 3 mirrors 000258 1782866237.425750 mapwrite 0x0327a5 thru 0x03ffff (0xd85b bytes) 000260 1782866237.464605 trunc from 0x040000 to 0x023358 (0x1cca7 bytes) 000265 1782866237.473300 read 0x015ccf thru 0x01fc7b (0x9fad bytes) 000266 1782866237.476860 trunc from 0x023359 to 0x01c0fe (0x725a bytes) 000267 1782866237.481670 write 0x036b3d thru 0x03d68b (0x6b4f bytes) 000268 1782866237.484228 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d68c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d68c): Mirror 5: 0x998c95e5 (stale) Mirror 6: 0x998c95e5 (stale) CRC-32 checksum value for chunk [0, 0x3d68c): Mirror 1: 0xd2450a1b Mirror 7: 0xd2450a1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d68c: skipped 000269 1782866237.706447 mapread 0x0112bd thru 0x012208 (0xf4c bytes) 000271 1782866237.711990 mapwrite 0x024921 thru 0x02ec17 (0xa2f7 bytes) 000272 1782866237.762780 trunc from 0x03d68c to 0x03b6c6 (0x1fc5 bytes) 000273 1782866237.772020 mapwrite 0x03072b thru 0x0334dd (0x2db3 bytes) 000274 1782866237.783618 write 0x03fb3f thru 0x03ffff (0x4c1 bytes) 000276 1782866237.785203 write 0x03b79a thru 0x03ffff (0x4866 bytes) 000277 1782866237.787832 mapwrite 0x03450c thru 0x03723b (0x2d30 bytes) 000280 1782866237.804022 mapread 0x023ec6 thru 0x026104 (0x223f bytes) 000281 1782866237.804849 read 0x012962 thru 0x017ebe (0x555d bytes) 000282 1782866237.808457 write 0x02500d thru 0x028ab1 (0x3aa5 bytes) 000284 1782866237.810107 trunc from 0x040000 to 0x0270bb (0x18f44 bytes) 000285 1782866237.815195 read 0x0181cb thru 0x01ba40 (0x3876 bytes) 000286 1782866237.819737 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x270bc): Mirror 5: 0x5f11f85a (stale) Mirror 6: 0x5f11f85a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x270bc): Mirror 5: 0x5f11f85a (stale) Mirror 6: 0x5f11f85a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x270bc: skipped 000288 1782866237.901656 trunc from 0x0270bc to 0x0197e6 (0xd8d5 bytes) 000290 1782866237.908074 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x197e7): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x197e7): Mirror 5: 0x23d0a9ab (stale) Mirror 6: 0x23d0a9ab (stale) CRC-32 checksum value for chunk [0, 0x197e7): Mirror 1: 0x23d0a9ab Mirror 7: 0x23d0a9ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x197e7: skipped 000291 1782866238.140867 read 0x011db3 thru 0x0197e6 (0x7a34 bytes) 000293 1782866238.146732 read 0x00b501 thru 0x0197e6 (0xe2e6 bytes) 000294 1782866238.150785 read 0x0139fe thru 0x0197e6 (0x5de9 bytes) 000296 1782866238.154391 write 0x03a452 thru 0x03ffff (0x5bae bytes) 000299 1782866238.174015 trunc from 0x040000 to 0x00a7f4 (0x3580b bytes) 000300 1782866238.179595 mapwrite 0x00683b thru 0x013532 (0xccf8 bytes) 000301 1782866238.201795 write 0x0320ca thru 0x03cbe1 (0xab18 bytes) 000303 1782866238.204525 MIRROR_RESYNC 4 mirrors 000304 1782866238.407836 mapwrite 0x03f725 thru 0x03ffff (0x8db bytes) 000305 1782866238.449614 trunc from 0x040000 to 0x019641 (0x269be bytes) 000308 1782866238.457117 MIRROR_RESYNC 4 mirrors 000310 1782866238.650307 read 0x014f82 thru 0x019641 (0x46c0 bytes) 000311 1782866238.652617 trunc from 0x019642 to 0x014542 (0x50ff bytes) 000312 1782866238.675384 write 0x03d068 thru 0x03ffff (0x2f98 bytes) 000313 1782866238.676163 trunc from 0x040000 to 0x00dee6 (0x32119 bytes) 000315 1782866238.682037 trunc from 0x00dee7 to 0x0143a5 (0x64bf bytes) 000319 1782866238.689221 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x143a6): Mirror 6: 0xbef0f6f9 (stale) Mirror 7: 0xbef0f6f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x143a6): Mirror 6: 0xbef0f6f9 (stale) Mirror 7: 0xbef0f6f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x143a6: skipped 000321 1782866238.771283 mapwrite 0x022714 thru 0x025d19 (0x3606 bytes) 000322 1782866238.790743 trunc from 0x025d1a to 0x01c1fe (0x9b1b bytes) 000323 1782866238.794947 mapread 0x01968b thru 0x01c1fe (0x2b74 bytes) 000324 1782866238.798125 read 0x00456e thru 0x00c3d2 (0x7e65 bytes) 000327 1782866238.801123 trunc from 0x01c1ff to 0x00fb1b (0xc6e3 bytes) 000329 1782866238.805242 mapwrite 0x038fb7 thru 0x03ffff (0x7049 bytes) 000330 1782866238.822852 trunc from 0x040000 to 0x0371d3 (0x8e2c bytes) 000331 1782866238.826745 read 0x0273c2 thru 0x0332ca (0xbf09 bytes) 000332 1782866238.829568 read 0x008a5f thru 0x009f18 (0x14ba bytes) 000334 1782866238.830373 mapwrite 0x022cba thru 0x02dfaf (0xb2f6 bytes) 000335 1782866238.843228 trunc from 0x0371d4 to 0x0132e4 (0x23eef bytes) 000337 1782866238.847670 read 0x005b41 thru 0x00ecc9 (0x9189 bytes) 000338 1782866238.848124 mapread 0x0068f2 thru 0x008787 (0x1e96 bytes) 000339 1782866238.849750 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x132e5): Mirror 6: 0xecb24a4d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x132e5): Mirror 6: 0xecb24a4d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x132e5: skipped 000340 1782866238.927288 trunc from 0x0132e5 to 0x036e84 (0x23ba0 bytes) 000341 1782866238.931527 trunc from 0x036e85 to 0x016140 (0x20d44 bytes) 000343 1782866238.937204 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16141): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16141): Mirror 6: 0x4cc06828 (stale) CRC-32 checksum value for chunk [0, 0x16141): Mirror 1: 0x608a2492 Mirror 7: 0x608a2492 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16141: skipped 000344 1782866239.159963 MIRROR_RESYNC 3 mirrors 000345 1782866239.315632 mapread 0x00935d thru 0x016140 (0xcde4 bytes) 000346 1782866239.322275 mapwrite 0x01730f thru 0x0227ea (0xb4dc bytes) 000348 1782866239.361110 mapwrite 0x00ee2a thru 0x012402 (0x35d9 bytes) 000350 1782866239.375226 mapread 0x012d89 thru 0x01e89c (0xbb14 bytes) 000354 1782866239.376848 trunc from 0x0227eb to 0x032797 (0xffad bytes) 000355 1782866239.381645 write 0x02c7e4 thru 0x036bb3 (0xa3d0 bytes) 000356 1782866239.383651 trunc from 0x036bb4 to 0x020587 (0x1662c bytes) 000357 1782866239.387068 mapread 0x009e70 thru 0x00bf51 (0x20e2 bytes) 000358 1782866239.387703 mapread 0x005eb5 thru 0x0134cc (0xd618 bytes) 000359 1782866239.390071 write 0x02c382 thru 0x02df67 (0x1be6 bytes) 000362 1782866239.391374 read 0x018fcf thru 0x01ddb9 (0x4deb bytes) 000363 1782866239.391753 read 0x02b6c2 thru 0x02df67 (0x28a6 bytes) 000364 1782866239.393639 mapread 0x00883f thru 0x016c16 (0xe3d8 bytes) 000369 1782866239.395972 mapwrite 0x0141f6 thru 0x019a09 (0x5814 bytes) 000370 1782866239.407759 mapwrite 0x007abd thru 0x01374a (0xbc8e bytes) 000371 1782866239.420708 read 0x029d95 thru 0x02df67 (0x41d3 bytes) 000372 1782866239.421149 write 0x00e82d thru 0x019916 (0xb0ea bytes) 000373 1782866239.421872 trunc from 0x02df68 to 0x01be9c (0x120cb bytes) 000374 1782866239.426288 write 0x00da95 thru 0x01a725 (0xcc91 bytes) 000377 1782866239.428217 mapwrite 0x0198d5 thru 0x023470 (0x9b9c bytes) 000378 1782866239.447303 mapwrite 0x028e7a thru 0x02ba35 (0x2bbc bytes) 000382 1782866239.465169 trunc from 0x02ba36 to 0x00678f (0x252a6 bytes) 000384 1782866239.470315 mapwrite 0x026051 thru 0x02beb9 (0x5e69 bytes) 000386 1782866239.493644 mapwrite 0x007747 thru 0x00c616 (0x4ed0 bytes) 000389 1782866239.513861 mapwrite 0x00ab74 thru 0x013b60 (0x8fed bytes) 000391 1782866239.536260 trunc from 0x02beba to 0x03b348 (0xf48f bytes) 000394 1782866239.541847 mapwrite 0x005214 thru 0x010cf1 (0xbade bytes) 000396 1782866239.553610 write 0x01ec35 thru 0x02b660 (0xca2c bytes) 000397 1782866239.556961 mapread 0x00cc29 thru 0x011356 (0x472e bytes) 000400 1782866239.558622 read 0x034975 thru 0x038db9 (0x4445 bytes) 000401 1782866239.559023 mapwrite 0x0285fc thru 0x03080a (0x820f bytes) 000403 1782866239.571690 mapwrite 0x03d511 thru 0x03ffff (0x2aef bytes) 000404 1782866239.591234 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x50ab60d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x50ab60d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000405 1782866239.658242 write 0x01721e thru 0x021b80 (0xa963 bytes) 000407 1782866239.663572 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x50ab60d0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xefd3539c Mirror 8: 0xefd3539c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000408 1782866239.861293 mapread 0x03f971 thru 0x03ffff (0x68f bytes) 000411 1782866239.867761 mapwrite 0x02980f thru 0x02a61c (0xe0e bytes) 000414 1782866239.916678 mapwrite 0x00443f thru 0x00b056 (0x6c18 bytes) 000415 1782866239.934417 read 0x006879 thru 0x013b33 (0xd2bb bytes) 000421 1782866239.938589 read 0x00c59e thru 0x00e011 (0x1a74 bytes) 000422 1782866239.939086 read 0x00c379 thru 0x015687 (0x930f bytes) 000423 1782866239.944072 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x50ab60d0 (stale) Mirror 8: 0xefd3539c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf54cd8ec Mirror 9: 0xf54cd8ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000425 1782866240.141711 mapwrite 0x02b332 thru 0x02d69d (0x236c bytes) 000426 1782866240.188056 mapread 0x033fde thru 0x038b58 (0x4b7b bytes) 000427 1782866240.191097 write 0x011bb4 thru 0x019f59 (0x83a6 bytes) 000428 1782866240.193868 read 0x003d2f thru 0x005776 (0x1a48 bytes) 000429 1782866240.195461 mapread 0x016f41 thru 0x01afe2 (0x40a2 bytes) 000431 1782866240.198278 mapread 0x00fc8a thru 0x015caa (0x6021 bytes) 000432 1782866240.200985 trunc from 0x040000 to 0x000574 (0x3fa8b bytes) 000433 1782866240.207076 write 0x01fa08 thru 0x02c8fa (0xcef3 bytes) 000436 1782866240.209749 read 0x022e2a thru 0x02acd9 (0x7eb0 bytes) truncating to largest ever: 0x3fe04 000437 1782866240.210436 trunc from 0x02c8fb to 0x03fe03 (0x13509 bytes) 000438 1782866240.214626 read 0x004aa9 thru 0x00a99b (0x5ef3 bytes) 000440 1782866240.218652 trunc from 0x03fe04 to 0x01bbe4 (0x2421f bytes) 000442 1782866240.223752 mapwrite 0x023b2d thru 0x027e07 (0x42db bytes) 000444 1782866240.245873 mapwrite 0x00a8b9 thru 0x016820 (0xbf68 bytes) 000445 1782866240.257130 write 0x034ab5 thru 0x039c37 (0x5183 bytes) 000448 1782866240.258405 mapread 0x01bb01 thru 0x02a7a2 (0xeca2 bytes) 000449 1782866240.269265 mapwrite 0x0019aa thru 0x006299 (0x48f0 bytes) 000450 1782866240.282664 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39c38): Mirror 8: 0x3b3bb534 (stale) Mirror 9: 0x7658c159 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c38): Mirror 8: 0x3b3bb534 (stale) Mirror 9: 0x7658c159 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c38: skipped 000452 1782866240.370896 read 0x00e219 thru 0x018f8c (0xad74 bytes) 000454 1782866240.374076 mapwrite 0x00de15 thru 0x00ea90 (0xc7c bytes) 000455 1782866240.386426 write 0x00d4ff thru 0x01d301 (0xfe03 bytes) 000456 1782866240.388456 trunc from 0x039c38 to 0x03799b (0x229c bytes) 000458 1782866240.395534 read 0x024568 thru 0x02fbfb (0xb694 bytes) 000459 1782866240.400582 MIRROR_RESYNC 3 mirrors 000461 1782866240.581682 trunc from 0x03799c to 0x03c57d (0x4be2 bytes) 000462 1782866240.603784 MIRROR_RESYNC 3 mirrors 000463 1782866240.776526 write 0x0052b8 thru 0x006d42 (0x1a8b bytes) 000468 1782866240.797306 read 0x0296d4 thru 0x035557 (0xbe84 bytes) 000469 1782866240.799641 mapwrite 0x00f91c thru 0x01d77b (0xde60 bytes) 000472 1782866240.829283 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c57e): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c57e): Mirror 8: 0x8a70eea3 (stale) Mirror 9: 0x8a70eea3 (stale) CRC-32 checksum value for chunk [0, 0x3c57e): Mirror 1: 0xf35d0879 Mirror 10: 0xf35d0879 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c57e: skipped 000473 1782866241.026412 mapwrite 0x03eb89 thru 0x03ffff (0x1477 bytes) 000477 1782866241.062866 write 0x021ade thru 0x02ab28 (0x904b bytes) 000480 1782866241.066707 trunc from 0x040000 to 0x005dd4 (0x3a22b bytes) 000481 1782866241.072931 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x5dd5): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5dd5): Mirror 8: 0x64fc297b (stale) Mirror 9: 0x64fc297b (stale) Mirror 10: 0x901ef6f1 (stale) CRC-32 checksum value for chunk [0, 0x5dd5): Mirror 1: 0x901ef6f1 Mirror 11: 0x901ef6f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5dd5: skipped 000482 1782866241.278621 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x5dd5): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5dd5): Mirror 8: 0x64fc297b (stale) Mirror 9: 0x64fc297b (stale) Mirror 10: 0x901ef6f1 (stale) CRC-32 checksum value for chunk [0, 0x5dd5): Mirror 1: 0x901ef6f1 Mirror 11: 0x901ef6f1 Mirror 12: 0x901ef6f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5dd5: skipped 000483 1782866241.489460 write 0x022961 thru 0x022fec (0x68c bytes) 000484 1782866241.505329 trunc from 0x022fed to 0x00e6d3 (0x14919 bytes) 000485 1782866241.509975 mapread 0x004c97 thru 0x00a62a (0x5994 bytes) 000489 1782866241.515447 write 0x037138 thru 0x03ffff (0x8ec8 bytes) 000490 1782866241.516300 trunc from 0x040000 to 0x03d9a5 (0x265a bytes) 000493 1782866241.520505 mapwrite 0x03b4ab thru 0x03ef27 (0x3a7d bytes) 000494 1782866241.535493 read 0x025e0b thru 0x0286f8 (0x28ee bytes) 000495 1782866241.538489 MIRROR_RESYNC 6 mirrors 000496 1782866241.767262 trunc from 0x03ef28 to 0x00c2d6 (0x32c51 bytes) 000498 1782866241.790324 read 0x004d3c thru 0x00546b (0x730 bytes) 000501 1782866241.793506 read 0x00be67 thru 0x00c2d6 (0x470 bytes) 000502 1782866241.796428 trunc from 0x00c2d7 to 0x017144 (0xae6e bytes) 000503 1782866241.803771 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17145): Mirror 8: 0xe283bf14 (stale) Mirror 9: 0xe283bf14 (stale) Mirror 10: 0xe283bf14 (stale) Mirror 12: 0xe283bf14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17145): Mirror 8: 0xe283bf14 (stale) Mirror 9: 0xe283bf14 (stale) Mirror 10: 0xe283bf14 (stale) Mirror 12: 0xe283bf14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17145: skipped 000506 1782866241.898058 MIRROR_RESYNC 5 mirrors 000507 1782866242.107729 read 0x0097ac thru 0x013aba (0xa30f bytes) 000508 1782866242.109946 trunc from 0x017145 to 0x03167b (0x1a537 bytes) 000510 1782866242.126382 write 0x02adca thru 0x02f141 (0x4378 bytes) 000511 1782866242.129107 write 0x02c5c1 thru 0x02fd49 (0x3789 bytes) 000513 1782866242.130065 mapread 0x00b15d thru 0x017416 (0xc2ba bytes) 000514 1782866242.136615 mapwrite 0x0372c5 thru 0x03de50 (0x6b8c bytes) 000515 1782866242.155263 mapwrite 0x03d3fc thru 0x03ffff (0x2c04 bytes) 000516 1782866242.168992 mapread 0x033b2b thru 0x03fd25 (0xc1fb bytes) 000517 1782866242.169675 mapread 0x038076 thru 0x03ffff (0x7f8a bytes) 000522 1782866242.171519 write 0x008be4 thru 0x016537 (0xd954 bytes) 000524 1782866242.172566 mapread 0x0231bf thru 0x02eca4 (0xbae6 bytes) 000526 1782866242.175977 mapread 0x015563 thru 0x01c078 (0x6b16 bytes) 000527 1782866242.176983 read 0x031264 thru 0x03b4d2 (0xa26f bytes) 000528 1782866242.177576 mapwrite 0x0095b5 thru 0x014928 (0xb374 bytes) 000529 1782866242.189664 write 0x03c612 thru 0x03ffff (0x39ee bytes) 000530 1782866242.190376 trunc from 0x040000 to 0x0034e1 (0x3cb1e bytes) 000531 1782866242.195220 trunc from 0x0034e2 to 0x020445 (0x1cf64 bytes) 000532 1782866242.199040 mapread 0x00e742 thru 0x01071a (0x1fd9 bytes) 000533 1782866242.202116 mapread 0x01a606 thru 0x01f488 (0x4e83 bytes) 000535 1782866242.203099 mapwrite 0x02b1ad thru 0x030bcf (0x5a23 bytes) 000536 1782866242.220664 trunc from 0x030bd0 to 0x01cc2f (0x13fa0 bytes) 000537 1782866242.224730 trunc from 0x01cc30 to 0x0358c9 (0x18c9a bytes) 000538 1782866242.228056 trunc from 0x0358ca to 0x02e0a8 (0x7821 bytes) 000543 1782866242.233441 write 0x034f0f thru 0x03934b (0x443d bytes) 000544 1782866242.234545 write 0x015dfd thru 0x01f7e1 (0x99e5 bytes) 000545 1782866242.238305 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3934c): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3934c): Mirror 8: 0x27ba4c31 (stale) Mirror 9: 0x27ba4c31 (stale) Mirror 10: 0x27ba4c31 (stale) Mirror 12: 0x27ba4c31 (stale) CRC-32 checksum value for chunk [0, 0x3934c): Mirror 1: 0x682967fc Mirror 13: 0x682967fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3934c: skipped 000546 1782866242.461642 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3934c): Mirror 8: 0x27ba4c31 (stale) Mirror 10: 0x27ba4c31 (stale) Mirror 12: 0x27ba4c31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3934c): Mirror 8: 0x27ba4c31 (stale) Mirror 10: 0x27ba4c31 (stale) Mirror 12: 0x27ba4c31 (stale) CRC-32 checksum value for chunk [0, 0x3934c): Mirror 1: 0x682967fc Mirror 13: 0x682967fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3934c: skipped 000547 1782866242.624198 read 0x03562f thru 0x03934b (0x3d1d bytes) 000549 1782866242.632880 write 0x02a520 thru 0x02bc6e (0x174f bytes) 000550 1782866242.652297 trunc from 0x03934c to 0x003e76 (0x354d5 bytes) 000551 1782866242.656790 trunc from 0x003e77 to 0x005270 (0x13fa bytes) 000554 1782866242.660789 mapread 0x0029be thru 0x005270 (0x28b3 bytes) 000555 1782866242.665322 mapwrite 0x02e08b thru 0x038042 (0x9fb8 bytes) 000556 1782866242.683564 mapread 0x015a90 thru 0x017095 (0x1606 bytes) 000557 1782866242.685872 read 0x02e68f thru 0x03246d (0x3ddf bytes) 000560 1782866242.687887 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38043): Mirror 10: 0xd13a4752 (stale) Mirror 12: 0xd13a4752 (stale) Mirror 13: 0xe396b9d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38043): Mirror 10: 0xd13a4752 (stale) Mirror 12: 0xd13a4752 (stale) Mirror 13: 0xe396b9d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38043: skipped 000561 1782866242.771080 write 0x00dc89 thru 0x014775 (0x6aed bytes) 000562 1782866242.774191 read 0x032049 thru 0x036621 (0x45d9 bytes) 000563 1782866242.776562 write 0x03da84 thru 0x03e36b (0x8e8 bytes) 000565 1782866242.777981 mapread 0x02ef13 thru 0x02f2cf (0x3bd bytes) 000566 1782866242.780993 mapwrite 0x01e2a0 thru 0x020dd2 (0x2b33 bytes) 000567 1782866242.795144 mapwrite 0x005927 thru 0x00956a (0x3c44 bytes) 000570 1782866242.809150 mapread 0x0010ad thru 0x006328 (0x527c bytes) 000571 1782866242.810136 trunc from 0x03e36c to 0x004cd1 (0x3969a bytes) 000572 1782866242.814883 mapwrite 0x021def thru 0x03183b (0xfa4d bytes) 000573 1782866242.838514 MIRROR_RESYNC 4 mirrors 000576 1782866243.026886 write 0x017ceb thru 0x01b6bb (0x39d1 bytes) 000579 1782866243.052781 mapwrite 0x001760 thru 0x011332 (0xfbd3 bytes) 000580 1782866243.081641 mapwrite 0x00bac2 thru 0x011c26 (0x6165 bytes) 000581 1782866243.093722 mapread 0x000ce7 thru 0x00591c (0x4c36 bytes) 000582 1782866243.095896 read 0x030924 thru 0x030975 (0x52 bytes) 000584 1782866243.098230 write 0x01d03b thru 0x027eb1 (0xae77 bytes) 000585 1782866243.101353 trunc from 0x03183c to 0x0385b2 (0x6d77 bytes) 000589 1782866243.112785 write 0x038300 thru 0x03ffff (0x7d00 bytes) 000590 1782866243.114712 write 0x03f0b4 thru 0x03ffff (0xf4c bytes) 000591 1782866243.115320 write 0x0203af thru 0x02d3e8 (0xd03a bytes) 000596 1782866243.119525 trunc from 0x040000 to 0x018a7a (0x27585 bytes) 000597 1782866243.124702 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18a7b): Mirror 10: 0x91048a59 (stale) Mirror 13: 0x91048a59 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18a7b): Mirror 10: 0x91048a59 (stale) Mirror 13: 0x91048a59 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18a7b: skipped 000598 1782866243.199238 mapwrite 0x016105 thru 0x01bcbe (0x5bba bytes) 000599 1782866243.218952 write 0x00258b thru 0x0097a3 (0x7219 bytes) 000600 1782866243.221477 write 0x004d77 thru 0x00df13 (0x919d bytes) 000601 1782866243.223359 trunc from 0x01bcbf to 0x00f314 (0xc9aa bytes) 000602 1782866243.227455 read 0x005871 thru 0x00f314 (0x9aa4 bytes) 000603 1782866243.230011 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf315): Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf315): Mirror 10: 0xf101d8bc (stale) Mirror 13: 0xf101d8bc (stale) CRC-32 checksum value for chunk [0, 0xf315): Mirror 1: 0xfedf63bc Mirror 14: 0xfedf63bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf315: skipped 000605 1782866243.429284 read 0x000554 thru 0x00508f (0x4b3c bytes) 000606 1782866243.434060 MIRROR_RESYNC 4 mirrors 000608 1782866243.600275 trunc from 0x00f315 to 0x0354ed (0x261d9 bytes) 000609 1782866243.622276 trunc from 0x0354ee to 0x03b271 (0x5d84 bytes) 000610 1782866243.628879 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3b272): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b272): Mirror 10: 0xe3daa8c7 (stale) Mirror 13: 0xe3daa8c7 (stale) Mirror 14: 0xe3daa8c7 (stale) CRC-32 checksum value for chunk [0, 0x3b272): Mirror 1: 0xe3daa8c7 Mirror 15: 0xe3daa8c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b272: skipped 000614 1782866243.826089 write 0x0021fa thru 0x00d324 (0xb12b bytes) 000615 1782866243.845767 mapwrite 0x00865b thru 0x00b829 (0x31cf bytes) 000616 1782866243.858036 mapwrite 0x0092ce thru 0x01482b (0xb55e bytes) 000617 1782866243.875688 mapwrite 0x03a631 thru 0x03ffff (0x59cf bytes) 000620 1782866243.900143 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe42ee55c (stale) Mirror 13: 0xe42ee55c (stale) Mirror 14: 0xe42ee55c (stale) Mirror 15: 0xe42ee55c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc3cdaca2 Mirror 16: 0xc3cdaca2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000622 1782866244.090624 trunc from 0x040000 to 0x00eb04 (0x314fb bytes) 000623 1782866244.112991 write 0x022f01 thru 0x02e707 (0xb807 bytes) 000624 1782866244.114416 trunc from 0x02e708 to 0x03dc0f (0xf508 bytes) 000627 1782866244.121111 read 0x0396f1 thru 0x03dc0f (0x451f bytes) 000628 1782866244.123889 read 0x010f2c thru 0x019417 (0x84ec bytes) 000634 1782866244.129930 write 0x02dbd1 thru 0x038a4d (0xae7d bytes) 000635 1782866244.131112 mapread 0x0292ab thru 0x030930 (0x7686 bytes) 000639 1782866244.133613 mapwrite 0x011c10 thru 0x0218ab (0xfc9c bytes) 000642 1782866244.150585 mapwrite 0x02129d thru 0x030ea1 (0xfc05 bytes) 000643 1782866244.164381 mapread 0x010965 thru 0x019792 (0x8e2e bytes) 000646 1782866244.165706 trunc from 0x03dc10 to 0x02018d (0x1da82 bytes) 000648 1782866244.170790 mapwrite 0x00b2ff thru 0x00b909 (0x60b bytes) 000651 1782866244.182595 write 0x009447 thru 0x00baed (0x26a7 bytes) 000652 1782866244.183422 read 0x000fae thru 0x008c99 (0x7cec bytes) 000653 1782866244.184076 write 0x02259e thru 0x02b322 (0x8d85 bytes) 000654 1782866244.185234 mapread 0x0294d7 thru 0x02b322 (0x1e4c bytes) 000656 1782866244.188176 MIRROR_RESYNC 6 mirrors 000658 1782866244.436852 mapwrite 0x00ef0c thru 0x01bcf5 (0xcdea bytes) 000659 1782866244.487634 read 0x027b62 thru 0x02b322 (0x37c1 bytes) 000660 1782866244.489916 write 0x02c996 thru 0x037afa (0xb165 bytes) 000661 1782866244.490932 write 0x014f9f thru 0x01d6ff (0x8761 bytes) 000662 1782866244.491743 read 0x0371e7 thru 0x037afa (0x914 bytes) 000664 1782866244.492615 mapwrite 0x034732 thru 0x03ca08 (0x82d7 bytes) 000666 1782866244.518509 mapwrite 0x0151f7 thru 0x01722c (0x2036 bytes) 000670 1782866244.531600 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ca09): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca09): Mirror 10: 0xaa6db9ce (stale) Mirror 13: 0xaa6db9ce (stale) Mirror 14: 0xaa6db9ce (stale) Mirror 15: 0xaa6db9ce (stale) Mirror 16: 0xaa6db9ce (stale) CRC-32 checksum value for chunk [0, 0x3ca09): Mirror 1: 0xaa17f624 Mirror 17: 0xaa17f624 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca09: skipped 000671 1782866244.732255 trunc from 0x03ca09 to 0x03bebe (0xb4a bytes) 000674 1782866244.754645 write 0x015aaf thru 0x015ce9 (0x23b bytes) 000675 1782866244.757624 MIRROR_RESYNC 7 mirrors 000676 1782866244.997726 mapwrite 0x03fc5b thru 0x03ffff (0x3a5 bytes) 000677 1782866245.030242 trunc from 0x040000 to 0x0352fb (0xad04 bytes) 000678 1782866245.034921 mapwrite 0x038aa9 thru 0x03bf75 (0x34cd bytes) 000679 1782866245.052127 trunc from 0x03bf76 to 0x013f19 (0x2805c bytes) 000680 1782866245.056231 mapwrite 0x012e52 thru 0x022d61 (0xff10 bytes) 000683 1782866245.077804 mapwrite 0x02a00e thru 0x037a01 (0xd9f4 bytes) 000684 1782866245.099547 write 0x0352c3 thru 0x03ffff (0xad3d bytes) 000688 1782866245.102263 mapread 0x02b1e3 thru 0x035fc8 (0xade6 bytes) 000689 1782866245.102935 mapwrite 0x01f7c4 thru 0x02f666 (0xfea3 bytes) 000691 1782866245.116709 write 0x020b84 thru 0x02ad75 (0xa1f2 bytes) 000692 1782866245.117552 write 0x010bfb thru 0x018a2c (0x7e32 bytes) 000693 1782866245.118227 mapwrite 0x0350b0 thru 0x037fe9 (0x2f3a bytes) 000694 1782866245.129297 trunc from 0x040000 to 0x026ecb (0x19134 bytes) 000696 1782866245.135060 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x26ecc): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ecc): Mirror 10: 0x664e8131 (stale) Mirror 13: 0x664e8131 (stale) Mirror 14: 0x664e8131 (stale) Mirror 15: 0x664e8131 (stale) Mirror 16: 0x664e8131 (stale) Mirror 17: 0x664e8131 (stale) CRC-32 checksum value for chunk [0, 0x26ecc): Mirror 1: 0xbebb79f5 Mirror 18: 0xbebb79f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ecc: skipped 000698 1782866245.362313 MIRROR_RESYNC 8 mirrors 000699 1782866245.612705 mapwrite 0x03b528 thru 0x03ffff (0x4ad8 bytes) 000701 1782866245.647631 trunc from 0x040000 to 0x021312 (0x1eced bytes) 000702 1782866245.653810 MIRROR_RESYNC 8 mirrors 000703 1782866245.923973 mapwrite 0x00573a thru 0x00faa3 (0xa36a bytes) 000705 1782866245.973791 mapread 0x004f15 thru 0x006ea8 (0x1f94 bytes) 000706 1782866245.974538 read 0x008989 thru 0x0165e3 (0xdc5b bytes) 000707 1782866245.978972 MIRROR_RESYNC 8 mirrors 000709 1782866246.257168 read 0x00f289 thru 0x01d47e (0xe1f6 bytes) 000711 1782866246.259703 trunc from 0x021313 to 0x031840 (0x1052e bytes) 000712 1782866246.277591 write 0x03f06c thru 0x03ffff (0xf94 bytes) 000715 1782866246.279131 write 0x01cf74 thru 0x02237f (0x540c bytes) 000718 1782866246.282632 mapwrite 0x018ae2 thru 0x02223a (0x9759 bytes) 000722 1782866246.305853 read 0x001540 thru 0x001e79 (0x93a bytes) 000723 1782866246.309722 mapwrite 0x0118e6 thru 0x020dc6 (0xf4e1 bytes) 000724 1782866246.325619 read 0x02c65b thru 0x0319c5 (0x536b bytes) 000726 1782866246.326533 mapread 0x03112d thru 0x034a49 (0x391d bytes) 000727 1782866246.327158 write 0x03d514 thru 0x03ffff (0x2aec bytes) 000728 1782866246.327798 trunc from 0x040000 to 0x00b78f (0x34870 bytes) 000729 1782866246.335149 read 0x00891a thru 0x00b78f (0x2e76 bytes) 000731 1782866246.336314 mapwrite 0x0216c3 thru 0x02503e (0x397c bytes) 000733 1782866246.357943 mapwrite 0x03bd69 thru 0x03ffff (0x4297 bytes) 000734 1782866246.376272 mapread 0x02a392 thru 0x02fa5a (0x56c9 bytes) 000735 1782866246.376990 mapwrite 0x026dc3 thru 0x027a23 (0xc61 bytes) 000738 1782866246.388462 mapread 0x01c12c thru 0x01d9c4 (0x1899 bytes) 000740 1782866246.389367 write 0x013707 thru 0x021cc1 (0xe5bb bytes) 000741 1782866246.391606 MIRROR_RESYNC 8 mirrors 000742 1782866246.664185 mapwrite 0x02e80f thru 0x036fa8 (0x879a bytes) 000743 1782866246.711418 trunc from 0x040000 to 0x022d2e (0x1d2d1 bytes) 000744 1782866246.721947 mapwrite 0x020da8 thru 0x025320 (0x4579 bytes) 000745 1782866246.741214 write 0x01b563 thru 0x021e3a (0x68d8 bytes) 000746 1782866246.743662 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x25321): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25321): Mirror 10: 0xd4a93550 (stale) Mirror 13: 0xd4a93550 (stale) Mirror 14: 0xd4a93550 (stale) Mirror 15: 0xd4a93550 (stale) Mirror 16: 0xd4a93550 (stale) Mirror 17: 0xd4a93550 (stale) Mirror 18: 0xd4a93550 (stale) CRC-32 checksum value for chunk [0, 0x25321): Mirror 1: 0x66400bfa Mirror 19: 0x66400bfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25321: skipped 000748 1782866246.965571 mapwrite 0x0328b5 thru 0x03d84a (0xaf96 bytes) 000749 1782866247.010608 mapwrite 0x017357 thru 0x018245 (0xeef bytes) 000753 1782866247.025628 mapwrite 0x03c463 thru 0x03deb4 (0x1a52 bytes) 000754 1782866247.042867 trunc from 0x03deb5 to 0x01987d (0x24637 bytes) 000756 1782866247.047565 read 0x0188df thru 0x01987d (0xf9f bytes) 000757 1782866247.047980 write 0x02d940 thru 0x037cbd (0xa37e bytes) 000762 1782866247.050696 trunc from 0x037cbe to 0x035c71 (0x204c bytes) 000763 1782866247.056153 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x35c72): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c72): Mirror 10: 0x124f294e (stale) Mirror 13: 0x124f294e (stale) Mirror 14: 0x124f294e (stale) Mirror 15: 0x124f294e (stale) Mirror 16: 0x124f294e (stale) Mirror 17: 0x124f294e (stale) Mirror 18: 0x124f294e (stale) Mirror 19: 0x66952314 (stale) CRC-32 checksum value for chunk [0, 0x35c72): Mirror 1: 0x5fb4e2ca Mirror 20: 0x5fb4e2ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c72: skipped 000764 1782866247.301415 read 0x00e35e thru 0x019300 (0xafa3 bytes) 000765 1782866247.305103 mapread 0x030149 thru 0x030b04 (0x9bc bytes) 000767 1782866247.312122 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35c72): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c72): Mirror 10: 0x124f294e (stale) Mirror 13: 0x124f294e (stale) Mirror 14: 0x124f294e (stale) Mirror 15: 0x124f294e (stale) Mirror 16: 0x124f294e (stale) Mirror 17: 0x124f294e (stale) Mirror 18: 0x124f294e (stale) Mirror 19: 0x66952314 (stale) CRC-32 checksum value for chunk [0, 0x35c72): Mirror 1: 0x5fb4e2ca Mirror 20: 0x5fb4e2ca Mirror 21: 0x5fb4e2ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c72: skipped 000769 1782866247.558207 MIRROR_RESYNC 11 mirrors 000770 1782866247.852353 read 0x02f7d5 thru 0x030c0c (0x1438 bytes) 000772 1782866247.854478 trunc from 0x035c72 to 0x00fe14 (0x25e5d bytes) 000775 1782866247.877595 mapread 0x00b25b thru 0x00fe14 (0x4bba bytes) 000776 1782866247.882470 write 0x006787 thru 0x014093 (0xd90d bytes) 000778 1782866247.884285 trunc from 0x014094 to 0x008923 (0xb770 bytes) 000780 1782866247.890089 trunc from 0x008924 to 0x03eaa5 (0x36182 bytes) 000781 1782866247.894168 mapwrite 0x0198e9 thru 0x024637 (0xad4f bytes) 000782 1782866247.915476 trunc from 0x03eaa6 to 0x02d095 (0x11a10 bytes) 000783 1782866247.919739 write 0x00000b thru 0x005f08 (0x5efe bytes) 000784 1782866247.922384 read 0x021637 thru 0x02c456 (0xae20 bytes) 000785 1782866247.924875 trunc from 0x02d096 to 0x01f051 (0xe044 bytes) 000788 1782866247.929432 read 0x016f66 thru 0x01f051 (0x80ec bytes) 000791 1782866247.930487 trunc from 0x01f052 to 0x011b4e (0xd503 bytes) 000792 1782866247.934378 write 0x027cad thru 0x0317f2 (0x9b46 bytes) 000793 1782866247.935414 mapread 0x00753d thru 0x00fc00 (0x86c4 bytes) 000794 1782866247.936393 read 0x00c1f6 thru 0x01ac27 (0xea32 bytes) 000796 1782866247.939695 mapread 0x025a03 thru 0x0317f2 (0xbdf0 bytes) 000797 1782866247.940860 read 0x028b40 thru 0x0317f2 (0x8cb3 bytes) 000798 1782866247.941501 mapwrite 0x007c41 thru 0x0173ca (0xf78a bytes) 000799 1782866247.957761 read 0x01a6bd thru 0x01bb1d (0x1461 bytes) 000800 1782866247.958410 trunc from 0x0317f3 to 0x026ba1 (0xac51 bytes) 000802 1782866247.963876 mapread 0x01a19f thru 0x026ba1 (0xca03 bytes) 000803 1782866247.965030 mapread 0x01e301 thru 0x0264b4 (0x81b4 bytes) 000804 1782866247.967597 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26ba2): Mirror 13: 0x9d7e7bd5 (stale) Mirror 14: 0x9d7e7bd5 (stale) Mirror 15: 0x9d7e7bd5 (stale) Mirror 16: 0x9d7e7bd5 (stale) Mirror 17: 0x9d7e7bd5 (stale) Mirror 18: 0x9d7e7bd5 (stale) Mirror 19: 0x9d7e7bd5 (stale) Mirror 20: 0x9d7e7bd5 (stale) Mirror 21: 0x9d7e7bd5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ba2): Mirror 13: 0x9d7e7bd5 (stale) Mirror 14: 0x9d7e7bd5 (stale) Mirror 15: 0x9d7e7bd5 (stale) Mirror 16: 0x9d7e7bd5 (stale) Mirror 17: 0x9d7e7bd5 (stale) Mirror 18: 0x9d7e7bd5 (stale) Mirror 19: 0x9d7e7bd5 (stale) Mirror 20: 0x9d7e7bd5 (stale) Mirror 21: 0x9d7e7bd5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ba2: skipped 000805 1782866248.099867 trunc from 0x026ba2 to 0x00d11b (0x19a86 bytes) 000806 1782866248.106810 mapwrite 0x0004e9 thru 0x0104c9 (0xffe1 bytes) 000807 1782866248.131584 mapread 0x000dd0 thru 0x00a360 (0x9591 bytes) 000808 1782866248.132367 mapread 0x007f21 thru 0x00d37e (0x545e bytes) 000809 1782866248.133012 write 0x037088 thru 0x03ffff (0x8f78 bytes) 000810 1782866248.133793 mapread 0x02a8ec thru 0x034037 (0x974c bytes) 000812 1782866248.140221 MIRROR_RESYNC 10 mirrors 000814 1782866248.463347 trunc from 0x040000 to 0x011ccb (0x2e334 bytes) 000815 1782866248.489164 trunc from 0x011ccc to 0x00d3da (0x48f1 bytes) 000817 1782866248.494930 mapread 0x000dc6 thru 0x00d3da (0xc615 bytes) 000818 1782866248.501603 read 0x000c1f thru 0x00cc2e (0xc010 bytes) 000820 1782866248.502732 mapread 0x00cf98 thru 0x00d3da (0x443 bytes) 000822 1782866248.504119 trunc from 0x00d3db to 0x010d99 (0x39bf bytes) 000824 1782866248.508572 trunc from 0x010d9a to 0x01f3c5 (0xe62c bytes) 000825 1782866248.512381 mapread 0x01a5b9 thru 0x01f3c5 (0x4e0d bytes) 000826 1782866248.515337 write 0x03e3c9 thru 0x03ffff (0x1c37 bytes) 000827 1782866248.516018 mapwrite 0x0301ad thru 0x03fa1d (0xf871 bytes) 000828 1782866248.537275 MIRROR_RESYNC 10 mirrors 000829 1782866248.839153 read 0x01ac42 thru 0x01de21 (0x31e0 bytes) 000830 1782866248.841115 mapwrite 0x009766 thru 0x011b64 (0x83ff bytes) 000831 1782866248.890486 mapwrite 0x0022a6 thru 0x006387 (0x40e2 bytes) 000833 1782866248.903639 write 0x0355f5 thru 0x03ffff (0xaa0b bytes) 000834 1782866248.905619 mapwrite 0x00a175 thru 0x012fc2 (0x8e4e bytes) 000835 1782866248.918612 mapwrite 0x017ae1 thru 0x019ce6 (0x2206 bytes) 000836 1782866248.931739 read 0x01b7a4 thru 0x01d91d (0x217a bytes) 000837 1782866248.932175 mapread 0x010509 thru 0x01ffcf (0xfac7 bytes) 000839 1782866248.934606 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3bdaacec (stale) Mirror 14: 0x3bdaacec (stale) Mirror 15: 0x3bdaacec (stale) Mirror 16: 0x3bdaacec (stale) Mirror 17: 0x3bdaacec (stale) Mirror 18: 0x3bdaacec (stale) Mirror 19: 0x3bdaacec (stale) Mirror 20: 0x3bdaacec (stale) Mirror 21: 0x3bdaacec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x34fa7599 Mirror 22: 0x34fa7599 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000840 1782866249.181271 MIRROR_RESYNC 11 mirrors 000841 1782866249.490447 read 0x03d824 thru 0x03ffff (0x27dc bytes) 000843 1782866249.492281 write 0x012c2e thru 0x01ff39 (0xd30c bytes) 000844 1782866249.513013 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x34fa7599 (stale) Mirror 14: 0x34fa7599 (stale) Mirror 15: 0x34fa7599 (stale) Mirror 16: 0x34fa7599 (stale) Mirror 17: 0x34fa7599 (stale) Mirror 18: 0x34fa7599 (stale) Mirror 19: 0x34fa7599 (stale) Mirror 20: 0x34fa7599 (stale) Mirror 21: 0x34fa7599 (stale) Mirror 22: 0x34fa7599 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x17a83aab Mirror 23: 0x17a83aab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000846 1782866249.761248 mapread 0x0184a8 thru 0x021381 (0x8eda bytes) 000848 1782866249.771459 write 0x010dae thru 0x013ccf (0x2f22 bytes) 000849 1782866249.793414 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x34fa7599 (stale) Mirror 15: 0x34fa7599 (stale) Mirror 16: 0x34fa7599 (stale) Mirror 17: 0x34fa7599 (stale) Mirror 18: 0x34fa7599 (stale) Mirror 19: 0x34fa7599 (stale) Mirror 20: 0x34fa7599 (stale) Mirror 21: 0x34fa7599 (stale) Mirror 22: 0x34fa7599 (stale) Mirror 23: 0x17a83aab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x34fa7599 (stale) Mirror 15: 0x34fa7599 (stale) Mirror 16: 0x34fa7599 (stale) Mirror 17: 0x34fa7599 (stale) Mirror 18: 0x34fa7599 (stale) Mirror 19: 0x34fa7599 (stale) Mirror 20: 0x34fa7599 (stale) Mirror 21: 0x34fa7599 (stale) Mirror 22: 0x34fa7599 (stale) Mirror 23: 0x17a83aab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000851 1782866249.922399 mapread 0x03c279 thru 0x03ffff (0x3d87 bytes) 000852 1782866249.926640 mapread 0x00695b thru 0x0113bc (0xaa62 bytes) 000853 1782866249.930680 read 0x027ca5 thru 0x035724 (0xda80 bytes) 000854 1782866249.934015 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x34fa7599 (stale) Mirror 16: 0x34fa7599 (stale) Mirror 17: 0x34fa7599 (stale) Mirror 18: 0x34fa7599 (stale) Mirror 19: 0x34fa7599 (stale) Mirror 20: 0x34fa7599 (stale) Mirror 21: 0x34fa7599 (stale) Mirror 22: 0x34fa7599 (stale) Mirror 23: 0x17a83aab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x34fa7599 (stale) Mirror 16: 0x34fa7599 (stale) Mirror 17: 0x34fa7599 (stale) Mirror 18: 0x34fa7599 (stale) Mirror 19: 0x34fa7599 (stale) Mirror 20: 0x34fa7599 (stale) Mirror 21: 0x34fa7599 (stale) Mirror 22: 0x34fa7599 (stale) Mirror 23: 0x17a83aab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000855 1782866250.060883 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x34fa7599 (stale) Mirror 16: 0x34fa7599 (stale) Mirror 17: 0x34fa7599 (stale) Mirror 18: 0x34fa7599 (stale) Mirror 19: 0x34fa7599 (stale) Mirror 20: 0x34fa7599 (stale) Mirror 21: 0x34fa7599 (stale) Mirror 22: 0x34fa7599 (stale) Mirror 23: 0x17a83aab (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x96220702 Mirror 24: 0x96220702 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000857 1782866250.317616 mapread 0x029503 thru 0x031489 (0x7f87 bytes) 000858 1782866250.326546 trunc from 0x040000 to 0x000513 (0x3faec bytes) 000860 1782866250.351033 mapwrite 0x03c8a2 thru 0x03ffff (0x375e bytes) 000863 1782866250.372641 mapread 0x01cddb thru 0x0242d6 (0x74fc bytes) 000865 1782866250.376674 trunc from 0x040000 to 0x025695 (0x1a96a bytes) 000866 1782866250.380845 mapread 0x00c86c thru 0x01870f (0xbea4 bytes) 000869 1782866250.385085 write 0x02ac97 thru 0x0350ba (0xa424 bytes) 000870 1782866250.385932 mapread 0x0090cb thru 0x00a405 (0x133b bytes) 000871 1782866250.386673 trunc from 0x0350bb to 0x031ab9 (0x3601 bytes) truncating to largest ever: 0x3ff42 000877 1782866250.392535 trunc from 0x031aba to 0x03ff41 (0xe488 bytes) 000878 1782866250.397413 MIRROR_RESYNC 11 mirrors 000879 1782866250.741626 MIRROR_EXTEND to 12 mirrors 000880 1782866250.927788 mapwrite 0x01566f thru 0x0254c1 (0xfe53 bytes) 000883 1782866250.985169 write 0x00f1da thru 0x01b35d (0xc184 bytes) 000884 1782866250.986520 read 0x010912 thru 0x01fed0 (0xf5bf bytes) 000885 1782866250.987234 write 0x03e8e6 thru 0x03ffff (0x171a bytes) 000888 1782866250.990690 write 0x0020dc thru 0x006e87 (0x4dac bytes) 000889 1782866250.993682 mapread 0x01ab7d thru 0x01ce2c (0x22b0 bytes) 000890 1782866250.994634 mapwrite 0x0107d9 thru 0x011be9 (0x1411 bytes) 000892 1782866251.005751 read 0x026d84 thru 0x0320d1 (0xb34e bytes) 000893 1782866251.008410 read 0x016e2d thru 0x01fc11 (0x8de5 bytes) 000895 1782866251.009141 write 0x034507 thru 0x0363db (0x1ed5 bytes) 000896 1782866251.009773 mapwrite 0x0350ad thru 0x038409 (0x335d bytes) 000898 1782866251.020042 write 0x01cd0d thru 0x025a5a (0x8d4e bytes) 000899 1782866251.020726 mapwrite 0x031763 thru 0x037660 (0x5efe bytes) 000900 1782866251.031857 mapwrite 0x01590b thru 0x02547a (0xfb70 bytes) 000901 1782866251.044763 mapread 0x03559f thru 0x037568 (0x1fca bytes) 000903 1782866251.045720 mapwrite 0x0197f2 thru 0x02182e (0x803d bytes) 000910 1782866251.059033 mapread 0x00b3c6 thru 0x01ab9b (0xf7d6 bytes) 000911 1782866251.061479 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x738c6ca1 (stale) Mirror 16: 0x738c6ca1 (stale) Mirror 17: 0x738c6ca1 (stale) Mirror 18: 0x738c6ca1 (stale) Mirror 19: 0x738c6ca1 (stale) Mirror 21: 0x738c6ca1 (stale) Mirror 22: 0x738c6ca1 (stale) Mirror 23: 0x738c6ca1 (stale) Mirror 24: 0x738c6ca1 (stale) Mirror 25: 0x738c6ca1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x738c6ca1 (stale) Mirror 16: 0x738c6ca1 (stale) Mirror 17: 0x738c6ca1 (stale) Mirror 18: 0x738c6ca1 (stale) Mirror 19: 0x738c6ca1 (stale) Mirror 21: 0x738c6ca1 (stale) Mirror 22: 0x738c6ca1 (stale) Mirror 23: 0x738c6ca1 (stale) Mirror 24: 0x738c6ca1 (stale) Mirror 25: 0x738c6ca1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000912 1782866251.194358 mapwrite 0x001c3f thru 0x002b5c (0xf1e bytes) 000914 1782866251.207292 read 0x0078ca thru 0x00c00f (0x4746 bytes) 000915 1782866251.210089 read 0x03ebe3 thru 0x03ffff (0x141d bytes) 000916 1782866251.213262 write 0x00c180 thru 0x01935a (0xd1db bytes) 000917 1782866251.214145 write 0x01b203 thru 0x0204fd (0x52fb bytes) 000920 1782866251.216050 trunc from 0x040000 to 0x038106 (0x7ef9 bytes) 000922 1782866251.220909 mapread 0x014a79 thru 0x01a8d3 (0x5e5b bytes) 000923 1782866251.223134 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38107): Mirror 15: 0x8540071d (stale) Mirror 16: 0x8540071d (stale) Mirror 17: 0x8540071d (stale) Mirror 18: 0x8540071d (stale) Mirror 19: 0x8540071d (stale) Mirror 21: 0x8540071d (stale) Mirror 22: 0x8540071d (stale) Mirror 24: 0x8540071d (stale) Mirror 25: 0x8540071d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38107): Mirror 15: 0x8540071d (stale) Mirror 16: 0x8540071d (stale) Mirror 17: 0x8540071d (stale) Mirror 18: 0x8540071d (stale) Mirror 19: 0x8540071d (stale) Mirror 21: 0x8540071d (stale) Mirror 22: 0x8540071d (stale) Mirror 24: 0x8540071d (stale) Mirror 25: 0x8540071d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38107: skipped 000925 1782866251.356702 MIRROR_RESYNC 10 mirrors 000928 1782866251.666515 write 0x007c06 thru 0x00f774 (0x7b6f bytes) 000929 1782866251.685795 mapread 0x022c95 thru 0x0247ba (0x1b26 bytes) 000930 1782866251.690873 mapwrite 0x016de3 thru 0x022aff (0xbd1d bytes) 000931 1782866251.708107 mapread 0x030ffb thru 0x03508e (0x4094 bytes) 000932 1782866251.711233 mapread 0x02ce06 thru 0x034ffd (0x81f8 bytes) 000934 1782866251.712698 mapread 0x00bc79 thru 0x00beff (0x287 bytes) 000935 1782866251.713521 write 0x022edf thru 0x02a2fb (0x741d bytes) 000937 1782866251.715110 write 0x010453 thru 0x01a83f (0xa3ed bytes) 000939 1782866251.716681 trunc from 0x038107 to 0x017bb1 (0x20555 bytes) 000941 1782866251.726693 trunc from 0x017bb2 to 0x00a254 (0xd95d bytes) 000942 1782866251.731455 write 0x022122 thru 0x02460e (0x24ed bytes) 000943 1782866251.732266 mapwrite 0x00c2e0 thru 0x010faf (0x4cd0 bytes) 000946 1782866251.748131 mapwrite 0x002d6b thru 0x006fc6 (0x425c bytes) 000948 1782866251.761218 mapwrite 0x01c132 thru 0x02ab28 (0xe9f7 bytes) 000952 1782866251.785204 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2ab29): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ab29): Mirror 15: 0x31141f58 (stale) Mirror 16: 0x31141f58 (stale) Mirror 17: 0x31141f58 (stale) Mirror 18: 0x31141f58 (stale) Mirror 19: 0x31141f58 (stale) Mirror 21: 0x31141f58 (stale) Mirror 22: 0x31141f58 (stale) Mirror 24: 0x31141f58 (stale) Mirror 25: 0x31141f58 (stale) CRC-32 checksum value for chunk [0, 0x2ab29): Mirror 1: 0x6ecd3db8 Mirror 26: 0x6ecd3db8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ab29: skipped 000953 1782866252.006990 write 0x003195 thru 0x00a305 (0x7171 bytes) 000955 1782866252.030835 read 0x023ec6 thru 0x02ab28 (0x6c63 bytes) 000957 1782866252.035067 MIRROR_RESYNC 11 mirrors 000958 1782866252.370892 mapwrite 0x038585 thru 0x03ffff (0x7a7b bytes) 000959 1782866252.415601 trunc from 0x040000 to 0x02bdcc (0x14233 bytes) 000960 1782866252.422574 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bdcd): Mirror 15: 0xc04e6fe1 (stale) Mirror 16: 0xc04e6fe1 (stale) Mirror 17: 0xc04e6fe1 (stale) Mirror 18: 0xc04e6fe1 (stale) Mirror 19: 0xc04e6fe1 (stale) Mirror 21: 0xc04e6fe1 (stale) Mirror 24: 0xc04e6fe1 (stale) Mirror 25: 0xc04e6fe1 (stale) Mirror 26: 0xc04e6fe1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bdcd): Mirror 15: 0xc04e6fe1 (stale) Mirror 16: 0xc04e6fe1 (stale) Mirror 17: 0xc04e6fe1 (stale) Mirror 18: 0xc04e6fe1 (stale) Mirror 19: 0xc04e6fe1 (stale) Mirror 21: 0xc04e6fe1 (stale) Mirror 24: 0xc04e6fe1 (stale) Mirror 25: 0xc04e6fe1 (stale) Mirror 26: 0xc04e6fe1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bdcd: skipped 000961 1782866252.555505 trunc from 0x02bdcd to 0x01b513 (0x108b9 bytes) 000962 1782866252.559515 write 0x024586 thru 0x029585 (0x5000 bytes) 000964 1782866252.560732 mapwrite 0x01b2dd thru 0x02668e (0xb3b2 bytes) 000967 1782866252.583683 mapwrite 0x039105 thru 0x03ffff (0x6efb bytes) 000970 1782866252.606152 mapwrite 0x020cbc thru 0x02f847 (0xeb8c bytes) 000971 1782866252.624707 trunc from 0x040000 to 0x013d61 (0x2c29e bytes) 000972 1782866252.629474 trunc from 0x013d62 to 0x0388f0 (0x24b8f bytes) 000975 1782866252.634519 mapread 0x012e8f thru 0x01e91a (0xba8c bytes) 000976 1782866252.640737 mapread 0x0237e6 thru 0x02578f (0x1faa bytes) 000977 1782866252.644239 mapwrite 0x00940a thru 0x0133c0 (0x9fb7 bytes) 000978 1782866252.662118 trunc from 0x0388f1 to 0x03b4d0 (0x2be0 bytes) 000980 1782866252.667880 mapwrite 0x02394f thru 0x03076a (0xce1c bytes) 000985 1782866252.689365 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b4d1): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4d1): Mirror 15: 0xb6b749d1 (stale) Mirror 16: 0xb6b749d1 (stale) Mirror 17: 0xb6b749d1 (stale) Mirror 18: 0xb6b749d1 (stale) Mirror 19: 0xb6b749d1 (stale) Mirror 21: 0xb6b749d1 (stale) Mirror 24: 0xb6b749d1 (stale) Mirror 25: 0xb6b749d1 (stale) Mirror 26: 0xb6b749d1 (stale) CRC-32 checksum value for chunk [0, 0x3b4d1): Mirror 1: 0x1d2deef1 Mirror 27: 0x1d2deef1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4d1: skipped 000986 1782866252.927115 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x664:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b4d1): Mirror 15: 0xb6b749d1 (stale) Mirror 16: 0xb6b749d1 (stale) Mirror 17: 0xb6b749d1 (stale) Mirror 18: 0xb6b749d1 (stale) Mirror 19: 0xb6b749d1 (stale) Mirror 21: 0xb6b749d1 (stale) Mirror 24: 0xb6b749d1 (stale) Mirror 26: 0xb6b749d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4d1): Mirror 15: 0xb6b749d1 (stale) Mirror 16: 0xb6b749d1 (stale) Mirror 17: 0xb6b749d1 (stale) Mirror 18: 0xb6b749d1 (stale) Mirror 19: 0xb6b749d1 (stale) Mirror 21: 0xb6b749d1 (stale) Mirror 24: 0xb6b749d1 (stale) Mirror 26: 0xb6b749d1 (stale) CRC-32 checksum value for chunk [0, 0x3b4d1): Mirror 1: 0x1d2deef1 Mirror 27: 0x1d2deef1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4d1: skipped 000987 1782866253.138560 trunc from 0x03b4d1 to 0x02f526 (0xbfaa bytes) 000988 1782866253.165073 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f527): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f527): Mirror 15: 0x7bae88ef (stale) Mirror 16: 0x7bae88ef (stale) Mirror 17: 0x7bae88ef (stale) Mirror 18: 0x7bae88ef (stale) Mirror 19: 0x7bae88ef (stale) Mirror 21: 0x7bae88ef (stale) Mirror 24: 0x7bae88ef (stale) Mirror 26: 0x7bae88ef (stale) Mirror 27: 0x8e3f9f2c (stale) CRC-32 checksum value for chunk [0, 0x2f527): Mirror 1: 0x8e3f9f2c Mirror 28: 0x8e3f9f2c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f527: skipped 000989 1782866253.404074 mapwrite 0x01d8bb thru 0x025fdb (0x8721 bytes) 000991 1782866253.460451 mapread 0x0057b9 thru 0x010942 (0xb18a bytes) 000992 1782866253.463557 mapwrite 0x034af0 thru 0x03ffff (0xb510 bytes) 000995 1782866253.489212 mapread 0x004a51 thru 0x009a23 (0x4fd3 bytes) 000996 1782866253.490348 trunc from 0x040000 to 0x028438 (0x17bc7 bytes) 000998 1782866253.495056 read 0x007f68 thru 0x008459 (0x4f2 bytes) 000999 1782866253.495429 write 0x03b6bb thru 0x03e559 (0x2e9f bytes) 001000 1782866253.496105 mapwrite 0x02a1de thru 0x02da9f (0x38c2 bytes) All operations completed A-OK!