== sanity-flr test 70a: flr mode fsx test ================ 18:27:24 (1787783244) Seed set to 3246 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002 1787783247.187758 mapwrite 0x0119c4 thru 0x01eafa (0xd137 bytes) 000003 1787783247.344389 MIRROR_EXTEND to 2 mirrors 000004 1787783248.221707 MIRROR_RESYNC 2 mirrors 000005 1787783248.553630 read 0x00a7e1 thru 0x010865 (0x6085 bytes) 000006 1787783248.566925 MIRROR_EXTEND to 3 mirrors 000008 1787783249.613640 mapread 0x00d479 thru 0x010bf4 (0x377c bytes) 000009 1787783249.635039 mapwrite 0x004f71 thru 0x0097e4 (0x4874 bytes) 000010 1787783249.812864 write 0x01536e thru 0x022bea (0xd87d bytes) 000011 1787783249.821881 mapread 0x010601 thru 0x01b0ed (0xaaed bytes) 000012 1787783249.829914 write 0x00e90c thru 0x014b6f (0x6264 bytes) truncating to largest ever: 0xe9da 000014 1787783249.834103 trunc from 0x022beb to 0x00e9d9 (0x14211 bytes) 000016 1787783249.863495 mapwrite 0x01ad7b thru 0x027abf (0xcd45 bytes) 000017 1787783249.947108 read 0x00e3db thru 0x019efb (0xbb21 bytes) truncating to largest ever: 0x3b357 000018 1787783249.956523 trunc from 0x027ac0 to 0x03b356 (0x13897 bytes) 000021 1787783249.980504 mapwrite 0x01ffdc thru 0x020ce5 (0xd0a bytes) 000026 1787783250.035196 MIRROR_RESYNC 3 mirrors 000027 1787783252.067791 mapwrite 0x0086c3 thru 0x009ed3 (0x1811 bytes) 000028 1787783252.382646 MIRROR_RESYNC 3 mirrors 000030 1787783254.600598 write 0x029d75 thru 0x0364cd (0xc759 bytes) 000031 1787783254.727005 read 0x007f41 thru 0x014673 (0xc733 bytes) 000036 1787783254.749663 write 0x01a0c7 thru 0x01ada8 (0xce2 bytes) 000037 1787783254.758532 write 0x019dbd thru 0x01c0b4 (0x22f8 bytes) 000038 1787783254.768531 mapread 0x016d29 thru 0x018b13 (0x1deb bytes) 000039 1787783254.786546 mapwrite 0x00bc39 thru 0x00f856 (0x3c1e bytes) 000043 1787783254.851432 write 0x01aaad thru 0x02087b (0x5dcf bytes) 000045 1787783254.853346 read 0x021289 thru 0x02c6ee (0xb466 bytes) 000046 1787783254.865493 mapread 0x032033 thru 0x036f4f (0x4f1d bytes) 000047 1787783254.872353 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b357): Mirror 3: 0xd7ab41f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b357): Mirror 3: 0xd7ab41f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b357: skipped 000048 1787783255.309104 write 0x02dcff thru 0x039000 (0xb302 bytes) 000049 1787783255.320324 read 0x012b40 thru 0x022190 (0xf651 bytes) 000050 1787783255.329026 write 0x023dfa thru 0x029a4c (0x5c53 bytes) 000051 1787783255.339070 mapread 0x0386be thru 0x03b20d (0x2b50 bytes) 000054 1787783255.353976 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000055 1787783255.512907 read 0x034217 thru 0x03a401 (0x61eb bytes) 000058 1787783255.524714 write 0x008322 thru 0x00ae27 (0x2b06 bytes) 000059 1787783255.533672 mapread 0x02c134 thru 0x030089 (0x3f56 bytes) 000061 1787783255.550885 read 0x00e492 thru 0x017564 (0x90d3 bytes) 000063 1787783255.562068 trunc from 0x03b357 to 0x036527 (0x4e2f bytes) 000064 1787783255.575107 trunc from 0x036528 to 0x0360aa (0x47d bytes) 000066 1787783255.591116 read 0x00fdd0 thru 0x01ba42 (0xbc73 bytes) 000067 1787783255.591760 mapread 0x029154 thru 0x0345d7 (0xb484 bytes) 000068 1787783255.592653 write 0x039a64 thru 0x03ffff (0x659c bytes) 000070 1787783255.595597 write 0x00228d thru 0x00aa69 (0x87dd bytes) 000072 1787783255.597573 trunc from 0x040000 to 0x034811 (0xb7ee bytes) 000075 1787783255.616103 read 0x0255d7 thru 0x0285dc (0x3006 bytes) 000077 1787783255.617131 write 0x004db5 thru 0x00a813 (0x5a5f bytes) 000078 1787783255.619500 mapwrite 0x0304db thru 0x03ffff (0xfb25 bytes) 000082 1787783255.700019 read 0x03a903 thru 0x03ffff (0x56fd bytes) 000085 1787783255.703306 write 0x025698 thru 0x03264d (0xcfb6 bytes) 000086 1787783255.704881 write 0x03cf0a thru 0x03ffff (0x30f6 bytes) 000087 1787783255.706660 mapwrite 0x03e59d thru 0x03ffff (0x1a63 bytes) 000090 1787783255.748567 mapwrite 0x02e9bf thru 0x033a24 (0x5066 bytes) 000092 1787783255.828872 read 0x00180b thru 0x0047bc (0x2fb2 bytes) 000093 1787783255.829815 trunc from 0x040000 to 0x03b34a (0x4cb5 bytes) 000096 1787783255.866330 read 0x013354 thru 0x01facb (0xc778 bytes) 000101 1787783255.871460 trunc from 0x03b34b to 0x015a7a (0x258d0 bytes) 000103 1787783255.908141 trunc from 0x015a7b to 0x02a87d (0x14e03 bytes) 000104 1787783255.933840 trunc from 0x02a87e to 0x026599 (0x42e4 bytes) 000108 1787783255.959657 mapwrite 0x002f46 thru 0x00e48f (0xb54a bytes) 000109 1787783256.067464 mapwrite 0x01454e thru 0x016f30 (0x29e3 bytes) 000110 1787783256.260346 mapread 0x00cdf0 thru 0x00f79d (0x29ae bytes) 000111 1787783256.280481 MIRROR_EXTEND to 2 mirrors 000112 1787783257.484422 MIRROR_RESYNC 2 mirrors 000120 1787783257.787655 mapwrite 0x012a07 thru 0x01863e (0x5c38 bytes) 000122 1787783257.977550 write 0x037e86 thru 0x03de6a (0x5fe5 bytes) 000123 1787783257.979658 write 0x02af46 thru 0x036ab8 (0xbb73 bytes) 000124 1787783257.992473 mapwrite 0x01e0ce thru 0x0258c8 (0x77fb bytes) 000126 1787783258.074600 write 0x003f47 thru 0x013ed9 (0xff93 bytes) 000130 1787783258.083505 mapread 0x02dc16 thru 0x02f089 (0x1474 bytes) 000131 1787783258.085637 write 0x011f89 thru 0x013c25 (0x1c9d bytes) 000133 1787783258.088765 read 0x01a735 thru 0x028c4e (0xe51a bytes) 000138 1787783258.103529 write 0x017223 thru 0x0259a1 (0xe77f bytes) 000140 1787783258.117602 MIRROR_RESYNC 2 mirrors 000142 1787783258.955551 read 0x00ef05 thru 0x015a5a (0x6b56 bytes) 000143 1787783258.965366 trunc from 0x03de6b to 0x02fb5a (0xe310 bytes) 000145 1787783259.170444 mapread 0x009542 thru 0x011819 (0x82d8 bytes) 000146 1787783259.218755 mapread 0x028cf8 thru 0x029191 (0x49a bytes) 000147 1787783259.251498 mapread 0x00a1cd thru 0x00fefa (0x5d2e bytes) 000148 1787783259.255733 mapread 0x00d649 thru 0x01ba03 (0xe3bb bytes) 000149 1787783259.275573 read 0x027823 thru 0x02fb5a (0x8338 bytes) 000150 1787783259.277626 mapwrite 0x032031 thru 0x03b4c6 (0x9496 bytes) 000152 1787783259.466898 write 0x0240be thru 0x02e73d (0xa680 bytes) 000157 1787783259.473675 read 0x00f9e7 thru 0x01c6b0 (0xccca bytes) 000158 1787783259.474341 mapread 0x0300c8 thru 0x035a3b (0x5974 bytes) 000159 1787783259.474980 trunc from 0x03b4c7 to 0x007f2f (0x33597 bytes) 000160 1787783259.519839 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x7f30): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7f30): Mirror 2: 0xbadaea4f (stale) CRC-32 checksum value for chunk [0, 0x7f30): Mirror 1: 0xbadaea4f Mirror 3: 0xbadaea4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7f30: skipped 000162 1787783261.108444 write 0x017666 thru 0x026f1c (0xf8b7 bytes) 000168 1787783261.334603 read 0x01f4d9 thru 0x02083a (0x1362 bytes) 000169 1787783261.335375 write 0x026ae7 thru 0x02c5c0 (0x5ada bytes) 000170 1787783261.355238 mapwrite 0x013da2 thru 0x018a50 (0x4caf bytes) 000171 1787783261.614265 read 0x02a78c thru 0x02c5c0 (0x1e35 bytes) 000172 1787783261.615587 read 0x02ad90 thru 0x02c5c0 (0x1831 bytes) 000174 1787783261.621619 mapwrite 0x00dfda thru 0x01429f (0x62c6 bytes) 000175 1787783261.807826 trunc from 0x02c5c1 to 0x0252a0 (0x7320 bytes) 000176 1787783261.838125 write 0x03966a thru 0x03d171 (0x3b08 bytes) 000177 1787783261.839155 write 0x01cf27 thru 0x021695 (0x476f bytes) 000178 1787783261.843308 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d172): Mirror 3: 0x12b31aec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d172): Mirror 3: 0x12b31aec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d172: skipped 000180 1787783262.123393 trunc from 0x03d172 to 0x02b5c2 (0x11baf bytes) 000181 1787783262.149529 read 0x0121db thru 0x01595f (0x3785 bytes) 000183 1787783262.163086 mapwrite 0x0145a1 thru 0x0243ca (0xfe2a bytes) 000185 1787783262.242177 trunc from 0x02b5c3 to 0x036092 (0xaad0 bytes) 000186 1787783262.251282 read 0x02e899 thru 0x036092 (0x77fa bytes) 000189 1787783262.262965 write 0x03fb98 thru 0x03ffff (0x468 bytes) 000190 1787783262.263707 mapwrite 0x0192e5 thru 0x01dd25 (0x4a41 bytes) 000191 1787783262.302954 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd50e4cb2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xaadf8464 Mirror 4: 0xaadf8464 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000192 1787783263.444362 trunc from 0x040000 to 0x019fda (0x26025 bytes) 000193 1787783263.525748 write 0x025ec7 thru 0x02fabe (0x9bf8 bytes) 000194 1787783263.528415 read 0x006a1d thru 0x00aa1e (0x4002 bytes) 000195 1787783263.536343 mapread 0x02f25a thru 0x02fabe (0x865 bytes) 000196 1787783263.550144 mapwrite 0x037dda thru 0x03b826 (0x3a4d bytes) 000197 1787783263.619764 mapread 0x010b80 thru 0x01fd89 (0xf20a bytes) 000198 1787783263.633810 read 0x01f8ff thru 0x023bd3 (0x42d5 bytes) 000202 1787783263.641683 mapread 0x019b69 thru 0x0220e6 (0x857e bytes) 000204 1787783263.642885 write 0x0146b5 thru 0x0224ea (0xde36 bytes) 000205 1787783263.644267 trunc from 0x03b827 to 0x01b37e (0x204a8 bytes) 000207 1787783263.669927 trunc from 0x01b37f to 0x00c2d0 (0xf0ae bytes) 000209 1787783263.708442 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xc2d1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc2d1): Mirror 3: 0xcc08a60a (stale) Mirror 4: 0xcc08a60a (stale) CRC-32 checksum value for chunk [0, 0xc2d1): Mirror 1: 0xcc08a60a Mirror 5: 0xcc08a60a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc2d1: skipped 000211 1787783264.832152 write 0x03dfaf thru 0x03e826 (0x878 bytes) 000214 1787783265.006597 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e827): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e827): Mirror 3: 0x24d079a9 (stale) Mirror 4: 0x798eb8a2 (stale) Mirror 5: 0x24d079a9 (stale) CRC-32 checksum value for chunk [0, 0x3e827): Mirror 1: 0x9ceb3827 Mirror 6: 0x9ceb3827 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e827: skipped 000215 1787783266.239430 trunc from 0x03e827 to 0x014f00 (0x29926 bytes) 000218 1787783266.321417 mapread 0x014066 thru 0x014f00 (0xe9b bytes) 000219 1787783266.332702 MIRROR_RESYNC 5 mirrors 000220 1787783267.562329 mapread 0x012f88 thru 0x014f00 (0x1f79 bytes) 000222 1787783267.596619 MIRROR_EXTEND to 6 mirrors 000223 1787783268.362313 mapread 0x0081d4 thru 0x012c61 (0xaa8e bytes) 000225 1787783268.380067 mapread 0x01454e thru 0x014f00 (0x9b3 bytes) 000227 1787783268.385933 read 0x009575 thru 0x014f00 (0xb98c bytes) 000228 1787783268.386536 read 0x0093ea thru 0x00f785 (0x639c bytes) 000230 1787783268.387358 write 0x033d6b thru 0x03e864 (0xaafa bytes) 000231 1787783268.457234 trunc from 0x03e865 to 0x00299a (0x3beca bytes) 000232 1787783268.478346 mapread 0x000719 thru 0x00299a (0x2282 bytes) 000235 1787783268.485538 trunc from 0x00299b to 0x00b4dd (0x8b43 bytes) 000236 1787783268.504413 write 0x02cb45 thru 0x02f2d1 (0x278d bytes) 000237 1787783268.509689 MIRROR_RESYNC 6 mirrors 000238 1787783269.802164 mapwrite 0x002e63 thru 0x00d846 (0xa9e4 bytes) 000240 1787783269.957893 mapread 0x00b7ee thru 0x00eb4a (0x335d bytes) 000241 1787783269.958806 trunc from 0x02f2d2 to 0x004efd (0x2a3d4 bytes) 000242 1787783269.987187 MIRROR_RESYNC 6 mirrors 000246 1787783270.904564 write 0x03587f thru 0x03ffff (0xa781 bytes) 000247 1787783270.979332 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbcad1a2a (stale) Mirror 5: 0xbcad1a2a (stale) Mirror 6: 0xbcad1a2a (stale) Mirror 7: 0xbcad1a2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbcad1a2a (stale) Mirror 5: 0xbcad1a2a (stale) Mirror 6: 0xbcad1a2a (stale) Mirror 7: 0xbcad1a2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000250 1787783271.296953 trunc from 0x040000 to 0x024eeb (0x1b114 bytes) 000252 1787783271.317318 MIRROR_RESYNC 5 mirrors 000253 1787783272.317435 trunc from 0x024eec to 0x016361 (0xeb8a bytes) 000256 1787783272.388013 MIRROR_RESYNC 5 mirrors 000257 1787783273.555412 trunc from 0x016362 to 0x021f67 (0xbc06 bytes) 000258 1787783273.733324 read 0x01da7f thru 0x021f67 (0x44e9 bytes) 000260 1787783273.767644 mapread 0x01eb1e thru 0x021f67 (0x344a bytes) 000262 1787783273.774655 mapread 0x0059a4 thru 0x0070a9 (0x1706 bytes) 000263 1787783273.799705 write 0x036cee thru 0x03d7f4 (0x6b07 bytes) 000264 1787783273.801533 mapwrite 0x036572 thru 0x03ffff (0x9a8e bytes) 000265 1787783273.900748 MIRROR_RESYNC 5 mirrors 000267 1787783275.157432 write 0x01313b thru 0x0188b4 (0x577a bytes) 000269 1787783275.215453 MIRROR_RESYNC 5 mirrors 000270 1787783277.034138 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000271 1787783277.431530 MIRROR_RESYNC 4 mirrors 000272 1787783278.082577 trunc from 0x040000 to 0x023368 (0x1cc97 bytes) 000273 1787783278.303309 mapwrite 0x02ca97 thru 0x02e9cb (0x1f35 bytes) 000277 1787783278.563857 write 0x02bcac thru 0x03711b (0xb470 bytes) 000278 1787783278.577512 read 0x01c1d5 thru 0x028adb (0xc907 bytes) 000279 1787783278.615339 trunc from 0x03711c to 0x016e4b (0x202d0 bytes) 000281 1787783278.679823 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x16e4c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16e4c): Mirror 4: 0x92b61d0 (stale) Mirror 5: 0x92b61d0 (stale) Mirror 6: 0x92b61d0 (stale) CRC-32 checksum value for chunk [0, 0x16e4c): Mirror 1: 0x92b61d0 Mirror 7: 0x92b61d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16e4c: skipped 000282 1787783280.100959 mapwrite 0x02b2d2 thru 0x037cbc (0xc9eb bytes) 000284 1787783280.386434 MIRROR_RESYNC 5 mirrors 000286 1787783282.235663 mapread 0x027cb3 thru 0x0312e3 (0x9631 bytes) 000289 1787783282.257382 trunc from 0x037cbd to 0x016cc0 (0x20ffc bytes) 000291 1787783282.377632 MIRROR_RESYNC 5 mirrors 000292 1787783284.039411 read 0x00e763 thru 0x011259 (0x2af7 bytes) 000293 1787783284.046311 trunc from 0x016cc1 to 0x02950a (0x1284a bytes) 000295 1787783284.119053 trunc from 0x02950b to 0x016b4a (0x129c0 bytes) 000296 1787783284.144156 read 0x000c01 thru 0x0090bf (0x84bf bytes) 000297 1787783284.153623 mapread 0x011123 thru 0x016b4a (0x5a28 bytes) 000301 1787783284.157071 mapwrite 0x03dd52 thru 0x03ffff (0x22ae bytes) 000303 1787783284.247319 read 0x03e7aa thru 0x03ffff (0x1856 bytes) 000304 1787783284.251103 mapwrite 0x02fc07 thru 0x031438 (0x1832 bytes) 000305 1787783284.290159 mapread 0x0318cb thru 0x036a3f (0x5175 bytes) 000308 1787783284.293605 mapread 0x00f4f5 thru 0x01b9bf (0xc4cb bytes) 000309 1787783284.295030 mapread 0x038102 thru 0x03ffff (0x7efe bytes) 000310 1787783284.301051 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x77da056 (stale) Mirror 5: 0x77da056 (stale) Mirror 6: 0x77da056 (stale) Mirror 7: 0x77da056 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7d3623a4 Mirror 8: 0x7d3623a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000311 1787783285.110676 write 0x036be1 thru 0x03c8b0 (0x5cd0 bytes) 000313 1787783285.200576 trunc from 0x040000 to 0x02c5da (0x13a25 bytes) 000314 1787783285.239983 trunc from 0x02c5db to 0x02dd50 (0x1776 bytes) 000317 1787783285.254575 write 0x00510a thru 0x0138e7 (0xe7de bytes) 000318 1787783285.263751 write 0x03d433 thru 0x03ff10 (0x2ade bytes) 000319 1787783285.264915 write 0x00bfeb thru 0x0141c1 (0x81d7 bytes) 000321 1787783285.272098 mapread 0x01714c thru 0x025e14 (0xecc9 bytes) 000323 1787783285.296577 mapwrite 0x0071c5 thru 0x008990 (0x17cc bytes) 000326 1787783285.344026 write 0x002508 thru 0x00af51 (0x8a4a bytes) 000329 1787783285.350754 trunc from 0x03ff11 to 0x036e03 (0x910d bytes) 000330 1787783285.369689 mapread 0x02d65d thru 0x036e03 (0x97a7 bytes) 000331 1787783285.381033 mapread 0x019d03 thru 0x0278dd (0xdbdb bytes) 000332 1787783285.381850 mapwrite 0x020784 thru 0x0242cf (0x3b4c bytes) 000333 1787783285.427166 mapread 0x0151bf thru 0x0163d1 (0x1213 bytes) 000334 1787783285.428327 mapwrite 0x022601 thru 0x031083 (0xea83 bytes) 000337 1787783285.479955 MIRROR_RESYNC 6 mirrors 000338 1787783286.976937 write 0x03fa31 thru 0x03ffff (0x5cf bytes) 000341 1787783287.070482 mapwrite 0x0211b5 thru 0x025aea (0x4936 bytes) 000344 1787783287.173286 mapwrite 0x03f0aa thru 0x03ffff (0xf56 bytes) 000346 1787783287.215571 mapread 0x0052d7 thru 0x008306 (0x3030 bytes) 000347 1787783287.223029 mapwrite 0x025f73 thru 0x03045e (0xa4ec bytes) 000348 1787783287.260282 read 0x029ff2 thru 0x02ee71 (0x4e80 bytes) 000350 1787783287.261404 write 0x00f2e5 thru 0x016e24 (0x7b40 bytes) 000351 1787783287.266146 mapwrite 0x0367d6 thru 0x0399fc (0x3227 bytes) 000352 1787783287.311136 trunc from 0x040000 to 0x0188b8 (0x27747 bytes) 000353 1787783287.336503 write 0x032e9f thru 0x0331a1 (0x303 bytes) 000357 1787783287.340588 mapread 0x00604f thru 0x00dfe5 (0x7f97 bytes) 000358 1787783287.342447 mapread 0x009605 thru 0x01468b (0xb087 bytes) 000360 1787783287.344029 mapwrite 0x0097bf thru 0x0164a7 (0xcce9 bytes) 000361 1787783287.406048 write 0x0350d1 thru 0x039446 (0x4376 bytes) 000365 1787783287.409939 read 0x0155d1 thru 0x01f9de (0xa40e bytes) 000370 1787783287.421593 read 0x012d22 thru 0x019ca7 (0x6f86 bytes) 000374 1787783287.425117 trunc from 0x039447 to 0x02799d (0x11aa9 bytes) 000376 1787783287.444466 trunc from 0x02799e to 0x031510 (0x9b73 bytes) 000377 1787783287.464045 trunc from 0x031511 to 0x016819 (0x1acf7 bytes) 000378 1787783287.481395 trunc from 0x01681a to 0x0264ab (0xfc92 bytes) 000380 1787783287.497719 mapread 0x01749e thru 0x0264ab (0xf00e bytes) 000382 1787783287.507501 mapwrite 0x028572 thru 0x02c529 (0x3fb8 bytes) 000383 1787783287.567620 MIRROR_RESYNC 6 mirrors 000384 1787783289.307545 read 0x02a5a2 thru 0x02c529 (0x1f88 bytes) 000386 1787783289.313294 trunc from 0x02c52a to 0x00a9b8 (0x21b71 bytes) 000388 1787783289.434765 mapwrite 0x020880 thru 0x02b4dc (0xac5d bytes) 000390 1787783289.566527 mapwrite 0x019813 thru 0x027467 (0xdc55 bytes) 000391 1787783289.624693 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b4dd): Mirror 5: 0xf00adb2c (stale) Mirror 6: 0xf00adb2c (stale) Mirror 7: 0xf00adb2c (stale) Mirror 8: 0xf00adb2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b4dd): Mirror 5: 0xf00adb2c (stale) Mirror 6: 0xf00adb2c (stale) Mirror 7: 0xf00adb2c (stale) Mirror 8: 0xf00adb2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b4dd: skipped 000392 1787783290.030660 read 0x006c8d thru 0x00cf82 (0x62f6 bytes) 000393 1787783290.038064 mapwrite 0x039a13 thru 0x03b84e (0x1e3c bytes) 000394 1787783290.160522 mapread 0x007840 thru 0x00f148 (0x7909 bytes) 000396 1787783290.169295 read 0x00d222 thru 0x00d2f9 (0xd8 bytes) 000401 1787783290.175521 mapread 0x02dd50 thru 0x035ce9 (0x7f9a bytes) 000402 1787783290.189827 mapread 0x0186ff thru 0x019215 (0xb17 bytes) 000403 1787783290.191161 mapread 0x017ebe thru 0x025187 (0xd2ca bytes) 000404 1787783290.192005 trunc from 0x03b84f to 0x0168c4 (0x24f8a bytes) 000406 1787783290.208528 read 0x003c61 thru 0x013499 (0xf839 bytes) 000407 1787783290.215323 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x168c5): Mirror 5: 0x5542f102 (stale) Mirror 6: 0x5542f102 (stale) Mirror 7: 0x5542f102 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x168c5): Mirror 5: 0x5542f102 (stale) Mirror 6: 0x5542f102 (stale) Mirror 7: 0x5542f102 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x168c5: skipped 000413 1787783290.509093 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x168c5): Mirror 6: 0x5542f102 (stale) Mirror 7: 0x5542f102 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x168c5): Mirror 6: 0x5542f102 (stale) Mirror 7: 0x5542f102 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x168c5: skipped 000414 1787783290.750237 write 0x004383 thru 0x005db8 (0x1a36 bytes) 000415 1787783290.760391 write 0x0323c3 thru 0x035d21 (0x395f bytes) 000416 1787783290.762402 write 0x034c27 thru 0x03ffff (0xb3d9 bytes) 000417 1787783290.763824 mapwrite 0x0189d9 thru 0x024465 (0xba8d bytes) 000420 1787783290.830038 mapwrite 0x00d6be thru 0x017d98 (0xa6db bytes) 000421 1787783290.884087 mapread 0x01ba16 thru 0x01f8c3 (0x3eae bytes) 000422 1787783290.885129 mapread 0x00a8b6 thru 0x00dbca (0x3315 bytes) 000423 1787783290.890406 MIRROR_RESYNC 3 mirrors 000424 1787783292.419915 read 0x0395a3 thru 0x03ffff (0x6a5d bytes) 000425 1787783292.426996 mapwrite 0x01cb97 thru 0x02ca68 (0xfed2 bytes) 000426 1787783292.642302 trunc from 0x040000 to 0x038d32 (0x72cd bytes) 000428 1787783292.678945 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38d33): Mirror 6: 0xac7250ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d33): Mirror 6: 0xac7250ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d33: skipped 000429 1787783293.000090 read 0x012b44 thru 0x0166d6 (0x3b93 bytes) 000430 1787783293.018683 MIRROR_RESYNC 2 mirrors 000431 1787783293.890027 write 0x03e44f thru 0x03ffff (0x1bb1 bytes) 000432 1787783294.024509 read 0x033029 thru 0x0357c8 (0x27a0 bytes) 000433 1787783294.034108 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000434 1787783294.173177 trunc from 0x040000 to 0x01e80e (0x217f1 bytes) 000436 1787783294.205613 write 0x015f0f thru 0x01ec1d (0x8d0f bytes) 000437 1787783294.221056 MIRROR_EXTEND to 2 mirrors 000438 1787783295.132034 mapread 0x002bdc thru 0x00cf35 (0xa35a bytes) 000439 1787783295.163949 write 0x024934 thru 0x02e463 (0x9b30 bytes) 000440 1787783295.273038 trunc from 0x02e464 to 0x03935e (0xaefb bytes) 000442 1787783295.361781 mapread 0x000e07 thru 0x008b8f (0x7d89 bytes) 000449 1787783295.399446 write 0x00e875 thru 0x01a129 (0xb8b5 bytes) 000450 1787783295.418693 trunc from 0x03935f to 0x019077 (0x202e7 bytes) 000452 1787783295.460462 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000453 1787783295.794494 mapwrite 0x034957 thru 0x03ffff (0xb6a9 bytes) 000456 1787783295.953176 mapread 0x02b43b thru 0x02b57e (0x144 bytes) 000457 1787783295.975667 read 0x03919c thru 0x03cd53 (0x3bb8 bytes) 000458 1787783295.976788 trunc from 0x040000 to 0x02ae00 (0x151ff bytes) 000459 1787783296.021633 mapread 0x002138 thru 0x008a1b (0x68e4 bytes) 000460 1787783296.042466 trunc from 0x02ae01 to 0x00bf7d (0x1ee83 bytes) 000463 1787783296.093476 mapread 0x0051d4 thru 0x00a247 (0x5074 bytes) 000464 1787783296.097463 trunc from 0x00bf7e to 0x0044d4 (0x7aa9 bytes) 000467 1787783296.146775 trunc from 0x0044d5 to 0x00e242 (0x9d6e bytes) 000469 1787783296.183323 trunc from 0x00e243 to 0x002df5 (0xb44d bytes) 000470 1787783296.220576 MIRROR_EXTEND to 2 mirrors 000471 1787783297.703114 mapwrite 0x00041a thru 0x0043b3 (0x3f9a bytes) 000472 1787783297.944421 MIRROR_RESYNC 2 mirrors 000475 1787783299.231523 mapwrite 0x03abe3 thru 0x03d7bb (0x2bd9 bytes) 000476 1787783299.504634 mapwrite 0x03c311 thru 0x03ffff (0x3cef bytes) 000477 1787783299.615245 mapread 0x004125 thru 0x005c14 (0x1af0 bytes) 000479 1787783299.635378 write 0x02d4a9 thru 0x0324a8 (0x5000 bytes) 000481 1787783299.648442 mapwrite 0x02e4e0 thru 0x0380e6 (0x9c07 bytes) 000482 1787783299.746965 trunc from 0x040000 to 0x03263d (0xd9c2 bytes) 000484 1787783299.774572 mapread 0x0131de thru 0x01f83a (0xc65d bytes) 000489 1787783299.807785 read 0x0102c4 thru 0x01ab39 (0xa876 bytes) 000492 1787783299.809693 mapwrite 0x02aca2 thru 0x032df8 (0x8157 bytes) 000493 1787783300.027421 mapwrite 0x03140e thru 0x03f9c1 (0xe5b4 bytes) 000494 1787783300.154550 write 0x03fc3b thru 0x03ffff (0x3c5 bytes) 000495 1787783300.164635 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf2549d1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf901878c Mirror 3: 0xf901878c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000496 1787783301.334049 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf2549d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf2549d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000497 1787783301.756430 write 0x036a44 thru 0x03c096 (0x5653 bytes) 000498 1787783301.793659 read 0x012548 thru 0x016332 (0x3deb bytes) 000499 1787783301.815053 mapread 0x02ec13 thru 0x030a94 (0x1e82 bytes) 000500 1787783301.842435 trunc from 0x040000 to 0x007608 (0x389f7 bytes) 000501 1787783301.911681 mapwrite 0x02e00d thru 0x039d8a (0xbd7e bytes) 000503 1787783302.076851 write 0x00209e thru 0x009254 (0x71b7 bytes) 000504 1787783302.095186 trunc from 0x039d8b to 0x032023 (0x7d67 bytes) 000505 1787783302.124236 read 0x0203ab thru 0x021e24 (0x1a7a bytes) 000507 1787783302.142647 mapwrite 0x02cc48 thru 0x03b793 (0xeb4c bytes) 000508 1787783302.251528 read 0x02b494 thru 0x033392 (0x7eff bytes) 000509 1787783302.252504 write 0x010f3f thru 0x012e60 (0x1f22 bytes) 000510 1787783302.257522 write 0x0130a6 thru 0x02154b (0xe4a6 bytes) 000511 1787783302.260518 mapread 0x033676 thru 0x037618 (0x3fa3 bytes) 000514 1787783302.263708 trunc from 0x03b794 to 0x01ecf2 (0x1caa1 bytes) 000516 1787783302.288754 read 0x00936c thru 0x013309 (0x9f9e bytes) 000517 1787783302.290101 mapread 0x016340 thru 0x01ecf2 (0x89b3 bytes) 000521 1787783302.300371 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ecf3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecf3): Mirror 2: 0xb61ac1ff (stale) CRC-32 checksum value for chunk [0, 0x1ecf3): Mirror 1: 0x487209b1 Mirror 3: 0x487209b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecf3: skipped 000522 1787783303.463358 mapwrite 0x034fa0 thru 0x038f95 (0x3ff6 bytes) 000523 1787783303.669691 read 0x01202c thru 0x0206d4 (0xe6a9 bytes) 000524 1787783303.694758 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38f96): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f96): Mirror 2: 0x163fca09 (stale) Mirror 3: 0xa7143d7c (stale) CRC-32 checksum value for chunk [0, 0x38f96): Mirror 1: 0xa1a233d1 Mirror 4: 0xa1a233d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f96: skipped 000525 1787783304.910515 read 0x01a63b thru 0x029827 (0xf1ed bytes) 000526 1787783304.919776 read 0x0354d3 thru 0x038f95 (0x3ac3 bytes) 000527 1787783304.932026 mapwrite 0x02342d thru 0x0286aa (0x527e bytes) 000528 1787783305.136060 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38f96): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f96): Mirror 2: 0x163fca09 (stale) Mirror 3: 0xa7143d7c (stale) Mirror 4: 0xa1a233d1 (stale) CRC-32 checksum value for chunk [0, 0x38f96): Mirror 1: 0xd6beb146 Mirror 5: 0xd6beb146 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f96: skipped 000530 1787783306.437508 write 0x034133 thru 0x03e9ae (0xa87c bytes) 000532 1787783306.581309 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 2: 0x905b9170 (stale) Mirror 4: 0xf67d1f6e (stale) Mirror 5: 0xa7853be2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 2: 0x905b9170 (stale) Mirror 4: 0xf67d1f6e (stale) Mirror 5: 0xa7853be2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9af: skipped 000533 1787783306.908362 write 0x00a439 thru 0x01821b (0xdde3 bytes) 000534 1787783306.920797 mapwrite 0x0216f7 thru 0x02db8a (0xc494 bytes) 000536 1787783307.000881 mapread 0x039510 thru 0x03e9ae (0x549f bytes) 000537 1787783307.010829 mapread 0x02db24 thru 0x0344e3 (0x69c0 bytes) 000538 1787783307.016058 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 2: 0x905b9170 (stale) Mirror 4: 0xf67d1f6e (stale) Mirror 5: 0xa7853be2 (stale) CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 1: 0x711262b8 Mirror 6: 0x711262b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9af: skipped 000539 1787783308.437872 mapread 0x02c974 thru 0x0300ed (0x377a bytes) 000542 1787783308.473565 read 0x01bdb5 thru 0x020faa (0x51f6 bytes) 000544 1787783308.487299 mapwrite 0x006131 thru 0x015dfe (0xfcce bytes) 000546 1787783308.696954 read 0x00a8eb thru 0x00bc84 (0x139a bytes) 000548 1787783308.698160 read 0x0201c5 thru 0x022fbd (0x2df9 bytes) 000550 1787783308.711178 mapread 0x025e26 thru 0x0300fd (0xa2d8 bytes) 000551 1787783308.712382 write 0x00e224 thru 0x0151cd (0x6faa bytes) 000552 1787783308.715294 trunc from 0x03e9af to 0x03a665 (0x4349 bytes) 000553 1787783308.735681 write 0x007185 thru 0x015c8e (0xeb0a bytes) 000554 1787783308.737535 mapread 0x006f1b thru 0x0150bc (0xe1a2 bytes) 000555 1787783308.738646 mapwrite 0x036b62 thru 0x03b60f (0x4aae bytes) 000556 1787783308.804776 read 0x0060d0 thru 0x013141 (0xd072 bytes) 000558 1787783308.805975 mapwrite 0x030968 thru 0x03a1f3 (0x988c bytes) 000561 1787783308.854101 mapwrite 0x02c47d thru 0x031939 (0x54bd bytes) 000562 1787783308.913643 mapread 0x034785 thru 0x03b60f (0x6e8b bytes) 000566 1787783308.920761 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b610): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b610): Mirror 2: 0x73ece9d0 (stale) Mirror 4: 0x4cfc6f59 (stale) Mirror 5: 0x603f95b8 (stale) Mirror 6: 0xa21577c6 (stale) CRC-32 checksum value for chunk [0, 0x3b610): Mirror 1: 0xa1ebcc3 Mirror 7: 0xa1ebcc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b610: skipped 000568 1787783310.224792 write 0x0287ed thru 0x02bb38 (0x334c bytes) 000569 1787783310.367504 mapread 0x0054c5 thru 0x012e65 (0xd9a1 bytes) 000571 1787783310.402486 mapread 0x010b87 thru 0x01f54e (0xe9c8 bytes) 000572 1787783310.428032 trunc from 0x03b610 to 0x00812a (0x334e5 bytes) 000573 1787783310.476838 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x812b): Mirror 2: 0x1d34d44b (stale) Mirror 4: 0x96b741e (stale) Mirror 5: 0x96b741e (stale) Mirror 7: 0xf2d6e6d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x812b): Mirror 2: 0x1d34d44b (stale) Mirror 4: 0x96b741e (stale) Mirror 5: 0x96b741e (stale) Mirror 7: 0xf2d6e6d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x812b: skipped 000574 1787783311.033032 mapwrite 0x033d5e thru 0x03ffff (0xc2a2 bytes) 000576 1787783311.254862 write 0x02e49a thru 0x031197 (0x2cfe bytes) 000577 1787783311.273662 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf2549d1 (stale) Mirror 4: 0xbab7ca7e (stale) Mirror 5: 0xb3a1378e (stale) Mirror 7: 0x36857ae9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4bacb1c0 Mirror 8: 0x4bacb1c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000578 1787783312.597008 mapread 0x02d435 thru 0x02d912 (0x4de bytes) 000580 1787783312.605755 read 0x03bc3f thru 0x03c701 (0xac3 bytes) 000581 1787783312.613890 mapread 0x00e00d thru 0x014f4d (0x6f41 bytes) truncating to largest ever: 0x3dfdb 000582 1787783312.630386 trunc from 0x040000 to 0x03dfda (0x2025 bytes) 000583 1787783312.768141 mapread 0x005848 thru 0x013aa1 (0xe25a bytes) 000584 1787783312.791634 mapread 0x035782 thru 0x038c81 (0x3500 bytes) 000585 1787783312.802853 trunc from 0x03dfdb to 0x029da0 (0x1423a bytes) 000586 1787783312.867482 MIRROR_RESYNC 6 mirrors 000587 1787783314.425637 mapwrite 0x012163 thru 0x01cc1a (0xaab8 bytes) 000588 1787783314.628506 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29da1): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29da1): Mirror 2: 0x97e5436 (stale) Mirror 4: 0x97e5436 (stale) Mirror 5: 0x97e5436 (stale) Mirror 7: 0x97e5436 (stale) Mirror 8: 0x97e5436 (stale) CRC-32 checksum value for chunk [0, 0x29da1): Mirror 1: 0x6207f14a Mirror 9: 0x6207f14a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29da1: skipped 000589 1787783316.325515 mapwrite 0x038c9f thru 0x03ffff (0x7361 bytes) 000593 1787783316.564072 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x91f66836 (stale) Mirror 4: 0x91f66836 (stale) Mirror 5: 0x91f66836 (stale) Mirror 7: 0x91f66836 (stale) Mirror 8: 0x91f66836 (stale) Mirror 9: 0x72c8c3ee (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x63e41148 Mirror 10: 0x63e41148 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000594 1787783318.062495 read 0x01ea42 thru 0x026310 (0x78cf bytes) 000596 1787783318.075268 read 0x02621d thru 0x02c66b (0x644f bytes) 000597 1787783318.092999 read 0x006d0a thru 0x009591 (0x2888 bytes) 000602 1787783318.095466 write 0x02b6aa thru 0x02bbfe (0x555 bytes) 000603 1787783318.236177 read 0x01a019 thru 0x021796 (0x777e bytes) 000606 1787783318.243134 write 0x01ec3c thru 0x02557f (0x6944 bytes) 000607 1787783318.246754 mapwrite 0x037c00 thru 0x03a77b (0x2b7c bytes) 000608 1787783318.343241 write 0x01a09c thru 0x0297df (0xf744 bytes) 000609 1787783318.347833 mapwrite 0x0083c0 thru 0x0096b5 (0x12f6 bytes) 000610 1787783318.450355 mapwrite 0x029964 thru 0x0306bd (0x6d5a bytes) 000611 1787783318.534250 mapread 0x03aacd thru 0x03ffff (0x5533 bytes) 000613 1787783318.536316 mapwrite 0x004190 thru 0x00cd8b (0x8bfc bytes) 000614 1787783318.634265 read 0x0345af thru 0x03b712 (0x7164 bytes) 000615 1787783318.635275 read 0x034b5c thru 0x03609a (0x153f bytes) 000616 1787783318.636927 mapwrite 0x02509e thru 0x026916 (0x1879 bytes) 000617 1787783318.697227 trunc from 0x040000 to 0x010c5f (0x2f3a0 bytes) 000619 1787783318.724758 read 0x00b537 thru 0x00ba62 (0x52c bytes) 000623 1787783318.733715 mapwrite 0x02872b thru 0x032eca (0xa7a0 bytes) 000624 1787783318.821754 mapwrite 0x00229c thru 0x0059c4 (0x3729 bytes) 000627 1787783318.883134 trunc from 0x032ecb to 0x009853 (0x29677 bytes) truncating to largest ever: 0x3f7ff 000628 1787783318.921960 trunc from 0x009854 to 0x03f7fe (0x35fab bytes) 000629 1787783318.978387 mapwrite 0x0158dd thru 0x01b22a (0x594e bytes) 000631 1787783319.076992 read 0x0038f9 thru 0x00d697 (0x9d9f bytes) 000632 1787783319.087691 write 0x02dd81 thru 0x0303c2 (0x2642 bytes) 000633 1787783319.088805 read 0x02dfba thru 0x032e08 (0x4e4f bytes) 000634 1787783319.092327 mapread 0x0000eb thru 0x0011b1 (0x10c7 bytes) 000635 1787783319.094257 read 0x034ecc thru 0x03f7fe (0xa933 bytes) 000636 1787783319.098759 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f7ff): Mirror 2: 0x56e371a0 (stale) Mirror 4: 0x56e371a0 (stale) Mirror 5: 0x56e371a0 (stale) Mirror 8: 0x56e371a0 (stale) Mirror 9: 0xc02520a4 (stale) Mirror 10: 0xbfc413f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f7ff): Mirror 2: 0x56e371a0 (stale) Mirror 4: 0x56e371a0 (stale) Mirror 5: 0x56e371a0 (stale) Mirror 8: 0x56e371a0 (stale) Mirror 9: 0xc02520a4 (stale) Mirror 10: 0xbfc413f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f7ff: skipped 000637 1787783319.895714 trunc from 0x03f7ff to 0x02459f (0x1b25f bytes) 000638 1787783319.923788 write 0x00cae1 thru 0x016bba (0xa0da bytes) 000640 1787783319.952007 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x245a0): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x245a0): Mirror 2: 0xef2ea17c (stale) Mirror 4: 0xef2ea17c (stale) Mirror 5: 0xef2ea17c (stale) Mirror 8: 0xef2ea17c (stale) Mirror 9: 0xfaab9106 (stale) Mirror 10: 0xfaab9106 (stale) CRC-32 checksum value for chunk [0, 0x245a0): Mirror 1: 0x55fbcc7e Mirror 11: 0x55fbcc7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x245a0: skipped 000642 1787783321.786016 mapwrite 0x03a923 thru 0x03ffff (0x56dd bytes) 000643 1787783321.982423 mapread 0x033d94 thru 0x0390e1 (0x534e bytes) 000647 1787783321.994024 write 0x0374fb thru 0x0376eb (0x1f1 bytes) 000648 1787783321.995084 mapread 0x00d882 thru 0x015913 (0x8092 bytes) 000649 1787783322.005190 read 0x00a7f8 thru 0x017727 (0xcf30 bytes) 000650 1787783322.010440 read 0x03b623 thru 0x03fa4a (0x4428 bytes) 000651 1787783322.011233 write 0x00711e thru 0x016c23 (0xfb06 bytes) 000652 1787783322.013690 read 0x0033c1 thru 0x0059dd (0x261d bytes) 000654 1787783322.023276 write 0x0127c5 thru 0x01959c (0x6dd8 bytes) 000655 1787783322.025279 mapwrite 0x01b4f5 thru 0x01e91c (0x3428 bytes) 000657 1787783322.078653 write 0x00ec7e thru 0x017e7a (0x91fd bytes) 000658 1787783322.084056 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x91f66836 (stale) Mirror 4: 0x91f66836 (stale) Mirror 5: 0x91f66836 (stale) Mirror 8: 0x91f66836 (stale) Mirror 9: 0x72c8c3ee (stale) Mirror 10: 0x63e41148 (stale) Mirror 11: 0x497448fb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4733224e Mirror 12: 0x4733224e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000659 1787783323.161660 mapread 0x02b16c thru 0x03226a (0x70ff bytes) 000661 1787783323.192189 write 0x01688a thru 0x01f142 (0x88b9 bytes) 000662 1787783323.310029 read 0x018db8 thru 0x01d5f9 (0x4842 bytes) 000664 1787783323.317626 mapread 0x021338 thru 0x022d6d (0x1a36 bytes) 000665 1787783323.334174 mapwrite 0x038da5 thru 0x03dd80 (0x4fdc bytes) 000666 1787783323.503870 mapread 0x0076b7 thru 0x00f9cd (0x8317 bytes) 000667 1787783323.530017 mapread 0x00f4ff thru 0x01179d (0x229f bytes) 000668 1787783323.544948 mapwrite 0x0203ae thru 0x02e60b (0xe25e bytes) 000669 1787783323.643778 mapread 0x016a51 thru 0x017686 (0xc36 bytes) 000670 1787783323.647070 trunc from 0x040000 to 0x011c67 (0x2e398 bytes) 000671 1787783323.711798 read 0x0106ff thru 0x011c67 (0x1569 bytes) 000673 1787783323.713841 read 0x006d8e thru 0x007a3e (0xcb1 bytes) 000678 1787783323.717053 write 0x0297e8 thru 0x02c81c (0x3035 bytes) 000681 1787783323.719756 read 0x00884d thru 0x011997 (0x914b bytes) 000682 1787783323.720960 read 0x00c4a4 thru 0x00c4c4 (0x21 bytes) 000683 1787783323.726393 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2c81d): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c81d): Mirror 2: 0x6958dbe0 (stale) Mirror 4: 0x6958dbe0 (stale) Mirror 5: 0x6958dbe0 (stale) Mirror 8: 0x6958dbe0 (stale) Mirror 9: 0x115e11cc (stale) Mirror 10: 0x115e11cc (stale) Mirror 11: 0x74e7eed1 (stale) Mirror 12: 0xf42c043a (stale) CRC-32 checksum value for chunk [0, 0x2c81d): Mirror 1: 0xd9cd065b Mirror 13: 0xd9cd065b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c81d: skipped 000684 1787783324.979171 read 0x00a544 thru 0x018730 (0xe1ed bytes) 000685 1787783324.999176 mapwrite 0x022d92 thru 0x02b364 (0x85d3 bytes) 000686 1787783325.396542 trunc from 0x02c81d to 0x02e476 (0x1c5a bytes) 000689 1787783325.473108 mapread 0x0047bb thru 0x0077be (0x3004 bytes) 000690 1787783325.510482 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e477): Mirror 2: 0xd03e8334 (stale) Mirror 4: 0xd03e8334 (stale) Mirror 5: 0xd03e8334 (stale) Mirror 8: 0xd03e8334 (stale) Mirror 9: 0x5929b0eb (stale) Mirror 10: 0x5929b0eb (stale) Mirror 11: 0x332af58a (stale) Mirror 13: 0x5b120913 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e477): Mirror 2: 0xd03e8334 (stale) Mirror 4: 0xd03e8334 (stale) Mirror 5: 0xd03e8334 (stale) Mirror 8: 0xd03e8334 (stale) Mirror 9: 0x5929b0eb (stale) Mirror 10: 0x5929b0eb (stale) Mirror 11: 0x332af58a (stale) Mirror 13: 0x5b120913 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e477: skipped 000691 1787783326.257669 mapread 0x01fe69 thru 0x02e476 (0xe60e bytes) 000692 1787783326.319602 mapread 0x0254a3 thru 0x0266a4 (0x1202 bytes) 000693 1787783326.332183 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e477): Mirror 2: 0xd03e8334 (stale) Mirror 4: 0xd03e8334 (stale) Mirror 8: 0xd03e8334 (stale) Mirror 9: 0x5929b0eb (stale) Mirror 10: 0x5929b0eb (stale) Mirror 11: 0x332af58a (stale) Mirror 13: 0x5b120913 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e477): Mirror 2: 0xd03e8334 (stale) Mirror 4: 0xd03e8334 (stale) Mirror 8: 0xd03e8334 (stale) Mirror 9: 0x5929b0eb (stale) Mirror 10: 0x5929b0eb (stale) Mirror 11: 0x332af58a (stale) Mirror 13: 0x5b120913 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e477: skipped 000694 1787783327.037176 trunc from 0x02e477 to 0x02d9a4 (0xad2 bytes) 000695 1787783327.061050 write 0x0231a5 thru 0x0260e2 (0x2f3e bytes) 000697 1787783327.082755 write 0x01b151 thru 0x01b365 (0x215 bytes) 000698 1787783327.101891 trunc from 0x02d9a5 to 0x005ea9 (0x27afb bytes) 000700 1787783327.125577 mapread 0x002931 thru 0x005ea9 (0x3579 bytes) 000701 1787783327.160110 trunc from 0x005eaa to 0x002597 (0x3912 bytes) 000702 1787783327.178395 read 0x000f81 thru 0x0012ce (0x34e bytes) 000703 1787783327.184984 trunc from 0x002598 to 0x000325 (0x2272 bytes) 000705 1787783327.209188 trunc from 0x000326 to 0x02740b (0x270e6 bytes) 000706 1787783327.225670 write 0x0281c8 thru 0x02b2b1 (0x30ea bytes) 000707 1787783327.226783 read 0x0298c7 thru 0x02b2b1 (0x19eb bytes) 000709 1787783327.229658 write 0x0183b2 thru 0x0184f4 (0x143 bytes) 000711 1787783327.241134 trunc from 0x02b2b2 to 0x01942b (0x11e86 bytes) 000713 1787783327.261632 trunc from 0x01942c to 0x02c53f (0x13114 bytes) 000714 1787783327.280136 write 0x02d6fa thru 0x03168a (0x3f91 bytes) 000716 1787783327.282143 write 0x012bb6 thru 0x015fb8 (0x3403 bytes) 000717 1787783327.285136 read 0x0227de thru 0x0312cc (0xeaef bytes) 000718 1787783327.293591 mapread 0x00cd5e thru 0x011752 (0x49f5 bytes) 000719 1787783327.294846 read 0x00333b thru 0x00725e (0x3f24 bytes) 000720 1787783327.295898 mapwrite 0x004a73 thru 0x00e64f (0x9bdd bytes) 000721 1787783327.377269 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3168b): Mirror 2: 0x8bb025f7 (stale) Mirror 4: 0x8bb025f7 (stale) Mirror 8: 0x8bb025f7 (stale) Mirror 9: 0x2ccf04b9 (stale) Mirror 10: 0x2ccf04b9 (stale) Mirror 13: 0xd7d13ca4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3168b): Mirror 2: 0x8bb025f7 (stale) Mirror 4: 0x8bb025f7 (stale) Mirror 8: 0x8bb025f7 (stale) Mirror 9: 0x2ccf04b9 (stale) Mirror 10: 0x2ccf04b9 (stale) Mirror 13: 0xd7d13ca4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3168b: skipped 000723 1787783327.855891 write 0x020406 thru 0x02a686 (0xa281 bytes) 000724 1787783327.872694 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3168b): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3168b): Mirror 2: 0x8bb025f7 (stale) Mirror 4: 0x8bb025f7 (stale) Mirror 8: 0x8bb025f7 (stale) Mirror 9: 0x2ccf04b9 (stale) Mirror 10: 0x2ccf04b9 (stale) Mirror 13: 0xd7d13ca4 (stale) CRC-32 checksum value for chunk [0, 0x3168b): Mirror 1: 0xd65a9a01 Mirror 14: 0xd65a9a01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3168b: skipped 000725 1787783329.119882 mapwrite 0x034ad3 thru 0x039d5c (0x528a bytes) 000726 1787783329.301408 write 0x00538f thru 0x0099a8 (0x461a bytes) 000727 1787783329.314695 trunc from 0x039d5d to 0x0300f5 (0x9c67 bytes) 000733 1787783329.375486 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x300f6): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x300f6): Mirror 2: 0xf34a62c0 (stale) Mirror 4: 0xf34a62c0 (stale) Mirror 8: 0xf34a62c0 (stale) Mirror 9: 0x939328f6 (stale) Mirror 10: 0x939328f6 (stale) Mirror 13: 0xa72877e8 (stale) Mirror 14: 0x2be8e84 (stale) CRC-32 checksum value for chunk [0, 0x300f6): Mirror 1: 0xa9ebed68 Mirror 15: 0xa9ebed68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x300f6: skipped 000734 1787783331.044682 mapread 0x008fc5 thru 0x017b35 (0xeb71 bytes) 000735 1787783331.078164 write 0x01bbd3 thru 0x023f25 (0x8353 bytes) 000737 1787783331.167602 read 0x00a48c thru 0x015b8b (0xb700 bytes) 000738 1787783331.189009 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x300f6): Mirror 4: 0xf34a62c0 (stale) Mirror 8: 0xf34a62c0 (stale) Mirror 9: 0x939328f6 (stale) Mirror 10: 0x939328f6 (stale) Mirror 13: 0xa72877e8 (stale) Mirror 14: 0x2be8e84 (stale) Mirror 15: 0xa9ebed68 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x300f6): Mirror 4: 0xf34a62c0 (stale) Mirror 8: 0xf34a62c0 (stale) Mirror 9: 0x939328f6 (stale) Mirror 10: 0x939328f6 (stale) Mirror 13: 0xa72877e8 (stale) Mirror 14: 0x2be8e84 (stale) Mirror 15: 0xa9ebed68 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x300f6: skipped 000739 1787783331.925325 write 0x0186bd thru 0x020d73 (0x86b7 bytes) 000740 1787783331.941048 mapwrite 0x03fe88 thru 0x03ffff (0x178 bytes) 000741 1787783332.085925 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x91f66836 (stale) Mirror 8: 0x91f66836 (stale) Mirror 9: 0x72c8c3ee (stale) Mirror 10: 0x63e41148 (stale) Mirror 13: 0xda476ca3 (stale) Mirror 15: 0x4dd5ea97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x91f66836 (stale) Mirror 8: 0x91f66836 (stale) Mirror 9: 0x72c8c3ee (stale) Mirror 10: 0x63e41148 (stale) Mirror 13: 0xda476ca3 (stale) Mirror 15: 0x4dd5ea97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000742 1787783332.695803 mapwrite 0x0043c7 thru 0x00f617 (0xb251 bytes) 000744 1787783332.794389 write 0x03eeb0 thru 0x03ffff (0x1150 bytes) 000753 1787783332.809021 write 0x0385e4 thru 0x03ffff (0x7a1c bytes) 000754 1787783332.819980 MIRROR_RESYNC 7 mirrors 000756 1787783337.431360 mapread 0x01a788 thru 0x021046 (0x68bf bytes) 000757 1787783337.458310 MIRROR_EXTEND to 8 mirrors 000759 1787783339.072484 read 0x00611e thru 0x006878 (0x75b bytes) 000760 1787783339.089940 MIRROR_RESYNC 8 mirrors 000761 1787783339.763399 write 0x01c2c2 thru 0x0200e7 (0x3e26 bytes) 000763 1787783339.846827 MIRROR_RESYNC 8 mirrors 000764 1787783344.286447 read 0x03ae2e thru 0x03ff01 (0x50d4 bytes) 000765 1787783344.311463 MIRROR_EXTEND to 9 mirrors 000767 1787783345.917987 trunc from 0x040000 to 0x001e61 (0x3e19e bytes) 000769 1787783346.005250 trunc from 0x001e62 to 0x03f703 (0x3d8a2 bytes) 000772 1787783346.032153 mapwrite 0x020bdb thru 0x027845 (0x6c6b bytes) 000775 1787783346.138665 trunc from 0x03f704 to 0x027a3c (0x17cc7 bytes) 000776 1787783346.162911 mapwrite 0x017752 thru 0x025ea2 (0xe751 bytes) 000777 1787783346.245938 trunc from 0x027a3d to 0x01eb02 (0x8f3a bytes) 000778 1787783346.269632 mapwrite 0x00731a thru 0x00f69e (0x8385 bytes) 000779 1787783346.393632 mapread 0x016d8d thru 0x017a39 (0xcad bytes) 000780 1787783346.396832 write 0x001e8b thru 0x007bb0 (0x5d26 bytes) 000781 1787783346.406853 write 0x00419e thru 0x013c74 (0xfad7 bytes) 000782 1787783346.408815 read 0x01c4d2 thru 0x01eb02 (0x2631 bytes) 000783 1787783346.411585 mapread 0x015249 thru 0x01b05a (0x5e12 bytes) 000784 1787783346.415174 mapread 0x009c80 thru 0x014499 (0xa81a bytes) 000787 1787783346.431008 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1eb03): Mirror 8: 0xa0d1508c (stale) Mirror 9: 0xa0d1508c (stale) Mirror 10: 0xa0d1508c (stale) Mirror 13: 0xa0d1508c (stale) Mirror 15: 0xa0d1508c (stale) Mirror 16: 0xa0d1508c (stale) Mirror 17: 0xa0d1508c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eb03): Mirror 8: 0xa0d1508c (stale) Mirror 9: 0xa0d1508c (stale) Mirror 10: 0xa0d1508c (stale) Mirror 13: 0xa0d1508c (stale) Mirror 15: 0xa0d1508c (stale) Mirror 16: 0xa0d1508c (stale) Mirror 17: 0xa0d1508c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eb03: skipped 000789 1787783346.954383 write 0x000dff thru 0x0018cf (0xad1 bytes) 000791 1787783346.966502 trunc from 0x01eb03 to 0x03983a (0x1ad38 bytes) 000793 1787783346.987528 mapread 0x0060dc thru 0x00f146 (0x906b bytes) 000794 1787783347.008367 mapread 0x019902 thru 0x0242c5 (0xa9c4 bytes) 000796 1787783347.032909 write 0x034950 thru 0x03c5c6 (0x7c77 bytes) 000798 1787783347.041024 trunc from 0x03c5c7 to 0x039b8c (0x2a3a bytes) 000799 1787783347.061843 mapwrite 0x034e0f thru 0x038e46 (0x4038 bytes) 000800 1787783347.127674 read 0x0370f6 thru 0x039b8c (0x2a97 bytes) 000801 1787783347.129080 read 0x002865 thru 0x00e6e1 (0xbe7d bytes) 000802 1787783347.129935 mapread 0x0083ed thru 0x008fc6 (0xbda bytes) 000803 1787783347.137172 MIRROR_RESYNC 8 mirrors 000806 1787783349.800069 MIRROR_RESYNC 8 mirrors 000807 1787783350.218399 MIRROR_EXTEND to 9 mirrors 000811 1787783351.027532 mapwrite 0x013504 thru 0x01bf51 (0x8a4e bytes) 000813 1787783351.168546 write 0x00b62d thru 0x00bb7d (0x551 bytes) 000814 1787783351.175504 mapwrite 0x03537c thru 0x03ffff (0xac84 bytes) 000820 1787783351.259477 mapwrite 0x014515 thru 0x01804f (0x3b3b bytes) 000821 1787783351.299451 mapwrite 0x030e08 thru 0x03bcde (0xaed7 bytes) 000822 1787783351.356038 trunc from 0x040000 to 0x02f671 (0x1098e bytes) 000823 1787783351.382989 trunc from 0x02f672 to 0x02dde0 (0x1891 bytes) 000824 1787783351.400182 mapwrite 0x0372f6 thru 0x03ffff (0x8d0a bytes) 000825 1787783351.464489 mapread 0x01a5d2 thru 0x024762 (0xa191 bytes) 000826 1787783351.471662 mapwrite 0x030d29 thru 0x03f1aa (0xe482 bytes) 000827 1787783351.518771 trunc from 0x040000 to 0x018bd6 (0x27429 bytes) 000828 1787783351.543437 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x18bd7): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18bd7): Mirror 8: 0xb0ab70cb (stale) Mirror 9: 0xb0ab70cb (stale) Mirror 10: 0xb0ab70cb (stale) Mirror 13: 0xb0ab70cb (stale) Mirror 15: 0xb0ab70cb (stale) Mirror 16: 0xb0ab70cb (stale) Mirror 17: 0xb0ab70cb (stale) Mirror 18: 0xb0ab70cb (stale) CRC-32 checksum value for chunk [0, 0x18bd7): Mirror 1: 0xbcf9e857 Mirror 19: 0xbcf9e857 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18bd7: skipped 000829 1787783352.345868 mapread 0x012b6b thru 0x0136ea (0xb80 bytes) 000830 1787783352.355428 trunc from 0x018bd7 to 0x008970 (0x10266 bytes) 000833 1787783352.454741 write 0x00f748 thru 0x01e5d0 (0xee89 bytes) 000834 1787783352.462697 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1e5d1): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e5d1): Mirror 8: 0xbaf903a9 (stale) Mirror 9: 0xbaf903a9 (stale) Mirror 10: 0xbaf903a9 (stale) Mirror 13: 0xbaf903a9 (stale) Mirror 15: 0xbaf903a9 (stale) Mirror 16: 0xbaf903a9 (stale) Mirror 17: 0xbaf903a9 (stale) Mirror 18: 0xbaf903a9 (stale) Mirror 19: 0x692cbe1d (stale) CRC-32 checksum value for chunk [0, 0x1e5d1): Mirror 1: 0x2a6f4c63 Mirror 20: 0x2a6f4c63 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e5d1: skipped 000837 1787783353.420650 mapwrite 0x03b83b thru 0x03ffff (0x47c5 bytes) 000838 1787783353.601728 read 0x01e6f3 thru 0x02abea (0xc4f8 bytes) 000839 1787783353.614063 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9baffffe (stale) Mirror 9: 0x9baffffe (stale) Mirror 10: 0x9baffffe (stale) Mirror 13: 0x9baffffe (stale) Mirror 15: 0x9baffffe (stale) Mirror 16: 0x9baffffe (stale) Mirror 17: 0x9baffffe (stale) Mirror 18: 0x9baffffe (stale) Mirror 19: 0x8540f50f (stale) Mirror 20: 0x6edd2964 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c5c6f1a Mirror 21: 0x1c5c6f1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000841 1787783354.730554 read 0x02466c thru 0x0322bd (0xdc52 bytes) 000842 1787783354.742565 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9baffffe (stale) Mirror 9: 0x9baffffe (stale) Mirror 10: 0x9baffffe (stale) Mirror 13: 0x9baffffe (stale) Mirror 15: 0x9baffffe (stale) Mirror 16: 0x9baffffe (stale) Mirror 17: 0x9baffffe (stale) Mirror 18: 0x9baffffe (stale) Mirror 19: 0x8540f50f (stale) Mirror 20: 0x6edd2964 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c5c6f1a Mirror 21: 0x1c5c6f1a Mirror 22: 0x1c5c6f1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000843 1787783355.997718 write 0x009dc9 thru 0x012d22 (0x8f5a bytes) 000844 1787783356.106777 trunc from 0x040000 to 0x00ac64 (0x3539b bytes) 000849 1787783356.138120 trunc from 0x00ac65 to 0x01a74c (0xfae8 bytes) 000851 1787783356.154698 trunc from 0x01a74d to 0x011aac (0x8ca0 bytes) 000855 1787783356.175689 trunc from 0x011aad to 0x028980 (0x16ed4 bytes) 000857 1787783356.204156 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x28981): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28981): Mirror 8: 0xa0e4061d (stale) Mirror 9: 0xa0e4061d (stale) Mirror 10: 0xa0e4061d (stale) Mirror 13: 0xa0e4061d (stale) Mirror 15: 0xa0e4061d (stale) Mirror 16: 0xa0e4061d (stale) Mirror 17: 0xa0e4061d (stale) Mirror 18: 0xa0e4061d (stale) Mirror 19: 0x31a0b632 (stale) Mirror 20: 0xeba6344d (stale) Mirror 21: 0xeba6344d (stale) Mirror 22: 0xeba6344d (stale) CRC-32 checksum value for chunk [0, 0x28981): Mirror 1: 0x5fdae396 Mirror 23: 0x5fdae396 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28981: skipped 000858 1787783357.507870 read 0x00568b thru 0x013c0a (0xe580 bytes) 000859 1787783357.517666 trunc from 0x028981 to 0x03ee89 (0x16509 bytes) 000864 1787783357.615072 mapread 0x03494a thru 0x03ee89 (0xa540 bytes) 000865 1787783357.642701 MIRROR_RESYNC 14 mirrors 000867 1787783361.559162 mapwrite 0x03f564 thru 0x03ffff (0xa9c bytes) 000870 1787783361.708101 read 0x0255c1 thru 0x03067b (0xb0bb bytes) 000871 1787783361.722269 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcbd1a06 (stale) Mirror 9: 0xbcbd1a06 (stale) Mirror 10: 0xbcbd1a06 (stale) Mirror 13: 0xbcbd1a06 (stale) Mirror 16: 0xbcbd1a06 (stale) Mirror 17: 0xbcbd1a06 (stale) Mirror 18: 0xbcbd1a06 (stale) Mirror 19: 0xbcbd1a06 (stale) Mirror 20: 0xbcbd1a06 (stale) Mirror 21: 0xbcbd1a06 (stale) Mirror 22: 0xbcbd1a06 (stale) Mirror 23: 0xbcbd1a06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcbd1a06 (stale) Mirror 9: 0xbcbd1a06 (stale) Mirror 10: 0xbcbd1a06 (stale) Mirror 13: 0xbcbd1a06 (stale) Mirror 16: 0xbcbd1a06 (stale) Mirror 17: 0xbcbd1a06 (stale) Mirror 18: 0xbcbd1a06 (stale) Mirror 19: 0xbcbd1a06 (stale) Mirror 20: 0xbcbd1a06 (stale) Mirror 21: 0xbcbd1a06 (stale) Mirror 22: 0xbcbd1a06 (stale) Mirror 23: 0xbcbd1a06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000874 1787783362.584810 write 0x03863f thru 0x03ffff (0x79c1 bytes) 000876 1787783362.610866 write 0x033fa3 thru 0x039e9e (0x5efc bytes) 000877 1787783362.624861 mapwrite 0x025d61 thru 0x02deb7 (0x8157 bytes) 000878 1787783362.760401 mapread 0x02f61a thru 0x039846 (0xa22d bytes) 000882 1787783362.790358 write 0x0117eb thru 0x0160f0 (0x4906 bytes) 000883 1787783362.814383 write 0x00051a thru 0x00910a (0x8bf1 bytes) 000886 1787783362.833660 mapread 0x004f3a thru 0x005a3b (0xb02 bytes) 000890 1787783362.842629 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcbd1a06 (stale) Mirror 9: 0xbcbd1a06 (stale) Mirror 10: 0xbcbd1a06 (stale) Mirror 13: 0xbcbd1a06 (stale) Mirror 16: 0xbcbd1a06 (stale) Mirror 17: 0xbcbd1a06 (stale) Mirror 18: 0xbcbd1a06 (stale) Mirror 19: 0xbcbd1a06 (stale) Mirror 20: 0xbcbd1a06 (stale) Mirror 21: 0xbcbd1a06 (stale) Mirror 22: 0xbcbd1a06 (stale) Mirror 23: 0xbcbd1a06 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5f4bba96 Mirror 24: 0x5f4bba96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000891 1787783364.153932 mapread 0x03c23a thru 0x03ffff (0x3dc6 bytes) 000895 1787783364.173577 write 0x03ed5a thru 0x03ffff (0x12a6 bytes) 000896 1787783364.262982 read 0x02a07a thru 0x02c3ef (0x2376 bytes) 000898 1787783364.270751 write 0x00f2e8 thru 0x01427f (0x4f98 bytes) 000900 1787783364.281898 trunc from 0x040000 to 0x006753 (0x398ac bytes) 000902 1787783364.302000 read 0x00057f thru 0x0021c7 (0x1c49 bytes) 000905 1787783364.315025 write 0x037e22 thru 0x03ffff (0x81de bytes) 000906 1787783364.321595 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcbd1a06 (stale) Mirror 9: 0xbcbd1a06 (stale) Mirror 10: 0xbcbd1a06 (stale) Mirror 13: 0xbcbd1a06 (stale) Mirror 16: 0xbcbd1a06 (stale) Mirror 17: 0xbcbd1a06 (stale) Mirror 18: 0xbcbd1a06 (stale) Mirror 20: 0xbcbd1a06 (stale) Mirror 21: 0xbcbd1a06 (stale) Mirror 22: 0xbcbd1a06 (stale) Mirror 23: 0xbcbd1a06 (stale) Mirror 24: 0x5f4bba96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcbd1a06 (stale) Mirror 9: 0xbcbd1a06 (stale) Mirror 10: 0xbcbd1a06 (stale) Mirror 13: 0xbcbd1a06 (stale) Mirror 16: 0xbcbd1a06 (stale) Mirror 17: 0xbcbd1a06 (stale) Mirror 18: 0xbcbd1a06 (stale) Mirror 20: 0xbcbd1a06 (stale) Mirror 21: 0xbcbd1a06 (stale) Mirror 22: 0xbcbd1a06 (stale) Mirror 23: 0xbcbd1a06 (stale) Mirror 24: 0x5f4bba96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000908 1787783365.003373 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcbd1a06 (stale) Mirror 9: 0xbcbd1a06 (stale) Mirror 10: 0xbcbd1a06 (stale) Mirror 13: 0xbcbd1a06 (stale) Mirror 16: 0xbcbd1a06 (stale) Mirror 17: 0xbcbd1a06 (stale) Mirror 18: 0xbcbd1a06 (stale) Mirror 20: 0xbcbd1a06 (stale) Mirror 21: 0xbcbd1a06 (stale) Mirror 22: 0xbcbd1a06 (stale) Mirror 23: 0xbcbd1a06 (stale) Mirror 24: 0x5f4bba96 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xddc35e60 Mirror 25: 0xddc35e60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1787783366.260799 read 0x036f58 thru 0x03b62d (0x46d6 bytes) 000912 1787783366.268998 trunc from 0x040000 to 0x01a1b1 (0x25e4e bytes) 000913 1787783366.402043 trunc from 0x01a1b2 to 0x0333f4 (0x19243 bytes) 000914 1787783366.449627 mapread 0x01d52b thru 0x022c3d (0x5713 bytes) 000915 1787783366.493024 trunc from 0x0333f5 to 0x0245e7 (0xee0d bytes) 000916 1787783366.523060 MIRROR_RESYNC 14 mirrors 000918 1787783369.455690 mapread 0x013347 thru 0x0149ad (0x1667 bytes) 000920 1787783369.473660 trunc from 0x0245e8 to 0x028bde (0x45f7 bytes) 000923 1787783369.660538 write 0x01ffae thru 0x023678 (0x36cb bytes) 000924 1787783369.701361 write 0x008dcc thru 0x0176cb (0xe900 bytes) 000925 1787783369.719368 read 0x01b41c thru 0x028bde (0xd7c3 bytes) 000926 1787783369.738271 write 0x00ce6f thru 0x01b4f4 (0xe686 bytes) 000927 1787783369.739836 mapwrite 0x013487 thru 0x01d939 (0xa4b3 bytes) 000930 1787783369.845879 read 0x01cbf0 thru 0x024f82 (0x8393 bytes) 000931 1787783369.848569 write 0x038c37 thru 0x03ffff (0x73c9 bytes) 000933 1787783369.852815 write 0x0274b5 thru 0x031075 (0x9bc1 bytes) 000934 1787783369.874969 read 0x0248ac thru 0x02de64 (0x95b9 bytes) 000935 1787783369.875574 read 0x01f3f7 thru 0x024978 (0x5582 bytes) 000936 1787783369.876077 mapread 0x037ad1 thru 0x03d6cb (0x5bfb bytes) 000937 1787783369.893546 read 0x0314d5 thru 0x03acc4 (0x97f0 bytes) 000938 1787783369.896556 mapwrite 0x032afd thru 0x039053 (0x6557 bytes) 000939 1787783370.015591 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe2d614a7 (stale) Mirror 9: 0xe2d614a7 (stale) Mirror 10: 0xe2d614a7 (stale) Mirror 13: 0xe2d614a7 (stale) Mirror 16: 0xe2d614a7 (stale) Mirror 17: 0xe2d614a7 (stale) Mirror 18: 0xe2d614a7 (stale) Mirror 20: 0xe2d614a7 (stale) Mirror 22: 0xe2d614a7 (stale) Mirror 23: 0xe2d614a7 (stale) Mirror 24: 0xe2d614a7 (stale) Mirror 25: 0xe2d614a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe2d614a7 (stale) Mirror 9: 0xe2d614a7 (stale) Mirror 10: 0xe2d614a7 (stale) Mirror 13: 0xe2d614a7 (stale) Mirror 16: 0xe2d614a7 (stale) Mirror 17: 0xe2d614a7 (stale) Mirror 18: 0xe2d614a7 (stale) Mirror 20: 0xe2d614a7 (stale) Mirror 22: 0xe2d614a7 (stale) Mirror 23: 0xe2d614a7 (stale) Mirror 24: 0xe2d614a7 (stale) Mirror 25: 0xe2d614a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000940 1787783370.838409 mapwrite 0x03946e thru 0x03ffff (0x6b92 bytes) 000941 1787783370.891436 trunc from 0x040000 to 0x01b6fd (0x24902 bytes) 000942 1787783370.904983 trunc from 0x01b6fe to 0x0355e0 (0x19ee3 bytes) 000943 1787783370.918424 mapread 0x02cc3e thru 0x030452 (0x3815 bytes) 000944 1787783370.931353 mapwrite 0x00b2a0 thru 0x00b933 (0x694 bytes) 000946 1787783370.974727 write 0x03ef83 thru 0x03ffff (0x107d bytes) 000951 1787783370.978826 write 0x001f0f thru 0x00a731 (0x8823 bytes) 000952 1787783370.988132 MIRROR_RESYNC 13 mirrors 000954 1787783374.767558 mapread 0x03418a thru 0x03ffff (0xbe76 bytes) 000955 1787783374.801591 mapread 0x00ccbf thru 0x01b87b (0xebbd bytes) 000956 1787783374.842121 write 0x01df01 thru 0x0283b2 (0xa4b2 bytes) 000957 1787783374.971588 read 0x0238ce thru 0x025f4f (0x2682 bytes) 000958 1787783374.972711 write 0x02a296 thru 0x02deb4 (0x3c1f bytes) 000961 1787783374.986323 MIRROR_RESYNC 13 mirrors 000963 1787783382.677164 mapread 0x03ad2a thru 0x03c60a (0x18e1 bytes) 000966 1787783382.704877 MIRROR_RESYNC 13 mirrors 000970 1787783383.526429 mapwrite 0x038dce thru 0x03d96b (0x4b9e bytes) 000972 1787783383.940540 mapread 0x010a31 thru 0x012e10 (0x23e0 bytes) 000973 1787783383.965521 trunc from 0x040000 to 0x038811 (0x77ee bytes) 000974 1787783384.031298 mapread 0x01137d thru 0x01a28c (0x8f10 bytes) 000976 1787783384.051461 trunc from 0x038812 to 0x0348c3 (0x3f4e bytes) 000981 1787783384.104370 mapread 0x015833 thru 0x01701a (0x17e8 bytes) 000983 1787783384.111416 trunc from 0x0348c4 to 0x03cf01 (0x863e bytes) 000984 1787783384.162898 read 0x02e1e6 thru 0x037fc3 (0x9dde bytes) 000985 1787783384.186102 read 0x009b03 thru 0x01873e (0xec3c bytes) 000986 1787783384.191410 mapread 0x016a55 thru 0x018b37 (0x20e3 bytes) 000987 1787783384.195345 read 0x036558 thru 0x038780 (0x2229 bytes) 000988 1787783384.220843 write 0x0153e2 thru 0x018892 (0x34b1 bytes) 000989 1787783384.229555 MIRROR_RESYNC 13 mirrors 000990 1787783389.074120 write 0x0018ec thru 0x00b474 (0x9b89 bytes) 000991 1787783389.153109 read 0x00d35e thru 0x019aeb (0xc78e bytes) 000992 1787783389.161460 mapread 0x021f74 thru 0x022d97 (0xe24 bytes) 000994 1787783389.170968 mapwrite 0x002224 thru 0x008087 (0x5e64 bytes) 000995 1787783389.214439 read 0x0074bb thru 0x016c35 (0xf77b bytes) 000996 1787783389.231394 mapread 0x020403 thru 0x02d6b3 (0xd2b1 bytes) 000998 1787783389.232723 mapread 0x02e1b2 thru 0x0382c1 (0xa110 bytes) 001000 1787783389.233904 write 0x000390 thru 0x001cbe (0x192f bytes) All operations completed A-OK!