== sanity-flr test 70a: flr mode fsx test ================ 21:52:15 (1781661135) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1135 fallocating to largest ever: 0x109f3 000003 1781661135.940011 fallocate 0x00be2b thru 0x0109f2 (0x4bc8 bytes) skipping zero size read 000005 1781661135.942984 write 0x0360ab thru 0x036d4d (0xca3 bytes) 000006 1781661135.946260 MIRROR_EXTEND to 2 mirrors 000007 1781661136.166413 mapwrite 0x0156a6 thru 0x024dd7 (0xf732 bytes) 000008 1781661136.224193 write 0x02cbeb thru 0x03678d (0x9ba3 bytes) fallocating to largest ever: 0x1b08d 000009 1781661136.232206 fallocate 0x019641 thru 0x01b08c (0x1a4c bytes) 000010 1781661136.235174 punch from 0x00b00b to 0x014d57 (0x9d4d bytes) 000011 1781661136.241824 fallocate 0x0071e3 thru 0x011058 (0x9e76 bytes) 000012 1781661136.249139 MIRROR_RESYNC 2 mirrors 000013 1781661136.501343 punch from 0x0221d0 to 0x031629 (0xf45a bytes) 000014 1781661136.518849 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: 0x4263cbde (stale) CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 1: 0x1324a255 Mirror 3: 0x1324a255 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d4e: skipped 000015 1781661136.848534 mapread 0x026288 thru 0x0357dc (0xf555 bytes) 000016 1781661136.863099 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: 0x4263cbde (stale) CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 1: 0x1324a255 Mirror 3: 0x1324a255 Mirror 4: 0x1324a255 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d4e: skipped 000017 1781661137.187493 read 0x00147b thru 0x00245e (0xfe4 bytes) 000018 1781661137.193521 mapread 0x0005ff thru 0x00a121 (0x9b23 bytes) 000019 1781661137.216757 MIRROR_RESYNC 4 mirrors fallocating to largest ever: 0x27722 000020 1781661137.477534 fallocate 0x025c8b thru 0x027721 (0x1a97 bytes) 000021 1781661137.496319 fallocate 0x0066ce thru 0x00f3f3 (0x8d26 bytes) fallocating to largest ever: 0x2e327 000022 1781661137.503122 fallocate 0x028dbc thru 0x02e326 (0x556b bytes) 000023 1781661137.510425 trunc from 0x01a666 to 0x0279eb (0xd386 bytes) 000024 1781661137.517905 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: 0x1324a255 (stale) Mirror 3: 0x1324a255 (stale) Mirror 4: 0x1324a255 (stale) CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 1: 0x3ac23598 Mirror 5: 0x3ac23598 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d4e: skipped 000025 1781661137.895628 mapwrite 0x02e746 thru 0x034926 (0x61e1 bytes) 000026 1781661137.954091 write 0x00ba68 thru 0x01012a (0x46c3 bytes) 000027 1781661137.962682 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 2: 0x1324a255 (stale) Mirror 3: 0x1324a255 (stale) Mirror 4: 0x1324a255 (stale) Mirror 5: 0x3ac23598 (stale) CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 1: 0xa33c5feb Mirror 6: 0xa33c5feb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d4e: skipped 000028 1781661138.325693 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 3: 0x1324a255 (stale) Mirror 4: 0x1324a255 (stale) Mirror 5: 0x3ac23598 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 3: 0x1324a255 (stale) Mirror 4: 0x1324a255 (stale) Mirror 5: 0x3ac23598 (stale) CRC-32 checksum value for chunk [0, 0x36d4e): Mirror 1: 0xa33c5feb Mirror 6: 0xa33c5feb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d4e: skipped 000029 1781661138.601893 write 0x03a62f thru 0x03ce03 (0x27d5 bytes) fallocating to largest ever: 0x30db2 000030 1781661138.624834 fallocate 0x029c6c thru 0x030db1 (0x7146 bytes) 000031 1781661138.629946 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ce04): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce04): Mirror 3: 0x73660335 (stale) Mirror 4: 0x73660335 (stale) Mirror 5: 0xfa2ad945 (stale) Mirror 6: 0xec779c9a (stale) CRC-32 checksum value for chunk [0, 0x3ce04): Mirror 1: 0x4772d20f Mirror 7: 0x4772d20f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce04: skipped 000033 1781661138.984256 MIRROR_RESYNC 6 mirrors 000034 1781661139.467185 punch from 0x025c09 to 0x02b6a4 (0x5a9c bytes) 000035 1781661139.478981 fallocate 0x00020c thru 0x00a3e2 (0xa1d7 bytes) 000036 1781661139.481247 trunc from 0x03ce04 to 0x0097e9 (0x3361a bytes) 000037 1781661139.488481 write 0x011e26 thru 0x019bcf (0x7daa bytes) 000038 1781661139.489808 trunc from 0x015bff to 0x019bcf (0x3fd1 bytes) 000039 1781661139.494703 trunc from 0x0025bd to 0x00d4bd (0xaf01 bytes) 000040 1781661139.497023 mapwrite 0x01a69b thru 0x01e486 (0x3dec bytes) 000041 1781661139.515836 trunc from 0x014f4b to 0x01e486 (0x953c bytes) 000042 1781661139.518407 mapread 0x009896 thru 0x01260e (0x8d79 bytes) 000043 1781661139.522738 write 0x031a7a thru 0x03a148 (0x86cf bytes) 000044 1781661139.523983 trunc from 0x03a149 to 0x01b94a (0x1e7fe bytes) 000045 1781661139.531017 read 0x00b54a thru 0x00e2ad (0x2d64 bytes) 000048 1781661139.532814 mapread 0x00964f thru 0x00e923 (0x52d5 bytes) 000049 1781661139.533572 read 0x00ce2b thru 0x01b94a (0xeb20 bytes) 000050 1781661139.537797 mapread 0x00f3b7 thru 0x01b94a (0xc594 bytes) 000051 1781661139.539092 mapread 0x01a8e7 thru 0x01b94a (0x1064 bytes) fallocating to largest ever: 0x36bf5 000052 1781661139.539958 fallocate 0x028267 thru 0x036bf4 (0xe98e bytes) 000053 1781661139.543199 punch from 0x012edc to 0x01b94a (0x8a6f bytes) 000054 1781661139.546425 write 0x01e784 thru 0x02d10e (0xe98b bytes) 000055 1781661139.548037 write 0x00f93e thru 0x0117dd (0x1ea0 bytes) fallocating to largest ever: 0x3af67 000056 1781661139.548890 fallocate 0x02d7f6 thru 0x03af66 (0xd771 bytes) 000057 1781661139.553366 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3af67): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af67): Mirror 3: 0xa12a38d7 (stale) Mirror 4: 0xa12a38d7 (stale) Mirror 5: 0xa12a38d7 (stale) Mirror 6: 0xa12a38d7 (stale) Mirror 7: 0xa12a38d7 (stale) CRC-32 checksum value for chunk [0, 0x3af67): Mirror 1: 0xd793fba8 Mirror 8: 0xd793fba8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af67: skipped 000058 1781661139.873671 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3af67): Mirror 3: 0xa12a38d7 (stale) Mirror 4: 0xa12a38d7 (stale) Mirror 6: 0xa12a38d7 (stale) Mirror 7: 0xa12a38d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af67): Mirror 3: 0xa12a38d7 (stale) Mirror 4: 0xa12a38d7 (stale) Mirror 6: 0xa12a38d7 (stale) Mirror 7: 0xa12a38d7 (stale) CRC-32 checksum value for chunk [0, 0x3af67): Mirror 1: 0xd793fba8 Mirror 8: 0xd793fba8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af67: skipped 000059 1781661140.084319 read 0x012c66 thru 0x01ab18 (0x7eb3 bytes) fallocating to largest ever: 0x40000 000060 1781661140.088647 fallocate 0x03f238 thru 0x03ffff (0xdc8 bytes) 000061 1781661140.107267 MIRROR_RESYNC 6 mirrors 000062 1781661140.619268 write 0x03a4ab thru 0x03ffff (0x5b55 bytes) 000063 1781661140.632728 mapwrite 0x02846c thru 0x02b384 (0x2f19 bytes) 000064 1781661140.652227 fallocate 0x0245af thru 0x02cf7e (0x89d0 bytes) 000065 1781661140.655372 punch from 0x028a9f to 0x038572 (0xfad4 bytes) 000066 1781661140.662365 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x99aee889 (stale) Mirror 4: 0x99aee889 (stale) Mirror 6: 0x99aee889 (stale) Mirror 7: 0x99aee889 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x99aee889 (stale) Mirror 4: 0x99aee889 (stale) Mirror 6: 0x99aee889 (stale) Mirror 7: 0x99aee889 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000067 1781661140.798747 trunc from 0x040000 to 0x0223be (0x1dc41 bytes) 000068 1781661140.805742 write 0x02e221 thru 0x032fc1 (0x4da1 bytes) 000069 1781661140.806797 punch from 0x009c60 to 0x00f7bc (0x5b5d bytes) 000071 1781661140.809804 fallocate 0x00ddd7 thru 0x014435 (0x665f bytes) 000072 1781661140.811965 punch from 0x02ffb2 to 0x032fc1 (0x3010 bytes) 000073 1781661140.817306 trunc from 0x032fc2 to 0x01a833 (0x1878e bytes) 000074 1781661140.825043 mapwrite 0x000d6a thru 0x00289c (0x1b33 bytes) 000075 1781661140.835631 punch from 0x01343d to 0x0140f2 (0xcb6 bytes) 000076 1781661140.837323 fallocate 0x02643d thru 0x02f09a (0x8c5e bytes) 000077 1781661140.839157 mapwrite 0x01438e thru 0x01daa2 (0x9715 bytes) 000078 1781661140.854625 trunc from 0x01daa3 to 0x02ae1e (0xd37c bytes) 000079 1781661140.859501 read 0x001c2b thru 0x004248 (0x261e bytes) 000080 1781661140.861847 mapwrite 0x03cf1a thru 0x03ffff (0x30e6 bytes) 000081 1781661140.874723 mapread 0x03eb3c thru 0x03ffff (0x14c4 bytes) 000082 1781661140.875716 write 0x009d74 thru 0x015af1 (0xbd7e bytes) 000083 1781661140.879307 write 0x03983e thru 0x03ffff (0x67c2 bytes) 000084 1781661140.880158 punch from 0x02de4b to 0x0398b5 (0xba6b bytes) 000085 1781661140.886384 read 0x021ccf thru 0x02ff84 (0xe2b6 bytes) 000086 1781661140.890554 punch from 0x02c51b to 0x037944 (0xb42a bytes) 000087 1781661140.892513 punch from 0x03b3e3 to 0x03ffff (0x4c1d bytes) 000088 1781661140.894615 punch from 0x014696 to 0x0183a4 (0x3d0f bytes) 000090 1781661140.897112 read 0x006ad6 thru 0x006f8a (0x4b5 bytes) 000091 1781661140.897537 punch from 0x030669 to 0x036010 (0x59a8 bytes) 000092 1781661140.899519 read 0x02b1d0 thru 0x03a4cf (0xf300 bytes) 000093 1781661140.903179 mapwrite 0x002d9a thru 0x00d1a2 (0xa409 bytes) 000094 1781661140.911323 fallocate 0x021656 thru 0x02c520 (0xaecb bytes) 000095 1781661140.913579 read 0x03bddf thru 0x03ffff (0x4221 bytes) 000096 1781661140.914242 mapwrite 0x01a3c9 thru 0x01c435 (0x206d bytes) 000097 1781661140.920090 mapwrite 0x032d7d thru 0x0362b7 (0x353b bytes) 000098 1781661140.928421 read 0x02d22c thru 0x03a2b8 (0xd08d bytes) 000099 1781661140.929079 mapwrite 0x003658 thru 0x004fbd (0x1966 bytes) 000100 1781661140.935487 punch from 0x00f13e to 0x01e9d8 (0xf89b bytes) 000101 1781661140.939761 MIRROR_RESYNC 5 mirrors 000102 1781661141.403505 mapread 0x02aefe thru 0x038b61 (0xdc64 bytes) 000103 1781661141.417879 read 0x02cd3c thru 0x03052b (0x37f0 bytes) 000104 1781661141.418317 trunc from 0x00f49b to 0x01b9a5 (0xc50b bytes) 000105 1781661141.437260 write 0x03c9cc thru 0x03ffff (0x3634 bytes) 000106 1781661141.439802 trunc from 0x040000 to 0x03113a (0xeec5 bytes) 000107 1781661141.449185 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3113b): Mirror 3: 0xabbfbee9 (stale) Mirror 6: 0xabbfbee9 (stale) Mirror 7: 0xabbfbee9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3113b): Mirror 3: 0xabbfbee9 (stale) Mirror 6: 0xabbfbee9 (stale) Mirror 7: 0xabbfbee9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3113b: skipped 000108 1781661141.572196 trunc from 0x019acb to 0x01abb0 (0x10e6 bytes) 000109 1781661141.574941 trunc from 0x005b1f to 0x013349 (0xd82b bytes) 000110 1781661141.581461 mapwrite 0x01c700 thru 0x01e937 (0x2238 bytes) 000111 1781661141.593728 fallocate 0x002922 thru 0x0101e7 (0xd8c6 bytes) 000112 1781661141.596427 punch from 0x01242f to 0x01a7e2 (0x83b4 bytes) 000113 1781661141.599616 trunc from 0x019951 to 0x02764a (0xdcfa bytes) 000115 1781661141.602984 mapwrite 0x034e62 thru 0x03f82f (0xa9ce bytes) 000117 1781661141.632013 punch from 0x01432c to 0x022934 (0xe609 bytes) 000119 1781661141.635779 mapwrite 0x022ea4 thru 0x02d378 (0xa4d5 bytes) 000120 1781661141.652796 trunc from 0x03f830 to 0x035cd0 (0x9b5f bytes) 000121 1781661141.661068 punch from 0x0323f9 to 0x035cd0 (0x38d8 bytes) 000122 1781661141.665508 punch from 0x008d6d to 0x0139b3 (0xac47 bytes) 000123 1781661141.670630 mapwrite 0x01959c thru 0x02942f (0xfe94 bytes) 000125 1781661141.689937 punch from 0x009484 to 0x014400 (0xaf7d bytes) 000126 1781661141.694950 fallocate 0x00bb1f thru 0x00c127 (0x609 bytes) 000127 1781661141.699168 trunc from 0x035cd1 to 0x024720 (0x115b0 bytes) 000128 1781661141.713036 read 0x0024e5 thru 0x008d8f (0x68ab bytes) 000129 1781661141.717366 punch from 0x016696 to 0x024720 (0xe08b bytes) 000130 1781661141.720122 trunc from 0x024721 to 0x03dd7a (0x1965a bytes) 000131 1781661141.726774 punch from 0x000bf2 to 0x00b22f (0xa63e bytes) 000132 1781661141.729700 punch from 0x01754a to 0x01f654 (0x810b bytes) 000133 1781661141.733478 mapread 0x038562 thru 0x03dd7a (0x5819 bytes) 000134 1781661141.738947 fallocate 0x02b9e8 thru 0x035f7a (0xa593 bytes) 000135 1781661141.744172 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd7b): Mirror 6: 0xc1396a (stale) Mirror 7: 0xc1396a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd7b): Mirror 6: 0xc1396a (stale) Mirror 7: 0xc1396a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd7b: skipped 000137 1781661141.869170 mapread 0x00b45a thru 0x00f503 (0x40aa bytes) 000138 1781661141.875473 fallocate 0x02aff7 thru 0x035b0f (0xab19 bytes) 000139 1781661141.877840 read 0x00040f thru 0x00520d (0x4dff bytes) 000140 1781661141.880515 fallocate 0x0185fc thru 0x02273b (0xa140 bytes) 000141 1781661141.882233 fallocate 0x029f46 thru 0x039624 (0xf6df bytes) 000142 1781661141.884116 mapwrite 0x03fa6b thru 0x03ffff (0x595 bytes) 000143 1781661141.896384 punch from 0x00e454 to 0x018b3b (0xa6e8 bytes) 000144 1781661141.898405 punch from 0x0015f4 to 0x005b60 (0x456d bytes) 000145 1781661141.900100 trunc from 0x023ba5 to 0x02593f (0x1d9b bytes) 000146 1781661141.901816 punch from 0x01968e to 0x01ad6e (0x16e1 bytes) 000147 1781661141.903526 trunc from 0x040000 to 0x01912c (0x26ed3 bytes) 000148 1781661141.908721 trunc from 0x0021a9 to 0x010965 (0xe7bd bytes) 000149 1781661141.911079 punch from 0x00eadc to 0x01912c (0xa651 bytes) 000150 1781661141.912806 mapwrite 0x004ee5 thru 0x00e30c (0x9428 bytes) 000151 1781661141.924006 read 0x00923e thru 0x01339a (0xa15d bytes) 000152 1781661141.928506 fallocate 0x007f4e thru 0x00b4c5 (0x3578 bytes) 000153 1781661141.931293 trunc from 0x01912d to 0x0020dc (0x17050 bytes) 000154 1781661141.939895 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x20dd): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20dd): Mirror 6: 0x9b941d19 (stale) Mirror 7: 0x9b941d19 (stale) CRC-32 checksum value for chunk [0, 0x20dd): Mirror 1: 0xaba66ce4 Mirror 8: 0xaba66ce4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20dd: skipped 000155 1781661142.188762 punch from 0x00196d to 0x0020dc (0x770 bytes) 000156 1781661142.201832 MIRROR_RESYNC 4 mirrors 000158 1781661142.405937 read 0x001023 thru 0x0020dc (0x10ba bytes) 000159 1781661142.407818 read 0x001ec2 thru 0x0020dc (0x21b bytes) 000160 1781661142.408163 read 0x000f84 thru 0x0020dc (0x1159 bytes) 000161 1781661142.409703 trunc from 0x00176b to 0x0020dc (0x972 bytes) 000162 1781661142.420290 mapread 0x0009a1 thru 0x0020dc (0x173c bytes) 000163 1781661142.425826 read 0x000af4 thru 0x0020dc (0x15e9 bytes) 000164 1781661142.426390 punch from 0x000a5e to 0x0020dc (0x167f bytes) 000165 1781661142.428642 trunc from 0x001208 to 0x0020dc (0xed5 bytes) 000167 1781661142.431391 read 0x000ec1 thru 0x0020dc (0x121c bytes) 000168 1781661142.435551 mapwrite 0x021b43 thru 0x028fda (0x7498 bytes) 000169 1781661142.452835 trunc from 0x010b92 to 0x01c2e8 (0xb757 bytes) 000170 1781661142.456041 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28fdb): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28fdb): Mirror 6: 0x12f5e540 (stale) Mirror 7: 0x12f5e540 (stale) Mirror 8: 0x12f5e540 (stale) CRC-32 checksum value for chunk [0, 0x28fdb): Mirror 1: 0xd80b4b99 Mirror 9: 0xd80b4b99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28fdb: skipped 000171 1781661142.683636 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28fdb): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28fdb): Mirror 6: 0x12f5e540 (stale) Mirror 7: 0x12f5e540 (stale) Mirror 8: 0x12f5e540 (stale) CRC-32 checksum value for chunk [0, 0x28fdb): Mirror 1: 0xd80b4b99 Mirror 9: 0xd80b4b99 Mirror 10: 0xd80b4b99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28fdb: skipped 000172 1781661142.911310 write 0x0093fe thru 0x00b3fc (0x1fff bytes) 000173 1781661142.926327 punch from 0x0185b5 to 0x01c82a (0x4276 bytes) 000174 1781661142.928667 mapread 0x015ade thru 0x020c9b (0xb1be bytes) 000175 1781661142.938318 mapread 0x006030 thru 0x008ee9 (0x2eba bytes) 000177 1781661142.942121 read 0x006dd0 thru 0x013270 (0xc4a1 bytes) 000179 1781661142.943199 mapwrite 0x001734 thru 0x00a28d (0x8b5a bytes) 000180 1781661142.951542 punch from 0x01834e to 0x0242e5 (0xbf98 bytes) 000181 1781661142.953771 mapwrite 0x032f4b thru 0x03e3b9 (0xb46f bytes) 000185 1781661142.983095 MIRROR_RESYNC 6 mirrors 000186 1781661143.384815 punch from 0x024be7 to 0x0266c3 (0x1add bytes) 000187 1781661143.402472 trunc from 0x03e3ba to 0x01a09d (0x2431c bytes) 000188 1781661143.410757 punch from 0x00cfc7 to 0x011669 (0x46a3 bytes) 000189 1781661143.413550 trunc from 0x01a09e to 0x01f8dd (0x5840 bytes) 000190 1781661143.419512 mapread 0x0143e3 thru 0x019ed6 (0x5af4 bytes) 000191 1781661143.427811 trunc from 0x01f8de to 0x00d8f4 (0x11fe9 bytes) 000192 1781661143.433912 trunc from 0x00a4dd to 0x00d8f4 (0x3418 bytes) 000193 1781661143.436410 punch from 0x00142b to 0x00b730 (0xa306 bytes) 000194 1781661143.439090 read 0x007f25 thru 0x00d8f4 (0x59d0 bytes) 000195 1781661143.442961 fallocate 0x02dfcb thru 0x03d64f (0xf685 bytes) 000196 1781661143.445586 write 0x020d82 thru 0x020ee2 (0x161 bytes) 000197 1781661143.446535 read 0x00b610 thru 0x019831 (0xe222 bytes) 000198 1781661143.451106 fallocate 0x03f969 thru 0x03ffff (0x697 bytes) 000199 1781661143.453987 read 0x009a83 thru 0x015a0f (0xbf8d bytes) 000200 1781661143.454535 trunc from 0x020101 to 0x020f81 (0xe81 bytes) 000201 1781661143.459374 trunc from 0x040000 to 0x015fb3 (0x2a04c bytes) 000202 1781661143.466443 trunc from 0x015fb4 to 0x022e11 (0xce5e bytes) 000203 1781661143.472969 write 0x02560c thru 0x02c20b (0x6c00 bytes) 000204 1781661143.474493 write 0x01f131 thru 0x02b8c5 (0xc795 bytes) 000205 1781661143.478627 mapwrite 0x020bfc thru 0x027979 (0x6d7e bytes) 000206 1781661143.487907 write 0x0155e3 thru 0x0218fc (0xc31a bytes) 000207 1781661143.489354 write 0x00ead1 thru 0x0199ff (0xaf2f bytes) 000208 1781661143.493344 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c20c): Mirror 6: 0xaf438498 (stale) Mirror 7: 0xaf438498 (stale) Mirror 9: 0xaf438498 (stale) Mirror 10: 0xaf438498 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c20c): Mirror 6: 0xaf438498 (stale) Mirror 7: 0xaf438498 (stale) Mirror 9: 0xaf438498 (stale) Mirror 10: 0xaf438498 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c20c: skipped 000209 1781661143.664258 punch from 0x00b8d2 to 0x015963 (0xa092 bytes) 000210 1781661143.667397 mapwrite 0x030a22 thru 0x03cf5e (0xc53d bytes) 000211 1781661143.708241 trunc from 0x027455 to 0x0343b2 (0xcf5e bytes) 000212 1781661143.711463 trunc from 0x03cf5f to 0x02d57b (0xf9e3 bytes) 000213 1781661143.718047 mapread 0x024205 thru 0x02d57b (0x9377 bytes) 000214 1781661143.726776 trunc from 0x02d57c to 0x00e609 (0x1ef72 bytes) 000215 1781661143.739247 trunc from 0x00e60a to 0x0000e1 (0xe528 bytes) 000216 1781661143.747415 fallocate 0x01fa68 thru 0x0289d9 (0x8f72 bytes) 000217 1781661143.753251 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x289da): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x289da): Mirror 6: 0xb1ac941b (stale) Mirror 7: 0xb1ac941b (stale) Mirror 9: 0xb1ac941b (stale) Mirror 10: 0xb1ac941b (stale) CRC-32 checksum value for chunk [0, 0x289da): Mirror 1: 0xb3229ae6 Mirror 11: 0xb3229ae6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x289da: skipped 000218 1781661144.077522 mapwrite 0x00bc8a thru 0x014662 (0x89d9 bytes) 000219 1781661144.122946 read 0x012ce2 thru 0x0184b4 (0x57d3 bytes) 000220 1781661144.125926 trunc from 0x000559 to 0x00afb9 (0xaa61 bytes) 000221 1781661144.128839 mapread 0x014044 thru 0x0238d8 (0xf895 bytes) 000222 1781661144.139851 trunc from 0x0062b8 to 0x01050a (0xa253 bytes) 000225 1781661144.144494 read 0x0186f8 thru 0x02138b (0x8c94 bytes) 000226 1781661144.145315 mapwrite 0x02cbcc thru 0x03c27e (0xf6b3 bytes) 000227 1781661144.188099 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c27f): Mirror 6: 0x118006f (stale) Mirror 9: 0x118006f (stale) Mirror 10: 0x118006f (stale) Mirror 11: 0x310b168d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c27f): Mirror 6: 0x118006f (stale) Mirror 9: 0x118006f (stale) Mirror 10: 0x118006f (stale) Mirror 11: 0x310b168d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c27f: skipped 000228 1781661144.325188 trunc from 0x026df7 to 0x035f49 (0xf153 bytes) 000229 1781661144.328359 punch from 0x038908 to 0x03af15 (0x260e bytes) 000230 1781661144.330464 write 0x01b1ac thru 0x01ebff (0x3a54 bytes) 000231 1781661144.336091 mapread 0x034f30 thru 0x03c27e (0x734f bytes) 000232 1781661144.344724 write 0x03d294 thru 0x03ffff (0x2d6c bytes) 000233 1781661144.345578 trunc from 0x040000 to 0x01da15 (0x225ea bytes) 000234 1781661144.351618 read 0x00f21e thru 0x019b72 (0xa955 bytes) 000235 1781661144.357957 trunc from 0x01da16 to 0x03bf95 (0x1e580 bytes) 000236 1781661144.367547 fallocate 0x03363d thru 0x03f453 (0xbe17 bytes) 000237 1781661144.370984 mapwrite 0x0389a5 thru 0x03ffff (0x765b bytes) 000238 1781661144.391717 trunc from 0x040000 to 0x00d7c3 (0x3283c bytes) 000239 1781661144.397879 write 0x00de10 thru 0x011b3f (0x3d30 bytes) 000240 1781661144.401147 mapread 0x00d9c7 thru 0x011b3f (0x4179 bytes) 000241 1781661144.404325 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11b40): Mirror 6: 0x6539d914 (stale) Mirror 9: 0x6539d914 (stale) Mirror 11: 0x776d2061 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11b40): Mirror 6: 0x6539d914 (stale) Mirror 9: 0x6539d914 (stale) Mirror 11: 0x776d2061 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11b40: skipped 000242 1781661144.588324 mapread 0x00e543 thru 0x011b3f (0x35fd bytes) 000243 1781661144.597285 mapread 0x0021b0 thru 0x007ca1 (0x5af2 bytes) 000244 1781661144.602337 trunc from 0x00e195 to 0x00ea38 (0x8a4 bytes) 000245 1781661144.606468 MIRROR_RESYNC 4 mirrors 000246 1781661144.896374 trunc from 0x000426 to 0x00e753 (0xe32e bytes) 000247 1781661144.910226 mapread 0x008432 thru 0x00b6dc (0x32ab bytes) 000248 1781661144.920431 trunc from 0x011b40 to 0x0342de (0x2279f bytes) 000249 1781661144.933970 mapwrite 0x01c48c thru 0x0260bf (0x9c34 bytes) 000250 1781661144.949811 mapwrite 0x0349cc thru 0x03a7de (0x5e13 bytes) 000251 1781661144.972647 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a7df): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7df): Mirror 6: 0x8fb4ee64 (stale) Mirror 9: 0x8fb4ee64 (stale) Mirror 11: 0x8fb4ee64 (stale) CRC-32 checksum value for chunk [0, 0x3a7df): Mirror 1: 0x920f4541 Mirror 12: 0x920f4541 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7df: skipped 000252 1781661145.297837 trunc from 0x03a7df to 0x0327dc (0x8002 bytes) 000253 1781661145.313904 trunc from 0x0327dd to 0x02957d (0x925f bytes) 000255 1781661145.320401 trunc from 0x018495 to 0x01e5b6 (0x6122 bytes) 000257 1781661145.323348 trunc from 0x002b04 to 0x005551 (0x2a4e bytes) 000258 1781661145.325176 mapread 0x01ea81 thru 0x0208f7 (0x1e77 bytes) 000259 1781661145.333418 MIRROR_RESYNC 5 mirrors 000260 1781661145.749299 fallocate 0x028521 thru 0x0295de (0x10be bytes) 000261 1781661145.761566 write 0x01bc42 thru 0x02b40c (0xf7cb bytes) 000262 1781661145.766745 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b40d): Mirror 9: 0x6fa3a350 (stale) Mirror 11: 0x6fa3a350 (stale) Mirror 12: 0x6fa3a350 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b40d): Mirror 9: 0x6fa3a350 (stale) Mirror 11: 0x6fa3a350 (stale) Mirror 12: 0x6fa3a350 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b40d: skipped 000263 1781661145.938541 trunc from 0x00dc63 to 0x00eec6 (0x1264 bytes) 000264 1781661145.940885 trunc from 0x029d64 to 0x02b40c (0x16a9 bytes) 000265 1781661145.943013 mapwrite 0x0209dd thru 0x02999a (0x8fbe bytes) 000266 1781661145.960271 read 0x017744 thru 0x019d1d (0x25da bytes) 000267 1781661145.963313 read 0x01e93e thru 0x024a07 (0x60ca bytes) 000268 1781661145.963913 read 0x029a12 thru 0x02b40c (0x19fb bytes) 000269 1781661145.969325 mapread 0x00ea1d thru 0x01078b (0x1d6f bytes) 000270 1781661145.970311 mapread 0x0177c5 thru 0x01a83e (0x307a bytes) 000271 1781661145.971129 punch from 0x01d6d8 to 0x02721b (0x9b44 bytes) 000272 1781661145.977169 MIRROR_RESYNC 4 mirrors 000273 1781661146.435421 write 0x01617b thru 0x01b6d2 (0x5558 bytes) 000275 1781661146.450238 mapread 0x006d32 thru 0x0157a0 (0xea6f bytes) 000276 1781661146.468042 write 0x01233a thru 0x0192b2 (0x6f79 bytes) 000277 1781661146.469032 read 0x01afcf thru 0x01dc89 (0x2cbb bytes) 000278 1781661146.473188 mapread 0x013131 thru 0x020d03 (0xdbd3 bytes) 000279 1781661146.477701 punch from 0x029fed to 0x02b40c (0x1420 bytes) 000280 1781661146.480506 mapwrite 0x00e20b thru 0x0150c9 (0x6ebf bytes) 000281 1781661146.491378 fallocate 0x02550c thru 0x02a745 (0x523a bytes) 000282 1781661146.494084 trunc from 0x02b40d to 0x02319d (0x826f bytes) 000283 1781661146.501985 mapwrite 0x033b13 thru 0x03e93c (0xae2a bytes) 000284 1781661146.521829 punch from 0x012aa8 to 0x01f67b (0xcbd4 bytes) 000285 1781661146.524238 punch from 0x022649 to 0x02e534 (0xbeec bytes) 000286 1781661146.527746 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e93d): Mirror 11: 0xbf086708 (stale) Mirror 12: 0xbf086708 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e93d): Mirror 11: 0xbf086708 (stale) Mirror 12: 0xbf086708 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e93d: skipped 000287 1781661146.644381 read 0x02d5e4 thru 0x038d4b (0xb768 bytes) 000288 1781661146.648511 write 0x01c066 thru 0x0224d3 (0x646e bytes) 000289 1781661146.654640 trunc from 0x036783 to 0x03e93c (0x81ba bytes) 000290 1781661146.656996 trunc from 0x020409 to 0x023165 (0x2d5d bytes) 000292 1781661146.661847 trunc from 0x03e93d to 0x0040f5 (0x3a847 bytes) 000293 1781661146.666689 trunc from 0x002305 to 0x0040f5 (0x1df1 bytes) 000294 1781661146.668708 trunc from 0x0040f6 to 0x011478 (0xd383 bytes) 000295 1781661146.673521 write 0x004259 thru 0x011930 (0xd6d8 bytes) 000296 1781661146.678027 write 0x01e78b thru 0x02abde (0xc454 bytes) 000297 1781661146.679696 read 0x006b90 thru 0x009c3f (0x30b0 bytes) 000298 1781661146.680414 trunc from 0x02abdf to 0x002bd9 (0x28005 bytes) 000299 1781661146.686696 trunc from 0x0026a2 to 0x002bd9 (0x538 bytes) 000300 1781661146.688682 trunc from 0x002bda to 0x005820 (0x2c47 bytes) 000301 1781661146.695386 mapread 0x001bc3 thru 0x005820 (0x3c5e bytes) 000302 1781661146.699745 punch from 0x00170d to 0x005820 (0x4114 bytes) 000303 1781661146.702552 trunc from 0x005821 to 0x00ed35 (0x9515 bytes) 000304 1781661146.714843 read 0x001d8d thru 0x00b6cd (0x9941 bytes) 000306 1781661146.719882 fallocate 0x016ad3 thru 0x01f22a (0x8758 bytes) 000307 1781661146.723047 punch from 0x017706 to 0x01e9c5 (0x72c0 bytes) 000308 1781661146.725950 trunc from 0x01cad3 to 0x01f22a (0x2758 bytes) 000310 1781661146.729490 fallocate 0x0106dc thru 0x01a79d (0xa0c2 bytes) 000311 1781661146.732815 mapwrite 0x032943 thru 0x03eccd (0xc38b bytes) 000312 1781661146.754867 write 0x005520 thru 0x00c2f5 (0x6dd6 bytes) 000313 1781661146.756008 punch from 0x0068c9 to 0x00f93a (0x9072 bytes) 000315 1781661146.763036 mapread 0x0343e2 thru 0x037b19 (0x3738 bytes) 000316 1781661146.763916 write 0x03fa2a thru 0x03ffff (0x5d6 bytes) 000317 1781661146.764875 trunc from 0x040000 to 0x02e063 (0x11f9c bytes) 000318 1781661146.772769 fallocate 0x033085 thru 0x03cc3d (0x9bb9 bytes) 000319 1781661146.777736 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e064): Mirror 12: 0x450badde (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e064): Mirror 12: 0x450badde (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e064: skipped 000320 1781661146.879699 fallocate 0x00fd52 thru 0x01706d (0x731c bytes) 000321 1781661146.883473 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2e064): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e064): Mirror 12: 0x450badde (stale) CRC-32 checksum value for chunk [0, 0x2e064): Mirror 1: 0x3b26e3cc Mirror 13: 0x3b26e3cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e064: skipped 000322 1781661147.178591 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000323 1781661147.317585 punch from 0x02960f to 0x02e063 (0x4a55 bytes) 000324 1781661147.349737 mapread 0x0079fc thru 0x014e6b (0xd470 bytes) 000325 1781661147.377426 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000327 1781661147.438731 punch from 0x01c287 to 0x0247c9 (0x8543 bytes) 000328 1781661147.443231 mapwrite 0x0291f9 thru 0x02bed0 (0x2cd8 bytes) 000329 1781661147.460037 punch from 0x0261c2 to 0x02e063 (0x7ea2 bytes) 000330 1781661147.462829 punch from 0x018db2 to 0x026763 (0xd9b2 bytes) 000331 1781661147.465788 punch from 0x008b80 to 0x00d1f5 (0x4676 bytes) 000332 1781661147.468011 read 0x008365 thru 0x0094a2 (0x113e bytes) 000333 1781661147.470777 write 0x0212e7 thru 0x02a8ca (0x95e4 bytes) 000334 1781661147.476598 trunc from 0x02e064 to 0x03ae86 (0xce23 bytes) 000335 1781661147.482028 trunc from 0x034dfb to 0x03ae86 (0x608c bytes) 000336 1781661147.483741 mapread 0x003752 thru 0x008a31 (0x52e0 bytes) 000337 1781661147.487700 write 0x03d113 thru 0x03ffff (0x2eed bytes) 000338 1781661147.488815 fallocate 0x00597c thru 0x005db4 (0x439 bytes) 000340 1781661147.492512 mapread 0x006e32 thru 0x00edde (0x7fad bytes) 000341 1781661147.493546 trunc from 0x040000 to 0x00f1d7 (0x30e28 bytes) 000342 1781661147.501188 trunc from 0x0006c2 to 0x00bebe (0xb7fd bytes) 000343 1781661147.504185 trunc from 0x00b900 to 0x00f1d7 (0x38d8 bytes) 000344 1781661147.507851 read 0x008631 thru 0x00a66b (0x203b bytes) 000346 1781661147.514198 trunc from 0x00f1d8 to 0x0252a3 (0x160cc bytes) 000347 1781661147.521891 mapwrite 0x03dbe1 thru 0x03ed2b (0x114b bytes) 000348 1781661147.540152 trunc from 0x015c4f to 0x018062 (0x2414 bytes) 000349 1781661147.542836 read 0x000f0a thru 0x005aa3 (0x4b9a bytes) 000350 1781661147.545450 MIRROR_EXTEND to 2 mirrors 000351 1781661147.787770 fallocate 0x03c93d thru 0x03ffff (0x36c3 bytes) 000352 1781661147.802744 mapread 0x01388b thru 0x014b0a (0x1280 bytes) 000353 1781661147.806848 trunc from 0x03ed2c to 0x026d57 (0x17fd4 bytes) 000354 1781661147.822043 trunc from 0x026d58 to 0x01e3f3 (0x8964 bytes) 000355 1781661147.829811 mapread 0x004853 thru 0x00c7f3 (0x7fa1 bytes) 000356 1781661147.834698 mapread 0x00dcdc thru 0x019e70 (0xc195 bytes) 000357 1781661147.839231 read 0x01c021 thru 0x01e3f3 (0x23d3 bytes) 000358 1781661147.842014 fallocate 0x00fa5d thru 0x016ad5 (0x7079 bytes) 000359 1781661147.844802 mapread 0x016474 thru 0x01e3f3 (0x7f80 bytes) 000360 1781661147.848164 mapwrite 0x03a815 thru 0x03ffff (0x57eb bytes) 000361 1781661147.864899 punch from 0x017efd to 0x024271 (0xc375 bytes) 000362 1781661147.867544 write 0x02d1e1 thru 0x02ded1 (0xcf1 bytes) 000363 1781661147.870171 trunc from 0x01095f to 0x01bb67 (0xb209 bytes) 000364 1781661147.873186 trunc from 0x02a45b to 0x0331d7 (0x8d7d bytes) 000365 1781661147.882401 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000366 1781661147.934878 punch from 0x010d21 to 0x017a6e (0x6d4e bytes) 000367 1781661147.938911 write 0x036d50 thru 0x03ffff (0x92b0 bytes) 000368 1781661147.943906 punch from 0x021a2c to 0x024da9 (0x337e bytes) 000369 1781661147.946611 trunc from 0x013bb2 to 0x021308 (0xd757 bytes) 000370 1781661147.949610 trunc from 0x01b7c7 to 0x026bb8 (0xb3f2 bytes) 000371 1781661147.952002 mapwrite 0x039798 thru 0x03ffff (0x6868 bytes) 000372 1781661147.960621 trunc from 0x040000 to 0x000cb5 (0x3f34a bytes) 000373 1781661147.966313 read 0x000351 thru 0x000cb5 (0x965 bytes) 000374 1781661147.968417 punch from 0x000899 to 0x000cb5 (0x41d bytes) 000376 1781661147.971251 fallocate 0x035c9a thru 0x0375e5 (0x194c bytes) 000377 1781661147.973646 read 0x01a1be thru 0x029408 (0xf24b bytes) 000378 1781661147.977513 trunc from 0x0375e6 to 0x01d430 (0x1a1b5 bytes) 000381 1781661147.983830 mapwrite 0x02da9b thru 0x03993d (0xbea3 bytes) 000382 1781661148.023106 trunc from 0x021cb3 to 0x02baee (0x9e3c bytes) 000383 1781661148.030663 mapwrite 0x00d521 thru 0x01a855 (0xd335 bytes) 000384 1781661148.042343 trunc from 0x03993e to 0x013075 (0x268c8 bytes) 000385 1781661148.051046 fallocate 0x02ad67 thru 0x035e78 (0xb112 bytes) 000387 1781661148.054610 punch from 0x014abe to 0x01ee59 (0xa39c bytes) 000388 1781661148.057731 fallocate 0x022e58 thru 0x02f864 (0xca0d bytes) 000389 1781661148.060798 trunc from 0x035e79 to 0x00b9df (0x2a499 bytes) 000390 1781661148.067082 mapread 0x0067f5 thru 0x00b9df (0x51eb bytes) 000391 1781661148.068161 mapread 0x00820b thru 0x00b9df (0x37d5 bytes) 000392 1781661148.069019 read 0x006b19 thru 0x00b9df (0x4ec7 bytes) 000393 1781661148.069680 fallocate 0x01f366 thru 0x0216eb (0x2386 bytes) 000394 1781661148.072817 punch from 0x00b05d to 0x00b9df (0x983 bytes) 000395 1781661148.075220 read 0x006994 thru 0x00b7df (0x4e4c bytes) 000396 1781661148.078131 write 0x02d8d7 thru 0x0372f4 (0x9a1e bytes) 000397 1781661148.079623 trunc from 0x02de31 to 0x02e2ec (0x4bc bytes) 000398 1781661148.085662 punch from 0x02f6bf to 0x03063a (0xf7c bytes) 000400 1781661148.088572 mapread 0x006749 thru 0x015fda (0xf892 bytes) 000401 1781661148.096893 mapwrite 0x01b171 thru 0x029a16 (0xe8a6 bytes) 000402 1781661148.109292 trunc from 0x008884 to 0x00af4c (0x26c9 bytes) 000404 1781661148.112219 punch from 0x036844 to 0x0372f4 (0xab1 bytes) 000405 1781661148.114403 trunc from 0x0372f5 to 0x00731e (0x2ffd6 bytes) 000406 1781661148.122772 fallocate 0x007a89 thru 0x013c45 (0xc1bd bytes) 000408 1781661148.126126 mapwrite 0x0363bd thru 0x03f548 (0x918c bytes) 000409 1781661148.148659 mapwrite 0x03feb6 thru 0x03ffff (0x14a bytes) 000410 1781661148.170367 read 0x022f36 thru 0x02ce78 (0x9f43 bytes) 000411 1781661148.178816 mapwrite 0x024422 thru 0x027800 (0x33df bytes) 000414 1781661148.190282 trunc from 0x006a7b to 0x00b260 (0x47e6 bytes) 000415 1781661148.193495 fallocate 0x0154a2 thru 0x017a28 (0x2587 bytes) 000416 1781661148.195771 mapwrite 0x0314ca thru 0x036fe7 (0x5b1e bytes) 000417 1781661148.203594 write 0x0011d1 thru 0x00c937 (0xb767 bytes) 000418 1781661148.204783 punch from 0x0266f2 to 0x03485a (0xe169 bytes) 000419 1781661148.207804 mapwrite 0x00808c thru 0x00a7c0 (0x2735 bytes) 000420 1781661148.215531 mapwrite 0x021cee thru 0x02dda3 (0xc0b6 bytes) 000421 1781661148.245326 read 0x0300a9 thru 0x035d2b (0x5c83 bytes) 000422 1781661148.251075 write 0x018a4d thru 0x01daf7 (0x50ab bytes) 000423 1781661148.252211 fallocate 0x009b42 thru 0x01726e (0xd72d bytes) 000424 1781661148.255993 punch from 0x036057 to 0x03e75b (0x8705 bytes) 000425 1781661148.262901 mapwrite 0x00ff70 thru 0x010440 (0x4d1 bytes) 000426 1781661148.275610 trunc from 0x040000 to 0x02072f (0x1f8d0 bytes) 000427 1781661148.286868 mapwrite 0x01f830 thru 0x024524 (0x4cf5 bytes) 000428 1781661148.312285 fallocate 0x021111 thru 0x02fe02 (0xecf2 bytes) 000430 1781661148.315512 mapread 0x02c7b6 thru 0x02fe02 (0x364d bytes) 000431 1781661148.323352 punch from 0x025a8d to 0x02fe02 (0xa376 bytes) 000432 1781661148.325899 read 0x02ed54 thru 0x02fe02 (0x10af bytes) 000433 1781661148.330922 mapwrite 0x032989 thru 0x039755 (0x6dcd bytes) 000434 1781661148.347965 punch from 0x006f4c to 0x0152da (0xe38f bytes) 000435 1781661148.350173 fallocate 0x0209df thru 0x020b3a (0x15c bytes) 000436 1781661148.352332 write 0x00d8ac thru 0x018079 (0xa7ce bytes) 000437 1781661148.355547 mapwrite 0x01f503 thru 0x023d87 (0x4885 bytes) 000438 1781661148.365380 read 0x023b23 thru 0x02b2c1 (0x779f bytes) 000439 1781661148.366015 mapwrite 0x00b3bb thru 0x01b1b6 (0xfdfc bytes) 000440 1781661148.380081 mapread 0x018866 thru 0x02814b (0xf8e6 bytes) 000441 1781661148.381213 mapwrite 0x029e5c thru 0x02b256 (0x13fb bytes) 000442 1781661148.389965 fallocate 0x036099 thru 0x03ffff (0x9f67 bytes) 000444 1781661148.393465 read 0x0299ad thru 0x02e8fa (0x4f4e bytes) 000445 1781661148.394127 trunc from 0x01b707 to 0x023861 (0x815b bytes) 000446 1781661148.397272 write 0x006699 thru 0x01195f (0xb2c7 bytes) 000449 1781661148.399865 punch from 0x027119 to 0x030b60 (0x9a48 bytes) 000450 1781661148.402852 mapwrite 0x0166c6 thru 0x01fbb1 (0x94ec bytes) 000451 1781661148.417548 mapread 0x02e770 thru 0x036b6e (0x83ff bytes) 000452 1781661148.418668 read 0x025d10 thru 0x031ccc (0xbfbd bytes) 000453 1781661148.419254 mapread 0x024809 thru 0x02f16b (0xa963 bytes) 000454 1781661148.420018 mapwrite 0x030d20 thru 0x0354eb (0x47cc bytes) 000455 1781661148.429154 trunc from 0x00f92b to 0x01f878 (0xff4e bytes) 000456 1781661148.433771 write 0x03ba78 thru 0x03ffff (0x4588 bytes) 000458 1781661148.435641 write 0x014078 thru 0x0149b0 (0x939 bytes) 000459 1781661148.441203 mapread 0x0244cc thru 0x026f80 (0x2ab5 bytes) 000460 1781661148.444822 MIRROR_EXTEND to 2 mirrors 000461 1781661148.690609 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000462 1781661148.743215 trunc from 0x040000 to 0x00316a (0x3ce95 bytes) 000464 1781661148.769936 fallocate 0x021a6e thru 0x026f7d (0x5510 bytes) 000465 1781661148.773840 punch from 0x0005b7 to 0x001264 (0xcae bytes) 000467 1781661148.776822 fallocate 0x01b911 thru 0x028f1a (0xd60a bytes) 000468 1781661148.779895 write 0x01a604 thru 0x0253a7 (0xada4 bytes) 000470 1781661148.786581 mapwrite 0x023e5d thru 0x033668 (0xf80c bytes) 000471 1781661148.816020 mapread 0x0275a2 thru 0x02a6fa (0x3159 bytes) 000472 1781661148.816973 write 0x0207f8 thru 0x02b0cf (0xa8d8 bytes) 000473 1781661148.818149 trunc from 0x0193d8 to 0x01be69 (0x2a92 bytes) 000475 1781661148.821902 trunc from 0x021538 to 0x030d80 (0xf849 bytes) 000476 1781661148.828826 trunc from 0x002174 to 0x0047f4 (0x2681 bytes) 000477 1781661148.832097 punch from 0x02f4ef to 0x03169d (0x21af bytes) 000478 1781661148.834788 fallocate 0x006e75 thru 0x00f550 (0x86dc bytes) 000479 1781661148.837694 mapwrite 0x018b30 thru 0x01e595 (0x5a66 bytes) 000480 1781661148.860778 MIRROR_EXTEND to 2 mirrors 000481 1781661149.098995 mapread 0x018be9 thru 0x01cf3f (0x4357 bytes) 000482 1781661149.106332 write 0x016dfa thru 0x01973b (0x2942 bytes) 000483 1781661149.128209 fallocate 0x00e2b2 thru 0x014c2a (0x6979 bytes) 000484 1781661149.130780 fallocate 0x03886a thru 0x03ffff (0x7796 bytes) 000485 1781661149.133339 trunc from 0x040000 to 0x02636c (0x19c93 bytes) 000486 1781661149.141985 trunc from 0x02636d to 0x004aeb (0x21881 bytes) 000487 1781661149.148791 fallocate 0x0307c8 thru 0x03b999 (0xb1d2 bytes) 000488 1781661149.151659 write 0x02067f thru 0x02ad1d (0xa69f bytes) 000489 1781661149.156360 mapread 0x004979 thru 0x00cc2c (0x82b4 bytes) 000490 1781661149.160599 write 0x016a77 thru 0x025390 (0xe91a bytes) 000491 1781661149.163651 fallocate 0x01498e thru 0x01f6f1 (0xad64 bytes) 000492 1781661149.168544 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b99a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b99a): Mirror 2: 0xb6d174fb (stale) CRC-32 checksum value for chunk [0, 0x3b99a): Mirror 1: 0x4a3e85ca Mirror 3: 0x4a3e85ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b99a: skipped 000493 1781661149.449426 mapwrite 0x035dcd thru 0x03ffff (0xa233 bytes) 000494 1781661149.490896 trunc from 0x03fb30 to 0x03ffff (0x4d0 bytes) 000495 1781661149.493749 trunc from 0x040000 to 0x016168 (0x29e97 bytes) 000496 1781661149.504634 mapwrite 0x00a301 thru 0x01273b (0x843b bytes) 000497 1781661149.520027 mapwrite 0x03f7ca thru 0x03ffff (0x836 bytes) 000498 1781661149.543352 trunc from 0x040000 to 0x00496d (0x3b692 bytes) 000499 1781661149.551530 mapread 0x0018dc thru 0x00496d (0x3092 bytes) 000500 1781661149.555220 mapread 0x003795 thru 0x00435b (0xbc7 bytes) 000501 1781661149.556232 mapread 0x000131 thru 0x00496d (0x483d bytes) 000502 1781661149.559434 mapread 0x000bce thru 0x000ee3 (0x316 bytes) 000503 1781661149.560539 trunc from 0x00496e to 0x00d921 (0x8fb4 bytes) 000504 1781661149.567822 trunc from 0x00cfab to 0x00d921 (0x977 bytes) 000505 1781661149.572740 punch from 0x00b1a1 to 0x00d921 (0x2781 bytes) 000506 1781661149.576702 punch from 0x008ab6 to 0x00d921 (0x4e6c bytes) 000507 1781661149.579847 trunc from 0x00d922 to 0x02d7cc (0x1feab bytes) 000508 1781661149.588333 read 0x01ad4e thru 0x01f46c (0x471f bytes) 000509 1781661149.592542 punch from 0x020f80 to 0x0210eb (0x16c bytes) 000511 1781661149.595927 trunc from 0x02d7cd to 0x018465 (0x15367 bytes) 000512 1781661149.603369 punch from 0x0031c0 to 0x0076a0 (0x44e1 bytes) 000513 1781661149.606396 fallocate 0x035267 thru 0x03ffff (0xad99 bytes) 000514 1781661149.609610 mapread 0x016d90 thru 0x018465 (0x16d6 bytes) 000515 1781661149.615927 fallocate 0x02b62f thru 0x03b04e (0xfa20 bytes) 000516 1781661149.619734 trunc from 0x006097 to 0x00ce61 (0x6dcb bytes) 000517 1781661149.626333 MIRROR_RESYNC 3 mirrors 000518 1781661149.897667 trunc from 0x00b229 to 0x015785 (0xa55d bytes) 000519 1781661149.915668 fallocate 0x039d10 thru 0x03e4cd (0x47be bytes) 000521 1781661149.921006 fallocate 0x02bdd9 thru 0x03064c (0x4874 bytes) 000522 1781661149.923954 mapwrite 0x01c474 thru 0x0296f8 (0xd285 bytes) 000523 1781661149.948809 trunc from 0x03e4ce to 0x02c6c7 (0x11e06 bytes) 000524 1781661149.965433 mapread 0x014c31 thru 0x01c65e (0x7a2e bytes) 000525 1781661149.970128 trunc from 0x02c6c8 to 0x00562e (0x27099 bytes) 000526 1781661149.977384 write 0x03b3ee thru 0x03ffff (0x4c12 bytes) 000527 1781661149.980151 MIRROR_RESYNC 3 mirrors 000528 1781661150.236327 trunc from 0x02f7d4 to 0x039997 (0xa1c4 bytes) 000529 1781661150.256011 mapwrite 0x022c71 thru 0x022ded (0x17d bytes) 000530 1781661150.264728 write 0x008b33 thru 0x01536d (0xc83b bytes) 000531 1781661150.269816 mapread 0x017703 thru 0x01910c (0x1a0a bytes) 000532 1781661150.278137 punch from 0x03fe7a to 0x03ffff (0x186 bytes) 000533 1781661150.283127 read 0x022cc2 thru 0x02d061 (0xa3a0 bytes) 000534 1781661150.288087 write 0x00c0fe thru 0x01258a (0x648d bytes) 000535 1781661150.289258 fallocate 0x030626 thru 0x03ae4a (0xa825 bytes) 000537 1781661150.293993 punch from 0x035b30 to 0x03ffff (0xa4d0 bytes) 000538 1781661150.296939 mapwrite 0x00c630 thru 0x00fa95 (0x3466 bytes) 000539 1781661150.312079 write 0x01c665 thru 0x029f23 (0xd8bf bytes) 000540 1781661150.313576 read 0x037f8b thru 0x03ffff (0x8075 bytes) 000541 1781661150.317744 mapread 0x03956b thru 0x03c7e0 (0x3276 bytes) 000542 1781661150.320643 MIRROR_RESYNC 3 mirrors 000543 1781661150.634313 punch from 0x006f54 to 0x00cc43 (0x5cf0 bytes) 000544 1781661150.645857 write 0x02eae3 thru 0x03e46e (0xf98c bytes) 000545 1781661150.649970 read 0x00594c thru 0x00954f (0x3c04 bytes) 000546 1781661150.652799 mapread 0x037255 thru 0x03bfc8 (0x4d74 bytes) 000547 1781661150.653479 trunc from 0x009c6b to 0x014901 (0xac97 bytes) 000549 1781661150.656236 read 0x02393b thru 0x02406c (0x732 bytes) 000550 1781661150.660278 write 0x03f92a thru 0x03ffff (0x6d6 bytes) 000552 1781661150.661775 mapwrite 0x028a0b thru 0x032175 (0x976b bytes) 000553 1781661150.671444 fallocate 0x03904c thru 0x03ae77 (0x1e2c bytes) 000554 1781661150.678301 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x40ff290a (stale) Mirror 3: 0x40ff290a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x27275030 Mirror 4: 0x27275030 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000555 1781661151.008640 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x40ff290a (stale) Mirror 3: 0x40ff290a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x40ff290a (stale) Mirror 3: 0x40ff290a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1781661151.139146 trunc from 0x02f452 to 0x03acd5 (0xb884 bytes) 000557 1781661151.147548 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x40ff290a (stale) Mirror 3: 0x40ff290a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8c1c69b0 Mirror 4: 0x8c1c69b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000558 1781661151.488048 punch from 0x0310f4 to 0x0346f0 (0x35fd bytes) 000559 1781661151.501958 trunc from 0x039115 to 0x03ffff (0x6eeb bytes) 000560 1781661151.504580 read 0x02690f thru 0x028aa0 (0x2192 bytes) 000561 1781661151.507582 punch from 0x0115c3 to 0x018e30 (0x786e bytes) 000562 1781661151.509836 write 0x003468 thru 0x012438 (0xefd1 bytes) 000563 1781661151.516455 trunc from 0x012d81 to 0x01a214 (0x7494 bytes) 000564 1781661151.522219 fallocate 0x03ff50 thru 0x03ffff (0xb0 bytes) 000565 1781661151.524982 fallocate 0x02c529 thru 0x0365b9 (0xa091 bytes) 000566 1781661151.527670 fallocate 0x037ea7 thru 0x03b73c (0x3896 bytes) 000567 1781661151.530310 punch from 0x02b45b to 0x02f485 (0x402b bytes) 000568 1781661151.533844 write 0x0077b8 thru 0x014562 (0xcdab bytes) 000569 1781661151.538172 trunc from 0x030f3d to 0x037f0b (0x6fcf bytes) 000570 1781661151.541386 fallocate 0x0328d1 thru 0x0354ae (0x2bde bytes) 000571 1781661151.545010 trunc from 0x040000 to 0x01f0dc (0x20f23 bytes) 000572 1781661151.556176 trunc from 0x01f0dd to 0x025449 (0x636d bytes) 000573 1781661151.569110 MIRROR_RESYNC 4 mirrors 000574 1781661151.928945 MIRROR_EXTEND to 5 mirrors 000576 1781661152.190672 trunc from 0x0141e4 to 0x0224cb (0xe2e8 bytes) 000577 1781661152.208505 trunc from 0x00f51d to 0x013c28 (0x470c bytes) 000578 1781661152.215144 MIRROR_RESYNC 5 mirrors 000579 1781661152.658964 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000580 1781661152.820702 write 0x0387b2 thru 0x03ffff (0x784e bytes) 000582 1781661152.839830 read 0x00ef00 thru 0x0179a6 (0x8aa7 bytes) 000583 1781661152.844500 read 0x02e928 thru 0x02fd0a (0x13e3 bytes) 000584 1781661152.850581 trunc from 0x040000 to 0x00e18b (0x31e74 bytes) 000585 1781661152.868172 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xe18c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe18c): Mirror 2: 0xf8833c31 (stale) Mirror 3: 0xf8833c31 (stale) Mirror 5: 0xf8833c31 (stale) CRC-32 checksum value for chunk [0, 0xe18c): Mirror 1: 0xf8833c31 Mirror 6: 0xf8833c31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe18c: skipped 000586 1781661153.131514 mapread 0x004250 thru 0x00e18b (0x9f3c bytes) 000587 1781661153.143090 MIRROR_RESYNC 5 mirrors 000588 1781661153.392688 trunc from 0x008424 to 0x00e18b (0x5d68 bytes) 000589 1781661153.417841 trunc from 0x008ccf to 0x00e18b (0x54bd bytes) 000590 1781661153.420956 mapwrite 0x017d0e thru 0x022a0f (0xad02 bytes) 000591 1781661153.457567 write 0x023eed thru 0x02abf8 (0x6d0c bytes) 000592 1781661153.459022 mapwrite 0x025dde thru 0x02626b (0x48e bytes) 000593 1781661153.467040 mapwrite 0x025ac3 thru 0x035751 (0xfc8f bytes) 000594 1781661153.491274 trunc from 0x035752 to 0x02ac14 (0xab3d bytes) 000596 1781661153.498540 punch from 0x007596 to 0x010c9d (0x9708 bytes) 000597 1781661153.501869 write 0x027292 thru 0x028d92 (0x1b01 bytes) 000598 1781661153.502833 mapread 0x01043a thru 0x010b98 (0x75f bytes) 000599 1781661153.507274 fallocate 0x000656 thru 0x0072ba (0x6c65 bytes) 000600 1781661153.510034 fallocate 0x0163a4 thru 0x01bd7c (0x59d9 bytes) 000601 1781661153.512643 read 0x014c80 thru 0x017be0 (0x2f61 bytes) 000602 1781661153.513343 trunc from 0x02ac15 to 0x03dee5 (0x132d1 bytes) 000603 1781661153.519407 read 0x026251 thru 0x0336f2 (0xd4a2 bytes) 000605 1781661153.525304 read 0x0037f4 thru 0x0049f6 (0x1203 bytes) 000606 1781661153.525791 write 0x0068f1 thru 0x014190 (0xd8a0 bytes) 000607 1781661153.527113 trunc from 0x03dee6 to 0x01ae28 (0x230bd bytes) 000608 1781661153.536421 write 0x021dc4 thru 0x02fd9a (0xdfd7 bytes) 000609 1781661153.538168 trunc from 0x01731f to 0x01816e (0xe50 bytes) 000610 1781661153.541268 write 0x023290 thru 0x02c7a9 (0x951a bytes) 000611 1781661153.542300 write 0x00f821 thru 0x0116de (0x1ebe bytes) 000612 1781661153.543217 mapwrite 0x02ab4e thru 0x037f9b (0xd44e bytes) 000613 1781661153.563282 read 0x005613 thru 0x0124a1 (0xce8f bytes) 000614 1781661153.563926 mapwrite 0x028af8 thru 0x028d59 (0x262 bytes) 000615 1781661153.569205 mapread 0x026bac thru 0x027080 (0x4d5 bytes) 000616 1781661153.571721 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37f9c): Mirror 3: 0x2142e86b (stale) Mirror 5: 0x2142e86b (stale) Mirror 6: 0x2142e86b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f9c): Mirror 3: 0x2142e86b (stale) Mirror 5: 0x2142e86b (stale) Mirror 6: 0x2142e86b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f9c: skipped 000617 1781661153.693913 trunc from 0x037f9c to 0x01d750 (0x1a84b bytes) 000618 1781661153.702916 punch from 0x00b710 to 0x013be7 (0x84d8 bytes) 000619 1781661153.705631 trunc from 0x01d751 to 0x03913c (0x1b9ec bytes) 000620 1781661153.713161 fallocate 0x03a2be thru 0x03ffff (0x5d42 bytes) 000621 1781661153.716218 read 0x0149a6 thru 0x023684 (0xecdf bytes) 000622 1781661153.723535 trunc from 0x023434 to 0x02ec9f (0xb86c bytes) 000624 1781661153.729323 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x353e8aac (stale) Mirror 6: 0x353e8aac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x353e8aac (stale) Mirror 6: 0x353e8aac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000625 1781661153.833953 punch from 0x01049e to 0x018c5f (0x87c2 bytes) 000626 1781661153.836437 mapwrite 0x0245cd thru 0x02612d (0x1b61 bytes) 000627 1781661153.853506 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x353e8aac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x353e8aac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000628 1781661153.961679 trunc from 0x040000 to 0x020f8f (0x1f070 bytes) 000629 1781661153.968897 write 0x01cfe8 thru 0x0240e1 (0x70fa bytes) 000630 1781661153.972379 punch from 0x018771 to 0x01aae7 (0x2377 bytes) 000631 1781661153.975298 punch from 0x019946 to 0x0240e1 (0xa79c bytes) 000632 1781661153.989282 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x240e2): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x240e2): Mirror 5: 0x1e29765a (stale) CRC-32 checksum value for chunk [0, 0x240e2): Mirror 1: 0x82ff9a33 Mirror 6: 0x82ff9a33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x240e2: skipped 000633 1781661154.276463 fallocate 0x012f11 thru 0x016d25 (0x3e15 bytes) 000634 1781661154.293162 MIRROR_RESYNC 3 mirrors 000635 1781661154.567709 trunc from 0x0240e2 to 0x024c4e (0xb6d bytes) 000636 1781661154.589758 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24c4f): Mirror 6: 0xf6d90073 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24c4f): Mirror 6: 0xf6d90073 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24c4f: skipped 000637 1781661154.693964 mapwrite 0x03ee3f thru 0x03ffff (0x11c1 bytes) 000638 1781661154.710429 fallocate 0x026285 thru 0x02a279 (0x3ff5 bytes) 000639 1781661154.712687 write 0x02c8f2 thru 0x032594 (0x5ca3 bytes) 000640 1781661154.719422 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000641 1781661154.771176 write 0x023bb6 thru 0x028456 (0x48a1 bytes) 000642 1781661154.778840 mapwrite 0x002f2b thru 0x009cab (0x6d81 bytes) 000644 1781661154.793906 punch from 0x010256 to 0x014bac (0x4957 bytes) 000645 1781661154.795916 write 0x023026 thru 0x02ebb9 (0xbb94 bytes) 000646 1781661154.798093 mapread 0x005bab thru 0x00b263 (0x56b9 bytes) 000647 1781661154.798874 mapwrite 0x01ba81 thru 0x02b21b (0xf79b bytes) 000648 1781661154.810849 mapread 0x0274b9 thru 0x02b4de (0x4026 bytes) 000650 1781661154.812170 write 0x016ef7 thru 0x018545 (0x164f bytes) 000652 1781661154.813496 fallocate 0x02d1bc thru 0x03637e (0x91c3 bytes) 000653 1781661154.816634 fallocate 0x034aa7 thru 0x037967 (0x2ec1 bytes) 000655 1781661154.819226 mapread 0x026ece thru 0x036b2b (0xfc5e bytes) 000656 1781661154.823387 mapwrite 0x0210a2 thru 0x02b561 (0xa4c0 bytes) 000657 1781661154.832861 trunc from 0x040000 to 0x019502 (0x26afd bytes) 000659 1781661154.840733 trunc from 0x0017e9 to 0x011694 (0xfeac bytes) 000660 1781661154.844176 trunc from 0x019503 to 0x02f9ba (0x164b8 bytes) 000661 1781661154.850862 punch from 0x004118 to 0x00ee9e (0xad87 bytes) 000663 1781661154.853518 mapread 0x000ef7 thru 0x004d9e (0x3ea8 bytes) 000664 1781661154.857980 mapwrite 0x00e2ac thru 0x0178bf (0x9614 bytes) 000665 1781661154.870312 write 0x031e1f thru 0x034f9e (0x3180 bytes) 000666 1781661154.871478 mapread 0x006c6e thru 0x00e8ab (0x7c3e bytes) 000667 1781661154.872807 fallocate 0x01815d thru 0x024ec4 (0xcd68 bytes) 000668 1781661154.876134 read 0x0326d4 thru 0x034f9e (0x28cb bytes) 000671 1781661154.877504 trunc from 0x034f9f to 0x024cc8 (0x102d6 bytes) 000672 1781661154.885441 read 0x008363 thru 0x016976 (0xe614 bytes) 000673 1781661154.886143 mapread 0x020cf0 thru 0x022ffb (0x230c bytes) 000674 1781661154.896214 MIRROR_EXTEND to 2 mirrors 000675 1781661155.101674 mapread 0x00c95b thru 0x0184ba (0xbb60 bytes) 000676 1781661155.110980 punch from 0x007f43 to 0x00d1c6 (0x5284 bytes) 000677 1781661155.122754 trunc from 0x024cc9 to 0x00446d (0x2085b bytes) 000678 1781661155.129794 write 0x038bdf thru 0x03ffff (0x7421 bytes) 000679 1781661155.130943 punch from 0x004894 to 0x013c26 (0xf393 bytes) 000680 1781661155.132939 trunc from 0x022431 to 0x029a94 (0x7664 bytes) 000681 1781661155.134953 trunc from 0x040000 to 0x02c0c3 (0x13f3c bytes) 000682 1781661155.140497 fallocate 0x0135d8 thru 0x01e38a (0xadb3 bytes) 000683 1781661155.142590 trunc from 0x02c0c4 to 0x00f606 (0x1cabd bytes) 000684 1781661155.150146 mapread 0x00c0d0 thru 0x00f606 (0x3537 bytes) 000685 1781661155.154170 trunc from 0x00745b to 0x00f606 (0x81ac bytes) 000686 1781661155.157410 mapwrite 0x0343f0 thru 0x037a30 (0x3641 bytes) 000687 1781661155.171556 fallocate 0x03f3e9 thru 0x03ffff (0xc17 bytes) 000688 1781661155.173932 fallocate 0x0099a3 thru 0x00c432 (0x2a90 bytes) 000689 1781661155.176135 fallocate 0x00d07e thru 0x017cde (0xac61 bytes) 000690 1781661155.178734 mapwrite 0x016b64 thru 0x01f664 (0x8b01 bytes) 000691 1781661155.192704 trunc from 0x0062ef to 0x006bb5 (0x8c7 bytes) 000692 1781661155.195284 mapwrite 0x02e867 thru 0x03ccc3 (0xe45d bytes) 000693 1781661155.213359 read 0x028145 thru 0x02ee63 (0x6d1f bytes) 000694 1781661155.217769 fallocate 0x010607 thru 0x012aa5 (0x249f bytes) 000695 1781661155.220481 trunc from 0x03ccc4 to 0x00df03 (0x2edc0 bytes) 000697 1781661155.227999 mapread 0x00ca99 thru 0x00df03 (0x146b bytes) 000699 1781661155.233718 trunc from 0x005697 to 0x00df03 (0x886d bytes) 000700 1781661155.236561 punch from 0x00a0c5 to 0x00df03 (0x3e3f bytes) 000701 1781661155.239641 punch from 0x001847 to 0x00635e (0x4b18 bytes) 000702 1781661155.242687 read 0x0019c5 thru 0x00c110 (0xa74c bytes) 000703 1781661155.246953 punch from 0x00a1e8 to 0x00b481 (0x129a bytes) 000704 1781661155.249976 read 0x00b93d thru 0x00df03 (0x25c7 bytes) 000705 1781661155.253269 trunc from 0x00786f to 0x00df03 (0x6695 bytes) 000706 1781661155.255897 mapwrite 0x028ac5 thru 0x030025 (0x7561 bytes) 000707 1781661155.276594 MIRROR_RESYNC 2 mirrors 000708 1781661155.453331 mapread 0x01c0fa thru 0x023fc7 (0x7ece bytes) 000709 1781661155.459021 punch from 0x02ad5a to 0x030025 (0x52cc bytes) 000710 1781661155.469587 trunc from 0x030026 to 0x03ac8e (0xac69 bytes) 000711 1781661155.480304 fallocate 0x013120 thru 0x01d60b (0xa4ec bytes) 000712 1781661155.482935 trunc from 0x038987 to 0x039520 (0xb9a bytes) 000713 1781661155.486012 mapread 0x010029 thru 0x0183e9 (0x83c1 bytes) 000715 1781661155.490750 mapwrite 0x03327b thru 0x03579a (0x2520 bytes) 000716 1781661155.499002 mapwrite 0x00344d thru 0x006c4f (0x3803 bytes) 000717 1781661155.507737 fallocate 0x035186 thru 0x039f47 (0x4dc2 bytes) 000718 1781661155.510481 read 0x002a16 thru 0x005e5e (0x3449 bytes) 000719 1781661155.510859 trunc from 0x03ac8f to 0x022c26 (0x18068 bytes) 000720 1781661155.516394 read 0x021263 thru 0x022c26 (0x19c4 bytes) 000721 1781661155.519675 fallocate 0x038387 thru 0x03ffff (0x7c79 bytes) 000722 1781661155.521988 read 0x0071d1 thru 0x00fa45 (0x8875 bytes) 000723 1781661155.522779 trunc from 0x015c65 to 0x022c26 (0xcfc2 bytes) 000724 1781661155.526138 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000725 1781661155.566708 trunc from 0x0077d6 to 0x00808d (0x8b8 bytes) 000727 1781661155.569185 read 0x0196a1 thru 0x019d23 (0x683 bytes) 000728 1781661155.571398 mapread 0x013108 thru 0x022ba2 (0xfa9b bytes) 000729 1781661155.580494 punch from 0x022bdd to 0x022c26 (0x4a bytes) 000730 1781661155.582335 write 0x01de0a thru 0x027736 (0x992d bytes) 000731 1781661155.585167 trunc from 0x000dcb to 0x0023d6 (0x160c bytes) 000732 1781661155.587230 write 0x035b0c thru 0x03a380 (0x4875 bytes) 000733 1781661155.588332 trunc from 0x01c0b1 to 0x020c29 (0x4b79 bytes) 000734 1781661155.593013 trunc from 0x0270a5 to 0x02d816 (0x6772 bytes) 000735 1781661155.595137 mapwrite 0x024f1b thru 0x034321 (0xf407 bytes) 000736 1781661155.609926 read 0x03355b thru 0x03a380 (0x6e26 bytes) 000737 1781661155.610668 trunc from 0x03a381 to 0x000d26 (0x3965a bytes) 000738 1781661155.616559 write 0x02f7ab thru 0x0312e7 (0x1b3d bytes) 000739 1781661155.617711 read 0x02fffb thru 0x0312e7 (0x12ed bytes) 000740 1781661155.618182 punch from 0x0265a6 to 0x029bdb (0x3636 bytes) 000741 1781661155.620340 read 0x01ac75 thru 0x01b6dc (0xa68 bytes) 000742 1781661155.624242 trunc from 0x01f0a3 to 0x01f5ed (0x54b bytes) 000743 1781661155.626333 mapwrite 0x01ecf4 thru 0x02816d (0x947a bytes) 000744 1781661155.636106 fallocate 0x00f106 thru 0x0122e7 (0x31e2 bytes) 000745 1781661155.638193 punch from 0x025c8f to 0x02e187 (0x84f9 bytes) 000746 1781661155.640238 read 0x020d1f thru 0x026d00 (0x5fe2 bytes) 000748 1781661155.643537 punch from 0x01ccc0 to 0x029a15 (0xcd56 bytes) 000749 1781661155.645635 read 0x026344 thru 0x029f11 (0x3bce bytes) 000750 1781661155.649144 trunc from 0x0312e8 to 0x03172f (0x448 bytes) 000752 1781661155.655516 trunc from 0x031730 to 0x0153f6 (0x1c339 bytes) 000753 1781661155.660751 mapwrite 0x00725a thru 0x013187 (0xbf2e bytes) 000754 1781661155.671211 MIRROR_EXTEND to 2 mirrors 000755 1781661155.858670 MIRROR_RESYNC 2 mirrors 000756 1781661155.977125 read 0x006737 thru 0x00a58e (0x3e58 bytes) 000758 1781661155.980206 mapread 0x0044b4 thru 0x00a89f (0x63ec bytes) 000759 1781661155.983729 read 0x00da1e thru 0x0153f6 (0x79d9 bytes) 000760 1781661155.986519 mapwrite 0x033fbe thru 0x03ffff (0xc042 bytes) 000762 1781661156.017233 read 0x02d74e thru 0x03260a (0x4ebd bytes) 000763 1781661156.017710 mapwrite 0x004f0d thru 0x008a13 (0x3b07 bytes) 000764 1781661156.027588 trunc from 0x02cbdb to 0x02cc29 (0x4f bytes) 000765 1781661156.029800 trunc from 0x040000 to 0x011f50 (0x2e0af bytes) 000766 1781661156.037020 mapwrite 0x037347 thru 0x03a3a4 (0x305e bytes) 000767 1781661156.050952 mapwrite 0x02b7cc thru 0x02f012 (0x3847 bytes) 000768 1781661156.063543 punch from 0x00ae32 to 0x01257c (0x774b bytes) 000769 1781661156.065657 write 0x007c8a thru 0x00f9cc (0x7d43 bytes) 000770 1781661156.068268 mapwrite 0x03a369 thru 0x03ffff (0x5c97 bytes) 000772 1781661156.084167 mapwrite 0x0006ba thru 0x005bcc (0x5513 bytes) 000773 1781661156.090758 fallocate 0x012bb3 thru 0x01fda1 (0xd1ef bytes) 000774 1781661156.092751 trunc from 0x040000 to 0x01220d (0x2ddf2 bytes) 000775 1781661156.097142 trunc from 0x0107c2 to 0x01220d (0x1a4c bytes) 000776 1781661156.098592 mapwrite 0x02f90f thru 0x03ce27 (0xd519 bytes) 000777 1781661156.129992 mapwrite 0x0236d9 thru 0x02a999 (0x72c1 bytes) 000778 1781661156.146377 trunc from 0x03ce28 to 0x02ee06 (0xe021 bytes) 000780 1781661156.151484 fallocate 0x0309e0 thru 0x036c7b (0x629c bytes) 000781 1781661156.153597 read 0x00bb24 thru 0x00f5e3 (0x3ac0 bytes) 000782 1781661156.155897 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000783 1781661156.199597 write 0x02f551 thru 0x02fec1 (0x971 bytes) 000784 1781661156.203225 trunc from 0x01c55e to 0x024b83 (0x8626 bytes) 000785 1781661156.205195 read 0x023bf7 thru 0x027951 (0x3d5b bytes) 000786 1781661156.207904 write 0x018468 thru 0x01eba9 (0x6742 bytes) 000787 1781661156.211995 mapread 0x0205e9 thru 0x02ec1e (0xe636 bytes) 000788 1781661156.220635 fallocate 0x01a899 thru 0x01b75d (0xec5 bytes) 000789 1781661156.222677 trunc from 0x036c7c to 0x01cc61 (0x1a01a bytes) 000790 1781661156.229525 read 0x012997 thru 0x01866c (0x5cd6 bytes) 000792 1781661156.234352 read 0x00e044 thru 0x00e39d (0x35a bytes) 000793 1781661156.234838 read 0x00527b thru 0x0148ac (0xf632 bytes) 000794 1781661156.235554 write 0x03699d thru 0x03ffff (0x9663 bytes) 000795 1781661156.236735 read 0x02d8c3 thru 0x034d54 (0x7492 bytes) 000796 1781661156.239982 read 0x02b054 thru 0x036cb5 (0xbc62 bytes) 000797 1781661156.240645 fallocate 0x00e22b thru 0x013382 (0x5158 bytes) 000799 1781661156.243462 read 0x004556 thru 0x01394d (0xf3f8 bytes) 000800 1781661156.244148 fallocate 0x02ea2e thru 0x037fb0 (0x9583 bytes) 000801 1781661156.246848 mapwrite 0x03a6b7 thru 0x03f262 (0x4bac bytes) 000802 1781661156.255878 fallocate 0x01f15c thru 0x026b5c (0x7a01 bytes) 000803 1781661156.258617 trunc from 0x040000 to 0x03e2ae (0x1d51 bytes) 000804 1781661156.263698 fallocate 0x0143c9 thru 0x01914f (0x4d87 bytes) 000805 1781661156.265815 read 0x013825 thru 0x0211a5 (0xd981 bytes) 000806 1781661156.266382 mapread 0x03a9a0 thru 0x03e2ae (0x390f bytes) 000807 1781661156.267032 trunc from 0x03e2af to 0x031b9f (0xc70f bytes) 000809 1781661156.272085 write 0x02f1ac thru 0x03aaca (0xb91f bytes) 000810 1781661156.273129 trunc from 0x00884b to 0x00cf89 (0x473f bytes) 000811 1781661156.275208 fallocate 0x02ffaf thru 0x03e877 (0xe8c9 bytes) 000813 1781661156.277809 punch from 0x031c32 to 0x03bd0f (0xa0de bytes) 000814 1781661156.283360 mapread 0x014d40 thru 0x023b5a (0xee1b bytes) 000815 1781661156.284507 mapread 0x0155c2 thru 0x01d2fe (0x7d3d bytes) 000816 1781661156.285269 punch from 0x004eb2 to 0x009836 (0x4985 bytes) 000817 1781661156.287456 write 0x030e55 thru 0x0341b9 (0x3365 bytes) 000818 1781661156.290773 mapread 0x0248f3 thru 0x02927f (0x498d bytes) 000819 1781661156.291791 read 0x0267ac thru 0x027ae6 (0x133b bytes) 000820 1781661156.292358 trunc from 0x001d1a to 0x00675b (0x4a42 bytes) 000821 1781661156.295081 trunc from 0x03e878 to 0x0393cb (0x54ac bytes) 000822 1781661156.300681 trunc from 0x023113 to 0x029170 (0x605e bytes) 000823 1781661156.304873 MIRROR_EXTEND to 2 mirrors 000824 1781661156.513085 trunc from 0x0393cc to 0x011801 (0x27bca bytes) 000825 1781661156.530772 fallocate 0x020e01 thru 0x02767d (0x687d bytes) 000826 1781661156.533169 trunc from 0x00371d to 0x003c91 (0x575 bytes) 000827 1781661156.534960 write 0x01ec37 thru 0x022ee3 (0x42ad bytes) 000828 1781661156.536178 mapread 0x00140e thru 0x00e6d5 (0xd2c8 bytes) 000829 1781661156.543971 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x22ee4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22ee4): Mirror 2: 0xeb9ea372 (stale) CRC-32 checksum value for chunk [0, 0x22ee4): Mirror 1: 0x85dda3bc Mirror 3: 0x85dda3bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22ee4: skipped 000830 1781661156.769243 trunc from 0x01417f to 0x0144b0 (0x332 bytes) 000834 1781661156.780527 trunc from 0x022ee4 to 0x02770b (0x4828 bytes) 000836 1781661156.791331 punch from 0x02454f to 0x024e16 (0x8c8 bytes) 000837 1781661156.792821 fallocate 0x01a99c thru 0x01eb00 (0x4165 bytes) 000838 1781661156.794748 trunc from 0x004245 to 0x00ad1d (0x6ad9 bytes) 000839 1781661156.796316 mapwrite 0x03dd35 thru 0x03ffff (0x22cb bytes) 000840 1781661156.810983 trunc from 0x040000 to 0x003286 (0x3cd79 bytes) 000841 1781661156.815943 mapwrite 0x012e99 thru 0x01e443 (0xb5ab bytes) 000842 1781661156.831361 mapwrite 0x03afe7 thru 0x03ffff (0x5019 bytes) 000844 1781661156.844647 mapwrite 0x00194c thru 0x00e467 (0xcb1c bytes) 000845 1781661156.854179 read 0x016d4e thru 0x023ef6 (0xd1a9 bytes) 000846 1781661156.857124 mapwrite 0x00f7d2 thru 0x0142f7 (0x4b26 bytes) 000847 1781661156.863793 punch from 0x035584 to 0x03ffff (0xaa7c bytes) 000848 1781661156.865608 mapread 0x007323 thru 0x0137a3 (0xc481 bytes) 000849 1781661156.866428 mapwrite 0x00b7fc thru 0x019470 (0xdc75 bytes) 000851 1781661156.874620 trunc from 0x021619 to 0x0238f0 (0x22d8 bytes) 000852 1781661156.876440 fallocate 0x02c755 thru 0x032390 (0x5c3c bytes) 000854 1781661156.878857 trunc from 0x040000 to 0x03cfe2 (0x301d bytes) 000855 1781661156.883561 punch from 0x0154f2 to 0x01ce10 (0x791f bytes) 000856 1781661156.885591 read 0x01cfef thru 0x02a2e4 (0xd2f6 bytes) 000857 1781661156.889170 write 0x0193ea thru 0x028a34 (0xf64b bytes) 000858 1781661156.890647 mapread 0x01fa70 thru 0x0257e6 (0x5d77 bytes) 000859 1781661156.893364 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cfe3): Mirror 2: 0xa2e74512 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfe3): Mirror 2: 0xa2e74512 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfe3: skipped 000860 1781661156.978119 mapwrite 0x018b3c thru 0x01d63e (0x4b03 bytes) 000861 1781661156.988471 mapread 0x0084e0 thru 0x0134bd (0xafde bytes) 000862 1781661156.993958 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000863 1781661157.030577 fallocate 0x015afa thru 0x01cf21 (0x7428 bytes) 000864 1781661157.032544 mapread 0x032687 thru 0x0327cc (0x146 bytes) 000865 1781661157.034862 trunc from 0x02445e to 0x0282a9 (0x3e4c bytes) 000866 1781661157.036934 write 0x02c3c6 thru 0x038b96 (0xc7d1 bytes) 000867 1781661157.041925 trunc from 0x03cfe3 to 0x016f45 (0x2609d bytes) 000868 1781661157.047373 trunc from 0x016f46 to 0x03b56c (0x24627 bytes) 000869 1781661157.052016 punch from 0x0281fa to 0x028fa8 (0xdaf bytes) 000870 1781661157.053885 write 0x02db13 thru 0x02faaf (0x1f9d bytes) 000871 1781661157.057406 mapread 0x00a0fb thru 0x00b7ba (0x16c0 bytes) 000872 1781661157.061868 write 0x01a0d4 thru 0x01d66d (0x359a bytes) 000873 1781661157.064855 mapwrite 0x01d931 thru 0x01fbf2 (0x22c2 bytes) 000874 1781661157.070649 trunc from 0x015389 to 0x023cb5 (0xe92d bytes) 000875 1781661157.072668 punch from 0x02b193 to 0x03141c (0x628a bytes) 000876 1781661157.074495 trunc from 0x03b56d to 0x00efb4 (0x2c5b8 bytes) 000877 1781661157.078714 fallocate 0x02c4ab thru 0x03b7af (0xf305 bytes) 000878 1781661157.080647 read 0x02801e thru 0x028ae0 (0xac3 bytes) 000879 1781661157.082564 punch from 0x02afa2 to 0x02ef64 (0x3fc3 bytes) 000881 1781661157.084583 trunc from 0x02d310 to 0x035519 (0x820a bytes) 000882 1781661157.086293 trunc from 0x0398aa to 0x03b7af (0x1f06 bytes) 000883 1781661157.087930 trunc from 0x03b7b0 to 0x00505f (0x36750 bytes) 000884 1781661157.092820 write 0x011a93 thru 0x019c28 (0x8196 bytes) 000885 1781661157.093958 trunc from 0x019c29 to 0x00242f (0x177f9 bytes) 000887 1781661157.099130 mapwrite 0x01cdd6 thru 0x023cb7 (0x6ee2 bytes) 000888 1781661157.111723 fallocate 0x00a0db thru 0x00e687 (0x45ad bytes) 000889 1781661157.113516 punch from 0x01dc46 to 0x023cb7 (0x6072 bytes) 000890 1781661157.115007 mapread 0x00b145 thru 0x0143a5 (0x9261 bytes) 000891 1781661157.119190 trunc from 0x01582d to 0x01f91f (0xa0f3 bytes) 000892 1781661157.120990 trunc from 0x023cb8 to 0x010e8b (0x12e2c bytes) 000894 1781661157.125618 mapwrite 0x00b80f thru 0x010a4c (0x523e bytes) 000895 1781661157.133454 MIRROR_EXTEND to 2 mirrors 000896 1781661157.300029 read 0x00ac82 thru 0x010e8b (0x620a bytes) 000897 1781661157.302682 trunc from 0x010e8c to 0x008b25 (0x8366 bytes) 000899 1781661157.320613 mapwrite 0x00f86d thru 0x016bbe (0x7352 bytes) 000900 1781661157.341352 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000902 1781661157.386918 fallocate 0x011ace thru 0x01de21 (0xc354 bytes) 000903 1781661157.389193 write 0x02d281 thru 0x037933 (0xa6b3 bytes) 000904 1781661157.391885 write 0x0308da thru 0x0321c9 (0x18f0 bytes) 000905 1781661157.392579 mapwrite 0x03682f thru 0x03ffff (0x97d1 bytes) 000906 1781661157.410964 fallocate 0x03fb59 thru 0x03ffff (0x4a7 bytes) 000910 1781661157.415251 write 0x032031 thru 0x03ffff (0xdfcf bytes) 000911 1781661157.416478 trunc from 0x040000 to 0x03eb85 (0x147a bytes) 000912 1781661157.422481 trunc from 0x01df0f to 0x0201a7 (0x2299 bytes) 000913 1781661157.424402 write 0x0248a4 thru 0x0334ec (0xec49 bytes) 000914 1781661157.427559 read 0x023df1 thru 0x031f1e (0xe12e bytes) 000915 1781661157.430177 read 0x009095 thru 0x013dc8 (0xad34 bytes) 000916 1781661157.434264 trunc from 0x001f3c to 0x007399 (0x545e bytes) 000917 1781661157.437557 read 0x0115da thru 0x017368 (0x5d8f bytes) 000918 1781661157.438253 mapread 0x0116bc thru 0x01fdfe (0xe743 bytes) 000919 1781661157.439501 mapread 0x0123b3 thru 0x018c5b (0x68a9 bytes) 000921 1781661157.441604 fallocate 0x0170e0 thru 0x01882b (0x174c bytes) 000922 1781661157.444534 read 0x03c0bf thru 0x03eb85 (0x2ac7 bytes) 000924 1781661157.446201 fallocate 0x02c1f2 thru 0x02d4ea (0x12f9 bytes) 000925 1781661157.448861 fallocate 0x015645 thru 0x01eb60 (0x951c bytes) 000926 1781661157.451110 write 0x023614 thru 0x02b177 (0x7b64 bytes) 000927 1781661157.452315 trunc from 0x00d5e2 to 0x0169f6 (0x9415 bytes) 000928 1781661157.454733 trunc from 0x023dbe to 0x02bf0d (0x8150 bytes) 000929 1781661157.460164 read 0x0168ef thru 0x018d54 (0x2466 bytes) 000930 1781661157.463693 trunc from 0x03eb86 to 0x02e77f (0x10406 bytes) 000931 1781661157.471006 MIRROR_EXTEND to 2 mirrors 000932 1781661157.685141 trunc from 0x02d2b5 to 0x02e1f6 (0xf42 bytes) 000934 1781661157.701042 fallocate 0x006488 thru 0x014322 (0xde9b bytes) 000935 1781661157.703650 mapwrite 0x0067b5 thru 0x014989 (0xe1d5 bytes) 000936 1781661157.724485 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2e780): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e780): Mirror 2: 0x4b4c9f05 (stale) CRC-32 checksum value for chunk [0, 0x2e780): Mirror 1: 0xec74ed8b Mirror 3: 0xec74ed8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e780: skipped 000937 1781661157.986751 punch from 0x01713c to 0x0264c3 (0xf388 bytes) 000938 1781661157.998022 mapread 0x01cbc4 thru 0x029e62 (0xd29f bytes) 000939 1781661158.006623 fallocate 0x03e31f thru 0x03fcae (0x1990 bytes) 000940 1781661158.008701 trunc from 0x02e780 to 0x03781c (0x909d bytes) 000941 1781661158.020188 mapread 0x02c706 thru 0x0325c4 (0x5ebf bytes) 000942 1781661158.023566 mapwrite 0x03b7ca thru 0x03fee3 (0x471a bytes) 000943 1781661158.034693 trunc from 0x03fee4 to 0x0123d2 (0x2db11 bytes) 000944 1781661158.039246 trunc from 0x005228 to 0x00d723 (0x84fc bytes) 000945 1781661158.040839 punch from 0x003327 to 0x00346f (0x149 bytes) 000946 1781661158.042264 trunc from 0x00a80a to 0x0123d2 (0x7bc9 bytes) 000947 1781661158.043801 mapread 0x00f79c thru 0x0123d2 (0x2c37 bytes) 000948 1781661158.046888 punch from 0x00dc0e to 0x00feec (0x22df bytes) 000949 1781661158.048822 read 0x003ce8 thru 0x00589f (0x1bb8 bytes) 000951 1781661158.051426 punch from 0x00660a to 0x008d24 (0x271b bytes) 000952 1781661158.053186 fallocate 0x03f130 thru 0x03ffff (0xed0 bytes) 000953 1781661158.054834 trunc from 0x0123d3 to 0x033a7d (0x216ab bytes) 000954 1781661158.059459 trunc from 0x02ec18 to 0x033a7d (0x4e66 bytes) 000956 1781661158.061657 write 0x020276 thru 0x02a74d (0xa4d8 bytes) 000957 1781661158.065233 trunc from 0x033a7e to 0x0364ed (0x2a70 bytes) 000958 1781661158.069865 mapwrite 0x0029ed thru 0x0031bb (0x7cf bytes) 000959 1781661158.077941 trunc from 0x0364ee to 0x007500 (0x2efed bytes) 000960 1781661158.082773 mapwrite 0x00ca54 thru 0x010545 (0x3af2 bytes) 000961 1781661158.097182 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x10546): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10546): Mirror 2: 0x8aed7648 (stale) Mirror 3: 0xad236da8 (stale) CRC-32 checksum value for chunk [0, 0x10546): Mirror 1: 0x9e7e60d1 Mirror 4: 0x9e7e60d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10546: skipped 000962 1781661158.301362 MIRROR_RESYNC 4 mirrors 000963 1781661158.493335 mapwrite 0x02be07 thru 0x02f5a1 (0x379b bytes) 000964 1781661158.526017 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2f5a2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5a2): Mirror 2: 0x7355269c (stale) Mirror 3: 0x7355269c (stale) Mirror 4: 0x7355269c (stale) CRC-32 checksum value for chunk [0, 0x2f5a2): Mirror 1: 0xce623113 Mirror 5: 0xce623113 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5a2: skipped 000965 1781661158.778979 write 0x012c31 thru 0x01728a (0x465a bytes) 000966 1781661158.794629 write 0x021b5c thru 0x028e03 (0x72a8 bytes) 000967 1781661158.799314 trunc from 0x02f5a2 to 0x00bc0e (0x23993 bytes) 000968 1781661158.812154 fallocate 0x034408 thru 0x03770c (0x3305 bytes) 000969 1781661158.815278 trunc from 0x00bc0f to 0x012508 (0x68fa bytes) 000970 1781661158.822259 mapread 0x0041aa thru 0x0103ff (0xc256 bytes) 000971 1781661158.832656 mapread 0x00b202 thru 0x00cf71 (0x1d70 bytes) 000972 1781661158.833659 trunc from 0x012509 to 0x02b1e1 (0x18cd9 bytes) 000975 1781661158.844271 read 0x01fcdf thru 0x021715 (0x1a37 bytes) 000976 1781661158.847831 mapread 0x006eed thru 0x006f81 (0x95 bytes) 000977 1781661158.848887 mapwrite 0x023740 thru 0x02e40d (0xacce bytes) 000978 1781661158.875750 write 0x015c69 thru 0x024731 (0xeac9 bytes) 000980 1781661158.879442 punch from 0x02b140 to 0x02e40d (0x32ce bytes) 000982 1781661158.882635 trunc from 0x01365f to 0x01d0b5 (0x9a57 bytes) 000983 1781661158.888659 mapwrite 0x0051d9 thru 0x00db94 (0x89bc bytes) 000984 1781661158.897489 read 0x0055ab thru 0x00bd17 (0x676d bytes) 000985 1781661158.898199 mapwrite 0x031167 thru 0x03190c (0x7a6 bytes) 000987 1781661158.917243 mapwrite 0x03aca8 thru 0x03ffff (0x5358 bytes) 000988 1781661158.936599 read 0x035b77 thru 0x03ffff (0xa489 bytes) 000989 1781661158.937328 trunc from 0x040000 to 0x005eae (0x3a151 bytes) 000990 1781661158.946605 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5eaf): Mirror 2: 0x4365ebf3 (stale) Mirror 3: 0x4365ebf3 (stale) Mirror 4: 0x4365ebf3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5eaf): Mirror 2: 0x4365ebf3 (stale) Mirror 3: 0x4365ebf3 (stale) Mirror 4: 0x4365ebf3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5eaf: skipped 000991 1781661159.048453 write 0x02aaaf thru 0x02b6b4 (0xc06 bytes) 000992 1781661159.050762 write 0x02050d thru 0x026949 (0x643d bytes) 000993 1781661159.054714 punch from 0x00a9a9 to 0x012904 (0x7f5c bytes) 000994 1781661159.056714 read 0x002471 thru 0x004b4b (0x26db bytes) 000995 1781661159.059018 punch from 0x01ae57 to 0x01bd64 (0xf0e bytes) 000996 1781661159.060677 fallocate 0x033036 thru 0x03deb4 (0xae7f bytes) 000997 1781661159.062975 trunc from 0x003be5 to 0x005f58 (0x2374 bytes) 000998 1781661159.065408 mapread 0x016d0d thru 0x025f1a (0xf20e bytes) 000999 1781661159.071576 mapread 0x01399b thru 0x01fa1f (0xc085 bytes) 001000 1781661159.072457 punch from 0x012e3f to 0x0225b7 (0xf779 bytes) All operations completed A-OK!