== sanity-flr test 70a: flr mode fsx test ================ 15:06:50 (1789067210) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 7212 000001 1789067212.566599 write 0x01ed1b thru 0x025a89 (0x6d6f bytes) 000002 1789067212.575681 mapwrite 0x026bef thru 0x03127d (0xa68f bytes) fallocating to largest ever: 0x40000 000003 1789067212.634277 fallocate 0x03a549 thru 0x03ffff (0x5ab7 bytes) 000004 1789067212.639276 write 0x03ee51 thru 0x03ffff (0x11af bytes) 000005 1789067212.644182 read 0x031ba0 thru 0x03aac3 (0x8f24 bytes) 000007 1789067212.652941 mapread 0x02dd0a thru 0x03c65a (0xe951 bytes) 000008 1789067212.658494 mapread 0x023801 thru 0x02a5a1 (0x6da1 bytes) 000009 1789067212.663032 MIRROR_EXTEND to 2 mirrors 000010 1789067213.401933 mapread 0x01b835 thru 0x0292f3 (0xdabf bytes) 000011 1789067213.440494 mapread 0x00c112 thru 0x016a24 (0xa913 bytes) 000012 1789067213.466756 fallocate 0x0026ed thru 0x012599 (0xfead bytes) 000013 1789067213.493780 mapwrite 0x008e10 thru 0x0102e0 (0x74d1 bytes) 000014 1789067213.519235 punch from 0x01f479 to 0x024846 (0x53ce bytes) 000015 1789067213.524531 read 0x031750 thru 0x03d9d4 (0xc285 bytes) 000016 1789067213.533021 read 0x0016ab thru 0x00237b (0xcd1 bytes) 000017 1789067213.533620 mapread 0x02989e thru 0x03594e (0xc0b1 bytes) 000018 1789067213.542684 trunc from 0x040000 to 0x023e5b (0x1c1a4 bytes) 000019 1789067213.578523 mapread 0x00076a thru 0x003cf1 (0x3588 bytes) 000020 1789067213.579801 trunc from 0x0030e2 to 0x004597 (0x14b6 bytes) 000021 1789067213.587308 punch from 0x0051d6 to 0x00e9aa (0x97d5 bytes) 000022 1789067213.592604 trunc from 0x017cde to 0x01dabd (0x5de0 bytes) 000023 1789067213.607793 read 0x0221e9 thru 0x023e5b (0x1c73 bytes) 000024 1789067213.620603 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23e5c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23e5c): Mirror 2: 0xc53cc668 (stale) CRC-32 checksum value for chunk [0, 0x23e5c): Mirror 1: 0x11e2bbe8 Mirror 3: 0x11e2bbe8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23e5c: skipped 000025 1789067214.602830 mapread 0x0179ec thru 0x01bd4e (0x4363 bytes) 000026 1789067214.622955 mapread 0x008508 thru 0x0126de (0xa1d7 bytes) 000027 1789067214.638721 MIRROR_RESYNC 3 mirrors 000028 1789067215.271059 punch from 0x022d29 to 0x023e5b (0x1133 bytes) 000029 1789067215.304801 trunc from 0x0020c8 to 0x00b8b4 (0x97ed bytes) 000030 1789067215.313850 fallocate 0x037cb8 thru 0x03ffff (0x8348 bytes) 000032 1789067215.319266 trunc from 0x040000 to 0x01a9c3 (0x2563c bytes) 000034 1789067215.349151 write 0x0143b8 thru 0x01736d (0x2fb6 bytes) 000035 1789067215.377066 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a9c4): Mirror 3: 0x44c1a76c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a9c4): Mirror 3: 0x44c1a76c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a9c4: skipped 000036 1789067215.759123 write 0x00975e thru 0x0138b9 (0xa15c bytes) 000037 1789067215.771693 trunc from 0x01a9c4 to 0x026f62 (0xc59f bytes) 000038 1789067215.788931 punch from 0x026c1f to 0x026f62 (0x344 bytes) 000039 1789067215.793185 write 0x02c977 thru 0x03748b (0xab15 bytes) 000040 1789067215.794997 write 0x03634f thru 0x03ffff (0x9cb1 bytes) 000041 1789067215.797169 trunc from 0x040000 to 0x02aa3c (0x155c3 bytes) 000043 1789067215.818802 mapread 0x02a55f thru 0x02aa3c (0x4de bytes) 000045 1789067215.826684 mapread 0x00e658 thru 0x016c73 (0x861c bytes) 000046 1789067215.838804 write 0x03fb08 thru 0x03ffff (0x4f8 bytes) 000047 1789067215.839943 trunc from 0x01e188 to 0x02cb72 (0xe9eb bytes) 000048 1789067215.843990 trunc from 0x01ae48 to 0x023f75 (0x912e bytes) 000049 1789067215.848724 mapwrite 0x01b966 thru 0x02b3e1 (0xfa7c bytes) 000050 1789067215.892389 fallocate 0x025806 thru 0x029625 (0x3e20 bytes) 000051 1789067215.897052 trunc from 0x040000 to 0x00881c (0x377e3 bytes) 000052 1789067215.910519 mapwrite 0x03df79 thru 0x03ffff (0x2087 bytes) 000054 1789067215.948152 read 0x009805 thru 0x015275 (0xba71 bytes) 000055 1789067215.965145 read 0x02ff5e thru 0x03c764 (0xc807 bytes) 000056 1789067216.017933 punch from 0x017d22 to 0x01cce5 (0x4fc4 bytes) 000057 1789067216.027071 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7eece592 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbe498fbd Mirror 4: 0xbe498fbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000058 1789067216.908150 trunc from 0x040000 to 0x01ed68 (0x21297 bytes) 000059 1789067216.966141 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ed69): Mirror 4: 0x34fe8d65 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ed69): Mirror 4: 0x34fe8d65 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ed69: skipped 000060 1789067217.415570 fallocate 0x0070bd thru 0x014d2c (0xdc70 bytes) 000061 1789067217.421479 trunc from 0x01ed69 to 0x013233 (0xbb35 bytes) 000062 1789067217.451038 mapwrite 0x00d252 thru 0x019d97 (0xcb46 bytes) 000063 1789067217.536842 trunc from 0x0014ca to 0x00e001 (0xcb38 bytes) 000064 1789067217.543132 write 0x01bb72 thru 0x01f4d0 (0x395f bytes) 000065 1789067217.545111 mapread 0x011474 thru 0x019dda (0x8967 bytes) 000066 1789067217.548789 mapread 0x002455 thru 0x010a55 (0xe601 bytes) 000067 1789067217.564501 trunc from 0x005420 to 0x00990c (0x44ed bytes) 000068 1789067217.568685 fallocate 0x021209 thru 0x02c69d (0xb495 bytes) 000069 1789067217.578595 read 0x01bc04 thru 0x01f4d0 (0x38cd bytes) 000070 1789067217.579119 punch from 0x007e13 to 0x009f95 (0x2183 bytes) 000072 1789067217.584773 mapread 0x002033 thru 0x004743 (0x2711 bytes) 000073 1789067217.588105 trunc from 0x01f4d1 to 0x01e4a9 (0x1027 bytes) 000074 1789067217.607091 read 0x013d4e thru 0x01a902 (0x6bb5 bytes) 000075 1789067217.618017 mapwrite 0x0308a6 thru 0x03af59 (0xa6b4 bytes) 000076 1789067217.697296 mapread 0x018451 thru 0x022a16 (0xa5c6 bytes) 000077 1789067217.698248 mapwrite 0x0338a4 thru 0x03498f (0x10ec bytes) 000078 1789067217.710520 fallocate 0x03ddcd thru 0x03fb94 (0x1dc8 bytes) 000079 1789067217.725059 write 0x0367e7 thru 0x03c8df (0x60f9 bytes) 000080 1789067217.731529 punch from 0x01f657 to 0x028260 (0x8c0a bytes) 000082 1789067217.739981 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: 0x49bfc5ad (stale) CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 1: 0xc9b4129d Mirror 5: 0xc9b4129d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb95: skipped 000084 1789067218.869785 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: 0x49bfc5ad (stale) CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 1: 0xc9b4129d Mirror 5: 0xc9b4129d Mirror 6: 0xc9b4129d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb95: skipped 000085 1789067220.004306 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: 0x49bfc5ad (stale) CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 1: 0xc9b4129d Mirror 5: 0xc9b4129d Mirror 6: 0xc9b4129d Mirror 7: 0xc9b4129d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb95: skipped 000087 1789067221.087207 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 4: 0x49bfc5ad (stale) CRC-32 checksum value for chunk [0, 0x3fb95): Mirror 1: 0xc9b4129d Mirror 5: 0xc9b4129d Mirror 6: 0xc9b4129d Mirror 7: 0xc9b4129d Mirror 8: 0xc9b4129d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb95: skipped 000088 1789067222.012849 punch from 0x02cb91 to 0x0302bb (0x372b bytes) 000090 1789067222.100188 MIRROR_RESYNC 6 mirrors 000091 1789067224.037138 punch from 0x02ad60 to 0x032f0c (0x81ad bytes) 000092 1789067224.068514 read 0x01d853 thru 0x02a450 (0xcbfe bytes) 000093 1789067224.076954 mapread 0x015ec5 thru 0x02047c (0xa5b8 bytes) 000094 1789067224.100098 trunc from 0x031ef3 to 0x03a0c8 (0x81d6 bytes) 000096 1789067224.105067 read 0x0082b7 thru 0x0108cd (0x8617 bytes) 000097 1789067224.116522 trunc from 0x03fb95 to 0x026c81 (0x18f13 bytes) 000098 1789067224.144279 trunc from 0x008911 to 0x01127c (0x896c bytes) 000099 1789067224.157430 trunc from 0x011ad5 to 0x01938f (0x78bb bytes) 000100 1789067224.175770 trunc from 0x026c82 to 0x025812 (0x146f bytes) 000101 1789067224.204064 trunc from 0x01781e to 0x01b39f (0x3b82 bytes) 000102 1789067224.215721 mapread 0x01765a thru 0x01f8d0 (0x8277 bytes) 000103 1789067224.258449 write 0x037e3a thru 0x03e633 (0x67fa bytes) 000104 1789067224.260034 fallocate 0x015e1d thru 0x01e36b (0x854f bytes) 000105 1789067224.270281 read 0x00f98f thru 0x018e86 (0x94f8 bytes) 000106 1789067224.282362 mapwrite 0x002fdf thru 0x0122f1 (0xf313 bytes) 000107 1789067224.306183 read 0x02a0ec thru 0x036517 (0xc42c bytes) 000108 1789067224.307441 read 0x008914 thru 0x014aa7 (0xc194 bytes) 000109 1789067224.309687 mapread 0x03a0bb thru 0x03e2bb (0x4201 bytes) 000110 1789067224.312469 punch from 0x01c3a5 to 0x02b156 (0xedb2 bytes) 000111 1789067224.318800 mapread 0x024776 thru 0x02ada0 (0x662b bytes) 000112 1789067224.334000 trunc from 0x017b31 to 0x023807 (0xbcd7 bytes) 000115 1789067224.352003 fallocate 0x011b5a thru 0x01aeca (0x9371 bytes) 000117 1789067224.367896 MIRROR_RESYNC 6 mirrors 000118 1789067225.703569 read 0x0395b2 thru 0x03e633 (0x5082 bytes) 000119 1789067225.713942 write 0x006b93 thru 0x00c533 (0x59a1 bytes) 000121 1789067225.755037 mapread 0x015acd thru 0x01d81c (0x7d50 bytes) 000122 1789067225.797992 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e634): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e634): Mirror 4: 0x79b44c25 (stale) Mirror 5: 0x79b44c25 (stale) Mirror 6: 0x79b44c25 (stale) Mirror 7: 0x79b44c25 (stale) Mirror 8: 0x79b44c25 (stale) CRC-32 checksum value for chunk [0, 0x3e634): Mirror 1: 0xcd1647ac Mirror 9: 0xcd1647ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e634: skipped 000123 1789067226.949667 mapwrite 0x037f6e thru 0x03f244 (0x72d7 bytes) 000124 1789067227.047556 trunc from 0x037b27 to 0x038120 (0x5fa bytes) 000125 1789067227.051995 trunc from 0x03f245 to 0x008d99 (0x364ab bytes) 000126 1789067227.073033 MIRROR_RESYNC 7 mirrors 000127 1789067228.057688 fallocate 0x03c691 thru 0x03fb03 (0x3473 bytes) 000128 1789067228.100788 write 0x039d78 thru 0x03ffff (0x6288 bytes) 000129 1789067228.102751 trunc from 0x040000 to 0x0180eb (0x27f14 bytes) 000130 1789067228.128661 fallocate 0x02820d thru 0x036c9e (0xea92 bytes) 000131 1789067228.132904 trunc from 0x01587f to 0x0180eb (0x286d bytes) 000133 1789067228.139443 read 0x007692 thru 0x014cc8 (0xd637 bytes) 000134 1789067228.155039 write 0x00d56f thru 0x01ad7b (0xd80d bytes) 000136 1789067228.167195 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1ad7c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad7c): Mirror 4: 0x8012bceb (stale) Mirror 5: 0x8012bceb (stale) Mirror 6: 0x8012bceb (stale) Mirror 7: 0x8012bceb (stale) Mirror 8: 0x8012bceb (stale) Mirror 9: 0x8012bceb (stale) CRC-32 checksum value for chunk [0, 0x1ad7c): Mirror 1: 0x8f6461b5 Mirror 10: 0x8f6461b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad7c: skipped 000137 1789067228.987333 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ad7c): Mirror 4: 0x8012bceb (stale) Mirror 6: 0x8012bceb (stale) Mirror 7: 0x8012bceb (stale) Mirror 8: 0x8012bceb (stale) Mirror 9: 0x8012bceb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad7c): Mirror 4: 0x8012bceb (stale) Mirror 6: 0x8012bceb (stale) Mirror 7: 0x8012bceb (stale) Mirror 8: 0x8012bceb (stale) Mirror 9: 0x8012bceb (stale) CRC-32 checksum value for chunk [0, 0x1ad7c): Mirror 1: 0x8f6461b5 Mirror 10: 0x8f6461b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad7c: skipped 000138 1789067229.597175 trunc from 0x0108ac to 0x018671 (0x7dc6 bytes) 000139 1789067229.644235 trunc from 0x00b6cb to 0x012cbf (0x75f5 bytes) 000140 1789067229.647934 punch from 0x00625a to 0x014b17 (0xe8be bytes) 000142 1789067229.658013 trunc from 0x01ad7c to 0x03193e (0x16bc3 bytes) 000143 1789067229.718735 read 0x02928d thru 0x03193e (0x86b2 bytes) 000144 1789067229.733052 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3193f): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3193f): Mirror 4: 0xfc0be270 (stale) Mirror 6: 0xfc0be270 (stale) Mirror 7: 0xfc0be270 (stale) Mirror 8: 0xfc0be270 (stale) Mirror 9: 0xfc0be270 (stale) Mirror 10: 0x3bbb890c (stale) CRC-32 checksum value for chunk [0, 0x3193f): Mirror 1: 0x3425ab00 Mirror 11: 0x3425ab00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3193f: skipped 000145 1789067230.611746 punch from 0x00afbd to 0x017a1c (0xca60 bytes) 000146 1789067230.682814 trunc from 0x004272 to 0x00ef6e (0xacfd bytes) 000147 1789067230.687984 mapread 0x008b0f thru 0x00df81 (0x5473 bytes) 000148 1789067230.731057 trunc from 0x03193f to 0x03b173 (0x9835 bytes) 000149 1789067230.793692 trunc from 0x016aa1 to 0x0199fc (0x2f5c bytes) 000150 1789067230.801603 write 0x03f3e4 thru 0x03ffff (0xc1c bytes) 000151 1789067230.808295 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb9468553 (stale) Mirror 6: 0xb9468553 (stale) Mirror 7: 0xb9468553 (stale) Mirror 8: 0xb9468553 (stale) Mirror 9: 0xb9468553 (stale) Mirror 10: 0xbce917b9 (stale) Mirror 11: 0x7e81afb7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x47bb869b Mirror 12: 0x47bb869b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000152 1789067231.916378 trunc from 0x040000 to 0x0256ea (0x1a915 bytes) 000154 1789067232.001281 write 0x01af1c thru 0x021e33 (0x6f18 bytes) 000155 1789067232.011555 trunc from 0x0256eb to 0x02a251 (0x4b67 bytes) 000156 1789067232.038741 mapread 0x002fdb thru 0x00516a (0x2190 bytes) 000157 1789067232.068795 mapwrite 0x01f908 thru 0x02341a (0x3b13 bytes) 000158 1789067232.097969 trunc from 0x01951b to 0x0220d0 (0x8bb6 bytes) 000159 1789067232.104761 write 0x01f126 thru 0x0234fb (0x43d6 bytes) 000160 1789067232.109841 mapread 0x01e36f thru 0x029a29 (0xb6bb bytes) 000161 1789067232.120053 trunc from 0x02a252 to 0x03af38 (0x10ce7 bytes) 000162 1789067232.135106 trunc from 0x00818f to 0x01559c (0xd40e bytes) 000163 1789067232.141248 trunc from 0x03af39 to 0x03132d (0x9c0b bytes) 000165 1789067232.157010 write 0x02762b thru 0x029422 (0x1df8 bytes) 000166 1789067232.158492 write 0x02336d thru 0x032f98 (0xfc2c bytes) 000167 1789067232.162456 punch from 0x0047c8 to 0x00672f (0x1f68 bytes) 000168 1789067232.167152 fallocate 0x005eff thru 0x00f9af (0x9ab1 bytes) 000169 1789067232.173011 fallocate 0x01e380 thru 0x02d03f (0xecc0 bytes) 000170 1789067232.179103 trunc from 0x032f99 to 0x01e8c7 (0x146d1 bytes) 000171 1789067232.210578 fallocate 0x008c39 thru 0x00acfc (0x20c4 bytes) 000172 1789067232.224585 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1e8c8): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e8c8): Mirror 4: 0xc41b9eb3 (stale) Mirror 6: 0xc41b9eb3 (stale) Mirror 7: 0xc41b9eb3 (stale) Mirror 8: 0xc41b9eb3 (stale) Mirror 9: 0xc41b9eb3 (stale) Mirror 10: 0x5fbe72e4 (stale) Mirror 11: 0x5a9eb1b1 (stale) Mirror 12: 0xab447060 (stale) CRC-32 checksum value for chunk [0, 0x1e8c8): Mirror 1: 0xa1ee8a04 Mirror 13: 0xa1ee8a04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e8c8: skipped 000173 1789067232.996912 fallocate 0x012b56 thru 0x01a6db (0x7b86 bytes) 000174 1789067233.058728 mapwrite 0x03a4ed thru 0x03e6d0 (0x41e4 bytes) 000175 1789067233.140562 write 0x01e127 thru 0x028137 (0xa011 bytes) 000176 1789067233.148610 mapread 0x00e4d3 thru 0x011ada (0x3608 bytes) 000177 1789067233.157193 write 0x02dcf7 thru 0x0335c0 (0x58ca bytes) 000178 1789067233.166681 mapread 0x016f7d thru 0x018838 (0x18bc bytes) 000179 1789067233.176915 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3e6d1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6d1): Mirror 4: 0x3b1e5f0 (stale) Mirror 6: 0x3b1e5f0 (stale) Mirror 7: 0x3b1e5f0 (stale) Mirror 8: 0x3b1e5f0 (stale) Mirror 9: 0x3b1e5f0 (stale) Mirror 10: 0x1955f579 (stale) Mirror 11: 0x8b0a368c (stale) Mirror 12: 0x6a9361df (stale) Mirror 13: 0x95091457 (stale) CRC-32 checksum value for chunk [0, 0x3e6d1): Mirror 1: 0x2f6514bf Mirror 14: 0x2f6514bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6d1: skipped 000180 1789067234.140747 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e6d1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6d1): Mirror 4: 0x3b1e5f0 (stale) Mirror 6: 0x3b1e5f0 (stale) Mirror 7: 0x3b1e5f0 (stale) Mirror 8: 0x3b1e5f0 (stale) Mirror 9: 0x3b1e5f0 (stale) Mirror 10: 0x1955f579 (stale) Mirror 11: 0x8b0a368c (stale) Mirror 12: 0x6a9361df (stale) Mirror 13: 0x95091457 (stale) CRC-32 checksum value for chunk [0, 0x3e6d1): Mirror 1: 0x2f6514bf Mirror 14: 0x2f6514bf Mirror 15: 0x2f6514bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6d1: skipped 000182 1789067235.340113 fallocate 0x02c445 thru 0x02fd42 (0x38fe bytes) 000183 1789067235.377513 mapwrite 0x02b802 thru 0x036d5d (0xb55c bytes) 000184 1789067235.417454 trunc from 0x02bc78 to 0x031b07 (0x5e90 bytes) 000185 1789067235.423042 mapwrite 0x03064d thru 0x03b16f (0xab23 bytes) 000186 1789067235.453747 mapwrite 0x001199 thru 0x008aeb (0x7953 bytes) 000187 1789067235.483933 fallocate 0x0331d3 thru 0x037ae9 (0x4917 bytes) 000189 1789067235.489544 mapread 0x01a96f thru 0x01b63f (0xcd1 bytes) 000190 1789067235.497402 mapread 0x039ce4 thru 0x03e6d0 (0x49ed bytes) 000191 1789067235.498482 write 0x038de1 thru 0x03ffff (0x721f bytes) 000192 1789067235.506664 mapwrite 0x02b09a thru 0x02bc7a (0xbe1 bytes) 000193 1789067235.533286 mapread 0x00cb19 thru 0x01322e (0x6716 bytes) 000194 1789067235.543172 write 0x0337ac thru 0x03ffff (0xc854 bytes) 000196 1789067235.545685 mapwrite 0x012fd9 thru 0x020fc9 (0xdff1 bytes) 000198 1789067235.575301 trunc from 0x040000 to 0x000c9d (0x3f362 bytes) 000200 1789067235.617771 trunc from 0x000c7f to 0x000c9d (0x1f bytes) 000201 1789067235.626237 read 0x000863 thru 0x000c9d (0x43b bytes) 000202 1789067235.633097 mapwrite 0x02ce0a thru 0x038a18 (0xbc0f bytes) 000203 1789067235.688415 punch from 0x01268a to 0x0204d8 (0xde4f bytes) 000204 1789067235.704142 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x38a19): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a19): Mirror 4: 0x400342ec (stale) Mirror 6: 0x400342ec (stale) Mirror 7: 0x400342ec (stale) Mirror 8: 0x400342ec (stale) Mirror 9: 0x400342ec (stale) Mirror 10: 0xd5e71f5a (stale) Mirror 11: 0x23b1f035 (stale) Mirror 12: 0x6a9d42e4 (stale) Mirror 13: 0x9183f2e2 (stale) Mirror 14: 0x7536e8d4 (stale) Mirror 15: 0x7536e8d4 (stale) CRC-32 checksum value for chunk [0, 0x38a19): Mirror 1: 0x57df5460 Mirror 16: 0x57df5460 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a19: skipped 000205 1789067237.050089 trunc from 0x038a19 to 0x03f8a3 (0x6e8b bytes) 000206 1789067237.125423 punch from 0x0130bd to 0x0171b8 (0x40fc bytes) 000207 1789067237.136404 trunc from 0x03f8a4 to 0x02c1e3 (0x136c0 bytes) 000208 1789067237.170418 mapread 0x006db8 thru 0x007f6e (0x11b7 bytes) 000209 1789067237.190610 mapread 0x00de12 thru 0x01ce4c (0xf03b bytes) 000210 1789067237.228434 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c1e4): Mirror 6: 0x99f296c9 (stale) Mirror 7: 0x99f296c9 (stale) Mirror 8: 0x99f296c9 (stale) Mirror 9: 0x99f296c9 (stale) Mirror 10: 0xaf653de9 (stale) Mirror 11: 0xc484a845 (stale) Mirror 12: 0x7943ae8a (stale) Mirror 13: 0x433d4682 (stale) Mirror 14: 0xf98ee366 (stale) Mirror 15: 0xf98ee366 (stale) Mirror 16: 0x80aff2f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c1e4): Mirror 6: 0x99f296c9 (stale) Mirror 7: 0x99f296c9 (stale) Mirror 8: 0x99f296c9 (stale) Mirror 9: 0x99f296c9 (stale) Mirror 10: 0xaf653de9 (stale) Mirror 11: 0xc484a845 (stale) Mirror 12: 0x7943ae8a (stale) Mirror 13: 0x433d4682 (stale) Mirror 14: 0xf98ee366 (stale) Mirror 15: 0xf98ee366 (stale) Mirror 16: 0x80aff2f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c1e4: skipped 000211 1789067237.925205 write 0x018c24 thru 0x026aa6 (0xde83 bytes) 000213 1789067237.949448 mapread 0x004e9f thru 0x00ec34 (0x9d96 bytes) 000214 1789067237.967429 trunc from 0x0229b8 to 0x025884 (0x2ecd bytes) 000215 1789067237.982957 MIRROR_RESYNC 12 mirrors 000216 1789067240.717922 punch from 0x022866 to 0x02c1e3 (0x997e bytes) 000217 1789067240.771971 mapread 0x008da2 thru 0x013682 (0xa8e1 bytes) 000218 1789067240.823068 fallocate 0x00633a thru 0x00c894 (0x655b bytes) 000219 1789067240.830752 trunc from 0x02c1e4 to 0x03bbb2 (0xf9cf bytes) 000220 1789067240.861723 mapread 0x03b1bf thru 0x03bbb2 (0x9f4 bytes) 000222 1789067240.885886 write 0x000335 thru 0x00e1d6 (0xdea2 bytes) 000223 1789067240.899497 write 0x0241ad thru 0x02cbe2 (0x8a36 bytes) 000224 1789067240.923207 mapread 0x00d7f6 thru 0x015341 (0x7b4c bytes) 000225 1789067240.924159 mapwrite 0x038aef thru 0x03b5ed (0x2aff bytes) 000226 1789067240.951717 trunc from 0x013075 to 0x01dd32 (0xacbe bytes) 000227 1789067240.965402 punch from 0x02f32a to 0x03bbb2 (0xc889 bytes) 000228 1789067240.985259 punch from 0x031025 to 0x038216 (0x71f2 bytes) 000229 1789067240.999597 trunc from 0x0256d0 to 0x0283ce (0x2cff bytes) 000231 1789067241.011173 read 0x02547d thru 0x02c635 (0x71b9 bytes) 000232 1789067241.023662 trunc from 0x02182a to 0x024c48 (0x341f bytes) 000233 1789067241.029624 mapwrite 0x0186ab thru 0x023825 (0xb17b bytes) 000234 1789067241.105651 punch from 0x02ab43 to 0x033a6d (0x8f2b bytes) 000236 1789067241.123339 fallocate 0x01e429 thru 0x027aba (0x9692 bytes) 000237 1789067241.146632 MIRROR_RESYNC 12 mirrors 000239 1789067244.550988 mapread 0x018836 thru 0x027385 (0xeb50 bytes) 000240 1789067244.601179 punch from 0x038119 to 0x03bbb2 (0x3a9a bytes) 000241 1789067244.650899 punch from 0x032482 to 0x0386e8 (0x6267 bytes) 000243 1789067244.657945 mapwrite 0x0331ff thru 0x033c07 (0xa09 bytes) 000244 1789067244.685390 trunc from 0x03bbb3 to 0x021465 (0x1a74d bytes) 000245 1789067244.724310 MIRROR_RESYNC 12 mirrors 000246 1789067246.631292 write 0x008df0 thru 0x00f2af (0x64c0 bytes) 000247 1789067246.673979 mapwrite 0x03b674 thru 0x03d9de (0x236b bytes) 000248 1789067246.719355 read 0x01e0c5 thru 0x029d79 (0xbcb5 bytes) 000249 1789067246.727592 punch from 0x03aac2 to 0x03d9de (0x2f1d bytes) 000250 1789067246.731390 punch from 0x029dac to 0x02ca2b (0x2c80 bytes) 000251 1789067246.735739 trunc from 0x03d9df to 0x02a767 (0x13277 bytes) 000252 1789067246.752502 punch from 0x005413 to 0x012258 (0xce46 bytes) 000254 1789067246.762425 read 0x0083c3 thru 0x00cb62 (0x47a0 bytes) 000255 1789067246.771555 trunc from 0x029457 to 0x02a767 (0x1311 bytes) 000256 1789067246.774829 trunc from 0x02a768 to 0x021073 (0x96f4 bytes) 000257 1789067246.785352 read 0x020904 thru 0x021073 (0x770 bytes) 000258 1789067246.786524 read 0x009d2e thru 0x00e449 (0x471c bytes) 000259 1789067246.787848 fallocate 0x01e457 thru 0x027c5d (0x9807 bytes) 000260 1789067246.792765 mapread 0x022f07 thru 0x0258fe (0x29f8 bytes) 000261 1789067246.800776 mapwrite 0x02e139 thru 0x03d0d2 (0xef9a bytes) 000263 1789067246.838200 punch from 0x00d10d to 0x00fcf1 (0x2be5 bytes) 000264 1789067246.845479 MIRROR_RESYNC 12 mirrors 000266 1789067249.496400 mapread 0x017e3f thru 0x025676 (0xd838 bytes) 000267 1789067249.536603 punch from 0x01346d to 0x01f5d3 (0xc167 bytes) 000268 1789067249.604373 fallocate 0x03fe48 thru 0x03ffff (0x1b8 bytes) 000269 1789067249.609396 trunc from 0x03d0d3 to 0x03354f (0x9b83 bytes) 000270 1789067249.630612 mapread 0x0214a6 thru 0x030218 (0xed73 bytes) 000272 1789067249.652221 mapread 0x019aa5 thru 0x01adf1 (0x134d bytes) 000273 1789067249.661786 mapwrite 0x00de50 thru 0x00ea86 (0xc37 bytes) 000274 1789067249.703764 mapread 0x0201d3 thru 0x02dd92 (0xdbc0 bytes) 000275 1789067249.704806 mapwrite 0x024ccc thru 0x02682e (0x1b63 bytes) 000276 1789067249.718453 trunc from 0x033550 to 0x007acd (0x2ba82 bytes) 000277 1789067249.743402 trunc from 0x007ace to 0x00cd48 (0x527b bytes) 000278 1789067249.790784 punch from 0x00bc65 to 0x00cd48 (0x10e4 bytes) 000279 1789067249.795761 trunc from 0x00cd49 to 0x019dd7 (0xd08f bytes) 000280 1789067249.812464 trunc from 0x00439b to 0x004754 (0x3ba bytes) 000281 1789067249.828818 mapwrite 0x020ecb thru 0x025b4b (0x4c81 bytes) 000283 1789067249.913590 mapread 0x00d5b6 thru 0x014a0d (0x7458 bytes) 000284 1789067249.943663 mapwrite 0x019e58 thru 0x01db76 (0x3d1f bytes) 000285 1789067249.965409 trunc from 0x025b4c to 0x032550 (0xca05 bytes) 000286 1789067249.980291 write 0x030aad thru 0x03c755 (0xbca9 bytes) 000287 1789067249.986734 trunc from 0x03c756 to 0x00f22b (0x2d52a bytes) 000288 1789067250.003633 fallocate 0x038ac5 thru 0x03ffff (0x753b bytes) 000289 1789067250.030779 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf22c): Mirror 6: 0xfe493182 (stale) Mirror 7: 0xfe493182 (stale) Mirror 8: 0xfe493182 (stale) Mirror 9: 0xfe493182 (stale) Mirror 11: 0xfe493182 (stale) Mirror 12: 0xfe493182 (stale) Mirror 13: 0xfe493182 (stale) Mirror 14: 0xfe493182 (stale) Mirror 15: 0xfe493182 (stale) Mirror 16: 0xfe493182 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf22c): Mirror 6: 0xfe493182 (stale) Mirror 7: 0xfe493182 (stale) Mirror 8: 0xfe493182 (stale) Mirror 9: 0xfe493182 (stale) Mirror 11: 0xfe493182 (stale) Mirror 12: 0xfe493182 (stale) Mirror 13: 0xfe493182 (stale) Mirror 14: 0xfe493182 (stale) Mirror 15: 0xfe493182 (stale) Mirror 16: 0xfe493182 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf22c: skipped 000290 1789067250.612624 write 0x014240 thru 0x016a07 (0x27c8 bytes) 000291 1789067250.620993 write 0x021105 thru 0x0254af (0x43ab bytes) 000292 1789067250.623431 punch from 0x00e821 to 0x00f0ed (0x8cd bytes) 000293 1789067250.628744 trunc from 0x0254b0 to 0x03b8b5 (0x16406 bytes) 000294 1789067250.641980 punch from 0x03957a to 0x03b8b5 (0x233c bytes) 000295 1789067250.648114 read 0x024ccd thru 0x02f8cd (0xac01 bytes) 000296 1789067250.658732 trunc from 0x01efe4 to 0x0221bd (0x31da bytes) 000297 1789067250.690684 read 0x0092a4 thru 0x014a92 (0xb7ef bytes) 000298 1789067250.719824 trunc from 0x0135c4 to 0x01a49e (0x6edb bytes) 000299 1789067250.729542 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3b8b6): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8b6): Mirror 6: 0xd5252625 (stale) Mirror 7: 0xd5252625 (stale) Mirror 8: 0xd5252625 (stale) Mirror 9: 0xd5252625 (stale) Mirror 11: 0xd5252625 (stale) Mirror 12: 0xd5252625 (stale) Mirror 13: 0xd5252625 (stale) Mirror 14: 0xd5252625 (stale) Mirror 15: 0xd5252625 (stale) Mirror 16: 0xd5252625 (stale) CRC-32 checksum value for chunk [0, 0x3b8b6): Mirror 1: 0xe60154b3 Mirror 17: 0xe60154b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8b6: skipped 000300 1789067252.098618 read 0x004c0e thru 0x011391 (0xc784 bytes) 000301 1789067252.124656 punch from 0x002ed5 to 0x00f956 (0xca82 bytes) 000302 1789067252.191754 read 0x02bbde thru 0x033357 (0x777a bytes) 000303 1789067252.216617 read 0x03660b thru 0x0375d2 (0xfc8 bytes) 000304 1789067252.217953 trunc from 0x0025f6 to 0x00bce8 (0x96f3 bytes) 000305 1789067252.224410 trunc from 0x03b8b6 to 0x03a481 (0x1434 bytes) 000306 1789067252.249903 mapwrite 0x01b91e thru 0x01bcf5 (0x3d8 bytes) 000307 1789067252.261610 fallocate 0x007089 thru 0x00b7b4 (0x472c bytes) 000308 1789067252.266942 read 0x00bbc3 thru 0x013937 (0x7d75 bytes) 000309 1789067252.276741 trunc from 0x01fa8e to 0x022721 (0x2c94 bytes) 000310 1789067252.286502 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a482): Mirror 7: 0xe57a87c9 (stale) Mirror 8: 0xe57a87c9 (stale) Mirror 9: 0xe57a87c9 (stale) Mirror 11: 0xe57a87c9 (stale) Mirror 12: 0xe57a87c9 (stale) Mirror 13: 0xe57a87c9 (stale) Mirror 14: 0xe57a87c9 (stale) Mirror 15: 0xe57a87c9 (stale) Mirror 16: 0xe57a87c9 (stale) Mirror 17: 0x770066f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a482): Mirror 7: 0xe57a87c9 (stale) Mirror 8: 0xe57a87c9 (stale) Mirror 9: 0xe57a87c9 (stale) Mirror 11: 0xe57a87c9 (stale) Mirror 12: 0xe57a87c9 (stale) Mirror 13: 0xe57a87c9 (stale) Mirror 14: 0xe57a87c9 (stale) Mirror 15: 0xe57a87c9 (stale) Mirror 16: 0xe57a87c9 (stale) Mirror 17: 0x770066f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a482: skipped 000311 1789067253.150025 punch from 0x00779a to 0x01276f (0xafd6 bytes) 000312 1789067253.182347 punch from 0x02a910 to 0x02ef4e (0x463f bytes) 000313 1789067253.194846 fallocate 0x031478 thru 0x034d84 (0x390d bytes) 000314 1789067253.207531 punch from 0x0187ba to 0x023146 (0xa98d bytes) 000317 1789067253.237838 fallocate 0x01d031 thru 0x021935 (0x4905 bytes) 000318 1789067253.256433 read 0x00e723 thru 0x01563a (0x6f18 bytes) 000319 1789067253.282610 trunc from 0x028b70 to 0x02da4d (0x4ede bytes) 000320 1789067253.292056 write 0x011c2c thru 0x01939c (0x7771 bytes) 000321 1789067253.315750 fallocate 0x026666 thru 0x02f5e9 (0x8f84 bytes) 000322 1789067253.327468 read 0x0055f7 thru 0x0083aa (0x2db4 bytes) 000323 1789067253.341772 read 0x02b6d7 thru 0x0372db (0xbc05 bytes) 000324 1789067253.342424 punch from 0x00d5e3 to 0x01543a (0x7e58 bytes) 000326 1789067253.373972 write 0x0044c7 thru 0x011b5d (0xd697 bytes) 000328 1789067253.382645 punch from 0x012a89 to 0x01ae81 (0x83f9 bytes) 000329 1789067253.394428 trunc from 0x018f80 to 0x02241c (0x949d bytes) 000330 1789067253.401748 trunc from 0x017d26 to 0x01f352 (0x762d bytes) 000331 1789067253.407963 trunc from 0x019f96 to 0x022bd9 (0x8c44 bytes) 000332 1789067253.413268 mapwrite 0x0348e3 thru 0x03c818 (0x7f36 bytes) 000333 1789067253.461375 mapwrite 0x0243cd thru 0x032ee4 (0xeb18 bytes) 000334 1789067253.513795 write 0x00eaf7 thru 0x016984 (0x7e8e bytes) 000335 1789067253.515047 mapread 0x03bb53 thru 0x03c818 (0xcc6 bytes) 000336 1789067253.515794 mapread 0x00467b thru 0x00afd6 (0x695c bytes) 000338 1789067253.543581 trunc from 0x004bb7 to 0x00a350 (0x579a bytes) 000339 1789067253.548894 trunc from 0x02a915 to 0x02ae7d (0x569 bytes) 000340 1789067253.556008 read 0x011297 thru 0x01de79 (0xcbe3 bytes) 000341 1789067253.556951 mapread 0x003151 thru 0x010533 (0xd3e3 bytes) 000342 1789067253.574386 fallocate 0x02a77b thru 0x02b150 (0x9d6 bytes) 000343 1789067253.588909 trunc from 0x03c819 to 0x003291 (0x39587 bytes) 000344 1789067253.620783 mapwrite 0x024266 thru 0x026c7b (0x2a16 bytes) 000345 1789067253.723090 trunc from 0x026c7c to 0x000b2b (0x26150 bytes) 000346 1789067253.789447 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xb2c): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb2c): Mirror 7: 0xcf71a47f (stale) Mirror 8: 0xcf71a47f (stale) Mirror 9: 0xcf71a47f (stale) Mirror 11: 0xcf71a47f (stale) Mirror 12: 0xcf71a47f (stale) Mirror 13: 0xcf71a47f (stale) Mirror 14: 0xcf71a47f (stale) Mirror 15: 0xcf71a47f (stale) Mirror 16: 0xcf71a47f (stale) Mirror 17: 0xcf71a47f (stale) CRC-32 checksum value for chunk [0, 0xb2c): Mirror 1: 0xcf71a47f Mirror 18: 0xcf71a47f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb2c: skipped 000347 1789067254.748077 fallocate 0x02698f thru 0x0363fd (0xfa6f bytes) 000348 1789067254.820781 trunc from 0x000b2c to 0x01b39d (0x1a872 bytes) 000349 1789067254.858816 mapwrite 0x035de3 thru 0x03905d (0x327b bytes) 000350 1789067254.961206 mapwrite 0x025296 thru 0x028f9d (0x3d08 bytes) 000351 1789067255.002147 write 0x00ab6a thru 0x0130a7 (0x853e bytes) 000352 1789067255.037001 mapwrite 0x017bc3 thru 0x0197ce (0x1c0c bytes) 000353 1789067255.089491 write 0x005bbf thru 0x0092fc (0x373e bytes) 000354 1789067255.103536 trunc from 0x035bea to 0x03905d (0x3474 bytes) 000355 1789067255.112965 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3905e): Mirror 7: 0x1b2c5c1c (stale) Mirror 8: 0x1b2c5c1c (stale) Mirror 9: 0x1b2c5c1c (stale) Mirror 11: 0x1b2c5c1c (stale) Mirror 12: 0x1b2c5c1c (stale) Mirror 13: 0x1b2c5c1c (stale) Mirror 14: 0x1b2c5c1c (stale) Mirror 15: 0x1b2c5c1c (stale) Mirror 16: 0x1b2c5c1c (stale) Mirror 18: 0xb67796ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3905e): Mirror 7: 0x1b2c5c1c (stale) Mirror 8: 0x1b2c5c1c (stale) Mirror 9: 0x1b2c5c1c (stale) Mirror 11: 0x1b2c5c1c (stale) Mirror 12: 0x1b2c5c1c (stale) Mirror 13: 0x1b2c5c1c (stale) Mirror 14: 0x1b2c5c1c (stale) Mirror 15: 0x1b2c5c1c (stale) Mirror 16: 0x1b2c5c1c (stale) Mirror 18: 0xb67796ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3905e: skipped 000356 1789067255.856700 fallocate 0x021eac thru 0x0238ac (0x1a01 bytes) 000357 1789067255.863596 punch from 0x02f5df to 0x035436 (0x5e58 bytes) 000358 1789067255.868395 read 0x0290fb thru 0x032e35 (0x9d3b bytes) 000359 1789067255.876726 mapread 0x0018d6 thru 0x008550 (0x6c7b bytes) 000360 1789067255.897975 trunc from 0x017664 to 0x01ec13 (0x75b0 bytes) 000361 1789067255.908956 MIRROR_RESYNC 11 mirrors 000362 1789067260.086403 mapread 0x00edda thru 0x01c55b (0xd782 bytes) 000363 1789067260.114667 trunc from 0x03905e to 0x009e7c (0x2f1e1 bytes) 000364 1789067260.157504 read 0x005a11 thru 0x009e7c (0x446c bytes) 000365 1789067260.167775 trunc from 0x009e7d to 0x02b84b (0x219cf bytes) 000366 1789067260.188267 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2b84c): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b84c): Mirror 7: 0xe60f357f (stale) Mirror 8: 0xe60f357f (stale) Mirror 9: 0xe60f357f (stale) Mirror 11: 0xe60f357f (stale) Mirror 12: 0xe60f357f (stale) Mirror 13: 0xe60f357f (stale) Mirror 14: 0xe60f357f (stale) Mirror 15: 0xe60f357f (stale) Mirror 16: 0xe60f357f (stale) Mirror 18: 0xe60f357f (stale) CRC-32 checksum value for chunk [0, 0x2b84c): Mirror 1: 0x95c6cc6 Mirror 19: 0x95c6cc6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b84c: skipped 000367 1789067261.048915 trunc from 0x02b84c to 0x024d5e (0x6aed bytes) 000368 1789067261.191483 fallocate 0x023b6e thru 0x024beb (0x107e bytes) 000369 1789067261.198112 read 0x001a1e thru 0x008478 (0x6a5b bytes) 000370 1789067261.226261 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24d5f): Mirror 7: 0xe28cf600 (stale) Mirror 8: 0xe28cf600 (stale) Mirror 9: 0xe28cf600 (stale) Mirror 11: 0xe28cf600 (stale) Mirror 12: 0xe28cf600 (stale) Mirror 13: 0xe28cf600 (stale) Mirror 14: 0xe28cf600 (stale) Mirror 15: 0xe28cf600 (stale) Mirror 16: 0xe28cf600 (stale) Mirror 18: 0xe28cf600 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d5f): Mirror 7: 0xe28cf600 (stale) Mirror 8: 0xe28cf600 (stale) Mirror 9: 0xe28cf600 (stale) Mirror 11: 0xe28cf600 (stale) Mirror 12: 0xe28cf600 (stale) Mirror 13: 0xe28cf600 (stale) Mirror 14: 0xe28cf600 (stale) Mirror 15: 0xe28cf600 (stale) Mirror 16: 0xe28cf600 (stale) Mirror 18: 0xe28cf600 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d5f: skipped 000371 1789067262.007461 trunc from 0x007650 to 0x00d4a3 (0x5e54 bytes) 000373 1789067262.015450 trunc from 0x024d5f to 0x03d244 (0x184e6 bytes) 000374 1789067262.038741 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d245): Mirror 7: 0xe3205889 (stale) Mirror 8: 0xe3205889 (stale) Mirror 9: 0xe3205889 (stale) Mirror 11: 0xe3205889 (stale) Mirror 12: 0xe3205889 (stale) Mirror 14: 0xe3205889 (stale) Mirror 15: 0xe3205889 (stale) Mirror 16: 0xe3205889 (stale) Mirror 18: 0xe3205889 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d245): Mirror 7: 0xe3205889 (stale) Mirror 8: 0xe3205889 (stale) Mirror 9: 0xe3205889 (stale) Mirror 11: 0xe3205889 (stale) Mirror 12: 0xe3205889 (stale) Mirror 14: 0xe3205889 (stale) Mirror 15: 0xe3205889 (stale) Mirror 16: 0xe3205889 (stale) Mirror 18: 0xe3205889 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d245: skipped 000375 1789067262.822461 fallocate 0x01c819 thru 0x029760 (0xcf48 bytes) 000376 1789067262.831909 read 0x00c63c thru 0x01c2b9 (0xfc7e bytes) 000377 1789067262.856635 punch from 0x000b23 to 0x00c6ca (0xbba8 bytes) 000378 1789067262.884506 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d245): Mirror 7: 0xe3205889 (stale) Mirror 8: 0xe3205889 (stale) Mirror 9: 0xe3205889 (stale) Mirror 11: 0xe3205889 (stale) Mirror 14: 0xe3205889 (stale) Mirror 15: 0xe3205889 (stale) Mirror 16: 0xe3205889 (stale) Mirror 18: 0xe3205889 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d245): Mirror 7: 0xe3205889 (stale) Mirror 8: 0xe3205889 (stale) Mirror 9: 0xe3205889 (stale) Mirror 11: 0xe3205889 (stale) Mirror 14: 0xe3205889 (stale) Mirror 15: 0xe3205889 (stale) Mirror 16: 0xe3205889 (stale) Mirror 18: 0xe3205889 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d245: skipped 000379 1789067263.699990 mapwrite 0x02bce9 thru 0x038f77 (0xd28f bytes) 000380 1789067263.742327 mapread 0x031092 thru 0x031842 (0x7b1 bytes) 000381 1789067263.749810 MIRROR_RESYNC 9 mirrors 000382 1789067265.806753 fallocate 0x00b116 thru 0x019e15 (0xed00 bytes) 000383 1789067265.869640 trunc from 0x00d963 to 0x01072a (0x2dc8 bytes) 000384 1789067265.876509 write 0x029894 thru 0x036426 (0xcb93 bytes) 000385 1789067265.890392 mapwrite 0x00ca41 thru 0x014ec1 (0x8481 bytes) 000386 1789067265.935436 fallocate 0x03e80e thru 0x03fa17 (0x120a bytes) 000387 1789067265.941338 mapread 0x023c85 thru 0x024f63 (0x12df bytes) 000388 1789067265.955694 MIRROR_RESYNC 9 mirrors 000389 1789067269.282571 mapread 0x01e3c5 thru 0x022f2d (0x4b69 bytes) 000390 1789067269.308755 trunc from 0x03fa18 to 0x021605 (0x1e412 bytes) 000391 1789067269.376415 mapwrite 0x029130 thru 0x02dbe6 (0x4ab7 bytes) 000392 1789067269.458539 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2dbe7): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dbe7): Mirror 7: 0x25098a53 (stale) Mirror 8: 0x25098a53 (stale) Mirror 9: 0x25098a53 (stale) Mirror 11: 0x25098a53 (stale) Mirror 14: 0x25098a53 (stale) Mirror 15: 0x25098a53 (stale) Mirror 16: 0x25098a53 (stale) Mirror 18: 0x25098a53 (stale) CRC-32 checksum value for chunk [0, 0x2dbe7): Mirror 1: 0x54cb1fc8 Mirror 19: 0x54cb1fc8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dbe7: skipped 000394 1789067270.647535 trunc from 0x00de25 to 0x00fef3 (0x20cf bytes) 000395 1789067270.704461 fallocate 0x0086c5 thru 0x00e48c (0x5dc8 bytes) 000396 1789067270.710308 trunc from 0x02dbe7 to 0x02c801 (0x13e5 bytes) 000397 1789067270.756741 trunc from 0x023d74 to 0x02c801 (0x8a8e bytes) 000398 1789067270.763474 trunc from 0x02c802 to 0x02ae60 (0x19a1 bytes) 000399 1789067270.780376 fallocate 0x01ef78 thru 0x024fbb (0x6044 bytes) 000400 1789067270.785572 trunc from 0x02ae61 to 0x01c7cf (0xe691 bytes) 000401 1789067270.808284 fallocate 0x005964 thru 0x00d1c9 (0x7866 bytes) 000402 1789067270.816395 punch from 0x00da09 to 0x00f2a1 (0x1899 bytes) 000403 1789067270.822470 fallocate 0x00d99e thru 0x0109dc (0x303f bytes) 000404 1789067270.836253 fallocate 0x031878 thru 0x033800 (0x1f89 bytes) 000405 1789067270.846258 trunc from 0x00bcb7 to 0x011bb9 (0x5f03 bytes) 000406 1789067270.867137 trunc from 0x01c7d0 to 0x01ddc5 (0x15f6 bytes) 000407 1789067270.902572 trunc from 0x01b5dc to 0x01ddc5 (0x27ea bytes) 000408 1789067270.916799 read 0x01be53 thru 0x01ddc5 (0x1f73 bytes) 000409 1789067270.927969 read 0x00a9ae thru 0x0105b8 (0x5c0b bytes) 000410 1789067270.975112 trunc from 0x01ddc6 to 0x03c83b (0x1ea76 bytes) 000412 1789067271.014352 mapread 0x00bfc4 thru 0x018d44 (0xcd81 bytes) 000413 1789067271.015368 read 0x03a792 thru 0x03c83b (0x20aa bytes) 000414 1789067271.051100 read 0x025e2c thru 0x02a86f (0x4a44 bytes) 000415 1789067271.052187 fallocate 0x035b00 thru 0x03ffff (0xa500 bytes) 000416 1789067271.079334 MIRROR_RESYNC 10 mirrors 000417 1789067273.156798 trunc from 0x040000 to 0x03b8db (0x4724 bytes) 000418 1789067273.231293 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b8dc): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8dc): Mirror 7: 0xdf39521d (stale) Mirror 8: 0xdf39521d (stale) Mirror 9: 0xdf39521d (stale) Mirror 11: 0xdf39521d (stale) Mirror 14: 0xdf39521d (stale) Mirror 15: 0xdf39521d (stale) Mirror 16: 0xdf39521d (stale) Mirror 18: 0xdf39521d (stale) Mirror 19: 0xdf39521d (stale) CRC-32 checksum value for chunk [0, 0x3b8dc): Mirror 1: 0xdf39521d Mirror 20: 0xdf39521d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8dc: skipped 000419 1789067274.737631 punch from 0x023f17 to 0x02ee57 (0xaf41 bytes) 000420 1789067274.790664 MIRROR_RESYNC 11 mirrors 000421 1789067276.834672 read 0x006ea5 thru 0x00da61 (0x6bbd bytes) 000422 1789067276.846312 mapread 0x01e534 thru 0x0256c9 (0x7196 bytes) 000423 1789067276.868304 fallocate 0x011270 thru 0x01426d (0x2ffe bytes) 000424 1789067276.913830 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b8dc): Mirror 7: 0xdf39521d (stale) Mirror 8: 0xdf39521d (stale) Mirror 9: 0xdf39521d (stale) Mirror 14: 0xdf39521d (stale) Mirror 15: 0xdf39521d (stale) Mirror 16: 0xdf39521d (stale) Mirror 18: 0xdf39521d (stale) Mirror 19: 0xdf39521d (stale) Mirror 20: 0xdf39521d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8dc): Mirror 7: 0xdf39521d (stale) Mirror 8: 0xdf39521d (stale) Mirror 9: 0xdf39521d (stale) Mirror 14: 0xdf39521d (stale) Mirror 15: 0xdf39521d (stale) Mirror 16: 0xdf39521d (stale) Mirror 18: 0xdf39521d (stale) Mirror 19: 0xdf39521d (stale) Mirror 20: 0xdf39521d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8dc: skipped 000426 1789067277.544137 punch from 0x03415d to 0x03b8db (0x777f bytes) 000427 1789067277.550021 read 0x025864 thru 0x02ef6c (0x9709 bytes) 000428 1789067277.557938 mapread 0x01adcf thru 0x01f72b (0x495d bytes) 000429 1789067277.574196 mapread 0x00382a thru 0x0055bf (0x1d96 bytes) 000430 1789067277.583239 mapwrite 0x00f70b thru 0x01d671 (0xdf67 bytes) 000431 1789067277.610459 write 0x017c96 thru 0x025555 (0xd8c0 bytes) 000432 1789067277.617226 punch from 0x02bd33 to 0x03b74f (0xfa1d bytes) 000433 1789067277.622296 fallocate 0x033f61 thru 0x03a067 (0x6107 bytes) 000435 1789067277.631384 punch from 0x03649d to 0x03b8db (0x543f bytes) 000436 1789067277.636459 mapwrite 0x001bd4 thru 0x008cad (0x70da bytes) 000437 1789067277.667437 mapread 0x00c853 thru 0x01bc1d (0xf3cb bytes) 000438 1789067277.668509 fallocate 0x026029 thru 0x02b607 (0x55df bytes) 000439 1789067277.677216 punch from 0x01cb30 to 0x024215 (0x76e6 bytes) 000440 1789067277.688139 punch from 0x032e46 to 0x03b8db (0x8a96 bytes) 000441 1789067277.693602 write 0x03258f thru 0x03ffff (0xda71 bytes) 000442 1789067277.699154 write 0x0221b8 thru 0x02d8c1 (0xb70a bytes) 000443 1789067277.712147 write 0x033fb0 thru 0x03ffff (0xc050 bytes) 000444 1789067277.714416 read 0x0215c6 thru 0x0291e3 (0x7c1e bytes) 000445 1789067277.731047 mapread 0x02e9fa thru 0x0350a7 (0x66ae bytes) 000446 1789067277.732090 mapread 0x0284ee thru 0x02efa0 (0x6ab3 bytes) 000447 1789067277.733172 trunc from 0x0211f5 to 0x027f79 (0x6d85 bytes) 000449 1789067277.761885 mapread 0x021cf4 thru 0x031355 (0xf662 bytes) 000450 1789067277.814631 mapread 0x00b25a thru 0x018e89 (0xdc30 bytes) 000451 1789067277.823215 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x57a2e3d (stale) Mirror 8: 0x57a2e3d (stale) Mirror 9: 0x57a2e3d (stale) Mirror 14: 0x57a2e3d (stale) Mirror 15: 0x57a2e3d (stale) Mirror 16: 0x57a2e3d (stale) Mirror 18: 0x57a2e3d (stale) Mirror 19: 0x57a2e3d (stale) Mirror 20: 0x57a2e3d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd7cbb0dc Mirror 21: 0xd7cbb0dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000452 1789067278.867632 mapread 0x01445f thru 0x01d129 (0x8ccb bytes) 000453 1789067278.911632 read 0x026f69 thru 0x036d1a (0xfdb2 bytes) 000454 1789067278.929275 trunc from 0x040000 to 0x0384a5 (0x7b5a bytes) 000456 1789067279.011492 fallocate 0x03b9f8 thru 0x03ffff (0x4608 bytes) 000457 1789067279.018745 read 0x00270f thru 0x00a793 (0x8085 bytes) 000458 1789067279.040210 read 0x035707 thru 0x037b01 (0x23fb bytes) 000459 1789067279.040801 trunc from 0x0384a6 to 0x036c44 (0x1861 bytes) 000460 1789067279.063364 read 0x01935f thru 0x0268f9 (0xd59b bytes) 000461 1789067279.064206 mapread 0x0159f9 thru 0x01e395 (0x899d bytes) 000462 1789067279.066484 write 0x0311ac thru 0x032749 (0x159e bytes) 000463 1789067279.071433 read 0x019dde thru 0x01fe91 (0x60b4 bytes) 000464 1789067279.072714 punch from 0x01f09a to 0x02cdf3 (0xdd5a bytes) 000465 1789067279.080416 trunc from 0x0218f9 to 0x031249 (0xf951 bytes) 000466 1789067279.089664 trunc from 0x01c864 to 0x01f877 (0x3014 bytes) 000467 1789067279.094612 read 0x0242de thru 0x02e7db (0xa4fe bytes) 000468 1789067279.107752 fallocate 0x01a063 thru 0x028369 (0xe307 bytes) 000469 1789067279.114804 write 0x005ba6 thru 0x00c581 (0x69dc bytes) 000470 1789067279.119969 trunc from 0x036c45 to 0x00499e (0x322a6 bytes) 000471 1789067279.138681 trunc from 0x000b5c to 0x00499e (0x3e43 bytes) 000472 1789067279.144828 trunc from 0x003a5c to 0x00428b (0x830 bytes) 000473 1789067279.148659 punch from 0x003a55 to 0x00499e (0xf4a bytes) 000475 1789067279.154034 write 0x0091a0 thru 0x01100b (0x7e6c bytes) 000476 1789067279.155228 write 0x020b53 thru 0x0256c2 (0x4b70 bytes) 000477 1789067279.160359 MIRROR_RESYNC 11 mirrors 000478 1789067282.086744 trunc from 0x022b95 to 0x0256c2 (0x2b2e bytes) 000479 1789067282.143160 write 0x0172ca thru 0x017974 (0x6ab bytes) 000480 1789067282.148298 read 0x01078e thru 0x018027 (0x789a bytes) 000481 1789067282.156841 mapread 0x023eba thru 0x0256c2 (0x1809 bytes) 000483 1789067282.178396 read 0x016cdb thru 0x01c676 (0x599c bytes) 000484 1789067282.186196 mapread 0x009ce5 thru 0x00e3dc (0x46f8 bytes) 000485 1789067282.187544 trunc from 0x003a98 to 0x00a8d1 (0x6e3a bytes) 000486 1789067282.192403 read 0x00055c thru 0x00cee0 (0xc985 bytes) 000487 1789067282.201653 mapread 0x0180bc thru 0x01a1b9 (0x20fe bytes) 000488 1789067282.202500 punch from 0x01e56f to 0x0256c2 (0x7154 bytes) 000489 1789067282.207924 mapwrite 0x03ab22 thru 0x03ffff (0x54de bytes) 000490 1789067282.272577 fallocate 0x038c8c thru 0x03ffff (0x7374 bytes) 000491 1789067282.281168 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7c71ba3b (stale) Mirror 8: 0x7c71ba3b (stale) Mirror 9: 0x7c71ba3b (stale) Mirror 14: 0x7c71ba3b (stale) Mirror 15: 0x7c71ba3b (stale) Mirror 16: 0x7c71ba3b (stale) Mirror 18: 0x7c71ba3b (stale) Mirror 19: 0x7c71ba3b (stale) Mirror 20: 0x7c71ba3b (stale) Mirror 21: 0x7c71ba3b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x33584722 Mirror 22: 0x33584722 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000492 1789067283.168657 mapread 0x038e6c thru 0x03ffff (0x7194 bytes) 000493 1789067283.192680 trunc from 0x021f57 to 0x02730d (0x53b7 bytes) 000494 1789067283.225057 trunc from 0x040000 to 0x01d137 (0x22ec8 bytes) 000496 1789067283.298362 fallocate 0x003f64 thru 0x00ea66 (0xab03 bytes) 000497 1789067283.311739 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d138): Mirror 7: 0x2c79d718 (stale) Mirror 8: 0x2c79d718 (stale) Mirror 9: 0x2c79d718 (stale) Mirror 14: 0x2c79d718 (stale) Mirror 15: 0x2c79d718 (stale) Mirror 16: 0x2c79d718 (stale) Mirror 18: 0x2c79d718 (stale) Mirror 19: 0x2c79d718 (stale) Mirror 20: 0x2c79d718 (stale) Mirror 22: 0x723122e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d138): Mirror 7: 0x2c79d718 (stale) Mirror 8: 0x2c79d718 (stale) Mirror 9: 0x2c79d718 (stale) Mirror 14: 0x2c79d718 (stale) Mirror 15: 0x2c79d718 (stale) Mirror 16: 0x2c79d718 (stale) Mirror 18: 0x2c79d718 (stale) Mirror 19: 0x2c79d718 (stale) Mirror 20: 0x2c79d718 (stale) Mirror 22: 0x723122e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d138: skipped 000499 1789067283.972001 mapwrite 0x03d98d thru 0x03ffff (0x2673 bytes) 000500 1789067284.045721 MIRROR_RESYNC 11 mirrors 000501 1789067286.670262 punch from 0x00b0b2 to 0x00bf5a (0xea9 bytes) 000502 1789067286.700834 mapwrite 0x00c031 thru 0x011fac (0x5f7c bytes) 000503 1789067286.734008 MIRROR_RESYNC 11 mirrors 000504 1789067289.704269 fallocate 0x02f45b thru 0x03a65b (0xb201 bytes) 000505 1789067289.725586 mapread 0x01a38b thru 0x01eb79 (0x47ef bytes) 000506 1789067289.749531 write 0x019c01 thru 0x01a034 (0x434 bytes) 000507 1789067289.750454 fallocate 0x03b11e thru 0x03ffff (0x4ee2 bytes) 000508 1789067289.756228 mapwrite 0x029549 thru 0x02ea96 (0x554e bytes) 000509 1789067289.795459 mapwrite 0x026905 thru 0x02f8be (0x8fba bytes) 000510 1789067289.814739 fallocate 0x016d54 thru 0x0172d2 (0x57f bytes) 000511 1789067289.820341 mapwrite 0x0089c6 thru 0x00b2d3 (0x290e bytes) 000512 1789067289.857346 trunc from 0x0079c1 to 0x01754b (0xfb8b bytes) 000513 1789067289.888277 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5c934212 (stale) Mirror 8: 0x5c934212 (stale) Mirror 9: 0x5c934212 (stale) Mirror 14: 0x5c934212 (stale) Mirror 15: 0x5c934212 (stale) Mirror 16: 0x5c934212 (stale) Mirror 18: 0x5c934212 (stale) Mirror 19: 0x5c934212 (stale) Mirror 20: 0x5c934212 (stale) Mirror 22: 0x5c934212 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2bc5bc76 Mirror 23: 0x2bc5bc76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000514 1789067291.130487 trunc from 0x01cd95 to 0x021ded (0x5059 bytes) 000515 1789067291.173819 punch from 0x018a6e to 0x01a22a (0x17bd bytes) 000516 1789067291.178123 trunc from 0x040000 to 0x01eb98 (0x21467 bytes) 000517 1789067291.205992 mapread 0x001c1e thru 0x009961 (0x7d44 bytes) 000518 1789067291.242602 fallocate 0x01d716 thru 0x02a59a (0xce85 bytes) 000519 1789067291.249170 trunc from 0x02a59b to 0x00cbd2 (0x1d9c8 bytes) 000520 1789067291.269239 fallocate 0x03ed87 thru 0x03ffff (0x1279 bytes) 000521 1789067291.278177 punch from 0x018525 to 0x0220c0 (0x9b9c bytes) 000522 1789067291.286571 read 0x01e5a5 thru 0x0203e7 (0x1e43 bytes) 000523 1789067291.292657 write 0x006660 thru 0x00f046 (0x89e7 bytes) 000524 1789067291.300004 fallocate 0x011941 thru 0x013424 (0x1ae4 bytes) 000525 1789067291.312388 mapwrite 0x02c74a thru 0x03b208 (0xeabf bytes) 000526 1789067291.352999 write 0x018535 thru 0x018d55 (0x821 bytes) 000527 1789067291.358600 mapread 0x02e4e4 thru 0x03b62a (0xd147 bytes) 000528 1789067291.359689 mapwrite 0x003acf thru 0x0040b0 (0x5e2 bytes) 000529 1789067291.386123 mapread 0x005c9b thru 0x00f150 (0x94b6 bytes) 000530 1789067291.392473 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5c934212 (stale) Mirror 8: 0x5c934212 (stale) Mirror 9: 0x5c934212 (stale) Mirror 14: 0x5c934212 (stale) Mirror 15: 0x5c934212 (stale) Mirror 16: 0x5c934212 (stale) Mirror 18: 0x5c934212 (stale) Mirror 19: 0x5c934212 (stale) Mirror 20: 0x5c934212 (stale) Mirror 22: 0x5c934212 (stale) Mirror 23: 0x2bc5bc76 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb87e0221 Mirror 24: 0xb87e0221 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000531 1789067292.518399 MIRROR_RESYNC 13 mirrors 000532 1789067296.322833 trunc from 0x040000 to 0x02a8b4 (0x1574b bytes) 000533 1789067296.465277 mapread 0x00876a thru 0x00dc26 (0x54bd bytes) 000534 1789067296.503409 fallocate 0x0017fb thru 0x006653 (0x4e59 bytes) 000535 1789067296.508514 mapread 0x01babc thru 0x024c15 (0x915a bytes) 000536 1789067296.543819 mapread 0x00ea44 thru 0x01446b (0x5a28 bytes) 000537 1789067296.549655 fallocate 0x0158f7 thru 0x0160ea (0x7f4 bytes) 000540 1789067296.556148 mapread 0x0247e4 thru 0x02a8b4 (0x60d1 bytes) 000541 1789067296.561795 mapread 0x006bc1 thru 0x0099a9 (0x2de9 bytes) 000542 1789067296.562975 mapread 0x01afdb thru 0x01c940 (0x1966 bytes) 000543 1789067296.564044 read 0x005413 thru 0x00773c (0x232a bytes) 000544 1789067296.569180 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2a8b5): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8b5): Mirror 7: 0x43003596 (stale) Mirror 8: 0x43003596 (stale) Mirror 9: 0x43003596 (stale) Mirror 14: 0x43003596 (stale) Mirror 15: 0x43003596 (stale) Mirror 16: 0x43003596 (stale) Mirror 18: 0x43003596 (stale) Mirror 19: 0x43003596 (stale) Mirror 20: 0x43003596 (stale) Mirror 22: 0x43003596 (stale) Mirror 23: 0x43003596 (stale) Mirror 24: 0x43003596 (stale) CRC-32 checksum value for chunk [0, 0x2a8b5): Mirror 1: 0x43003596 Mirror 25: 0x43003596 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8b5: skipped 000546 1789067297.957158 trunc from 0x00abda to 0x00f28d (0x46b4 bytes) 000547 1789067298.012390 write 0x02fe0f thru 0x032a26 (0x2c18 bytes) 000548 1789067298.025091 read 0x025cb8 thru 0x02cfb6 (0x72ff bytes) 000549 1789067298.041204 trunc from 0x02d1a7 to 0x032a26 (0x5880 bytes) 000550 1789067298.057749 trunc from 0x032a27 to 0x019e91 (0x18b95 bytes) 000551 1789067298.103357 fallocate 0x03bc95 thru 0x03ffff (0x436b bytes) 000552 1789067298.108669 write 0x00ed21 thru 0x00f2ae (0x58e bytes) 000553 1789067298.118543 read 0x014972 thru 0x019e91 (0x5520 bytes) 000554 1789067298.128811 mapwrite 0x02e66b thru 0x030d01 (0x2697 bytes) 000555 1789067298.173175 mapread 0x026c62 thru 0x030d01 (0xa0a0 bytes) 000556 1789067298.175509 read 0x00d99d thru 0x014aff (0x7163 bytes) 000557 1789067298.178102 write 0x01af09 thru 0x01d15f (0x2257 bytes) 000558 1789067298.184506 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x30d02): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d02): Mirror 7: 0xc2ac79d (stale) Mirror 8: 0xc2ac79d (stale) Mirror 9: 0xc2ac79d (stale) Mirror 14: 0xc2ac79d (stale) Mirror 15: 0xc2ac79d (stale) Mirror 16: 0xc2ac79d (stale) Mirror 18: 0xc2ac79d (stale) Mirror 19: 0xc2ac79d (stale) Mirror 20: 0xc2ac79d (stale) Mirror 22: 0xc2ac79d (stale) Mirror 23: 0xc2ac79d (stale) Mirror 24: 0xc2ac79d (stale) Mirror 25: 0x4cf9f8b7 (stale) CRC-32 checksum value for chunk [0, 0x30d02): Mirror 1: 0xf1f7004e Mirror 26: 0xf1f7004e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d02: skipped 000559 1789067299.478493 write 0x03b96b thru 0x03f411 (0x3aa7 bytes) 000560 1789067299.548273 mapread 0x031b0e thru 0x036cd2 (0x51c5 bytes) 000561 1789067299.573340 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f412): Mirror 7: 0x4825bac5 (stale) Mirror 8: 0x4825bac5 (stale) Mirror 9: 0x4825bac5 (stale) Mirror 14: 0x4825bac5 (stale) Mirror 15: 0x4825bac5 (stale) Mirror 18: 0x4825bac5 (stale) Mirror 19: 0x4825bac5 (stale) Mirror 20: 0x4825bac5 (stale) Mirror 22: 0x4825bac5 (stale) Mirror 23: 0x4825bac5 (stale) Mirror 24: 0x4825bac5 (stale) Mirror 25: 0x9d528519 (stale) Mirror 26: 0xaca019db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f412): Mirror 7: 0x4825bac5 (stale) Mirror 8: 0x4825bac5 (stale) Mirror 9: 0x4825bac5 (stale) Mirror 14: 0x4825bac5 (stale) Mirror 15: 0x4825bac5 (stale) Mirror 18: 0x4825bac5 (stale) Mirror 19: 0x4825bac5 (stale) Mirror 20: 0x4825bac5 (stale) Mirror 22: 0x4825bac5 (stale) Mirror 23: 0x4825bac5 (stale) Mirror 24: 0x4825bac5 (stale) Mirror 25: 0x9d528519 (stale) Mirror 26: 0xaca019db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f412: skipped 000562 1789067300.761199 trunc from 0x020857 to 0x0299cc (0x9176 bytes) 000563 1789067300.772638 mapwrite 0x0083be thru 0x00fcab (0x78ee bytes) 000564 1789067300.809955 trunc from 0x03f412 to 0x023e01 (0x1b610 bytes) 000565 1789067300.855658 trunc from 0x023e02 to 0x035824 (0x11a23 bytes) 000566 1789067300.872596 mapread 0x009fe3 thru 0x010626 (0x6644 bytes) 000567 1789067300.873545 trunc from 0x026858 to 0x029f6e (0x3717 bytes) 000568 1789067300.879456 fallocate 0x011684 thru 0x013781 (0x20fe bytes) 000569 1789067300.885050 mapwrite 0x036916 thru 0x03ffff (0x96ea bytes) 000570 1789067300.932696 mapread 0x01d685 thru 0x02719d (0x9b19 bytes) 000571 1789067300.952530 trunc from 0x0337ab to 0x03ffff (0xc855 bytes) 000572 1789067300.957567 mapwrite 0x02f525 thru 0x032e7d (0x3959 bytes) 000573 1789067300.970751 trunc from 0x03e497 to 0x03ffff (0x1b69 bytes) 000574 1789067300.975572 write 0x003918 thru 0x00dd3e (0xa427 bytes) 000575 1789067300.978037 read 0x021206 thru 0x0267e0 (0x55db bytes) 000576 1789067300.979608 punch from 0x03c11e to 0x03ffff (0x3ee2 bytes) 000577 1789067300.983515 mapwrite 0x03ba56 thru 0x03ffff (0x45aa bytes) 000578 1789067301.011139 mapread 0x02de02 thru 0x03ae06 (0xd005 bytes) 000579 1789067301.016634 punch from 0x012f43 to 0x02158e (0xe64c bytes) 000580 1789067301.022437 mapwrite 0x022abb thru 0x02f20e (0xc754 bytes) 000581 1789067301.042236 punch from 0x0231f1 to 0x027b28 (0x4938 bytes) 000582 1789067301.047648 write 0x004fa1 thru 0x00b6ec (0x674c bytes) 000583 1789067301.049413 write 0x00b343 thru 0x00fa72 (0x4730 bytes) 000584 1789067301.051762 fallocate 0x023ac6 thru 0x024eeb (0x1426 bytes) 000585 1789067301.058016 trunc from 0x039c93 to 0x03ffff (0x636d bytes) 000586 1789067301.063509 write 0x025168 thru 0x02b37c (0x6215 bytes) 000587 1789067301.069511 mapwrite 0x037014 thru 0x03b633 (0x4620 bytes) 000588 1789067301.117024 mapread 0x02b376 thru 0x02ebca (0x3855 bytes) 000589 1789067301.118542 punch from 0x03976f to 0x03ffff (0x6891 bytes) 000590 1789067301.129247 MIRROR_RESYNC 14 mirrors 000591 1789067305.955714 trunc from 0x003aa5 to 0x006a6f (0x2fcb bytes) 000592 1789067306.048832 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x557d57bb (stale) Mirror 8: 0x557d57bb (stale) Mirror 9: 0x557d57bb (stale) Mirror 14: 0x557d57bb (stale) Mirror 15: 0x557d57bb (stale) Mirror 18: 0x557d57bb (stale) Mirror 19: 0x557d57bb (stale) Mirror 20: 0x557d57bb (stale) Mirror 22: 0x557d57bb (stale) Mirror 23: 0x557d57bb (stale) Mirror 24: 0x557d57bb (stale) Mirror 26: 0x557d57bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x557d57bb (stale) Mirror 8: 0x557d57bb (stale) Mirror 9: 0x557d57bb (stale) Mirror 14: 0x557d57bb (stale) Mirror 15: 0x557d57bb (stale) Mirror 18: 0x557d57bb (stale) Mirror 19: 0x557d57bb (stale) Mirror 20: 0x557d57bb (stale) Mirror 22: 0x557d57bb (stale) Mirror 23: 0x557d57bb (stale) Mirror 24: 0x557d57bb (stale) Mirror 26: 0x557d57bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000593 1789067306.829969 write 0x004729 thru 0x013e04 (0xf6dc bytes) 000594 1789067306.862487 mapread 0x022a8f thru 0x028d56 (0x62c8 bytes) 000595 1789067306.898747 trunc from 0x00adf3 to 0x017d82 (0xcf90 bytes) 000596 1789067306.922697 MIRROR_RESYNC 13 mirrors 000599 1789067311.322419 write 0x036b15 thru 0x03c6be (0x5baa bytes) 000600 1789067311.361159 fallocate 0x00258c thru 0x002e11 (0x886 bytes) 000601 1789067311.366451 mapread 0x03652a thru 0x03ffff (0x9ad6 bytes) 000602 1789067311.388668 punch from 0x02d784 to 0x0386e4 (0xaf61 bytes) 000603 1789067311.401363 mapread 0x01cbe1 thru 0x020500 (0x3920 bytes) 000604 1789067311.407684 trunc from 0x027cd3 to 0x03543c (0xd76a bytes) 000605 1789067311.413449 read 0x02fc03 thru 0x033a0b (0x3e09 bytes) 000606 1789067311.421483 mapread 0x03c06e thru 0x03ffff (0x3f92 bytes) 000607 1789067311.423298 mapread 0x029cea thru 0x036d2a (0xd041 bytes) 000608 1789067311.438229 mapread 0x009f8f thru 0x00c105 (0x2177 bytes) 000609 1789067311.453138 mapread 0x00681f thru 0x00dbf6 (0x73d8 bytes) 000610 1789067311.454308 punch from 0x0113d1 to 0x012c45 (0x1875 bytes) 000611 1789067311.458825 trunc from 0x040000 to 0x0141ac (0x2be53 bytes) 000612 1789067311.487627 read 0x008ec6 thru 0x0141ac (0xb2e7 bytes) 000613 1789067311.518799 fallocate 0x01b4ec thru 0x027fcb (0xcae0 bytes) 000615 1789067311.533073 read 0x00d761 thru 0x011bd6 (0x4476 bytes) 000616 1789067311.538884 fallocate 0x01b278 thru 0x02a96d (0xf6f6 bytes) 000617 1789067311.556383 trunc from 0x008c4d to 0x0141ac (0xb560 bytes) 000618 1789067311.561669 mapread 0x0107a0 thru 0x012eec (0x274d bytes) 000619 1789067311.572235 punch from 0x0095aa to 0x010484 (0x6edb bytes) 000620 1789067311.576344 write 0x0283ca thru 0x032f78 (0xabaf bytes) 000621 1789067311.578793 trunc from 0x00df70 to 0x01d6cc (0xf75d bytes) 000622 1789067311.584255 read 0x0051ed thru 0x00bebc (0x6cd0 bytes) 000623 1789067311.595973 mapwrite 0x03f834 thru 0x03ffff (0x7cc bytes) 000624 1789067311.651693 trunc from 0x03146b to 0x03ffff (0xeb95 bytes) 000625 1789067311.657471 punch from 0x032fa4 to 0x0357bb (0x2818 bytes) 000626 1789067311.662808 punch from 0x011450 to 0x01eb33 (0xd6e4 bytes) 000629 1789067311.668839 trunc from 0x040000 to 0x028679 (0x17986 bytes) 000630 1789067311.683792 mapread 0x0269e7 thru 0x0279c5 (0xfdf bytes) 000631 1789067311.685270 trunc from 0x02867a to 0x035867 (0xd1ee bytes) 000633 1789067311.706248 write 0x034a81 thru 0x036ed8 (0x2458 bytes) 000634 1789067311.711995 trunc from 0x02106f to 0x02f184 (0xe116 bytes) 000635 1789067311.720584 punch from 0x0366c3 to 0x036ed8 (0x816 bytes) 000636 1789067311.734569 read 0x018575 thru 0x0269b4 (0xe440 bytes) 000637 1789067311.753232 trunc from 0x006d76 to 0x010f7a (0xa205 bytes) 000638 1789067311.768496 write 0x028cc1 thru 0x03776f (0xeaaf bytes) 000639 1789067311.771433 write 0x027213 thru 0x029dc9 (0x2bb7 bytes) 000640 1789067311.774189 trunc from 0x037770 to 0x031af3 (0x5c7c bytes) 000641 1789067311.810064 mapread 0x02d445 thru 0x031af3 (0x46af bytes) 000642 1789067311.812517 mapwrite 0x023d90 thru 0x029e2b (0x609c bytes) 000643 1789067311.847848 punch from 0x018fa2 to 0x02898f (0xf9ee bytes) 000645 1789067311.854929 mapread 0x015aec thru 0x0184ed (0x2a02 bytes) 000646 1789067311.860080 write 0x0097cc thru 0x015159 (0xb98e bytes) 000647 1789067311.866022 read 0x00e10c thru 0x018355 (0xa24a bytes) 000648 1789067311.866696 trunc from 0x00b13d to 0x016dec (0xbcb0 bytes) 000649 1789067311.891001 punch from 0x01efcb to 0x01f200 (0x236 bytes) 000650 1789067311.898268 punch from 0x002447 to 0x008d73 (0x692d bytes) 000651 1789067311.902377 punch from 0x01686a to 0x02353a (0xccd1 bytes) 000653 1789067311.910034 punch from 0x00db23 to 0x0154f9 (0x79d7 bytes) 000654 1789067311.916684 read 0x000345 thru 0x00c258 (0xbf14 bytes) 000655 1789067311.959285 read 0x01e321 thru 0x02d158 (0xee38 bytes) 000656 1789067311.967963 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31af4): Mirror 7: 0xe275f8c3 (stale) Mirror 8: 0xe275f8c3 (stale) Mirror 9: 0xe275f8c3 (stale) Mirror 14: 0xe275f8c3 (stale) Mirror 15: 0xe275f8c3 (stale) Mirror 18: 0xe275f8c3 (stale) Mirror 19: 0xe275f8c3 (stale) Mirror 20: 0xe275f8c3 (stale) Mirror 23: 0xe275f8c3 (stale) Mirror 24: 0xe275f8c3 (stale) Mirror 26: 0xe275f8c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31af4): Mirror 7: 0xe275f8c3 (stale) Mirror 8: 0xe275f8c3 (stale) Mirror 9: 0xe275f8c3 (stale) Mirror 14: 0xe275f8c3 (stale) Mirror 15: 0xe275f8c3 (stale) Mirror 18: 0xe275f8c3 (stale) Mirror 19: 0xe275f8c3 (stale) Mirror 20: 0xe275f8c3 (stale) Mirror 23: 0xe275f8c3 (stale) Mirror 24: 0xe275f8c3 (stale) Mirror 26: 0xe275f8c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31af4: skipped 000657 1789067312.608076 write 0x0382e4 thru 0x03ffff (0x7d1c bytes) 000658 1789067312.613551 punch from 0x039e56 to 0x03ffff (0x61aa bytes) 000659 1789067312.636786 trunc from 0x0259bb to 0x02911e (0x3764 bytes) 000660 1789067312.642533 write 0x03f4ef thru 0x03ffff (0xb11 bytes) 000661 1789067312.648549 mapwrite 0x016f81 thru 0x02205d (0xb0dd bytes) 000662 1789067312.728234 punch from 0x035b29 to 0x03b03f (0x5517 bytes) 000664 1789067312.736149 trunc from 0x03185e to 0x03ed2c (0xd4cf bytes) 000665 1789067312.741830 punch from 0x03e016 to 0x03ffff (0x1fea bytes) 000667 1789067312.753651 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8256bd2e (stale) Mirror 8: 0x8256bd2e (stale) Mirror 9: 0x8256bd2e (stale) Mirror 14: 0x8256bd2e (stale) Mirror 15: 0x8256bd2e (stale) Mirror 18: 0x8256bd2e (stale) Mirror 19: 0x8256bd2e (stale) Mirror 20: 0x8256bd2e (stale) Mirror 23: 0x8256bd2e (stale) Mirror 24: 0x8256bd2e (stale) Mirror 26: 0x8256bd2e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x53b5747f Mirror 27: 0x53b5747f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000668 1789067313.826970 trunc from 0x02be66 to 0x036780 (0xa91b bytes) 000669 1789067313.875494 trunc from 0x005a08 to 0x013c64 (0xe25d bytes) 000671 1789067313.884437 trunc from 0x026976 to 0x0364bc (0xfb47 bytes) 000672 1789067313.899237 mapwrite 0x013309 thru 0x021037 (0xdd2f bytes) 000673 1789067313.977101 mapread 0x01843e thru 0x02004f (0x7c12 bytes) 000674 1789067313.980481 mapread 0x01c42d thru 0x0212c3 (0x4e97 bytes) 000675 1789067313.983502 punch from 0x02e0bf to 0x03d22b (0xf16d bytes) 000676 1789067314.001211 MIRROR_RESYNC 13 mirrors 000677 1789067316.220456 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) 000678 1789067316.688257 punch from 0x02edf0 to 0x03530c (0x651d bytes) 000679 1789067316.729684 mapwrite 0x0027e4 thru 0x00619f (0x39bc bytes) 000680 1789067316.782777 trunc from 0x033eae to 0x037916 (0x3a69 bytes) 000681 1789067316.788952 trunc from 0x008ac4 to 0x013a87 (0xafc4 bytes) 000682 1789067316.796946 mapwrite 0x010e62 thru 0x018ef6 (0x8095 bytes) 000683 1789067316.871776 punch from 0x038600 to 0x03ffff (0x7a00 bytes) 000685 1789067316.885226 trunc from 0x015506 to 0x0238f6 (0xe3f1 bytes) 000686 1789067316.894139 fallocate 0x012a6d thru 0x01aceb (0x827f bytes) 000687 1789067316.916526 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe62ab020 (stale) Mirror 8: 0xe62ab020 (stale) Mirror 9: 0xe62ab020 (stale) Mirror 14: 0xe62ab020 (stale) Mirror 18: 0xe62ab020 (stale) Mirror 19: 0xe62ab020 (stale) Mirror 20: 0xe62ab020 (stale) Mirror 23: 0xe62ab020 (stale) Mirror 24: 0xe62ab020 (stale) Mirror 26: 0xe62ab020 (stale) Mirror 27: 0xe62ab020 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x21e147be Mirror 28: 0x21e147be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000688 1789067318.132109 trunc from 0x040000 to 0x03ff21 (0xde bytes) 000689 1789067318.221382 punch from 0x00aa44 to 0x016cd8 (0xc295 bytes) 000690 1789067318.233283 write 0x03029f thru 0x03d735 (0xd497 bytes) 000692 1789067318.249074 trunc from 0x000d27 to 0x0024e7 (0x17c1 bytes) 000693 1789067318.261217 mapread 0x01f522 thru 0x02bc30 (0xc70f bytes) 000694 1789067318.301980 punch from 0x00875c to 0x014b85 (0xc42a bytes) 000696 1789067318.313364 mapwrite 0x01aed2 thru 0x026014 (0xb143 bytes) 000697 1789067318.357768 read 0x00dfa8 thru 0x01a9ba (0xca13 bytes) 000698 1789067318.366027 fallocate 0x02d53c thru 0x03d0c9 (0xfb8e bytes) 000699 1789067318.375366 trunc from 0x02c7b2 to 0x035191 (0x89e0 bytes) 000700 1789067318.397349 fallocate 0x0242db thru 0x03025f (0xbf85 bytes) 000701 1789067318.401924 read 0x01a050 thru 0x025169 (0xb11a bytes) 000702 1789067318.402718 mapread 0x001c8c thru 0x00f914 (0xdc89 bytes) 000703 1789067318.412092 punch from 0x02c7a7 to 0x035e9e (0x96f8 bytes) 000704 1789067318.418258 trunc from 0x027daf to 0x037281 (0xf4d3 bytes) 000705 1789067318.423408 mapread 0x0033b2 thru 0x011d69 (0xe9b8 bytes) 000706 1789067318.424509 trunc from 0x03ff22 to 0x00abdb (0x35346 bytes) 000707 1789067318.456500 punch from 0x0085cf to 0x00abdb (0x260d bytes) 000708 1789067318.463347 trunc from 0x004477 to 0x005bb1 (0x173b bytes) 000709 1789067318.471957 trunc from 0x00abdc to 0x019ebd (0xf2e2 bytes) 000710 1789067318.506474 trunc from 0x01373c to 0x0197de (0x60a3 bytes) 000712 1789067318.519504 mapwrite 0x02f0eb thru 0x03e725 (0xf63b bytes) 000713 1789067318.689422 mapwrite 0x02f899 thru 0x038ce5 (0x944d bytes) 000714 1789067318.723216 mapwrite 0x02b57c thru 0x03a862 (0xf2e7 bytes) 000715 1789067318.785419 mapwrite 0x02d7cb thru 0x03d5e0 (0xfe16 bytes) 000716 1789067318.820032 read 0x0126ad thru 0x015702 (0x3056 bytes) 000717 1789067318.841398 write 0x011610 thru 0x01b7dc (0xa1cd bytes) 000718 1789067318.842780 read 0x0307ee thru 0x0393fd (0x8c10 bytes) 000719 1789067318.848827 mapwrite 0x00afce thru 0x016fc8 (0xbffb bytes) 000720 1789067318.892616 fallocate 0x021947 thru 0x0254f4 (0x3bae bytes) 000721 1789067318.902286 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e726): Mirror 7: 0xaeb72812 (stale) Mirror 8: 0xaeb72812 (stale) Mirror 9: 0xaeb72812 (stale) Mirror 14: 0xaeb72812 (stale) Mirror 18: 0xaeb72812 (stale) Mirror 19: 0xaeb72812 (stale) Mirror 20: 0xaeb72812 (stale) Mirror 23: 0xaeb72812 (stale) Mirror 24: 0xaeb72812 (stale) Mirror 27: 0xaeb72812 (stale) Mirror 28: 0x29fee6ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e726): Mirror 7: 0xaeb72812 (stale) Mirror 8: 0xaeb72812 (stale) Mirror 9: 0xaeb72812 (stale) Mirror 14: 0xaeb72812 (stale) Mirror 18: 0xaeb72812 (stale) Mirror 19: 0xaeb72812 (stale) Mirror 20: 0xaeb72812 (stale) Mirror 23: 0xaeb72812 (stale) Mirror 24: 0xaeb72812 (stale) Mirror 27: 0xaeb72812 (stale) Mirror 28: 0x29fee6ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e726: skipped 000722 1789067319.636151 write 0x038512 thru 0x03b815 (0x3304 bytes) 000723 1789067319.672276 fallocate 0x00aded thru 0x0174af (0xc6c3 bytes) 000724 1789067319.682034 mapwrite 0x036625 thru 0x03f814 (0x91f0 bytes) 000725 1789067319.746957 mapwrite 0x022105 thru 0x02772b (0x5627 bytes) 000726 1789067319.799470 mapread 0x00fbb2 thru 0x0177c2 (0x7c11 bytes) 000727 1789067319.808179 punch from 0x0138ea to 0x01c9d9 (0x90f0 bytes) 000728 1789067319.812847 trunc from 0x03f815 to 0x028090 (0x17784 bytes) 000729 1789067319.827435 trunc from 0x028091 to 0x00a518 (0x1db78 bytes) 000730 1789067319.850503 trunc from 0x00a519 to 0x00abb0 (0x698 bytes) 000731 1789067319.874134 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xabb1): Mirror 7: 0xff83104 (stale) Mirror 8: 0xff83104 (stale) Mirror 14: 0xff83104 (stale) Mirror 18: 0xff83104 (stale) Mirror 19: 0xff83104 (stale) Mirror 20: 0xff83104 (stale) Mirror 23: 0xff83104 (stale) Mirror 24: 0xff83104 (stale) Mirror 27: 0xff83104 (stale) Mirror 28: 0x5a5119ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xabb1): Mirror 7: 0xff83104 (stale) Mirror 8: 0xff83104 (stale) Mirror 14: 0xff83104 (stale) Mirror 18: 0xff83104 (stale) Mirror 19: 0xff83104 (stale) Mirror 20: 0xff83104 (stale) Mirror 23: 0xff83104 (stale) Mirror 24: 0xff83104 (stale) Mirror 27: 0xff83104 (stale) Mirror 28: 0x5a5119ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xabb1: skipped 000732 1789067320.337016 read 0x001f5d thru 0x00abb0 (0x8c54 bytes) 000733 1789067320.350110 trunc from 0x00abb1 to 0x01d829 (0x12c79 bytes) 000734 1789067320.376688 MIRROR_RESYNC 11 mirrors 000735 1789067323.201116 trunc from 0x01d82a to 0x01f6fb (0x1ed2 bytes) 000736 1789067323.272491 fallocate 0x0113bd thru 0x01cb4f (0xb793 bytes) 000737 1789067323.289489 MIRROR_RESYNC 11 mirrors 000738 1789067325.795782 write 0x012009 thru 0x013b22 (0x1b1a bytes) 000739 1789067325.841222 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1f6fc): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f6fc): Mirror 7: 0xadf7cf15 (stale) Mirror 8: 0xadf7cf15 (stale) Mirror 14: 0xadf7cf15 (stale) Mirror 18: 0xadf7cf15 (stale) Mirror 19: 0xadf7cf15 (stale) Mirror 20: 0xadf7cf15 (stale) Mirror 23: 0xadf7cf15 (stale) Mirror 24: 0xadf7cf15 (stale) Mirror 27: 0xadf7cf15 (stale) Mirror 28: 0xadf7cf15 (stale) CRC-32 checksum value for chunk [0, 0x1f6fc): Mirror 1: 0xa8703c74 Mirror 29: 0xa8703c74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f6fc: skipped 000740 1789067326.867617 mapwrite 0x01b0a0 thru 0x01efac (0x3f0d bytes) 000741 1789067326.977259 punch from 0x00fae7 to 0x01ab4c (0xb066 bytes) 000742 1789067326.985404 punch from 0x018b69 to 0x01956f (0xa07 bytes) 000744 1789067326.992145 punch from 0x000d8e to 0x00d64d (0xc8c0 bytes) 000745 1789067326.999491 punch from 0x017fd8 to 0x01f6fb (0x7724 bytes) 000746 1789067327.005565 read 0x008197 thru 0x00ee92 (0x6cfc bytes) 000747 1789067327.014833 write 0x033045 thru 0x0386a0 (0x565c bytes) 000748 1789067327.023680 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x386a1): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x386a1): Mirror 7: 0x13c69f8f (stale) Mirror 8: 0x13c69f8f (stale) Mirror 14: 0x13c69f8f (stale) Mirror 18: 0x13c69f8f (stale) Mirror 19: 0x13c69f8f (stale) Mirror 20: 0x13c69f8f (stale) Mirror 23: 0x13c69f8f (stale) Mirror 24: 0x13c69f8f (stale) Mirror 27: 0x13c69f8f (stale) Mirror 28: 0x13c69f8f (stale) Mirror 29: 0xf96b5e6f (stale) CRC-32 checksum value for chunk [0, 0x386a1): Mirror 1: 0x93c46814 Mirror 30: 0x93c46814 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x386a1: skipped 000749 1789067327.902981 trunc from 0x005a94 to 0x012a8d (0xcffa bytes) 000750 1789067327.947919 trunc from 0x0386a1 to 0x03dc62 (0x55c2 bytes) 000751 1789067327.984002 mapwrite 0x00db7f thru 0x0196f3 (0xbb75 bytes) 000752 1789067328.042344 trunc from 0x03b3c2 to 0x03dc62 (0x28a1 bytes) 000753 1789067328.047931 read 0x00c1d7 thru 0x0167af (0xa5d9 bytes) 000754 1789067328.048813 punch from 0x02dc6b to 0x037283 (0x9619 bytes) 000756 1789067328.060073 read 0x031fec thru 0x033874 (0x1889 bytes) 000757 1789067328.077381 trunc from 0x03dc63 to 0x01b63c (0x22626 bytes) 000758 1789067328.100740 trunc from 0x01b63d to 0x01d51c (0x1ee0 bytes) 000759 1789067328.130502 punch from 0x01ae2f to 0x01d51c (0x26ee bytes) 000760 1789067328.140782 fallocate 0x0284e9 thru 0x02ac40 (0x2758 bytes) 000761 1789067328.149397 write 0x026b81 thru 0x033e86 (0xd306 bytes) 000762 1789067328.156349 trunc from 0x033e87 to 0x016dfa (0x1d08c bytes) 000763 1789067328.171346 trunc from 0x00a4e9 to 0x0129af (0x84c7 bytes) 000764 1789067328.176033 read 0x00b25b thru 0x015cd6 (0xaa7c bytes) 000765 1789067328.183291 trunc from 0x016dfb to 0x0346d3 (0x1d8d9 bytes) 000766 1789067328.196831 read 0x024b46 thru 0x02cf28 (0x83e3 bytes) 000767 1789067328.213177 MIRROR_RESYNC 13 mirrors 000768 1789067330.748207 mapread 0x000511 thru 0x00df62 (0xda52 bytes) 000769 1789067330.781113 write 0x03f857 thru 0x03ffff (0x7a9 bytes) 000770 1789067330.824390 mapwrite 0x0110aa thru 0x01a0b0 (0x9007 bytes) 000771 1789067330.874830 mapread 0x002f44 thru 0x009bcf (0x6c8c bytes) 000772 1789067330.886186 mapread 0x0152aa thru 0x020412 (0xb169 bytes) 000775 1789067330.890096 fallocate 0x0119fb thru 0x01cb2f (0xb135 bytes) 000776 1789067330.896903 write 0x03ed9a thru 0x03ffff (0x1266 bytes) 000778 1789067330.903142 punch from 0x020cd9 to 0x02fc71 (0xef99 bytes) 000779 1789067330.909111 mapwrite 0x00c08e thru 0x019213 (0xd186 bytes) 000780 1789067330.931357 trunc from 0x040000 to 0x02dff3 (0x1200c bytes) 000782 1789067330.947824 punch from 0x02a2e9 to 0x02dff3 (0x3d0b bytes) 000783 1789067330.952614 trunc from 0x02dff4 to 0x03d029 (0xf036 bytes) 000784 1789067330.985226 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d02a): Mirror 7: 0x78abfe65 (stale) Mirror 8: 0x78abfe65 (stale) Mirror 14: 0x78abfe65 (stale) Mirror 18: 0x78abfe65 (stale) Mirror 19: 0x78abfe65 (stale) Mirror 20: 0x78abfe65 (stale) Mirror 23: 0x78abfe65 (stale) Mirror 24: 0x78abfe65 (stale) Mirror 27: 0x78abfe65 (stale) Mirror 28: 0x78abfe65 (stale) Mirror 29: 0x78abfe65 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d02a): Mirror 7: 0x78abfe65 (stale) Mirror 8: 0x78abfe65 (stale) Mirror 14: 0x78abfe65 (stale) Mirror 18: 0x78abfe65 (stale) Mirror 19: 0x78abfe65 (stale) Mirror 20: 0x78abfe65 (stale) Mirror 23: 0x78abfe65 (stale) Mirror 24: 0x78abfe65 (stale) Mirror 27: 0x78abfe65 (stale) Mirror 28: 0x78abfe65 (stale) Mirror 29: 0x78abfe65 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d02a: skipped 000785 1789067331.673774 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d02a): Mirror 8: 0x78abfe65 (stale) Mirror 14: 0x78abfe65 (stale) Mirror 18: 0x78abfe65 (stale) Mirror 19: 0x78abfe65 (stale) Mirror 20: 0x78abfe65 (stale) Mirror 23: 0x78abfe65 (stale) Mirror 24: 0x78abfe65 (stale) Mirror 27: 0x78abfe65 (stale) Mirror 28: 0x78abfe65 (stale) Mirror 29: 0x78abfe65 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d02a): Mirror 8: 0x78abfe65 (stale) Mirror 14: 0x78abfe65 (stale) Mirror 18: 0x78abfe65 (stale) Mirror 19: 0x78abfe65 (stale) Mirror 20: 0x78abfe65 (stale) Mirror 23: 0x78abfe65 (stale) Mirror 24: 0x78abfe65 (stale) Mirror 27: 0x78abfe65 (stale) Mirror 28: 0x78abfe65 (stale) Mirror 29: 0x78abfe65 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d02a: skipped 000786 1789067332.283069 read 0x0126a5 thru 0x01ad74 (0x86d0 bytes) 000787 1789067332.292139 read 0x033403 thru 0x03d029 (0x9c27 bytes) 000788 1789067332.300348 write 0x00c5c4 thru 0x01625c (0x9c99 bytes) 000789 1789067332.304718 punch from 0x02e15d to 0x03b073 (0xcf17 bytes) 000790 1789067332.311921 mapwrite 0x021497 thru 0x02830c (0x6e76 bytes) 000791 1789067332.327906 fallocate 0x00f7e3 thru 0x017d26 (0x8544 bytes) 000792 1789067332.333447 punch from 0x0283ce to 0x035b3a (0xd76d bytes) 000794 1789067332.341392 read 0x035ad9 thru 0x03d029 (0x7551 bytes) 000795 1789067332.369133 mapwrite 0x00da3a thru 0x00e9ba (0xf81 bytes) 000796 1789067332.382100 mapread 0x039a48 thru 0x03a424 (0x9dd bytes) 000798 1789067332.383538 mapread 0x01f852 thru 0x020c2c (0x13db bytes) 000799 1789067332.384451 mapread 0x00d2d5 thru 0x010b66 (0x3892 bytes) 000802 1789067332.386481 trunc from 0x0391d3 to 0x03d029 (0x3e57 bytes) 000803 1789067332.394396 trunc from 0x01bb2d to 0x02163f (0x5b13 bytes) 000804 1789067332.402670 mapwrite 0x001440 thru 0x011089 (0xfc4a bytes) 000805 1789067332.431375 trunc from 0x03d02a to 0x026864 (0x167c5 bytes) 000806 1789067332.451881 punch from 0x00e3d3 to 0x0131d9 (0x4e07 bytes) 000807 1789067332.457780 trunc from 0x001517 to 0x010614 (0xf0fe bytes) 000808 1789067332.464308 punch from 0x00140e to 0x004564 (0x3157 bytes) 000809 1789067332.469070 write 0x009398 thru 0x012605 (0x926e bytes) 000810 1789067332.477819 trunc from 0x01c088 to 0x026864 (0xa7dd bytes) 000811 1789067332.483361 trunc from 0x026865 to 0x008fca (0x1d89a bytes) 000812 1789067332.498443 mapwrite 0x010122 thru 0x012bf3 (0x2ad2 bytes) 000813 1789067332.549050 trunc from 0x012bf4 to 0x002597 (0x1065c bytes) 000814 1789067332.578820 punch from 0x001653 to 0x002597 (0xf45 bytes) 000815 1789067332.589356 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2598): Mirror 8: 0x2cc876ba (stale) Mirror 18: 0x2cc876ba (stale) Mirror 19: 0x2cc876ba (stale) Mirror 20: 0x2cc876ba (stale) Mirror 23: 0x2cc876ba (stale) Mirror 24: 0x2cc876ba (stale) Mirror 27: 0x2cc876ba (stale) Mirror 28: 0x2cc876ba (stale) Mirror 29: 0x2cc876ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2598): Mirror 8: 0x2cc876ba (stale) Mirror 18: 0x2cc876ba (stale) Mirror 19: 0x2cc876ba (stale) Mirror 20: 0x2cc876ba (stale) Mirror 23: 0x2cc876ba (stale) Mirror 24: 0x2cc876ba (stale) Mirror 27: 0x2cc876ba (stale) Mirror 28: 0x2cc876ba (stale) Mirror 29: 0x2cc876ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2598: skipped 000817 1789067332.972805 punch from 0x000d75 to 0x002597 (0x1823 bytes) 000818 1789067332.986207 mapread 0x001e3f thru 0x002597 (0x759 bytes) 000819 1789067333.017264 write 0x017972 thru 0x0194d6 (0x1b65 bytes) 000820 1789067333.026416 trunc from 0x0194d7 to 0x02e60a (0x15134 bytes) 000821 1789067333.040097 trunc from 0x01d70c to 0x02664b (0x8f40 bytes) 000822 1789067333.044992 trunc from 0x02e60b to 0x0309d5 (0x23cb bytes) 000823 1789067333.060901 punch from 0x02d744 to 0x0309d5 (0x3292 bytes) 000824 1789067333.066650 mapwrite 0x001835 thru 0x0078c8 (0x6094 bytes) 000825 1789067333.098071 trunc from 0x0309d6 to 0x038ebe (0x84e9 bytes) 000826 1789067333.117804 punch from 0x01f819 to 0x021d53 (0x253b bytes) 000827 1789067333.124156 fallocate 0x034ebb thru 0x03ffff (0xb145 bytes) 000828 1789067333.131063 mapread 0x009429 thru 0x00dc7f (0x4857 bytes) 000829 1789067333.132145 mapwrite 0x039b17 thru 0x03ffff (0x64e9 bytes) 000830 1789067333.263829 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x96ed2025 (stale) Mirror 18: 0x96ed2025 (stale) Mirror 19: 0x96ed2025 (stale) Mirror 20: 0x96ed2025 (stale) Mirror 23: 0x96ed2025 (stale) Mirror 24: 0x96ed2025 (stale) Mirror 27: 0x96ed2025 (stale) Mirror 28: 0x96ed2025 (stale) Mirror 29: 0x96ed2025 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1f61164 Mirror 30: 0xc1f61164 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000832 1789067335.010838 mapread 0x004a1b thru 0x00afd8 (0x65be bytes) 000833 1789067335.065287 write 0x017850 thru 0x0202fb (0x8aac bytes) 000834 1789067335.160548 write 0x028ddc thru 0x0389df (0xfc04 bytes) 000835 1789067335.169650 trunc from 0x040000 to 0x012877 (0x2d788 bytes) 000836 1789067335.202763 trunc from 0x009251 to 0x012877 (0x9627 bytes) 000837 1789067335.206456 fallocate 0x002992 thru 0x00bafc (0x916b bytes) 000838 1789067335.210808 fallocate 0x00b75f thru 0x018285 (0xcb27 bytes) 000839 1789067335.215255 write 0x03ae9d thru 0x03ffff (0x5163 bytes) 000840 1789067335.216827 read 0x00462a thru 0x00ed3a (0xa711 bytes) 000841 1789067335.224652 mapwrite 0x035bb3 thru 0x03ffff (0xa44d bytes) 000842 1789067335.244383 mapread 0x019575 thru 0x027f30 (0xe9bc bytes) 000843 1789067335.264524 read 0x03a377 thru 0x03fd96 (0x5a20 bytes) 000844 1789067335.265647 trunc from 0x040000 to 0x033481 (0xcb7e bytes) 000845 1789067335.276072 write 0x03ba71 thru 0x03ffff (0x458f bytes) 000846 1789067335.278290 write 0x03bb3b thru 0x03ffff (0x44c5 bytes) 000849 1789067335.281262 trunc from 0x03d34c to 0x03e511 (0x11c6 bytes) 000850 1789067335.293419 read 0x03fe18 thru 0x03ffff (0x1e8 bytes) 000851 1789067335.294317 fallocate 0x02b72c thru 0x0334a6 (0x7d7b bytes) 000852 1789067335.298334 trunc from 0x007118 to 0x00a63e (0x3527 bytes) 000853 1789067335.306501 punch from 0x02fabe to 0x0346af (0x4bf2 bytes) 000854 1789067335.313951 read 0x026c2c thru 0x036137 (0xf50c bytes) 000855 1789067335.332836 fallocate 0x03ce04 thru 0x03ffff (0x31fc bytes) 000856 1789067335.364255 MIRROR_RESYNC 11 mirrors 000857 1789067336.951517 fallocate 0x00559a thru 0x00633e (0xda5 bytes) 000858 1789067336.987720 trunc from 0x040000 to 0x023f87 (0x1c078 bytes) 000859 1789067337.008398 trunc from 0x023f88 to 0x00ee47 (0x15140 bytes) 000860 1789067337.042092 mapread 0x000658 thru 0x00928d (0x8c36 bytes) 000861 1789067337.082399 MIRROR_RESYNC 11 mirrors 000862 1789067338.794394 read 0x000edb thru 0x00a7ce (0x98f4 bytes) 000863 1789067338.809984 punch from 0x009bbf to 0x00ee47 (0x5289 bytes) 000864 1789067338.861739 mapwrite 0x00104e thru 0x00f2d4 (0xe287 bytes) 000866 1789067339.024988 trunc from 0x00abb1 to 0x00f2d4 (0x4724 bytes) 000867 1789067339.040774 mapread 0x009a0b thru 0x00a146 (0x73c bytes) 000868 1789067339.065135 trunc from 0x00dd09 to 0x00f2d4 (0x15cc bytes) 000869 1789067339.076788 mapread 0x00b910 thru 0x00eb0d (0x31fe bytes) 000870 1789067339.100281 write 0x027099 thru 0x02f6c2 (0x862a bytes) 000871 1789067339.106844 mapwrite 0x009e25 thru 0x00fa4c (0x5c28 bytes) 000872 1789067339.169289 punch from 0x013547 to 0x01bff6 (0x8ab0 bytes) 000873 1789067339.190078 MIRROR_RESYNC 11 mirrors 000874 1789067341.487716 trunc from 0x0018b4 to 0x00655a (0x4ca7 bytes) 000875 1789067341.523051 fallocate 0x02c302 thru 0x038e8f (0xcb8e bytes) 000876 1789067341.530402 write 0x017172 thru 0x01a81f (0x36ae bytes) 000878 1789067341.540255 punch from 0x0030a9 to 0x004fbc (0x1f14 bytes) 000879 1789067341.551909 punch from 0x015ccc to 0x021c2e (0xbf63 bytes) 000880 1789067341.564937 read 0x02ba0a thru 0x0326b9 (0x6cb0 bytes) 000882 1789067341.578579 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x38e90): Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e90): Mirror 8: 0x26b433bf (stale) Mirror 18: 0x26b433bf (stale) Mirror 19: 0x26b433bf (stale) Mirror 20: 0x26b433bf (stale) Mirror 23: 0x26b433bf (stale) Mirror 24: 0x26b433bf (stale) Mirror 27: 0x26b433bf (stale) Mirror 28: 0x26b433bf (stale) Mirror 29: 0x26b433bf (stale) Mirror 30: 0x26b433bf (stale) CRC-32 checksum value for chunk [0, 0x38e90): Mirror 1: 0xc9ecdea8 Mirror 31: 0xc9ecdea8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e90: skipped 000883 1789067343.283411 trunc from 0x038e90 to 0x0342e7 (0x4ba8 bytes) 000884 1789067343.371006 mapread 0x00d046 thru 0x01655b (0x9516 bytes) 000885 1789067343.400366 trunc from 0x0342e8 to 0x016ed7 (0x1d410 bytes) 000887 1789067343.439415 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x16ed8): Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16ed8): Mirror 8: 0xb90df9bd (stale) Mirror 18: 0xb90df9bd (stale) Mirror 19: 0xb90df9bd (stale) Mirror 20: 0xb90df9bd (stale) Mirror 23: 0xb90df9bd (stale) Mirror 24: 0xb90df9bd (stale) Mirror 27: 0xb90df9bd (stale) Mirror 28: 0xb90df9bd (stale) Mirror 29: 0xb90df9bd (stale) Mirror 30: 0xb90df9bd (stale) Mirror 31: 0x619de4fa (stale) CRC-32 checksum value for chunk [0, 0x16ed8): Mirror 1: 0x619de4fa Mirror 32: 0x619de4fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16ed8: skipped 000888 1789067344.786197 punch from 0x0109d9 to 0x0163fb (0x5a23 bytes) 000889 1789067344.897352 trunc from 0x016ed8 to 0x01d927 (0x6a50 bytes) 000891 1789067344.987200 trunc from 0x00b8ac to 0x01ad0d (0xf462 bytes) 000893 1789067344.999415 mapwrite 0x00f46b thru 0x01699d (0x7533 bytes) 000894 1789067345.097797 fallocate 0x0373f3 thru 0x03ffff (0x8c0d bytes) 000895 1789067345.129380 MIRROR_RESYNC 13 mirrors 000896 1789067349.556844 read 0x002b7e thru 0x00e31f (0xb7a2 bytes) 000897 1789067349.591066 mapread 0x015684 thru 0x017117 (0x1a94 bytes) 000898 1789067349.641268 MIRROR_RESYNC 13 mirrors 000899 1789067350.592806 write 0x00e272 thru 0x010526 (0x22b5 bytes) 000900 1789067350.652403 fallocate 0x0082f9 thru 0x00a0f2 (0x1dfa bytes) 000901 1789067350.661700 punch from 0x0017b6 to 0x00437b (0x2bc6 bytes) 000902 1789067350.675046 read 0x00339e thru 0x013275 (0xfed8 bytes) 000904 1789067350.697827 mapread 0x01d40a thru 0x01d927 (0x51e bytes) 000905 1789067350.703950 write 0x02f4a5 thru 0x030c4c (0x17a8 bytes) 000906 1789067350.705114 mapwrite 0x009b48 thru 0x00fd20 (0x61d9 bytes) 000907 1789067350.729746 mapwrite 0x0056d7 thru 0x011cc4 (0xc5ee bytes) 000908 1789067350.763531 fallocate 0x03ba73 thru 0x03ffff (0x458d bytes) 000909 1789067350.769116 trunc from 0x040000 to 0x02394f (0x1c6b0 bytes) 000910 1789067350.807133 write 0x008323 thru 0x00c5dc (0x42ba bytes) 000911 1789067350.812462 mapread 0x008ffc thru 0x00de52 (0x4e57 bytes) 000913 1789067350.826736 MIRROR_RESYNC 13 mirrors 000914 1789067352.922197 trunc from 0x023950 to 0x00f6e5 (0x1426a bytes) 000915 1789067352.967510 trunc from 0x00f6e6 to 0x02f6bd (0x1ffd8 bytes) 000916 1789067353.038103 punch from 0x026bcd to 0x02d7a1 (0x6bd5 bytes) 000917 1789067353.049787 punch from 0x00866f to 0x009ee0 (0x1872 bytes) 000918 1789067353.062075 mapwrite 0x00b2f5 thru 0x0175e6 (0xc2f2 bytes) 000919 1789067353.144346 punch from 0x021c1e to 0x0270b5 (0x5498 bytes) 000920 1789067353.150157 fallocate 0x033e51 thru 0x03ae84 (0x7034 bytes) 000921 1789067353.157318 mapwrite 0x016229 thru 0x021e78 (0xbc50 bytes) 000922 1789067353.218079 punch from 0x01750e to 0x022d0f (0xb802 bytes) 000923 1789067353.226306 punch from 0x029847 to 0x02d885 (0x403f bytes) 000924 1789067353.242949 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2f6be): Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f6be): Mirror 8: 0x7880c48c (stale) Mirror 18: 0x7880c48c (stale) Mirror 19: 0x7880c48c (stale) Mirror 20: 0x7880c48c (stale) Mirror 23: 0x7880c48c (stale) Mirror 24: 0x7880c48c (stale) Mirror 27: 0x7880c48c (stale) Mirror 28: 0x7880c48c (stale) Mirror 29: 0x7880c48c (stale) Mirror 30: 0x7880c48c (stale) Mirror 31: 0x7880c48c (stale) Mirror 32: 0x7880c48c (stale) CRC-32 checksum value for chunk [0, 0x2f6be): Mirror 1: 0x65399a4b Mirror 33: 0x65399a4b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f6be: skipped 000925 1789067354.371456 trunc from 0x02f6be to 0x0372af (0x7bf2 bytes) 000926 1789067354.474130 mapwrite 0x0162bf thru 0x01685b (0x59d bytes) 000927 1789067354.489029 punch from 0x0097c6 to 0x00ae05 (0x1640 bytes) 000928 1789067354.493076 fallocate 0x02d9ee thru 0x037590 (0x9ba3 bytes) 000929 1789067354.496722 fallocate 0x02f717 thru 0x0318b7 (0x21a1 bytes) 000930 1789067354.502278 trunc from 0x00cb03 to 0x019311 (0xc80f bytes) 000932 1789067354.508407 punch from 0x024a36 to 0x0346e0 (0xfcab bytes) 000933 1789067354.513124 write 0x01f825 thru 0x029dfd (0xa5d9 bytes) 000934 1789067354.523075 punch from 0x009c74 to 0x010cea (0x7077 bytes) 000935 1789067354.528003 punch from 0x021c9c to 0x028210 (0x6575 bytes) 000936 1789067354.544807 punch from 0x000f5f to 0x00f7a4 (0xe846 bytes) 000937 1789067354.553496 read 0x02897e thru 0x0308db (0x7f5e bytes) 000938 1789067354.561895 fallocate 0x00bd11 thru 0x00fca0 (0x3f90 bytes) 000939 1789067354.567626 mapread 0x025e28 thru 0x034414 (0xe5ed bytes) 000940 1789067354.590251 fallocate 0x01c7c8 thru 0x022c85 (0x64be bytes) 000941 1789067354.601027 trunc from 0x001df9 to 0x00f1bf (0xd3c7 bytes) 000942 1789067354.613067 read 0x018efd thru 0x01bb77 (0x2c7b bytes) 000943 1789067354.637325 MIRROR_RESYNC 14 mirrors 000944 1789067357.862137 write 0x02fb8f thru 0x0300a1 (0x513 bytes) 000945 1789067357.974126 mapread 0x01d63a thru 0x02b871 (0xe238 bytes) 000947 1789067358.030039 mapwrite 0x019f32 thru 0x0239ea (0x9ab9 bytes) 000948 1789067358.066619 trunc from 0x037591 to 0x014bbc (0x229d4 bytes) 000949 1789067358.096587 write 0x018115 thru 0x021176 (0x9062 bytes) 000950 1789067358.100180 fallocate 0x00cb33 thru 0x00d0eb (0x5b9 bytes) 000951 1789067358.106616 mapwrite 0x03fd7d thru 0x03ffff (0x283 bytes) 000953 1789067358.163342 read 0x00a09e thru 0x016032 (0xbf95 bytes) 000954 1789067358.182839 write 0x01bb6e thru 0x0241d6 (0x8669 bytes) 000955 1789067358.189181 read 0x03d66a thru 0x03ffff (0x2996 bytes) 000956 1789067358.189979 punch from 0x0162a5 to 0x016c3e (0x99a bytes) 000957 1789067358.199010 trunc from 0x0391d0 to 0x03ffff (0x6e30 bytes) 000958 1789067358.208572 MIRROR_RESYNC 14 mirrors 000959 1789067360.710186 trunc from 0x01dbba to 0x02c85c (0xeca3 bytes) 000960 1789067360.746050 trunc from 0x039a31 to 0x03d356 (0x3926 bytes) 000962 1789067360.751150 read 0x001441 thru 0x0045cf (0x318f bytes) 000963 1789067360.757270 fallocate 0x0305b6 thru 0x0335f7 (0x3042 bytes) 000964 1789067360.765374 MIRROR_RESYNC 14 mirrors 000965 1789067363.108330 mapread 0x0004be thru 0x0040b8 (0x3bfb bytes) 000966 1789067363.155970 fallocate 0x01e745 thru 0x022acf (0x438b bytes) 000967 1789067363.216537 trunc from 0x03a7fa to 0x03ffff (0x5806 bytes) 000968 1789067363.225555 mapread 0x02802b thru 0x02dc01 (0x5bd7 bytes) 000969 1789067363.238152 read 0x0144e9 thru 0x016c3e (0x2756 bytes) 000970 1789067363.244276 read 0x02af31 thru 0x034c94 (0x9d64 bytes) 000971 1789067363.269282 write 0x00cc87 thru 0x00eeb7 (0x2231 bytes) 000972 1789067363.272137 read 0x03645d thru 0x03ffff (0x9ba3 bytes) 000973 1789067363.273719 mapread 0x029dcd thru 0x031125 (0x7359 bytes) 000976 1789067363.282970 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x28:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x5abdbf1a (stale) Mirror 18: 0x5abdbf1a (stale) Mirror 20: 0x5abdbf1a (stale) Mirror 23: 0x5abdbf1a (stale) Mirror 24: 0x5abdbf1a (stale) Mirror 27: 0x5abdbf1a (stale) Mirror 28: 0x5abdbf1a (stale) Mirror 29: 0x5abdbf1a (stale) Mirror 30: 0x5abdbf1a (stale) Mirror 31: 0x5abdbf1a (stale) Mirror 32: 0x5abdbf1a (stale) Mirror 33: 0x5abdbf1a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x5abdbf1a (stale) Mirror 18: 0x5abdbf1a (stale) Mirror 20: 0x5abdbf1a (stale) Mirror 23: 0x5abdbf1a (stale) Mirror 24: 0x5abdbf1a (stale) Mirror 27: 0x5abdbf1a (stale) Mirror 28: 0x5abdbf1a (stale) Mirror 29: 0x5abdbf1a (stale) Mirror 30: 0x5abdbf1a (stale) Mirror 31: 0x5abdbf1a (stale) Mirror 32: 0x5abdbf1a (stale) Mirror 33: 0x5abdbf1a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000977 1789067364.027422 punch from 0x03af6d to 0x03ffff (0x5093 bytes) 000979 1789067364.035761 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x5abdbf1a (stale) Mirror 18: 0x5abdbf1a (stale) Mirror 20: 0x5abdbf1a (stale) Mirror 23: 0x5abdbf1a (stale) Mirror 24: 0x5abdbf1a (stale) Mirror 27: 0x5abdbf1a (stale) Mirror 28: 0x5abdbf1a (stale) Mirror 29: 0x5abdbf1a (stale) Mirror 30: 0x5abdbf1a (stale) Mirror 31: 0x5abdbf1a (stale) Mirror 32: 0x5abdbf1a (stale) Mirror 33: 0x5abdbf1a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x11bc84ac Mirror 34: 0x11bc84ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000980 1789067365.273163 trunc from 0x040000 to 0x013923 (0x2c6dc bytes) 000981 1789067365.342501 fallocate 0x01c492 thru 0x02172a (0x5299 bytes) 000982 1789067365.347927 mapread 0x004891 thru 0x00531f (0xa8f bytes) 000983 1789067365.357435 write 0x00f6b6 thru 0x013be6 (0x4531 bytes) 000984 1789067365.368333 fallocate 0x02182f thru 0x024db7 (0x3589 bytes) 000985 1789067365.374523 trunc from 0x02172b to 0x03ca39 (0x1b30f bytes) 000986 1789067365.404385 MIRROR_RESYNC 14 mirrors 000987 1789067367.934611 write 0x02247a thru 0x028765 (0x62ec bytes) 000988 1789067367.975500 mapread 0x0388c1 thru 0x03ca39 (0x4179 bytes) 000989 1789067368.010206 fallocate 0x017806 thru 0x0191c0 (0x19bb bytes) 000990 1789067368.018169 read 0x02ab2f thru 0x037c08 (0xd0da bytes) 000991 1789067368.031299 trunc from 0x03ca3a to 0x005073 (0x379c6 bytes) 000992 1789067368.049391 fallocate 0x0006b7 thru 0x00c0bf (0xba09 bytes) 000993 1789067368.054740 write 0x00dd42 thru 0x012b33 (0x4df2 bytes) 000994 1789067368.056757 trunc from 0x010c16 to 0x011f50 (0x133b bytes) 000995 1789067368.076657 trunc from 0x012b34 to 0x0299f4 (0x16ec1 bytes) 000996 1789067368.095324 trunc from 0x0299f5 to 0x02ed58 (0x5364 bytes) 000997 1789067368.121288 trunc from 0x020608 to 0x0277cc (0x71c5 bytes) 000998 1789067368.128090 write 0x03d046 thru 0x03ffff (0x2fba bytes) 001000 1789067368.133146 punch from 0x03ab41 to 0x03ffff (0x54bf bytes) All operations completed A-OK!