== sanity-flr test 70a: flr mode fsx test ================ 06:54:14 (1781693654) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 3654 fallocating to largest ever: 0x3b792 000001 1781693654.853802 fallocate 0x02fe8a thru 0x03b791 (0xb908 bytes) 000002 1781693654.859587 fallocate 0x02569a thru 0x02c06c (0x69d3 bytes) 000003 1781693654.862043 read 0x034760 thru 0x03b791 (0x7032 bytes) 000004 1781693654.865467 mapwrite 0x011220 thru 0x01be95 (0xac76 bytes) 000005 1781693654.885960 write 0x0302b9 thru 0x031dc9 (0x1b11 bytes) 000009 1781693654.891043 mapwrite 0x0265e0 thru 0x0277f6 (0x1217 bytes) 000010 1781693654.907544 punch from 0x03a72c to 0x03b791 (0x1066 bytes) 000012 1781693654.910089 mapread 0x03a551 thru 0x03b791 (0x1241 bytes) 000013 1781693654.913453 read 0x020ed8 thru 0x02f356 (0xe47f bytes) 000014 1781693654.916842 trunc from 0x03b792 to 0x00eaac (0x2cce5 bytes) 000015 1781693654.922119 punch from 0x00dccb to 0x00e5f7 (0x92d bytes) 000016 1781693654.923987 mapread 0x00c7c3 thru 0x00eaac (0x22ea bytes) 000017 1781693654.928160 read 0x00cc7a thru 0x00eaac (0x1e33 bytes) 000018 1781693654.928782 mapwrite 0x03d27f thru 0x03e3af (0x1131 bytes) 000020 1781693654.945556 MIRROR_EXTEND to 2 mirrors 000021 1781693655.239569 fallocate 0x028a9e thru 0x0369cc (0xdf2f bytes) 000022 1781693655.257247 punch from 0x003f7c to 0x0135d4 (0xf659 bytes) 000023 1781693655.262467 write 0x0011f9 thru 0x00ce6f (0xbc77 bytes) 000024 1781693655.272381 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e3b0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3b0): Mirror 2: 0xcd00a66d (stale) CRC-32 checksum value for chunk [0, 0x3e3b0): Mirror 1: 0xfe0a5e32 Mirror 3: 0xfe0a5e32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3b0: skipped 000025 1781693655.664773 mapread 0x0028b6 thru 0x005156 (0x28a1 bytes) 000026 1781693655.677111 write 0x00193a thru 0x002d68 (0x142f bytes) 000027 1781693655.693922 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e3b0): Mirror 3: 0xfe0a5e32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3b0): Mirror 3: 0xfe0a5e32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3b0: skipped 000028 1781693655.822536 trunc from 0x02c919 to 0x02fc9f (0x3387 bytes) 000029 1781693655.824879 fallocate 0x02465a thru 0x0303e4 (0xbd8b bytes) 000030 1781693655.829231 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000031 1781693655.896946 mapread 0x0171db thru 0x0210a4 (0x9eca bytes) 000032 1781693655.910999 trunc from 0x0104d3 to 0x01748b (0x6fb9 bytes) 000033 1781693655.919700 write 0x03526b thru 0x03ffff (0xad95 bytes) 000035 1781693655.928107 trunc from 0x01d436 to 0x0297e6 (0xc3b1 bytes) 000036 1781693655.933105 write 0x010e25 thru 0x01cf47 (0xc123 bytes) 000037 1781693655.935929 read 0x02dd0b thru 0x033178 (0x546e bytes) 000038 1781693655.939510 write 0x021cc2 thru 0x02a3da (0x8719 bytes) 000039 1781693655.945598 trunc from 0x035506 to 0x03a4f9 (0x4ff4 bytes) 000040 1781693655.958099 read 0x00293f thru 0x004efe (0x25c0 bytes) 000041 1781693655.962741 mapread 0x013ac0 thru 0x01efa8 (0xb4e9 bytes) 000042 1781693655.963838 trunc from 0x02db2f to 0x03a297 (0xc769 bytes) 000043 1781693655.966165 fallocate 0x0278e0 thru 0x032a86 (0xb1a7 bytes) 000044 1781693655.968521 mapread 0x023adf thru 0x031c26 (0xe148 bytes) 000045 1781693655.977081 mapwrite 0x00b8f1 thru 0x00f655 (0x3d65 bytes) 000047 1781693655.984966 write 0x01d328 thru 0x02af12 (0xdbeb bytes) 000048 1781693655.986336 punch from 0x011e90 to 0x01a703 (0x8874 bytes) 000049 1781693655.988947 fallocate 0x003f74 thru 0x0082c6 (0x4353 bytes) 000051 1781693655.991553 fallocate 0x01b388 thru 0x024662 (0x92db bytes) 000052 1781693655.993651 mapwrite 0x00ccf0 thru 0x0164c0 (0x97d1 bytes) 000053 1781693656.011751 read 0x010294 thru 0x01cba0 (0xc90d bytes) 000054 1781693656.016022 read 0x00698e thru 0x00a26c (0x38df bytes) 000055 1781693656.016475 trunc from 0x040000 to 0x02e3bf (0x11c40 bytes) 000057 1781693656.022627 read 0x01457e thru 0x014949 (0x3cc bytes) truncating to largest ever: 0x3ecfa 000058 1781693656.023396 trunc from 0x02e3c0 to 0x03ecf9 (0x1093a bytes) 000060 1781693656.030249 trunc from 0x027cc6 to 0x02890b (0xc46 bytes) 000061 1781693656.032630 mapwrite 0x01a221 thru 0x02374b (0x952b bytes) 000062 1781693656.040753 write 0x00a4e5 thru 0x00d86f (0x338b bytes) 000063 1781693656.041529 trunc from 0x03ecfa to 0x0117b7 (0x2d542 bytes) 000064 1781693656.055279 write 0x002dc2 thru 0x00669c (0x38db bytes) 000066 1781693656.057039 punch from 0x006112 to 0x00b3f2 (0x52e1 bytes) 000067 1781693656.065971 fallocate 0x020e25 thru 0x029337 (0x8513 bytes) 000070 1781693656.071665 MIRROR_EXTEND to 2 mirrors 000071 1781693656.249208 mapread 0x001856 thru 0x00be48 (0xa5f3 bytes) 000072 1781693656.255198 trunc from 0x009857 to 0x00c6b2 (0x2e5c bytes) 000073 1781693656.267454 write 0x02dba2 thru 0x031c9f (0x40fe bytes) 000074 1781693656.270982 trunc from 0x015c17 to 0x022e0d (0xd1f7 bytes) 000075 1781693656.273124 punch from 0x025cc7 to 0x02a1ba (0x44f4 bytes) 000076 1781693656.275010 trunc from 0x031ca0 to 0x004ef4 (0x2cdab bytes) 000077 1781693656.286722 fallocate 0x036202 thru 0x03d83b (0x763a bytes) 000078 1781693656.288989 trunc from 0x00c2e8 to 0x01b084 (0xed9d bytes) 000079 1781693656.290760 trunc from 0x01aa1e to 0x0213f7 (0x69da bytes) 000080 1781693656.292614 trunc from 0x0157d1 to 0x01ccc4 (0x74f4 bytes) 000081 1781693656.294498 fallocate 0x0171fb thru 0x026b27 (0xf92d bytes) 000082 1781693656.296496 trunc from 0x03d83c to 0x033009 (0xa832 bytes) 000083 1781693656.302281 mapread 0x02df97 thru 0x033009 (0x5073 bytes) 000084 1781693656.306152 trunc from 0x03300a to 0x014729 (0x1e8e0 bytes) 000085 1781693656.312426 read 0x0097b4 thru 0x014729 (0xaf76 bytes) fallocating to largest ever: 0x40000 000086 1781693656.315745 fallocate 0x037a2a thru 0x03ffff (0x85d6 bytes) 000087 1781693656.318010 punch from 0x01091d to 0x011874 (0xf58 bytes) 000088 1781693656.319608 punch from 0x0062db to 0x007851 (0x1577 bytes) 000089 1781693656.321177 read 0x0016bf thru 0x0047f4 (0x3136 bytes) 000090 1781693656.324793 mapread 0x013ef8 thru 0x014729 (0x832 bytes) 000092 1781693656.326388 punch from 0x00c0e8 to 0x014729 (0x8642 bytes) 000093 1781693656.328641 trunc from 0x01472a to 0x013488 (0x12a1 bytes) 000094 1781693656.334752 write 0x005b4c thru 0x00c6d5 (0x6b8a bytes) 000095 1781693656.337959 trunc from 0x00ce31 to 0x013488 (0x6658 bytes) 000096 1781693656.344956 trunc from 0x007e27 to 0x013488 (0xb662 bytes) 000097 1781693656.348635 trunc from 0x00dd35 to 0x013488 (0x5754 bytes) 000098 1781693656.350735 fallocate 0x00affa thru 0x01049f (0x54a6 bytes) 000099 1781693656.356128 fallocate 0x01ed48 thru 0x02a5c7 (0xb880 bytes) 000100 1781693656.358769 read 0x00a0dd thru 0x00bf9b (0x1ebf bytes) 000101 1781693656.363214 mapwrite 0x00f275 thru 0x01cc41 (0xd9cd bytes) 000102 1781693656.371561 read 0x0080fc thru 0x011a38 (0x993d bytes) 000103 1781693656.372138 write 0x000545 thru 0x009264 (0x8d20 bytes) 000104 1781693656.373324 write 0x03a187 thru 0x03ffff (0x5e79 bytes) 000105 1781693656.376794 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x95c26275 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2d1e64a Mirror 3: 0x2d1e64a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000106 1781693656.645125 mapwrite 0x035fdf thru 0x038a65 (0x2a87 bytes) 000107 1781693656.687021 punch from 0x000158 to 0x003550 (0x33f9 bytes) 000108 1781693656.689658 mapread 0x02327d thru 0x0232f4 (0x78 bytes) 000109 1781693656.693490 punch from 0x0252d2 to 0x031675 (0xc3a4 bytes) 000110 1781693656.695790 trunc from 0x040000 to 0x032423 (0xdbdc bytes) 000111 1781693656.711348 mapread 0x0278b9 thru 0x030d88 (0x94d0 bytes) 000112 1781693656.716292 write 0x01acee thru 0x02187b (0x6b8e bytes) 000114 1781693656.719192 mapread 0x02bf40 thru 0x030417 (0x44d8 bytes) 000115 1781693656.719975 trunc from 0x01e675 to 0x0244a7 (0x5e33 bytes) 000116 1781693656.724355 trunc from 0x00af9c to 0x01179e (0x6803 bytes) 000117 1781693656.726362 punch from 0x02df63 to 0x030524 (0x25c2 bytes) 000118 1781693656.728597 mapwrite 0x03eaaa thru 0x03ffff (0x1556 bytes) 000119 1781693656.740991 read 0x014d66 thru 0x020183 (0xb41e bytes) 000120 1781693656.747663 mapread 0x039b65 thru 0x03ffff (0x649b bytes) 000121 1781693656.748661 mapwrite 0x00ceec thru 0x01cd37 (0xfe4c bytes) 000122 1781693656.760783 mapwrite 0x029df5 thru 0x02f953 (0x5b5f bytes) 000123 1781693656.772400 trunc from 0x013d29 to 0x0195b4 (0x588c bytes) 000124 1781693656.779671 trunc from 0x010616 to 0x01bf91 (0xb97c bytes) 000125 1781693656.781846 mapwrite 0x01d4f0 thru 0x01f129 (0x1c3a bytes) 000126 1781693656.787819 mapwrite 0x02ff8d thru 0x03a1f7 (0xa26b bytes) 000127 1781693656.801065 punch from 0x0174ca to 0x01dbc5 (0x66fc bytes) 000128 1781693656.803409 punch from 0x011478 to 0x01692e (0x54b7 bytes) 000129 1781693656.807159 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2d1e64a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2d1e64a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000130 1781693656.900099 punch from 0x020c73 to 0x026bbf (0x5f4d bytes) 000131 1781693656.901979 mapwrite 0x02d81d thru 0x02f4e0 (0x1cc4 bytes) 000132 1781693656.914177 punch from 0x03b40c to 0x03c882 (0x1477 bytes) 000133 1781693656.916377 trunc from 0x040000 to 0x01c505 (0x23afa bytes) 000134 1781693656.925313 MIRROR_RESYNC 2 mirrors 000135 1781693657.146804 punch from 0x004a80 to 0x010884 (0xbe05 bytes) 000137 1781693657.159921 punch from 0x007ba1 to 0x00fef3 (0x8353 bytes) 000138 1781693657.162112 trunc from 0x01c506 to 0x022e2c (0x6927 bytes) 000140 1781693657.169410 punch from 0x00ae19 to 0x00fdf5 (0x4fdd bytes) 000141 1781693657.171741 trunc from 0x00be88 to 0x017841 (0xb9ba bytes) 000142 1781693657.173900 mapread 0x00f28c thru 0x0152de (0x6053 bytes) 000143 1781693657.180340 trunc from 0x0125c8 to 0x015410 (0x2e49 bytes) 000145 1781693657.182696 read 0x01a0f1 thru 0x022e2c (0x8d3c bytes) 000146 1781693657.187052 mapread 0x003688 thru 0x006bfd (0x3576 bytes) 000147 1781693657.190460 trunc from 0x022e2d to 0x034187 (0x1135b bytes) 000148 1781693657.197300 punch from 0x0336ec to 0x034187 (0xa9c bytes) 000149 1781693657.199327 write 0x00f1e8 thru 0x015b9c (0x69b5 bytes) 000150 1781693657.201931 mapwrite 0x01a7fe thru 0x02962b (0xee2e bytes) 000151 1781693657.214718 read 0x0290be thru 0x034187 (0xb0ca bytes) 000152 1781693657.218017 trunc from 0x00b810 to 0x012122 (0x6913 bytes) 000153 1781693657.221187 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34188): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34188): Mirror 3: 0x734e55aa (stale) CRC-32 checksum value for chunk [0, 0x34188): Mirror 1: 0x9631beca Mirror 4: 0x9631beca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34188: skipped 000154 1781693657.467368 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000155 1781693657.575870 mapwrite 0x01c953 thru 0x01fb1d (0x31cb bytes) 000156 1781693657.608670 mapread 0x015870 thru 0x01e87c (0x900d bytes) 000157 1781693657.612849 read 0x004a44 thru 0x00b3d4 (0x6991 bytes) 000158 1781693657.616721 mapwrite 0x034b3b thru 0x03c7a9 (0x7c6f bytes) 000159 1781693657.640212 punch from 0x01bb5a to 0x02409a (0x8541 bytes) 000160 1781693657.642302 trunc from 0x03c7aa to 0x03acad (0x1afc bytes) 000161 1781693657.646429 read 0x000fdb thru 0x00dc8c (0xccb2 bytes) 000162 1781693657.650694 write 0x0111a2 thru 0x014dde (0x3c3d bytes) 000166 1781693657.652589 mapread 0x0259bf thru 0x0306e5 (0xad27 bytes) 000167 1781693657.653529 trunc from 0x026327 to 0x028099 (0x1d73 bytes) 000168 1781693657.655908 punch from 0x0328cb to 0x03acad (0x83e3 bytes) 000169 1781693657.658038 trunc from 0x03acae to 0x01ceb5 (0x1ddf8 bytes) 000170 1781693657.666606 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000171 1781693657.709419 trunc from 0x01ceb6 to 0x02c20b (0xf356 bytes) 000172 1781693657.719406 write 0x027a1b thru 0x037490 (0xfa76 bytes) 000173 1781693657.721924 mapwrite 0x00f40e thru 0x011e95 (0x2a88 bytes) 000174 1781693657.731851 trunc from 0x030fd8 to 0x037490 (0x64b9 bytes) 000175 1781693657.733667 mapread 0x01587e thru 0x01615f (0x8e2 bytes) 000176 1781693657.734580 punch from 0x01fcc0 to 0x02302e (0x336f bytes) 000177 1781693657.736234 read 0x009946 thru 0x00c04b (0x2706 bytes) 000178 1781693657.738091 trunc from 0x00aecd to 0x00c0f3 (0x1227 bytes) 000181 1781693657.741379 write 0x00d22f thru 0x00dec8 (0xc9a bytes) 000182 1781693657.742084 mapwrite 0x014165 thru 0x0190ed (0x4f89 bytes) 000183 1781693657.749669 mapwrite 0x024abb thru 0x02995b (0x4ea1 bytes) 000184 1781693657.757765 write 0x033029 thru 0x0355e2 (0x25ba bytes) 000185 1781693657.760546 mapwrite 0x01c04e thru 0x0273a5 (0xb358 bytes) 000186 1781693657.768970 trunc from 0x012294 to 0x0187cf (0x653c bytes) 000187 1781693657.770980 trunc from 0x037491 to 0x017df2 (0x1f69e bytes) 000188 1781693657.775709 read 0x00b092 thru 0x014240 (0x91af bytes) 000190 1781693657.779690 punch from 0x00fa38 to 0x012957 (0x2f20 bytes) 000191 1781693657.783363 MIRROR_EXTEND to 2 mirrors 000192 1781693657.983909 MIRROR_EXTEND to 3 mirrors 000193 1781693658.212696 fallocate 0x0307b8 thru 0x03884e (0x8097 bytes) 000195 1781693658.224898 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x17df3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17df3): Mirror 2: 0x6c53d0bb (stale) Mirror 3: 0x6c53d0bb (stale) CRC-32 checksum value for chunk [0, 0x17df3): Mirror 1: 0x6c53d0bb Mirror 4: 0x6c53d0bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17df3: skipped 000196 1781693658.497140 fallocate 0x0094c8 thru 0x00e194 (0x4ccd bytes) 000197 1781693658.510916 trunc from 0x017df3 to 0x026746 (0xe954 bytes) 000198 1781693658.517541 mapread 0x009f73 thru 0x013c16 (0x9ca4 bytes) 000199 1781693658.524395 trunc from 0x002493 to 0x004e78 (0x29e6 bytes) 000200 1781693658.526463 write 0x02732d thru 0x0362a4 (0xef78 bytes) 000201 1781693658.527568 punch from 0x0149cc to 0x01f105 (0xa73a bytes) 000202 1781693658.529547 mapwrite 0x0001f2 thru 0x0003f6 (0x205 bytes) 000204 1781693658.538661 trunc from 0x0362a5 to 0x019157 (0x1d14d bytes) 000205 1781693658.543435 mapwrite 0x021017 thru 0x02c684 (0xb66e bytes) 000206 1781693658.558916 read 0x025ad6 thru 0x029f27 (0x4452 bytes) 000207 1781693658.559617 read 0x0218f3 thru 0x02c684 (0xad92 bytes) 000209 1781693658.560722 mapread 0x00163c thru 0x005622 (0x3fe7 bytes) 000210 1781693658.561464 write 0x00d6f7 thru 0x01618a (0x8a94 bytes) 000211 1781693658.564026 mapwrite 0x03c1ef thru 0x03ffff (0x3e11 bytes) 000212 1781693658.577156 trunc from 0x040000 to 0x02129f (0x1ed60 bytes) 000213 1781693658.584143 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x212a0): Mirror 3: 0x20c5e3a0 (stale) Mirror 4: 0x20c5e3a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x212a0): Mirror 3: 0x20c5e3a0 (stale) Mirror 4: 0x20c5e3a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x212a0: skipped 000214 1781693658.681520 punch from 0x01c855 to 0x02128d (0x4a39 bytes) 000215 1781693658.684072 write 0x03842c thru 0x03ffff (0x7bd4 bytes) 000216 1781693658.686707 punch from 0x03eea5 to 0x03ffff (0x115b bytes) 000217 1781693658.692136 mapwrite 0x026627 thru 0x032829 (0xc203 bytes) 000218 1781693658.709183 fallocate 0x02c67f thru 0x02d7e5 (0x1167 bytes) 000219 1781693658.711821 trunc from 0x01fc4d to 0x025e7e (0x6232 bytes) 000221 1781693658.714824 trunc from 0x02390d to 0x02ca34 (0x9128 bytes) 000222 1781693658.717740 read 0x010728 thru 0x01adb2 (0xa68b bytes) 000223 1781693658.723201 mapwrite 0x0248e8 thru 0x031a50 (0xd169 bytes) 000224 1781693658.742215 mapwrite 0x00be3d thru 0x00ef5e (0x3122 bytes) 000225 1781693658.753243 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa809a7c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa809a7c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000226 1781693658.855060 fallocate 0x0013a8 thru 0x00e974 (0xd5cd bytes) 000227 1781693658.860646 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000228 1781693658.906432 read 0x036c4f thru 0x03ffff (0x93b1 bytes) 000230 1781693658.910735 fallocate 0x015902 thru 0x020636 (0xad35 bytes) 000231 1781693658.913467 punch from 0x027c53 to 0x02912a (0x14d8 bytes) 000232 1781693658.915805 mapwrite 0x0399c7 thru 0x03ffff (0x6639 bytes) 000233 1781693658.924218 fallocate 0x00a9ae thru 0x00f373 (0x49c6 bytes) 000235 1781693658.926657 fallocate 0x0068f6 thru 0x010011 (0x971c bytes) 000238 1781693658.929696 trunc from 0x005e49 to 0x00fc76 (0x9e2e bytes) 000239 1781693658.932038 trunc from 0x040000 to 0x03197e (0xe681 bytes) 000240 1781693658.939220 fallocate 0x000c22 thru 0x00bb3c (0xaf1b bytes) 000241 1781693658.941642 fallocate 0x03adc7 thru 0x03ffff (0x5239 bytes) 000242 1781693658.943934 write 0x0000d6 thru 0x0027d9 (0x2704 bytes) 000243 1781693658.947057 fallocate 0x030a90 thru 0x0315a5 (0xb16 bytes) 000245 1781693658.949728 mapwrite 0x01f233 thru 0x02d718 (0xe4e6 bytes) 000246 1781693658.969505 write 0x03b43b thru 0x03ffff (0x4bc5 bytes) 000248 1781693658.970736 trunc from 0x016c27 to 0x01d81c (0x6bf6 bytes) 000249 1781693658.973342 mapwrite 0x024352 thru 0x02a62d (0x62dc bytes) 000250 1781693658.980760 trunc from 0x01cfb0 to 0x023c9a (0x6ceb bytes) 000251 1781693658.984057 mapwrite 0x027a88 thru 0x034786 (0xccff bytes) 000252 1781693658.997531 write 0x004063 thru 0x00f571 (0xb50f bytes) 000253 1781693659.004929 MIRROR_EXTEND to 2 mirrors 000254 1781693659.296085 write 0x0287c1 thru 0x028fff (0x83f bytes) 000255 1781693659.315419 trunc from 0x014995 to 0x015e96 (0x1502 bytes) 000256 1781693659.320015 mapwrite 0x022d0d thru 0x030062 (0xd356 bytes) 000257 1781693659.352727 MIRROR_RESYNC 2 mirrors 000258 1781693659.581207 punch from 0x013256 to 0x02043d (0xd1e8 bytes) 000259 1781693659.591976 read 0x0233d1 thru 0x02b117 (0x7d47 bytes) 000260 1781693659.595073 read 0x0065cc thru 0x00f3de (0x8e13 bytes) 000261 1781693659.599483 mapwrite 0x021ee2 thru 0x0277fe (0x591d bytes) 000262 1781693659.608057 read 0x032182 thru 0x03cc4e (0xaacd bytes) 000263 1781693659.608741 fallocate 0x0140cd thru 0x018246 (0x417a bytes) 000264 1781693659.611083 trunc from 0x040000 to 0x00c2e5 (0x33d1a bytes) 000265 1781693659.623701 fallocate 0x03599b thru 0x03ffff (0xa665 bytes) 000268 1781693659.626638 trunc from 0x00c2e6 to 0x01ff4a (0x13c65 bytes) 000269 1781693659.631993 write 0x02eeac thru 0x03271d (0x3872 bytes) 000271 1781693659.633782 fallocate 0x035085 thru 0x03a495 (0x5411 bytes) 000272 1781693659.636356 fallocate 0x0270ff thru 0x032016 (0xaf18 bytes) 000273 1781693659.638415 punch from 0x00cb73 to 0x01b9cb (0xee59 bytes) 000274 1781693659.640357 mapwrite 0x026c95 thru 0x02cb80 (0x5eec bytes) 000275 1781693659.653222 trunc from 0x02d07d to 0x03271d (0x56a1 bytes) 000276 1781693659.656347 write 0x01c030 thru 0x02a249 (0xe21a bytes) 000277 1781693659.657756 punch from 0x018a5f to 0x027257 (0xe7f9 bytes) 000279 1781693659.666059 mapwrite 0x02ba94 thru 0x02d6f2 (0x1c5f bytes) 000280 1781693659.677594 punch from 0x031386 to 0x03271d (0x1398 bytes) 000281 1781693659.680694 fallocate 0x007eba thru 0x013c0d (0xbd54 bytes) 000282 1781693659.685702 mapread 0x01073c thru 0x0168fb (0x61c0 bytes) 000283 1781693659.686587 read 0x004a62 thru 0x01392e (0xeecd bytes) 000284 1781693659.687256 fallocate 0x03d178 thru 0x03ffff (0x2e88 bytes) 000285 1781693659.691336 write 0x009f2f thru 0x00a310 (0x3e2 bytes) 000287 1781693659.692918 trunc from 0x007b3b to 0x0102f1 (0x87b7 bytes) 000288 1781693659.698139 read 0x019bf9 thru 0x02714b (0xd553 bytes) 000289 1781693659.704628 write 0x008f8a thru 0x012367 (0x93de bytes) 000290 1781693659.705964 write 0x002b92 thru 0x00af8c (0x83fb bytes) 000291 1781693659.707269 punch from 0x028405 to 0x031d7b (0x9977 bytes) 000292 1781693659.710460 write 0x006364 thru 0x012d95 (0xca32 bytes) 000293 1781693659.711819 write 0x024fc4 thru 0x0295c0 (0x45fd bytes) 000294 1781693659.716489 trunc from 0x03271e to 0x0221b6 (0x10567 bytes) 000295 1781693659.723284 write 0x0076ac thru 0x012a26 (0xb37b bytes) 000296 1781693659.724639 mapwrite 0x01d7e3 thru 0x02b806 (0xe024 bytes) 000298 1781693659.758181 trunc from 0x0169c0 to 0x01a93b (0x3f7c bytes) 000299 1781693659.760018 mapread 0x003cdc thru 0x00ee12 (0xb137 bytes) 000300 1781693659.760843 read 0x021805 thru 0x02a2a3 (0x8a9f bytes) 000301 1781693659.761458 write 0x02e5bc thru 0x02e80e (0x253 bytes) 000302 1781693659.762117 mapread 0x0135b8 thru 0x01c678 (0x90c1 bytes) 000303 1781693659.767342 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000304 1781693659.811626 fallocate 0x020dda thru 0x0241e0 (0x3407 bytes) 000305 1781693659.814434 mapwrite 0x034ca0 thru 0x035ec0 (0x1221 bytes) 000306 1781693659.828178 read 0x02dc15 thru 0x035ec0 (0x82ac bytes) 000307 1781693659.831094 read 0x01336e thru 0x023008 (0xfc9b bytes) 000308 1781693659.834983 punch from 0x00f14e to 0x01be2c (0xccdf bytes) 000310 1781693659.838180 trunc from 0x035ec1 to 0x029629 (0xc897 bytes) 000311 1781693659.843208 write 0x022fbb thru 0x023c9d (0xce3 bytes) 000312 1781693659.843940 mapwrite 0x014ede thru 0x01a525 (0x5648 bytes) 000313 1781693659.863379 mapread 0x0035d4 thru 0x006237 (0x2c64 bytes) 000315 1781693659.865275 mapwrite 0x018319 thru 0x021664 (0x934c bytes) 000316 1781693659.875632 mapwrite 0x021289 thru 0x021d40 (0xab8 bytes) 000317 1781693659.881545 read 0x01a9f8 thru 0x028135 (0xd73e bytes) 000318 1781693659.882189 fallocate 0x025cbe thru 0x033fe9 (0xe32c bytes) 000319 1781693659.884675 trunc from 0x033fea to 0x036b0f (0x2b26 bytes) 000320 1781693659.889583 punch from 0x021cb4 to 0x02c470 (0xa7bd bytes) 000322 1781693659.894029 fallocate 0x03dc25 thru 0x03ffff (0x23db bytes) 000323 1781693659.896519 write 0x03b4ba thru 0x03ffff (0x4b46 bytes) 000324 1781693659.901354 read 0x016046 thru 0x01ebcb (0x8b86 bytes) 000325 1781693659.901928 mapread 0x033672 thru 0x03a13b (0x6aca bytes) 000326 1781693659.902945 trunc from 0x040000 to 0x0345f8 (0xba07 bytes) 000327 1781693659.908549 mapread 0x008b41 thru 0x00f6a5 (0x6b65 bytes) 000328 1781693659.909747 read 0x0029c7 thru 0x003144 (0x77e bytes) 000330 1781693659.910956 fallocate 0x03dbe4 thru 0x03ffff (0x241c bytes) 000331 1781693659.913712 write 0x024613 thru 0x02e5a7 (0x9f95 bytes) 000332 1781693659.914772 mapread 0x026a78 thru 0x032352 (0xb8db bytes) 000333 1781693659.916020 mapwrite 0x009c66 thru 0x00bb60 (0x1efb bytes) 000335 1781693659.925367 read 0x00e009 thru 0x0198fc (0xb8f4 bytes) 000336 1781693659.925839 read 0x00340b thru 0x006138 (0x2d2e bytes) 000338 1781693659.926590 trunc from 0x040000 to 0x0113c3 (0x2ec3c bytes) 000339 1781693659.931665 trunc from 0x0113c4 to 0x006793 (0xac30 bytes) 000340 1781693659.936649 trunc from 0x006794 to 0x03e05b (0x378c8 bytes) 000342 1781693659.942522 mapwrite 0x01528e thru 0x020336 (0xb0a9 bytes) 000343 1781693659.952961 mapread 0x0112b9 thru 0x013265 (0x1fad bytes) 000344 1781693659.954010 trunc from 0x0016c7 to 0x00a73f (0x9079 bytes) 000345 1781693659.956233 mapread 0x02af4f thru 0x031c32 (0x6ce4 bytes) 000346 1781693659.957008 punch from 0x032e9b to 0x037964 (0x4aca bytes) 000347 1781693659.958915 punch from 0x007ea1 to 0x00f3cc (0x752c bytes) 000348 1781693659.960419 write 0x00be25 thru 0x00c0ef (0x2cb bytes) 000349 1781693659.963630 trunc from 0x03e05c to 0x026b1a (0x17541 bytes) 000350 1781693659.968583 write 0x03bbd9 thru 0x03ffff (0x4427 bytes) 000353 1781693659.970714 trunc from 0x040000 to 0x012498 (0x2db67 bytes) 000355 1781693659.976127 trunc from 0x012499 to 0x012704 (0x26c bytes) 000357 1781693659.981615 trunc from 0x00974b to 0x012704 (0x8fba bytes) 000359 1781693659.986342 mapread 0x004c5e thru 0x0072af (0x2652 bytes) 000361 1781693659.994447 mapwrite 0x0234de thru 0x02ad66 (0x7889 bytes) 000362 1781693660.023387 mapread 0x00fbfa thru 0x0165aa (0x69b1 bytes) 000363 1781693660.038756 fallocate 0x003416 thru 0x004c86 (0x1871 bytes) 000364 1781693660.041105 write 0x003492 thru 0x00c80e (0x937d bytes) 000365 1781693660.045151 trunc from 0x02ad67 to 0x012bf7 (0x1816f bytes) 000366 1781693660.050202 fallocate 0x02a9fa thru 0x02d635 (0x2c3c bytes) 000367 1781693660.052138 punch from 0x00fd21 to 0x012bf7 (0x2ed7 bytes) 000369 1781693660.054550 mapwrite 0x00e3b5 thru 0x01494b (0x6597 bytes) 000371 1781693660.080180 write 0x031d55 thru 0x0324c2 (0x76e bytes) 000372 1781693660.081111 mapwrite 0x022661 thru 0x03119a (0xeb3a bytes) 000374 1781693660.122024 write 0x037943 thru 0x03ffff (0x86bd bytes) 000375 1781693660.123396 fallocate 0x0209ef thru 0x02350a (0x2b1c bytes) 000378 1781693660.127853 trunc from 0x040000 to 0x03a9c6 (0x5639 bytes) 000379 1781693660.133300 trunc from 0x03a9c7 to 0x03cd2e (0x2368 bytes) 000380 1781693660.142666 MIRROR_EXTEND to 2 mirrors 000381 1781693660.380743 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000382 1781693660.417491 punch from 0x007523 to 0x0117c1 (0xa29f bytes) 000383 1781693660.421732 punch from 0x01ca63 to 0x01f33e (0x28dc bytes) 000384 1781693660.423567 mapwrite 0x029bd2 thru 0x02f004 (0x5433 bytes) 000385 1781693660.438150 trunc from 0x03cd2f to 0x0187c9 (0x24565 bytes) 000386 1781693660.447570 punch from 0x010f16 to 0x0133be (0x24a9 bytes) 000387 1781693660.449963 punch from 0x010a83 to 0x016c65 (0x61e3 bytes) 000388 1781693660.451970 write 0x03c3bc thru 0x03ffff (0x3c44 bytes) 000389 1781693660.453031 read 0x0386be thru 0x03cc56 (0x4599 bytes) 000390 1781693660.455505 write 0x02ea41 thru 0x0383dc (0x999c bytes) 000391 1781693660.458245 mapwrite 0x02b016 thru 0x039c23 (0xec0e bytes) 000392 1781693660.474899 fallocate 0x03c24f thru 0x03ffff (0x3db1 bytes) 000393 1781693660.477985 mapread 0x01ffbd thru 0x023ce7 (0x3d2b bytes) 000394 1781693660.482470 read 0x03c9f8 thru 0x03d6f3 (0xcfc bytes) 000395 1781693660.483134 fallocate 0x005d4b thru 0x00e07d (0x8333 bytes) 000397 1781693660.486022 punch from 0x00ed6c to 0x00f281 (0x516 bytes) 000398 1781693660.489004 mapread 0x000be1 thru 0x008301 (0x7721 bytes) 000399 1781693660.494464 punch from 0x029851 to 0x02fd0d (0x64bd bytes) 000400 1781693660.498252 write 0x0284f3 thru 0x02e21a (0x5d28 bytes) 000401 1781693660.501139 mapread 0x038610 thru 0x03f408 (0x6df9 bytes) 000402 1781693660.502207 trunc from 0x024fab to 0x029515 (0x456b bytes) 000403 1781693660.510245 mapread 0x006422 thru 0x0097fb (0x33da bytes) 000404 1781693660.511322 punch from 0x018cb2 to 0x01c72a (0x3a79 bytes) 000405 1781693660.513531 write 0x03b8ee thru 0x03ffff (0x4712 bytes) 000406 1781693660.514502 read 0x036009 thru 0x03ecaf (0x8ca7 bytes) 000407 1781693660.515111 trunc from 0x02d2d6 to 0x032d2f (0x5a5a bytes) 000408 1781693660.517417 fallocate 0x00971a thru 0x014534 (0xae1b bytes) 000410 1781693660.520467 trunc from 0x040000 to 0x00982f (0x367d0 bytes) 000411 1781693660.527915 write 0x039611 thru 0x03ffff (0x69ef bytes) 000412 1781693660.529045 trunc from 0x040000 to 0x00c185 (0x33e7a bytes) 000414 1781693660.535059 read 0x00a568 thru 0x00c185 (0x1c1e bytes) 000415 1781693660.537749 mapread 0x007589 thru 0x00c185 (0x4bfd bytes) 000416 1781693660.538901 mapread 0x006b58 thru 0x00c185 (0x562e bytes) 000417 1781693660.541713 MIRROR_EXTEND to 2 mirrors 000418 1781693660.756144 fallocate 0x00feee thru 0x01cb6c (0xcc7f bytes) 000419 1781693660.767378 write 0x00be3b thru 0x00eded (0x2fb3 bytes) 000420 1781693660.772534 trunc from 0x012845 to 0x018753 (0x5f0f bytes) 000421 1781693660.778249 mapwrite 0x00ed1d thru 0x011b2b (0x2e0f bytes) 000422 1781693660.795531 fallocate 0x031cbd thru 0x0384e3 (0x6827 bytes) 000423 1781693660.800470 MIRROR_RESYNC 2 mirrors 000424 1781693661.012917 trunc from 0x01950e to 0x01cb6c (0x365f bytes) 000425 1781693661.024990 trunc from 0x01cb6d to 0x015b3f (0x702d bytes) 000426 1781693661.035946 write 0x02e304 thru 0x038662 (0xa35f bytes) 000428 1781693661.038222 fallocate 0x03b41c thru 0x03ffff (0x4be4 bytes) 000430 1781693661.041416 fallocate 0x027d97 thru 0x02e1e5 (0x644f bytes) 000431 1781693661.043837 write 0x03af23 thru 0x03ffff (0x50dd bytes) 000432 1781693661.044742 write 0x031198 thru 0x03573d (0x45a6 bytes) 000433 1781693661.045465 mapwrite 0x01b2b0 thru 0x01ff50 (0x4ca1 bytes) 000434 1781693661.059463 read 0x009752 thru 0x018fa9 (0xf858 bytes) 000435 1781693661.063097 fallocate 0x02463d thru 0x030515 (0xbed9 bytes) 000437 1781693661.066254 read 0x036a3b thru 0x03ffff (0x95c5 bytes) 000438 1781693661.070308 mapwrite 0x033b70 thru 0x0393fe (0x588f bytes) 000439 1781693661.080852 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xea490318 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1db4b039 Mirror 3: 0x1db4b039 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000440 1781693661.368994 mapread 0x019b46 thru 0x02167c (0x7b37 bytes) 000441 1781693661.382024 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xea490318 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1db4b039 Mirror 3: 0x1db4b039 Mirror 4: 0x1db4b039 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000442 1781693661.648574 mapread 0x0162e6 thru 0x0222b8 (0xbfd3 bytes) 000443 1781693661.657431 read 0x01d8b1 thru 0x024c40 (0x7390 bytes) 000444 1781693661.657929 trunc from 0x040000 to 0x00ed8d (0x31272 bytes) 000445 1781693661.685457 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xed8e): Mirror 3: 0x166e24b (stale) Mirror 4: 0x166e24b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xed8e): Mirror 3: 0x166e24b (stale) Mirror 4: 0x166e24b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xed8e: skipped 000446 1781693661.773772 trunc from 0x00ed8e to 0x00434c (0xaa41 bytes) 000448 1781693661.780583 mapread 0x001ec7 thru 0x00434c (0x2486 bytes) 000450 1781693661.786425 trunc from 0x00434d to 0x02e613 (0x2a2c7 bytes) 000452 1781693661.791641 trunc from 0x02e614 to 0x0316b1 (0x309e bytes) 000453 1781693661.795836 read 0x00da27 thru 0x0196c0 (0xbc9a bytes) 000454 1781693661.798998 read 0x021022 thru 0x030627 (0xf606 bytes) 000455 1781693661.802719 mapwrite 0x008baf thru 0x016125 (0xd577 bytes) 000456 1781693661.812852 trunc from 0x0316b2 to 0x0065ec (0x2b0c5 bytes) 000457 1781693661.817835 mapread 0x000314 thru 0x0065ec (0x62d9 bytes) 000458 1781693661.818801 write 0x00a0f2 thru 0x00d8ab (0x37ba bytes) 000459 1781693661.819946 trunc from 0x002e82 to 0x00cacd (0x9c4c bytes) 000460 1781693661.825536 MIRROR_RESYNC 3 mirrors 000461 1781693662.004283 punch from 0x00a101 to 0x00d8ab (0x37ab bytes) 000462 1781693662.015946 punch from 0x0023ed to 0x006421 (0x4035 bytes) 000463 1781693662.019346 MIRROR_RESYNC 3 mirrors 000464 1781693662.234078 fallocate 0x03f7ae thru 0x03ffff (0x852 bytes) 000465 1781693662.243985 read 0x003721 thru 0x00d3ee (0x9cce bytes) 000466 1781693662.247187 fallocate 0x02ac60 thru 0x032aef (0x7e90 bytes) 000467 1781693662.249517 trunc from 0x040000 to 0x02e79f (0x11860 bytes) 000469 1781693662.255984 mapread 0x02d17e thru 0x02e79f (0x1622 bytes) 000470 1781693662.261391 MIRROR_RESYNC 3 mirrors 000471 1781693662.458655 punch from 0x01c884 to 0x02a7dc (0xdf59 bytes) 000472 1781693662.471149 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e7a0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7a0): Mirror 3: 0x49ce60a1 (stale) Mirror 4: 0x49ce60a1 (stale) CRC-32 checksum value for chunk [0, 0x2e7a0): Mirror 1: 0x49ce60a1 Mirror 5: 0x49ce60a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7a0: skipped 000473 1781693662.721002 read 0x02bee2 thru 0x02d13d (0x125c bytes) 000474 1781693662.724544 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e7a0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7a0): Mirror 3: 0x49ce60a1 (stale) Mirror 4: 0x49ce60a1 (stale) CRC-32 checksum value for chunk [0, 0x2e7a0): Mirror 1: 0x49ce60a1 Mirror 5: 0x49ce60a1 Mirror 6: 0x49ce60a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7a0: skipped 000475 1781693663.043073 mapwrite 0x03ecab thru 0x03ffff (0x1355 bytes) 000476 1781693663.079044 mapread 0x010a30 thru 0x01e739 (0xdd0a bytes) 000477 1781693663.085427 mapwrite 0x029052 thru 0x0352e5 (0xc294 bytes) 000478 1781693663.100154 write 0x0252a2 thru 0x032dea (0xdb49 bytes) 000479 1781693663.101571 trunc from 0x040000 to 0x0173b7 (0x28c48 bytes) 000480 1781693663.108508 read 0x0076a8 thru 0x007cf6 (0x64f bytes) 000482 1781693663.111507 punch from 0x01568a to 0x0173b7 (0x1d2e bytes) 000484 1781693663.114160 write 0x0001f2 thru 0x00a8a5 (0xa6b4 bytes) 000485 1781693663.116942 punch from 0x004256 to 0x011fd1 (0xdd7c bytes) 000486 1781693663.122134 write 0x029116 thru 0x03607e (0xcf69 bytes) 000487 1781693663.123339 mapread 0x005393 thru 0x00cbae (0x781c bytes) 000488 1781693663.126637 write 0x0154b8 thru 0x016902 (0x144b bytes) 000489 1781693663.130098 read 0x006eeb thru 0x00d0f7 (0x620d bytes) 000490 1781693663.130572 write 0x014336 thru 0x01599c (0x1667 bytes) 000491 1781693663.131285 mapread 0x019ae7 thru 0x01fcc9 (0x61e3 bytes) 000492 1781693663.134442 read 0x00dd7f thru 0x01567d (0x78ff bytes) 000493 1781693663.135033 write 0x001f42 thru 0x0074e1 (0x55a0 bytes) 000494 1781693663.135826 mapread 0x01ba93 thru 0x02b315 (0xf883 bytes) 000495 1781693663.136727 read 0x005c87 thru 0x009f93 (0x430d bytes) 000496 1781693663.137246 mapread 0x014fa5 thru 0x018166 (0x31c2 bytes) 000497 1781693663.138135 trunc from 0x03607f to 0x038cbd (0x2c3f bytes) 000498 1781693663.143316 write 0x02b640 thru 0x03b2da (0xfc9b bytes) 000500 1781693663.145506 mapread 0x000779 thru 0x003cd1 (0x3559 bytes) 000501 1781693663.146509 write 0x01d4e2 thru 0x02962e (0xc14d bytes) 000502 1781693663.147884 punch from 0x00804e to 0x013e6f (0xbe22 bytes) 000503 1781693663.150368 fallocate 0x01231b thru 0x0184af (0x6195 bytes) 000504 1781693663.152459 punch from 0x037d79 to 0x03b2da (0x3562 bytes) 000505 1781693663.158552 read 0x00f012 thru 0x01a4a2 (0xb491 bytes) 000506 1781693663.161644 trunc from 0x03b2db to 0x013aed (0x277ed bytes) 000507 1781693663.166782 trunc from 0x013aee to 0x01ece0 (0xb1f3 bytes) 000508 1781693663.171593 trunc from 0x016cef to 0x01ece0 (0x7ff2 bytes) 000509 1781693663.173849 read 0x01a7da thru 0x01ec4e (0x4475 bytes) 000510 1781693663.177473 write 0x02b481 thru 0x03b2da (0xfe5a bytes) 000511 1781693663.178985 trunc from 0x02b0e0 to 0x0335bc (0x84dd bytes) 000512 1781693663.185380 trunc from 0x0399eb to 0x03b2da (0x18f0 bytes) 000513 1781693663.189409 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b2db): Mirror 4: 0xc205f23 (stale) Mirror 5: 0xc205f23 (stale) Mirror 6: 0xc205f23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2db): Mirror 4: 0xc205f23 (stale) Mirror 5: 0xc205f23 (stale) Mirror 6: 0xc205f23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2db: skipped 000514 1781693663.295374 mapwrite 0x02eef3 thru 0x03d796 (0xe8a4 bytes) 000515 1781693663.329538 punch from 0x001362 to 0x004b42 (0x37e1 bytes) 000516 1781693663.332190 write 0x01e84e thru 0x02270f (0x3ec2 bytes) 000517 1781693663.339412 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d797): Mirror 4: 0x3ad69592 (stale) Mirror 5: 0x3ad69592 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d797): Mirror 4: 0x3ad69592 (stale) Mirror 5: 0x3ad69592 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d797: skipped 000518 1781693663.449925 punch from 0x03ac58 to 0x03d796 (0x2b3f bytes) 000519 1781693663.453919 mapread 0x00b782 thru 0x013143 (0x79c2 bytes) 000520 1781693663.460491 punch from 0x01fb56 to 0x02466c (0x4b17 bytes) 000521 1781693663.462532 read 0x015c81 thru 0x0202a8 (0xa628 bytes) 000522 1781693663.466193 trunc from 0x0150f2 to 0x022bb4 (0xdac3 bytes) 000523 1781693663.468689 trunc from 0x02c333 to 0x032d91 (0x6a5f bytes) 000525 1781693663.471222 trunc from 0x03d797 to 0x004ff0 (0x387a6 bytes) 000526 1781693663.487208 write 0x021207 thru 0x025e6f (0x4c69 bytes) 000528 1781693663.488981 read 0x0173e1 thru 0x022b61 (0xb781 bytes) 000529 1781693663.493550 punch from 0x008f47 to 0x0189f0 (0xfaaa bytes) 000530 1781693663.495548 trunc from 0x025e70 to 0x02fd4c (0x9edd bytes) 000531 1781693663.500330 read 0x014160 thru 0x01745f (0x3300 bytes) 000533 1781693663.508268 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 5: 0xae8d5607 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 5: 0xae8d5607 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd4d: skipped 000534 1781693663.594702 mapwrite 0x00f860 thru 0x015d9f (0x6540 bytes) 000535 1781693663.608481 mapread 0x008acf thru 0x00fd6a (0x729c bytes) 000536 1781693663.612215 write 0x009e57 thru 0x00cef1 (0x309b bytes) 000537 1781693663.614723 mapread 0x010319 thru 0x0105e5 (0x2cd bytes) 000539 1781693663.616259 punch from 0x01d64d to 0x027b13 (0xa4c7 bytes) 000540 1781693663.620211 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 5: 0xae8d5607 (stale) CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 1: 0xf6828cfa Mirror 6: 0xf6828cfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd4d: skipped 000541 1781693663.898001 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 5: 0xae8d5607 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd4d): Mirror 5: 0xae8d5607 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd4d: skipped 000542 1781693663.981062 punch from 0x00c80b to 0x013949 (0x713f bytes) 000544 1781693663.985885 trunc from 0x02fd4d to 0x03f622 (0xf8d6 bytes) 000545 1781693663.996847 write 0x01ced3 thru 0x022d1c (0x5e4a bytes) 000546 1781693664.002125 read 0x01314a thru 0x01cd6f (0x9c26 bytes) 000547 1781693664.006504 trunc from 0x03f623 to 0x00de29 (0x317f9 bytes) 000548 1781693664.013257 trunc from 0x00b19d to 0x00de29 (0x2c8d bytes) 000549 1781693664.016084 fallocate 0x03c7e3 thru 0x03ffff (0x381d bytes) 000550 1781693664.019106 read 0x0050f1 thru 0x01071d (0xb62d bytes) 000552 1781693664.034324 trunc from 0x040000 to 0x030672 (0xf98d bytes) 000553 1781693664.046803 fallocate 0x01665e thru 0x01a48f (0x3e32 bytes) 000554 1781693664.049894 write 0x002008 thru 0x007133 (0x512c bytes) 000555 1781693664.051312 write 0x016543 thru 0x01c2d1 (0x5d8f bytes) 000556 1781693664.052437 mapread 0x02d7e6 thru 0x02db9c (0x3b7 bytes) 000557 1781693664.053563 write 0x009ae9 thru 0x016a14 (0xcf2c bytes) 000558 1781693664.054990 read 0x005a8a thru 0x00858a (0x2b01 bytes) 000559 1781693664.055565 write 0x00aa90 thru 0x019f72 (0xf4e3 bytes) 000560 1781693664.056911 fallocate 0x03473e thru 0x0353db (0xc9e bytes) 000561 1781693664.061898 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x353dc): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353dc): Mirror 5: 0xa3826472 (stale) CRC-32 checksum value for chunk [0, 0x353dc): Mirror 1: 0xa290d4 Mirror 6: 0xa290d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353dc: skipped 000562 1781693664.319778 mapread 0x0172b6 thru 0x024cd2 (0xda1d bytes) 000563 1781693664.333670 punch from 0x02d3aa to 0x0353db (0x8032 bytes) 000564 1781693664.347992 punch from 0x009ca5 to 0x00edb6 (0x5112 bytes) 000565 1781693664.350029 fallocate 0x03b180 thru 0x03d2d0 (0x2151 bytes) 000568 1781693664.352665 trunc from 0x002c39 to 0x0033ef (0x7b7 bytes) 000569 1781693664.354405 punch from 0x01393a to 0x022240 (0xe907 bytes) 000570 1781693664.356384 read 0x021c89 thru 0x022b26 (0xe9e bytes) 000571 1781693664.358503 mapwrite 0x00afcd thru 0x01592f (0xa963 bytes) 000572 1781693664.371520 mapread 0x00053a thru 0x009dd9 (0x98a0 bytes) 000573 1781693664.374149 trunc from 0x0353dc to 0x00b982 (0x29a59 bytes) 000574 1781693664.387091 mapread 0x002bc0 thru 0x00a34b (0x778c bytes) 000575 1781693664.388276 trunc from 0x002056 to 0x00b982 (0x992d bytes) 000576 1781693664.390948 write 0x015e0c thru 0x018711 (0x2906 bytes) 000577 1781693664.391949 punch from 0x00a440 to 0x018379 (0xdf3a bytes) 000578 1781693664.396127 punch from 0x00e217 to 0x016d3a (0x8b24 bytes) 000579 1781693664.397735 mapwrite 0x00d7e3 thru 0x00f50b (0x1d29 bytes) 000580 1781693664.406609 fallocate 0x01da04 thru 0x01e396 (0x993 bytes) 000581 1781693664.409199 trunc from 0x00df7e to 0x01c2b1 (0xe334 bytes) 000582 1781693664.412668 read 0x01736e thru 0x01e396 (0x7029 bytes) 000583 1781693664.416462 mapwrite 0x029640 thru 0x038f5b (0xf91c bytes) 000584 1781693664.440711 write 0x00d78b thru 0x00edd9 (0x164f bytes) 000585 1781693664.441737 trunc from 0x038f5c to 0x029ddd (0xf17e bytes) 000586 1781693664.449972 trunc from 0x029dde to 0x000a4a (0x29393 bytes) 000587 1781693664.458322 read 0x00019e thru 0x000a4a (0x8ad bytes) 000589 1781693664.459593 trunc from 0x000a4b to 0x01623b (0x157f1 bytes) 000590 1781693664.469439 trunc from 0x01623c to 0x023fb4 (0xdd79 bytes) 000591 1781693664.476105 mapwrite 0x02f069 thru 0x0395ec (0xa584 bytes) 000592 1781693664.514212 mapread 0x024a04 thru 0x028aa2 (0x409f bytes) 000593 1781693664.515359 punch from 0x0268c3 to 0x0312d1 (0xaa0f bytes) 000594 1781693664.522707 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x395ed): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395ed): Mirror 5: 0xbf0b038f (stale) Mirror 6: 0x58668556 (stale) CRC-32 checksum value for chunk [0, 0x395ed): Mirror 1: 0xbd6e6219 Mirror 7: 0xbd6e6219 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395ed: skipped 000595 1781693664.805818 trunc from 0x003c71 to 0x012c96 (0xf026 bytes) 000596 1781693664.818656 punch from 0x03071e to 0x0395ec (0x8ecf bytes) 000597 1781693664.822317 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x395ed): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395ed): Mirror 5: 0xbf0b038f (stale) Mirror 6: 0x58668556 (stale) Mirror 7: 0xbd6e6219 (stale) CRC-32 checksum value for chunk [0, 0x395ed): Mirror 1: 0x4572b77f Mirror 8: 0x4572b77f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395ed: skipped 000598 1781693665.083048 punch from 0x02ffc9 to 0x0395ec (0x9624 bytes) 000599 1781693665.097029 mapread 0x02fc97 thru 0x030080 (0x3ea bytes) 000600 1781693665.100503 mapwrite 0x007233 thru 0x0130b5 (0xbe83 bytes) 000601 1781693665.114027 punch from 0x026eb5 to 0x02eb38 (0x7c84 bytes) 000602 1781693665.115746 fallocate 0x00cc85 thru 0x019327 (0xc6a3 bytes) 000603 1781693665.117564 trunc from 0x0395ed to 0x0274ab (0x12141 bytes) 000604 1781693665.133640 punch from 0x01fb51 to 0x0274ab (0x795b bytes) 000605 1781693665.135738 trunc from 0x018a1c to 0x020d6b (0x8350 bytes) 000607 1781693665.140323 MIRROR_RESYNC 5 mirrors 000608 1781693665.498200 trunc from 0x0274ac to 0x0363d4 (0xef29 bytes) 000610 1781693665.515883 fallocate 0x008f5f thru 0x00f9f6 (0x6a98 bytes) 000611 1781693665.518201 trunc from 0x0363d5 to 0x01c565 (0x19e6f bytes) 000612 1781693665.523916 trunc from 0x004cff to 0x0051ea (0x4ec bytes) 000613 1781693665.526415 trunc from 0x0082c4 to 0x014b0b (0xc848 bytes) 000614 1781693665.528644 mapread 0x017cff thru 0x01c565 (0x4867 bytes) 000615 1781693665.538968 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c566): Mirror 5: 0x70a4b6be (stale) Mirror 6: 0x70a4b6be (stale) Mirror 7: 0x70a4b6be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c566): Mirror 5: 0x70a4b6be (stale) Mirror 6: 0x70a4b6be (stale) Mirror 7: 0x70a4b6be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c566: skipped 000616 1781693665.682085 fallocate 0x01cf70 thru 0x0222a3 (0x5334 bytes) 000617 1781693665.685788 trunc from 0x008a88 to 0x00abae (0x2127 bytes) 000618 1781693665.688300 mapwrite 0x0244b0 thru 0x027c87 (0x37d8 bytes) 000619 1781693665.710273 write 0x017073 thru 0x024835 (0xd7c3 bytes) 000620 1781693665.714113 punch from 0x002dfe to 0x009b77 (0x6d7a bytes) 000622 1781693665.717267 trunc from 0x027c88 to 0x0168ed (0x1139a bytes) 000623 1781693665.727117 fallocate 0x03de7f thru 0x03fbc0 (0x1d42 bytes) 000624 1781693665.730085 write 0x02ac87 thru 0x02e5b6 (0x3930 bytes) 000625 1781693665.736538 fallocate 0x03c256 thru 0x03ffff (0x3daa bytes) 000626 1781693665.739267 write 0x0198f5 thru 0x01f3cf (0x5adb bytes) 000627 1781693665.743718 fallocate 0x026138 thru 0x034c40 (0xeb09 bytes) 000628 1781693665.749964 MIRROR_RESYNC 4 mirrors 000629 1781693666.075319 read 0x01ff45 thru 0x02f379 (0xf435 bytes) 000630 1781693666.078409 punch from 0x030e18 to 0x0382d3 (0x74bc bytes) 000631 1781693666.090017 punch from 0x00bd3e to 0x00ea08 (0x2ccb bytes) 000632 1781693666.092255 write 0x01b7f3 thru 0x028ef9 (0xd707 bytes) 000633 1781693666.096460 fallocate 0x037fed thru 0x03ffff (0x8013 bytes) 000634 1781693666.098609 trunc from 0x0352b4 to 0x03ffff (0xad4c bytes) 000637 1781693666.101481 punch from 0x031ec2 to 0x0383b8 (0x64f7 bytes) 000638 1781693666.103678 trunc from 0x040000 to 0x0346dd (0xb922 bytes) 000641 1781693666.113299 write 0x01d230 thru 0x02ce47 (0xfc18 bytes) 000642 1781693666.116193 trunc from 0x0346de to 0x03b69b (0x6fbe bytes) 000643 1781693666.121315 write 0x03ac75 thru 0x03ffff (0x538b bytes) 000644 1781693666.123800 trunc from 0x040000 to 0x018c81 (0x2737e bytes) 000645 1781693666.130297 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18c82): Mirror 5: 0x1b19a6db (stale) Mirror 6: 0x1b19a6db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18c82): Mirror 5: 0x1b19a6db (stale) Mirror 6: 0x1b19a6db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18c82: skipped 000646 1781693666.236410 punch from 0x000261 to 0x00e333 (0xe0d3 bytes) 000647 1781693666.238618 mapread 0x006c19 thru 0x0098ae (0x2c96 bytes) 000648 1781693666.248388 MIRROR_RESYNC 3 mirrors 000649 1781693666.432986 read 0x0058bb thru 0x007a3f (0x2185 bytes) 000650 1781693666.435099 trunc from 0x018c82 to 0x0036ea (0x15597 bytes) 000652 1781693666.457631 fallocate 0x012ef6 thru 0x0184a7 (0x55b2 bytes) 000653 1781693666.459558 write 0x01f95b thru 0x0203ca (0xa70 bytes) 000654 1781693666.460343 mapread 0x011fce thru 0x0136a8 (0x16db bytes) 000655 1781693666.467061 trunc from 0x003903 to 0x00fb4b (0xc249 bytes) 000657 1781693666.469291 fallocate 0x03be14 thru 0x03ffff (0x41ec bytes) 000658 1781693666.471337 write 0x0087d1 thru 0x00a7b8 (0x1fe8 bytes) 000659 1781693666.474478 trunc from 0x0203cb to 0x0245fe (0x4234 bytes) 000661 1781693666.480695 fallocate 0x0272de thru 0x032537 (0xb25a bytes) 000662 1781693666.483117 read 0x01dc04 thru 0x023af5 (0x5ef2 bytes) 000663 1781693666.486756 trunc from 0x007994 to 0x008305 (0x972 bytes) 000664 1781693666.490901 mapwrite 0x00b5bc thru 0x0103d3 (0x4e18 bytes) 000665 1781693666.498057 read 0x00afbd thru 0x00dd02 (0x2d46 bytes) 000666 1781693666.498704 mapwrite 0x014e5e thru 0x01a648 (0x57eb bytes) 000667 1781693666.506425 trunc from 0x0245ff to 0x00df8b (0x16673 bytes) 000668 1781693666.511830 mapwrite 0x03fb0c thru 0x03ffff (0x4f4 bytes) 000669 1781693666.524471 fallocate 0x027c6a thru 0x033bbd (0xbf54 bytes) 000670 1781693666.526909 trunc from 0x009246 to 0x00f684 (0x643f bytes) 000671 1781693666.528710 trunc from 0x023590 to 0x023753 (0x1c4 bytes) 000672 1781693666.530365 mapwrite 0x017388 thru 0x01a92d (0x35a6 bytes) 000673 1781693666.535359 trunc from 0x040000 to 0x017936 (0x286c9 bytes) 000674 1781693666.540235 write 0x02fe45 thru 0x03d8b8 (0xda74 bytes) 000675 1781693666.541947 read 0x030aa9 thru 0x03d8b8 (0xce10 bytes) 000678 1781693666.545729 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d8b9): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8b9): Mirror 5: 0x707408ae (stale) Mirror 6: 0x707408ae (stale) CRC-32 checksum value for chunk [0, 0x3d8b9): Mirror 1: 0xef7037cb Mirror 7: 0xef7037cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8b9: skipped 000679 1781693666.798456 trunc from 0x0203c8 to 0x023b16 (0x374f bytes) 000680 1781693666.816373 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d8b9): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8b9): Mirror 5: 0x707408ae (stale) Mirror 6: 0x707408ae (stale) Mirror 7: 0xef7037cb (stale) CRC-32 checksum value for chunk [0, 0x3d8b9): Mirror 1: 0xef7037cb Mirror 8: 0xef7037cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8b9: skipped 000681 1781693667.101558 trunc from 0x03d8b9 to 0x02f733 (0xe185 bytes) 000682 1781693667.122385 write 0x020eab thru 0x02762c (0x6782 bytes) 000683 1781693667.126223 trunc from 0x00397e to 0x0073f1 (0x3a74 bytes) 000684 1781693667.128125 trunc from 0x02f734 to 0x00b899 (0x23e9a bytes) 000685 1781693667.136549 mapread 0x00aff6 thru 0x00b899 (0x8a4 bytes) 000686 1781693667.140833 trunc from 0x00b89a to 0x0115be (0x5d25 bytes) 000687 1781693667.145496 trunc from 0x0085eb to 0x010dda (0x87f0 bytes) 000688 1781693667.147540 read 0x00e3fc thru 0x00ecd0 (0x8d5 bytes) 000689 1781693667.151264 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x115bf): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x115bf): Mirror 5: 0x39cf700e (stale) Mirror 6: 0x39cf700e (stale) Mirror 7: 0x8628b909 (stale) Mirror 8: 0x8628b909 (stale) CRC-32 checksum value for chunk [0, 0x115bf): Mirror 1: 0x39cf700e Mirror 9: 0x39cf700e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x115bf: skipped 000690 1781693667.377332 trunc from 0x0115bf to 0x02719f (0x15be1 bytes) 000691 1781693667.397302 read 0x01ca53 thru 0x02719f (0xa74d bytes) 000692 1781693667.404525 mapwrite 0x03311c thru 0x03346f (0x354 bytes) 000694 1781693667.419183 trunc from 0x033470 to 0x00c470 (0x26fff bytes) 000695 1781693667.432453 write 0x02d72d thru 0x02eb1e (0x13f2 bytes) 000696 1781693667.433418 trunc from 0x02d724 to 0x02eb1e (0x13fb bytes) 000697 1781693667.441375 MIRROR_RESYNC 6 mirrors 000699 1781693667.761494 trunc from 0x01a4aa to 0x021ab0 (0x7607 bytes) 000700 1781693667.776626 trunc from 0x02eb1f to 0x0179da (0x17144 bytes) 000701 1781693667.791597 trunc from 0x00b01f to 0x012f35 (0x7f17 bytes) 000702 1781693667.794559 trunc from 0x0179db to 0x032250 (0x1a876 bytes) 000703 1781693667.804830 fallocate 0x034659 thru 0x039a08 (0x53b0 bytes) 000704 1781693667.807582 mapwrite 0x019817 thru 0x01bd45 (0x252f bytes) 000705 1781693667.818649 trunc from 0x02ff86 to 0x031f95 (0x2010 bytes) 000706 1781693667.820911 write 0x02977e thru 0x03606d (0xc8f0 bytes) 000708 1781693667.827934 mapwrite 0x0054de thru 0x00e8bd (0x93e0 bytes) 000709 1781693667.838610 mapread 0x01a0ed thru 0x0270be (0xcfd2 bytes) 000710 1781693667.841712 fallocate 0x02f64b thru 0x03b417 (0xbdcd bytes) 000711 1781693667.844017 punch from 0x016fb8 to 0x01b766 (0x47af bytes) 000712 1781693667.846069 fallocate 0x03499f thru 0x03ffff (0xb661 bytes) 000713 1781693667.848329 trunc from 0x02d997 to 0x039eaa (0xc514 bytes) 000714 1781693667.850806 trunc from 0x040000 to 0x0180b3 (0x27f4c bytes) 000715 1781693667.859018 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x180b4): Mirror 5: 0x5f1320bd (stale) Mirror 6: 0x5f1320bd (stale) Mirror 8: 0x5f1320bd (stale) Mirror 9: 0x5f1320bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x180b4): Mirror 5: 0x5f1320bd (stale) Mirror 6: 0x5f1320bd (stale) Mirror 8: 0x5f1320bd (stale) Mirror 9: 0x5f1320bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x180b4: skipped 000716 1781693667.985282 trunc from 0x0180b4 to 0x02200a (0x9f57 bytes) 000717 1781693667.994167 fallocate 0x037b1e thru 0x03ffff (0x84e2 bytes) 000718 1781693667.996696 fallocate 0x02c978 thru 0x0307ab (0x3e34 bytes) 000719 1781693667.998772 trunc from 0x02200b to 0x0316d2 (0xf6c8 bytes) 000720 1781693668.004156 trunc from 0x027fae to 0x0316d2 (0x9725 bytes) 000721 1781693668.006177 read 0x018206 thru 0x01b353 (0x314e bytes) 000722 1781693668.008602 mapread 0x016d70 thru 0x022064 (0xb2f5 bytes) 000723 1781693668.016359 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x316d3): Mirror 5: 0xc973e531 (stale) Mirror 6: 0xc973e531 (stale) Mirror 9: 0xc973e531 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x316d3): Mirror 5: 0xc973e531 (stale) Mirror 6: 0xc973e531 (stale) Mirror 9: 0xc973e531 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x316d3: skipped 000725 1781693668.127199 fallocate 0x0046a2 thru 0x008103 (0x3a62 bytes) 000726 1781693668.129446 write 0x02fa44 thru 0x03b549 (0xbb06 bytes) 000728 1781693668.133975 read 0x004291 thru 0x010cc1 (0xca31 bytes) 000730 1781693668.141107 trunc from 0x006f8c to 0x00e013 (0x7088 bytes) 000731 1781693668.143554 trunc from 0x03b54a to 0x03313a (0x840f bytes) 000732 1781693668.152223 punch from 0x031901 to 0x03313a (0x183a bytes) 000733 1781693668.158571 write 0x031b1f thru 0x0374f6 (0x59d8 bytes) 000734 1781693668.163402 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x374f7): Mirror 5: 0xa1c7ffe (stale) Mirror 6: 0xa1c7ffe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374f7): Mirror 5: 0xa1c7ffe (stale) Mirror 6: 0xa1c7ffe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374f7: skipped 000735 1781693668.262879 mapread 0x02fb4b thru 0x0374f6 (0x79ac bytes) 000736 1781693668.269024 mapwrite 0x012d3b thru 0x015c1e (0x2ee4 bytes) 000737 1781693668.281209 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x374f7): Mirror 6: 0xa1c7ffe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374f7): Mirror 6: 0xa1c7ffe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374f7: skipped 000738 1781693668.361818 trunc from 0x0214d9 to 0x02b29e (0x9dc6 bytes) 000739 1781693668.363813 trunc from 0x0374f7 to 0x037097 (0x45f bytes) 000740 1781693668.369480 mapread 0x036485 thru 0x037097 (0xc13 bytes) 000741 1781693668.373197 write 0x007adf thru 0x0107eb (0x8d0d bytes) 000742 1781693668.376975 read 0x009ccf thru 0x015697 (0xb9c9 bytes) 000743 1781693668.380008 trunc from 0x037098 to 0x0180cf (0x1efc8 bytes) 000745 1781693668.385907 mapread 0x006220 thru 0x00d97d (0x775e bytes) 000746 1781693668.389344 read 0x00a031 thru 0x0180cf (0xe09f bytes) 000747 1781693668.392251 trunc from 0x0180d0 to 0x03eca7 (0x26bd8 bytes) 000748 1781693668.397760 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3eca8): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eca8): Mirror 6: 0x6c7b13b0 (stale) CRC-32 checksum value for chunk [0, 0x3eca8): Mirror 1: 0x8f05fb98 Mirror 7: 0x8f05fb98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eca8: skipped 000749 1781693668.654164 fallocate 0x003ee8 thru 0x004bcb (0xce4 bytes) 000750 1781693668.670788 mapread 0x03c8b9 thru 0x03eca7 (0x23ef bytes) 000751 1781693668.681908 mapread 0x000cb3 thru 0x003d0b (0x3059 bytes) 000752 1781693668.686756 mapread 0x030922 thru 0x0398c9 (0x8fa8 bytes) 000753 1781693668.691085 fallocate 0x0057bd thru 0x0154b3 (0xfcf7 bytes) 000756 1781693668.694350 trunc from 0x0060b6 to 0x008696 (0x25e1 bytes) 000757 1781693668.699166 fallocate 0x017d7b thru 0x027816 (0xfa9c bytes) 000758 1781693668.701830 trunc from 0x03eca8 to 0x028437 (0x16870 bytes) 000759 1781693668.714534 punch from 0x003b99 to 0x00a73a (0x6ba2 bytes) 000760 1781693668.716839 mapwrite 0x0185e1 thru 0x018da4 (0x7c4 bytes) 000761 1781693668.725356 trunc from 0x003cdd to 0x00b1b0 (0x74d4 bytes) 000762 1781693668.727901 mapread 0x00fd2c thru 0x018dfc (0x90d1 bytes) 000763 1781693668.731543 mapread 0x01f6a3 thru 0x027111 (0x7a6f bytes) 000764 1781693668.735539 read 0x00643e thru 0x00978d (0x3350 bytes) 000765 1781693668.738460 trunc from 0x028438 to 0x00156c (0x26ecb bytes) 000766 1781693668.744304 punch from 0x0008b6 to 0x00156c (0xcb7 bytes) 000767 1781693668.749817 trunc from 0x00034f to 0x00156c (0x121e bytes) 000768 1781693668.752203 read 0x0012c7 thru 0x00156c (0x2a6 bytes) 000769 1781693668.754374 write 0x03560a thru 0x03ffff (0xa9f6 bytes) 000770 1781693668.755921 trunc from 0x001f96 to 0x010ff3 (0xf05e bytes) 000771 1781693668.758314 punch from 0x02e590 to 0x03d9e2 (0xf453 bytes) 000772 1781693668.766111 read 0x01ec44 thru 0x021262 (0x261f bytes) 000773 1781693668.770759 read 0x009039 thru 0x00ca32 (0x39fa bytes) 000774 1781693668.771360 mapwrite 0x0055ad thru 0x00733a (0x1d8e bytes) 000775 1781693668.776844 mapwrite 0x02e134 thru 0x036382 (0x824f bytes) 000776 1781693668.785500 write 0x022e90 thru 0x02943d (0x65ae bytes) 000777 1781693668.788970 MIRROR_RESYNC 3 mirrors 000778 1781693669.133445 fallocate 0x015c36 thru 0x018d10 (0x30db bytes) 000779 1781693669.143183 trunc from 0x00587f to 0x00bc3d (0x63bf bytes) 000780 1781693669.146669 MIRROR_RESYNC 3 mirrors 000783 1781693669.453034 punch from 0x013f2a to 0x01cc2f (0x8d06 bytes) 000784 1781693669.471075 mapread 0x025ade thru 0x0268cb (0xdee bytes) 000786 1781693669.476433 fallocate 0x02df02 thru 0x02fe96 (0x1f95 bytes) 000787 1781693669.479268 read 0x0134f1 thru 0x021515 (0xe025 bytes) 000788 1781693669.485237 mapread 0x022704 thru 0x0326c0 (0xffbd bytes) 000789 1781693669.497326 fallocate 0x02fc09 thru 0x034d3b (0x5133 bytes) 000790 1781693669.499831 mapread 0x0086d4 thru 0x00ecf6 (0x6623 bytes) 000791 1781693669.503795 read 0x006a88 thru 0x00ff93 (0x950c bytes) 000792 1781693669.504526 fallocate 0x031339 thru 0x037cf8 (0x69c0 bytes) 000793 1781693669.506955 trunc from 0x00f576 to 0x0151cf (0x5c5a bytes) 000794 1781693669.508942 fallocate 0x02da31 thru 0x03c64d (0xec1d bytes) 000795 1781693669.511019 write 0x037fc4 thru 0x03ffff (0x803c bytes) 000796 1781693669.516199 write 0x029eb9 thru 0x032900 (0x8a48 bytes) 000798 1781693669.518110 mapwrite 0x03efcb thru 0x03ffff (0x1035 bytes) 000799 1781693669.525168 mapwrite 0x0213a9 thru 0x022197 (0xdef bytes) 000800 1781693669.531557 write 0x009e6b thru 0x00bde9 (0x1f7f bytes) 000801 1781693669.532377 mapwrite 0x035e63 thru 0x038ac8 (0x2c66 bytes) 000802 1781693669.546212 trunc from 0x00b52d to 0x013ea2 (0x8976 bytes) 000803 1781693669.549217 write 0x03ef86 thru 0x03ffff (0x107a bytes) 000804 1781693669.550131 trunc from 0x040000 to 0x03c0ab (0x3f54 bytes) 000805 1781693669.558617 punch from 0x03a084 to 0x03c0ab (0x2028 bytes) 000806 1781693669.565976 MIRROR_RESYNC 3 mirrors 000807 1781693669.967146 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000809 1781693670.094546 trunc from 0x039ed1 to 0x03c0ab (0x21db bytes) 000810 1781693670.108396 punch from 0x031a6d to 0x03786c (0x5e00 bytes) 000811 1781693670.110852 read 0x022baf thru 0x02d603 (0xaa55 bytes) 000812 1781693670.115192 fallocate 0x03ed9d thru 0x03ffff (0x1263 bytes) 000813 1781693670.120163 mapwrite 0x018e30 thru 0x01f880 (0x6a51 bytes) 000814 1781693670.147925 mapread 0x02507a thru 0x02eea8 (0x9e2f bytes) 000815 1781693670.156154 mapwrite 0x02868e thru 0x03501f (0xc992 bytes) 000816 1781693670.175475 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000817 1781693670.216608 mapwrite 0x03c370 thru 0x03ffff (0x3c90 bytes) 000818 1781693670.241130 mapwrite 0x03efaf thru 0x03f610 (0x662 bytes) 000819 1781693670.245914 read 0x003cb5 thru 0x009d67 (0x60b3 bytes) 000820 1781693670.249512 trunc from 0x040000 to 0x01c6fc (0x23903 bytes) 000821 1781693670.255023 read 0x019d48 thru 0x01c6fc (0x29b5 bytes) 000824 1781693670.259887 mapwrite 0x01fdc2 thru 0x02e021 (0xe260 bytes) 000825 1781693670.277938 mapread 0x024ef6 thru 0x02e021 (0x912c bytes) 000826 1781693670.278953 fallocate 0x03815e thru 0x03ffff (0x7ea2 bytes) 000828 1781693670.281402 fallocate 0x01fc68 thru 0x026c97 (0x7030 bytes) 000829 1781693670.283392 mapread 0x0055f1 thru 0x0130f5 (0xdb05 bytes) 000830 1781693670.284210 trunc from 0x01d147 to 0x02bf54 (0xee0e bytes) 000831 1781693670.286239 fallocate 0x018790 thru 0x0189b6 (0x227 bytes) 000833 1781693670.288977 mapwrite 0x01a760 thru 0x026afe (0xc39f bytes) 000834 1781693670.312114 read 0x01efe6 thru 0x02ac40 (0xbc5b bytes) 000835 1781693670.315155 mapwrite 0x01e288 thru 0x024df2 (0x6b6b bytes) 000836 1781693670.328350 MIRROR_EXTEND to 2 mirrors 000837 1781693670.548955 punch from 0x03d279 to 0x03ffff (0x2d87 bytes) 000838 1781693670.566949 punch from 0x035f2d to 0x03b46c (0x5540 bytes) 000839 1781693670.568756 trunc from 0x01b6e1 to 0x0218ab (0x61cb bytes) 000840 1781693670.570956 write 0x03cfa9 thru 0x03e294 (0x12ec bytes) 000841 1781693670.576187 mapwrite 0x022304 thru 0x02d888 (0xb585 bytes) 000842 1781693670.599164 fallocate 0x036e5a thru 0x03ae4b (0x3ff2 bytes) 000843 1781693670.601842 fallocate 0x0285c8 thru 0x02dcdf (0x5718 bytes) 000844 1781693670.604135 read 0x00eea2 thru 0x01c990 (0xdaef bytes) 000845 1781693670.608409 write 0x038722 thru 0x03ffff (0x78de bytes) 000846 1781693670.611529 write 0x03fcaa thru 0x03ffff (0x356 bytes) 000847 1781693670.612192 trunc from 0x039880 to 0x03ffff (0x6780 bytes) 000848 1781693670.622045 MIRROR_RESYNC 2 mirrors 000849 1781693670.875975 write 0x026be3 thru 0x0329da (0xbdf8 bytes) 000850 1781693670.891604 mapread 0x02de11 thru 0x037b2a (0x9d1a bytes) 000851 1781693670.903969 punch from 0x03ffeb to 0x03ffff (0x15 bytes) 000852 1781693670.906470 mapwrite 0x03f1e7 thru 0x03ffff (0xe19 bytes) 000853 1781693670.916721 MIRROR_RESYNC 2 mirrors 000854 1781693671.222817 mapwrite 0x036f1b thru 0x03ffff (0x90e5 bytes) 000855 1781693671.262179 trunc from 0x03745b to 0x03ffff (0x8ba5 bytes) 000856 1781693671.264745 trunc from 0x00ee20 to 0x01bbce (0xcdaf bytes) 000857 1781693671.267152 read 0x03a756 thru 0x03ffff (0x58aa bytes) 000858 1781693671.276252 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000859 1781693671.337829 write 0x0258ab thru 0x0347ad (0xef03 bytes) 000860 1781693671.344110 fallocate 0x019b2e thru 0x0214f0 (0x79c3 bytes) 000861 1781693671.346516 read 0x014e50 thru 0x023d9e (0xef4f bytes) 000862 1781693671.350082 fallocate 0x033d44 thru 0x0344f1 (0x7ae bytes) 000863 1781693671.352240 mapwrite 0x0360e9 thru 0x03ffff (0x9f17 bytes) 000865 1781693671.369981 write 0x033a13 thru 0x0357f6 (0x1de4 bytes) 000866 1781693671.370962 trunc from 0x001cdc to 0x00b540 (0x9865 bytes) 000868 1781693671.373448 mapwrite 0x01c26c thru 0x0238d7 (0x766c bytes) 000869 1781693671.384736 mapread 0x000a7f thru 0x0030a4 (0x2626 bytes) 000870 1781693671.394106 punch from 0x0175b3 to 0x01b0d5 (0x3b23 bytes) 000872 1781693671.398289 punch from 0x03f0a3 to 0x03ffff (0xf5d bytes) 000873 1781693671.402072 trunc from 0x040000 to 0x020501 (0x1fafe bytes) 000874 1781693671.413939 read 0x011405 thru 0x01a9c8 (0x95c4 bytes) 000876 1781693671.419193 punch from 0x00363b to 0x0108f4 (0xd2ba bytes) 000877 1781693671.422936 MIRROR_EXTEND to 2 mirrors 000878 1781693671.633430 punch from 0x01dede to 0x01eba5 (0xcc8 bytes) 000879 1781693671.673005 MIRROR_RESYNC 2 mirrors 000880 1781693671.866834 trunc from 0x020502 to 0x007eae (0x18653 bytes) 000881 1781693671.893353 mapread 0x001c20 thru 0x007af8 (0x5ed9 bytes) 000882 1781693671.905168 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000883 1781693671.963109 fallocate 0x01f80c thru 0x0227de (0x2fd3 bytes) 000884 1781693671.965145 read 0x001af8 thru 0x007eae (0x63b7 bytes) 000885 1781693671.969172 MIRROR_EXTEND to 2 mirrors 000886 1781693672.165784 mapwrite 0x038b8f thru 0x03a5a5 (0x1a17 bytes) 000887 1781693672.195852 fallocate 0x024175 thru 0x028ce5 (0x4b71 bytes) 000888 1781693672.198260 trunc from 0x03a5a6 to 0x008f4f (0x31656 bytes) 000889 1781693672.204200 fallocate 0x038df7 thru 0x03ffff (0x7209 bytes) 000890 1781693672.206258 read 0x01cdea thru 0x027402 (0xa619 bytes) 000891 1781693672.211385 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) 000892 1781693672.252540 punch from 0x005fff to 0x00a891 (0x4893 bytes) 000894 1781693672.254655 trunc from 0x02cb0a to 0x032ff5 (0x64ec bytes) 000895 1781693672.257390 mapwrite 0x010193 thru 0x012445 (0x22b3 bytes) 000896 1781693672.271409 trunc from 0x040000 to 0x03fbb7 (0x448 bytes) 000897 1781693672.277505 punch from 0x01deb4 to 0x02806d (0xa1ba bytes) 000898 1781693672.279178 fallocate 0x032715 thru 0x03ffff (0xd8eb bytes) 000901 1781693672.282230 mapwrite 0x005d19 thru 0x00d4d4 (0x77bc bytes) 000902 1781693672.291688 fallocate 0x00dc93 thru 0x0157d5 (0x7b43 bytes) 000903 1781693672.293900 trunc from 0x026a59 to 0x02f6b5 (0x8c5d bytes) 000904 1781693672.295664 mapwrite 0x0014a4 thru 0x00443a (0x2f97 bytes) 000905 1781693672.301803 read 0x0139d1 thru 0x0218bc (0xdeec bytes) 000906 1781693672.305200 read 0x021355 thru 0x03126f (0xff1b bytes) 000907 1781693672.309320 write 0x020ad2 thru 0x026856 (0x5d85 bytes) 000908 1781693672.310399 punch from 0x0399d5 to 0x03fbb7 (0x61e3 bytes) 000909 1781693672.312490 trunc from 0x00394e to 0x00e5a4 (0xac57 bytes) 000910 1781693672.314559 trunc from 0x000c78 to 0x009beb (0x8f74 bytes) 000911 1781693672.316387 trunc from 0x03fbb8 to 0x0185bd (0x275fa bytes) 000913 1781693672.321950 mapread 0x0076d2 thru 0x011a72 (0xa3a1 bytes) 000914 1781693672.332316 fallocate 0x02726c thru 0x0337f4 (0xc589 bytes) 000915 1781693672.334002 punch from 0x017572 to 0x02282e (0xb2bd bytes) 000917 1781693672.335797 punch from 0x01719a to 0x01b9d4 (0x483b bytes) 000918 1781693672.337415 punch from 0x016fe3 to 0x01a6ae (0x36cc bytes) 000919 1781693672.338957 punch from 0x00a56f to 0x00dc56 (0x36e8 bytes) 000920 1781693672.340653 write 0x03fe3e thru 0x03ffff (0x1c2 bytes) 000921 1781693672.341472 write 0x0392df thru 0x03ffff (0x6d21 bytes) 000922 1781693672.343825 trunc from 0x040000 to 0x03ff85 (0x7a bytes) 000923 1781693672.355283 read 0x038cab thru 0x03ca13 (0x3d69 bytes) 000924 1781693672.359455 punch from 0x00885b to 0x016a90 (0xe236 bytes) 000925 1781693672.362155 trunc from 0x03ff86 to 0x0185d9 (0x279ac bytes) 000926 1781693672.367962 write 0x02671e thru 0x030b0a (0xa3ed bytes) 000927 1781693672.369453 mapread 0x0091e6 thru 0x01850b (0xf326 bytes) 000928 1781693672.394814 read 0x017496 thru 0x01ea1a (0x7585 bytes) 000929 1781693672.398637 mapread 0x015190 thru 0x019618 (0x4489 bytes) 000930 1781693672.399398 mapwrite 0x026b78 thru 0x0331ca (0xc653 bytes) 000932 1781693672.416161 punch from 0x00162c to 0x0066f5 (0x50ca bytes) 000935 1781693672.421262 write 0x00b8b6 thru 0x00ed54 (0x349f bytes) 000936 1781693672.422265 mapwrite 0x00aeb3 thru 0x013a96 (0x8be4 bytes) 000937 1781693672.431259 punch from 0x0230ef to 0x026442 (0x3354 bytes) 000938 1781693672.433360 read 0x024f52 thru 0x02b64f (0x66fe bytes) 000940 1781693672.438351 mapread 0x018511 thru 0x019364 (0xe54 bytes) 000941 1781693672.439030 punch from 0x00eb12 to 0x011330 (0x281f bytes) 000942 1781693672.441377 punch from 0x012ddb to 0x013fc2 (0x11e8 bytes) 000943 1781693672.449091 trunc from 0x00de6b to 0x019fad (0xc143 bytes) 000944 1781693672.453161 trunc from 0x0331cb to 0x018a92 (0x1a738 bytes) 000945 1781693672.459034 trunc from 0x00e2fd to 0x018a92 (0xa796 bytes) 000946 1781693672.461026 trunc from 0x00388b to 0x00d1d7 (0x994d bytes) 000947 1781693672.463046 trunc from 0x018a93 to 0x031624 (0x18b92 bytes) 000950 1781693672.469416 trunc from 0x01e21d to 0x02b3e5 (0xd1c9 bytes) 000951 1781693672.471328 trunc from 0x01c0c7 to 0x0238f6 (0x7830 bytes) 000953 1781693672.473664 trunc from 0x031625 to 0x001c30 (0x2f9f4 bytes) 000954 1781693672.480363 MIRROR_EXTEND to 2 mirrors 000955 1781693672.653799 MIRROR_EXTEND to 3 mirrors 000956 1781693672.829934 MIRROR_EXTEND to 4 mirrors 000957 1781693672.969294 write 0x004d5f thru 0x0063ea (0x168c bytes) 000958 1781693672.983200 punch from 0x003cc1 to 0x0063ea (0x272a bytes) 000959 1781693672.987032 fallocate 0x0281ed thru 0x02fe71 (0x7c85 bytes) 000960 1781693672.989251 mapread 0x01bb18 thru 0x01fb87 (0x4070 bytes) 000961 1781693672.995298 write 0x03b6ea thru 0x03ffff (0x4916 bytes) 000962 1781693672.996156 trunc from 0x040000 to 0x0379a8 (0x8657 bytes) 000963 1781693673.006018 mapwrite 0x01138c thru 0x01acfb (0x9970 bytes) 000964 1781693673.015966 read 0x037528 thru 0x0379a8 (0x481 bytes) 000965 1781693673.017670 mapwrite 0x02df7e thru 0x03685b (0x88de bytes) 000966 1781693673.028653 write 0x0129c3 thru 0x01c0a3 (0x96e1 bytes) 000967 1781693673.029611 mapread 0x0214b7 thru 0x02cf69 (0xbab3 bytes) 000968 1781693673.030387 mapwrite 0x022dd5 thru 0x02f514 (0xc740 bytes) 000969 1781693673.038469 fallocate 0x035874 thru 0x03d8b3 (0x8040 bytes) 000970 1781693673.040385 trunc from 0x0379a9 to 0x0393b4 (0x1a0c bytes) 000971 1781693673.044461 trunc from 0x0387a9 to 0x0393b4 (0xc0c bytes) 000973 1781693673.047484 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x393b5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393b5): Mirror 2: 0xfb3de143 (stale) Mirror 3: 0xfb3de143 (stale) Mirror 4: 0xfb3de143 (stale) CRC-32 checksum value for chunk [0, 0x393b5): Mirror 1: 0x46e4ade9 Mirror 5: 0x46e4ade9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393b5: skipped 000974 1781693673.302751 read 0x025501 thru 0x02e6dd (0x91dd bytes) 000975 1781693673.305651 mapread 0x00f7ae thru 0x0189e6 (0x9239 bytes) 000976 1781693673.311208 mapwrite 0x026efd thru 0x03129b (0xa39f bytes) 000977 1781693673.351242 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x393b5): Mirror 3: 0xfb3de143 (stale) Mirror 4: 0xfb3de143 (stale) Mirror 5: 0x46e4ade9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393b5): Mirror 3: 0xfb3de143 (stale) Mirror 4: 0xfb3de143 (stale) Mirror 5: 0x46e4ade9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393b5: skipped 000978 1781693673.451981 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x393b5): Mirror 4: 0xfb3de143 (stale) Mirror 5: 0x46e4ade9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393b5): Mirror 4: 0xfb3de143 (stale) Mirror 5: 0x46e4ade9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393b5: skipped 000979 1781693673.548045 trunc from 0x037248 to 0x0393b4 (0x216d bytes) 000980 1781693673.550020 mapread 0x00ead1 thru 0x017597 (0x8ac7 bytes) 000981 1781693673.556113 write 0x00f5c9 thru 0x017f75 (0x89ad bytes) 000982 1781693673.558448 punch from 0x018993 to 0x026edd (0xe54b bytes) 000983 1781693673.560655 write 0x02fce1 thru 0x034cb0 (0x4fd0 bytes) 000984 1781693673.564095 trunc from 0x02e717 to 0x0393b4 (0xac9e bytes) 000985 1781693673.568292 trunc from 0x0393b5 to 0x0285d8 (0x10ddc bytes) 000986 1781693673.577773 read 0x010b28 thru 0x01e13d (0xd616 bytes) 000987 1781693673.582145 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x285d9): Mirror 5: 0x83c8557d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x285d9): Mirror 5: 0x83c8557d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x285d9: skipped 000989 1781693673.662317 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x285d9): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x285d9): Mirror 5: 0x83c8557d (stale) CRC-32 checksum value for chunk [0, 0x285d9): Mirror 1: 0xb97fc9e1 Mirror 6: 0xb97fc9e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x285d9: skipped 000990 1781693673.910387 fallocate 0x037326 thru 0x03ac0c (0x38e7 bytes) 000991 1781693673.920772 mapwrite 0x039a4f thru 0x03aac9 (0x107b bytes) 000992 1781693673.939295 MIRROR_RESYNC 3 mirrors 000993 1781693674.211383 trunc from 0x001f66 to 0x006197 (0x4232 bytes) 000994 1781693674.221552 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x76b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aaca): Mirror 5: 0x5c9a484c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aaca): Mirror 5: 0x5c9a484c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aaca: skipped 000995 1781693674.308805 fallocate 0x02b553 thru 0x031bd3 (0x6681 bytes) 000996 1781693674.311185 read 0x00fab9 thru 0x017ebb (0x8403 bytes) 000997 1781693674.314534 trunc from 0x03aaca to 0x0199d6 (0x210f3 bytes) 000998 1781693674.322335 mapread 0x01476b thru 0x0199d6 (0x526c bytes) 000999 1781693674.327727 trunc from 0x016cf2 to 0x0199d6 (0x2ce5 bytes) 001000 1781693674.331443 punch from 0x012ba7 to 0x0199d6 (0x6e30 bytes) All operations completed A-OK!