== sanity-flr test 70a: flr mode fsx test ================ 12:42:35 (1789317755) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 7756 skipping zero size read 000003 1789317756.387349 write 0x014b2f thru 0x01dde0 (0x92b2 bytes) 000004 1789317756.388511 punch from 0x00e8b9 to 0x0194c1 (0xac09 bytes) truncating to largest ever: 0x1ed34 000006 1789317756.394343 trunc from 0x01dde1 to 0x01ed33 (0xf53 bytes) 000007 1789317756.400426 write 0x0398aa thru 0x03ffff (0x6756 bytes) 000008 1789317756.401676 punch from 0x035f6c to 0x03ffff (0xa094 bytes) 000009 1789317756.407190 write 0x02cb8b thru 0x03bc56 (0xf0cc bytes) truncating to largest ever: 0x2d69e 000010 1789317756.411805 trunc from 0x040000 to 0x02d69d (0x12962 bytes) 000011 1789317756.417560 write 0x01a0f8 thru 0x01b134 (0x103d bytes) 000012 1789317756.419955 read 0x0186c5 thru 0x025d87 (0xd6c3 bytes) 000013 1789317756.425541 read 0x0122ca thru 0x017ab6 (0x57ed bytes) 000014 1789317756.430556 mapwrite 0x02252a thru 0x02ec8d (0xc764 bytes) 000015 1789317756.453933 trunc from 0x00e178 to 0x0127bd (0x4646 bytes) 000016 1789317756.456458 read 0x01aee2 thru 0x022870 (0x798f bytes) 000017 1789317756.457115 mapwrite 0x022e2d thru 0x02a96c (0x7b40 bytes) 000018 1789317756.468278 MIRROR_EXTEND to 2 mirrors zero_range to largest ever: 0x2ec8e 000019 1789317756.685926 trunc from 0x02ec3c to 0x02ec8d (0x52 bytes) 000020 1789317756.696617 trunc from 0x01d389 to 0x01e92c (0x15a4 bytes) 000021 1789317756.699969 MIRROR_RESYNC 2 mirrors 000022 1789317756.921201 fallocate 0x02d0a1 thru 0x02da70 (0x9d0 bytes) 000023 1789317756.936142 mapread 0x024b79 thru 0x027edf (0x3367 bytes) 000024 1789317756.945855 trunc from 0x01ed8f to 0x023779 (0x49eb bytes) 000027 1789317756.949529 fallocate 0x01d818 thru 0x0265aa (0x8d93 bytes) 000028 1789317756.954387 MIRROR_RESYNC 2 mirrors 000029 1789317757.191240 mapread 0x026638 thru 0x0276d4 (0x109d bytes) 000030 1789317757.194706 write 0x02418e thru 0x03160c (0xd47f bytes) 000031 1789317757.206926 mapread 0x018047 thru 0x01fa1d (0x79d7 bytes) 000032 1789317757.210701 read 0x008c48 thru 0x009536 (0x8ef bytes) 000033 1789317757.212912 mapwrite 0x02ae5d thru 0x03765e (0xc802 bytes) 000034 1789317757.230184 punch from 0x01d67a to 0x0244e0 (0x6e67 bytes) 000035 1789317757.232675 punch from 0x034fd7 to 0x03765e (0x2688 bytes) 000036 1789317757.234454 write 0x005ddc thru 0x00aca0 (0x4ec5 bytes) 000037 1789317757.240121 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000038 1789317757.294655 mapread 0x032c80 thru 0x036aa0 (0x3e21 bytes) 000039 1789317757.302906 trunc from 0x009327 to 0x01718f (0xde69 bytes) 000041 1789317757.306673 mapwrite 0x0266ec thru 0x033b8a (0xd49f bytes) 000043 1789317757.323732 write 0x02eece thru 0x0379f0 (0x8b23 bytes) 000045 1789317757.327548 trunc from 0x0379f1 to 0x0187a1 (0x1f24f bytes) 000046 1789317757.334885 trunc from 0x0187a2 to 0x00960a (0xf197 bytes) 000047 1789317757.341069 fallocate 0x00bb3b thru 0x01b5fc (0xfac2 bytes) 000048 1789317757.343792 read 0x0043f3 thru 0x00ed89 (0xa997 bytes) 000049 1789317757.348408 read 0x00c12a thru 0x0160a8 (0x9f7f bytes) 000050 1789317757.352225 write 0x029c10 thru 0x033445 (0x9836 bytes) 000051 1789317757.353507 write 0x014de2 thru 0x01f4f6 (0xa715 bytes) 000052 1789317757.356873 mapwrite 0x029f5f thru 0x03860e (0xe6b0 bytes) 000053 1789317757.374373 mapread 0x0153ae thru 0x0206f8 (0xb34b bytes) 000054 1789317757.375344 punch from 0x0093d4 to 0x00a9fb (0x1628 bytes) 000055 1789317757.377668 mapwrite 0x0318d0 thru 0x03468d (0x2dbe bytes) 000056 1789317757.383798 write 0x03fa33 thru 0x03ffff (0x5cd bytes) 000057 1789317757.384655 trunc from 0x006019 to 0x012e3a (0xce22 bytes) 000058 1789317757.387173 punch from 0x0186e7 to 0x0203bc (0x7cd6 bytes) 000060 1789317757.389513 punch from 0x03ebef to 0x03ffff (0x1411 bytes) 000061 1789317757.392992 read 0x02af99 thru 0x032f2a (0x7f92 bytes) 000062 1789317757.393572 mapwrite 0x00d489 thru 0x00f326 (0x1e9e bytes) 000063 1789317757.401483 write 0x01fb3a thru 0x022d05 (0x31cc bytes) 000064 1789317757.402257 read 0x02606c thru 0x0333fc (0xd391 bytes) 000065 1789317757.402638 trunc from 0x040000 to 0x0161c6 (0x29e39 bytes) 000066 1789317757.407534 write 0x021f2d thru 0x02cf62 (0xb036 bytes) 000068 1789317757.409129 read 0x028864 thru 0x029aaa (0x1247 bytes) 000070 1789317757.409730 trunc from 0x002743 to 0x011107 (0xe9c5 bytes) 000071 1789317757.412272 punch from 0x012c50 to 0x02226c (0xf61d bytes) 000072 1789317757.417205 trunc from 0x01cc51 to 0x01f6dc (0x2a8c bytes) 000073 1789317757.419073 mapwrite 0x02a4a9 thru 0x03403d (0x9b95 bytes) 000074 1789317757.435178 mapread 0x02f459 thru 0x03403d (0x4be5 bytes) 000076 1789317757.436226 fallocate 0x019eda thru 0x029014 (0xf13b bytes) 000077 1789317757.438473 punch from 0x011c7f to 0x016692 (0x4a14 bytes) 000078 1789317757.440382 trunc from 0x02a853 to 0x03403d (0x97eb bytes) truncating to largest ever: 0x346e9 000079 1789317757.442290 trunc from 0x03403e to 0x0346e8 (0x6ab bytes) 000080 1789317757.447371 trunc from 0x0346e9 to 0x016e91 (0x1d857 bytes) 000081 1789317757.452399 mapwrite 0x031d3e thru 0x0321fc (0x4bf bytes) 000082 1789317757.467976 MIRROR_EXTEND to 2 mirrors 000083 1789317757.676460 trunc from 0x021741 to 0x02f565 (0xde25 bytes) 000084 1789317757.685622 write 0x012bae thru 0x0190c0 (0x6513 bytes) 000085 1789317757.691965 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x321fd): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321fd): Mirror 2: 0x43f3eed4 (stale) CRC-32 checksum value for chunk [0, 0x321fd): Mirror 1: 0x399a8abd Mirror 3: 0x399a8abd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321fd: skipped 000086 1789317757.934492 trunc from 0x01e947 to 0x028bab (0xa265 bytes) 000087 1789317757.944086 read 0x014065 thru 0x023d09 (0xfca5 bytes) 000088 1789317757.948482 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x321fd): Mirror 3: 0x399a8abd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321fd): Mirror 3: 0x399a8abd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321fd: skipped 000089 1789317758.042347 write 0x03e2af thru 0x03fc55 (0x19a7 bytes) 000090 1789317758.046799 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3fc56): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc56): Mirror 3: 0x20a91962 (stale) CRC-32 checksum value for chunk [0, 0x3fc56): Mirror 1: 0x9ef3f88 Mirror 4: 0x9ef3f88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc56: skipped 000091 1789317758.310412 read 0x03b764 thru 0x03fc55 (0x44f2 bytes) 000092 1789317758.313469 write 0x01c4d1 thru 0x02beda (0xfa0a bytes) 000093 1789317758.327678 read 0x011bd6 thru 0x01699c (0x4dc7 bytes) 000094 1789317758.331431 punch from 0x01f268 to 0x02bc62 (0xc9fb bytes) 000095 1789317758.336328 write 0x03b727 thru 0x03bdc2 (0x69c bytes) 000096 1789317758.337087 trunc from 0x01a03e to 0x023bef (0x9bb2 bytes) 000097 1789317758.340226 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fc56): Mirror 4: 0x9ef3f88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc56): Mirror 4: 0x9ef3f88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc56: skipped fallocating to largest ever: 0x40000 000098 1789317758.427542 fallocate 0x03dbe1 thru 0x03ffff (0x241f bytes) 000099 1789317758.430104 write 0x004b2a thru 0x00c52c (0x7a03 bytes) 000100 1789317758.438817 mapwrite 0x03fb30 thru 0x03ffff (0x4d0 bytes) 000101 1789317758.449718 MIRROR_RESYNC 2 mirrors 000102 1789317758.695584 mapread 0x020dd8 thru 0x02ed6d (0xdf96 bytes) 000103 1789317758.704488 trunc from 0x029fe3 to 0x037a56 (0xda74 bytes) 000104 1789317758.716606 mapread 0x037845 thru 0x03ffff (0x87bb bytes) 000105 1789317758.719892 trunc from 0x040000 to 0x02f974 (0x1068b bytes) 000106 1789317758.731092 fallocate 0x00624c thru 0x010a6e (0xa823 bytes) 000108 1789317758.733560 mapread 0x017de9 thru 0x01c164 (0x437c bytes) 000110 1789317758.737141 read 0x00c1ac thru 0x011978 (0x57cd bytes) 000111 1789317758.739412 read 0x01635f thru 0x020765 (0xa407 bytes) 000112 1789317758.743100 write 0x016d23 thru 0x021c4d (0xaf2b bytes) 000113 1789317758.744433 punch from 0x0213c0 to 0x02c239 (0xae7a bytes) 000114 1789317758.749649 write 0x0046fd thru 0x00772a (0x302e bytes) 000115 1789317758.750572 trunc from 0x021d26 to 0x02f974 (0xdc4f bytes) 000116 1789317758.752880 mapwrite 0x02c5ac thru 0x032a0e (0x6463 bytes) 000117 1789317758.772368 punch from 0x01c0ab to 0x01e522 (0x2478 bytes) 000118 1789317758.774523 trunc from 0x01ddcb to 0x020c5c (0x2e92 bytes) 000119 1789317758.777934 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000120 1789317758.821591 punch from 0x02d1d0 to 0x032a0e (0x583f bytes) 000121 1789317758.823569 mapwrite 0x02a23b thru 0x036668 (0xc42e bytes) 000122 1789317758.842412 trunc from 0x00387f to 0x00c85b (0x8fdd bytes) 000123 1789317758.844050 trunc from 0x036669 to 0x0072e7 (0x2f381 bytes) 000124 1789317758.848125 read 0x0007cf thru 0x0072e7 (0x6b19 bytes) 000125 1789317758.850453 punch from 0x004d26 to 0x0072e7 (0x25c2 bytes) 000126 1789317758.851870 trunc from 0x0072e8 to 0x00d3f4 (0x610d bytes) 000127 1789317758.855955 fallocate 0x003178 thru 0x00c346 (0x91cf bytes) 000128 1789317758.857674 trunc from 0x00d3f5 to 0x0140ce (0x6cda bytes) 000129 1789317758.861635 trunc from 0x00fed3 to 0x0102ee (0x41c bytes) 000130 1789317758.863337 write 0x00bf2a thru 0x010e30 (0x4f07 bytes) 000131 1789317758.866430 punch from 0x0048f0 to 0x00ea4a (0xa15b bytes) 000133 1789317758.871049 fallocate 0x038410 thru 0x03bbfe (0x37ef bytes) 000134 1789317758.872933 fallocate 0x00bf07 thru 0x011d1d (0x5e17 bytes) 000135 1789317758.874668 read 0x007d83 thru 0x014661 (0xc8df bytes) 000136 1789317758.879167 trunc from 0x017d7e to 0x01d0bd (0x5340 bytes) 000138 1789317758.881778 write 0x026c9a thru 0x035da4 (0xf10b bytes) 000139 1789317758.882798 read 0x033215 thru 0x033a25 (0x811 bytes) 000140 1789317758.883204 trunc from 0x03bbff to 0x01030e (0x2b8f0 bytes) 000141 1789317758.889641 write 0x0118b0 thru 0x013632 (0x1d83 bytes) 000142 1789317758.890954 trunc from 0x013633 to 0x01f26d (0xbc3b bytes) 000144 1789317758.896912 fallocate 0x029a86 thru 0x039467 (0xf9e2 bytes) 000145 1789317758.899087 write 0x02ccae thru 0x03a264 (0xd5b7 bytes) 000146 1789317758.900639 mapread 0x00d0bd thru 0x012354 (0x5298 bytes) 000149 1789317758.902341 fallocate 0x00d93a thru 0x017f43 (0xa60a bytes) 000150 1789317758.906847 MIRROR_EXTEND to 2 mirrors 000152 1789317759.144720 write 0x03eff3 thru 0x03ffff (0x100d bytes) 000153 1789317759.155363 trunc from 0x0208e9 to 0x02ed8a (0xe4a2 bytes) 000155 1789317759.157865 punch from 0x0017e3 to 0x009a32 (0x8250 bytes) 000156 1789317759.159929 trunc from 0x040000 to 0x01a919 (0x256e6 bytes) 000157 1789317759.165878 mapread 0x003d41 thru 0x013a82 (0xfd42 bytes) 000158 1789317759.174157 trunc from 0x01a91a to 0x03a65c (0x1fd43 bytes) 000159 1789317759.181539 fallocate 0x03eb8a thru 0x03ebb5 (0x2c bytes) 000160 1789317759.184086 mapread 0x01a42f thru 0x021cac (0x787e bytes) 000161 1789317759.187597 read 0x00cf30 thru 0x018728 (0xb7f9 bytes) 000162 1789317759.188257 trunc from 0x03ebb6 to 0x02fcd3 (0xeee2 bytes) 000163 1789317759.193568 mapread 0x00e313 thru 0x0100a3 (0x1d91 bytes) 000164 1789317759.194313 fallocate 0x010c83 thru 0x0146bf (0x3a3d bytes) 000166 1789317759.196684 trunc from 0x011c5b to 0x01ce97 (0xb23d bytes) 000167 1789317759.199211 mapread 0x009312 thru 0x013020 (0x9d0f bytes) 000168 1789317759.202664 write 0x022d38 thru 0x02437e (0x1647 bytes) 000169 1789317759.204996 trunc from 0x018d5c to 0x01e848 (0x5aed bytes) 000170 1789317759.207086 trunc from 0x02fcd4 to 0x0391c2 (0x94ef bytes) 000171 1789317759.213106 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x391c3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x391c3): Mirror 2: 0x1f9d42a0 (stale) CRC-32 checksum value for chunk [0, 0x391c3): Mirror 1: 0xe07be758 Mirror 3: 0xe07be758 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x391c3: skipped 000172 1789317759.481885 trunc from 0x0391c3 to 0x01cd3f (0x1c483 bytes) 000173 1789317759.493350 fallocate 0x02d74b thru 0x037e4a (0xa700 bytes) 000174 1789317759.496985 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37e4b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e4b): Mirror 2: 0x17c8a1ab (stale) Mirror 3: 0xe2825d2e (stale) CRC-32 checksum value for chunk [0, 0x37e4b): Mirror 1: 0x628f92bf Mirror 4: 0x628f92bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e4b: skipped 000176 1789317759.764640 trunc from 0x00d6c8 to 0x00ea8c (0x13c5 bytes) 000177 1789317759.775893 mapread 0x01a55b thru 0x01ecb6 (0x475c bytes) 000178 1789317759.781011 mapwrite 0x00e3a6 thru 0x0107a6 (0x2401 bytes) 000179 1789317759.787545 trunc from 0x037e4b to 0x0010bc (0x36d8e bytes) 000180 1789317759.794847 write 0x036fe0 thru 0x03dd56 (0x6d77 bytes) 000182 1789317759.796176 mapread 0x023433 thru 0x032a01 (0xf5cf bytes) 000183 1789317759.802638 MIRROR_RESYNC 4 mirrors 000184 1789317760.037679 trunc from 0x03dd57 to 0x035a7f (0x82d7 bytes) 000185 1789317760.055300 mapread 0x0289aa thru 0x02fc5a (0x72b1 bytes) 000186 1789317760.061770 fallocate 0x00e27f thru 0x0147ca (0x654c bytes) 000187 1789317760.064198 trunc from 0x028353 to 0x02b9de (0x368c bytes) 000188 1789317760.066276 fallocate 0x01112f thru 0x01e696 (0xd568 bytes) 000189 1789317760.070056 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35a80): Mirror 3: 0x50de7461 (stale) Mirror 4: 0x50de7461 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a80): Mirror 3: 0x50de7461 (stale) Mirror 4: 0x50de7461 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a80: skipped 000190 1789317760.165504 mapread 0x00ddd1 thru 0x00e9ba (0xbea bytes) 000192 1789317760.170233 read 0x03136f thru 0x035a7f (0x4711 bytes) 000193 1789317760.173519 mapread 0x01a405 thru 0x02184c (0x7448 bytes) 000194 1789317760.178533 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35a80): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a80): Mirror 3: 0x50de7461 (stale) Mirror 4: 0x50de7461 (stale) CRC-32 checksum value for chunk [0, 0x35a80): Mirror 1: 0x50de7461 Mirror 5: 0x50de7461 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a80: skipped 000195 1789317760.434625 trunc from 0x02792f to 0x035a7f (0xe151 bytes) 000196 1789317760.446043 fallocate 0x01cdad thru 0x02c7cc (0xfa20 bytes) 000198 1789317760.448270 fallocate 0x008e12 thru 0x00d375 (0x4564 bytes) 000199 1789317760.450114 write 0x038acd thru 0x03ffff (0x7533 bytes) 000200 1789317760.452725 punch from 0x0319c5 to 0x03ffff (0xe63b bytes) 000201 1789317760.457531 trunc from 0x03df24 to 0x03ffff (0x20dc bytes) 000202 1789317760.459480 trunc from 0x02dbaf to 0x03cb39 (0xef8b bytes) 000203 1789317760.461516 punch from 0x01261a to 0x020d5d (0xe744 bytes) 000204 1789317760.463519 mapwrite 0x0292fa thru 0x02b4fe (0x2205 bytes) 000205 1789317760.475122 mapread 0x0265ef thru 0x033868 (0xd27a bytes) 000206 1789317760.476061 write 0x008cea thru 0x00dd5a (0x5071 bytes) 000207 1789317760.479347 punch from 0x00eade to 0x019153 (0xa676 bytes) 000208 1789317760.481281 mapwrite 0x005570 thru 0x008af3 (0x3584 bytes) 000209 1789317760.491483 write 0x00a4dd thru 0x00b696 (0x11ba bytes) 000210 1789317760.492158 trunc from 0x040000 to 0x00ef1e (0x310e1 bytes) 000212 1789317760.505977 punch from 0x003e02 to 0x00c610 (0x880f bytes) 000213 1789317760.510158 read 0x0031ea thru 0x005162 (0x1f79 bytes) 000214 1789317760.512789 trunc from 0x00b3ef to 0x00ef1e (0x3b30 bytes) 000215 1789317760.515081 mapwrite 0x003b76 thru 0x003fd2 (0x45d bytes) 000216 1789317760.520721 fallocate 0x01beb7 thru 0x0230eb (0x7235 bytes) 000217 1789317760.523566 mapread 0x002b58 thru 0x009962 (0x6e0b bytes) 000218 1789317760.528866 fallocate 0x01d09b thru 0x0203b5 (0x331b bytes) 000219 1789317760.531453 trunc from 0x0018fb to 0x009e16 (0x851c bytes) 000220 1789317760.534015 read 0x00699b thru 0x00ef1e (0x8584 bytes) 000221 1789317760.537341 trunc from 0x006c6c to 0x00d56c (0x6901 bytes) 000223 1789317760.539670 mapwrite 0x0244c1 thru 0x02611c (0x1c5c bytes) 000224 1789317760.554884 read 0x001ad9 thru 0x007e1b (0x6343 bytes) 000225 1789317760.557974 mapwrite 0x01cc9d thru 0x01f864 (0x2bc8 bytes) 000227 1789317760.563551 mapread 0x00890b thru 0x00a39f (0x1a95 bytes) 000228 1789317760.564164 fallocate 0x021276 thru 0x02d718 (0xc4a3 bytes) 000229 1789317760.566255 punch from 0x01b627 to 0x02611c (0xaaf6 bytes) 000230 1789317760.568096 trunc from 0x02611d to 0x038fbf (0x12ea3 bytes) 000231 1789317760.572173 mapwrite 0x004693 thru 0x00e810 (0xa17e bytes) 000233 1789317760.579141 fallocate 0x034f7d thru 0x03cd8a (0x7e0e bytes) 000234 1789317760.580999 trunc from 0x01a607 to 0x01de33 (0x382d bytes) 000235 1789317760.584206 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38fc0): Mirror 4: 0x76c69725 (stale) Mirror 5: 0x7dce8a35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38fc0): Mirror 4: 0x76c69725 (stale) Mirror 5: 0x7dce8a35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38fc0: skipped 000236 1789317760.675774 fallocate 0x01d942 thru 0x01f7d0 (0x1e8f bytes) 000237 1789317760.677434 mapwrite 0x02f8de thru 0x034878 (0x4f9b bytes) 000238 1789317760.688320 read 0x000534 thru 0x00b779 (0xb246 bytes) 000239 1789317760.691605 mapwrite 0x037518 thru 0x03e733 (0x721c bytes) 000240 1789317760.704124 trunc from 0x03e734 to 0x022bd2 (0x1bb61 bytes) 000242 1789317760.709380 mapread 0x01b028 thru 0x022bd2 (0x7bab bytes) 000243 1789317760.712389 read 0x0074a2 thru 0x00ffe3 (0x8b42 bytes) 000244 1789317760.714975 trunc from 0x022bd3 to 0x034b77 (0x11fa5 bytes) 000245 1789317760.719022 punch from 0x011639 to 0x018243 (0x6c0b bytes) 000246 1789317760.720950 read 0x025ac7 thru 0x026b73 (0x10ad bytes) 000247 1789317760.724093 punch from 0x02296e to 0x024414 (0x1aa7 bytes) 000250 1789317760.726641 fallocate 0x01cc78 thru 0x025fe8 (0x9371 bytes) 000251 1789317760.728677 mapwrite 0x01e752 thru 0x02a248 (0xbaf7 bytes) 000252 1789317760.740880 fallocate 0x02c678 thru 0x038b04 (0xc48d bytes) 000253 1789317760.742778 punch from 0x026cac to 0x02bfb6 (0x530b bytes) 000254 1789317760.744463 write 0x0049a1 thru 0x00b499 (0x6af9 bytes) 000256 1789317760.745768 mapwrite 0x011001 thru 0x0141a1 (0x31a1 bytes) 000257 1789317760.752901 trunc from 0x024824 to 0x02db81 (0x935e bytes) 000258 1789317760.755604 read 0x013cfb thru 0x01d957 (0x9c5d bytes) 000259 1789317760.756120 write 0x0313a7 thru 0x03f436 (0xe090 bytes) 000260 1789317760.757207 read 0x006fdb thru 0x0116f7 (0xa71d bytes) 000261 1789317760.757619 mapwrite 0x0102cd thru 0x01d7a4 (0xd4d8 bytes) 000262 1789317760.766928 trunc from 0x03f437 to 0x01ecf4 (0x20742 bytes) 000263 1789317760.772134 punch from 0x003ef8 to 0x005faa (0x20b3 bytes) 000264 1789317760.774166 punch from 0x018ba9 to 0x01ecf4 (0x614c bytes) 000265 1789317760.776508 trunc from 0x012abf to 0x01ecf4 (0xc236 bytes) 000266 1789317760.780239 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1ecf5): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecf5): Mirror 4: 0xb25f87e (stale) Mirror 5: 0xb25f87e (stale) CRC-32 checksum value for chunk [0, 0x1ecf5): Mirror 1: 0x50fb470a Mirror 6: 0x50fb470a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecf5: skipped 000267 1789317761.074048 punch from 0x00a48b to 0x00f1a6 (0x4d1c bytes) 000268 1789317761.086382 trunc from 0x01ecf5 to 0x0031d8 (0x1bb1c bytes) 000269 1789317761.097514 mapwrite 0x02d3fa thru 0x03aaac (0xd6b3 bytes) 000270 1789317761.118035 trunc from 0x030dec to 0x0390c2 (0x82d7 bytes) 000272 1789317761.120686 mapread 0x0154c3 thru 0x01d80b (0x8349 bytes) 000273 1789317761.124371 trunc from 0x03aaad to 0x038721 (0x238b bytes) 000274 1789317761.128489 trunc from 0x02e3a0 to 0x035639 (0x729a bytes) 000275 1789317761.130265 read 0x033b74 thru 0x038721 (0x4bae bytes) 000276 1789317761.133514 read 0x00128d thru 0x0083b2 (0x7126 bytes) 000277 1789317761.139430 fallocate 0x0078d9 thru 0x01388a (0xbfb2 bytes) 000278 1789317761.141661 read 0x01c798 thru 0x027873 (0xb0dc bytes) 000279 1789317761.142103 read 0x022f3b thru 0x026c74 (0x3d3a bytes) 000280 1789317761.142401 fallocate 0x028979 thru 0x02e8ae (0x5f36 bytes) 000281 1789317761.144614 write 0x013a75 thru 0x02285b (0xede7 bytes) 000282 1789317761.145622 trunc from 0x038722 to 0x03721f (0x1502 bytes) 000283 1789317761.150577 read 0x0253da thru 0x034cca (0xf8f1 bytes) 000284 1789317761.153791 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37220): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37220): Mirror 4: 0x4d19eaef (stale) Mirror 5: 0x681cc9ad (stale) Mirror 6: 0x76d7b81f (stale) CRC-32 checksum value for chunk [0, 0x37220): Mirror 1: 0x5efffa05 Mirror 7: 0x5efffa05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37220: skipped 000285 1789317761.433489 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37220): Mirror 4: 0x4d19eaef (stale) Mirror 6: 0x76d7b81f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37220): Mirror 4: 0x4d19eaef (stale) Mirror 6: 0x76d7b81f (stale) CRC-32 checksum value for chunk [0, 0x37220): Mirror 1: 0x5efffa05 Mirror 7: 0x5efffa05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37220: skipped 000286 1789317761.647136 fallocate 0x010c27 thru 0x010e75 (0x24f bytes) 000287 1789317761.660058 punch from 0x029c4a to 0x036f71 (0xd328 bytes) 000288 1789317761.661592 trunc from 0x03427e to 0x03721f (0x2fa2 bytes) 000289 1789317761.663203 mapwrite 0x02657b thru 0x02d67a (0x7100 bytes) 000290 1789317761.673953 read 0x020fe6 thru 0x0216ec (0x707 bytes) 000291 1789317761.675839 punch from 0x02e253 to 0x034c57 (0x6a05 bytes) 000292 1789317761.677522 fallocate 0x03b12d thru 0x03ffff (0x4ed3 bytes) 000293 1789317761.680559 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37220): Mirror 6: 0x76d7b81f (stale) Mirror 7: 0x5efffa05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37220): Mirror 6: 0x76d7b81f (stale) Mirror 7: 0x5efffa05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37220: skipped 000294 1789317761.764033 mapread 0x024cb7 thru 0x033664 (0xe9ae bytes) 000295 1789317761.772515 read 0x014ec2 thru 0x022b3a (0xdc79 bytes) 000297 1789317761.777777 MIRROR_RESYNC 3 mirrors 000298 1789317762.010476 read 0x0332e0 thru 0x0367f5 (0x3516 bytes) 000299 1789317762.012958 punch from 0x029b4d to 0x02dc3a (0x40ee bytes) 000300 1789317762.024127 fallocate 0x02debd thru 0x03dc0c (0xfd50 bytes) 000301 1789317762.026111 punch from 0x00c85d to 0x00e4fe (0x1ca2 bytes) 000302 1789317762.027677 mapread 0x02c683 thru 0x02e254 (0x1bd2 bytes) 000303 1789317762.032975 mapwrite 0x025d86 thru 0x02decd (0x8148 bytes) 000304 1789317762.042489 fallocate 0x011bd0 thru 0x01f459 (0xd88a bytes) 000305 1789317762.044352 mapwrite 0x039ba9 thru 0x03cbfd (0x3055 bytes) 000307 1789317762.061278 trunc from 0x005825 to 0x00649a (0xc76 bytes) 000308 1789317762.063129 punch from 0x001af4 to 0x005a1b (0x3f28 bytes) 000311 1789317762.065410 trunc from 0x03cbfe to 0x025beb (0x17012 bytes) 000312 1789317762.070394 punch from 0x00c0f4 to 0x014ecf (0x8ddc bytes) 000313 1789317762.072327 fallocate 0x02b243 thru 0x02ce9a (0x1c58 bytes) 000314 1789317762.074164 write 0x018454 thru 0x01e2d2 (0x5e7f bytes) 000315 1789317762.076213 trunc from 0x0185c2 to 0x019bb8 (0x15f7 bytes) 000316 1789317762.079858 read 0x0146e4 thru 0x01be0c (0x7729 bytes) 000317 1789317762.083501 trunc from 0x00d129 to 0x014c5a (0x7b32 bytes) 000318 1789317762.085875 trunc from 0x025bec to 0x012394 (0x13857 bytes) 000320 1789317762.090923 write 0x006dba thru 0x00c34c (0x5593 bytes) 000321 1789317762.093137 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12395): Mirror 7: 0xfe30a297 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12395): Mirror 7: 0xfe30a297 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12395: skipped 000322 1789317762.188541 write 0x01dfb1 thru 0x028449 (0xa499 bytes) 000323 1789317762.191960 write 0x03758f thru 0x03783b (0x2ad bytes) 000324 1789317762.192820 trunc from 0x03783c to 0x035cf5 (0x1b46 bytes) 000325 1789317762.199197 trunc from 0x0168d0 to 0x0250b8 (0xe7e9 bytes) 000326 1789317762.205448 trunc from 0x006457 to 0x00ebfe (0x87a8 bytes) 000327 1789317762.208245 mapwrite 0x012d73 thru 0x022612 (0xf8a0 bytes) 000328 1789317762.232135 trunc from 0x020482 to 0x02ac09 (0xa788 bytes) 000329 1789317762.234819 mapread 0x00a876 thru 0x010c7a (0x6405 bytes) 000330 1789317762.238593 trunc from 0x00e162 to 0x0104d9 (0x2378 bytes) 000331 1789317762.241114 mapread 0x020f7e thru 0x02e89a (0xd91d bytes) 000332 1789317762.250448 fallocate 0x007692 thru 0x008df5 (0x1764 bytes) 000333 1789317762.252843 read 0x014ef0 thru 0x01a584 (0x5695 bytes) 000334 1789317762.253251 read 0x0171ff thru 0x020d42 (0x9b44 bytes) 000335 1789317762.253611 mapread 0x026b83 thru 0x0307b3 (0x9c31 bytes) 000336 1789317762.254241 mapread 0x034f0f thru 0x035cf5 (0xde7 bytes) 000337 1789317762.257503 mapread 0x0310a6 thru 0x035243 (0x419e bytes) 000338 1789317762.258112 read 0x0145d8 thru 0x021441 (0xce6a bytes) 000339 1789317762.258467 fallocate 0x02e8ba thru 0x03d11f (0xe866 bytes) 000340 1789317762.260484 mapread 0x013c70 thru 0x018fd7 (0x5368 bytes) 000341 1789317762.261019 punch from 0x017c42 to 0x0242da (0xc699 bytes) 000342 1789317762.262900 write 0x00cbc1 thru 0x012acf (0x5f0f bytes) 000343 1789317762.263638 fallocate 0x02612e thru 0x02fa7c (0x994f bytes) 000344 1789317762.265444 write 0x011962 thru 0x0151ec (0x388b bytes) 000345 1789317762.266251 trunc from 0x011ce4 to 0x015029 (0x3346 bytes) 000346 1789317762.270495 trunc from 0x03d120 to 0x011967 (0x2b7b8 bytes) 000347 1789317762.275580 fallocate 0x029872 thru 0x02ae39 (0x15c8 bytes) 000348 1789317762.277596 trunc from 0x00426e to 0x00eae9 (0xa87c bytes) 000349 1789317762.279310 trunc from 0x011968 to 0x039829 (0x27ec2 bytes) 000350 1789317762.283355 mapread 0x017a93 thru 0x01ec5a (0x71c8 bytes) 000351 1789317762.287311 punch from 0x027810 to 0x0361bc (0xe9ad bytes) 000352 1789317762.289121 read 0x02948c thru 0x0361fb (0xcd70 bytes) 000353 1789317762.291814 trunc from 0x03982a to 0x03587a (0x3faf bytes) 000354 1789317762.295868 fallocate 0x016171 thru 0x0215d5 (0xb465 bytes) 000355 1789317762.297545 trunc from 0x019149 to 0x01e141 (0x4ff9 bytes) 000358 1789317762.299755 fallocate 0x03e275 thru 0x03e919 (0x6a5 bytes) 000359 1789317762.301699 trunc from 0x03e91a to 0x00708e (0x3788b bytes) 000360 1789317762.307045 write 0x00171e thru 0x008477 (0x6d5a bytes) 000362 1789317762.308126 punch from 0x001d7f to 0x008477 (0x66f9 bytes) 000363 1789317762.313149 fallocate 0x01f555 thru 0x029a87 (0xa533 bytes) 000364 1789317762.315555 mapread 0x00160f thru 0x008477 (0x6e69 bytes) 000365 1789317762.327419 write 0x01fe93 thru 0x022aff (0x2c6d bytes) 000366 1789317762.328319 mapwrite 0x03055c thru 0x0340d8 (0x3b7d bytes) 000367 1789317762.345032 mapwrite 0x0307e4 thru 0x03a69e (0x9ebb bytes) 000368 1789317762.364248 trunc from 0x03a69f to 0x01a67c (0x20022 bytes) 000369 1789317762.370017 trunc from 0x002bb8 to 0x006f1d (0x4366 bytes) 000370 1789317762.372176 fallocate 0x023191 thru 0x027ad9 (0x4949 bytes) 000371 1789317762.375923 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27ada): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ada): Mirror 7: 0xd110fa80 (stale) CRC-32 checksum value for chunk [0, 0x27ada): Mirror 1: 0xed36fbd0 Mirror 8: 0xed36fbd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ada: skipped 000372 1789317762.654235 read 0x000c65 thru 0x00e097 (0xd433 bytes) 000373 1789317762.657099 trunc from 0x027ada to 0x009830 (0x1e2a9 bytes) 000374 1789317762.675882 mapwrite 0x00d876 thru 0x013d46 (0x64d1 bytes) 000375 1789317762.698834 fallocate 0x02f851 thru 0x034ed7 (0x5687 bytes) 000376 1789317762.701261 trunc from 0x013d47 to 0x03a404 (0x266be bytes) 000377 1789317762.706502 punch from 0x0365cc to 0x03a404 (0x3e39 bytes) 000378 1789317762.708703 fallocate 0x034270 thru 0x03ffff (0xbd90 bytes) 000379 1789317762.711379 mapread 0x02a7b9 thru 0x02d19a (0x29e2 bytes) 000380 1789317762.715353 trunc from 0x01e526 to 0x028755 (0xa230 bytes) 000381 1789317762.717927 fallocate 0x0332da thru 0x03edfd (0xbb24 bytes) 000382 1789317762.720216 trunc from 0x03e5c5 to 0x03eb77 (0x5b3 bytes) 000383 1789317762.722302 fallocate 0x012894 thru 0x0152d3 (0x2a40 bytes) 000384 1789317762.724554 punch from 0x003d6f to 0x01157c (0xd80e bytes) 000388 1789317762.727594 fallocate 0x039dd3 thru 0x03ffff (0x622d bytes) 000389 1789317762.731369 MIRROR_RESYNC 3 mirrors 000390 1789317762.963863 mapwrite 0x00cfc0 thru 0x01cecd (0xff0e bytes) 000391 1789317763.002149 mapread 0x00efd3 thru 0x016169 (0x7197 bytes) 000392 1789317763.003011 read 0x02aee6 thru 0x02f089 (0x41a4 bytes) 000393 1789317763.005568 mapread 0x01a513 thru 0x0297e8 (0xf2d6 bytes) 000394 1789317763.010700 fallocate 0x021af6 thru 0x030c2f (0xf13a bytes) 000395 1789317763.012863 punch from 0x0226a0 to 0x02540d (0x2d6e bytes) 000396 1789317763.016375 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x70535f10 (stale) Mirror 8: 0x70535f10 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xad96f997 Mirror 9: 0xad96f997 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000397 1789317763.322250 mapread 0x03f1aa thru 0x03ffff (0xe56 bytes) 000398 1789317763.327988 punch from 0x01585d to 0x018478 (0x2c1c bytes) 000399 1789317763.344073 punch from 0x0079e4 to 0x0139c8 (0xbfe5 bytes) 000401 1789317763.347030 trunc from 0x03427c to 0x03d0ab (0x8e30 bytes) 000402 1789317763.350138 punch from 0x03c926 to 0x03ffff (0x36da bytes) 000403 1789317763.353057 punch from 0x02d144 to 0x039984 (0xc841 bytes) 000404 1789317763.357450 trunc from 0x0379f3 to 0x03a425 (0x2a33 bytes) 000405 1789317763.360507 trunc from 0x040000 to 0x0393ea (0x6c15 bytes) 000406 1789317763.371665 mapwrite 0x03fb7d thru 0x03ffff (0x483 bytes) 000407 1789317763.383468 trunc from 0x040000 to 0x017e50 (0x281af bytes) 000410 1789317763.389478 trunc from 0x017e51 to 0x00b0f3 (0xcd5d bytes) 000411 1789317763.394174 punch from 0x0015bb to 0x00b0f3 (0x9b39 bytes) 000412 1789317763.396075 trunc from 0x00b0f4 to 0x00767f (0x3a74 bytes) 000413 1789317763.402441 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x7680): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7680): Mirror 7: 0xd98bd9a3 (stale) Mirror 8: 0xd98bd9a3 (stale) Mirror 9: 0xd98bd9a3 (stale) CRC-32 checksum value for chunk [0, 0x7680): Mirror 1: 0x81faa73b Mirror 10: 0x81faa73b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7680: skipped 000415 1789317763.663159 trunc from 0x0065db to 0x00767f (0x10a5 bytes) 000416 1789317763.680885 read 0x003946 thru 0x00767f (0x3d3a bytes) 000417 1789317763.687281 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x7680): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7680): Mirror 7: 0xd98bd9a3 (stale) Mirror 8: 0xd98bd9a3 (stale) Mirror 9: 0xd98bd9a3 (stale) Mirror 10: 0x81faa73b (stale) CRC-32 checksum value for chunk [0, 0x7680): Mirror 1: 0x81faa73b Mirror 11: 0x81faa73b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7680: skipped 000419 1789317763.976037 write 0x002fc9 thru 0x009462 (0x649a bytes) 000420 1789317763.992248 fallocate 0x01379a thru 0x01ef41 (0xb7a8 bytes) 000421 1789317763.994712 write 0x0164d6 thru 0x01985e (0x3389 bytes) 000422 1789317763.995863 read 0x014ac3 thru 0x01985e (0x4d9c bytes) 000424 1789317763.998669 fallocate 0x03f838 thru 0x03ffff (0x7c8 bytes) 000425 1789317764.000916 punch from 0x00c038 to 0x012c35 (0x6bfe bytes) 000426 1789317764.002909 write 0x01f352 thru 0x02ce6d (0xdb1c bytes) 000427 1789317764.004250 mapread 0x000499 thru 0x00fb08 (0xf670 bytes) 000428 1789317764.013541 read 0x01ffbf thru 0x029e0b (0x9e4d bytes) 000429 1789317764.015709 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ce6e): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce6e): Mirror 7: 0xcd939201 (stale) Mirror 8: 0xcd939201 (stale) Mirror 9: 0x811823f7 (stale) Mirror 10: 0x7d6f1105 (stale) Mirror 11: 0x7d6f1105 (stale) CRC-32 checksum value for chunk [0, 0x2ce6e): Mirror 1: 0xd03b0f6b Mirror 12: 0xd03b0f6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce6e: skipped 000431 1789317764.309227 punch from 0x01afde to 0x01feb2 (0x4ed5 bytes) 000432 1789317764.322806 write 0x039b1e thru 0x03a452 (0x935 bytes) 000434 1789317764.326114 read 0x02c56c thru 0x02d488 (0xf1d bytes) 000435 1789317764.328952 trunc from 0x03a453 to 0x016fe2 (0x23470 bytes) 000436 1789317764.343381 mapread 0x0095a5 thru 0x00e953 (0x53af bytes) 000437 1789317764.350579 write 0x02ad93 thru 0x032a29 (0x7c97 bytes) 000438 1789317764.351519 trunc from 0x032a2a to 0x00aadf (0x27f4a bytes) 000441 1789317764.358109 mapwrite 0x019c36 thru 0x025cd6 (0xc0a1 bytes) 000442 1789317764.378056 punch from 0x024aed to 0x025cd6 (0x11ea bytes) 000443 1789317764.379925 mapread 0x00bad6 thru 0x00fa38 (0x3f63 bytes) 000444 1789317764.383498 mapread 0x003e3b thru 0x011d71 (0xdf37 bytes) 000445 1789317764.386535 trunc from 0x025cd7 to 0x012a58 (0x1327e bytes) 000446 1789317764.393702 mapread 0x00f045 thru 0x012a58 (0x3a14 bytes) 000447 1789317764.394635 trunc from 0x00578e to 0x0085ad (0x2e20 bytes) 000448 1789317764.397017 fallocate 0x001694 thru 0x00f07c (0xd9e9 bytes) 000449 1789317764.401003 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12a59): Mirror 7: 0xcd83abdf (stale) Mirror 9: 0xceb50c45 (stale) Mirror 10: 0xd0a2b624 (stale) Mirror 11: 0xd0a2b624 (stale) Mirror 12: 0xf4df8efb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12a59): Mirror 7: 0xcd83abdf (stale) Mirror 9: 0xceb50c45 (stale) Mirror 10: 0xd0a2b624 (stale) Mirror 11: 0xd0a2b624 (stale) Mirror 12: 0xf4df8efb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12a59: skipped 000450 1789317764.506100 read 0x005ab1 thru 0x01086e (0xadbe bytes) 000451 1789317764.509049 fallocate 0x01df4a thru 0x0243d8 (0x648f bytes) 000452 1789317764.511120 read 0x023d7e thru 0x0243d8 (0x65b bytes) 000453 1789317764.514576 trunc from 0x006182 to 0x00a89a (0x4719 bytes) 000454 1789317764.516379 write 0x01fea3 thru 0x02565c (0x57ba bytes) 000455 1789317764.518368 read 0x01f0b4 thru 0x02565c (0x65a9 bytes) 000456 1789317764.518860 trunc from 0x0214da to 0x024655 (0x317c bytes) 000457 1789317764.523198 write 0x0112d7 thru 0x01f8ea (0xe614 bytes) 000458 1789317764.524319 trunc from 0x02565d to 0x037721 (0x120c5 bytes) 000459 1789317764.530208 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37722): Mirror 7: 0x4a7e8c7 (stale) Mirror 9: 0xeb8ddf8e (stale) Mirror 10: 0xdf1d306c (stale) Mirror 11: 0xdf1d306c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37722): Mirror 7: 0x4a7e8c7 (stale) Mirror 9: 0xeb8ddf8e (stale) Mirror 10: 0xdf1d306c (stale) Mirror 11: 0xdf1d306c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37722: skipped 000460 1789317764.647801 mapwrite 0x01c754 thru 0x025dc4 (0x9671 bytes) 000461 1789317764.665404 mapread 0x035efa thru 0x037721 (0x1828 bytes) 000462 1789317764.669553 punch from 0x013d88 to 0x0235e9 (0xf862 bytes) 000463 1789317764.671975 fallocate 0x0239fa thru 0x029152 (0x5759 bytes) 000464 1789317764.677845 mapwrite 0x010f52 thru 0x013746 (0x27f5 bytes) 000465 1789317764.687507 mapwrite 0x02b211 thru 0x03323c (0x802c bytes) 000466 1789317764.697474 fallocate 0x01d052 thru 0x025942 (0x88f1 bytes) 000467 1789317764.699478 punch from 0x0123e0 to 0x016352 (0x3f73 bytes) 000468 1789317764.701408 trunc from 0x037722 to 0x024bc3 (0x12b5e bytes) 000469 1789317764.707636 mapwrite 0x03d652 thru 0x03ffff (0x29ae bytes) 000470 1789317764.720284 mapwrite 0x03c325 thru 0x03d61e (0x12fa bytes) 000471 1789317764.725684 read 0x026879 thru 0x027eab (0x1633 bytes) 000472 1789317764.728163 punch from 0x027e1a to 0x02f8ca (0x7ab1 bytes) 000473 1789317764.730178 trunc from 0x040000 to 0x039a67 (0x6598 bytes) 000474 1789317764.735915 trunc from 0x039a68 to 0x004004 (0x35a63 bytes) 000475 1789317764.742479 mapread 0x002c34 thru 0x004004 (0x13d1 bytes) 000476 1789317764.746008 trunc from 0x004005 to 0x038f65 (0x34f61 bytes) 000478 1789317764.751562 mapwrite 0x00ab9a thru 0x01a4ee (0xf955 bytes) 000479 1789317764.766803 fallocate 0x00a4eb thru 0x00e146 (0x3c5c bytes) 000481 1789317764.769309 punch from 0x010e6f to 0x01afbd (0xa14f bytes) 000483 1789317764.771786 trunc from 0x010ad7 to 0x0127f5 (0x1d1f bytes) 000484 1789317764.773641 trunc from 0x038f66 to 0x00cb53 (0x2c412 bytes) 000485 1789317764.780610 MIRROR_RESYNC 5 mirrors 000486 1789317765.045089 trunc from 0x00cb54 to 0x03d90f (0x30dbc bytes) 000487 1789317765.058400 punch from 0x03bceb to 0x03d90f (0x1c25 bytes) 000489 1789317765.060072 fallocate 0x01276b thru 0x01adc3 (0x8659 bytes) 000490 1789317765.061542 mapread 0x019f60 thru 0x022ffb (0x909c bytes) 000491 1789317765.066355 punch from 0x03a9ed to 0x03d90f (0x2f23 bytes) 000492 1789317765.067965 trunc from 0x02c93a to 0x038128 (0xb7ef bytes) 000493 1789317765.070993 write 0x023675 thru 0x02e6f0 (0xb07c bytes) 000495 1789317765.075258 MIRROR_RESYNC 5 mirrors 000496 1789317765.445482 read 0x02ffc3 thru 0x030ea0 (0xede bytes) 000497 1789317765.447898 mapwrite 0x00b567 thru 0x01a970 (0xf40a bytes) 000498 1789317765.490998 mapread 0x010c7c thru 0x014b93 (0x3f18 bytes) 000499 1789317765.491691 mapread 0x01acb3 thru 0x01b37f (0x6cd bytes) 000500 1789317765.492163 read 0x009148 thru 0x016470 (0xd329 bytes) 000501 1789317765.492583 trunc from 0x03d910 to 0x032b20 (0xadef bytes) 000502 1789317765.502379 trunc from 0x02e0ff to 0x032241 (0x4143 bytes) 000503 1789317765.504011 trunc from 0x032b21 to 0x0369ae (0x3e8e bytes) 000505 1789317765.508449 read 0x01f0df thru 0x02c6eb (0xd60d bytes) 000506 1789317765.511607 mapwrite 0x0144b7 thru 0x020452 (0xbf9c bytes) 000507 1789317765.519782 fallocate 0x02f6f0 thru 0x03c76b (0xd07c bytes) 000508 1789317765.521795 fallocate 0x019c63 thru 0x01d8ac (0x3c4a bytes) 000509 1789317765.523729 mapwrite 0x00d508 thru 0x011534 (0x402d bytes) 000510 1789317765.530812 mapread 0x00df7b thru 0x00e355 (0x3db bytes) 000511 1789317765.531468 read 0x018228 thru 0x0256f5 (0xd4ce bytes) 000512 1789317765.531898 trunc from 0x038332 to 0x03c76b (0x443a bytes) 000513 1789317765.533662 read 0x0347c9 thru 0x03b77c (0x6fb4 bytes) 000515 1789317765.536760 punch from 0x0398d3 to 0x03c76b (0x2e99 bytes) 000518 1789317765.539248 mapwrite 0x01d94f thru 0x025d5d (0x840f bytes) 000519 1789317765.550095 MIRROR_RESYNC 5 mirrors 000520 1789317765.858292 trunc from 0x021121 to 0x02132b (0x20b bytes) 000521 1789317765.867865 trunc from 0x03c76c to 0x02e34b (0xe420 bytes) 000522 1789317765.877326 fallocate 0x0365aa thru 0x03ea2c (0x8483 bytes) 000523 1789317765.879242 mapread 0x000bfc thru 0x007cfa (0x70ff bytes) 000524 1789317765.886466 fallocate 0x00b768 thru 0x018436 (0xcccf bytes) 000525 1789317765.889658 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea2d): Mirror 7: 0xbfdb9ac1 (stale) Mirror 9: 0xbfdb9ac1 (stale) Mirror 10: 0xbfdb9ac1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea2d): Mirror 7: 0xbfdb9ac1 (stale) Mirror 9: 0xbfdb9ac1 (stale) Mirror 10: 0xbfdb9ac1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea2d: skipped 000526 1789317766.006094 punch from 0x0249df to 0x0339d5 (0xeff7 bytes) 000528 1789317766.008437 punch from 0x0337f3 to 0x03c7ca (0x8fd8 bytes) 000529 1789317766.010064 mapread 0x018d71 thru 0x0192d7 (0x567 bytes) 000530 1789317766.013935 punch from 0x02ef8d to 0x03e12d (0xf1a1 bytes) 000531 1789317766.016253 fallocate 0x0129cb thru 0x01ed2b (0xc361 bytes) 000532 1789317766.018734 trunc from 0x03ea2d to 0x013845 (0x2b1e7 bytes) 000534 1789317766.026817 fallocate 0x02e223 thru 0x031bf5 (0x39d3 bytes) 000535 1789317766.030067 trunc from 0x013846 to 0x032ab5 (0x1f270 bytes) 000536 1789317766.035767 write 0x03cda0 thru 0x03dcc3 (0xf24 bytes) 000537 1789317766.036570 punch from 0x022bae to 0x02cdce (0xa221 bytes) 000538 1789317766.038967 trunc from 0x03dcc4 to 0x006bf2 (0x370d1 bytes) 000539 1789317766.044463 trunc from 0x006bf3 to 0x025fd5 (0x1f3e3 bytes) 000540 1789317766.049139 trunc from 0x025fd6 to 0x02f443 (0x946e bytes) 000541 1789317766.053786 mapread 0x018715 thru 0x01aa22 (0x230e bytes) 000542 1789317766.057253 trunc from 0x00bb53 to 0x013467 (0x7915 bytes) 000543 1789317766.059245 trunc from 0x02f444 to 0x008367 (0x270dc bytes) 000544 1789317766.064113 fallocate 0x020aa1 thru 0x024c35 (0x4195 bytes) 000545 1789317766.066050 mapwrite 0x00121d thru 0x00c9ad (0xb791 bytes) 000548 1789317766.080646 read 0x000438 thru 0x00522d (0x4df6 bytes) 000549 1789317766.083687 MIRROR_RESYNC 4 mirrors 000550 1789317766.279018 read 0x0000d7 thru 0x006d54 (0x6c7e bytes) 000552 1789317766.281809 mapread 0x0059e9 thru 0x00c7ca (0x6de2 bytes) 000553 1789317766.286662 punch from 0x005bb0 to 0x00ac41 (0x5092 bytes) 000554 1789317766.299236 read 0x00441a thru 0x00c9ad (0x8594 bytes) 000555 1789317766.303566 trunc from 0x00afaf to 0x00c9ad (0x19ff bytes) 000556 1789317766.306046 write 0x00ae69 thru 0x010d16 (0x5eae bytes) 000557 1789317766.308880 mapwrite 0x002bbf thru 0x00f4d9 (0xc91b bytes) 000558 1789317766.317185 trunc from 0x010d17 to 0x025b2a (0x14e14 bytes) 000559 1789317766.333336 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25b2b): Mirror 7: 0x3bdd57e7 (stale) Mirror 9: 0x3bdd57e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25b2b): Mirror 7: 0x3bdd57e7 (stale) Mirror 9: 0x3bdd57e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25b2b: skipped 000560 1789317766.433642 read 0x006ffe thru 0x010ede (0x9ee1 bytes) 000561 1789317766.437367 trunc from 0x025b2b to 0x0242b5 (0x1875 bytes) 000562 1789317766.444065 trunc from 0x0242b6 to 0x03e40f (0x1a15a bytes) 000563 1789317766.449890 trunc from 0x0038ab to 0x00b44e (0x7ba4 bytes) 000564 1789317766.452224 mapread 0x014afa thru 0x01605a (0x1561 bytes) 000565 1789317766.458944 trunc from 0x02c325 to 0x02e852 (0x252e bytes) 000566 1789317766.460934 fallocate 0x024dc7 thru 0x02dd62 (0x8f9c bytes) 000567 1789317766.465200 trunc from 0x013047 to 0x01bd59 (0x8d13 bytes) 000568 1789317766.468120 read 0x0116cf thru 0x019b01 (0x8433 bytes) 000569 1789317766.475610 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e410): Mirror 9: 0xaa44a584 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e410): Mirror 9: 0xaa44a584 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e410: skipped 000570 1789317766.590049 mapwrite 0x007e81 thru 0x016c50 (0xedd0 bytes) 000571 1789317766.607437 punch from 0x00774e to 0x00c1b1 (0x4a64 bytes) 000572 1789317766.609278 trunc from 0x0295f6 to 0x037fbf (0xe9ca bytes) 000574 1789317766.611129 mapwrite 0x006a28 thru 0x00a3f2 (0x39cb bytes) 000575 1789317766.618710 punch from 0x00d68b to 0x0115b2 (0x3f28 bytes) 000576 1789317766.620328 trunc from 0x008ea7 to 0x00f4f8 (0x6652 bytes) 000577 1789317766.622036 trunc from 0x03e410 to 0x00476a (0x39ca5 bytes) 000578 1789317766.627995 trunc from 0x000597 to 0x00476a (0x41d4 bytes) 000579 1789317766.630222 trunc from 0x00476b to 0x018e49 (0x146df bytes) 000580 1789317766.640902 MIRROR_RESYNC 2 mirrors 000581 1789317766.808912 read 0x012461 thru 0x0182eb (0x5e8b bytes) 000582 1789317766.811368 mapwrite 0x024aa3 thru 0x03431f (0xf87d bytes) 000583 1789317766.841331 punch from 0x027e5b to 0x02e8b2 (0x6a58 bytes) 000584 1789317766.843209 trunc from 0x034320 to 0x02783d (0xcae2 bytes) 000585 1789317766.848855 read 0x02340e thru 0x02783d (0x4430 bytes) 000586 1789317766.853432 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2783e): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2783e): Mirror 9: 0x2b5c255d (stale) CRC-32 checksum value for chunk [0, 0x2783e): Mirror 1: 0x9f8219d6 Mirror 10: 0x9f8219d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2783e: skipped 000587 1789317767.083069 punch from 0x023b8f to 0x02783d (0x3caf bytes) 000589 1789317767.093011 trunc from 0x00efd5 to 0x01446c (0x5498 bytes) 000590 1789317767.094780 trunc from 0x01ea79 to 0x0204ad (0x1a35 bytes) 000591 1789317767.096504 punch from 0x006635 to 0x0118d4 (0xb2a0 bytes) 000592 1789317767.098288 trunc from 0x01498b to 0x01bae2 (0x7158 bytes) 000593 1789317767.099783 trunc from 0x02783e to 0x02aba0 (0x3363 bytes) 000594 1789317767.110942 write 0x01e4a0 thru 0x02cde8 (0xe949 bytes) 000595 1789317767.113343 trunc from 0x02cde9 to 0x025e7f (0x6f69 bytes) 000596 1789317767.117136 trunc from 0x015392 to 0x024526 (0xf195 bytes) 000597 1789317767.121450 fallocate 0x01e90a thru 0x024b3a (0x6231 bytes) 000598 1789317767.123774 trunc from 0x025e80 to 0x023f50 (0x1f2f bytes) 000600 1789317767.130040 trunc from 0x023f51 to 0x017aa2 (0xc4ae bytes) 000601 1789317767.135530 trunc from 0x017aa3 to 0x00e2a4 (0x97fe bytes) 000602 1789317767.140206 mapread 0x00b811 thru 0x00e2a4 (0x2a94 bytes) 000603 1789317767.148947 MIRROR_RESYNC 3 mirrors 000604 1789317767.321185 mapread 0x00290c thru 0x00e2a4 (0xb999 bytes) 000605 1789317767.328144 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000606 1789317767.433101 read 0x005bfb thru 0x00e2a4 (0x86aa bytes) 000607 1789317767.436726 punch from 0x0007c6 to 0x00dc72 (0xd4ad bytes) 000608 1789317767.448675 trunc from 0x00e2a5 to 0x03e418 (0x30174 bytes) 000609 1789317767.461245 trunc from 0x03e419 to 0x03be64 (0x25b4 bytes) 000610 1789317767.467007 fallocate 0x0146a0 thru 0x014a19 (0x37a bytes) 000611 1789317767.469306 mapread 0x0355f3 thru 0x0399d5 (0x43e3 bytes) 000612 1789317767.476183 write 0x02cde8 thru 0x035e30 (0x9049 bytes) 000613 1789317767.478475 read 0x03077b thru 0x03be64 (0xb6ea bytes) 000614 1789317767.478946 fallocate 0x015dd0 thru 0x01d6bb (0x78ec bytes) 000615 1789317767.481064 mapwrite 0x01dc0d thru 0x02bce6 (0xe0da bytes) 000616 1789317767.492062 read 0x035ab1 thru 0x03be64 (0x63b4 bytes) 000617 1789317767.492688 fallocate 0x015f9b thru 0x020a6a (0xaad0 bytes) 000619 1789317767.495183 trunc from 0x01b2f9 to 0x026fe1 (0xbce9 bytes) 000620 1789317767.497048 fallocate 0x0296a1 thru 0x03057a (0x6eda bytes) 000621 1789317767.498822 write 0x03755a thru 0x03d1b9 (0x5c60 bytes) 000622 1789317767.499913 mapread 0x02ff24 thru 0x038ff2 (0x90cf bytes) 000623 1789317767.500884 write 0x03a51c thru 0x03a9cd (0x4b2 bytes) 000624 1789317767.501418 fallocate 0x003542 thru 0x007208 (0x3cc7 bytes) 000625 1789317767.505151 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d1ba): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1ba): Mirror 10: 0x4f9eed81 (stale) CRC-32 checksum value for chunk [0, 0x3d1ba): Mirror 1: 0x3285a947 Mirror 11: 0x3285a947 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1ba: skipped 000626 1789317767.735851 write 0x032730 thru 0x03ffff (0xd8d0 bytes) 000627 1789317767.748957 trunc from 0x0311e6 to 0x03f2fd (0xe118 bytes) 000628 1789317767.753807 mapread 0x00790c thru 0x00ec4e (0x7343 bytes) 000631 1789317767.760141 punch from 0x01f23e to 0x02b169 (0xbf2c bytes) 000632 1789317767.762097 mapwrite 0x001bb9 thru 0x0065ab (0x49f3 bytes) 000634 1789317767.770444 mapread 0x02d2db thru 0x0396d4 (0xc3fa bytes) 000635 1789317767.777042 punch from 0x015a1e to 0x01fe10 (0xa3f3 bytes) 000636 1789317767.779069 read 0x01a19e thru 0x01c83d (0x26a0 bytes) 000637 1789317767.781231 punch from 0x028ca3 to 0x032863 (0x9bc1 bytes) 000638 1789317767.783008 mapread 0x013615 thru 0x0144ab (0xe97 bytes) 000639 1789317767.786197 trunc from 0x040000 to 0x00bc48 (0x343b7 bytes) 000640 1789317767.797468 punch from 0x004bef to 0x00bc48 (0x705a bytes) 000641 1789317767.799511 trunc from 0x007524 to 0x00bc48 (0x4725 bytes) 000642 1789317767.801130 fallocate 0x0140fa thru 0x01ae54 (0x6d5b bytes) 000643 1789317767.803056 punch from 0x004043 to 0x009fb7 (0x5f75 bytes) 000644 1789317767.806302 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ae55): Mirror 11: 0xb85c9024 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ae55): Mirror 11: 0xb85c9024 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ae55: skipped 000645 1789317767.891294 read 0x018a8e thru 0x01ae54 (0x23c7 bytes) 000646 1789317767.894578 write 0x01abd5 thru 0x026167 (0xb593 bytes) 000647 1789317767.897167 write 0x03ae0b thru 0x03c155 (0x134b bytes) 000648 1789317767.899508 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c156): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c156): Mirror 11: 0x8e13c620 (stale) CRC-32 checksum value for chunk [0, 0x3c156): Mirror 1: 0xa4cc5070 Mirror 12: 0xa4cc5070 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c156: skipped 000650 1789317768.173836 mapread 0x0172e2 thru 0x018ad9 (0x17f8 bytes) 000651 1789317768.177328 fallocate 0x014cac thru 0x01d3b2 (0x8707 bytes) 000652 1789317768.187368 trunc from 0x037d8b to 0x03c155 (0x43cb bytes) 000654 1789317768.189515 punch from 0x03987e to 0x03c155 (0x28d8 bytes) 000655 1789317768.191449 trunc from 0x00814e to 0x01596e (0xd821 bytes) 000656 1789317768.193261 punch from 0x02bd97 to 0x032caf (0x6f19 bytes) 000657 1789317768.194971 fallocate 0x00068c thru 0x0031e1 (0x2b56 bytes) 000658 1789317768.196904 read 0x01cdbd thru 0x02024a (0x348e bytes) 000659 1789317768.199489 read 0x00979f thru 0x00fd19 (0x657b bytes) 000660 1789317768.203048 mapwrite 0x02c269 thru 0x0364e0 (0xa278 bytes) 000661 1789317768.210146 mapread 0x008e7f thru 0x017edc (0xf05e bytes) 000662 1789317768.211031 write 0x019748 thru 0x020332 (0x6beb bytes) 000663 1789317768.212867 mapwrite 0x00af4a thru 0x0164eb (0xb5a2 bytes) 000664 1789317768.220086 mapread 0x019566 thru 0x01f08d (0x5b28 bytes) 000665 1789317768.220801 punch from 0x0057aa to 0x012093 (0xc8ea bytes) 000666 1789317768.222873 fallocate 0x03bc6c thru 0x03ff93 (0x4328 bytes) 000667 1789317768.224502 read 0x03afb0 thru 0x03c155 (0x11a6 bytes) 000668 1789317768.224892 mapread 0x02fd34 thru 0x03c155 (0xc422 bytes) 000669 1789317768.225719 fallocate 0x0248e5 thru 0x026de0 (0x24fc bytes) 000670 1789317768.227690 trunc from 0x03c156 to 0x00b886 (0x308cf bytes) 000671 1789317768.234093 mapread 0x008ffb thru 0x00b886 (0x288c bytes) 000672 1789317768.237675 mapread 0x003cb2 thru 0x00b886 (0x7bd5 bytes) 000673 1789317768.238629 read 0x00a1a1 thru 0x00a52b (0x38b bytes) 000674 1789317768.241008 MIRROR_RESYNC 3 mirrors 000676 1789317768.434074 trunc from 0x00b887 to 0x01af30 (0xf6aa bytes) 000678 1789317768.448731 read 0x003a7a thru 0x00d4e2 (0x9a69 bytes) 000679 1789317768.453494 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1af31): Mirror 12: 0xddfa524c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1af31): Mirror 12: 0xddfa524c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1af31: skipped 000680 1789317768.538097 trunc from 0x017b6a to 0x01af30 (0x33c7 bytes) 000681 1789317768.540227 mapwrite 0x001b2f thru 0x00e06b (0xc53d bytes) 000682 1789317768.556522 trunc from 0x0081ba to 0x00d2ba (0x5101 bytes) 000683 1789317768.559026 mapwrite 0x0100df thru 0x01389e (0x37c0 bytes) 000685 1789317768.569334 read 0x00968d thru 0x0156f4 (0xc068 bytes) 000686 1789317768.571910 trunc from 0x0023fc to 0x0095c3 (0x71c8 bytes) 000687 1789317768.573965 mapwrite 0x0162c2 thru 0x01a6d2 (0x4411 bytes) 000688 1789317768.583007 punch from 0x008886 to 0x013c58 (0xb3d3 bytes) 000689 1789317768.585403 trunc from 0x0151bf to 0x01a45a (0x529c bytes) 000690 1789317768.588736 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1af31): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1af31): Mirror 12: 0xddfa524c (stale) CRC-32 checksum value for chunk [0, 0x1af31): Mirror 1: 0x847e4581 Mirror 13: 0x847e4581 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1af31: skipped 000691 1789317768.831509 trunc from 0x005671 to 0x00f0ca (0x9a5a bytes) 000692 1789317768.845579 MIRROR_RESYNC 3 mirrors 000693 1789317769.100395 punch from 0x00bbc2 to 0x00e226 (0x2665 bytes) 000694 1789317769.109447 read 0x019303 thru 0x01af30 (0x1c2e bytes) 000695 1789317769.111603 read 0x004ed7 thru 0x00bb84 (0x6cae bytes) 000696 1789317769.115781 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1af31): Mirror 12: 0x847e4581 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1af31): Mirror 12: 0x847e4581 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1af31: skipped 000697 1789317769.196045 write 0x03baa1 thru 0x03e3bf (0x291f bytes) 000699 1789317769.198779 mapwrite 0x023da5 thru 0x027bd6 (0x3e32 bytes) 000700 1789317769.210976 write 0x00d189 thru 0x01ba10 (0xe888 bytes) 000701 1789317769.215969 trunc from 0x0205be to 0x0265d7 (0x601a bytes) 000704 1789317769.218937 trunc from 0x03e3c0 to 0x00f4af (0x2ef10 bytes) 000705 1789317769.223842 mapread 0x002933 thru 0x003670 (0xd3e bytes) 000707 1789317769.227354 read 0x005936 thru 0x00f4af (0x9b7a bytes) 000708 1789317769.227887 read 0x00ecd6 thru 0x00f4af (0x7da bytes) 000709 1789317769.228190 mapread 0x007f9d thru 0x00f4af (0x7513 bytes) 000710 1789317769.228846 punch from 0x002500 to 0x00b4b3 (0x8fb4 bytes) 000711 1789317769.230937 mapwrite 0x00396d thru 0x00827c (0x4910 bytes) 000712 1789317769.240718 read 0x006dce thru 0x008483 (0x16b6 bytes) 000713 1789317769.241397 read 0x00aac8 thru 0x00f4af (0x49e8 bytes) 000714 1789317769.243605 MIRROR_RESYNC 2 mirrors 000715 1789317769.429942 write 0x005f76 thru 0x0091b3 (0x323e bytes) 000716 1789317769.441485 fallocate 0x01457d thru 0x01bf32 (0x79b6 bytes) 000717 1789317769.443883 fallocate 0x01d670 thru 0x02909c (0xba2d bytes) 000718 1789317769.446040 punch from 0x0131af to 0x01fba3 (0xc9f5 bytes) 000720 1789317769.448093 mapread 0x00c086 thru 0x00d225 (0x11a0 bytes) 000722 1789317769.451554 trunc from 0x02909d to 0x035760 (0xc6c4 bytes) 000723 1789317769.460990 mapwrite 0x025acb thru 0x02ba14 (0x5f4a bytes) 000724 1789317769.469451 write 0x02f414 thru 0x036610 (0x71fd bytes) 000726 1789317769.472176 trunc from 0x036611 to 0x014a29 (0x21be7 bytes) 000727 1789317769.476772 trunc from 0x00ba2f to 0x014a29 (0x8ffb bytes) 000728 1789317769.478346 mapread 0x006906 thru 0x00980f (0x2f0a bytes) 000729 1789317769.479109 punch from 0x0007d4 to 0x001a76 (0x12a3 bytes) 000730 1789317769.480471 trunc from 0x003134 to 0x01063d (0xd50a bytes) 000731 1789317769.482127 mapread 0x0110d3 thru 0x014a29 (0x3957 bytes) 000732 1789317769.485899 punch from 0x006d34 to 0x0118b4 (0xab81 bytes) 000733 1789317769.487852 read 0x009190 thru 0x014a29 (0xb89a bytes) 000734 1789317769.492155 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x14a2a): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14a2a): Mirror 12: 0xf1808a68 (stale) CRC-32 checksum value for chunk [0, 0x14a2a): Mirror 1: 0x2ad748f7 Mirror 13: 0x2ad748f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14a2a: skipped 000736 1789317769.727221 fallocate 0x00e93d thru 0x01a262 (0xb926 bytes) 000737 1789317769.738106 trunc from 0x01a263 to 0x02aeee (0x10c8c bytes) 000738 1789317769.747877 trunc from 0x01c584 to 0x01eb9d (0x261a bytes) 000739 1789317769.749258 write 0x003f51 thru 0x00d55b (0x960b bytes) 000740 1789317769.752357 write 0x001f25 thru 0x003177 (0x1253 bytes) 000741 1789317769.754107 write 0x031f89 thru 0x03ffc3 (0xe03b bytes) 000742 1789317769.755129 fallocate 0x03fd35 thru 0x03ffff (0x2cb bytes) 000743 1789317769.756874 mapwrite 0x027885 thru 0x02c54f (0x4ccb bytes) 000744 1789317769.768008 mapread 0x01da61 thru 0x02d61d (0xfbbd bytes) 000745 1789317769.771473 trunc from 0x040000 to 0x0063fa (0x39c05 bytes) 000746 1789317769.776577 mapread 0x0031e3 thru 0x0063fa (0x3218 bytes) 000747 1789317769.777234 trunc from 0x003070 to 0x0063fa (0x338b bytes) 000748 1789317769.779127 read 0x0017bf thru 0x0063fa (0x4c3c bytes) 000749 1789317769.781286 mapwrite 0x019218 thru 0x02294f (0x9738 bytes) 000750 1789317769.796689 write 0x018865 thru 0x01989f (0x103b bytes) 000751 1789317769.797497 write 0x0022af thru 0x003171 (0xec3 bytes) 000752 1789317769.797993 trunc from 0x00459d to 0x00ab99 (0x65fd bytes) 000753 1789317769.799686 write 0x01787b thru 0x01a0c6 (0x284c bytes) 000754 1789317769.800462 trunc from 0x022950 to 0x009987 (0x18fc8 bytes) 000756 1789317769.806653 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x9988): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9988): Mirror 12: 0x54785ac4 (stale) Mirror 13: 0xcb219b4e (stale) CRC-32 checksum value for chunk [0, 0x9988): Mirror 1: 0xa8d38e4a Mirror 14: 0xa8d38e4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9988: skipped 000757 1789317770.013858 mapread 0x002d5c thru 0x009987 (0x6c2c bytes) 000758 1789317770.022812 mapwrite 0x015c14 thru 0x017ac4 (0x1eb1 bytes) 000759 1789317770.046573 trunc from 0x017ac5 to 0x005c73 (0x11e51 bytes) 000760 1789317770.054019 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x5c74): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5c74): Mirror 12: 0x771046c0 (stale) Mirror 13: 0x3afd6a92 (stale) Mirror 14: 0x5eec4576 (stale) CRC-32 checksum value for chunk [0, 0x5c74): Mirror 1: 0x5eec4576 Mirror 15: 0x5eec4576 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5c74: skipped 000761 1789317770.311792 punch from 0x003baa to 0x0054a3 (0x18fa bytes) 000762 1789317770.321623 trunc from 0x005c74 to 0x03e4a7 (0x38834 bytes) 000763 1789317770.327343 write 0x03f669 thru 0x03ffff (0x997 bytes) 000764 1789317770.329169 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x8a697798 (stale) Mirror 14: 0xea1e3387 (stale) Mirror 15: 0xea1e3387 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x8a697798 (stale) Mirror 14: 0xea1e3387 (stale) Mirror 15: 0xea1e3387 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000765 1789317770.427717 fallocate 0x0216bd thru 0x02ae9c (0x97e0 bytes) 000766 1789317770.429712 trunc from 0x034ccc to 0x03b8e3 (0x6c18 bytes) 000767 1789317770.431623 trunc from 0x02b8f0 to 0x03350b (0x7c1c bytes) 000768 1789317770.433460 trunc from 0x02abdb to 0x03070e (0x5b34 bytes) 000769 1789317770.435482 mapread 0x010083 thru 0x011d0d (0x1c8b bytes) 000770 1789317770.439065 mapwrite 0x03014e thru 0x0317fa (0x16ad bytes) 000771 1789317770.447024 mapwrite 0x02fe33 thru 0x03921c (0x93ea bytes) 000772 1789317770.457634 trunc from 0x040000 to 0x01278f (0x2d870 bytes) 000773 1789317770.467657 read 0x000891 thru 0x01000f (0xf77f bytes) 000774 1789317770.470883 mapread 0x00ee82 thru 0x01278f (0x390e bytes) 000775 1789317770.472977 punch from 0x00e038 to 0x01278f (0x4758 bytes) 000776 1789317770.476061 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x12790): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12790): Mirror 13: 0x19e30973 (stale) Mirror 14: 0x4f5b99aa (stale) Mirror 15: 0x4f5b99aa (stale) CRC-32 checksum value for chunk [0, 0x12790): Mirror 1: 0x4f5b99aa Mirror 16: 0x4f5b99aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12790: skipped 000778 1789317770.725189 mapread 0x00b374 thru 0x01278f (0x741c bytes) 000779 1789317770.735136 trunc from 0x012790 to 0x00fd3d (0x2a52 bytes) 000780 1789317770.755857 write 0x027519 thru 0x037010 (0xfaf8 bytes) 000781 1789317770.757178 trunc from 0x037011 to 0x030e50 (0x61c0 bytes) 000782 1789317770.762938 mapread 0x000cfe thru 0x00c334 (0xb637 bytes) 000787 1789317770.768652 punch from 0x01ef8c to 0x029525 (0xa59a bytes) 000788 1789317770.774358 fallocate 0x0200c0 thru 0x0294ac (0x93ed bytes) 000789 1789317770.776431 mapwrite 0x01386a thru 0x0237e6 (0xff7d bytes) 000790 1789317770.791916 punch from 0x00d03e to 0x014f1c (0x7edf bytes) 000791 1789317770.794202 mapread 0x000118 thru 0x00f91b (0xf804 bytes) 000792 1789317770.799098 MIRROR_RESYNC 5 mirrors 000793 1789317771.131968 trunc from 0x030e51 to 0x021d51 (0xf0ff bytes) 000794 1789317771.142079 trunc from 0x021d52 to 0x00f21c (0x12b35 bytes) 000795 1789317771.147955 trunc from 0x00f21d to 0x00d64e (0x1bce bytes) 000796 1789317771.153629 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xd64f): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd64f): Mirror 13: 0x2a7ea619 (stale) Mirror 14: 0x2a7ea619 (stale) Mirror 15: 0x2a7ea619 (stale) Mirror 16: 0x2a7ea619 (stale) CRC-32 checksum value for chunk [0, 0xd64f): Mirror 1: 0x2a7ea619 Mirror 17: 0x2a7ea619 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd64f: skipped 000797 1789317771.417424 read 0x00a526 thru 0x00d64e (0x3129 bytes) 000798 1789317771.419669 fallocate 0x01060f thru 0x020353 (0xfd45 bytes) 000799 1789317771.432940 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20354): Mirror 13: 0xcc4009bb (stale) Mirror 14: 0xcc4009bb (stale) Mirror 15: 0xcc4009bb (stale) Mirror 16: 0xcc4009bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20354): Mirror 13: 0xcc4009bb (stale) Mirror 14: 0xcc4009bb (stale) Mirror 15: 0xcc4009bb (stale) Mirror 16: 0xcc4009bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20354: skipped 000800 1789317771.537623 trunc from 0x008bbc to 0x0091fd (0x642 bytes) 000801 1789317771.539326 trunc from 0x01f640 to 0x020353 (0xd14 bytes) 000802 1789317771.540861 trunc from 0x020354 to 0x03226e (0x11f1b bytes) 000803 1789317771.546526 write 0x0372f4 thru 0x03e513 (0x7220 bytes) 000804 1789317771.547596 punch from 0x02458c to 0x029306 (0x4d7b bytes) 000805 1789317771.549536 trunc from 0x03e514 to 0x039288 (0x528b bytes) 000806 1789317771.554239 trunc from 0x039289 to 0x00bb22 (0x2d766 bytes) 000807 1789317771.560368 trunc from 0x00bb23 to 0x0298b8 (0x1dd96 bytes) 000808 1789317771.566622 mapwrite 0x00a6f8 thru 0x00fd37 (0x5640 bytes) 000809 1789317771.582687 trunc from 0x003f0f to 0x0060bf (0x21b1 bytes) 000810 1789317771.585595 trunc from 0x021573 to 0x021e1b (0x8a9 bytes) 000811 1789317771.587909 trunc from 0x01e8b0 to 0x0298b8 (0xb009 bytes) 000812 1789317771.591285 trunc from 0x0063e4 to 0x00c64d (0x626a bytes) 000813 1789317771.596294 MIRROR_RESYNC 5 mirrors 000814 1789317771.913375 trunc from 0x025885 to 0x028305 (0x2a81 bytes) 000815 1789317771.923955 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x298b9): Mirror 13: 0x6a829da0 (stale) Mirror 15: 0x6a829da0 (stale) Mirror 16: 0x6a829da0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x298b9): Mirror 13: 0x6a829da0 (stale) Mirror 15: 0x6a829da0 (stale) Mirror 16: 0x6a829da0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x298b9: skipped 000816 1789317772.020344 punch from 0x00d9ed to 0x0117bc (0x3dd0 bytes) 000817 1789317772.022296 write 0x021f5f thru 0x02a4dd (0x857f bytes) 000818 1789317772.025977 mapwrite 0x03f6c9 thru 0x03ffff (0x937 bytes) 000819 1789317772.040560 write 0x013f19 thru 0x018400 (0x44e8 bytes) 000820 1789317772.043586 trunc from 0x040000 to 0x00bb59 (0x344a6 bytes) 000821 1789317772.047588 mapread 0x000547 thru 0x00bb59 (0xb613 bytes) 000822 1789317772.052324 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xbb5a): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbb5a): Mirror 13: 0xdb8a2324 (stale) Mirror 15: 0xdb8a2324 (stale) Mirror 16: 0xdb8a2324 (stale) CRC-32 checksum value for chunk [0, 0xbb5a): Mirror 1: 0xdb8a2324 Mirror 17: 0xdb8a2324 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbb5a: skipped 000823 1789317772.288537 trunc from 0x00bb5a to 0x02c2e7 (0x2078e bytes) 000824 1789317772.303851 punch from 0x00d9d7 to 0x01a086 (0xc6b0 bytes) 000825 1789317772.305300 read 0x005b81 thru 0x008ff0 (0x3470 bytes) 000826 1789317772.307143 punch from 0x013e8f to 0x022def (0xef61 bytes) 000827 1789317772.308517 mapread 0x00d17d thru 0x00e5c3 (0x1447 bytes) 000828 1789317772.312245 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 13: 0xe44f46b4 (stale) Mirror 15: 0xe44f46b4 (stale) Mirror 16: 0xe44f46b4 (stale) Mirror 17: 0xe30a2325 (stale) CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 1: 0xe30a2325 Mirror 18: 0xe30a2325 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c2e8: skipped 000829 1789317772.537326 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 13: 0xe44f46b4 (stale) Mirror 15: 0xe44f46b4 (stale) Mirror 16: 0xe44f46b4 (stale) Mirror 17: 0xe30a2325 (stale) CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 1: 0xe30a2325 Mirror 18: 0xe30a2325 Mirror 19: 0xe30a2325 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c2e8: skipped 000830 1789317772.785364 punch from 0x013a21 to 0x021b41 (0xe121 bytes) 000831 1789317772.798541 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 15: 0xe44f46b4 (stale) Mirror 16: 0xe44f46b4 (stale) Mirror 17: 0xe30a2325 (stale) Mirror 18: 0xe30a2325 (stale) Mirror 19: 0xe30a2325 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 15: 0xe44f46b4 (stale) Mirror 16: 0xe44f46b4 (stale) Mirror 17: 0xe30a2325 (stale) Mirror 18: 0xe30a2325 (stale) Mirror 19: 0xe30a2325 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c2e8: skipped 000832 1789317772.913170 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 15: 0xe44f46b4 (stale) Mirror 16: 0xe44f46b4 (stale) Mirror 17: 0xe30a2325 (stale) Mirror 18: 0xe30a2325 (stale) Mirror 19: 0xe30a2325 (stale) CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 1: 0xe30a2325 Mirror 20: 0xe30a2325 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c2e8: skipped 000833 1789317773.157080 read 0x01d3a0 thru 0x0299e3 (0xc644 bytes) 000834 1789317773.161715 fallocate 0x013e41 thru 0x01c99c (0x8b5c bytes) 000836 1789317773.172281 mapread 0x000313 thru 0x00c6f6 (0xc3e4 bytes) 000838 1789317773.179707 write 0x005d53 thru 0x009cd3 (0x3f81 bytes) 000839 1789317773.182973 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 15: 0xe44f46b4 (stale) Mirror 16: 0xe44f46b4 (stale) Mirror 17: 0xe30a2325 (stale) Mirror 18: 0xe30a2325 (stale) Mirror 19: 0xe30a2325 (stale) Mirror 20: 0xe30a2325 (stale) CRC-32 checksum value for chunk [0, 0x2c2e8): Mirror 1: 0xc49208d1 Mirror 21: 0xc49208d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c2e8: skipped 000840 1789317773.462380 mapread 0x01be06 thru 0x021ac6 (0x5cc1 bytes) 000841 1789317773.472887 read 0x01adc6 thru 0x01fa37 (0x4c72 bytes) 000842 1789317773.475108 mapwrite 0x0056c5 thru 0x005c70 (0x5ac bytes) 000843 1789317773.510628 mapwrite 0x0285d8 thru 0x029b13 (0x153c bytes) 000844 1789317773.518149 MIRROR_RESYNC 8 mirrors 000845 1789317773.986475 MIRROR_RESYNC 8 mirrors 000846 1789317774.140216 fallocate 0x011082 thru 0x0196ec (0x866b bytes) 000847 1789317774.150279 read 0x01d204 thru 0x0279bd (0xa7ba bytes) 000850 1789317774.154146 read 0x007ef7 thru 0x012e8a (0xaf94 bytes) 000851 1789317774.157511 trunc from 0x02c2e8 to 0x037edc (0xbbf5 bytes) 000852 1789317774.169848 MIRROR_RESYNC 8 mirrors 000853 1789317774.693307 read 0x009719 thru 0x016db4 (0xd69c bytes) 000854 1789317774.696947 read 0x02af89 thru 0x02d940 (0x29b8 bytes) 000855 1789317774.700916 fallocate 0x004730 thru 0x010228 (0xbaf9 bytes) 000856 1789317774.715393 mapread 0x00964a thru 0x01550a (0xbec1 bytes) 000857 1789317774.736141 mapread 0x029091 thru 0x037edc (0xee4c bytes) 000858 1789317774.766186 MIRROR_RESYNC 8 mirrors 000859 1789317775.395428 punch from 0x019485 to 0x025a97 (0xc613 bytes) 000860 1789317775.408893 fallocate 0x020132 thru 0x0272e5 (0x71b4 bytes) 000861 1789317775.412509 fallocate 0x01c45c thru 0x01c753 (0x2f8 bytes) 000862 1789317775.415235 trunc from 0x024ad4 to 0x02caf3 (0x8020 bytes) 000863 1789317775.421568 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x37edd): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37edd): Mirror 15: 0x4578289d (stale) Mirror 16: 0x4578289d (stale) Mirror 17: 0x4578289d (stale) Mirror 18: 0x4578289d (stale) Mirror 19: 0x4578289d (stale) Mirror 20: 0x4578289d (stale) Mirror 21: 0x4578289d (stale) CRC-32 checksum value for chunk [0, 0x37edd): Mirror 1: 0xaa29c7d2 Mirror 22: 0xaa29c7d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37edd: skipped 000864 1789317775.815664 punch from 0x00df3a to 0x01ba41 (0xdb08 bytes) 000865 1789317775.841587 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37edd): Mirror 15: 0x4578289d (stale) Mirror 16: 0x4578289d (stale) Mirror 18: 0x4578289d (stale) Mirror 19: 0x4578289d (stale) Mirror 20: 0x4578289d (stale) Mirror 21: 0x4578289d (stale) Mirror 22: 0xaa29c7d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37edd): Mirror 15: 0x4578289d (stale) Mirror 16: 0x4578289d (stale) Mirror 18: 0x4578289d (stale) Mirror 19: 0x4578289d (stale) Mirror 20: 0x4578289d (stale) Mirror 21: 0x4578289d (stale) Mirror 22: 0xaa29c7d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37edd: skipped 000866 1789317776.040631 MIRROR_RESYNC 8 mirrors 000867 1789317776.701535 fallocate 0x02dfcf thru 0x03af83 (0xcfb5 bytes) 000868 1789317776.723661 mapwrite 0x028ae0 thru 0x02db4c (0x506d bytes) 000869 1789317776.737205 mapread 0x028544 thru 0x030a5e (0x851b bytes) 000870 1789317776.738041 mapread 0x02e297 thru 0x02ffb3 (0x1d1d bytes) 000871 1789317776.738590 mapread 0x00695e thru 0x014e5d (0xe500 bytes) 000872 1789317776.747218 write 0x02816e thru 0x02d1e9 (0x507c bytes) 000873 1789317776.748211 trunc from 0x037edd to 0x014626 (0x238b6 bytes) 000874 1789317776.756709 punch from 0x007bd3 to 0x00c35a (0x4788 bytes) 000875 1789317776.759274 read 0x00db99 thru 0x014626 (0x6a8e bytes) 000876 1789317776.759793 write 0x0152fd thru 0x0173f3 (0x20f7 bytes) 000877 1789317776.760682 mapread 0x012a2b thru 0x0173f3 (0x49c9 bytes) 000878 1789317776.761552 trunc from 0x0103e1 to 0x015426 (0x5046 bytes) 000879 1789317776.766947 mapwrite 0x01d19f thru 0x02a689 (0xd4eb bytes) 000880 1789317776.794307 punch from 0x014f00 to 0x019551 (0x4652 bytes) 000881 1789317776.797848 trunc from 0x011aa9 to 0x0141b0 (0x2708 bytes) 000882 1789317776.800226 punch from 0x008229 to 0x00cbb9 (0x4991 bytes) 000883 1789317776.802251 trunc from 0x02a68a to 0x007c77 (0x22a12 bytes) 000884 1789317776.811215 trunc from 0x007c78 to 0x000386 (0x78f1 bytes) 000885 1789317776.819178 mapwrite 0x0068d5 thru 0x010ed6 (0xa602 bytes) 000888 1789317776.849658 read 0x005216 thru 0x006666 (0x1451 bytes) 000889 1789317776.850205 write 0x0289a0 thru 0x03749d (0xeafe bytes) 000890 1789317776.851989 punch from 0x00a3aa to 0x015779 (0xb3d0 bytes) 000892 1789317776.856208 punch from 0x001e30 to 0x00cd5a (0xaf2b bytes) 000894 1789317776.860968 write 0x02e4e3 thru 0x02ed6e (0x88c bytes) 000895 1789317776.861593 fallocate 0x021856 thru 0x02e721 (0xcecc bytes) 000896 1789317776.870314 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3749e): Mirror 15: 0x20e2a9cc (stale) Mirror 16: 0x20e2a9cc (stale) Mirror 18: 0x20e2a9cc (stale) Mirror 19: 0x20e2a9cc (stale) Mirror 20: 0x20e2a9cc (stale) Mirror 21: 0x20e2a9cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3749e): Mirror 15: 0x20e2a9cc (stale) Mirror 16: 0x20e2a9cc (stale) Mirror 18: 0x20e2a9cc (stale) Mirror 19: 0x20e2a9cc (stale) Mirror 20: 0x20e2a9cc (stale) Mirror 21: 0x20e2a9cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3749e: skipped 000897 1789317777.067211 punch from 0x02a515 to 0x02c1e3 (0x1ccf bytes) 000898 1789317777.070199 punch from 0x00776e to 0x00d9db (0x626e bytes) 000900 1789317777.073928 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3749e): Mirror 16: 0x20e2a9cc (stale) Mirror 18: 0x20e2a9cc (stale) Mirror 19: 0x20e2a9cc (stale) Mirror 20: 0x20e2a9cc (stale) Mirror 21: 0x20e2a9cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3749e): Mirror 16: 0x20e2a9cc (stale) Mirror 18: 0x20e2a9cc (stale) Mirror 19: 0x20e2a9cc (stale) Mirror 20: 0x20e2a9cc (stale) Mirror 21: 0x20e2a9cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3749e: skipped 000901 1789317777.227863 write 0x00d30f thru 0x0116cb (0x43bd bytes) 000902 1789317777.235206 read 0x01343d thru 0x0191a1 (0x5d65 bytes) 000903 1789317777.238866 fallocate 0x03790e thru 0x03ffff (0x86f2 bytes) 000904 1789317777.241528 fallocate 0x02e692 thru 0x03540a (0x6d79 bytes) 000905 1789317777.244314 punch from 0x011e0f to 0x01e471 (0xc663 bytes) 000906 1789317777.253320 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x47934634 (stale) Mirror 18: 0x47934634 (stale) Mirror 19: 0x47934634 (stale) Mirror 20: 0x47934634 (stale) Mirror 21: 0x47934634 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x49b41072 Mirror 22: 0x49b41072 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000907 1789317777.583093 punch from 0x00c9a6 to 0x010408 (0x3a63 bytes) 000908 1789317777.596673 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x47934634 (stale) Mirror 18: 0x47934634 (stale) Mirror 19: 0x47934634 (stale) Mirror 21: 0x47934634 (stale) Mirror 22: 0x49b41072 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x47934634 (stale) Mirror 18: 0x47934634 (stale) Mirror 19: 0x47934634 (stale) Mirror 21: 0x47934634 (stale) Mirror 22: 0x49b41072 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000909 1789317777.734585 trunc from 0x026709 to 0x034f46 (0xe83e bytes) 000910 1789317777.736569 write 0x01d02a thru 0x01d2ee (0x2c5 bytes) 000911 1789317777.740874 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x47934634 (stale) Mirror 19: 0x47934634 (stale) Mirror 21: 0x47934634 (stale) Mirror 22: 0x49b41072 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x47934634 (stale) Mirror 19: 0x47934634 (stale) Mirror 21: 0x47934634 (stale) Mirror 22: 0x49b41072 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000912 1789317777.870100 fallocate 0x024604 thru 0x029151 (0x4b4e bytes) 000913 1789317777.872382 mapread 0x03036f thru 0x033f87 (0x3c19 bytes) 000914 1789317777.879981 write 0x033e6e thru 0x03f3cd (0xb560 bytes) 000915 1789317777.885089 fallocate 0x00e501 thru 0x010044 (0x1b44 bytes) 000916 1789317777.887904 punch from 0x03b77e to 0x03ffff (0x4882 bytes) 000917 1789317777.894297 punch from 0x03f7eb to 0x03ffff (0x815 bytes) 000918 1789317777.896703 mapwrite 0x03d211 thru 0x03ffff (0x2def bytes) 000919 1789317777.905926 read 0x018a58 thru 0x019c8f (0x1238 bytes) 000920 1789317777.908298 write 0x035f58 thru 0x03d0be (0x7167 bytes) 000921 1789317777.909091 trunc from 0x040000 to 0x018db7 (0x27248 bytes) 000922 1789317777.920307 read 0x00c0f9 thru 0x00eb72 (0x2a7a bytes) 000924 1789317777.925701 mapwrite 0x0178f8 thru 0x02759a (0xfca3 bytes) 000925 1789317777.951736 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2759b): Mirror 18: 0x11b49509 (stale) Mirror 19: 0x11b49509 (stale) Mirror 22: 0x59ab97f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2759b): Mirror 18: 0x11b49509 (stale) Mirror 19: 0x11b49509 (stale) Mirror 22: 0x59ab97f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2759b: skipped 000926 1789317778.071137 mapwrite 0x02ed0a thru 0x03e314 (0xf60b bytes) 000927 1789317778.094965 trunc from 0x004cd4 to 0x00615a (0x1487 bytes) 000928 1789317778.098884 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0x663c17fa (stale) Mirror 22: 0x507f60ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0x663c17fa (stale) Mirror 22: 0x507f60ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e315: skipped 000929 1789317778.207683 fallocate 0x024de1 thru 0x030790 (0xb9b0 bytes) 000930 1789317778.211092 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0x663c17fa (stale) Mirror 22: 0x507f60ae (stale) CRC-32 checksum value for chunk [0, 0x3e315): Mirror 1: 0x2e2f2a4d Mirror 23: 0x2e2f2a4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e315: skipped 000931 1789317778.525158 mapread 0x02c808 thru 0x038394 (0xbb8d bytes) 000932 1789317778.543497 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0x663c17fa (stale) Mirror 22: 0x507f60ae (stale) CRC-32 checksum value for chunk [0, 0x3e315): Mirror 1: 0x2e2f2a4d Mirror 23: 0x2e2f2a4d Mirror 24: 0x2e2f2a4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e315: skipped 000933 1789317778.832409 trunc from 0x03dd89 to 0x03e314 (0x58c bytes) 000934 1789317778.844031 read 0x0097dd thru 0x017895 (0xe0b9 bytes) 000935 1789317778.847411 punch from 0x03be7b to 0x03e314 (0x249a bytes) 000936 1789317778.849374 trunc from 0x028280 to 0x02e35f (0x60e0 bytes) 000937 1789317778.850982 mapwrite 0x0277ec thru 0x0329bf (0xb1d4 bytes) 000938 1789317778.867234 MIRROR_RESYNC 5 mirrors 000939 1789317779.240946 trunc from 0x033b41 to 0x03e314 (0xa7d4 bytes) 000940 1789317779.249809 punch from 0x031205 to 0x039cc6 (0x8ac2 bytes) 000941 1789317779.251573 read 0x00216e thru 0x0116eb (0xf57e bytes) 000942 1789317779.254769 mapread 0x003650 thru 0x006435 (0x2de6 bytes) 000943 1789317779.255571 fallocate 0x0224c7 thru 0x025850 (0x338a bytes) 000944 1789317779.257392 write 0x02b326 thru 0x02f2f9 (0x3fd4 bytes) 000945 1789317779.262424 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0xaf1a972e (stale) Mirror 23: 0xaf1a972e (stale) Mirror 24: 0xaf1a972e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0xaf1a972e (stale) Mirror 23: 0xaf1a972e (stale) Mirror 24: 0xaf1a972e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e315: skipped 000946 1789317779.378129 trunc from 0x034a53 to 0x03a52f (0x5add bytes) 000947 1789317779.380147 fallocate 0x03a73d thru 0x03ffff (0x58c3 bytes) 000949 1789317779.382729 fallocate 0x0095bd thru 0x01760d (0xe051 bytes) 000950 1789317779.386028 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e315): Mirror 19: 0xaf1a972e (stale) Mirror 23: 0xaf1a972e (stale) Mirror 24: 0xaf1a972e (stale) CRC-32 checksum value for chunk [0, 0x3e315): Mirror 1: 0x25a44e5d Mirror 25: 0x25a44e5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e315: skipped 000951 1789317779.657714 mapread 0x00050b thru 0x00f275 (0xed6b bytes) 000952 1789317779.669402 read 0x0009cb thru 0x0038a8 (0x2ede bytes) 000953 1789317779.671835 trunc from 0x03e315 to 0x02ca55 (0x118bf bytes) 000955 1789317779.692090 fallocate 0x0220f6 thru 0x02a4e7 (0x83f2 bytes) 000956 1789317779.694056 trunc from 0x017483 to 0x01ee2f (0x79ad bytes) 000957 1789317779.695685 punch from 0x0167b3 to 0x018a90 (0x22de bytes) 000958 1789317779.697299 fallocate 0x005b5d thru 0x00b9b5 (0x5e59 bytes) 000959 1789317779.699007 read 0x01e9e4 thru 0x021e89 (0x34a6 bytes) 000961 1789317779.704793 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ca56): Mirror 23: 0xb9e741bb (stale) Mirror 24: 0xb9e741bb (stale) Mirror 25: 0x1efa2be4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca56): Mirror 23: 0xb9e741bb (stale) Mirror 24: 0xb9e741bb (stale) Mirror 25: 0x1efa2be4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca56: skipped 000962 1789317779.809418 write 0x015f00 thru 0x019b81 (0x3c82 bytes) 000964 1789317779.815471 trunc from 0x02ca56 to 0x00b1ce (0x21887 bytes) 000965 1789317779.821840 mapread 0x009f43 thru 0x00b1ce (0x128c bytes) 000966 1789317779.828498 mapwrite 0x00f9eb thru 0x01419e (0x47b4 bytes) 000967 1789317779.844666 fallocate 0x00c3a8 thru 0x018edf (0xcb38 bytes) 000968 1789317779.846944 mapwrite 0x01a2f4 thru 0x02a1c4 (0xfed1 bytes) 000969 1789317779.867025 punch from 0x002ec1 to 0x008e3b (0x5f7b bytes) 000970 1789317779.869446 trunc from 0x02a1c5 to 0x02015d (0xa067 bytes) 000971 1789317779.876603 mapread 0x01422e thru 0x01cfa0 (0x8d73 bytes) 000972 1789317779.877692 read 0x00ab6e thru 0x00f418 (0x48ab bytes) 000973 1789317779.878270 punch from 0x01631e to 0x01dbe5 (0x78c8 bytes) 000974 1789317779.881175 mapread 0x004ab9 thru 0x00f3fe (0xa946 bytes) 000975 1789317779.885415 write 0x030a24 thru 0x032d20 (0x22fd bytes) 000976 1789317779.886390 trunc from 0x032d21 to 0x017d47 (0x1afd9 bytes) 000977 1789317779.895449 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17d48): Mirror 23: 0xd78eb992 (stale) Mirror 25: 0xd78eb992 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17d48): Mirror 23: 0xd78eb992 (stale) Mirror 25: 0xd78eb992 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17d48: skipped 000978 1789317780.010695 read 0x00d7b0 thru 0x010f3a (0x378b bytes) 000979 1789317780.014911 punch from 0x00f1b7 to 0x00f962 (0x7ac bytes) 000980 1789317780.017016 mapread 0x0021a2 thru 0x009812 (0x7671 bytes) 000981 1789317780.028819 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17d48): Mirror 25: 0xd78eb992 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17d48): Mirror 25: 0xd78eb992 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17d48: skipped 000982 1789317780.122203 read 0x00778a thru 0x015ab0 (0xe327 bytes) 000983 1789317780.125317 fallocate 0x00d0e8 thru 0x00d20e (0x127 bytes) 000984 1789317780.127224 read 0x013bbb thru 0x017d47 (0x418d bytes) 000985 1789317780.131467 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000986 1789317780.168628 punch from 0x010eb8 to 0x013fdb (0x3124 bytes) 000987 1789317780.170917 read 0x00c873 thru 0x011138 (0x48c6 bytes) 000988 1789317780.174361 trunc from 0x00e9e8 to 0x012aa4 (0x40bd bytes) 000991 1789317780.177355 trunc from 0x017d48 to 0x0142d8 (0x3a6f bytes) 000992 1789317780.183693 mapread 0x00ca23 thru 0x01349e (0x6a7c bytes) 000993 1789317780.191214 read 0x00f32e thru 0x0142d8 (0x4fab bytes) 000994 1789317780.191841 mapread 0x002397 thru 0x00e69a (0xc304 bytes) 000995 1789317780.196133 mapwrite 0x002b24 thru 0x012b18 (0xfff5 bytes) 000996 1789317780.205611 fallocate 0x00f427 thru 0x01cf8a (0xdb64 bytes) 000997 1789317780.208099 mapwrite 0x016f7f thru 0x01706b (0xed bytes) 000998 1789317780.216536 trunc from 0x00a9dc to 0x00c246 (0x186b bytes) 000999 1789317780.218880 punch from 0x0168df to 0x01cf8a (0x66ac bytes) 001000 1789317780.221190 trunc from 0x01cf8b to 0x03c348 (0x1f3be bytes) All operations completed A-OK!