== sanity-flr test 70a: flr mode fsx test ================ 11:52:08 (1788623528) Seed set to 3530 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002 1788623530.873522 mapwrite 0x010102 thru 0x01986e (0x976d bytes) 000004 1788623531.026778 punch from 0x010da0 to 0x016f8e (0x61ef bytes) truncating to largest ever: 0x20990 000005 1788623531.046247 trunc from 0x01986f to 0x02098f (0x7121 bytes) 000008 1788623531.069437 mapread 0x01a5ad thru 0x01da37 (0x348b bytes) 000009 1788623531.079823 mapwrite 0x03ba94 thru 0x03ffff (0x456c bytes) 000010 1788623531.210156 punch from 0x003e8b to 0x0101ea (0xc360 bytes) 000011 1788623531.217044 mapread 0x02d4e0 thru 0x03c782 (0xf2a3 bytes) 000015 1788623531.234041 punch from 0x024e75 to 0x0271a1 (0x232d bytes) 000017 1788623531.242068 mapwrite 0x010786 thru 0x018167 (0x79e2 bytes) 000019 1788623531.309447 mapwrite 0x02c915 thru 0x02d8c4 (0xfb0 bytes) 000020 1788623531.352084 write 0x023538 thru 0x03164c (0xe115 bytes) 000023 1788623531.359100 mapread 0x023e60 thru 0x031989 (0xdb2a bytes) 000024 1788623531.360429 punch from 0x01e7a6 to 0x023835 (0x5090 bytes) truncating to largest ever: 0x305bf 000026 1788623531.374721 trunc from 0x040000 to 0x0305be (0xfa41 bytes) 000027 1788623531.397071 mapwrite 0x00fbed thru 0x01b3e3 (0xb7f7 bytes) 000029 1788623531.459640 read 0x0055f7 thru 0x00753c (0x1f46 bytes) 000030 1788623531.473734 write 0x03ca18 thru 0x03ffff (0x35e8 bytes) 000033 1788623531.482102 mapwrite 0x01c320 thru 0x027f29 (0xbc0a bytes) 000034 1788623531.613246 mapwrite 0x0305e1 thru 0x0344b4 (0x3ed4 bytes) 000035 1788623531.711227 punch from 0x0220ce to 0x027a00 (0x5933 bytes) 000036 1788623531.716689 mapwrite 0x03b0b8 thru 0x03ffff (0x4f48 bytes) 000037 1788623531.797215 punch from 0x01998f to 0x0220ed (0x875f bytes) 000038 1788623531.807893 write 0x02dfff thru 0x036e0e (0x8e10 bytes) 000040 1788623531.817156 punch from 0x01b95b to 0x0236ff (0x7da5 bytes) 000041 1788623531.843773 MIRROR_EXTEND to 2 mirrors 000044 1788623533.204604 write 0x01d388 thru 0x0228ed (0x5566 bytes) 000045 1788623533.350783 mapread 0x02f9df thru 0x035d5f (0x6381 bytes) 000050 1788623533.368281 trunc from 0x040000 to 0x001313 (0x3ecec bytes) 000051 1788623533.391886 read 0x0002c7 thru 0x001313 (0x104d bytes) 000052 1788623533.398721 mapwrite 0x02948b thru 0x02e221 (0x4d97 bytes) 000053 1788623533.471010 punch from 0x00c7ef to 0x01878a (0xbf9c bytes) 000055 1788623533.476528 write 0x001c57 thru 0x0028f9 (0xca3 bytes) 000056 1788623533.481419 mapread 0x0216b3 thru 0x02e221 (0xcb6f bytes) 000057 1788623533.489701 trunc from 0x02e222 to 0x01bd42 (0x124df bytes) 000058 1788623533.505558 punch from 0x013909 to 0x01634e (0x2a46 bytes) 000060 1788623533.514769 trunc from 0x01bd43 to 0x02bfba (0x10278 bytes) 000061 1788623533.531385 mapwrite 0x02ded0 thru 0x036b61 (0x8c92 bytes) 000062 1788623533.606538 read 0x009fb4 thru 0x01655c (0xc5a9 bytes) 000063 1788623533.616661 punch from 0x0338f2 to 0x036b61 (0x3270 bytes) 000064 1788623533.623142 write 0x02d259 thru 0x02fab0 (0x2858 bytes) 000066 1788623533.624581 write 0x0352e7 thru 0x03ffff (0xad19 bytes) 000067 1788623533.630796 punch from 0x005709 to 0x00829e (0x2b96 bytes) 000068 1788623533.645894 write 0x035198 thru 0x03559d (0x406 bytes) 000071 1788623533.647903 mapwrite 0x03a8bb thru 0x03a9ae (0xf4 bytes) 000072 1788623533.690311 punch from 0x02e949 to 0x030f4f (0x2607 bytes) 000074 1788623533.700751 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x87278860 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd33c768a Mirror 3: 0xd33c768a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000075 1788623535.422823 read 0x03de37 thru 0x03ef95 (0x115f bytes) 000079 1788623535.484106 mapread 0x03a991 thru 0x03e9b7 (0x4027 bytes) 000080 1788623535.527342 write 0x0372c8 thru 0x039be0 (0x2919 bytes) 000081 1788623535.625056 read 0x01d94b thru 0x02be29 (0xe4df bytes) 000082 1788623535.659414 mapwrite 0x02b01c thru 0x03aca6 (0xfc8b bytes) 000083 1788623535.815726 trunc from 0x040000 to 0x012eeb (0x2d114 bytes) 000084 1788623535.835318 trunc from 0x012eec to 0x005ff5 (0xcef6 bytes) 000085 1788623535.864668 MIRROR_RESYNC 3 mirrors 000086 1788623537.456292 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) 000087 1788623537.963804 read 0x00443a thru 0x005a15 (0x15dc bytes) 000088 1788623537.969468 mapread 0x005b40 thru 0x005ff5 (0x4b6 bytes) 000089 1788623537.971109 punch from 0x0004bf to 0x005ff5 (0x5b37 bytes) 000091 1788623538.162523 mapread 0x003f58 thru 0x005ff5 (0x209e bytes) 000092 1788623538.213772 MIRROR_RESYNC 2 mirrors 000093 1788623539.720084 read 0x000a2d thru 0x005ff5 (0x55c9 bytes) 000094 1788623539.733812 mapwrite 0x019187 thru 0x020f73 (0x7ded bytes) 000095 1788623540.049721 mapwrite 0x0185d4 thru 0x020852 (0x827f bytes) 000097 1788623540.140558 write 0x019513 thru 0x02664d (0xd13b bytes) 000098 1788623540.141986 mapwrite 0x001f89 thru 0x00beac (0x9f24 bytes) 000099 1788623540.254606 mapread 0x01c978 thru 0x02664d (0x9cd6 bytes) 000100 1788623540.255605 trunc from 0x02664e to 0x010597 (0x160b6 bytes) 000101 1788623540.333063 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) 000102 1788623540.549591 punch from 0x003bc8 to 0x0097b8 (0x5bf1 bytes) 000103 1788623540.570877 trunc from 0x010598 to 0x02828f (0x17cf8 bytes) 000104 1788623540.637882 mapwrite 0x0212be thru 0x02ec13 (0xd956 bytes) 000108 1788623540.965851 mapread 0x02d532 thru 0x02ec13 (0x16e2 bytes) 000110 1788623540.980279 punch from 0x001480 to 0x002b9f (0x1720 bytes) 000113 1788623541.026955 mapwrite 0x0341c8 thru 0x03fa65 (0xb89e bytes) 000114 1788623541.205586 mapwrite 0x00e92a thru 0x01e7f2 (0xfec9 bytes) 000115 1788623541.338411 mapread 0x03677d thru 0x0373b5 (0xc39 bytes) truncating to largest ever: 0x33327 000118 1788623541.341728 trunc from 0x03fa66 to 0x033326 (0xc73f bytes) 000120 1788623541.360857 trunc from 0x033327 to 0x023f8e (0xf398 bytes) truncating to largest ever: 0x3cd79 000122 1788623541.389846 trunc from 0x023f8f to 0x03cd78 (0x18dea bytes) 000124 1788623541.410895 mapread 0x0348c1 thru 0x035d2f (0x146f bytes) 000126 1788623541.426137 trunc from 0x03cd79 to 0x03a480 (0x28f8 bytes) 000127 1788623541.442716 write 0x0170b7 thru 0x01ac0b (0x3b55 bytes) 000128 1788623541.443733 mapwrite 0x005225 thru 0x011aaa (0xc886 bytes) 000129 1788623541.535603 read 0x016488 thru 0x021874 (0xb3ed bytes) 000130 1788623541.536241 read 0x006c6f thru 0x00f8a7 (0x8c39 bytes) 000132 1788623541.537246 trunc from 0x03a481 to 0x021f08 (0x18578 bytes) 000133 1788623541.564079 mapread 0x01e512 thru 0x021f08 (0x39f7 bytes) 000134 1788623541.568405 trunc from 0x021f09 to 0x038a04 (0x16afc bytes) 000138 1788623541.607155 punch from 0x0251f8 to 0x028e73 (0x3c7c bytes) 000141 1788623541.619213 trunc from 0x038a05 to 0x0383f9 (0x60b bytes) 000145 1788623541.651502 punch from 0x01cb30 to 0x029556 (0xca27 bytes) 000146 1788623541.660629 punch from 0x018dab to 0x01fecc (0x7122 bytes) 000147 1788623541.674341 read 0x031820 thru 0x035a4a (0x422b bytes) 000151 1788623541.686056 read 0x01ae2f thru 0x01d994 (0x2b66 bytes) 000152 1788623541.697350 read 0x02ff75 thru 0x0383f9 (0x8485 bytes) 000153 1788623541.702417 read 0x0043c9 thru 0x00e729 (0xa361 bytes) 000154 1788623541.704541 mapwrite 0x02efa3 thru 0x03d3ec (0xe44a bytes) 000155 1788623541.888026 read 0x02be72 thru 0x02de8d (0x201c bytes) 000157 1788623541.898776 punch from 0x003603 to 0x00fabe (0xc4bc bytes) 000158 1788623541.916815 punch from 0x01387c to 0x017c79 (0x43fe bytes) 000159 1788623541.939319 MIRROR_EXTEND to 2 mirrors 000160 1788623543.529027 write 0x01a2cd thru 0x01e4c5 (0x41f9 bytes) 000162 1788623543.706502 trunc from 0x03d3ed to 0x027f91 (0x1545b bytes) 000163 1788623543.731835 mapwrite 0x011e7e thru 0x021d0f (0xfe92 bytes) 000164 1788623543.849926 trunc from 0x027f92 to 0x0109de (0x175b3 bytes) 000166 1788623543.866737 write 0x017686 thru 0x01ad45 (0x36c0 bytes) 000167 1788623543.867885 trunc from 0x01ad46 to 0x0228d0 (0x7b8b bytes) 000168 1788623543.893309 trunc from 0x0228d1 to 0x032c10 (0x10340 bytes) 000169 1788623543.917080 write 0x02fc84 thru 0x037b40 (0x7ebd bytes) 000170 1788623543.924051 read 0x005fba thru 0x0139a2 (0xd9e9 bytes) 000171 1788623543.945184 punch from 0x03408a to 0x0374cf (0x3446 bytes) 000172 1788623543.956908 punch from 0x01701a to 0x01c132 (0x5119 bytes) 000173 1788623543.965486 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37b41): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b41): Mirror 2: 0x53d35cad (stale) CRC-32 checksum value for chunk [0, 0x37b41): Mirror 1: 0x2e98cba0 Mirror 3: 0x2e98cba0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b41: skipped 000174 1788623545.397073 write 0x0231d2 thru 0x029f15 (0x6d44 bytes) 000176 1788623545.637712 punch from 0x00f696 to 0x01ab77 (0xb4e2 bytes) 000178 1788623545.661804 write 0x00b01b thru 0x015425 (0xa40b bytes) 000179 1788623545.673684 trunc from 0x037b41 to 0x026d1f (0x10e21 bytes) 000180 1788623545.709310 mapwrite 0x02c815 thru 0x02fb73 (0x335f bytes) 000184 1788623545.898682 read 0x000a91 thru 0x0017b6 (0xd26 bytes) 000185 1788623545.913634 write 0x019557 thru 0x01b8f3 (0x239d bytes) 000186 1788623545.957374 read 0x025aec thru 0x025e1b (0x330 bytes) 000187 1788623545.958727 write 0x00cc61 thru 0x019c10 (0xcfb0 bytes) 000188 1788623545.963209 punch from 0x0267d7 to 0x02fb73 (0x939d bytes) 000191 1788623546.006848 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fb74): Mirror 3: 0x810734f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fb74): Mirror 3: 0x810734f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fb74: skipped 000192 1788623546.575139 punch from 0x007482 to 0x00ea21 (0x75a0 bytes) 000193 1788623546.582985 punch from 0x029aad to 0x02fb73 (0x60c7 bytes) 000194 1788623546.588779 mapwrite 0x013653 thru 0x01fa34 (0xc3e2 bytes) 000195 1788623546.741582 trunc from 0x02fb74 to 0x0052b4 (0x2a8bf bytes) 000198 1788623546.776121 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x52b5): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x52b5): Mirror 3: 0x760f9e39 (stale) CRC-32 checksum value for chunk [0, 0x52b5): Mirror 1: 0x760f9e39 Mirror 4: 0x760f9e39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x52b5: skipped 000200 1788623548.700409 mapwrite 0x015f04 thru 0x01a144 (0x4241 bytes) 000201 1788623548.865995 trunc from 0x01a145 to 0x02a000 (0xfebc bytes) 000204 1788623548.894922 read 0x01eaa0 thru 0x024429 (0x598a bytes) 000205 1788623548.909870 read 0x01f3e4 thru 0x027b3b (0x8758 bytes) 000206 1788623548.924462 mapwrite 0x03802a thru 0x0386d4 (0x6ab bytes) 000209 1788623549.072783 read 0x035e49 thru 0x0386d4 (0x288c bytes) 000211 1788623549.076624 mapread 0x018c15 thru 0x01c4a8 (0x3894 bytes) 000212 1788623549.077816 punch from 0x0304a6 to 0x036c9f (0x67fa bytes) 000214 1788623549.096852 punch from 0x021b84 to 0x02ff4d (0xe3ca bytes) 000215 1788623549.123114 MIRROR_RESYNC 3 mirrors 000216 1788623550.454044 mapwrite 0x03816f thru 0x03882c (0x6be bytes) 000217 1788623550.526309 punch from 0x012e8b to 0x0155f7 (0x276d bytes) 000221 1788623550.532306 write 0x0273c1 thru 0x029a65 (0x26a5 bytes) 000222 1788623550.541048 trunc from 0x03882d to 0x00f774 (0x290b8 bytes) 000223 1788623550.569424 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf775): Mirror 3: 0x49dfdb5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf775): Mirror 3: 0x49dfdb5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf775: skipped 000226 1788623550.920440 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xf775): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf775): Mirror 3: 0x49dfdb5f (stale) CRC-32 checksum value for chunk [0, 0xf775): Mirror 1: 0x49dfdb5f Mirror 4: 0x49dfdb5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf775: skipped 000227 1788623551.978288 read 0x00d8f9 thru 0x00f774 (0x1e7c bytes) 000228 1788623551.988802 mapread 0x00e9e6 thru 0x00f774 (0xd8f bytes) 000229 1788623552.000802 write 0x00ce81 thru 0x01a5b2 (0xd732 bytes) 000230 1788623552.071203 write 0x02fe01 thru 0x03769d (0x789d bytes) 000232 1788623552.073112 punch from 0x00afc1 to 0x00ec60 (0x3ca0 bytes) 000233 1788623552.091970 punch from 0x02748a to 0x02cca9 (0x5820 bytes) 000234 1788623552.097568 mapwrite 0x02945d thru 0x037669 (0xe20d bytes) 000235 1788623552.159484 trunc from 0x03769e to 0x018810 (0x1ee8d bytes) 000236 1788623552.178680 trunc from 0x018811 to 0x037f88 (0x1f778 bytes) 000239 1788623552.197712 mapwrite 0x00bce7 thru 0x0166bf (0xa9d9 bytes) 000240 1788623552.260915 punch from 0x01bf89 to 0x01f08f (0x3107 bytes) 000242 1788623552.266600 mapread 0x036854 thru 0x037f88 (0x1735 bytes) 000243 1788623552.274569 write 0x00b75c thru 0x011545 (0x5dea bytes) 000244 1788623552.276076 punch from 0x022de6 to 0x0293b1 (0x65cc bytes) 000246 1788623552.293985 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37f89): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f89): Mirror 3: 0x28b7e38a (stale) Mirror 4: 0x6580bd31 (stale) CRC-32 checksum value for chunk [0, 0x37f89): Mirror 1: 0x23ad4987 Mirror 5: 0x23ad4987 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f89: skipped 000247 1788623553.541724 write 0x02cd24 thru 0x0340ee (0x73cb bytes) 000248 1788623553.643743 write 0x013425 thru 0x022d4d (0xf929 bytes) 000250 1788623553.658940 write 0x02fac3 thru 0x03fa94 (0xffd2 bytes) 000251 1788623553.667880 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fa95): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa95): Mirror 3: 0xe643b69e (stale) Mirror 4: 0x1303580c (stale) Mirror 5: 0x70ebba1d (stale) CRC-32 checksum value for chunk [0, 0x3fa95): Mirror 1: 0x18e746e2 Mirror 6: 0x18e746e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa95: skipped 000252 1788623554.791873 write 0x00eca2 thru 0x00f1fb (0x55a bytes) 000255 1788623554.862828 read 0x02863b thru 0x02b7d9 (0x319f bytes) 000257 1788623554.874028 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fa95): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa95): Mirror 3: 0xe643b69e (stale) Mirror 4: 0x1303580c (stale) Mirror 5: 0x70ebba1d (stale) Mirror 6: 0x18e746e2 (stale) CRC-32 checksum value for chunk [0, 0x3fa95): Mirror 1: 0x6b81f1a3 Mirror 7: 0x6b81f1a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa95: skipped 000258 1788623555.961201 read 0x03cbec thru 0x03f517 (0x292c bytes) 000259 1788623555.972052 trunc from 0x03fa95 to 0x027159 (0x1893b bytes) 000261 1788623556.057306 mapread 0x0253c5 thru 0x027159 (0x1d95 bytes) 000262 1788623556.071992 mapread 0x025867 thru 0x027159 (0x18f3 bytes) 000263 1788623556.072637 read 0x007eff thru 0x0172c4 (0xf3c6 bytes) 000264 1788623556.079912 mapread 0x0079ea thru 0x0145f1 (0xcc08 bytes) 000266 1788623556.085486 mapwrite 0x030215 thru 0x03346e (0x325a bytes) 000268 1788623556.136765 write 0x0007c2 thru 0x00da44 (0xd283 bytes) 000270 1788623556.139598 punch from 0x00f79a to 0x013bde (0x4445 bytes) 000272 1788623556.156924 punch from 0x004844 to 0x013472 (0xec2f bytes) 000273 1788623556.161135 mapread 0x02b7ab thru 0x02fc73 (0x44c9 bytes) 000274 1788623556.162203 write 0x016ac2 thru 0x026a36 (0xff75 bytes) 000275 1788623556.163981 read 0x024fbb thru 0x02ce7b (0x7ec1 bytes) 000276 1788623556.164629 punch from 0x025aa1 to 0x02c5c9 (0x6b29 bytes) 000277 1788623556.172805 mapread 0x02b985 thru 0x03346e (0x7aea bytes) 000278 1788623556.178912 mapwrite 0x020cca thru 0x026234 (0x556b bytes) 000279 1788623556.220483 punch from 0x001915 to 0x010432 (0xeb1e bytes) 000280 1788623556.224768 mapread 0x0081b3 thru 0x008871 (0x6bf bytes) 000281 1788623556.231598 mapread 0x000349 thru 0x00a8a3 (0xa55b bytes) 000282 1788623556.276863 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3346f): Mirror 3: 0x5c83b7ec (stale) Mirror 4: 0xab9df347 (stale) Mirror 5: 0x7ca0ddfb (stale) Mirror 6: 0x7e3c8593 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3346f): Mirror 3: 0x5c83b7ec (stale) Mirror 4: 0xab9df347 (stale) Mirror 5: 0x7ca0ddfb (stale) Mirror 6: 0x7e3c8593 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3346f: skipped 000283 1788623556.620491 write 0x026dd6 thru 0x02a926 (0x3b51 bytes) 000284 1788623556.626903 punch from 0x00dc0f to 0x00e6eb (0xadd bytes) 000285 1788623556.640606 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3346f): Mirror 4: 0xab9df347 (stale) Mirror 5: 0x7ca0ddfb (stale) Mirror 6: 0x7e3c8593 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3346f): Mirror 4: 0xab9df347 (stale) Mirror 5: 0x7ca0ddfb (stale) Mirror 6: 0x7e3c8593 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3346f: skipped 000287 1788623556.921751 mapwrite 0x023bb3 thru 0x031a3a (0xde88 bytes) 000288 1788623556.983827 read 0x022b57 thru 0x02cd0b (0xa1b5 bytes) 000289 1788623556.984517 mapwrite 0x012282 thru 0x01dc93 (0xba12 bytes) 000290 1788623557.027282 MIRROR_RESYNC 4 mirrors 000291 1788623558.141071 mapread 0x0062a3 thru 0x00d4bd (0x721b bytes) 000293 1788623558.163205 trunc from 0x03346f to 0x00bc8d (0x277e1 bytes) 000297 1788623558.289327 read 0x002d50 thru 0x00bc8d (0x8f3e bytes) 000298 1788623558.342854 MIRROR_RESYNC 4 mirrors 000299 1788623560.087845 mapwrite 0x003f1f thru 0x00ea32 (0xab14 bytes) 000300 1788623560.345795 MIRROR_RESYNC 4 mirrors 000301 1788623561.686539 mapwrite 0x03fa33 thru 0x03ffff (0x5cd bytes) 000302 1788623561.882906 mapread 0x020ace thru 0x022b62 (0x2095 bytes) 000303 1788623561.914799 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xea016748 (stale) Mirror 6: 0xea016748 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xea016748 (stale) Mirror 6: 0xea016748 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000304 1788623562.459906 write 0x03c2ae thru 0x03ffff (0x3d52 bytes) 000305 1788623562.469768 trunc from 0x040000 to 0x024d8d (0x1b272 bytes) 000308 1788623562.480626 mapread 0x022d88 thru 0x024d8d (0x2006 bytes) 000310 1788623562.510996 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24d8e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d8e): Mirror 5: 0xc5bad1d2 (stale) Mirror 6: 0xc5bad1d2 (stale) CRC-32 checksum value for chunk [0, 0x24d8e): Mirror 1: 0xc5bad1d2 Mirror 7: 0xc5bad1d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d8e: skipped 000311 1788623563.216426 write 0x011ec4 thru 0x016117 (0x4254 bytes) 000313 1788623563.302906 mapwrite 0x01f315 thru 0x02b04f (0xbd3b bytes) 000314 1788623563.462362 mapwrite 0x01d5a6 thru 0x01dac6 (0x521 bytes) 000315 1788623563.499645 punch from 0x0278f4 to 0x02b04f (0x375c bytes) 000316 1788623563.507605 trunc from 0x02b050 to 0x022c37 (0x8418 bytes) 000317 1788623563.519327 punch from 0x008fd8 to 0x017b42 (0xeb6b bytes) 000318 1788623563.522790 read 0x00d997 thru 0x01374b (0x5db5 bytes) 000319 1788623563.528667 mapread 0x016fd0 thru 0x022c37 (0xbc68 bytes) 000320 1788623563.535198 mapwrite 0x0383c5 thru 0x03ca09 (0x4645 bytes) 000321 1788623563.612712 mapwrite 0x039a29 thru 0x03ffff (0x65d7 bytes) 000322 1788623563.666098 trunc from 0x040000 to 0x00e741 (0x318be bytes) 000323 1788623563.678915 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe742): Mirror 6: 0x7b7e6fb8 (stale) Mirror 7: 0x7b7e6fb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe742): Mirror 6: 0x7b7e6fb8 (stale) Mirror 7: 0x7b7e6fb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe742: skipped 000324 1788623563.915141 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe742): Mirror 7: 0x7b7e6fb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe742): Mirror 7: 0x7b7e6fb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe742: skipped 000325 1788623564.156511 punch from 0x0075a1 to 0x00e741 (0x71a1 bytes) 000327 1788623564.166386 write 0x021bbf thru 0x02488a (0x2ccc bytes) 000328 1788623564.167556 read 0x004fe7 thru 0x008903 (0x391d bytes) 000329 1788623564.191626 punch from 0x00cdcd to 0x016803 (0x9a37 bytes) 000330 1788623564.223532 mapread 0x01b42c thru 0x02488a (0x945f bytes) 000331 1788623564.252015 read 0x01f0a3 thru 0x01fc0e (0xb6c bytes) 000333 1788623564.254004 write 0x03bc9b thru 0x03c9ea (0xd50 bytes) 000334 1788623564.255681 trunc from 0x03c9eb to 0x01b44d (0x2159d bytes) 000335 1788623564.287599 write 0x01ff2a thru 0x02bb3c (0xbc13 bytes) 000336 1788623564.290079 read 0x024d01 thru 0x02bb3c (0x6e3c bytes) 000337 1788623564.292064 mapread 0x0189fd thru 0x01a96f (0x1f73 bytes) 000338 1788623564.297785 punch from 0x024780 to 0x02bb3c (0x73bd bytes) 000340 1788623564.323391 trunc from 0x02bb3d to 0x0019bf (0x2a17d bytes) 000341 1788623564.340401 mapwrite 0x01ee8b thru 0x027f39 (0x90af bytes) 000343 1788623564.462752 mapread 0x012011 thru 0x01b1d0 (0x91c0 bytes) 000345 1788623564.465656 write 0x03e907 thru 0x03ffff (0x16f9 bytes) 000348 1788623564.468533 punch from 0x01ec35 to 0x02e265 (0xf631 bytes) 000349 1788623564.477420 mapread 0x018d88 thru 0x01bfc4 (0x323d bytes) 000350 1788623564.479436 read 0x01dade thru 0x02d9d7 (0xfefa bytes) 000351 1788623564.494571 trunc from 0x040000 to 0x015273 (0x2ad8c bytes) 000352 1788623564.511869 mapread 0x01122d thru 0x015273 (0x4047 bytes) 000353 1788623564.513636 mapread 0x00fdce thru 0x015273 (0x54a6 bytes) 000360 1788623564.518658 mapwrite 0x035469 thru 0x038647 (0x31df bytes) 000361 1788623564.588426 mapread 0x018132 thru 0x018b6a (0xa39 bytes) 000362 1788623564.596477 MIRROR_RESYNC 2 mirrors 000363 1788623565.214707 write 0x036f9d thru 0x03aadb (0x3b3f bytes) 000368 1788623565.366644 mapread 0x03a145 thru 0x03aadb (0x997 bytes) 000369 1788623565.374941 trunc from 0x03aadc to 0x02ee86 (0xbc55 bytes) 000370 1788623565.467777 write 0x0258dd thru 0x02f1dc (0x9900 bytes) 000371 1788623565.493346 mapwrite 0x00da59 thru 0x017740 (0x9ce8 bytes) 000372 1788623565.713297 punch from 0x0031b7 to 0x009b3e (0x6988 bytes) 000374 1788623565.728453 mapread 0x00d02e thru 0x0107a3 (0x3776 bytes) 000375 1788623565.744595 trunc from 0x02f1dd to 0x00acb2 (0x2452a bytes) 000376 1788623565.782848 MIRROR_RESYNC 2 mirrors 000377 1788623566.497582 mapread 0x005236 thru 0x0054e0 (0x2ab bytes) 000379 1788623566.507383 write 0x032d38 thru 0x039297 (0x6560 bytes) 000380 1788623566.556780 write 0x00c49d thru 0x00ddb2 (0x1916 bytes) 000383 1788623566.568804 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) 000384 1788623566.695468 MIRROR_EXTEND to 2 mirrors 000385 1788623567.469144 punch from 0x000847 to 0x0058e3 (0x509d bytes) 000386 1788623567.587498 write 0x03503c thru 0x03ffff (0xafc4 bytes) 000387 1788623567.595444 mapwrite 0x00f59c thru 0x010a27 (0x148c bytes) 000389 1788623567.662598 MIRROR_RESYNC 2 mirrors 000390 1788623568.448723 mapread 0x008392 thru 0x00997a (0x15e9 bytes) 000393 1788623568.462194 mapread 0x01675d thru 0x020ddb (0xa67f bytes) 000394 1788623568.481222 write 0x01d40c thru 0x0271da (0x9dcf bytes) 000395 1788623568.608397 mapread 0x000587 thru 0x005bf5 (0x566f bytes) 000398 1788623568.618406 mapwrite 0x000fb6 thru 0x002644 (0x168f bytes) 000399 1788623568.677830 read 0x0236dd thru 0x02957d (0x5ea1 bytes) 000401 1788623568.683478 mapwrite 0x03056f thru 0x03ed12 (0xe7a4 bytes) 000402 1788623568.778659 write 0x009cdd thru 0x0190c3 (0xf3e7 bytes) 000404 1788623568.787526 read 0x0156c2 thru 0x01fc74 (0xa5b3 bytes) 000406 1788623568.799785 MIRROR_RESYNC 2 mirrors 000407 1788623570.227534 mapread 0x01cc4e thru 0x022651 (0x5a04 bytes) 000409 1788623570.248446 punch from 0x02015e to 0x026016 (0x5eb9 bytes) 000410 1788623570.325432 read 0x03cfcf thru 0x03ffff (0x3031 bytes) 000411 1788623570.340210 write 0x00741b thru 0x0098e0 (0x24c6 bytes) 000412 1788623570.352243 mapread 0x012428 thru 0x01dc34 (0xb80d bytes) 000414 1788623570.372350 read 0x01b753 thru 0x023c71 (0x851f bytes) 000415 1788623570.372970 punch from 0x0297ad to 0x02abff (0x1453 bytes) 000416 1788623570.383336 punch from 0x001959 to 0x00f3fb (0xdaa3 bytes) 000417 1788623570.388820 mapread 0x03c316 thru 0x03ffff (0x3cea bytes) 000418 1788623570.395607 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) 000419 1788623570.543229 mapread 0x00a674 thru 0x01a5ec (0xff79 bytes) 000420 1788623570.569303 mapread 0x02ac08 thru 0x0349f4 (0x9ded bytes) 000422 1788623570.588073 mapread 0x011fad thru 0x014d26 (0x2d7a bytes) 000423 1788623570.589675 write 0x03b4ba thru 0x03ffff (0x4b46 bytes) 000424 1788623570.592637 trunc from 0x040000 to 0x018489 (0x27b76 bytes) 000426 1788623570.620426 punch from 0x00e903 to 0x013926 (0x5024 bytes) 000428 1788623570.626143 mapread 0x003cbe thru 0x012a8e (0xedd1 bytes) 000429 1788623570.638349 trunc from 0x01848a to 0x00c00e (0xc47b bytes) 000431 1788623570.658450 punch from 0x00a334 to 0x00c00e (0x1cdb bytes) 000433 1788623570.663741 read 0x00a779 thru 0x00c00e (0x1896 bytes) 000434 1788623570.669877 write 0x02c011 thru 0x02f72c (0x371c bytes) 000435 1788623570.678227 MIRROR_EXTEND to 2 mirrors 000436 1788623572.367576 MIRROR_EXTEND to 3 mirrors 000437 1788623573.594393 punch from 0x00b6fd to 0x0134f6 (0x7dfa bytes) 000440 1788623573.684896 trunc from 0x02f72d to 0x01f99d (0xfd8f bytes) 000441 1788623573.720418 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 3: 0xdbde2d6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 3: 0xdbde2d6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f99e: skipped 000442 1788623574.060828 mapwrite 0x009890 thru 0x00b75d (0x1ece bytes) 000443 1788623574.206963 trunc from 0x01f99e to 0x0081f2 (0x177ab bytes) 000444 1788623574.230965 trunc from 0x0081f3 to 0x01960c (0x1141a bytes) 000445 1788623574.254848 write 0x024aa8 thru 0x026a8c (0x1fe5 bytes) 000446 1788623574.262633 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) 000447 1788623574.510270 punch from 0x01cc0c to 0x026a8c (0x9e81 bytes) 000450 1788623574.523723 mapread 0x014dc0 thru 0x01dcfa (0x8f3b bytes) 000452 1788623574.577664 mapread 0x01e6ec thru 0x026a8c (0x83a1 bytes) 000456 1788623574.610897 read 0x0132d9 thru 0x021179 (0xdea1 bytes) 000457 1788623574.612205 read 0x01b06a thru 0x026a8c (0xba23 bytes) 000458 1788623574.620602 mapwrite 0x0309bf thru 0x037bdf (0x7221 bytes) 000459 1788623574.756680 mapwrite 0x00c977 thru 0x011e6d (0x54f7 bytes) 000460 1788623574.813902 mapwrite 0x02ca74 thru 0x03b493 (0xea20 bytes) 000463 1788623574.924665 write 0x00c1c4 thru 0x010b71 (0x49ae bytes) 000464 1788623574.925714 trunc from 0x03b494 to 0x01b80a (0x1fc89 bytes) 000466 1788623574.971324 write 0x0043a5 thru 0x007e37 (0x3a93 bytes) 000467 1788623574.976448 punch from 0x002e30 to 0x003746 (0x917 bytes) 000470 1788623575.000345 write 0x032075 thru 0x03f049 (0xcfd5 bytes) 000471 1788623575.002024 read 0x0061db thru 0x015486 (0xf2ac bytes) 000472 1788623575.014723 trunc from 0x03f04a to 0x026719 (0x18930 bytes) 000473 1788623575.048049 mapread 0x0248de thru 0x026719 (0x1e3c bytes) 000474 1788623575.060281 mapwrite 0x02c90d thru 0x039f2e (0xd622 bytes) 000475 1788623575.219720 read 0x027bed thru 0x02ea34 (0x6e48 bytes) 000476 1788623575.220575 punch from 0x0066e3 to 0x00c6eb (0x6009 bytes) 000477 1788623575.227849 punch from 0x00c50a to 0x010384 (0x3e7b bytes) 000479 1788623575.234669 punch from 0x037998 to 0x039f2e (0x2597 bytes) 000482 1788623575.242785 write 0x026334 thru 0x02e9cc (0x8699 bytes) 000483 1788623575.265129 MIRROR_EXTEND to 2 mirrors 000485 1788623576.659462 mapwrite 0x01c656 thru 0x026f8a (0xa935 bytes) 000487 1788623576.808601 punch from 0x003f22 to 0x00dc32 (0x9d11 bytes) 000489 1788623576.814823 read 0x01c684 thru 0x01dd1d (0x169a bytes) 000490 1788623576.816485 mapread 0x017291 thru 0x01c4a9 (0x5219 bytes) 000491 1788623576.819220 read 0x038027 thru 0x039f2e (0x1f08 bytes) 000492 1788623576.828587 trunc from 0x039f2f to 0x02c685 (0xd8a9 bytes) 000493 1788623576.859107 trunc from 0x02c686 to 0x033eaa (0x7825 bytes) 000494 1788623576.877569 trunc from 0x033eab to 0x011ab6 (0x223f4 bytes) 000495 1788623576.907823 mapread 0x0015a4 thru 0x00fef3 (0xe950 bytes) 000496 1788623576.911309 trunc from 0x011ab7 to 0x02d4c7 (0x1ba11 bytes) 000500 1788623576.940629 mapread 0x02c7f3 thru 0x02d4c7 (0xcd5 bytes) 000501 1788623576.964112 MIRROR_RESYNC 2 mirrors 000503 1788623578.295799 write 0x00cc87 thru 0x00e000 (0x137a bytes) 000504 1788623578.410577 trunc from 0x02d4c8 to 0x00609f (0x27428 bytes) 000505 1788623578.432278 mapread 0x003bc5 thru 0x00609f (0x24db bytes) 000506 1788623578.468645 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x60a0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x60a0): Mirror 2: 0x820cd1da (stale) CRC-32 checksum value for chunk [0, 0x60a0): Mirror 1: 0x820cd1da Mirror 3: 0x820cd1da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x60a0: skipped 000507 1788623579.767116 read 0x0052a3 thru 0x00609f (0xdfd bytes) 000508 1788623579.796507 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) 000509 1788623580.203124 write 0x039a83 thru 0x03ffff (0x657d bytes) 000510 1788623580.401702 write 0x03fdc1 thru 0x03ffff (0x23f bytes) 000511 1788623580.405009 trunc from 0x040000 to 0x013b8f (0x2c470 bytes) 000513 1788623580.438885 punch from 0x013756 to 0x013b8f (0x43a bytes) 000514 1788623580.450448 trunc from 0x013b90 to 0x012505 (0x168a bytes) 000517 1788623580.485955 punch from 0x00ac66 to 0x012505 (0x78a0 bytes) 000518 1788623580.494568 read 0x00f4b9 thru 0x00f593 (0xdb bytes) 000519 1788623580.501945 write 0x039f67 thru 0x03d15a (0x31f4 bytes) 000520 1788623580.509659 mapread 0x00742d thru 0x00d879 (0x644d bytes) 000521 1788623580.545700 write 0x03d0b7 thru 0x03e6f7 (0x1641 bytes) 000522 1788623580.550804 write 0x012b74 thru 0x01adb4 (0x8241 bytes) 000525 1788623580.586725 mapwrite 0x02cf58 thru 0x035d72 (0x8e1b bytes) 000527 1788623580.726290 write 0x03e959 thru 0x03ffff (0x16a7 bytes) 000529 1788623580.730227 write 0x0033db thru 0x00f7f9 (0xc41f bytes) 000530 1788623580.736888 mapwrite 0x005e20 thru 0x0140be (0xe29f bytes) 000532 1788623580.882535 mapread 0x0372e6 thru 0x03edd8 (0x7af3 bytes) 000536 1788623580.889708 punch from 0x007d69 to 0x015c97 (0xdf2f bytes) 000537 1788623580.898557 read 0x009fa1 thru 0x0143aa (0xa40a bytes) 000538 1788623580.917570 write 0x03f2cd thru 0x03ffff (0xd33 bytes) 000539 1788623580.925293 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa86053a3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc9c8bfdc Mirror 4: 0xc9c8bfdc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000540 1788623582.477393 mapwrite 0x03350f thru 0x03ee79 (0xb96b bytes) 000543 1788623582.869490 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa86053a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa86053a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000545 1788623583.193320 trunc from 0x040000 to 0x0057e6 (0x3a819 bytes) 000547 1788623583.210738 write 0x024153 thru 0x02c3f2 (0x82a0 bytes) 000548 1788623583.212093 punch from 0x0297c3 to 0x02c3f2 (0x2c30 bytes) 000549 1788623583.230294 punch from 0x023636 to 0x02c3f2 (0x8dbd bytes) 000552 1788623583.241117 read 0x0220c8 thru 0x02aaf7 (0x8a30 bytes) 000555 1788623583.250437 read 0x01c677 thru 0x01eafd (0x2487 bytes) 000556 1788623583.260375 punch from 0x00d6fc to 0x018c54 (0xb559 bytes) 000559 1788623583.266486 punch from 0x008f54 to 0x0188ce (0xf97b bytes) 000563 1788623583.271832 mapread 0x008010 thru 0x017b5a (0xfb4b bytes) 000565 1788623583.347356 punch from 0x0215ae to 0x0228bb (0x130e bytes) 000566 1788623583.364468 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c3f3): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c3f3): Mirror 3: 0x98893913 (stale) CRC-32 checksum value for chunk [0, 0x2c3f3): Mirror 1: 0xed0b7c48 Mirror 4: 0xed0b7c48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c3f3: skipped 000567 1788623584.642964 mapwrite 0x01f470 thru 0x022e1c (0x39ad bytes) 000568 1788623584.850487 mapwrite 0x02a598 thru 0x02cf89 (0x29f2 bytes) 000569 1788623584.953111 mapread 0x00c747 thru 0x01172e (0x4fe8 bytes) 000571 1788623584.973093 write 0x02349c thru 0x02b303 (0x7e68 bytes) 000572 1788623584.976719 mapwrite 0x02fa6c thru 0x03b2cf (0xb864 bytes) 000573 1788623585.092021 read 0x02e756 thru 0x0349ef (0x629a bytes) 000575 1788623585.093480 punch from 0x0100b9 to 0x01544c (0x5394 bytes) 000582 1788623585.119040 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b2d0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2d0): Mirror 3: 0x40aa6651 (stale) Mirror 4: 0x1914b25d (stale) CRC-32 checksum value for chunk [0, 0x3b2d0): Mirror 1: 0x400a6e49 Mirror 5: 0x400a6e49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2d0: skipped 000583 1788623586.376983 mapwrite 0x0231b7 thru 0x025532 (0x237c bytes) 000585 1788623586.694026 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3b2d0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2d0): Mirror 3: 0x40aa6651 (stale) Mirror 4: 0x1914b25d (stale) Mirror 5: 0x400a6e49 (stale) CRC-32 checksum value for chunk [0, 0x3b2d0): Mirror 1: 0xd3fb77c8 Mirror 6: 0xd3fb77c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2d0: skipped 000587 1788623588.455423 write 0x020bdb thru 0x02c3f2 (0xb818 bytes) 000588 1788623588.551095 punch from 0x022d21 to 0x023567 (0x847 bytes) 000589 1788623588.570007 mapwrite 0x034eb9 thru 0x03cb92 (0x7cda bytes) 000591 1788623588.730303 read 0x003950 thru 0x007110 (0x37c1 bytes) 000592 1788623588.759409 MIRROR_RESYNC 5 mirrors 000593 1788623592.138903 mapread 0x02e658 thru 0x02ec4b (0x5f4 bytes) 000594 1788623592.153934 mapwrite 0x02e39c thru 0x03435a (0x5fbf bytes) 000596 1788623592.483123 mapread 0x02cc09 thru 0x03aaa7 (0xde9f bytes) 000597 1788623592.496353 mapwrite 0x03e7ef thru 0x03ffff (0x1811 bytes) 000599 1788623592.617078 write 0x02419c thru 0x024871 (0x6d6 bytes) 000600 1788623592.627548 write 0x01f6ba thru 0x02535d (0x5ca4 bytes) 000601 1788623592.647493 punch from 0x02c604 to 0x03b951 (0xf34e bytes) 000602 1788623592.667844 punch from 0x007a87 to 0x00b471 (0x39eb bytes) 000603 1788623592.675659 read 0x03465f thru 0x03a944 (0x62e6 bytes) 000604 1788623592.690283 trunc from 0x040000 to 0x03850d (0x7af2 bytes) 000605 1788623592.737248 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3850e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3850e): Mirror 3: 0x85350c70 (stale) Mirror 4: 0x85350c70 (stale) Mirror 5: 0x85350c70 (stale) Mirror 6: 0x85350c70 (stale) CRC-32 checksum value for chunk [0, 0x3850e): Mirror 1: 0xdc09bff0 Mirror 7: 0xdc09bff0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3850e: skipped 000607 1788623594.456601 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3850e): Mirror 4: 0x85350c70 (stale) Mirror 5: 0x85350c70 (stale) Mirror 6: 0x85350c70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3850e): Mirror 4: 0x85350c70 (stale) Mirror 5: 0x85350c70 (stale) Mirror 6: 0x85350c70 (stale) CRC-32 checksum value for chunk [0, 0x3850e): Mirror 1: 0xdc09bff0 Mirror 7: 0xdc09bff0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3850e: skipped 000609 1788623595.246372 mapwrite 0x01f14a thru 0x024621 (0x54d8 bytes) 000610 1788623595.494897 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3850e): Mirror 5: 0x85350c70 (stale) Mirror 6: 0x85350c70 (stale) Mirror 7: 0xdc09bff0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3850e): Mirror 5: 0x85350c70 (stale) Mirror 6: 0x85350c70 (stale) Mirror 7: 0xdc09bff0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3850e: skipped 000612 1788623595.928719 write 0x0067cb thru 0x012abd (0xc2f3 bytes) 000613 1788623595.942860 read 0x025944 thru 0x0300a9 (0xa766 bytes) 000615 1788623595.957027 mapwrite 0x036ab7 thru 0x039a10 (0x2f5a bytes) 000619 1788623596.069285 mapwrite 0x02bb6f thru 0x039f3f (0xe3d1 bytes) 000621 1788623596.181915 write 0x036bd8 thru 0x03f14f (0x8578 bytes) 000622 1788623596.193894 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f150): Mirror 6: 0x5133bd9a (stale) Mirror 7: 0x8f90ca73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f150): Mirror 6: 0x5133bd9a (stale) Mirror 7: 0x8f90ca73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f150: skipped 000623 1788623596.636702 trunc from 0x03f150 to 0x025721 (0x19a2e bytes) 000624 1788623596.654010 mapwrite 0x020909 thru 0x02408a (0x3782 bytes) 000625 1788623596.774518 punch from 0x01318e to 0x015287 (0x20fa bytes) 000626 1788623596.783454 trunc from 0x025722 to 0x00e994 (0x16d8d bytes) 000627 1788623596.804311 read 0x00335c thru 0x00d4a9 (0xa14e bytes) 000631 1788623596.818920 punch from 0x007266 to 0x009acc (0x2867 bytes) 000632 1788623596.824765 punch from 0x007e3d to 0x00e994 (0x6b58 bytes) 000633 1788623596.835422 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xe995): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe995): Mirror 6: 0x12a4232f (stale) Mirror 7: 0x12a4232f (stale) CRC-32 checksum value for chunk [0, 0xe995): Mirror 1: 0x6f72c682 Mirror 8: 0x6f72c682 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe995: skipped 000634 1788623598.251615 trunc from 0x00e995 to 0x03aaf4 (0x2c160 bytes) 000635 1788623598.354576 trunc from 0x03aaf5 to 0x02dbd4 (0xcf20 bytes) 000636 1788623598.382970 mapwrite 0x02116b thru 0x028fbe (0x7e54 bytes) 000637 1788623598.475465 write 0x01905b thru 0x027741 (0xe6e7 bytes) 000638 1788623598.483023 write 0x00346a thru 0x0089c3 (0x555a bytes) 000639 1788623598.494830 read 0x01f755 thru 0x02dbd4 (0xe480 bytes) 000640 1788623598.506631 punch from 0x012e9a to 0x02036d (0xd4d4 bytes) 000641 1788623598.526958 trunc from 0x02dbd5 to 0x02f42b (0x1857 bytes) 000643 1788623598.566246 read 0x02cb19 thru 0x02f42b (0x2913 bytes) 000644 1788623598.589092 trunc from 0x02f42c to 0x011f7e (0x1d4ad bytes) 000646 1788623598.625230 MIRROR_RESYNC 4 mirrors 000647 1788623599.930766 mapread 0x000f79 thru 0x00ea25 (0xdaad bytes) 000648 1788623599.956915 mapread 0x00bb99 thru 0x00c3e2 (0x84a bytes) 000649 1788623599.957765 trunc from 0x011f7f to 0x006286 (0xbcf8 bytes) 000651 1788623600.061507 trunc from 0x006287 to 0x012afa (0xc874 bytes) 000652 1788623600.092990 read 0x0084a7 thru 0x008673 (0x1cd bytes) 000654 1788623600.101315 punch from 0x0022a8 to 0x004d76 (0x2acf bytes) 000655 1788623600.109549 mapread 0x0116f9 thru 0x012afa (0x1402 bytes) 000656 1788623600.121833 read 0x0069e5 thru 0x012afa (0xc116 bytes) 000659 1788623600.133614 read 0x00a5f8 thru 0x012afa (0x8503 bytes) truncating to largest ever: 0x3fe2e 000660 1788623600.134699 trunc from 0x012afb to 0x03fe2d (0x2d333 bytes) 000661 1788623600.156084 trunc from 0x03fe2e to 0x0032b3 (0x3cb7a bytes) 000662 1788623600.184065 write 0x0309be thru 0x0322e4 (0x1927 bytes) 000668 1788623600.188896 trunc from 0x0322e5 to 0x00bfe9 (0x262fb bytes) 000669 1788623600.220998 trunc from 0x00bfea to 0x03be6f (0x2fe86 bytes) 000671 1788623600.248950 read 0x009598 thru 0x010a07 (0x7470 bytes) 000672 1788623600.270435 mapwrite 0x03aafb thru 0x03ffff (0x5505 bytes) 000674 1788623600.369107 mapread 0x00c3fd thru 0x015747 (0x934b bytes) 000675 1788623600.370139 trunc from 0x040000 to 0x0331ab (0xce54 bytes) 000676 1788623600.392039 trunc from 0x0331ac to 0x01863c (0x1ab6f bytes) 000677 1788623600.416079 read 0x017191 thru 0x01863c (0x14ac bytes) 000679 1788623600.422781 MIRROR_RESYNC 4 mirrors 000682 1788623601.846682 MIRROR_EXTEND to 5 mirrors 000683 1788623602.658978 mapwrite 0x03ab5d thru 0x03ffff (0x54a3 bytes) 000685 1788623602.832754 mapread 0x02869e thru 0x02b959 (0x32bc bytes) 000686 1788623602.847305 read 0x021fa2 thru 0x02858f (0x65ee bytes) 000687 1788623602.848916 write 0x024c2b thru 0x0283f6 (0x37cc bytes) 000689 1788623602.851421 mapwrite 0x03b20d thru 0x03ffff (0x4df3 bytes) 000690 1788623602.918933 trunc from 0x040000 to 0x03b500 (0x4aff bytes) 000693 1788623602.954986 punch from 0x024419 to 0x030e7a (0xca62 bytes) 000694 1788623602.964128 mapread 0x02e461 thru 0x03047d (0x201d bytes) 000695 1788623602.978973 read 0x00f9ac thru 0x015de6 (0x643b bytes) 000699 1788623602.995270 read 0x009b76 thru 0x00faae (0x5f39 bytes) 000701 1788623602.997796 mapread 0x01d9a8 thru 0x028b4e (0xb1a7 bytes) 000702 1788623603.000139 mapread 0x01cda6 thru 0x020c71 (0x3ecc bytes) 000704 1788623603.002895 punch from 0x022772 to 0x02d301 (0xab90 bytes) 000707 1788623603.013137 write 0x03f6f5 thru 0x03ffff (0x90b bytes) 000708 1788623603.015160 trunc from 0x040000 to 0x03ab71 (0x548e bytes) 000710 1788623603.045125 read 0x00e024 thru 0x013ee1 (0x5ebe bytes) 000711 1788623603.046034 write 0x03c66a thru 0x03ffff (0x3996 bytes) 000712 1788623603.049114 mapread 0x0186b4 thru 0x0214ad (0x8dfa bytes) 000713 1788623603.052002 punch from 0x0166f6 to 0x01f18f (0x8a9a bytes) 000714 1788623603.065951 mapread 0x001ac4 thru 0x00cb2f (0xb06c bytes) 000715 1788623603.069101 write 0x000078 thru 0x00c1c1 (0xc14a bytes) 000717 1788623603.073822 punch from 0x01825e to 0x028019 (0xfdbc bytes) 000718 1788623603.091104 write 0x03adf8 thru 0x03ffff (0x5208 bytes) 000719 1788623603.093399 read 0x01ecbb thru 0x02d9c2 (0xed08 bytes) 000720 1788623603.107275 trunc from 0x040000 to 0x024176 (0x1be89 bytes) 000721 1788623603.141416 mapread 0x01e2cb thru 0x024176 (0x5eac bytes) 000722 1788623603.144829 read 0x00d3c6 thru 0x0124ba (0x50f5 bytes) 000724 1788623603.157094 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x24177): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24177): Mirror 6: 0x4bfb4509 (stale) Mirror 7: 0x4bfb4509 (stale) Mirror 8: 0x4bfb4509 (stale) Mirror 9: 0x4bfb4509 (stale) CRC-32 checksum value for chunk [0, 0x24177): Mirror 1: 0x6dbb5e33 Mirror 10: 0x6dbb5e33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24177: skipped 000725 1788623604.298686 punch from 0x020075 to 0x024176 (0x4102 bytes) 000727 1788623604.431665 mapwrite 0x00ff44 thru 0x014147 (0x4204 bytes) 000729 1788623604.515862 mapwrite 0x016174 thru 0x01cd66 (0x6bf3 bytes) 000730 1788623604.579762 read 0x014a3f thru 0x02138a (0xc94c bytes) 000731 1788623604.581516 trunc from 0x024177 to 0x03f597 (0x1b421 bytes) 000734 1788623604.639844 trunc from 0x03f598 to 0x0118c5 (0x2dcd2 bytes) 000735 1788623604.656560 read 0x00f0f4 thru 0x0118c5 (0x27d2 bytes) 000736 1788623604.657133 trunc from 0x0118c6 to 0x0000ec (0x117d9 bytes) 000737 1788623604.695888 write 0x02ebbe thru 0x032751 (0x3b94 bytes) 000738 1788623604.700684 mapread 0x026be4 thru 0x031704 (0xab21 bytes) 000740 1788623604.721055 read 0x000715 thru 0x0046d0 (0x3fbc bytes) 000741 1788623604.721944 read 0x020827 thru 0x022b82 (0x235c bytes) 000742 1788623604.729383 read 0x019eca thru 0x019f33 (0x6a bytes) 000743 1788623604.731978 write 0x0322f9 thru 0x03eafd (0xc805 bytes) 000745 1788623604.736720 mapread 0x01e5ce thru 0x0223d3 (0x3e06 bytes) 000746 1788623604.738960 write 0x029baa thru 0x02c757 (0x2bae bytes) 000747 1788623604.753861 write 0x029056 thru 0x03592d (0xc8d8 bytes) 000748 1788623604.763089 mapread 0x017a57 thru 0x020a0a (0x8fb4 bytes) 000749 1788623604.766840 trunc from 0x03eafe to 0x00d336 (0x317c7 bytes) 000752 1788623604.799862 read 0x0036ff thru 0x00395c (0x25e bytes) 000753 1788623604.800511 write 0x009bcc thru 0x010e44 (0x7279 bytes) 000754 1788623604.801716 read 0x00bdaf thru 0x00d319 (0x156b bytes) 000755 1788623604.815834 trunc from 0x010e45 to 0x02036a (0xf526 bytes) 000758 1788623604.849258 trunc from 0x02036b to 0x0046a2 (0x1bcc8 bytes) 000759 1788623604.904722 punch from 0x0011d8 to 0x0046a2 (0x34cb bytes) 000760 1788623604.919331 mapread 0x003238 thru 0x0046a2 (0x146b bytes) 000762 1788623604.937469 punch from 0x000444 to 0x0009dc (0x599 bytes) 000763 1788623604.946691 punch from 0x000504 to 0x0046a2 (0x419f bytes) 000765 1788623604.951969 punch from 0x0012c7 to 0x0046a2 (0x33dc bytes) 000766 1788623604.961590 mapwrite 0x031746 thru 0x034932 (0x31ed bytes) 000767 1788623605.183760 trunc from 0x034933 to 0x002b06 (0x31e2c bytes) 000769 1788623605.221017 MIRROR_RESYNC 6 mirrors 000771 1788623606.827835 mapread 0x001080 thru 0x002b06 (0x1a87 bytes) 000772 1788623606.840332 mapread 0x0011b5 thru 0x002b06 (0x1952 bytes) 000773 1788623606.840946 mapwrite 0x005f63 thru 0x00a3b0 (0x444e bytes) 000775 1788623606.992964 mapwrite 0x02bb5d thru 0x030214 (0x46b8 bytes) 000777 1788623607.073880 read 0x02ac93 thru 0x030214 (0x5582 bytes) 000778 1788623607.075682 trunc from 0x030215 to 0x00c1f1 (0x24023 bytes) 000779 1788623607.099990 punch from 0x000375 to 0x008057 (0x7ce3 bytes) 000780 1788623607.104726 read 0x0012b0 thru 0x0057ca (0x451b bytes) 000781 1788623607.113461 write 0x00a20c thru 0x016152 (0xbf47 bytes) 000782 1788623607.114852 mapwrite 0x0193a0 thru 0x027233 (0xde94 bytes) 000783 1788623607.218482 write 0x033bfb thru 0x034bfa (0x1000 bytes) 000784 1788623607.220454 trunc from 0x034bfb to 0x0090d9 (0x2bb21 bytes) 000785 1788623607.247030 write 0x00ecc0 thru 0x0127e1 (0x3b22 bytes) 000786 1788623607.255455 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x127e2): Mirror 6: 0xd0945497 (stale) Mirror 7: 0xd0945497 (stale) Mirror 9: 0xd0945497 (stale) Mirror 10: 0xd0945497 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x127e2): Mirror 6: 0xd0945497 (stale) Mirror 7: 0xd0945497 (stale) Mirror 9: 0xd0945497 (stale) Mirror 10: 0xd0945497 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x127e2: skipped 000787 1788623607.613806 mapread 0x0096ce thru 0x0127e1 (0x9114 bytes) 000788 1788623607.642747 trunc from 0x0127e2 to 0x00d925 (0x4ebc bytes) 000789 1788623607.659793 mapread 0x002b16 thru 0x007899 (0x4d84 bytes) 000790 1788623607.671234 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd926): Mirror 6: 0xc2a8d71b (stale) Mirror 7: 0xc2a8d71b (stale) Mirror 9: 0xc2a8d71b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd926): Mirror 6: 0xc2a8d71b (stale) Mirror 7: 0xc2a8d71b (stale) Mirror 9: 0xc2a8d71b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd926: skipped 000791 1788623608.236687 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd926): Mirror 6: 0xc2a8d71b (stale) Mirror 7: 0xc2a8d71b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd926): Mirror 6: 0xc2a8d71b (stale) Mirror 7: 0xc2a8d71b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd926: skipped 000792 1788623608.592888 mapread 0x00b882 thru 0x00d925 (0x20a4 bytes) 000795 1788623608.609930 punch from 0x006016 to 0x00c6cf (0x66ba bytes) 000796 1788623608.615890 mapread 0x00b28c thru 0x00d925 (0x269a bytes) 000797 1788623608.628678 MIRROR_RESYNC 3 mirrors 000798 1788623609.804118 write 0x02cbb7 thru 0x031a89 (0x4ed3 bytes) 000799 1788623609.901761 write 0x02b773 thru 0x0308fd (0x518b bytes) 000800 1788623609.909696 mapread 0x015816 thru 0x01b4fb (0x5ce6 bytes) 000801 1788623609.944656 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31a8a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a8a): Mirror 6: 0x55dc929 (stale) Mirror 7: 0x55dc929 (stale) CRC-32 checksum value for chunk [0, 0x31a8a): Mirror 1: 0xc88e685e Mirror 8: 0xc88e685e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a8a: skipped 000803 1788623611.172056 mapwrite 0x03b0cf thru 0x03ffff (0x4f31 bytes) 000804 1788623611.399930 punch from 0x01b876 to 0x02a5ad (0xed38 bytes) 000805 1788623611.417755 trunc from 0x040000 to 0x02f37d (0x10c82 bytes) 000806 1788623611.442882 mapwrite 0x03702e thru 0x03cecd (0x5ea0 bytes) 000807 1788623611.532922 punch from 0x004f6a to 0x0133d5 (0xe46c bytes) 000809 1788623611.542919 mapwrite 0x02b63a thru 0x03aa7b (0xf442 bytes) 000810 1788623611.612716 read 0x00d4c6 thru 0x0187cd (0xb308 bytes) 000811 1788623611.623350 punch from 0x000604 to 0x0050a3 (0x4aa0 bytes) 000814 1788623611.630687 mapread 0x02f5fb thru 0x03cd5f (0xd765 bytes) 000815 1788623611.631777 trunc from 0x03cece to 0x007de2 (0x350eb bytes) 000816 1788623611.651255 mapwrite 0x025422 thru 0x0320f5 (0xccd4 bytes) 000817 1788623611.747069 mapread 0x01bb16 thru 0x01dab9 (0x1fa4 bytes) 000819 1788623611.759873 punch from 0x00cb2d to 0x011e0e (0x52e2 bytes) 000821 1788623611.767044 trunc from 0x0320f6 to 0x00212f (0x2ffc6 bytes) 000823 1788623611.788819 mapread 0x000b04 thru 0x00212f (0x162c bytes) 000825 1788623611.796959 mapwrite 0x032014 thru 0x0337ba (0x17a7 bytes) 000826 1788623611.887670 punch from 0x000856 to 0x002b3e (0x22e9 bytes) 000827 1788623611.898105 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x337bb): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337bb): Mirror 6: 0x1155d4cc (stale) Mirror 7: 0x1155d4cc (stale) Mirror 8: 0xff225c15 (stale) CRC-32 checksum value for chunk [0, 0x337bb): Mirror 1: 0x51c884e8 Mirror 9: 0x51c884e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337bb: skipped 000828 1788623612.868566 trunc from 0x0337bb to 0x025d2c (0xda8e bytes) 000829 1788623612.976408 mapwrite 0x011918 thru 0x015786 (0x3e6f bytes) 000830 1788623613.078631 MIRROR_RESYNC 5 mirrors 000831 1788623615.615912 mapwrite 0x032058 thru 0x03f2fc (0xd2a5 bytes) 000832 1788623615.950705 mapwrite 0x03b7c4 thru 0x03ffff (0x483c bytes) 000834 1788623616.086911 write 0x018b75 thru 0x026c07 (0xe093 bytes) 000835 1788623616.103954 mapread 0x01b2e5 thru 0x0240a6 (0x8dc2 bytes) 000836 1788623616.105499 punch from 0x01713d to 0x01a592 (0x3456 bytes) 000837 1788623616.122140 read 0x03f983 thru 0x03ffff (0x67d bytes) 000839 1788623616.129400 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xcaa42542 (stale) Mirror 7: 0xcaa42542 (stale) Mirror 8: 0xcaa42542 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xcaa42542 (stale) Mirror 7: 0xcaa42542 (stale) Mirror 8: 0xcaa42542 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000840 1788623616.677736 read 0x025e76 thru 0x029380 (0x350b bytes) 000841 1788623616.687123 read 0x00b8c8 thru 0x019e0d (0xe546 bytes) 000842 1788623616.701902 read 0x032d32 thru 0x03766e (0x493d bytes) 000844 1788623616.702957 write 0x01d4fa thru 0x0258a8 (0x83af bytes) 000846 1788623616.705562 trunc from 0x040000 to 0x03c741 (0x38be bytes) 000847 1788623616.721904 write 0x01aba0 thru 0x028b4f (0xdfb0 bytes) 000848 1788623616.724896 punch from 0x00df8a to 0x0158e6 (0x795d bytes) 000851 1788623616.742453 punch from 0x010d73 to 0x016ecd (0x615b bytes) 000852 1788623616.747091 mapwrite 0x0285bd thru 0x037c7c (0xf6c0 bytes) 000853 1788623616.813467 mapread 0x01e8e5 thru 0x023e67 (0x5583 bytes) 000857 1788623616.817613 punch from 0x0180ff to 0x026005 (0xdf07 bytes) 000858 1788623616.826853 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c742): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c742): Mirror 6: 0x8cd9aa30 (stale) Mirror 7: 0x8cd9aa30 (stale) Mirror 8: 0x8cd9aa30 (stale) CRC-32 checksum value for chunk [0, 0x3c742): Mirror 1: 0xbbfed844 Mirror 9: 0xbbfed844 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c742: skipped 000859 1788623618.089295 mapread 0x020003 thru 0x021c32 (0x1c30 bytes) 000860 1788623618.096713 punch from 0x02d8b0 to 0x033ed3 (0x6624 bytes) 000861 1788623618.227797 mapwrite 0x021d18 thru 0x0283ad (0x6696 bytes) 000863 1788623618.282144 read 0x005bf7 thru 0x007eb4 (0x22be bytes) 000865 1788623618.293836 punch from 0x00f2b1 to 0x018ae6 (0x9836 bytes) 000867 1788623618.300766 mapread 0x028908 thru 0x037efe (0xf5f7 bytes) 000868 1788623618.331604 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c742): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c742): Mirror 6: 0x8cd9aa30 (stale) Mirror 7: 0x8cd9aa30 (stale) Mirror 8: 0x8cd9aa30 (stale) Mirror 9: 0xbbfed844 (stale) CRC-32 checksum value for chunk [0, 0x3c742): Mirror 1: 0x33e11adb Mirror 10: 0x33e11adb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c742: skipped 000869 1788623619.732270 punch from 0x005362 to 0x005473 (0x112 bytes) 000871 1788623619.817599 mapwrite 0x03336e thru 0x037b63 (0x47f6 bytes) 000877 1788623619.897909 mapread 0x00050d thru 0x00c062 (0xbb56 bytes) 000878 1788623619.913789 mapwrite 0x014652 thru 0x0198d5 (0x5284 bytes) 000879 1788623619.966043 read 0x02393f thru 0x02c6d7 (0x8d99 bytes) 000880 1788623619.975956 read 0x025953 thru 0x028ee9 (0x3597 bytes) 000882 1788623619.977675 read 0x014298 thru 0x01752d (0x3296 bytes) 000883 1788623619.979049 mapread 0x01fb28 thru 0x028460 (0x8939 bytes) 000884 1788623619.988237 write 0x03b132 thru 0x03ffff (0x4ece bytes) 000886 1788623619.989884 mapread 0x03057a thru 0x039838 (0x92bf bytes) 000887 1788623619.991705 trunc from 0x040000 to 0x012928 (0x2d6d7 bytes) 000888 1788623620.015353 read 0x0120ba thru 0x012928 (0x86f bytes) 000891 1788623620.016898 write 0x008f03 thru 0x00d55f (0x465d bytes) 000892 1788623620.021664 MIRROR_RESYNC 6 mirrors 000893 1788623623.092559 mapwrite 0x02a728 thru 0x03776b (0xd044 bytes) 000894 1788623623.364782 write 0x01092e thru 0x01a8a7 (0x9f7a bytes) 000895 1788623623.379041 read 0x00fc2d thru 0x0107a0 (0xb74 bytes) 000896 1788623623.388462 read 0x036573 thru 0x03776b (0x11f9 bytes) 000897 1788623623.389572 trunc from 0x03776c to 0x03ab43 (0x33d8 bytes) 000898 1788623623.449592 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 6: 0xbf7fdfeb (stale) Mirror 7: 0xbf7fdfeb (stale) Mirror 8: 0xbf7fdfeb (stale) Mirror 9: 0xbf7fdfeb (stale) Mirror 10: 0xbf7fdfeb (stale) CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 1: 0x14f7ea02 Mirror 11: 0x14f7ea02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab44: skipped 000901 1788623625.476881 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 6: 0xbf7fdfeb (stale) Mirror 7: 0xbf7fdfeb (stale) Mirror 8: 0xbf7fdfeb (stale) Mirror 9: 0xbf7fdfeb (stale) Mirror 10: 0xbf7fdfeb (stale) CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 1: 0x14f7ea02 Mirror 11: 0x14f7ea02 Mirror 12: 0x14f7ea02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab44: skipped 000902 1788623627.812917 punch from 0x02e4e1 to 0x037523 (0x9043 bytes) 000903 1788623627.985934 mapwrite 0x0211bc thru 0x02b37c (0xa1c1 bytes) 000904 1788623628.188161 read 0x009f9a thru 0x01248e (0x84f5 bytes) 000905 1788623628.214015 mapwrite 0x037e8d thru 0x038401 (0x575 bytes) 000909 1788623628.330535 read 0x01f3bf thru 0x0218c0 (0x2502 bytes) 000910 1788623628.331871 mapread 0x031405 thru 0x0381bb (0x6db7 bytes) 000911 1788623628.334443 punch from 0x023bfd to 0x027c35 (0x4039 bytes) 000912 1788623628.343874 punch from 0x010613 to 0x01e5ea (0xdfd8 bytes) 000914 1788623628.355336 mapwrite 0x012ad7 thru 0x01b982 (0x8eac bytes) 000915 1788623628.437884 mapread 0x038b9f thru 0x03ab43 (0x1fa5 bytes) 000917 1788623628.444699 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 6: 0xbf7fdfeb (stale) Mirror 7: 0xbf7fdfeb (stale) Mirror 8: 0xbf7fdfeb (stale) Mirror 9: 0xbf7fdfeb (stale) Mirror 10: 0xbf7fdfeb (stale) Mirror 11: 0x14f7ea02 (stale) Mirror 12: 0x14f7ea02 (stale) CRC-32 checksum value for chunk [0, 0x3ab44): Mirror 1: 0x50c73968 Mirror 13: 0x50c73968 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab44: skipped 000918 1788623630.799865 punch from 0x01c426 to 0x0289e7 (0xc5c2 bytes) 000922 1788623630.913713 mapread 0x03237d thru 0x038756 (0x63da bytes) 000923 1788623630.937079 trunc from 0x03ab44 to 0x01074e (0x2a3f5 bytes) 000924 1788623630.967828 write 0x024307 thru 0x030da8 (0xcaa2 bytes) 000925 1788623630.971508 punch from 0x00dac6 to 0x018234 (0xa76f bytes) 000926 1788623630.996223 mapread 0x02cce4 thru 0x030da8 (0x40c5 bytes) 000927 1788623631.003830 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30da9): Mirror 6: 0xcdf22c03 (stale) Mirror 8: 0xcdf22c03 (stale) Mirror 9: 0xcdf22c03 (stale) Mirror 10: 0xcdf22c03 (stale) Mirror 11: 0x115362d2 (stale) Mirror 12: 0x115362d2 (stale) Mirror 13: 0x798fc094 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30da9): Mirror 6: 0xcdf22c03 (stale) Mirror 8: 0xcdf22c03 (stale) Mirror 9: 0xcdf22c03 (stale) Mirror 10: 0xcdf22c03 (stale) Mirror 11: 0x115362d2 (stale) Mirror 12: 0x115362d2 (stale) Mirror 13: 0x798fc094 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30da9: skipped 000928 1788623631.890442 read 0x013664 thru 0x01ecec (0xb689 bytes) 000929 1788623631.911571 write 0x019f94 thru 0x024633 (0xa6a0 bytes) 000933 1788623631.932691 read 0x01e574 thru 0x025aa3 (0x7530 bytes) 000936 1788623631.961062 write 0x009c3e thru 0x0110f4 (0x74b7 bytes) 000937 1788623631.963013 punch from 0x017c04 to 0x019259 (0x1656 bytes) 000938 1788623631.984588 punch from 0x0030da to 0x010348 (0xd26f bytes) 000940 1788623632.001335 mapwrite 0x028f00 thru 0x02978c (0x88d bytes) 000941 1788623632.095486 read 0x026ea0 thru 0x02db27 (0x6c88 bytes) 000943 1788623632.098373 mapread 0x030aff thru 0x030da8 (0x2aa bytes) 000944 1788623632.102698 write 0x0091d4 thru 0x016505 (0xd332 bytes) 000945 1788623632.131354 read 0x011b96 thru 0x01440e (0x2879 bytes) 000946 1788623632.133018 read 0x006fec thru 0x00b1cd (0x41e2 bytes) 000947 1788623632.134223 punch from 0x014668 to 0x014f0d (0x8a6 bytes) 000948 1788623632.159771 trunc from 0x030da9 to 0x01f0aa (0x11cfe bytes) 000949 1788623632.185658 mapwrite 0x033a37 thru 0x03ffff (0xc5c9 bytes) 000950 1788623632.335778 read 0x02e605 thru 0x031591 (0x2f8d bytes) 000951 1788623632.338494 read 0x03f5c3 thru 0x03fe75 (0x8b3 bytes) 000952 1788623632.340403 punch from 0x006148 to 0x008789 (0x2642 bytes) 000953 1788623632.353799 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x89a10018 (stale) Mirror 9: 0x89a10018 (stale) Mirror 10: 0x89a10018 (stale) Mirror 11: 0xd6958456 (stale) Mirror 12: 0xd6958456 (stale) Mirror 13: 0x5816d571 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x89a10018 (stale) Mirror 9: 0x89a10018 (stale) Mirror 10: 0x89a10018 (stale) Mirror 11: 0xd6958456 (stale) Mirror 12: 0xd6958456 (stale) Mirror 13: 0x5816d571 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000954 1788623633.337508 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x89a10018 (stale) Mirror 9: 0x89a10018 (stale) Mirror 10: 0x89a10018 (stale) Mirror 11: 0xd6958456 (stale) Mirror 12: 0xd6958456 (stale) Mirror 13: 0x5816d571 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcb800435 Mirror 14: 0xcb800435 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000955 1788623635.336736 write 0x010588 thru 0x011d67 (0x17e0 bytes) 000956 1788623635.454953 trunc from 0x040000 to 0x013118 (0x2cee7 bytes) 000957 1788623635.489041 MIRROR_RESYNC 8 mirrors 000959 1788623638.058984 trunc from 0x013119 to 0x036880 (0x23768 bytes) 000960 1788623638.204259 trunc from 0x036881 to 0x02bfe9 (0xa897 bytes) 000961 1788623638.230385 punch from 0x003f3e to 0x0068e2 (0x29a5 bytes) 000962 1788623638.241613 mapwrite 0x02f5a0 thru 0x033f69 (0x49ca bytes) 000964 1788623638.377868 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x33f6a): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f6a): Mirror 8: 0xee02190e (stale) Mirror 9: 0xee02190e (stale) Mirror 10: 0xee02190e (stale) Mirror 11: 0xee02190e (stale) Mirror 12: 0xee02190e (stale) Mirror 13: 0xee02190e (stale) Mirror 14: 0xee02190e (stale) CRC-32 checksum value for chunk [0, 0x33f6a): Mirror 1: 0xd4b942e9 Mirror 15: 0xd4b942e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f6a: skipped 000965 1788623640.008581 mapread 0x01f61d thru 0x02697e (0x7362 bytes) 000967 1788623640.083138 mapread 0x01fc47 thru 0x0269af (0x6d69 bytes) 000968 1788623640.131576 mapwrite 0x03b91b thru 0x03ffff (0x46e5 bytes) 000969 1788623640.435212 write 0x037c33 thru 0x03b212 (0x35e0 bytes) 000970 1788623640.441073 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x58b64bb5 (stale) Mirror 9: 0x58b64bb5 (stale) Mirror 10: 0x58b64bb5 (stale) Mirror 11: 0x58b64bb5 (stale) Mirror 12: 0x58b64bb5 (stale) Mirror 13: 0x58b64bb5 (stale) Mirror 14: 0x58b64bb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x58b64bb5 (stale) Mirror 9: 0x58b64bb5 (stale) Mirror 10: 0x58b64bb5 (stale) Mirror 11: 0x58b64bb5 (stale) Mirror 12: 0x58b64bb5 (stale) Mirror 13: 0x58b64bb5 (stale) Mirror 14: 0x58b64bb5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000971 1788623641.175829 read 0x00dcf0 thru 0x01426a (0x657b bytes) 000973 1788623641.191402 mapwrite 0x01556c thru 0x022b0a (0xd59f bytes) 000974 1788623641.259286 mapwrite 0x0157a2 thru 0x0248bd (0xf11c bytes) 000975 1788623641.320434 read 0x0304d1 thru 0x03f643 (0xf173 bytes) 000976 1788623641.332028 read 0x00f9de thru 0x01918d (0x97b0 bytes) 000977 1788623641.332975 mapwrite 0x02817d thru 0x032336 (0xa1ba bytes) 000979 1788623641.395633 punch from 0x010a0f to 0x0208fd (0xfeef bytes) 000983 1788623641.409682 mapread 0x03d62b thru 0x03ffff (0x29d5 bytes) 000985 1788623641.412023 read 0x0358d6 thru 0x039508 (0x3c33 bytes) 000986 1788623641.413637 punch from 0x01bad1 to 0x01ea66 (0x2f96 bytes) 000987 1788623641.418882 write 0x02b472 thru 0x034dbe (0x994d bytes) 000990 1788623641.422123 mapwrite 0x01198e thru 0x01f2ab (0xd91e bytes) 000991 1788623641.542073 mapwrite 0x01112a thru 0x013655 (0x252c bytes) 000994 1788623641.572370 mapread 0x0348b2 thru 0x03f6c7 (0xae16 bytes) 000996 1788623641.573826 read 0x00fa1d thru 0x01073e (0xd22 bytes) 000997 1788623641.575041 mapwrite 0x03e4cf thru 0x03ffff (0x1b31 bytes) 000999 1788623641.619555 read 0x028f4e thru 0x033d9d (0xae50 bytes) 001000 1788623641.620369 mapread 0x039982 thru 0x03eeee (0x556d bytes) All operations completed A-OK!