== sanity-flr test 70a: flr mode fsx test ================ 22:39:26 (1789439966) Seed set to 9968 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1789439968.296826 mapwrite 0x008ee8 thru 0x0100f6 (0x720f bytes) 000004 1789439968.526778 punch from 0x004473 to 0x007225 (0x2db3 bytes) truncating to largest ever: 0x344dd 000005 1789439968.535504 trunc from 0x0100f7 to 0x0344dc (0x243e6 bytes) 000006 1789439968.555989 mapread 0x00c2b3 thru 0x015943 (0x9691 bytes) 000007 1789439968.572067 mapread 0x024805 thru 0x030c82 (0xc47e bytes) 000008 1789439968.613620 mapwrite 0x0001bb thru 0x00a88f (0xa6d5 bytes) 000010 1789439968.741896 write 0x034875 thru 0x03ffff (0xb78b bytes) 000011 1789439968.748133 trunc from 0x040000 to 0x030b62 (0xf49d bytes) 000012 1789439968.777459 trunc from 0x030b63 to 0x032bd3 (0x2071 bytes) 000014 1789439968.794237 write 0x02ed77 thru 0x031f6b (0x31f5 bytes) 000017 1789439968.803973 punch from 0x02f8fa to 0x032bd3 (0x32da bytes) 000018 1789439968.817569 punch from 0x0319ab to 0x032bd3 (0x1229 bytes) 000020 1789439968.845940 punch from 0x00c139 to 0x00c212 (0xda bytes) 000021 1789439968.851681 mapwrite 0x002ebd thru 0x00a970 (0x7ab4 bytes) 000022 1789439968.937730 punch from 0x0009a5 to 0x0097bb (0x8e17 bytes) 000023 1789439968.946341 mapread 0x00ca46 thru 0x00f2b5 (0x2870 bytes) 000024 1789439968.962828 mapwrite 0x02dd8c thru 0x02f5bd (0x1832 bytes) 000025 1789439969.112962 read 0x0205f8 thru 0x0264d7 (0x5ee0 bytes) 000027 1789439969.114084 write 0x032691 thru 0x0332b7 (0xc27 bytes) 000030 1789439969.127327 read 0x0140be thru 0x0140c6 (0x9 bytes) truncating to largest ever: 0x3463a 000031 1789439969.142614 trunc from 0x0332b8 to 0x034639 (0x1382 bytes) 000033 1789439969.197675 mapread 0x031ae9 thru 0x034639 (0x2b51 bytes) 000035 1789439969.223048 punch from 0x02a74b to 0x02a9a1 (0x257 bytes) 000037 1789439969.249824 punch from 0x01b69a to 0x028c23 (0xd58a bytes) truncating to largest ever: 0x3fde2 000039 1789439969.260973 trunc from 0x03463a to 0x03fde1 (0xb7a8 bytes) 000040 1789439969.296892 trunc from 0x03fde2 to 0x008ef6 (0x36eeb bytes) 000041 1789439969.312701 trunc from 0x008ef7 to 0x02709a (0x1e1a4 bytes) 000042 1789439969.343010 write 0x00ce93 thru 0x00e90d (0x1a7b bytes) 000043 1789439969.352978 mapwrite 0x029512 thru 0x033d6f (0xa85e bytes) 000044 1789439969.505939 mapwrite 0x0108c1 thru 0x01536c (0x4aac bytes) 000046 1789439969.598459 read 0x0278cd thru 0x033d6f (0xc4a3 bytes) 000047 1789439969.642158 write 0x016fa3 thru 0x021bb7 (0xac15 bytes) 000048 1789439969.643538 mapwrite 0x005a95 thru 0x00f3fd (0x9969 bytes) 000049 1789439969.688672 write 0x00e4c4 thru 0x01137b (0x2eb8 bytes) 000050 1789439969.689565 mapread 0x030dc8 thru 0x033d6f (0x2fa8 bytes) 000051 1789439969.690396 mapread 0x00de11 thru 0x016abd (0x8cad bytes) 000052 1789439969.691176 mapwrite 0x02ae1f thru 0x0318df (0x6ac1 bytes) 000054 1789439969.736549 read 0x0318f0 thru 0x033d6f (0x2480 bytes) 000055 1789439969.737449 read 0x001b95 thru 0x00350e (0x197a bytes) 000057 1789439969.739811 read 0x02bff1 thru 0x033d6f (0x7d7f bytes) 000058 1789439969.740606 trunc from 0x033d70 to 0x03764f (0x38e0 bytes) 000059 1789439969.753977 punch from 0x0232ea to 0x02ecb3 (0xb9ca bytes) 000060 1789439969.760071 mapread 0x033a09 thru 0x03764f (0x3c47 bytes) 000061 1789439969.769978 mapread 0x023ce4 thru 0x02b738 (0x7a55 bytes) 000062 1789439969.772264 trunc from 0x037650 to 0x025536 (0x12119 bytes) 000066 1789439969.794098 punch from 0x0059b8 to 0x0135c1 (0xdc0a bytes) 000068 1789439969.799639 mapwrite 0x025370 thru 0x0317bd (0xc44e bytes) 000070 1789439969.917547 read 0x0200e0 thru 0x023fbc (0x3edd bytes) 000071 1789439969.918151 write 0x03933c thru 0x03ffff (0x6cc4 bytes) 000072 1789439969.919224 mapread 0x0095b1 thru 0x01484a (0xb29a bytes) 000074 1789439969.929972 trunc from 0x040000 to 0x03c165 (0x3e9a bytes) 000077 1789439969.950104 mapread 0x021c6a thru 0x02feaf (0xe246 bytes) 000079 1789439969.956170 MIRROR_EXTEND to 2 mirrors 000080 1789439970.615689 mapread 0x02a436 thru 0x038156 (0xdd21 bytes) 000081 1789439970.696136 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) 000082 1789439970.817825 trunc from 0x03c166 to 0x020958 (0x1b80d bytes) 000086 1789439970.848528 mapread 0x00b4cf thru 0x00c174 (0xca6 bytes) 000087 1789439970.861167 MIRROR_EXTEND to 2 mirrors 000088 1789439971.471828 MIRROR_RESYNC 2 mirrors 000089 1789439971.869839 read 0x01bd77 thru 0x020958 (0x4be2 bytes) 000090 1789439971.898561 mapread 0x014a79 thru 0x01ef5e (0xa4e6 bytes) 000091 1789439971.944611 write 0x01cec2 thru 0x022d12 (0x5e51 bytes) 000092 1789439972.064622 mapwrite 0x02c3bc thru 0x033989 (0x75ce bytes) 000096 1789439972.214595 trunc from 0x03398a to 0x02be99 (0x7af0 bytes) 000097 1789439972.243194 write 0x038d16 thru 0x03d14c (0x4437 bytes) 000099 1789439972.247540 write 0x009ebd thru 0x017502 (0xd646 bytes) 000100 1789439972.275911 mapwrite 0x013095 thru 0x013e81 (0xded bytes) 000101 1789439972.347012 mapread 0x0089f9 thru 0x00d688 (0x4c90 bytes) 000103 1789439972.356728 read 0x0158b1 thru 0x024d2a (0xf47a bytes) 000104 1789439972.384678 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) 000106 1789439972.560354 mapread 0x02f1b4 thru 0x0325b9 (0x3406 bytes) 000109 1789439972.595340 trunc from 0x03d14d to 0x00fab5 (0x2d697 bytes) 000110 1789439972.618664 read 0x00242a thru 0x0073ed (0x4fc4 bytes) 000112 1789439972.660440 MIRROR_EXTEND to 2 mirrors 000113 1789439973.402486 read 0x007012 thru 0x00fab5 (0x8aa4 bytes) 000114 1789439973.422556 write 0x00449a thru 0x00d496 (0x8ffd bytes) 000118 1789439973.498344 read 0x00755f thru 0x00fab5 (0x8557 bytes) 000121 1789439973.516450 read 0x0099ec thru 0x00ea0d (0x5022 bytes) 000123 1789439973.519748 trunc from 0x00fab6 to 0x03520a (0x25755 bytes) 000124 1789439973.540331 punch from 0x0151bc to 0x022f10 (0xdd55 bytes) 000125 1789439973.560096 trunc from 0x03520b to 0x00c2f0 (0x28f1a bytes) 000126 1789439973.581952 read 0x001e6d thru 0x00bf09 (0xa09d bytes) 000127 1789439973.582741 mapwrite 0x01778e thru 0x019b4e (0x23c1 bytes) 000128 1789439973.736775 trunc from 0x019b4f to 0x0213c4 (0x7876 bytes) 000129 1789439973.758270 trunc from 0x0213c5 to 0x0109f2 (0x109d2 bytes) 000130 1789439973.775911 read 0x001072 thru 0x00bd1c (0xacab bytes) 000131 1789439973.776531 trunc from 0x0109f3 to 0x03ba0f (0x2b01d bytes) 000132 1789439973.792509 write 0x03fded thru 0x03ffff (0x213 bytes) 000133 1789439973.794099 mapread 0x005ff9 thru 0x00ea3f (0x8a47 bytes) 000134 1789439973.795831 mapwrite 0x010c14 thru 0x014fdd (0x43ca bytes) 000139 1789439973.850224 read 0x01b0b5 thru 0x025111 (0xa05d bytes) 000142 1789439973.862367 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) 000144 1789439974.048594 read 0x01197d thru 0x013e58 (0x24dc bytes) 000146 1789439974.057642 read 0x037631 thru 0x03ffff (0x89cf bytes) 000147 1789439974.071637 write 0x033c1f thru 0x03ffff (0xc3e1 bytes) 000149 1789439974.074295 read 0x001453 thru 0x010c5c (0xf80a bytes) 000150 1789439974.075048 trunc from 0x040000 to 0x005ea3 (0x3a15c bytes) 000151 1789439974.093769 write 0x03aff4 thru 0x03e7b1 (0x37be bytes) 000153 1789439974.095352 punch from 0x00f351 to 0x01c5bd (0xd26d bytes) 000154 1789439974.108527 read 0x03a56c thru 0x03e7b1 (0x4246 bytes) 000155 1789439974.109127 mapread 0x027050 thru 0x0288d3 (0x1884 bytes) 000156 1789439974.119751 write 0x019e48 thru 0x025bfb (0xbdb4 bytes) 000157 1789439974.125763 MIRROR_EXTEND to 2 mirrors 000158 1789439974.763189 mapwrite 0x0175f5 thru 0x01ac2c (0x3638 bytes) 000160 1789439975.134799 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e7b2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7b2): Mirror 2: 0x487a53d3 (stale) CRC-32 checksum value for chunk [0, 0x3e7b2): Mirror 1: 0x2920b6f9 Mirror 3: 0x2920b6f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7b2: skipped 000161 1789439975.897613 mapread 0x03860a thru 0x03e7b1 (0x61a8 bytes) 000165 1789439975.917582 mapread 0x024aa2 thru 0x02f9df (0xaf3e bytes) 000167 1789439975.931289 punch from 0x03adbd to 0x03c373 (0x15b7 bytes) 000168 1789439975.985841 read 0x00517f thru 0x01114e (0xbfd0 bytes) 000171 1789439976.011663 read 0x00fc96 thru 0x01304d (0x33b8 bytes) 000172 1789439976.028849 mapwrite 0x031982 thru 0x034913 (0x2f92 bytes) 000174 1789439976.091363 punch from 0x037f1a to 0x03a1db (0x22c2 bytes) 000176 1789439976.100493 mapread 0x02c73b thru 0x02e3b7 (0x1c7d bytes) 000177 1789439976.101378 trunc from 0x03e7b2 to 0x031e8d (0xc924 bytes) 000179 1789439976.123374 write 0x035f5a thru 0x03a785 (0x482c bytes) 000180 1789439976.125537 mapwrite 0x02e45f thru 0x03662c (0x81ce bytes) 000181 1789439976.177207 trunc from 0x03a786 to 0x01048e (0x2a2f7 bytes) 000182 1789439976.205982 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1048f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1048f): Mirror 2: 0xa1bb4fc1 (stale) Mirror 3: 0xa1bb4fc1 (stale) CRC-32 checksum value for chunk [0, 0x1048f): Mirror 1: 0xa1bb4fc1 Mirror 4: 0xa1bb4fc1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1048f: skipped 000183 1789439976.996236 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1048f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1048f): Mirror 2: 0xa1bb4fc1 (stale) Mirror 3: 0xa1bb4fc1 (stale) CRC-32 checksum value for chunk [0, 0x1048f): Mirror 1: 0xa1bb4fc1 Mirror 4: 0xa1bb4fc1 Mirror 5: 0xa1bb4fc1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1048f: skipped 000184 1789439977.665654 write 0x03fecc thru 0x03ffff (0x134 bytes) 000185 1789439977.749320 write 0x008bca thru 0x010420 (0x7857 bytes) 000186 1789439977.763514 trunc from 0x040000 to 0x02b20d (0x14df2 bytes) 000187 1789439977.824323 punch from 0x01e65c to 0x02455d (0x5f02 bytes) 000188 1789439977.844177 trunc from 0x02b20e to 0x023e4c (0x73c1 bytes) 000189 1789439977.860580 write 0x03db0b thru 0x03ffff (0x24f5 bytes) 000190 1789439977.864181 write 0x00c393 thru 0x013c16 (0x7884 bytes) 000192 1789439977.878312 mapwrite 0x0189d6 thru 0x024c3b (0xc266 bytes) 000194 1789439978.026826 mapread 0x02a0c5 thru 0x030487 (0x63c3 bytes) 000196 1789439978.051649 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc1d35d89 (stale) Mirror 3: 0xe0cbd662 (stale) Mirror 4: 0xe5dfda94 (stale) Mirror 5: 0xe5dfda94 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7ea894ce Mirror 6: 0x7ea894ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000197 1789439978.987828 read 0x02a49d thru 0x02cc8e (0x27f2 bytes) 000199 1789439979.016604 trunc from 0x040000 to 0x00ee35 (0x311ca bytes) 000200 1789439979.096614 mapwrite 0x01dcf4 thru 0x028435 (0xa742 bytes) 000202 1789439979.251743 punch from 0x01d4c3 to 0x022a3f (0x557d bytes) 000206 1789439979.266887 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28436): Mirror 2: 0x9e0e8bd4 (stale) Mirror 3: 0x736b490c (stale) Mirror 5: 0xa0c20d44 (stale) Mirror 6: 0x378a7c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28436): Mirror 2: 0x9e0e8bd4 (stale) Mirror 3: 0x736b490c (stale) Mirror 5: 0xa0c20d44 (stale) Mirror 6: 0x378a7c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28436: skipped 000207 1789439979.749425 write 0x02f5f5 thru 0x034460 (0x4e6c bytes) 000208 1789439979.750548 punch from 0x00be88 to 0x014dd3 (0x8f4c bytes) 000210 1789439979.767341 punch from 0x011693 to 0x0161f2 (0x4b60 bytes) 000212 1789439979.772065 punch from 0x01e252 to 0x02ce90 (0xec3f bytes) 000214 1789439979.776872 read 0x0271ca thru 0x034460 (0xd297 bytes) 000215 1789439979.783948 trunc from 0x034461 to 0x035ad1 (0x1671 bytes) 000217 1789439979.797138 trunc from 0x035ad2 to 0x002d2e (0x32da3 bytes) 000218 1789439979.815936 mapread 0x000ada thru 0x002d2e (0x2255 bytes) 000219 1789439979.828534 mapread 0x00283b thru 0x002d2e (0x4f4 bytes) 000222 1789439979.830383 trunc from 0x002d2f to 0x0297d6 (0x26aa8 bytes) 000223 1789439979.847905 mapread 0x00524d thru 0x010e1f (0xbbd3 bytes) 000224 1789439979.861407 punch from 0x00f31f to 0x01f1fb (0xfedd bytes) 000225 1789439979.865934 mapwrite 0x01b268 thru 0x023820 (0x85b9 bytes) 000226 1789439979.931695 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x297d7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x297d7): Mirror 2: 0x32e78ec9 (stale) Mirror 3: 0xdafeb72b (stale) Mirror 5: 0x1b7efe76 (stale) Mirror 6: 0x8ecdab0b (stale) CRC-32 checksum value for chunk [0, 0x297d7): Mirror 1: 0x9eb43036 Mirror 7: 0x9eb43036 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x297d7: skipped 000227 1789439980.846861 write 0x012524 thru 0x017ce9 (0x57c6 bytes) 000229 1789439980.916114 read 0x014022 thru 0x0174f2 (0x34d1 bytes) 000230 1789439980.916756 read 0x021def thru 0x025181 (0x3393 bytes) 000231 1789439980.924379 trunc from 0x0297d7 to 0x0009c8 (0x28e0e bytes) 000232 1789439980.939917 mapread 0x000757 thru 0x0009c8 (0x272 bytes) 000233 1789439980.941634 write 0x00d059 thru 0x01af15 (0xdebd bytes) 000234 1789439980.943702 mapwrite 0x015f1c thru 0x019d1d (0x3e02 bytes) 000235 1789439980.985095 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1af16): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1af16): Mirror 2: 0x1b8b9bf1 (stale) Mirror 3: 0x70444f94 (stale) Mirror 5: 0x4f84a96c (stale) Mirror 6: 0x16b4d337 (stale) Mirror 7: 0xd5fbf75d (stale) CRC-32 checksum value for chunk [0, 0x1af16): Mirror 1: 0x77861640 Mirror 8: 0x77861640 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1af16: skipped 000236 1789439981.883483 trunc from 0x01af16 to 0x0236db (0x87c6 bytes) 000239 1789439981.965798 trunc from 0x0236dc to 0x01afa9 (0x8732 bytes) 000241 1789439981.994838 mapwrite 0x036cde thru 0x03ffff (0x9322 bytes) 000242 1789439982.145680 write 0x00ffe1 thru 0x011325 (0x1345 bytes) 000243 1789439982.153335 mapread 0x032d0c thru 0x0377ec (0x4ae1 bytes) 000244 1789439982.154237 mapwrite 0x01d532 thru 0x025021 (0x7af0 bytes) 000246 1789439982.214583 trunc from 0x040000 to 0x02f3b5 (0x10c4a bytes) 000248 1789439982.230926 read 0x0191be thru 0x01b6ee (0x2531 bytes) 000249 1789439982.231851 punch from 0x0299cc to 0x02f3b5 (0x59ea bytes) 000251 1789439982.235520 punch from 0x0263bf to 0x02c657 (0x6299 bytes) 000252 1789439982.250309 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f3b6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f3b6): Mirror 2: 0xc30659dd (stale) Mirror 3: 0x1c735cc0 (stale) Mirror 5: 0xe879334f (stale) Mirror 6: 0xeb20c62 (stale) Mirror 7: 0x4fcde128 (stale) Mirror 8: 0xfd0e7833 (stale) CRC-32 checksum value for chunk [0, 0x2f3b6): Mirror 1: 0x7244f56f Mirror 9: 0x7244f56f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f3b6: skipped 000253 1789439983.175008 mapread 0x0016e2 thru 0x009307 (0x7c26 bytes) 000254 1789439983.205996 read 0x01b7e7 thru 0x024996 (0x91b0 bytes) 000256 1789439983.225876 trunc from 0x02f3b6 to 0x005a20 (0x29995 bytes) 000258 1789439983.345159 punch from 0x00085f to 0x005a20 (0x51c2 bytes) 000259 1789439983.352340 punch from 0x004f59 to 0x005a20 (0xac8 bytes) 000260 1789439983.365189 MIRROR_RESYNC 8 mirrors 000261 1789439984.894311 mapread 0x0035ed thru 0x005a20 (0x2434 bytes) 000262 1789439984.914114 read 0x005856 thru 0x005a20 (0x1cb bytes) 000263 1789439984.914692 write 0x02da16 thru 0x02fdca (0x23b5 bytes) 000264 1789439985.026539 write 0x01db32 thru 0x02b326 (0xd7f5 bytes) 000265 1789439985.037961 mapread 0x0229c7 thru 0x02b4d5 (0x8b0f bytes) 000266 1789439985.043012 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 2: 0x3d1233bc (stale) Mirror 3: 0x3d1233bc (stale) Mirror 5: 0x3d1233bc (stale) Mirror 7: 0x3d1233bc (stale) Mirror 8: 0x3d1233bc (stale) Mirror 9: 0x3d1233bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 2: 0x3d1233bc (stale) Mirror 3: 0x3d1233bc (stale) Mirror 5: 0x3d1233bc (stale) Mirror 7: 0x3d1233bc (stale) Mirror 8: 0x3d1233bc (stale) Mirror 9: 0x3d1233bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fdcb: skipped 000268 1789439985.530431 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 2: 0x3d1233bc (stale) Mirror 3: 0x3d1233bc (stale) Mirror 5: 0x3d1233bc (stale) Mirror 7: 0x3d1233bc (stale) Mirror 8: 0x3d1233bc (stale) Mirror 9: 0x3d1233bc (stale) CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 1: 0x95c657dc Mirror 10: 0x95c657dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fdcb: skipped 000269 1789439986.421834 mapread 0x016e03 thru 0x019032 (0x2230 bytes) 000270 1789439986.473752 mapread 0x0186b9 thru 0x0247f3 (0xc13b bytes) 000272 1789439986.510791 mapread 0x02c5cc thru 0x02ede1 (0x2816 bytes) 000273 1789439986.546851 punch from 0x0018c1 to 0x0049e5 (0x3125 bytes) 000275 1789439986.674716 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 2: 0x3d1233bc (stale) Mirror 3: 0x3d1233bc (stale) Mirror 5: 0x3d1233bc (stale) Mirror 7: 0x3d1233bc (stale) Mirror 8: 0x3d1233bc (stale) Mirror 9: 0x3d1233bc (stale) Mirror 10: 0x95c657dc (stale) CRC-32 checksum value for chunk [0, 0x2fdcb): Mirror 1: 0x95c657dc Mirror 11: 0x95c657dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fdcb: skipped 000276 1789439987.918002 trunc from 0x02fdcb to 0x0260ea (0x9ce0 bytes) 000277 1789439988.017860 mapwrite 0x01ecc7 thru 0x028ce3 (0xa01d bytes) 000278 1789439988.103580 trunc from 0x028ce4 to 0x00fe52 (0x18e91 bytes) 000279 1789439988.124389 mapread 0x007eec thru 0x00bb4a (0x3c5f bytes) 000280 1789439988.140872 read 0x009cc9 thru 0x00fe52 (0x618a bytes) 000281 1789439988.147106 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xfe53): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfe53): Mirror 2: 0x574c2ad2 (stale) Mirror 3: 0x574c2ad2 (stale) Mirror 5: 0x574c2ad2 (stale) Mirror 7: 0x574c2ad2 (stale) Mirror 8: 0x574c2ad2 (stale) Mirror 9: 0x574c2ad2 (stale) Mirror 10: 0x574c2ad2 (stale) Mirror 11: 0x574c2ad2 (stale) CRC-32 checksum value for chunk [0, 0xfe53): Mirror 1: 0x574c2ad2 Mirror 12: 0x574c2ad2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfe53: skipped 000282 1789439988.941347 mapread 0x009a97 thru 0x00fe52 (0x63bc bytes) 000284 1789439988.981967 read 0x00cd5d thru 0x00fe52 (0x30f6 bytes) 000285 1789439988.985282 trunc from 0x00fe53 to 0x033bc6 (0x23d74 bytes) 000287 1789439989.100085 read 0x01c3ff thru 0x01e13f (0x1d41 bytes) 000289 1789439989.111534 trunc from 0x033bc7 to 0x0174f6 (0x1c6d0 bytes) 000291 1789439989.129880 mapread 0x006e2d thru 0x008a98 (0x1c6c bytes) 000292 1789439989.131340 mapwrite 0x003f7e thru 0x010fac (0xd02f bytes) 000295 1789439989.240997 mapread 0x0045bd thru 0x013006 (0xea4a bytes) 000297 1789439989.244472 mapwrite 0x01ab67 thru 0x0200ff (0x5599 bytes) 000298 1789439989.379278 read 0x000348 thru 0x00851d (0x81d6 bytes) 000299 1789439989.380088 read 0x00bc21 thru 0x00ecfd (0x30dd bytes) 000300 1789439989.380644 mapwrite 0x012ef5 thru 0x01396b (0xa77 bytes) 000302 1789439989.439272 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x20100): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20100): Mirror 2: 0x281d6bd9 (stale) Mirror 3: 0x281d6bd9 (stale) Mirror 5: 0x281d6bd9 (stale) Mirror 7: 0x281d6bd9 (stale) Mirror 8: 0x281d6bd9 (stale) Mirror 9: 0x281d6bd9 (stale) Mirror 10: 0x97face3d (stale) Mirror 11: 0x97face3d (stale) Mirror 12: 0x281d6bd9 (stale) CRC-32 checksum value for chunk [0, 0x20100): Mirror 1: 0x56f9f93b Mirror 13: 0x56f9f93b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20100: skipped 000303 1789439990.313147 write 0x0031d4 thru 0x00b846 (0x8673 bytes) 000304 1789439990.417704 read 0x0147d6 thru 0x014e93 (0x6be bytes) 000305 1789439990.424184 mapread 0x00584c thru 0x0088f2 (0x30a7 bytes) 000306 1789439990.425141 write 0x028b7e thru 0x035142 (0xc5c5 bytes) 000307 1789439990.426810 write 0x02c144 thru 0x03052c (0x43e9 bytes) 000309 1789439990.432842 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x35143): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35143): Mirror 2: 0x917bfc17 (stale) Mirror 3: 0x917bfc17 (stale) Mirror 5: 0x917bfc17 (stale) Mirror 7: 0x917bfc17 (stale) Mirror 8: 0x917bfc17 (stale) Mirror 9: 0x917bfc17 (stale) Mirror 10: 0xfd7442a (stale) Mirror 11: 0xfd7442a (stale) Mirror 12: 0x917bfc17 (stale) Mirror 13: 0x4cff8a3b (stale) CRC-32 checksum value for chunk [0, 0x35143): Mirror 1: 0xd9d70a7f Mirror 14: 0xd9d70a7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35143: skipped 000310 1789439991.456759 mapread 0x01431d thru 0x014c88 (0x96c bytes) 000311 1789439991.493335 trunc from 0x035143 to 0x03ddc9 (0x8c87 bytes) 000313 1789439991.661925 write 0x00878f thru 0x017852 (0xf0c4 bytes) 000314 1789439991.674621 trunc from 0x03ddca to 0x017c61 (0x26168 bytes) 000315 1789439991.697757 punch from 0x0169f7 to 0x017c61 (0x126b bytes) 000316 1789439991.711817 mapread 0x01466c thru 0x017c61 (0x35f6 bytes) 000317 1789439991.728062 punch from 0x00f08f to 0x017c61 (0x8bd3 bytes) 000319 1789439991.736452 mapwrite 0x03d480 thru 0x03ffff (0x2b80 bytes) 000322 1789439991.802197 MIRROR_RESYNC 12 mirrors 000323 1789439993.998675 mapwrite 0x022397 thru 0x0241eb (0x1e55 bytes) 000325 1789439994.216921 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe11b211b (stale) Mirror 3: 0xe11b211b (stale) Mirror 5: 0xe11b211b (stale) Mirror 7: 0xe11b211b (stale) Mirror 8: 0xe11b211b (stale) Mirror 9: 0xe11b211b (stale) Mirror 10: 0xe11b211b (stale) Mirror 11: 0xe11b211b (stale) Mirror 12: 0xe11b211b (stale) Mirror 13: 0xe11b211b (stale) Mirror 14: 0xe11b211b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8c2fe985 Mirror 15: 0x8c2fe985 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000326 1789439995.346501 mapread 0x020ffe thru 0x02d92b (0xc92e bytes) 000327 1789439995.383976 read 0x013c14 thru 0x01b4ee (0x78db bytes) 000328 1789439995.400346 read 0x03a067 thru 0x03ffff (0x5f99 bytes) 000329 1789439995.413766 punch from 0x020543 to 0x02a30c (0x9dca bytes) 000330 1789439995.485557 mapread 0x00bdbe thru 0x011b03 (0x5d46 bytes) 000331 1789439995.511728 write 0x02acbc thru 0x02d907 (0x2c4c bytes) 000332 1789439995.519896 trunc from 0x040000 to 0x034c03 (0xb3fc bytes) 000336 1789439995.543861 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34c04): Mirror 2: 0x3a17ea26 (stale) Mirror 3: 0x3a17ea26 (stale) Mirror 5: 0x3a17ea26 (stale) Mirror 7: 0x3a17ea26 (stale) Mirror 8: 0x3a17ea26 (stale) Mirror 9: 0x3a17ea26 (stale) Mirror 10: 0x3a17ea26 (stale) Mirror 11: 0x3a17ea26 (stale) Mirror 13: 0x3a17ea26 (stale) Mirror 14: 0x3a17ea26 (stale) Mirror 15: 0x5917baed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c04): Mirror 2: 0x3a17ea26 (stale) Mirror 3: 0x3a17ea26 (stale) Mirror 5: 0x3a17ea26 (stale) Mirror 7: 0x3a17ea26 (stale) Mirror 8: 0x3a17ea26 (stale) Mirror 9: 0x3a17ea26 (stale) Mirror 10: 0x3a17ea26 (stale) Mirror 11: 0x3a17ea26 (stale) Mirror 13: 0x3a17ea26 (stale) Mirror 14: 0x3a17ea26 (stale) Mirror 15: 0x5917baed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c04: skipped 000338 1789439996.327378 write 0x014815 thru 0x0245c1 (0xfdad bytes) 000340 1789439996.342370 mapwrite 0x0118e3 thru 0x012dfd (0x151b bytes) 000341 1789439996.410926 punch from 0x00b583 to 0x00f8f6 (0x4374 bytes) 000344 1789439996.420087 read 0x0204bd thru 0x027a2e (0x7572 bytes) 000345 1789439996.427082 write 0x02f4df thru 0x03edd9 (0xf8fb bytes) 000346 1789439996.433623 read 0x030d7a thru 0x039995 (0x8c1c bytes) 000347 1789439996.434757 trunc from 0x03edda to 0x005448 (0x39991 bytes) 000348 1789439996.458382 read 0x00484c thru 0x005448 (0xbfd bytes) 000349 1789439996.471460 write 0x024c48 thru 0x02a8a7 (0x5c60 bytes) 000351 1789439996.482939 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a8a8): Mirror 2: 0x1bab1f93 (stale) Mirror 3: 0x1bab1f93 (stale) Mirror 5: 0x1bab1f93 (stale) Mirror 7: 0x1bab1f93 (stale) Mirror 8: 0x1bab1f93 (stale) Mirror 10: 0x1bab1f93 (stale) Mirror 11: 0x1bab1f93 (stale) Mirror 13: 0x1bab1f93 (stale) Mirror 14: 0x1bab1f93 (stale) Mirror 15: 0x50a4b0b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8a8): Mirror 2: 0x1bab1f93 (stale) Mirror 3: 0x1bab1f93 (stale) Mirror 5: 0x1bab1f93 (stale) Mirror 7: 0x1bab1f93 (stale) Mirror 8: 0x1bab1f93 (stale) Mirror 10: 0x1bab1f93 (stale) Mirror 11: 0x1bab1f93 (stale) Mirror 13: 0x1bab1f93 (stale) Mirror 14: 0x1bab1f93 (stale) Mirror 15: 0x50a4b0b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8a8: skipped 000353 1789439997.259071 read 0x00cea0 thru 0x0113a2 (0x4503 bytes) 000354 1789439997.268263 punch from 0x019376 to 0x01b87c (0x2507 bytes) 000355 1789439997.273856 mapwrite 0x03e60c thru 0x03ffff (0x19f4 bytes) 000357 1789439997.378071 write 0x01b4fc thru 0x02a9a9 (0xf4ae bytes) 000358 1789439997.390734 mapwrite 0x013c66 thru 0x0233c7 (0xf762 bytes) 000359 1789439997.455790 trunc from 0x040000 to 0x039eaa (0x6155 bytes) 000360 1789439997.490937 mapwrite 0x003fb9 thru 0x00d251 (0x9299 bytes) 000363 1789439997.543289 read 0x037e1a thru 0x039d59 (0x1f40 bytes) 000364 1789439997.554583 trunc from 0x039eab to 0x013d75 (0x26135 bytes) 000365 1789439997.577058 read 0x0069fc thru 0x010dd8 (0xa3dd bytes) 000366 1789439997.577950 mapwrite 0x027ea4 thru 0x02cf3d (0x509a bytes) 000370 1789439997.654995 mapwrite 0x00fade thru 0x014bb3 (0x50d6 bytes) 000372 1789439997.726012 trunc from 0x02cf3e to 0x02a944 (0x25f9 bytes) 000374 1789439997.744655 write 0x037f3e thru 0x03ffff (0x80c2 bytes) 000376 1789439997.754839 MIRROR_RESYNC 11 mirrors 000378 1789439999.354552 MIRROR_RESYNC 11 mirrors 000382 1789439999.849777 write 0x00178b thru 0x00955e (0x7dd4 bytes) 000384 1789439999.917961 read 0x02ff20 thru 0x03da56 (0xdb37 bytes) 000385 1789439999.934720 read 0x02f371 thru 0x036593 (0x7223 bytes) 000386 1789439999.940742 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdf9910a4 (stale) Mirror 3: 0xdf9910a4 (stale) Mirror 5: 0xdf9910a4 (stale) Mirror 7: 0xdf9910a4 (stale) Mirror 8: 0xdf9910a4 (stale) Mirror 10: 0xdf9910a4 (stale) Mirror 13: 0xdf9910a4 (stale) Mirror 14: 0xdf9910a4 (stale) Mirror 15: 0xdf9910a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdf9910a4 (stale) Mirror 3: 0xdf9910a4 (stale) Mirror 5: 0xdf9910a4 (stale) Mirror 7: 0xdf9910a4 (stale) Mirror 8: 0xdf9910a4 (stale) Mirror 10: 0xdf9910a4 (stale) Mirror 13: 0xdf9910a4 (stale) Mirror 14: 0xdf9910a4 (stale) Mirror 15: 0xdf9910a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000389 1789440000.394839 read 0x01b92e thru 0x01f2ef (0x39c2 bytes) 000390 1789440000.404017 mapread 0x0275f2 thru 0x02a3db (0x2dea bytes) 000391 1789440000.438230 read 0x01e090 thru 0x028316 (0xa287 bytes) 000392 1789440000.450250 punch from 0x00118c to 0x002252 (0x10c7 bytes) 000393 1789440000.458355 write 0x037a54 thru 0x03ffff (0x85ac bytes) 000394 1789440000.459454 trunc from 0x040000 to 0x006ffe (0x39001 bytes) 000395 1789440000.488815 punch from 0x00008a to 0x006ffe (0x6f75 bytes) 000396 1789440000.498438 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6fff): Mirror 2: 0x53e6c33b (stale) Mirror 3: 0x53e6c33b (stale) Mirror 5: 0x53e6c33b (stale) Mirror 7: 0x53e6c33b (stale) Mirror 8: 0x53e6c33b (stale) Mirror 10: 0x53e6c33b (stale) Mirror 13: 0x53e6c33b (stale) Mirror 15: 0x53e6c33b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6fff): Mirror 2: 0x53e6c33b (stale) Mirror 3: 0x53e6c33b (stale) Mirror 5: 0x53e6c33b (stale) Mirror 7: 0x53e6c33b (stale) Mirror 8: 0x53e6c33b (stale) Mirror 10: 0x53e6c33b (stale) Mirror 13: 0x53e6c33b (stale) Mirror 15: 0x53e6c33b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6fff: skipped 000398 1789440000.891907 trunc from 0x006fff to 0x0391a3 (0x321a5 bytes) 000403 1789440000.907367 mapwrite 0x003dcf thru 0x0052e4 (0x1516 bytes) 000404 1789440000.965217 mapread 0x038729 thru 0x0391a3 (0xa7b bytes) 000406 1789440000.991321 read 0x02baa4 thru 0x034ca8 (0x9205 bytes) 000407 1789440001.003985 trunc from 0x0391a4 to 0x00f732 (0x29a71 bytes) 000408 1789440001.036567 write 0x0366d2 thru 0x03ffff (0x992e bytes) 000409 1789440001.038936 read 0x034383 thru 0x0395fa (0x5278 bytes) 000410 1789440001.053277 mapread 0x037cba thru 0x03ffff (0x8346 bytes) 000411 1789440001.054277 read 0x00c941 thru 0x017749 (0xae09 bytes) 000412 1789440001.055695 trunc from 0x040000 to 0x02c0a1 (0x13f5e bytes) 000413 1789440001.081623 trunc from 0x02c0a2 to 0x034cd9 (0x8c38 bytes) 000414 1789440001.109589 punch from 0x00e9c5 to 0x012ce2 (0x431e bytes) 000417 1789440001.115992 mapwrite 0x0169c1 thru 0x019833 (0x2e73 bytes) 000418 1789440001.157577 write 0x02d6d3 thru 0x030140 (0x2a6e bytes) 000419 1789440001.187708 punch from 0x02b981 to 0x032c77 (0x72f7 bytes) 000420 1789440001.199850 write 0x0148d8 thru 0x01c8f1 (0x801a bytes) 000421 1789440001.201654 punch from 0x0114b5 to 0x01ca94 (0xb5e0 bytes) 000422 1789440001.215490 write 0x002dbf thru 0x00af7e (0x81c0 bytes) 000424 1789440001.222783 mapwrite 0x0215fa thru 0x02f479 (0xde80 bytes) 000425 1789440001.310117 write 0x00076f thru 0x00a724 (0x9fb6 bytes) 000426 1789440001.317657 punch from 0x034012 to 0x034cd9 (0xcc8 bytes) 000427 1789440001.342683 write 0x034874 thru 0x03c8d2 (0x805f bytes) 000429 1789440001.356225 trunc from 0x03c8d3 to 0x037186 (0x574c bytes) 000430 1789440001.389890 mapwrite 0x013fa9 thru 0x016531 (0x2589 bytes) 000431 1789440001.525794 mapread 0x0187b2 thru 0x01aac2 (0x2311 bytes) 000432 1789440001.545479 read 0x00850b thru 0x0115d0 (0x90c6 bytes) 000433 1789440001.560139 mapread 0x025d35 thru 0x027604 (0x18d0 bytes) 000434 1789440001.568185 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37187): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37187): Mirror 2: 0x318d49eb (stale) Mirror 3: 0x318d49eb (stale) Mirror 5: 0x318d49eb (stale) Mirror 7: 0x318d49eb (stale) Mirror 8: 0x318d49eb (stale) Mirror 10: 0x318d49eb (stale) Mirror 13: 0x318d49eb (stale) Mirror 15: 0x318d49eb (stale) CRC-32 checksum value for chunk [0, 0x37187): Mirror 1: 0xddbf1f0f Mirror 16: 0xddbf1f0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37187: skipped 000435 1789440002.498674 read 0x0171e4 thru 0x01a9e2 (0x37ff bytes) 000436 1789440002.517811 write 0x020686 thru 0x0301ba (0xfb35 bytes) 000437 1789440002.634720 read 0x00fefd thru 0x0147cc (0x48d0 bytes) 000438 1789440002.646886 punch from 0x01007a to 0x01e15e (0xe0e5 bytes) 000439 1789440002.664333 MIRROR_RESYNC 10 mirrors 000440 1789440004.153834 trunc from 0x037187 to 0x027e1f (0xf367 bytes) 000441 1789440004.249228 mapwrite 0x03403b thru 0x037c89 (0x3c4f bytes) 000442 1789440004.381003 MIRROR_RESYNC 10 mirrors 000444 1789440005.764648 read 0x008f4b thru 0x017acd (0xeb83 bytes) 000445 1789440005.780930 MIRROR_EXTEND to 11 mirrors 000446 1789440006.618096 mapwrite 0x0177d3 thru 0x0219e7 (0xa215 bytes) 000447 1789440006.857146 mapread 0x01ad59 thru 0x01bd34 (0xfdc bytes) 000448 1789440006.858150 mapread 0x022c99 thru 0x02cba6 (0x9f0e bytes) 000449 1789440006.875478 mapread 0x034a7e thru 0x037c89 (0x320c bytes) 000450 1789440006.889824 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c8a): Mirror 2: 0xbe2a7bb2 (stale) Mirror 3: 0xbe2a7bb2 (stale) Mirror 7: 0xbe2a7bb2 (stale) Mirror 8: 0xbe2a7bb2 (stale) Mirror 10: 0xbe2a7bb2 (stale) Mirror 13: 0xbe2a7bb2 (stale) Mirror 15: 0xbe2a7bb2 (stale) Mirror 16: 0xbe2a7bb2 (stale) Mirror 17: 0xbe2a7bb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c8a): Mirror 2: 0xbe2a7bb2 (stale) Mirror 3: 0xbe2a7bb2 (stale) Mirror 7: 0xbe2a7bb2 (stale) Mirror 8: 0xbe2a7bb2 (stale) Mirror 10: 0xbe2a7bb2 (stale) Mirror 13: 0xbe2a7bb2 (stale) Mirror 15: 0xbe2a7bb2 (stale) Mirror 16: 0xbe2a7bb2 (stale) Mirror 17: 0xbe2a7bb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c8a: skipped 000451 1789440007.449244 read 0x0218d0 thru 0x0224d7 (0xc08 bytes) 000452 1789440007.453425 punch from 0x01b2e3 to 0x0204ed (0x520b bytes) 000453 1789440007.458827 mapwrite 0x0285fa thru 0x030a1a (0x8421 bytes) 000454 1789440007.527483 mapread 0x02aa95 thru 0x02c493 (0x19ff bytes) 000456 1789440007.529729 punch from 0x007c73 to 0x017998 (0xfd26 bytes) 000458 1789440007.540353 punch from 0x02a3b5 to 0x034fd6 (0xac22 bytes) 000459 1789440007.551961 mapread 0x015214 thru 0x0169b4 (0x17a1 bytes) 000460 1789440007.562977 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c8a): Mirror 2: 0xbe2a7bb2 (stale) Mirror 7: 0xbe2a7bb2 (stale) Mirror 8: 0xbe2a7bb2 (stale) Mirror 10: 0xbe2a7bb2 (stale) Mirror 13: 0xbe2a7bb2 (stale) Mirror 15: 0xbe2a7bb2 (stale) Mirror 16: 0xbe2a7bb2 (stale) Mirror 17: 0xbe2a7bb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c8a): Mirror 2: 0xbe2a7bb2 (stale) Mirror 7: 0xbe2a7bb2 (stale) Mirror 8: 0xbe2a7bb2 (stale) Mirror 10: 0xbe2a7bb2 (stale) Mirror 13: 0xbe2a7bb2 (stale) Mirror 15: 0xbe2a7bb2 (stale) Mirror 16: 0xbe2a7bb2 (stale) Mirror 17: 0xbe2a7bb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c8a: skipped 000461 1789440008.084949 mapwrite 0x02e910 thru 0x03045a (0x1b4b bytes) 000462 1789440008.193211 trunc from 0x037c8a to 0x016445 (0x21844 bytes) 000463 1789440008.215337 read 0x00ece0 thru 0x016445 (0x7766 bytes) 000465 1789440008.228644 mapread 0x00a865 thru 0x016445 (0xbbe1 bytes) 000467 1789440008.242876 write 0x016339 thru 0x01f7a9 (0x9471 bytes) 000470 1789440008.247836 mapwrite 0x01b533 thru 0x029131 (0xdbff bytes) 000471 1789440008.357967 read 0x018b59 thru 0x020f88 (0x8430 bytes) 000472 1789440008.358687 read 0x010873 thru 0x019892 (0x9020 bytes) 000473 1789440008.359201 read 0x027708 thru 0x029131 (0x1a2a bytes) 000475 1789440008.360172 punch from 0x00b74d to 0x01b1c4 (0xfa78 bytes) 000477 1789440008.365489 write 0x03b732 thru 0x03ffff (0x48ce bytes) 000478 1789440008.366595 read 0x0276f7 thru 0x02d028 (0x5932 bytes) 000479 1789440008.376154 read 0x00c24e thru 0x01a1c1 (0xdf74 bytes) 000480 1789440008.376845 read 0x02c60d thru 0x034bd0 (0x85c4 bytes) 000481 1789440008.377859 mapread 0x00f81c thru 0x015bd7 (0x63bc bytes) 000483 1789440008.379248 write 0x01b09f thru 0x025871 (0xa7d3 bytes) 000484 1789440008.384890 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdd50b003 (stale) Mirror 7: 0xdd50b003 (stale) Mirror 8: 0xdd50b003 (stale) Mirror 10: 0xdd50b003 (stale) Mirror 13: 0xdd50b003 (stale) Mirror 15: 0xdd50b003 (stale) Mirror 16: 0xdd50b003 (stale) Mirror 17: 0xdd50b003 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5d77fe15 Mirror 18: 0x5d77fe15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000485 1789440009.365527 write 0x00b9b3 thru 0x01a159 (0xe7a7 bytes) 000486 1789440009.448411 write 0x026878 thru 0x02cda8 (0x6531 bytes) 000488 1789440009.472398 mapread 0x019ed7 thru 0x01bfa1 (0x20cb bytes) 000489 1789440009.481855 read 0x00394c thru 0x00c511 (0x8bc6 bytes) 000491 1789440009.498727 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdd50b003 (stale) Mirror 7: 0xdd50b003 (stale) Mirror 8: 0xdd50b003 (stale) Mirror 10: 0xdd50b003 (stale) Mirror 13: 0xdd50b003 (stale) Mirror 15: 0xdd50b003 (stale) Mirror 16: 0xdd50b003 (stale) Mirror 17: 0xdd50b003 (stale) Mirror 18: 0x5d77fe15 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe3fc7e73 Mirror 19: 0xe3fc7e73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000492 1789440010.399549 punch from 0x03549a to 0x03cd21 (0x7888 bytes) 000494 1789440010.475716 trunc from 0x040000 to 0x004f8a (0x3b075 bytes) 000498 1789440010.507742 read 0x00037f thru 0x004f8a (0x4c0c bytes) 000499 1789440010.518787 write 0x033104 thru 0x0392d7 (0x61d4 bytes) 000500 1789440010.521765 mapwrite 0x0070d4 thru 0x013884 (0xc7b1 bytes) 000502 1789440010.629005 write 0x01eb1a thru 0x024752 (0x5c39 bytes) 000503 1789440010.643725 trunc from 0x0392d8 to 0x02880c (0x10acb bytes) 000504 1789440010.680802 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2880d): Mirror 2: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2880d): Mirror 2: 0x9808377e (stale) Mirror 7: 0x9808377e (stale) Mirror 8: 0x9808377e (stale) Mirror 10: 0x9808377e (stale) Mirror 13: 0x9808377e (stale) Mirror 15: 0x9808377e (stale) Mirror 16: 0x9808377e (stale) Mirror 17: 0x9808377e (stale) Mirror 18: 0xbf8be967 (stale) Mirror 19: 0xf54eb7df (stale) CRC-32 checksum value for chunk [0, 0x2880d): Mirror 1: 0xafc57fe0 Mirror 20: 0xafc57fe0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2880d: skipped 000506 1789440011.952633 write 0x0268b4 thru 0x0317e2 (0xaf2f bytes) 000507 1789440012.073434 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x317e3): Mirror 2: 0x33510e93 (stale) Mirror 7: 0x33510e93 (stale) Mirror 8: 0x33510e93 (stale) Mirror 10: 0x33510e93 (stale) Mirror 13: 0x33510e93 (stale) Mirror 16: 0x33510e93 (stale) Mirror 17: 0x33510e93 (stale) Mirror 18: 0xcc5fceb7 (stale) Mirror 19: 0x21a1a151 (stale) Mirror 20: 0xf1c8b173 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x317e3): Mirror 2: 0x33510e93 (stale) Mirror 7: 0x33510e93 (stale) Mirror 8: 0x33510e93 (stale) Mirror 10: 0x33510e93 (stale) Mirror 13: 0x33510e93 (stale) Mirror 16: 0x33510e93 (stale) Mirror 17: 0x33510e93 (stale) Mirror 18: 0xcc5fceb7 (stale) Mirror 19: 0x21a1a151 (stale) Mirror 20: 0xf1c8b173 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x317e3: skipped 000509 1789440012.846989 MIRROR_RESYNC 11 mirrors 000510 1789440014.664908 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) 000514 1789440015.113807 mapwrite 0x03a7dc thru 0x03c039 (0x185e bytes) 000515 1789440015.332936 punch from 0x032d2f to 0x032e31 (0x103 bytes) 000516 1789440015.338993 mapwrite 0x00e246 thru 0x013359 (0x5114 bytes) 000519 1789440015.397728 punch from 0x015417 to 0x01f251 (0x9e3b bytes) 000520 1789440015.406689 trunc from 0x03c03a to 0x0010f6 (0x3af43 bytes) 000525 1789440015.427922 MIRROR_RESYNC 10 mirrors 000526 1789440016.609463 write 0x01af4c thru 0x0241e3 (0x9298 bytes) 000528 1789440016.725629 read 0x021b1b thru 0x0241e3 (0x26c9 bytes) 000529 1789440016.728979 trunc from 0x0241e4 to 0x0102e2 (0x13f01 bytes) 000530 1789440016.769831 punch from 0x0014f0 to 0x009f9d (0x8aae bytes) 000531 1789440016.782594 mapread 0x004e0c thru 0x007376 (0x256b bytes) 000532 1789440016.820365 punch from 0x0078ec to 0x00a2b3 (0x29c8 bytes) 000533 1789440016.836150 punch from 0x003982 to 0x00c562 (0x8be1 bytes) 000535 1789440016.870721 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x102e3): Mirror 7: 0xff21714 (stale) Mirror 8: 0xff21714 (stale) Mirror 10: 0xff21714 (stale) Mirror 13: 0xff21714 (stale) Mirror 16: 0xff21714 (stale) Mirror 18: 0xff21714 (stale) Mirror 19: 0xff21714 (stale) Mirror 20: 0xff21714 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x102e3): Mirror 7: 0xff21714 (stale) Mirror 8: 0xff21714 (stale) Mirror 10: 0xff21714 (stale) Mirror 13: 0xff21714 (stale) Mirror 16: 0xff21714 (stale) Mirror 18: 0xff21714 (stale) Mirror 19: 0xff21714 (stale) Mirror 20: 0xff21714 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x102e3: skipped 000537 1789440017.258994 write 0x00a078 thru 0x010a0d (0x6996 bytes) 000538 1789440017.273892 mapread 0x006ffc thru 0x010a0d (0x9a12 bytes) 000539 1789440017.289788 mapread 0x010988 thru 0x010a0d (0x86 bytes) 000540 1789440017.298227 MIRROR_RESYNC 9 mirrors 000541 1789440018.708648 punch from 0x0039b5 to 0x010a0d (0xd059 bytes) 000544 1789440018.819825 read 0x00b91f thru 0x010a0d (0x50ef bytes) 000546 1789440018.837541 trunc from 0x010a0e to 0x03e264 (0x2d857 bytes) 000547 1789440018.867729 read 0x015fa1 thru 0x01bac5 (0x5b25 bytes) 000548 1789440018.887660 punch from 0x0157ed to 0x01f15f (0x9973 bytes) 000551 1789440018.900785 trunc from 0x03e265 to 0x01e211 (0x20053 bytes) 000552 1789440018.921342 write 0x01ab8e thru 0x02416e (0x95e1 bytes) 000553 1789440018.926918 mapwrite 0x033209 thru 0x037040 (0x3e38 bytes) 000557 1789440019.077936 mapwrite 0x00ee39 thru 0x00f2d6 (0x49e bytes) 000558 1789440019.113856 mapwrite 0x012597 thru 0x0204d4 (0xdf3e bytes) 000560 1789440019.182245 mapwrite 0x039cb4 thru 0x03ffff (0x634c bytes) 000561 1789440019.262168 punch from 0x0003ea to 0x0016d8 (0x12ef bytes) 000562 1789440019.266960 mapwrite 0x034d2a thru 0x03ffff (0xb2d6 bytes) 000563 1789440019.366564 write 0x02343a thru 0x02a6e4 (0x72ab bytes) 000564 1789440019.375551 mapread 0x022c9d thru 0x02a3fc (0x7760 bytes) 000568 1789440019.377826 mapread 0x0036c3 thru 0x00b983 (0x82c1 bytes) 000569 1789440019.382662 punch from 0x02b481 to 0x03112e (0x5cae bytes) 000570 1789440019.410804 mapwrite 0x0072b3 thru 0x00d44c (0x619a bytes) 000572 1789440019.493376 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf2fd989d (stale) Mirror 8: 0xf2fd989d (stale) Mirror 10: 0xf2fd989d (stale) Mirror 13: 0xf2fd989d (stale) Mirror 16: 0xf2fd989d (stale) Mirror 18: 0xf2fd989d (stale) Mirror 19: 0xf2fd989d (stale) Mirror 20: 0xf2fd989d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x626bd248 Mirror 21: 0x626bd248 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000573 1789440020.334877 punch from 0x02bbb3 to 0x03b859 (0xfca7 bytes) 000574 1789440020.414999 read 0x03f9ac thru 0x03ffff (0x654 bytes) 000575 1789440020.420449 punch from 0x015772 to 0x01f68e (0x9f1d bytes) 000576 1789440020.425950 mapread 0x022368 thru 0x02b5ba (0x9253 bytes) 000578 1789440020.455387 trunc from 0x040000 to 0x012650 (0x2d9af bytes) 000579 1789440020.506632 mapread 0x011b80 thru 0x012650 (0xad1 bytes) 000580 1789440020.516532 mapwrite 0x02b2e4 thru 0x02f5ee (0x430b bytes) 000583 1789440020.585637 trunc from 0x02f5ef to 0x017f28 (0x176c6 bytes) 000585 1789440020.606576 punch from 0x00459e to 0x00b732 (0x7195 bytes) 000587 1789440020.610993 read 0x017568 thru 0x017f28 (0x9c1 bytes) 000588 1789440020.620345 trunc from 0x017f29 to 0x014223 (0x3d05 bytes) 000589 1789440020.650190 write 0x00baa8 thru 0x010ad2 (0x502b bytes) 000590 1789440020.653839 read 0x000348 thru 0x0102ed (0xffa6 bytes) 000591 1789440020.662181 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x14224): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14224): Mirror 7: 0xfcbbae5c (stale) Mirror 8: 0xfcbbae5c (stale) Mirror 10: 0xfcbbae5c (stale) Mirror 13: 0xfcbbae5c (stale) Mirror 16: 0xfcbbae5c (stale) Mirror 18: 0xfcbbae5c (stale) Mirror 19: 0xfcbbae5c (stale) Mirror 20: 0xfcbbae5c (stale) Mirror 21: 0x947af4cb (stale) CRC-32 checksum value for chunk [0, 0x14224): Mirror 1: 0x6e3d6085 Mirror 22: 0x6e3d6085 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14224: skipped 000592 1789440021.583601 mapread 0x0075f4 thru 0x014223 (0xcc30 bytes) 000593 1789440021.629273 read 0x001205 thru 0x006ff8 (0x5df4 bytes) 000594 1789440021.640826 read 0x0136ec thru 0x014223 (0xb38 bytes) 000595 1789440021.652873 punch from 0x011139 to 0x014223 (0x30eb bytes) 000596 1789440021.756911 read 0x008c7a thru 0x014223 (0xb5aa bytes) 000597 1789440021.777916 punch from 0x003723 to 0x00b36a (0x7c48 bytes) 000598 1789440021.782478 trunc from 0x014224 to 0x02223b (0xe018 bytes) 000599 1789440021.803087 mapread 0x01bd6d thru 0x02223b (0x64cf bytes) 000600 1789440021.811659 mapread 0x00b5a3 thru 0x00d463 (0x1ec1 bytes) 000601 1789440021.818283 MIRROR_RESYNC 11 mirrors 000602 1789440023.659123 write 0x012cd7 thru 0x01ab05 (0x7e2f bytes) 000604 1789440023.731827 write 0x0107c4 thru 0x019ab9 (0x92f6 bytes) 000607 1789440023.737286 mapwrite 0x00387a thru 0x0118ec (0xe073 bytes) 000608 1789440023.825838 mapread 0x01037a thru 0x01d2c7 (0xcf4e bytes) 000609 1789440023.835442 read 0x001c6c thru 0x0113fd (0xf792 bytes) 000610 1789440023.837268 punch from 0x021cb3 to 0x02223b (0x589 bytes) 000611 1789440023.845813 punch from 0x01fa7e to 0x02223b (0x27be bytes) 000612 1789440023.858862 MIRROR_RESYNC 11 mirrors 000613 1789440026.014521 write 0x02fc65 thru 0x038c2a (0x8fc6 bytes) 000616 1789440026.080917 trunc from 0x038c2b to 0x0145dd (0x2464d bytes) 000617 1789440026.105405 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x145de): Mirror 7: 0x38d81f3e (stale) Mirror 10: 0x38d81f3e (stale) Mirror 13: 0x38d81f3e (stale) Mirror 16: 0x38d81f3e (stale) Mirror 18: 0x38d81f3e (stale) Mirror 19: 0x38d81f3e (stale) Mirror 20: 0x38d81f3e (stale) Mirror 21: 0x38d81f3e (stale) Mirror 22: 0x38d81f3e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x145de): Mirror 7: 0x38d81f3e (stale) Mirror 10: 0x38d81f3e (stale) Mirror 13: 0x38d81f3e (stale) Mirror 16: 0x38d81f3e (stale) Mirror 18: 0x38d81f3e (stale) Mirror 19: 0x38d81f3e (stale) Mirror 20: 0x38d81f3e (stale) Mirror 21: 0x38d81f3e (stale) Mirror 22: 0x38d81f3e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x145de: skipped 000618 1789440026.584347 punch from 0x0034ae to 0x007fb8 (0x4b0b bytes) 000619 1789440026.589744 mapwrite 0x0112a2 thru 0x011d32 (0xa91 bytes) 000621 1789440026.651811 punch from 0x00678c to 0x00d569 (0x6dde bytes) 000623 1789440026.658248 read 0x006d8b thru 0x012b36 (0xbdac bytes) 000624 1789440026.668889 mapread 0x00d8fc thru 0x0145dd (0x6ce2 bytes) 000625 1789440026.681726 trunc from 0x0145de to 0x027a54 (0x13477 bytes) 000626 1789440026.711889 punch from 0x0013c2 to 0x003824 (0x2463 bytes) 000627 1789440026.722459 punch from 0x008168 to 0x014dcc (0xcc65 bytes) 000628 1789440026.731592 trunc from 0x027a55 to 0x036170 (0xe71c bytes) 000629 1789440026.748189 punch from 0x02c306 to 0x036170 (0x9e6b bytes) 000630 1789440026.752837 read 0x01e93d thru 0x02c5f4 (0xdcb8 bytes) 000633 1789440026.767665 mapread 0x015918 thru 0x02359f (0xdc88 bytes) 000634 1789440026.768715 write 0x03911f thru 0x03cb30 (0x3a12 bytes) 000635 1789440026.776563 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3cb31): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb31): Mirror 7: 0x4a84cd7c (stale) Mirror 10: 0x4a84cd7c (stale) Mirror 13: 0x4a84cd7c (stale) Mirror 16: 0x4a84cd7c (stale) Mirror 18: 0x4a84cd7c (stale) Mirror 19: 0x4a84cd7c (stale) Mirror 20: 0x4a84cd7c (stale) Mirror 21: 0x4a84cd7c (stale) Mirror 22: 0x4a84cd7c (stale) CRC-32 checksum value for chunk [0, 0x3cb31): Mirror 1: 0x9012cdbd Mirror 23: 0x9012cdbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb31: skipped 000638 1789440027.866803 mapread 0x01d876 thru 0x029113 (0xb89e bytes) 000640 1789440027.917593 trunc from 0x03cb31 to 0x00b61f (0x31511 bytes) 000643 1789440027.999876 write 0x00dd11 thru 0x0162b3 (0x85a3 bytes) 000645 1789440028.002620 trunc from 0x0162b4 to 0x0320dc (0x1be29 bytes) 000647 1789440028.019870 mapread 0x02d40b thru 0x0320dc (0x4cd2 bytes) 000648 1789440028.033715 MIRROR_RESYNC 11 mirrors 000650 1789440029.878208 trunc from 0x0320dd to 0x03436b (0x228f bytes) 000651 1789440029.970600 mapread 0x024cfd thru 0x02c1fc (0x7500 bytes) 000652 1789440030.005239 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3436c): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3436c): Mirror 7: 0x34aba279 (stale) Mirror 10: 0x34aba279 (stale) Mirror 13: 0x34aba279 (stale) Mirror 16: 0x34aba279 (stale) Mirror 18: 0x34aba279 (stale) Mirror 19: 0x34aba279 (stale) Mirror 20: 0x34aba279 (stale) Mirror 21: 0x34aba279 (stale) Mirror 22: 0x34aba279 (stale) Mirror 23: 0x34aba279 (stale) CRC-32 checksum value for chunk [0, 0x3436c): Mirror 1: 0x34aba279 Mirror 24: 0x34aba279 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3436c: skipped 000654 1789440031.307335 write 0x019bfb thru 0x01e957 (0x4d5d bytes) 000656 1789440031.406774 MIRROR_RESYNC 12 mirrors 000657 1789440033.947843 punch from 0x01f730 to 0x02604c (0x691d bytes) 000658 1789440034.002509 punch from 0x021a6f to 0x02d0e6 (0xb678 bytes) 000660 1789440034.008891 punch from 0x004d93 to 0x00e333 (0x95a1 bytes) 000661 1789440034.016058 mapread 0x0198fc thru 0x01f869 (0x5f6e bytes) 000662 1789440034.032108 mapwrite 0x01981a thru 0x0207b3 (0x6f9a bytes) 000663 1789440034.102729 MIRROR_RESYNC 12 mirrors 000665 1789440036.374984 mapwrite 0x005cf2 thru 0x013ce5 (0xdff4 bytes) 000666 1789440036.572828 trunc from 0x03436c to 0x03a536 (0x61cb bytes) 000667 1789440036.628622 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a537): Mirror 7: 0x1ff21c5a (stale) Mirror 10: 0x1ff21c5a (stale) Mirror 13: 0x1ff21c5a (stale) Mirror 16: 0x1ff21c5a (stale) Mirror 18: 0x1ff21c5a (stale) Mirror 19: 0x1ff21c5a (stale) Mirror 20: 0x1ff21c5a (stale) Mirror 22: 0x1ff21c5a (stale) Mirror 23: 0x1ff21c5a (stale) Mirror 24: 0x1ff21c5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a537): Mirror 7: 0x1ff21c5a (stale) Mirror 10: 0x1ff21c5a (stale) Mirror 13: 0x1ff21c5a (stale) Mirror 16: 0x1ff21c5a (stale) Mirror 18: 0x1ff21c5a (stale) Mirror 19: 0x1ff21c5a (stale) Mirror 20: 0x1ff21c5a (stale) Mirror 22: 0x1ff21c5a (stale) Mirror 23: 0x1ff21c5a (stale) Mirror 24: 0x1ff21c5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a537: skipped 000668 1789440037.187830 punch from 0x017272 to 0x0253fe (0xe18d bytes) 000669 1789440037.192103 punch from 0x01d6c1 to 0x01ed31 (0x1671 bytes) 000670 1789440037.195824 read 0x00e54f thru 0x0123b0 (0x3e62 bytes) 000672 1789440037.204201 read 0x02b847 thru 0x030510 (0x4cca bytes) 000673 1789440037.212680 write 0x03db83 thru 0x03ffff (0x247d bytes) 000675 1789440037.218218 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9e7e0b23 (stale) Mirror 13: 0x9e7e0b23 (stale) Mirror 16: 0x9e7e0b23 (stale) Mirror 18: 0x9e7e0b23 (stale) Mirror 19: 0x9e7e0b23 (stale) Mirror 20: 0x9e7e0b23 (stale) Mirror 22: 0x9e7e0b23 (stale) Mirror 23: 0x9e7e0b23 (stale) Mirror 24: 0x9e7e0b23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9e7e0b23 (stale) Mirror 13: 0x9e7e0b23 (stale) Mirror 16: 0x9e7e0b23 (stale) Mirror 18: 0x9e7e0b23 (stale) Mirror 19: 0x9e7e0b23 (stale) Mirror 20: 0x9e7e0b23 (stale) Mirror 22: 0x9e7e0b23 (stale) Mirror 23: 0x9e7e0b23 (stale) Mirror 24: 0x9e7e0b23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000676 1789440037.837689 punch from 0x0076c7 to 0x008cf5 (0x162f bytes) 000677 1789440037.859937 write 0x03c805 thru 0x03ffff (0x37fb bytes) 000678 1789440037.866870 mapread 0x01dce4 thru 0x026eff (0x921c bytes) 000680 1789440037.890363 write 0x0372e1 thru 0x03ffff (0x8d1f bytes) 000681 1789440037.900752 write 0x0376a7 thru 0x03ffff (0x8959 bytes) 000682 1789440037.905679 write 0x020e62 thru 0x027f88 (0x7127 bytes) 000683 1789440037.909450 write 0x033f5b thru 0x03a713 (0x67b9 bytes) 000684 1789440037.932089 mapwrite 0x017186 thru 0x01db74 (0x69ef bytes) 000685 1789440038.025975 mapwrite 0x03f4ed thru 0x03ffff (0xb13 bytes) 000686 1789440038.066927 mapwrite 0x02b6df thru 0x039955 (0xe277 bytes) 000687 1789440038.144921 punch from 0x03c8f0 to 0x03ffff (0x3710 bytes) 000688 1789440038.151122 trunc from 0x040000 to 0x0038ef (0x3c710 bytes) 000690 1789440038.179811 trunc from 0x0038f0 to 0x0273ba (0x23acb bytes) 000691 1789440038.200484 trunc from 0x0273bb to 0x0017b6 (0x25c04 bytes) 000693 1789440038.224635 read 0x000ba9 thru 0x0017b6 (0xc0e bytes) 000694 1789440038.234703 mapread 0x000337 thru 0x0017b6 (0x1480 bytes) 000695 1789440038.236406 mapread 0x0004fc thru 0x0017b6 (0x12bb bytes) 000696 1789440038.237928 read 0x000cc8 thru 0x0017b6 (0xaef bytes) 000697 1789440038.239180 punch from 0x000e65 to 0x0017b6 (0x952 bytes) 000698 1789440038.244511 write 0x03ff29 thru 0x03ffff (0xd7 bytes) 000699 1789440038.245530 mapwrite 0x01f3d1 thru 0x02d051 (0xdc81 bytes) 000700 1789440038.346082 MIRROR_RESYNC 10 mirrors 000701 1789440039.756597 mapwrite 0x027266 thru 0x029a0f (0x27aa bytes) 000704 1789440039.955374 trunc from 0x040000 to 0x00beaa (0x34155 bytes) 000706 1789440039.990716 punch from 0x000677 to 0x00812d (0x7ab7 bytes) 000708 1789440039.996246 punch from 0x00531a to 0x00b64f (0x6336 bytes) 000709 1789440040.004400 mapwrite 0x023140 thru 0x028653 (0x5514 bytes) 000710 1789440040.065775 trunc from 0x028654 to 0x03c531 (0x13ede bytes) 000711 1789440040.078428 read 0x02a77f thru 0x03558f (0xae11 bytes) 000717 1789440040.088999 mapread 0x0117ab thru 0x01d5f4 (0xbe4a bytes) 000718 1789440040.110502 mapwrite 0x013ce6 thru 0x01b260 (0x757b bytes) 000719 1789440040.180321 write 0x005c90 thru 0x00c8ef (0x6c60 bytes) 000721 1789440040.186589 mapread 0x015603 thru 0x015a13 (0x411 bytes) 000723 1789440040.187941 mapwrite 0x0047e0 thru 0x007b8e (0x33af bytes) 000724 1789440040.253996 mapread 0x03c4e8 thru 0x03c531 (0x4a bytes) 000725 1789440040.262569 read 0x00dcb3 thru 0x017880 (0x9bce bytes) 000727 1789440040.264669 trunc from 0x03c532 to 0x00b951 (0x30be0 bytes) 000728 1789440040.287511 punch from 0x00649c to 0x00b951 (0x54b6 bytes) 000729 1789440040.295923 punch from 0x0070e1 to 0x00b951 (0x4871 bytes) 000732 1789440040.301528 write 0x035937 thru 0x03ffff (0xa6c9 bytes) 000734 1789440040.303417 trunc from 0x040000 to 0x00587a (0x3a785 bytes) 000736 1789440040.333094 trunc from 0x00587b to 0x03ae7f (0x35605 bytes) 000737 1789440040.352733 punch from 0x02a546 to 0x035169 (0xac24 bytes) 000738 1789440040.362614 MIRROR_RESYNC 10 mirrors 000739 1789440043.091375 read 0x0286f0 thru 0x02f9b9 (0x72ca bytes) 000741 1789440043.108231 write 0x03042f thru 0x03aa62 (0xa634 bytes) 000743 1789440043.240890 trunc from 0x03ae80 to 0x0308e1 (0xa59e bytes) 000744 1789440043.275724 mapwrite 0x02bb0a thru 0x032661 (0x6b58 bytes) 000745 1789440043.381730 mapread 0x008820 thru 0x00eb6b (0x634c bytes) 000746 1789440043.405850 trunc from 0x032662 to 0x03c6f8 (0xa097 bytes) 000747 1789440043.425664 mapread 0x038bb5 thru 0x03965b (0xaa7 bytes) 000748 1789440043.443261 mapread 0x03a1ab thru 0x03b4f0 (0x1346 bytes) 000751 1789440043.447922 read 0x01857f thru 0x0244a2 (0xbf24 bytes) 000752 1789440043.490440 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c6f9): Mirror 7: 0x8ca712b2 (stale) Mirror 13: 0x8ca712b2 (stale) Mirror 18: 0x8ca712b2 (stale) Mirror 19: 0x8ca712b2 (stale) Mirror 20: 0x8ca712b2 (stale) Mirror 22: 0x8ca712b2 (stale) Mirror 23: 0x8ca712b2 (stale) Mirror 24: 0x8ca712b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c6f9): Mirror 7: 0x8ca712b2 (stale) Mirror 13: 0x8ca712b2 (stale) Mirror 18: 0x8ca712b2 (stale) Mirror 19: 0x8ca712b2 (stale) Mirror 20: 0x8ca712b2 (stale) Mirror 22: 0x8ca712b2 (stale) Mirror 23: 0x8ca712b2 (stale) Mirror 24: 0x8ca712b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c6f9: skipped 000753 1789440044.019605 mapwrite 0x02b01f thru 0x034396 (0x9378 bytes) 000754 1789440044.089617 trunc from 0x03c6f9 to 0x039d39 (0x29bf bytes) 000755 1789440044.133716 MIRROR_RESYNC 9 mirrors 000757 1789440046.080377 punch from 0x01a670 to 0x01f7f6 (0x5187 bytes) 000760 1789440046.152641 mapread 0x0370cb thru 0x039d39 (0x2c6f bytes) 000761 1789440046.169661 punch from 0x003623 to 0x00e90b (0xb2e9 bytes) 000762 1789440046.174005 mapread 0x004e0e thru 0x00c334 (0x7527 bytes) 000766 1789440046.189589 write 0x01189c thru 0x01a6e6 (0x8e4b bytes) 000768 1789440046.202117 read 0x019109 thru 0x01e079 (0x4f71 bytes) 000773 1789440046.211974 punch from 0x01e503 to 0x021d38 (0x3836 bytes) 000774 1789440046.225339 write 0x02da43 thru 0x0375af (0x9b6d bytes) 000775 1789440046.231076 mapread 0x008f8c thru 0x013eca (0xaf3f bytes) 000776 1789440046.236599 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39d3a): Mirror 7: 0x498b04bb (stale) Mirror 13: 0x498b04bb (stale) Mirror 18: 0x498b04bb (stale) Mirror 19: 0x498b04bb (stale) Mirror 22: 0x498b04bb (stale) Mirror 23: 0x498b04bb (stale) Mirror 24: 0x498b04bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d3a): Mirror 7: 0x498b04bb (stale) Mirror 13: 0x498b04bb (stale) Mirror 18: 0x498b04bb (stale) Mirror 19: 0x498b04bb (stale) Mirror 22: 0x498b04bb (stale) Mirror 23: 0x498b04bb (stale) Mirror 24: 0x498b04bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d3a: skipped 000777 1789440046.716806 mapwrite 0x014fe3 thru 0x024d4c (0xfd6a bytes) 000778 1789440046.838863 mapread 0x01ce12 thru 0x01e276 (0x1465 bytes) 000779 1789440046.839952 punch from 0x0172c2 to 0x01a4c8 (0x3207 bytes) 000780 1789440046.845759 write 0x03d65a thru 0x03ffff (0x29a6 bytes) 000782 1789440046.850253 mapwrite 0x02cd0b thru 0x032367 (0x565d bytes) 000784 1789440046.946767 mapread 0x02fd8d thru 0x03d5be (0xd832 bytes) 000785 1789440046.969494 punch from 0x02b165 to 0x0382dd (0xd179 bytes) 000786 1789440046.975387 mapread 0x0197c7 thru 0x020bc4 (0x73fe bytes) 000787 1789440046.984004 trunc from 0x040000 to 0x03362c (0xc9d3 bytes) 000788 1789440047.020242 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3362d): Mirror 7: 0xa7108b06 (stale) Mirror 13: 0xa7108b06 (stale) Mirror 18: 0xa7108b06 (stale) Mirror 19: 0xa7108b06 (stale) Mirror 23: 0xa7108b06 (stale) Mirror 24: 0xa7108b06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3362d): Mirror 7: 0xa7108b06 (stale) Mirror 13: 0xa7108b06 (stale) Mirror 18: 0xa7108b06 (stale) Mirror 19: 0xa7108b06 (stale) Mirror 23: 0xa7108b06 (stale) Mirror 24: 0xa7108b06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3362d: skipped 000789 1789440047.408013 mapwrite 0x00af85 thru 0x010092 (0x510e bytes) 000792 1789440047.475053 mapread 0x02c60e thru 0x03362c (0x701f bytes) 000794 1789440047.489769 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3362d): Mirror 7: 0xa7108b06 (stale) Mirror 13: 0xa7108b06 (stale) Mirror 18: 0xa7108b06 (stale) Mirror 23: 0xa7108b06 (stale) Mirror 24: 0xa7108b06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3362d): Mirror 7: 0xa7108b06 (stale) Mirror 13: 0xa7108b06 (stale) Mirror 18: 0xa7108b06 (stale) Mirror 23: 0xa7108b06 (stale) Mirror 24: 0xa7108b06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3362d: skipped 000795 1789440047.953528 MIRROR_RESYNC 6 mirrors 000796 1789440048.842513 mapwrite 0x038772 thru 0x03f351 (0x6be0 bytes) 000797 1789440049.042680 mapread 0x0380e4 thru 0x03d7e6 (0x5703 bytes) 000798 1789440049.047048 punch from 0x00808e to 0x00dcb6 (0x5c29 bytes) 000799 1789440049.052305 punch from 0x038878 to 0x03f351 (0x6ada bytes) 000800 1789440049.056500 mapread 0x00dc45 thru 0x016353 (0x870f bytes) 000801 1789440049.077674 MIRROR_RESYNC 6 mirrors 000802 1789440050.167197 MIRROR_EXTEND to 7 mirrors 000803 1789440050.938833 read 0x0079fe thru 0x0105a1 (0x8ba4 bytes) 000804 1789440050.949523 mapread 0x02ae80 thru 0x02e3be (0x353f bytes) 000805 1789440050.978128 read 0x0035ba thru 0x012f14 (0xf95b bytes) 000807 1789440051.050713 mapwrite 0x0165cf thru 0x019312 (0x2d44 bytes) 000808 1789440051.221882 write 0x012320 thru 0x01b48b (0x916c bytes) 000809 1789440051.230218 mapread 0x028a55 thru 0x02c432 (0x39de bytes) 000810 1789440051.252855 mapwrite 0x01fd67 thru 0x026923 (0x6bbd bytes) 000811 1789440051.325767 punch from 0x0137ea to 0x023402 (0xfc19 bytes) 000812 1789440051.330903 mapread 0x0079bd thru 0x0122ab (0xa8ef bytes) 000813 1789440051.377660 mapwrite 0x0121ea thru 0x019dbb (0x7bd2 bytes) 000814 1789440051.444900 mapwrite 0x004c6b thru 0x0108da (0xbc70 bytes) 000815 1789440051.496648 mapread 0x025cfd thru 0x031462 (0xb766 bytes) 000816 1789440051.543819 read 0x006779 thru 0x014797 (0xe01f bytes) 000817 1789440051.545422 write 0x005719 thru 0x00a083 (0x496b bytes) 000819 1789440051.546863 trunc from 0x03f352 to 0x01c45a (0x22ef7 bytes) 000820 1789440051.579337 mapread 0x014ff5 thru 0x01c45a (0x7466 bytes) 000821 1789440051.590409 trunc from 0x01c45b to 0x014359 (0x8101 bytes) 000823 1789440051.622434 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1435a): Mirror 7: 0xabc9d37c (stale) Mirror 13: 0xabc9d37c (stale) Mirror 23: 0xabc9d37c (stale) Mirror 24: 0xabc9d37c (stale) Mirror 25: 0xabc9d37c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1435a): Mirror 7: 0xabc9d37c (stale) Mirror 13: 0xabc9d37c (stale) Mirror 23: 0xabc9d37c (stale) Mirror 24: 0xabc9d37c (stale) Mirror 25: 0xabc9d37c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1435a: skipped 000824 1789440052.108472 trunc from 0x01435a to 0x017234 (0x2edb bytes) 000825 1789440052.135362 write 0x01ae6e thru 0x023a68 (0x8bfb bytes) 000826 1789440052.137310 mapread 0x019a46 thru 0x01a68a (0xc45 bytes) 000827 1789440052.147202 mapread 0x003fd8 thru 0x0125da (0xe603 bytes) 000831 1789440052.169842 mapread 0x00eebf thru 0x01e2c8 (0xf40a bytes) 000832 1789440052.170841 mapread 0x021c23 thru 0x023a68 (0x1e46 bytes) 000833 1789440052.174509 punch from 0x01c922 to 0x023a68 (0x7147 bytes) 000835 1789440052.210848 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x23a69): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23a69): Mirror 7: 0x83f3e0d7 (stale) Mirror 13: 0x83f3e0d7 (stale) Mirror 23: 0x83f3e0d7 (stale) Mirror 24: 0x83f3e0d7 (stale) Mirror 25: 0x83f3e0d7 (stale) CRC-32 checksum value for chunk [0, 0x23a69): Mirror 1: 0xa6d8e105 Mirror 26: 0xa6d8e105 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23a69: skipped 000836 1789440053.145982 read 0x012bb0 thru 0x01afcc (0x841d bytes) 000837 1789440053.162153 mapread 0x01c091 thru 0x0225a5 (0x6515 bytes) 000839 1789440053.216837 mapwrite 0x029da5 thru 0x02f938 (0x5b94 bytes) 000840 1789440053.385451 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f939): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f939): Mirror 7: 0x6389a052 (stale) Mirror 13: 0x6389a052 (stale) Mirror 23: 0x6389a052 (stale) Mirror 24: 0x6389a052 (stale) Mirror 25: 0x6389a052 (stale) Mirror 26: 0x5a61ae94 (stale) CRC-32 checksum value for chunk [0, 0x2f939): Mirror 1: 0x39437c8c Mirror 27: 0x39437c8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f939: skipped 000842 1789440054.149412 write 0x019631 thru 0x0267a0 (0xd170 bytes) 000843 1789440054.240774 mapwrite 0x00ca0d thru 0x0114be (0x4ab2 bytes) 000844 1789440054.358531 trunc from 0x02f939 to 0x01b5df (0x14359 bytes) 000846 1789440054.409751 MIRROR_RESYNC 8 mirrors 000849 1789440055.517541 punch from 0x018e6a to 0x01a015 (0x11ac bytes) 000850 1789440055.583747 write 0x02d2fb thru 0x037e5a (0xab60 bytes) 000851 1789440055.585558 mapwrite 0x02485f thru 0x02cea7 (0x8649 bytes) 000852 1789440055.675739 read 0x025c16 thru 0x030b01 (0xaeec bytes) 000853 1789440055.676367 read 0x03446d thru 0x037e5a (0x39ee bytes) 000854 1789440055.676873 mapread 0x01a22c thru 0x02785f (0xd634 bytes) 000855 1789440055.686605 trunc from 0x037e5b to 0x014848 (0x23612 bytes) 000857 1789440055.707313 trunc from 0x014849 to 0x010a35 (0x3e13 bytes) 000858 1789440055.723963 mapread 0x00e9f7 thru 0x00ed81 (0x38b bytes) 000859 1789440055.725375 punch from 0x00c310 to 0x010a35 (0x4726 bytes) 000861 1789440055.731626 mapread 0x000b4d thru 0x00aeb2 (0xa366 bytes) 000864 1789440055.734135 trunc from 0x010a36 to 0x0311e7 (0x207b2 bytes) 000865 1789440055.765915 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x311e8): Mirror 7: 0xd6f6461a (stale) Mirror 13: 0xd6f6461a (stale) Mirror 23: 0xd6f6461a (stale) Mirror 24: 0xd6f6461a (stale) Mirror 25: 0xd6f6461a (stale) Mirror 26: 0xd6f6461a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x311e8): Mirror 7: 0xd6f6461a (stale) Mirror 13: 0xd6f6461a (stale) Mirror 23: 0xd6f6461a (stale) Mirror 24: 0xd6f6461a (stale) Mirror 25: 0xd6f6461a (stale) Mirror 26: 0xd6f6461a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x311e8: skipped 000866 1789440056.266852 trunc from 0x0311e8 to 0x036893 (0x56ac bytes) 000867 1789440056.290273 punch from 0x001be5 to 0x0115f1 (0xfa0d bytes) 000871 1789440056.305681 mapwrite 0x019634 thru 0x021afe (0x84cb bytes) 000873 1789440056.404686 read 0x023d9c thru 0x02f095 (0xb2fa bytes) 000874 1789440056.415356 mapwrite 0x02924e thru 0x0301bd (0x6f70 bytes) 000875 1789440056.488465 trunc from 0x036894 to 0x021129 (0x1576a bytes) 000877 1789440056.517277 write 0x002203 thru 0x00dd4a (0xbb48 bytes) 000878 1789440056.529300 read 0x00a610 thru 0x00f64e (0x503f bytes) 000879 1789440056.531064 punch from 0x009043 to 0x0147a6 (0xb764 bytes) 000882 1789440056.549322 trunc from 0x02112a to 0x003bc2 (0x1d567 bytes) 000883 1789440056.574813 MIRROR_RESYNC 7 mirrors 000884 1789440057.667562 write 0x00cbc7 thru 0x019cdf (0xd119 bytes) 000885 1789440057.746386 mapwrite 0x004f0e thru 0x01294e (0xda41 bytes) 000886 1789440057.813259 trunc from 0x019ce0 to 0x02940c (0xf72d bytes) 000887 1789440057.830564 punch from 0x016baf to 0x023b09 (0xcf5b bytes) 000888 1789440057.834140 mapread 0x002f96 thru 0x006219 (0x3284 bytes) 000890 1789440057.838587 mapwrite 0x0192b6 thru 0x01cda4 (0x3aef bytes) 000891 1789440057.901748 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2940d): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2940d): Mirror 7: 0x3a7fd611 (stale) Mirror 13: 0x3a7fd611 (stale) Mirror 23: 0x3a7fd611 (stale) Mirror 24: 0x3a7fd611 (stale) Mirror 25: 0x3a7fd611 (stale) Mirror 26: 0x3a7fd611 (stale) CRC-32 checksum value for chunk [0, 0x2940d): Mirror 1: 0x7d23e134 Mirror 27: 0x7d23e134 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2940d: skipped 000892 1789440058.930976 write 0x038b22 thru 0x03f2ea (0x67c9 bytes) 000893 1789440059.007188 punch from 0x039d10 to 0x03ea8b (0x4d7c bytes) 000894 1789440059.024433 read 0x00a76b thru 0x00ad9c (0x632 bytes) 000896 1789440059.032616 trunc from 0x03f2eb to 0x03ae3e (0x44ac bytes) 000898 1789440059.059604 read 0x00a30f thru 0x0119ee (0x76e0 bytes) 000900 1789440059.082453 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ae3f): Mirror 13: 0x80ca5964 (stale) Mirror 23: 0x80ca5964 (stale) Mirror 24: 0x80ca5964 (stale) Mirror 25: 0x80ca5964 (stale) Mirror 26: 0x80ca5964 (stale) Mirror 27: 0xff053c93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae3f): Mirror 13: 0x80ca5964 (stale) Mirror 23: 0x80ca5964 (stale) Mirror 24: 0x80ca5964 (stale) Mirror 25: 0x80ca5964 (stale) Mirror 26: 0x80ca5964 (stale) Mirror 27: 0xff053c93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae3f: skipped 000901 1789440059.525499 read 0x004f2b thru 0x007559 (0x262f bytes) 000903 1789440059.532466 mapwrite 0x0136c6 thru 0x01fddd (0xc718 bytes) 000904 1789440059.619446 mapread 0x02b81f thru 0x02e8f1 (0x30d3 bytes) 000908 1789440059.639391 write 0x02a4bf thru 0x038e61 (0xe9a3 bytes) 000909 1789440059.647087 write 0x01d770 thru 0x022aac (0x533d bytes) 000910 1789440059.662297 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ae3f): Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae3f): Mirror 13: 0x80ca5964 (stale) Mirror 23: 0x80ca5964 (stale) Mirror 24: 0x80ca5964 (stale) Mirror 25: 0x80ca5964 (stale) Mirror 26: 0x80ca5964 (stale) Mirror 27: 0xff053c93 (stale) CRC-32 checksum value for chunk [0, 0x3ae3f): Mirror 1: 0x23867657 Mirror 28: 0x23867657 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae3f: skipped 000912 1789440060.561670 trunc from 0x03ae3f to 0x03e6f5 (0x38b7 bytes) 000913 1789440060.665810 trunc from 0x03e6f6 to 0x029033 (0x156c2 bytes) 000914 1789440060.691212 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x29034): Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29034): Mirror 13: 0xfe4877ad (stale) Mirror 23: 0xfe4877ad (stale) Mirror 24: 0xfe4877ad (stale) Mirror 25: 0xfe4877ad (stale) Mirror 26: 0xfe4877ad (stale) Mirror 27: 0x285322d1 (stale) Mirror 28: 0x10b09f2 (stale) CRC-32 checksum value for chunk [0, 0x29034): Mirror 1: 0x10b09f2 Mirror 29: 0x10b09f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29034: skipped 000915 1789440061.511458 punch from 0x008298 to 0x0156da (0xd443 bytes) 000916 1789440061.609793 trunc from 0x029034 to 0x00925a (0x1fdd9 bytes) 000917 1789440061.629360 write 0x00ba54 thru 0x013ad6 (0x8083 bytes) 000918 1789440061.631372 read 0x011bf9 thru 0x013ad6 (0x1ede bytes) 000919 1789440061.632503 read 0x00b102 thru 0x00cca2 (0x1ba1 bytes) 000920 1789440061.637642 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13ad7): Mirror 13: 0xf92ded14 (stale) Mirror 23: 0xf92ded14 (stale) Mirror 24: 0xf92ded14 (stale) Mirror 25: 0xf92ded14 (stale) Mirror 26: 0xf92ded14 (stale) Mirror 27: 0x29ac0fc2 (stale) Mirror 29: 0x215f5151 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ad7): Mirror 13: 0xf92ded14 (stale) Mirror 23: 0xf92ded14 (stale) Mirror 24: 0xf92ded14 (stale) Mirror 25: 0xf92ded14 (stale) Mirror 26: 0xf92ded14 (stale) Mirror 27: 0x29ac0fc2 (stale) Mirror 29: 0x215f5151 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ad7: skipped 000921 1789440062.001857 write 0x0014c5 thru 0x00b774 (0xa2b0 bytes) 000922 1789440062.010481 trunc from 0x013ad7 to 0x014cf4 (0x121e bytes) 000924 1789440062.031633 mapread 0x0065fb thru 0x0135ac (0xcfb2 bytes) 000925 1789440062.076428 mapwrite 0x023f7c thru 0x02c481 (0x8506 bytes) 000926 1789440062.152172 mapwrite 0x015ee4 thru 0x01ed8f (0x8eac bytes) 000927 1789440062.230438 punch from 0x01a2a6 to 0x02017f (0x5eda bytes) 000929 1789440062.235674 read 0x0232fd thru 0x02a241 (0x6f45 bytes) 000930 1789440062.236415 punch from 0x0060d4 to 0x00fc80 (0x9bad bytes) 000931 1789440062.243645 punch from 0x012861 to 0x01a240 (0x79e0 bytes) 000935 1789440062.249541 mapwrite 0x03702d thru 0x03ffff (0x8fd3 bytes) 000937 1789440062.343065 read 0x0011ac thru 0x0088b3 (0x7708 bytes) 000938 1789440062.358869 mapread 0x004104 thru 0x011927 (0xd824 bytes) 000939 1789440062.359906 read 0x010e33 thru 0x016945 (0x5b13 bytes) 000940 1789440062.364959 mapwrite 0x035073 thru 0x03ffff (0xaf8d bytes) 000942 1789440062.413330 write 0x03bfe5 thru 0x03ffff (0x401b bytes) 000943 1789440062.414470 trunc from 0x040000 to 0x01d540 (0x22abf bytes) 000944 1789440062.448163 read 0x007e8e thru 0x008c1e (0xd91 bytes) 000945 1789440062.448739 punch from 0x01c9fd to 0x01d540 (0xb44 bytes) 000946 1789440062.456138 punch from 0x01c55d to 0x01d540 (0xfe4 bytes) 000948 1789440062.461774 write 0x006a01 thru 0x015289 (0xe889 bytes) 000950 1789440062.464777 punch from 0x01660d to 0x01d540 (0x6f34 bytes) 000951 1789440062.485157 punch from 0x01b899 to 0x01d540 (0x1ca8 bytes) 000952 1789440062.490690 punch from 0x0022f7 to 0x010baf (0xe8b9 bytes) 000953 1789440062.501182 write 0x01918a thru 0x021100 (0x7f77 bytes) 000954 1789440062.523333 mapwrite 0x00dd69 thru 0x017b38 (0x9dd0 bytes) 000955 1789440062.583362 trunc from 0x021101 to 0x00001d (0x210e3 bytes) 000956 1789440062.604353 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1e): Mirror 13: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e): Mirror 13: 0x43eb5 (stale) Mirror 23: 0x43eb5 (stale) Mirror 24: 0x43eb5 (stale) Mirror 25: 0x43eb5 (stale) Mirror 26: 0x43eb5 (stale) Mirror 27: 0x43eb5 (stale) Mirror 29: 0x43eb5 (stale) CRC-32 checksum value for chunk [0, 0x1e): Mirror 1: 0x43eb5 Mirror 30: 0x43eb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e: skipped 000962 1789440063.549915 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e): Mirror 23: 0x43eb5 (stale) Mirror 24: 0x43eb5 (stale) Mirror 25: 0x43eb5 (stale) Mirror 26: 0x43eb5 (stale) Mirror 27: 0x43eb5 (stale) Mirror 29: 0x43eb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e): Mirror 23: 0x43eb5 (stale) Mirror 24: 0x43eb5 (stale) Mirror 25: 0x43eb5 (stale) Mirror 26: 0x43eb5 (stale) Mirror 27: 0x43eb5 (stale) Mirror 29: 0x43eb5 (stale) CRC-32 checksum value for chunk [0, 0x1e): Mirror 1: 0x43eb5 Mirror 30: 0x43eb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e: skipped 000963 1789440064.082689 punch from 0x00000b to 0x00001d (0x13 bytes) 000964 1789440064.222831 mapread 0x00001c thru 0x00001d (0x2 bytes) 000966 1789440064.232602 write 0x039296 thru 0x03ffff (0x6d6a bytes) 000967 1789440064.233958 punch from 0x0187b5 to 0x02050f (0x7d5b bytes) 000968 1789440064.249943 read 0x014d91 thru 0x019dc5 (0x5035 bytes) 000969 1789440064.271796 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x9d674442 (stale) Mirror 24: 0x9d674442 (stale) Mirror 25: 0x9d674442 (stale) Mirror 26: 0x9d674442 (stale) Mirror 27: 0x630327d (stale) Mirror 30: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x9d674442 (stale) Mirror 24: 0x9d674442 (stale) Mirror 25: 0x9d674442 (stale) Mirror 26: 0x9d674442 (stale) Mirror 27: 0x630327d (stale) Mirror 30: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000971 1789440064.700941 mapread 0x018459 thru 0x023a44 (0xb5ec bytes) 000972 1789440064.730767 mapwrite 0x0139e9 thru 0x01508e (0x16a6 bytes) 000973 1789440064.826922 mapwrite 0x001eba thru 0x00f69b (0xd7e2 bytes) 000974 1789440064.901282 write 0x03104a thru 0x039d91 (0x8d48 bytes) 000975 1789440064.918381 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x9d674442 (stale) Mirror 25: 0x9d674442 (stale) Mirror 26: 0x9d674442 (stale) Mirror 27: 0x630327d (stale) Mirror 30: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x9d674442 (stale) Mirror 25: 0x9d674442 (stale) Mirror 26: 0x9d674442 (stale) Mirror 27: 0x630327d (stale) Mirror 30: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000976 1789440065.299771 mapwrite 0x0277dd thru 0x0279f2 (0x216 bytes) 000977 1789440065.390610 mapwrite 0x0140d8 thru 0x022791 (0xe6ba bytes) 000978 1789440065.471564 mapread 0x036e83 thru 0x03ffff (0x917d bytes) 000979 1789440065.486846 punch from 0x01aa88 to 0x02435f (0x98d8 bytes) 000980 1789440065.491521 punch from 0x00d0ea to 0x00fff1 (0x2f08 bytes) 000981 1789440065.498229 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x9d674442 (stale) Mirror 25: 0x9d674442 (stale) Mirror 26: 0x9d674442 (stale) Mirror 27: 0x630327d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x9d674442 (stale) Mirror 25: 0x9d674442 (stale) Mirror 26: 0x9d674442 (stale) Mirror 27: 0x630327d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000983 1789440065.819652 trunc from 0x040000 to 0x006a01 (0x395fe bytes) 000984 1789440065.840250 trunc from 0x006a02 to 0x01a7d9 (0x13dd8 bytes) 000985 1789440065.860278 mapread 0x004c33 thru 0x0143fa (0xf7c8 bytes) 000987 1789440065.913279 MIRROR_RESYNC 5 mirrors 000988 1789440067.029297 mapread 0x01286e thru 0x01a7d9 (0x7f6c bytes) 000989 1789440067.065885 MIRROR_RESYNC 5 mirrors 000991 1789440067.491780 write 0x0312c4 thru 0x03197f (0x6bc bytes) 000993 1789440067.557632 punch from 0x013e92 to 0x01f6a9 (0xb818 bytes) 000994 1789440067.573401 read 0x0061b2 thru 0x0112c3 (0xb112 bytes) 000996 1789440067.592772 trunc from 0x031980 to 0x00e274 (0x2370b bytes) 000997 1789440067.627939 punch from 0x00cef5 to 0x00dee5 (0xff1 bytes) 000998 1789440067.633430 read 0x00ac95 thru 0x00e274 (0x35e0 bytes) 000999 1789440067.646430 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe275): Mirror 24: 0xa7a3bbd4 (stale) Mirror 25: 0xa7a3bbd4 (stale) Mirror 27: 0xa7a3bbd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe275): Mirror 24: 0xa7a3bbd4 (stale) Mirror 25: 0xa7a3bbd4 (stale) Mirror 27: 0xa7a3bbd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe275: skipped 001000 1789440067.999225 read 0x0065ad thru 0x00c6ae (0x6102 bytes) All operations completed A-OK!