== sanity-flr test 70a: flr mode fsx test ================ 06:54:06 (1788864846) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 4848 skipping zero length zero range skipping zero size read 000004 1788864848.206480 mapwrite 0x00caa8 thru 0x01936e (0xc8c7 bytes) 000005 1788864848.269186 punch from 0x016ccc to 0x016d1e (0x53 bytes) 000006 1788864848.283337 mapread 0x009326 thru 0x012850 (0x952b bytes) fallocating to largest ever: 0xa10c 000007 1788864848.288091 fallocate 0x0006e4 thru 0x00a10b (0x9a28 bytes) 000008 1788864848.292479 write 0x024a95 thru 0x0343cb (0xf937 bytes) truncating to largest ever: 0xf43c 000009 1788864848.297641 trunc from 0x0343cc to 0x00f43b (0x24f90 bytes) 000011 1788864848.328520 trunc from 0x00a3a0 to 0x00f43b (0x509c bytes) truncating to largest ever: 0x39497 000012 1788864848.332494 trunc from 0x00f43c to 0x039496 (0x2a05b bytes) 000013 1788864848.344662 punch from 0x0311f2 to 0x039496 (0x82a5 bytes) 000014 1788864848.348734 trunc from 0x02699f to 0x032fe3 (0xc645 bytes) 000015 1788864848.353416 mapwrite 0x03bf03 thru 0x03ffff (0x40fd bytes) 000017 1788864848.396181 read 0x03e32a thru 0x03ffff (0x1cd6 bytes) 000018 1788864848.396768 mapread 0x0370bf thru 0x03ffff (0x8f41 bytes) 000019 1788864848.398283 punch from 0x014504 to 0x018e05 (0x4902 bytes) 000020 1788864848.403322 write 0x014540 thru 0x0158ec (0x13ad bytes) 000021 1788864848.410911 trunc from 0x040000 to 0x02353a (0x1cac5 bytes) 000023 1788864848.430540 read 0x002056 thru 0x00e501 (0xc4ac bytes) 000024 1788864848.470857 mapwrite 0x01fe4f thru 0x0274f8 (0x76aa bytes) 000026 1788864848.551654 write 0x014398 thru 0x01c11c (0x7d85 bytes) 000029 1788864848.565361 read 0x02471d thru 0x0274f8 (0x2ddc bytes) 000030 1788864848.567961 mapwrite 0x034c10 thru 0x03e2b2 (0x96a3 bytes) 000031 1788864848.648632 trunc from 0x03e2b3 to 0x010652 (0x2dc60 bytes) 000032 1788864848.668522 read 0x000ef9 thru 0x0017eb (0x8f3 bytes) truncating to largest ever: 0x39bc5 000033 1788864848.670358 trunc from 0x010653 to 0x039bc4 (0x29572 bytes) 000034 1788864848.682362 mapread 0x022d5f thru 0x028349 (0x55eb bytes) 000035 1788864848.704963 trunc from 0x02ac17 to 0x030b1b (0x5f05 bytes) 000036 1788864848.714333 trunc from 0x02108e to 0x02773d (0x66b0 bytes) 000038 1788864848.722256 write 0x020d9a thru 0x023b65 (0x2dcc bytes) 000039 1788864848.733245 read 0x00eb7e thru 0x017b5f (0x8fe2 bytes) 000040 1788864848.735344 write 0x0236b2 thru 0x02dec1 (0xa810 bytes) 000041 1788864848.756496 punch from 0x039152 to 0x039bc4 (0xa73 bytes) 000043 1788864848.762762 trunc from 0x01ab3e to 0x01d1f9 (0x26bc bytes) 000044 1788864848.775802 mapwrite 0x01ca1c thru 0x025a01 (0x8fe6 bytes) 000045 1788864848.814977 read 0x028c94 thru 0x029b61 (0xece bytes) 000046 1788864848.815576 trunc from 0x039bc5 to 0x02a692 (0xf532 bytes) 000047 1788864848.832946 punch from 0x01fbdf to 0x021891 (0x1cb3 bytes) 000048 1788864848.844659 fallocate 0x00b106 thru 0x00d38e (0x2289 bytes) 000049 1788864848.851477 mapwrite 0x0065ff thru 0x01067d (0xa07f bytes) 000050 1788864848.888243 punch from 0x006a5d to 0x009472 (0x2a16 bytes) 000051 1788864848.919039 MIRROR_EXTEND to 2 mirrors 000052 1788864849.576260 MIRROR_EXTEND to 3 mirrors 000053 1788864850.316594 punch from 0x0089d6 to 0x00915c (0x787 bytes) 000054 1788864850.357519 mapread 0x0060f4 thru 0x006dd3 (0xce0 bytes) 000055 1788864850.372758 MIRROR_RESYNC 3 mirrors 000056 1788864851.186266 mapwrite 0x021c9e thru 0x02bc53 (0x9fb6 bytes) 000057 1788864851.258891 mapread 0x0011b3 thru 0x00c029 (0xae77 bytes) 000058 1788864851.270730 fallocate 0x0289b5 thru 0x030ca2 (0x82ee bytes) 000059 1788864851.275392 fallocate 0x002cf3 thru 0x00aa4f (0x7d5d bytes) 000060 1788864851.279403 trunc from 0x02bc54 to 0x01a13c (0x11b17 bytes) 000062 1788864851.300813 write 0x00d904 thru 0x014195 (0x6892 bytes) 000063 1788864851.306852 mapread 0x00c39e thru 0x00dace (0x1731 bytes) 000064 1788864851.308410 punch from 0x009821 to 0x0188db (0xf0bb bytes) 000065 1788864851.327913 mapread 0x01977b thru 0x01a13c (0x9c2 bytes) 000066 1788864851.339581 mapread 0x00eef5 thru 0x01a13c (0xb248 bytes) 000067 1788864851.362750 mapread 0x012627 thru 0x01a13c (0x7b16 bytes) 000068 1788864851.364385 mapwrite 0x01dfba thru 0x023104 (0x514b bytes) 000070 1788864851.420250 read 0x015a8e thru 0x020981 (0xaef4 bytes) 000072 1788864851.437057 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x23105): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23105): Mirror 2: 0x7eccb268 (stale) Mirror 3: 0x7eccb268 (stale) CRC-32 checksum value for chunk [0, 0x23105): Mirror 1: 0x452fb115 Mirror 4: 0x452fb115 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23105: skipped 000074 1788864852.228400 mapread 0x011280 thru 0x017e84 (0x6c05 bytes) 000075 1788864852.264818 mapread 0x00e250 thru 0x010635 (0x23e6 bytes) 000076 1788864852.290672 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23105): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23105): Mirror 2: 0x7eccb268 (stale) Mirror 3: 0x7eccb268 (stale) CRC-32 checksum value for chunk [0, 0x23105): Mirror 1: 0x452fb115 Mirror 4: 0x452fb115 Mirror 5: 0x452fb115 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23105: skipped 000077 1788864853.003009 mapwrite 0x00d118 thru 0x0109b1 (0x389a bytes) 000078 1788864853.139294 mapwrite 0x02a7d8 thru 0x02f3d2 (0x4bfb bytes) 000079 1788864853.267698 mapread 0x00471d thru 0x0062da (0x1bbe bytes) 000080 1788864853.282867 trunc from 0x00ee54 to 0x011c8a (0x2e37 bytes) 000081 1788864853.298005 fallocate 0x0244f8 thru 0x028bc7 (0x46d0 bytes) 000082 1788864853.309782 trunc from 0x02f3d3 to 0x018d80 (0x16652 bytes) fallocating to largest ever: 0x40000 000084 1788864853.350235 fallocate 0x03fbe5 thru 0x03ffff (0x41b bytes) 000085 1788864853.357552 punch from 0x00ff73 to 0x01a764 (0xa7f2 bytes) 000086 1788864853.383318 MIRROR_RESYNC 5 mirrors 000087 1788864854.883758 mapwrite 0x020c67 thru 0x027133 (0x64cd bytes) 000088 1788864854.997367 read 0x0261e9 thru 0x02d434 (0x724c bytes) 000089 1788864855.011753 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd64ae5b5 (stale) Mirror 3: 0xd64ae5b5 (stale) Mirror 5: 0xd64ae5b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd64ae5b5 (stale) Mirror 3: 0xd64ae5b5 (stale) Mirror 5: 0xd64ae5b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000090 1788864855.359046 trunc from 0x019234 to 0x026919 (0xd6e6 bytes) 000091 1788864855.370247 punch from 0x022c59 to 0x032403 (0xf7ab bytes) 000092 1788864855.380011 punch from 0x00222e to 0x005e30 (0x3c03 bytes) 000093 1788864855.387148 trunc from 0x040000 to 0x032023 (0xdfdc bytes) 000094 1788864855.408420 trunc from 0x01c91e to 0x02222c (0x590f bytes) 000095 1788864855.414241 trunc from 0x00cbd8 to 0x0165fc (0x9a25 bytes) 000096 1788864855.419331 mapwrite 0x00b5f8 thru 0x00f6d0 (0x40d9 bytes) 000097 1788864855.482423 mapread 0x00b881 thru 0x012664 (0x6de4 bytes) 000098 1788864855.484311 trunc from 0x0213a0 to 0x025015 (0x3c76 bytes) 000099 1788864855.491843 write 0x024aa5 thru 0x032b87 (0xe0e3 bytes) 000100 1788864855.519462 mapwrite 0x03d541 thru 0x03ffff (0x2abf bytes) 000101 1788864855.575970 trunc from 0x00cdb6 to 0x00edad (0x1ff8 bytes) 000103 1788864855.582482 mapread 0x01268d thru 0x01ac26 (0x859a bytes) 000104 1788864855.596963 mapwrite 0x01a337 thru 0x02272d (0x83f7 bytes) 000106 1788864855.649480 MIRROR_RESYNC 4 mirrors 000107 1788864857.317899 punch from 0x026a22 to 0x0276e6 (0xcc5 bytes) 000108 1788864857.367507 punch from 0x01c850 to 0x028ad6 (0xc287 bytes) 000109 1788864857.376401 write 0x00c416 thru 0x0161ce (0x9db9 bytes) 000110 1788864857.399991 write 0x03a968 thru 0x03ffff (0x5698 bytes) 000111 1788864857.409065 read 0x03fdad thru 0x03ffff (0x253 bytes) 000112 1788864857.410548 mapread 0x027495 thru 0x036dce (0xf93a bytes) 000113 1788864857.446628 MIRROR_RESYNC 4 mirrors 000114 1788864859.108547 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) 000115 1788864859.560384 MIRROR_EXTEND to 4 mirrors 000116 1788864860.391624 fallocate 0x03d2fc thru 0x03ffff (0x2d04 bytes) 000117 1788864860.421208 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x72fbac06 (stale) Mirror 6: 0x72fbac06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x72fbac06 (stale) Mirror 6: 0x72fbac06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000118 1788864860.677107 write 0x005de9 thru 0x010cb3 (0xaecb bytes) 000119 1788864860.690781 mapwrite 0x01c7c7 thru 0x02c4cc (0xfd06 bytes) 000120 1788864860.735798 fallocate 0x019f51 thru 0x0243d1 (0xa481 bytes) 000121 1788864860.741281 mapwrite 0x03e7e2 thru 0x03ffff (0x181e bytes) 000122 1788864860.777125 trunc from 0x02d51a to 0x034e7b (0x7962 bytes) 000124 1788864860.790356 trunc from 0x003694 to 0x00a38d (0x6cfa bytes) 000125 1788864860.797424 mapwrite 0x01ba37 thru 0x01c6ee (0xcb8 bytes) 000126 1788864860.832398 mapwrite 0x0202ce thru 0x0226ff (0x2432 bytes) 000127 1788864860.892105 trunc from 0x040000 to 0x021f1b (0x1e0e4 bytes) 000129 1788864860.944828 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21f1c): Mirror 2: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f1c): Mirror 2: 0x2dccd18d (stale) Mirror 6: 0x2dccd18d (stale) CRC-32 checksum value for chunk [0, 0x21f1c): Mirror 1: 0xcebc1073 Mirror 7: 0xcebc1073 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f1c: skipped 000130 1788864862.101666 mapwrite 0x0314d1 thru 0x03e4fd (0xd02d bytes) 000131 1788864862.227581 mapread 0x025e30 thru 0x02ef47 (0x9118 bytes) 000132 1788864862.250142 trunc from 0x007741 to 0x0098bf (0x217f bytes) 000133 1788864862.256367 mapread 0x0211dc thru 0x02376c (0x2591 bytes) 000134 1788864862.257427 fallocate 0x001291 thru 0x00b6fd (0xa46d bytes) 000135 1788864862.263299 fallocate 0x02b9cf thru 0x038a13 (0xd045 bytes) 000136 1788864862.273041 fallocate 0x00546f thru 0x00f1c2 (0x9d54 bytes) 000137 1788864862.283661 trunc from 0x0106d9 to 0x01292d (0x2255 bytes) 000138 1788864862.294788 mapwrite 0x0328fd thru 0x039038 (0x673c bytes) 000139 1788864862.321636 punch from 0x013ef7 to 0x02230b (0xe415 bytes) 000140 1788864862.340494 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e4fe): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4fe): Mirror 2: 0xcc5c134e (stale) Mirror 6: 0xcc5c134e (stale) Mirror 7: 0x73ed5121 (stale) CRC-32 checksum value for chunk [0, 0x3e4fe): Mirror 1: 0xa8f5ee65 Mirror 8: 0xa8f5ee65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4fe: skipped 000141 1788864863.185149 mapwrite 0x023ead thru 0x02fc37 (0xbd8b bytes) 000142 1788864863.341624 trunc from 0x03e4fe to 0x0126ad (0x2be50 bytes) 000143 1788864863.394309 mapwrite 0x0019d2 thru 0x00292b (0xf5a bytes) 000144 1788864863.410764 punch from 0x00396f to 0x00cb25 (0x91b7 bytes) 000145 1788864863.418260 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x126ae): Mirror 2: 0x5e8bcef5 (stale) Mirror 6: 0x5e8bcef5 (stale) Mirror 8: 0xe3e59cb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x126ae): Mirror 2: 0x5e8bcef5 (stale) Mirror 6: 0x5e8bcef5 (stale) Mirror 8: 0xe3e59cb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x126ae: skipped 000146 1788864863.782472 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x126ae): Mirror 2: 0x5e8bcef5 (stale) Mirror 8: 0xe3e59cb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x126ae): Mirror 2: 0x5e8bcef5 (stale) Mirror 8: 0xe3e59cb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x126ae: skipped 000147 1788864864.085003 trunc from 0x0126ae to 0x0123ef (0x2be bytes) 000148 1788864864.100073 trunc from 0x011d95 to 0x0123ef (0x65b bytes) 000149 1788864864.104685 fallocate 0x038ce4 thru 0x03ffff (0x731c bytes) 000150 1788864864.109601 fallocate 0x022af1 thru 0x023914 (0xe24 bytes) 000151 1788864864.114587 read 0x01c439 thru 0x023914 (0x74dc bytes) 000152 1788864864.122763 mapwrite 0x000e5e thru 0x00a79f (0x9942 bytes) 000153 1788864864.156197 trunc from 0x007e28 to 0x010bcb (0x8da4 bytes) 000154 1788864864.160650 mapwrite 0x01de78 thru 0x02c820 (0xe9a9 bytes) 000155 1788864864.198968 punch from 0x00c88e to 0x013454 (0x6bc7 bytes) 000156 1788864864.203078 trunc from 0x02c821 to 0x00d330 (0x1f4f0 bytes) 000158 1788864864.220047 write 0x034328 thru 0x0391d0 (0x4ea9 bytes) 000159 1788864864.225055 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x391d1): Mirror 2: 0x852c77a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x391d1): Mirror 2: 0x852c77a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x391d1: skipped 000160 1788864864.447527 write 0x033dda thru 0x03962e (0x5855 bytes) 000161 1788864864.458271 mapread 0x032086 thru 0x039541 (0x74bc bytes) 000162 1788864864.463256 mapwrite 0x027ab4 thru 0x028ba7 (0x10f4 bytes) 000163 1788864864.501044 mapwrite 0x03eaa5 thru 0x03ffff (0x155b bytes) 000164 1788864864.565409 fallocate 0x029e18 thru 0x02a2c5 (0x4ae bytes) 000165 1788864864.580174 write 0x003bd4 thru 0x006b1f (0x2f4c bytes) 000166 1788864864.590031 trunc from 0x0035a6 to 0x00c713 (0x916e bytes) 000167 1788864864.606297 MIRROR_RESYNC 2 mirrors 000168 1788864865.235701 fallocate 0x026c00 thru 0x030240 (0x9641 bytes) 000169 1788864865.277266 trunc from 0x040000 to 0x03c408 (0x3bf7 bytes) 000170 1788864865.338605 trunc from 0x03c409 to 0x006e94 (0x35574 bytes) 000171 1788864865.367164 write 0x014f41 thru 0x01c691 (0x7751 bytes) 000172 1788864865.371479 trunc from 0x01c692 to 0x038c82 (0x1c5f1 bytes) 000173 1788864865.391314 fallocate 0x02060d thru 0x0277e9 (0x71dd bytes) 000174 1788864865.401698 trunc from 0x038c83 to 0x000689 (0x385f9 bytes) 000175 1788864865.450213 mapwrite 0x00b79d thru 0x01840e (0xcc72 bytes) 000176 1788864865.551292 fallocate 0x01fc4e thru 0x0264f8 (0x68ab bytes) 000177 1788864865.556555 read 0x012069 thru 0x016ab7 (0x4a4f bytes) 000178 1788864865.559632 read 0x0125ec thru 0x01870a (0x611f bytes) 000179 1788864865.560398 punch from 0x012802 to 0x01b641 (0x8e40 bytes) 000180 1788864865.566055 trunc from 0x0264f9 to 0x037522 (0x1102a bytes) 000181 1788864865.600379 fallocate 0x029c8e thru 0x0372d0 (0xd643 bytes) 000182 1788864865.615149 trunc from 0x00bfb9 to 0x00f655 (0x369d bytes) 000184 1788864865.627687 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37523): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37523): Mirror 2: 0x9709e616 (stale) CRC-32 checksum value for chunk [0, 0x37523): Mirror 1: 0x6a2f54e1 Mirror 3: 0x6a2f54e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37523: skipped 000185 1788864866.502591 mapwrite 0x008bdf thru 0x0136d7 (0xaaf9 bytes) 000186 1788864866.642506 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37523): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37523): Mirror 2: 0x9709e616 (stale) Mirror 3: 0x6a2f54e1 (stale) CRC-32 checksum value for chunk [0, 0x37523): Mirror 1: 0xbc5026a0 Mirror 4: 0xbc5026a0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37523: skipped 000188 1788864867.544643 trunc from 0x037523 to 0x006c0f (0x30913 bytes) 000189 1788864867.605938 trunc from 0x001bc8 to 0x0025ae (0x9e7 bytes) 000190 1788864867.610768 punch from 0x0020b8 to 0x006c0f (0x4b58 bytes) 000191 1788864867.614790 trunc from 0x006c10 to 0x00402c (0x2be3 bytes) 000192 1788864867.637847 fallocate 0x03ab7b thru 0x03ffff (0x5485 bytes) 000194 1788864867.649353 punch from 0x000a90 to 0x001e4d (0x13be bytes) 000195 1788864867.656039 trunc from 0x00402d to 0x00a786 (0x675a bytes) 000196 1788864867.676170 read 0x006c21 thru 0x0095a7 (0x2987 bytes) 000197 1788864867.686674 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xa787): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa787): Mirror 2: 0xe4c9233b (stale) Mirror 3: 0x5b6cbbcc (stale) Mirror 4: 0x9b5d9b (stale) CRC-32 checksum value for chunk [0, 0xa787): Mirror 1: 0x5b6cbbcc Mirror 5: 0x5b6cbbcc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa787: skipped 000198 1788864868.638948 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xa787): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa787): Mirror 2: 0xe4c9233b (stale) Mirror 3: 0x5b6cbbcc (stale) Mirror 4: 0x9b5d9b (stale) CRC-32 checksum value for chunk [0, 0xa787): Mirror 1: 0x5b6cbbcc Mirror 5: 0x5b6cbbcc Mirror 6: 0x5b6cbbcc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa787: skipped 000199 1788864869.557947 fallocate 0x036039 thru 0x036603 (0x5cb bytes) 000200 1788864869.592260 write 0x0063f9 thru 0x00ed69 (0x8971 bytes) 000202 1788864869.607928 mapwrite 0x021f7f thru 0x02d7c9 (0xb84b bytes) 000203 1788864869.743181 mapwrite 0x03d2a2 thru 0x03ffff (0x2d5e bytes) 000204 1788864869.835389 trunc from 0x00e99c to 0x017fec (0x9651 bytes) 000205 1788864869.850364 trunc from 0x002664 to 0x005839 (0x31d6 bytes) 000206 1788864869.859062 mapread 0x00674f thru 0x011b55 (0xb407 bytes) 000207 1788864869.882957 mapread 0x02d5c8 thru 0x02fd8b (0x27c4 bytes) 000209 1788864869.893698 mapread 0x01be54 thru 0x02adf9 (0xefa6 bytes) 000210 1788864869.905360 write 0x005926 thru 0x00ecc2 (0x939d bytes) 000211 1788864869.914933 read 0x000316 thru 0x00352e (0x3219 bytes) 000212 1788864869.924042 trunc from 0x040000 to 0x03fd8f (0x270 bytes) 000213 1788864869.962287 mapwrite 0x026179 thru 0x032c19 (0xcaa1 bytes) 000214 1788864870.017752 trunc from 0x0264f8 to 0x0308aa (0xa3b3 bytes) 000215 1788864870.023644 trunc from 0x00dea4 to 0x0177ea (0x9947 bytes) 000216 1788864870.029704 fallocate 0x035b96 thru 0x03ffff (0xa46a bytes) 000217 1788864870.039939 MIRROR_RESYNC 6 mirrors 000218 1788864872.561549 fallocate 0x0232e5 thru 0x02d5e4 (0xa300 bytes) 000219 1788864872.613253 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fd90): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd90): Mirror 2: 0x829e253a (stale) Mirror 3: 0x829e253a (stale) Mirror 4: 0x829e253a (stale) Mirror 5: 0x829e253a (stale) Mirror 6: 0x829e253a (stale) CRC-32 checksum value for chunk [0, 0x3fd90): Mirror 1: 0x829e253a Mirror 7: 0x829e253a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd90: skipped 000220 1788864873.885272 write 0x0289b8 thru 0x02d90b (0x4f54 bytes) 000222 1788864873.949642 trunc from 0x0051a7 to 0x010a80 (0xb8da bytes) 000223 1788864873.956734 mapread 0x009ee8 thru 0x0131c7 (0x92e0 bytes) 000225 1788864873.996650 read 0x0291b6 thru 0x036901 (0xd74c bytes) 000226 1788864874.013735 mapwrite 0x005b69 thru 0x0133f5 (0xd88d bytes) 000228 1788864874.065533 fallocate 0x01708a thru 0x01c3a8 (0x531f bytes) 000229 1788864874.077177 write 0x02c36c thru 0x034b82 (0x8817 bytes) 000230 1788864874.080405 read 0x02d185 thru 0x03878b (0xb607 bytes) 000231 1788864874.122778 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3fd90): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd90): Mirror 2: 0x829e253a (stale) Mirror 3: 0x829e253a (stale) Mirror 4: 0x829e253a (stale) Mirror 5: 0x829e253a (stale) Mirror 6: 0x829e253a (stale) Mirror 7: 0x829e253a (stale) CRC-32 checksum value for chunk [0, 0x3fd90): Mirror 1: 0xcc9d4f7b Mirror 8: 0xcc9d4f7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd90: skipped 000232 1788864875.279258 mapwrite 0x02ad3b thru 0x02fa05 (0x4ccb bytes) 000233 1788864875.376709 trunc from 0x03e857 to 0x03fd8f (0x1539 bytes) 000234 1788864875.383506 mapread 0x02dc75 thru 0x03730b (0x9697 bytes) 000235 1788864875.395375 write 0x0028ee thru 0x0108d0 (0xdfe3 bytes) 000236 1788864875.420877 mapread 0x003c14 thru 0x0096a9 (0x5a96 bytes) 000237 1788864875.421935 write 0x004458 thru 0x00fbb7 (0xb760 bytes) 000238 1788864875.423867 write 0x01d4de thru 0x029aee (0xc611 bytes) 000239 1788864875.429345 trunc from 0x03fd90 to 0x01e2cf (0x21ac0 bytes) 000240 1788864875.464296 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e2d0): Mirror 2: 0xb37d635 (stale) Mirror 3: 0xb37d635 (stale) Mirror 4: 0xb37d635 (stale) Mirror 5: 0xb37d635 (stale) Mirror 6: 0xb37d635 (stale) Mirror 7: 0xb37d635 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e2d0): Mirror 2: 0xb37d635 (stale) Mirror 3: 0xb37d635 (stale) Mirror 4: 0xb37d635 (stale) Mirror 5: 0xb37d635 (stale) Mirror 6: 0xb37d635 (stale) Mirror 7: 0xb37d635 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e2d0: skipped 000241 1788864875.905269 fallocate 0x02c4a3 thru 0x0342ca (0x7e28 bytes) 000242 1788864875.921810 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x342cb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342cb): Mirror 2: 0xbfcf7f32 (stale) Mirror 3: 0xbfcf7f32 (stale) Mirror 4: 0xbfcf7f32 (stale) Mirror 5: 0xbfcf7f32 (stale) Mirror 6: 0xbfcf7f32 (stale) Mirror 7: 0xbfcf7f32 (stale) CRC-32 checksum value for chunk [0, 0x342cb): Mirror 1: 0xa0c032f3 Mirror 8: 0xa0c032f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342cb: skipped 000243 1788864876.891289 trunc from 0x0342cb to 0x01b460 (0x18e6a bytes) 000244 1788864876.942670 mapread 0x00dd36 thru 0x0119ae (0x3c79 bytes) 000245 1788864876.963614 trunc from 0x00f8e7 to 0x01b460 (0xbb7a bytes) 000246 1788864876.969372 mapread 0x000fae thru 0x00ab07 (0x9b5a bytes) 000247 1788864876.985032 MIRROR_RESYNC 8 mirrors 000248 1788864879.038252 mapread 0x00f05e thru 0x01b460 (0xc403 bytes) 000249 1788864879.061258 mapwrite 0x01b91d thru 0x0229b6 (0x709a bytes) 000250 1788864879.122657 punch from 0x012080 to 0x012508 (0x489 bytes) 000251 1788864879.127312 mapread 0x00bccb thru 0x017128 (0xb45e bytes) 000252 1788864879.136064 mapread 0x001707 thru 0x008177 (0x6a71 bytes) 000253 1788864879.142618 write 0x01dcdc thru 0x0275e4 (0x9909 bytes) 000256 1788864879.144984 write 0x007081 thru 0x009e7d (0x2dfd bytes) 000257 1788864879.146718 trunc from 0x015179 to 0x01e079 (0x8f01 bytes) 000258 1788864879.164614 punch from 0x0243cd to 0x0245f8 (0x22c bytes) 000261 1788864879.170973 mapwrite 0x00a2ce thru 0x01431d (0xa050 bytes) 000262 1788864879.187221 trunc from 0x0170c0 to 0x0204df (0x9420 bytes) 000263 1788864879.195252 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x275e5): Mirror 2: 0xf48bb235 (stale) Mirror 3: 0xf48bb235 (stale) Mirror 4: 0xf48bb235 (stale) Mirror 6: 0xf48bb235 (stale) Mirror 7: 0xf48bb235 (stale) Mirror 8: 0xf48bb235 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x275e5): Mirror 2: 0xf48bb235 (stale) Mirror 3: 0xf48bb235 (stale) Mirror 4: 0xf48bb235 (stale) Mirror 6: 0xf48bb235 (stale) Mirror 7: 0xf48bb235 (stale) Mirror 8: 0xf48bb235 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x275e5: skipped 000264 1788864879.698707 trunc from 0x01dfbd to 0x024e9f (0x6ee3 bytes) 000265 1788864879.703894 mapread 0x02590b thru 0x0275e4 (0x1cda bytes) 000266 1788864879.721307 fallocate 0x02c2e4 thru 0x02c628 (0x345 bytes) 000267 1788864879.744836 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x275e5): Mirror 2: 0xf48bb235 (stale) Mirror 3: 0xf48bb235 (stale) Mirror 4: 0xf48bb235 (stale) Mirror 6: 0xf48bb235 (stale) Mirror 8: 0xf48bb235 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x275e5): Mirror 2: 0xf48bb235 (stale) Mirror 3: 0xf48bb235 (stale) Mirror 4: 0xf48bb235 (stale) Mirror 6: 0xf48bb235 (stale) Mirror 8: 0xf48bb235 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x275e5: skipped 000268 1788864880.456317 mapread 0x01f03d thru 0x0275e4 (0x85a8 bytes) 000269 1788864880.507038 trunc from 0x0275e5 to 0x037450 (0xfe6c bytes) 000270 1788864880.558396 mapwrite 0x03ae50 thru 0x03ffff (0x51b0 bytes) 000271 1788864880.622622 read 0x03c372 thru 0x03ffff (0x3c8e bytes) 000272 1788864880.628239 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x89fd203 (stale) Mirror 3: 0x89fd203 (stale) Mirror 4: 0x89fd203 (stale) Mirror 6: 0x89fd203 (stale) Mirror 8: 0x89fd203 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4753b474 Mirror 9: 0x4753b474 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000274 1788864882.017677 mapread 0x03a3b0 thru 0x03ffff (0x5c50 bytes) 000275 1788864882.089832 read 0x01f874 thru 0x024bb2 (0x533f bytes) 000276 1788864882.111644 write 0x006fa4 thru 0x0112ac (0xa309 bytes) 000277 1788864882.203209 fallocate 0x03d821 thru 0x03ffff (0x27df bytes) 000278 1788864882.226214 mapwrite 0x03ec21 thru 0x03ffff (0x13df bytes) 000280 1788864882.291323 fallocate 0x005755 thru 0x005eb7 (0x763 bytes) 000281 1788864882.308919 trunc from 0x040000 to 0x02bcec (0x14313 bytes) 000282 1788864882.360410 punch from 0x004bff to 0x009c82 (0x5084 bytes) 000283 1788864882.368303 fallocate 0x038f6e thru 0x03ffff (0x7092 bytes) 000284 1788864882.377047 mapwrite 0x005c73 thru 0x00ce43 (0x71d1 bytes) 000285 1788864882.449693 trunc from 0x02bced to 0x001edf (0x29e0d bytes) 000287 1788864882.504589 mapwrite 0x02429e thru 0x028171 (0x3ed4 bytes) 000288 1788864882.625477 read 0x00a24c thru 0x0180ed (0xdea2 bytes) 000289 1788864882.650017 trunc from 0x01e29d to 0x020906 (0x266a bytes) 000290 1788864882.671236 trunc from 0x00e3c4 to 0x00fc0a (0x1847 bytes) 000291 1788864882.682023 write 0x003c60 thru 0x004037 (0x3d8 bytes) 000292 1788864882.687643 trunc from 0x01ccc6 to 0x01d138 (0x473 bytes) 000293 1788864882.708424 read 0x00a6ba thru 0x00be88 (0x17cf bytes) 000294 1788864882.709342 fallocate 0x02693a thru 0x032c7e (0xc345 bytes) 000295 1788864882.730293 MIRROR_RESYNC 7 mirrors 000297 1788864885.507614 mapwrite 0x02316b thru 0x02959f (0x6435 bytes) 000299 1788864885.669520 write 0x018c53 thru 0x021a60 (0x8e0e bytes) 000300 1788864885.678925 punch from 0x0189a9 to 0x019dab (0x1403 bytes) 000301 1788864885.693957 fallocate 0x012c01 thru 0x01e253 (0xb653 bytes) 000302 1788864885.699640 write 0x01d651 thru 0x01e5fd (0xfad bytes) 000303 1788864885.701166 trunc from 0x01054e to 0x0105e7 (0x9a bytes) 000304 1788864885.709846 mapread 0x01be3b thru 0x027137 (0xb2fd bytes) 000305 1788864885.714651 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x32c7f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32c7f): Mirror 2: 0x8b636c54 (stale) Mirror 3: 0x8b636c54 (stale) Mirror 4: 0x8b636c54 (stale) Mirror 6: 0x8b636c54 (stale) Mirror 8: 0x8b636c54 (stale) Mirror 9: 0x8b636c54 (stale) CRC-32 checksum value for chunk [0, 0x32c7f): Mirror 1: 0xb5a08d9b Mirror 10: 0xb5a08d9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32c7f: skipped 000307 1788864887.712530 read 0x01b429 thru 0x02592d (0xa505 bytes) 000308 1788864887.727756 punch from 0x01faa7 to 0x02569d (0x5bf7 bytes) 000309 1788864887.801692 fallocate 0x02c811 thru 0x02e3d6 (0x1bc6 bytes) 000310 1788864887.806472 trunc from 0x032c7f to 0x00ec0d (0x24071 bytes) 000311 1788864887.867006 mapwrite 0x00ac58 thru 0x00ba08 (0xdb1 bytes) 000312 1788864887.913957 write 0x024a16 thru 0x024d3a (0x325 bytes) 000313 1788864887.916383 read 0x013532 thru 0x020450 (0xcf1f bytes) 000314 1788864887.942944 punch from 0x003df3 to 0x00a87d (0x6a8b bytes) 000315 1788864887.956704 trunc from 0x024d3b to 0x023b7e (0x11bc bytes) 000316 1788864887.990339 punch from 0x01048a to 0x016f3f (0x6ab6 bytes) 000317 1788864888.003669 mapwrite 0x0073a5 thru 0x00c883 (0x54df bytes) 000318 1788864888.105387 trunc from 0x01e449 to 0x01ee16 (0x9ce bytes) 000319 1788864888.113903 trunc from 0x023b7f to 0x01c811 (0x736d bytes) 000320 1788864888.149251 write 0x0135b5 thru 0x017703 (0x414f bytes) 000321 1788864888.177900 trunc from 0x01c812 to 0x023817 (0x7006 bytes) 000322 1788864888.223852 trunc from 0x023818 to 0x03051c (0xcd05 bytes) 000323 1788864888.273307 punch from 0x001a43 to 0x002d20 (0x12de bytes) 000324 1788864888.283160 write 0x031642 thru 0x03d229 (0xbbe8 bytes) 000325 1788864888.285686 trunc from 0x03d22a to 0x011b1d (0x2b70c bytes) 000326 1788864888.328404 read 0x0058b2 thru 0x011b1d (0xc26c bytes) 000327 1788864888.345427 write 0x00f9e6 thru 0x01a3d1 (0xa9ec bytes) 000328 1788864888.356559 trunc from 0x01052d to 0x013083 (0x2b57 bytes) 000329 1788864888.391072 mapread 0x01a1a8 thru 0x01a3d1 (0x22a bytes) 000331 1788864888.400326 punch from 0x014975 to 0x01a3d1 (0x5a5d bytes) 000332 1788864888.408103 read 0x004a93 thru 0x01255d (0xdacb bytes) 000333 1788864888.429158 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a3d2): Mirror 2: 0xc4990a08 (stale) Mirror 3: 0xc4990a08 (stale) Mirror 4: 0xc4990a08 (stale) Mirror 6: 0xc4990a08 (stale) Mirror 8: 0xc4990a08 (stale) Mirror 9: 0xc4990a08 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a3d2): Mirror 2: 0xc4990a08 (stale) Mirror 3: 0xc4990a08 (stale) Mirror 4: 0xc4990a08 (stale) Mirror 6: 0xc4990a08 (stale) Mirror 8: 0xc4990a08 (stale) Mirror 9: 0xc4990a08 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a3d2: skipped 000334 1788864888.901606 punch from 0x00cc78 to 0x011dab (0x5134 bytes) 000335 1788864888.908410 read 0x0001fa thru 0x004594 (0x439b bytes) 000336 1788864888.917646 fallocate 0x02bc9f thru 0x03b8a8 (0xfc0a bytes) 000337 1788864888.931599 MIRROR_RESYNC 7 mirrors 000338 1788864892.593196 mapread 0x02ca09 thru 0x02fcf7 (0x32ef bytes) 000339 1788864892.630067 fallocate 0x02a391 thru 0x02b805 (0x1475 bytes) 000340 1788864892.709596 mapwrite 0x030afb thru 0x03d923 (0xce29 bytes) 000341 1788864892.870888 write 0x02e8f8 thru 0x03becc (0xd5d5 bytes) 000342 1788864892.872311 trunc from 0x03d924 to 0x028ff0 (0x14933 bytes) 000343 1788864892.898128 punch from 0x012877 to 0x018985 (0x610f bytes) 000344 1788864892.904708 mapread 0x021f5b thru 0x025cf9 (0x3d9f bytes) 000345 1788864892.924869 trunc from 0x0277fd to 0x027e40 (0x644 bytes) 000346 1788864892.934557 mapread 0x01c3c4 thru 0x028ff0 (0xcc2d bytes) 000347 1788864892.950201 trunc from 0x0003eb to 0x00b245 (0xae5b bytes) 000348 1788864892.974174 read 0x01c9ce thru 0x028ff0 (0xc623 bytes) 000349 1788864892.979632 write 0x0332bb thru 0x03ffff (0xcd45 bytes) 000350 1788864892.989318 punch from 0x0164b9 to 0x02152f (0xb077 bytes) 000352 1788864893.014628 mapwrite 0x00638a thru 0x00a704 (0x437b bytes) 000353 1788864893.077942 fallocate 0x0078bb thru 0x0141a1 (0xc8e7 bytes) 000354 1788864893.103671 trunc from 0x040000 to 0x03e499 (0x1b66 bytes) 000355 1788864893.153062 trunc from 0x03e49a to 0x01cf1f (0x2157a bytes) 000356 1788864893.170650 trunc from 0x01cf20 to 0x019235 (0x3cea bytes) 000357 1788864893.193629 write 0x013136 thru 0x01b6ae (0x8579 bytes) 000358 1788864893.201513 write 0x02b652 thru 0x03abae (0xf55d bytes) 000359 1788864893.204686 trunc from 0x026e1a to 0x02813d (0x1324 bytes) 000360 1788864893.214192 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3abaf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3abaf): Mirror 2: 0xfb19b282 (stale) Mirror 3: 0xfb19b282 (stale) Mirror 4: 0xfb19b282 (stale) Mirror 6: 0xfb19b282 (stale) Mirror 8: 0xfb19b282 (stale) Mirror 9: 0xfb19b282 (stale) CRC-32 checksum value for chunk [0, 0x3abaf): Mirror 1: 0x67c5f6fa Mirror 10: 0x67c5f6fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3abaf: skipped 000362 1788864895.375496 trunc from 0x03abaf to 0x0282f4 (0x128ba bytes) 000363 1788864895.491252 trunc from 0x0282f5 to 0x001353 (0x26fa1 bytes) 000365 1788864895.526066 trunc from 0x0009e9 to 0x001353 (0x96b bytes) 000366 1788864895.534662 read 0x000419 thru 0x001353 (0xf3b bytes) 000367 1788864895.549079 punch from 0x0003cf to 0x001353 (0xf85 bytes) 000368 1788864895.563164 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1354): Mirror 2: 0x378537ca (stale) Mirror 3: 0x378537ca (stale) Mirror 4: 0x378537ca (stale) Mirror 8: 0x378537ca (stale) Mirror 9: 0x378537ca (stale) Mirror 10: 0x378537ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1354): Mirror 2: 0x378537ca (stale) Mirror 3: 0x378537ca (stale) Mirror 4: 0x378537ca (stale) Mirror 8: 0x378537ca (stale) Mirror 9: 0x378537ca (stale) Mirror 10: 0x378537ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1354: skipped 000369 1788864896.303964 MIRROR_RESYNC 7 mirrors 000370 1788864897.770636 fallocate 0x02754a thru 0x02956f (0x2026 bytes) 000371 1788864897.822766 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29570): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29570): Mirror 2: 0xa713b65c (stale) Mirror 3: 0xa713b65c (stale) Mirror 4: 0xa713b65c (stale) Mirror 8: 0xa713b65c (stale) Mirror 9: 0xa713b65c (stale) Mirror 10: 0xa713b65c (stale) CRC-32 checksum value for chunk [0, 0x29570): Mirror 1: 0xa713b65c Mirror 11: 0xa713b65c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29570: skipped 000372 1788864898.796389 fallocate 0x01761c thru 0x0254f4 (0xded9 bytes) 000373 1788864898.830330 mapread 0x021b75 thru 0x02956f (0x79fb bytes) 000374 1788864898.850346 MIRROR_RESYNC 8 mirrors 000375 1788864899.761554 trunc from 0x029570 to 0x006e2e (0x22741 bytes) 000376 1788864899.791342 mapread 0x002659 thru 0x006e2e (0x47d6 bytes) 000377 1788864899.813785 mapread 0x001c9c thru 0x006e2e (0x5193 bytes) 000378 1788864899.814873 trunc from 0x006e2f to 0x023f24 (0x1d0f6 bytes) 000379 1788864899.836263 write 0x023f9b thru 0x033534 (0xf59a bytes) 000380 1788864899.849273 mapread 0x01bfab thru 0x02b5b3 (0xf609 bytes) 000381 1788864899.859780 trunc from 0x031992 to 0x033534 (0x1ba3 bytes) 000382 1788864899.874062 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33535): Mirror 2: 0x47f06728 (stale) Mirror 4: 0x47f06728 (stale) Mirror 8: 0x47f06728 (stale) Mirror 9: 0x47f06728 (stale) Mirror 10: 0x47f06728 (stale) Mirror 11: 0x47f06728 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33535): Mirror 2: 0x47f06728 (stale) Mirror 4: 0x47f06728 (stale) Mirror 8: 0x47f06728 (stale) Mirror 9: 0x47f06728 (stale) Mirror 10: 0x47f06728 (stale) Mirror 11: 0x47f06728 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33535: skipped 000383 1788864900.334644 mapwrite 0x02de4c thru 0x03c0cc (0xe281 bytes) 000385 1788864900.396560 fallocate 0x036651 thru 0x03e6a1 (0x8051 bytes) 000386 1788864900.402314 mapread 0x0337b8 thru 0x03d3f6 (0x9c3f bytes) 000387 1788864900.407643 punch from 0x03176e to 0x0334d7 (0x1d6a bytes) 000388 1788864900.413552 trunc from 0x02682d to 0x0321f0 (0xb9c4 bytes) 000389 1788864900.422375 MIRROR_RESYNC 7 mirrors 000390 1788864902.093770 fallocate 0x008c7d thru 0x011d43 (0x90c7 bytes) 000391 1788864902.136926 mapwrite 0x01c59e thru 0x02097d (0x43e0 bytes) 000392 1788864902.174994 mapread 0x00dcf5 thru 0x01abcf (0xcedb bytes) 000393 1788864902.186746 trunc from 0x03e6a2 to 0x03b47e (0x3223 bytes) 000394 1788864902.205306 trunc from 0x03b47f to 0x02fbd1 (0xb8ad bytes) 000395 1788864902.223030 read 0x00927c thru 0x0182fe (0xf083 bytes) 000396 1788864902.223794 trunc from 0x024c90 to 0x02fbd1 (0xaf42 bytes) 000397 1788864902.230236 fallocate 0x002bfe thru 0x0097d0 (0x6bd3 bytes) 000398 1788864902.235039 punch from 0x02aaaa to 0x02eaec (0x4043 bytes) 000399 1788864902.246499 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2fbd2): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fbd2): Mirror 2: 0xce99a770 (stale) Mirror 4: 0xce99a770 (stale) Mirror 8: 0xce99a770 (stale) Mirror 9: 0xce99a770 (stale) Mirror 10: 0xce99a770 (stale) Mirror 11: 0xce99a770 (stale) CRC-32 checksum value for chunk [0, 0x2fbd2): Mirror 1: 0x204a0f50 Mirror 12: 0x204a0f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fbd2: skipped 000400 1788864903.304047 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2fbd2): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fbd2): Mirror 2: 0xce99a770 (stale) Mirror 4: 0xce99a770 (stale) Mirror 8: 0xce99a770 (stale) Mirror 9: 0xce99a770 (stale) Mirror 10: 0xce99a770 (stale) Mirror 11: 0xce99a770 (stale) CRC-32 checksum value for chunk [0, 0x2fbd2): Mirror 1: 0x204a0f50 Mirror 12: 0x204a0f50 Mirror 13: 0x204a0f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fbd2: skipped 000401 1788864904.172322 read 0x021059 thru 0x0249c1 (0x3969 bytes) 000402 1788864904.179734 fallocate 0x0044d2 thru 0x00de7e (0x99ad bytes) 000403 1788864904.218516 mapwrite 0x032ba5 thru 0x035893 (0x2cef bytes) 000404 1788864904.286591 trunc from 0x035894 to 0x03fc9e (0xa40b bytes) 000406 1788864904.299759 write 0x025e5c thru 0x02aa45 (0x4bea bytes) 000407 1788864904.309562 write 0x00abfb thru 0x01abb5 (0xffbb bytes) 000409 1788864904.335122 MIRROR_RESYNC 9 mirrors 000410 1788864907.391459 fallocate 0x030b38 thru 0x03ede7 (0xe2b0 bytes) 000412 1788864907.443602 mapread 0x0299ce thru 0x03538c (0xb9bf bytes) 000413 1788864907.498318 trunc from 0x03fc9f to 0x03de27 (0x1e77 bytes) 000414 1788864907.526209 trunc from 0x00b65d to 0x010d51 (0x56f5 bytes) 000415 1788864907.534382 mapread 0x019d9e thru 0x029d37 (0xff9a bytes) 000416 1788864907.546127 read 0x011451 thru 0x012fec (0x1b9c bytes) 000417 1788864907.551001 read 0x036ef3 thru 0x03de27 (0x6f35 bytes) 000418 1788864907.565898 trunc from 0x03de28 to 0x012247 (0x2bbe0 bytes) 000419 1788864907.584170 trunc from 0x009cee to 0x012247 (0x855a bytes) 000420 1788864907.589860 mapwrite 0x030982 thru 0x03efa3 (0xe622 bytes) 000421 1788864907.678943 mapread 0x00e215 thru 0x019660 (0xb44c bytes) 000422 1788864907.726469 fallocate 0x0165ed thru 0x021cc9 (0xb6dd bytes) 000423 1788864907.731992 mapwrite 0x00a8d0 thru 0x014ac8 (0xa1f9 bytes) 000424 1788864907.766199 fallocate 0x00356f thru 0x00b08e (0x7b20 bytes) 000425 1788864907.771061 read 0x0005b1 thru 0x007257 (0x6ca7 bytes) 000426 1788864907.771986 trunc from 0x03efa4 to 0x0107cd (0x2e7d6 bytes) 000427 1788864907.794190 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x107ce): Mirror 2: 0xc6fd6d83 (stale) Mirror 8: 0xc6fd6d83 (stale) Mirror 9: 0xc6fd6d83 (stale) Mirror 10: 0xc6fd6d83 (stale) Mirror 11: 0xc6fd6d83 (stale) Mirror 12: 0xc6fd6d83 (stale) Mirror 13: 0xc6fd6d83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x107ce): Mirror 2: 0xc6fd6d83 (stale) Mirror 8: 0xc6fd6d83 (stale) Mirror 9: 0xc6fd6d83 (stale) Mirror 10: 0xc6fd6d83 (stale) Mirror 11: 0xc6fd6d83 (stale) Mirror 12: 0xc6fd6d83 (stale) Mirror 13: 0xc6fd6d83 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x107ce: skipped 000429 1788864908.184426 trunc from 0x0107ce to 0x010f06 (0x739 bytes) 000430 1788864908.236602 MIRROR_RESYNC 8 mirrors 000431 1788864909.519130 MIRROR_EXTEND to 9 mirrors 000432 1788864910.124377 punch from 0x0085a0 to 0x010f06 (0x8967 bytes) 000433 1788864910.160566 write 0x013105 thru 0x019878 (0x6774 bytes) 000434 1788864910.165836 trunc from 0x019879 to 0x0141f6 (0x5682 bytes) 000435 1788864910.185025 trunc from 0x00e64a to 0x010531 (0x1ee8 bytes) 000436 1788864910.194082 punch from 0x010329 to 0x01295f (0x2637 bytes) 000437 1788864910.201905 punch from 0x000429 to 0x009272 (0x8e4a bytes) 000438 1788864910.207582 mapwrite 0x026164 thru 0x02d30b (0x71a8 bytes) 000439 1788864910.250211 mapwrite 0x0219c9 thru 0x02f3c9 (0xda01 bytes) 000440 1788864910.308687 punch from 0x0076ad to 0x011180 (0x9ad4 bytes) 000441 1788864910.320205 fallocate 0x01fd3a thru 0x028396 (0x865d bytes) 000442 1788864910.326925 trunc from 0x00e5bc to 0x01316e (0x4bb3 bytes) 000443 1788864910.332736 fallocate 0x032d72 thru 0x034154 (0x13e3 bytes) 000444 1788864910.337375 mapwrite 0x028127 thru 0x0348ec (0xc7c6 bytes) 000445 1788864910.374987 trunc from 0x028c88 to 0x034896 (0xbc0f bytes) 000446 1788864910.380375 write 0x026ada thru 0x033952 (0xce79 bytes) 000447 1788864910.386747 mapread 0x003755 thru 0x007e8f (0x473b bytes) 000448 1788864910.396489 write 0x00c979 thru 0x0199e2 (0xd06a bytes) 000450 1788864910.401938 trunc from 0x0348ed to 0x01043e (0x244ae bytes) 000451 1788864910.419832 mapread 0x009d77 thru 0x01043e (0x66c8 bytes) 000452 1788864910.420783 trunc from 0x005484 to 0x007046 (0x1bc3 bytes) 000453 1788864910.430015 read 0x0080b2 thru 0x0084be (0x40d bytes) 000455 1788864910.431070 write 0x0045df thru 0x012004 (0xda26 bytes) 000456 1788864910.436182 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x12005): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12005): Mirror 2: 0x9d21d226 (stale) Mirror 8: 0x9d21d226 (stale) Mirror 9: 0x9d21d226 (stale) Mirror 10: 0x9d21d226 (stale) Mirror 11: 0x9d21d226 (stale) Mirror 12: 0x9d21d226 (stale) Mirror 13: 0x9d21d226 (stale) Mirror 14: 0x9d21d226 (stale) CRC-32 checksum value for chunk [0, 0x12005): Mirror 1: 0xc37e005 Mirror 15: 0xc37e005 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12005: skipped 000457 1788864911.348214 mapread 0x011771 thru 0x011c60 (0x4f0 bytes) 000458 1788864911.413536 mapread 0x00dcd7 thru 0x012004 (0x432e bytes) 000459 1788864911.469922 punch from 0x001219 to 0x0079c4 (0x67ac bytes) 000460 1788864911.541129 mapwrite 0x01bfca thru 0x01e1cd (0x2204 bytes) 000461 1788864911.657179 mapwrite 0x023a4e thru 0x02cce8 (0x929b bytes) 000462 1788864911.704839 write 0x016dc2 thru 0x01f609 (0x8848 bytes) 000464 1788864911.708131 trunc from 0x02cce9 to 0x000be4 (0x2c104 bytes) 000465 1788864911.727631 read 0x0009c1 thru 0x000be4 (0x224 bytes) 000466 1788864911.733414 fallocate 0x02d9cf thru 0x03d90a (0xff3c bytes) 000467 1788864911.738061 mapread 0x000242 thru 0x000be4 (0x9a3 bytes) 000468 1788864911.739410 trunc from 0x000767 to 0x000be4 (0x47e bytes) 000469 1788864911.743403 punch from 0x000070 to 0x000be4 (0xb75 bytes) 000470 1788864911.747788 mapread 0x0006b2 thru 0x000be4 (0x533 bytes) 000471 1788864911.752120 mapwrite 0x038e94 thru 0x03aff7 (0x2164 bytes) 000472 1788864911.785736 trunc from 0x020646 to 0x02b64d (0xb008 bytes) 000473 1788864911.791991 write 0x033be6 thru 0x03e4a6 (0xa8c1 bytes) 000475 1788864911.804962 MIRROR_RESYNC 10 mirrors 000476 1788864913.449861 fallocate 0x0355c1 thru 0x03a0ce (0x4b0e bytes) 000477 1788864913.484758 trunc from 0x03e4a7 to 0x016fb6 (0x274f0 bytes) 000478 1788864913.523240 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16fb7): Mirror 2: 0x246407ec (stale) Mirror 8: 0x246407ec (stale) Mirror 9: 0x246407ec (stale) Mirror 10: 0x246407ec (stale) Mirror 11: 0x246407ec (stale) Mirror 13: 0x246407ec (stale) Mirror 14: 0x246407ec (stale) Mirror 15: 0x246407ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16fb7): Mirror 2: 0x246407ec (stale) Mirror 8: 0x246407ec (stale) Mirror 9: 0x246407ec (stale) Mirror 10: 0x246407ec (stale) Mirror 11: 0x246407ec (stale) Mirror 13: 0x246407ec (stale) Mirror 14: 0x246407ec (stale) Mirror 15: 0x246407ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16fb7: skipped 000479 1788864913.938097 MIRROR_RESYNC 9 mirrors 000480 1788864915.201378 read 0x0126ac thru 0x016fb6 (0x490b bytes) 000481 1788864915.209390 trunc from 0x016fb7 to 0x03da2a (0x26a74 bytes) 000482 1788864915.257491 trunc from 0x03da2b to 0x03f25f (0x1835 bytes) 000483 1788864915.279841 read 0x03de51 thru 0x03f25f (0x140f bytes) 000484 1788864915.300768 MIRROR_RESYNC 9 mirrors 000486 1788864916.666954 write 0x002fc3 thru 0x00dfa9 (0xafe7 bytes) 000487 1788864916.728744 trunc from 0x03f260 to 0x03f524 (0x2c5 bytes) 000488 1788864916.747419 read 0x016279 thru 0x01c453 (0x61db bytes) 000489 1788864916.756389 mapwrite 0x032e8d thru 0x03925b (0x63cf bytes) 000490 1788864916.794748 write 0x0337c2 thru 0x03d6e6 (0x9f25 bytes) 000491 1788864916.800567 trunc from 0x0151ab to 0x01b85f (0x66b5 bytes) 000492 1788864916.806456 mapread 0x02a3bc thru 0x02dd29 (0x396e bytes) 000493 1788864916.815190 fallocate 0x0177f2 thru 0x019937 (0x2146 bytes) 000494 1788864916.819955 trunc from 0x00b044 to 0x015301 (0xa2be bytes) 000496 1788864916.826422 fallocate 0x00b619 thru 0x01642a (0xae12 bytes) 000497 1788864916.831653 read 0x0014e1 thru 0x00e04e (0xcb6e bytes) 000498 1788864916.853406 fallocate 0x02d5c9 thru 0x030027 (0x2a5f bytes) 000499 1788864916.859945 fallocate 0x015603 thru 0x01dce8 (0x86e6 bytes) 000500 1788864916.866068 mapwrite 0x03c443 thru 0x03ffff (0x3bbd bytes) 000501 1788864916.916312 punch from 0x0177d2 to 0x024599 (0xcdc8 bytes) 000503 1788864916.923010 punch from 0x0384c2 to 0x03cd64 (0x48a3 bytes) 000504 1788864916.928821 mapread 0x0280c5 thru 0x0367c5 (0xe701 bytes) 000505 1788864916.929982 mapread 0x0387f1 thru 0x039aed (0x12fd bytes) 000506 1788864916.943121 read 0x02eba5 thru 0x037678 (0x8ad4 bytes) 000507 1788864916.943934 trunc from 0x040000 to 0x017461 (0x28b9e bytes) 000508 1788864916.964986 fallocate 0x014692 thru 0x021a1c (0xd38b bytes) 000509 1788864916.970344 trunc from 0x0139e2 to 0x013c96 (0x2b5 bytes) 000510 1788864916.975108 fallocate 0x00c169 thru 0x011a51 (0x58e9 bytes) 000511 1788864916.979584 trunc from 0x017462 to 0x017656 (0x1f5 bytes) 000512 1788864916.995884 trunc from 0x017657 to 0x02f997 (0x18341 bytes) 000513 1788864917.013427 trunc from 0x02f998 to 0x02736c (0x862b bytes) 000514 1788864917.040585 trunc from 0x02736d to 0x02febe (0x8b52 bytes) 000515 1788864917.053374 mapwrite 0x02800c thru 0x02b58a (0x357f bytes) 000516 1788864917.076021 punch from 0x005deb to 0x012eaf (0xd0c5 bytes) 000517 1788864917.088042 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2febf): Mirror 2: 0x2dd5bd32 (stale) Mirror 8: 0x2dd5bd32 (stale) Mirror 9: 0x2dd5bd32 (stale) Mirror 10: 0x2dd5bd32 (stale) Mirror 11: 0x2dd5bd32 (stale) Mirror 13: 0x2dd5bd32 (stale) Mirror 15: 0x2dd5bd32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2febf): Mirror 2: 0x2dd5bd32 (stale) Mirror 8: 0x2dd5bd32 (stale) Mirror 9: 0x2dd5bd32 (stale) Mirror 10: 0x2dd5bd32 (stale) Mirror 11: 0x2dd5bd32 (stale) Mirror 13: 0x2dd5bd32 (stale) Mirror 15: 0x2dd5bd32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2febf: skipped 000518 1788864917.548139 fallocate 0x02fdbc thru 0x03144b (0x1690 bytes) 000522 1788864917.556210 trunc from 0x03144c to 0x01c25e (0x151ed bytes) 000523 1788864917.568414 trunc from 0x01bbdc to 0x01c25e (0x683 bytes) 000524 1788864917.572303 fallocate 0x019b30 thru 0x02967f (0xfb50 bytes) 000525 1788864917.577159 write 0x03d05c thru 0x03ffff (0x2fa4 bytes) 000526 1788864917.579082 fallocate 0x021047 thru 0x0244a4 (0x345e bytes) 000527 1788864917.592947 MIRROR_RESYNC 8 mirrors 000528 1788864919.276299 write 0x00571a thru 0x0124d6 (0xcdbd bytes) 000529 1788864919.306710 trunc from 0x0249d7 to 0x03451d (0xfb47 bytes) 000530 1788864919.314189 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xad0db0c7 (stale) Mirror 9: 0xad0db0c7 (stale) Mirror 10: 0xad0db0c7 (stale) Mirror 11: 0xad0db0c7 (stale) Mirror 13: 0xad0db0c7 (stale) Mirror 15: 0xad0db0c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xad0db0c7 (stale) Mirror 9: 0xad0db0c7 (stale) Mirror 10: 0xad0db0c7 (stale) Mirror 11: 0xad0db0c7 (stale) Mirror 13: 0xad0db0c7 (stale) Mirror 15: 0xad0db0c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000531 1788864919.787220 mapread 0x03fb38 thru 0x03ffff (0x4c8 bytes) 000532 1788864919.795211 fallocate 0x02c3a0 thru 0x03ace3 (0xe944 bytes) 000533 1788864919.801937 mapwrite 0x002db2 thru 0x00fc78 (0xcec7 bytes) 000534 1788864919.866485 mapread 0x03f6f9 thru 0x03f92f (0x237 bytes) 000536 1788864919.869167 write 0x03b319 thru 0x03ffff (0x4ce7 bytes) 000537 1788864919.901246 punch from 0x0146c2 to 0x01d3be (0x8cfd bytes) 000538 1788864919.914574 read 0x02c541 thru 0x02e387 (0x1e47 bytes) 000540 1788864919.922139 mapread 0x0079ac thru 0x013cd3 (0xc328 bytes) 000541 1788864919.932305 mapread 0x0135f0 thru 0x01454f (0xf60 bytes) 000542 1788864919.933352 trunc from 0x040000 to 0x03d197 (0x2e68 bytes) 000545 1788864919.948832 write 0x01bf2e thru 0x01dbe5 (0x1cb8 bytes) 000546 1788864919.957374 trunc from 0x0272e7 to 0x02efdc (0x7cf6 bytes) 000547 1788864919.961534 mapwrite 0x030b47 thru 0x03e4c8 (0xd982 bytes) 000548 1788864920.022354 trunc from 0x03e4c9 to 0x001da1 (0x3c727 bytes) 000549 1788864920.048271 fallocate 0x026eb3 thru 0x034442 (0xd590 bytes) 000550 1788864920.057049 punch from 0x00ee9f to 0x0106e3 (0x1845 bytes) 000551 1788864920.063036 trunc from 0x0112ad to 0x018bce (0x7922 bytes) 000552 1788864920.068961 trunc from 0x031605 to 0x034442 (0x2e3e bytes) 000553 1788864920.075950 mapwrite 0x00ca34 thru 0x0176a6 (0xac73 bytes) 000554 1788864920.125017 read 0x000530 thru 0x00ab80 (0xa651 bytes) 000555 1788864920.133770 trunc from 0x01bd37 to 0x026649 (0xa913 bytes) 000556 1788864920.139098 trunc from 0x024bfd to 0x03100c (0xc410 bytes) 000557 1788864920.144964 trunc from 0x01c196 to 0x01e3cc (0x2237 bytes) 000558 1788864920.149060 punch from 0x018fd4 to 0x01bd99 (0x2dc6 bytes) 000560 1788864920.154934 mapwrite 0x01e80c thru 0x01f197 (0x98c bytes) 000562 1788864920.175470 mapwrite 0x004eb9 thru 0x00ac7b (0x5dc3 bytes) 000563 1788864920.192934 write 0x03d606 thru 0x03ffff (0x29fa bytes) 000564 1788864920.194886 fallocate 0x0021ac thru 0x0031de (0x1033 bytes) 000566 1788864920.200852 punch from 0x032090 to 0x037811 (0x5782 bytes) 000567 1788864920.204511 mapread 0x00dd5a thru 0x013202 (0x54a9 bytes) 000568 1788864920.206202 mapwrite 0x004b89 thru 0x00b87e (0x6cf6 bytes) 000569 1788864920.225116 fallocate 0x03d19b thru 0x03ffff (0x2e65 bytes) 000570 1788864920.229845 write 0x0322c6 thru 0x036ead (0x4be8 bytes) 000571 1788864920.239203 fallocate 0x022ecd thru 0x026e8f (0x3fc3 bytes) 000572 1788864920.244378 write 0x02ad8a thru 0x0315df (0x6856 bytes) 000573 1788864920.253364 mapwrite 0x015a53 thru 0x016da4 (0x1352 bytes) 000574 1788864920.281584 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xad0db0c7 (stale) Mirror 10: 0xad0db0c7 (stale) Mirror 11: 0xad0db0c7 (stale) Mirror 13: 0xad0db0c7 (stale) Mirror 15: 0xad0db0c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xad0db0c7 (stale) Mirror 10: 0xad0db0c7 (stale) Mirror 11: 0xad0db0c7 (stale) Mirror 13: 0xad0db0c7 (stale) Mirror 15: 0xad0db0c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000575 1788864920.838205 fallocate 0x0264da thru 0x02eaa3 (0x85ca bytes) 000576 1788864920.847073 trunc from 0x040000 to 0x0323b1 (0xdc4e bytes) 000577 1788864920.873423 mapread 0x024332 thru 0x0250b9 (0xd88 bytes) 000579 1788864920.887151 trunc from 0x0323b2 to 0x01db09 (0x148a8 bytes) 000580 1788864920.902611 trunc from 0x017c52 to 0x01ab7d (0x2f2c bytes) 000581 1788864920.912358 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1db0a): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db0a): Mirror 9: 0x99d9462e (stale) Mirror 10: 0x99d9462e (stale) Mirror 11: 0x99d9462e (stale) Mirror 13: 0x99d9462e (stale) Mirror 15: 0x99d9462e (stale) CRC-32 checksum value for chunk [0, 0x1db0a): Mirror 1: 0xc93a5b0f Mirror 16: 0xc93a5b0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db0a: skipped 000582 1788864922.028712 mapread 0x010851 thru 0x01a55b (0x9d0b bytes) 000583 1788864922.071954 trunc from 0x01db0a to 0x02dd43 (0x1023a bytes) 000584 1788864922.135037 write 0x0263df thru 0x031477 (0xb099 bytes) 000585 1788864922.140632 trunc from 0x031478 to 0x022c3d (0xe83a bytes) 000586 1788864922.161297 trunc from 0x01f8c4 to 0x022c3d (0x337a bytes) 000587 1788864922.168148 trunc from 0x00934e to 0x00e92f (0x55e2 bytes) 000588 1788864922.174815 read 0x0001a3 thru 0x0037a4 (0x3602 bytes) 000589 1788864922.185926 punch from 0x0160a5 to 0x022b16 (0xca72 bytes) 000590 1788864922.191978 trunc from 0x022c3e to 0x0365be (0x13981 bytes) 000591 1788864922.228761 trunc from 0x0365bf to 0x00334c (0x33272 bytes) 000592 1788864922.254659 write 0x00348a thru 0x004e5b (0x19d2 bytes) 000593 1788864922.258550 punch from 0x002d87 to 0x004e5b (0x20d5 bytes) 000594 1788864922.272111 mapread 0x003e60 thru 0x004e5b (0xffc bytes) 000595 1788864922.281193 fallocate 0x03efc9 thru 0x03ffff (0x1037 bytes) 000596 1788864922.289138 read 0x0002e7 thru 0x004e5b (0x4b75 bytes) 000597 1788864922.289763 mapread 0x0043e8 thru 0x004e5b (0xa74 bytes) 000598 1788864922.290922 mapread 0x00269d thru 0x004e5b (0x27bf bytes) 000599 1788864922.293393 write 0x038366 thru 0x03ffff (0x7c9a bytes) 000600 1788864922.302379 MIRROR_RESYNC 7 mirrors 000601 1788864923.559844 mapwrite 0x0080bd thru 0x016390 (0xe2d4 bytes) 000602 1788864923.665014 read 0x00f208 thru 0x01a9b2 (0xb7ab bytes) 000603 1788864923.666402 punch from 0x007754 to 0x009dc5 (0x2672 bytes) 000604 1788864923.671279 punch from 0x021275 to 0x02fdcd (0xeb59 bytes) 000605 1788864923.676965 write 0x03fae6 thru 0x03ffff (0x51a bytes) 000606 1788864923.681325 punch from 0x0038df to 0x008b1f (0x5241 bytes) 000607 1788864923.687087 mapread 0x00424b thru 0x00fb0d (0xb8c3 bytes) 000608 1788864923.696976 write 0x02d965 thru 0x033b4d (0x61e9 bytes) 000609 1788864923.707065 trunc from 0x040000 to 0x03fba6 (0x459 bytes) 000610 1788864923.724306 fallocate 0x035178 thru 0x03ca19 (0x78a2 bytes) 000611 1788864923.729403 write 0x038cf8 thru 0x03ffff (0x7308 bytes) 000613 1788864923.738305 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xba0aef17 (stale) Mirror 11: 0xba0aef17 (stale) Mirror 13: 0xba0aef17 (stale) Mirror 15: 0xba0aef17 (stale) Mirror 16: 0xba0aef17 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xba0aef17 (stale) Mirror 11: 0xba0aef17 (stale) Mirror 13: 0xba0aef17 (stale) Mirror 15: 0xba0aef17 (stale) Mirror 16: 0xba0aef17 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000614 1788864924.078305 punch from 0x013207 to 0x0166da (0x34d4 bytes) 000615 1788864924.083057 read 0x00b08b thru 0x00df4d (0x2ec3 bytes) 000616 1788864924.087788 fallocate 0x024995 thru 0x033ee5 (0xf551 bytes) 000617 1788864924.092150 mapwrite 0x0268a8 thru 0x032b6d (0xc2c6 bytes) 000618 1788864924.144766 punch from 0x037f61 to 0x0390d9 (0x1179 bytes) 000619 1788864924.149630 fallocate 0x021770 thru 0x02d78b (0xc01c bytes) 000620 1788864924.153781 mapread 0x0248ed thru 0x02a982 (0x6096 bytes) 000621 1788864924.154685 mapwrite 0x00ac28 thru 0x012569 (0x7942 bytes) 000622 1788864924.198926 mapread 0x016716 thru 0x023540 (0xce2b bytes) 000623 1788864924.218507 trunc from 0x040000 to 0x0055f2 (0x3aa0d bytes) 000624 1788864924.241354 trunc from 0x001cbf to 0x0055f2 (0x3934 bytes) 000625 1788864924.254851 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x55f3): Mirror 10: 0x3025a02c (stale) Mirror 13: 0x3025a02c (stale) Mirror 15: 0x3025a02c (stale) Mirror 16: 0x3025a02c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x55f3): Mirror 10: 0x3025a02c (stale) Mirror 13: 0x3025a02c (stale) Mirror 15: 0x3025a02c (stale) Mirror 16: 0x3025a02c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x55f3: skipped 000626 1788864924.575182 mapwrite 0x036464 thru 0x03edae (0x894b bytes) 000627 1788864924.643079 read 0x008004 thru 0x0097a7 (0x17a4 bytes) 000629 1788864924.650380 write 0x03b9a8 thru 0x03d39d (0x19f6 bytes) 000630 1788864924.651723 read 0x01c294 thru 0x023f1a (0x7c87 bytes) 000631 1788864924.671680 MIRROR_RESYNC 5 mirrors 000632 1788864925.734972 read 0x035139 thru 0x03a296 (0x515e bytes) 000634 1788864925.773418 MIRROR_EXTEND to 6 mirrors 000635 1788864926.821274 trunc from 0x03edaf to 0x01087e (0x2e530 bytes) 000636 1788864926.865083 punch from 0x00ee64 to 0x01087e (0x1a1b bytes) 000637 1788864926.869664 trunc from 0x0042e1 to 0x01087e (0xc59e bytes) 000638 1788864926.874104 trunc from 0x01087f to 0x01ded0 (0xd652 bytes) 000639 1788864926.890910 punch from 0x000f56 to 0x00d97a (0xca25 bytes) 000641 1788864926.895964 punch from 0x00731b to 0x00dacb (0x67b1 bytes) 000642 1788864926.900364 mapread 0x00d5a4 thru 0x00d7de (0x23b bytes) 000643 1788864926.905938 fallocate 0x03ed25 thru 0x03ffff (0x12db bytes) 000644 1788864926.911292 punch from 0x02c8d5 to 0x03282d (0x5f59 bytes) 000646 1788864926.915685 mapwrite 0x01eda5 thru 0x0233c0 (0x461c bytes) 000647 1788864926.947097 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x281fe1b8 (stale) Mirror 13: 0x281fe1b8 (stale) Mirror 15: 0x281fe1b8 (stale) Mirror 16: 0x281fe1b8 (stale) Mirror 17: 0x281fe1b8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x68d9456f Mirror 18: 0x68d9456f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000648 1788864927.822547 trunc from 0x040000 to 0x00111d (0x3eee2 bytes) 000649 1788864927.867325 write 0x030d65 thru 0x03f45d (0xe6f9 bytes) 000650 1788864927.870308 trunc from 0x03f45e to 0x012ca1 (0x2c7bc bytes) 000651 1788864927.886072 mapwrite 0x01580c thru 0x020325 (0xab1a bytes) 000652 1788864927.943660 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20326): Mirror 13: 0xdce9395f (stale) Mirror 15: 0xdce9395f (stale) Mirror 16: 0xdce9395f (stale) Mirror 17: 0xdce9395f (stale) Mirror 18: 0x15cbeb58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20326): Mirror 13: 0xdce9395f (stale) Mirror 15: 0xdce9395f (stale) Mirror 16: 0xdce9395f (stale) Mirror 17: 0xdce9395f (stale) Mirror 18: 0x15cbeb58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20326: skipped 000653 1788864928.296357 trunc from 0x020326 to 0x03064b (0x10326 bytes) 000654 1788864928.313742 mapwrite 0x016c68 thru 0x026586 (0xf91f bytes) 000655 1788864928.369586 MIRROR_RESYNC 6 mirrors 000657 1788864929.627394 read 0x027b2f thru 0x02af65 (0x3437 bytes) 000658 1788864929.633523 mapwrite 0x00f689 thru 0x012146 (0x2abe bytes) 000659 1788864929.715645 write 0x036e3f thru 0x03ffff (0x91c1 bytes) 000660 1788864929.718295 mapread 0x016cbc thru 0x022d2e (0xc073 bytes) 000661 1788864929.749058 mapwrite 0x00d266 thru 0x013f4c (0x6ce7 bytes) 000662 1788864929.776639 write 0x0114f4 thru 0x01cce0 (0xb7ed bytes) 000663 1788864929.782892 mapwrite 0x01a29c thru 0x01dd92 (0x3af7 bytes) 000664 1788864929.799948 mapread 0x00c374 thru 0x00e27d (0x1f0a bytes) 000665 1788864929.801202 mapwrite 0x02880c thru 0x034442 (0xbc37 bytes) 000667 1788864929.834920 write 0x021dea thru 0x0306b2 (0xe8c9 bytes) 000668 1788864929.837707 mapwrite 0x0345de thru 0x034856 (0x279 bytes) 000669 1788864929.855607 write 0x01b359 thru 0x01b3bf (0x67 bytes) 000670 1788864929.857357 punch from 0x0167ce to 0x02343a (0xcc6d bytes) 000671 1788864929.869016 read 0x011da5 thru 0x01c7b8 (0xaa14 bytes) 000672 1788864929.878842 write 0x0385b3 thru 0x03dfaf (0x59fd bytes) 000673 1788864929.880793 trunc from 0x03381b to 0x03c352 (0x8b38 bytes) 000674 1788864929.892629 trunc from 0x040000 to 0x035ec4 (0xa13b bytes) 000675 1788864929.912812 mapread 0x000c7d thru 0x002978 (0x1cfc bytes) 000676 1788864929.913732 trunc from 0x0164c3 to 0x016a67 (0x5a5 bytes) 000677 1788864929.924748 write 0x03373e thru 0x03a6e8 (0x6fab bytes) 000678 1788864929.932075 write 0x0297fd thru 0x033171 (0x9975 bytes) 000679 1788864929.934128 punch from 0x029280 to 0x038002 (0xed83 bytes) 000680 1788864929.948454 read 0x008654 thru 0x0145fa (0xbfa7 bytes) 000681 1788864929.949073 mapread 0x006041 thru 0x00d457 (0x7417 bytes) 000682 1788864929.953836 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a6e9): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a6e9): Mirror 13: 0x8a2a2f9c (stale) Mirror 15: 0x8a2a2f9c (stale) Mirror 16: 0x8a2a2f9c (stale) Mirror 17: 0x8a2a2f9c (stale) Mirror 18: 0x8a2a2f9c (stale) CRC-32 checksum value for chunk [0, 0x3a6e9): Mirror 1: 0x4be054e8 Mirror 19: 0x4be054e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a6e9: skipped 000683 1788864930.839995 read 0x0257e8 thru 0x02ad6d (0x5586 bytes) 000684 1788864930.856210 trunc from 0x03a6e9 to 0x02449c (0x1624c bytes) 000685 1788864930.918102 read 0x014b36 thru 0x018161 (0x362c bytes) 000686 1788864930.941935 fallocate 0x008102 thru 0x00a148 (0x2047 bytes) 000688 1788864930.949220 trunc from 0x02449d to 0x02fa4b (0xb5af bytes) 000689 1788864930.996835 trunc from 0x02fa4c to 0x02fa0f (0x3c bytes) 000690 1788864931.028612 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa10): Mirror 13: 0xf1c2ddcf (stale) Mirror 15: 0xf1c2ddcf (stale) Mirror 16: 0xf1c2ddcf (stale) Mirror 18: 0xf1c2ddcf (stale) Mirror 19: 0xb74e2a28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa10): Mirror 13: 0xf1c2ddcf (stale) Mirror 15: 0xf1c2ddcf (stale) Mirror 16: 0xf1c2ddcf (stale) Mirror 18: 0xf1c2ddcf (stale) Mirror 19: 0xb74e2a28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa10: skipped 000691 1788864931.474348 trunc from 0x02fa10 to 0x03d41b (0xda0c bytes) 000692 1788864931.501140 fallocate 0x00eb96 thru 0x010718 (0x1b83 bytes) 000696 1788864931.511276 read 0x006c31 thru 0x010a74 (0x9e44 bytes) 000698 1788864931.525064 mapread 0x01a8e7 thru 0x0272a7 (0xc9c1 bytes) 000699 1788864931.569156 write 0x032377 thru 0x036ad2 (0x475c bytes) 000700 1788864931.585721 mapread 0x01de81 thru 0x02bbf5 (0xdd75 bytes) 000701 1788864931.589230 read 0x00a624 thru 0x012b59 (0x8536 bytes) 000702 1788864931.611038 read 0x028514 thru 0x02eecb (0x69b8 bytes) 000703 1788864931.611659 trunc from 0x005dfa to 0x0158b3 (0xfaba bytes) 000704 1788864931.632513 read 0x0072b8 thru 0x0075fc (0x345 bytes) 000705 1788864931.649273 trunc from 0x0221d7 to 0x0249cd (0x27f7 bytes) 000706 1788864931.671785 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3d41c): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d41c): Mirror 13: 0xe8c7ad39 (stale) Mirror 15: 0xe8c7ad39 (stale) Mirror 16: 0xe8c7ad39 (stale) Mirror 18: 0xe8c7ad39 (stale) Mirror 19: 0x8d95b8d2 (stale) CRC-32 checksum value for chunk [0, 0x3d41c): Mirror 1: 0x64c37947 Mirror 20: 0x64c37947 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d41c: skipped 000707 1788864932.615477 punch from 0x004569 to 0x00b80c (0x72a4 bytes) 000709 1788864932.669931 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d41c): Mirror 13: 0xe8c7ad39 (stale) Mirror 15: 0xe8c7ad39 (stale) Mirror 16: 0xe8c7ad39 (stale) Mirror 19: 0x8d95b8d2 (stale) Mirror 20: 0x64c37947 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d41c): Mirror 13: 0xe8c7ad39 (stale) Mirror 15: 0xe8c7ad39 (stale) Mirror 16: 0xe8c7ad39 (stale) Mirror 19: 0x8d95b8d2 (stale) Mirror 20: 0x64c37947 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d41c: skipped 000710 1788864932.973561 punch from 0x02b324 to 0x035579 (0xa256 bytes) 000711 1788864932.978960 write 0x0351e3 thru 0x03b459 (0x6277 bytes) 000712 1788864932.991265 fallocate 0x01ac17 thru 0x0288aa (0xdc94 bytes) 000713 1788864932.996392 mapread 0x033d12 thru 0x039939 (0x5c28 bytes) 000714 1788864933.011505 trunc from 0x03d41c to 0x038383 (0x5098 bytes) 000715 1788864933.042038 read 0x03520c thru 0x038383 (0x3178 bytes) 000716 1788864933.042959 trunc from 0x01cd8b to 0x027848 (0xaabe bytes) 000717 1788864933.052186 trunc from 0x021b14 to 0x02b903 (0x9df0 bytes) 000718 1788864933.058826 write 0x0142a8 thru 0x0224e3 (0xe23c bytes) 000719 1788864933.076351 read 0x0012e6 thru 0x00fd57 (0xea72 bytes) 000720 1788864933.086491 trunc from 0x038384 to 0x039563 (0x11e0 bytes) 000721 1788864933.102282 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39564): Mirror 15: 0xe1c8b9b3 (stale) Mirror 16: 0xe1c8b9b3 (stale) Mirror 19: 0xddedaa0f (stale) Mirror 20: 0xbbe57bda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39564): Mirror 15: 0xe1c8b9b3 (stale) Mirror 16: 0xe1c8b9b3 (stale) Mirror 19: 0xddedaa0f (stale) Mirror 20: 0xbbe57bda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39564: skipped 000722 1788864933.502033 punch from 0x01e7ce to 0x02cc69 (0xe49c bytes) 000723 1788864933.510870 read 0x00eec7 thru 0x0128e9 (0x3a23 bytes) 000724 1788864933.519075 write 0x028bb1 thru 0x030afa (0x7f4a bytes) 000725 1788864933.531470 read 0x01b153 thru 0x029909 (0xe7b7 bytes) 000726 1788864933.540876 trunc from 0x018485 to 0x01d815 (0x5391 bytes) 000727 1788864933.545158 punch from 0x0161ca to 0x01f456 (0x928d bytes) 000729 1788864933.551026 punch from 0x00e997 to 0x01014c (0x17b6 bytes) 000730 1788864933.555339 read 0x00952e thru 0x014715 (0xb1e8 bytes) 000731 1788864933.564235 mapread 0x01d1bc thru 0x01f23a (0x207f bytes) 000732 1788864933.565157 fallocate 0x00f741 thru 0x010454 (0xd14 bytes) 000733 1788864933.569335 punch from 0x020a80 to 0x0286d4 (0x7c55 bytes) 000734 1788864933.580633 punch from 0x033a4a to 0x0376a9 (0x3c60 bytes) 000735 1788864933.588698 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39564): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39564): Mirror 15: 0xe1c8b9b3 (stale) Mirror 16: 0xe1c8b9b3 (stale) Mirror 19: 0xddedaa0f (stale) Mirror 20: 0xbbe57bda (stale) CRC-32 checksum value for chunk [0, 0x39564): Mirror 1: 0x3c571942 Mirror 21: 0x3c571942 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39564: skipped 000736 1788864934.626028 read 0x0379e8 thru 0x03822d (0x846 bytes) 000737 1788864934.644024 read 0x024946 thru 0x02a652 (0x5d0d bytes) 000738 1788864934.671063 read 0x020cde thru 0x030512 (0xf835 bytes) 000739 1788864934.680592 mapread 0x002819 thru 0x00fef1 (0xd6d9 bytes) 000740 1788864934.703952 read 0x00a037 thru 0x00ee05 (0x4dcf bytes) 000741 1788864934.727018 MIRROR_RESYNC 6 mirrors 000742 1788864936.432698 write 0x00ba06 thru 0x015b8e (0xa189 bytes) 000744 1788864936.487604 punch from 0x026b62 to 0x027335 (0x7d4 bytes) 000745 1788864936.493008 punch from 0x0215bd to 0x024a86 (0x34ca bytes) 000746 1788864936.503793 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39564): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39564): Mirror 15: 0x3c571942 (stale) Mirror 16: 0x3c571942 (stale) Mirror 19: 0x3c571942 (stale) Mirror 20: 0x3c571942 (stale) Mirror 21: 0x3c571942 (stale) CRC-32 checksum value for chunk [0, 0x39564): Mirror 1: 0xf4f85308 Mirror 22: 0xf4f85308 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39564: skipped 000747 1788864937.631124 trunc from 0x015756 to 0x022dab (0xd656 bytes) 000748 1788864937.670473 mapread 0x0311f0 thru 0x0358ec (0x46fd bytes) 000749 1788864937.688837 punch from 0x022c4f to 0x028f50 (0x6302 bytes) 000751 1788864937.693906 trunc from 0x039564 to 0x00107f (0x384e4 bytes) 000752 1788864937.720776 trunc from 0x001080 to 0x01a62e (0x195af bytes) 000753 1788864937.738277 trunc from 0x0062a9 to 0x00cc37 (0x698f bytes) 000754 1788864937.743256 write 0x01aaef thru 0x01edd6 (0x42e8 bytes) 000755 1788864937.748627 trunc from 0x01edd7 to 0x03c535 (0x1d75f bytes) 000756 1788864937.767792 mapwrite 0x01a853 thru 0x0211fd (0x69ab bytes) 000757 1788864937.800618 mapread 0x00562f thru 0x008330 (0x2d02 bytes) 000759 1788864937.808995 trunc from 0x03c536 to 0x0354a7 (0x708e bytes) 000760 1788864937.822986 trunc from 0x0179e8 to 0x017c09 (0x222 bytes) 000761 1788864937.831993 MIRROR_RESYNC 7 mirrors 000762 1788864939.217104 trunc from 0x0123fd to 0x019a9c (0x76a0 bytes) 000763 1788864939.253255 punch from 0x02801f to 0x02a7ef (0x27d1 bytes) 000764 1788864939.259093 punch from 0x008fe9 to 0x009637 (0x64f bytes) 000765 1788864939.279067 trunc from 0x0354a8 to 0x00583c (0x2fc6b bytes) 000766 1788864939.308117 mapwrite 0x034977 thru 0x039a1f (0x50a9 bytes) 000767 1788864939.384242 mapread 0x012999 thru 0x0214d6 (0xeb3e bytes) 000768 1788864939.403726 trunc from 0x039a20 to 0x01c626 (0x1d3f9 bytes) 000769 1788864939.421990 fallocate 0x02bbd4 thru 0x034061 (0x848e bytes) 000770 1788864939.428579 read 0x01c81d thru 0x023643 (0x6e27 bytes) 000771 1788864939.437864 mapwrite 0x007219 thru 0x0167ac (0xf594 bytes) 000772 1788864939.476792 trunc from 0x02a170 to 0x02b208 (0x1099 bytes) 000773 1788864939.481265 write 0x01fbb1 thru 0x02754f (0x799f bytes) 000775 1788864939.488222 mapread 0x00946d thru 0x00ed3f (0x58d3 bytes) 000776 1788864939.489808 fallocate 0x03034e thru 0x03647e (0x6131 bytes) 000777 1788864939.495239 punch from 0x0311cc to 0x034061 (0x2e96 bytes) 000778 1788864939.499670 mapwrite 0x02d488 thru 0x03c030 (0xeba9 bytes) 000779 1788864939.554855 trunc from 0x03c031 to 0x01341b (0x28c15 bytes) 000780 1788864939.577017 fallocate 0x02924c thru 0x02e12b (0x4ee0 bytes) 000781 1788864939.585617 trunc from 0x00c74e to 0x01c741 (0xfff4 bytes) 000782 1788864939.590371 read 0x01c554 thru 0x01c62e (0xdb bytes) 000783 1788864939.603752 fallocate 0x03dfe9 thru 0x03ffff (0x2017 bytes) 000785 1788864939.610197 read 0x00e988 thru 0x01293a (0x3fb3 bytes) 000786 1788864939.610933 mapwrite 0x02b9e0 thru 0x03087d (0x4e9e bytes) 000787 1788864939.649748 mapread 0x002646 thru 0x0028b0 (0x26b bytes) 000788 1788864939.651264 mapread 0x01a594 thru 0x01d43f (0x2eac bytes) 000789 1788864939.652157 fallocate 0x036bb0 thru 0x03ffff (0x9450 bytes) 000790 1788864939.657404 trunc from 0x02cf55 to 0x035bb8 (0x8c64 bytes) 000791 1788864939.662909 write 0x01ac9e thru 0x01c0a4 (0x1407 bytes) 000792 1788864939.668037 MIRROR_RESYNC 7 mirrors 000793 1788864941.641592 mapread 0x000ca8 thru 0x002d98 (0x20f1 bytes) 000794 1788864941.658062 mapwrite 0x009d15 thru 0x0124c4 (0x87b0 bytes) 000795 1788864941.777146 fallocate 0x02df7b thru 0x0346f3 (0x6779 bytes) 000796 1788864941.783405 punch from 0x007277 to 0x00a746 (0x34d0 bytes) 000797 1788864941.790037 write 0x03f582 thru 0x03ffff (0xa7e bytes) 000798 1788864941.796826 write 0x03d2cb thru 0x03ffff (0x2d35 bytes) 000799 1788864941.806194 MIRROR_RESYNC 7 mirrors 000800 1788864944.187239 MIRROR_EXTEND to 8 mirrors 000801 1788864945.101579 write 0x020178 thru 0x025198 (0x5021 bytes) 000802 1788864945.180376 MIRROR_RESYNC 8 mirrors 000803 1788864948.544855 MIRROR_EXTEND to 9 mirrors 000804 1788864949.521271 read 0x005e46 thru 0x01312d (0xd2e8 bytes) 000805 1788864949.550763 write 0x0323b4 thru 0x03ffff (0xdc4c bytes) 000806 1788864949.650612 mapwrite 0x00482b thru 0x010edd (0xc6b3 bytes) 000807 1788864949.734983 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x31060745 (stale) Mirror 16: 0x31060745 (stale) Mirror 19: 0x31060745 (stale) Mirror 20: 0x31060745 (stale) Mirror 21: 0x31060745 (stale) Mirror 22: 0x31060745 (stale) Mirror 24: 0x31060745 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x31060745 (stale) Mirror 16: 0x31060745 (stale) Mirror 19: 0x31060745 (stale) Mirror 20: 0x31060745 (stale) Mirror 21: 0x31060745 (stale) Mirror 22: 0x31060745 (stale) Mirror 24: 0x31060745 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000808 1788864950.241101 mapwrite 0x026a10 thru 0x0270c0 (0x6b1 bytes) 000810 1788864950.265851 trunc from 0x011596 to 0x0210e1 (0xfb4c bytes) 000811 1788864950.269966 mapwrite 0x015aff thru 0x0188dc (0x2dde bytes) 000812 1788864950.312036 MIRROR_RESYNC 8 mirrors 000813 1788864952.993010 read 0x002a1b thru 0x011426 (0xea0c bytes) 000814 1788864953.003889 MIRROR_RESYNC 8 mirrors 000815 1788864953.408402 punch from 0x0303cc to 0x03e97d (0xe5b2 bytes) 000816 1788864953.438501 trunc from 0x02d2b4 to 0x02f069 (0x1db6 bytes) 000818 1788864953.443366 trunc from 0x040000 to 0x0363e4 (0x9c1b bytes) 000820 1788864953.461077 mapread 0x00828f thru 0x00f6cd (0x743f bytes) 000822 1788864953.485209 punch from 0x035330 to 0x0363e4 (0x10b5 bytes) 000823 1788864953.493294 trunc from 0x004c00 to 0x00f867 (0xac68 bytes) 000824 1788864953.498413 trunc from 0x011462 to 0x01a446 (0x8fe5 bytes) 000825 1788864953.503711 fallocate 0x03becd thru 0x03ffff (0x4133 bytes) 000826 1788864953.511106 write 0x03a016 thru 0x03ffff (0x5fea bytes) 000827 1788864953.520356 mapread 0x02573a thru 0x028dfc (0x36c3 bytes) 000828 1788864953.530806 punch from 0x00beb5 to 0x01624b (0xa397 bytes) 000829 1788864953.536395 fallocate 0x012740 thru 0x01687a (0x413b bytes) 000830 1788864953.542191 punch from 0x032445 to 0x03ffff (0xdbbb bytes) 000831 1788864953.562535 trunc from 0x01c153 to 0x028eab (0xcd59 bytes) 000833 1788864953.569697 mapread 0x026a53 thru 0x02c91b (0x5ec9 bytes) 000834 1788864953.580135 read 0x00dda4 thru 0x01ab01 (0xcd5e bytes) 000835 1788864953.587322 trunc from 0x03e8d9 to 0x03ffff (0x1727 bytes) 000836 1788864953.593388 trunc from 0x02444f to 0x0332f2 (0xeea4 bytes) 000837 1788864953.603642 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xb124f1a1 (stale) Mirror 16: 0xb124f1a1 (stale) Mirror 19: 0xb124f1a1 (stale) Mirror 20: 0xb124f1a1 (stale) Mirror 21: 0xb124f1a1 (stale) Mirror 24: 0xb124f1a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xb124f1a1 (stale) Mirror 16: 0xb124f1a1 (stale) Mirror 19: 0xb124f1a1 (stale) Mirror 20: 0xb124f1a1 (stale) Mirror 21: 0xb124f1a1 (stale) Mirror 24: 0xb124f1a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000838 1788864953.981068 trunc from 0x031a9f to 0x0379f1 (0x5f53 bytes) 000839 1788864953.985126 trunc from 0x040000 to 0x032e09 (0xd1f6 bytes) 000840 1788864953.999931 punch from 0x00b853 to 0x0183d6 (0xcb84 bytes) 000841 1788864954.004659 punch from 0x0227b9 to 0x02798a (0x51d2 bytes) 000842 1788864954.009168 mapread 0x016ef2 thru 0x019549 (0x2658 bytes) 000843 1788864954.025978 trunc from 0x006da9 to 0x011c2f (0xae87 bytes) 000844 1788864954.032232 mapwrite 0x039c0f thru 0x03ffff (0x63f1 bytes) 000845 1788864954.071716 trunc from 0x040000 to 0x008996 (0x37669 bytes) 000846 1788864954.092977 trunc from 0x008997 to 0x0014f9 (0x749d bytes) 000847 1788864954.108024 write 0x023948 thru 0x029158 (0x5811 bytes) 000848 1788864954.110065 trunc from 0x01f0ea to 0x029158 (0xa06f bytes) 000849 1788864954.122413 mapread 0x003a5d thru 0x0073a6 (0x394a bytes) 000850 1788864954.131868 write 0x02ca17 thru 0x033541 (0x6b2b bytes) 000851 1788864954.139767 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33542): Mirror 15: 0x499680a2 (stale) Mirror 16: 0x499680a2 (stale) Mirror 20: 0x499680a2 (stale) Mirror 21: 0x499680a2 (stale) Mirror 24: 0x499680a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33542): Mirror 15: 0x499680a2 (stale) Mirror 16: 0x499680a2 (stale) Mirror 20: 0x499680a2 (stale) Mirror 21: 0x499680a2 (stale) Mirror 24: 0x499680a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33542: skipped 000852 1788864954.554832 punch from 0x0031b9 to 0x0094c8 (0x6310 bytes) 000853 1788864954.566238 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33542): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33542): Mirror 15: 0x499680a2 (stale) Mirror 16: 0x499680a2 (stale) Mirror 20: 0x499680a2 (stale) Mirror 21: 0x499680a2 (stale) Mirror 24: 0x499680a2 (stale) CRC-32 checksum value for chunk [0, 0x33542): Mirror 1: 0xd2e5b24a Mirror 25: 0xd2e5b24a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33542: skipped 000854 1788864955.312972 mapread 0x028713 thru 0x02f358 (0x6c46 bytes) 000855 1788864955.354036 punch from 0x003aed to 0x00eef5 (0xb409 bytes) 000856 1788864955.490662 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x33542): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33542): Mirror 15: 0x499680a2 (stale) Mirror 16: 0x499680a2 (stale) Mirror 20: 0x499680a2 (stale) Mirror 21: 0x499680a2 (stale) Mirror 24: 0x499680a2 (stale) Mirror 25: 0xd2e5b24a (stale) CRC-32 checksum value for chunk [0, 0x33542): Mirror 1: 0xd2e5b24a Mirror 26: 0xd2e5b24a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33542: skipped 000857 1788864956.321790 trunc from 0x033542 to 0x03f0ad (0xbb6c bytes) 000860 1788864956.382303 mapread 0x00e558 thru 0x00e9e5 (0x48e bytes) 000861 1788864956.387901 punch from 0x035d3d to 0x03f0ad (0x9371 bytes) 000862 1788864956.392071 trunc from 0x03f0ae to 0x0052d8 (0x39dd5 bytes) 000863 1788864956.415104 trunc from 0x003b32 to 0x0052d8 (0x17a7 bytes) 000864 1788864956.419761 write 0x004e23 thru 0x007250 (0x242e bytes) 000865 1788864956.428501 MIRROR_RESYNC 8 mirrors 000866 1788864957.761044 trunc from 0x002515 to 0x007250 (0x4d3c bytes) 000867 1788864957.793252 write 0x00c3b0 thru 0x0194dd (0xd12e bytes) 000868 1788864957.799093 trunc from 0x0194de to 0x02e848 (0x1536b bytes) 000869 1788864957.819078 trunc from 0x001af8 to 0x006555 (0x4a5e bytes) 000871 1788864957.824144 trunc from 0x02e849 to 0x00e0c3 (0x20785 bytes) 000872 1788864957.837494 write 0x009d9c thru 0x015f52 (0xc1b7 bytes) 000873 1788864957.848673 mapread 0x00e504 thru 0x015f52 (0x7a4f bytes) 000874 1788864957.849874 trunc from 0x015f53 to 0x02da62 (0x17b10 bytes) 000875 1788864957.875514 MIRROR_RESYNC 8 mirrors 000876 1788864959.902596 fallocate 0x019ec6 thru 0x023bb2 (0x9ced bytes) 000877 1788864959.941155 fallocate 0x0157bc thru 0x01e5ea (0x8e2f bytes) 000879 1788864959.956929 MIRROR_RESYNC 8 mirrors 000880 1788864961.803099 fallocate 0x02aa8e thru 0x02c05d (0x15d0 bytes) 000881 1788864961.850167 mapwrite 0x03de98 thru 0x03ffff (0x2168 bytes) 000884 1788864961.919350 trunc from 0x040000 to 0x012a4a (0x2d5b5 bytes) 000885 1788864961.939459 mapwrite 0x00203f thru 0x003441 (0x1403 bytes) 000886 1788864961.968151 mapwrite 0x028a89 thru 0x029222 (0x79a bytes) 000889 1788864962.029755 write 0x0396f5 thru 0x03ffff (0x690b bytes) 000890 1788864962.032083 mapwrite 0x01c13f thru 0x0264cc (0xa38e bytes) 000891 1788864962.062803 write 0x01e915 thru 0x02d08b (0xe777 bytes) 000892 1788864962.070575 mapread 0x01236e thru 0x015aef (0x3782 bytes) 000893 1788864962.074816 mapwrite 0x012fd5 thru 0x01bf19 (0x8f45 bytes) 000894 1788864962.087237 trunc from 0x040000 to 0x039352 (0x6cad bytes) 000895 1788864962.096809 trunc from 0x039353 to 0x023ef8 (0x1545a bytes) 000897 1788864962.114095 mapread 0x01b4c7 thru 0x022623 (0x715d bytes) 000898 1788864962.115041 fallocate 0x03de30 thru 0x03ffff (0x21d0 bytes) 000899 1788864962.120953 trunc from 0x040000 to 0x01ca4c (0x235b3 bytes) 000900 1788864962.141280 write 0x033b28 thru 0x03d851 (0x9d2a bytes) 000901 1788864962.142477 read 0x02778e thru 0x02bd44 (0x45b7 bytes) 000902 1788864962.148689 mapread 0x0181bc thru 0x019d6e (0x1bb3 bytes) 000903 1788864962.150086 punch from 0x035c14 to 0x037190 (0x157d bytes) 000904 1788864962.160263 write 0x00474e thru 0x0122de (0xdb91 bytes) 000905 1788864962.162104 write 0x00daa6 thru 0x0166bf (0x8c1a bytes) 000906 1788864962.163597 trunc from 0x00668c to 0x006de1 (0x756 bytes) 000907 1788864962.210864 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d852): Mirror 15: 0x694a326 (stale) Mirror 20: 0x694a326 (stale) Mirror 21: 0x694a326 (stale) Mirror 24: 0x694a326 (stale) Mirror 25: 0x694a326 (stale) Mirror 26: 0x694a326 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d852): Mirror 15: 0x694a326 (stale) Mirror 20: 0x694a326 (stale) Mirror 21: 0x694a326 (stale) Mirror 24: 0x694a326 (stale) Mirror 25: 0x694a326 (stale) Mirror 26: 0x694a326 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d852: skipped 000908 1788864962.733622 mapwrite 0x00c527 thru 0x01432b (0x7e05 bytes) 000909 1788864962.763276 write 0x0071c4 thru 0x0152bd (0xe0fa bytes) 000910 1788864962.768027 punch from 0x030d0f to 0x03d851 (0xcb43 bytes) 000911 1788864962.772829 write 0x039ad6 thru 0x03aa4d (0xf78 bytes) 000913 1788864962.782410 read 0x02ff27 thru 0x0302bd (0x397 bytes) 000914 1788864962.791169 mapwrite 0x003286 thru 0x00a941 (0x76bc bytes) 000915 1788864962.859657 mapwrite 0x024ab6 thru 0x026af9 (0x2044 bytes) 000916 1788864962.934740 punch from 0x00fabf to 0x01e96d (0xeeaf bytes) 000917 1788864962.943075 mapread 0x01406f thru 0x016aa8 (0x2a3a bytes) 000918 1788864962.954674 write 0x03d2a7 thru 0x03ffff (0x2d59 bytes) 000919 1788864962.971473 MIRROR_RESYNC 7 mirrors 000920 1788864965.454620 read 0x010d5b thru 0x011071 (0x317 bytes) 000921 1788864965.459369 fallocate 0x006b6f thru 0x00999d (0x2e2f bytes) 000922 1788864965.508088 write 0x016147 thru 0x023dce (0xdc88 bytes) 000923 1788864965.522951 read 0x038ca7 thru 0x03ffff (0x7359 bytes) 000924 1788864965.536611 trunc from 0x040000 to 0x01c828 (0x237d7 bytes) 000925 1788864965.557420 MIRROR_RESYNC 7 mirrors 000926 1788864966.945705 write 0x01a95c thru 0x01e800 (0x3ea5 bytes) 000927 1788864966.979546 mapwrite 0x00b5ab thru 0x01960c (0xe062 bytes) 000928 1788864967.024512 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e801): Mirror 20: 0xce8c12e (stale) Mirror 21: 0xce8c12e (stale) Mirror 24: 0xce8c12e (stale) Mirror 25: 0xce8c12e (stale) Mirror 26: 0xce8c12e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e801): Mirror 20: 0xce8c12e (stale) Mirror 21: 0xce8c12e (stale) Mirror 24: 0xce8c12e (stale) Mirror 25: 0xce8c12e (stale) Mirror 26: 0xce8c12e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e801: skipped 000929 1788864967.485200 punch from 0x0191bf to 0x01e800 (0x5642 bytes) 000930 1788864967.492262 read 0x01a9fe thru 0x01e800 (0x3e03 bytes) 000931 1788864967.502239 fallocate 0x021884 thru 0x026354 (0x4ad1 bytes) 000932 1788864967.518153 MIRROR_RESYNC 6 mirrors 000933 1788864969.454618 mapread 0x00fd1a thru 0x014616 (0x48fd bytes) 000934 1788864969.474944 mapwrite 0x00c48f thru 0x00df6a (0x1adc bytes) 000935 1788864969.555093 punch from 0x01bf67 to 0x026354 (0xa3ee bytes) 000936 1788864969.561577 mapwrite 0x020272 thru 0x029982 (0x9711 bytes) 000937 1788864969.608599 read 0x005edd thru 0x006239 (0x35d bytes) 000938 1788864969.609217 mapwrite 0x03501b thru 0x0364bf (0x14a5 bytes) 000939 1788864969.638940 mapwrite 0x02a4e8 thru 0x02d23d (0x2d56 bytes) 000940 1788864969.657537 fallocate 0x026b1e thru 0x0277a4 (0xc87 bytes) 000941 1788864969.670187 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x364c0): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364c0): Mirror 20: 0x94d2c251 (stale) Mirror 21: 0x94d2c251 (stale) Mirror 24: 0x94d2c251 (stale) Mirror 25: 0x94d2c251 (stale) Mirror 26: 0x94d2c251 (stale) CRC-32 checksum value for chunk [0, 0x364c0): Mirror 1: 0xcaa818d6 Mirror 27: 0xcaa818d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364c0: skipped 000942 1788864970.623012 write 0x028769 thru 0x035d2c (0xd5c4 bytes) 000944 1788864970.680071 read 0x029b24 thru 0x03393a (0x9e17 bytes) 000945 1788864970.680756 mapread 0x0091e9 thru 0x0097ea (0x602 bytes) 000947 1788864970.697055 trunc from 0x0092c9 to 0x012325 (0x905d bytes) 000948 1788864970.715575 trunc from 0x019ee7 to 0x026ece (0xcfe8 bytes) 000949 1788864970.720728 read 0x00a8f0 thru 0x01862a (0xdd3b bytes) 000950 1788864970.743738 write 0x00d0bf thru 0x0157ca (0x870c bytes) 000951 1788864970.746826 trunc from 0x00b12e to 0x0146ec (0x95bf bytes) 000952 1788864970.766045 trunc from 0x0364c0 to 0x0074f8 (0x2efc7 bytes) 000953 1788864970.795988 trunc from 0x0074f9 to 0x037f05 (0x30a0d bytes) 000954 1788864970.814326 punch from 0x009fdc to 0x00e019 (0x403e bytes) 000955 1788864970.819950 punch from 0x024944 to 0x032fb8 (0xe675 bytes) 000956 1788864970.823932 punch from 0x00d33b to 0x00fbb3 (0x2879 bytes) 000957 1788864970.828503 trunc from 0x037f06 to 0x02ed1c (0x91e9 bytes) 000958 1788864970.844375 trunc from 0x02ed1d to 0x004a5f (0x2a2bd bytes) 000959 1788864970.862880 mapread 0x00488c thru 0x004a5f (0x1d4 bytes) 000960 1788864970.866846 write 0x00e773 thru 0x0102b9 (0x1b47 bytes) 000961 1788864970.868676 punch from 0x006d76 to 0x0102b9 (0x9544 bytes) 000962 1788864970.881031 trunc from 0x0102ba to 0x03f07d (0x2edc4 bytes) 000963 1788864970.897797 punch from 0x02d1a2 to 0x03c357 (0xf1b6 bytes) 000964 1788864970.901784 trunc from 0x0002f9 to 0x00bcfa (0xba02 bytes) 000965 1788864970.914732 read 0x02cfb9 thru 0x02f325 (0x236d bytes) 000966 1788864970.942700 trunc from 0x03f07e to 0x0058a3 (0x397da bytes) 000967 1788864970.969071 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x58a4): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x58a4): Mirror 20: 0xc9956d33 (stale) Mirror 21: 0xc9956d33 (stale) Mirror 24: 0xc9956d33 (stale) Mirror 25: 0xc9956d33 (stale) Mirror 26: 0xc9956d33 (stale) Mirror 27: 0xc9956d33 (stale) CRC-32 checksum value for chunk [0, 0x58a4): Mirror 1: 0x716dd44 Mirror 28: 0x716dd44 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x58a4: skipped 000968 1788864971.804098 read 0x001ec2 thru 0x0058a3 (0x39e2 bytes) 000969 1788864971.820130 read 0x00457c thru 0x0058a3 (0x1328 bytes) 000970 1788864971.827711 fallocate 0x004c32 thru 0x00a26f (0x563e bytes) 000971 1788864971.886006 trunc from 0x004a51 to 0x006a92 (0x2042 bytes) 000972 1788864971.892767 trunc from 0x00a270 to 0x03b490 (0x31221 bytes) 000973 1788864971.918945 punch from 0x0274ed to 0x0318db (0xa3ef bytes) 000974 1788864971.922683 write 0x01d5d0 thru 0x01e2ba (0xceb bytes) 000975 1788864971.929946 punch from 0x01b4b9 to 0x02990c (0xe454 bytes) 000976 1788864971.942616 punch from 0x00d985 to 0x00e86a (0xee6 bytes) 000978 1788864971.951673 trunc from 0x00cc06 to 0x00d543 (0x93e bytes) 000979 1788864971.962065 read 0x006397 thru 0x0153ee (0xf058 bytes) 000980 1788864971.980006 mapwrite 0x010add thru 0x016887 (0x5dab bytes) 000981 1788864972.010507 mapread 0x03210b thru 0x03b490 (0x9386 bytes) 000982 1788864972.011649 mapwrite 0x005192 thru 0x012013 (0xce82 bytes) 000983 1788864972.063786 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1bf:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b491): Mirror 20: 0xee8f144d (stale) Mirror 21: 0xee8f144d (stale) Mirror 25: 0xee8f144d (stale) Mirror 26: 0xee8f144d (stale) Mirror 27: 0x8f141be5 (stale) Mirror 28: 0xdd7fd5c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b491): Mirror 20: 0xee8f144d (stale) Mirror 21: 0xee8f144d (stale) Mirror 25: 0xee8f144d (stale) Mirror 26: 0xee8f144d (stale) Mirror 27: 0x8f141be5 (stale) Mirror 28: 0xdd7fd5c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b491: skipped 000984 1788864972.553908 trunc from 0x03b491 to 0x0230a2 (0x183ee bytes) 000985 1788864972.590096 write 0x02fa8a thru 0x032f22 (0x3499 bytes) 000987 1788864972.595086 read 0x00bed5 thru 0x00c5f5 (0x721 bytes) 000988 1788864972.603682 write 0x03a98e thru 0x03ccc4 (0x2337 bytes) 000990 1788864972.609228 mapread 0x00081f thru 0x00c649 (0xbe2b bytes) 000991 1788864972.662963 trunc from 0x03ccc5 to 0x03aac0 (0x2204 bytes) 000992 1788864972.695918 read 0x03159f thru 0x03949c (0x7efe bytes) 000993 1788864972.722843 trunc from 0x03aac1 to 0x009c1e (0x30ea2 bytes) 000995 1788864972.741149 mapread 0x001f2a thru 0x009c1e (0x7cf5 bytes) 000997 1788864972.746493 punch from 0x0030c7 to 0x003620 (0x55a bytes) 000998 1788864972.751228 fallocate 0x01beb7 thru 0x0281ea (0xc334 bytes) 000999 1788864972.760038 write 0x02a14c thru 0x02a5f7 (0x4ac bytes) 001000 1788864972.761139 fallocate 0x005332 thru 0x00a420 (0x50ef bytes) All operations completed A-OK!