== sanity-flr test 70a: flr mode fsx test ================ 22:14:16 (1789352056) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 2057 skipping zero size read fallocating to largest ever: 0x199b7 000002 1789352058.026048 fallocate 0x00adfe thru 0x0199b6 (0xebb9 bytes) skipping zero size read skipping zero length zero range skipping zero length zero range 000006 1789352058.036429 mapwrite 0x028a71 thru 0x030204 (0x7794 bytes) 000007 1789352058.096909 trunc from 0x030205 to 0x0008d6 (0x2f92e bytes) truncating to largest ever: 0x1c809 000008 1789352058.121511 trunc from 0x0008d7 to 0x01c808 (0x1bf32 bytes) 000009 1789352058.152498 trunc from 0x00bb99 to 0x00fafa (0x3f62 bytes) 000010 1789352058.157096 trunc from 0x01624d to 0x01c808 (0x65bc bytes) 000011 1789352058.162788 trunc from 0x0117a5 to 0x01bd1b (0xa577 bytes) 000014 1789352058.177822 trunc from 0x011100 to 0x012b80 (0x1a81 bytes) 000015 1789352058.184465 mapread 0x006e5e thru 0x00b8b9 (0x4a5c bytes) 000016 1789352058.200348 punch from 0x004ea8 to 0x0058b9 (0xa12 bytes) 000017 1789352058.205782 punch from 0x006e9f to 0x00f7c8 (0x892a bytes) 000018 1789352058.210871 mapwrite 0x004c59 thru 0x00d050 (0x83f8 bytes) 000019 1789352058.247042 punch from 0x00e358 to 0x01416f (0x5e18 bytes) 000020 1789352058.252324 mapread 0x00da54 thru 0x01b16f (0xd71c bytes) 000022 1789352058.277002 write 0x007ce1 thru 0x013281 (0xb5a1 bytes) 000023 1789352058.278665 trunc from 0x00db02 to 0x01c808 (0xed07 bytes) 000024 1789352058.293715 trunc from 0x01c809 to 0x004940 (0x17ec8 bytes) 000025 1789352058.309501 read 0x0017e5 thru 0x004940 (0x315c bytes) 000026 1789352058.310610 trunc from 0x002bf6 to 0x00463a (0x1a45 bytes) 000027 1789352058.316562 trunc from 0x001dfd to 0x004940 (0x2b44 bytes) 000028 1789352058.321183 trunc from 0x0033ed to 0x004940 (0x1554 bytes) fallocating to largest ever: 0x40000 000029 1789352058.330269 fallocate 0x03fbe2 thru 0x03ffff (0x41e bytes) 000030 1789352058.338459 mapwrite 0x00beb4 thru 0x015c85 (0x9dd2 bytes) 000031 1789352058.394842 read 0x0185d6 thru 0x0206c4 (0x80ef bytes) 000034 1789352058.410656 mapwrite 0x02b344 thru 0x032973 (0x7630 bytes) 000035 1789352058.437112 trunc from 0x02c798 to 0x0303c2 (0x3c2b bytes) 000036 1789352058.443706 punch from 0x027556 to 0x03499f (0xd44a bytes) 000037 1789352058.452866 mapwrite 0x02cd3a thru 0x0348f4 (0x7bbb bytes) 000038 1789352058.559693 mapread 0x02cc63 thru 0x033d3f (0x70dd bytes) 000039 1789352058.560508 punch from 0x010649 to 0x012489 (0x1e41 bytes) 000040 1789352058.566099 mapread 0x02766d thru 0x037394 (0xfd28 bytes) 000041 1789352058.588687 mapwrite 0x02f615 thru 0x03d6f6 (0xe0e2 bytes) 000042 1789352058.612146 trunc from 0x02eb7f to 0x03df11 (0xf393 bytes) 000043 1789352058.617928 punch from 0x0369cc to 0x03ffff (0x9634 bytes) 000044 1789352058.623747 mapwrite 0x008960 thru 0x0143ea (0xba8b bytes) 000045 1789352058.679625 write 0x02c1a6 thru 0x039eda (0xdd35 bytes) 000046 1789352058.696201 mapwrite 0x024829 thru 0x024fb3 (0x78b bytes) 000047 1789352058.735513 mapread 0x01b14a thru 0x01d7a6 (0x265d bytes) 000048 1789352058.741401 MIRROR_EXTEND to 2 mirrors 000049 1789352059.564270 trunc from 0x040000 to 0x02c620 (0x139df bytes) 000050 1789352059.639830 MIRROR_RESYNC 2 mirrors 000052 1789352060.341169 MIRROR_EXTEND to 3 mirrors 000053 1789352060.978738 trunc from 0x02c621 to 0x038c02 (0xc5e2 bytes) 000055 1789352061.023045 fallocate 0x01ec35 thru 0x021078 (0x2444 bytes) 000056 1789352061.030193 fallocate 0x0119e7 thru 0x01ec4a (0xd264 bytes) 000057 1789352061.037988 read 0x008cd5 thru 0x01597b (0xcca7 bytes) 000058 1789352061.056801 fallocate 0x005f69 thru 0x010910 (0xa9a8 bytes) 000059 1789352061.062890 mapwrite 0x02b304 thru 0x036616 (0xb313 bytes) 000060 1789352061.135966 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38c03): Mirror 3: 0xc70dff8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38c03): Mirror 3: 0xc70dff8a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38c03: skipped 000061 1789352061.460099 trunc from 0x002f33 to 0x003e1b (0xee9 bytes) 000062 1789352061.469581 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) 000064 1789352061.671751 mapwrite 0x0138e8 thru 0x0213ed (0xdb06 bytes) 000065 1789352061.734289 mapwrite 0x03ac2b thru 0x03ffff (0x53d5 bytes) 000066 1789352061.818976 mapread 0x007fea thru 0x016b9a (0xebb1 bytes) 000067 1789352061.838332 MIRROR_EXTEND to 2 mirrors 000068 1789352062.612273 write 0x02fc8d thru 0x03ae54 (0xb1c8 bytes) 000069 1789352062.665928 fallocate 0x00ef08 thru 0x01700b (0x8104 bytes) 000070 1789352062.673374 write 0x018a63 thru 0x019c62 (0x1200 bytes) 000071 1789352062.687403 trunc from 0x015fbf to 0x01699c (0x9de bytes) 000072 1789352062.692683 punch from 0x02783f to 0x02b56f (0x3d31 bytes) 000073 1789352062.697686 mapwrite 0x038f18 thru 0x03ffff (0x70e8 bytes) 000074 1789352062.740141 write 0x038d46 thru 0x03ffff (0x72ba bytes) 000075 1789352062.742013 trunc from 0x040000 to 0x00ed4b (0x312b4 bytes) 000076 1789352062.773486 mapread 0x001e5d thru 0x00953d (0x76e1 bytes) 000077 1789352062.789722 mapwrite 0x02055f thru 0x029920 (0x93c2 bytes) 000078 1789352062.872179 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) 000079 1789352063.003982 trunc from 0x029921 to 0x01adfc (0xeb24 bytes) 000080 1789352063.022129 mapwrite 0x0312b8 thru 0x0355e4 (0x432d bytes) 000081 1789352063.067649 fallocate 0x0366f6 thru 0x03ffff (0x990a bytes) 000082 1789352063.072922 punch from 0x02b087 to 0x0388ce (0xd848 bytes) 000083 1789352063.078077 fallocate 0x0326c6 thru 0x03b86c (0x91a7 bytes) 000084 1789352063.082771 write 0x01b8e9 thru 0x029479 (0xdb91 bytes) 000086 1789352063.095200 write 0x0042fc thru 0x012022 (0xdd27 bytes) 000087 1789352063.106075 mapwrite 0x0192fa thru 0x0201f9 (0x6f00 bytes) 000088 1789352063.147489 write 0x026ad3 thru 0x02f953 (0x8e81 bytes) 000089 1789352063.156315 mapread 0x00e1a3 thru 0x01b1dd (0xd03b bytes) 000090 1789352063.157594 mapwrite 0x016d60 thru 0x01b584 (0x4825 bytes) 000091 1789352063.186287 fallocate 0x0186d4 thru 0x026e07 (0xe734 bytes) 000092 1789352063.198494 mapwrite 0x03adab thru 0x03ddf4 (0x304a bytes) 000093 1789352063.244386 trunc from 0x040000 to 0x02524c (0x1adb3 bytes) 000094 1789352063.266280 mapwrite 0x03cd7b thru 0x03f021 (0x22a7 bytes) 000095 1789352063.324035 mapwrite 0x02edc7 thru 0x03e1a2 (0xf3dc bytes) 000096 1789352063.355565 trunc from 0x03f022 to 0x018fad (0x26074 bytes) 000097 1789352063.377085 mapread 0x00ad15 thru 0x013dfb (0x90e7 bytes) 000098 1789352063.378438 fallocate 0x03d266 thru 0x03ffff (0x2d9a bytes) 000099 1789352063.384859 mapread 0x016dea thru 0x01deff (0x7116 bytes) 000100 1789352063.398549 trunc from 0x040000 to 0x020047 (0x1ffb8 bytes) 000101 1789352063.416697 trunc from 0x020048 to 0x018f09 (0x713e bytes) 000103 1789352063.431990 trunc from 0x018f0a to 0x014ade (0x442b bytes) 000104 1789352063.452893 trunc from 0x014adf to 0x022735 (0xdc57 bytes) 000105 1789352063.467147 trunc from 0x022736 to 0x00a1f4 (0x18541 bytes) 000106 1789352063.486580 punch from 0x00734f to 0x00a1f4 (0x2ea6 bytes) 000108 1789352063.492970 mapwrite 0x023915 thru 0x029340 (0x5a2c bytes) 000109 1789352063.541208 trunc from 0x01fd94 to 0x027a0b (0x7c78 bytes) 000110 1789352063.547167 mapwrite 0x00b3a8 thru 0x015189 (0x9de2 bytes) 000111 1789352063.589867 read 0x01297b thru 0x0208a7 (0xdf2d bytes) 000113 1789352063.597001 mapwrite 0x031b18 thru 0x0337d0 (0x1cb9 bytes) 000114 1789352063.636741 trunc from 0x00c4cb to 0x01a5c5 (0xe0fb bytes) 000116 1789352063.642756 fallocate 0x031b7c thru 0x0357de (0x3c63 bytes) 000117 1789352063.647872 trunc from 0x03009f to 0x0337d0 (0x3732 bytes) 000119 1789352063.653970 trunc from 0x01907a to 0x02280b (0x9792 bytes) 000120 1789352063.658150 write 0x0038e6 thru 0x00933a (0x5a55 bytes) 000122 1789352063.665008 mapwrite 0x021909 thru 0x024a78 (0x3170 bytes) 000123 1789352063.690625 trunc from 0x0337d1 to 0x00f5e0 (0x241f0 bytes) 000126 1789352063.706989 mapwrite 0x00425d thru 0x004c37 (0x9db bytes) 000127 1789352063.717813 punch from 0x005d43 to 0x00f5e0 (0x989e bytes) 000128 1789352063.722962 fallocate 0x03a451 thru 0x03fa37 (0x55e7 bytes) 000129 1789352063.727968 trunc from 0x00efa2 to 0x00f5e0 (0x63f bytes) 000130 1789352063.732723 punch from 0x0006c3 to 0x00095b (0x299 bytes) 000131 1789352063.752516 punch from 0x00377c to 0x00f5e0 (0xbe65 bytes) 000132 1789352063.758453 read 0x00c829 thru 0x00f5e0 (0x2db8 bytes) 000133 1789352063.772274 trunc from 0x00f5e1 to 0x01084a (0x126a bytes) 000134 1789352063.785703 read 0x0078ec thru 0x01084a (0x8f5f bytes) 000136 1789352063.798157 read 0x003395 thru 0x00ca2e (0x969a bytes) 000137 1789352063.798838 read 0x00f7a4 thru 0x01084a (0x10a7 bytes) 000139 1789352063.799954 punch from 0x000e36 to 0x006ff3 (0x61be bytes) 000140 1789352063.806100 trunc from 0x01084b to 0x03f127 (0x2e8dd bytes) 000141 1789352063.821773 punch from 0x039ac1 to 0x03ec03 (0x5143 bytes) 000142 1789352063.827858 fallocate 0x025a3a thru 0x02d525 (0x7aec bytes) 000145 1789352063.835386 trunc from 0x01f3a2 to 0x02b58a (0xc1e9 bytes) 000146 1789352063.846169 MIRROR_EXTEND to 2 mirrors 000147 1789352064.360946 trunc from 0x03f128 to 0x0011da (0x3df4d bytes) 000148 1789352064.419931 punch from 0x000971 to 0x0011da (0x86a bytes) 000149 1789352064.425774 write 0x022349 thru 0x022375 (0x2d bytes) 000150 1789352064.426843 fallocate 0x0365be thru 0x03ae79 (0x48bc bytes) 000151 1789352064.433611 mapread 0x02f53a thru 0x03a3b5 (0xae7c bytes) 000152 1789352064.460845 fallocate 0x022115 thru 0x022211 (0xfd bytes) 000154 1789352064.467837 trunc from 0x03ae7a to 0x0132b5 (0x27bc4 bytes) 000155 1789352064.489828 mapwrite 0x00155d thru 0x00c66f (0xb113 bytes) 000156 1789352064.523493 fallocate 0x012c40 thru 0x020faf (0xe370 bytes) 000157 1789352064.529093 write 0x01c953 thru 0x0279db (0xb089 bytes) 000158 1789352064.532190 fallocate 0x02ad6e thru 0x03ad42 (0xffd5 bytes) 000159 1789352064.537826 mapread 0x000bdc thru 0x00dcf3 (0xd118 bytes) 000160 1789352064.544437 mapread 0x011a5c thru 0x017b6b (0x6110 bytes) 000161 1789352064.559565 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 2: 0xa929218c (stale) CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 1: 0xffbb1ec4 Mirror 3: 0xffbb1ec4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad43: skipped 000162 1789352065.262737 mapread 0x031ec9 thru 0x032098 (0x1d0 bytes) 000163 1789352065.300801 fallocate 0x000c50 thru 0x00d238 (0xc5e9 bytes) 000164 1789352065.366254 mapread 0x00e34c thru 0x018c30 (0xa8e5 bytes) 000165 1789352065.396630 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 2: 0xa929218c (stale) Mirror 3: 0xffbb1ec4 (stale) CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 1: 0xffbb1ec4 Mirror 4: 0xffbb1ec4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad43: skipped 000166 1789352066.207945 MIRROR_RESYNC 4 mirrors 000167 1789352067.036793 write 0x025598 thru 0x02ec72 (0x96db bytes) 000168 1789352067.082471 mapread 0x0139cd thru 0x0238d9 (0xff0d bytes) 000170 1789352067.104445 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 2: 0xffbb1ec4 (stale) Mirror 3: 0xffbb1ec4 (stale) Mirror 4: 0xffbb1ec4 (stale) CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 1: 0xc5310281 Mirror 5: 0xc5310281 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad43: skipped 000171 1789352067.968934 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 3: 0xffbb1ec4 (stale) Mirror 4: 0xffbb1ec4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 3: 0xffbb1ec4 (stale) Mirror 4: 0xffbb1ec4 (stale) CRC-32 checksum value for chunk [0, 0x3ad43): Mirror 1: 0xc5310281 Mirror 5: 0xc5310281 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad43: skipped 000172 1789352068.612498 trunc from 0x03ad43 to 0x00dca5 (0x2d09d bytes) 000173 1789352068.705150 punch from 0x000b23 to 0x0068d7 (0x5db5 bytes) 000174 1789352068.715180 trunc from 0x00dca6 to 0x00336e (0xa937 bytes) 000175 1789352068.740461 read 0x000d5e thru 0x00336e (0x2611 bytes) 000176 1789352068.747675 trunc from 0x001b47 to 0x00336e (0x1828 bytes) 000177 1789352068.755886 mapread 0x002216 thru 0x00336e (0x1159 bytes) 000178 1789352068.783680 trunc from 0x00336f to 0x03f541 (0x3c1d3 bytes) 000179 1789352068.821664 write 0x037281 thru 0x03bb95 (0x4915 bytes) 000180 1789352068.853860 write 0x0007e9 thru 0x0008d2 (0xea bytes) 000181 1789352068.855193 punch from 0x032b94 to 0x038810 (0x5c7d bytes) 000182 1789352068.868417 mapread 0x01f616 thru 0x01fb0a (0x4f5 bytes) 000183 1789352068.886256 read 0x03e670 thru 0x03f541 (0xed2 bytes) 000184 1789352068.923050 mapwrite 0x02ce04 thru 0x032006 (0x5203 bytes) 000185 1789352068.950642 trunc from 0x01117d to 0x01fdfa (0xec7e bytes) 000186 1789352068.959530 punch from 0x0228c7 to 0x023b9b (0x12d5 bytes) 000187 1789352068.966817 mapread 0x00fd24 thru 0x015dda (0x60b7 bytes) 000188 1789352069.010212 read 0x02e692 thru 0x032912 (0x4281 bytes) 000189 1789352069.011300 punch from 0x01cebb to 0x01e056 (0x119c bytes) 000190 1789352069.032586 write 0x010e35 thru 0x014934 (0x3b00 bytes) 000192 1789352069.034759 mapread 0x002e6b thru 0x007f94 (0x512a bytes) 000193 1789352069.041608 trunc from 0x03f542 to 0x023333 (0x1c20e bytes) 000194 1789352069.074261 read 0x01d911 thru 0x021008 (0x36f8 bytes) 000195 1789352069.103402 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23334): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23334): Mirror 3: 0x44fd8f71 (stale) Mirror 4: 0x44fd8f71 (stale) Mirror 5: 0x44fd8f71 (stale) CRC-32 checksum value for chunk [0, 0x23334): Mirror 1: 0xacde00ff Mirror 6: 0xacde00ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23334: skipped 000196 1789352069.905872 mapread 0x022470 thru 0x023333 (0xec4 bytes) 000197 1789352069.938451 mapwrite 0x0130a5 thru 0x01cec8 (0x9e24 bytes) 000198 1789352070.054278 trunc from 0x01b382 to 0x02178f (0x640e bytes) 000199 1789352070.059092 mapwrite 0x031c0a thru 0x03bc1e (0xa015 bytes) 000200 1789352070.142108 punch from 0x0238e0 to 0x02ff01 (0xc622 bytes) 000201 1789352070.151633 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc1f): Mirror 3: 0x316c1d2f (stale) Mirror 4: 0x316c1d2f (stale) Mirror 5: 0x69440b38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc1f): Mirror 3: 0x316c1d2f (stale) Mirror 4: 0x316c1d2f (stale) Mirror 5: 0x69440b38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc1f: skipped 000202 1789352070.483832 trunc from 0x02355f to 0x027a15 (0x44b7 bytes) 000203 1789352070.488773 write 0x01199b thru 0x01efd3 (0xd639 bytes) 000204 1789352070.504412 read 0x0194ab thru 0x01adee (0x1944 bytes) 000205 1789352070.505413 trunc from 0x03bc1f to 0x0196ed (0x22531 bytes) 000206 1789352070.536716 write 0x01b55e thru 0x01f1a7 (0x3c4a bytes) 000207 1789352070.539200 fallocate 0x016ff9 thru 0x022bbc (0xbbc4 bytes) 000208 1789352070.544267 mapread 0x01d49d thru 0x01e5a4 (0x1108 bytes) 000209 1789352070.546214 mapwrite 0x036484 thru 0x03ffff (0x9b7c bytes) 000210 1789352070.609306 mapread 0x00f8ef thru 0x016087 (0x6799 bytes) 000211 1789352070.623868 mapwrite 0x0324bf thru 0x033101 (0xc43 bytes) 000212 1789352070.639219 trunc from 0x040000 to 0x014c24 (0x2b3db bytes) 000213 1789352070.652942 trunc from 0x00b81d to 0x00fc3a (0x441e bytes) 000214 1789352070.661424 mapread 0x00ea95 thru 0x014c24 (0x6190 bytes) 000215 1789352070.671541 mapwrite 0x00125f thru 0x01121a (0xffbc bytes) 000216 1789352070.716003 MIRROR_RESYNC 4 mirrors 000217 1789352071.465899 trunc from 0x014c25 to 0x024819 (0xfbf5 bytes) 000218 1789352071.511503 punch from 0x00b237 to 0x0103ec (0x51b6 bytes) 000219 1789352071.517724 fallocate 0x014a9a thru 0x01e12d (0x9694 bytes) 000220 1789352071.523472 trunc from 0x00deb8 to 0x01aa4c (0xcb95 bytes) 000221 1789352071.528687 write 0x020c2e thru 0x02c484 (0xb857 bytes) 000222 1789352071.535514 read 0x023135 thru 0x027f77 (0x4e43 bytes) 000223 1789352071.536510 read 0x01f2f7 thru 0x021d97 (0x2aa1 bytes) 000224 1789352071.548089 fallocate 0x00e9ce thru 0x01df29 (0xf55c bytes) 000225 1789352071.553209 punch from 0x01d59f to 0x02522b (0x7c8d bytes) 000227 1789352071.583836 read 0x014193 thru 0x01dda4 (0x9c12 bytes) 000228 1789352071.595478 punch from 0x010e3a to 0x0160ac (0x5273 bytes) 000229 1789352071.600816 mapread 0x00ab7a thru 0x00ed60 (0x41e7 bytes) 000230 1789352071.602339 punch from 0x01f4eb to 0x02193a (0x2450 bytes) 000231 1789352071.611830 MIRROR_RESYNC 4 mirrors 000232 1789352072.517804 punch from 0x0204ab to 0x0242b7 (0x3e0d bytes) 000233 1789352072.575357 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c485): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c485): Mirror 3: 0xadda69b (stale) Mirror 4: 0xadda69b (stale) Mirror 5: 0xadda69b (stale) CRC-32 checksum value for chunk [0, 0x2c485): Mirror 1: 0xadda69b Mirror 6: 0xadda69b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c485: skipped 000234 1789352073.550071 MIRROR_RESYNC 5 mirrors 000235 1789352074.582375 fallocate 0x03ab16 thru 0x03b01e (0x509 bytes) 000236 1789352074.662653 fallocate 0x012390 thru 0x014f53 (0x2bc4 bytes) 000237 1789352074.674211 mapwrite 0x00062b thru 0x0041fa (0x3bd0 bytes) 000238 1789352074.749001 trunc from 0x02ec70 to 0x035890 (0x6c21 bytes) 000239 1789352074.763693 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b01f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b01f): Mirror 3: 0x309177eb (stale) Mirror 4: 0x309177eb (stale) Mirror 5: 0x309177eb (stale) Mirror 6: 0x309177eb (stale) CRC-32 checksum value for chunk [0, 0x3b01f): Mirror 1: 0xe7466fb5 Mirror 7: 0xe7466fb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b01f: skipped 000240 1789352075.864291 read 0x017b9c thru 0x0242fa (0xc75f bytes) 000241 1789352075.881306 trunc from 0x03b01f to 0x03c1a4 (0x1186 bytes) 000242 1789352075.944513 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c1a5): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1a5): Mirror 3: 0x56f91c1a (stale) Mirror 4: 0x56f91c1a (stale) Mirror 5: 0x56f91c1a (stale) Mirror 6: 0x56f91c1a (stale) Mirror 7: 0x699b1781 (stale) CRC-32 checksum value for chunk [0, 0x3c1a5): Mirror 1: 0x699b1781 Mirror 8: 0x699b1781 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1a5: skipped 000243 1789352076.967499 read 0x014963 thru 0x017c7d (0x331b bytes) 000244 1789352076.981712 write 0x00b630 thru 0x014dc6 (0x9797 bytes) 000245 1789352077.063061 read 0x020ecf thru 0x02d182 (0xc2b4 bytes) 000246 1789352077.082347 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c1a5): Mirror 3: 0x56f91c1a (stale) Mirror 4: 0x56f91c1a (stale) Mirror 6: 0x56f91c1a (stale) Mirror 7: 0x699b1781 (stale) Mirror 8: 0x699b1781 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1a5): Mirror 3: 0x56f91c1a (stale) Mirror 4: 0x56f91c1a (stale) Mirror 6: 0x56f91c1a (stale) Mirror 7: 0x699b1781 (stale) Mirror 8: 0x699b1781 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1a5: skipped 000248 1789352077.589040 trunc from 0x006108 to 0x00c887 (0x6780 bytes) 000249 1789352077.595447 read 0x020c4c thru 0x02c7e5 (0xbb9a bytes) 000250 1789352077.611593 trunc from 0x03a18b to 0x03c1a4 (0x201a bytes) 000251 1789352077.617139 trunc from 0x03c1a5 to 0x0379f9 (0x47ab bytes) 000252 1789352077.640642 trunc from 0x0379fa to 0x02004f (0x179aa bytes) 000253 1789352077.658688 trunc from 0x020050 to 0x03e239 (0x1e1ea bytes) 000254 1789352077.679068 read 0x03a8a7 thru 0x03ac1e (0x378 bytes) 000255 1789352077.690916 trunc from 0x03e23a to 0x02d379 (0x10ec0 bytes) 000256 1789352077.710838 mapread 0x0001c4 thru 0x00e9b7 (0xe7f4 bytes) 000257 1789352077.713563 trunc from 0x02d37a to 0x002ac4 (0x2a8b5 bytes) 000258 1789352077.731214 write 0x039623 thru 0x03ffff (0x69dd bytes) 000259 1789352077.732724 punch from 0x030486 to 0x03bc13 (0xb78e bytes) 000260 1789352077.749011 mapread 0x00288a thru 0x00c965 (0xa0dc bytes) 000261 1789352077.803619 fallocate 0x01c7ff thru 0x02a917 (0xe119 bytes) 000262 1789352077.815568 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa5361fd6 (stale) Mirror 4: 0xa5361fd6 (stale) Mirror 7: 0x5eacc687 (stale) Mirror 8: 0x5eacc687 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa5361fd6 (stale) Mirror 4: 0xa5361fd6 (stale) Mirror 7: 0x5eacc687 (stale) Mirror 8: 0x5eacc687 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1789352078.194711 mapread 0x025612 thru 0x02c61b (0x700a bytes) 000264 1789352078.227031 trunc from 0x040000 to 0x03dc04 (0x23fb bytes) 000265 1789352078.273813 MIRROR_RESYNC 5 mirrors 000267 1789352079.349750 punch from 0x02f2a1 to 0x035344 (0x60a4 bytes) 000268 1789352079.404080 mapwrite 0x0082e3 thru 0x00b425 (0x3143 bytes) 000271 1789352079.468047 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc05): Mirror 3: 0xdd46567e (stale) Mirror 4: 0xdd46567e (stale) Mirror 7: 0xdd46567e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc05): Mirror 3: 0xdd46567e (stale) Mirror 4: 0xdd46567e (stale) Mirror 7: 0xdd46567e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc05: skipped 000272 1789352079.882368 punch from 0x00b1d1 to 0x014068 (0x8e98 bytes) 000273 1789352079.890843 trunc from 0x03dc05 to 0x03b449 (0x27bb bytes) 000274 1789352079.918839 write 0x01712b thru 0x01f48b (0x8361 bytes) 000276 1789352079.964599 trunc from 0x034fea to 0x03b449 (0x6460 bytes) 000277 1789352079.972529 mapread 0x0244f4 thru 0x02b8a7 (0x73b4 bytes) 000278 1789352080.007512 trunc from 0x01de57 to 0x028c4f (0xadf9 bytes) 000279 1789352080.022967 write 0x01d0e6 thru 0x01d1e5 (0x100 bytes) 000280 1789352080.028808 trunc from 0x03b44a to 0x015d74 (0x256d5 bytes) 000282 1789352080.054788 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15d75): Mirror 4: 0x94b9c02d (stale) Mirror 7: 0x94b9c02d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15d75): Mirror 4: 0x94b9c02d (stale) Mirror 7: 0x94b9c02d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15d75: skipped 000283 1789352080.362113 mapwrite 0x004187 thru 0x009872 (0x56ec bytes) 000284 1789352080.398132 trunc from 0x015d75 to 0x00d876 (0x84fe bytes) 000285 1789352080.436685 fallocate 0x002be0 thru 0x00f630 (0xca51 bytes) 000286 1789352080.440951 read 0x0036f0 thru 0x00f630 (0xbf41 bytes) 000287 1789352080.445227 trunc from 0x004db3 to 0x00a174 (0x53c2 bytes) 000288 1789352080.450289 trunc from 0x00194e to 0x006739 (0x4dec bytes) 000289 1789352080.462153 read 0x0051d2 thru 0x00e6d0 (0x94ff bytes) 000290 1789352080.476318 punch from 0x007c70 to 0x00f630 (0x79c1 bytes) 000291 1789352080.481890 write 0x030a0f thru 0x0368f5 (0x5ee7 bytes) 000292 1789352080.483626 punch from 0x035371 to 0x0368f5 (0x1585 bytes) 000293 1789352080.512663 trunc from 0x0123c8 to 0x01c7bf (0xa3f8 bytes) 000294 1789352080.519059 mapwrite 0x0237be thru 0x0257b0 (0x1ff3 bytes) 000295 1789352080.549339 read 0x02fbd4 thru 0x036018 (0x6445 bytes) 000297 1789352080.551628 mapwrite 0x01229a thru 0x01ac24 (0x898b bytes) 000299 1789352080.573790 write 0x039798 thru 0x03ffff (0x6868 bytes) 000301 1789352080.579778 mapread 0x03446a thru 0x039d31 (0x58c8 bytes) 000302 1789352080.587634 trunc from 0x040000 to 0x00ed6e (0x31291 bytes) 000303 1789352080.606582 fallocate 0x036bf9 thru 0x03ffff (0x9407 bytes) 000304 1789352080.611784 mapwrite 0x02eb81 thru 0x038107 (0x9587 bytes) 000305 1789352080.687969 fallocate 0x0280e3 thru 0x02aace (0x29ec bytes) 000306 1789352080.696447 mapread 0x00c94a thru 0x00e360 (0x1a17 bytes) 000308 1789352080.702517 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x418a8d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x418a8d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000309 1789352081.032683 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x418a8d7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xef701b9e Mirror 5: 0xef701b9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000310 1789352081.904739 MIRROR_RESYNC 3 mirrors 000311 1789352082.558480 trunc from 0x040000 to 0x028728 (0x178d7 bytes) 000312 1789352082.606887 trunc from 0x028729 to 0x035008 (0xc8e0 bytes) 000313 1789352082.629971 write 0x01f79f thru 0x021d70 (0x25d2 bytes) 000315 1789352082.641648 punch from 0x01f26a to 0x02a434 (0xb1cb bytes) 000318 1789352082.656382 read 0x00d71b thru 0x010b2e (0x3414 bytes) 000319 1789352082.663156 write 0x001cc5 thru 0x005219 (0x3555 bytes) 000320 1789352082.671724 write 0x0399c4 thru 0x03ffff (0x663c bytes) 000321 1789352082.673152 mapread 0x00379f thru 0x006270 (0x2ad2 bytes) 000322 1789352082.683912 punch from 0x02aaba to 0x039b10 (0xf057 bytes) 000323 1789352082.698202 punch from 0x00427f to 0x004fc1 (0xd43 bytes) 000324 1789352082.704813 mapwrite 0x030312 thru 0x0359a3 (0x5692 bytes) 000325 1789352082.764087 fallocate 0x028bb7 thru 0x0328de (0x9d28 bytes) 000326 1789352082.777533 fallocate 0x0168bd thru 0x0227fd (0xbf41 bytes) 000327 1789352082.791006 mapread 0x0055e7 thru 0x00ed31 (0x974b bytes) 000329 1789352082.841427 trunc from 0x040000 to 0x014ee7 (0x2b118 bytes) 000330 1789352082.877744 MIRROR_RESYNC 3 mirrors 000331 1789352083.692949 punch from 0x00f07e to 0x013d71 (0x4cf4 bytes) 000332 1789352083.748148 read 0x004470 thru 0x00fb91 (0xb722 bytes) 000333 1789352083.773901 write 0x021fb3 thru 0x028532 (0x6580 bytes) 000334 1789352083.777474 trunc from 0x0033dd to 0x013360 (0xff84 bytes) 000335 1789352083.793559 mapread 0x01b322 thru 0x0239c2 (0x86a1 bytes) 000336 1789352083.843351 MIRROR_RESYNC 3 mirrors 000337 1789352084.997865 read 0x024c12 thru 0x028532 (0x3921 bytes) 000338 1789352085.013500 MIRROR_EXTEND to 4 mirrors 000339 1789352085.761710 fallocate 0x001e96 thru 0x011b32 (0xfc9d bytes) 000340 1789352085.799184 fallocate 0x01c3a7 thru 0x01c667 (0x2c1 bytes) 000341 1789352085.805293 trunc from 0x0009b1 to 0x0096a9 (0x8cf9 bytes) 000342 1789352085.813542 mapwrite 0x01c69a thru 0x01e029 (0x1990 bytes) 000343 1789352085.851904 write 0x020552 thru 0x02e8d7 (0xe386 bytes) 000344 1789352085.857926 trunc from 0x02e8d8 to 0x027680 (0x7257 bytes) 000345 1789352085.890421 fallocate 0x00ccc1 thru 0x00ef1f (0x225f bytes) 000346 1789352085.901108 mapread 0x013c1e thru 0x01a100 (0x64e3 bytes) 000347 1789352085.916824 write 0x01d88c thru 0x02b12d (0xd8a2 bytes) 000348 1789352085.920695 fallocate 0x002c32 thru 0x011021 (0xe3f0 bytes) 000349 1789352085.930149 mapwrite 0x005897 thru 0x00cecd (0x7637 bytes) 000350 1789352085.959040 trunc from 0x02b12e to 0x03671a (0xb5ed bytes) 000351 1789352085.981539 trunc from 0x03671b to 0x034691 (0x2089 bytes) 000352 1789352086.003720 mapwrite 0x0151fd thru 0x0233a5 (0xe1a9 bytes) 000353 1789352086.032325 mapwrite 0x02a0d3 thru 0x02b524 (0x1452 bytes) 000354 1789352086.045632 trunc from 0x034692 to 0x03673a (0x20a9 bytes) 000355 1789352086.062464 write 0x03c3b0 thru 0x03ffff (0x3c50 bytes) 000357 1789352086.076509 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5f15eff3 (stale) Mirror 6: 0x5f15eff3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5f15eff3 (stale) Mirror 6: 0x5f15eff3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000358 1789352086.529430 mapread 0x01d442 thru 0x026894 (0x9453 bytes) 000359 1789352086.558994 fallocate 0x004caf thru 0x011c52 (0xcfa4 bytes) 000360 1789352086.565662 fallocate 0x038279 thru 0x03836a (0xf2 bytes) 000361 1789352086.573806 punch from 0x0060a9 to 0x014712 (0xe66a bytes) 000362 1789352086.581359 read 0x01d72b thru 0x02a62b (0xcf01 bytes) 000363 1789352086.592912 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000364 1789352086.904681 write 0x038b69 thru 0x03ffff (0x7497 bytes) 000365 1789352086.917333 fallocate 0x0299cf thru 0x02e16e (0x47a0 bytes) 000366 1789352086.922985 punch from 0x030133 to 0x033ad5 (0x39a3 bytes) 000367 1789352086.928430 mapwrite 0x01d621 thru 0x026f05 (0x98e5 bytes) 000368 1789352086.978727 mapread 0x02c766 thru 0x03b909 (0xf1a4 bytes) 000369 1789352087.015404 write 0x01d0ae thru 0x0244d9 (0x742c bytes) 000371 1789352087.018861 mapwrite 0x031330 thru 0x03a802 (0x94d3 bytes) 000374 1789352087.060501 trunc from 0x03c382 to 0x03ffff (0x3c7e bytes) 000375 1789352087.070840 fallocate 0x0196e1 thru 0x01b91e (0x223e bytes) 000376 1789352087.095081 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc3f60444 Mirror 7: 0xc3f60444 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000377 1789352088.243434 mapwrite 0x01d08f thru 0x02be13 (0xed85 bytes) 000378 1789352088.465096 punch from 0x016a08 to 0x023609 (0xcc02 bytes) 000379 1789352088.472023 fallocate 0x01b3e2 thru 0x0285c9 (0xd1e8 bytes) 000380 1789352088.485135 read 0x005339 thru 0x014c63 (0xf92b bytes) 000381 1789352088.497384 punch from 0x0371da to 0x0378ac (0x6d3 bytes) 000382 1789352088.504955 mapread 0x00e0a0 thru 0x0186cc (0xa62d bytes) 000383 1789352088.519822 mapwrite 0x01ec4c thru 0x023580 (0x4935 bytes) 000384 1789352088.552758 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) Mirror 7: 0xc3f60444 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x91adc30c Mirror 8: 0x91adc30c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000385 1789352089.657894 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) Mirror 7: 0xc3f60444 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) Mirror 7: 0xc3f60444 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000386 1789352090.051228 mapread 0x031ba9 thru 0x03f9ee (0xde46 bytes) 000387 1789352090.087264 mapwrite 0x0321ea thru 0x03f399 (0xd1b0 bytes) 000388 1789352090.187890 trunc from 0x040000 to 0x00fcc9 (0x30336 bytes) 000389 1789352090.221126 mapread 0x00c44b thru 0x00c76a (0x320 bytes) 000390 1789352090.236801 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xfcca): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfcca): Mirror 6: 0xf12f00c7 (stale) Mirror 7: 0x3bcf571b (stale) CRC-32 checksum value for chunk [0, 0xfcca): Mirror 1: 0x3bcf571b Mirror 8: 0x3bcf571b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfcca: skipped 000391 1789352091.271205 mapwrite 0x019667 thru 0x01d798 (0x4132 bytes) 000392 1789352091.430194 trunc from 0x019f06 to 0x01d798 (0x3893 bytes) 000393 1789352091.437752 write 0x0242be thru 0x0304bf (0xc202 bytes) 000394 1789352091.441047 fallocate 0x001e38 thru 0x002f21 (0x10ea bytes) 000395 1789352091.447677 write 0x03dcb6 thru 0x03ffff (0x234a bytes) 000396 1789352091.450738 read 0x01dd5a thru 0x01f304 (0x15ab bytes) 000397 1789352091.457272 mapread 0x0115ac thru 0x01df0f (0xc964 bytes) 000398 1789352091.482848 trunc from 0x039766 to 0x03ffff (0x689a bytes) 000399 1789352091.497466 trunc from 0x040000 to 0x025e66 (0x1a199 bytes) 000400 1789352091.522319 trunc from 0x01b124 to 0x025e66 (0xad43 bytes) 000401 1789352091.531380 mapwrite 0x0352ef thru 0x03ffff (0xad11 bytes) 000402 1789352091.584475 punch from 0x020603 to 0x0243f1 (0x3def bytes) 000403 1789352091.597730 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) Mirror 7: 0xc3f60444 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5f15eff3 (stale) Mirror 7: 0xc3f60444 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000404 1789352091.927658 mapwrite 0x02dac0 thru 0x03792b (0x9e6c bytes) 000405 1789352092.000773 fallocate 0x011c18 thru 0x01f226 (0xd60f bytes) 000407 1789352092.013538 trunc from 0x00444c to 0x005877 (0x142c bytes) 000408 1789352092.023293 write 0x00fc7b thru 0x01a52b (0xa8b1 bytes) 000409 1789352092.054113 punch from 0x0246a5 to 0x02ede5 (0xa741 bytes) 000410 1789352092.061354 read 0x01065c thru 0x01d44c (0xcdf1 bytes) 000411 1789352092.072080 mapread 0x01e953 thru 0x02c6dc (0xdd8a bytes) 000412 1789352092.101287 mapread 0x02bf29 thru 0x036f7f (0xb057 bytes) 000413 1789352092.112561 punch from 0x03a936 to 0x03c483 (0x1b4e bytes) 000414 1789352092.122059 read 0x011af1 thru 0x01f58d (0xda9d bytes) 000415 1789352092.122943 fallocate 0x020a32 thru 0x02305d (0x262c bytes) 000416 1789352092.133149 fallocate 0x01f468 thru 0x0258e0 (0x6479 bytes) 000417 1789352092.149403 fallocate 0x01548f thru 0x015d03 (0x875 bytes) 000418 1789352092.159362 mapread 0x00b73a thru 0x01412c (0x89f3 bytes) 000419 1789352092.188398 trunc from 0x01c50e to 0x0247f9 (0x82ec bytes) 000420 1789352092.195358 trunc from 0x040000 to 0x03c2fa (0x3d05 bytes) 000421 1789352092.220083 punch from 0x025476 to 0x02a270 (0x4dfb bytes) 000422 1789352092.226286 read 0x01abfe thru 0x022183 (0x7586 bytes) 000423 1789352092.236904 punch from 0x01ccc7 to 0x02b971 (0xecab bytes) 000424 1789352092.242122 trunc from 0x03c2fb to 0x01f0a1 (0x1d259 bytes) 000425 1789352092.265898 trunc from 0x01f0a2 to 0x01f371 (0x2d0 bytes) 000426 1789352092.292798 mapread 0x00a4bf thru 0x0141d8 (0x9d1a bytes) 000427 1789352092.295842 mapwrite 0x025f5e thru 0x035b34 (0xfbd7 bytes) 000428 1789352092.473228 punch from 0x00756e to 0x008c5d (0x16f0 bytes) 000429 1789352092.480831 trunc from 0x035b35 to 0x009915 (0x2c21f bytes) 000430 1789352092.501324 fallocate 0x00d1b5 thru 0x012e33 (0x5c7f bytes) 000431 1789352092.508411 read 0x000e80 thru 0x007c62 (0x6de3 bytes) 000432 1789352092.515606 read 0x001559 thru 0x009915 (0x83bd bytes) 000433 1789352092.516383 read 0x008ec8 thru 0x009915 (0xa4e bytes) 000434 1789352092.517544 mapwrite 0x02484c thru 0x02679b (0x1f50 bytes) 000436 1789352092.576167 mapread 0x004607 thru 0x006efc (0x28f6 bytes) 000437 1789352092.578405 trunc from 0x02473b to 0x02679b (0x2061 bytes) 000438 1789352092.585070 punch from 0x0189f1 to 0x020be4 (0x81f4 bytes) 000439 1789352092.591798 fallocate 0x036757 thru 0x03b76b (0x5015 bytes) 000440 1789352092.605385 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2679c): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2679c): Mirror 6: 0x49e03d09 (stale) Mirror 7: 0x9033a60c (stale) CRC-32 checksum value for chunk [0, 0x2679c): Mirror 1: 0xb3382f22 Mirror 8: 0xb3382f22 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2679c: skipped 000441 1789352093.607155 read 0x0134bc thru 0x019cf9 (0x683e bytes) 000442 1789352093.626785 write 0x0280e3 thru 0x031ae8 (0x9a06 bytes) 000443 1789352093.682186 fallocate 0x034e53 thru 0x03793e (0x2aec bytes) 000444 1789352093.696964 trunc from 0x01cf3c to 0x01e4fe (0x15c3 bytes) 000445 1789352093.703624 fallocate 0x03074f thru 0x033c97 (0x3549 bytes) 000447 1789352093.723095 fallocate 0x02f378 thru 0x03121c (0x1ea5 bytes) 000448 1789352093.735525 trunc from 0x03793f to 0x00d657 (0x2a2e7 bytes) 000449 1789352093.759464 write 0x01bc47 thru 0x023255 (0x760f bytes) 000450 1789352093.762081 punch from 0x0155a6 to 0x020ce8 (0xb743 bytes) 000452 1789352093.775931 mapread 0x01d24c thru 0x01d795 (0x54a bytes) 000453 1789352093.781213 fallocate 0x007c2f thru 0x013585 (0xb957 bytes) 000455 1789352093.793389 trunc from 0x01593a to 0x021bfe (0xc2c5 bytes) 000456 1789352093.799134 mapread 0x01f16b thru 0x01ff05 (0xd9b bytes) 000457 1789352093.807783 mapread 0x00571a thru 0x00a5fd (0x4ee4 bytes) 000458 1789352093.817682 trunc from 0x023256 to 0x03b9f3 (0x1879e bytes) 000460 1789352093.873979 trunc from 0x03b9f4 to 0x0017f7 (0x3a1fc bytes) 000462 1789352093.893695 trunc from 0x000290 to 0x0017f7 (0x1568 bytes) 000463 1789352093.898090 write 0x00a5e1 thru 0x010471 (0x5e91 bytes) 000464 1789352093.902366 fallocate 0x03660d thru 0x03cf34 (0x6928 bytes) 000465 1789352093.912710 write 0x024ac1 thru 0x033a2d (0xef6d bytes) 000466 1789352093.928850 read 0x027f25 thru 0x02d364 (0x5440 bytes) 000467 1789352093.929782 mapwrite 0x022163 thru 0x02ed1b (0xcbb9 bytes) 000469 1789352093.997543 punch from 0x03018d to 0x03c337 (0xc1ab bytes) 000470 1789352094.008110 punch from 0x00893a to 0x0125f1 (0x9cb8 bytes) 000471 1789352094.017674 mapwrite 0x03358f thru 0x036890 (0x3302 bytes) 000473 1789352094.097643 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cf35): Mirror 7: 0x5de6d7c9 (stale) Mirror 8: 0x4ca2b432 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cf35): Mirror 7: 0x5de6d7c9 (stale) Mirror 8: 0x4ca2b432 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cf35: skipped 000474 1789352094.448108 punch from 0x0308c7 to 0x03cf34 (0xc66e bytes) 000475 1789352094.456820 punch from 0x034081 to 0x03cf34 (0x8eb4 bytes) 000476 1789352094.471557 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3cf35): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cf35): Mirror 7: 0x5de6d7c9 (stale) Mirror 8: 0x4ca2b432 (stale) CRC-32 checksum value for chunk [0, 0x3cf35): Mirror 1: 0x1ccfc0c4 Mirror 9: 0x1ccfc0c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cf35: skipped 000477 1789352095.651690 fallocate 0x00bd16 thru 0x00c11c (0x407 bytes) 000478 1789352095.718607 write 0x0248a0 thru 0x029598 (0x4cf9 bytes) 000479 1789352095.737502 mapread 0x03a9f3 thru 0x03cf34 (0x2542 bytes) 000480 1789352095.780573 MIRROR_RESYNC 4 mirrors 000481 1789352096.921196 mapwrite 0x025ca4 thru 0x02aaf3 (0x4e50 bytes) 000483 1789352097.066138 write 0x02231e thru 0x02b442 (0x9125 bytes) 000484 1789352097.071761 punch from 0x036871 to 0x03a63c (0x3dcc bytes) 000485 1789352097.089425 mapread 0x030a80 thru 0x03cf34 (0xc4b5 bytes) 000486 1789352097.115729 mapread 0x03a042 thru 0x03cf34 (0x2ef3 bytes) 000487 1789352097.117844 trunc from 0x027428 to 0x02ea6f (0x7648 bytes) 000488 1789352097.156528 trunc from 0x0168e0 to 0x020473 (0x9b94 bytes) 000489 1789352097.166346 trunc from 0x03cf35 to 0x00e1db (0x2ed59 bytes) 000490 1789352097.203388 punch from 0x00d2f4 to 0x00e1db (0xee8 bytes) 000491 1789352097.209375 trunc from 0x00e1dc to 0x00868f (0x5b4c bytes) 000492 1789352097.242845 write 0x007611 thru 0x007b96 (0x586 bytes) 000493 1789352097.255294 mapread 0x001f0b thru 0x006815 (0x490b bytes) 000494 1789352097.266102 trunc from 0x004cc8 to 0x00868f (0x39c8 bytes) 000495 1789352097.296177 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8690): Mirror 8: 0xa05d677b (stale) Mirror 9: 0xa05d677b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8690): Mirror 8: 0xa05d677b (stale) Mirror 9: 0xa05d677b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8690: skipped 000496 1789352097.667115 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x8690): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8690): Mirror 8: 0xa05d677b (stale) Mirror 9: 0xa05d677b (stale) CRC-32 checksum value for chunk [0, 0x8690): Mirror 1: 0xa05d677b Mirror 10: 0xa05d677b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8690: skipped 000497 1789352098.417508 trunc from 0x008690 to 0x030a6d (0x283de bytes) 000498 1789352098.468512 fallocate 0x009693 thru 0x00e800 (0x516e bytes) 000499 1789352098.474258 mapwrite 0x035f24 thru 0x036ee5 (0xfc2 bytes) 000500 1789352098.518575 punch from 0x008dac to 0x00cd5e (0x3fb3 bytes) 000501 1789352098.524451 read 0x02d3dc thru 0x035173 (0x7d98 bytes) 000502 1789352098.533139 write 0x0234e6 thru 0x02a981 (0x749c bytes) 000503 1789352098.543164 trunc from 0x036ee6 to 0x03f4c8 (0x85e3 bytes) 000504 1789352098.564513 MIRROR_RESYNC 4 mirrors 000505 1789352099.537670 trunc from 0x03f4c9 to 0x021883 (0x1dc45 bytes) 000506 1789352099.570279 write 0x02de9d thru 0x03332f (0x5493 bytes) 000507 1789352099.572080 fallocate 0x001232 thru 0x0065f5 (0x53c4 bytes) 000508 1789352099.578101 write 0x03c3cf thru 0x03ffff (0x3c31 bytes) 000509 1789352099.584285 MIRROR_RESYNC 4 mirrors 000511 1789352100.405166 MIRROR_RESYNC 4 mirrors 000512 1789352100.767108 mapread 0x00bfca thru 0x00c05d (0x94 bytes) 000513 1789352100.781082 trunc from 0x040000 to 0x019375 (0x26c8a bytes) 000514 1789352100.850317 fallocate 0x026a44 thru 0x02b498 (0x4a55 bytes) 000515 1789352100.856378 write 0x00bb2e thru 0x0175fe (0xbad1 bytes) 000516 1789352100.867697 write 0x01316e thru 0x01cffc (0x9e8f bytes) 000517 1789352100.877687 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b499): Mirror 9: 0xacf380d7 (stale) Mirror 10: 0xacf380d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b499): Mirror 9: 0xacf380d7 (stale) Mirror 10: 0xacf380d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b499: skipped 000518 1789352101.185046 fallocate 0x038407 thru 0x03ffff (0x7bf9 bytes) 000519 1789352101.193466 mapwrite 0x0067fe thru 0x00c4bf (0x5cc2 bytes) 000520 1789352101.231998 trunc from 0x040000 to 0x028b75 (0x1748a bytes) 000521 1789352101.253357 mapwrite 0x00e304 thru 0x018d63 (0xaa60 bytes) 000522 1789352101.281902 punch from 0x022413 to 0x025910 (0x34fe bytes) 000523 1789352101.286158 write 0x010f09 thru 0x01e4ab (0xd5a3 bytes) 000524 1789352101.291214 fallocate 0x03092a thru 0x037ff7 (0x76ce bytes) 000525 1789352101.298886 trunc from 0x037ff8 to 0x0159a8 (0x2264f bytes) 000526 1789352101.314929 fallocate 0x02b47c thru 0x031b36 (0x66bb bytes) 000527 1789352101.318525 read 0x0080a7 thru 0x00f039 (0x6f93 bytes) 000528 1789352101.322372 MIRROR_RESYNC 3 mirrors 000529 1789352101.925677 mapwrite 0x00d966 thru 0x0148ce (0x6f69 bytes) 000530 1789352102.032283 read 0x00e0dd thru 0x0159a8 (0x78cc bytes) 000531 1789352102.033148 punch from 0x005730 to 0x006d2d (0x15fe bytes) 000532 1789352102.038973 read 0x011b28 thru 0x0143ac (0x2885 bytes) 000533 1789352102.043630 MIRROR_RESYNC 3 mirrors 000534 1789352102.653853 read 0x003202 thru 0x01074c (0xd54b bytes) 000535 1789352102.663478 MIRROR_EXTEND to 4 mirrors 000536 1789352103.158115 MIRROR_RESYNC 4 mirrors 000537 1789352103.447996 mapwrite 0x038b56 thru 0x03ffff (0x74aa bytes) 000538 1789352103.547891 fallocate 0x000d0c thru 0x00b207 (0xa4fc bytes) 000539 1789352103.553795 trunc from 0x02a7cf to 0x0319ee (0x7220 bytes) 000541 1789352103.564314 mapread 0x02e2eb thru 0x03d759 (0xf46f bytes) 000542 1789352103.583715 trunc from 0x013e30 to 0x01c1bc (0x838d bytes) 000544 1789352103.594730 mapread 0x023f95 thru 0x02d2b6 (0x9322 bytes) 000545 1789352103.612378 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xcb9317fb (stale) Mirror 10: 0xcb9317fb (stale) Mirror 11: 0xcb9317fb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf660a4 Mirror 12: 0xf660a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000546 1789352104.341097 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xcb9317fb (stale) Mirror 11: 0xcb9317fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xcb9317fb (stale) Mirror 11: 0xcb9317fb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf660a4 Mirror 12: 0xf660a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000547 1789352104.885879 fallocate 0x015821 thru 0x0216c2 (0xbea2 bytes) 000548 1789352104.928535 mapread 0x00a14d thru 0x00fdc8 (0x5c7c bytes) 000549 1789352104.962053 trunc from 0x040000 to 0x03d077 (0x2f88 bytes) 000550 1789352105.020150 fallocate 0x0125b8 thru 0x017de6 (0x582f bytes) 000551 1789352105.025639 mapwrite 0x0225a9 thru 0x02fdc8 (0xd820 bytes) 000552 1789352105.064157 mapwrite 0x031c19 thru 0x03b627 (0x9a0f bytes) 000553 1789352105.104973 trunc from 0x02c65e to 0x036401 (0x9da4 bytes) 000554 1789352105.113739 write 0x02357b thru 0x032215 (0xec9b bytes) 000555 1789352105.121870 fallocate 0x039f96 thru 0x03b46a (0x14d5 bytes) 000556 1789352105.127721 read 0x02ee7f thru 0x035d5e (0x6ee0 bytes) 000557 1789352105.136338 write 0x00ebf9 thru 0x00f93c (0xd44 bytes) 000558 1789352105.151444 MIRROR_RESYNC 4 mirrors 000559 1789352106.439528 mapwrite 0x008fc2 thru 0x00e8ba (0x58f9 bytes) 000560 1789352106.566074 trunc from 0x01625a to 0x016aca (0x871 bytes) 000561 1789352106.571028 trunc from 0x00f188 to 0x01d760 (0xe5d9 bytes) 000562 1789352106.576457 punch from 0x011694 to 0x01c4f7 (0xae64 bytes) 000563 1789352106.585223 write 0x00258a thru 0x00ff26 (0xd99d bytes) 000565 1789352106.600602 trunc from 0x03d078 to 0x00a298 (0x32ddf bytes) 000566 1789352106.622659 fallocate 0x01e652 thru 0x01ef46 (0x8f5 bytes) 000567 1789352106.628932 fallocate 0x024b7e thru 0x034423 (0xf8a6 bytes) 000568 1789352106.633667 mapwrite 0x009e71 thru 0x00aa50 (0xbe0 bytes) 000569 1789352106.650435 fallocate 0x00033f thru 0x0012dc (0xf9e bytes) 000570 1789352106.654585 fallocate 0x016822 thru 0x01c3e5 (0x5bc4 bytes) 000571 1789352106.660259 mapwrite 0x0385b1 thru 0x03ffff (0x7a4f bytes) 000572 1789352106.706566 punch from 0x013df2 to 0x013fe8 (0x1f7 bytes) 000573 1789352106.711018 trunc from 0x00aab3 to 0x0150cf (0xa61d bytes) 000574 1789352106.716160 read 0x009ed3 thru 0x00d3f5 (0x3523 bytes) 000575 1789352106.725444 fallocate 0x01a548 thru 0x025716 (0xb1cf bytes) 000576 1789352106.733657 punch from 0x02dae9 to 0x030479 (0x2991 bytes) 000577 1789352106.739649 fallocate 0x019253 thru 0x027d59 (0xeb07 bytes) 000578 1789352106.746712 trunc from 0x040000 to 0x02a876 (0x15789 bytes) 000579 1789352106.772827 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a877): Mirror 10: 0xc72abe79 (stale) Mirror 11: 0xc72abe79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a877): Mirror 10: 0xc72abe79 (stale) Mirror 11: 0xc72abe79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a877: skipped 000581 1789352107.167816 mapread 0x011054 thru 0x0208a8 (0xf855 bytes) 000582 1789352107.249780 MIRROR_RESYNC 3 mirrors 000583 1789352108.025964 trunc from 0x02a877 to 0x020e8c (0x99ea bytes) 000584 1789352108.083868 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20e8d): Mirror 10: 0x5d04306f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20e8d): Mirror 10: 0x5d04306f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20e8d: skipped 000585 1789352108.358595 read 0x0058e2 thru 0x00f77a (0x9e99 bytes) 000586 1789352108.364921 read 0x013f97 thru 0x020e8c (0xcef6 bytes) 000587 1789352108.376060 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x20e8d): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20e8d): Mirror 10: 0x5d04306f (stale) CRC-32 checksum value for chunk [0, 0x20e8d): Mirror 1: 0x5d04306f Mirror 11: 0x5d04306f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20e8d: skipped 000588 1789352109.107875 trunc from 0x01d531 to 0x020e8c (0x395c bytes) 000589 1789352109.168596 mapwrite 0x00d5d3 thru 0x00dee0 (0x90e bytes) 000590 1789352109.187098 fallocate 0x03ea81 thru 0x03ffff (0x157f bytes) 000591 1789352109.199828 write 0x028842 thru 0x032dd0 (0xa58f bytes) 000592 1789352109.226139 mapread 0x003f04 thru 0x00eeb3 (0xafb0 bytes) 000593 1789352109.268059 trunc from 0x040000 to 0x01a172 (0x25e8d bytes) 000594 1789352109.331632 read 0x015605 thru 0x01a172 (0x4b6e bytes) 000596 1789352109.342292 mapread 0x009593 thru 0x00a5fe (0x106c bytes) 000597 1789352109.343332 trunc from 0x017cd1 to 0x01a172 (0x24a2 bytes) 000598 1789352109.358439 trunc from 0x001558 to 0x00200a (0xab3 bytes) 000599 1789352109.364937 read 0x006a72 thru 0x00dc35 (0x71c4 bytes) 000600 1789352109.366059 mapwrite 0x02d94e thru 0x02fa93 (0x2146 bytes) 000601 1789352109.439047 read 0x01e82e thru 0x027f88 (0x975b bytes) 000602 1789352109.440015 trunc from 0x02c84c to 0x02fa93 (0x3248 bytes) 000603 1789352109.483097 MIRROR_RESYNC 3 mirrors 000604 1789352110.365279 mapread 0x01e7e6 thru 0x02074f (0x1f6a bytes) 000605 1789352110.411275 trunc from 0x02fa94 to 0x03acc3 (0xb230 bytes) 000606 1789352110.479716 read 0x022f09 thru 0x02bae2 (0x8bda bytes) 000607 1789352110.488803 fallocate 0x03fa72 thru 0x03ffff (0x58e bytes) 000608 1789352110.496921 write 0x01dca4 thru 0x0268f7 (0x8c54 bytes) 000609 1789352110.507043 write 0x00688c thru 0x009c38 (0x33ad bytes) 000610 1789352110.532116 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3acc4): Mirror 11: 0xce6cd1b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3acc4): Mirror 11: 0xce6cd1b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3acc4: skipped 000611 1789352111.054136 write 0x00201e thru 0x01115d (0xf140 bytes) 000612 1789352111.080710 write 0x0389c2 thru 0x03ffff (0x763e bytes) 000613 1789352111.101217 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) 000614 1789352111.354927 write 0x014d03 thru 0x01bba1 (0x6e9f bytes) 000615 1789352111.396107 punch from 0x0390c4 to 0x03ffff (0x6f3c bytes) 000616 1789352111.408059 trunc from 0x040000 to 0x018e99 (0x27166 bytes) 000617 1789352111.437836 punch from 0x00cc6c to 0x00dac8 (0xe5d bytes) 000618 1789352111.445360 read 0x00f6d2 thru 0x012f0f (0x383e bytes) 000619 1789352111.460652 fallocate 0x029c51 thru 0x02d191 (0x3541 bytes) 000620 1789352111.482677 fallocate 0x026d12 thru 0x0353e8 (0xe6d7 bytes) 000621 1789352111.490811 trunc from 0x0113e1 to 0x0190e3 (0x7d03 bytes) 000622 1789352111.521704 punch from 0x000f83 to 0x010179 (0xf1f7 bytes) 000623 1789352111.543688 punch from 0x014827 to 0x0171ff (0x29d9 bytes) 000624 1789352111.556161 fallocate 0x009aee thru 0x01995a (0xfe6d bytes) 000625 1789352111.561630 fallocate 0x0132e2 thru 0x01cd21 (0x9a40 bytes) 000626 1789352111.568389 trunc from 0x019864 to 0x01c90b (0x30a8 bytes) 000627 1789352111.577077 mapwrite 0x03fc98 thru 0x03ffff (0x368 bytes) 000628 1789352111.626633 mapread 0x019f13 thru 0x028f10 (0xeffe bytes) 000629 1789352111.660733 mapread 0x023010 thru 0x026294 (0x3285 bytes) 000630 1789352111.661821 punch from 0x01e3da to 0x021f6b (0x3b92 bytes) 000631 1789352111.672097 MIRROR_EXTEND to 2 mirrors 000632 1789352112.299470 trunc from 0x040000 to 0x000846 (0x3f7b9 bytes) 000633 1789352112.368292 fallocate 0x02139f thru 0x023d35 (0x2997 bytes) 000634 1789352112.375672 trunc from 0x023d36 to 0x0213e3 (0x2952 bytes) 000635 1789352112.401198 mapread 0x012c17 thru 0x012cf8 (0xe2 bytes) 000636 1789352112.414944 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x213e4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x213e4): Mirror 2: 0x73c38c55 (stale) CRC-32 checksum value for chunk [0, 0x213e4): Mirror 1: 0x44ab61ee Mirror 3: 0x44ab61ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x213e4: skipped 000637 1789352113.231002 mapwrite 0x0264c3 thru 0x03566e (0xf1ac bytes) 000639 1789352113.364795 read 0x028526 thru 0x02c463 (0x3f3e bytes) 000640 1789352113.365488 read 0x034dd6 thru 0x03566e (0x899 bytes) 000641 1789352113.366025 mapread 0x01d900 thru 0x0228b8 (0x4fb9 bytes) 000642 1789352113.376368 fallocate 0x01f660 thru 0x0207d8 (0x1179 bytes) 000643 1789352113.381695 punch from 0x007bc1 to 0x0153d3 (0xd813 bytes) 000644 1789352113.387689 trunc from 0x0057d5 to 0x013876 (0xe0a2 bytes) 000645 1789352113.395704 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3566f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3566f): Mirror 2: 0xf1a8e59c (stale) Mirror 3: 0x296c8d02 (stale) CRC-32 checksum value for chunk [0, 0x3566f): Mirror 1: 0x247aa916 Mirror 4: 0x247aa916 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3566f: skipped 000646 1789352114.037778 trunc from 0x004f19 to 0x00a905 (0x59ed bytes) 000647 1789352114.073706 punch from 0x030f6b to 0x03566e (0x4704 bytes) 000648 1789352114.078086 trunc from 0x02d44b to 0x033f78 (0x6b2e bytes) 000649 1789352114.084588 punch from 0x02c8d8 to 0x03566e (0x8d97 bytes) 000650 1789352114.090413 punch from 0x02372c to 0x02d7bd (0xa092 bytes) 000651 1789352114.102382 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3566f): Mirror 2: 0xf1a8e59c (stale) Mirror 3: 0x296c8d02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3566f): Mirror 2: 0xf1a8e59c (stale) Mirror 3: 0x296c8d02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3566f: skipped 000652 1789352114.399721 fallocate 0x0082c3 thru 0x00a3f6 (0x2134 bytes) 000654 1789352114.416207 MIRROR_RESYNC 3 mirrors 000655 1789352115.012685 mapread 0x0159b0 thru 0x025940 (0xff91 bytes) 000657 1789352115.042677 trunc from 0x014219 to 0x01c6f7 (0x84df bytes) 000658 1789352115.072859 read 0x01ddaf thru 0x0281eb (0xa43d bytes) 000659 1789352115.081983 fallocate 0x00a1d7 thru 0x00c377 (0x21a1 bytes) 000660 1789352115.087213 mapwrite 0x02ac56 thru 0x03717d (0xc528 bytes) 000661 1789352115.145982 mapwrite 0x0277dd thru 0x02877d (0xfa1 bytes) 000662 1789352115.161994 mapwrite 0x019f1a thru 0x01dcf2 (0x3dd9 bytes) 000663 1789352115.196200 mapread 0x0223cd thru 0x02b6e6 (0x931a bytes) 000664 1789352115.208596 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3717e): Mirror 3: 0xf0b90fff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3717e): Mirror 3: 0xf0b90fff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3717e: skipped 000665 1789352115.482198 fallocate 0x015cb6 thru 0x024cc8 (0xf013 bytes) 000666 1789352115.489128 mapread 0x00f41b thru 0x01d148 (0xdd2e bytes) 000667 1789352115.535138 read 0x00eae4 thru 0x01b7f6 (0xcd13 bytes) 000668 1789352115.535774 trunc from 0x011301 to 0x011df2 (0xaf2 bytes) 000669 1789352115.541091 read 0x01e476 thru 0x02c98c (0xe517 bytes) 000670 1789352115.573490 punch from 0x004571 to 0x00d6c8 (0x9158 bytes) 000671 1789352115.579042 write 0x032329 thru 0x03ee9d (0xcb75 bytes) 000672 1789352115.586041 punch from 0x010432 to 0x01d144 (0xcd13 bytes) 000673 1789352115.592452 mapread 0x032b52 thru 0x035ebc (0x336b bytes) 000674 1789352115.594008 mapwrite 0x020b8c thru 0x02eeee (0xe363 bytes) 000675 1789352115.622028 trunc from 0x010c4c to 0x016bc7 (0x5f7c bytes) 000676 1789352115.630571 punch from 0x005d8e to 0x015326 (0xf599 bytes) 000677 1789352115.641229 trunc from 0x0152fa to 0x0167a4 (0x14ab bytes) 000678 1789352115.646674 fallocate 0x02989d thru 0x030fd3 (0x7737 bytes) 000680 1789352115.656701 fallocate 0x009501 thru 0x015ef0 (0xc9f0 bytes) 000681 1789352115.664087 fallocate 0x016701 thru 0x01dfdb (0x78db bytes) 000682 1789352115.677468 fallocate 0x01d2d9 thru 0x01eb4e (0x1876 bytes) 000683 1789352115.685320 trunc from 0x03ee9e to 0x02e714 (0x10789 bytes) 000684 1789352115.710027 mapread 0x001069 thru 0x005f19 (0x4eb1 bytes) 000685 1789352115.724641 write 0x007065 thru 0x009dcd (0x2d69 bytes) 000686 1789352115.749326 mapwrite 0x01c9a8 thru 0x029b97 (0xd1f0 bytes) 000687 1789352115.790069 read 0x02003a thru 0x02dd9b (0xdd62 bytes) 000688 1789352115.791042 mapwrite 0x030122 thru 0x0356b4 (0x5593 bytes) 000690 1789352115.853717 mapwrite 0x00fe02 thru 0x014789 (0x4988 bytes) 000691 1789352115.890698 punch from 0x027c41 to 0x027d15 (0xd5 bytes) 000692 1789352115.903894 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x356b5): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356b5): Mirror 3: 0x2e6aa7bc (stale) CRC-32 checksum value for chunk [0, 0x356b5): Mirror 1: 0x98eae883 Mirror 4: 0x98eae883 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356b5: skipped 000694 1789352117.006156 trunc from 0x0356b5 to 0x01aa9b (0x1ac19 bytes) 000695 1789352117.088042 trunc from 0x00076b to 0x00d619 (0xceaf bytes) 000696 1789352117.096092 punch from 0x001082 to 0x00ac97 (0x9c16 bytes) 000697 1789352117.103036 write 0x0390a1 thru 0x03ffff (0x6f5f bytes) 000698 1789352117.104928 fallocate 0x025ad3 thru 0x02daf7 (0x8025 bytes) 000699 1789352117.116640 mapread 0x01d886 thru 0x01e706 (0xe81 bytes) 000700 1789352117.130704 mapwrite 0x004ecc thru 0x01163b (0xc770 bytes) 000701 1789352117.177054 punch from 0x023e1e to 0x024c0b (0xdee bytes) 000702 1789352117.182071 write 0x010cac thru 0x0191d1 (0x8526 bytes) 000703 1789352117.183968 fallocate 0x024c7a thru 0x0317c2 (0xcb49 bytes) 000704 1789352117.189949 mapread 0x008f3c thru 0x0156c0 (0xc785 bytes) 000705 1789352117.192123 trunc from 0x02bafa to 0x0311f0 (0x56f7 bytes) 000706 1789352117.197905 fallocate 0x001859 thru 0x0115c7 (0xfd6f bytes) 000707 1789352117.203847 mapread 0x030491 thru 0x0305b2 (0x122 bytes) 000708 1789352117.215347 write 0x029037 thru 0x0295e8 (0x5b2 bytes) 000709 1789352117.218022 trunc from 0x040000 to 0x02c3b0 (0x13c4f bytes) 000710 1789352117.254421 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c3b1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c3b1): Mirror 3: 0xfcc4e10c (stale) Mirror 4: 0x9d7b7759 (stale) CRC-32 checksum value for chunk [0, 0x2c3b1): Mirror 1: 0x457152bf Mirror 5: 0x457152bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c3b1: skipped 000712 1789352118.290971 trunc from 0x02c3b1 to 0x00b462 (0x20f4e bytes) 000713 1789352118.355008 write 0x0122cc thru 0x01943a (0x716f bytes) 000714 1789352118.358682 punch from 0x0014f5 to 0x0108c3 (0xf3cf bytes) 000715 1789352118.378637 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1943b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1943b): Mirror 3: 0x666ad031 (stale) Mirror 4: 0x3d72e000 (stale) Mirror 5: 0x3a8cf4f1 (stale) CRC-32 checksum value for chunk [0, 0x1943b): Mirror 1: 0x21471c97 Mirror 6: 0x21471c97 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1943b: skipped 000716 1789352119.523788 mapread 0x012bef thru 0x01943a (0x684c bytes) 000717 1789352119.559129 mapwrite 0x01671f thru 0x01883d (0x211f bytes) 000718 1789352119.657195 trunc from 0x003763 to 0x00e838 (0xb0d6 bytes) 000719 1789352119.663188 trunc from 0x01943b to 0x02562b (0xc1f1 bytes) 000720 1789352119.697170 read 0x0089a4 thru 0x00cac2 (0x411f bytes) 000721 1789352119.707715 punch from 0x009560 to 0x00f74b (0x61ec bytes) 000722 1789352119.713095 fallocate 0x02c479 thru 0x02ccae (0x836 bytes) 000723 1789352119.719097 punch from 0x015d63 to 0x01e869 (0x8b07 bytes) 000724 1789352119.725208 mapread 0x015611 thru 0x01afd1 (0x59c1 bytes) 000725 1789352119.746661 MIRROR_RESYNC 5 mirrors 000726 1789352120.955054 trunc from 0x02562c to 0x01327a (0x123b1 bytes) 000727 1789352120.994945 read 0x003f1e thru 0x012e08 (0xeeeb bytes) 000728 1789352121.004850 read 0x00c9ff thru 0x01327a (0x687c bytes) 000729 1789352121.013329 write 0x02c50d thru 0x02d655 (0x1149 bytes) 000730 1789352121.014882 trunc from 0x0057e1 to 0x014604 (0xee24 bytes) 000731 1789352121.023906 trunc from 0x02a6b6 to 0x02d655 (0x2fa0 bytes) 000732 1789352121.035070 write 0x01ab6d thru 0x02602e (0xb4c2 bytes) 000733 1789352121.056315 mapwrite 0x00663c thru 0x00dd49 (0x770e bytes) 000734 1789352121.128566 mapread 0x02434b thru 0x02d655 (0x930b bytes) 000735 1789352121.130897 fallocate 0x0327be thru 0x0381ac (0x59ef bytes) 000736 1789352121.136815 write 0x02d62d thru 0x0313be (0x3d92 bytes) 000737 1789352121.148385 MIRROR_RESYNC 5 mirrors 000738 1789352122.624968 write 0x013ec3 thru 0x021dcb (0xdf09 bytes) 000739 1789352122.689126 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x381ad): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x381ad): Mirror 3: 0xe4bc78b (stale) Mirror 4: 0xe4bc78b (stale) Mirror 5: 0xe4bc78b (stale) Mirror 6: 0xe4bc78b (stale) CRC-32 checksum value for chunk [0, 0x381ad): Mirror 1: 0xefcf9944 Mirror 7: 0xefcf9944 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x381ad: skipped 000740 1789352123.741011 mapread 0x02ef0b thru 0x036d4b (0x7e41 bytes) 000742 1789352123.791826 trunc from 0x00026e to 0x001048 (0xddb bytes) 000743 1789352123.840943 read 0x0043b1 thru 0x006d78 (0x29c8 bytes) 000744 1789352123.850359 trunc from 0x015035 to 0x01c57f (0x754b bytes) 000746 1789352123.859764 mapread 0x021a85 thru 0x025a25 (0x3fa1 bytes) 000747 1789352123.876365 write 0x0101a7 thru 0x012b90 (0x29ea bytes) 000748 1789352123.897188 trunc from 0x0381ad to 0x00578f (0x32a1d bytes) 000751 1789352123.931089 punch from 0x002131 to 0x00578f (0x365f bytes) 000753 1789352123.940651 mapwrite 0x032e41 thru 0x035f23 (0x30e3 bytes) 000754 1789352123.995621 write 0x0213d3 thru 0x021c83 (0x8b1 bytes) 000755 1789352124.003160 fallocate 0x00a489 thru 0x00bacf (0x1647 bytes) 000756 1789352124.010416 trunc from 0x035f24 to 0x00d362 (0x28bc1 bytes) 000758 1789352124.034991 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xd363): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd363): Mirror 3: 0xedd61bd1 (stale) Mirror 4: 0xedd61bd1 (stale) Mirror 5: 0xedd61bd1 (stale) Mirror 6: 0xedd61bd1 (stale) Mirror 7: 0xedd61bd1 (stale) CRC-32 checksum value for chunk [0, 0xd363): Mirror 1: 0x4d0de2c2 Mirror 8: 0x4d0de2c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd363: skipped 000759 1789352124.976692 punch from 0x001a72 to 0x00c9cc (0xaf5b bytes) 000760 1789352125.031969 mapwrite 0x000a8a thru 0x00b165 (0xa6dc bytes) 000761 1789352125.084328 fallocate 0x02efea thru 0x034d78 (0x5d8f bytes) 000762 1789352125.091027 fallocate 0x009c94 thru 0x018543 (0xe8b0 bytes) 000763 1789352125.096595 read 0x004bf6 thru 0x00ad9f (0x61aa bytes) 000764 1789352125.105000 trunc from 0x018544 to 0x025c58 (0xd715 bytes) 000765 1789352125.131910 punch from 0x021506 to 0x021dd2 (0x8cd bytes) 000766 1789352125.138026 fallocate 0x02e1ec thru 0x03a8ce (0xc6e3 bytes) 000767 1789352125.151592 MIRROR_RESYNC 7 mirrors 000768 1789352126.338159 write 0x016036 thru 0x01a56c (0x4537 bytes) 000770 1789352126.372903 fallocate 0x0233b4 thru 0x02540a (0x2057 bytes) 000771 1789352126.379075 mapwrite 0x02e9ee thru 0x03106f (0x2682 bytes) 000773 1789352126.417405 read 0x0141d0 thru 0x023b0f (0xf940 bytes) 000774 1789352126.427198 trunc from 0x00838b to 0x012fd9 (0xac4f bytes) 000775 1789352126.432065 mapwrite 0x038231 thru 0x03e04f (0x5e1f bytes) 000776 1789352126.478923 write 0x035462 thru 0x03cf1b (0x7aba bytes) 000777 1789352126.480790 fallocate 0x03351f thru 0x03ca37 (0x9519 bytes) 000778 1789352126.485815 trunc from 0x02236a to 0x025ac9 (0x3760 bytes) 000779 1789352126.494336 read 0x03319b thru 0x0332dd (0x143 bytes) 000781 1789352126.500178 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e050): Mirror 4: 0x72047610 (stale) Mirror 5: 0x72047610 (stale) Mirror 6: 0x72047610 (stale) Mirror 7: 0x72047610 (stale) Mirror 8: 0x72047610 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e050): Mirror 4: 0x72047610 (stale) Mirror 5: 0x72047610 (stale) Mirror 6: 0x72047610 (stale) Mirror 7: 0x72047610 (stale) Mirror 8: 0x72047610 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e050: skipped 000782 1789352126.982173 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e050): Mirror 5: 0x72047610 (stale) Mirror 6: 0x72047610 (stale) Mirror 7: 0x72047610 (stale) Mirror 8: 0x72047610 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e050): Mirror 5: 0x72047610 (stale) Mirror 6: 0x72047610 (stale) Mirror 7: 0x72047610 (stale) Mirror 8: 0x72047610 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e050: skipped 000784 1789352127.469294 write 0x021253 thru 0x02616b (0x4f19 bytes) 000785 1789352127.486953 read 0x00fe64 thru 0x018221 (0x83be bytes) 000786 1789352127.517501 punch from 0x01e168 to 0x02005a (0x1ef3 bytes) 000787 1789352127.523343 mapwrite 0x007de4 thru 0x00851a (0x737 bytes) 000788 1789352127.562421 read 0x005814 thru 0x00d5f2 (0x7ddf bytes) 000789 1789352127.569784 trunc from 0x03e050 to 0x00e6f4 (0x2f95b bytes) 000790 1789352127.608800 fallocate 0x0077e7 thru 0x012d58 (0xb572 bytes) 000791 1789352127.615389 write 0x004b58 thru 0x00bde2 (0x728b bytes) 000792 1789352127.616847 fallocate 0x0118f2 thru 0x021439 (0xfb48 bytes) 000793 1789352127.630516 mapwrite 0x036fb0 thru 0x03e6ac (0x76fd bytes) 000794 1789352127.729919 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 5: 0xc46773f1 (stale) Mirror 6: 0xc46773f1 (stale) Mirror 7: 0xc46773f1 (stale) Mirror 8: 0xc46773f1 (stale) CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 1: 0x7453cd61 Mirror 9: 0x7453cd61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6ad: skipped 000795 1789352128.770366 fallocate 0x005fd0 thru 0x00e2ea (0x831b bytes) 000796 1789352128.825301 read 0x00570f thru 0x0090af (0x39a1 bytes) 000798 1789352128.834605 punch from 0x020a0c to 0x027b7f (0x7174 bytes) 000799 1789352128.851637 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 5: 0xc46773f1 (stale) Mirror 7: 0xc46773f1 (stale) Mirror 8: 0xc46773f1 (stale) Mirror 9: 0x7453cd61 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 5: 0xc46773f1 (stale) Mirror 7: 0xc46773f1 (stale) Mirror 8: 0xc46773f1 (stale) Mirror 9: 0x7453cd61 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6ad: skipped 000800 1789352129.277888 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 5: 0xc46773f1 (stale) Mirror 7: 0xc46773f1 (stale) Mirror 8: 0xc46773f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6ad): Mirror 5: 0xc46773f1 (stale) Mirror 7: 0xc46773f1 (stale) Mirror 8: 0xc46773f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6ad: skipped 000801 1789352129.620823 trunc from 0x009366 to 0x01898a (0xf625 bytes) 000802 1789352129.636405 mapwrite 0x00d87b thru 0x016faf (0x9735 bytes) 000803 1789352129.698557 mapwrite 0x0027f3 thru 0x008324 (0x5b32 bytes) 000804 1789352129.761320 write 0x016f93 thru 0x018a56 (0x1ac4 bytes) 000805 1789352129.774007 mapwrite 0x012be3 thru 0x018141 (0x555f bytes) 000806 1789352129.804342 trunc from 0x03e6ad to 0x005c55 (0x38a57 bytes) 000807 1789352129.851759 fallocate 0x034052 thru 0x034e1f (0xdce bytes) 000808 1789352129.865808 mapread 0x002882 thru 0x005c55 (0x33d4 bytes) 000810 1789352129.872576 mapwrite 0x018065 thru 0x021648 (0x95e4 bytes) 000811 1789352129.967755 punch from 0x015fdc to 0x01e4cc (0x84f1 bytes) 000812 1789352129.973870 read 0x00473b thru 0x0050e2 (0x9a8 bytes) 000814 1789352129.976864 write 0x005e2d thru 0x00cb32 (0x6d06 bytes) 000815 1789352129.983469 trunc from 0x021649 to 0x039891 (0x18249 bytes) 000816 1789352129.999653 punch from 0x01724c to 0x01849f (0x1254 bytes) 000817 1789352130.004017 punch from 0x00e32d to 0x0166a0 (0x8374 bytes) 000818 1789352130.008748 write 0x037401 thru 0x03ffff (0x8bff bytes) 000820 1789352130.015229 mapread 0x006611 thru 0x00dfc4 (0x79b4 bytes) 000821 1789352130.028815 write 0x00672e thru 0x00ee0b (0x86de bytes) 000822 1789352130.030270 mapwrite 0x03f0e0 thru 0x03ffff (0xf20 bytes) 000823 1789352130.046632 trunc from 0x014176 to 0x0225dd (0xe468 bytes) 000824 1789352130.052487 fallocate 0x019092 thru 0x01e49d (0x540c bytes) 000826 1789352130.069412 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x79c19736 (stale) Mirror 7: 0x79c19736 (stale) Mirror 8: 0x79c19736 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x78ccf61c Mirror 9: 0x78ccf61c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000827 1789352130.761504 trunc from 0x0155a7 to 0x022816 (0xd270 bytes) 000828 1789352130.829348 write 0x02846f thru 0x035a44 (0xd5d6 bytes) 000829 1789352130.850893 mapwrite 0x00af46 thru 0x018833 (0xd8ee bytes) 000830 1789352130.894525 mapwrite 0x016c85 thru 0x025e61 (0xf1dd bytes) 000831 1789352130.922650 mapwrite 0x00fdad thru 0x01883c (0x8a90 bytes) 000832 1789352130.944773 mapread 0x03cc7b thru 0x03ffff (0x3385 bytes) 000833 1789352130.952483 write 0x03f28d thru 0x03ffff (0xd73 bytes) 000834 1789352130.953529 trunc from 0x040000 to 0x00a790 (0x3586f bytes) 000835 1789352130.987669 fallocate 0x01ab94 thru 0x01e7a0 (0x3c0d bytes) 000836 1789352130.993135 trunc from 0x01e7a1 to 0x03c36e (0x1dbce bytes) 000837 1789352131.007807 read 0x031ada thru 0x03c36e (0xa895 bytes) 000838 1789352131.016029 read 0x00aee7 thru 0x00c229 (0x1343 bytes) 000839 1789352131.024426 trunc from 0x038cf2 to 0x03c36e (0x367d bytes) 000840 1789352131.028819 write 0x03ce9a thru 0x03ffff (0x3166 bytes) 000841 1789352131.034203 write 0x03880e thru 0x03ddf6 (0x55e9 bytes) 000842 1789352131.039217 fallocate 0x008b02 thru 0x00f408 (0x6907 bytes) 000843 1789352131.042519 trunc from 0x040000 to 0x01122d (0x2edd2 bytes) 000844 1789352131.057196 punch from 0x0055b1 to 0x008322 (0x2d72 bytes) 000845 1789352131.062492 punch from 0x00e1a1 to 0x00fde7 (0x1c47 bytes) 000847 1789352131.066573 read 0x00f69d thru 0x01122d (0x1b91 bytes) 000848 1789352131.077519 punch from 0x0025f0 to 0x003a4c (0x145d bytes) 000849 1789352131.085725 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1122e): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1122e): Mirror 5: 0x570e88ee (stale) Mirror 7: 0x570e88ee (stale) Mirror 8: 0x570e88ee (stale) Mirror 9: 0xd25b4902 (stale) CRC-32 checksum value for chunk [0, 0x1122e): Mirror 1: 0x7e04a81e Mirror 10: 0x7e04a81e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1122e: skipped 000850 1789352131.819923 punch from 0x00ace0 to 0x01122d (0x654e bytes) 000851 1789352131.859895 trunc from 0x01122e to 0x015530 (0x4303 bytes) 000852 1789352131.904459 punch from 0x003548 to 0x00848d (0x4f46 bytes) 000853 1789352131.910800 mapwrite 0x01bd3e thru 0x026e6e (0xb131 bytes) 000854 1789352131.966875 mapread 0x00cd95 thru 0x00f8ac (0x2b18 bytes) 000855 1789352131.980618 mapread 0x00ba6d thru 0x00f2ae (0x3842 bytes) 000856 1789352131.981727 trunc from 0x018308 to 0x01cfd0 (0x4cc9 bytes) 000857 1789352131.991552 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x26e6f): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26e6f): Mirror 5: 0x3891546b (stale) Mirror 7: 0x3891546b (stale) Mirror 8: 0x3891546b (stale) Mirror 9: 0xa9e6af4c (stale) Mirror 10: 0xd057b73d (stale) CRC-32 checksum value for chunk [0, 0x26e6f): Mirror 1: 0x3f45813 Mirror 11: 0x3f45813 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26e6f: skipped 000858 1789352132.896913 trunc from 0x026e6f to 0x03f424 (0x185b6 bytes) 000859 1789352132.945080 fallocate 0x03823a thru 0x03ffff (0x7dc6 bytes) 000860 1789352132.953347 write 0x03fce2 thru 0x03ffff (0x31e bytes) 000861 1789352132.959166 trunc from 0x040000 to 0x03aeac (0x5153 bytes) 000862 1789352132.982152 read 0x0067ea thru 0x011f73 (0xb78a bytes) 000864 1789352132.992401 trunc from 0x02cb6c to 0x03aeac (0xe341 bytes) 000866 1789352133.009975 trunc from 0x02bbe7 to 0x0363b2 (0xa7cc bytes) 000867 1789352133.028848 write 0x01b02d thru 0x022f8a (0x7f5e bytes) 000868 1789352133.059227 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aead): Mirror 5: 0x7443afb0 (stale) Mirror 7: 0x7443afb0 (stale) Mirror 9: 0x403e1937 (stale) Mirror 10: 0xcd33438d (stale) Mirror 11: 0x9780e492 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aead): Mirror 5: 0x7443afb0 (stale) Mirror 7: 0x7443afb0 (stale) Mirror 9: 0x403e1937 (stale) Mirror 10: 0xcd33438d (stale) Mirror 11: 0x9780e492 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aead: skipped 000869 1789352133.564804 trunc from 0x013f8e to 0x022942 (0xe9b5 bytes) 000870 1789352133.580102 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3aead): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aead): Mirror 5: 0x7443afb0 (stale) Mirror 7: 0x7443afb0 (stale) Mirror 9: 0x403e1937 (stale) Mirror 10: 0xcd33438d (stale) Mirror 11: 0x9780e492 (stale) CRC-32 checksum value for chunk [0, 0x3aead): Mirror 1: 0xb3a87f80 Mirror 12: 0xb3a87f80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aead: skipped 000871 1789352134.663372 write 0x036de9 thru 0x03f0c6 (0x82de bytes) 000872 1789352134.721540 trunc from 0x03f0c7 to 0x02f3d2 (0xfcf4 bytes) 000873 1789352134.752109 read 0x019631 thru 0x025e3e (0xc80e bytes) 000874 1789352134.761854 write 0x01d78c thru 0x01ea16 (0x128b bytes) 000875 1789352134.763638 mapwrite 0x00fb40 thru 0x01216b (0x262c bytes) 000876 1789352134.807330 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f3d3): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f3d3): Mirror 5: 0xcafaf02e (stale) Mirror 7: 0xcafaf02e (stale) Mirror 9: 0x249394f8 (stale) Mirror 10: 0x5f9dfdab (stale) Mirror 11: 0x13ec23d4 (stale) Mirror 12: 0x63643cfb (stale) CRC-32 checksum value for chunk [0, 0x2f3d3): Mirror 1: 0xbf502a16 Mirror 13: 0xbf502a16 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f3d3: skipped 000878 1789352135.985173 read 0x009884 thru 0x00f48c (0x5c09 bytes) 000879 1789352136.001407 trunc from 0x021eea to 0x02d23b (0xb352 bytes) 000880 1789352136.049426 mapread 0x02a63b thru 0x02d204 (0x2bca bytes) 000881 1789352136.066599 punch from 0x008591 to 0x00bfca (0x3a3a bytes) 000882 1789352136.070899 read 0x019a41 thru 0x023cab (0xa26b bytes) 000883 1789352136.078741 trunc from 0x010980 to 0x01226b (0x18ec bytes) 000884 1789352136.086867 write 0x0369a4 thru 0x03ffff (0x965c bytes) 000886 1789352136.092761 fallocate 0x02f55a thru 0x03bd04 (0xc7ab bytes) 000887 1789352136.100673 trunc from 0x03f350 to 0x03ffff (0xcb0 bytes) 000888 1789352136.122807 fallocate 0x025f5a thru 0x02c8cb (0x6972 bytes) 000890 1789352136.135644 write 0x017dbb thru 0x01db6d (0x5db3 bytes) 000891 1789352136.139635 mapread 0x032e13 thru 0x03f7bb (0xc9a9 bytes) 000892 1789352136.155874 write 0x0191d7 thru 0x01f945 (0x676f bytes) 000893 1789352136.159920 punch from 0x03db58 to 0x03ffff (0x24a8 bytes) 000894 1789352136.167549 punch from 0x02ea28 to 0x02f9e0 (0xfb9 bytes) 000895 1789352136.174526 mapwrite 0x02886a thru 0x031be8 (0x937f bytes) 000896 1789352136.220683 trunc from 0x00c50f to 0x0165df (0xa0d1 bytes) 000897 1789352136.232701 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x79c19736 (stale) Mirror 7: 0x79c19736 (stale) Mirror 9: 0x78ccf61c (stale) Mirror 10: 0xb1e9e5ff (stale) Mirror 11: 0x41a71274 (stale) Mirror 12: 0xb10bda91 (stale) Mirror 13: 0x6f25eb23 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7d4c6602 Mirror 14: 0x7d4c6602 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1789352137.169752 read 0x01ab42 thru 0x01d251 (0x2710 bytes) 000902 1789352137.234172 punch from 0x00173e to 0x0048e7 (0x31aa bytes) 000903 1789352137.287079 punch from 0x039907 to 0x03ffff (0x66f9 bytes) 000904 1789352137.296508 mapread 0x01f057 thru 0x029b25 (0xaacf bytes) 000905 1789352137.332918 write 0x03382f thru 0x0342d9 (0xaab bytes) 000906 1789352137.349674 fallocate 0x008bf2 thru 0x0115ea (0x89f9 bytes) 000907 1789352137.355889 fallocate 0x037786 thru 0x03ffff (0x887a bytes) 000908 1789352137.361566 mapread 0x01e4ff thru 0x025dbf (0x78c1 bytes) 000909 1789352137.363494 read 0x00953d thru 0x00c2d5 (0x2d99 bytes) 000910 1789352137.391840 fallocate 0x0348ad thru 0x03ffff (0xb753 bytes) 000911 1789352137.405358 write 0x025b18 thru 0x03395c (0xde45 bytes) 000912 1789352137.413069 write 0x026914 thru 0x027a99 (0x1186 bytes) 000913 1789352137.422420 MIRROR_RESYNC 9 mirrors 000914 1789352140.007889 mapread 0x01b708 thru 0x01c394 (0xc8d bytes) 000915 1789352140.017101 fallocate 0x028497 thru 0x02cd7f (0x48e9 bytes) 000916 1789352140.054206 trunc from 0x03fb9d to 0x03ffff (0x463 bytes) 000917 1789352140.059407 mapwrite 0x00e663 thru 0x01a0c9 (0xba67 bytes) 000918 1789352140.090905 fallocate 0x021708 thru 0x022f7a (0x1873 bytes) 000919 1789352140.100616 trunc from 0x00392e to 0x009eda (0x65ad bytes) 000920 1789352140.105374 write 0x0326bb thru 0x03ffff (0xd945 bytes) 000921 1789352140.118875 read 0x03a702 thru 0x03ffff (0x58fe bytes) 000922 1789352140.121346 punch from 0x03a64c to 0x03c405 (0x1dba bytes) 000923 1789352140.143316 read 0x0074fd thru 0x00a485 (0x2f89 bytes) 000924 1789352140.157347 punch from 0x012ea7 to 0x017702 (0x485c bytes) 000926 1789352140.171259 mapwrite 0x02d175 thru 0x02efaf (0x1e3b bytes) 000927 1789352140.194407 mapwrite 0x0037ea thru 0x00d888 (0xa09f bytes) 000928 1789352140.227162 read 0x01bae0 thru 0x0283cf (0xc8f0 bytes) 000929 1789352140.227926 trunc from 0x040000 to 0x00165a (0x3e9a5 bytes) 000930 1789352140.255388 mapwrite 0x019bdf thru 0x01ca28 (0x2e4a bytes) 000931 1789352140.307285 mapwrite 0x00572b thru 0x00858b (0x2e61 bytes) 000932 1789352140.325762 read 0x0127d5 thru 0x01420b (0x1a37 bytes) 000933 1789352140.326797 write 0x0273b5 thru 0x027859 (0x4a5 bytes) 000934 1789352140.328278 write 0x033b5b thru 0x03e9d7 (0xae7d bytes) 000935 1789352140.330575 mapread 0x01d658 thru 0x02814f (0xaaf8 bytes) 000936 1789352140.345410 trunc from 0x0395a6 to 0x03c7a8 (0x3203 bytes) 000938 1789352140.384701 write 0x037691 thru 0x038da5 (0x1715 bytes) 000939 1789352140.385849 punch from 0x012506 to 0x01c861 (0xa35c bytes) 000940 1789352140.400003 punch from 0x03b7a3 to 0x03e9d7 (0x3235 bytes) 000941 1789352140.418895 punch from 0x0330fe to 0x03e9d7 (0xb8da bytes) 000942 1789352140.448934 trunc from 0x032631 to 0x03c593 (0x9f63 bytes) 000943 1789352140.466140 trunc from 0x007948 to 0x0127cf (0xae88 bytes) 000944 1789352140.482105 mapread 0x021e3b thru 0x022e2e (0xff4 bytes) 000945 1789352140.498529 MIRROR_RESYNC 9 mirrors 000946 1789352142.739983 read 0x01346b thru 0x013737 (0x2cd bytes) 000948 1789352142.745083 mapwrite 0x0207db thru 0x0231bf (0x29e5 bytes) 000949 1789352142.825614 trunc from 0x03e9d8 to 0x033c17 (0xadc0 bytes) 000950 1789352142.852908 read 0x03386f thru 0x033c17 (0x3a9 bytes) 000951 1789352142.866070 write 0x01a0a0 thru 0x0265d0 (0xc531 bytes) 000952 1789352142.868566 punch from 0x0071b1 to 0x012af4 (0xb944 bytes) 000953 1789352142.873990 read 0x02b770 thru 0x033c17 (0x84a8 bytes) 000954 1789352142.874822 fallocate 0x0216b9 thru 0x02d178 (0xbac0 bytes) 000955 1789352142.880219 read 0x007eb5 thru 0x00adf2 (0x2f3e bytes) 000956 1789352142.892484 write 0x02fe39 thru 0x03eb38 (0xed00 bytes) 000957 1789352142.895266 trunc from 0x0249eb to 0x024dd7 (0x3ed bytes) 000958 1789352142.914944 mapwrite 0x0059a9 thru 0x0130a5 (0xd6fd bytes) 000960 1789352142.939742 trunc from 0x015d68 to 0x01f2d0 (0x9569 bytes) 000961 1789352142.945150 write 0x024374 thru 0x02a796 (0x6423 bytes) 000962 1789352142.951124 mapread 0x00b5b8 thru 0x00cd04 (0x174d bytes) 000963 1789352142.952173 write 0x023a8b thru 0x02ed78 (0xb2ee bytes) 000964 1789352142.958759 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3eb39): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb39): Mirror 5: 0xebcdd08c (stale) Mirror 7: 0xebcdd08c (stale) Mirror 9: 0xebcdd08c (stale) Mirror 10: 0xebcdd08c (stale) Mirror 11: 0xebcdd08c (stale) Mirror 12: 0xebcdd08c (stale) Mirror 13: 0xebcdd08c (stale) Mirror 14: 0xebcdd08c (stale) CRC-32 checksum value for chunk [0, 0x3eb39): Mirror 1: 0x6bd7242e Mirror 15: 0x6bd7242e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb39: skipped 000965 1789352143.785145 read 0x000935 thru 0x00892c (0x7ff8 bytes) 000966 1789352143.799375 trunc from 0x010e55 to 0x01728e (0x643a bytes) 000967 1789352143.839729 fallocate 0x00b31a thru 0x01857c (0xd263 bytes) 000968 1789352143.845009 punch from 0x01a9e3 to 0x020e51 (0x646f bytes) 000971 1789352143.851359 read 0x0383cd thru 0x03db0a (0x573e bytes) 000972 1789352143.861535 trunc from 0x003e8b to 0x007849 (0x39bf bytes) 000973 1789352143.866398 read 0x037c31 thru 0x03d5bf (0x598f bytes) 000974 1789352143.867090 fallocate 0x01df9a thru 0x02aa99 (0xcb00 bytes) 000975 1789352143.871652 fallocate 0x00589f thru 0x008bba (0x331c bytes) 000976 1789352143.880389 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3eb39): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb39): Mirror 5: 0xebcdd08c (stale) Mirror 7: 0xebcdd08c (stale) Mirror 9: 0xebcdd08c (stale) Mirror 10: 0xebcdd08c (stale) Mirror 11: 0xebcdd08c (stale) Mirror 12: 0xebcdd08c (stale) Mirror 13: 0xebcdd08c (stale) Mirror 14: 0xebcdd08c (stale) Mirror 15: 0x6bd7242e (stale) CRC-32 checksum value for chunk [0, 0x3eb39): Mirror 1: 0x3b572d64 Mirror 16: 0x3b572d64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb39: skipped 000977 1789352144.765451 mapread 0x0148b7 thru 0x0199f3 (0x513d bytes) 000978 1789352144.809372 read 0x036c44 thru 0x037f2e (0x12eb bytes) 000979 1789352144.829467 trunc from 0x03eb39 to 0x003003 (0x3bb35 bytes) 000980 1789352144.877268 fallocate 0x03e17a thru 0x03ffff (0x1e86 bytes) 000983 1789352144.881550 trunc from 0x003004 to 0x03ce34 (0x39e31 bytes) 000984 1789352144.902775 punch from 0x033569 to 0x036e71 (0x3909 bytes) 000985 1789352144.911758 punch from 0x01f8a3 to 0x0277aa (0x7f08 bytes) 000986 1789352144.915612 write 0x03a9d0 thru 0x03ffff (0x5630 bytes) 000987 1789352144.921080 punch from 0x03eb02 to 0x03ffff (0x14fe bytes) 000988 1789352144.935178 write 0x03037e thru 0x03a019 (0x9c9c bytes) 000989 1789352144.949610 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1103ffd5 (stale) Mirror 7: 0x1103ffd5 (stale) Mirror 10: 0x1103ffd5 (stale) Mirror 11: 0x1103ffd5 (stale) Mirror 12: 0x1103ffd5 (stale) Mirror 13: 0x1103ffd5 (stale) Mirror 14: 0x1103ffd5 (stale) Mirror 15: 0x21878d3d (stale) Mirror 16: 0x73b370b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1103ffd5 (stale) Mirror 7: 0x1103ffd5 (stale) Mirror 10: 0x1103ffd5 (stale) Mirror 11: 0x1103ffd5 (stale) Mirror 12: 0x1103ffd5 (stale) Mirror 13: 0x1103ffd5 (stale) Mirror 14: 0x1103ffd5 (stale) Mirror 15: 0x21878d3d (stale) Mirror 16: 0x73b370b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000991 1789352145.537457 punch from 0x00916e to 0x010dfe (0x7c91 bytes) 000992 1789352145.542983 trunc from 0x040000 to 0x01c660 (0x2399f bytes) 000993 1789352145.566781 fallocate 0x017f82 thru 0x021406 (0x9485 bytes) 000995 1789352145.573067 fallocate 0x02fda7 thru 0x03dff2 (0xe24c bytes) 000996 1789352145.578450 read 0x006840 thru 0x0069de (0x19f bytes) 000997 1789352145.594546 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1c661): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c661): Mirror 5: 0xe3abdd3a (stale) Mirror 7: 0xe3abdd3a (stale) Mirror 10: 0xe3abdd3a (stale) Mirror 11: 0xe3abdd3a (stale) Mirror 12: 0xe3abdd3a (stale) Mirror 13: 0xe3abdd3a (stale) Mirror 14: 0xe3abdd3a (stale) Mirror 15: 0x375a2618 (stale) Mirror 16: 0xce4db390 (stale) CRC-32 checksum value for chunk [0, 0x1c661): Mirror 1: 0x150d7ea7 Mirror 17: 0x150d7ea7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c661: skipped 000998 1789352146.441433 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x21f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c661): Mirror 5: 0xe3abdd3a (stale) Mirror 7: 0xe3abdd3a (stale) Mirror 10: 0xe3abdd3a (stale) Mirror 11: 0xe3abdd3a (stale) Mirror 12: 0xe3abdd3a (stale) Mirror 13: 0xe3abdd3a (stale) Mirror 14: 0xe3abdd3a (stale) Mirror 15: 0x375a2618 (stale) Mirror 16: 0xce4db390 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c661): Mirror 5: 0xe3abdd3a (stale) Mirror 7: 0xe3abdd3a (stale) Mirror 10: 0xe3abdd3a (stale) Mirror 11: 0xe3abdd3a (stale) Mirror 12: 0xe3abdd3a (stale) Mirror 13: 0xe3abdd3a (stale) Mirror 14: 0xe3abdd3a (stale) Mirror 15: 0x375a2618 (stale) Mirror 16: 0xce4db390 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c661: skipped 000999 1789352147.007111 trunc from 0x011f13 to 0x01c660 (0xa74e bytes) 001000 1789352147.031611 MIRROR_RESYNC 10 mirrors All operations completed A-OK!