== sanity-flr test 70a: flr mode fsx test ================ 23:21:00 (1781234460) Seed set to 4461 skipping zero size read skipping zero length punch hole skipping zero size read fallocating to largest ever: 0x2f65e 000007 1781234461.804549 fallocate 0x0223a5 thru 0x02f65d (0xd2b9 bytes) 000008 1781234461.810331 write 0x028b23 thru 0x02fb9a (0x7078 bytes) 000009 1781234461.812196 punch from 0x0124c1 to 0x021823 (0xf363 bytes) 000010 1781234461.818353 write 0x02d6e5 thru 0x037a40 (0xa35c bytes) 000011 1781234461.821196 write 0x038a7e thru 0x03bd98 (0x331b bytes) truncating to largest ever: 0x32388 000013 1781234461.823846 trunc from 0x03bd99 to 0x032387 (0x9a11 bytes) 000014 1781234461.857864 read 0x00b09e thru 0x0137c3 (0x8726 bytes) fallocating to largest ever: 0x3d70c 000015 1781234461.877165 fallocate 0x03024a thru 0x03d70b (0xd4c2 bytes) 000016 1781234461.891825 fallocate 0x022c5b thru 0x02cbb2 (0x9f58 bytes) 000017 1781234461.900618 punch from 0x02f9b7 to 0x03a779 (0xadc3 bytes) 000018 1781234461.925895 punch from 0x03a07c to 0x03d70b (0x3690 bytes) 000019 1781234461.933729 mapwrite 0x010d39 thru 0x012cfd (0x1fc5 bytes) 000021 1781234461.956145 trunc from 0x03d70c to 0x008de3 (0x34928 bytes) 000022 1781234461.984594 read 0x005d64 thru 0x008de3 (0x3080 bytes) 000023 1781234461.994975 read 0x0005b4 thru 0x008de3 (0x8830 bytes) 000024 1781234462.000133 mapwrite 0x0067b7 thru 0x01049e (0x9ce8 bytes) 000025 1781234462.075065 punch from 0x007dca to 0x01049e (0x86d5 bytes) 000027 1781234462.086909 MIRROR_EXTEND to 2 mirrors 000028 1781234462.759205 mapread 0x000447 thru 0x00bc4d (0xb807 bytes) 000029 1781234462.801380 trunc from 0x003431 to 0x00ebe7 (0xb7b7 bytes) 000030 1781234462.866457 trunc from 0x01049f to 0x03ad83 (0x2a8e5 bytes) 000031 1781234462.924560 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000032 1781234463.139789 trunc from 0x03ad84 to 0x0328c2 (0x84c1 bytes) 000033 1781234463.169078 trunc from 0x009b32 to 0x01308f (0x955e bytes) 000034 1781234463.173953 trunc from 0x010a67 to 0x017e55 (0x73ef bytes) 000035 1781234463.178789 trunc from 0x0253e6 to 0x0328c2 (0xd4dd bytes) 000036 1781234463.183572 punch from 0x02e661 to 0x0328c2 (0x4262 bytes) 000037 1781234463.187882 write 0x020a31 thru 0x02be65 (0xb435 bytes) 000039 1781234463.202278 mapwrite 0x00c3f5 thru 0x01463a (0x8246 bytes) 000040 1781234463.244687 read 0x029217 thru 0x0328c2 (0x96ac bytes) 000041 1781234463.257306 MIRROR_EXTEND to 2 mirrors 000042 1781234463.774729 write 0x031929 thru 0x03eb5a (0xd232 bytes) 000044 1781234463.852427 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3eb5b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb5b): Mirror 2: 0x3cffc812 (stale) CRC-32 checksum value for chunk [0, 0x3eb5b): Mirror 1: 0x3e7364da Mirror 3: 0x3e7364da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb5b: skipped 000045 1781234464.752457 write 0x031933 thru 0x03dc3f (0xc30d bytes) 000046 1781234464.822326 write 0x00c1c5 thru 0x01170c (0x5548 bytes) 000047 1781234464.834443 mapread 0x00a3e6 thru 0x010193 (0x5dae bytes) 000048 1781234464.835818 mapread 0x0054e5 thru 0x00fa36 (0xa552 bytes) 000049 1781234464.838719 mapread 0x01a4e0 thru 0x02141c (0x6f3d bytes) 000050 1781234464.853491 fallocate 0x035928 thru 0x039fb3 (0x468c bytes) 000051 1781234464.860202 write 0x030e8e thru 0x035c3d (0x4db0 bytes) 000052 1781234464.871149 trunc from 0x022253 to 0x031322 (0xf0d0 bytes) 000053 1781234464.893281 trunc from 0x03eb5b to 0x00f2b1 (0x2f8a9 bytes) 000054 1781234464.921747 mapwrite 0x02e5bc thru 0x038262 (0x9ca7 bytes) 000055 1781234464.986608 punch from 0x01d718 to 0x02353a (0x5e23 bytes) 000056 1781234464.992872 punch from 0x01f99a to 0x02ad8a (0xb3f1 bytes) 000057 1781234465.000251 punch from 0x007fcb to 0x01064b (0x8681 bytes) 000058 1781234465.007231 read 0x0353fe thru 0x035bb9 (0x7bc bytes) 000060 1781234465.008715 write 0x0253fe thru 0x02b954 (0x6557 bytes) 000061 1781234465.021937 read 0x00dbed thru 0x0186c5 (0xaad9 bytes) 000062 1781234465.033461 punch from 0x02c116 to 0x0339f2 (0x78dd bytes) 000063 1781234465.039553 write 0x0220ff thru 0x022ccc (0xbce bytes) 000064 1781234465.041025 trunc from 0x01b918 to 0x027b7a (0xc263 bytes) 000065 1781234465.058143 read 0x01174d thru 0x015894 (0x4148 bytes) 000066 1781234465.059257 mapread 0x01454a thru 0x01a9c4 (0x647b bytes) 000067 1781234465.061274 write 0x023d66 thru 0x026e05 (0x30a0 bytes) 000068 1781234465.074876 mapwrite 0x02f308 thru 0x03f24a (0xff43 bytes) 000069 1781234465.129170 trunc from 0x03f24b to 0x023b02 (0x1b748 bytes) 000070 1781234465.150261 punch from 0x010270 to 0x01d94c (0xd6dd bytes) 000071 1781234465.161536 trunc from 0x01b3c1 to 0x023b02 (0x8742 bytes) 000072 1781234465.168694 write 0x01ab39 thru 0x028a08 (0xded0 bytes) 000074 1781234465.178577 write 0x03b718 thru 0x03ffff (0x48e8 bytes) 000076 1781234465.181871 read 0x00a997 thru 0x00d98e (0x2ff8 bytes) 000077 1781234465.183273 trunc from 0x040000 to 0x01e631 (0x219ce bytes) 000078 1781234465.214551 trunc from 0x01e632 to 0x018213 (0x641e bytes) 000079 1781234465.236272 write 0x003f3e thru 0x008a84 (0x4b47 bytes) 000080 1781234465.238453 fallocate 0x019cdf thru 0x021d37 (0x8059 bytes) 000081 1781234465.245665 mapread 0x00157a thru 0x00b56d (0x9ff4 bytes) 000082 1781234465.248231 read 0x00c24d thru 0x01544c (0x9200 bytes) 000083 1781234465.261306 punch from 0x0102e4 to 0x015b6b (0x5888 bytes) 000084 1781234465.266438 write 0x017a55 thru 0x0220fa (0xa6a6 bytes) 000085 1781234465.273509 mapread 0x00f5b3 thru 0x01374e (0x419c bytes) 000086 1781234465.299160 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x220fb): Mirror 2: 0x7d19231f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x220fb): Mirror 2: 0x7d19231f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x220fb: skipped 000087 1781234465.575231 write 0x02d7ad thru 0x030a59 (0x32ad bytes) 000088 1781234465.580483 trunc from 0x030a5a to 0x027b98 (0x8ec1 bytes) 000089 1781234465.596099 trunc from 0x027b99 to 0x00a43f (0x1d759 bytes) 000090 1781234465.610707 punch from 0x008220 to 0x00a43f (0x2220 bytes) 000091 1781234465.615292 trunc from 0x0007cb to 0x00704e (0x6884 bytes) 000093 1781234465.620409 read 0x005c9a thru 0x00a43f (0x47a6 bytes) 000094 1781234465.632365 write 0x017af5 thru 0x025e40 (0xe34c bytes) 000095 1781234465.634584 write 0x00b47b thru 0x014ee2 (0x9a68 bytes) 000096 1781234465.646127 mapwrite 0x0068c1 thru 0x009f56 (0x3696 bytes) 000097 1781234465.664664 trunc from 0x025e41 to 0x03b56b (0x1572b bytes) 000098 1781234465.680158 punch from 0x0234db to 0x02c598 (0x90be bytes) 000099 1781234465.685214 punch from 0x024dcb to 0x0295dc (0x4812 bytes) 000100 1781234465.689951 read 0x0343af thru 0x03b56b (0x71bd bytes) 000101 1781234465.701540 read 0x002e47 thru 0x0088a6 (0x5a60 bytes) 000102 1781234465.707132 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000103 1781234465.817546 punch from 0x0113b6 to 0x01fb91 (0xe7dc bytes) 000104 1781234465.824245 write 0x0105e2 thru 0x01f998 (0xf3b7 bytes) 000105 1781234465.839579 mapwrite 0x025450 thru 0x031c31 (0xc7e2 bytes) 000106 1781234465.921291 mapwrite 0x03abec thru 0x03ffff (0x5414 bytes) 000107 1781234466.011302 read 0x01780e thru 0x026c90 (0xf483 bytes) 000108 1781234466.012815 trunc from 0x040000 to 0x012b84 (0x2d47b bytes) 000109 1781234466.059603 read 0x01223e thru 0x012b84 (0x947 bytes) 000110 1781234466.061014 read 0x012af0 thru 0x012b84 (0x95 bytes) 000111 1781234466.063025 write 0x02da6d thru 0x030669 (0x2bfd bytes) 000112 1781234466.064479 read 0x00f334 thru 0x01997e (0xa64b bytes) 000113 1781234466.084793 read 0x003bf6 thru 0x00a996 (0x6da1 bytes) 000114 1781234466.085451 fallocate 0x0039a0 thru 0x010512 (0xcb73 bytes) fallocating to largest ever: 0x40000 000115 1781234466.102918 fallocate 0x03f3ac thru 0x03ffff (0xc54 bytes) 000116 1781234466.112431 trunc from 0x00c4bd to 0x01af97 (0xeadb bytes) 000118 1781234466.120002 trunc from 0x03066a to 0x01d825 (0x12e44 bytes) 000119 1781234466.138669 trunc from 0x01d826 to 0x01a9f8 (0x2e2d bytes) 000120 1781234466.154972 read 0x0010ce thru 0x00f57e (0xe4b1 bytes) 000121 1781234466.172162 mapwrite 0x0363a6 thru 0x03ffff (0x9c5a bytes) 000122 1781234466.229158 punch from 0x03c026 to 0x03c792 (0x76d bytes) 000123 1781234466.236172 trunc from 0x040000 to 0x00675b (0x398a4 bytes) 000124 1781234466.280236 punch from 0x001ed3 to 0x00675b (0x4889 bytes) 000125 1781234466.291189 punch from 0x0007a4 to 0x003812 (0x306f bytes) 000126 1781234466.298527 fallocate 0x0085b1 thru 0x0147be (0xc20e bytes) 000127 1781234466.305229 fallocate 0x0348cd thru 0x03c05e (0x7792 bytes) 000129 1781234466.312411 trunc from 0x00279a to 0x00675b (0x3fc2 bytes) 000130 1781234466.318646 read 0x00381a thru 0x00675b (0x2f42 bytes) 000131 1781234466.330911 mapread 0x001fdc thru 0x00675b (0x4780 bytes) 000132 1781234466.335548 write 0x026ee8 thru 0x029819 (0x2932 bytes) 000134 1781234466.340210 read 0x000f2e thru 0x00838c (0x745f bytes) 000135 1781234466.350934 fallocate 0x034496 thru 0x03b1ba (0x6d25 bytes) 000136 1781234466.356501 mapread 0x0068fd thru 0x015859 (0xef5d bytes) 000138 1781234466.359220 punch from 0x01d5d3 to 0x025927 (0x8355 bytes) 000140 1781234466.371268 MIRROR_EXTEND to 2 mirrors 000141 1781234467.015214 trunc from 0x01e8b7 to 0x0229d4 (0x411e bytes) 000142 1781234467.057173 MIRROR_RESYNC 2 mirrors 000143 1781234467.613062 mapwrite 0x01aa78 thru 0x024ff1 (0xa57a bytes) 000144 1781234467.760949 trunc from 0x02981a to 0x038830 (0xf017 bytes) 000145 1781234467.789161 punch from 0x01201f to 0x019855 (0x7837 bytes) 000146 1781234467.795028 mapwrite 0x038f9b thru 0x03ffff (0x7065 bytes) 000147 1781234467.846408 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdb6d968d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6ff5588f Mirror 3: 0x6ff5588f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000148 1781234469.377460 fallocate 0x020dca thru 0x02124c (0x483 bytes) 000149 1781234469.426532 trunc from 0x0300dd to 0x03e9b7 (0xe8db bytes) 000150 1781234469.435800 mapwrite 0x022fd7 thru 0x02b719 (0x8743 bytes) 000151 1781234469.514196 fallocate 0x0147a0 thru 0x0230b8 (0xe919 bytes) 000152 1781234469.532534 mapread 0x031e26 thru 0x038476 (0x6651 bytes) 000153 1781234469.565253 MIRROR_RESYNC 3 mirrors 000154 1781234470.881501 mapwrite 0x01a342 thru 0x029705 (0xf3c4 bytes) 000155 1781234471.055150 trunc from 0x01a03e to 0x02837a (0xe33d bytes) 000156 1781234471.064871 write 0x013e9a thru 0x017f7d (0x40e4 bytes) 000157 1781234471.082845 trunc from 0x040000 to 0x038349 (0x7cb6 bytes) 000158 1781234471.123912 trunc from 0x03834a to 0x03957e (0x1235 bytes) 000159 1781234471.153366 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3957f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3957f): Mirror 2: 0x9544a3ef (stale) Mirror 3: 0x9544a3ef (stale) CRC-32 checksum value for chunk [0, 0x3957f): Mirror 1: 0xa757c62d Mirror 4: 0xa757c62d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3957f: skipped 000160 1781234472.741462 punch from 0x01aab2 to 0x025cf8 (0xb247 bytes) 000161 1781234472.808977 write 0x01d693 thru 0x01edc6 (0x1734 bytes) 000162 1781234472.832726 mapwrite 0x00efb8 thru 0x012c38 (0x3c81 bytes) 000163 1781234472.870491 mapwrite 0x01c326 thru 0x0207b4 (0x448f bytes) 000164 1781234472.899783 read 0x008622 thru 0x00a723 (0x2102 bytes) 000165 1781234472.900669 punch from 0x034e8c to 0x03957e (0x46f3 bytes) 000166 1781234472.909336 fallocate 0x029889 thru 0x02dadb (0x4253 bytes) 000167 1781234472.918699 trunc from 0x03957f to 0x0296c1 (0xfebd bytes) 000168 1781234472.961251 fallocate 0x0031c1 thru 0x004ba6 (0x19e6 bytes) 000169 1781234472.971353 mapread 0x014caa thru 0x01e806 (0x9b5d bytes) 000171 1781234472.977108 mapread 0x021e3f thru 0x0274b3 (0x5675 bytes) 000172 1781234472.990236 mapwrite 0x01a45d thru 0x01b7a0 (0x1344 bytes) 000173 1781234473.020841 punch from 0x002aed to 0x00fcf5 (0xd209 bytes) 000174 1781234473.031957 write 0x00bbe1 thru 0x0174ce (0xb8ee bytes) 000175 1781234473.067549 trunc from 0x0296c2 to 0x0158ef (0x13dd2 bytes) 000177 1781234473.115861 MIRROR_RESYNC 4 mirrors 000178 1781234474.171687 trunc from 0x0158f0 to 0x01a562 (0x4c73 bytes) 000179 1781234474.233884 fallocate 0x009fd5 thru 0x0137d7 (0x9803 bytes) 000180 1781234474.240437 read 0x00a490 thru 0x01300f (0x8b80 bytes) 000181 1781234474.253202 trunc from 0x015c23 to 0x01a562 (0x4940 bytes) 000182 1781234474.258448 write 0x03ec45 thru 0x03ffff (0x13bb bytes) 000183 1781234474.260207 punch from 0x029fc6 to 0x035c12 (0xbc4d bytes) 000187 1781234474.269015 write 0x027040 thru 0x02c8af (0x5870 bytes) 000188 1781234474.282560 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x47e50d36 (stale) Mirror 4: 0x47e50d36 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x47e50d36 (stale) Mirror 4: 0x47e50d36 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000189 1781234474.731404 trunc from 0x040000 to 0x0361d1 (0x9e2e bytes) 000190 1781234474.808952 read 0x007ad5 thru 0x00a612 (0x2b3e bytes) 000191 1781234474.832782 punch from 0x01e0fc to 0x02da02 (0xf907 bytes) 000192 1781234474.860836 MIRROR_RESYNC 3 mirrors 000193 1781234475.948124 trunc from 0x035b96 to 0x0361d1 (0x63c bytes) 000194 1781234476.013123 mapwrite 0x0266fc thru 0x02cc4b (0x6550 bytes) 000195 1781234476.122920 mapwrite 0x004ece thru 0x00d696 (0x87c9 bytes) 000196 1781234476.212103 fallocate 0x01367f thru 0x016f82 (0x3904 bytes) 000197 1781234476.226712 write 0x0044fe thru 0x00d3a8 (0x8eab bytes) 000198 1781234476.233667 fallocate 0x015a24 thru 0x01cc3f (0x721c bytes) 000199 1781234476.262512 read 0x01d479 thru 0x02bf52 (0xeada bytes) 000200 1781234476.274533 write 0x0240c4 thru 0x0335a1 (0xf4de bytes) 000201 1781234476.283341 fallocate 0x019530 thru 0x01a93f (0x1410 bytes) 000202 1781234476.288684 punch from 0x030666 to 0x0361d1 (0x5b6c bytes) 000203 1781234476.309958 write 0x005efb thru 0x00e6cf (0x87d5 bytes) 000204 1781234476.314142 trunc from 0x02a0ff to 0x0342b6 (0xa1b8 bytes) 000205 1781234476.329107 mapwrite 0x01853b thru 0x027d70 (0xf836 bytes) 000206 1781234476.372845 trunc from 0x02e1bd to 0x0361d1 (0x8015 bytes) 000207 1781234476.379342 punch from 0x00db45 to 0x0133cf (0x588b bytes) 000208 1781234476.387406 mapwrite 0x039207 thru 0x03b92e (0x2728 bytes) 000209 1781234476.456951 read 0x003092 thru 0x003a33 (0x9a2 bytes) 000210 1781234476.459137 fallocate 0x02d7fd thru 0x03c795 (0xef99 bytes) 000211 1781234476.465334 write 0x03b978 thru 0x03ffff (0x4688 bytes) 000213 1781234476.469328 read 0x00e3ff thru 0x014c10 (0x6812 bytes) 000214 1781234476.492921 punch from 0x00d9df to 0x01152d (0x3b4f bytes) 000215 1781234476.497735 punch from 0x03fc17 to 0x03ffff (0x3e9 bytes) 000216 1781234476.537312 mapwrite 0x02f298 thru 0x03bd23 (0xca8c bytes) 000218 1781234476.597713 MIRROR_RESYNC 3 mirrors 000219 1781234477.675739 mapread 0x02d361 thru 0x03c2fd (0xef9d bytes) 000220 1781234477.704746 punch from 0x018fbd to 0x023beb (0xac2f bytes) 000221 1781234477.755131 mapwrite 0x028b8f thru 0x031456 (0x88c8 bytes) 000222 1781234477.794035 punch from 0x02671a to 0x02a23d (0x3b24 bytes) 000223 1781234477.800082 mapwrite 0x019990 thru 0x024297 (0xa908 bytes) 000224 1781234477.826076 trunc from 0x040000 to 0x03cab5 (0x354a bytes) 000225 1781234477.847498 mapwrite 0x03a704 thru 0x03ffff (0x58fc bytes) 000226 1781234477.892940 mapread 0x001372 thru 0x00b1f5 (0x9e84 bytes) 000227 1781234477.912795 punch from 0x010997 to 0x018c23 (0x828d bytes) 000228 1781234477.921596 mapread 0x0299f0 thru 0x033d11 (0xa322 bytes) 000229 1781234477.929976 punch from 0x002b1c to 0x00c2e2 (0x97c7 bytes) 000230 1781234477.934845 mapread 0x0026dd thru 0x00fe4a (0xd76e bytes) 000231 1781234477.949797 write 0x0170a8 thru 0x017803 (0x75c bytes) 000232 1781234477.958831 mapwrite 0x031bc7 thru 0x0324ee (0x928 bytes) 000233 1781234477.972537 mapread 0x03027a thru 0x03e5ab (0xe332 bytes) 000235 1781234477.975585 write 0x022c23 thru 0x03264f (0xfa2d bytes) 000236 1781234477.977616 read 0x00a5f9 thru 0x00fca6 (0x56ae bytes) 000237 1781234477.979038 write 0x02ec91 thru 0x0366e2 (0x7a52 bytes) 000238 1781234477.980540 trunc from 0x03e710 to 0x03ffff (0x18f0 bytes) 000239 1781234477.986592 write 0x03b077 thru 0x03d5b4 (0x253e bytes) 000240 1781234477.988031 trunc from 0x00f3cc to 0x0105b6 (0x11eb bytes) 000241 1781234477.992541 punch from 0x01bc62 to 0x0289de (0xcd7d bytes) 000242 1781234478.010513 fallocate 0x0343b2 thru 0x03f47c (0xb0cb bytes) 000244 1781234478.020089 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7bab2829 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7bab2829 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000245 1781234478.294464 write 0x02b58d thru 0x034f7d (0x99f1 bytes) 000246 1781234478.310717 write 0x03e656 thru 0x03ffff (0x19aa bytes) 000247 1781234478.325879 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000248 1781234478.456387 fallocate 0x0041d0 thru 0x00636a (0x219b bytes) 000250 1781234478.471482 MIRROR_EXTEND to 2 mirrors 000251 1781234479.070497 trunc from 0x040000 to 0x02b3fa (0x14c05 bytes) 000252 1781234479.142035 mapread 0x006434 thru 0x0073fb (0xfc8 bytes) 000253 1781234479.161740 mapread 0x00d3a8 thru 0x010af7 (0x3750 bytes) 000254 1781234479.172007 trunc from 0x00528e to 0x0136d5 (0xe448 bytes) 000255 1781234479.176983 punch from 0x0040fe to 0x00b267 (0x716a bytes) 000256 1781234479.182093 mapwrite 0x02bb1b thru 0x02efe6 (0x34cc bytes) 000257 1781234479.232673 punch from 0x0293f7 to 0x02efe6 (0x5bf0 bytes) 000258 1781234479.238416 mapread 0x00c49d thru 0x010783 (0x42e7 bytes) 000259 1781234479.249287 mapwrite 0x0358b1 thru 0x03ac1f (0x536f bytes) 000261 1781234479.293556 mapread 0x00dbca thru 0x0151b2 (0x75e9 bytes) 000262 1781234479.295558 fallocate 0x03a96c thru 0x03ffff (0x5694 bytes) 000263 1781234479.304186 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000265 1781234479.445166 MIRROR_EXTEND to 2 mirrors 000266 1781234480.142056 trunc from 0x040000 to 0x0188a3 (0x2775c bytes) 000268 1781234480.223062 punch from 0x00fc87 to 0x0188a3 (0x8c1d bytes) 000269 1781234480.231463 punch from 0x00a8e1 to 0x013f26 (0x9646 bytes) 000270 1781234480.248476 trunc from 0x0188a4 to 0x03bc4d (0x233aa bytes) 000271 1781234480.296062 read 0x0246d7 thru 0x0260a1 (0x19cb bytes) 000272 1781234480.324246 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000273 1781234480.519742 trunc from 0x000d76 to 0x001ad7 (0xd62 bytes) 000274 1781234480.525111 punch from 0x0281fc to 0x031782 (0x9587 bytes) 000275 1781234480.529609 fallocate 0x01bd24 thru 0x027066 (0xb343 bytes) 000276 1781234480.534771 write 0x0076d4 thru 0x0125ea (0xaf17 bytes) 000277 1781234480.566752 MIRROR_EXTEND to 2 mirrors 000278 1781234481.363053 mapread 0x02effa thru 0x030872 (0x1879 bytes) 000279 1781234481.413297 mapwrite 0x002361 thru 0x007d72 (0x5a12 bytes) 000281 1781234481.538138 write 0x0166bb thru 0x01bcb3 (0x55f9 bytes) 000282 1781234481.574734 mapwrite 0x0140ca thru 0x01d9d8 (0x990f bytes) 000283 1781234481.648271 trunc from 0x03bc4e to 0x0154eb (0x26762 bytes) 000284 1781234481.714205 fallocate 0x0039c9 thru 0x00ad75 (0x73ad bytes) 000285 1781234481.735883 trunc from 0x000aeb to 0x00a404 (0x991a bytes) 000286 1781234481.742712 write 0x0268c4 thru 0x035005 (0xe742 bytes) 000287 1781234481.747873 punch from 0x020cb3 to 0x02cef3 (0xc241 bytes) 000288 1781234481.782979 fallocate 0x033418 thru 0x03ede0 (0xb9c9 bytes) 000289 1781234481.797986 read 0x00c607 thru 0x00dc08 (0x1602 bytes) 000290 1781234481.804704 write 0x008bdd thru 0x00f116 (0x653a bytes) 000291 1781234481.827131 mapwrite 0x005405 thru 0x0088f3 (0x34ef bytes) 000292 1781234481.856103 trunc from 0x03ede1 to 0x01d954 (0x2148c bytes) 000293 1781234481.902761 MIRROR_RESYNC 2 mirrors 000294 1781234482.583291 mapwrite 0x0224dd thru 0x02d939 (0xb45d bytes) 000295 1781234482.669040 trunc from 0x006099 to 0x0066ea (0x652 bytes) 000296 1781234482.675988 mapread 0x025dff thru 0x02d939 (0x7b3b bytes) 000297 1781234482.681361 MIRROR_RESYNC 2 mirrors 000298 1781234483.237060 write 0x028125 thru 0x03158d (0x9469 bytes) 000299 1781234483.269283 trunc from 0x03158e to 0x02bcf7 (0x5896 bytes) 000300 1781234483.292576 mapread 0x018f38 thru 0x027cf6 (0xedbf bytes) 000301 1781234483.322665 trunc from 0x01a5f6 to 0x01ec7e (0x4689 bytes) 000302 1781234483.331960 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000304 1781234483.474156 read 0x018dde thru 0x027ddb (0xeffe bytes) 000305 1781234483.493574 mapwrite 0x036473 thru 0x039080 (0x2c0e bytes) 000306 1781234483.605392 punch from 0x012d17 to 0x019823 (0x6b0d bytes) 000308 1781234483.613990 mapwrite 0x00a878 thru 0x01825d (0xd9e6 bytes) 000310 1781234483.702357 punch from 0x00f640 to 0x019117 (0x9ad8 bytes) 000311 1781234483.712358 fallocate 0x00fb7e thru 0x01ee8c (0xf30f bytes) 000312 1781234483.722436 trunc from 0x010bba to 0x0191d0 (0x8617 bytes) 000314 1781234483.729376 punch from 0x026118 to 0x0314a4 (0xb38d bytes) 000315 1781234483.736743 trunc from 0x039081 to 0x004fdc (0x340a4 bytes) 000316 1781234483.761518 trunc from 0x004fdd to 0x034fad (0x2ffd1 bytes) 000317 1781234483.776575 trunc from 0x0119f3 to 0x015a53 (0x4061 bytes) 000318 1781234483.781102 fallocate 0x016576 thru 0x020456 (0x9ee1 bytes) 000321 1781234483.788995 fallocate 0x01cdbd thru 0x027128 (0xa36c bytes) 000325 1781234483.797948 punch from 0x02910f to 0x032edf (0x9dd1 bytes) 000326 1781234483.803371 punch from 0x0144e4 to 0x0235d0 (0xf0ed bytes) 000328 1781234483.810443 punch from 0x001561 to 0x002424 (0xec4 bytes) 000329 1781234483.819045 fallocate 0x0145ba thru 0x015f30 (0x1977 bytes) 000330 1781234483.826948 write 0x022fe4 thru 0x024edf (0x1efc bytes) 000331 1781234483.842061 trunc from 0x0090ca to 0x00f4d0 (0x6407 bytes) 000332 1781234483.846761 trunc from 0x034fae to 0x00b1e9 (0x29dc4 bytes) 000333 1781234483.869139 write 0x01e877 thru 0x02828e (0x9a18 bytes) 000334 1781234483.871944 fallocate 0x02a4db thru 0x02df0f (0x3a35 bytes) 000335 1781234483.879423 fallocate 0x022800 thru 0x02dddd (0xb5de bytes) 000336 1781234483.884599 punch from 0x008a0e to 0x00e932 (0x5f25 bytes) 000337 1781234483.889572 fallocate 0x0289ec thru 0x03659c (0xdbb1 bytes) 000338 1781234483.894586 mapwrite 0x00645b thru 0x012486 (0xc02c bytes) 000339 1781234483.932206 mapread 0x01263c thru 0x017cef (0x56b4 bytes) 000340 1781234483.937464 mapread 0x018b93 thru 0x01a886 (0x1cf4 bytes) 000342 1781234483.945508 trunc from 0x02828f to 0x039db7 (0x11b29 bytes) 000343 1781234483.962066 write 0x009041 thru 0x01097f (0x793f bytes) 000345 1781234483.965590 mapread 0x01513a thru 0x017b73 (0x2a3a bytes) 000346 1781234483.967016 trunc from 0x039db8 to 0x01d357 (0x1ca60 bytes) 000348 1781234483.988095 mapwrite 0x03a177 thru 0x03ffff (0x5e89 bytes) 000349 1781234484.035278 trunc from 0x005601 to 0x00cebc (0x78bc bytes) 000350 1781234484.041420 trunc from 0x040000 to 0x00928d (0x36d72 bytes) 000351 1781234484.058743 mapwrite 0x00edbe thru 0x017f88 (0x91cb bytes) 000352 1781234484.106440 punch from 0x00e55b to 0x017f88 (0x9a2e bytes) 000354 1781234484.113254 mapwrite 0x03543b thru 0x03c46c (0x7032 bytes) 000355 1781234484.149725 mapread 0x00cbee thru 0x014552 (0x7965 bytes) 000356 1781234484.158949 read 0x014eee thru 0x022f12 (0xe025 bytes) 000357 1781234484.172566 punch from 0x000645 to 0x00c40e (0xbdca bytes) 000358 1781234484.178072 mapread 0x0110ec thru 0x0139eb (0x2900 bytes) 000359 1781234484.179549 mapread 0x034a4e thru 0x03b0e8 (0x669b bytes) 000360 1781234484.181425 mapread 0x00f82b thru 0x0193c8 (0x9b9e bytes) 000361 1781234484.182717 read 0x009b8a thru 0x00de56 (0x42cd bytes) 000363 1781234484.194050 mapread 0x00ddbe thru 0x01674d (0x8990 bytes) 000365 1781234484.197271 write 0x003af9 thru 0x0059f9 (0x1f01 bytes) 000366 1781234484.202599 MIRROR_EXTEND to 2 mirrors 000367 1781234484.689058 MIRROR_EXTEND to 3 mirrors 000368 1781234485.262177 write 0x03e896 thru 0x03ffff (0x176a bytes) 000369 1781234485.319679 punch from 0x008754 to 0x0167b1 (0xe05e bytes) 000370 1781234485.331465 punch from 0x006842 to 0x00a6be (0x3e7d bytes) 000371 1781234485.345398 mapwrite 0x023c02 thru 0x02bf29 (0x8328 bytes) 000372 1781234485.391977 trunc from 0x040000 to 0x0349dd (0xb622 bytes) 000373 1781234485.436929 mapwrite 0x006fea thru 0x00cf48 (0x5f5f bytes) 000374 1781234485.480672 write 0x03aa83 thru 0x03d872 (0x2df0 bytes) 000375 1781234485.485501 trunc from 0x03d873 to 0x01f545 (0x1e32d bytes) 000376 1781234485.534378 trunc from 0x01f546 to 0x01afa9 (0x459c bytes) 000377 1781234485.565035 mapwrite 0x004e50 thru 0x009328 (0x44d9 bytes) 000378 1781234485.598075 trunc from 0x01afaa to 0x034a33 (0x19a8a bytes) 000379 1781234485.631746 read 0x022b0c thru 0x02cdc1 (0xa2b6 bytes) 000381 1781234485.644005 mapwrite 0x03cf66 thru 0x03ffff (0x309a bytes) 000382 1781234485.687108 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x34e434a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x34e434a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000383 1781234485.999561 write 0x0115a8 thru 0x0122a8 (0xd01 bytes) 000384 1781234486.018271 trunc from 0x040000 to 0x01799a (0x28665 bytes) 000385 1781234486.037559 fallocate 0x02a6fe thru 0x02fb6c (0x546f bytes) 000387 1781234486.051310 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000388 1781234486.196591 write 0x01e450 thru 0x0209d0 (0x2581 bytes) 000391 1781234486.219990 write 0x006d35 thru 0x010925 (0x9bf1 bytes) 000393 1781234486.242121 write 0x038b43 thru 0x03ffff (0x74bd bytes) 000394 1781234486.243809 trunc from 0x0375a2 to 0x03ffff (0x8a5e bytes) 000395 1781234486.267546 trunc from 0x040000 to 0x0323d6 (0xdc29 bytes) 000396 1781234486.281540 write 0x02b283 thru 0x035f09 (0xac87 bytes) 000397 1781234486.294247 read 0x01065d thru 0x01ccff (0xc6a3 bytes) 000398 1781234486.304312 read 0x016d78 thru 0x025e6a (0xf0f3 bytes) 000400 1781234486.312532 fallocate 0x0368ab thru 0x03ffff (0x9755 bytes) 000401 1781234486.317203 punch from 0x03d3a8 to 0x03ffff (0x2c58 bytes) 000402 1781234486.324582 punch from 0x03d771 to 0x03ffff (0x288f bytes) 000403 1781234486.329309 fallocate 0x00e41e thru 0x014c2e (0x6811 bytes) 000404 1781234486.333964 trunc from 0x040000 to 0x002cb5 (0x3d34a bytes) 000405 1781234486.355611 trunc from 0x001e22 to 0x002cb5 (0xe94 bytes) 000406 1781234486.361146 trunc from 0x001ad2 to 0x002cb5 (0x11e4 bytes) 000407 1781234486.366233 write 0x034432 thru 0x0345de (0x1ad bytes) 000408 1781234486.367476 trunc from 0x0345df to 0x018e06 (0x1b7d8 bytes) 000409 1781234486.385984 punch from 0x009677 to 0x00c013 (0x299d bytes) 000410 1781234486.391002 mapread 0x018c3f thru 0x018e06 (0x1c8 bytes) 000412 1781234486.397708 fallocate 0x03b1fd thru 0x03d554 (0x2358 bytes) 000415 1781234486.406078 mapwrite 0x03f011 thru 0x03ffff (0xfef bytes) 000416 1781234486.497352 write 0x00ea0b thru 0x011ae9 (0x30df bytes) 000418 1781234486.510856 trunc from 0x040000 to 0x0348ae (0xb751 bytes) 000419 1781234486.541685 trunc from 0x00a201 to 0x014090 (0x9e90 bytes) 000421 1781234486.577892 MIRROR_EXTEND to 2 mirrors 000422 1781234487.589012 trunc from 0x013499 to 0x01bef6 (0x8a5e bytes) 000423 1781234487.673339 read 0x009022 thru 0x01330b (0xa2ea bytes) 000425 1781234487.693242 write 0x017be2 thru 0x021ef1 (0xa310 bytes) 000426 1781234487.732856 trunc from 0x0348af to 0x036341 (0x1a93 bytes) 000427 1781234487.757444 fallocate 0x03285f thru 0x03d24b (0xa9ed bytes) 000428 1781234487.775684 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36342): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36342): Mirror 2: 0x3e3c9306 (stale) CRC-32 checksum value for chunk [0, 0x36342): Mirror 1: 0x6365e4fc Mirror 3: 0x6365e4fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36342: skipped 000430 1781234488.806607 read 0x00b541 thru 0x013aa3 (0x8563 bytes) 000432 1781234488.822171 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000433 1781234489.175522 trunc from 0x01255b to 0x020c8a (0xe730 bytes) 000434 1781234489.243719 read 0x0137cf thru 0x01cef7 (0x9729 bytes) 000435 1781234489.256456 trunc from 0x030fd1 to 0x036341 (0x5371 bytes) 000436 1781234489.261998 read 0x02bfc3 thru 0x036341 (0xa37f bytes) 000437 1781234489.303595 write 0x01c32b thru 0x021d6a (0x5a40 bytes) 000438 1781234489.312421 write 0x00ebed thru 0x01ab65 (0xbf79 bytes) 000439 1781234489.321431 mapwrite 0x012d48 thru 0x014b5c (0x1e15 bytes) 000440 1781234489.371431 punch from 0x006012 to 0x01439c (0xe38b bytes) 000441 1781234489.392986 trunc from 0x0119ad to 0x01d766 (0xbdba bytes) 000442 1781234489.400600 write 0x0188a3 thru 0x01d1b1 (0x490f bytes) 000443 1781234489.444225 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000444 1781234489.777614 trunc from 0x036342 to 0x033d81 (0x25c0 bytes) 000445 1781234489.811436 MIRROR_EXTEND to 2 mirrors 000446 1781234490.510405 mapwrite 0x021522 thru 0x029105 (0x7be4 bytes) 000447 1781234490.667327 MIRROR_RESYNC 2 mirrors 000449 1781234491.332515 trunc from 0x033d82 to 0x032af5 (0x128c bytes) 000450 1781234491.402515 mapread 0x00431a thru 0x013715 (0xf3fc bytes) 000451 1781234491.430336 trunc from 0x013f2e to 0x01c9e1 (0x8ab4 bytes) 000454 1781234491.436043 mapread 0x02063a thru 0x02911a (0x8ae1 bytes) 000455 1781234491.451262 punch from 0x029c05 to 0x032af5 (0x8ef1 bytes) 000456 1781234491.455778 mapwrite 0x00c1f8 thru 0x015273 (0x907c bytes) 000457 1781234491.481844 mapwrite 0x0357e0 thru 0x0360d0 (0x8f1 bytes) 000458 1781234491.522926 mapread 0x02f4df thru 0x0360d0 (0x6bf2 bytes) 000459 1781234491.524126 trunc from 0x0360d1 to 0x03f946 (0x9876 bytes) 000460 1781234491.540959 punch from 0x00efe0 to 0x01e497 (0xf4b8 bytes) 000461 1781234491.550772 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) 000462 1781234491.671937 trunc from 0x03f947 to 0x03ab68 (0x4dde bytes) 000463 1781234491.722855 trunc from 0x037bd6 to 0x038ec8 (0x12f3 bytes) 000465 1781234491.739660 punch from 0x018374 to 0x027667 (0xf2f4 bytes) 000466 1781234491.747918 punch from 0x029884 to 0x036329 (0xcaa6 bytes) 000467 1781234491.758257 trunc from 0x03ab69 to 0x00e97e (0x2c1ea bytes) 000468 1781234491.811723 MIRROR_EXTEND to 2 mirrors 000469 1781234492.621395 write 0x00f696 thru 0x01ae6e (0xb7d9 bytes) 000470 1781234492.655328 trunc from 0x0044c4 to 0x011777 (0xd2b4 bytes) 000471 1781234492.672539 trunc from 0x01ae6f to 0x01192d (0x9541 bytes) 000473 1781234492.699721 read 0x0075b9 thru 0x0089b5 (0x13fd bytes) 000474 1781234492.706452 fallocate 0x0194e6 thru 0x028ebf (0xf9da bytes) 000475 1781234492.712365 write 0x0010f4 thru 0x0099e8 (0x88f5 bytes) 000476 1781234492.722006 trunc from 0x028ec0 to 0x000cec (0x281d3 bytes) 000477 1781234492.738829 punch from 0x000262 to 0x000cec (0xa8b bytes) 000478 1781234492.747409 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xced): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xced): Mirror 2: 0x6f0a8d1c (stale) CRC-32 checksum value for chunk [0, 0xced): Mirror 1: 0x6f0a8d1c Mirror 3: 0x6f0a8d1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xced: skipped 000480 1781234493.349916 trunc from 0x000ced to 0x03db2f (0x3ce43 bytes) 000481 1781234493.399480 MIRROR_RESYNC 3 mirrors 000482 1781234493.917887 mapread 0x006b6c thru 0x00be18 (0x52ad bytes) 000483 1781234493.936407 fallocate 0x01ce14 thru 0x01e9d5 (0x1bc2 bytes) 000484 1781234493.976282 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3db30): Mirror 3: 0xa327ba0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db30): Mirror 3: 0xa327ba0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db30: skipped 000487 1781234494.210652 read 0x02a149 thru 0x02cbba (0x2a72 bytes) 000489 1781234494.217778 punch from 0x015994 to 0x01713d (0x17aa bytes) 000490 1781234494.226038 fallocate 0x023291 thru 0x02d520 (0xa290 bytes) 000491 1781234494.231021 mapread 0x02dd13 thru 0x033c81 (0x5f6f bytes) 000492 1781234494.249599 read 0x028653 thru 0x02a2e8 (0x1c96 bytes) 000493 1781234494.250495 mapwrite 0x00b31b thru 0x017661 (0xc347 bytes) 000495 1781234494.284410 punch from 0x016f93 to 0x026c31 (0xfc9f bytes) 000497 1781234494.290907 write 0x01f95b thru 0x02d0b3 (0xd759 bytes) 000498 1781234494.301340 write 0x025b46 thru 0x031a92 (0xbf4d bytes) 000499 1781234494.303479 mapread 0x033ca0 thru 0x03db2f (0x9e90 bytes) 000500 1781234494.305098 punch from 0x034b13 to 0x03acb2 (0x61a0 bytes) 000501 1781234494.310230 punch from 0x032de5 to 0x03624e (0x346a bytes) 000502 1781234494.314829 mapread 0x01ca83 thru 0x01f0e2 (0x2660 bytes) 000503 1781234494.333126 MIRROR_RESYNC 2 mirrors 000504 1781234494.828509 mapwrite 0x02abf8 thru 0x03886d (0xdc76 bytes) 000505 1781234494.923529 mapread 0x0320d4 thru 0x03db2f (0xba5c bytes) 000506 1781234494.929527 trunc from 0x013d5d to 0x01d662 (0x9906 bytes) 000507 1781234494.934991 trunc from 0x03db30 to 0x02f972 (0xe1bd bytes) 000508 1781234494.973456 punch from 0x01053b to 0x01a502 (0x9fc8 bytes) 000509 1781234494.978921 fallocate 0x033eed thru 0x039f52 (0x6066 bytes) 000510 1781234494.984275 mapwrite 0x01ff43 thru 0x021a48 (0x1b06 bytes) 000511 1781234495.005802 punch from 0x0218d8 to 0x025796 (0x3ebf bytes) 000512 1781234495.010091 fallocate 0x00d1ca thru 0x00e65f (0x1496 bytes) 000513 1781234495.014556 read 0x001a2a thru 0x008614 (0x6beb bytes) 000514 1781234495.023920 punch from 0x02281c to 0x028b04 (0x62e9 bytes) 000515 1781234495.029210 read 0x011b93 thru 0x014a9b (0x2f09 bytes) 000516 1781234495.039255 write 0x013c12 thru 0x01fdd8 (0xc1c7 bytes) 000517 1781234495.041308 mapread 0x012dee thru 0x0204d7 (0xd6ea bytes) 000518 1781234495.042853 trunc from 0x039f53 to 0x039fbc (0x6a bytes) 000519 1781234495.061339 MIRROR_RESYNC 2 mirrors 000520 1781234495.607486 write 0x03e5b7 thru 0x03ffff (0x1a49 bytes) 000521 1781234495.638568 punch from 0x022845 to 0x02348e (0xc4a bytes) 000522 1781234495.643661 read 0x038138 thru 0x03990d (0x17d6 bytes) 000523 1781234495.654765 MIRROR_RESYNC 2 mirrors 000524 1781234496.346080 mapread 0x01df20 thru 0x02534f (0x7430 bytes) 000525 1781234496.373547 write 0x009891 thru 0x016170 (0xc8e0 bytes) 000526 1781234496.478129 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xaeb3e8f5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4ad17347 Mirror 4: 0x4ad17347 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000528 1781234497.445471 mapread 0x0219fe thru 0x029fa3 (0x85a6 bytes) 000529 1781234497.468691 read 0x01d56a thru 0x02a257 (0xccee bytes) 000530 1781234497.469545 mapwrite 0x03c53f thru 0x03ffff (0x3ac1 bytes) 000531 1781234497.575319 read 0x003d45 thru 0x00efe4 (0xb2a0 bytes) 000532 1781234497.584920 read 0x02c06f thru 0x0326d9 (0x666b bytes) 000533 1781234497.585877 trunc from 0x01b707 to 0x028035 (0xc92f bytes) 000534 1781234497.607971 MIRROR_RESYNC 3 mirrors 000535 1781234498.606913 trunc from 0x040000 to 0x03161a (0xe9e5 bytes) 000536 1781234498.674852 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3161b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3161b): Mirror 3: 0xfd999c00 (stale) Mirror 4: 0xfd999c00 (stale) CRC-32 checksum value for chunk [0, 0x3161b): Mirror 1: 0xfd999c00 Mirror 5: 0xfd999c00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3161b: skipped 000537 1781234499.878833 mapread 0x002fd8 thru 0x00c506 (0x952f bytes) 000538 1781234499.920883 mapwrite 0x01eed1 thru 0x029d61 (0xae91 bytes) 000539 1781234500.068552 trunc from 0x02d6d2 to 0x03161a (0x3f49 bytes) 000540 1781234500.097870 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3161b): Mirror 3: 0xfd999c00 (stale) Mirror 4: 0xfd999c00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3161b): Mirror 3: 0xfd999c00 (stale) Mirror 4: 0xfd999c00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3161b: skipped 000541 1781234500.372480 mapwrite 0x014da6 thru 0x01ec97 (0x9ef2 bytes) 000542 1781234500.414368 trunc from 0x000fc7 to 0x003473 (0x24ad bytes) 000543 1781234500.418557 mapwrite 0x005998 thru 0x013e4f (0xe4b8 bytes) 000544 1781234500.450336 read 0x01714e thru 0x022acc (0xb97f bytes) 000545 1781234500.456202 trunc from 0x03161b to 0x03fa6f (0xe455 bytes) 000546 1781234500.497980 trunc from 0x03fa70 to 0x00b93e (0x34131 bytes) 000547 1781234500.533904 MIRROR_RESYNC 3 mirrors 000548 1781234501.069507 mapwrite 0x00d369 thru 0x01d2d6 (0xff6e bytes) 000550 1781234501.236868 read 0x00b5dd thru 0x013e64 (0x8888 bytes) 000551 1781234501.237971 read 0x009154 thru 0x017974 (0xe821 bytes) 000554 1781234501.247356 MIRROR_RESYNC 3 mirrors 000556 1781234501.930347 mapwrite 0x036c67 thru 0x03bb89 (0x4f23 bytes) 000557 1781234502.052581 trunc from 0x03bb8a to 0x01490f (0x2727a bytes) 000559 1781234502.088317 mapwrite 0x03e276 thru 0x03ffff (0x1d8a bytes) 000560 1781234502.172351 MIRROR_RESYNC 3 mirrors 000561 1781234503.001551 fallocate 0x00847c thru 0x00a86f (0x23f4 bytes) 000562 1781234503.035555 trunc from 0x040000 to 0x02a276 (0x15d89 bytes) 000563 1781234503.066744 write 0x025727 thru 0x029e0b (0x46e5 bytes) 000564 1781234503.074520 punch from 0x014241 to 0x020259 (0xc019 bytes) 000565 1781234503.079870 write 0x023080 thru 0x030ac8 (0xda49 bytes) 000566 1781234503.089484 trunc from 0x000010 to 0x00fcb5 (0xfca6 bytes) 000567 1781234503.094422 mapread 0x011b9d thru 0x01bdda (0xa23e bytes) 000568 1781234503.109578 read 0x01ec7a thru 0x02a871 (0xbbf8 bytes) 000569 1781234503.110746 fallocate 0x0162de thru 0x0174ee (0x1211 bytes) 000570 1781234503.118885 fallocate 0x03ad61 thru 0x03ffff (0x529f bytes) 000571 1781234503.124026 fallocate 0x0066aa thru 0x00c18c (0x5ae3 bytes) 000572 1781234503.128854 write 0x014865 thru 0x022092 (0xd82e bytes) 000573 1781234503.131356 fallocate 0x00a711 thru 0x00b377 (0xc67 bytes) 000574 1781234503.140476 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30ac9): Mirror 4: 0x1b3584a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ac9): Mirror 4: 0x1b3584a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ac9: skipped 000575 1781234503.578463 punch from 0x01f117 to 0x026214 (0x70fe bytes) 000576 1781234503.600351 MIRROR_RESYNC 2 mirrors 000577 1781234504.411234 trunc from 0x00b56d to 0x00e918 (0x33ac bytes) 000578 1781234504.463554 read 0x003cc0 thru 0x0137de (0xfb1f bytes) 000580 1781234504.486729 mapread 0x010ea4 thru 0x01ce04 (0xbf61 bytes) 000581 1781234504.533504 trunc from 0x030ac9 to 0x007cf8 (0x28dd0 bytes) 000582 1781234504.578356 write 0x0129b5 thru 0x018b47 (0x6193 bytes) 000583 1781234504.580344 mapread 0x00ed9a thru 0x01056e (0x17d5 bytes) 000584 1781234504.598135 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x18b48): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18b48): Mirror 4: 0xa8ce2097 (stale) CRC-32 checksum value for chunk [0, 0x18b48): Mirror 1: 0xa8fe23a2 Mirror 5: 0xa8fe23a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18b48: skipped 000585 1781234505.705014 punch from 0x0093b0 to 0x00e124 (0x4d75 bytes) 000586 1781234505.774309 read 0x00818c thru 0x016951 (0xe7c6 bytes) 000587 1781234505.785953 trunc from 0x018b48 to 0x02c4f8 (0x139b1 bytes) 000588 1781234505.809216 mapread 0x00dfb5 thru 0x0172e3 (0x932f bytes) 000589 1781234505.816728 mapread 0x02458f thru 0x02ad1e (0x6790 bytes) 000590 1781234505.831184 mapwrite 0x03839c thru 0x03ffff (0x7c64 bytes) 000591 1781234505.879381 MIRROR_RESYNC 3 mirrors 000592 1781234506.757376 punch from 0x007cb4 to 0x00c0ce (0x441b bytes) 000593 1781234506.814891 write 0x03c6cf thru 0x03ffff (0x3931 bytes) 000595 1781234506.830409 read 0x037683 thru 0x038116 (0xa94 bytes) 000596 1781234506.837308 write 0x00dbc8 thru 0x016475 (0x88ae bytes) 000597 1781234506.849546 trunc from 0x031738 to 0x036f90 (0x5859 bytes) 000598 1781234506.856417 trunc from 0x03a133 to 0x03ffff (0x5ecd bytes) 000599 1781234506.878873 punch from 0x0006a7 to 0x00a37f (0x9cd9 bytes) 000600 1781234506.884154 mapread 0x03459b thru 0x03dc64 (0x96ca bytes) 000601 1781234506.899299 mapwrite 0x00b6f6 thru 0x0170e0 (0xb9eb bytes) 000602 1781234506.942185 read 0x03c5d1 thru 0x03ffff (0x3a2f bytes) 000603 1781234506.943475 mapread 0x017019 thru 0x017f51 (0xf39 bytes) 000605 1781234506.946701 punch from 0x0323ad to 0x03fbbe (0xd812 bytes) 000606 1781234506.953760 mapread 0x0004dd thru 0x000cf8 (0x81c bytes) 000607 1781234506.965395 mapread 0x038d20 thru 0x03b623 (0x2904 bytes) 000609 1781234506.969208 mapread 0x032f8a thru 0x03baec (0x8b63 bytes) 000610 1781234506.973539 punch from 0x039180 to 0x03dea9 (0x4d2a bytes) 000611 1781234506.979414 write 0x0232fc thru 0x02aa00 (0x7705 bytes) 000612 1781234506.981446 mapread 0x000f52 thru 0x00408f (0x313e bytes) 000613 1781234506.983347 trunc from 0x02130c to 0x02ab81 (0x9876 bytes) 000614 1781234507.005128 punch from 0x01c229 to 0x01d177 (0xf4f bytes) 000615 1781234507.009340 trunc from 0x033fc3 to 0x039cda (0x5d18 bytes) 000617 1781234507.020614 write 0x036b88 thru 0x03ffff (0x9478 bytes) 000618 1781234507.034869 mapwrite 0x032b35 thru 0x03d140 (0xa60c bytes) 000619 1781234507.085187 punch from 0x00c37b to 0x013bb8 (0x783e bytes) 000620 1781234507.092357 read 0x011ca2 thru 0x02014c (0xe4ab bytes) 000621 1781234507.107155 read 0x028204 thru 0x03569b (0xd498 bytes) 000622 1781234507.108239 trunc from 0x040000 to 0x0354d8 (0xab27 bytes) 000623 1781234507.152467 fallocate 0x03ec50 thru 0x03ffff (0x13b0 bytes) 000624 1781234507.161835 read 0x01fea2 thru 0x026a43 (0x6ba2 bytes) 000625 1781234507.162982 trunc from 0x040000 to 0x03f68e (0x971 bytes) 000627 1781234507.181205 fallocate 0x014360 thru 0x01502c (0xccd bytes) 000628 1781234507.186223 read 0x02d94f thru 0x033fd9 (0x668b bytes) 000630 1781234507.188412 punch from 0x027ff3 to 0x031642 (0x9650 bytes) 000631 1781234507.193065 read 0x0225fb thru 0x02dc91 (0xb697 bytes) 000632 1781234507.202545 punch from 0x0105b5 to 0x01b7f4 (0xb240 bytes) 000633 1781234507.207658 trunc from 0x03f68f to 0x022572 (0x1d11c bytes) 000636 1781234507.225054 mapread 0x01280b thru 0x017381 (0x4b77 bytes) 000637 1781234507.253597 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22573): Mirror 5: 0xb9951d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22573): Mirror 5: 0xb9951d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22573: skipped 000638 1781234507.537536 mapread 0x01452b thru 0x01a5fd (0x60d3 bytes) 000639 1781234507.559973 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x22573): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22573): Mirror 5: 0xb9951d7 (stale) CRC-32 checksum value for chunk [0, 0x22573): Mirror 1: 0xf7f96880 Mirror 6: 0xf7f96880 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22573: skipped 000642 1781234508.206192 trunc from 0x022573 to 0x036313 (0x13da1 bytes) 000643 1781234508.272802 punch from 0x0041a7 to 0x0114ca (0xd324 bytes) 000644 1781234508.280661 mapread 0x00b988 thru 0x0183d9 (0xca52 bytes) 000645 1781234508.309128 trunc from 0x033494 to 0x036313 (0x2e80 bytes) 000646 1781234508.319764 MIRROR_RESYNC 3 mirrors 000647 1781234508.937247 mapread 0x02fe14 thru 0x036313 (0x6500 bytes) 000649 1781234508.971340 read 0x02e5a6 thru 0x0335e9 (0x5044 bytes) 000650 1781234508.971967 mapread 0x033329 thru 0x036313 (0x2feb bytes) 000651 1781234508.973251 trunc from 0x036314 to 0x00d5f9 (0x28d1a bytes) 000652 1781234509.038819 punch from 0x006fe9 to 0x00d5f9 (0x6611 bytes) 000653 1781234509.042987 write 0x02984f thru 0x0345cd (0xad7f bytes) 000654 1781234509.044597 read 0x030f19 thru 0x0345cd (0x36b5 bytes) 000655 1781234509.046000 punch from 0x01a394 to 0x02732a (0xcf97 bytes) 000657 1781234509.049478 mapread 0x029486 thru 0x02bf95 (0x2b10 bytes) 000658 1781234509.050392 fallocate 0x02a509 thru 0x03363c (0x9134 bytes) 000659 1781234509.056752 trunc from 0x0345ce to 0x01dd21 (0x168ac bytes) 000660 1781234509.085572 punch from 0x005b5d to 0x00faf2 (0x9f96 bytes) 000661 1781234509.091727 write 0x0138dd thru 0x01c95c (0x9080 bytes) 000662 1781234509.109458 read 0x01b78a thru 0x01dd21 (0x2598 bytes) 000663 1781234509.110319 mapread 0x0033c5 thru 0x009b0b (0x6747 bytes) 000664 1781234509.115363 trunc from 0x01dd22 to 0x03bb43 (0x1de22 bytes) 000665 1781234509.149276 trunc from 0x00182f to 0x005dc8 (0x459a bytes) 000666 1781234509.168315 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bb44): Mirror 6: 0x9a62e696 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb44): Mirror 6: 0x9a62e696 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb44: skipped 000667 1781234509.751524 punch from 0x03a307 to 0x03bb43 (0x183d bytes) 000668 1781234509.757859 trunc from 0x015cc1 to 0x020746 (0xaa86 bytes) 000669 1781234509.764740 fallocate 0x00ec2b thru 0x013116 (0x44ec bytes) 000670 1781234509.770241 write 0x01aa25 thru 0x01e010 (0x35ec bytes) 000671 1781234509.787488 mapread 0x034c1d thru 0x03bb43 (0x6f27 bytes) 000672 1781234509.800293 read 0x016859 thru 0x01eec2 (0x866a bytes) 000673 1781234509.815785 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bb44): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb44): Mirror 6: 0x9a62e696 (stale) CRC-32 checksum value for chunk [0, 0x3bb44): Mirror 1: 0x5380b6d Mirror 7: 0x5380b6d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb44: skipped 000674 1781234510.598796 write 0x019ff0 thru 0x021b8e (0x7b9f bytes) 000675 1781234510.656750 write 0x028191 thru 0x031367 (0x91d7 bytes) 000676 1781234510.674960 fallocate 0x007690 thru 0x0141b3 (0xcb24 bytes) 000677 1781234510.681406 mapwrite 0x01cc7c thru 0x0222bd (0x5642 bytes) 000678 1781234510.708211 trunc from 0x03bb44 to 0x01eec7 (0x1cc7c bytes) 000679 1781234510.729288 write 0x021798 thru 0x02f2b2 (0xdb1b bytes) 000680 1781234510.732203 punch from 0x01b64e to 0x02334b (0x7cfe bytes) 000681 1781234510.749886 mapread 0x011515 thru 0x016c90 (0x577c bytes) 000682 1781234510.761393 read 0x02621f thru 0x0273ac (0x118e bytes) 000683 1781234510.762265 read 0x018c79 thru 0x01c608 (0x3990 bytes) 000684 1781234510.772440 write 0x036b80 thru 0x037b9e (0x101f bytes) 000685 1781234510.774932 fallocate 0x032063 thru 0x03855e (0x64fc bytes) 000686 1781234510.782743 fallocate 0x036c0a thru 0x03e3a6 (0x779d bytes) 000687 1781234510.788376 fallocate 0x014caf thru 0x01ff17 (0xb269 bytes) 000688 1781234510.794275 trunc from 0x037b9f to 0x02ae43 (0xcd5b bytes) 000689 1781234510.811679 mapwrite 0x00c99e thru 0x0146cc (0x7d2f bytes) 000690 1781234510.834959 write 0x029f3d thru 0x032f4d (0x9011 bytes) 000691 1781234510.836889 mapwrite 0x00b253 thru 0x01710d (0xbebb bytes) 000692 1781234510.863211 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32f4e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32f4e): Mirror 6: 0x278bf902 (stale) Mirror 7: 0xea0bacf6 (stale) CRC-32 checksum value for chunk [0, 0x32f4e): Mirror 1: 0x854608b9 Mirror 8: 0x854608b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32f4e: skipped 000693 1781234511.697313 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x32f4e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32f4e): Mirror 6: 0x278bf902 (stale) Mirror 7: 0xea0bacf6 (stale) CRC-32 checksum value for chunk [0, 0x32f4e): Mirror 1: 0x854608b9 Mirror 8: 0x854608b9 Mirror 9: 0x854608b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32f4e: skipped 000694 1781234512.602661 trunc from 0x032f4e to 0x01acb0 (0x1829d bytes) 000695 1781234512.694661 read 0x01a889 thru 0x01acb0 (0x428 bytes) 000696 1781234512.702516 mapwrite 0x00f601 thru 0x016c30 (0x7630 bytes) 000697 1781234512.761850 fallocate 0x032b3a thru 0x03ef93 (0xc45a bytes) 000699 1781234512.771738 mapread 0x00bb85 thru 0x010e46 (0x52c2 bytes) 000700 1781234512.774263 write 0x023e2f thru 0x024532 (0x704 bytes) 000701 1781234512.785337 write 0x01b411 thru 0x029f5c (0xeb4c bytes) 000702 1781234512.791947 trunc from 0x00bb1b to 0x01935c (0xd842 bytes) 000703 1781234512.799822 mapread 0x009dd5 thru 0x010d78 (0x6fa4 bytes) 000704 1781234512.816269 trunc from 0x03ef94 to 0x00e450 (0x30b43 bytes) 000705 1781234512.839096 trunc from 0x0083a3 to 0x00ab98 (0x27f6 bytes) 000706 1781234512.844382 fallocate 0x0090b9 thru 0x011548 (0x8490 bytes) 000707 1781234512.849697 mapwrite 0x02b04d thru 0x02c904 (0x18b8 bytes) 000708 1781234512.896258 fallocate 0x026640 thru 0x0333e4 (0xcda5 bytes) 000709 1781234512.901846 mapread 0x011964 thru 0x01d665 (0xbd02 bytes) 000710 1781234512.932685 mapwrite 0x039c24 thru 0x03ffff (0x63dc bytes) 000711 1781234512.997370 write 0x01d2e1 thru 0x02279b (0x54bb bytes) 000712 1781234513.009057 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe20eea22 (stale) Mirror 7: 0x77c3ceec (stale) Mirror 8: 0x15fa9507 (stale) Mirror 9: 0x15fa9507 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x64d6a32b Mirror 10: 0x64d6a32b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000713 1781234514.874200 mapwrite 0x032c93 thru 0x03eeda (0xc248 bytes) 000714 1781234515.037167 fallocate 0x018f7c thru 0x0218fd (0x8982 bytes) 000715 1781234515.044171 read 0x0116f6 thru 0x01fe86 (0xe791 bytes) 000716 1781234515.059408 fallocate 0x026db3 thru 0x02929d (0x24eb bytes) 000717 1781234515.070424 punch from 0x00289c to 0x00f754 (0xceb9 bytes) 000718 1781234515.085871 read 0x00b679 thru 0x013582 (0x7f0a bytes) 000721 1781234515.120010 read 0x020ebd thru 0x022087 (0x11cb bytes) 000722 1781234515.120781 trunc from 0x040000 to 0x0075bb (0x38a44 bytes) 000723 1781234515.184977 fallocate 0x026e53 thru 0x03197b (0xab29 bytes) 000724 1781234515.200304 fallocate 0x033c86 thru 0x0391e3 (0x555e bytes) 000725 1781234515.221198 read 0x01380b thru 0x0169e5 (0x31db bytes) 000726 1781234515.243066 mapread 0x029f2b thru 0x03197b (0x7a51 bytes) 000727 1781234515.247162 punch from 0x0279fb to 0x02c783 (0x4d89 bytes) 000728 1781234515.266550 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3197c): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3197c): Mirror 6: 0x14f3cf92 (stale) Mirror 7: 0xf7f4e3a (stale) Mirror 8: 0xc19cfe4 (stale) Mirror 9: 0xc19cfe4 (stale) Mirror 10: 0xe577c598 (stale) CRC-32 checksum value for chunk [0, 0x3197c): Mirror 1: 0x14f3cf92 Mirror 11: 0x14f3cf92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3197c: skipped 000729 1781234516.426378 fallocate 0x010b53 thru 0x019a63 (0x8f11 bytes) 000730 1781234516.494211 trunc from 0x02d748 to 0x03197b (0x4234 bytes) 000731 1781234516.501604 trunc from 0x03197c to 0x022091 (0xf8ea bytes) 000732 1781234516.601072 fallocate 0x03970f thru 0x03bdef (0x26e1 bytes) 000733 1781234516.609347 mapwrite 0x015edd thru 0x01a318 (0x443c bytes) 000734 1781234516.667037 write 0x005ae6 thru 0x012ad3 (0xcfee bytes) 000735 1781234516.693736 MIRROR_RESYNC 7 mirrors 000736 1781234518.325055 mapwrite 0x007c7a thru 0x00c729 (0x4ab0 bytes) 000737 1781234518.434429 write 0x02f4ac thru 0x03aab1 (0xb606 bytes) 000738 1781234518.446751 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3aab2): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aab2): Mirror 6: 0x62d3d2ff (stale) Mirror 7: 0x62d3d2ff (stale) Mirror 8: 0x62d3d2ff (stale) Mirror 9: 0x62d3d2ff (stale) Mirror 10: 0x62d3d2ff (stale) Mirror 11: 0x62d3d2ff (stale) CRC-32 checksum value for chunk [0, 0x3aab2): Mirror 1: 0x2cf45d46 Mirror 12: 0x2cf45d46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aab2: skipped 000739 1781234519.303456 read 0x02405f thru 0x02b6b7 (0x7659 bytes) 000740 1781234519.317111 mapread 0x002d61 thru 0x006ce4 (0x3f84 bytes) 000741 1781234519.342367 mapwrite 0x03abb0 thru 0x03ffff (0x5450 bytes) 000742 1781234519.446406 mapread 0x03f771 thru 0x03ffff (0x88f bytes) 000743 1781234519.451419 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc519a66a (stale) Mirror 7: 0xc519a66a (stale) Mirror 8: 0xc519a66a (stale) Mirror 9: 0xc519a66a (stale) Mirror 10: 0xc519a66a (stale) Mirror 11: 0xc519a66a (stale) Mirror 12: 0x29835274 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8d84677a Mirror 13: 0x8d84677a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000744 1781234520.213996 punch from 0x02f4e6 to 0x035441 (0x5f5c bytes) 000745 1781234520.264731 MIRROR_RESYNC 9 mirrors 000746 1781234522.356398 trunc from 0x03947e to 0x03ffff (0x6b82 bytes) 000747 1781234522.403662 mapread 0x036bf3 thru 0x03ffff (0x940d bytes) 000749 1781234522.422953 read 0x0050b6 thru 0x00de6c (0x8db7 bytes) 000750 1781234522.432335 write 0x02b85a thru 0x034679 (0x8e20 bytes) 000751 1781234522.440510 trunc from 0x02778f to 0x030f50 (0x97c2 bytes) 000753 1781234522.454315 read 0x03fc16 thru 0x03ffff (0x3ea bytes) 000754 1781234522.455168 read 0x009e47 thru 0x013e24 (0x9fde bytes) 000755 1781234522.482730 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x791ee136 (stale) Mirror 7: 0x791ee136 (stale) Mirror 8: 0x791ee136 (stale) Mirror 9: 0x791ee136 (stale) Mirror 10: 0x791ee136 (stale) Mirror 11: 0x791ee136 (stale) Mirror 12: 0x791ee136 (stale) Mirror 13: 0x791ee136 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5840c3bb Mirror 14: 0x5840c3bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000756 1781234523.400394 fallocate 0x026085 thru 0x02eb39 (0x8ab5 bytes) 000757 1781234523.444691 trunc from 0x00e04d to 0x01d7fe (0xf7b2 bytes) 000758 1781234523.451388 punch from 0x03065c to 0x0318d6 (0x127b bytes) 000759 1781234523.456273 trunc from 0x040000 to 0x035081 (0xaf7e bytes) 000761 1781234523.515553 trunc from 0x02b8cc to 0x031743 (0x5e78 bytes) 000762 1781234523.521296 trunc from 0x02be1a to 0x0346e5 (0x88cc bytes) 000763 1781234523.527158 trunc from 0x0113f5 to 0x01e657 (0xd263 bytes) 000764 1781234523.531533 write 0x03fecc thru 0x03ffff (0x134 bytes) 000765 1781234523.537543 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x791ee136 (stale) Mirror 8: 0x791ee136 (stale) Mirror 9: 0x791ee136 (stale) Mirror 10: 0x791ee136 (stale) Mirror 11: 0x791ee136 (stale) Mirror 12: 0x791ee136 (stale) Mirror 13: 0x791ee136 (stale) Mirror 14: 0x5840c3bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x791ee136 (stale) Mirror 8: 0x791ee136 (stale) Mirror 9: 0x791ee136 (stale) Mirror 10: 0x791ee136 (stale) Mirror 11: 0x791ee136 (stale) Mirror 12: 0x791ee136 (stale) Mirror 13: 0x791ee136 (stale) Mirror 14: 0x5840c3bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000766 1781234524.111078 read 0x01cf68 thru 0x027337 (0xa3d0 bytes) 000767 1781234524.128612 trunc from 0x01c4d1 to 0x01c62a (0x15a bytes) 000768 1781234524.135758 punch from 0x00d962 to 0x00f2b7 (0x1956 bytes) 000769 1781234524.147337 trunc from 0x040000 to 0x0282e3 (0x17d1c bytes) 000770 1781234524.176754 trunc from 0x002809 to 0x00d589 (0xad81 bytes) 000771 1781234524.184696 trunc from 0x0282e4 to 0x02f27f (0x6f9c bytes) 000772 1781234524.224082 fallocate 0x038800 thru 0x038c68 (0x469 bytes) 000773 1781234524.243397 punch from 0x006eb5 to 0x012a7f (0xbbcb bytes) 000774 1781234524.261683 trunc from 0x021550 to 0x02e545 (0xcff6 bytes) 000775 1781234524.276860 mapread 0x0197e6 thru 0x01e3e4 (0x4bff bytes) 000776 1781234524.330788 trunc from 0x0261f0 to 0x02f27f (0x9090 bytes) 000777 1781234524.344099 trunc from 0x02f280 to 0x006c8e (0x285f1 bytes) 000778 1781234524.371684 write 0x025dc7 thru 0x02bdd9 (0x6013 bytes) 000779 1781234524.373155 trunc from 0x02bdda to 0x00f038 (0x1cda1 bytes) 000780 1781234524.418570 read 0x00012c thru 0x009ae7 (0x99bc bytes) 000781 1781234524.437928 MIRROR_RESYNC 9 mirrors 000782 1781234525.599902 fallocate 0x022969 thru 0x026362 (0x39fa bytes) 000783 1781234525.648904 write 0x002467 thru 0x010a61 (0xe5fb bytes) 000784 1781234525.655610 mapwrite 0x01b91c thru 0x01b9a5 (0x8a bytes) 000785 1781234525.717255 fallocate 0x030580 thru 0x03a32d (0x9dae bytes) 000786 1781234525.722415 fallocate 0x02786e thru 0x034b41 (0xd2d4 bytes) 000787 1781234525.728062 mapread 0x0290ca thru 0x0296a3 (0x5da bytes) 000788 1781234525.743269 fallocate 0x03b2d2 thru 0x03ffff (0x4d2e bytes) 000789 1781234525.749286 read 0x0203de thru 0x02bdea (0xba0d bytes) 000790 1781234525.754524 fallocate 0x000d01 thru 0x00a504 (0x9804 bytes) 000791 1781234525.758700 read 0x002058 thru 0x00e8e8 (0xc891 bytes) 000792 1781234525.759184 punch from 0x02e333 to 0x0363bd (0x808b bytes) 000793 1781234525.762885 trunc from 0x040000 to 0x0330e3 (0xcf1c bytes) 000794 1781234525.785302 MIRROR_RESYNC 9 mirrors 000795 1781234527.384115 trunc from 0x0330e4 to 0x014d6b (0x1e378 bytes) 000796 1781234527.446545 MIRROR_RESYNC 9 mirrors 000797 1781234528.962086 trunc from 0x014d6c to 0x029658 (0x148ed bytes) 000798 1781234529.006538 read 0x028f27 thru 0x029658 (0x732 bytes) 000800 1781234529.011831 mapread 0x01fb6f thru 0x02537b (0x580d bytes) 000801 1781234529.028537 fallocate 0x02c739 thru 0x03561d (0x8ee5 bytes) 000802 1781234529.033013 punch from 0x028ef9 to 0x02e861 (0x5969 bytes) 000804 1781234529.038253 write 0x030281 thru 0x03cb4e (0xc8ce bytes) 000806 1781234529.049265 read 0x0371c9 thru 0x03b201 (0x4039 bytes) 000807 1781234529.050338 mapread 0x00af0f thru 0x00d843 (0x2935 bytes) 000808 1781234529.060382 mapwrite 0x028df4 thru 0x032f33 (0xa140 bytes) 000809 1781234529.078230 trunc from 0x01706a to 0x01ae62 (0x3df9 bytes) 000810 1781234529.083916 punch from 0x02a0f2 to 0x02c32c (0x223b bytes) 000811 1781234529.088468 punch from 0x01e165 to 0x021ef4 (0x3d90 bytes) 000812 1781234529.092908 trunc from 0x03cb4f to 0x02ff72 (0xcbdc bytes) 000813 1781234529.117320 fallocate 0x019568 thru 0x022bda (0x9673 bytes) 000814 1781234529.124076 mapread 0x00e0c2 thru 0x019658 (0xb597 bytes) 000815 1781234529.138075 punch from 0x02cd36 to 0x02ff72 (0x323d bytes) 000816 1781234529.142799 fallocate 0x019723 thru 0x019d0e (0x5ec bytes) 000817 1781234529.147535 fallocate 0x020cb3 thru 0x0231f1 (0x253f bytes) 000818 1781234529.152207 punch from 0x000b35 to 0x001092 (0x55e bytes) 000820 1781234529.157461 read 0x009c16 thru 0x010e2f (0x721a bytes) 000821 1781234529.158244 punch from 0x00929e to 0x00cbe6 (0x3949 bytes) 000822 1781234529.163806 mapread 0x018a7e thru 0x027f21 (0xf4a4 bytes) 000823 1781234529.175214 trunc from 0x020d45 to 0x02e33f (0xd5fb bytes) 000824 1781234529.180268 fallocate 0x033ce9 thru 0x03b2e5 (0x75fd bytes) 000825 1781234529.185087 fallocate 0x0027d9 thru 0x01249a (0xfcc2 bytes) 000827 1781234529.192201 fallocate 0x028d11 thru 0x02fcd3 (0x6fc3 bytes) 000828 1781234529.197899 fallocate 0x005579 thru 0x011af5 (0xc57d bytes) 000830 1781234529.205518 trunc from 0x015536 to 0x0226d2 (0xd19d bytes) 000831 1781234529.211205 read 0x02c317 thru 0x03a91b (0xe605 bytes) 000832 1781234529.221482 trunc from 0x02a2c5 to 0x02ee69 (0x4ba5 bytes) 000833 1781234529.230265 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b2e6): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2e6): Mirror 7: 0x80f21a07 (stale) Mirror 8: 0x80f21a07 (stale) Mirror 9: 0x80f21a07 (stale) Mirror 10: 0x80f21a07 (stale) Mirror 11: 0x80f21a07 (stale) Mirror 12: 0x80f21a07 (stale) Mirror 13: 0x80f21a07 (stale) Mirror 14: 0x80f21a07 (stale) CRC-32 checksum value for chunk [0, 0x3b2e6): Mirror 1: 0x892921a8 Mirror 15: 0x892921a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2e6: skipped 000835 1781234530.040303 mapread 0x021733 thru 0x02a8fe (0x91cc bytes) 000836 1781234530.069907 write 0x02830e thru 0x02dfc6 (0x5cb9 bytes) 000838 1781234530.129733 mapwrite 0x03eb53 thru 0x03ffff (0x14ad bytes) 000839 1781234530.199454 trunc from 0x00f78c to 0x01a70a (0xaf7f bytes) 000841 1781234530.206847 write 0x036c49 thru 0x03c1c8 (0x5580 bytes) 000842 1781234530.217596 write 0x012f3c thru 0x022299 (0xf35e bytes) 000843 1781234530.226278 mapwrite 0x033d01 thru 0x03ffff (0xc2ff bytes) 000844 1781234530.244438 read 0x017181 thru 0x0219a3 (0xa823 bytes) 000845 1781234530.245307 mapread 0x001573 thru 0x0057d5 (0x4263 bytes) 000847 1781234530.256065 read 0x03c4da thru 0x03ffff (0x3b26 bytes) 000848 1781234530.260076 MIRROR_RESYNC 10 mirrors 000849 1781234533.026197 MIRROR_EXTEND to 11 mirrors 000850 1781234534.033222 fallocate 0x0044f1 thru 0x00b1c7 (0x6cd7 bytes) 000851 1781234534.087391 read 0x019dd7 thru 0x01bf10 (0x213a bytes) 000852 1781234534.096563 read 0x03112b thru 0x03de86 (0xcd5c bytes) 000853 1781234534.120336 punch from 0x036b47 to 0x03ffff (0x94b9 bytes) 000854 1781234534.125967 read 0x011753 thru 0x019077 (0x7925 bytes) 000855 1781234534.127471 mapwrite 0x0195e2 thru 0x01fcaf (0x66ce bytes) 000856 1781234534.144932 trunc from 0x0195d0 to 0x01da54 (0x4485 bytes) 000857 1781234534.150125 fallocate 0x015d18 thru 0x022e93 (0xd17c bytes) 000858 1781234534.155522 read 0x03feaa thru 0x03ffff (0x156 bytes) 000859 1781234534.167589 fallocate 0x014c1f thru 0x01c32d (0x770f bytes) 000860 1781234534.185791 read 0x031771 thru 0x03a7fa (0x908a bytes) 000861 1781234534.186761 punch from 0x01d048 to 0x020cb3 (0x3c6c bytes) 000862 1781234534.192609 fallocate 0x0182cd thru 0x01c376 (0x40aa bytes) 000863 1781234534.198887 mapwrite 0x035e7d thru 0x03b299 (0x541d bytes) 000864 1781234534.229002 trunc from 0x022ccc to 0x02e94f (0xbc84 bytes) 000865 1781234534.237010 write 0x017435 thru 0x0273cf (0xff9b bytes) 000866 1781234534.251068 mapwrite 0x00815e thru 0x00c3ee (0x4291 bytes) 000868 1781234534.272470 punch from 0x02af09 to 0x038c06 (0xdcfe bytes) 000869 1781234534.279855 read 0x009b01 thru 0x00b4fc (0x19fc bytes) 000870 1781234534.281120 fallocate 0x02fe26 thru 0x031b5e (0x1d39 bytes) 000871 1781234534.287026 trunc from 0x0303d3 to 0x03d542 (0xd170 bytes) 000872 1781234534.292293 punch from 0x01c752 to 0x027be9 (0xb498 bytes) 000873 1781234534.298263 trunc from 0x040000 to 0x001fa7 (0x3e058 bytes) 000874 1781234534.324949 mapread 0x001969 thru 0x001fa7 (0x63f bytes) 000875 1781234534.328247 mapread 0x000ae1 thru 0x001fa7 (0x14c7 bytes) 000876 1781234534.329913 fallocate 0x01b3ad thru 0x01e2a8 (0x2efc bytes) 000877 1781234534.336012 write 0x019d30 thru 0x02923f (0xf510 bytes) 000878 1781234534.338449 mapread 0x011e00 thru 0x016cde (0x4edf bytes) 000879 1781234534.347172 mapread 0x01a535 thru 0x027b2d (0xd5f9 bytes) 000880 1781234534.349569 trunc from 0x025b42 to 0x02923f (0x36fe bytes) 000882 1781234534.362880 mapwrite 0x007c13 thru 0x008585 (0x973 bytes) 000883 1781234534.373863 read 0x008ed7 thru 0x00954e (0x678 bytes) 000884 1781234534.374599 mapread 0x023875 thru 0x02923f (0x59cb bytes) 000885 1781234534.384121 read 0x014d9d thru 0x022edc (0xe140 bytes) 000887 1781234534.385612 write 0x01ad89 thru 0x01e0cb (0x3343 bytes) 000888 1781234534.387015 read 0x0240e4 thru 0x028e27 (0x4d44 bytes) 000889 1781234534.387576 write 0x015c03 thru 0x0177bb (0x1bb9 bytes) 000890 1781234534.388856 mapread 0x00a373 thru 0x017bbf (0xd84d bytes) 000891 1781234534.390432 punch from 0x001d07 to 0x00cef2 (0xb1ec bytes) 000892 1781234534.399239 MIRROR_RESYNC 11 mirrors 000893 1781234536.781123 trunc from 0x00b35a to 0x00bfcc (0xc73 bytes) 000895 1781234536.831905 mapwrite 0x00f1d4 thru 0x012d3b (0x3b68 bytes) 000896 1781234536.869075 trunc from 0x00cc1b to 0x00d769 (0xb4f bytes) 000897 1781234536.874911 mapread 0x024c0e thru 0x027949 (0x2d3c bytes) 000898 1781234536.885255 trunc from 0x029240 to 0x02a92a (0x16eb bytes) 000899 1781234536.907615 trunc from 0x02a92b to 0x028503 (0x2427 bytes) 000900 1781234536.928004 mapwrite 0x03fcc8 thru 0x03ffff (0x338 bytes) 000901 1781234536.953967 trunc from 0x010a8a to 0x01210d (0x1684 bytes) 000902 1781234536.957602 write 0x01d414 thru 0x024cfa (0x78e7 bytes) 000903 1781234536.958981 trunc from 0x040000 to 0x01c994 (0x2366b bytes) 000904 1781234536.972180 fallocate 0x01d2ae thru 0x01e4ea (0x123d bytes) 000905 1781234536.975991 trunc from 0x01c995 to 0x03bd1b (0x1f387 bytes) 000906 1781234537.009483 punch from 0x009cd4 to 0x019483 (0xf7b0 bytes) 000907 1781234537.014413 write 0x0353a0 thru 0x03a25d (0x4ebe bytes) 000908 1781234537.029503 MIRROR_RESYNC 11 mirrors 000909 1781234539.370720 write 0x001cf2 thru 0x00791a (0x5c29 bytes) 000910 1781234539.430381 trunc from 0x005d6b to 0x00654a (0x7e0 bytes) 000911 1781234539.449353 trunc from 0x00735b to 0x00eb61 (0x7807 bytes) 000912 1781234539.454948 write 0x025e8f thru 0x029fdc (0x414e bytes) 000914 1781234539.464908 punch from 0x01e674 to 0x028064 (0x99f1 bytes) 000915 1781234539.478884 trunc from 0x02fe03 to 0x0332f6 (0x34f4 bytes) 000916 1781234539.484603 trunc from 0x03bd1c to 0x007f13 (0x33e08 bytes) 000917 1781234539.516522 punch from 0x0053fe to 0x005b8e (0x791 bytes) 000918 1781234539.522434 write 0x03a8c5 thru 0x03ffff (0x573b bytes) 000919 1781234539.523885 mapwrite 0x00ae79 thru 0x01980e (0xe996 bytes) 000920 1781234539.566387 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x17c0139 (stale) Mirror 9: 0x17c0139 (stale) Mirror 10: 0x17c0139 (stale) Mirror 11: 0x17c0139 (stale) Mirror 12: 0x17c0139 (stale) Mirror 13: 0x17c0139 (stale) Mirror 14: 0x17c0139 (stale) Mirror 15: 0x17c0139 (stale) Mirror 16: 0x17c0139 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x17c0139 (stale) Mirror 9: 0x17c0139 (stale) Mirror 10: 0x17c0139 (stale) Mirror 11: 0x17c0139 (stale) Mirror 12: 0x17c0139 (stale) Mirror 13: 0x17c0139 (stale) Mirror 14: 0x17c0139 (stale) Mirror 15: 0x17c0139 (stale) Mirror 16: 0x17c0139 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000921 1781234540.055170 mapwrite 0x0138a8 thru 0x022386 (0xeadf bytes) 000922 1781234540.108233 punch from 0x02625f to 0x02db14 (0x78b6 bytes) 000923 1781234540.114057 trunc from 0x00b4d4 to 0x00d064 (0x1b91 bytes) 000924 1781234540.121074 punch from 0x01a7e8 to 0x01b905 (0x111e bytes) 000925 1781234540.127946 read 0x02b193 thru 0x034c54 (0x9ac2 bytes) 000927 1781234540.142696 trunc from 0x040000 to 0x011bdd (0x2e422 bytes) 000929 1781234540.167041 mapwrite 0x02ebb8 thru 0x030a2e (0x1e77 bytes) 000930 1781234540.210859 read 0x00abd4 thru 0x00eed8 (0x4305 bytes) 000931 1781234540.221175 read 0x00a43a thru 0x00d74f (0x3316 bytes) 000932 1781234540.222349 trunc from 0x021798 to 0x02ce28 (0xb691 bytes) 000933 1781234540.227116 trunc from 0x014674 to 0x01b0aa (0x6a37 bytes) 000934 1781234540.232108 mapwrite 0x030809 thru 0x038806 (0x7ffe bytes) 000935 1781234540.283026 MIRROR_RESYNC 10 mirrors 000936 1781234542.971462 write 0x02fe21 thru 0x0365fc (0x67dc bytes) 000937 1781234543.051531 read 0x01b684 thru 0x025fdb (0xa958 bytes) 000938 1781234543.071563 trunc from 0x038807 to 0x0016ac (0x3715a bytes) 000940 1781234543.111841 punch from 0x000e68 to 0x0016ac (0x845 bytes) 000941 1781234543.121662 punch from 0x000996 to 0x0016ac (0xd17 bytes) 000942 1781234543.132250 trunc from 0x0000d8 to 0x0016ac (0x15d5 bytes) 000943 1781234543.140399 mapwrite 0x0000fa thru 0x002619 (0x2520 bytes) 000944 1781234543.217720 read 0x00186b thru 0x002619 (0xdaf bytes) 000945 1781234543.219588 trunc from 0x00261a to 0x025374 (0x22d5b bytes) 000946 1781234543.259795 mapwrite 0x001999 thru 0x002547 (0xbaf bytes) 000948 1781234543.290051 mapwrite 0x01091b thru 0x01ee3c (0xe522 bytes) 000949 1781234543.324378 trunc from 0x025375 to 0x014b46 (0x1082e bytes) 000950 1781234543.346108 trunc from 0x014b47 to 0x03ab10 (0x25fca bytes) 000951 1781234543.363174 mapread 0x039021 thru 0x039e63 (0xe43 bytes) 000952 1781234543.372412 punch from 0x0002d2 to 0x004122 (0x3e51 bytes) 000953 1781234543.378038 write 0x02ee3c thru 0x038f5f (0xa124 bytes) 000954 1781234543.384365 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ab11): Mirror 7: 0x63222b8b (stale) Mirror 9: 0x63222b8b (stale) Mirror 11: 0x63222b8b (stale) Mirror 12: 0x63222b8b (stale) Mirror 13: 0x63222b8b (stale) Mirror 14: 0x63222b8b (stale) Mirror 15: 0x63222b8b (stale) Mirror 16: 0x63222b8b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab11): Mirror 7: 0x63222b8b (stale) Mirror 9: 0x63222b8b (stale) Mirror 11: 0x63222b8b (stale) Mirror 12: 0x63222b8b (stale) Mirror 13: 0x63222b8b (stale) Mirror 14: 0x63222b8b (stale) Mirror 15: 0x63222b8b (stale) Mirror 16: 0x63222b8b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab11: skipped 000955 1781234544.236004 mapread 0x0319fb thru 0x03ab10 (0x9116 bytes) 000956 1781234544.258392 mapwrite 0x03a7e0 thru 0x03ffff (0x5820 bytes) 000957 1781234544.308888 punch from 0x01122b to 0x01fc7e (0xea54 bytes) 000958 1781234544.314531 trunc from 0x040000 to 0x00b566 (0x34a99 bytes) 000959 1781234544.333972 mapwrite 0x032c1d thru 0x036cd6 (0x40ba bytes) 000960 1781234544.379236 fallocate 0x00af7f thru 0x0111f2 (0x6274 bytes) 000961 1781234544.388578 MIRROR_RESYNC 9 mirrors 000963 1781234546.049675 trunc from 0x036c07 to 0x036cd6 (0xd0 bytes) 000964 1781234546.096789 fallocate 0x003306 thru 0x003f45 (0xc40 bytes) 000965 1781234546.102443 punch from 0x02aad5 to 0x036cd6 (0xc202 bytes) 000966 1781234546.109708 read 0x035a39 thru 0x036cd6 (0x129e bytes) 000967 1781234546.116912 trunc from 0x028f1f to 0x036cd6 (0xddb8 bytes) 000968 1781234546.124527 trunc from 0x036cd7 to 0x00f448 (0x2788e bytes) 000969 1781234546.155476 trunc from 0x00c7ef to 0x00e13d (0x194f bytes) 000970 1781234546.160403 read 0x00ebdb thru 0x00f448 (0x86e bytes) 000971 1781234546.169438 mapwrite 0x008c1b thru 0x00d850 (0x4c36 bytes) 000972 1781234546.192728 write 0x01fdf7 thru 0x02f2fc (0xf506 bytes) 000973 1781234546.195472 mapwrite 0x0309a9 thru 0x039a9a (0x90f2 bytes) 000974 1781234546.255372 mapwrite 0x029142 thru 0x037c9a (0xeb59 bytes) 000975 1781234546.283840 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: 0xa61f5b2c (stale) Mirror 9: 0xa61f5b2c (stale) Mirror 11: 0xa61f5b2c (stale) Mirror 12: 0xa61f5b2c (stale) Mirror 13: 0xa61f5b2c (stale) Mirror 14: 0xa61f5b2c (stale) Mirror 15: 0xa61f5b2c (stale) Mirror 16: 0xa61f5b2c (stale) CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 1: 0x4fa0f16d Mirror 17: 0x4fa0f16d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a9b: skipped 000976 1781234547.297511 trunc from 0x0340df to 0x034357 (0x279 bytes) 000977 1781234547.364602 MIRROR_RESYNC 10 mirrors 000978 1781234550.133182 mapwrite 0x01bee3 thru 0x02692c (0xaa4a bytes) 000979 1781234550.456236 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: 0x40a4c4 (stale) Mirror 9: 0x40a4c4 (stale) Mirror 11: 0x40a4c4 (stale) Mirror 12: 0x40a4c4 (stale) Mirror 13: 0x40a4c4 (stale) Mirror 14: 0x40a4c4 (stale) Mirror 15: 0x40a4c4 (stale) Mirror 16: 0x40a4c4 (stale) Mirror 17: 0x40a4c4 (stale) CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 1: 0x560d055b Mirror 18: 0x560d055b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a9b: skipped 000980 1781234551.758326 punch from 0x023fb3 to 0x02ded1 (0x9f1f bytes) 000981 1781234551.832208 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: 0x40a4c4 (stale) Mirror 9: 0x40a4c4 (stale) Mirror 11: 0x40a4c4 (stale) Mirror 12: 0x40a4c4 (stale) Mirror 13: 0x40a4c4 (stale) Mirror 14: 0x40a4c4 (stale) Mirror 15: 0x40a4c4 (stale) Mirror 16: 0x40a4c4 (stale) Mirror 17: 0x40a4c4 (stale) Mirror 18: 0x560d055b (stale) CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 1: 0xb1657cb3 Mirror 19: 0xb1657cb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a9b: skipped 000982 1781234552.818104 fallocate 0x02c0d7 thru 0x03ac6f (0xeb99 bytes) 000984 1781234552.865954 mapread 0x0221c9 thru 0x03177a (0xf5b2 bytes) 000985 1781234552.902721 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 7: 0x40a4c4 (stale) Mirror 9: 0x40a4c4 (stale) Mirror 11: 0x40a4c4 (stale) Mirror 12: 0x40a4c4 (stale) Mirror 13: 0x40a4c4 (stale) Mirror 14: 0x40a4c4 (stale) Mirror 15: 0x40a4c4 (stale) Mirror 16: 0x40a4c4 (stale) Mirror 17: 0x40a4c4 (stale) Mirror 18: 0x560d055b (stale) Mirror 19: 0xb1657cb3 (stale) CRC-32 checksum value for chunk [0, 0x39a9b): Mirror 1: 0xb1657cb3 Mirror 20: 0xb1657cb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a9b: skipped 000986 1781234554.028475 trunc from 0x00d46d to 0x010527 (0x30bb bytes) 000987 1781234554.075520 write 0x032343 thru 0x03842d (0x60eb bytes) 000989 1781234554.091993 mapread 0x02ac15 thru 0x02fc1d (0x5009 bytes) 000990 1781234554.100521 punch from 0x01aa84 to 0x027241 (0xc7be bytes) 000991 1781234554.106008 punch from 0x020b6d to 0x02bfad (0xb441 bytes) 000992 1781234554.110719 fallocate 0x034cec thru 0x03ad9d (0x60b2 bytes) 000993 1781234554.115423 mapread 0x025307 thru 0x03361b (0xe315 bytes) 000994 1781234554.130989 trunc from 0x039a9b to 0x02a3ea (0xf6b0 bytes) 000995 1781234554.154496 write 0x03807a thru 0x03b754 (0x36db bytes) 000996 1781234554.160749 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1dc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b755): Mirror 7: 0xd9cecb15 (stale) Mirror 9: 0xd9cecb15 (stale) Mirror 11: 0xd9cecb15 (stale) Mirror 12: 0xd9cecb15 (stale) Mirror 13: 0xd9cecb15 (stale) Mirror 14: 0xd9cecb15 (stale) Mirror 15: 0xd9cecb15 (stale) Mirror 16: 0xd9cecb15 (stale) Mirror 17: 0xd9cecb15 (stale) Mirror 19: 0x8de950d5 (stale) Mirror 20: 0x8de950d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b755): Mirror 7: 0xd9cecb15 (stale) Mirror 9: 0xd9cecb15 (stale) Mirror 11: 0xd9cecb15 (stale) Mirror 12: 0xd9cecb15 (stale) Mirror 13: 0xd9cecb15 (stale) Mirror 14: 0xd9cecb15 (stale) Mirror 15: 0xd9cecb15 (stale) Mirror 16: 0xd9cecb15 (stale) Mirror 17: 0xd9cecb15 (stale) Mirror 19: 0x8de950d5 (stale) Mirror 20: 0x8de950d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b755: skipped 000997 1781234554.989581 read 0x009951 thru 0x00d373 (0x3a23 bytes) 000999 1781234555.020906 trunc from 0x03b755 to 0x025cc1 (0x15a93 bytes) 001000 1781234555.050424 punch from 0x012557 to 0x012cf7 (0x7a1 bytes) All operations completed A-OK!