== sanity-flr test 70a: flr mode fsx test ================ 23:54:12 (1788666852) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 6855 skipping zero size read skipping zero size read truncating to largest ever: 0x33eff 000004 1788666855.716537 trunc from 00000000 to 0x033efe (0x33eff bytes) 000006 1788666855.735934 read 0x009bc8 thru 0x015038 (0xb471 bytes) 000007 1788666855.748758 mapwrite 0x011915 thru 0x0143b6 (0x2aa2 bytes) 000008 1788666855.764603 mapwrite 0x00a4c3 thru 0x0151b5 (0xacf3 bytes) 000009 1788666855.796834 write 0x01ab5a thru 0x027f28 (0xd3cf bytes) 000010 1788666855.826924 write 0x023059 thru 0x02a7ce (0x7776 bytes) 000013 1788666855.853341 trunc from 0x033eff to 0x0059a1 (0x2e55d bytes) 000014 1788666855.868859 mapread 0x002965 thru 0x00433b (0x19d7 bytes) 000015 1788666855.895190 punch from 0x004b2b to 0x0059a1 (0xe77 bytes) 000016 1788666855.901716 write 0x006a7a thru 0x007d76 (0x12fd bytes) 000017 1788666855.910211 write 0x031416 thru 0x0327be (0x13a9 bytes) 000018 1788666855.911126 trunc from 0x0327bf to 0x01cb2b (0x15c93 bytes) 000019 1788666855.956055 punch from 0x018f2a to 0x01cb2b (0x3c02 bytes) 000020 1788666855.971695 mapwrite 0x03d315 thru 0x03ffff (0x2ceb bytes) 000021 1788666856.052820 read 0x008cdd thru 0x011a47 (0x8d6b bytes) 000022 1788666856.071526 mapwrite 0x005e5b thru 0x0102cb (0xa471 bytes) 000023 1788666856.095778 mapwrite 0x01c206 thru 0x0203b9 (0x41b4 bytes) 000024 1788666856.115843 fallocate 0x0000c4 thru 0x0066bf (0x65fc bytes) fallocating to largest ever: 0x38178 000025 1788666856.124776 fallocate 0x02b946 thru 0x038177 (0xc832 bytes) 000026 1788666856.133036 mapread 0x012cd7 thru 0x022772 (0xfa9c bytes) 000027 1788666856.133997 trunc from 0x01ebf4 to 0x020e24 (0x2231 bytes) 000028 1788666856.140551 mapread 0x02242b thru 0x02b8ae (0x9484 bytes) 000029 1788666856.141280 fallocate 0x02b290 thru 0x02ed8e (0x3aff bytes) 000030 1788666856.145957 trunc from 0x040000 to 0x002bae (0x3d451 bytes) 000031 1788666856.164932 mapread 0x0015cb thru 0x002bae (0x15e4 bytes) 000032 1788666856.166287 write 0x02a007 thru 0x035af1 (0xbaeb bytes) 000033 1788666856.169696 trunc from 0x025517 to 0x02dd80 (0x886a bytes) 000034 1788666856.194812 mapwrite 0x039d88 thru 0x03ffff (0x6278 bytes) 000035 1788666856.307603 mapwrite 0x029aad thru 0x030d1a (0x726e bytes) 000036 1788666856.351550 mapread 0x0215d3 thru 0x022601 (0x102f bytes) 000037 1788666856.362565 fallocate 0x020d2c thru 0x028110 (0x73e5 bytes) 000038 1788666856.366846 read 0x00ff2b thru 0x016629 (0x66ff bytes) 000039 1788666856.378910 mapwrite 0x00e315 thru 0x01d1f8 (0xeee4 bytes) 000040 1788666856.409984 write 0x0279d4 thru 0x0364bd (0xeaea bytes) 000041 1788666856.411989 read 0x02d76a thru 0x0390bf (0xb956 bytes) 000042 1788666856.413437 trunc from 0x040000 to 0x025077 (0x1af88 bytes) 000043 1788666856.434927 read 0x005bf9 thru 0x014e94 (0xf29c bytes) 000045 1788666856.436656 fallocate 0x026c58 thru 0x027739 (0xae2 bytes) 000046 1788666856.442276 read 0x01a42b thru 0x01d326 (0x2efc bytes) 000047 1788666856.446986 MIRROR_EXTEND to 2 mirrors 000048 1788666857.015747 mapread 0x021dc2 thru 0x024422 (0x2661 bytes) 000049 1788666857.048968 trunc from 0x0131c5 to 0x01af9a (0x7dd6 bytes) 000050 1788666857.105751 write 0x011095 thru 0x01df7c (0xcee8 bytes) 000051 1788666857.144664 write 0x00acc3 thru 0x0149ac (0x9cea bytes) 000052 1788666857.156557 mapwrite 0x010282 thru 0x01cddd (0xcb5c bytes) 000053 1788666857.184323 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000054 1788666857.347767 mapread 0x0085fd thru 0x0149de (0xc3e2 bytes) 000055 1788666857.385975 mapread 0x00b6ff thru 0x013d05 (0x8607 bytes) 000056 1788666857.388743 mapread 0x00b7cb thru 0x01058d (0x4dc3 bytes) 000057 1788666857.391950 mapread 0x01c8d2 thru 0x024098 (0x77c7 bytes) 000058 1788666857.439394 write 0x00acff thru 0x00bf2c (0x122e bytes) 000059 1788666857.450632 punch from 0x0233eb to 0x025077 (0x1c8d bytes) 000060 1788666857.460516 punch from 0x00cac4 to 0x01afd5 (0xe512 bytes) 000061 1788666857.466797 trunc from 0x025078 to 0x01f76e (0x5909 bytes) 000062 1788666857.583011 mapwrite 0x0103e9 thru 0x019c3c (0x9854 bytes) 000063 1788666857.686984 punch from 0x01616f to 0x016dd7 (0xc69 bytes) 000064 1788666857.699495 fallocate 0x0210c7 thru 0x02f8c2 (0xe7fc bytes) 000065 1788666857.715327 mapwrite 0x021449 thru 0x026137 (0x4cef bytes) 000066 1788666857.785117 punch from 0x00c3d2 to 0x014b76 (0x87a5 bytes) fallocating to largest ever: 0x40000 000067 1788666857.806791 fallocate 0x038e79 thru 0x03ffff (0x7187 bytes) 000068 1788666857.838400 punch from 0x01d5bd to 0x01f61e (0x2062 bytes) 000069 1788666857.860087 trunc from 0x036cdc to 0x03aec0 (0x41e5 bytes) 000071 1788666857.874591 write 0x00a2ea thru 0x011596 (0x72ad bytes) 000072 1788666857.883926 write 0x02c998 thru 0x03ab5e (0xe1c7 bytes) 000073 1788666857.907793 fallocate 0x034cf9 thru 0x03a75d (0x5a65 bytes) 000074 1788666857.932196 trunc from 0x038d65 to 0x03ffff (0x729b bytes) 000075 1788666857.955473 write 0x013900 thru 0x01bf16 (0x8617 bytes) 000076 1788666857.961501 read 0x027acd thru 0x035f72 (0xe4a6 bytes) 000078 1788666857.974381 fallocate 0x0015cf thru 0x00c9d1 (0xb403 bytes) 000079 1788666857.979740 mapwrite 0x027f1f thru 0x036eca (0xefac bytes) 000081 1788666858.006578 punch from 0x02153c to 0x022a31 (0x14f6 bytes) 000082 1788666858.011639 fallocate 0x0219d2 thru 0x027fc9 (0x65f8 bytes) 000083 1788666858.016757 write 0x034403 thru 0x03ffff (0xbbfd bytes) 000084 1788666858.019381 trunc from 0x01f9ae to 0x0260d4 (0x6727 bytes) 000085 1788666858.024654 fallocate 0x019f7a thru 0x01b870 (0x18f7 bytes) 000086 1788666858.029403 read 0x03fcd2 thru 0x03ffff (0x32e bytes) 000087 1788666858.030133 trunc from 0x040000 to 0x01cc1f (0x233e0 bytes) 000088 1788666858.047911 trunc from 0x000c7f to 0x004639 (0x39bb bytes) 000089 1788666858.053626 punch from 0x010cc8 to 0x01cc1f (0xbf58 bytes) 000090 1788666858.059612 write 0x008415 thru 0x00e363 (0x5f4f bytes) 000091 1788666858.061661 trunc from 0x01cc20 to 0x00b46e (0x117b1 bytes) 000092 1788666858.078996 trunc from 0x00b46f to 0x012d01 (0x7893 bytes) 000093 1788666858.102415 fallocate 0x00a200 thru 0x00d1e9 (0x2fea bytes) 000094 1788666858.110038 write 0x033c9c thru 0x03aea1 (0x7206 bytes) 000095 1788666858.113072 mapread 0x03590e thru 0x03aea1 (0x5594 bytes) 000096 1788666858.115607 read 0x01c391 thru 0x020bb7 (0x4827 bytes) 000097 1788666858.129943 fallocate 0x02f1ba thru 0x03ee6e (0xfcb5 bytes) 000099 1788666858.137102 read 0x005ab9 thru 0x00edd3 (0x931b bytes) 000101 1788666858.145763 MIRROR_EXTEND to 2 mirrors 000102 1788666859.042801 fallocate 0x03ade0 thru 0x03b322 (0x543 bytes) 000103 1788666859.085747 trunc from 0x03ee6f to 0x01daf2 (0x2137c bytes) 000104 1788666859.137990 fallocate 0x025938 thru 0x031280 (0xb949 bytes) 000105 1788666859.143073 trunc from 0x01583a to 0x01a366 (0x4b2d bytes) 000106 1788666859.147284 read 0x02bc13 thru 0x02bf99 (0x387 bytes) 000107 1788666859.154347 mapwrite 0x032b43 thru 0x036f5a (0x4418 bytes) 000108 1788666859.216523 write 0x00a39d thru 0x014778 (0xa3dc bytes) 000109 1788666859.227395 trunc from 0x00a25b to 0x00d2d1 (0x3077 bytes) 000110 1788666859.242797 write 0x00691d thru 0x0110fa (0xa7de bytes) 000112 1788666859.251711 read 0x004a74 thru 0x00a793 (0x5d20 bytes) 000113 1788666859.265665 mapread 0x0138d5 thru 0x01e0e0 (0xa80c bytes) 000114 1788666859.267047 trunc from 0x036f5b to 0x00063e (0x3691c bytes) 000115 1788666859.285116 mapwrite 0x02b201 thru 0x03287e (0x767e bytes) 000116 1788666859.364943 write 0x01c927 thru 0x027683 (0xad5d bytes) 000118 1788666859.377108 fallocate 0x03d3ea thru 0x03ffff (0x2c16 bytes) 000119 1788666859.382105 fallocate 0x030fd6 thru 0x03e10f (0xd13a bytes) 000120 1788666859.388906 mapread 0x01c39b thru 0x0212cf (0x4f35 bytes) 000121 1788666859.390662 punch from 0x0083bd to 0x00e24b (0x5e8f bytes) 000122 1788666859.400260 trunc from 0x011214 to 0x017db3 (0x6ba0 bytes) 000123 1788666859.409364 read 0x03bc9c thru 0x03e10f (0x2474 bytes) 000124 1788666859.419917 trunc from 0x02c387 to 0x02ca7d (0x6f7 bytes) 000125 1788666859.439710 trunc from 0x02333e to 0x02412b (0xdee bytes) 000126 1788666859.456675 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e110): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e110): Mirror 2: 0x24d85515 (stale) CRC-32 checksum value for chunk [0, 0x3e110): Mirror 1: 0x93352602 Mirror 3: 0x93352602 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e110: skipped 000128 1788666860.173369 trunc from 0x01de38 to 0x02c9a5 (0xeb6e bytes) 000129 1788666860.237730 trunc from 0x03e110 to 0x03e5fd (0x4ee bytes) 000131 1788666860.291890 fallocate 0x004e84 thru 0x011620 (0xc79d bytes) 000132 1788666860.295715 mapwrite 0x025662 thru 0x03441d (0xedbc bytes) 000133 1788666860.393622 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e5fe): Mirror 3: 0xc6c1ad8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5fe): Mirror 3: 0xc6c1ad8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5fe: skipped 000134 1788666860.795172 trunc from 0x03e5fe to 0x0267b9 (0x17e44 bytes) 000135 1788666860.821402 write 0x0342a1 thru 0x03a845 (0x65a5 bytes) 000138 1788666860.826084 fallocate 0x03d829 thru 0x03ffff (0x27d7 bytes) 000139 1788666860.831313 mapread 0x0218bf thru 0x03043a (0xeb7c bytes) 000141 1788666860.867105 read 0x02a9e6 thru 0x036e42 (0xc45d bytes) 000142 1788666860.867814 fallocate 0x031afd thru 0x03e280 (0xc784 bytes) 000143 1788666860.873021 fallocate 0x019322 thru 0x01a20d (0xeec bytes) 000144 1788666860.877780 mapwrite 0x03be60 thru 0x03ffff (0x41a0 bytes) 000145 1788666860.907187 trunc from 0x040000 to 0x022b9a (0x1d465 bytes) 000146 1788666860.923511 punch from 0x007849 to 0x011d53 (0xa50b bytes) 000147 1788666860.927708 mapwrite 0x01efc2 thru 0x026206 (0x7245 bytes) 000148 1788666860.981752 trunc from 0x007304 to 0x010227 (0x8f24 bytes) 000149 1788666860.989600 trunc from 0x026207 to 0x03ab1c (0x14916 bytes) 000150 1788666861.006765 trunc from 0x03ab1d to 0x018730 (0x223ec bytes) 000151 1788666861.025664 trunc from 0x00cc24 to 0x00ccf6 (0xd3 bytes) 000152 1788666861.029559 trunc from 0x006e70 to 0x0096b6 (0x2847 bytes) 000153 1788666861.033782 read 0x005b69 thru 0x015182 (0xf61a bytes) 000154 1788666861.041016 mapwrite 0x028b1f thru 0x032dcc (0xa2ae bytes) 000155 1788666861.099414 read 0x016460 thru 0x01f369 (0x8f0a bytes) 000157 1788666861.103026 mapread 0x020d2d thru 0x027dd9 (0x70ad bytes) 000158 1788666861.105566 punch from 0x01957f to 0x024f92 (0xba14 bytes) 000159 1788666861.110996 trunc from 0x013e31 to 0x014cd4 (0xea4 bytes) 000160 1788666861.115793 write 0x013812 thru 0x0159d9 (0x21c8 bytes) 000162 1788666861.133516 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32dcd): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32dcd): Mirror 3: 0x9a79fab8 (stale) CRC-32 checksum value for chunk [0, 0x32dcd): Mirror 1: 0xeae0d359 Mirror 4: 0xeae0d359 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32dcd: skipped 000163 1788666862.252224 MIRROR_RESYNC 3 mirrors 000164 1788666863.239923 trunc from 0x02b739 to 0x032dcc (0x7694 bytes) 000165 1788666863.327291 punch from 0x01d83b to 0x02a96d (0xd133 bytes) 000167 1788666863.344039 write 0x002330 thru 0x005287 (0x2f58 bytes) 000169 1788666863.390022 fallocate 0x0165b7 thru 0x0210c0 (0xab0a bytes) 000170 1788666863.397957 read 0x02a284 thru 0x02b4dc (0x1259 bytes) 000171 1788666863.408640 punch from 0x01870e to 0x025965 (0xd258 bytes) 000172 1788666863.415501 write 0x005bf0 thru 0x01367b (0xda8c bytes) 000173 1788666863.423766 mapread 0x01f54b thru 0x02b8a2 (0xc358 bytes) 000174 1788666863.441287 trunc from 0x00829d to 0x013548 (0xb2ac bytes) 000175 1788666863.467705 fallocate 0x032d10 thru 0x03ffff (0xd2f0 bytes) 000176 1788666863.472525 trunc from 0x029542 to 0x0310b9 (0x7b78 bytes) 000178 1788666863.484050 mapwrite 0x00c453 thru 0x01984c (0xd3fa bytes) 000179 1788666863.562139 trunc from 0x040000 to 0x00ccb5 (0x3334a bytes) 000180 1788666863.663179 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xccb6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xccb6): Mirror 3: 0x9ee6f406 (stale) Mirror 4: 0x9ee6f406 (stale) CRC-32 checksum value for chunk [0, 0xccb6): Mirror 1: 0x90b2b3c7 Mirror 5: 0x90b2b3c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xccb6: skipped 000181 1788666864.934862 read 0x00a64b thru 0x00ccb5 (0x266b bytes) 000182 1788666864.969095 mapwrite 0x02c25d thru 0x033e08 (0x7bac bytes) 000183 1788666865.124390 trunc from 0x033e09 to 0x02ae1e (0x8fea bytes) 000185 1788666865.140208 mapread 0x01c228 thru 0x02a38b (0xe164 bytes) 000186 1788666865.152111 trunc from 0x02ae1f to 0x01576b (0x156b3 bytes) 000187 1788666865.169231 write 0x025f4c thru 0x02ae4c (0x4f01 bytes) 000188 1788666865.171053 trunc from 0x02ae4d to 0x02c2a2 (0x1456 bytes) 000189 1788666865.196714 trunc from 0x02c2a3 to 0x036fd2 (0xad30 bytes) 000190 1788666865.237645 write 0x01db67 thru 0x025bef (0x8089 bytes) 000191 1788666865.249063 fallocate 0x03050f thru 0x0388ee (0x83e0 bytes) 000192 1788666865.255318 trunc from 0x01230b to 0x01a9ec (0x86e2 bytes) 000194 1788666865.263763 mapread 0x004bda thru 0x005e90 (0x12b7 bytes) 000196 1788666865.275655 mapwrite 0x026d01 thru 0x036be2 (0xfee2 bytes) 000197 1788666865.354967 read 0x0290a5 thru 0x02e1c2 (0x511e bytes) 000198 1788666865.355589 write 0x032ecd thru 0x0392b0 (0x63e4 bytes) 000199 1788666865.356761 write 0x02ca7c thru 0x0335bf (0x6b44 bytes) 000200 1788666865.386479 MIRROR_RESYNC 4 mirrors 000201 1788666866.786986 trunc from 0x01c8f8 to 0x0236ab (0x6db4 bytes) 000202 1788666866.889939 mapwrite 0x0255f7 thru 0x0315f6 (0xc000 bytes) 000203 1788666866.993067 mapread 0x02b594 thru 0x0339d8 (0x8445 bytes) 000205 1788666866.997999 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392b1): Mirror 4: 0x76ff8b26 (stale) Mirror 5: 0x76ff8b26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392b1): Mirror 4: 0x76ff8b26 (stale) Mirror 5: 0x76ff8b26 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392b1: skipped 000206 1788666867.504984 write 0x023762 thru 0x0317c0 (0xe05f bytes) 000207 1788666867.532771 read 0x01a217 thru 0x01b653 (0x143d bytes) 000208 1788666867.538541 punch from 0x0032f9 to 0x004c0c (0x1914 bytes) 000209 1788666867.548120 mapread 0x01e356 thru 0x01fed5 (0x1b80 bytes) 000210 1788666867.558137 trunc from 0x00936e to 0x00c481 (0x3114 bytes) 000211 1788666867.562597 write 0x03c0c1 thru 0x03ffff (0x3f3f bytes) 000212 1788666867.563770 mapread 0x01e018 thru 0x021a8b (0x3a74 bytes) 000213 1788666867.572637 mapread 0x02a24e thru 0x03353c (0x92ef bytes) 000214 1788666867.581479 punch from 0x012ebf to 0x01c012 (0x9154 bytes) 000215 1788666867.589494 mapwrite 0x017764 thru 0x020811 (0x90ae bytes) 000216 1788666867.618899 fallocate 0x012875 thru 0x020bf5 (0xe381 bytes) 000219 1788666867.623867 read 0x0247d3 thru 0x024af2 (0x320 bytes) 000221 1788666867.624866 punch from 0x027126 to 0x034ad6 (0xd9b1 bytes) 000222 1788666867.629679 write 0x00a144 thru 0x010c22 (0x6adf bytes) 000223 1788666867.642067 trunc from 0x00e5a0 to 0x010036 (0x1a97 bytes) 000224 1788666867.655055 punch from 0x03884b to 0x03ffff (0x77b5 bytes) 000225 1788666867.662127 write 0x01a104 thru 0x01b92c (0x1829 bytes) 000226 1788666867.664024 mapwrite 0x031e4d thru 0x03ffff (0xe1b3 bytes) 000227 1788666867.731926 fallocate 0x02d7b6 thru 0x037e23 (0xa66e bytes) 000228 1788666867.738913 mapread 0x00668c thru 0x014bf1 (0xe566 bytes) 000229 1788666867.765305 trunc from 0x040000 to 0x027a4a (0x185b5 bytes) 000230 1788666867.784764 write 0x025f0a thru 0x028e4a (0x2f41 bytes) 000231 1788666867.787328 trunc from 0x028e4b to 0x01d5f1 (0xb859 bytes) 000232 1788666867.804074 mapread 0x010809 thru 0x014ab8 (0x42b0 bytes) 000233 1788666867.805111 read 0x00c288 thru 0x01a4e2 (0xe25b bytes) 000234 1788666867.806769 mapwrite 0x01cd42 thru 0x0295f1 (0xc8b0 bytes) 000235 1788666867.854421 mapread 0x022d8f thru 0x0278e2 (0x4b54 bytes) 000237 1788666867.857541 trunc from 0x0284c3 to 0x0295f1 (0x112f bytes) 000238 1788666867.875070 write 0x033548 thru 0x03814d (0x4c06 bytes) 000239 1788666867.877469 mapread 0x0192e4 thru 0x01e776 (0x5493 bytes) 000240 1788666867.879650 write 0x034f11 thru 0x03bcff (0x6def bytes) 000241 1788666867.884915 trunc from 0x03bd00 to 0x0291b2 (0x12b4d bytes) 000243 1788666867.911319 mapwrite 0x0241f6 thru 0x029b75 (0x5980 bytes) 000244 1788666867.964337 fallocate 0x034280 thru 0x03ffff (0xbd80 bytes) 000245 1788666867.969751 trunc from 0x029b76 to 0x035400 (0xb88b bytes) 000246 1788666867.993604 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35401): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35401): Mirror 4: 0xfd8f667e (stale) Mirror 5: 0xfd8f667e (stale) CRC-32 checksum value for chunk [0, 0x35401): Mirror 1: 0x7dc07412 Mirror 6: 0x7dc07412 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35401: skipped 000247 1788666869.296823 read 0x019bcb thru 0x024381 (0xa7b7 bytes) 000248 1788666869.314767 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35401): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35401): Mirror 4: 0xfd8f667e (stale) Mirror 5: 0xfd8f667e (stale) CRC-32 checksum value for chunk [0, 0x35401): Mirror 1: 0x7dc07412 Mirror 6: 0x7dc07412 Mirror 7: 0x7dc07412 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35401: skipped 000249 1788666870.304324 read 0x02c11d thru 0x02fcb1 (0x3b95 bytes) 000250 1788666870.314381 fallocate 0x0116c1 thru 0x019936 (0x8276 bytes) 000251 1788666870.339645 fallocate 0x036a09 thru 0x038f0d (0x2505 bytes) 000252 1788666870.344800 fallocate 0x00d132 thru 0x00fd93 (0x2c62 bytes) 000253 1788666870.347721 punch from 0x02710b to 0x02f3b7 (0x82ad bytes) 000254 1788666870.352773 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35401): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35401): Mirror 4: 0xfd8f667e (stale) Mirror 5: 0xfd8f667e (stale) Mirror 6: 0x7dc07412 (stale) Mirror 7: 0x7dc07412 (stale) CRC-32 checksum value for chunk [0, 0x35401): Mirror 1: 0x850dd3c7 Mirror 8: 0x850dd3c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35401: skipped 000255 1788666871.259129 write 0x030da8 thru 0x03656d (0x57c6 bytes) 000257 1788666871.305925 write 0x00a3eb thru 0x01634c (0xbf62 bytes) 000258 1788666871.341300 fallocate 0x026e30 thru 0x0336c0 (0xc891 bytes) 000259 1788666871.348306 mapwrite 0x013938 thru 0x01f8a3 (0xbf6c bytes) 000260 1788666871.398027 mapwrite 0x022ccc thru 0x031b04 (0xee39 bytes) 000261 1788666871.437116 punch from 0x02e8a0 to 0x0340ff (0x5860 bytes) 000262 1788666871.444075 mapwrite 0x00c853 thru 0x00f711 (0x2ebf bytes) 000263 1788666871.457718 fallocate 0x031cba thru 0x034cde (0x3025 bytes) 000264 1788666871.462404 mapread 0x024214 thru 0x02abdb (0x69c8 bytes) 000265 1788666871.463898 write 0x01280c thru 0x019f83 (0x7778 bytes) 000266 1788666871.465304 trunc from 0x005bf4 to 0x00e60c (0x8a19 bytes) 000268 1788666871.471343 mapwrite 0x01ead1 thru 0x02c232 (0xd762 bytes) 000269 1788666871.507043 trunc from 0x03656e to 0x027f93 (0xe5da bytes) 000270 1788666871.531604 mapwrite 0x0040d0 thru 0x007b6c (0x3a9d bytes) 000271 1788666871.560543 punch from 0x01358c to 0x01957e (0x5ff3 bytes) 000272 1788666871.569566 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27f94): Mirror 4: 0x4f8e4b78 (stale) Mirror 6: 0x5176b33f (stale) Mirror 7: 0x5176b33f (stale) Mirror 8: 0xd2e6a68c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27f94): Mirror 4: 0x4f8e4b78 (stale) Mirror 6: 0x5176b33f (stale) Mirror 7: 0x5176b33f (stale) Mirror 8: 0xd2e6a68c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27f94: skipped 000273 1788666871.946017 write 0x00da1f thru 0x0191b6 (0xb798 bytes) 000274 1788666871.968915 punch from 0x0046b4 to 0x009539 (0x4e86 bytes) 000275 1788666871.978375 trunc from 0x027b63 to 0x027f93 (0x431 bytes) 000276 1788666871.982012 punch from 0x018470 to 0x027b59 (0xf6ea bytes) 000277 1788666872.002580 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27f94): Mirror 4: 0x4f8e4b78 (stale) Mirror 7: 0x5176b33f (stale) Mirror 8: 0xd2e6a68c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27f94): Mirror 4: 0x4f8e4b78 (stale) Mirror 7: 0x5176b33f (stale) Mirror 8: 0xd2e6a68c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27f94: skipped 000279 1788666872.247997 read 0x024ce5 thru 0x027f93 (0x32af bytes) 000280 1788666872.253965 fallocate 0x03377a thru 0x03ffff (0xc886 bytes) 000281 1788666872.261466 trunc from 0x040000 to 0x01261a (0x2d9e5 bytes) 000282 1788666872.282426 punch from 0x009151 to 0x01261a (0x94ca bytes) 000283 1788666872.287759 trunc from 0x00c3a8 to 0x00f9af (0x3608 bytes) 000284 1788666872.293385 MIRROR_RESYNC 4 mirrors 000285 1788666873.172079 write 0x03b730 thru 0x03bb76 (0x447 bytes) 000286 1788666873.228547 MIRROR_RESYNC 4 mirrors 000287 1788666874.544529 read 0x008427 thru 0x00b924 (0x34fe bytes) 000288 1788666874.553779 fallocate 0x02364c thru 0x027d7a (0x472f bytes) 000289 1788666874.620510 read 0x036df8 thru 0x03bb76 (0x4d7f bytes) 000290 1788666874.636212 read 0x00d076 thru 0x016ad2 (0x9a5d bytes) 000291 1788666874.637572 fallocate 0x03a32b thru 0x03bce9 (0x19bf bytes) 000292 1788666874.648282 read 0x00f3ab thru 0x0191f5 (0x9e4b bytes) 000293 1788666874.650638 trunc from 0x031a0d to 0x03bce9 (0xa2dd bytes) 000294 1788666874.658477 write 0x00516c thru 0x00e2de (0x9173 bytes) 000295 1788666874.663139 mapwrite 0x02c3a6 thru 0x037e48 (0xbaa3 bytes) 000296 1788666874.713338 punch from 0x0065a8 to 0x00a29a (0x3cf3 bytes) 000297 1788666874.721228 fallocate 0x00501c thru 0x00e1ee (0x91d3 bytes) 000298 1788666874.736325 read 0x001d7e thru 0x00e111 (0xc394 bytes) 000299 1788666874.767993 fallocate 0x022527 thru 0x02a043 (0x7b1d bytes) 000300 1788666874.776642 mapread 0x005d32 thru 0x00dfa2 (0x8271 bytes) 000301 1788666874.777880 trunc from 0x03bcea to 0x0214ba (0x1a82f bytes) 000303 1788666874.826906 write 0x00f668 thru 0x019509 (0x9ea2 bytes) 000304 1788666874.832815 punch from 0x00a851 to 0x018f5d (0xe70d bytes) 000305 1788666874.850690 mapread 0x0121ee thru 0x0192a4 (0x70b7 bytes) 000306 1788666874.886822 fallocate 0x00f27f thru 0x01f1a7 (0xff29 bytes) 000307 1788666874.900412 read 0x0112e4 thru 0x01ad3a (0x9a57 bytes) 000308 1788666874.918077 trunc from 0x0214bb to 0x023ebd (0x2a03 bytes) 000309 1788666874.932131 mapread 0x018f9f thru 0x01997e (0x9e0 bytes) 000310 1788666874.933345 write 0x01b863 thru 0x01c380 (0xb1e bytes) 000312 1788666874.941886 write 0x021043 thru 0x0299fe (0x89bc bytes) 000313 1788666874.943356 trunc from 0x0299ff to 0x003692 (0x2636c bytes) 000315 1788666874.981010 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3693): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3693): Mirror 4: 0x662648e8 (stale) Mirror 7: 0x662648e8 (stale) Mirror 8: 0x662648e8 (stale) CRC-32 checksum value for chunk [0, 0x3693): Mirror 1: 0x662648e8 Mirror 9: 0x662648e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3693: skipped 000316 1788666875.664556 trunc from 0x0007b4 to 0x003692 (0x2edf bytes) 000317 1788666875.706516 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3693): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3693): Mirror 4: 0x662648e8 (stale) Mirror 7: 0x662648e8 (stale) Mirror 8: 0x662648e8 (stale) Mirror 9: 0x662648e8 (stale) CRC-32 checksum value for chunk [0, 0x3693): Mirror 1: 0x7a1b992 Mirror 10: 0x7a1b992 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3693: skipped 000318 1788666876.217692 trunc from 0x003693 to 0x004a69 (0x13d7 bytes) 000319 1788666876.277095 trunc from 0x001f1b to 0x004a69 (0x2b4f bytes) 000320 1788666876.289097 MIRROR_RESYNC 6 mirrors 000321 1788666877.174651 punch from 0x003e69 to 0x004a69 (0xc01 bytes) 000322 1788666877.235461 trunc from 0x003b0b to 0x004a69 (0xf5f bytes) 000323 1788666877.242543 fallocate 0x02a56c thru 0x03965a (0xf0ef bytes) 000326 1788666877.256082 fallocate 0x01d3d5 thru 0x02a66c (0xd298 bytes) 000327 1788666877.263157 punch from 0x002bc9 to 0x004a69 (0x1ea1 bytes) 000328 1788666877.269301 punch from 0x00486f to 0x004a69 (0x1fb bytes) 000329 1788666877.276644 write 0x02ad61 thru 0x0302fd (0x559d bytes) 000330 1788666877.280297 write 0x03532d thru 0x036817 (0x14eb bytes) 000331 1788666877.282993 write 0x0241a6 thru 0x029688 (0x54e3 bytes) 000332 1788666877.294659 trunc from 0x036818 to 0x016f5f (0x1f8b8 bytes) 000333 1788666877.337561 MIRROR_RESYNC 6 mirrors 000334 1788666878.326625 fallocate 0x032551 thru 0x03ffff (0xdaaf bytes) 000336 1788666878.358083 mapwrite 0x0398ac thru 0x03ffff (0x6754 bytes) 000337 1788666878.415826 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xda2972fd Mirror 11: 0xda2972fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000338 1788666879.086048 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000339 1788666879.453865 punch from 0x00994b to 0x01103c (0x76f2 bytes) 000340 1788666879.469655 mapwrite 0x011661 thru 0x012459 (0xdf9 bytes) 000342 1788666879.489214 trunc from 0x040000 to 0x02e0d6 (0x11f29 bytes) 000343 1788666879.532698 punch from 0x02b976 to 0x02e0d6 (0x2761 bytes) 000344 1788666879.541563 MIRROR_RESYNC 6 mirrors 000345 1788666880.466356 read 0x006da7 thru 0x00ba2a (0x4c84 bytes) 000347 1788666880.472572 mapwrite 0x022f26 thru 0x028e74 (0x5f4f bytes) 000348 1788666880.547504 mapwrite 0x01a72b thru 0x0299b6 (0xf28c bytes) 000349 1788666880.588533 trunc from 0x019b7c to 0x01bb66 (0x1feb bytes) 000350 1788666880.593140 trunc from 0x02e0d7 to 0x028095 (0x6041 bytes) 000351 1788666880.618848 fallocate 0x004b92 thru 0x007187 (0x25f6 bytes) 000352 1788666880.624374 trunc from 0x028096 to 0x03d862 (0x157cd bytes) 000353 1788666880.637998 write 0x033a6c thru 0x03cdf4 (0x9389 bytes) 000354 1788666880.647693 punch from 0x037f47 to 0x03d862 (0x591c bytes) 000355 1788666880.664522 punch from 0x023a2c to 0x027fd0 (0x45a5 bytes) 000356 1788666880.669052 punch from 0x038fc2 to 0x03d862 (0x48a1 bytes) 000357 1788666880.673451 punch from 0x038e0f to 0x03c8a8 (0x3a9a bytes) 000359 1788666880.678463 trunc from 0x03d863 to 0x022bbc (0x1aca6 bytes) 000360 1788666880.701815 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x22bbd): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22bbd): Mirror 4: 0x2ce5aa25 (stale) Mirror 7: 0x2ce5aa25 (stale) Mirror 8: 0x2ce5aa25 (stale) Mirror 9: 0x2ce5aa25 (stale) Mirror 10: 0x2ce5aa25 (stale) CRC-32 checksum value for chunk [0, 0x22bbd): Mirror 1: 0xaf556688 Mirror 11: 0xaf556688 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22bbd: skipped 000361 1788666881.800914 trunc from 0x022bbd to 0x016d71 (0xbe4b bytes) 000363 1788666881.922806 mapread 0x0050e4 thru 0x013ebe (0xeddb bytes) 000364 1788666881.966655 fallocate 0x031ba4 thru 0x035b10 (0x3f6d bytes) 000366 1788666881.973731 read 0x00cd4b thru 0x015090 (0x8346 bytes) 000367 1788666881.974341 trunc from 0x035b11 to 0x016e4c (0x1ecc4 bytes) 000368 1788666882.021761 mapread 0x0035b6 thru 0x00b900 (0x834b bytes) 000369 1788666882.031151 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16e4d): Mirror 7: 0xabbb3b87 (stale) Mirror 8: 0xabbb3b87 (stale) Mirror 9: 0xabbb3b87 (stale) Mirror 10: 0xabbb3b87 (stale) Mirror 11: 0xabbb3b87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16e4d): Mirror 7: 0xabbb3b87 (stale) Mirror 8: 0xabbb3b87 (stale) Mirror 9: 0xabbb3b87 (stale) Mirror 10: 0xabbb3b87 (stale) Mirror 11: 0xabbb3b87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16e4d: skipped 000370 1788666882.714504 mapwrite 0x01c39a thru 0x022fae (0x6c15 bytes) 000371 1788666882.787042 read 0x01c132 thru 0x022fae (0x6e7d bytes) 000372 1788666882.787957 write 0x0348d4 thru 0x03ffff (0xb72c bytes) 000373 1788666882.791283 read 0x026d1d thru 0x031d75 (0xb059 bytes) 000374 1788666882.805498 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6977f472 (stale) Mirror 8: 0x6977f472 (stale) Mirror 10: 0x6977f472 (stale) Mirror 11: 0x1094e762 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6977f472 (stale) Mirror 8: 0x6977f472 (stale) Mirror 10: 0x6977f472 (stale) Mirror 11: 0x1094e762 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000375 1788666883.146329 mapwrite 0x02fae5 thru 0x030884 (0xda0 bytes) 000376 1788666883.168832 mapwrite 0x025320 thru 0x02de7f (0x8b60 bytes) 000377 1788666883.193588 trunc from 0x040000 to 0x01db9d (0x22462 bytes) 000378 1788666883.210344 write 0x01a8f2 thru 0x0275bb (0xccca bytes) 000379 1788666883.216550 fallocate 0x01131b thru 0x012994 (0x167a bytes) 000380 1788666883.220929 read 0x025985 thru 0x0275bb (0x1c37 bytes) 000381 1788666883.225103 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x275bc): Mirror 8: 0x7a163378 (stale) Mirror 10: 0x7a163378 (stale) Mirror 11: 0x77f0e5de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x275bc): Mirror 8: 0x7a163378 (stale) Mirror 10: 0x7a163378 (stale) Mirror 11: 0x77f0e5de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x275bc: skipped 000382 1788666883.537274 trunc from 0x0275bc to 0x036712 (0xf157 bytes) 000383 1788666883.557909 trunc from 0x036713 to 0x030c85 (0x5a8d bytes) 000384 1788666883.574663 MIRROR_RESYNC 4 mirrors 000385 1788666884.379421 write 0x030797 thru 0x039166 (0x89d0 bytes) 000386 1788666884.413661 mapwrite 0x012b2b thru 0x017d77 (0x524d bytes) 000387 1788666884.451999 fallocate 0x03a9bd thru 0x03d84f (0x2e93 bytes) 000388 1788666884.457208 read 0x02c584 thru 0x03893c (0xc3b9 bytes) 000389 1788666884.463141 mapwrite 0x021070 thru 0x026a5e (0x59ef bytes) 000390 1788666884.485635 trunc from 0x01f965 to 0x027c70 (0x830c bytes) 000391 1788666884.489645 punch from 0x000a72 to 0x002dc5 (0x2354 bytes) 000392 1788666884.494115 trunc from 0x023762 to 0x0325a0 (0xee3f bytes) 000393 1788666884.498992 trunc from 0x03d850 to 0x01d658 (0x201f7 bytes) 000394 1788666884.522955 fallocate 0x039697 thru 0x03b6d1 (0x203b bytes) 000395 1788666884.528535 mapwrite 0x012fa6 thru 0x01b887 (0x88e2 bytes) 000396 1788666884.548149 mapwrite 0x01beb2 thru 0x0242e1 (0x8430 bytes) 000397 1788666884.587692 mapread 0x00bd1e thru 0x016219 (0xa4fc bytes) 000398 1788666884.596896 read 0x020587 thru 0x0242e1 (0x3d5b bytes) 000399 1788666884.597618 read 0x018e0c thru 0x01b496 (0x268b bytes) 000400 1788666884.599000 mapread 0x005866 thru 0x00de77 (0x8612 bytes) 000401 1788666884.600045 fallocate 0x01902e thru 0x01f6e1 (0x66b4 bytes) 000402 1788666884.604454 punch from 0x000f7f to 0x0077d8 (0x685a bytes) 000403 1788666884.608571 write 0x026d37 thru 0x02fc4a (0x8f14 bytes) 000404 1788666884.610844 punch from 0x009273 to 0x018371 (0xf0ff bytes) 000405 1788666884.615966 fallocate 0x02dd14 thru 0x03b857 (0xdb44 bytes) 000406 1788666884.620593 mapwrite 0x0196b2 thru 0x0214f4 (0x7e43 bytes) 000407 1788666884.638477 fallocate 0x0091c6 thru 0x00d1e7 (0x4022 bytes) 000408 1788666884.643143 read 0x0212b7 thru 0x029b1f (0x8869 bytes) 000409 1788666884.652153 write 0x00607a thru 0x0091be (0x3145 bytes) 000410 1788666884.653219 read 0x021460 thru 0x02c5f2 (0xb193 bytes) 000411 1788666884.658746 MIRROR_RESYNC 4 mirrors 000412 1788666885.518791 trunc from 0x03b858 to 0x00251d (0x3933a bytes) 000413 1788666885.549953 trunc from 0x001a96 to 0x00251d (0xa88 bytes) 000414 1788666885.554515 punch from 0x002080 to 0x00251d (0x49e bytes) 000415 1788666885.558868 mapwrite 0x032cc0 thru 0x03d668 (0xa9a9 bytes) 000418 1788666885.612827 write 0x0056a1 thru 0x00c5fd (0x6f5d bytes) 000419 1788666885.621690 trunc from 0x03d669 to 0x00549d (0x381cb bytes) 000421 1788666885.636448 mapwrite 0x0369c0 thru 0x03ffff (0x9640 bytes) 000422 1788666885.680286 write 0x00b5de thru 0x01b5cf (0xfff2 bytes) 000423 1788666885.695872 trunc from 0x040000 to 0x00224e (0x3ddb1 bytes) 000424 1788666885.707937 punch from 0x000898 to 0x00224e (0x19b7 bytes) 000425 1788666885.717279 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x224f): Mirror 8: 0x8d3487c (stale) Mirror 11: 0x8d3487c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x224f): Mirror 8: 0x8d3487c (stale) Mirror 11: 0x8d3487c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x224f: skipped 000426 1788666885.938752 trunc from 0x00224f to 0x01c73e (0x1a4f0 bytes) 000427 1788666885.961441 write 0x002274 thru 0x0095f6 (0x7383 bytes) 000428 1788666885.975199 read 0x001d9a thru 0x00cb50 (0xadb7 bytes) 000429 1788666885.983505 mapwrite 0x004ad6 thru 0x011386 (0xc8b1 bytes) 000430 1788666886.015089 mapread 0x014cbf thru 0x01b2d3 (0x6615 bytes) 000431 1788666886.023212 fallocate 0x02c67e thru 0x036033 (0x99b6 bytes) 000432 1788666886.031113 MIRROR_RESYNC 3 mirrors 000434 1788666886.555666 punch from 0x013f35 to 0x01c73e (0x880a bytes) 000435 1788666886.592523 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c73f): Mirror 11: 0x9711adc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c73f): Mirror 11: 0x9711adc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c73f: skipped 000436 1788666886.804645 trunc from 0x006e94 to 0x006f58 (0xc5 bytes) 000437 1788666886.812450 fallocate 0x0290df thru 0x0328b9 (0x97db bytes) 000438 1788666886.817901 trunc from 0x00858d to 0x00e3fc (0x5e70 bytes) 000440 1788666886.823476 mapread 0x0013f8 thru 0x002a87 (0x1690 bytes) 000441 1788666886.832108 trunc from 0x0328ba to 0x013117 (0x1f7a2 bytes) 000442 1788666886.869370 mapread 0x0049b1 thru 0x00cb43 (0x8193 bytes) 000443 1788666886.884193 MIRROR_RESYNC 2 mirrors 000444 1788666887.363586 mapread 0x006652 thru 0x008a7c (0x242b bytes) 000445 1788666887.383742 fallocate 0x010e26 thru 0x01474d (0x3928 bytes) 000446 1788666887.407285 read 0x00d44e thru 0x013117 (0x5cca bytes) 000447 1788666887.414372 read 0x00b624 thru 0x0108da (0x52b7 bytes) 000448 1788666887.423159 punch from 0x00a78c to 0x01016b (0x59e0 bytes) 000449 1788666887.428147 trunc from 0x013118 to 0x0073ed (0xbd2a bytes) 000450 1788666887.449983 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000452 1788666887.563918 mapwrite 0x0001f6 thru 0x001d92 (0x1b9d bytes) 000453 1788666887.584587 mapwrite 0x02b346 thru 0x02bb85 (0x840 bytes) 000455 1788666887.617490 trunc from 0x01fbef to 0x0212c8 (0x16da bytes) 000456 1788666887.622236 trunc from 0x0296b1 to 0x02bb85 (0x24d5 bytes) 000457 1788666887.627031 read 0x013e9e thru 0x0226b9 (0xe81c bytes) 000458 1788666887.639898 write 0x01b59d thru 0x01bebf (0x923 bytes) 000461 1788666887.643539 fallocate 0x0272ae thru 0x029066 (0x1db9 bytes) 000464 1788666887.650342 mapwrite 0x034fa9 thru 0x03ffff (0xb057 bytes) 000465 1788666887.694961 fallocate 0x0234fd thru 0x023cd8 (0x7dc bytes) 000466 1788666887.699656 punch from 0x014921 to 0x021514 (0xcbf4 bytes) 000468 1788666887.705272 mapwrite 0x03b892 thru 0x03f6cf (0x3e3e bytes) 000469 1788666887.719278 trunc from 0x040000 to 0x01a5fa (0x25a05 bytes) 000470 1788666887.734466 read 0x018400 thru 0x01a5fa (0x21fb bytes) 000471 1788666887.754906 trunc from 0x00be3f to 0x00c2c5 (0x487 bytes) 000473 1788666887.762605 fallocate 0x0110d2 thru 0x0130ae (0x1fdd bytes) 000474 1788666887.767920 read 0x003f7b thru 0x0104a3 (0xc529 bytes) 000475 1788666887.773114 read 0x00108c thru 0x00bdcb (0xad40 bytes) 000476 1788666887.773926 trunc from 0x000f54 to 0x0074d4 (0x6581 bytes) 000477 1788666887.780872 fallocate 0x037a90 thru 0x03ab91 (0x3102 bytes) 000478 1788666887.786569 trunc from 0x00c16f to 0x010295 (0x4127 bytes) 000479 1788666887.790993 read 0x016fa6 thru 0x01a5fa (0x3655 bytes) 000480 1788666887.793182 punch from 0x0001d1 to 0x0027e0 (0x2610 bytes) 000482 1788666887.799075 write 0x033850 thru 0x03b2ae (0x7a5f bytes) 000484 1788666887.802075 punch from 0x018622 to 0x023941 (0xb320 bytes) 000485 1788666887.806148 mapwrite 0x02498c thru 0x02ad6b (0x63e0 bytes) 000486 1788666887.856039 punch from 0x039971 to 0x03b2ae (0x193e bytes) 000487 1788666887.862123 mapread 0x006559 thru 0x0136be (0xd166 bytes) 000489 1788666887.864838 mapwrite 0x0157d7 thru 0x01ce87 (0x76b1 bytes) 000492 1788666887.888160 mapread 0x01de3f thru 0x01f70a (0x18cc bytes) 000493 1788666887.889591 trunc from 0x020950 to 0x02500e (0x46bf bytes) 000494 1788666887.895199 punch from 0x00a249 to 0x012f08 (0x8cc0 bytes) 000495 1788666887.902605 trunc from 0x03b2af to 0x009823 (0x31a8b bytes) 000496 1788666887.927305 mapread 0x007448 thru 0x009823 (0x23dc bytes) 000498 1788666887.930989 write 0x031033 thru 0x03ffff (0xefcd bytes) 000499 1788666887.933295 read 0x03db37 thru 0x03ffff (0x24c9 bytes) 000500 1788666887.936236 mapread 0x02b9f7 thru 0x02cf06 (0x1510 bytes) 000501 1788666887.950647 trunc from 0x03ec90 to 0x03ffff (0x1370 bytes) 000502 1788666887.967657 trunc from 0x040000 to 0x02d318 (0x12ce7 bytes) 000503 1788666887.981047 fallocate 0x03f233 thru 0x03f46c (0x23a bytes) 000504 1788666887.987458 trunc from 0x01c10f to 0x01d497 (0x1389 bytes) 000507 1788666887.993005 read 0x01b927 thru 0x025740 (0x9e1a bytes) 000508 1788666887.997622 read 0x005173 thru 0x00dcde (0x8b6c bytes) 000509 1788666887.998378 write 0x038cbc thru 0x03ffff (0x7344 bytes) 000511 1788666888.000975 trunc from 0x02ce38 to 0x03588a (0x8a53 bytes) 000512 1788666888.005599 trunc from 0x040000 to 0x03e870 (0x178f bytes) 000513 1788666888.019489 read 0x027ead thru 0x02af8c (0x30e0 bytes) 000514 1788666888.020045 write 0x03f835 thru 0x03ffff (0x7cb bytes) 000517 1788666888.021769 punch from 0x012f49 to 0x019bf5 (0x6cad bytes) 000518 1788666888.026832 punch from 0x014a40 to 0x0187e2 (0x3da3 bytes) 000520 1788666888.032406 read 0x027bb4 thru 0x02e46c (0x68b9 bytes) 000521 1788666888.050170 read 0x0219e9 thru 0x02bcdb (0xa2f3 bytes) 000522 1788666888.051134 punch from 0x03ce1d to 0x03ffff (0x31e3 bytes) 000523 1788666888.064985 punch from 0x00713d to 0x009ecc (0x2d90 bytes) 000524 1788666888.070688 write 0x01bb53 thru 0x02240f (0x68bd bytes) 000525 1788666888.073137 fallocate 0x010c76 thru 0x0125b8 (0x1943 bytes) 000526 1788666888.078414 write 0x037162 thru 0x03f12b (0x7fca bytes) 000528 1788666888.088147 write 0x02421e thru 0x031684 (0xd467 bytes) 000529 1788666888.090419 trunc from 0x0146ed to 0x01652c (0x1e40 bytes) 000530 1788666888.094841 punch from 0x02955d to 0x02d0f4 (0x3b98 bytes) 000531 1788666888.108740 mapwrite 0x012ce7 thru 0x012cf6 (0x10 bytes) 000532 1788666888.122020 fallocate 0x017807 thru 0x025e7e (0xe678 bytes) 000533 1788666888.127106 mapwrite 0x035c82 thru 0x03fa93 (0x9e12 bytes) 000534 1788666888.149995 MIRROR_EXTEND to 2 mirrors 000536 1788666888.800800 fallocate 0x02df6d thru 0x0383c3 (0xa457 bytes) 000537 1788666888.860556 mapwrite 0x004109 thru 0x00cc89 (0x8b81 bytes) 000538 1788666888.921668 trunc from 0x040000 to 0x01ef67 (0x21098 bytes) 000539 1788666889.009471 write 0x022a4d thru 0x02b254 (0x8808 bytes) 000541 1788666889.019213 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2b255): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b255): Mirror 2: 0xbaac9185 (stale) CRC-32 checksum value for chunk [0, 0x2b255): Mirror 1: 0x2aa9a95e Mirror 3: 0x2aa9a95e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b255: skipped 000542 1788666889.769723 read 0x01ab2b thru 0x029fe6 (0xf4bc bytes) 000543 1788666889.784459 trunc from 0x00a03d to 0x00c3b7 (0x237b bytes) 000544 1788666889.814152 read 0x00ac80 thru 0x010c82 (0x6003 bytes) 000545 1788666889.826605 write 0x01bd4c thru 0x023748 (0x79fd bytes) 000546 1788666889.834223 mapread 0x0100e8 thru 0x01bbea (0xbb03 bytes) 000547 1788666889.839831 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b255): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b255): Mirror 2: 0xbaac9185 (stale) Mirror 3: 0x2aa9a95e (stale) CRC-32 checksum value for chunk [0, 0x2b255): Mirror 1: 0xab5a0cd5 Mirror 4: 0xab5a0cd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b255: skipped 000548 1788666890.793553 trunc from 0x02b255 to 0x015af2 (0x15762 bytes) 000550 1788666890.863351 punch from 0x00f945 to 0x015af2 (0x61ae bytes) 000551 1788666890.874601 trunc from 0x015af3 to 0x03d684 (0x27b92 bytes) 000552 1788666890.904452 fallocate 0x0147e2 thru 0x01f84f (0xb06e bytes) 000553 1788666890.918098 trunc from 0x00dfed to 0x011328 (0x333c bytes) 000554 1788666890.931086 read 0x01e1d5 thru 0x01f722 (0x154e bytes) 000555 1788666890.951627 write 0x00e6bd thru 0x00e9d9 (0x31d bytes) 000556 1788666890.960349 fallocate 0x026784 thru 0x02e19d (0x7a1a bytes) 000558 1788666890.967164 mapwrite 0x01ab79 thru 0x01b632 (0xaba bytes) 000559 1788666891.011413 punch from 0x016706 to 0x01fa2b (0x9326 bytes) 000560 1788666891.023935 punch from 0x0057ea to 0x012afd (0xd314 bytes) 000561 1788666891.039798 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d685): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d685): Mirror 2: 0x97038ac0 (stale) Mirror 3: 0x233852e2 (stale) Mirror 4: 0x9de92bc2 (stale) CRC-32 checksum value for chunk [0, 0x3d685): Mirror 1: 0x1cfc4c34 Mirror 5: 0x1cfc4c34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d685: skipped 000562 1788666892.082464 MIRROR_RESYNC 5 mirrors 000563 1788666893.168944 trunc from 0x03d685 to 0x00c268 (0x3141c bytes) 000564 1788666893.228887 trunc from 0x007e04 to 0x0084f3 (0x6f0 bytes) 000565 1788666893.234974 punch from 0x00a2cf to 0x00c268 (0x1f9a bytes) 000566 1788666893.240050 write 0x019613 thru 0x01cf73 (0x3961 bytes) 000567 1788666893.241316 trunc from 0x01cf74 to 0x030d5a (0x13de7 bytes) 000568 1788666893.266144 trunc from 0x004248 to 0x006ef9 (0x2cb2 bytes) 000569 1788666893.273207 fallocate 0x025697 thru 0x031ab1 (0xc41b bytes) 000570 1788666893.279074 punch from 0x00984a to 0x00b910 (0x20c7 bytes) 000571 1788666893.285338 fallocate 0x02795a thru 0x031bd5 (0xa27c bytes) 000572 1788666893.290841 mapread 0x018f06 thru 0x022c2e (0x9d29 bytes) 000573 1788666893.311125 punch from 0x027514 to 0x030d5a (0x9847 bytes) 000574 1788666893.317033 mapwrite 0x004ae3 thru 0x00e493 (0x99b1 bytes) 000575 1788666893.356938 read 0x027415 thru 0x02eef2 (0x7ade bytes) 000576 1788666893.366473 trunc from 0x02df31 to 0x02ef23 (0xff3 bytes) 000577 1788666893.371577 trunc from 0x030d5b to 0x02fd3f (0x101b bytes) 000578 1788666893.390606 trunc from 0x02fd40 to 0x038623 (0x88e4 bytes) 000579 1788666893.427487 trunc from 0x03236d to 0x038623 (0x62b7 bytes) 000580 1788666893.434721 punch from 0x02880b to 0x02df3f (0x5735 bytes) 000581 1788666893.440857 read 0x0024be thru 0x008929 (0x646c bytes) 000582 1788666893.442188 trunc from 0x01be1a to 0x02267a (0x6861 bytes) 000583 1788666893.449024 mapread 0x0159c1 thru 0x01d034 (0x7674 bytes) 000584 1788666893.462857 trunc from 0x0343b4 to 0x038108 (0x3d55 bytes) 000585 1788666893.469172 mapread 0x02aeba thru 0x0360e2 (0xb229 bytes) 000586 1788666893.487096 trunc from 0x038624 to 0x005758 (0x32ecb bytes) 000588 1788666893.518523 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x5759): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5759): Mirror 2: 0xa373d789 (stale) Mirror 3: 0xa373d789 (stale) Mirror 4: 0xa373d789 (stale) Mirror 5: 0xa373d789 (stale) CRC-32 checksum value for chunk [0, 0x5759): Mirror 1: 0xf49304be Mirror 6: 0xf49304be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5759: skipped 000589 1788666894.702575 punch from 0x00456a to 0x005758 (0x11ef bytes) 000590 1788666894.739691 punch from 0x000752 to 0x005758 (0x5007 bytes) 000591 1788666894.744694 mapwrite 0x03d745 thru 0x03ffff (0x28bb bytes) 000592 1788666894.797616 write 0x00b658 thru 0x014c76 (0x961f bytes) 000593 1788666894.824101 trunc from 0x040000 to 0x00b843 (0x347bc bytes) 000594 1788666894.849331 MIRROR_RESYNC 6 mirrors 000595 1788666895.878201 fallocate 0x01dbfd thru 0x01f85c (0x1c60 bytes) 000596 1788666895.905170 read 0x014334 thru 0x01f85c (0xb529 bytes) 000598 1788666895.915121 fallocate 0x021615 thru 0x024235 (0x2c21 bytes) 000599 1788666895.919577 trunc from 0x024236 to 0x0210ce (0x3167 bytes) 000600 1788666895.938098 read 0x004568 thru 0x010082 (0xbb1b bytes) 000601 1788666895.947637 mapwrite 0x017924 thru 0x0189be (0x109b bytes) 000602 1788666895.958618 read 0x000b1f thru 0x0092d1 (0x87b3 bytes) 000603 1788666895.959467 write 0x007b93 thru 0x009324 (0x1792 bytes) 000604 1788666895.961663 fallocate 0x01dc8c thru 0x0267d1 (0x8b46 bytes) 000605 1788666895.970210 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x267d2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x267d2): Mirror 2: 0x604e556b (stale) Mirror 3: 0x604e556b (stale) Mirror 4: 0x604e556b (stale) Mirror 5: 0x604e556b (stale) Mirror 6: 0x604e556b (stale) CRC-32 checksum value for chunk [0, 0x267d2): Mirror 1: 0xc68c4c4c Mirror 7: 0xc68c4c4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x267d2: skipped 000606 1788666896.970550 mapwrite 0x02e3a3 thru 0x0336c0 (0x531e bytes) 000607 1788666897.045504 mapread 0x00bd9f thru 0x00fdfe (0x4060 bytes) 000608 1788666897.057280 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x336c1): Mirror 2: 0x5c3528d3 (stale) Mirror 3: 0x5c3528d3 (stale) Mirror 4: 0x5c3528d3 (stale) Mirror 6: 0x5c3528d3 (stale) Mirror 7: 0x37b42e31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x336c1): Mirror 2: 0x5c3528d3 (stale) Mirror 3: 0x5c3528d3 (stale) Mirror 4: 0x5c3528d3 (stale) Mirror 6: 0x5c3528d3 (stale) Mirror 7: 0x37b42e31 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x336c1: skipped 000609 1788666897.406945 trunc from 0x00896a to 0x0097ce (0xe65 bytes) 000610 1788666897.412849 trunc from 0x0336c1 to 0x033a95 (0x3d5 bytes) 000611 1788666897.440929 trunc from 0x01c3f9 to 0x0284e2 (0xc0ea bytes) 000612 1788666897.445882 mapread 0x018d5b thru 0x01f06e (0x6314 bytes) 000613 1788666897.462949 read 0x016a7c thru 0x025070 (0xe5f5 bytes) 000614 1788666897.468187 write 0x02d05d thru 0x03786e (0xa812 bytes) 000615 1788666897.474864 write 0x02b976 thru 0x0392c3 (0xd94e bytes) 000616 1788666897.481540 punch from 0x01d377 to 0x026e35 (0x9abf bytes) 000617 1788666897.486766 mapread 0x02d833 thru 0x036f4a (0x9718 bytes) 000618 1788666897.488000 read 0x029b6d thru 0x0376ec (0xdb80 bytes) 000619 1788666897.496631 fallocate 0x01e704 thru 0x02e15c (0xfa59 bytes) 000620 1788666897.504889 MIRROR_RESYNC 6 mirrors 000622 1788666899.128326 trunc from 0x0115c5 to 0x01f86b (0xe2a7 bytes) 000623 1788666899.156172 write 0x006019 thru 0x00b9d9 (0x59c1 bytes) 000624 1788666899.166969 punch from 0x021822 to 0x0251b7 (0x3996 bytes) 000625 1788666899.171383 trunc from 0x0328ad to 0x0392c3 (0x6a17 bytes) 000626 1788666899.180148 MIRROR_RESYNC 6 mirrors 000627 1788666900.940312 trunc from 0x0392c4 to 0x02322c (0x16097 bytes) 000628 1788666901.003634 mapread 0x01b2a7 thru 0x0219ce (0x6728 bytes) 000629 1788666901.029744 trunc from 0x00dc80 to 0x01041f (0x27a0 bytes) 000630 1788666901.036155 mapwrite 0x00ba18 thru 0x00c66b (0xc54 bytes) 000631 1788666901.081386 mapwrite 0x01f320 thru 0x02780d (0x84ee bytes) 000633 1788666901.152130 fallocate 0x01c80a thru 0x0286cf (0xbec6 bytes) 000634 1788666901.158779 mapread 0x01d932 thru 0x02780d (0x9edc bytes) 000635 1788666901.161216 mapwrite 0x010c50 thru 0x01b03f (0xa3f0 bytes) 000637 1788666901.199579 punch from 0x00a151 to 0x00c808 (0x26b8 bytes) 000638 1788666901.205594 punch from 0x00ed06 to 0x01b254 (0xc54f bytes) 000639 1788666901.214390 write 0x017d56 thru 0x01b646 (0x38f1 bytes) 000640 1788666901.232199 trunc from 0x01fb3d to 0x02780d (0x7cd1 bytes) 000642 1788666901.246533 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2780e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2780e): Mirror 2: 0x541ab17f (stale) Mirror 3: 0x541ab17f (stale) Mirror 4: 0x541ab17f (stale) Mirror 6: 0x541ab17f (stale) Mirror 7: 0x541ab17f (stale) CRC-32 checksum value for chunk [0, 0x2780e): Mirror 1: 0x73009c8a Mirror 8: 0x73009c8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2780e: skipped 000644 1788666902.432702 punch from 0x01e092 to 0x0228d2 (0x4841 bytes) 000645 1788666902.480852 mapwrite 0x026696 thru 0x0339a6 (0xd311 bytes) 000646 1788666902.566456 mapwrite 0x027245 thru 0x035d70 (0xeb2c bytes) 000647 1788666902.612807 write 0x02626a thru 0x02975f (0x34f6 bytes) 000648 1788666902.621298 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x35d71): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d71): Mirror 2: 0xdf45b312 (stale) Mirror 3: 0xdf45b312 (stale) Mirror 4: 0xdf45b312 (stale) Mirror 6: 0xdf45b312 (stale) Mirror 7: 0xdf45b312 (stale) Mirror 8: 0xad8a7bef (stale) CRC-32 checksum value for chunk [0, 0x35d71): Mirror 1: 0x38bcef38 Mirror 9: 0x38bcef38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d71: skipped 000649 1788666903.645340 write 0x025f27 thru 0x02cc18 (0x6cf2 bytes) 000650 1788666903.725979 MIRROR_RESYNC 8 mirrors 000651 1788666907.297974 write 0x01325d thru 0x0192a1 (0x6045 bytes) 000652 1788666907.358124 mapwrite 0x020912 thru 0x02d22a (0xc919 bytes) 000653 1788666907.440500 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35d71): Mirror 2: 0xd015e73d (stale) Mirror 3: 0xd015e73d (stale) Mirror 6: 0xd015e73d (stale) Mirror 7: 0xd015e73d (stale) Mirror 8: 0xd015e73d (stale) Mirror 9: 0xd015e73d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d71): Mirror 2: 0xd015e73d (stale) Mirror 3: 0xd015e73d (stale) Mirror 6: 0xd015e73d (stale) Mirror 7: 0xd015e73d (stale) Mirror 8: 0xd015e73d (stale) Mirror 9: 0xd015e73d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d71: skipped 000654 1788666908.250422 read 0x029bbb thru 0x02bbaa (0x1ff0 bytes) 000656 1788666908.269893 punch from 0x00efb3 to 0x013b19 (0x4b67 bytes) 000657 1788666908.282641 fallocate 0x039793 thru 0x03f439 (0x5ca7 bytes) 000658 1788666908.296814 trunc from 0x03f43a to 0x01787c (0x27bbd bytes) 000659 1788666908.348165 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1787d): Mirror 3: 0xafeafb7a (stale) Mirror 6: 0xafeafb7a (stale) Mirror 7: 0xafeafb7a (stale) Mirror 8: 0xafeafb7a (stale) Mirror 9: 0xafeafb7a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1787d): Mirror 3: 0xafeafb7a (stale) Mirror 6: 0xafeafb7a (stale) Mirror 7: 0xafeafb7a (stale) Mirror 8: 0xafeafb7a (stale) Mirror 9: 0xafeafb7a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1787d: skipped 000660 1788666908.953442 mapwrite 0x00a229 thru 0x019f8a (0xfd62 bytes) 000661 1788666909.047429 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19f8b): Mirror 3: 0xe291fcb6 (stale) Mirror 7: 0xe291fcb6 (stale) Mirror 8: 0xe291fcb6 (stale) Mirror 9: 0xe291fcb6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19f8b): Mirror 3: 0xe291fcb6 (stale) Mirror 7: 0xe291fcb6 (stale) Mirror 8: 0xe291fcb6 (stale) Mirror 9: 0xe291fcb6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19f8b: skipped 000662 1788666909.625322 write 0x03e21d thru 0x03ffff (0x1de3 bytes) 000663 1788666909.639781 mapread 0x01f569 thru 0x02cf7b (0xda13 bytes) 000664 1788666909.707647 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdcce2656 (stale) Mirror 7: 0xdcce2656 (stale) Mirror 9: 0xdcce2656 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdcce2656 (stale) Mirror 7: 0xdcce2656 (stale) Mirror 9: 0xdcce2656 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000665 1788666910.114136 trunc from 0x040000 to 0x007dde (0x38221 bytes) 000666 1788666910.145998 mapread 0x004db2 thru 0x007dde (0x302d bytes) 000667 1788666910.169772 write 0x000fa3 thru 0x0026f1 (0x174f bytes) 000668 1788666910.175003 write 0x021736 thru 0x02e15a (0xca25 bytes) 000669 1788666910.176869 trunc from 0x02e15b to 0x01cf42 (0x11218 bytes) 000670 1788666910.198142 trunc from 0x01cf43 to 0x03e204 (0x212c2 bytes) 000671 1788666910.212448 mapread 0x029c17 thru 0x03909a (0xf484 bytes) 000672 1788666910.231453 mapwrite 0x0076ff thru 0x008ad8 (0x13da bytes) 000673 1788666910.253827 write 0x00a67d thru 0x011e6d (0x77f1 bytes) 000674 1788666910.266004 read 0x028785 thru 0x02ceaa (0x4726 bytes) 000675 1788666910.266833 trunc from 0x03e205 to 0x007010 (0x371f4 bytes) 000678 1788666910.285190 fallocate 0x01341c thru 0x01add8 (0x79bd bytes) 000680 1788666910.296650 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x7011): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7011): Mirror 3: 0x24badcbd (stale) Mirror 7: 0x24badcbd (stale) Mirror 9: 0x24badcbd (stale) CRC-32 checksum value for chunk [0, 0x7011): Mirror 1: 0xda3017fb Mirror 10: 0xda3017fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7011: skipped 000681 1788666911.514535 punch from 0x006d9b to 0x007010 (0x276 bytes) 000683 1788666911.567849 trunc from 0x007011 to 0x00e5d4 (0x75c4 bytes) 000684 1788666911.626418 trunc from 0x00e5d5 to 0x021cdb (0x13707 bytes) 000686 1788666911.651660 mapwrite 0x01b865 thru 0x026f8d (0xb729 bytes) 000687 1788666911.738849 trunc from 0x026f8e to 0x036878 (0xf8eb bytes) 000688 1788666911.764930 mapread 0x021d81 thru 0x02cd64 (0xafe4 bytes) 000689 1788666911.782878 mapwrite 0x017cef thru 0x026fe3 (0xf2f5 bytes) 000690 1788666911.819186 trunc from 0x024e1e to 0x027b72 (0x2d55 bytes) 000691 1788666911.833844 punch from 0x015323 to 0x018425 (0x3103 bytes) 000692 1788666911.843179 write 0x03f3b8 thru 0x03ffff (0xc48 bytes) 000693 1788666911.845596 mapread 0x010288 thru 0x01dcd3 (0xda4c bytes) 000694 1788666911.879211 write 0x022929 thru 0x02607d (0x3755 bytes) 000695 1788666911.907475 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdcce2656 (stale) Mirror 9: 0xdcce2656 (stale) Mirror 10: 0xfc2b2ef3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdcce2656 (stale) Mirror 9: 0xdcce2656 (stale) Mirror 10: 0xfc2b2ef3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000696 1788666912.436635 read 0x023772 thru 0x0285ac (0x4e3b bytes) 000697 1788666912.446633 trunc from 0x040000 to 0x01f3bd (0x20c42 bytes) 000698 1788666912.476892 mapwrite 0x01b1b5 thru 0x023936 (0x8782 bytes) 000699 1788666912.529627 trunc from 0x023937 to 0x031c19 (0xe2e3 bytes) 000700 1788666912.540936 punch from 0x01ffdf to 0x02508c (0x50ae bytes) 000702 1788666912.546862 mapread 0x028d5c thru 0x031c19 (0x8ebe bytes) 000704 1788666912.562612 read 0x0151c0 thru 0x020c9e (0xbadf bytes) 000705 1788666912.577869 write 0x0019fa thru 0x00428f (0x2896 bytes) 000706 1788666912.579893 punch from 0x0094a7 to 0x00cb94 (0x36ee bytes) 000707 1788666912.587466 read 0x01ae18 thru 0x01c6ce (0x18b7 bytes) 000708 1788666912.589639 write 0x00acc0 thru 0x015eca (0xb20b bytes) 000709 1788666912.601776 trunc from 0x02eaaa to 0x0308c8 (0x1e1f bytes) 000710 1788666912.622480 mapread 0x020276 thru 0x0285f0 (0x837b bytes) 000711 1788666912.624180 fallocate 0x014dd6 thru 0x0182ca (0x34f5 bytes) 000712 1788666912.633859 write 0x02a4f3 thru 0x031997 (0x74a5 bytes) 000713 1788666912.639048 trunc from 0x01c0b6 to 0x02a672 (0xe5bd bytes) 000714 1788666912.686039 write 0x0156b8 thru 0x025188 (0xfad1 bytes) 000715 1788666912.706752 read 0x00c1d6 thru 0x00cd3a (0xb65 bytes) 000716 1788666912.707487 fallocate 0x01ba8d thru 0x029b39 (0xe0ad bytes) 000717 1788666912.720594 trunc from 0x010940 to 0x01bc50 (0xb311 bytes) 000718 1788666912.764207 punch from 0x00171a to 0x00ba2e (0xa315 bytes) 000719 1788666912.773465 trunc from 0x01ba0d to 0x01d6ca (0x1cbe bytes) 000721 1788666912.794386 read 0x00bdf6 thru 0x00dfee (0x21f9 bytes) 000722 1788666912.813586 trunc from 0x012687 to 0x01ff6a (0xd8e4 bytes) 000723 1788666912.854649 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31c1a): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c1a): Mirror 7: 0xfc6e9514 (stale) Mirror 9: 0xfc6e9514 (stale) Mirror 10: 0x798138f9 (stale) CRC-32 checksum value for chunk [0, 0x31c1a): Mirror 1: 0x73bb3f8c Mirror 11: 0x73bb3f8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c1a: skipped 000724 1788666914.273022 mapread 0x006827 thru 0x009fc9 (0x37a3 bytes) 000725 1788666914.301690 mapwrite 0x036d4b thru 0x03d4cd (0x6783 bytes) 000726 1788666914.445437 trunc from 0x03d4ce to 0x01a2b7 (0x23216 bytes) 000727 1788666914.521519 fallocate 0x02b93f thru 0x03835e (0xca20 bytes) 000728 1788666914.527429 fallocate 0x03c067 thru 0x03ffff (0x3f99 bytes) 000729 1788666914.544097 trunc from 0x010cb4 to 0x01881e (0x7b6b bytes) 000730 1788666914.553645 mapread 0x00bc54 thru 0x00e0c1 (0x246e bytes) 000731 1788666914.573359 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1a2b8): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a2b8): Mirror 7: 0xc7114d0b (stale) Mirror 9: 0xc7114d0b (stale) Mirror 10: 0x7942f9f0 (stale) Mirror 11: 0x9555a965 (stale) CRC-32 checksum value for chunk [0, 0x1a2b8): Mirror 1: 0x9555a965 Mirror 12: 0x9555a965 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a2b8: skipped 000733 1788666915.611019 trunc from 0x01a2b8 to 0x02e1a0 (0x13ee9 bytes) 000735 1788666915.673830 mapread 0x01f12d thru 0x01f18a (0x5e bytes) 000736 1788666915.678106 mapwrite 0x012863 thru 0x01aa26 (0x81c4 bytes) 000737 1788666915.704594 write 0x03fe58 thru 0x03ffff (0x1a8 bytes) 000738 1788666915.706388 punch from 0x011e40 to 0x01d4b7 (0xb678 bytes) 000739 1788666915.711032 punch from 0x02418a to 0x02b7aa (0x7621 bytes) 000740 1788666915.724855 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdcce2656 (stale) Mirror 9: 0xdcce2656 (stale) Mirror 11: 0x63e21055 (stale) Mirror 12: 0x8674b14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdcce2656 (stale) Mirror 9: 0xdcce2656 (stale) Mirror 11: 0x63e21055 (stale) Mirror 12: 0x8674b14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000742 1788666916.071028 trunc from 0x040000 to 0x01ce4d (0x231b2 bytes) 000743 1788666916.091035 write 0x03fe49 thru 0x03ffff (0x1b7 bytes) 000744 1788666916.093931 mapwrite 0x030ec1 thru 0x032867 (0x19a7 bytes) 000745 1788666916.133068 mapwrite 0x0155de thru 0x0203ef (0xae12 bytes) 000747 1788666916.166899 mapread 0x036d6a thru 0x03fd20 (0x8fb7 bytes) 000748 1788666916.172652 mapread 0x0220e2 thru 0x0284e0 (0x63ff bytes) 000749 1788666916.179302 trunc from 0x040000 to 0x01a3b8 (0x25c47 bytes) 000750 1788666916.196578 mapread 0x00a7d3 thru 0x014ad0 (0xa2fe bytes) 000751 1788666916.206860 trunc from 0x00012f to 0x00d0a0 (0xcf72 bytes) 000752 1788666916.211090 punch from 0x017488 to 0x01a3b8 (0x2f31 bytes) 000753 1788666916.220712 MIRROR_RESYNC 5 mirrors 000754 1788666917.438204 fallocate 0x03af1f thru 0x03c7b3 (0x1895 bytes) 000755 1788666917.485075 trunc from 0x03c7b4 to 0x03f36c (0x2bb9 bytes) 000756 1788666917.512993 mapread 0x019c2f thru 0x021d50 (0x8122 bytes) 000757 1788666917.537981 punch from 0x028325 to 0x033168 (0xae44 bytes) 000758 1788666917.543335 punch from 0x032c53 to 0x03c2fa (0x96a8 bytes) 000759 1788666917.548197 read 0x0316ae thru 0x03480f (0x3162 bytes) 000760 1788666917.553939 mapwrite 0x00f57a thru 0x019c97 (0xa71e bytes) 000761 1788666917.580224 read 0x019279 thru 0x01bcd3 (0x2a5b bytes) 000762 1788666917.580994 punch from 0x0134d3 to 0x018eff (0x5a2d bytes) 000763 1788666917.585703 trunc from 0x01a07f to 0x01e6b6 (0x4638 bytes) 000764 1788666917.590982 punch from 0x024480 to 0x028fdc (0x4b5d bytes) 000765 1788666917.595520 mapwrite 0x0043a5 thru 0x004586 (0x1e2 bytes) 000767 1788666917.632782 mapread 0x00260d thru 0x006e31 (0x4825 bytes) 000768 1788666917.634319 trunc from 0x03f36d to 0x0048d8 (0x3aa94 bytes) 000769 1788666917.650439 fallocate 0x0043d1 thru 0x012723 (0xe353 bytes) 000770 1788666917.660319 MIRROR_RESYNC 5 mirrors 000771 1788666918.380453 write 0x004cbf thru 0x008cca (0x400c bytes) 000772 1788666918.447707 write 0x0062ca thru 0x007665 (0x139c bytes) 000773 1788666918.448906 mapwrite 0x024980 thru 0x026053 (0x16d4 bytes) 000775 1788666918.522177 write 0x0044b3 thru 0x008d1d (0x486b bytes) 000776 1788666918.524369 read 0x001662 thru 0x0108ed (0xf28c bytes) 000777 1788666918.535672 mapwrite 0x00aa93 thru 0x01a69a (0xfc08 bytes) 000778 1788666918.575684 trunc from 0x026054 to 0x023e08 (0x224b bytes) 000780 1788666918.598205 trunc from 0x01f634 to 0x023e08 (0x47d5 bytes) 000781 1788666918.603673 trunc from 0x023e09 to 0x019750 (0xa6b8 bytes) 000782 1788666918.618529 punch from 0x00614c to 0x013577 (0xd42c bytes) 000783 1788666918.623985 mapwrite 0x01d627 thru 0x02ae36 (0xd810 bytes) 000784 1788666918.684867 mapread 0x01d0bc thru 0x023f8a (0x6ecf bytes) 000785 1788666918.687137 trunc from 0x02ae37 to 0x012ee5 (0x17f51 bytes) 000786 1788666918.707187 mapread 0x00a544 thru 0x00ff19 (0x59d6 bytes) 000788 1788666918.734676 trunc from 0x009ab4 to 0x012ee5 (0x9432 bytes) 000789 1788666918.748914 fallocate 0x03f094 thru 0x03ffff (0xf6c bytes) 000790 1788666918.772421 MIRROR_RESYNC 5 mirrors 000792 1788666919.641992 trunc from 0x040000 to 0x00b804 (0x347fb bytes) 000793 1788666919.690965 read 0x00424a thru 0x008166 (0x3f1d bytes) 000794 1788666919.700935 mapread 0x00997d thru 0x00b804 (0x1e88 bytes) 000795 1788666919.719111 write 0x034e28 thru 0x03ffff (0xb1d8 bytes) 000796 1788666919.722727 mapread 0x02fc8a thru 0x037019 (0x7390 bytes) 000797 1788666919.732541 trunc from 0x040000 to 0x038a08 (0x75f7 bytes) 000798 1788666919.753646 punch from 0x0124f2 to 0x0214dd (0xefec bytes) 000799 1788666919.759988 mapwrite 0x014599 thru 0x01c207 (0x7c6f bytes) 000800 1788666919.796855 write 0x03f3a1 thru 0x03ffff (0xc5f bytes) 000801 1788666919.798590 trunc from 0x03d617 to 0x03ffff (0x29e9 bytes) 000802 1788666919.808969 read 0x03b209 thru 0x03ffff (0x4df7 bytes) 000803 1788666919.828635 write 0x033320 thru 0x035941 (0x2622 bytes) 000804 1788666919.829567 mapwrite 0x003417 thru 0x012f9f (0xfb89 bytes) 000805 1788666919.862741 fallocate 0x018902 thru 0x023318 (0xaa17 bytes) 000806 1788666919.870060 write 0x03b14b thru 0x03ffff (0x4eb5 bytes) 000807 1788666919.873102 read 0x02c15e thru 0x039c7c (0xdb1f bytes) 000808 1788666919.874902 punch from 0x006b9b to 0x01150b (0xa971 bytes) 000809 1788666919.900674 MIRROR_RESYNC 5 mirrors 000810 1788666922.007551 write 0x022987 thru 0x029fb6 (0x7630 bytes) 000811 1788666922.058763 read 0x01a7ac thru 0x01d84d (0x30a2 bytes) 000812 1788666922.065608 trunc from 0x040000 to 0x037446 (0x8bb9 bytes) 000813 1788666922.093502 write 0x0375eb thru 0x03ffff (0x8a15 bytes) 000814 1788666922.099272 mapread 0x012c07 thru 0x018a66 (0x5e60 bytes) 000815 1788666922.116587 fallocate 0x00992e thru 0x00f7a6 (0x5e79 bytes) 000817 1788666922.122350 read 0x027671 thru 0x027853 (0x1e3 bytes) 000818 1788666922.123312 read 0x017c58 thru 0x01e1de (0x6587 bytes) 000819 1788666922.136617 fallocate 0x00c434 thru 0x016eec (0xaab9 bytes) 000820 1788666922.141419 punch from 0x02950e to 0x030d30 (0x7823 bytes) 000821 1788666922.154845 mapwrite 0x01973b thru 0x01d775 (0x403b bytes) 000822 1788666922.169759 punch from 0x036afb to 0x03cb9b (0x60a1 bytes) 000823 1788666922.174206 punch from 0x032799 to 0x033a8d (0x12f5 bytes) 000824 1788666922.182713 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x87654ede (stale) Mirror 9: 0x87654ede (stale) Mirror 11: 0x87654ede (stale) Mirror 12: 0x87654ede (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc3aac39f Mirror 13: 0xc3aac39f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000825 1788666923.366736 trunc from 0x040000 to 0x01738d (0x28c72 bytes) 000826 1788666923.448304 read 0x010126 thru 0x01738d (0x7268 bytes) 000827 1788666923.465620 punch from 0x0044ed to 0x00bf7b (0x7a8f bytes) 000828 1788666923.471726 mapwrite 0x02fe84 thru 0x0329d6 (0x2b53 bytes) 000829 1788666923.526979 punch from 0x012062 to 0x01d2e9 (0xb288 bytes) 000830 1788666923.537679 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x329d7): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329d7): Mirror 7: 0x3ff080b7 (stale) Mirror 9: 0x3ff080b7 (stale) Mirror 11: 0x3ff080b7 (stale) Mirror 12: 0x3ff080b7 (stale) Mirror 13: 0x6f4f34f7 (stale) CRC-32 checksum value for chunk [0, 0x329d7): Mirror 1: 0xff5d2e62 Mirror 14: 0xff5d2e62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329d7: skipped 000831 1788666924.668718 mapwrite 0x019bdc thru 0x022618 (0x8a3d bytes) 000832 1788666924.841769 write 0x003d64 thru 0x00c684 (0x8921 bytes) 000834 1788666924.862815 punch from 0x02a7c3 to 0x0329d6 (0x8214 bytes) 000835 1788666924.868340 read 0x00e08e thru 0x01c93e (0xe8b1 bytes) 000836 1788666924.878108 read 0x013c45 thru 0x01bf4d (0x8309 bytes) 000837 1788666924.879024 write 0x02a75c thru 0x039528 (0xedcd bytes) 000838 1788666924.889180 mapwrite 0x0159f2 thru 0x019420 (0x3a2f bytes) 000839 1788666924.905933 trunc from 0x0270ce to 0x02bcfd (0x4c30 bytes) 000840 1788666924.910090 read 0x011024 thru 0x015020 (0x3ffd bytes) 000841 1788666924.910668 read 0x0138f8 thru 0x01d542 (0x9c4b bytes) 000842 1788666924.911142 read 0x02d05f thru 0x039108 (0xc0aa bytes) 000843 1788666924.911759 mapread 0x03298e thru 0x034539 (0x1bac bytes) 000844 1788666924.912791 trunc from 0x039529 to 0x03fab6 (0x658e bytes) 000845 1788666924.966792 mapwrite 0x0109a9 thru 0x010dfe (0x456 bytes) 000846 1788666924.981137 trunc from 0x03fab7 to 0x01fe84 (0x1fc32 bytes) 000847 1788666925.007215 write 0x00a9dd thru 0x019194 (0xe7b8 bytes) 000848 1788666925.014195 fallocate 0x0187d8 thru 0x01b9c4 (0x31ed bytes) 000849 1788666925.022651 mapread 0x00664d thru 0x012d70 (0xc724 bytes) 000850 1788666925.026210 mapwrite 0x011014 thru 0x0173a1 (0x638e bytes) 000851 1788666925.051833 write 0x02f7df thru 0x03afff (0xb821 bytes) 000852 1788666925.054219 write 0x020783 thru 0x029c5d (0x94db bytes) 000853 1788666925.082812 MIRROR_RESYNC 7 mirrors 000854 1788666926.606009 mapread 0x008792 thru 0x012fc8 (0xa837 bytes) 000855 1788666926.684452 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000856 1788666927.295234 punch from 0x009109 to 0x013286 (0xa17e bytes) 000857 1788666927.342982 read 0x025d62 thru 0x03266d (0xc90c bytes) 000858 1788666927.351011 trunc from 0x03b000 to 0x03a106 (0xef9 bytes) 000859 1788666927.377228 mapread 0x00a0f2 thru 0x017a99 (0xd9a8 bytes) 000860 1788666927.422132 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a107): Mirror 7: 0x9f859415 (stale) Mirror 11: 0x9f859415 (stale) Mirror 13: 0x9f859415 (stale) Mirror 14: 0x9f859415 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a107): Mirror 7: 0x9f859415 (stale) Mirror 11: 0x9f859415 (stale) Mirror 13: 0x9f859415 (stale) Mirror 14: 0x9f859415 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a107: skipped 000861 1788666927.915901 mapwrite 0x03ac00 thru 0x03ffff (0x5400 bytes) 000862 1788666927.994564 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9ad5f97 (stale) Mirror 13: 0x9ad5f97 (stale) Mirror 14: 0x9ad5f97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9ad5f97 (stale) Mirror 13: 0x9ad5f97 (stale) Mirror 14: 0x9ad5f97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000863 1788666928.497173 write 0x01703d thru 0x0258e3 (0xe8a7 bytes) 000864 1788666928.525621 fallocate 0x0140e8 thru 0x014b61 (0xa7a bytes) 000865 1788666928.546798 trunc from 0x040000 to 0x01d613 (0x229ec bytes) 000866 1788666928.571840 read 0x002c09 thru 0x00ff39 (0xd331 bytes) 000868 1788666928.585867 read 0x01a5ab thru 0x01d613 (0x3069 bytes) 000869 1788666928.588784 punch from 0x009f3d to 0x015c67 (0xbd2b bytes) 000870 1788666928.595476 trunc from 0x002c7a to 0x00ff85 (0xd30c bytes) 000871 1788666928.604147 read 0x01681f thru 0x01d613 (0x6df5 bytes) 000872 1788666928.631317 read 0x01a5f1 thru 0x01d613 (0x3023 bytes) 000873 1788666928.631881 write 0x0275e5 thru 0x02dafd (0x6519 bytes) 000874 1788666928.633129 mapread 0x001b06 thru 0x0034e8 (0x19e3 bytes) 000875 1788666928.633968 mapwrite 0x02e9c2 thru 0x0352be (0x68fd bytes) 000876 1788666928.694945 mapwrite 0x002589 thru 0x00b593 (0x900b bytes) 000878 1788666928.721994 fallocate 0x0242a1 thru 0x02e858 (0xa5b8 bytes) 000879 1788666928.728038 trunc from 0x0352bf to 0x02f105 (0x61b9 bytes) 000880 1788666928.745513 punch from 0x004c69 to 0x00c648 (0x79e0 bytes) 000881 1788666928.752071 mapwrite 0x03234c thru 0x036626 (0x42db bytes) 000882 1788666928.815781 write 0x033f7f thru 0x03e996 (0xaa18 bytes) 000883 1788666928.819145 trunc from 0x03e997 to 0x02fd64 (0xec32 bytes) 000884 1788666928.838375 trunc from 0x003c62 to 0x00bf81 (0x8320 bytes) 000885 1788666928.846666 read 0x006ff0 thru 0x011d2e (0xad3f bytes) 000886 1788666928.863707 write 0x00d427 thru 0x014dd1 (0x79ab bytes) 000887 1788666928.865100 fallocate 0x02f288 thru 0x03ce75 (0xdbee bytes) 000888 1788666928.873779 fallocate 0x023b5a thru 0x024a23 (0xeca bytes) 000889 1788666928.881947 write 0x0141d6 thru 0x01b944 (0x776f bytes) 000893 1788666928.886918 mapwrite 0x03cd33 thru 0x03ffff (0x32cd bytes) 000894 1788666928.947325 mapread 0x03ab76 thru 0x03ffff (0x548a bytes) 000896 1788666928.949890 fallocate 0x035760 thru 0x03fc0b (0xa4ac bytes) 000897 1788666928.967881 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x9ad5f97 (stale) Mirror 14: 0x9ad5f97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x9ad5f97 (stale) Mirror 14: 0x9ad5f97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1788666929.230193 trunc from 0x002399 to 0x00b849 (0x94b1 bytes) 000899 1788666929.235204 mapread 0x001417 thru 0x00270a (0x12f4 bytes) 000900 1788666929.244472 mapwrite 0x01e6fa thru 0x020bf9 (0x2500 bytes) 000901 1788666929.263769 trunc from 0x040000 to 0x00db62 (0x3249d bytes) 000902 1788666929.284801 punch from 0x003cdb to 0x00c835 (0x8b5b bytes) 000904 1788666929.290817 punch from 0x00200e to 0x00db62 (0xbb55 bytes) 000905 1788666929.296394 punch from 0x0078b2 to 0x00db62 (0x62b1 bytes) 000906 1788666929.301062 write 0x0142d2 thru 0x02073d (0xc46c bytes) 000907 1788666929.303628 trunc from 0x02073e to 0x03867e (0x17f41 bytes) 000908 1788666929.320474 trunc from 0x03867f to 0x01e3d3 (0x1a2ab bytes) 000909 1788666929.342435 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e3d4): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e3d4): Mirror 13: 0xaf8ecbb3 (stale) Mirror 14: 0xaf8ecbb3 (stale) CRC-32 checksum value for chunk [0, 0x1e3d4): Mirror 1: 0xa21b147 Mirror 15: 0xa21b147 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e3d4: skipped 000910 1788666930.067646 write 0x013ee3 thru 0x019e76 (0x5f94 bytes) 000911 1788666930.125158 MIRROR_RESYNC 4 mirrors 000912 1788666931.040876 write 0x024dc0 thru 0x027bb0 (0x2df1 bytes) 000913 1788666931.064930 mapread 0x002551 thru 0x003c5b (0x170b bytes) 000914 1788666931.080198 mapread 0x01e5eb thru 0x022723 (0x4139 bytes) 000915 1788666931.091603 punch from 0x020eb7 to 0x026e4b (0x5f95 bytes) 000916 1788666931.104360 trunc from 0x027bb1 to 0x01987b (0xe335 bytes) 000917 1788666931.121493 mapread 0x00ffcd thru 0x0188aa (0x88de bytes) 000918 1788666931.130387 trunc from 0x01987c to 0x03d97f (0x24104 bytes) 000919 1788666931.151123 mapread 0x032774 thru 0x037579 (0x4e06 bytes) 000921 1788666931.159579 punch from 0x0260e0 to 0x02cdc7 (0x6ce8 bytes) 000923 1788666931.168146 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d980): Mirror 13: 0x6d6a724f (stale) Mirror 15: 0x6d6a724f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d980): Mirror 13: 0x6d6a724f (stale) Mirror 15: 0x6d6a724f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d980: skipped 000924 1788666931.441357 trunc from 0x02d528 to 0x03c367 (0xee40 bytes) 000925 1788666931.445949 trunc from 0x03d980 to 0x00ff32 (0x2da4d bytes) 000926 1788666931.468941 write 0x002525 thru 0x011b6f (0xf64b bytes) 000927 1788666931.474834 fallocate 0x00d6b9 thru 0x013dd0 (0x6718 bytes) 000928 1788666931.479043 write 0x036592 thru 0x039996 (0x3405 bytes) 000929 1788666931.484742 punch from 0x016028 to 0x019079 (0x3052 bytes) 000931 1788666931.489125 mapwrite 0x010a3b thru 0x016989 (0x5f4f bytes) 000932 1788666931.535892 trunc from 0x039997 to 0x01d51c (0x1c47a bytes) 000933 1788666931.549043 mapread 0x012119 thru 0x0133cc (0x12b4 bytes) 000934 1788666931.549926 write 0x004323 thru 0x0138db (0xf5b9 bytes) 000935 1788666931.553201 read 0x0114fe thru 0x01ce8e (0xb991 bytes) 000936 1788666931.556396 punch from 0x00bf17 to 0x018d1f (0xce09 bytes) 000937 1788666931.577059 mapwrite 0x026308 thru 0x028635 (0x232e bytes) 000939 1788666931.634505 fallocate 0x037999 thru 0x03ffff (0x8667 bytes) 000940 1788666931.641228 read 0x01097c thru 0x019d3c (0x93c1 bytes) 000941 1788666931.656719 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xa105e8e8 (stale) Mirror 15: 0xa105e8e8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf8d4f163 Mirror 16: 0xf8d4f163 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000943 1788666932.542579 MIRROR_RESYNC 4 mirrors 000944 1788666933.211778 trunc from 0x040000 to 0x01fe34 (0x201cb bytes) 000945 1788666933.247375 mapread 0x0008db thru 0x00226c (0x1992 bytes) 000946 1788666933.258967 fallocate 0x00dc00 thru 0x012e8a (0x528b bytes) 000948 1788666933.263402 punch from 0x00e72a to 0x01bcbb (0xd592 bytes) 000949 1788666933.267048 write 0x023e32 thru 0x032476 (0xe645 bytes) 000950 1788666933.268721 mapread 0x005cf4 thru 0x009532 (0x383f bytes) 000951 1788666933.278063 mapread 0x023a77 thru 0x03101e (0xd5a8 bytes) 000952 1788666933.282420 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x32477): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32477): Mirror 13: 0xeab862c4 (stale) Mirror 15: 0xeab862c4 (stale) Mirror 16: 0xeab862c4 (stale) CRC-32 checksum value for chunk [0, 0x32477): Mirror 1: 0x3599d9a6 Mirror 17: 0x3599d9a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32477: skipped 000953 1788666934.042617 mapwrite 0x002962 thru 0x004d80 (0x241f bytes) 000955 1788666934.122503 fallocate 0x00acbc thru 0x01272b (0x7a70 bytes) 000957 1788666934.128949 write 0x010edc thru 0x01f203 (0xe328 bytes) 000958 1788666934.139822 punch from 0x007515 to 0x016879 (0xf365 bytes) 000959 1788666934.154160 trunc from 0x032477 to 0x00495b (0x2db1b bytes) 000960 1788666934.192924 mapwrite 0x035fad thru 0x03ffff (0xa053 bytes) 000961 1788666934.246816 punch from 0x03c6b1 to 0x03ffff (0x394f bytes) 000962 1788666934.251881 trunc from 0x040000 to 0x039775 (0x688a bytes) 000963 1788666934.265198 mapwrite 0x006181 thru 0x008a5b (0x28db bytes) 000964 1788666934.283125 mapwrite 0x034e30 thru 0x03a148 (0x5319 bytes) 000965 1788666934.313905 mapwrite 0x00831a thru 0x00e03e (0x5d25 bytes) 000966 1788666934.328148 mapread 0x00e3f3 thru 0x01910b (0xad19 bytes) 000967 1788666934.338737 write 0x0219a5 thru 0x02ce4a (0xb4a6 bytes) 000968 1788666934.348495 mapwrite 0x01d88b thru 0x02603b (0x87b1 bytes) 000969 1788666934.374532 write 0x03356c thru 0x03ffff (0xca94 bytes) 000970 1788666934.380450 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xf8d4f163 (stale) Mirror 15: 0xf8d4f163 (stale) Mirror 17: 0xb37ef186 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xf8d4f163 (stale) Mirror 15: 0xf8d4f163 (stale) Mirror 17: 0xb37ef186 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000971 1788666934.706563 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xf8d4f163 (stale) Mirror 15: 0xf8d4f163 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xf8d4f163 (stale) Mirror 15: 0xf8d4f163 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000972 1788666935.020474 trunc from 0x040000 to 0x00ff81 (0x3007e bytes) 000973 1788666935.050547 punch from 0x00d00d to 0x00ff81 (0x2f75 bytes) 000974 1788666935.056605 mapwrite 0x02fef7 thru 0x031039 (0x1143 bytes) 000975 1788666935.106783 read 0x02f135 thru 0x031039 (0x1f05 bytes) 000976 1788666935.107916 trunc from 0x01d994 to 0x022859 (0x4ec6 bytes) 000977 1788666935.113613 punch from 0x02cd47 to 0x031039 (0x42f3 bytes) 000978 1788666935.122892 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3103a): Mirror 13: 0xb0b8964a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3103a): Mirror 13: 0xb0b8964a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3103a: skipped 000979 1788666935.436538 trunc from 0x01312a to 0x02266f (0xf546 bytes) 000980 1788666935.440946 trunc from 0x00f20b to 0x01afc3 (0xbdb9 bytes) 000981 1788666935.446751 punch from 0x0011d6 to 0x00bcfa (0xab25 bytes) 000982 1788666935.456120 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000983 1788666935.587178 trunc from 0x03103a to 0x036ce2 (0x5ca9 bytes) 000984 1788666935.614507 trunc from 0x036ce3 to 0x00327c (0x33a66 bytes) 000988 1788666935.633786 write 0x01f931 thru 0x022212 (0x28e2 bytes) 000989 1788666935.638027 trunc from 0x012eb3 to 0x01faa3 (0xcbf1 bytes) 000991 1788666935.650007 fallocate 0x000358 thru 0x000490 (0x139 bytes) 000992 1788666935.655802 read 0x013f7c thru 0x015d76 (0x1dfb bytes) 000994 1788666935.668333 fallocate 0x02a1cd thru 0x02a5ec (0x420 bytes) 000996 1788666935.675660 fallocate 0x030c11 thru 0x03ff77 (0xf367 bytes) 000997 1788666935.680566 mapread 0x00a5f2 thru 0x015b02 (0xb511 bytes) 000999 1788666935.706593 trunc from 0x02a5ed to 0x00dbe8 (0x1ca04 bytes) 001000 1788666935.723584 mapread 0x00aec3 thru 0x00dbe8 (0x2d26 bytes) All operations completed A-OK!