== sanity-flr test 70a: flr mode fsx test ================ 01:42:33 (1788586953) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 6956 skipping zero size read skipping zero length punch hole fallocating to largest ever: 0x30df9 000007 1788586956.525900 fallocate 0x022ee2 thru 0x030df8 (0xdf17 bytes) 000008 1788586956.531149 trunc from 0x007a1a to 0x00c99a (0x4f81 bytes) 000009 1788586956.536213 trunc from 0x0183c8 to 0x01ac3f (0x2878 bytes) 000010 1788586956.540216 fallocate 0x00ea4a thru 0x0161b1 (0x7768 bytes) 000011 1788586956.544622 trunc from 0x01f9e6 to 0x02375a (0x3d75 bytes) 000012 1788586956.548625 mapread 0x0051cf thru 0x013636 (0xe468 bytes) 000013 1788586956.589082 write 0x0189e3 thru 0x0245aa (0xbbc8 bytes) 000015 1788586956.596668 read 0x01e15f thru 0x01e166 (0x8 bytes) 000016 1788586956.597179 read 0x018d7f thru 0x01fc97 (0x6f19 bytes) 000017 1788586956.597713 fallocate 0x011eab thru 0x01a4c5 (0x861b bytes) 000018 1788586956.608820 punch from 0x00869a to 0x012ad4 (0xa43b bytes) 000019 1788586956.615281 mapwrite 0x02303c thru 0x02a137 (0x70fc bytes) fallocating to largest ever: 0x40000 000020 1788586956.666897 fallocate 0x03a5b4 thru 0x03ffff (0x5a4c bytes) 000021 1788586956.675360 trunc from 0x02ca0f to 0x02ee5c (0x244e bytes) 000022 1788586956.681392 punch from 0x029d48 to 0x030df8 (0x70b1 bytes) 000023 1788586956.689350 punch from 0x02c891 to 0x030df8 (0x4568 bytes) 000024 1788586956.698106 trunc from 0x030df9 to 0x0351d6 (0x43de bytes) 000025 1788586956.735274 trunc from 0x02bbfe to 0x0351d6 (0x95d9 bytes) 000026 1788586956.740244 trunc from 0x0351d7 to 0x0030da (0x320fc bytes) 000027 1788586956.758702 punch from 0x000fca to 0x001a19 (0xa50 bytes) 000028 1788586956.764048 mapwrite 0x02175f thru 0x028754 (0x6ff6 bytes) 000029 1788586956.918018 read 0x011bb9 thru 0x01f35f (0xd7a7 bytes) 000030 1788586956.947050 punch from 0x008e3c to 0x018303 (0xf4c8 bytes) 000031 1788586956.953658 trunc from 0x028755 to 0x03254f (0x9dfb bytes) 000032 1788586956.982147 punch from 0x00de05 to 0x01b26e (0xd46a bytes) 000033 1788586956.989317 fallocate 0x02e647 thru 0x0361e4 (0x7b9e bytes) 000035 1788586956.995403 fallocate 0x02b7d8 thru 0x031a18 (0x6241 bytes) 000036 1788586957.002739 fallocate 0x03860d thru 0x03ffff (0x79f3 bytes) 000037 1788586957.007758 fallocate 0x039f51 thru 0x03ffff (0x60af bytes) 000039 1788586957.016797 punch from 0x037a5c to 0x03f726 (0x7ccb bytes) 000040 1788586957.024641 fallocate 0x000cbb thru 0x006ae4 (0x5e2a bytes) 000041 1788586957.032029 write 0x035505 thru 0x038403 (0x2eff bytes) 000042 1788586957.052288 write 0x002f39 thru 0x00a755 (0x781d bytes) 000043 1788586957.063454 mapread 0x019e31 thru 0x0286ca (0xe89a bytes) 000044 1788586957.106266 punch from 0x01a1ef to 0x01aa08 (0x81a bytes) 000045 1788586957.111824 write 0x0334a3 thru 0x034ba6 (0x1704 bytes) 000046 1788586957.112836 fallocate 0x0319bb thru 0x03786a (0x5eb0 bytes) 000047 1788586957.125368 mapread 0x01bec4 thru 0x01e44b (0x2588 bytes) 000049 1788586957.126898 trunc from 0x040000 to 0x03b5b8 (0x4a47 bytes) 000050 1788586957.161734 mapwrite 0x007677 thru 0x00ed9a (0x7724 bytes) 000051 1788586957.231058 trunc from 0x03b5b9 to 0x023453 (0x18165 bytes) 000053 1788586957.270208 MIRROR_EXTEND to 2 mirrors 000054 1788586958.177150 trunc from 0x0097ea to 0x01747b (0xdc92 bytes) 000055 1788586958.205291 punch from 0x021a59 to 0x023453 (0x19fb bytes) 000056 1788586958.210759 mapwrite 0x00222a thru 0x006ec1 (0x4c98 bytes) 000058 1788586958.247301 mapwrite 0x029eaa thru 0x033c01 (0x9d58 bytes) 000059 1788586958.315998 mapwrite 0x019912 thru 0x0288a1 (0xef90 bytes) 000061 1788586958.382021 mapwrite 0x011b3c thru 0x0196bf (0x7b84 bytes) 000062 1788586958.455829 MIRROR_RESYNC 2 mirrors 000063 1788586959.509030 MIRROR_EXTEND to 3 mirrors 000064 1788586960.519732 mapread 0x01aca1 thru 0x0256c8 (0xaa28 bytes) 000065 1788586960.577678 trunc from 0x033c02 to 0x01a0b7 (0x19b4a bytes) 000066 1788586960.652971 fallocate 0x01878d thru 0x028263 (0xfad7 bytes) 000067 1788586960.658403 trunc from 0x009ea1 to 0x00f945 (0x5aa5 bytes) 000068 1788586960.665362 trunc from 0x0232d6 to 0x028263 (0x4f8e bytes) 000069 1788586960.686893 MIRROR_RESYNC 3 mirrors 000070 1788586961.575878 trunc from 0x028264 to 0x01c850 (0xba13 bytes) 000072 1788586961.695070 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1c851): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c851): Mirror 2: 0x60d4bcf4 (stale) Mirror 3: 0x60d4bcf4 (stale) CRC-32 checksum value for chunk [0, 0x1c851): Mirror 1: 0x60d4bcf4 Mirror 4: 0x60d4bcf4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c851: skipped 000073 1788586963.232373 trunc from 0x01c851 to 0x022011 (0x57c1 bytes) 000075 1788586963.345932 trunc from 0x00d03d to 0x017dd3 (0xad97 bytes) 000076 1788586963.352205 trunc from 0x022012 to 0x01aeda (0x7137 bytes) 000077 1788586963.400734 read 0x003685 thru 0x00bc81 (0x85fd bytes) 000078 1788586963.418786 punch from 0x00d191 to 0x0134ca (0x633a bytes) 000079 1788586963.430411 punch from 0x019ba8 to 0x01aeda (0x1333 bytes) 000080 1788586963.439889 trunc from 0x0103e4 to 0x015269 (0x4e86 bytes) 000081 1788586963.451761 write 0x032d65 thru 0x03e7fe (0xba9a bytes) 000082 1788586963.454281 fallocate 0x01c8bf thru 0x023837 (0x6f79 bytes) 000085 1788586963.476596 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 2: 0x116614b2 (stale) Mirror 3: 0x116614b2 (stale) Mirror 4: 0x116614b2 (stale) CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 1: 0x671b626c Mirror 5: 0x671b626c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7ff: skipped 000086 1788586965.034600 trunc from 0x0068ff to 0x01554c (0xec4e bytes) 000087 1788586965.106037 mapwrite 0x02d380 thru 0x030af5 (0x3776 bytes) 000088 1788586965.144306 mapwrite 0x01a2b8 thru 0x026acf (0xc818 bytes) 000089 1788586965.206259 trunc from 0x02712d to 0x032dd0 (0xbca4 bytes) 000090 1788586965.214058 trunc from 0x0390c5 to 0x03e7fe (0x573a bytes) 000091 1788586965.221677 write 0x02b229 thru 0x0313fe (0x61d6 bytes) 000092 1788586965.240844 trunc from 0x0182de to 0x022c43 (0xa966 bytes) 000093 1788586965.248103 trunc from 0x018058 to 0x01a60e (0x25b7 bytes) 000094 1788586965.253589 trunc from 0x0115ce to 0x011a19 (0x44c bytes) 000095 1788586965.259995 trunc from 0x03e7ff to 0x02523c (0x195c2 bytes) 000096 1788586965.287325 punch from 0x021569 to 0x02523c (0x3cd4 bytes) 000097 1788586965.292648 trunc from 0x00da04 to 0x010ae5 (0x30e2 bytes) 000098 1788586965.314475 trunc from 0x02523d to 0x025805 (0x5c9 bytes) 000099 1788586965.360198 read 0x00ca81 thru 0x00dfc0 (0x1540 bytes) 000100 1788586965.374996 mapread 0x0078f8 thru 0x009889 (0x1f92 bytes) 000102 1788586965.399175 MIRROR_RESYNC 5 mirrors 000103 1788586967.568255 read 0x006797 thru 0x00e859 (0x80c3 bytes) 000104 1788586967.577594 write 0x02fc22 thru 0x035d53 (0x6132 bytes) 000105 1788586967.668431 punch from 0x0035c2 to 0x00dd82 (0xa7c1 bytes) 000106 1788586967.681737 fallocate 0x016e77 thru 0x026ca4 (0xfe2e bytes) 000107 1788586967.693944 punch from 0x030b7f to 0x035d53 (0x51d5 bytes) 000108 1788586967.729814 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35d54): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d54): Mirror 2: 0x3af136cb (stale) Mirror 3: 0x3af136cb (stale) Mirror 4: 0x3af136cb (stale) Mirror 5: 0x3af136cb (stale) CRC-32 checksum value for chunk [0, 0x35d54): Mirror 1: 0xe375d482 Mirror 6: 0xe375d482 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d54: skipped 000109 1788586969.240985 trunc from 0x035d54 to 0x02b207 (0xab4c bytes) 000110 1788586969.298315 mapwrite 0x01bdef thru 0x027292 (0xb4a4 bytes) 000111 1788586969.364673 mapwrite 0x020a78 thru 0x021fa5 (0x152e bytes) 000112 1788586969.378723 mapread 0x022393 thru 0x02b207 (0x8e75 bytes) 000113 1788586969.380911 read 0x0031aa thru 0x009591 (0x63e8 bytes) 000115 1788586969.394877 MIRROR_RESYNC 6 mirrors 000116 1788586971.309011 trunc from 0x02b208 to 0x017b4c (0x136bb bytes) 000118 1788586971.386187 fallocate 0x0351c1 thru 0x03ffff (0xae3f bytes) 000119 1788586971.408867 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x17b4d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17b4d): Mirror 2: 0x50602299 (stale) Mirror 3: 0x50602299 (stale) Mirror 4: 0x50602299 (stale) Mirror 5: 0x50602299 (stale) Mirror 6: 0x50602299 (stale) CRC-32 checksum value for chunk [0, 0x17b4d): Mirror 1: 0x50602299 Mirror 7: 0x50602299 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17b4d: skipped 000120 1788586972.929670 write 0x02e6be thru 0x02ec63 (0x5a6 bytes) 000121 1788586972.991031 mapread 0x02b827 thru 0x02ec63 (0x343d bytes) 000122 1788586973.038923 read 0x00bd58 thru 0x00eb1b (0x2dc4 bytes) 000123 1788586973.049255 trunc from 0x02ec64 to 0x004854 (0x2a40f bytes) 000124 1788586973.125881 write 0x02289b thru 0x027ae5 (0x524b bytes) 000125 1788586973.132959 read 0x008193 thru 0x015c12 (0xda80 bytes) 000126 1788586973.175915 read 0x00600c thru 0x010c4d (0xac42 bytes) 000127 1788586973.176696 trunc from 0x0003e9 to 0x0034b4 (0x30cc bytes) 000128 1788586973.196077 write 0x034ed4 thru 0x03f4d6 (0xa603 bytes) 000129 1788586973.234377 mapwrite 0x00778d thru 0x00b830 (0x40a4 bytes) 000130 1788586973.266845 punch from 0x00f374 to 0x01b012 (0xbc9f bytes) 000131 1788586973.278192 trunc from 0x0291eb to 0x03493b (0xb751 bytes) 000132 1788586973.284339 trunc from 0x03f4d7 to 0x02795e (0x17b78 bytes) 000133 1788586973.298710 trunc from 0x02795f to 0x03fac7 (0x18169 bytes) 000134 1788586973.319920 read 0x020623 thru 0x02876f (0x814d bytes) 000135 1788586973.332749 write 0x036617 thru 0x03c8c6 (0x62b0 bytes) 000136 1788586973.334184 punch from 0x019391 to 0x025b43 (0xc7b3 bytes) 000137 1788586973.345717 read 0x03aea3 thru 0x03fac7 (0x4c25 bytes) 000138 1788586973.348841 punch from 0x00c70c to 0x01a817 (0xe10c bytes) 000139 1788586973.354971 write 0x01b0c6 thru 0x0235f9 (0x8534 bytes) 000140 1788586973.382303 punch from 0x0043d4 to 0x004431 (0x5e bytes) 000141 1788586973.390745 fallocate 0x00389b thru 0x00c8ec (0x9052 bytes) 000142 1788586973.403974 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fac8): Mirror 3: 0x743523f9 (stale) Mirror 4: 0x743523f9 (stale) Mirror 5: 0x743523f9 (stale) Mirror 6: 0x743523f9 (stale) Mirror 7: 0x980c90c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fac8): Mirror 3: 0x743523f9 (stale) Mirror 4: 0x743523f9 (stale) Mirror 5: 0x743523f9 (stale) Mirror 6: 0x743523f9 (stale) Mirror 7: 0x980c90c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fac8: skipped 000143 1788586974.113705 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fac8): Mirror 3: 0x743523f9 (stale) Mirror 4: 0x743523f9 (stale) Mirror 5: 0x743523f9 (stale) Mirror 7: 0x980c90c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fac8): Mirror 3: 0x743523f9 (stale) Mirror 4: 0x743523f9 (stale) Mirror 5: 0x743523f9 (stale) Mirror 7: 0x980c90c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fac8: skipped 000144 1788586974.742717 mapread 0x006278 thru 0x00d9c6 (0x774f bytes) 000146 1788586974.802718 fallocate 0x00f3a4 thru 0x010e3f (0x1a9c bytes) 000147 1788586974.809433 trunc from 0x03fac8 to 0x01d1bb (0x2290c bytes) 000148 1788586974.841140 fallocate 0x000750 thru 0x00cef6 (0xc7a7 bytes) 000151 1788586974.854061 read 0x015d05 thru 0x01d1bb (0x74b7 bytes) 000152 1788586974.869453 mapread 0x012a44 thru 0x0199f2 (0x6faf bytes) 000153 1788586974.878240 read 0x000965 thru 0x008b9f (0x823b bytes) 000155 1788586974.885796 mapwrite 0x01135f thru 0x01adde (0x9a80 bytes) 000156 1788586974.916838 mapwrite 0x03d1cc thru 0x03ffff (0x2e34 bytes) 000157 1788586975.009434 fallocate 0x033e06 thru 0x03fa31 (0xbc2c bytes) 000158 1788586975.022290 punch from 0x0094d1 to 0x0176fb (0xe22b bytes) 000159 1788586975.033987 fallocate 0x034095 thru 0x03ffff (0xbf6b bytes) 000160 1788586975.045208 punch from 0x013d76 to 0x01632e (0x25b9 bytes) 000161 1788586975.054813 mapread 0x030120 thru 0x03f9a3 (0xf884 bytes) 000162 1788586975.059742 mapwrite 0x0376ac thru 0x0398b9 (0x220e bytes) 000163 1788586975.078869 mapwrite 0x006c03 thru 0x00acdb (0x40d9 bytes) 000164 1788586975.123779 mapwrite 0x00601c thru 0x00834e (0x2333 bytes) 000166 1788586975.151751 trunc from 0x040000 to 0x015085 (0x2af7a bytes) 000167 1788586975.208947 read 0x009014 thru 0x014713 (0xb700 bytes) 000168 1788586975.233993 mapread 0x014cb6 thru 0x015085 (0x3d0 bytes) 000169 1788586975.244894 write 0x018109 thru 0x01ac3b (0x2b33 bytes) 000170 1788586975.249968 mapread 0x0131d7 thru 0x01ac3b (0x7a65 bytes) 000171 1788586975.275543 MIRROR_RESYNC 5 mirrors 000172 1788586977.278000 trunc from 0x01ac3c to 0x01d7ee (0x2bb3 bytes) 000175 1788586977.355807 trunc from 0x00667d to 0x00c244 (0x5bc8 bytes) 000178 1788586977.370744 trunc from 0x01d7ef to 0x02b68a (0xde9c bytes) 000179 1788586977.388166 mapread 0x019286 thru 0x01beaf (0x2c2a bytes) 000180 1788586977.419421 mapread 0x0173e9 thru 0x0254a1 (0xe0b9 bytes) 000181 1788586977.429406 trunc from 0x00a725 to 0x00b725 (0x1001 bytes) 000182 1788586977.433649 trunc from 0x02b68b to 0x008dda (0x228b0 bytes) 000183 1788586977.447630 fallocate 0x02470f thru 0x025f11 (0x1803 bytes) 000184 1788586977.454229 mapwrite 0x017504 thru 0x018dcc (0x18c9 bytes) 000185 1788586977.497440 mapread 0x0102e9 thru 0x018dcc (0x8ae4 bytes) 000186 1788586977.498752 mapread 0x00a5df thru 0x018dcc (0xe7ee bytes) 000187 1788586977.520039 mapwrite 0x01bc5b thru 0x0249fd (0x8da3 bytes) 000188 1788586977.573948 mapwrite 0x025a28 thru 0x03229e (0xc877 bytes) 000189 1788586977.630189 fallocate 0x0011bc thru 0x003b96 (0x29db bytes) 000190 1788586977.635019 write 0x01e5e1 thru 0x020688 (0x20a8 bytes) 000191 1788586977.636909 mapread 0x00808d thru 0x00b236 (0x31aa bytes) 000192 1788586977.638097 fallocate 0x035da5 thru 0x03b317 (0x5573 bytes) 000193 1788586977.642563 read 0x01e9f4 thru 0x027205 (0x8812 bytes) 000194 1788586977.643587 read 0x0074dc thru 0x015ac0 (0xe5e5 bytes) 000195 1788586977.649089 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b318): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b318): Mirror 3: 0x476c4cd8 (stale) Mirror 4: 0x476c4cd8 (stale) Mirror 5: 0x476c4cd8 (stale) Mirror 7: 0x476c4cd8 (stale) CRC-32 checksum value for chunk [0, 0x3b318): Mirror 1: 0xdfc95726 Mirror 8: 0xdfc95726 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b318: skipped 000197 1788586978.690172 trunc from 0x0029bd to 0x00b627 (0x8c6b bytes) 000198 1788586978.742496 write 0x001c99 thru 0x00f041 (0xd3a9 bytes) 000199 1788586978.762929 write 0x01b194 thru 0x025186 (0x9ff3 bytes) 000200 1788586978.773865 fallocate 0x029c0e thru 0x02cc3b (0x302e bytes) 000201 1788586978.778923 read 0x0285ce thru 0x028c84 (0x6b7 bytes) 000202 1788586978.784628 mapwrite 0x019838 thru 0x01f429 (0x5bf2 bytes) 000204 1788586978.817473 trunc from 0x03b318 to 0x0130e5 (0x28232 bytes) 000205 1788586978.836781 trunc from 0x008e61 to 0x010944 (0x7ae4 bytes) 000206 1788586978.852105 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x130e6): Mirror 3: 0x9618c461 (stale) Mirror 4: 0x9618c461 (stale) Mirror 7: 0x9618c461 (stale) Mirror 8: 0x53620f19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x130e6): Mirror 3: 0x9618c461 (stale) Mirror 4: 0x9618c461 (stale) Mirror 7: 0x9618c461 (stale) Mirror 8: 0x53620f19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x130e6: skipped 000207 1788586979.346169 mapwrite 0x01996d thru 0x023648 (0x9cdc bytes) 000209 1788586979.405408 trunc from 0x003bb8 to 0x00a6b6 (0x6aff bytes) 000210 1788586979.413122 read 0x00b02b thru 0x00cc5a (0x1c30 bytes) 000212 1788586979.420745 punch from 0x01884a to 0x023648 (0xadff bytes) 000213 1788586979.428327 punch from 0x010e55 to 0x015fb9 (0x5165 bytes) 000214 1788586979.436933 MIRROR_RESYNC 5 mirrors 000215 1788586980.743429 mapwrite 0x0373ee thru 0x03afce (0x3be1 bytes) 000216 1788586980.814979 fallocate 0x02077c thru 0x022541 (0x1dc6 bytes) 000217 1788586980.820174 read 0x034ae7 thru 0x03afce (0x64e8 bytes) 000218 1788586980.824981 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3afcf): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afcf): Mirror 3: 0xfd318e25 (stale) Mirror 4: 0xfd318e25 (stale) Mirror 7: 0xfd318e25 (stale) Mirror 8: 0xfd318e25 (stale) CRC-32 checksum value for chunk [0, 0x3afcf): Mirror 1: 0x3fde5b1e Mirror 9: 0x3fde5b1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afcf: skipped 000220 1788586981.768757 punch from 0x0039b3 to 0x004012 (0x660 bytes) 000221 1788586981.814025 read 0x018470 thru 0x0238de (0xb46f bytes) 000222 1788586981.822948 mapwrite 0x006cdb thru 0x0092e8 (0x260e bytes) 000223 1788586981.857951 trunc from 0x03afcf to 0x0150fc (0x25ed2 bytes) 000225 1788586981.886699 read 0x011d91 thru 0x0150fc (0x336c bytes) 000227 1788586981.900906 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x150fd): Mirror 4: 0x33676449 (stale) Mirror 7: 0x33676449 (stale) Mirror 8: 0x33676449 (stale) Mirror 9: 0x33676449 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x150fd): Mirror 4: 0x33676449 (stale) Mirror 7: 0x33676449 (stale) Mirror 8: 0x33676449 (stale) Mirror 9: 0x33676449 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x150fd: skipped 000228 1788586982.206243 read 0x0053f5 thru 0x013b3f (0xe74b bytes) 000229 1788586982.229164 trunc from 0x013932 to 0x0150fc (0x17cb bytes) 000230 1788586982.234441 mapread 0x010057 thru 0x010fb1 (0xf5b bytes) 000231 1788586982.235795 read 0x000e7f thru 0x0083a3 (0x7525 bytes) 000232 1788586982.245659 trunc from 0x0150fd to 0x024e5a (0xfd5e bytes) 000233 1788586982.270961 mapwrite 0x01c851 thru 0x024630 (0x7de0 bytes) 000234 1788586982.301864 trunc from 0x01516c to 0x01bc9d (0x6b32 bytes) 000235 1788586982.306449 fallocate 0x03af48 thru 0x03ffff (0x50b8 bytes) 000237 1788586982.312686 mapwrite 0x00316e thru 0x009fdf (0x6e72 bytes) 000238 1788586982.335654 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x505ca6a0 (stale) Mirror 8: 0x505ca6a0 (stale) Mirror 9: 0x5932a2c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x505ca6a0 (stale) Mirror 8: 0x505ca6a0 (stale) Mirror 9: 0x5932a2c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000239 1788586982.705378 mapread 0x007d0a thru 0x00f469 (0x7760 bytes) 000241 1788586982.725570 trunc from 0x040000 to 0x017cd6 (0x28329 bytes) 000242 1788586982.750344 write 0x02034b thru 0x02e1a4 (0xde5a bytes) 000243 1788586982.753364 read 0x00b8ed thru 0x016dac (0xb4c0 bytes) 000244 1788586982.763381 read 0x012c9d thru 0x022635 (0xf999 bytes) 000245 1788586982.777353 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e1a5): Mirror 8: 0xe7b91f0f (stale) Mirror 9: 0xe7b91f0f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e1a5): Mirror 8: 0xe7b91f0f (stale) Mirror 9: 0xe7b91f0f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e1a5: skipped 000247 1788586983.080139 fallocate 0x03c1ca thru 0x03ffff (0x3e36 bytes) 000248 1788586983.085102 mapread 0x01fd98 thru 0x020d24 (0xf8d bytes) 000249 1788586983.094845 read 0x00ed8c thru 0x01529f (0x6514 bytes) 000250 1788586983.103275 read 0x000f83 thru 0x007716 (0x6794 bytes) 000251 1788586983.129702 trunc from 0x02de9a to 0x033349 (0x54b0 bytes) 000253 1788586983.135715 mapwrite 0x03615a thru 0x03ffff (0x9ea6 bytes) 000254 1788586983.155074 mapwrite 0x028de5 thru 0x02c8a3 (0x3abf bytes) 000255 1788586983.171787 read 0x02b04b thru 0x02c98a (0x1940 bytes) 000257 1788586983.172804 mapwrite 0x01e925 thru 0x02d14c (0xe828 bytes) 000258 1788586983.208124 fallocate 0x0166af thru 0x01cde2 (0x6734 bytes) 000259 1788586983.215415 trunc from 0x003ce3 to 0x007e5e (0x417c bytes) 000260 1788586983.224110 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x505ca6a0 (stale) Mirror 9: 0x5932a2c3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf4ca8dcc Mirror 10: 0xf4ca8dcc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000261 1788586984.413641 read 0x0289ea thru 0x02ee01 (0x6418 bytes) 000262 1788586984.431121 read 0x0168bf thru 0x018e0e (0x2550 bytes) 000263 1788586984.452032 write 0x024307 thru 0x02f1f8 (0xaef2 bytes) 000264 1788586984.504157 trunc from 0x040000 to 0x03298d (0xd672 bytes) 000265 1788586984.547616 trunc from 0x0079e5 to 0x011ade (0xa0fa bytes) 000267 1788586984.557531 trunc from 0x008e13 to 0x00fa4c (0x6c3a bytes) 000268 1788586984.563350 trunc from 0x00d6ff to 0x01c798 (0xf09a bytes) 000269 1788586984.569234 write 0x017826 thru 0x01c559 (0x4d34 bytes) 000270 1788586984.581730 punch from 0x01f8bd to 0x02a6c4 (0xae08 bytes) 000271 1788586984.597798 trunc from 0x03298e to 0x00f4fd (0x23490 bytes) 000272 1788586984.616986 mapread 0x00107d thru 0x00e536 (0xd4ba bytes) 000273 1788586984.697633 write 0x014626 thru 0x01cf8b (0x8966 bytes) 000274 1788586984.704456 write 0x014c64 thru 0x01b64e (0x69eb bytes) 000275 1788586984.706649 trunc from 0x001688 to 0x0107db (0xf154 bytes) 000276 1788586984.714043 read 0x019b22 thru 0x01cf8b (0x346a bytes) 000278 1788586984.716995 write 0x02a9df thru 0x038688 (0xdcaa bytes) 000279 1788586984.719701 write 0x01ddcd thru 0x02117d (0x33b1 bytes) 000281 1788586984.731463 mapwrite 0x01a04c thru 0x029537 (0xf4ec bytes) 000282 1788586984.766622 trunc from 0x034a43 to 0x038688 (0x3c46 bytes) 000284 1788586984.774624 mapread 0x02c04f thru 0x03755c (0xb50e bytes) 000285 1788586984.797994 punch from 0x037eaf to 0x038688 (0x7da bytes) 000287 1788586984.808060 write 0x02cbe4 thru 0x03cab7 (0xfed4 bytes) 000288 1788586984.811784 mapwrite 0x000aad thru 0x00ac43 (0xa197 bytes) 000289 1788586984.875992 fallocate 0x022861 thru 0x0246e7 (0x1e87 bytes) 000290 1788586984.885371 mapwrite 0x0216fd thru 0x028462 (0x6d66 bytes) 000291 1788586984.910999 mapread 0x03a0fd thru 0x03c731 (0x2635 bytes) 000293 1788586984.913459 trunc from 0x02f9fb to 0x03c1fe (0xc804 bytes) 000295 1788586984.920642 punch from 0x007c7c to 0x012cbb (0xb040 bytes) 000296 1788586984.926075 fallocate 0x00426d thru 0x012df6 (0xeb8a bytes) 000297 1788586984.931216 write 0x012bd3 thru 0x0191c3 (0x65f1 bytes) 000298 1788586984.942115 fallocate 0x015463 thru 0x022f5d (0xdafb bytes) 000299 1788586984.950215 mapwrite 0x0351f1 thru 0x03d2b2 (0x80c2 bytes) 000300 1788586985.049422 fallocate 0x02fbe0 thru 0x038088 (0x84a9 bytes) 000301 1788586985.055663 punch from 0x02e90c to 0x033172 (0x4867 bytes) 000302 1788586985.064762 MIRROR_RESYNC 4 mirrors 000303 1788586986.218344 punch from 0x024cee to 0x033d30 (0xf043 bytes) 000304 1788586986.252340 fallocate 0x02b394 thru 0x03b2c2 (0xff2f bytes) 000305 1788586986.257552 trunc from 0x03d2b3 to 0x0143c9 (0x28ee9 bytes) 000306 1788586986.275372 read 0x01324d thru 0x0143c9 (0x117d bytes) 000307 1788586986.281556 punch from 0x007509 to 0x009ceb (0x27e3 bytes) 000308 1788586986.285824 trunc from 0x0143ca to 0x007780 (0xcc49 bytes) 000309 1788586986.303223 punch from 0x003541 to 0x007780 (0x4240 bytes) 000310 1788586986.309381 mapwrite 0x03d563 thru 0x03ffff (0x2a9d bytes) 000311 1788586986.349599 fallocate 0x00fc38 thru 0x01c8f6 (0xccbf bytes) 000312 1788586986.355470 mapread 0x001a04 thru 0x00f6c5 (0xdcc2 bytes) 000313 1788586986.364701 fallocate 0x00589c thru 0x00e754 (0x8eb9 bytes) 000314 1788586986.369586 mapread 0x00662e thru 0x00a100 (0x3ad3 bytes) 000315 1788586986.370920 read 0x01b484 thru 0x0286dc (0xd259 bytes) 000316 1788586986.389101 mapwrite 0x00a13e thru 0x018121 (0xdfe4 bytes) 000317 1788586986.407188 trunc from 0x040000 to 0x01a90c (0x256f3 bytes) 000318 1788586986.420500 trunc from 0x01a785 to 0x01a90c (0x188 bytes) 000319 1788586986.425323 fallocate 0x030b4d thru 0x035a47 (0x4efb bytes) 000320 1788586986.429820 mapread 0x008a19 thru 0x0167f8 (0xdde0 bytes) 000321 1788586986.431417 fallocate 0x00bad6 thru 0x019264 (0xd78f bytes) 000322 1788586986.436497 fallocate 0x000f67 thru 0x003564 (0x25fe bytes) 000323 1788586986.441660 mapwrite 0x01137d thru 0x013790 (0x2414 bytes) 000324 1788586986.457317 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a90d): Mirror 8: 0x42967fb4 (stale) Mirror 9: 0x42967fb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a90d): Mirror 8: 0x42967fb4 (stale) Mirror 9: 0x42967fb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a90d: skipped 000325 1788586986.889891 write 0x03a06f thru 0x03c07c (0x200e bytes) 000326 1788586986.895670 mapwrite 0x01674d thru 0x01e875 (0x8129 bytes) 000327 1788586986.953732 trunc from 0x03c07d to 0x025433 (0x16c49 bytes) 000328 1788586986.972379 trunc from 0x025434 to 0x030685 (0xb252 bytes) 000329 1788586986.998731 mapread 0x01042f thru 0x0142de (0x3eb0 bytes) 000330 1788586987.007687 trunc from 0x030686 to 0x012630 (0x1e055 bytes) 000331 1788586987.024248 trunc from 0x000bdb to 0x00964e (0x8a74 bytes) 000332 1788586987.031919 write 0x034042 thru 0x03fe1f (0xbdde bytes) 000333 1788586987.035082 write 0x0240f8 thru 0x02a737 (0x6640 bytes) 000334 1788586987.047309 trunc from 0x015bb8 to 0x02293f (0xcd88 bytes) 000335 1788586987.053217 read 0x0294da thru 0x02fc38 (0x675f bytes) 000336 1788586987.061423 mapwrite 0x02aec3 thru 0x03a0e6 (0xf224 bytes) 000337 1788586987.101746 write 0x00f658 thru 0x01ded9 (0xe882 bytes) 000340 1788586987.118373 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3fe20): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe20): Mirror 8: 0x8c3c4cee (stale) Mirror 9: 0x8c3c4cee (stale) CRC-32 checksum value for chunk [0, 0x3fe20): Mirror 1: 0x6a532c17 Mirror 10: 0x6a532c17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe20: skipped 000341 1788586988.051066 mapwrite 0x00e478 thru 0x01ce68 (0xe9f1 bytes) 000342 1788586988.184692 trunc from 0x0141a6 to 0x019885 (0x56e0 bytes) 000343 1788586988.190036 punch from 0x02e936 to 0x032f68 (0x4633 bytes) 000344 1788586988.195290 read 0x0110c6 thru 0x01778c (0x66c7 bytes) 000347 1788586988.203108 write 0x03f602 thru 0x03ffff (0x9fe bytes) 000348 1788586988.218201 MIRROR_RESYNC 4 mirrors 000350 1788586989.897984 MIRROR_RESYNC 4 mirrors 000351 1788586990.364879 fallocate 0x0358db thru 0x03bcdd (0x6403 bytes) 000352 1788586990.394875 mapread 0x01a3f8 thru 0x0204c9 (0x60d2 bytes) 000353 1788586990.417535 write 0x013fdd thru 0x023558 (0xf57c bytes) 000354 1788586990.428656 mapwrite 0x013132 thru 0x015c1c (0x2aeb bytes) 000355 1788586990.462449 punch from 0x00fc1c to 0x0169ab (0x6d90 bytes) 000356 1788586990.469867 mapread 0x0114a5 thru 0x01c79d (0xb2f9 bytes) 000357 1788586990.485062 trunc from 0x040000 to 0x02fa24 (0x105db bytes) 000359 1788586990.516471 mapread 0x0091bd thru 0x00cb62 (0x39a6 bytes) 000360 1788586990.530396 trunc from 0x022702 to 0x02fa24 (0xd323 bytes) 000361 1788586990.538116 mapread 0x003569 thru 0x013406 (0xfe9e bytes) 000362 1788586990.540402 trunc from 0x006fb8 to 0x00c149 (0x5192 bytes) 000363 1788586990.546130 mapwrite 0x001e6f thru 0x00fcb4 (0xde46 bytes) 000364 1788586990.601698 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa25): Mirror 8: 0xdf2107d6 (stale) Mirror 9: 0xdf2107d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa25): Mirror 8: 0xdf2107d6 (stale) Mirror 9: 0xdf2107d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa25: skipped 000365 1788586991.160327 mapwrite 0x0308ba thru 0x03ffff (0xf746 bytes) 000366 1788586991.263308 fallocate 0x0205e4 thru 0x02d6f6 (0xd113 bytes) 000367 1788586991.270874 trunc from 0x040000 to 0x0112ad (0x2ed52 bytes) 000368 1788586991.318417 trunc from 0x0112ae to 0x005755 (0xbb58 bytes) 000369 1788586991.336469 write 0x036970 thru 0x03ffff (0x9690 bytes) 000370 1788586991.343364 read 0x00f370 thru 0x0134f9 (0x418a bytes) 000371 1788586991.356300 punch from 0x007b9c to 0x00ecdf (0x7144 bytes) 000372 1788586991.361301 trunc from 0x040000 to 0x02e8dc (0x11723 bytes) 000373 1788586991.385217 trunc from 0x02e8dd to 0x038f98 (0xa6bc bytes) 000374 1788586991.402200 write 0x02af3d thru 0x03885c (0xd920 bytes) 000375 1788586991.424906 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38f99): Mirror 9: 0x572db530 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f99): Mirror 9: 0x572db530 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f99: skipped 000376 1788586991.859963 mapwrite 0x03baff thru 0x03ffff (0x4501 bytes) 000378 1788586991.978188 read 0x00c79b thru 0x01ad08 (0xe56e bytes) 000380 1788586992.003657 read 0x00d4ea thru 0x018b07 (0xb61e bytes) 000381 1788586992.016663 MIRROR_RESYNC 2 mirrors 000382 1788586992.827570 MIRROR_EXTEND to 3 mirrors 000383 1788586993.607206 fallocate 0x0106e5 thru 0x0195f7 (0x8f13 bytes) 000385 1788586993.659659 write 0x002e2a thru 0x01061e (0xd7f5 bytes) 000386 1788586993.686440 read 0x008c66 thru 0x00ea6c (0x5e07 bytes) 000387 1788586993.689363 mapread 0x02df7e thru 0x039ec6 (0xbf49 bytes) 000388 1788586993.751294 read 0x005c11 thru 0x013241 (0xd631 bytes) 000390 1788586993.771275 write 0x02cc07 thru 0x036e66 (0xa260 bytes) 000391 1788586993.772647 trunc from 0x040000 to 0x0226b2 (0x1d94d bytes) 000392 1788586993.800562 fallocate 0x03e6cf thru 0x03ffff (0x1931 bytes) 000393 1788586993.806761 trunc from 0x0226b3 to 0x032a6e (0x103bc bytes) 000394 1788586993.824641 read 0x00331c thru 0x00fbc4 (0xc8a9 bytes) 000395 1788586993.831331 MIRROR_RESYNC 3 mirrors 000396 1788586994.486143 MIRROR_RESYNC 3 mirrors 000397 1788586994.874081 write 0x01355d thru 0x017834 (0x42d8 bytes) 000398 1788586994.932540 punch from 0x02c1f8 to 0x032a6e (0x6877 bytes) 000399 1788586994.937736 write 0x0216d7 thru 0x025d82 (0x46ac bytes) 000400 1788586994.962090 trunc from 0x032a6f to 0x01f1a3 (0x138cb bytes) 000401 1788586995.004852 trunc from 0x01f1a4 to 0x018ae0 (0x66c3 bytes) 000402 1788586995.037610 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18ae1): Mirror 10: 0x8e9f93e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18ae1): Mirror 10: 0x8e9f93e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18ae1: skipped 000403 1788586995.357235 write 0x03b681 thru 0x03ffff (0x497f bytes) 000404 1788586995.368009 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000405 1788586995.514574 trunc from 0x040000 to 0x01ad87 (0x25278 bytes) 000406 1788586995.533393 read 0x002855 thru 0x009fd9 (0x7785 bytes) 000408 1788586995.549667 MIRROR_EXTEND to 2 mirrors 000409 1788586996.092437 fallocate 0x0273da thru 0x033e5b (0xca82 bytes) 000410 1788586996.135269 mapwrite 0x01a50c thru 0x01d7e2 (0x32d7 bytes) 000412 1788586996.169202 mapwrite 0x038666 thru 0x03ffff (0x799a bytes) 000413 1788586996.248734 mapwrite 0x00d3b3 thru 0x01ab46 (0xd794 bytes) 000414 1788586996.284633 fallocate 0x03b457 thru 0x03ef23 (0x3acd bytes) 000415 1788586996.289997 punch from 0x0393ae to 0x03c4c6 (0x3119 bytes) 000416 1788586996.295276 fallocate 0x0006e2 thru 0x00889d (0x81bc bytes) 000417 1788586996.300860 mapread 0x004e41 thru 0x00f78a (0xa94a bytes) 000418 1788586996.309211 fallocate 0x03b77b thru 0x03c782 (0x1008 bytes) 000419 1788586996.317185 punch from 0x00e5a1 to 0x0141c2 (0x5c22 bytes) 000420 1788586996.322267 punch from 0x02ab20 to 0x02cf46 (0x2427 bytes) 000421 1788586996.327217 read 0x028909 thru 0x036e21 (0xe519 bytes) 000422 1788586996.336560 trunc from 0x03c0f2 to 0x03ffff (0x3f0e bytes) 000423 1788586996.341632 punch from 0x03cd4b to 0x03ffff (0x32b5 bytes) 000424 1788586996.346344 trunc from 0x040000 to 0x0239b8 (0x1c647 bytes) 000425 1788586996.364279 trunc from 0x0239b9 to 0x00f904 (0x140b4 bytes) 000426 1788586996.377134 punch from 0x00887d to 0x00f904 (0x7088 bytes) 000427 1788586996.382436 mapread 0x003250 thru 0x00f904 (0xc6b5 bytes) 000428 1788586996.397330 read 0x0039ee thru 0x009f62 (0x6575 bytes) 000429 1788586996.402959 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000430 1788586996.540386 trunc from 0x003f07 to 0x00b3a3 (0x749d bytes) 000431 1788586996.548397 punch from 0x0031f5 to 0x00f22c (0xc038 bytes) 000432 1788586996.555032 read 0x00a74f thru 0x00f904 (0x51b6 bytes) 000434 1788586996.567191 write 0x019665 thru 0x021882 (0x821e bytes) 000435 1788586996.573294 fallocate 0x014afa thru 0x01dbdf (0x90e6 bytes) 000436 1788586996.578714 fallocate 0x037989 thru 0x03ffff (0x8677 bytes) 000439 1788586996.584587 mapwrite 0x01eb98 thru 0x01f711 (0xb7a bytes) 000440 1788586996.600455 fallocate 0x023807 thru 0x02f173 (0xb96d bytes) 000441 1788586996.605208 trunc from 0x040000 to 0x010615 (0x2f9ea bytes) 000442 1788586996.620287 punch from 0x00acaf to 0x010615 (0x5967 bytes) 000444 1788586996.625787 trunc from 0x00625b to 0x00a583 (0x4329 bytes) 000447 1788586996.632748 mapwrite 0x030542 thru 0x03ddb2 (0xd871 bytes) 000448 1788586996.693421 mapread 0x038138 thru 0x03ddb2 (0x5c7b bytes) 000449 1788586996.694493 mapread 0x014e1d thru 0x0219e7 (0xcbcb bytes) 000450 1788586996.716198 read 0x00d907 thru 0x01a04b (0xc745 bytes) 000451 1788586996.717167 write 0x002a66 thru 0x009198 (0x6733 bytes) 000452 1788586996.728285 mapread 0x024b35 thru 0x02bced (0x71b9 bytes) 000453 1788586996.729407 punch from 0x0230aa to 0x030f63 (0xdeba bytes) 000454 1788586996.739101 MIRROR_EXTEND to 2 mirrors 000455 1788586997.349112 read 0x00e9e9 thru 0x015c2b (0x7243 bytes) 000456 1788586997.364556 mapread 0x000330 thru 0x000386 (0x57 bytes) 000457 1788586997.382641 write 0x03268c thru 0x038461 (0x5dd6 bytes) 000459 1788586997.422056 fallocate 0x01b0ce thru 0x0237a6 (0x86d9 bytes) 000460 1788586997.426854 mapread 0x02533d thru 0x02e28b (0x8f4f bytes) 000461 1788586997.444387 write 0x0300ed thru 0x038adb (0x89ef bytes) 000463 1788586997.450469 trunc from 0x033f8b to 0x034da6 (0xe1c bytes) 000464 1788586997.465115 fallocate 0x02aaf2 thru 0x02f5ce (0x4add bytes) 000465 1788586997.469790 write 0x023bfe thru 0x02db82 (0x9f85 bytes) 000466 1788586997.471080 read 0x0128db thru 0x0188d4 (0x5ffa bytes) 000467 1788586997.480000 mapread 0x00034e thru 0x0084f1 (0x81a4 bytes) 000468 1788586997.481332 trunc from 0x03ddb3 to 0x0109ff (0x2d3b3 bytes) 000469 1788586997.502312 mapwrite 0x033e81 thru 0x03c283 (0x8403 bytes) 000470 1788586997.583534 mapwrite 0x024001 thru 0x03394a (0xf94a bytes) 000471 1788586997.669129 punch from 0x02dec6 to 0x0396b3 (0xb7ee bytes) 000472 1788586997.674788 read 0x03bd10 thru 0x03c283 (0x574 bytes) 000473 1788586997.675350 write 0x0021e8 thru 0x00b9f4 (0x980d bytes) 000474 1788586997.676639 punch from 0x00e873 to 0x019c10 (0xb39e bytes) 000475 1788586997.681751 trunc from 0x03c284 to 0x017767 (0x24b1c bytes) 000476 1788586997.702107 write 0x001e71 thru 0x005fbe (0x414e bytes) 000477 1788586997.703357 trunc from 0x017768 to 0x03909f (0x21938 bytes) 000478 1788586997.722124 mapwrite 0x00ba35 thru 0x00db0e (0x20da bytes) 000479 1788586997.742834 read 0x029f3e thru 0x03667a (0xc73d bytes) 000480 1788586997.757494 mapread 0x01accf thru 0x021133 (0x6465 bytes) 000481 1788586997.762203 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x390a0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x390a0): Mirror 2: 0xe0cd8ed (stale) CRC-32 checksum value for chunk [0, 0x390a0): Mirror 1: 0x9aa29dc3 Mirror 3: 0x9aa29dc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x390a0: skipped 000482 1788586998.484360 trunc from 0x0343a1 to 0x03909f (0x4cff bytes) 000483 1788586998.536689 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x390a0): Mirror 2: 0xe0cd8ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x390a0): Mirror 2: 0xe0cd8ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x390a0: skipped 000484 1788586998.822384 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000485 1788586998.941971 trunc from 0x02cc2e to 0x0334cd (0x68a0 bytes) 000486 1788586998.947606 mapread 0x03095c thru 0x037b2a (0x71cf bytes) 000487 1788586998.968379 write 0x034420 thru 0x035903 (0x14e4 bytes) 000488 1788586998.975190 mapwrite 0x00f93e thru 0x01f8d4 (0xff97 bytes) 000489 1788586999.020371 trunc from 0x0051ff to 0x012452 (0xd254 bytes) 000490 1788586999.026834 mapwrite 0x00e968 thru 0x010bf1 (0x228a bytes) 000491 1788586999.052141 mapread 0x00e014 thru 0x0138f7 (0x58e4 bytes) 000492 1788586999.053703 write 0x03c843 thru 0x03ffff (0x37bd bytes) 000493 1788586999.055660 trunc from 0x040000 to 0x01989f (0x26760 bytes) 000494 1788586999.082093 MIRROR_EXTEND to 2 mirrors 000495 1788586999.754305 trunc from 0x0198a0 to 0x0364fc (0x1cc5d bytes) 000496 1788586999.814215 mapwrite 0x004b63 thru 0x014831 (0xfccf bytes) 000497 1788586999.899164 read 0x00197b thru 0x00bc31 (0xa2b7 bytes) 000498 1788586999.904665 mapwrite 0x0329f5 thru 0x036017 (0x3623 bytes) 000499 1788586999.947209 mapread 0x031697 thru 0x0364fc (0x4e66 bytes) 000500 1788586999.949913 trunc from 0x0364fd to 0x00ed6a (0x27792 bytes) 000501 1788586999.981525 trunc from 0x00ed6b to 0x026b11 (0x17da7 bytes) 000502 1788587000.036429 mapwrite 0x013fb4 thru 0x016120 (0x216d bytes) 000503 1788587000.072056 trunc from 0x026b12 to 0x006f7e (0x1fb93 bytes) 000504 1788587000.094930 trunc from 0x0053ee to 0x006f7e (0x1b91 bytes) 000505 1788587000.110032 write 0x02af61 thru 0x038b88 (0xdc28 bytes) 000506 1788587000.126736 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000507 1788587000.301064 trunc from 0x038b89 to 0x000916 (0x38272 bytes) 000508 1788587000.326315 fallocate 0x014f7d thru 0x01e00b (0x908f bytes) 000509 1788587000.339035 mapread 0x00e11b thru 0x01dd18 (0xfbfe bytes) 000510 1788587000.368125 fallocate 0x03b8ba thru 0x03ffff (0x4746 bytes) 000511 1788587000.373418 punch from 0x00c961 to 0x0192f7 (0xc997 bytes) 000513 1788587000.378774 mapread 0x012d5b thru 0x01e00b (0xb2b1 bytes) 000514 1788587000.390221 mapwrite 0x036604 thru 0x036796 (0x193 bytes) 000515 1788587000.425878 punch from 0x0095ec to 0x0118d5 (0x82ea bytes) 000516 1788587000.435262 mapwrite 0x01bbd4 thru 0x027169 (0xb596 bytes) 000517 1788587000.482964 mapwrite 0x016a43 thru 0x01b624 (0x4be2 bytes) 000518 1788587000.501821 mapread 0x035f01 thru 0x036796 (0x896 bytes) 000519 1788587000.502950 write 0x00e1f9 thru 0x01b868 (0xd670 bytes) 000520 1788587000.512863 punch from 0x0129ab to 0x0176ee (0x4d44 bytes) 000521 1788587000.531753 trunc from 0x036797 to 0x02f3ab (0x73eb bytes) 000522 1788587000.551292 trunc from 0x002b48 to 0x01077e (0xdc37 bytes) 000523 1788587000.558442 mapread 0x006925 thru 0x006e14 (0x4f0 bytes) 000524 1788587000.571688 punch from 0x004a15 to 0x00e77e (0x9d6a bytes) 000525 1788587000.578755 read 0x014a29 thru 0x016765 (0x1d3d bytes) 000526 1788587000.586698 write 0x02ea67 thru 0x03b442 (0xc9dc bytes) 000529 1788587000.595075 read 0x0339d5 thru 0x03b442 (0x7a6e bytes) 000530 1788587000.595961 write 0x030f8b thru 0x03ffff (0xf075 bytes) 000531 1788587000.598015 write 0x02b325 thru 0x037420 (0xc0fc bytes) 000532 1788587000.608318 mapwrite 0x0049c7 thru 0x00f5ad (0xabe7 bytes) 000534 1788587000.633247 mapread 0x010ddf thru 0x012fe6 (0x2208 bytes) 000537 1788587000.637180 punch from 0x012f68 to 0x015eb4 (0x2f4d bytes) 000538 1788587000.641350 write 0x0098b5 thru 0x017dc1 (0xe50d bytes) 000539 1788587000.643246 mapread 0x010c4c thru 0x01654e (0x5903 bytes) 000540 1788587000.644887 write 0x00a317 thru 0x00da6f (0x3759 bytes) 000542 1788587000.646354 write 0x020270 thru 0x027c50 (0x79e1 bytes) 000543 1788587000.648104 mapread 0x03467c thru 0x03f90e (0xb293 bytes) 000544 1788587000.649127 trunc from 0x00cb51 to 0x00ff66 (0x3416 bytes) 000545 1788587000.662374 fallocate 0x0167e3 thru 0x020b61 (0xa37f bytes) 000546 1788587000.667456 trunc from 0x03c099 to 0x03ffff (0x3f67 bytes) 000548 1788587000.673493 fallocate 0x014c3e thru 0x023cbb (0xf07e bytes) 000549 1788587000.678305 fallocate 0x009fb5 thru 0x015bf0 (0xbc3c bytes) 000550 1788587000.683263 fallocate 0x00ad76 thru 0x018a57 (0xdce2 bytes) 000551 1788587000.688720 read 0x02fe58 thru 0x0336ea (0x3893 bytes) 000552 1788587000.689612 read 0x02a273 thru 0x033957 (0x96e5 bytes) 000553 1788587000.690381 mapwrite 0x014654 thru 0x01b376 (0x6d23 bytes) 000554 1788587000.707590 fallocate 0x0071e4 thru 0x01577f (0xe59c bytes) 000555 1788587000.712136 read 0x022baa thru 0x028198 (0x55ef bytes) 000556 1788587000.712804 mapread 0x01e5f5 thru 0x01f6bd (0x10c9 bytes) 000557 1788587000.714773 trunc from 0x040000 to 0x001056 (0x3efa9 bytes) 000558 1788587000.728685 read 0x0003e1 thru 0x001056 (0xc76 bytes) 000559 1788587000.730265 trunc from 0x000ab0 to 0x001056 (0x5a7 bytes) 000560 1788587000.734937 fallocate 0x02d14b thru 0x030d63 (0x3c19 bytes) 000563 1788587000.744934 punch from 0x02a400 to 0x02b6d0 (0x12d1 bytes) 000566 1788587000.752028 write 0x03bfd2 thru 0x03ffff (0x402e bytes) 000567 1788587000.753662 fallocate 0x027dd7 thru 0x034ac8 (0xccf2 bytes) 000568 1788587000.759091 write 0x00ca58 thru 0x00d643 (0xbec bytes) 000569 1788587000.774377 trunc from 0x040000 to 0x01f542 (0x20abd bytes) 000570 1788587000.788059 fallocate 0x0094f1 thru 0x018628 (0xf138 bytes) 000571 1788587000.793271 trunc from 0x01f543 to 0x01f66a (0x128 bytes) 000572 1788587000.812760 trunc from 0x01f66b to 0x03364f (0x13fe5 bytes) 000573 1788587000.832465 mapread 0x014180 thru 0x0203ea (0xc26b bytes) 000575 1788587000.840632 trunc from 0x023eb5 to 0x0291a7 (0x52f3 bytes) 000576 1788587000.846643 trunc from 0x033650 to 0x024b47 (0xeb08 bytes) 000577 1788587000.865473 trunc from 0x021bb1 to 0x024720 (0x2b70 bytes) 000579 1788587000.873484 write 0x010264 thru 0x010ff9 (0xd96 bytes) 000581 1788587000.881951 mapwrite 0x016355 thru 0x01c884 (0x6530 bytes) 000582 1788587000.903720 mapwrite 0x006578 thru 0x00ab41 (0x45ca bytes) 000584 1788587000.923417 trunc from 0x01ad1c to 0x024b47 (0x9e2c bytes) 000585 1788587000.929766 punch from 0x00031f to 0x00b760 (0xb442 bytes) 000586 1788587000.935329 trunc from 0x009a5f to 0x00f5ec (0x5b8e bytes) 000588 1788587000.947303 mapwrite 0x0269e5 thru 0x02e1ca (0x77e6 bytes) 000589 1788587001.025916 fallocate 0x0141b4 thru 0x01541d (0x126a bytes) 000590 1788587001.031926 mapread 0x00bd4d thru 0x010695 (0x4949 bytes) 000591 1788587001.058229 write 0x018875 thru 0x026e24 (0xe5b0 bytes) 000593 1788587001.063075 fallocate 0x000daa thru 0x007886 (0x6add bytes) 000594 1788587001.068674 mapread 0x01f467 thru 0x02c05b (0xcbf5 bytes) 000595 1788587001.074392 mapwrite 0x02242f thru 0x0302e5 (0xdeb7 bytes) 000596 1788587001.124222 mapread 0x002e4f thru 0x012cfe (0xfeb0 bytes) 000597 1788587001.170365 mapread 0x02c03d thru 0x0302e5 (0x42a9 bytes) 000598 1788587001.171420 mapread 0x020b0d thru 0x027ed1 (0x73c5 bytes) 000599 1788587001.173069 read 0x02e031 thru 0x02eea0 (0xe70 bytes) 000600 1788587001.178896 MIRROR_EXTEND to 2 mirrors 000601 1788587001.734600 punch from 0x02c046 to 0x0302e5 (0x42a0 bytes) 000602 1788587001.772952 write 0x039dad thru 0x03ffff (0x6253 bytes) 000603 1788587001.779273 mapread 0x02e18a thru 0x034e71 (0x6ce8 bytes) 000605 1788587001.797886 read 0x02b3b1 thru 0x034385 (0x8fd5 bytes) 000606 1788587001.798658 write 0x00c39b thru 0x00c3e4 (0x4a bytes) 000607 1788587001.807285 MIRROR_RESYNC 2 mirrors 000608 1788587002.566183 punch from 0x00001f to 0x00d005 (0xcfe7 bytes) 000609 1788587002.606773 mapwrite 0x02a264 thru 0x032838 (0x85d5 bytes) 000610 1788587002.652208 trunc from 0x00ad4c to 0x017496 (0xc74b bytes) 000611 1788587002.659292 read 0x01cf1e thru 0x028b7e (0xbc61 bytes) 000612 1788587002.674769 mapwrite 0x02dfc3 thru 0x036917 (0x8955 bytes) 000613 1788587002.703595 trunc from 0x040000 to 0x02d407 (0x12bf8 bytes) 000614 1788587002.725923 punch from 0x00a619 to 0x00b440 (0xe28 bytes) 000615 1788587002.729987 punch from 0x016fdd to 0x02188b (0xa8af bytes) 000616 1788587002.736113 write 0x02d22b thru 0x038c4f (0xba25 bytes) 000617 1788587002.738417 trunc from 0x038c50 to 0x008512 (0x3073d bytes) 000618 1788587002.759756 mapread 0x002066 thru 0x008512 (0x64ad bytes) 000619 1788587002.767453 trunc from 0x008513 to 0x0121ee (0x9cdc bytes) 000620 1788587002.786740 read 0x00d89b thru 0x0121ee (0x4954 bytes) 000621 1788587002.795707 fallocate 0x021fe5 thru 0x02bb75 (0x9b91 bytes) 000622 1788587002.804181 MIRROR_RESYNC 2 mirrors 000623 1788587003.270416 mapwrite 0x01e246 thru 0x029cbf (0xba7a bytes) 000624 1788587003.348759 read 0x00c9f3 thru 0x01bfd6 (0xf5e4 bytes) 000625 1788587003.360729 fallocate 0x01f1c9 thru 0x02ce80 (0xdcb8 bytes) 000626 1788587003.365360 mapread 0x017421 thru 0x024a9d (0xd67d bytes) 000627 1788587003.367495 mapwrite 0x0240d0 thru 0x02be76 (0x7da7 bytes) 000629 1788587003.438073 trunc from 0x02be77 to 0x0074b0 (0x249c6 bytes) 000630 1788587003.463733 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) 000631 1788587003.628436 trunc from 0x001b65 to 0x0074b0 (0x594c bytes) 000632 1788587003.636083 fallocate 0x00ad70 thru 0x018e2c (0xe0bd bytes) 000633 1788587003.643365 read 0x004701 thru 0x0074b0 (0x2db0 bytes) 000634 1788587003.653901 fallocate 0x016cee thru 0x01f7bd (0x8ad0 bytes) 000635 1788587003.659489 punch from 0x01f34b to 0x01f7bd (0x473 bytes) 000636 1788587003.665089 fallocate 0x0044bf thru 0x008cc4 (0x4806 bytes) 000637 1788587003.670246 trunc from 0x01db76 to 0x01f7bd (0x1c48 bytes) 000638 1788587003.675082 mapread 0x019def thru 0x01f7bd (0x59cf bytes) 000641 1788587003.697655 trunc from 0x01f7be to 0x01c035 (0x3788 bytes) 000642 1788587003.726986 read 0x006d5c thru 0x010748 (0x99ed bytes) 000643 1788587003.741924 trunc from 0x01c036 to 0x010b1e (0xb517 bytes) 000644 1788587003.759220 mapread 0x0053ea thru 0x006fce (0x1be5 bytes) 000645 1788587003.761387 fallocate 0x012ec1 thru 0x016941 (0x3a81 bytes) 000650 1788587003.777204 trunc from 0x002d79 to 0x006d39 (0x3fc1 bytes) 000651 1788587003.783180 mapwrite 0x03f8f7 thru 0x03ffff (0x709 bytes) 000652 1788587003.833270 write 0x01c12b thru 0x0216b6 (0x558c bytes) 000653 1788587003.854594 MIRROR_EXTEND to 2 mirrors 000654 1788587004.682690 write 0x03f538 thru 0x03fc97 (0x760 bytes) 000656 1788587004.724934 MIRROR_RESYNC 2 mirrors 000657 1788587005.596460 mapwrite 0x02ba1a thru 0x037440 (0xba27 bytes) 000658 1788587005.746921 read 0x006900 thru 0x00c7b3 (0x5eb4 bytes) 000659 1788587005.762386 fallocate 0x037cfc thru 0x03ffff (0x8304 bytes) 000660 1788587005.767255 write 0x01d881 thru 0x023070 (0x57f0 bytes) 000661 1788587005.779718 punch from 0x009076 to 0x00e4d5 (0x5460 bytes) 000662 1788587005.785594 trunc from 0x02ae8b to 0x03547c (0xa5f2 bytes) 000663 1788587005.796155 mapread 0x025f54 thru 0x028bd9 (0x2c86 bytes) 000664 1788587005.797709 fallocate 0x005708 thru 0x013a03 (0xe2fc bytes) 000665 1788587005.803953 punch from 0x031c31 to 0x03ee35 (0xd205 bytes) 000666 1788587005.818004 MIRROR_RESYNC 2 mirrors 000667 1788587006.586382 mapwrite 0x01072c thru 0x010ef1 (0x7c6 bytes) 000668 1788587006.662041 MIRROR_RESYNC 2 mirrors 000669 1788587007.327174 mapwrite 0x00257f thru 0x00ba34 (0x94b6 bytes) 000670 1788587007.455967 trunc from 0x007474 to 0x01284a (0xb3d7 bytes) 000671 1788587007.465138 trunc from 0x00405c to 0x009729 (0x56ce bytes) 000672 1788587007.473373 fallocate 0x00a53c thru 0x011bcb (0x7690 bytes) 000673 1788587007.481941 punch from 0x02588a to 0x026add (0x1254 bytes) 000674 1788587007.490942 trunc from 0x040000 to 0x038b8b (0x7474 bytes) 000675 1788587007.522895 trunc from 0x00579d to 0x00cce5 (0x7549 bytes) 000677 1788587007.530095 punch from 0x036c01 to 0x038b8b (0x1f8b bytes) 000678 1788587007.534895 punch from 0x00ff37 to 0x0156d8 (0x57a2 bytes) 000679 1788587007.543970 punch from 0x01c278 to 0x023ad4 (0x785d bytes) 000680 1788587007.553682 MIRROR_RESYNC 2 mirrors 000681 1788587008.296565 trunc from 0x010682 to 0x01ac0f (0xa58e bytes) 000682 1788587008.342076 trunc from 0x0083ec to 0x0106b0 (0x82c5 bytes) 000683 1788587008.346491 trunc from 0x038b8c to 0x03ae31 (0x22a6 bytes) 000684 1788587008.372901 mapwrite 0x01f06d thru 0x029494 (0xa428 bytes) 000685 1788587008.453143 write 0x0138ca thru 0x0146d7 (0xe0e bytes) 000686 1788587008.473864 MIRROR_RESYNC 2 mirrors 000687 1788587009.221820 write 0x03dcdf thru 0x03ffff (0x2321 bytes) 000688 1788587009.283254 punch from 0x00132d to 0x00de06 (0xcada bytes) 000689 1788587009.291091 trunc from 0x01691a to 0x021c54 (0xb33b bytes) 000690 1788587009.299127 read 0x02e7fa thru 0x032255 (0x3a5c bytes) 000691 1788587009.312339 fallocate 0x0249a2 thru 0x02ca49 (0x80a8 bytes) 000692 1788587009.329062 trunc from 0x016337 to 0x0255f0 (0xf2ba bytes) 000693 1788587009.342621 trunc from 0x02c6dd to 0x03667b (0x9f9f bytes) 000694 1788587009.347976 trunc from 0x040000 to 0x00d937 (0x326c8 bytes) 000695 1788587009.416929 mapwrite 0x0374e5 thru 0x03d629 (0x6145 bytes) 000696 1788587009.580908 read 0x01af4a thru 0x021621 (0x66d8 bytes) 000697 1788587009.619036 fallocate 0x03b9f5 thru 0x03bf00 (0x50c bytes) 000698 1788587009.632421 mapwrite 0x019c24 thru 0x01e830 (0x4c0d bytes) 000699 1788587009.737917 mapread 0x01775f thru 0x02173b (0x9fdd bytes) 000700 1788587009.742968 mapwrite 0x004825 thru 0x005be5 (0x13c1 bytes) 000701 1788587009.799817 write 0x0295e0 thru 0x031ff2 (0x8a13 bytes) 000702 1788587009.802896 trunc from 0x03d62a to 0x03eb0b (0x14e2 bytes) 000703 1788587009.827097 trunc from 0x01913e to 0x027b86 (0xea49 bytes) 000704 1788587009.840693 write 0x03f8c5 thru 0x03ffff (0x73b bytes) 000705 1788587009.841693 mapwrite 0x030b9e thru 0x03c8e0 (0xbd43 bytes) 000707 1788587009.926844 punch from 0x00934d to 0x017da6 (0xea5a bytes) 000708 1788587009.955224 read 0x023270 thru 0x02679d (0x352e bytes) 000709 1788587009.994301 write 0x02df98 thru 0x03cb38 (0xeba1 bytes) 000710 1788587009.997640 trunc from 0x001d18 to 0x00c20c (0xa4f5 bytes) 000711 1788587010.007085 trunc from 0x0263f6 to 0x034830 (0xe43b bytes) 000712 1788587010.050289 trunc from 0x025afe to 0x034018 (0xe51b bytes) 000713 1788587010.057275 trunc from 0x040000 to 0x02b8e8 (0x14717 bytes) 000714 1788587010.116468 trunc from 0x02b8e9 to 0x0223c0 (0x9528 bytes) 000715 1788587010.152807 mapread 0x00d423 thru 0x00fb46 (0x2724 bytes) 000718 1788587010.158570 fallocate 0x03b24d thru 0x03ffff (0x4db3 bytes) 000719 1788587010.168901 trunc from 0x01d516 to 0x0223c0 (0x4eab bytes) 000720 1788587010.175884 write 0x00a32f thru 0x011c76 (0x7948 bytes) 000721 1788587010.195619 MIRROR_RESYNC 2 mirrors 000723 1788587011.086072 trunc from 0x0223c1 to 0x0337f4 (0x11434 bytes) 000724 1788587011.190992 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x337f5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337f5): Mirror 2: 0x29e6abfa (stale) CRC-32 checksum value for chunk [0, 0x337f5): Mirror 1: 0x29e6abfa Mirror 3: 0x29e6abfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337f5: skipped 000725 1788587012.291724 fallocate 0x038ca1 thru 0x03ffff (0x735f bytes) 000726 1788587012.329994 trunc from 0x0337f5 to 0x035fa7 (0x27b3 bytes) 000727 1788587012.354091 trunc from 0x035fa8 to 0x00beb6 (0x2a0f1 bytes) 000728 1788587012.369596 read 0x000baf thru 0x00232e (0x1780 bytes) 000729 1788587012.380256 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xbeb7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbeb7): Mirror 2: 0x21b77523 (stale) Mirror 3: 0x21b77523 (stale) CRC-32 checksum value for chunk [0, 0xbeb7): Mirror 1: 0x21b77523 Mirror 4: 0x21b77523 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbeb7: skipped 000730 1788587013.455734 mapwrite 0x0124ef thru 0x020d12 (0xe824 bytes) 000731 1788587013.703220 fallocate 0x0252e0 thru 0x026fcd (0x1cee bytes) 000732 1788587013.708160 fallocate 0x00e636 thru 0x0160f1 (0x7abc bytes) 000733 1788587013.715266 read 0x0258aa thru 0x026fcd (0x1724 bytes) 000734 1788587013.729061 read 0x00734e thru 0x015683 (0xe336 bytes) 000735 1788587013.744235 trunc from 0x026fce to 0x004521 (0x22aac bytes) 000736 1788587013.763042 trunc from 0x00360d to 0x004521 (0xf15 bytes) 000737 1788587013.767951 punch from 0x002a6e to 0x004521 (0x1ab4 bytes) 000738 1788587013.773053 mapread 0x0013f9 thru 0x002a55 (0x165d bytes) 000739 1788587013.778706 mapwrite 0x02d6df thru 0x03482a (0x714c bytes) 000740 1788587013.824674 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3482b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3482b): Mirror 2: 0x3bd2864e (stale) Mirror 3: 0x3bd2864e (stale) Mirror 4: 0x24bd412d (stale) CRC-32 checksum value for chunk [0, 0x3482b): Mirror 1: 0x7d541b18 Mirror 5: 0x7d541b18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3482b: skipped 000741 1788587014.637129 mapwrite 0x03bd13 thru 0x03ffff (0x42ed bytes) 000742 1788587014.780791 mapread 0x030ac0 thru 0x039718 (0x8c59 bytes) 000743 1788587014.798777 trunc from 0x040000 to 0x01eaf4 (0x2150b bytes) 000744 1788587014.830811 trunc from 0x01aab4 to 0x01eaf4 (0x4041 bytes) 000745 1788587014.837431 trunc from 0x01eaf5 to 0x032b9f (0x140ab bytes) 000747 1788587014.860569 read 0x00c14a thru 0x014d3a (0x8bf1 bytes) 000748 1788587014.872958 punch from 0x030dbd to 0x032b9f (0x1de3 bytes) 000749 1788587014.878273 mapwrite 0x008dba thru 0x015761 (0xc9a8 bytes) 000750 1788587014.937208 read 0x02d4e9 thru 0x03207b (0x4b93 bytes) 000752 1788587014.948771 fallocate 0x0273ac thru 0x03213e (0xad93 bytes) 000754 1788587014.956523 mapwrite 0x0214c6 thru 0x02fe98 (0xe9d3 bytes) 000755 1788587014.977967 read 0x0270c7 thru 0x02d00e (0x5f48 bytes) 000756 1788587014.978731 read 0x012b24 thru 0x01c707 (0x9be4 bytes) 000757 1788587014.980424 mapread 0x008e7a thru 0x00faa8 (0x6c2f bytes) 000758 1788587014.982524 punch from 0x023d65 to 0x0264f8 (0x2794 bytes) 000759 1788587014.987925 read 0x008d76 thru 0x0115d6 (0x8861 bytes) 000760 1788587014.991734 read 0x0296e1 thru 0x02c70c (0x302c bytes) 000762 1788587014.994540 fallocate 0x03e388 thru 0x03ffff (0x1c78 bytes) 000763 1788587015.003812 mapwrite 0x02f970 thru 0x037897 (0x7f28 bytes) 000764 1788587015.055102 read 0x02b468 thru 0x0367fe (0xb397 bytes) 000765 1788587015.055865 mapread 0x01c71a thru 0x024af0 (0x83d7 bytes) 000766 1788587015.062870 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37898): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37898): Mirror 2: 0xfed50dca (stale) Mirror 3: 0xfed50dca (stale) Mirror 4: 0x2053b40d (stale) Mirror 5: 0x6af85f41 (stale) CRC-32 checksum value for chunk [0, 0x37898): Mirror 1: 0xa82377e3 Mirror 6: 0xa82377e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37898: skipped 000767 1788587016.072910 fallocate 0x017f32 thru 0x01a6fe (0x27cd bytes) 000768 1788587016.161955 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37898): Mirror 2: 0xfed50dca (stale) Mirror 3: 0xfed50dca (stale) Mirror 4: 0x2053b40d (stale) Mirror 6: 0xa82377e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37898): Mirror 2: 0xfed50dca (stale) Mirror 3: 0xfed50dca (stale) Mirror 4: 0x2053b40d (stale) Mirror 6: 0xa82377e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37898: skipped 000769 1788587016.725379 trunc from 0x011cf8 to 0x0162a9 (0x45b2 bytes) 000770 1788587016.731825 trunc from 0x037898 to 0x037f60 (0x6c9 bytes) 000771 1788587016.790194 read 0x009edb thru 0x015510 (0xb636 bytes) 000772 1788587016.803190 mapread 0x0234b3 thru 0x027cbf (0x480d bytes) 000773 1788587016.821688 punch from 0x020bb7 to 0x0218cf (0xd19 bytes) 000774 1788587016.826820 mapread 0x00861f thru 0x00f276 (0x6c58 bytes) 000775 1788587016.834638 mapwrite 0x022274 thru 0x030525 (0xe2b2 bytes) 000776 1788587016.863831 trunc from 0x037f61 to 0x03af33 (0x2fd3 bytes) 000778 1788587016.886115 trunc from 0x02d829 to 0x03a073 (0xc84b bytes) 000779 1788587016.898890 MIRROR_RESYNC 5 mirrors 000780 1788587018.339060 mapread 0x01b96a thru 0x02685b (0xaef2 bytes) 000781 1788587018.368893 punch from 0x01c9b7 to 0x0255bb (0x8c05 bytes) 000782 1788587018.415085 write 0x024589 thru 0x033ee6 (0xf95e bytes) 000783 1788587018.445387 trunc from 0x00d7e1 to 0x013c62 (0x6482 bytes) 000784 1788587018.457175 trunc from 0x03af34 to 0x00a1ab (0x30d88 bytes) 000786 1788587018.487975 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 2: 0x9f06b293 (stale) Mirror 3: 0x9f06b293 (stale) Mirror 6: 0x9f06b293 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 2: 0x9f06b293 (stale) Mirror 3: 0x9f06b293 (stale) Mirror 6: 0x9f06b293 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1ac: skipped 000787 1788587018.866031 trunc from 0x00483f to 0x0082ae (0x3a70 bytes) 000788 1788587018.878016 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 2: 0x9f06b293 (stale) Mirror 6: 0x9f06b293 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 2: 0x9f06b293 (stale) Mirror 6: 0x9f06b293 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1ac: skipped 000789 1788587019.158124 punch from 0x005903 to 0x00a1ab (0x48a9 bytes) 000790 1788587019.164022 read 0x001b9e thru 0x00a1ab (0x860e bytes) 000792 1788587019.173898 punch from 0x00374f to 0x00a1ab (0x6a5d bytes) 000793 1788587019.180091 mapread 0x005a86 thru 0x00a1ab (0x4726 bytes) 000794 1788587019.199685 trunc from 0x007e28 to 0x00a1ab (0x2384 bytes) 000795 1788587019.205449 punch from 0x004ee9 to 0x00a1ab (0x52c3 bytes) 000796 1788587019.215322 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 2: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 2: 0x9f06b293 (stale) Mirror 6: 0x9f06b293 (stale) CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 1: 0x2ea19a2b Mirror 7: 0x2ea19a2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1ac: skipped 000797 1788587020.315268 punch from 0x007c45 to 0x00a1ab (0x2567 bytes) 000798 1788587020.360870 mapread 0x002845 thru 0x00a1ab (0x7967 bytes) 000799 1788587020.380767 trunc from 0x0054ce to 0x00a1ab (0x4cde bytes) 000800 1788587020.385835 punch from 0x002277 to 0x004864 (0x25ee bytes) 000802 1788587020.395995 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 6: 0x9f06b293 (stale) Mirror 7: 0x2ea19a2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1ac): Mirror 6: 0x9f06b293 (stale) Mirror 7: 0x2ea19a2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1ac: skipped 000803 1788587020.694384 read 0x0020d1 thru 0x007e1b (0x5d4b bytes) 000804 1788587020.703980 mapwrite 0x025728 thru 0x02fff2 (0xa8cb bytes) 000805 1788587020.786637 mapwrite 0x03fa20 thru 0x03ffff (0x5e0 bytes) 000806 1788587020.825652 mapread 0x01a493 thru 0x020950 (0x64be bytes) 000807 1788587020.836936 trunc from 0x015808 to 0x020125 (0xa91e bytes) 000808 1788587020.842379 fallocate 0x0107c9 thru 0x01cf50 (0xc788 bytes) 000809 1788587020.854148 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf3a38d23 (stale) Mirror 7: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd9bb7b4a Mirror 8: 0xd9bb7b4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000811 1788587022.096869 punch from 0x01f94c to 0x025e98 (0x654d bytes) 000812 1788587022.149257 trunc from 0x035191 to 0x03ffff (0xae6f bytes) 000813 1788587022.155793 write 0x01b267 thru 0x0207df (0x5579 bytes) 000814 1788587022.175830 read 0x029689 thru 0x038133 (0xeaab bytes) 000815 1788587022.189439 write 0x003da8 thru 0x0066f3 (0x294c bytes) 000817 1788587022.200636 fallocate 0x03da88 thru 0x03ffff (0x2578 bytes) 000818 1788587022.212001 trunc from 0x040000 to 0x01b59b (0x24a64 bytes) 000819 1788587022.237964 mapwrite 0x030e4f thru 0x036391 (0x5543 bytes) 000820 1788587022.337364 trunc from 0x031968 to 0x036391 (0x4a2a bytes) 000821 1788587022.350922 mapwrite 0x003a0c thru 0x006fe4 (0x35d9 bytes) 000822 1788587022.391249 mapread 0x01f472 thru 0x02185a (0x23e9 bytes) 000823 1788587022.411897 mapwrite 0x03661d thru 0x03fbb4 (0x9598 bytes) 000824 1788587022.488339 mapwrite 0x000e4e thru 0x01083e (0xf9f1 bytes) 000825 1788587022.537134 read 0x03e1b5 thru 0x03fbb4 (0x1a00 bytes) 000826 1788587022.538221 read 0x014abf thru 0x01e975 (0x9eb7 bytes) 000828 1788587022.540800 fallocate 0x019640 thru 0x026b9a (0xd55b bytes) 000829 1788587022.551955 trunc from 0x0395cd to 0x03df8a (0x49be bytes) 000830 1788587022.561039 write 0x001b6c thru 0x0031b0 (0x1645 bytes) 000831 1788587022.562923 trunc from 0x03fbb5 to 0x016d3e (0x28e76 bytes) 000832 1788587022.586938 trunc from 0x016d3f to 0x02476e (0xda30 bytes) 000833 1788587022.616611 trunc from 0x02476f to 0x02d68b (0x8f1d bytes) 000834 1788587022.637738 read 0x00884e thru 0x011432 (0x8be5 bytes) 000835 1788587022.638580 write 0x03e9c4 thru 0x03ffff (0x163c bytes) 000836 1788587022.640659 write 0x02a5f4 thru 0x032d37 (0x8744 bytes) 000837 1788587022.650477 write 0x03c287 thru 0x03ffff (0x3d79 bytes) 000838 1788587022.651563 trunc from 0x040000 to 0x006b36 (0x394c9 bytes) 000839 1788587022.675081 fallocate 0x000ae8 thru 0x002a15 (0x1f2e bytes) 000840 1788587022.680619 fallocate 0x03d8a0 thru 0x03da3a (0x19b bytes) 000842 1788587022.690082 fallocate 0x03fe72 thru 0x03ffff (0x18e bytes) 000844 1788587022.702906 MIRROR_RESYNC 4 mirrors 000845 1788587023.905148 trunc from 0x03da3b to 0x003bca (0x39e70 bytes) 000846 1788587024.015197 read 0x00053b thru 0x003bca (0x3690 bytes) 000847 1788587024.036229 punch from 0x003331 to 0x003bca (0x89a bytes) 000848 1788587024.048741 trunc from 0x0028c3 to 0x002db4 (0x4f2 bytes) 000850 1788587024.056042 trunc from 0x003bcb to 0x01353a (0xf970 bytes) 000851 1788587024.103670 mapwrite 0x035b6a thru 0x03d7ca (0x7c61 bytes) 000852 1788587024.179798 read 0x01f48d thru 0x0224af (0x3023 bytes) 000853 1788587024.194369 mapwrite 0x008698 thru 0x00f000 (0x6969 bytes) 000854 1788587024.229327 write 0x02dc01 thru 0x031d88 (0x4188 bytes) 000855 1788587024.232660 punch from 0x02e4a7 to 0x02fc4d (0x17a7 bytes) 000857 1788587024.268890 trunc from 0x009d6f to 0x014b5a (0xadec bytes) 000858 1788587024.282358 read 0x0343d2 thru 0x03d7ca (0x93f9 bytes) 000859 1788587024.283162 mapread 0x0319e3 thru 0x03d7ca (0xbde8 bytes) 000860 1788587024.287577 trunc from 0x011960 to 0x013367 (0x1a08 bytes) 000861 1788587024.295881 mapread 0x02e7b2 thru 0x033d32 (0x5581 bytes) 000863 1788587024.322236 trunc from 0x00b217 to 0x0158b0 (0xa69a bytes) 000864 1788587024.347570 MIRROR_RESYNC 4 mirrors 000865 1788587025.791714 mapread 0x0186ba thru 0x021dda (0x9721 bytes) 000866 1788587025.843035 MIRROR_RESYNC 4 mirrors 000867 1788587026.313422 trunc from 0x011d36 to 0x01c942 (0xac0d bytes) 000868 1788587026.372876 punch from 0x034afa to 0x03d707 (0x8c0e bytes) 000869 1788587026.379456 mapwrite 0x0220af thru 0x023f7e (0x1ed0 bytes) 000870 1788587026.417192 mapread 0x00c514 thru 0x0167c7 (0xa2b4 bytes) 000871 1788587026.461799 trunc from 0x03d7cb to 0x02c9aa (0x10e20 bytes) 000872 1788587026.494218 trunc from 0x02c9ab to 0x02d14a (0x7a0 bytes) 000873 1788587026.524006 mapwrite 0x007e6d thru 0x017b69 (0xfcfd bytes) 000875 1788587026.560961 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d14b): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d14b): Mirror 6: 0xfba977a7 (stale) Mirror 7: 0xfba977a7 (stale) Mirror 8: 0xfba977a7 (stale) CRC-32 checksum value for chunk [0, 0x2d14b): Mirror 1: 0x3b03cf29 Mirror 9: 0x3b03cf29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d14b: skipped 000876 1788587028.006640 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d14b): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d14b): Mirror 6: 0xfba977a7 (stale) Mirror 7: 0xfba977a7 (stale) Mirror 8: 0xfba977a7 (stale) CRC-32 checksum value for chunk [0, 0x2d14b): Mirror 1: 0x3b03cf29 Mirror 9: 0x3b03cf29 Mirror 10: 0x3b03cf29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d14b: skipped 000877 1788587029.115613 mapwrite 0x00e58a thru 0x019966 (0xb3dd bytes) 000878 1788587029.271390 punch from 0x015bbb to 0x020e35 (0xb27b bytes) 000879 1788587029.278220 write 0x003d9b thru 0x010aa2 (0xcd08 bytes) 000880 1788587029.290446 mapread 0x007373 thru 0x00ef32 (0x7bc0 bytes) 000881 1788587029.293642 trunc from 0x01ba84 to 0x01f716 (0x3c93 bytes) 000882 1788587029.301576 mapread 0x01cbb6 thru 0x029cf9 (0xd144 bytes) 000883 1788587029.343792 read 0x025e61 thru 0x02d14a (0x72ea bytes) 000885 1788587029.348178 trunc from 0x02d14b to 0x00024e (0x2cefc bytes) 000886 1788587029.383577 mapread 0x00005a thru 0x00024e (0x1f5 bytes) 000887 1788587029.394094 read 0x00008d thru 0x00024e (0x1c2 bytes) 000888 1788587029.394955 trunc from 0x00024f to 0x0312ea (0x3109c bytes) 000889 1788587029.423701 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x312eb): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x312eb): Mirror 6: 0xbb2c97d9 (stale) Mirror 7: 0xbb2c97d9 (stale) Mirror 8: 0xbb2c97d9 (stale) Mirror 9: 0x86f12976 (stale) Mirror 10: 0x86f12976 (stale) CRC-32 checksum value for chunk [0, 0x312eb): Mirror 1: 0x2ed25989 Mirror 11: 0x2ed25989 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x312eb: skipped 000890 1788587030.616296 mapwrite 0x02cdd5 thru 0x037be4 (0xae10 bytes) 000892 1788587030.820105 write 0x0176fe thru 0x01ce62 (0x5765 bytes) 000893 1788587030.832093 trunc from 0x037be5 to 0x0107dc (0x27408 bytes) 000895 1788587030.854576 mapwrite 0x024b9d thru 0x0309ff (0xbe63 bytes) 000896 1788587030.936142 read 0x01f39c thru 0x029189 (0x9dee bytes) 000897 1788587030.937044 fallocate 0x006b53 thru 0x008927 (0x1dd5 bytes) 000898 1788587030.942246 mapread 0x0168ea thru 0x023a20 (0xd137 bytes) 000899 1788587030.956222 trunc from 0x030a00 to 0x0119a3 (0x1f05c bytes) 000900 1788587030.993490 read 0x005f09 thru 0x00a2c9 (0x43c1 bytes) 000901 1788587031.019563 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x119a4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x119a4): Mirror 6: 0xb35d889d (stale) Mirror 7: 0xb35d889d (stale) Mirror 8: 0xb35d889d (stale) Mirror 9: 0x511108db (stale) Mirror 10: 0x511108db (stale) Mirror 11: 0x887b178 (stale) CRC-32 checksum value for chunk [0, 0x119a4): Mirror 1: 0x887b178 Mirror 12: 0x887b178 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x119a4: skipped 000902 1788587032.371897 punch from 0x0083e2 to 0x0119a3 (0x95c2 bytes) 000903 1788587032.426941 fallocate 0x03df27 thru 0x03ffff (0x20d9 bytes) 000904 1788587032.435172 trunc from 0x040000 to 0x00cf82 (0x3307d bytes) 000905 1788587032.460115 mapwrite 0x02be97 thru 0x0325a4 (0x670e bytes) 000907 1788587032.558944 read 0x00b1a3 thru 0x0185c5 (0xd423 bytes) 000908 1788587032.579447 read 0x02cca2 thru 0x03206f (0x53ce bytes) 000910 1788587032.581281 read 0x0265c5 thru 0x02fe67 (0x98a3 bytes) 000911 1788587032.604495 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x325a5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x325a5): Mirror 6: 0x1f0bfeb5 (stale) Mirror 7: 0x1f0bfeb5 (stale) Mirror 8: 0x1f0bfeb5 (stale) Mirror 9: 0xa50eb67d (stale) Mirror 10: 0xa50eb67d (stale) Mirror 11: 0xb0580c77 (stale) Mirror 12: 0xb0580c77 (stale) CRC-32 checksum value for chunk [0, 0x325a5): Mirror 1: 0x7df68636 Mirror 13: 0x7df68636 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x325a5: skipped 000912 1788587033.998142 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x325a5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x325a5): Mirror 6: 0x1f0bfeb5 (stale) Mirror 7: 0x1f0bfeb5 (stale) Mirror 8: 0x1f0bfeb5 (stale) Mirror 9: 0xa50eb67d (stale) Mirror 10: 0xa50eb67d (stale) Mirror 11: 0xb0580c77 (stale) Mirror 12: 0xb0580c77 (stale) CRC-32 checksum value for chunk [0, 0x325a5): Mirror 1: 0x7df68636 Mirror 13: 0x7df68636 Mirror 14: 0x7df68636 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x325a5: skipped 000913 1788587035.187147 write 0x029e7d thru 0x033817 (0x999b bytes) 000914 1788587035.278643 mapread 0x021a05 thru 0x02ce92 (0xb48e bytes) 000915 1788587035.302441 read 0x008f50 thru 0x00df8b (0x503c bytes) 000916 1788587035.314495 punch from 0x009533 to 0x00d8f5 (0x43c3 bytes) 000917 1788587035.325722 write 0x022d13 thru 0x022dd1 (0xbf bytes) 000918 1788587035.326822 fallocate 0x03525b thru 0x039165 (0x3f0b bytes) 000919 1788587035.333772 punch from 0x03745e to 0x039165 (0x1d08 bytes) 000920 1788587035.342347 punch from 0x00aa0b to 0x018a45 (0xe03b bytes) 000921 1788587035.367560 MIRROR_RESYNC 10 mirrors 000922 1788587038.145479 read 0x00db7d thru 0x017b28 (0x9fac bytes) 000923 1788587038.156281 read 0x0032d6 thru 0x00fc90 (0xc9bb bytes) 000924 1788587038.169648 read 0x00fa95 thru 0x018407 (0x8973 bytes) 000925 1788587038.170010 write 0x006b9c thru 0x013643 (0xcaa8 bytes) 000926 1788587038.244036 mapread 0x005cbe thru 0x008eb5 (0x31f8 bytes) 000927 1788587038.256799 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x39166): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39166): Mirror 6: 0x9cd3259 (stale) Mirror 7: 0x9cd3259 (stale) Mirror 8: 0x9cd3259 (stale) Mirror 9: 0x9cd3259 (stale) Mirror 10: 0x9cd3259 (stale) Mirror 11: 0x9cd3259 (stale) Mirror 12: 0x9cd3259 (stale) Mirror 13: 0x9cd3259 (stale) Mirror 14: 0x9cd3259 (stale) CRC-32 checksum value for chunk [0, 0x39166): Mirror 1: 0xc05e6c0 Mirror 15: 0xc05e6c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39166: skipped 000928 1788587039.537974 fallocate 0x0258dd thru 0x027f2d (0x2651 bytes) 000929 1788587039.583677 mapread 0x036e4b thru 0x039165 (0x231b bytes) 000930 1788587039.612662 mapwrite 0x0318ea thru 0x03c58d (0xaca4 bytes) 000931 1788587039.746171 trunc from 0x03c58e to 0x00161f (0x3af6e bytes) 000932 1788587039.777937 trunc from 0x001134 to 0x00161f (0x4ec bytes) 000933 1788587039.794373 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1620): Mirror 6: 0x49f6e386 (stale) Mirror 7: 0x49f6e386 (stale) Mirror 9: 0x49f6e386 (stale) Mirror 10: 0x49f6e386 (stale) Mirror 11: 0x49f6e386 (stale) Mirror 12: 0x49f6e386 (stale) Mirror 13: 0x49f6e386 (stale) Mirror 14: 0x49f6e386 (stale) Mirror 15: 0x49f6e386 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1620): Mirror 6: 0x49f6e386 (stale) Mirror 7: 0x49f6e386 (stale) Mirror 9: 0x49f6e386 (stale) Mirror 10: 0x49f6e386 (stale) Mirror 11: 0x49f6e386 (stale) Mirror 12: 0x49f6e386 (stale) Mirror 13: 0x49f6e386 (stale) Mirror 14: 0x49f6e386 (stale) Mirror 15: 0x49f6e386 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1620: skipped 000934 1788587040.270390 write 0x02b9bf thru 0x036c2f (0xb271 bytes) 000935 1788587040.283103 mapwrite 0x018236 thru 0x01d34b (0x5116 bytes) 000936 1788587040.322366 trunc from 0x036c30 to 0x03f259 (0x862a bytes) 000937 1788587040.352471 punch from 0x03edad to 0x03f259 (0x4ad bytes) 000939 1788587040.360673 write 0x0198e2 thru 0x024b52 (0xb271 bytes) 000941 1788587040.368264 mapread 0x00063c thru 0x00fe55 (0xf81a bytes) 000942 1788587040.379703 mapread 0x02567a thru 0x0289de (0x3365 bytes) 000943 1788587040.393329 write 0x0331f5 thru 0x039646 (0x6452 bytes) 000944 1788587040.406011 MIRROR_RESYNC 10 mirrors 000945 1788587043.442913 punch from 0x0256f9 to 0x031e1d (0xc725 bytes) 000946 1788587043.478374 mapwrite 0x02074a thru 0x02f419 (0xecd0 bytes) 000947 1788587043.540695 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x21f519d4 (stale) Mirror 7: 0x21f519d4 (stale) Mirror 9: 0x21f519d4 (stale) Mirror 10: 0x21f519d4 (stale) Mirror 11: 0x21f519d4 (stale) Mirror 12: 0x21f519d4 (stale) Mirror 13: 0x21f519d4 (stale) Mirror 14: 0x21f519d4 (stale) Mirror 15: 0x21f519d4 (stale) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 1: 0xf9724307 Mirror 16: 0xf9724307 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000948 1788587045.027312 trunc from 0x01a89d to 0x024790 (0x9ef4 bytes) 000949 1788587045.094058 read 0x013764 thru 0x01e66e (0xaf0b bytes) 000950 1788587045.109460 write 0x01845e thru 0x01b80b (0x33ae bytes) 000951 1788587045.118423 mapwrite 0x00ee75 thru 0x0137d0 (0x495c bytes) 000952 1788587045.153555 mapwrite 0x00266c thru 0x00e2a4 (0xbc39 bytes) 000953 1788587045.182940 trunc from 0x0318a3 to 0x03f20f (0xd96d bytes) 000954 1788587045.188729 mapwrite 0x034c93 thru 0x03af2b (0x6299 bytes) 000955 1788587045.222662 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x21f519d4 (stale) Mirror 7: 0x21f519d4 (stale) Mirror 9: 0x21f519d4 (stale) Mirror 10: 0x21f519d4 (stale) Mirror 12: 0x21f519d4 (stale) Mirror 13: 0x21f519d4 (stale) Mirror 14: 0x21f519d4 (stale) Mirror 15: 0x21f519d4 (stale) Mirror 16: 0xf9724307 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x21f519d4 (stale) Mirror 7: 0x21f519d4 (stale) Mirror 9: 0x21f519d4 (stale) Mirror 10: 0x21f519d4 (stale) Mirror 12: 0x21f519d4 (stale) Mirror 13: 0x21f519d4 (stale) Mirror 14: 0x21f519d4 (stale) Mirror 15: 0x21f519d4 (stale) Mirror 16: 0xf9724307 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000956 1788587045.984807 punch from 0x03867f to 0x03ed3a (0x66bc bytes) 000957 1788587045.991654 read 0x01cda1 thru 0x01e680 (0x18e0 bytes) 000959 1788587046.005473 trunc from 0x03d41e to 0x03f259 (0x1e3c bytes) 000960 1788587046.020270 mapwrite 0x027837 thru 0x037022 (0xf7ec bytes) 000961 1788587046.091431 punch from 0x01e18f to 0x02bd16 (0xdb88 bytes) 000962 1788587046.098254 read 0x028605 thru 0x03758d (0xef89 bytes) 000964 1788587046.128932 mapread 0x003083 thru 0x008cc0 (0x5c3e bytes) 000965 1788587046.130593 trunc from 0x02c76d to 0x03814d (0xb9e1 bytes) 000966 1788587046.146071 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x21f519d4 (stale) Mirror 7: 0x21f519d4 (stale) Mirror 9: 0x21f519d4 (stale) Mirror 10: 0x21f519d4 (stale) Mirror 12: 0x21f519d4 (stale) Mirror 13: 0x21f519d4 (stale) Mirror 14: 0x21f519d4 (stale) Mirror 15: 0x21f519d4 (stale) Mirror 16: 0xf9724307 (stale) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 1: 0x50e2c363 Mirror 17: 0x50e2c363 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000968 1788587047.589944 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x21f519d4 (stale) Mirror 7: 0x21f519d4 (stale) Mirror 9: 0x21f519d4 (stale) Mirror 10: 0x21f519d4 (stale) Mirror 12: 0x21f519d4 (stale) Mirror 13: 0x21f519d4 (stale) Mirror 14: 0x21f519d4 (stale) Mirror 15: 0x21f519d4 (stale) Mirror 16: 0xf9724307 (stale) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 1: 0x50e2c363 Mirror 17: 0x50e2c363 Mirror 18: 0x50e2c363 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000969 1788587049.474680 fallocate 0x01be4a thru 0x0252bd (0x9474 bytes) 000970 1788587049.594842 MIRROR_RESYNC 12 mirrors 000972 1788587054.785676 mapwrite 0x033139 thru 0x0338e2 (0x7aa bytes) 000973 1788587054.882164 write 0x03caa8 thru 0x03ee1b (0x2374 bytes) 000974 1788587054.894215 mapwrite 0x01cc28 thru 0x0238bc (0x6c95 bytes) 000975 1788587054.931884 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x50e2c363 (stale) Mirror 7: 0x50e2c363 (stale) Mirror 9: 0x50e2c363 (stale) Mirror 10: 0x50e2c363 (stale) Mirror 12: 0x50e2c363 (stale) Mirror 13: 0x50e2c363 (stale) Mirror 14: 0x50e2c363 (stale) Mirror 15: 0x50e2c363 (stale) Mirror 16: 0x50e2c363 (stale) Mirror 17: 0x50e2c363 (stale) Mirror 18: 0x50e2c363 (stale) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 1: 0xf302e6ac Mirror 19: 0xf302e6ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000976 1788587056.581478 punch from 0x01e41b to 0x02b5a1 (0xd187 bytes) 000977 1788587056.654830 write 0x02ce76 thru 0x037049 (0xa1d4 bytes) 000978 1788587056.672750 write 0x010eca thru 0x01e273 (0xd3aa bytes) 000979 1788587056.688380 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x50e2c363 (stale) Mirror 7: 0x50e2c363 (stale) Mirror 9: 0x50e2c363 (stale) Mirror 12: 0x50e2c363 (stale) Mirror 13: 0x50e2c363 (stale) Mirror 14: 0x50e2c363 (stale) Mirror 15: 0x50e2c363 (stale) Mirror 16: 0x50e2c363 (stale) Mirror 17: 0x50e2c363 (stale) Mirror 18: 0x50e2c363 (stale) Mirror 19: 0xf302e6ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0x50e2c363 (stale) Mirror 7: 0x50e2c363 (stale) Mirror 9: 0x50e2c363 (stale) Mirror 12: 0x50e2c363 (stale) Mirror 13: 0x50e2c363 (stale) Mirror 14: 0x50e2c363 (stale) Mirror 15: 0x50e2c363 (stale) Mirror 16: 0x50e2c363 (stale) Mirror 17: 0x50e2c363 (stale) Mirror 18: 0x50e2c363 (stale) Mirror 19: 0xf302e6ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000980 1788587057.515052 MIRROR_RESYNC 12 mirrors 000981 1788587061.472425 mapwrite 0x033d1a thru 0x03c3a3 (0x868a bytes) 000982 1788587061.642056 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0xcd7371e4 (stale) Mirror 7: 0xcd7371e4 (stale) Mirror 9: 0xcd7371e4 (stale) Mirror 12: 0xcd7371e4 (stale) Mirror 13: 0xcd7371e4 (stale) Mirror 14: 0xcd7371e4 (stale) Mirror 15: 0xcd7371e4 (stale) Mirror 16: 0xcd7371e4 (stale) Mirror 17: 0xcd7371e4 (stale) Mirror 18: 0xcd7371e4 (stale) Mirror 19: 0xcd7371e4 (stale) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 1: 0x6935da07 Mirror 20: 0x6935da07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000984 1788587062.788459 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x15f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0xcd7371e4 (stale) Mirror 9: 0xcd7371e4 (stale) Mirror 12: 0xcd7371e4 (stale) Mirror 13: 0xcd7371e4 (stale) Mirror 14: 0xcd7371e4 (stale) Mirror 15: 0xcd7371e4 (stale) Mirror 16: 0xcd7371e4 (stale) Mirror 17: 0xcd7371e4 (stale) Mirror 18: 0xcd7371e4 (stale) Mirror 19: 0xcd7371e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 6: 0xcd7371e4 (stale) Mirror 9: 0xcd7371e4 (stale) Mirror 12: 0xcd7371e4 (stale) Mirror 13: 0xcd7371e4 (stale) Mirror 14: 0xcd7371e4 (stale) Mirror 15: 0xcd7371e4 (stale) Mirror 16: 0xcd7371e4 (stale) Mirror 17: 0xcd7371e4 (stale) Mirror 18: 0xcd7371e4 (stale) Mirror 19: 0xcd7371e4 (stale) CRC-32 checksum value for chunk [0, 0x3f25a): Mirror 1: 0x6935da07 Mirror 20: 0x6935da07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25a: skipped 000985 1788587064.086289 write 0x02cbe4 thru 0x03aa8d (0xdeaa bytes) 000986 1788587064.152724 mapwrite 0x01f4e1 thru 0x0296ba (0xa1da bytes) 000987 1788587064.197488 trunc from 0x01d4ef to 0x023616 (0x6128 bytes) 000988 1788587064.204840 fallocate 0x02c650 thru 0x02fa21 (0x33d2 bytes) 000989 1788587064.212914 fallocate 0x005719 thru 0x015512 (0xfdfa bytes) 000991 1788587064.218858 mapread 0x00b4c0 thru 0x0197b2 (0xe2f3 bytes) 000992 1788587064.239737 read 0x01edd6 thru 0x021e4a (0x3075 bytes) 000993 1788587064.246116 punch from 0x022a75 to 0x02c23b (0x97c7 bytes) 000994 1788587064.253026 trunc from 0x014712 to 0x01cd04 (0x85f3 bytes) 000996 1788587064.273462 trunc from 0x03dead to 0x03f259 (0x13ad bytes) 000997 1788587064.282003 fallocate 0x016a68 thru 0x01f5ae (0x8b47 bytes) 000998 1788587064.292946 write 0x034aa9 thru 0x037a26 (0x2f7e bytes) 000999 1788587064.298549 mapread 0x002270 thru 0x00638b (0x411c bytes) 001000 1788587064.311843 fallocate 0x02aeba thru 0x03161f (0x6766 bytes) All operations completed A-OK!