== sanity-flr test 70a: flr mode fsx test ================ 18:13:22 (1784585602) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 5604 000001 1784585604.506504 write 0x01f1fa thru 0x021010 (0x1e17 bytes) 000002 1784585604.518985 punch from 0x0178ce to 0x021010 (0x9743 bytes) 000003 1784585604.529887 trunc from 0x0102d8 to 0x01bf23 (0xbc4c bytes) 000004 1784585604.535846 mapread 0x000544 thru 0x006537 (0x5ff4 bytes) 000005 1784585604.566135 mapwrite 0x03ce05 thru 0x03f120 (0x231c bytes) 000006 1784585604.622924 mapwrite 0x00b9c4 thru 0x00c000 (0x63d bytes) 000007 1784585604.640785 read 0x01107a thru 0x015dc6 (0x4d4d bytes) 000009 1784585604.656726 punch from 0x0201b4 to 0x0262ff (0x614c bytes) 000010 1784585604.664242 punch from 0x00b156 to 0x00e376 (0x3221 bytes) 000011 1784585604.682872 mapread 0x0255c8 thru 0x032add (0xd516 bytes) fallocating to largest ever: 0x27836 000013 1784585604.729672 fallocate 0x01ce17 thru 0x027835 (0xaa1f bytes) 000014 1784585604.744406 fallocate 0x005bd6 thru 0x00d198 (0x75c3 bytes) 000015 1784585604.759118 punch from 0x02a6e6 to 0x031c70 (0x758b bytes) 000016 1784585604.784099 MIRROR_EXTEND to 2 mirrors 000017 1784585605.702308 trunc from 0x03f121 to 0x00f53f (0x2fbe1 bytes) 000018 1784585605.765487 trunc from 0x00c5e6 to 0x00f53f (0x2f5a bytes) 000019 1784585605.773043 mapwrite 0x019236 thru 0x01c513 (0x32de bytes) 000020 1784585605.873631 trunc from 0x01c514 to 0x01c990 (0x47d bytes) 000021 1784585605.894155 mapread 0x01bb00 thru 0x01c990 (0xe91 bytes) 000022 1784585605.895489 mapread 0x01c0bd thru 0x01c990 (0x8d4 bytes) 000023 1784585605.899973 trunc from 0x008b52 to 0x008df1 (0x2a0 bytes) 000024 1784585605.906319 mapwrite 0x031b67 thru 0x032513 (0x9ad bytes) 000025 1784585605.946032 fallocate 0x011355 thru 0x01e9c9 (0xd675 bytes) 000026 1784585605.957510 MIRROR_RESYNC 2 mirrors 000027 1784585606.718453 trunc from 0x032514 to 0x007250 (0x2b2c3 bytes) 000028 1784585606.813020 mapwrite 0x0102c9 thru 0x014476 (0x41ae bytes) 000029 1784585606.927259 read 0x0095d0 thru 0x00a1bc (0xbed bytes) 000030 1784585606.941450 fallocate 0x00b902 thru 0x00f8f9 (0x3ff8 bytes) fallocating to largest ever: 0x329dc 000031 1784585606.960485 fallocate 0x031dd4 thru 0x0329db (0xc08 bytes) fallocating to largest ever: 0x3db16 000032 1784585606.967138 fallocate 0x03195e thru 0x03db15 (0xc1b8 bytes) 000033 1784585606.984706 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x329dc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329dc): Mirror 2: 0xcdf0ae43 (stale) CRC-32 checksum value for chunk [0, 0x329dc): Mirror 1: 0x423b4688 Mirror 3: 0x423b4688 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329dc: skipped 000034 1784585608.232393 MIRROR_RESYNC 3 mirrors fallocating to largest ever: 0x3fc3b 000035 1784585609.122064 fallocate 0x03e076 thru 0x03fc3a (0x1bc5 bytes) 000036 1784585609.203465 trunc from 0x025c21 to 0x027529 (0x1909 bytes) 000038 1784585609.223523 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x329dc): Mirror 2: 0x423b4688 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329dc): Mirror 2: 0x423b4688 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329dc: skipped 000039 1784585609.572337 trunc from 0x0112a9 to 0x016b7a (0x58d2 bytes) 000040 1784585609.599694 mapread 0x02c788 thru 0x02ecf4 (0x256d bytes) 000041 1784585609.638238 trunc from 0x0329dc to 0x00ddd3 (0x24c08 bytes) 000042 1784585609.677262 write 0x00de8b thru 0x01a9e0 (0xcb56 bytes) 000043 1784585609.695504 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000044 1784585609.916058 trunc from 0x01a2fb to 0x01a9e0 (0x6e6 bytes) 000045 1784585609.926438 mapread 0x00ada0 thru 0x01a80b (0xfa6c bytes) 000047 1784585609.988052 trunc from 0x01a9e1 to 0x0121a3 (0x883d bytes) 000048 1784585610.038609 read 0x00cb7e thru 0x0121a3 (0x5626 bytes) 000049 1784585610.039863 mapread 0x008545 thru 0x010b8e (0x864a bytes) 000050 1784585610.053920 trunc from 0x00ff1d to 0x010f65 (0x1049 bytes) 000051 1784585610.064914 read 0x00e8ba thru 0x00f995 (0x10dc bytes) 000052 1784585610.081624 fallocate 0x030c64 thru 0x03bb00 (0xae9d bytes) 000053 1784585610.089336 write 0x03cd64 thru 0x03ffff (0x329c bytes) 000055 1784585610.095783 write 0x0039ec thru 0x00c2dd (0x88f2 bytes) 000056 1784585610.099893 write 0x03d6f7 thru 0x03da5f (0x369 bytes) 000057 1784585610.101884 trunc from 0x040000 to 0x021f84 (0x1e07b bytes) 000058 1784585610.149418 MIRROR_EXTEND to 2 mirrors 000059 1784585610.958872 trunc from 0x012bba to 0x01442e (0x1875 bytes) 000060 1784585611.005814 write 0x01865e thru 0x01ef1f (0x68c2 bytes) 000061 1784585611.028875 write 0x026802 thru 0x02c1c3 (0x59c2 bytes) 000062 1784585611.033790 read 0x011426 thru 0x01a6ed (0x92c8 bytes) 000063 1784585611.048668 punch from 0x003aec to 0x0097c8 (0x5cdd bytes) 000064 1784585611.059311 punch from 0x0037e3 to 0x008df1 (0x560f bytes) 000065 1784585611.069481 mapread 0x01382c thru 0x01d488 (0x9c5d bytes) 000066 1784585611.072862 mapwrite 0x02e2fb thru 0x02e4be (0x1c4 bytes) 000067 1784585611.147866 punch from 0x01c82a to 0x01da98 (0x126f bytes) 000068 1784585611.154403 mapwrite 0x009b9a thru 0x01071d (0x6b84 bytes) 000069 1784585611.193608 read 0x01e99c thru 0x02a03b (0xb6a0 bytes) 000070 1784585611.203075 read 0x02ab70 thru 0x02e4be (0x394f bytes) 000071 1784585611.203897 mapread 0x004ea0 thru 0x0084b0 (0x3611 bytes) 000072 1784585611.207038 fallocate 0x00bf8f thru 0x0183d3 (0xc445 bytes) 000073 1784585611.212510 punch from 0x02772f to 0x02e4be (0x6d90 bytes) 000076 1784585611.221126 read 0x0272fe thru 0x028e3b (0x1b3e bytes) 000077 1784585611.231006 fallocate 0x02e8f5 thru 0x0389c6 (0xa0d2 bytes) 000079 1784585611.245091 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000080 1784585611.389061 fallocate 0x02dbfc thru 0x035fc5 (0x83ca bytes) 000081 1784585611.397065 punch from 0x02f4f3 to 0x035fc5 (0x6ad3 bytes) 000082 1784585611.402826 trunc from 0x035bab to 0x035fc5 (0x41b bytes) 000083 1784585611.410251 trunc from 0x01d4cc to 0x020650 (0x3185 bytes) 000084 1784585611.417055 trunc from 0x0039a0 to 0x006d71 (0x33d2 bytes) 000085 1784585611.425194 mapwrite 0x02ec69 thru 0x03e400 (0xf798 bytes) 000087 1784585611.547487 write 0x019892 thru 0x025805 (0xbf74 bytes) 000088 1784585611.582682 fallocate 0x023c9d thru 0x032edf (0xf243 bytes) 000089 1784585611.592675 punch from 0x02b961 to 0x034bdb (0x927b bytes) 000090 1784585611.604737 read 0x0037f5 thru 0x01226f (0xea7b bytes) 000091 1784585611.635891 fallocate 0x01d3cd thru 0x024a2b (0x765f bytes) 000092 1784585611.649586 fallocate 0x02d4e5 thru 0x03b46e (0xdf8a bytes) 000093 1784585611.659450 fallocate 0x02594e thru 0x034f55 (0xf608 bytes) 000094 1784585611.673828 fallocate 0x015c2b thru 0x01669e (0xa74 bytes) 000095 1784585611.684853 fallocate 0x02ca8b thru 0x0384e3 (0xba59 bytes) 000096 1784585611.706138 mapread 0x000962 thru 0x00a46b (0x9b0a bytes) 000097 1784585611.722821 mapwrite 0x01b9fa thru 0x024c96 (0x929d bytes) 000098 1784585611.772878 fallocate 0x027231 thru 0x03601d (0xeded bytes) 000100 1784585611.785508 mapwrite 0x010f54 thru 0x01c4ca (0xb577 bytes) 000101 1784585611.834361 trunc from 0x0304f4 to 0x0394ab (0x8fb8 bytes) 000102 1784585611.850765 mapwrite 0x03fd94 thru 0x03ffff (0x26c bytes) 000103 1784585611.891605 read 0x035b5b thru 0x036af5 (0xf9b bytes) 000105 1784585611.908310 fallocate 0x031cd7 thru 0x03ea0d (0xcd37 bytes) 000106 1784585611.913575 fallocate 0x0282b7 thru 0x037912 (0xf65c bytes) 000107 1784585611.924484 MIRROR_EXTEND to 2 mirrors 000108 1784585612.930011 write 0x011dba thru 0x01573e (0x3985 bytes) 000109 1784585612.985265 punch from 0x025663 to 0x027e11 (0x27af bytes) 000110 1784585612.993868 punch from 0x0368fc to 0x03ffff (0x9704 bytes) 000111 1784585613.002233 read 0x024bde thru 0x026579 (0x199c bytes) 000112 1784585613.012201 mapwrite 0x03f834 thru 0x03ffff (0x7cc bytes) 000113 1784585613.055138 mapread 0x03c355 thru 0x03ffff (0x3cab bytes) 000114 1784585613.085931 write 0x025368 thru 0x02db7d (0x8816 bytes) 000115 1784585613.091401 fallocate 0x035adc thru 0x0364f1 (0xa16 bytes) 000116 1784585613.097203 punch from 0x03ee83 to 0x03f319 (0x497 bytes) 000117 1784585613.104369 read 0x00a216 thru 0x00b7e8 (0x15d3 bytes) 000118 1784585613.119947 mapwrite 0x0391ef thru 0x03b4c8 (0x22da bytes) 000119 1784585613.148110 trunc from 0x03e031 to 0x03ffff (0x1fcf bytes) 000120 1784585613.155147 fallocate 0x00f080 thru 0x01e1f2 (0xf173 bytes) 000121 1784585613.162508 mapwrite 0x020232 thru 0x0259c4 (0x5793 bytes) 000122 1784585613.201577 mapread 0x035975 thru 0x037247 (0x18d3 bytes) 000123 1784585613.202880 fallocate 0x01c418 thru 0x02a2f7 (0xdee0 bytes) 000124 1784585613.210463 fallocate 0x014eac thru 0x01dd58 (0x8ead bytes) 000125 1784585613.229652 punch from 0x03a767 to 0x03ffff (0x5899 bytes) 000126 1784585613.253116 mapread 0x018b7d thru 0x01c42a (0x38ae bytes) fallocating to largest ever: 0x40000 000127 1784585613.254662 fallocate 0x03e3aa thru 0x03ffff (0x1c56 bytes) 000129 1784585613.263983 punch from 0x00cb0a to 0x013163 (0x665a bytes) 000130 1784585613.270681 write 0x02ec96 thru 0x02f404 (0x76f bytes) 000131 1784585613.274737 read 0x00e4d2 thru 0x01e13b (0xfc6a bytes) 000132 1784585613.291811 read 0x027069 thru 0x036e65 (0xfdfd bytes) 000133 1784585613.293396 trunc from 0x040000 to 0x0153d5 (0x2ac2a bytes) 000134 1784585613.330010 trunc from 0x0153d6 to 0x031b71 (0x1c79c bytes) 000135 1784585613.362672 mapwrite 0x016aaa thru 0x016ced (0x244 bytes) 000136 1784585613.414828 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000137 1784585613.588875 punch from 0x022cb1 to 0x025820 (0x2b70 bytes) 000138 1784585613.600518 read 0x00bbb9 thru 0x010e67 (0x52af bytes) 000139 1784585613.621550 write 0x028e70 thru 0x02a5a6 (0x1737 bytes) 000140 1784585613.647234 write 0x00d006 thru 0x01331a (0x6315 bytes) 000141 1784585613.658727 mapread 0x01189a thru 0x012b24 (0x128b bytes) 000142 1784585613.661929 fallocate 0x0006a1 thru 0x00cee6 (0xc846 bytes) 000143 1784585613.670429 write 0x023217 thru 0x026657 (0x3441 bytes) 000144 1784585613.698422 MIRROR_EXTEND to 2 mirrors 000145 1784585614.683510 mapread 0x0174d2 thru 0x01d893 (0x63c2 bytes) 000146 1784585614.715946 read 0x001acb thru 0x00be97 (0xa3cd bytes) 000147 1784585614.735044 MIRROR_RESYNC 2 mirrors 000148 1784585615.203971 trunc from 0x01fc20 to 0x025c57 (0x6038 bytes) 000149 1784585615.242279 fallocate 0x02af5a thru 0x034086 (0x912d bytes) 000150 1784585615.247930 fallocate 0x01d3d1 thru 0x025340 (0x7f70 bytes) 000151 1784585615.252698 mapwrite 0x027078 thru 0x02fac6 (0x8a4f bytes) 000152 1784585615.292606 mapread 0x026707 thru 0x028742 (0x203c bytes) 000153 1784585615.294151 trunc from 0x02392b to 0x02d4d1 (0x9ba7 bytes) 000154 1784585615.309124 punch from 0x015351 to 0x015c25 (0x8d5 bytes) 000155 1784585615.329936 MIRROR_RESYNC 2 mirrors 000156 1784585616.211300 trunc from 0x031b72 to 0x0160fd (0x1ba74 bytes) 000157 1784585616.294303 MIRROR_RESYNC 2 mirrors 000158 1784585616.970348 punch from 0x005989 to 0x00fae9 (0xa161 bytes) 000159 1784585617.012870 mapwrite 0x0264d2 thru 0x0286ab (0x21da bytes) 000160 1784585617.063610 trunc from 0x01daf8 to 0x022cc5 (0x51ce bytes) 000161 1784585617.074997 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000162 1784585617.215595 write 0x00b46e thru 0x0113cb (0x5f5e bytes) 000163 1784585617.230987 mapread 0x00ef6f thru 0x01bd72 (0xce04 bytes) 000164 1784585617.257365 trunc from 0x0286ac to 0x01fe8a (0x8821 bytes) 000165 1784585617.294130 trunc from 0x01fe8b to 0x025527 (0x569d bytes) 000167 1784585617.320200 punch from 0x01799b to 0x022803 (0xae69 bytes) 000168 1784585617.326109 mapwrite 0x028d36 thru 0x033def (0xb0ba bytes) 000169 1784585617.409888 read 0x0033ef thru 0x00aca9 (0x78bb bytes) 000170 1784585617.428771 read 0x00585f thru 0x014fdd (0xf77f bytes) 000171 1784585617.429747 read 0x017c7b thru 0x019c3f (0x1fc5 bytes) 000172 1784585617.442471 write 0x02ffc5 thru 0x03007b (0xb7 bytes) 000173 1784585617.447455 trunc from 0x033df0 to 0x00aa1b (0x293d4 bytes) 000174 1784585617.471211 fallocate 0x00cb8d thru 0x015f58 (0x93cc bytes) 000175 1784585617.478273 trunc from 0x00266f to 0x00aa1b (0x83ad bytes) 000176 1784585617.492799 mapwrite 0x00908b thru 0x009230 (0x1a6 bytes) 000177 1784585617.546345 punch from 0x009726 to 0x00aa1b (0x12f6 bytes) 000179 1784585617.556918 write 0x0175c6 thru 0x01cc49 (0x5684 bytes) 000180 1784585617.565524 mapwrite 0x01a4fc thru 0x021f4f (0x7a54 bytes) 000181 1784585617.662084 trunc from 0x021f50 to 0x00a4df (0x17a70 bytes) 000182 1784585617.699539 MIRROR_EXTEND to 2 mirrors 000185 1784585618.472501 punch from 0x000a74 to 0x007a06 (0x6f93 bytes) 000186 1784585618.524919 mapwrite 0x02d251 thru 0x03b964 (0xe714 bytes) 000187 1784585618.625052 read 0x029fab thru 0x03144d (0x74a3 bytes) 000188 1784585618.626992 fallocate 0x00454d thru 0x009c25 (0x56d9 bytes) 000189 1784585618.641414 trunc from 0x03b965 to 0x00770a (0x3425a bytes) 000190 1784585618.670127 punch from 0x002324 to 0x005e3b (0x3b18 bytes) 000191 1784585618.683018 mapread 0x00247b thru 0x00770a (0x5290 bytes) 000193 1784585618.716268 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x770b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x770b): Mirror 2: 0xfa0040c (stale) CRC-32 checksum value for chunk [0, 0x770b): Mirror 1: 0xfa0040c Mirror 3: 0xfa0040c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x770b: skipped 000194 1784585619.696069 punch from 0x0059df to 0x00770a (0x1d2c bytes) 000195 1784585619.767881 trunc from 0x0046ed to 0x00770a (0x301e bytes) 000196 1784585619.809206 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x770b): Mirror 3: 0xfa0040c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x770b): Mirror 3: 0xfa0040c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x770b: skipped 000197 1784585620.143728 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000199 1784585620.331932 fallocate 0x003b91 thru 0x00d0a1 (0x9511 bytes) 000201 1784585620.340016 write 0x02e602 thru 0x0352d5 (0x6cd4 bytes) 000202 1784585620.351548 trunc from 0x0352d6 to 0x022017 (0x132be bytes) 000203 1784585620.374041 mapread 0x008312 thru 0x00b3bf (0x30ae bytes) 000204 1784585620.412689 read 0x018eb8 thru 0x01c1bd (0x3306 bytes) 000205 1784585620.430552 read 0x006750 thru 0x00f9aa (0x925b bytes) 000206 1784585620.431481 mapwrite 0x005659 thru 0x00778d (0x2135 bytes) 000207 1784585620.456823 mapwrite 0x0374e3 thru 0x03ffff (0x8b1d bytes) 000208 1784585620.517011 read 0x027f37 thru 0x0332ac (0xb376 bytes) 000209 1784585620.522119 mapwrite 0x02eada thru 0x03286a (0x3d91 bytes) 000210 1784585620.544690 read 0x00826a thru 0x0129c3 (0xa75a bytes) 000211 1784585620.545979 trunc from 0x00a88a to 0x00dd07 (0x347e bytes) 000212 1784585620.557674 fallocate 0x03ff4b thru 0x03ffff (0xb5 bytes) 000213 1784585620.577782 punch from 0x00c4dc to 0x018251 (0xbd76 bytes) 000215 1784585620.592104 trunc from 0x014481 to 0x0164f3 (0x2073 bytes) 000216 1784585620.601804 write 0x02e436 thru 0x0325c2 (0x418d bytes) 000217 1784585620.603142 trunc from 0x0309b1 to 0x03b9df (0xb02f bytes) 000218 1784585620.633857 read 0x034beb thru 0x03ffff (0xb415 bytes) 000220 1784585620.657405 write 0x005d71 thru 0x015619 (0xf8a9 bytes) 000221 1784585620.660430 trunc from 0x040000 to 0x019226 (0x26dd9 bytes) 000223 1784585620.692058 mapwrite 0x01afd5 thru 0x0294f2 (0xe51e bytes) 000224 1784585621.001690 trunc from 0x0294f3 to 0x0096b0 (0x1fe42 bytes) 000226 1784585621.037917 mapread 0x00253c thru 0x0096b0 (0x7175 bytes) 000227 1784585621.041786 write 0x033610 thru 0x038131 (0x4b22 bytes) 000228 1784585621.043698 write 0x014722 thru 0x015480 (0xd5f bytes) 000229 1784585621.053400 read 0x00902e thru 0x00a661 (0x1634 bytes) 000230 1784585621.075864 mapread 0x026860 thru 0x02afd9 (0x477a bytes) 000231 1784585621.081816 mapwrite 0x03de05 thru 0x03ffff (0x21fb bytes) 000233 1784585621.160069 read 0x00fc4f thru 0x0172a1 (0x7653 bytes) 000234 1784585621.161960 mapwrite 0x03b174 thru 0x03ffff (0x4e8c bytes) 000235 1784585621.194765 punch from 0x00086b to 0x009f96 (0x972c bytes) 000236 1784585621.200775 write 0x0202e8 thru 0x02aff0 (0xad09 bytes) 000237 1784585621.208154 fallocate 0x01cedc thru 0x024b79 (0x7c9e bytes) 000238 1784585621.213957 read 0x0333e5 thru 0x03f911 (0xc52d bytes) 000239 1784585621.214789 trunc from 0x000695 to 0x002dcf (0x273b bytes) 000240 1784585621.223249 trunc from 0x004517 to 0x01185c (0xd346 bytes) 000241 1784585621.229452 mapread 0x0308de thru 0x03c2a0 (0xb9c3 bytes) 000242 1784585621.234199 trunc from 0x02d0ea to 0x032f64 (0x5e7b bytes) 000243 1784585621.242127 write 0x038d33 thru 0x03ffff (0x72cd bytes) 000244 1784585621.245278 trunc from 0x040000 to 0x03d389 (0x2c76 bytes) 000245 1784585621.277976 write 0x020ea9 thru 0x024a12 (0x3b6a bytes) 000246 1784585621.280544 mapwrite 0x0311f5 thru 0x039e34 (0x8c40 bytes) 000248 1784585621.325514 write 0x012431 thru 0x017591 (0x5161 bytes) 000249 1784585621.327837 mapwrite 0x0280a1 thru 0x033c5e (0xbbbe bytes) 000250 1784585621.352463 trunc from 0x038c94 to 0x03a25b (0x15c8 bytes) 000251 1784585621.358210 trunc from 0x03d38a to 0x001da3 (0x3b5e6 bytes) 000253 1784585621.390149 fallocate 0x01a820 thru 0x01bf5b (0x173c bytes) 000254 1784585621.396958 punch from 0x004c71 to 0x00bfd5 (0x7365 bytes) 000255 1784585621.404229 punch from 0x012972 to 0x017dbf (0x544e bytes) 000257 1784585621.411294 trunc from 0x01bf5c to 0x02511d (0x91c2 bytes) 000258 1784585621.431756 trunc from 0x02511e to 0x027d0e (0x2bf1 bytes) 000260 1784585621.448359 read 0x01f5bb thru 0x0253c3 (0x5e09 bytes) 000261 1784585621.460831 mapwrite 0x02dc8a thru 0x02fdb7 (0x212e bytes) 000262 1784585621.502688 write 0x023614 thru 0x032b2b (0xf518 bytes) 000263 1784585621.504665 read 0x02c871 thru 0x032b2b (0x62bb bytes) 000264 1784585621.506973 trunc from 0x032b2c to 0x01398b (0x1f1a0 bytes) 000265 1784585621.533053 fallocate 0x0310fb thru 0x038543 (0x7449 bytes) 000266 1784585621.540469 trunc from 0x0123e6 to 0x018e04 (0x6a1f bytes) 000267 1784585621.550129 mapread 0x027b9d thru 0x02efae (0x7412 bytes) 000268 1784585621.564274 write 0x031b0b thru 0x03ffff (0xe4f5 bytes) 000269 1784585621.567597 trunc from 0x0251ae to 0x02cc93 (0x7ae6 bytes) 000271 1784585621.575469 punch from 0x03cffd to 0x03ffff (0x3003 bytes) 000272 1784585621.590139 trunc from 0x040000 to 0x009034 (0x36fcb bytes) 000273 1784585621.607080 mapread 0x001745 thru 0x003e69 (0x2725 bytes) 000274 1784585621.609875 trunc from 0x00357a to 0x009034 (0x5abb bytes) 000278 1784585621.617808 write 0x025f0e thru 0x029383 (0x3476 bytes) 000279 1784585621.620034 punch from 0x006430 to 0x0064d5 (0xa6 bytes) 000280 1784585621.625571 trunc from 0x029384 to 0x00a9b8 (0x1e9cb bytes) 000281 1784585621.643530 mapread 0x0051fa thru 0x005b24 (0x92b bytes) 000282 1784585621.650469 read 0x0077d2 thru 0x00a9b8 (0x31e7 bytes) 000283 1784585621.665592 MIRROR_EXTEND to 2 mirrors 000284 1784585622.714017 write 0x019fc7 thru 0x021638 (0x7672 bytes) 000285 1784585622.804452 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21639): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21639): Mirror 2: 0x864557da (stale) CRC-32 checksum value for chunk [0, 0x21639): Mirror 1: 0xe5ff8f85 Mirror 3: 0xe5ff8f85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21639: skipped 000286 1784585623.985414 fallocate 0x02371b thru 0x02aaf8 (0x73de bytes) 000287 1784585624.079805 MIRROR_RESYNC 3 mirrors 000288 1784585624.976048 read 0x01a01d thru 0x021638 (0x761c bytes) 000289 1784585624.997922 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000291 1784585625.476524 trunc from 0x013459 to 0x01f597 (0xc13f bytes) 000292 1784585625.537866 write 0x0033b7 thru 0x010308 (0xcf52 bytes) 000293 1784585625.558759 fallocate 0x01b6ad thru 0x01bdb0 (0x704 bytes) 000294 1784585625.567604 punch from 0x00361e to 0x007ebe (0x48a1 bytes) 000295 1784585625.585955 write 0x0042db thru 0x009b8e (0x58b4 bytes) 000296 1784585625.598513 mapread 0x015fd4 thru 0x01c242 (0x626f bytes) 000297 1784585625.641118 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21639): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21639): Mirror 3: 0xe5ff8f85 (stale) CRC-32 checksum value for chunk [0, 0x21639): Mirror 1: 0x7d9f3ddf Mirror 4: 0x7d9f3ddf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21639: skipped 000299 1784585626.827923 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21639): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21639): Mirror 3: 0xe5ff8f85 (stale) CRC-32 checksum value for chunk [0, 0x21639): Mirror 1: 0x7d9f3ddf Mirror 4: 0x7d9f3ddf Mirror 5: 0x7d9f3ddf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21639: skipped 000300 1784585628.123990 mapread 0x019e96 thru 0x01ec26 (0x4d91 bytes) 000301 1784585628.174513 trunc from 0x016e00 to 0x021638 (0xa839 bytes) 000302 1784585628.256309 mapwrite 0x020451 thru 0x021d9f (0x194f bytes) 000303 1784585628.332496 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x21da0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21da0): Mirror 3: 0xc208a8c5 (stale) Mirror 4: 0x8c6ed3e8 (stale) Mirror 5: 0x8c6ed3e8 (stale) CRC-32 checksum value for chunk [0, 0x21da0): Mirror 1: 0xe9ec6cf4 Mirror 6: 0xe9ec6cf4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21da0: skipped 000305 1784585629.256224 write 0x011490 thru 0x01ce30 (0xb9a1 bytes) 000306 1784585629.324443 write 0x013ced thru 0x020291 (0xc5a5 bytes) 000307 1784585629.334519 write 0x0327db thru 0x03ffff (0xd825 bytes) 000308 1784585629.337790 write 0x0057e5 thru 0x00e712 (0x8f2e bytes) 000309 1784585629.363784 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe679b20 (stale) Mirror 4: 0x3274f8cc (stale) Mirror 6: 0x85d448e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe679b20 (stale) Mirror 4: 0x3274f8cc (stale) Mirror 6: 0x85d448e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000310 1784585629.909401 punch from 0x00fd43 to 0x010800 (0xabe bytes) 000311 1784585629.916850 punch from 0x037266 to 0x03ffff (0x8d9a bytes) 000312 1784585629.932134 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3274f8cc (stale) Mirror 6: 0x85d448e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3274f8cc (stale) Mirror 6: 0x85d448e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000313 1784585630.343210 fallocate 0x0337c7 thru 0x039f61 (0x679b bytes) 000314 1784585630.354566 mapwrite 0x02a549 thru 0x03894e (0xe406 bytes) 000315 1784585630.440393 fallocate 0x029288 thru 0x02d914 (0x468d bytes) 000316 1784585630.448858 fallocate 0x005608 thru 0x011bce (0xc5c7 bytes) 000317 1784585630.455155 trunc from 0x040000 to 0x011849 (0x2e7b6 bytes) 000318 1784585630.516081 read 0x00f8a4 thru 0x011849 (0x1fa6 bytes) 000319 1784585630.522728 read 0x009814 thru 0x011849 (0x8036 bytes) 000320 1784585630.533920 read 0x0034e2 thru 0x00ba4a (0x8569 bytes) 000323 1784585630.536476 write 0x015696 thru 0x018b75 (0x34e0 bytes) 000324 1784585630.538618 trunc from 0x0048dd to 0x0061f3 (0x1917 bytes) 000325 1784585630.552680 mapwrite 0x0284e8 thru 0x032495 (0x9fae bytes) 000326 1784585630.627327 read 0x00ae7b thru 0x00fbd2 (0x4d58 bytes) 000327 1784585630.628512 write 0x03203c thru 0x0337e7 (0x17ac bytes) 000328 1784585630.638055 MIRROR_RESYNC 3 mirrors 000329 1784585631.920395 trunc from 0x0337e8 to 0x02ca3d (0x6daa bytes) 000330 1784585632.018882 MIRROR_RESYNC 3 mirrors 000332 1784585633.459620 mapwrite 0x038fb4 thru 0x03ffff (0x704c bytes) 000333 1784585633.629010 read 0x002637 thru 0x008417 (0x5de1 bytes) 000334 1784585633.648365 write 0x00ef44 thru 0x01a18b (0xb248 bytes) 000335 1784585633.677498 mapwrite 0x007c5d thru 0x00dc63 (0x6007 bytes) 000336 1784585633.719055 write 0x02807a thru 0x02845a (0x3e1 bytes) 000337 1784585633.724316 mapwrite 0x023a8f thru 0x03347f (0xf9f1 bytes) 000338 1784585633.801079 read 0x011a76 thru 0x01fc27 (0xe1b2 bytes) 000339 1784585633.822581 mapread 0x01d92b thru 0x0208ce (0x2fa4 bytes) 000340 1784585633.824010 trunc from 0x040000 to 0x02f6ad (0x10952 bytes) 000341 1784585633.848615 mapwrite 0x00e7ff thru 0x016294 (0x7a96 bytes) 000342 1784585633.868030 mapwrite 0x02c85c thru 0x02e23e (0x19e3 bytes) 000343 1784585633.880919 mapwrite 0x01e349 thru 0x023637 (0x52ef bytes) 000344 1784585633.901881 mapread 0x015566 thru 0x01b471 (0x5f0c bytes) 000345 1784585633.904657 punch from 0x02ec8b to 0x02f6ad (0xa23 bytes) 000346 1784585633.909994 punch from 0x01bfa2 to 0x01d663 (0x16c2 bytes) 000347 1784585633.915651 write 0x02e5b5 thru 0x03b411 (0xce5d bytes) 000349 1784585633.928764 MIRROR_RESYNC 3 mirrors 000350 1784585635.006267 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000351 1784585635.383049 trunc from 0x03b412 to 0x01f893 (0x1bb7e bytes) 000352 1784585635.485541 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1f894): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f894): Mirror 6: 0xb892a7d0 (stale) CRC-32 checksum value for chunk [0, 0x1f894): Mirror 1: 0xb892a7d0 Mirror 7: 0xb892a7d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f894: skipped 000354 1784585636.741960 write 0x003b1a thru 0x00a1fa (0x66e1 bytes) 000355 1784585636.816822 read 0x004fe2 thru 0x00f06b (0xa08a bytes) 000356 1784585636.828703 read 0x005d67 thru 0x008ea0 (0x313a bytes) 000357 1784585636.829901 mapread 0x01d3b2 thru 0x01f893 (0x24e2 bytes) 000359 1784585636.851378 trunc from 0x01f894 to 0x03e84a (0x1efb7 bytes) 000360 1784585636.878037 read 0x02ff49 thru 0x0318ea (0x19a2 bytes) 000361 1784585636.892522 mapwrite 0x0050fd thru 0x0099b4 (0x48b8 bytes) 000362 1784585636.910301 read 0x00e8ad thru 0x019059 (0xa7ad bytes) 000363 1784585636.911291 mapwrite 0x00c95c thru 0x0106da (0x3d7f bytes) 000364 1784585636.929705 mapread 0x00b200 thru 0x011676 (0x6477 bytes) 000365 1784585636.930999 trunc from 0x03e84b to 0x02439c (0x1a4ae bytes) 000366 1784585636.948841 fallocate 0x034235 thru 0x03a7ac (0x6578 bytes) 000367 1784585636.954753 mapwrite 0x00648a thru 0x00ab5d (0x46d4 bytes) 000368 1784585636.974891 punch from 0x0019a5 to 0x0105d2 (0xec2e bytes) 000369 1784585636.982620 trunc from 0x01a554 to 0x02439c (0x9e49 bytes) 000370 1784585636.989923 write 0x02f39b thru 0x02f520 (0x186 bytes) 000371 1784585636.991276 punch from 0x00fa61 to 0x0113e1 (0x1981 bytes) 000372 1784585636.997727 trunc from 0x02f521 to 0x00d434 (0x220ec bytes) 000373 1784585637.025718 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xd435): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd435): Mirror 6: 0x6b6b95ba (stale) Mirror 7: 0x6b6b95ba (stale) CRC-32 checksum value for chunk [0, 0xd435): Mirror 1: 0xf2723dae Mirror 8: 0xf2723dae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd435: skipped 000375 1784585638.161326 fallocate 0x019722 thru 0x01b32c (0x1c0b bytes) 000376 1784585638.201774 read 0x006519 thru 0x00d434 (0x6f1c bytes) 000377 1784585638.214140 fallocate 0x000697 thru 0x00d681 (0xcfeb bytes) 000378 1784585638.219080 read 0x0056a1 thru 0x00d434 (0x7d94 bytes) 000379 1784585638.228824 trunc from 0x00d435 to 0x01199e (0x456a bytes) 000380 1784585638.255659 mapwrite 0x008399 thru 0x00e35f (0x5fc7 bytes) 000381 1784585638.282715 write 0x01a987 thru 0x02a320 (0xf99a bytes) 000382 1784585638.291377 MIRROR_RESYNC 4 mirrors 000383 1784585639.452806 write 0x038b5b thru 0x03dbd2 (0x5078 bytes) 000384 1784585639.476934 fallocate 0x02c568 thru 0x03623b (0x9cd4 bytes) 000385 1784585639.484292 mapread 0x002f4c thru 0x004c9a (0x1d4f bytes) 000386 1784585639.509939 punch from 0x00b4f5 to 0x0179ea (0xc4f6 bytes) 000387 1784585639.515492 write 0x03b5f6 thru 0x03ffff (0x4a0a bytes) 000388 1784585639.521303 trunc from 0x027c96 to 0x0305b9 (0x8924 bytes) 000389 1784585639.534738 punch from 0x015378 to 0x01f358 (0x9fe1 bytes) 000390 1784585639.544980 fallocate 0x009cb9 thru 0x00f943 (0x5c8b bytes) 000391 1784585639.561740 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc1d5b907 (stale) Mirror 7: 0xc1d5b907 (stale) Mirror 8: 0xc1d5b907 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x30f8cc85 Mirror 9: 0x30f8cc85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000393 1784585640.818530 fallocate 0x020e36 thru 0x026adf (0x5caa bytes) 000394 1784585640.858520 write 0x001adb thru 0x00701c (0x5542 bytes) 000395 1784585640.880662 fallocate 0x006dba thru 0x006e92 (0xd9 bytes) 000396 1784585640.894028 write 0x026ca2 thru 0x029a8e (0x2ded bytes) 000397 1784585640.921465 write 0x02c38b thru 0x038aa5 (0xc71b bytes) 000398 1784585640.942915 write 0x03e5cc thru 0x03ffff (0x1a34 bytes) 000399 1784585640.954807 trunc from 0x0353e2 to 0x03a7a3 (0x53c2 bytes) 000400 1784585640.985663 trunc from 0x014014 to 0x0158ce (0x18bb bytes) 000401 1784585640.993931 punch from 0x039e1f to 0x03ffff (0x61e1 bytes) 000402 1784585641.003712 trunc from 0x040000 to 0x00eb0c (0x314f3 bytes) 000403 1784585641.036137 punch from 0x008d43 to 0x00eb0c (0x5dca bytes) 000404 1784585641.043847 punch from 0x007a9d to 0x00d959 (0x5ebd bytes) 000406 1784585641.053039 trunc from 0x00e4e7 to 0x00eb0c (0x626 bytes) 000408 1784585641.060926 punch from 0x007b9e to 0x00eb0c (0x6f6f bytes) 000409 1784585641.068221 read 0x00b396 thru 0x00eb0c (0x3777 bytes) 000410 1784585641.075607 trunc from 0x0085de to 0x00eb0c (0x652f bytes) 000412 1784585641.085416 mapwrite 0x038efa thru 0x03fb14 (0x6c1b bytes) 000413 1784585641.170815 trunc from 0x03fb15 to 0x038a1f (0x70f5 bytes) 000414 1784585641.204586 punch from 0x017c4b to 0x01f6a4 (0x7a5a bytes) 000415 1784585641.225310 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38a20): Mirror 6: 0xc7b70ed3 (stale) Mirror 7: 0xc7b70ed3 (stale) Mirror 9: 0x3220f0b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a20): Mirror 6: 0xc7b70ed3 (stale) Mirror 7: 0xc7b70ed3 (stale) Mirror 9: 0x3220f0b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a20: skipped 000416 1784585641.825408 fallocate 0x02c760 thru 0x030e0a (0x46ab bytes) 000417 1784585641.834721 trunc from 0x038a20 to 0x01cb51 (0x1bece bytes) 000418 1784585641.878006 punch from 0x006698 to 0x012b12 (0xc47b bytes) 000419 1784585641.891295 mapread 0x0140dc thru 0x01cb51 (0x8a76 bytes) 000420 1784585641.926418 fallocate 0x006455 thru 0x007581 (0x112d bytes) 000421 1784585641.936874 fallocate 0x02f123 thru 0x03abc2 (0xbaa0 bytes) 000422 1784585641.949332 punch from 0x010c9a to 0x01fcf0 (0xf057 bytes) 000423 1784585641.954695 punch from 0x0136d2 to 0x017c66 (0x4595 bytes) 000424 1784585641.960571 fallocate 0x023836 thru 0x031014 (0xd7df bytes) 000425 1784585641.967060 write 0x01533d thru 0x0192b8 (0x3f7c bytes) 000427 1784585641.978565 fallocate 0x02fef7 thru 0x03ce11 (0xcf1b bytes) 000428 1784585641.983780 read 0x035f65 thru 0x038577 (0x2613 bytes) 000429 1784585641.994118 MIRROR_RESYNC 4 mirrors 000430 1784585643.490044 trunc from 0x03abc3 to 0x004839 (0x36389 bytes) 000431 1784585643.570867 read 0x002426 thru 0x004839 (0x2414 bytes) 000434 1784585643.595976 mapwrite 0x00e304 thru 0x015dd0 (0x7acd bytes) 000435 1784585643.744080 fallocate 0x02741a thru 0x02f26a (0x7e51 bytes) 000436 1784585643.763090 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x15dd1): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15dd1): Mirror 6: 0x89a8adcd (stale) Mirror 7: 0x89a8adcd (stale) Mirror 9: 0x89a8adcd (stale) CRC-32 checksum value for chunk [0, 0x15dd1): Mirror 1: 0x6107ec29 Mirror 10: 0x6107ec29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15dd1: skipped 000437 1784585644.814043 write 0x00be49 thru 0x0127aa (0x6962 bytes) 000438 1784585644.920034 trunc from 0x00c569 to 0x015b1e (0x95b6 bytes) 000439 1784585644.949827 trunc from 0x014fa2 to 0x015dd0 (0xe2f bytes) 000440 1784585644.963621 trunc from 0x015dd1 to 0x014587 (0x1849 bytes) 000442 1784585645.007512 MIRROR_RESYNC 5 mirrors 000443 1784585646.629945 trunc from 0x005372 to 0x008462 (0x30f1 bytes) 000444 1784585646.706741 trunc from 0x005ca1 to 0x00d4d2 (0x7832 bytes) 000445 1784585646.726132 read 0x013d8c thru 0x014587 (0x7fc bytes) 000446 1784585646.741101 trunc from 0x014588 to 0x022433 (0xdeac bytes) 000447 1784585646.789623 punch from 0x01d122 to 0x022433 (0x5312 bytes) 000448 1784585646.800974 punch from 0x007edf to 0x0139e1 (0xbb03 bytes) 000449 1784585646.822114 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22434): Mirror 7: 0x8abec8af (stale) Mirror 9: 0x8abec8af (stale) Mirror 10: 0x8abec8af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22434): Mirror 7: 0x8abec8af (stale) Mirror 9: 0x8abec8af (stale) Mirror 10: 0x8abec8af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22434: skipped 000450 1784585647.255112 mapread 0x000cc6 thru 0x00f8fd (0xec38 bytes) 000451 1784585647.281494 trunc from 0x01e26c to 0x022433 (0x41c8 bytes) 000453 1784585647.290812 MIRROR_RESYNC 4 mirrors 000454 1784585648.315980 mapwrite 0x013e7a thru 0x01bed3 (0x805a bytes) 000456 1784585648.457153 mapread 0x01acb3 thru 0x022433 (0x7781 bytes) 000457 1784585648.477462 mapread 0x00cd3c thru 0x0125f3 (0x58b8 bytes) 000458 1784585648.533015 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22434): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22434): Mirror 7: 0x745b70b8 (stale) Mirror 9: 0x745b70b8 (stale) Mirror 10: 0x745b70b8 (stale) CRC-32 checksum value for chunk [0, 0x22434): Mirror 1: 0xc0152197 Mirror 11: 0xc0152197 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22434: skipped 000459 1784585649.798255 mapwrite 0x011307 thru 0x01bc56 (0xa950 bytes) 000460 1784585649.970724 fallocate 0x004488 thru 0x00e989 (0xa502 bytes) 000461 1784585650.000897 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x22434): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22434): Mirror 7: 0x745b70b8 (stale) Mirror 9: 0x745b70b8 (stale) Mirror 10: 0x745b70b8 (stale) Mirror 11: 0xc0152197 (stale) CRC-32 checksum value for chunk [0, 0x22434): Mirror 1: 0x955ddc09 Mirror 12: 0x955ddc09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22434: skipped 000462 1784585651.379029 mapread 0x020ae3 thru 0x022433 (0x1951 bytes) 000463 1784585651.403642 write 0x039d8a thru 0x03ffff (0x6276 bytes) 000464 1784585651.455952 read 0x0392ec thru 0x03cf37 (0x3c4c bytes) 000465 1784585651.461797 punch from 0x013aaa to 0x01b29c (0x77f3 bytes) 000466 1784585651.473366 mapwrite 0x03db0c thru 0x03ffff (0x24f4 bytes) 000467 1784585651.505398 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf8fcf335 (stale) Mirror 9: 0xf8fcf335 (stale) Mirror 11: 0xc33ecf7e (stale) Mirror 12: 0xa39e4d66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf8fcf335 (stale) Mirror 9: 0xf8fcf335 (stale) Mirror 11: 0xc33ecf7e (stale) Mirror 12: 0xa39e4d66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000468 1784585652.150093 trunc from 0x040000 to 0x003648 (0x3c9b7 bytes) 000469 1784585652.179574 mapread 0x00099c thru 0x003648 (0x2cad bytes) 000470 1784585652.205072 mapwrite 0x03d9e1 thru 0x03ffff (0x261f bytes) 000471 1784585652.270565 punch from 0x008665 to 0x01860f (0xffab bytes) 000472 1784585652.293874 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf8fcf335 (stale) Mirror 9: 0xf8fcf335 (stale) Mirror 11: 0xc33ecf7e (stale) Mirror 12: 0xa39e4d66 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf08b28df Mirror 13: 0xf08b28df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000473 1784585653.830306 write 0x014644 thru 0x021f39 (0xd8f6 bytes) 000474 1784585653.903221 mapread 0x006011 thru 0x012c38 (0xcc28 bytes) 000475 1784585653.944369 fallocate 0x00f5a0 thru 0x0192a6 (0x9d07 bytes) 000476 1784585653.956240 write 0x00125f thru 0x00d96f (0xc711 bytes) 000477 1784585653.963283 write 0x02317a thru 0x03246f (0xf2f6 bytes) 000478 1784585653.999849 trunc from 0x011563 to 0x01725f (0x5cfd bytes) 000479 1784585654.024448 mapwrite 0x02fa23 thru 0x03470b (0x4ce9 bytes) 000480 1784585654.053002 read 0x03a31e thru 0x03c937 (0x261a bytes) 000481 1784585654.060793 mapread 0x0108d5 thru 0x01fbe9 (0xf315 bytes) 000482 1784585654.081018 punch from 0x009840 to 0x013f56 (0xa717 bytes) 000483 1784585654.103023 write 0x020a55 thru 0x024aa0 (0x404c bytes) 000484 1784585654.113218 fallocate 0x0398f3 thru 0x03ffff (0x670d bytes) 000485 1784585654.119634 mapread 0x03cb8a thru 0x03ffff (0x3476 bytes) 000486 1784585654.132935 mapread 0x032508 thru 0x03ffff (0xdaf8 bytes) 000487 1784585654.137631 fallocate 0x008e99 thru 0x016112 (0xd27a bytes) 000488 1784585654.159860 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf8fcf335 (stale) Mirror 9: 0xf8fcf335 (stale) Mirror 11: 0xc33ecf7e (stale) Mirror 12: 0xa39e4d66 (stale) Mirror 13: 0xf08b28df (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9d12c36d Mirror 14: 0x9d12c36d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000489 1784585655.436918 punch from 0x0355f7 to 0x03ffff (0xaa09 bytes) 000490 1784585655.494814 fallocate 0x0144f0 thru 0x01fe65 (0xb976 bytes) 000491 1784585655.503002 mapwrite 0x01fcd3 thru 0x02a125 (0xa453 bytes) 000492 1784585655.608002 mapwrite 0x00979f thru 0x00f303 (0x5b65 bytes) 000495 1784585655.660450 mapread 0x02bee2 thru 0x031fd4 (0x60f3 bytes) 000496 1784585655.663115 punch from 0x0280df to 0x02fe70 (0x7d92 bytes) 000497 1784585655.675887 punch from 0x0054f9 to 0x0151fc (0xfd04 bytes) 000498 1784585655.694339 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf8fcf335 (stale) Mirror 9: 0xf8fcf335 (stale) Mirror 11: 0xc33ecf7e (stale) Mirror 12: 0xa39e4d66 (stale) Mirror 13: 0xf08b28df (stale) Mirror 14: 0x9d12c36d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xba693f53 Mirror 15: 0xba693f53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000499 1784585657.359587 read 0x03e0a6 thru 0x03ffff (0x1f5a bytes) 000500 1784585657.375991 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf8fcf335 (stale) Mirror 9: 0xf8fcf335 (stale) Mirror 11: 0xc33ecf7e (stale) Mirror 12: 0xa39e4d66 (stale) Mirror 13: 0xf08b28df (stale) Mirror 14: 0x9d12c36d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xba693f53 Mirror 15: 0xba693f53 Mirror 16: 0xba693f53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000501 1784585658.943749 punch from 0x0382ab to 0x03c5fc (0x4352 bytes) 000502 1784585659.011916 read 0x0005f8 thru 0x00eb34 (0xe53d bytes) 000503 1784585659.023350 trunc from 0x040000 to 0x03629c (0x9d63 bytes) 000504 1784585659.064605 MIRROR_RESYNC 9 mirrors 000505 1784585662.548383 MIRROR_RESYNC 9 mirrors 000506 1784585663.519832 fallocate 0x03d301 thru 0x03ffff (0x2cff bytes) 000507 1784585663.561707 write 0x00fcc6 thru 0x016721 (0x6a5c bytes) 000508 1784585663.574385 punch from 0x011a4c to 0x01d269 (0xb81e bytes) 000509 1784585663.590037 punch from 0x00cb60 to 0x01201e (0x54bf bytes) 000510 1784585663.595778 fallocate 0x01af56 thru 0x022ebd (0x7f68 bytes) 000512 1784585663.601268 trunc from 0x03629d to 0x00685a (0x2fa42 bytes) 000513 1784585663.625305 mapwrite 0x02642f thru 0x035d37 (0xf909 bytes) 000514 1784585663.781605 trunc from 0x035d38 to 0x02c9e5 (0x9352 bytes) 000515 1784585663.836510 read 0x009313 thru 0x00c66b (0x3359 bytes) 000516 1784585663.847501 write 0x010722 thru 0x017b44 (0x7423 bytes) 000517 1784585663.863867 trunc from 0x02c9e6 to 0x033e6b (0x7486 bytes) 000518 1784585663.897583 trunc from 0x0279ac to 0x03096f (0x8fc4 bytes) 000519 1784585663.905530 mapread 0x007967 thru 0x012859 (0xaef3 bytes) 000520 1784585663.927741 fallocate 0x03c83b thru 0x03ffff (0x37c5 bytes) 000521 1784585663.933290 write 0x006a9f thru 0x01266b (0xbbcd bytes) 000522 1784585663.936296 read 0x001256 thru 0x005341 (0x40ec bytes) 000523 1784585663.941152 MIRROR_RESYNC 9 mirrors 000524 1784585666.912027 mapread 0x018faa thru 0x027c80 (0xecd7 bytes) 000525 1784585666.953075 read 0x016bab thru 0x0220cc (0xb522 bytes) 000526 1784585666.953755 write 0x017de0 thru 0x01852a (0x74b bytes) 000527 1784585667.021913 fallocate 0x0233bd thru 0x0306d8 (0xd31c bytes) 000528 1784585667.036044 punch from 0x0284a1 to 0x0348f5 (0xc455 bytes) 000529 1784585667.057683 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9b2c2c10 (stale) Mirror 9: 0x9b2c2c10 (stale) Mirror 11: 0x9b2c2c10 (stale) Mirror 12: 0x9b2c2c10 (stale) Mirror 13: 0x9b2c2c10 (stale) Mirror 14: 0x9b2c2c10 (stale) Mirror 15: 0x9b2c2c10 (stale) Mirror 16: 0x9b2c2c10 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x285e6fd8 Mirror 17: 0x285e6fd8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000530 1784585668.740469 mapread 0x02967a thru 0x02ce82 (0x3809 bytes) 000531 1784585668.782006 mapread 0x016fe9 thru 0x01e0db (0x70f3 bytes) 000532 1784585668.815890 write 0x02feb7 thru 0x03a4a1 (0xa5eb bytes) 000533 1784585668.917437 mapread 0x00a142 thru 0x0192ff (0xf1be bytes) 000534 1784585668.960460 mapread 0x014839 thru 0x01b7dd (0x6fa5 bytes) 000535 1784585668.963075 write 0x01394f thru 0x019660 (0x5d12 bytes) 000536 1784585668.965674 trunc from 0x040000 to 0x02626e (0x19d91 bytes) 000537 1784585669.020763 read 0x000f07 thru 0x007494 (0x658e bytes) 000538 1784585669.042953 MIRROR_RESYNC 10 mirrors 000539 1784585672.087802 read 0x006cfa thru 0x0137cf (0xcad6 bytes) 000540 1784585672.106614 write 0x00b676 thru 0x00d4c5 (0x1e50 bytes) 000541 1784585672.182277 mapread 0x017160 thru 0x024acb (0xd96c bytes) 000542 1784585672.223953 trunc from 0x016e59 to 0x022c02 (0xbdaa bytes) 000543 1784585672.238980 fallocate 0x00f078 thru 0x014ff3 (0x5f7c bytes) 000544 1784585672.249387 write 0x007583 thru 0x00ad1a (0x3798 bytes) 000545 1784585672.283099 mapwrite 0x0300a3 thru 0x03ff9e (0xfefc bytes) 000546 1784585672.368066 punch from 0x004b5a to 0x0127b9 (0xdc60 bytes) 000547 1784585672.375606 mapread 0x00287c thru 0x00bfca (0x974f bytes) 000548 1784585672.396712 read 0x0172fa thru 0x01e8ad (0x75b4 bytes) 000549 1784585672.423051 trunc from 0x03ff9f to 0x003f44 (0x3c05a bytes) 000550 1784585672.448833 read 0x003cac thru 0x003f44 (0x299 bytes) 000551 1784585672.450583 fallocate 0x007021 thru 0x00b141 (0x4121 bytes) 000552 1784585672.462352 trunc from 0x00057d to 0x003f44 (0x39c8 bytes) 000553 1784585672.472620 punch from 0x002182 to 0x003f44 (0x1dc3 bytes) 000554 1784585672.480470 trunc from 0x003f45 to 0x014ee3 (0x10f9f bytes) 000555 1784585672.519098 MIRROR_RESYNC 10 mirrors 000557 1784585675.859463 mapread 0x002cf5 thru 0x00a076 (0x7382 bytes) 000558 1784585675.902741 mapread 0x012f93 thru 0x014ee3 (0x1f51 bytes) 000560 1784585675.911546 fallocate 0x01e59b thru 0x01ee6b (0x8d1 bytes) 000561 1784585675.967199 trunc from 0x014ee4 to 0x029974 (0x14a91 bytes) 000562 1784585676.006670 write 0x00fc64 thru 0x01ea40 (0xeddd bytes) 000563 1784585676.029394 mapwrite 0x00f97f thru 0x0143de (0x4a60 bytes) 000564 1784585676.089137 read 0x014ba0 thru 0x01b4bc (0x691d bytes) 000565 1784585676.107282 MIRROR_RESYNC 10 mirrors 000566 1784585679.693956 MIRROR_RESYNC 10 mirrors 000568 1784585680.427456 fallocate 0x000da1 thru 0x007995 (0x6bf5 bytes) 000569 1784585680.486555 write 0x03dc60 thru 0x03ffff (0x23a0 bytes) 000570 1784585680.495071 MIRROR_RESYNC 10 mirrors 000571 1784585683.746968 mapwrite 0x00b430 thru 0x01320e (0x7ddf bytes) 000572 1784585683.880109 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xa773fff5 (stale) Mirror 9: 0xa773fff5 (stale) Mirror 11: 0xa773fff5 (stale) Mirror 12: 0xa773fff5 (stale) Mirror 13: 0xa773fff5 (stale) Mirror 14: 0xa773fff5 (stale) Mirror 15: 0xa773fff5 (stale) Mirror 16: 0xa773fff5 (stale) Mirror 17: 0xa773fff5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd3673c78 Mirror 18: 0xd3673c78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000573 1784585685.619601 read 0x030077 thru 0x0360fa (0x6084 bytes) 000574 1784585685.651774 trunc from 0x01ae9d to 0x01dea7 (0x300b bytes) 000575 1784585685.710816 write 0x03461f thru 0x03c47d (0x7e5f bytes) 000576 1784585685.725444 fallocate 0x00093f thru 0x000e82 (0x544 bytes) 000577 1784585685.730893 trunc from 0x040000 to 0x011864 (0x2e79b bytes) 000578 1784585685.751033 read 0x00bee0 thru 0x011864 (0x5985 bytes) 000579 1784585685.762339 fallocate 0x00440f thru 0x011215 (0xce07 bytes) 000580 1784585685.767595 mapread 0x00a62f thru 0x010954 (0x6326 bytes) 000581 1784585685.769971 mapwrite 0x0017f6 thru 0x005db8 (0x45c3 bytes) 000582 1784585685.797218 mapwrite 0x01db5c thru 0x020d56 (0x31fb bytes) 000583 1784585685.938235 trunc from 0x020d57 to 0x01098f (0x103c7 bytes) 000584 1784585685.971014 fallocate 0x02280c thru 0x023fe1 (0x17d6 bytes) 000585 1784585685.992627 write 0x033231 thru 0x03ffff (0xcdcf bytes) 000586 1784585686.004786 mapwrite 0x01d0b3 thru 0x01f674 (0x25c2 bytes) 000588 1784585686.119308 fallocate 0x00a425 thru 0x019a40 (0xf61c bytes) 000589 1784585686.124640 punch from 0x00c4ae to 0x0104c2 (0x4015 bytes) 000590 1784585686.134628 fallocate 0x01c486 thru 0x025ff7 (0x9b72 bytes) 000591 1784585686.151779 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xa773fff5 (stale) Mirror 9: 0xa773fff5 (stale) Mirror 11: 0xa773fff5 (stale) Mirror 12: 0xa773fff5 (stale) Mirror 13: 0xa773fff5 (stale) Mirror 14: 0xa773fff5 (stale) Mirror 15: 0xa773fff5 (stale) Mirror 16: 0xa773fff5 (stale) Mirror 17: 0xa773fff5 (stale) Mirror 18: 0xd3673c78 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x79f2ff9c Mirror 19: 0x79f2ff9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000592 1784585687.713489 punch from 0x00cf70 to 0x00d4e9 (0x57a bytes) 000593 1784585687.813867 punch from 0x02a81d to 0x035ca8 (0xb48c bytes) 000594 1784585687.825424 mapwrite 0x03576d thru 0x03ffff (0xa893 bytes) 000595 1784585687.964328 MIRROR_RESYNC 12 mirrors 000596 1784585694.077292 write 0x008200 thru 0x00fee1 (0x7ce2 bytes) 000597 1784585694.156192 trunc from 0x040000 to 0x0333d1 (0xcc2e bytes) 000598 1784585694.184638 mapread 0x0176c1 thru 0x01a21c (0x2b5c bytes) 000599 1784585694.210124 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x333d2): Mirror 7: 0x9caf8b27 (stale) Mirror 9: 0x9caf8b27 (stale) Mirror 11: 0x9caf8b27 (stale) Mirror 12: 0x9caf8b27 (stale) Mirror 13: 0x9caf8b27 (stale) Mirror 14: 0x9caf8b27 (stale) Mirror 16: 0x9caf8b27 (stale) Mirror 17: 0x9caf8b27 (stale) Mirror 18: 0x9caf8b27 (stale) Mirror 19: 0x9caf8b27 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x333d2): Mirror 7: 0x9caf8b27 (stale) Mirror 9: 0x9caf8b27 (stale) Mirror 11: 0x9caf8b27 (stale) Mirror 12: 0x9caf8b27 (stale) Mirror 13: 0x9caf8b27 (stale) Mirror 14: 0x9caf8b27 (stale) Mirror 16: 0x9caf8b27 (stale) Mirror 17: 0x9caf8b27 (stale) Mirror 18: 0x9caf8b27 (stale) Mirror 19: 0x9caf8b27 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x333d2: skipped 000600 1784585695.354588 mapread 0x00a278 thru 0x00bd8d (0x1b16 bytes) 000601 1784585695.373735 fallocate 0x0276a9 thru 0x02c5e4 (0x4f3c bytes) 000602 1784585695.385521 write 0x03626b thru 0x03cf00 (0x6c96 bytes) 000603 1784585695.395821 trunc from 0x03cf01 to 0x007469 (0x35a97 bytes) 000605 1784585695.438712 trunc from 0x00746a to 0x026926 (0x1f4bd bytes) 000606 1784585695.466605 read 0x01fc40 thru 0x02411c (0x44dd bytes) 000607 1784585695.492004 MIRROR_RESYNC 11 mirrors 000609 1784585698.219055 fallocate 0x00cadb thru 0x01778e (0xacb4 bytes) 000610 1784585698.278027 fallocate 0x006b8f thru 0x011397 (0xa809 bytes) 000611 1784585698.295435 trunc from 0x00a0ec to 0x01508d (0xafa2 bytes) 000612 1784585698.310835 mapwrite 0x008c8e thru 0x0132e3 (0xa656 bytes) 000613 1784585698.449120 fallocate 0x03f4b3 thru 0x03f536 (0x84 bytes) 000614 1784585698.464035 trunc from 0x026927 to 0x002cde (0x23c48 bytes) 000615 1784585698.512498 MIRROR_RESYNC 11 mirrors 000616 1784585700.292016 write 0x03db05 thru 0x03e2e1 (0x7dd bytes) 000617 1784585700.336894 punch from 0x00ca19 to 0x015d40 (0x9328 bytes) 000619 1784585700.359150 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e2e2): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e2e2): Mirror 7: 0xd0697678 (stale) Mirror 9: 0xd0697678 (stale) Mirror 11: 0xd0697678 (stale) Mirror 12: 0xd0697678 (stale) Mirror 13: 0xd0697678 (stale) Mirror 14: 0xd0697678 (stale) Mirror 16: 0xd0697678 (stale) Mirror 17: 0xd0697678 (stale) Mirror 18: 0xd0697678 (stale) Mirror 19: 0xd0697678 (stale) CRC-32 checksum value for chunk [0, 0x3e2e2): Mirror 1: 0x8fb499e9 Mirror 20: 0x8fb499e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e2e2: skipped 000620 1784585702.098701 trunc from 0x02faeb to 0x03e2e1 (0xe7f7 bytes) 000621 1784585702.156975 punch from 0x0269d0 to 0x02ebea (0x821b bytes) 000622 1784585702.165431 write 0x037379 thru 0x03a487 (0x310f bytes) 000623 1784585702.191412 read 0x012793 thru 0x01d75e (0xafcc bytes) 000624 1784585702.206627 trunc from 0x03e2e2 to 0x023c37 (0x1a6aa bytes) 000625 1784585702.227531 trunc from 0x00b128 to 0x01afcc (0xfea5 bytes) 000626 1784585702.237105 fallocate 0x01dcc3 thru 0x024288 (0x65c6 bytes) 000627 1784585702.249771 trunc from 0x0159e0 to 0x017363 (0x1984 bytes) 000628 1784585702.256451 read 0x01778e thru 0x01be48 (0x46bb bytes) 000629 1784585702.271340 write 0x02aed2 thru 0x037651 (0xc780 bytes) 000630 1784585702.275589 read 0x00a360 thru 0x00b021 (0xcc2 bytes) 000631 1784585702.276726 mapwrite 0x03f9ae thru 0x03ffff (0x652 bytes) 000632 1784585702.346237 mapwrite 0x02989d thru 0x0345dc (0xad40 bytes) 000633 1784585702.377418 fallocate 0x0263c0 thru 0x02eed0 (0x8b11 bytes) 000634 1784585702.392744 mapread 0x01df55 thru 0x02cf16 (0xefc2 bytes) 000635 1784585702.401136 trunc from 0x008edc to 0x011196 (0x82bb bytes) 000636 1784585702.418620 fallocate 0x017a91 thru 0x0196f7 (0x1c67 bytes) 000637 1784585702.429345 read 0x00affe thru 0x01a131 (0xf134 bytes) 000638 1784585702.442122 trunc from 0x040000 to 0x034c15 (0xb3ea bytes) 000640 1784585702.464091 fallocate 0x00e1e4 thru 0x01c90e (0xe72b bytes) 000641 1784585702.470682 trunc from 0x034c16 to 0x02b7ef (0x9426 bytes) 000642 1784585702.491625 trunc from 0x026d80 to 0x02b7ef (0x4a70 bytes) 000643 1784585702.498783 mapwrite 0x00953f thru 0x00c7ee (0x32b0 bytes) 000644 1784585702.518139 punch from 0x02551b to 0x026aca (0x15b0 bytes) 000645 1784585702.528558 mapwrite 0x034e36 thru 0x03ffff (0xb1ca bytes) 000646 1784585702.640646 mapread 0x021d4d thru 0x02cb4f (0xae03 bytes) 000647 1784585702.684969 mapwrite 0x018c84 thru 0x01c340 (0x36bd bytes) 000648 1784585702.705014 punch from 0x00f069 to 0x017894 (0x882c bytes) 000649 1784585702.711535 trunc from 0x022a9c to 0x0245e4 (0x1b49 bytes) 000650 1784585702.720034 fallocate 0x00b990 thru 0x018cbb (0xd32c bytes) 000651 1784585702.727021 fallocate 0x00e694 thru 0x0128bf (0x422c bytes) 000652 1784585702.733320 fallocate 0x033f4d thru 0x0340f7 (0x1ab bytes) 000653 1784585702.738828 mapwrite 0x01dca9 thru 0x029f47 (0xc29f bytes) 000654 1784585702.799146 mapwrite 0x01fdaa thru 0x02ea8e (0xece5 bytes) 000655 1784585702.881482 mapwrite 0x0227b3 thru 0x02d959 (0xb1a7 bytes) 000656 1784585702.954002 mapread 0x0315cc thru 0x0338cc (0x2301 bytes) 000657 1784585702.984641 mapwrite 0x01adc3 thru 0x029728 (0xe966 bytes) 000658 1784585703.040927 fallocate 0x00c0c4 thru 0x0175ed (0xb52a bytes) 000659 1784585703.051677 fallocate 0x02b9bd thru 0x032cd2 (0x7316 bytes) 000660 1784585703.063886 mapwrite 0x0093af thru 0x012c5f (0x98b1 bytes) 000662 1784585703.145319 mapread 0x0196c7 thru 0x026a71 (0xd3ab bytes) 000663 1784585703.148090 mapwrite 0x00ef55 thru 0x0100c8 (0x1174 bytes) 000664 1784585703.170373 trunc from 0x040000 to 0x003c98 (0x3c367 bytes) 000665 1784585703.196806 read 0x0038a2 thru 0x003c98 (0x3f7 bytes) 000666 1784585703.198757 trunc from 0x003c99 to 0x01d2e9 (0x19651 bytes) 000667 1784585703.225057 fallocate 0x026a1e thru 0x0289d4 (0x1fb7 bytes) 000669 1784585703.233726 trunc from 0x0289d5 to 0x022ff3 (0x59e1 bytes) 000670 1784585703.270520 punch from 0x008516 to 0x016fbc (0xeaa7 bytes) 000671 1784585703.277963 trunc from 0x022ff4 to 0x02707b (0x4088 bytes) 000672 1784585703.296219 write 0x038483 thru 0x03ffff (0x7b7d bytes) 000673 1784585703.298078 read 0x033e0b thru 0x03a0fe (0x62f4 bytes) 000674 1784585703.318981 trunc from 0x040000 to 0x03db65 (0x249a bytes) 000675 1784585703.343513 trunc from 0x01e448 to 0x0291a9 (0xad62 bytes) 000676 1784585703.356900 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3db66): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db66): Mirror 7: 0xe592afaf (stale) Mirror 9: 0xe592afaf (stale) Mirror 11: 0xe592afaf (stale) Mirror 12: 0xe592afaf (stale) Mirror 13: 0xe592afaf (stale) Mirror 14: 0xe592afaf (stale) Mirror 16: 0xe592afaf (stale) Mirror 17: 0xe592afaf (stale) Mirror 18: 0xe592afaf (stale) Mirror 19: 0xe592afaf (stale) Mirror 20: 0xd4021684 (stale) CRC-32 checksum value for chunk [0, 0x3db66): Mirror 1: 0x4b3febb3 Mirror 21: 0x4b3febb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db66: skipped 000677 1784585704.778453 fallocate 0x01aa36 thru 0x028265 (0xd830 bytes) 000678 1784585704.854608 trunc from 0x03db66 to 0x018963 (0x25202 bytes) 000679 1784585704.912501 trunc from 0x00fd42 to 0x01482d (0x4aec bytes) 000680 1784585704.921303 mapwrite 0x0383c9 thru 0x038af6 (0x72e bytes) 000681 1784585704.989992 fallocate 0x0377cf thru 0x03ffff (0x8831 bytes) 000682 1784585704.999434 mapwrite 0x02c728 thru 0x037f54 (0xb82d bytes) 000683 1784585705.106440 write 0x01ca4f thru 0x02591c (0x8ece bytes) 000684 1784585705.120622 read 0x027535 thru 0x0323a7 (0xae73 bytes) 000685 1784585705.122434 trunc from 0x00effe to 0x019d82 (0xad85 bytes) 000686 1784585705.130063 trunc from 0x023931 to 0x0278bc (0x3f8c bytes) 000687 1784585705.145135 fallocate 0x02f3ae thru 0x03a976 (0xb5c9 bytes) 000688 1784585705.153361 trunc from 0x040000 to 0x02701c (0x18fe3 bytes) 000689 1784585705.176909 trunc from 0x011bc1 to 0x018ef2 (0x7332 bytes) 000690 1784585705.181818 mapread 0x01c63f thru 0x01fac0 (0x3482 bytes) 000691 1784585705.183913 fallocate 0x003c19 thru 0x01355b (0xf943 bytes) 000692 1784585705.189934 mapwrite 0x0176fd thru 0x021831 (0xa135 bytes) 000693 1784585705.235980 mapwrite 0x02a868 thru 0x03a19b (0xf934 bytes) 000694 1784585705.306377 trunc from 0x0316b0 to 0x03397e (0x22cf bytes) 000695 1784585705.312094 mapread 0x01e3c3 thru 0x024edb (0x6b19 bytes) 000696 1784585705.314722 read 0x01f078 thru 0x026995 (0x791e bytes) 000697 1784585705.317458 mapread 0x004c36 thru 0x00bddd (0x71a8 bytes) 000698 1784585705.328089 trunc from 0x03a19c to 0x034625 (0x5b76 bytes) 000699 1784585705.349217 fallocate 0x02ab37 thru 0x039a6d (0xef37 bytes) 000700 1784585705.358033 write 0x0060dd thru 0x009d79 (0x3c9d bytes) 000701 1784585705.360317 mapread 0x02635e thru 0x02cbb9 (0x685c bytes) 000702 1784585705.363528 fallocate 0x00fdcc thru 0x01d85e (0xda93 bytes) 000703 1784585705.372528 read 0x020c80 thru 0x027192 (0x6513 bytes) 000704 1784585705.374430 trunc from 0x034626 to 0x020886 (0x13d9f bytes) 000705 1784585705.397685 read 0x0077b5 thru 0x00ba16 (0x4262 bytes) 000706 1784585705.398845 fallocate 0x03efe5 thru 0x03f88d (0x8a9 bytes) 000707 1784585705.406444 read 0x03ca9f thru 0x03f88d (0x2def bytes) 000708 1784585705.419972 punch from 0x018a34 to 0x025649 (0xcc16 bytes) 000709 1784585705.425955 mapwrite 0x0188b2 thru 0x024ee0 (0xc62f bytes) 000710 1784585705.622359 trunc from 0x00adb8 to 0x00b6ba (0x903 bytes) 000711 1784585705.651799 mapwrite 0x01406e thru 0x0208e6 (0xc879 bytes) 000712 1784585705.684929 MIRROR_RESYNC 13 mirrors 000713 1784585710.884600 mapwrite 0x038ccd thru 0x03ffff (0x7333 bytes) 000714 1784585711.048631 punch from 0x0366f1 to 0x03ffff (0x990f bytes) 000715 1784585711.057541 mapread 0x009635 thru 0x01328a (0x9c56 bytes) 000716 1784585711.097897 read 0x03c95d thru 0x03ffff (0x36a3 bytes) 000717 1784585711.117552 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd943f797 (stale) Mirror 11: 0xd943f797 (stale) Mirror 12: 0xd943f797 (stale) Mirror 13: 0xd943f797 (stale) Mirror 14: 0xd943f797 (stale) Mirror 16: 0xd943f797 (stale) Mirror 17: 0xd943f797 (stale) Mirror 18: 0xd943f797 (stale) Mirror 19: 0xd943f797 (stale) Mirror 20: 0xd943f797 (stale) Mirror 21: 0xd943f797 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd943f797 (stale) Mirror 11: 0xd943f797 (stale) Mirror 12: 0xd943f797 (stale) Mirror 13: 0xd943f797 (stale) Mirror 14: 0xd943f797 (stale) Mirror 16: 0xd943f797 (stale) Mirror 17: 0xd943f797 (stale) Mirror 18: 0xd943f797 (stale) Mirror 19: 0xd943f797 (stale) Mirror 20: 0xd943f797 (stale) Mirror 21: 0xd943f797 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000718 1784585712.272497 trunc from 0x040000 to 0x021dfa (0x1e205 bytes) 000719 1784585712.318518 read 0x01dc47 thru 0x021dfa (0x41b4 bytes) 000720 1784585712.336819 trunc from 0x021dfb to 0x01457e (0xd87c bytes) 000721 1784585712.375742 fallocate 0x00c9e5 thru 0x015abf (0x90db bytes) 000722 1784585712.393562 fallocate 0x02c465 thru 0x03aaaf (0xe64b bytes) 000723 1784585712.411221 mapwrite 0x03e749 thru 0x03ffff (0x18b7 bytes) 000724 1784585712.507682 read 0x008f07 thru 0x00f48a (0x6584 bytes) 000725 1784585712.559939 mapread 0x0084ee thru 0x01192a (0x943d bytes) 000728 1784585712.567666 punch from 0x01d65b to 0x02d057 (0xf9fd bytes) 000730 1784585712.589363 mapwrite 0x017497 thru 0x02502a (0xdb94 bytes) 000731 1784585712.699333 trunc from 0x00b58a to 0x013846 (0x82bd bytes) 000732 1784585712.705989 trunc from 0x03b2fd to 0x03ffff (0x4d03 bytes) 000733 1784585712.713847 trunc from 0x03d8c5 to 0x03f15b (0x1897 bytes) 000736 1784585712.730089 MIRROR_RESYNC 12 mirrors 000737 1784585717.737003 mapread 0x004109 thru 0x00906c (0x4f64 bytes) 000738 1784585717.784233 write 0x025564 thru 0x032e99 (0xd936 bytes) 000739 1784585717.876965 fallocate 0x00d4dd thru 0x01af4b (0xda6f bytes) 000741 1784585717.892086 punch from 0x012398 to 0x0155e8 (0x3251 bytes) 000742 1784585717.904274 trunc from 0x040000 to 0x0155ca (0x2aa35 bytes) 000743 1784585717.944260 write 0x0283f4 thru 0x02aef5 (0x2b02 bytes) 000744 1784585717.949116 trunc from 0x02aef6 to 0x035c42 (0xad4d bytes) 000745 1784585717.974104 trunc from 0x035c43 to 0x00ad71 (0x2aed1 bytes) 000746 1784585718.010145 trunc from 0x008a4f to 0x00ad71 (0x2323 bytes) 000747 1784585718.019470 fallocate 0x007717 thru 0x00a105 (0x29ef bytes) 000748 1784585718.029819 write 0x0296b7 thru 0x034acb (0xb415 bytes) 000749 1784585718.036481 mapwrite 0x0036bf thru 0x0095d8 (0x5f1a bytes) 000750 1784585718.102975 mapwrite 0x01ccb2 thru 0x022b70 (0x5ebf bytes) 000751 1784585718.162954 read 0x03165b thru 0x03304e (0x19f4 bytes) 000752 1784585718.165963 read 0x00a8c8 thru 0x01083c (0x5f75 bytes) 000753 1784585718.167641 mapwrite 0x00214a thru 0x00dad6 (0xb98d bytes) 000754 1784585718.195798 trunc from 0x027f33 to 0x034acb (0xcb99 bytes) 000755 1784585718.204830 punch from 0x015832 to 0x01979b (0x3f6a bytes) 000756 1784585718.212452 fallocate 0x0163d3 thru 0x01ee9e (0x8acc bytes) 000758 1784585718.221815 read 0x02c4e5 thru 0x034acb (0x85e7 bytes) 000759 1784585718.238079 mapread 0x02a2e5 thru 0x034acb (0xa7e7 bytes) 000760 1784585718.239778 trunc from 0x01ef0f to 0x02ba55 (0xcb47 bytes) 000761 1784585718.251227 mapread 0x0318e3 thru 0x03375c (0x1e7a bytes) 000762 1784585718.254122 trunc from 0x020935 to 0x02e848 (0xdf14 bytes) 000763 1784585718.269411 read 0x0113b6 thru 0x015531 (0x417c bytes) 000764 1784585718.271636 fallocate 0x01b932 thru 0x01fcf3 (0x43c2 bytes) 000765 1784585718.288837 read 0x02c00b thru 0x034acb (0x8ac1 bytes) 000766 1784585718.330152 punch from 0x01320f to 0x014232 (0x1024 bytes) 000768 1784585718.341245 trunc from 0x027cd8 to 0x033328 (0xb651 bytes) 000769 1784585718.359728 read 0x01897a thru 0x02866b (0xfcf2 bytes) 000770 1784585718.392602 trunc from 0x034acc to 0x0191b5 (0x1b916 bytes) 000771 1784585718.423848 fallocate 0x008750 thru 0x010c5f (0x8510 bytes) 000772 1784585718.439558 punch from 0x0040df to 0x011836 (0xd758 bytes) 000773 1784585718.456950 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x191b6): Mirror 7: 0x7c9a778e (stale) Mirror 12: 0x7c9a778e (stale) Mirror 13: 0x7c9a778e (stale) Mirror 14: 0x7c9a778e (stale) Mirror 16: 0x7c9a778e (stale) Mirror 17: 0x7c9a778e (stale) Mirror 18: 0x7c9a778e (stale) Mirror 19: 0x7c9a778e (stale) Mirror 20: 0x7c9a778e (stale) Mirror 21: 0x7c9a778e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x191b6): Mirror 7: 0x7c9a778e (stale) Mirror 12: 0x7c9a778e (stale) Mirror 13: 0x7c9a778e (stale) Mirror 14: 0x7c9a778e (stale) Mirror 16: 0x7c9a778e (stale) Mirror 17: 0x7c9a778e (stale) Mirror 18: 0x7c9a778e (stale) Mirror 19: 0x7c9a778e (stale) Mirror 20: 0x7c9a778e (stale) Mirror 21: 0x7c9a778e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x191b6: skipped 000774 1784585719.405837 mapwrite 0x020a43 thru 0x0282d7 (0x7895 bytes) 000775 1784585719.514480 trunc from 0x0282d8 to 0x02aebd (0x2be6 bytes) 000776 1784585719.539433 punch from 0x020195 to 0x027251 (0x70bd bytes) 000777 1784585719.546392 fallocate 0x0017ee thru 0x00d02a (0xb83d bytes) 000778 1784585719.552026 trunc from 0x02aebe to 0x03ef1f (0x14062 bytes) 000779 1784585719.571544 fallocate 0x02c3fc thru 0x033161 (0x6d66 bytes) 000780 1784585719.579252 mapwrite 0x02d192 thru 0x03a331 (0xd1a0 bytes) 000782 1784585719.655045 fallocate 0x007abb thru 0x0167ac (0xecf2 bytes) 000783 1784585719.668132 mapread 0x0385bb thru 0x03ab2f (0x2575 bytes) 000784 1784585719.670759 read 0x0279c4 thru 0x034ddc (0xd419 bytes) 000785 1784585719.672075 trunc from 0x03e25c to 0x03ef1f (0xcc4 bytes) 000786 1784585719.678980 punch from 0x0206cd to 0x02361a (0x2f4e bytes) 000787 1784585719.689837 trunc from 0x037e5b to 0x03ef1f (0x70c5 bytes) 000788 1784585719.700001 write 0x02ef43 thru 0x039042 (0xa100 bytes) 000789 1784585719.725013 punch from 0x0162f9 to 0x01d225 (0x6f2d bytes) 000790 1784585719.746094 trunc from 0x02be05 to 0x0317e9 (0x59e5 bytes) 000793 1784585719.775619 mapread 0x028d74 thru 0x02da46 (0x4cd3 bytes) 000794 1784585719.787781 mapwrite 0x0142ff thru 0x01b766 (0x7468 bytes) 000795 1784585719.822972 punch from 0x017aa0 to 0x021381 (0x98e2 bytes) 000796 1784585719.831768 punch from 0x005bde to 0x00e97a (0x8d9d bytes) 000797 1784585719.839724 read 0x021555 thru 0x027a0a (0x64b6 bytes) 000798 1784585719.853692 fallocate 0x03b700 thru 0x03c531 (0xe32 bytes) 000799 1784585719.860719 mapwrite 0x01f20a thru 0x028be5 (0x99dc bytes) 000800 1784585719.887394 mapwrite 0x01250b thru 0x019770 (0x7266 bytes) 000801 1784585719.925688 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef20): Mirror 7: 0xff49d5a1 (stale) Mirror 12: 0xff49d5a1 (stale) Mirror 13: 0xff49d5a1 (stale) Mirror 14: 0xff49d5a1 (stale) Mirror 16: 0xff49d5a1 (stale) Mirror 17: 0xff49d5a1 (stale) Mirror 18: 0xff49d5a1 (stale) Mirror 19: 0xff49d5a1 (stale) Mirror 21: 0xff49d5a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef20): Mirror 7: 0xff49d5a1 (stale) Mirror 12: 0xff49d5a1 (stale) Mirror 13: 0xff49d5a1 (stale) Mirror 14: 0xff49d5a1 (stale) Mirror 16: 0xff49d5a1 (stale) Mirror 17: 0xff49d5a1 (stale) Mirror 18: 0xff49d5a1 (stale) Mirror 19: 0xff49d5a1 (stale) Mirror 21: 0xff49d5a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef20: skipped 000802 1784585720.795029 mapread 0x03e16d thru 0x03ef1f (0xdb3 bytes) 000803 1784585720.808655 write 0x028a2f thru 0x02bc58 (0x322a bytes) 000804 1784585720.840441 fallocate 0x022071 thru 0x02cd1f (0xacaf bytes) 000805 1784585720.847707 trunc from 0x03ef20 to 0x01e9c3 (0x2055c bytes) 000806 1784585720.868006 mapwrite 0x02ede8 thru 0x03e7f7 (0xfa10 bytes) 000807 1784585720.985667 punch from 0x03174b to 0x038f81 (0x7837 bytes) 000808 1784585720.993904 punch from 0x039352 to 0x03b38a (0x2039 bytes) 000809 1784585721.002684 punch from 0x01e8f9 to 0x025e96 (0x759e bytes) 000810 1784585721.017113 MIRROR_RESYNC 10 mirrors 000811 1784585725.426568 write 0x015dc3 thru 0x01d0e0 (0x731e bytes) 000812 1784585725.501980 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3e7f8): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7f8): Mirror 7: 0x3849cc47 (stale) Mirror 12: 0x3849cc47 (stale) Mirror 13: 0x3849cc47 (stale) Mirror 14: 0x3849cc47 (stale) Mirror 16: 0x3849cc47 (stale) Mirror 17: 0x3849cc47 (stale) Mirror 18: 0x3849cc47 (stale) Mirror 19: 0x3849cc47 (stale) Mirror 21: 0x3849cc47 (stale) CRC-32 checksum value for chunk [0, 0x3e7f8): Mirror 1: 0x765d8095 Mirror 22: 0x765d8095 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7f8: skipped 000814 1784585727.589741 mapwrite 0x006d8f thru 0x012c52 (0xbec4 bytes) 000815 1784585727.826430 trunc from 0x030c00 to 0x033cd6 (0x30d7 bytes) 000816 1784585727.836144 write 0x02db84 thru 0x031955 (0x3dd2 bytes) 000817 1784585727.860995 trunc from 0x022602 to 0x02e594 (0xbf93 bytes) 000818 1784585727.904287 mapwrite 0x00e876 thru 0x01cef9 (0xe684 bytes) 000819 1784585727.962607 trunc from 0x01f55f to 0x0252da (0x5d7c bytes) 000820 1784585727.969085 trunc from 0x01714f to 0x01cfb9 (0x5e6b bytes) 000821 1784585727.978589 read 0x038d53 thru 0x03e7f7 (0x5aa5 bytes) 000823 1784585727.996229 punch from 0x00a2cf to 0x00dcb1 (0x39e3 bytes) 000824 1784585728.009446 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e7f8): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7f8): Mirror 7: 0x3849cc47 (stale) Mirror 12: 0x3849cc47 (stale) Mirror 13: 0x3849cc47 (stale) Mirror 14: 0x3849cc47 (stale) Mirror 16: 0x3849cc47 (stale) Mirror 17: 0x3849cc47 (stale) Mirror 18: 0x3849cc47 (stale) Mirror 19: 0x3849cc47 (stale) Mirror 21: 0x3849cc47 (stale) Mirror 22: 0x765d8095 (stale) CRC-32 checksum value for chunk [0, 0x3e7f8): Mirror 1: 0x53626a8a Mirror 23: 0x53626a8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7f8: skipped 000825 1784585729.924546 read 0x002845 thru 0x0072ff (0x4abb bytes) 000826 1784585729.953071 trunc from 0x023d97 to 0x0269d8 (0x2c42 bytes) 000827 1784585730.045120 mapread 0x01189b thru 0x014b04 (0x326a bytes) 000828 1784585730.067528 write 0x0235e1 thru 0x0236ab (0xcb bytes) 000829 1784585730.078496 trunc from 0x03e7f8 to 0x02b0ed (0x1370a bytes) 000830 1784585730.100150 trunc from 0x01e417 to 0x026a1b (0x8605 bytes) 000831 1784585730.117066 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 7: 0x98cc6e19 (stale) Mirror 12: 0x98cc6e19 (stale) Mirror 13: 0x98cc6e19 (stale) Mirror 14: 0x98cc6e19 (stale) Mirror 16: 0x98cc6e19 (stale) Mirror 17: 0x98cc6e19 (stale) Mirror 18: 0x98cc6e19 (stale) Mirror 19: 0x98cc6e19 (stale) Mirror 21: 0x98cc6e19 (stale) Mirror 22: 0x748c19c0 (stale) Mirror 23: 0x5e62eb97 (stale) CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 1: 0x5e62eb97 Mirror 24: 0x5e62eb97 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0ee: skipped 000832 1784585731.907286 write 0x014bf0 thru 0x0192cd (0x46de bytes) 000833 1784585731.972061 punch from 0x012d9b to 0x01ad5a (0x7fc0 bytes) 000834 1784585731.998501 fallocate 0x01235e thru 0x01b5ec (0x928f bytes) 000836 1784585732.022274 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 7: 0x98cc6e19 (stale) Mirror 12: 0x98cc6e19 (stale) Mirror 13: 0x98cc6e19 (stale) Mirror 14: 0x98cc6e19 (stale) Mirror 16: 0x98cc6e19 (stale) Mirror 17: 0x98cc6e19 (stale) Mirror 18: 0x98cc6e19 (stale) Mirror 19: 0x98cc6e19 (stale) Mirror 21: 0x98cc6e19 (stale) Mirror 22: 0x748c19c0 (stale) Mirror 23: 0x5e62eb97 (stale) Mirror 24: 0x5e62eb97 (stale) CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 1: 0xf9170db7 Mirror 25: 0xf9170db7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0ee: skipped 000837 1784585734.009806 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 7: 0x98cc6e19 (stale) Mirror 12: 0x98cc6e19 (stale) Mirror 13: 0x98cc6e19 (stale) Mirror 16: 0x98cc6e19 (stale) Mirror 17: 0x98cc6e19 (stale) Mirror 18: 0x98cc6e19 (stale) Mirror 19: 0x98cc6e19 (stale) Mirror 21: 0x98cc6e19 (stale) Mirror 22: 0x748c19c0 (stale) Mirror 23: 0x5e62eb97 (stale) Mirror 24: 0x5e62eb97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 7: 0x98cc6e19 (stale) Mirror 12: 0x98cc6e19 (stale) Mirror 13: 0x98cc6e19 (stale) Mirror 16: 0x98cc6e19 (stale) Mirror 17: 0x98cc6e19 (stale) Mirror 18: 0x98cc6e19 (stale) Mirror 19: 0x98cc6e19 (stale) Mirror 21: 0x98cc6e19 (stale) Mirror 22: 0x748c19c0 (stale) Mirror 23: 0x5e62eb97 (stale) Mirror 24: 0x5e62eb97 (stale) CRC-32 checksum value for chunk [0, 0x2b0ee): Mirror 1: 0xf9170db7 Mirror 25: 0xf9170db7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0ee: skipped 000838 1784585735.598505 trunc from 0x0117ab to 0x01abc9 (0x941f bytes) 000839 1784585735.674651 trunc from 0x02b0ee to 0x03f37c (0x1428f bytes) 000840 1784585735.705868 punch from 0x038a3c to 0x03f37c (0x6941 bytes) 000841 1784585735.723626 trunc from 0x03685e to 0x03f37c (0x8b1f bytes) 000842 1784585735.734793 trunc from 0x02bac9 to 0x036cc4 (0xb1fc bytes) 000843 1784585735.740770 fallocate 0x02ff3a thru 0x03644b (0x6512 bytes) 000845 1784585735.754335 mapwrite 0x01218e thru 0x018dd5 (0x6c48 bytes) 000846 1784585735.833948 trunc from 0x03f37d to 0x03d8f8 (0x1a84 bytes) 000847 1784585735.870864 mapread 0x039632 thru 0x03d8f8 (0x42c7 bytes) 000848 1784585735.909141 mapread 0x03571b thru 0x03a462 (0x4d48 bytes) 000849 1784585735.918849 trunc from 0x03d8f9 to 0x025ef9 (0x179ff bytes) 000850 1784585735.965937 mapwrite 0x03516e thru 0x039e55 (0x4ce8 bytes) 000851 1784585736.040729 read 0x00c7a6 thru 0x012814 (0x606f bytes) 000852 1784585736.051862 fallocate 0x0227c0 thru 0x028782 (0x5fc3 bytes) 000853 1784585736.059471 trunc from 0x0046ec to 0x00c82d (0x8142 bytes) 000854 1784585736.066337 fallocate 0x03e172 thru 0x03ffff (0x1e8e bytes) 000855 1784585736.073425 write 0x032a31 thru 0x03a97d (0x7f4d bytes) 000856 1784585736.086403 mapread 0x02aae3 thru 0x039d26 (0xf244 bytes) 000857 1784585736.100847 punch from 0x00834e to 0x00e36e (0x6021 bytes) 000858 1784585736.110023 trunc from 0x040000 to 0x036d1e (0x92e1 bytes) 000859 1784585736.134218 mapwrite 0x02b5db thru 0x030dca (0x57f0 bytes) 000860 1784585736.173945 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36d1f): Mirror 12: 0x5109df88 (stale) Mirror 13: 0x5109df88 (stale) Mirror 16: 0x5109df88 (stale) Mirror 17: 0x5109df88 (stale) Mirror 18: 0x5109df88 (stale) Mirror 19: 0x5109df88 (stale) Mirror 21: 0x5109df88 (stale) Mirror 22: 0x9f1c7bc6 (stale) Mirror 23: 0x4138b586 (stale) Mirror 24: 0xe3ebc929 (stale) Mirror 25: 0xfe8419f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d1f): Mirror 12: 0x5109df88 (stale) Mirror 13: 0x5109df88 (stale) Mirror 16: 0x5109df88 (stale) Mirror 17: 0x5109df88 (stale) Mirror 18: 0x5109df88 (stale) Mirror 19: 0x5109df88 (stale) Mirror 21: 0x5109df88 (stale) Mirror 22: 0x9f1c7bc6 (stale) Mirror 23: 0x4138b586 (stale) Mirror 24: 0xe3ebc929 (stale) Mirror 25: 0xfe8419f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d1f: skipped 000862 1784585737.089876 read 0x0169a4 thru 0x01cb31 (0x618e bytes) 000863 1784585737.106109 mapwrite 0x013b24 thru 0x01423b (0x718 bytes) 000864 1784585737.143142 mapread 0x000d0c thru 0x003968 (0x2c5d bytes) 000866 1784585737.192886 MIRROR_RESYNC 12 mirrors 000867 1784585742.994913 MIRROR_RESYNC 12 mirrors 000868 1784585743.953855 trunc from 0x036d1f to 0x0396bc (0x299e bytes) 000869 1784585744.043516 fallocate 0x02df29 thru 0x0330be (0x5196 bytes) 000870 1784585744.058961 write 0x01fb61 thru 0x0226d5 (0x2b75 bytes) 000872 1784585744.090736 mapread 0x0049eb thru 0x00723d (0x2853 bytes) 000873 1784585744.144598 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x396bd): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396bd): Mirror 12: 0xa98b698e (stale) Mirror 13: 0xa98b698e (stale) Mirror 16: 0xa98b698e (stale) Mirror 17: 0xa98b698e (stale) Mirror 18: 0xa98b698e (stale) Mirror 19: 0xa98b698e (stale) Mirror 21: 0xa98b698e (stale) Mirror 22: 0xa98b698e (stale) Mirror 23: 0xa98b698e (stale) Mirror 24: 0xa98b698e (stale) Mirror 25: 0xa98b698e (stale) CRC-32 checksum value for chunk [0, 0x396bd): Mirror 1: 0x8e9002a7 Mirror 26: 0x8e9002a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396bd: skipped 000874 1784585745.858808 trunc from 0x0396bd to 0x00a6a6 (0x2f016 bytes) 000875 1784585746.031153 mapwrite 0x0367d5 thru 0x03ffff (0x982b bytes) 000876 1784585746.232220 mapwrite 0x02df9c thru 0x031acc (0x3b31 bytes) 000877 1784585746.313573 trunc from 0x036bc4 to 0x037efd (0x133a bytes) 000878 1784585746.328479 trunc from 0x0364cf to 0x0384ab (0x1fdd bytes) 000879 1784585746.341702 punch from 0x0261fc to 0x032bdb (0xc9e0 bytes) 000880 1784585746.357456 trunc from 0x040000 to 0x014bbc (0x2b443 bytes) 000881 1784585746.394810 punch from 0x00d402 to 0x00eb64 (0x1763 bytes) 000882 1784585746.410279 trunc from 0x014bbd to 0x02454f (0xf993 bytes) 000883 1784585746.460877 write 0x031f0b thru 0x03ffff (0xe0f5 bytes) 000884 1784585746.466393 mapwrite 0x02671a thru 0x034884 (0xe16b bytes) 000885 1784585746.523821 trunc from 0x00ed9a to 0x015d1c (0x6f83 bytes) 000886 1784585746.532886 punch from 0x035058 to 0x03a1a6 (0x514f bytes) 000887 1784585746.541834 mapwrite 0x039980 thru 0x03e3bf (0x4a40 bytes) 000888 1784585746.574043 mapread 0x02fc43 thru 0x03e49c (0xe85a bytes) 000889 1784585746.575465 fallocate 0x03c2a0 thru 0x03ffff (0x3d60 bytes) 000890 1784585746.581485 mapread 0x013390 thru 0x01614f (0x2dc0 bytes) 000891 1784585746.599591 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x89c16690 (stale) Mirror 13: 0x89c16690 (stale) Mirror 16: 0x89c16690 (stale) Mirror 17: 0x89c16690 (stale) Mirror 18: 0x89c16690 (stale) Mirror 19: 0x89c16690 (stale) Mirror 21: 0x89c16690 (stale) Mirror 22: 0x89c16690 (stale) Mirror 23: 0x89c16690 (stale) Mirror 24: 0x89c16690 (stale) Mirror 25: 0x89c16690 (stale) Mirror 26: 0x7b0ca6aa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf4b07f0b Mirror 27: 0xf4b07f0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1784585748.270808 write 0x01ccf3 thru 0x020c6f (0x3f7d bytes) 000893 1784585748.347622 mapread 0x02ce6d thru 0x030e03 (0x3f97 bytes) 000895 1784585748.382412 MIRROR_RESYNC 14 mirrors 000896 1784585753.830035 MIRROR_RESYNC 14 mirrors 000897 1784585754.710457 trunc from 0x038c42 to 0x039c24 (0xfe3 bytes) 000898 1784585754.755622 trunc from 0x040000 to 0x03fb48 (0x4b7 bytes) 000899 1784585754.791638 read 0x01497a thru 0x01f156 (0xa7dd bytes) 000900 1784585754.803725 mapread 0x01e714 thru 0x022488 (0x3d75 bytes) 000901 1784585754.831095 MIRROR_RESYNC 14 mirrors 000902 1784585759.889632 read 0x03dce5 thru 0x03ece6 (0x1002 bytes) 000903 1784585759.906094 mapwrite 0x00e00c thru 0x019b8c (0xbb81 bytes) 000904 1784585760.127420 fallocate 0x01a3a9 thru 0x0291de (0xee36 bytes) 000905 1784585760.143540 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb49): Mirror 13: 0x7d9c6a03 (stale) Mirror 16: 0x7d9c6a03 (stale) Mirror 17: 0x7d9c6a03 (stale) Mirror 18: 0x7d9c6a03 (stale) Mirror 19: 0x7d9c6a03 (stale) Mirror 21: 0x7d9c6a03 (stale) Mirror 22: 0x7d9c6a03 (stale) Mirror 23: 0x7d9c6a03 (stale) Mirror 24: 0x7d9c6a03 (stale) Mirror 25: 0x7d9c6a03 (stale) Mirror 26: 0x7d9c6a03 (stale) Mirror 27: 0x7d9c6a03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb49): Mirror 13: 0x7d9c6a03 (stale) Mirror 16: 0x7d9c6a03 (stale) Mirror 17: 0x7d9c6a03 (stale) Mirror 18: 0x7d9c6a03 (stale) Mirror 19: 0x7d9c6a03 (stale) Mirror 21: 0x7d9c6a03 (stale) Mirror 22: 0x7d9c6a03 (stale) Mirror 23: 0x7d9c6a03 (stale) Mirror 24: 0x7d9c6a03 (stale) Mirror 25: 0x7d9c6a03 (stale) Mirror 26: 0x7d9c6a03 (stale) Mirror 27: 0x7d9c6a03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb49: skipped 000906 1784585760.985877 trunc from 0x01cffb to 0x01d6fc (0x702 bytes) 000907 1784585760.992598 read 0x02da41 thru 0x039ad7 (0xc097 bytes) 000908 1784585761.008316 mapread 0x01e034 thru 0x024454 (0x6421 bytes) 000909 1784585761.083549 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb49): Mirror 13: 0x7d9c6a03 (stale) Mirror 16: 0x7d9c6a03 (stale) Mirror 17: 0x7d9c6a03 (stale) Mirror 18: 0x7d9c6a03 (stale) Mirror 19: 0x7d9c6a03 (stale) Mirror 21: 0x7d9c6a03 (stale) Mirror 22: 0x7d9c6a03 (stale) Mirror 23: 0x7d9c6a03 (stale) Mirror 24: 0x7d9c6a03 (stale) Mirror 26: 0x7d9c6a03 (stale) Mirror 27: 0x7d9c6a03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb49): Mirror 13: 0x7d9c6a03 (stale) Mirror 16: 0x7d9c6a03 (stale) Mirror 17: 0x7d9c6a03 (stale) Mirror 18: 0x7d9c6a03 (stale) Mirror 19: 0x7d9c6a03 (stale) Mirror 21: 0x7d9c6a03 (stale) Mirror 22: 0x7d9c6a03 (stale) Mirror 23: 0x7d9c6a03 (stale) Mirror 24: 0x7d9c6a03 (stale) Mirror 26: 0x7d9c6a03 (stale) Mirror 27: 0x7d9c6a03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb49: skipped 000910 1784585762.146290 fallocate 0x002572 thru 0x00ee7a (0xc909 bytes) 000911 1784585762.159668 read 0x006b4d thru 0x01693a (0xfdee bytes) 000912 1784585762.191956 trunc from 0x03fb49 to 0x012f48 (0x2cc00 bytes) 000913 1784585762.246032 trunc from 0x012f49 to 0x032bb5 (0x1fc6d bytes) 000914 1784585762.295855 write 0x010fc8 thru 0x020d9e (0xfdd7 bytes) 000915 1784585762.324233 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32bb6): Mirror 13: 0x67a8eec8 (stale) Mirror 16: 0x67a8eec8 (stale) Mirror 17: 0x67a8eec8 (stale) Mirror 18: 0x67a8eec8 (stale) Mirror 19: 0x67a8eec8 (stale) Mirror 22: 0x67a8eec8 (stale) Mirror 23: 0x67a8eec8 (stale) Mirror 24: 0x67a8eec8 (stale) Mirror 26: 0x67a8eec8 (stale) Mirror 27: 0x67a8eec8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32bb6): Mirror 13: 0x67a8eec8 (stale) Mirror 16: 0x67a8eec8 (stale) Mirror 17: 0x67a8eec8 (stale) Mirror 18: 0x67a8eec8 (stale) Mirror 19: 0x67a8eec8 (stale) Mirror 22: 0x67a8eec8 (stale) Mirror 23: 0x67a8eec8 (stale) Mirror 24: 0x67a8eec8 (stale) Mirror 26: 0x67a8eec8 (stale) Mirror 27: 0x67a8eec8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32bb6: skipped 000916 1784585763.350986 trunc from 0x013827 to 0x01a9fb (0x71d5 bytes) 000917 1784585763.359631 trunc from 0x027138 to 0x030707 (0x95d0 bytes) 000918 1784585763.369270 mapwrite 0x003487 thru 0x00d9ae (0xa528 bytes) 000919 1784585763.430425 mapread 0x010cc8 thru 0x01489b (0x3bd4 bytes) 000921 1784585763.453568 trunc from 0x01ee96 to 0x0234fb (0x4666 bytes) 000922 1784585763.470480 trunc from 0x032bb6 to 0x034f46 (0x2391 bytes) 000923 1784585763.503216 write 0x02a4ce thru 0x02afaf (0xae2 bytes) 000924 1784585763.512367 read 0x02c3d0 thru 0x034f46 (0x8b77 bytes) 000925 1784585763.525649 write 0x03de6d thru 0x03ffff (0x2193 bytes) 000926 1784585763.528928 fallocate 0x03e710 thru 0x03ffff (0x18f0 bytes) 000927 1784585763.548842 mapwrite 0x01f2bb thru 0x027cf9 (0x8a3f bytes) 000930 1784585763.624325 trunc from 0x011ee6 to 0x01daa6 (0xbbc1 bytes) 000931 1784585763.654888 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x41e59bc8 (stale) Mirror 16: 0x41e59bc8 (stale) Mirror 17: 0x41e59bc8 (stale) Mirror 18: 0x41e59bc8 (stale) Mirror 19: 0x41e59bc8 (stale) Mirror 22: 0x41e59bc8 (stale) Mirror 23: 0x41e59bc8 (stale) Mirror 24: 0x41e59bc8 (stale) Mirror 26: 0x41e59bc8 (stale) Mirror 27: 0x41e59bc8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4d0878ce Mirror 28: 0x4d0878ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000932 1784585765.823504 fallocate 0x032d59 thru 0x038ccc (0x5f74 bytes) 000933 1784585765.872605 fallocate 0x03050a thru 0x03c9d0 (0xc4c7 bytes) 000934 1784585765.879671 mapread 0x0274a2 thru 0x02b71d (0x427c bytes) 000935 1784585765.904129 punch from 0x00f686 to 0x011db5 (0x2730 bytes) 000936 1784585765.911113 trunc from 0x02d417 to 0x037836 (0xa420 bytes) 000937 1784585765.917718 read 0x02abbe thru 0x034175 (0x95b8 bytes) 000938 1784585765.927834 punch from 0x0075bc to 0x0087f7 (0x123c bytes) 000939 1784585765.940383 read 0x01287f thru 0x0224b9 (0xfc3b bytes) 000940 1784585765.963808 read 0x02fda4 thru 0x03fc67 (0xfec4 bytes) 000941 1784585765.967208 fallocate 0x03adf4 thru 0x03ffff (0x520c bytes) 000942 1784585765.983411 mapwrite 0x001804 thru 0x004bf0 (0x33ed bytes) 000943 1784585766.027761 mapread 0x011a7b thru 0x018908 (0x6e8e bytes) 000944 1784585766.039286 fallocate 0x033ec9 thru 0x03da06 (0x9b3e bytes) 000945 1784585766.055944 mapread 0x022184 thru 0x02c3ba (0xa237 bytes) 000946 1784585766.063057 trunc from 0x040000 to 0x01be30 (0x241cf bytes) 000947 1784585766.125466 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1be31): Mirror 13: 0xb2c18024 (stale) Mirror 16: 0xb2c18024 (stale) Mirror 17: 0xb2c18024 (stale) Mirror 18: 0xb2c18024 (stale) Mirror 19: 0xb2c18024 (stale) Mirror 22: 0xb2c18024 (stale) Mirror 23: 0xb2c18024 (stale) Mirror 24: 0xb2c18024 (stale) Mirror 26: 0xb2c18024 (stale) Mirror 28: 0xd042df41 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1be31): Mirror 13: 0xb2c18024 (stale) Mirror 16: 0xb2c18024 (stale) Mirror 17: 0xb2c18024 (stale) Mirror 18: 0xb2c18024 (stale) Mirror 19: 0xb2c18024 (stale) Mirror 22: 0xb2c18024 (stale) Mirror 23: 0xb2c18024 (stale) Mirror 24: 0xb2c18024 (stale) Mirror 26: 0xb2c18024 (stale) Mirror 28: 0xd042df41 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1be31: skipped 000948 1784585766.746498 mapread 0x017940 thru 0x01be30 (0x44f1 bytes) 000949 1784585766.773383 punch from 0x0010ed to 0x001bcc (0xae0 bytes) 000950 1784585766.786515 MIRROR_RESYNC 11 mirrors 000951 1784585770.431924 trunc from 0x01be31 to 0x00ddb7 (0xe079 bytes) 000952 1784585770.533398 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xddb8): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xddb8): Mirror 13: 0x7a88d83e (stale) Mirror 16: 0x7a88d83e (stale) Mirror 17: 0x7a88d83e (stale) Mirror 18: 0x7a88d83e (stale) Mirror 19: 0x7a88d83e (stale) Mirror 22: 0x7a88d83e (stale) Mirror 23: 0x7a88d83e (stale) Mirror 24: 0x7a88d83e (stale) Mirror 26: 0x7a88d83e (stale) Mirror 28: 0x7a88d83e (stale) CRC-32 checksum value for chunk [0, 0xddb8): Mirror 1: 0x7a88d83e Mirror 29: 0x7a88d83e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xddb8: skipped 000953 1784585771.892991 trunc from 0x00ddb8 to 0x01b9bc (0xdc05 bytes) 000954 1784585771.996008 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b9bd): Mirror 13: 0x4228cc0d (stale) Mirror 16: 0x4228cc0d (stale) Mirror 18: 0x4228cc0d (stale) Mirror 19: 0x4228cc0d (stale) Mirror 22: 0x4228cc0d (stale) Mirror 23: 0x4228cc0d (stale) Mirror 24: 0x4228cc0d (stale) Mirror 26: 0x4228cc0d (stale) Mirror 28: 0x4228cc0d (stale) Mirror 29: 0x1eb2474 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b9bd): Mirror 13: 0x4228cc0d (stale) Mirror 16: 0x4228cc0d (stale) Mirror 18: 0x4228cc0d (stale) Mirror 19: 0x4228cc0d (stale) Mirror 22: 0x4228cc0d (stale) Mirror 23: 0x4228cc0d (stale) Mirror 24: 0x4228cc0d (stale) Mirror 26: 0x4228cc0d (stale) Mirror 28: 0x4228cc0d (stale) Mirror 29: 0x1eb2474 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b9bd: skipped 000955 1784585772.794436 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b9bd): Mirror 13: 0x4228cc0d (stale) Mirror 18: 0x4228cc0d (stale) Mirror 19: 0x4228cc0d (stale) Mirror 22: 0x4228cc0d (stale) Mirror 23: 0x4228cc0d (stale) Mirror 24: 0x4228cc0d (stale) Mirror 26: 0x4228cc0d (stale) Mirror 28: 0x4228cc0d (stale) Mirror 29: 0x1eb2474 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b9bd): Mirror 13: 0x4228cc0d (stale) Mirror 18: 0x4228cc0d (stale) Mirror 19: 0x4228cc0d (stale) Mirror 22: 0x4228cc0d (stale) Mirror 23: 0x4228cc0d (stale) Mirror 24: 0x4228cc0d (stale) Mirror 26: 0x4228cc0d (stale) Mirror 28: 0x4228cc0d (stale) Mirror 29: 0x1eb2474 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b9bd: skipped 000956 1784585773.462653 trunc from 0x01b9bd to 0x01a2c1 (0x16fb bytes) 000957 1784585773.518352 MIRROR_RESYNC 10 mirrors 000958 1784585775.770658 read 0x003537 thru 0x00cad1 (0x959b bytes) 000959 1784585775.787239 MIRROR_EXTEND to 11 mirrors 000960 1784585776.868092 read 0x0194bd thru 0x01a2c1 (0xe05 bytes) 000961 1784585776.878138 mapread 0x0056e4 thru 0x00f1af (0x9acc bytes) 000962 1784585776.909264 trunc from 0x01a2c2 to 0x036472 (0x1c1b1 bytes) 000963 1784585776.976984 mapread 0x021d3c thru 0x021ef3 (0x1b8 bytes) 000964 1784585776.990786 punch from 0x025860 to 0x025afe (0x29f bytes) 000965 1784585776.998282 fallocate 0x038af8 thru 0x03b3c8 (0x28d1 bytes) 000966 1784585777.015784 trunc from 0x01cba2 to 0x0277ea (0xac49 bytes) 000967 1784585777.030007 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36473): Mirror 13: 0xd1751ca9 (stale) Mirror 18: 0xd1751ca9 (stale) Mirror 19: 0xd1751ca9 (stale) Mirror 22: 0xd1751ca9 (stale) Mirror 23: 0xd1751ca9 (stale) Mirror 26: 0xd1751ca9 (stale) Mirror 28: 0xd1751ca9 (stale) Mirror 29: 0xd1751ca9 (stale) Mirror 30: 0xd1751ca9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36473): Mirror 13: 0xd1751ca9 (stale) Mirror 18: 0xd1751ca9 (stale) Mirror 19: 0xd1751ca9 (stale) Mirror 22: 0xd1751ca9 (stale) Mirror 23: 0xd1751ca9 (stale) Mirror 26: 0xd1751ca9 (stale) Mirror 28: 0xd1751ca9 (stale) Mirror 29: 0xd1751ca9 (stale) Mirror 30: 0xd1751ca9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36473: skipped 000969 1784585777.681878 write 0x01021f thru 0x0116d9 (0x14bb bytes) 000970 1784585777.708863 punch from 0x01c75c to 0x01eeac (0x2751 bytes) 000971 1784585777.738916 MIRROR_RESYNC 10 mirrors 000972 1784585780.629800 write 0x000cb1 thru 0x007c71 (0x6fc1 bytes) 000973 1784585780.676426 trunc from 0x036473 to 0x0231ed (0x13285 bytes) 000974 1784585780.705200 trunc from 0x0231ee to 0x01761c (0xbbd1 bytes) 000975 1784585780.731563 MIRROR_RESYNC 10 mirrors 000976 1784585783.461826 punch from 0x0063aa to 0x012050 (0xbca7 bytes) 000977 1784585783.543004 trunc from 0x00df57 to 0x01761c (0x96c6 bytes) 000979 1784585783.563962 mapread 0x007950 thru 0x017049 (0xf6fa bytes) 000980 1784585783.659546 write 0x01c4f6 thru 0x02a7aa (0xe2b5 bytes) 000981 1784585783.665777 mapread 0x00174c thru 0x0025ae (0xe63 bytes) 000982 1784585783.699856 mapwrite 0x02eb1c thru 0x03e180 (0xf665 bytes) 000983 1784585783.828566 trunc from 0x0316c7 to 0x032085 (0x9bf bytes) 000984 1784585783.835355 mapwrite 0x008916 thru 0x009a07 (0x10f2 bytes) 000985 1784585783.862241 fallocate 0x03bf14 thru 0x03ffff (0x40ec bytes) 000986 1784585783.871900 mapwrite 0x02d3d3 thru 0x0385a8 (0xb1d6 bytes) 000987 1784585783.920651 mapread 0x00ae4c thru 0x0139ec (0x8ba1 bytes) 000988 1784585783.947369 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x19205bb8 (stale) Mirror 18: 0x19205bb8 (stale) Mirror 19: 0x19205bb8 (stale) Mirror 22: 0x19205bb8 (stale) Mirror 23: 0x19205bb8 (stale) Mirror 26: 0x19205bb8 (stale) Mirror 28: 0x19205bb8 (stale) Mirror 29: 0x19205bb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x19205bb8 (stale) Mirror 18: 0x19205bb8 (stale) Mirror 19: 0x19205bb8 (stale) Mirror 22: 0x19205bb8 (stale) Mirror 23: 0x19205bb8 (stale) Mirror 26: 0x19205bb8 (stale) Mirror 28: 0x19205bb8 (stale) Mirror 29: 0x19205bb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000989 1784585784.750156 read 0x002a9c thru 0x006eff (0x4464 bytes) 000990 1784585784.761510 trunc from 0x040000 to 0x00d4e2 (0x32b1d bytes) 000991 1784585784.792869 mapwrite 0x023bd1 thru 0x0283b7 (0x47e7 bytes) 000992 1784585784.952685 punch from 0x025d58 to 0x0283b7 (0x2660 bytes) 000993 1784585784.981618 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x283b8): Mirror 13: 0xd7c7ebed (stale) Mirror 18: 0xd7c7ebed (stale) Mirror 19: 0xd7c7ebed (stale) Mirror 22: 0xd7c7ebed (stale) Mirror 23: 0xd7c7ebed (stale) Mirror 26: 0xd7c7ebed (stale) Mirror 29: 0xd7c7ebed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x283b8): Mirror 13: 0xd7c7ebed (stale) Mirror 18: 0xd7c7ebed (stale) Mirror 19: 0xd7c7ebed (stale) Mirror 22: 0xd7c7ebed (stale) Mirror 23: 0xd7c7ebed (stale) Mirror 26: 0xd7c7ebed (stale) Mirror 29: 0xd7c7ebed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x283b8: skipped 000994 1784585785.530984 write 0x021469 thru 0x030167 (0xecff bytes) 000996 1784585785.562721 write 0x0202b4 thru 0x02244c (0x2199 bytes) 000997 1784585785.574570 mapwrite 0x0197d1 thru 0x01fc9b (0x64cb bytes) 000998 1784585785.655517 write 0x0134e4 thru 0x0159da (0x24f7 bytes) 000999 1784585785.673400 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x30168): Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30168): Mirror 13: 0xd506ff8f (stale) Mirror 18: 0xd506ff8f (stale) Mirror 19: 0xd506ff8f (stale) Mirror 22: 0xd506ff8f (stale) Mirror 23: 0xd506ff8f (stale) Mirror 26: 0xd506ff8f (stale) Mirror 29: 0xd506ff8f (stale) CRC-32 checksum value for chunk [0, 0x30168): Mirror 1: 0xeec02edb Mirror 30: 0xeec02edb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30168: skipped 001000 1784585786.973351 mapread 0x01f884 thru 0x02213b (0x28b8 bytes) All operations completed A-OK!