== sanity-flr test 70a: flr mode fsx test ================ 04:28:13 (1788510493) Seed set to 495 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788510495.499793 MIRROR_EXTEND to 2 mirrors skipping zero size read 000004 1788510496.194041 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) skipping zero size read skipping zero size read 000011 1788510496.470367 write 0x01a459 thru 0x01ef79 (0x4b21 bytes) 000012 1788510496.478585 MIRROR_EXTEND to 2 mirrors 000013 1788510498.024577 punch from 0x00be89 to 0x01afb0 (0xf128 bytes) 000014 1788510498.105836 MIRROR_RESYNC 2 mirrors 000015 1788510499.002599 punch from 0x00f210 to 0x013082 (0x3e73 bytes) 000016 1788510499.067582 read 0x004e7a thru 0x006d2a (0x1eb1 bytes) 000017 1788510499.074757 mapread 0x014c7e thru 0x01a8e6 (0x5c69 bytes) 000018 1788510499.096113 mapread 0x009a44 thru 0x009de8 (0x3a5 bytes) 000020 1788510499.108072 mapread 0x006f05 thru 0x0168f1 (0xf9ed bytes) truncating to largest ever: 0x7a39 000022 1788510499.110279 trunc from 0x01ef7a to 0x007a38 (0x17541 bytes) 000024 1788510499.144268 MIRROR_RESYNC 2 mirrors 000025 1788510499.892214 mapread 0x006bc7 thru 0x007a38 (0xe72 bytes) 000026 1788510499.911159 read 0x00083f thru 0x004a8d (0x424f bytes) 000027 1788510499.924191 MIRROR_EXTEND to 3 mirrors 000029 1788510500.964009 write 0x035606 thru 0x03db29 (0x8524 bytes) 000030 1788510501.052923 mapwrite 0x0051a0 thru 0x01127f (0xc0e0 bytes) 000031 1788510501.131193 read 0x018453 thru 0x024b6b (0xc719 bytes) 000033 1788510501.142775 read 0x005dc2 thru 0x00c10c (0x634b bytes) 000035 1788510501.147772 MIRROR_RESYNC 3 mirrors 000038 1788510502.119899 mapread 0x019fa3 thru 0x01a727 (0x785 bytes) 000039 1788510502.149736 MIRROR_EXTEND to 4 mirrors 000040 1788510502.993028 punch from 0x005d86 to 0x00b686 (0x5901 bytes) 000041 1788510503.192065 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3db2a): Mirror 2: 0xa05b829b (stale) Mirror 3: 0xa05b829b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db2a): Mirror 2: 0xa05b829b (stale) Mirror 3: 0xa05b829b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db2a: skipped 000042 1788510503.878630 mapwrite 0x00f3c0 thru 0x0193e8 (0xa029 bytes) 000044 1788510504.013980 punch from 0x0021f6 to 0x004050 (0x1e5b bytes) 000045 1788510504.019724 punch from 0x017618 to 0x01ac23 (0x360c bytes) 000046 1788510504.024937 mapwrite 0x01d333 thru 0x0260b9 (0x8d87 bytes) 000047 1788510504.115358 trunc from 0x03db2a to 0x004118 (0x39a11 bytes) 000049 1788510504.174431 punch from 0x000ddd to 0x003ac5 (0x2ce9 bytes) 000050 1788510504.180150 mapwrite 0x029f07 thru 0x0385bc (0xe6b6 bytes) 000053 1788510504.374108 write 0x02d49c thru 0x03cc98 (0xf7fd bytes) truncating to largest ever: 0x304e7 000054 1788510504.383752 trunc from 0x03cc99 to 0x0304e6 (0xc7b2 bytes) truncating to largest ever: 0x32cf9 000056 1788510504.407882 trunc from 0x0304e7 to 0x032cf8 (0x2812 bytes) 000058 1788510504.444506 punch from 0x02b6f3 to 0x02e8be (0x31cc bytes) 000059 1788510504.472863 mapread 0x005a08 thru 0x013a7f (0xe078 bytes) 000060 1788510504.501587 punch from 0x00e9ff to 0x013418 (0x4a1a bytes) 000061 1788510504.507544 mapread 0x021044 thru 0x024b28 (0x3ae5 bytes) 000062 1788510504.516545 punch from 0x02a4ff to 0x032cf8 (0x87fa bytes) 000064 1788510504.524675 punch from 0x00ca5b to 0x0150b0 (0x8656 bytes) 000066 1788510504.534439 mapread 0x026ba7 thru 0x02cfba (0x6414 bytes) 000068 1788510504.552704 mapread 0x02d938 thru 0x032cf8 (0x53c1 bytes) 000069 1788510504.553731 trunc from 0x032cf9 to 0x0022ec (0x30a0c bytes) 000070 1788510504.586477 mapread 0x0018e6 thru 0x0022ec (0xa07 bytes) 000072 1788510504.605475 mapwrite 0x02d1b1 thru 0x02ffb9 (0x2e09 bytes) 000073 1788510504.730013 mapread 0x00518f thru 0x00b29e (0x6110 bytes) 000075 1788510504.743410 write 0x031270 thru 0x03dd19 (0xcaaa bytes) 000076 1788510504.746647 mapread 0x0097fa thru 0x0144f9 (0xad00 bytes) 000077 1788510504.755629 trunc from 0x03dd1a to 0x01af3f (0x22dda bytes) 000079 1788510504.767760 write 0x027b71 thru 0x02cbe5 (0x5075 bytes) 000080 1788510504.768770 read 0x02b30b thru 0x02cbe5 (0x18db bytes) 000081 1788510504.769760 write 0x033a3f thru 0x039de9 (0x63ab bytes) 000083 1788510504.771361 mapwrite 0x018135 thru 0x0273b5 (0xf281 bytes) 000084 1788510504.861760 mapread 0x012b80 thru 0x020e91 (0xe312 bytes) 000085 1788510504.863119 write 0x0373a3 thru 0x03af4b (0x3ba9 bytes) 000087 1788510504.866797 read 0x03929e thru 0x03af4b (0x1cae bytes) 000088 1788510504.867787 read 0x013eef thru 0x020627 (0xc739 bytes) 000089 1788510504.868896 mapread 0x00b7a6 thru 0x0199c6 (0xe221 bytes) 000090 1788510504.870707 mapread 0x013dde thru 0x01bc29 (0x7e4c bytes) 000091 1788510504.872503 mapread 0x033ddf thru 0x03af4b (0x716d bytes) 000094 1788510504.877065 trunc from 0x03af4c to 0x002332 (0x38c19 bytes) 000095 1788510504.904164 mapwrite 0x010d52 thru 0x01d9b0 (0xcc5f bytes) 000096 1788510504.989177 read 0x00b029 thru 0x0170e0 (0xc0b8 bytes) 000097 1788510504.989970 mapread 0x00970b thru 0x018d90 (0xf686 bytes) 000101 1788510504.995133 mapwrite 0x009cfb thru 0x016c46 (0xcf4c bytes) 000102 1788510505.054275 punch from 0x001a00 to 0x003da1 (0x23a2 bytes) 000103 1788510505.059533 trunc from 0x01d9b1 to 0x026692 (0x8ce2 bytes) 000104 1788510505.079220 write 0x02e54a thru 0x035e97 (0x794e bytes) 000106 1788510505.082178 punch from 0x011495 to 0x01acc8 (0x9834 bytes) 000107 1788510505.108559 read 0x00c4d0 thru 0x0185b9 (0xc0ea bytes) 000108 1788510505.135311 read 0x02f858 thru 0x0328dc (0x3085 bytes) 000109 1788510505.135981 trunc from 0x035e98 to 0x027677 (0xe820 bytes) 000111 1788510505.166511 punch from 0x0089eb to 0x00e423 (0x5a39 bytes) 000112 1788510505.174731 mapwrite 0x021fa9 thru 0x028ef1 (0x6f49 bytes) 000113 1788510505.396387 mapwrite 0x01d80c thru 0x02b1fd (0xd9f2 bytes) 000115 1788510505.592092 mapwrite 0x03e04a thru 0x03ffff (0x1fb6 bytes) 000117 1788510505.754677 write 0x03bf79 thru 0x03ffff (0x4087 bytes) 000118 1788510505.781540 MIRROR_RESYNC 3 mirrors 000119 1788510507.588192 trunc from 0x040000 to 0x0325ad (0xda52 bytes) 000121 1788510507.820363 mapread 0x02a9c5 thru 0x02e9d0 (0x400c bytes) 000122 1788510507.855901 write 0x02cd72 thru 0x02ebaa (0x1e39 bytes) 000124 1788510507.859967 write 0x013a33 thru 0x01ba2b (0x7ff9 bytes) 000125 1788510507.887676 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x325ae): Mirror 2: 0x87761089 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x325ae): Mirror 2: 0x87761089 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x325ae: skipped 000126 1788510508.401688 mapread 0x00040b thru 0x0036b8 (0x32ae bytes) 000127 1788510508.497179 punch from 0x0130f8 to 0x013de2 (0xceb bytes) 000128 1788510508.514947 read 0x000a96 thru 0x0066f6 (0x5c61 bytes) 000129 1788510508.516282 punch from 0x024c2f to 0x0304e6 (0xb8b8 bytes) 000131 1788510508.531136 trunc from 0x0325ae to 0x0087d4 (0x29dd9 bytes) 000133 1788510508.577657 MIRROR_RESYNC 2 mirrors 000134 1788510509.240775 punch from 0x004854 to 0x0087d4 (0x3f81 bytes) 000135 1788510509.336908 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x87d5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x87d5): Mirror 2: 0x85ede37b (stale) CRC-32 checksum value for chunk [0, 0x87d5): Mirror 1: 0x85ede37b Mirror 3: 0x85ede37b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x87d5: skipped 000136 1788510510.682846 punch from 0x0028d0 to 0x0087d4 (0x5f05 bytes) 000137 1788510510.790208 punch from 0x000ade to 0x008772 (0x7c95 bytes) 000138 1788510510.796237 mapread 0x001e39 thru 0x0087d4 (0x699c bytes) 000140 1788510510.843386 mapwrite 0x00bcef thru 0x0173f2 (0xb704 bytes) 000141 1788510511.127594 MIRROR_RESYNC 3 mirrors 000142 1788510512.353908 trunc from 0x0173f3 to 0x00f5fd (0x7df5 bytes) 000143 1788510512.423463 read 0x004958 thru 0x00f5fd (0xaca6 bytes) 000144 1788510512.434989 mapwrite 0x0153af thru 0x01f53a (0xa18c bytes) 000145 1788510512.559767 trunc from 0x01f53b to 0x002430 (0x1d10a bytes) 000147 1788510512.580357 write 0x0041a8 thru 0x00abe4 (0x6a3d bytes) 000148 1788510512.589101 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xabe5): Mirror 2: 0xdcdb953d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xabe5): Mirror 2: 0xdcdb953d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xabe5: skipped 000149 1788510512.833666 trunc from 0x00abe5 to 0x003b23 (0x70c1 bytes) 000150 1788510512.859475 mapwrite 0x000241 thru 0x0058d4 (0x5694 bytes) truncating to largest ever: 0x3339e 000151 1788510512.962912 trunc from 0x0058d5 to 0x03339d (0x2dac9 bytes) 000154 1788510512.983203 mapread 0x01f41d thru 0x026f0a (0x7aee bytes) 000155 1788510512.993253 write 0x018be9 thru 0x01c540 (0x3958 bytes) 000156 1788510513.017239 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000157 1788510513.337691 punch from 0x02c449 to 0x02e916 (0x24ce bytes) 000158 1788510513.343895 read 0x02987d thru 0x02d5b0 (0x3d34 bytes) 000159 1788510513.368929 write 0x03961b thru 0x03ffff (0x69e5 bytes) truncating to largest ever: 0x3bc1a 000163 1788510513.371753 trunc from 0x040000 to 0x03bc19 (0x43e6 bytes) 000164 1788510513.393421 mapwrite 0x01af40 thru 0x020f3b (0x5ffc bytes) 000166 1788510513.515938 write 0x003c6a thru 0x012130 (0xe4c7 bytes) 000167 1788510513.551772 trunc from 0x03bc1a to 0x001456 (0x3a7c3 bytes) 000168 1788510513.584752 mapwrite 0x00593f thru 0x009c3d (0x42ff bytes) 000172 1788510513.760953 write 0x01135e thru 0x020c21 (0xf8c4 bytes) 000174 1788510513.763805 read 0x00d103 thru 0x00f3ae (0x22ac bytes) 000175 1788510513.778099 write 0x01a51c thru 0x023fd3 (0x9ab8 bytes) truncating to largest ever: 0x3f365 000176 1788510513.781437 trunc from 0x023fd4 to 0x03f364 (0x1b391 bytes) 000177 1788510513.800014 read 0x028815 thru 0x035e70 (0xd65c bytes) 000178 1788510513.819667 mapread 0x025d09 thru 0x02ab0b (0x4e03 bytes) 000179 1788510513.820721 read 0x0101d2 thru 0x012e22 (0x2c51 bytes) 000180 1788510513.821724 read 0x001a3f thru 0x00e180 (0xc742 bytes) 000181 1788510513.822459 mapread 0x02ce23 thru 0x038e31 (0xc00f bytes) 000182 1788510513.823458 read 0x02ca4d thru 0x038611 (0xbbc5 bytes) 000185 1788510513.827079 write 0x0159f1 thru 0x01da67 (0x8077 bytes) 000186 1788510513.828604 write 0x00a0d8 thru 0x0114fa (0x7423 bytes) 000188 1788510513.831978 write 0x0248ec thru 0x02c905 (0x801a bytes) 000189 1788510513.834164 write 0x008dec thru 0x012a20 (0x9c35 bytes) 000191 1788510513.836950 write 0x00582b thru 0x0083a5 (0x2b7b bytes) 000193 1788510513.839124 trunc from 0x03f365 to 0x021fb0 (0x1d3b4 bytes) 000195 1788510513.860668 mapread 0x008c4b thru 0x011188 (0x853e bytes) 000198 1788510513.862896 read 0x015808 thru 0x021fb0 (0xc7a9 bytes) 000199 1788510513.867416 read 0x01e262 thru 0x021fb0 (0x3d4f bytes) 000200 1788510513.877188 MIRROR_EXTEND to 2 mirrors 000201 1788510514.943545 trunc from 0x021fb1 to 0x02e233 (0xc283 bytes) 000202 1788510515.048945 mapwrite 0x0187d2 thru 0x01fa9e (0x72cd bytes) 000204 1788510515.119711 trunc from 0x02e234 to 0x01e878 (0xf9bb bytes) 000205 1788510515.140517 mapwrite 0x03bb3a thru 0x03de08 (0x22cf bytes) 000207 1788510515.222770 mapwrite 0x034a45 thru 0x035664 (0xc20 bytes) 000208 1788510515.336820 MIRROR_RESYNC 2 mirrors 000209 1788510516.165998 MIRROR_EXTEND to 3 mirrors 000211 1788510517.165428 trunc from 0x03de09 to 0x01d03b (0x20dcd bytes) 000213 1788510517.265098 mapread 0x00f464 thru 0x0175e8 (0x8185 bytes) 000214 1788510517.286461 punch from 0x007975 to 0x00d830 (0x5ebc bytes) 000217 1788510517.294667 trunc from 0x01d03c to 0x00a8a1 (0x1279a bytes) 000218 1788510517.319097 trunc from 0x00a8a2 to 0x03c50d (0x31c6c bytes) 000219 1788510517.346102 mapwrite 0x03380d thru 0x0345e8 (0xddc bytes) 000220 1788510517.402129 read 0x02e21a thru 0x034d0e (0x6af5 bytes) 000221 1788510517.402746 mapread 0x011fc2 thru 0x018521 (0x6560 bytes) 000222 1788510517.412464 mapread 0x033af4 thru 0x03566b (0x1b78 bytes) 000223 1788510517.413399 trunc from 0x03c50e to 0x01c280 (0x2028d bytes) 000224 1788510517.434366 mapread 0x016aeb thru 0x01bde9 (0x52ff bytes) 000225 1788510517.441917 read 0x008183 thru 0x01606e (0xdeec bytes) 000226 1788510517.451734 read 0x00be95 thru 0x016ba9 (0xad15 bytes) 000230 1788510517.453687 punch from 0x017db2 to 0x01c280 (0x44cf bytes) 000232 1788510517.464229 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1c281): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c281): Mirror 2: 0x93ae0fa5 (stale) Mirror 3: 0x93ae0fa5 (stale) CRC-32 checksum value for chunk [0, 0x1c281): Mirror 1: 0xa8cded62 Mirror 4: 0xa8cded62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c281: skipped 000234 1788510518.914648 write 0x01f107 thru 0x0275f6 (0x84f0 bytes) 000235 1788510519.056430 write 0x024aa9 thru 0x0323eb (0xd943 bytes) 000236 1788510519.059965 punch from 0x026fdc to 0x0297ad (0x27d2 bytes) 000237 1788510519.082885 write 0x011e15 thru 0x01d8ca (0xbab6 bytes) 000238 1788510519.097550 mapwrite 0x03a7e7 thru 0x03ffff (0x5819 bytes) 000239 1788510519.268069 mapread 0x03bbb9 thru 0x03ffff (0x4447 bytes) 000241 1788510519.271946 punch from 0x02f5a6 to 0x038274 (0x8ccf bytes) 000242 1788510519.278839 mapwrite 0x0205b7 thru 0x0256ad (0x50f7 bytes) 000243 1788510519.347231 trunc from 0x040000 to 0x03420b (0xbdf4 bytes) 000245 1788510519.366820 write 0x03625b thru 0x03c25a (0x6000 bytes) 000247 1788510519.368506 write 0x01284d thru 0x019dfb (0x75af bytes) 000248 1788510519.376841 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c25b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c25b): Mirror 2: 0x7798640d (stale) Mirror 3: 0x7798640d (stale) Mirror 4: 0xa2ece085 (stale) CRC-32 checksum value for chunk [0, 0x3c25b): Mirror 1: 0x505a16c5 Mirror 5: 0x505a16c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c25b: skipped 000249 1788510520.743310 mapwrite 0x023df4 thru 0x028edc (0x50e9 bytes) 000250 1788510521.090064 read 0x03b44f thru 0x03bcfd (0x8af bytes) 000252 1788510521.111669 punch from 0x02f4c8 to 0x034b00 (0x5639 bytes) 000253 1788510521.119373 mapwrite 0x03c9da thru 0x03ffff (0x3626 bytes) 000254 1788510521.275026 punch from 0x019fbd to 0x01c8ad (0x28f1 bytes) 000256 1788510521.290964 mapwrite 0x00d6a5 thru 0x0194cb (0xbe27 bytes) 000260 1788510521.457398 mapwrite 0x03effd thru 0x03ffff (0x1003 bytes) 000261 1788510521.665145 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6614ad93 (stale) Mirror 4: 0x5784572 (stale) Mirror 5: 0xa3453019 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6614ad93 (stale) Mirror 4: 0x5784572 (stale) Mirror 5: 0xa3453019 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1788510522.608928 read 0x01665d thru 0x01a5e5 (0x3f89 bytes) 000264 1788510522.633776 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5784572 (stale) Mirror 5: 0xa3453019 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5784572 (stale) Mirror 5: 0xa3453019 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000265 1788510523.384683 mapread 0x00a6c4 thru 0x0147a4 (0xa0e1 bytes) 000266 1788510523.447371 punch from 0x025842 to 0x027d35 (0x24f4 bytes) 000267 1788510523.478388 punch from 0x0352b6 to 0x03ffff (0xad4a bytes) 000268 1788510523.490499 read 0x02596a thru 0x02ac2c (0x52c3 bytes) 000269 1788510523.529486 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5784572 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5784572 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000272 1788510524.118942 mapread 0x01410c thru 0x015a24 (0x1919 bytes) 000273 1788510524.144505 mapread 0x013793 thru 0x018109 (0x4977 bytes) 000277 1788510524.194653 mapread 0x015615 thru 0x01e787 (0x9173 bytes) 000280 1788510524.218090 write 0x037791 thru 0x03ffff (0x886f bytes) 000283 1788510524.224798 mapwrite 0x02ec8e thru 0x0367e6 (0x7b59 bytes) 000284 1788510524.346748 mapread 0x03f6f8 thru 0x03ffff (0x908 bytes) 000285 1788510524.347641 write 0x0396ba thru 0x03c7d7 (0x311e bytes) 000286 1788510524.355489 mapwrite 0x02032a thru 0x02470d (0x43e4 bytes) 000288 1788510524.473552 write 0x02acd1 thru 0x0350a8 (0xa3d8 bytes) 000289 1788510524.476624 mapwrite 0x00c453 thru 0x0184e6 (0xc094 bytes) 000290 1788510524.614254 mapread 0x03ef53 thru 0x03ffff (0x10ad bytes) 000293 1788510524.620130 write 0x030b25 thru 0x03fb6c (0xf048 bytes) 000294 1788510524.622816 write 0x031dda thru 0x03a817 (0x8a3e bytes) 000295 1788510524.624050 mapread 0x01bf2a thru 0x026b7e (0xac55 bytes) 000297 1788510524.636077 trunc from 0x040000 to 0x03be52 (0x41ad bytes) 000298 1788510524.668600 read 0x001bfa thru 0x00464f (0x2a56 bytes) 000299 1788510524.680729 mapread 0x00d8b2 thru 0x01aee7 (0xd636 bytes) 000301 1788510524.681912 mapread 0x01efed thru 0x02121c (0x2230 bytes) 000302 1788510524.682626 write 0x00abff thru 0x013a2e (0x8e30 bytes) 000306 1788510524.693861 punch from 0x02037f to 0x025308 (0x4f8a bytes) 000307 1788510524.711764 read 0x030b4e thru 0x037b76 (0x7029 bytes) 000308 1788510524.712526 write 0x001a6b thru 0x005842 (0x3dd8 bytes) 000309 1788510524.722619 mapread 0x01e3db thru 0x027f86 (0x9bac bytes) 000310 1788510524.732999 mapread 0x0304ab thru 0x03986a (0x93c0 bytes) 000311 1788510524.733983 punch from 0x02f8c6 to 0x031c97 (0x23d2 bytes) 000312 1788510524.747175 write 0x03fb67 thru 0x03ffff (0x499 bytes) 000313 1788510524.748188 trunc from 0x040000 to 0x038a5a (0x75a5 bytes) 000315 1788510524.769898 mapread 0x025667 thru 0x027aa4 (0x243e bytes) 000316 1788510524.771481 punch from 0x02e295 to 0x034c97 (0x6a03 bytes) 000317 1788510524.778437 write 0x00c8ac thru 0x0109de (0x4133 bytes) 000322 1788510524.785269 read 0x01cbea thru 0x02393b (0x6d52 bytes) 000323 1788510524.786033 punch from 0x03251a to 0x034112 (0x1bf9 bytes) 000327 1788510524.800481 trunc from 0x038a5b to 0x009a61 (0x2eff9 bytes) 000328 1788510524.822301 mapwrite 0x02484b thru 0x029ace (0x5284 bytes) 000330 1788510524.989061 punch from 0x027da3 to 0x029ace (0x1d2c bytes) 000331 1788510525.005196 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29acf): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29acf): Mirror 4: 0x9742ad78 (stale) CRC-32 checksum value for chunk [0, 0x29acf): Mirror 1: 0x417e6e5f Mirror 5: 0x417e6e5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29acf: skipped 000332 1788510526.807863 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29acf): Mirror 4: 0x9742ad78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29acf): Mirror 4: 0x9742ad78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29acf: skipped 000333 1788510527.317586 punch from 0x01fb08 to 0x0299b1 (0x9eaa bytes) 000336 1788510527.348255 mapwrite 0x027868 thru 0x02c308 (0x4aa1 bytes) 000337 1788510527.536416 mapread 0x028d77 thru 0x02c308 (0x3592 bytes) 000338 1788510527.540553 mapread 0x017478 thru 0x01c899 (0x5422 bytes) 000341 1788510527.576188 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000342 1788510527.801503 mapread 0x01ff27 thru 0x0286d2 (0x87ac bytes) 000343 1788510527.848471 MIRROR_EXTEND to 2 mirrors 000344 1788510529.435027 read 0x002ccb thru 0x011290 (0xe5c6 bytes) 000345 1788510529.466825 write 0x005858 thru 0x00c48d (0x6c36 bytes) 000346 1788510529.623833 read 0x00bbeb thru 0x0172dd (0xb6f3 bytes) 000347 1788510529.667024 trunc from 0x02c309 to 0x00a5b5 (0x21d53 bytes) 000349 1788510529.709538 mapread 0x000e78 thru 0x007ff2 (0x717b bytes) 000350 1788510529.713608 punch from 0x000813 to 0x00111e (0x90c bytes) 000352 1788510529.739003 punch from 0x009efd to 0x00a5b5 (0x6b9 bytes) 000353 1788510529.746251 mapwrite 0x008107 thru 0x00e413 (0x630d bytes) 000354 1788510529.926866 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000355 1788510530.137833 mapread 0x005be4 thru 0x00e413 (0x8830 bytes) 000356 1788510530.178757 read 0x009310 thru 0x00e413 (0x5104 bytes) 000361 1788510530.182952 mapwrite 0x0130f7 thru 0x01b03a (0x7f44 bytes) 000362 1788510530.367628 read 0x00d74c thru 0x0133f5 (0x5caa bytes) 000363 1788510530.372513 MIRROR_EXTEND to 2 mirrors 000364 1788510531.560697 mapread 0x0191d1 thru 0x01b03a (0x1e6a bytes) 000366 1788510531.662410 mapwrite 0x038f9f thru 0x03ffff (0x7061 bytes) 000367 1788510532.059172 read 0x026b1e thru 0x034413 (0xd8f6 bytes) 000368 1788510532.090007 trunc from 0x040000 to 0x01dcec (0x22313 bytes) 000369 1788510532.136686 write 0x016b66 thru 0x01ee53 (0x82ee bytes) 000370 1788510532.147570 mapread 0x0138f2 thru 0x01ed17 (0xb426 bytes) 000371 1788510532.186070 trunc from 0x01ee54 to 0x00905d (0x15df6 bytes) 000373 1788510532.227892 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000375 1788510532.582826 read 0x0009e3 thru 0x00905d (0x867b bytes) 000379 1788510532.609067 trunc from 0x00905e to 0x02bb2b (0x22ace bytes) 000380 1788510532.648505 write 0x0284ce thru 0x02aaa4 (0x25d7 bytes) 000382 1788510532.678207 read 0x01d3c4 thru 0x01deb7 (0xaf4 bytes) 000383 1788510532.702597 write 0x032661 thru 0x038832 (0x61d2 bytes) 000384 1788510532.705532 trunc from 0x038833 to 0x0307c9 (0x8069 bytes) 000386 1788510532.741891 write 0x011bbd thru 0x013f63 (0x23a7 bytes) 000387 1788510532.748527 trunc from 0x0307ca to 0x0309ad (0x1e4 bytes) 000389 1788510532.795169 mapwrite 0x018a41 thru 0x02648e (0xda4e bytes) 000390 1788510533.150064 write 0x006f66 thru 0x013ef2 (0xcf8d bytes) 000391 1788510533.173785 write 0x002dce thru 0x005507 (0x273a bytes) 000392 1788510533.177776 mapwrite 0x00277f thru 0x00ff40 (0xd7c2 bytes) 000393 1788510533.377497 write 0x016748 thru 0x0172a6 (0xb5f bytes) 000394 1788510533.379724 mapwrite 0x01319b thru 0x01ade9 (0x7c4f bytes) 000396 1788510533.598079 read 0x01893f thru 0x025ec8 (0xd58a bytes) 000404 1788510533.620599 MIRROR_EXTEND to 2 mirrors 000406 1788510535.086047 write 0x028546 thru 0x034f31 (0xc9ec bytes) 000407 1788510535.201947 mapread 0x0018af thru 0x005977 (0x40c9 bytes) 000408 1788510535.233885 write 0x02cb9c thru 0x0336a3 (0x6b08 bytes) 000409 1788510535.235740 read 0x0260ed thru 0x02b3be (0x52d2 bytes) 000411 1788510535.267710 read 0x02acc5 thru 0x031bab (0x6ee7 bytes) 000412 1788510535.268730 write 0x022e6c thru 0x024241 (0x13d6 bytes) 000413 1788510535.298251 trunc from 0x034f32 to 0x03895c (0x3a2b bytes) 000414 1788510535.333907 mapread 0x021ea1 thru 0x025d90 (0x3ef0 bytes) 000416 1788510535.335525 write 0x02f026 thru 0x03d9de (0xe9b9 bytes) 000418 1788510535.345233 mapread 0x02bd63 thru 0x0303bc (0x465a bytes) 000420 1788510535.362224 MIRROR_RESYNC 2 mirrors 000421 1788510536.783702 trunc from 0x03d9df to 0x03d9e1 (0x3 bytes) 000422 1788510536.950884 punch from 0x031c2c to 0x037549 (0x591e bytes) 000423 1788510536.994950 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d9e2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d9e2): Mirror 2: 0xce8d0c20 (stale) CRC-32 checksum value for chunk [0, 0x3d9e2): Mirror 1: 0xc364c1b8 Mirror 3: 0xc364c1b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d9e2: skipped 000425 1788510539.515147 mapread 0x02e518 thru 0x03b41a (0xcf03 bytes) 000426 1788510539.640994 read 0x0239ae thru 0x031b33 (0xe186 bytes) 000427 1788510539.712677 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d9e2): Mirror 2: 0xce8d0c20 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d9e2): Mirror 2: 0xce8d0c20 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d9e2: skipped 000431 1788510540.342530 mapwrite 0x03953b thru 0x03ffff (0x6ac5 bytes) 000432 1788510540.636400 write 0x03561f thru 0x038264 (0x2c46 bytes) 000436 1788510540.668762 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa7665251 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc9a51ee1 Mirror 3: 0xc9a51ee1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000437 1788510542.884650 write 0x03239c thru 0x03df4f (0xbbb4 bytes) 000438 1788510543.082836 read 0x019de3 thru 0x01ec56 (0x4e74 bytes) 000439 1788510543.103108 read 0x00220d thru 0x00ac33 (0x8a27 bytes) 000440 1788510543.145679 mapread 0x02bac5 thru 0x02bc4c (0x188 bytes) 000441 1788510543.167118 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa7665251 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa7665251 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000442 1788510543.913541 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa7665251 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5da2012 Mirror 3: 0x5da2012 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000443 1788510545.622869 read 0x03d123 thru 0x03ffff (0x2edd bytes) 000444 1788510545.631214 mapwrite 0x03f1f6 thru 0x03ffff (0xe0a bytes) 000446 1788510545.710192 mapwrite 0x01daaf thru 0x025e67 (0x83b9 bytes) 000447 1788510545.756410 MIRROR_RESYNC 3 mirrors 000448 1788510546.749769 mapread 0x015c1b thru 0x022e4e (0xd234 bytes) 000449 1788510546.821912 punch from 0x02c208 to 0x03a810 (0xe609 bytes) 000450 1788510546.932031 read 0x01fde5 thru 0x023c23 (0x3e3f bytes) 000453 1788510546.980858 trunc from 0x040000 to 0x031e15 (0xe1ea bytes) 000455 1788510547.061688 mapread 0x0221e7 thru 0x02ffa6 (0xddc0 bytes) 000456 1788510547.124955 trunc from 0x031e16 to 0x01adfe (0x17017 bytes) 000458 1788510547.183486 mapwrite 0x02f354 thru 0x0322d4 (0x2f81 bytes) 000459 1788510547.385140 mapwrite 0x010abe thru 0x01c910 (0xbe53 bytes) 000461 1788510547.459204 punch from 0x01c247 to 0x027418 (0xb1d2 bytes) 000462 1788510547.470652 MIRROR_RESYNC 3 mirrors 000463 1788510548.400071 mapwrite 0x016fec thru 0x01f0f6 (0x810b bytes) 000464 1788510548.517242 read 0x00e5be thru 0x01ae2a (0xc86d bytes) 000465 1788510548.524488 mapread 0x01d255 thru 0x02c8e2 (0xf68e bytes) 000466 1788510548.544989 read 0x015846 thru 0x016668 (0xe23 bytes) 000467 1788510548.545780 mapwrite 0x027d6c thru 0x02acbe (0x2f53 bytes) 000469 1788510548.601395 trunc from 0x0322d5 to 0x00877e (0x29b56 bytes) 000472 1788510548.623483 mapread 0x005b4c thru 0x00877e (0x2c33 bytes) 000473 1788510548.634677 mapread 0x005546 thru 0x00877e (0x3239 bytes) 000474 1788510548.639476 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x877f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x877f): Mirror 2: 0xec8087e5 (stale) Mirror 3: 0xec8087e5 (stale) CRC-32 checksum value for chunk [0, 0x877f): Mirror 1: 0xec8087e5 Mirror 4: 0xec8087e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x877f: skipped 000475 1788510550.263234 trunc from 0x00877f to 0x01eba9 (0x1642b bytes) 000476 1788510550.418699 trunc from 0x01ebaa to 0x00ef74 (0xfc35 bytes) 000477 1788510550.477923 trunc from 0x00ef75 to 0x016f4e (0x7fda bytes) 000478 1788510550.513984 read 0x00adee thru 0x016f4e (0xc161 bytes) 000479 1788510550.537453 punch from 0x01416c to 0x01658b (0x2420 bytes) 000480 1788510550.554092 trunc from 0x016f4f to 0x00e02c (0x8f22 bytes) 000482 1788510550.579833 trunc from 0x00e02d to 0x00fe2a (0x1dfe bytes) 000483 1788510550.613573 mapread 0x00d2b0 thru 0x00fe2a (0x2b7b bytes) 000484 1788510550.630490 mapread 0x009660 thru 0x00fe2a (0x67cb bytes) 000485 1788510550.652191 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xfe2b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfe2b): Mirror 2: 0x7178fcdb (stale) Mirror 3: 0x7178fcdb (stale) Mirror 4: 0xecbf27b9 (stale) CRC-32 checksum value for chunk [0, 0xfe2b): Mirror 1: 0xecbf27b9 Mirror 5: 0xecbf27b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfe2b: skipped 000487 1788510551.935435 read 0x00d1c1 thru 0x00fe2a (0x2c6a bytes) 000488 1788510551.965016 write 0x002811 thru 0x00caef (0xa2df bytes) 000489 1788510552.146890 trunc from 0x00fe2b to 0x000d84 (0xf0a6 bytes) 000490 1788510552.180636 mapwrite 0x00e753 thru 0x01a1f8 (0xbaa6 bytes) 000492 1788510552.404595 mapwrite 0x01e962 thru 0x02a732 (0xbdd1 bytes) 000493 1788510552.609803 write 0x0351c3 thru 0x03834a (0x3188 bytes) 000494 1788510552.612867 mapread 0x002080 thru 0x00c468 (0xa3e9 bytes) 000497 1788510552.636289 punch from 0x031fea to 0x034f7d (0x2f94 bytes) 000498 1788510552.648858 mapwrite 0x0362a1 thru 0x03e606 (0x8366 bytes) 000499 1788510552.757078 read 0x02b374 thru 0x02befe (0xb8b bytes) 000501 1788510552.770274 read 0x022110 thru 0x024016 (0x1f07 bytes) 000503 1788510552.771485 punch from 0x02dd1e to 0x02e5a6 (0x889 bytes) 000504 1788510552.791015 punch from 0x0321a4 to 0x03e606 (0xc463 bytes) 000505 1788510552.802300 read 0x00e3d6 thru 0x014dde (0x6a09 bytes) 000507 1788510552.830060 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e607): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e607): Mirror 2: 0xebadfca1 (stale) Mirror 3: 0xebadfca1 (stale) Mirror 4: 0x7c62d8ef (stale) Mirror 5: 0x7c62d8ef (stale) CRC-32 checksum value for chunk [0, 0x3e607): Mirror 1: 0x6580685e Mirror 6: 0x6580685e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e607: skipped 000508 1788510554.207243 mapwrite 0x016104 thru 0x01c0d7 (0x5fd4 bytes) 000510 1788510554.508571 MIRROR_RESYNC 6 mirrors 000512 1788510556.381477 trunc from 0x03e607 to 0x000d9e (0x3d868 bytes) 000513 1788510556.546527 read 0x000bc6 thru 0x000d9e (0x1d9 bytes) 000514 1788510556.554555 mapwrite 0x001a63 thru 0x00346d (0x1a0b bytes) 000517 1788510556.664785 mapwrite 0x006aca thru 0x014837 (0xdd6e bytes) 000518 1788510556.836674 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14838): Mirror 2: 0x92e6f7e9 (stale) Mirror 3: 0x92e6f7e9 (stale) Mirror 5: 0x92e6f7e9 (stale) Mirror 6: 0x92e6f7e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14838): Mirror 2: 0x92e6f7e9 (stale) Mirror 3: 0x92e6f7e9 (stale) Mirror 5: 0x92e6f7e9 (stale) Mirror 6: 0x92e6f7e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14838: skipped 000519 1788510557.140713 read 0x011320 thru 0x014837 (0x3518 bytes) 000521 1788510557.150682 punch from 0x010115 to 0x014837 (0x4723 bytes) 000522 1788510557.171510 punch from 0x003e7c to 0x00cd5a (0x8edf bytes) 000523 1788510557.180808 trunc from 0x014838 to 0x03b734 (0x26efd bytes) 000524 1788510557.214320 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b735): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b735): Mirror 2: 0xc0cb03d3 (stale) Mirror 3: 0xc0cb03d3 (stale) Mirror 5: 0xc0cb03d3 (stale) Mirror 6: 0xc0cb03d3 (stale) CRC-32 checksum value for chunk [0, 0x3b735): Mirror 1: 0xdc6a972d Mirror 7: 0xdc6a972d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b735: skipped 000525 1788510558.078312 write 0x013f19 thru 0x020807 (0xc8ef bytes) 000527 1788510558.195727 mapread 0x00f4db thru 0x01a273 (0xad99 bytes) 000528 1788510558.222589 write 0x012bd6 thru 0x018bd6 (0x6001 bytes) 000535 1788510558.234835 trunc from 0x03b735 to 0x020bcf (0x1ab65 bytes) 000536 1788510558.291138 punch from 0x003471 to 0x003932 (0x4c2 bytes) 000537 1788510558.308520 punch from 0x00ead4 to 0x012de2 (0x430f bytes) 000538 1788510558.318133 punch from 0x006e65 to 0x012018 (0xb1b4 bytes) 000539 1788510558.324131 mapwrite 0x02c6ef thru 0x031891 (0x51a3 bytes) 000542 1788510558.433183 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31892): Mirror 2: 0x2f604055 (stale) Mirror 3: 0x2f604055 (stale) Mirror 5: 0x2f604055 (stale) Mirror 7: 0xfc1da159 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31892): Mirror 2: 0x2f604055 (stale) Mirror 3: 0x2f604055 (stale) Mirror 5: 0x2f604055 (stale) Mirror 7: 0xfc1da159 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31892: skipped 000544 1788510558.978798 punch from 0x0102aa to 0x01b2ac (0xb003 bytes) 000545 1788510558.988036 punch from 0x00a8ad to 0x016912 (0xc066 bytes) 000546 1788510558.994065 mapread 0x0317ca thru 0x031891 (0xc8 bytes) 000547 1788510559.010188 MIRROR_RESYNC 5 mirrors 000548 1788510561.793896 write 0x0017ee thru 0x00c094 (0xa8a7 bytes) 000550 1788510561.983902 mapwrite 0x010fbb thru 0x0121e2 (0x1228 bytes) 000551 1788510562.232991 trunc from 0x031892 to 0x00c471 (0x25420 bytes) 000552 1788510562.273794 trunc from 0x00c472 to 0x019f6b (0xdafa bytes) 000553 1788510562.304923 MIRROR_RESYNC 5 mirrors 000556 1788510564.403174 mapwrite 0x02c2ef thru 0x02e3ae (0x20c0 bytes) 000558 1788510564.584089 write 0x00b074 thru 0x018ac2 (0xda4f bytes) 000559 1788510564.605221 read 0x009087 thru 0x0109d3 (0x794d bytes) 000560 1788510564.612503 write 0x019e1f thru 0x029d2c (0xff0e bytes) 000562 1788510564.615135 mapread 0x0048ae thru 0x00ed93 (0xa4e6 bytes) 000563 1788510564.624080 read 0x029c24 thru 0x02e3ae (0x478b bytes) 000564 1788510564.624542 read 0x009031 thru 0x01754c (0xe51c bytes) 000565 1788510564.625003 trunc from 0x02e3af to 0x009585 (0x24e29 bytes) 000566 1788510564.670550 write 0x012534 thru 0x015a67 (0x3534 bytes) 000568 1788510564.682214 MIRROR_RESYNC 5 mirrors 000569 1788510565.985079 mapwrite 0x0256db thru 0x02a491 (0x4db7 bytes) 000571 1788510566.380959 trunc from 0x02a492 to 0x008940 (0x21b51 bytes) 000572 1788510566.436248 trunc from 0x008941 to 0x02d58b (0x24c4b bytes) 000574 1788510566.491304 trunc from 0x02d58c to 0x027580 (0x600b bytes) 000575 1788510566.522690 mapread 0x01a884 thru 0x027580 (0xccfd bytes) 000576 1788510566.565664 mapwrite 0x01e9ff thru 0x02055f (0x1b61 bytes) 000577 1788510566.724061 mapwrite 0x01b2dc thru 0x01ba81 (0x7a6 bytes) 000579 1788510566.841229 mapwrite 0x018e6e thru 0x0282f1 (0xf484 bytes) 000580 1788510566.961799 trunc from 0x0282f2 to 0x0161a5 (0x1214c bytes) 000581 1788510566.998937 trunc from 0x0161a6 to 0x00eda7 (0x73fe bytes) 000582 1788510567.023519 trunc from 0x00eda8 to 0x00de7a (0xf2d bytes) 000583 1788510567.045480 read 0x00c44e thru 0x00de7a (0x1a2d bytes) 000584 1788510567.053043 punch from 0x00ca21 to 0x00de7a (0x145a bytes) 000585 1788510567.063319 mapwrite 0x025a38 thru 0x02dca7 (0x8270 bytes) 000586 1788510567.146146 write 0x038e0b thru 0x03ffff (0x71f5 bytes) 000590 1788510567.151249 trunc from 0x040000 to 0x021405 (0x1ebfa bytes) 000591 1788510567.180796 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21406): Mirror 3: 0x849b9bfb (stale) Mirror 5: 0x849b9bfb (stale) Mirror 7: 0x849b9bfb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21406): Mirror 3: 0x849b9bfb (stale) Mirror 5: 0x849b9bfb (stale) Mirror 7: 0x849b9bfb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21406: skipped 000592 1788510567.859914 mapread 0x011989 thru 0x01984c (0x7ec4 bytes) 000593 1788510567.896757 read 0x014921 thru 0x0182e9 (0x39c9 bytes) 000594 1788510567.900674 write 0x038d2f thru 0x03ffff (0x72d1 bytes) 000595 1788510567.904887 trunc from 0x040000 to 0x00ada6 (0x35259 bytes) 000596 1788510567.944287 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xada7): Mirror 3: 0x8047e073 (stale) Mirror 7: 0x8047e073 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xada7): Mirror 3: 0x8047e073 (stale) Mirror 7: 0x8047e073 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xada7: skipped 000597 1788510568.441818 MIRROR_RESYNC 3 mirrors 000598 1788510569.944944 read 0x0042f3 thru 0x00ada6 (0x6ab4 bytes) 000599 1788510569.956263 punch from 0x001628 to 0x00a414 (0x8ded bytes) 000600 1788510570.125296 mapread 0x006465 thru 0x00ada6 (0x4942 bytes) 000601 1788510570.236801 MIRROR_RESYNC 3 mirrors 000602 1788510571.525995 punch from 0x00334e to 0x00ada6 (0x7a59 bytes) 000604 1788510571.626791 mapread 0x0010ef thru 0x00a2dd (0x91ef bytes) 000605 1788510571.671997 mapwrite 0x03f234 thru 0x03ffff (0xdcc bytes) 000606 1788510571.738284 trunc from 0x040000 to 0x032034 (0xdfcb bytes) 000607 1788510571.776616 MIRROR_RESYNC 3 mirrors 000608 1788510572.970855 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000609 1788510573.312417 read 0x002b9c thru 0x0040ea (0x154f bytes) 000613 1788510573.328807 write 0x0000b0 thru 0x00c188 (0xc0d9 bytes) 000614 1788510573.477693 punch from 0x003642 to 0x00cd71 (0x9730 bytes) 000615 1788510573.496468 write 0x02de9b thru 0x03ccc5 (0xee2b bytes) 000617 1788510573.531863 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ccc6): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ccc6): Mirror 3: 0xba7a7b55 (stale) CRC-32 checksum value for chunk [0, 0x3ccc6): Mirror 1: 0x9aa4546d Mirror 4: 0x9aa4546d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ccc6: skipped 000619 1788510575.541818 mapwrite 0x029985 thru 0x02d51a (0x3b96 bytes) 000620 1788510575.882749 read 0x026d46 thru 0x02f5bc (0x8877 bytes) 000623 1788510575.886463 read 0x000374 thru 0x0017cd (0x145a bytes) 000625 1788510575.957531 punch from 0x0318f9 to 0x033009 (0x1711 bytes) 000628 1788510575.967956 mapread 0x011d18 thru 0x01599c (0x3c85 bytes) 000630 1788510575.969305 trunc from 0x03ccc6 to 0x01a2ba (0x22a0b bytes) 000631 1788510576.019651 read 0x00da13 thru 0x017944 (0x9f32 bytes) 000632 1788510576.020459 mapwrite 0x03167d thru 0x0336bd (0x2041 bytes) 000633 1788510576.141179 trunc from 0x0336be to 0x01d0fc (0x165c1 bytes) 000634 1788510576.172654 mapwrite 0x0356d1 thru 0x03ffff (0xa92f bytes) 000638 1788510576.281222 mapwrite 0x027c41 thru 0x02b07b (0x343b bytes) 000639 1788510576.369061 trunc from 0x040000 to 0x001eae (0x3e151 bytes) 000640 1788510576.404198 write 0x03ab16 thru 0x03e3d6 (0x38c1 bytes) 000641 1788510576.408995 trunc from 0x03e3d7 to 0x02ad93 (0x13643 bytes) 000642 1788510576.448237 punch from 0x00f50f to 0x0161d3 (0x6cc5 bytes) 000644 1788510576.460944 write 0x00b2f8 thru 0x011173 (0x5e7c bytes) 000646 1788510576.478515 mapread 0x0112b5 thru 0x01336e (0x20ba bytes) 000648 1788510576.494941 punch from 0x018808 to 0x01893f (0x138 bytes) 000649 1788510576.510954 write 0x01fa1e thru 0x01fdc4 (0x3a7 bytes) 000651 1788510576.536648 MIRROR_RESYNC 3 mirrors 000652 1788510577.895178 mapread 0x01406b thru 0x017cd1 (0x3c67 bytes) 000653 1788510577.913604 write 0x012ae1 thru 0x01f030 (0xc550 bytes) 000654 1788510577.984310 read 0x019a95 thru 0x01dfaa (0x4516 bytes) 000655 1788510577.989783 MIRROR_RESYNC 3 mirrors 000658 1788510578.809310 MIRROR_RESYNC 3 mirrors 000660 1788510579.420464 read 0x00a56d thru 0x01578f (0xb223 bytes) 000661 1788510579.455932 mapread 0x017049 thru 0x01edc2 (0x7d7a bytes) 000664 1788510579.506653 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000665 1788510579.946168 trunc from 0x02ad94 to 0x01b597 (0xf7fc bytes) 000667 1788510580.146132 read 0x0084a4 thru 0x017f30 (0xfa8d bytes) 000668 1788510580.159788 read 0x00e0e3 thru 0x01401c (0x5f3a bytes) 000669 1788510580.160497 mapwrite 0x0016e3 thru 0x00464b (0x2f69 bytes) 000670 1788510580.355209 read 0x008648 thru 0x0138fe (0xb2b7 bytes) 000671 1788510580.362002 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000672 1788510580.718074 write 0x01e408 thru 0x02aea0 (0xca99 bytes) 000673 1788510580.728385 write 0x03be08 thru 0x03c7e2 (0x9db bytes) 000675 1788510580.740943 punch from 0x0132fc to 0x017879 (0x457e bytes) 000677 1788510580.775113 read 0x0136e0 thru 0x015d44 (0x2665 bytes) 000678 1788510580.787458 write 0x01f5b9 thru 0x0269fd (0x7445 bytes) 000679 1788510580.788836 punch from 0x021b80 to 0x02bb91 (0xa012 bytes) 000680 1788510580.812677 punch from 0x0256cb to 0x03411d (0xea53 bytes) 000682 1788510580.827192 trunc from 0x03c7e3 to 0x01e46d (0x1e375 bytes) 000683 1788510580.875491 read 0x0139cb thru 0x01698f (0x2fc5 bytes) 000685 1788510580.898859 punch from 0x016336 to 0x019fce (0x3c99 bytes) 000686 1788510580.907779 mapread 0x004f17 thru 0x00f8f1 (0xa9db bytes) 000690 1788510580.921150 punch from 0x016026 to 0x01e46d (0x8448 bytes) 000691 1788510580.941924 punch from 0x008265 to 0x0151b2 (0xcf4e bytes) 000693 1788510580.959888 mapwrite 0x00f538 thru 0x015e18 (0x68e1 bytes) 000694 1788510581.273987 mapwrite 0x0041e4 thru 0x011d6e (0xdb8b bytes) 000695 1788510581.505051 read 0x018e7c thru 0x0197c9 (0x94e bytes) 000696 1788510581.534542 punch from 0x01df74 to 0x01e46d (0x4fa bytes) 000697 1788510581.541733 mapwrite 0x03a5ae thru 0x03ffff (0x5a52 bytes) 000698 1788510581.617509 mapwrite 0x036edc thru 0x03ffff (0x9124 bytes) 000700 1788510581.835006 mapread 0x011023 thru 0x01f763 (0xe741 bytes) 000704 1788510581.879994 read 0x00b25b thru 0x016008 (0xadae bytes) 000705 1788510581.884699 mapread 0x009216 thru 0x00cbc8 (0x39b3 bytes) 000708 1788510581.891776 mapread 0x0210ff thru 0x02d4fc (0xc3fe bytes) 000709 1788510581.897248 mapread 0x031992 thru 0x0355cf (0x3c3e bytes) 000710 1788510581.901808 write 0x03923b thru 0x0392f3 (0xb9 bytes) 000711 1788510581.905799 punch from 0x02f5a2 to 0x03b1f4 (0xbc53 bytes) 000712 1788510581.943173 punch from 0x006cc9 to 0x00c631 (0x5969 bytes) 000714 1788510581.981785 MIRROR_EXTEND to 2 mirrors 000716 1788510583.232014 write 0x014a43 thru 0x021caf (0xd26d bytes) 000721 1788510583.337741 punch from 0x0075d9 to 0x012714 (0xb13c bytes) 000722 1788510583.394515 mapwrite 0x02e243 thru 0x0321af (0x3f6d bytes) 000723 1788510583.549282 write 0x024dd4 thru 0x02aa49 (0x5c76 bytes) 000724 1788510583.556563 mapwrite 0x03ecdf thru 0x03ffff (0x1321 bytes) 000725 1788510583.617097 read 0x02dcc5 thru 0x03d402 (0xf73e bytes) 000726 1788510583.634177 MIRROR_RESYNC 2 mirrors 000727 1788510585.053606 mapwrite 0x03b915 thru 0x03c4fd (0xbe9 bytes) 000728 1788510585.464920 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd5e14258 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcf52658b Mirror 3: 0xcf52658b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000730 1788510587.003066 trunc from 0x040000 to 0x01d1bc (0x22e43 bytes) 000734 1788510587.191617 punch from 0x019186 to 0x01d1bc (0x4037 bytes) 000735 1788510587.211562 mapwrite 0x00be21 thru 0x011c29 (0x5e09 bytes) 000736 1788510587.356920 mapread 0x019347 thru 0x01d1bc (0x3e76 bytes) 000739 1788510587.383838 mapread 0x019230 thru 0x01d1bc (0x3f8d bytes) 000740 1788510587.385042 mapwrite 0x03e790 thru 0x03fe02 (0x1673 bytes) 000741 1788510587.472519 punch from 0x00c563 to 0x014e8e (0x892c bytes) 000742 1788510587.501301 mapwrite 0x00c3d4 thru 0x01b090 (0xecbd bytes) 000743 1788510587.627560 read 0x03f740 thru 0x03fe02 (0x6c3 bytes) 000745 1788510587.630114 punch from 0x018a5d to 0x01f39c (0x6940 bytes) 000746 1788510587.636853 punch from 0x03f9b4 to 0x03fe02 (0x44f bytes) 000747 1788510587.643318 mapread 0x00d03b thru 0x0145cf (0x7595 bytes) 000748 1788510587.646016 trunc from 0x03fe03 to 0x034de2 (0xb020 bytes) 000749 1788510587.671112 punch from 0x010065 to 0x01080d (0x7a9 bytes) 000750 1788510587.678994 mapread 0x02019b thru 0x0241c4 (0x402a bytes) 000751 1788510587.708974 mapwrite 0x0193e5 thru 0x01b282 (0x1e9e bytes) 000755 1788510587.785218 mapwrite 0x0324d4 thru 0x0335f6 (0x1123 bytes) 000756 1788510587.927392 trunc from 0x034de3 to 0x02d5cd (0x7815 bytes) 000757 1788510587.982119 punch from 0x01a777 to 0x0298ab (0xf135 bytes) 000758 1788510588.001078 mapread 0x02c986 thru 0x02d5cd (0xc48 bytes) 000760 1788510588.009227 mapread 0x027747 thru 0x02d5cd (0x5e87 bytes) 000764 1788510588.048774 MIRROR_RESYNC 3 mirrors 000765 1788510589.830986 MIRROR_RESYNC 3 mirrors 000766 1788510590.350907 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000767 1788510590.757466 trunc from 0x02d5ce to 0x00da90 (0x1fb3d bytes) 000768 1788510590.869442 write 0x03d04a thru 0x03ffff (0x2fb6 bytes) 000771 1788510590.873905 read 0x02030f thru 0x02edbd (0xeaaf bytes) 000773 1788510590.893950 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2e397cad (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd5fedb Mirror 3: 0xbd5fedb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000774 1788510592.276810 read 0x020832 thru 0x02a191 (0x9960 bytes) 000776 1788510592.351638 punch from 0x01d83a to 0x025eba (0x8681 bytes) 000777 1788510592.457889 mapread 0x0163c8 thru 0x01ea38 (0x8671 bytes) 000778 1788510592.503544 mapread 0x00ae2e thru 0x00faf0 (0x4cc3 bytes) 000779 1788510592.525387 trunc from 0x040000 to 0x020731 (0x1f8ce bytes) 000780 1788510592.563691 trunc from 0x020732 to 0x0298db (0x91aa bytes) 000781 1788510592.604162 mapwrite 0x00627e thru 0x0127d0 (0xc553 bytes) 000782 1788510592.735096 trunc from 0x0298dc to 0x028457 (0x1484 bytes) 000783 1788510592.783980 trunc from 0x028458 to 0x0315d8 (0x9181 bytes) 000785 1788510592.803905 mapwrite 0x02dca3 thru 0x03031e (0x267c bytes) 000786 1788510593.008815 read 0x02a65e thru 0x02d157 (0x2afa bytes) 000789 1788510593.011021 mapread 0x0270db thru 0x02cbd3 (0x5af9 bytes) 000790 1788510593.015088 mapwrite 0x0117ae thru 0x02015c (0xe9af bytes) 000792 1788510593.085271 read 0x00c48d thru 0x01b87d (0xf3f1 bytes) 000793 1788510593.086206 mapwrite 0x00db03 thru 0x013d1e (0x621c bytes) 000794 1788510593.159053 read 0x001fd5 thru 0x002c17 (0xc43 bytes) 000795 1788510593.170198 read 0x01e8d7 thru 0x0284d8 (0x9c02 bytes) 000796 1788510593.171024 mapwrite 0x00a077 thru 0x016924 (0xc8ae bytes) 000797 1788510593.230408 MIRROR_RESYNC 3 mirrors 000798 1788510594.268295 mapwrite 0x002dfe thru 0x00a204 (0x7407 bytes) 000799 1788510594.463002 mapread 0x015546 thru 0x016b87 (0x1642 bytes) 000801 1788510594.482724 read 0x0220f2 thru 0x02a917 (0x8826 bytes) 000804 1788510594.508100 MIRROR_RESYNC 3 mirrors 000805 1788510595.591913 mapwrite 0x0352b4 thru 0x03ffff (0xad4c bytes) 000806 1788510596.024796 MIRROR_RESYNC 3 mirrors 000807 1788510597.372314 write 0x012e7b thru 0x015e3f (0x2fc5 bytes) 000808 1788510597.519685 read 0x019551 thru 0x020478 (0x6f28 bytes) 000809 1788510597.537670 read 0x000d9a thru 0x00c7ec (0xba53 bytes) 000811 1788510597.548888 mapread 0x02af1a thru 0x036087 (0xb16e bytes) 000812 1788510597.550074 punch from 0x01344c to 0x01503e (0x1bf3 bytes) 000813 1788510597.569500 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5e018f46 (stale) Mirror 3: 0x5e018f46 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4397b60f Mirror 4: 0x4397b60f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000815 1788510598.381021 read 0x022c3e thru 0x02d65b (0xaa1e bytes) 000817 1788510598.407245 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5e018f46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5e018f46 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4397b60f Mirror 4: 0x4397b60f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1788510599.456916 mapread 0x01af3d thru 0x024a83 (0x9b47 bytes) 000820 1788510599.500608 mapread 0x00f60c thru 0x0163ef (0x6de4 bytes) 000821 1788510599.550951 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5e018f46 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4397b60f Mirror 4: 0x4397b60f Mirror 5: 0x4397b60f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000824 1788510600.690910 trunc from 0x040000 to 0x00df80 (0x3207f bytes) 000825 1788510600.903960 mapread 0x003d03 thru 0x00df80 (0xa27e bytes) 000826 1788510600.929456 mapread 0x00d3b7 thru 0x00df80 (0xbca bytes) 000827 1788510600.930177 punch from 0x001b21 to 0x005bf2 (0x40d2 bytes) 000828 1788510600.936148 trunc from 0x00df81 to 0x0168da (0x895a bytes) 000829 1788510600.968492 mapwrite 0x0338ad thru 0x039bf1 (0x6345 bytes) 000832 1788510601.060298 trunc from 0x039bf2 to 0x01ca10 (0x1d1e1 bytes) 000835 1788510601.076354 mapwrite 0x0299eb thru 0x02baaf (0x20c5 bytes) 000836 1788510601.177596 mapread 0x0294b4 thru 0x02b4ab (0x1ff8 bytes) 000837 1788510601.178609 punch from 0x01c6ee to 0x02669b (0x9fae bytes) 000838 1788510601.186245 punch from 0x003560 to 0x012399 (0xee3a bytes) 000839 1788510601.192674 punch from 0x01f320 to 0x02abf9 (0xb8da bytes) 000841 1788510601.200538 mapread 0x00b40f thru 0x00f88b (0x447d bytes) 000842 1788510601.212078 trunc from 0x02bab0 to 0x01246b (0x19644 bytes) 000844 1788510601.238576 mapwrite 0x01a726 thru 0x021aa2 (0x737d bytes) 000845 1788510601.381169 read 0x008c48 thru 0x00e859 (0x5c12 bytes) 000847 1788510601.386284 write 0x0021e7 thru 0x0090af (0x6ec9 bytes) 000848 1788510601.398998 mapwrite 0x000217 thru 0x0049b5 (0x479f bytes) 000851 1788510601.487391 MIRROR_RESYNC 4 mirrors 000852 1788510603.307182 trunc from 0x021aa3 to 0x01fcca (0x1dd8 bytes) 000853 1788510603.405201 mapwrite 0x015425 thru 0x01bc3c (0x6818 bytes) 000854 1788510603.509051 write 0x021ef1 thru 0x02dcbf (0xbdcf bytes) 000855 1788510603.510761 mapwrite 0x02a304 thru 0x0331df (0x8edc bytes) 000856 1788510603.595862 read 0x019f73 thru 0x01c8b4 (0x2942 bytes) 000857 1788510603.597233 read 0x01355b thru 0x0143d3 (0xe79 bytes) 000858 1788510603.598914 trunc from 0x0331e0 to 0x012c46 (0x20599 bytes) 000859 1788510603.626255 mapwrite 0x02a501 thru 0x02bcd4 (0x17d4 bytes) 000860 1788510603.712882 read 0x017804 thru 0x01acf3 (0x34f0 bytes) 000862 1788510603.714311 trunc from 0x02bcd5 to 0x01a53d (0x11797 bytes) 000863 1788510603.734927 write 0x001850 thru 0x00c49a (0xac4b bytes) 000864 1788510603.736540 trunc from 0x01a53e to 0x01028d (0xa2b0 bytes) 000865 1788510603.757370 mapwrite 0x02f2ec thru 0x0380f3 (0x8e08 bytes) 000866 1788510603.925161 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x380f4): Mirror 3: 0xc744a160 (stale) Mirror 4: 0xc744a160 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380f4): Mirror 3: 0xc744a160 (stale) Mirror 4: 0xc744a160 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380f4: skipped 000867 1788510604.452624 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x380f4): Mirror 4: 0xc744a160 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380f4): Mirror 4: 0xc744a160 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380f4: skipped 000868 1788510604.910566 mapread 0x014f57 thru 0x023c79 (0xed23 bytes) 000870 1788510604.949258 mapwrite 0x014763 thru 0x01c1a8 (0x7a46 bytes) 000871 1788510605.004693 mapwrite 0x01b80e thru 0x024d38 (0x952b bytes) 000872 1788510605.070663 trunc from 0x0380f4 to 0x01755e (0x20b95 bytes) 000873 1788510605.100253 mapwrite 0x0350c0 thru 0x03ffff (0xaf40 bytes) 000875 1788510605.179531 write 0x023de1 thru 0x02879b (0x49bb bytes) 000876 1788510605.198148 trunc from 0x040000 to 0x03d27e (0x2d81 bytes) 000878 1788510605.218529 mapwrite 0x023c44 thru 0x02576a (0x1b27 bytes) 000879 1788510605.290249 trunc from 0x03d27f to 0x030192 (0xd0ec bytes) 000881 1788510605.321521 mapwrite 0x034624 thru 0x03844c (0x3e29 bytes) 000882 1788510605.401209 trunc from 0x03844d to 0x01c1f2 (0x1c25a bytes) 000884 1788510605.427052 punch from 0x000674 to 0x00c07d (0xba0a bytes) 000885 1788510605.435939 mapwrite 0x0041c6 thru 0x007f76 (0x3db1 bytes) 000886 1788510605.495784 punch from 0x007f60 to 0x014cd9 (0xcd7a bytes) 000887 1788510605.507168 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1c1f3): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c1f3): Mirror 4: 0x2c3a78d (stale) CRC-32 checksum value for chunk [0, 0x1c1f3): Mirror 1: 0x24f9d087 Mirror 5: 0x24f9d087 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c1f3: skipped 000889 1788510606.832449 punch from 0x0162b2 to 0x01c1f2 (0x5f41 bytes) 000891 1788510606.940680 read 0x009d71 thru 0x00cac5 (0x2d55 bytes) 000893 1788510606.951747 write 0x01d12a thru 0x023094 (0x5f6b bytes) 000895 1788510606.954778 mapread 0x0214ff thru 0x023094 (0x1b96 bytes) 000896 1788510606.956124 punch from 0x009a25 to 0x00df55 (0x4531 bytes) 000898 1788510606.976613 write 0x02a1a9 thru 0x034196 (0x9fee bytes) 000900 1788510606.981468 read 0x00dcba thru 0x01796a (0x9cb1 bytes) 000901 1788510607.011711 punch from 0x02fc03 to 0x034196 (0x4594 bytes) 000902 1788510607.044259 MIRROR_RESYNC 3 mirrors 000903 1788510608.500641 mapread 0x01dfc8 thru 0x01e9e3 (0xa1c bytes) 000905 1788510608.520853 mapread 0x027dd6 thru 0x029052 (0x127d bytes) 000906 1788510608.535885 mapwrite 0x021863 thru 0x02e611 (0xcdaf bytes) 000907 1788510608.734126 read 0x02c5c4 thru 0x02f0ac (0x2ae9 bytes) 000908 1788510608.743184 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34197): Mirror 5: 0xe99ec644 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34197): Mirror 5: 0xe99ec644 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34197: skipped 000909 1788510609.073675 read 0x021802 thru 0x02a514 (0x8d13 bytes) 000910 1788510609.087897 write 0x01a79d thru 0x024a0b (0xa26f bytes) 000911 1788510609.094246 read 0x02ec29 thru 0x034196 (0x556e bytes) 000912 1788510609.106154 read 0x02df0d thru 0x034196 (0x628a bytes) 000913 1788510609.107303 mapwrite 0x00010d thru 0x004689 (0x457d bytes) 000914 1788510609.158994 punch from 0x001b0b to 0x00ffd6 (0xe4cc bytes) 000917 1788510609.166239 punch from 0x0260fb to 0x033210 (0xd116 bytes) 000919 1788510609.173206 punch from 0x02a5cb to 0x034196 (0x9bcc bytes) 000921 1788510609.179262 mapread 0x031fc3 thru 0x034196 (0x21d4 bytes) 000922 1788510609.193169 mapread 0x0294c2 thru 0x02d177 (0x3cb6 bytes) 000924 1788510609.194838 trunc from 0x034197 to 0x029c10 (0xa586 bytes) 000926 1788510609.219317 mapwrite 0x03b3d5 thru 0x03ffff (0x4c2b bytes) 000927 1788510609.306142 punch from 0x029404 to 0x037157 (0xdd54 bytes) 000928 1788510609.316105 read 0x03a412 thru 0x03ffff (0x5bee bytes) 000931 1788510609.318275 punch from 0x028780 to 0x02cbec (0x446d bytes) 000932 1788510609.323577 mapwrite 0x023770 thru 0x02b830 (0x80c1 bytes) 000933 1788510609.409357 write 0x02d0a1 thru 0x03b6d0 (0xe630 bytes) 000935 1788510609.413153 punch from 0x02b1d0 to 0x03266b (0x749c bytes) 000936 1788510609.437101 read 0x02eab7 thru 0x033933 (0x4e7d bytes) 000938 1788510609.448789 write 0x030b9b thru 0x031538 (0x99e bytes) 000940 1788510609.452826 write 0x007e66 thru 0x0154c6 (0xd661 bytes) 000942 1788510609.455886 mapwrite 0x01a9c8 thru 0x01e3a5 (0x39de bytes) 000943 1788510609.529559 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) 000944 1788510609.721470 write 0x01805f thru 0x01d4d2 (0x5474 bytes) 000945 1788510609.738914 mapwrite 0x03668b thru 0x03acab (0x4621 bytes) 000948 1788510609.835417 mapwrite 0x03542f thru 0x03ffff (0xabd1 bytes) 000949 1788510609.869671 mapread 0x008a44 thru 0x01711e (0xe6db bytes) 000950 1788510609.890422 write 0x029aa2 thru 0x02b07f (0x15de bytes) 000952 1788510609.905150 read 0x03d15b thru 0x03ffff (0x2ea5 bytes) 000953 1788510609.913548 MIRROR_EXTEND to 2 mirrors 000954 1788510611.174294 write 0x03bcef thru 0x03ffff (0x4311 bytes) 000955 1788510611.274667 trunc from 0x040000 to 0x015509 (0x2aaf6 bytes) 000956 1788510611.311275 mapread 0x0060d3 thru 0x015509 (0xf437 bytes) 000957 1788510611.352749 mapwrite 0x004dc5 thru 0x013f2d (0xf169 bytes) 000960 1788510611.437172 trunc from 0x01550a to 0x0131df (0x232a bytes) 000962 1788510611.461651 mapread 0x003e37 thru 0x00dd72 (0x9f3c bytes) 000963 1788510611.463213 punch from 0x00cbcd to 0x0131df (0x6613 bytes) 000964 1788510611.470655 read 0x00ebd1 thru 0x0131df (0x460f bytes) 000967 1788510611.485126 read 0x01263f thru 0x0130cb (0xa8d bytes) 000969 1788510611.487095 write 0x014b3d thru 0x01a6db (0x5b9f bytes) 000970 1788510611.489230 mapwrite 0x037689 thru 0x03ffff (0x8977 bytes) 000971 1788510611.599291 punch from 0x03ffce to 0x03ffff (0x32 bytes) 000972 1788510611.608125 trunc from 0x040000 to 0x01e32e (0x21cd1 bytes) 000975 1788510611.644693 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1e32f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e32f): Mirror 2: 0x2b22cb37 (stale) CRC-32 checksum value for chunk [0, 0x1e32f): Mirror 1: 0xcc12e1f3 Mirror 3: 0xcc12e1f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e32f: skipped 000976 1788510613.132250 write 0x03074e thru 0x035141 (0x49f4 bytes) 000977 1788510613.261549 read 0x02ead3 thru 0x035141 (0x666f bytes) 000980 1788510613.271808 mapwrite 0x02208b thru 0x02577e (0x36f4 bytes) 000982 1788510613.383134 mapwrite 0x03cc29 thru 0x03ffff (0x33d7 bytes) 000983 1788510613.541935 mapwrite 0x014031 thru 0x015dc2 (0x1d92 bytes) 000984 1788510613.640457 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7f54e0ce (stale) Mirror 3: 0x6230207 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd13d7ef Mirror 4: 0xbd13d7ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000985 1788510614.965504 write 0x00af8d thru 0x015964 (0xa9d8 bytes) 000986 1788510615.053160 read 0x01c696 thru 0x023999 (0x7304 bytes) 000987 1788510615.063777 write 0x019151 thru 0x022901 (0x97b1 bytes) 000988 1788510615.080708 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x179:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6230207 (stale) Mirror 4: 0xbd13d7ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6230207 (stale) Mirror 4: 0xbd13d7ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000989 1788510615.494747 MIRROR_RESYNC 3 mirrors 000990 1788510616.904736 read 0x00b540 thru 0x00f808 (0x42c9 bytes) 000991 1788510616.923379 MIRROR_EXTEND to 4 mirrors 000992 1788510617.756078 write 0x016d3c thru 0x01afe3 (0x42a8 bytes) 000993 1788510617.841234 read 0x0215fb thru 0x02b06a (0x9a70 bytes) 000994 1788510617.857664 MIRROR_RESYNC 4 mirrors 000995 1788510619.164611 read 0x00b833 thru 0x017fed (0xc7bb bytes) 000997 1788510619.180424 mapwrite 0x012732 thru 0x017268 (0x4b37 bytes) 000998 1788510619.359233 write 0x01b758 thru 0x01b998 (0x241 bytes) All operations completed A-OK!