== sanity-flr test 70a: flr mode fsx test ================ 00:14:28 (1788581668) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1670 skipping zero length zero range skipping zero length punch hole 000003 1788581671.149651 mapwrite 0x03eeb2 thru 0x03ffff (0x114e bytes) 000005 1788581671.237902 read 0x02fb7d thru 0x03fb2a (0xffae bytes) truncating to largest ever: 0x32c33 000006 1788581671.269552 trunc from 0x040000 to 0x032c32 (0xd3cd bytes) fallocating to largest ever: 0x33bc4 000007 1788581671.391945 fallocate 0x025280 thru 0x033bc3 (0xe944 bytes) 000008 1788581671.416940 write 0x02ee2f thru 0x03cc5f (0xde31 bytes) 000009 1788581671.425021 mapwrite 0x011822 thru 0x01e6a6 (0xce85 bytes) 000010 1788581671.497340 fallocate 0x01de9d thru 0x01eae9 (0xc4d bytes) 000011 1788581671.505901 punch from 0x0336b3 to 0x03a070 (0x69be bytes) 000012 1788581671.510578 trunc from 0x03cc60 to 0x022842 (0x1a41d bytes) 000013 1788581671.529041 trunc from 0x01e188 to 0x01fe27 (0x1ca0 bytes) 000014 1788581671.533772 read 0x007db9 thru 0x00c783 (0x49cb bytes) fallocating to largest ever: 0x40000 000015 1788581671.551699 fallocate 0x03e79d thru 0x03ffff (0x1863 bytes) 000016 1788581671.559599 write 0x0243f7 thru 0x024505 (0x10f bytes) 000017 1788581671.561511 mapwrite 0x0185f1 thru 0x02664d (0xe05d bytes) 000018 1788581671.615106 mapwrite 0x0154e1 thru 0x02480f (0xf32f bytes) 000019 1788581671.637675 mapread 0x01b1c5 thru 0x02373b (0x8577 bytes) 000020 1788581671.639051 mapwrite 0x016975 thru 0x01fa6e (0x90fa bytes) 000021 1788581671.661675 trunc from 0x02664e to 0x02deec (0x789f bytes) 000022 1788581671.702628 read 0x0147b1 thru 0x02299b (0xe1eb bytes) 000023 1788581671.703210 mapwrite 0x0061d4 thru 0x00d19e (0x6fcb bytes) 000024 1788581671.729454 mapwrite 0x03d8f2 thru 0x03f523 (0x1c32 bytes) 000025 1788581671.789731 mapwrite 0x001d08 thru 0x0117f4 (0xfaed bytes) 000026 1788581671.858588 punch from 0x01ac35 to 0x025edc (0xb2a8 bytes) 000028 1788581671.876078 fallocate 0x014c71 thru 0x017480 (0x2810 bytes) 000029 1788581671.884877 trunc from 0x00a449 to 0x018fb0 (0xeb68 bytes) 000030 1788581671.895827 punch from 0x01ca35 to 0x02ac60 (0xe22c bytes) 000031 1788581671.908616 punch from 0x007634 to 0x007df7 (0x7c4 bytes) 000032 1788581671.919289 MIRROR_EXTEND to 2 mirrors 000033 1788581672.605795 punch from 0x0394d7 to 0x03f523 (0x604d bytes) 000034 1788581672.640554 mapwrite 0x0191f8 thru 0x01b0fb (0x1f04 bytes) 000035 1788581672.670904 read 0x02e849 thru 0x03aac1 (0xc279 bytes) 000036 1788581672.679297 mapwrite 0x01cbf8 thru 0x029fc6 (0xd3cf bytes) 000037 1788581672.712887 MIRROR_RESYNC 2 mirrors 000039 1788581673.411667 mapwrite 0x037cac thru 0x03ffff (0x8354 bytes) 000040 1788581673.513401 read 0x000156 thru 0x008aa4 (0x894f bytes) 000041 1788581673.528302 punch from 0x006b90 to 0x00daed (0x6f5e bytes) 000042 1788581673.534364 fallocate 0x0323a2 thru 0x039d40 (0x799f bytes) 000044 1788581673.540442 read 0x006824 thru 0x00a67f (0x3e5c bytes) 000045 1788581673.556296 mapread 0x037269 thru 0x03e1d9 (0x6f71 bytes) 000046 1788581673.558647 mapread 0x019144 thru 0x0224ba (0x9377 bytes) 000047 1788581673.560795 mapread 0x0061a5 thru 0x00b1b9 (0x5015 bytes) 000048 1788581673.566910 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9568bcc3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x95867a7 Mirror 3: 0x95867a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000049 1788581674.453639 fallocate 0x02e015 thru 0x031198 (0x3184 bytes) 000050 1788581674.488123 write 0x02471f thru 0x02b3ae (0x6c90 bytes) 000051 1788581674.502095 trunc from 0x0075f8 to 0x00fe3e (0x8847 bytes) 000052 1788581674.507067 fallocate 0x037bcb thru 0x03ffff (0x8435 bytes) 000053 1788581674.511510 mapread 0x031cf2 thru 0x039cbc (0x7fcb bytes) 000054 1788581674.529832 read 0x0316da thru 0x03e191 (0xcab8 bytes) 000055 1788581674.536349 mapread 0x01b23b thru 0x029c2e (0xe9f4 bytes) 000056 1788581674.553173 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9568bcc3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9568bcc3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000057 1788581674.896552 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000058 1788581675.068728 mapwrite 0x025c73 thru 0x0340f2 (0xe480 bytes) 000059 1788581675.141215 punch from 0x038a12 to 0x03ffff (0x75ee bytes) 000060 1788581675.147689 read 0x01e609 thru 0x022896 (0x428e bytes) 000061 1788581675.154716 read 0x024c09 thru 0x032c18 (0xe010 bytes) 000062 1788581675.155555 read 0x004387 thru 0x00ea61 (0xa6db bytes) 000063 1788581675.171099 fallocate 0x02c5af thru 0x02db14 (0x1566 bytes) 000065 1788581675.179706 mapread 0x02a240 thru 0x02e3fd (0x41be bytes) 000066 1788581675.181953 punch from 0x019f31 to 0x02454a (0xa61a bytes) 000067 1788581675.188156 mapread 0x0301cf thru 0x03f514 (0xf346 bytes) 000068 1788581675.190140 trunc from 0x040000 to 0x036324 (0x9cdb bytes) 000069 1788581675.209032 read 0x028b88 thru 0x02e2ac (0x5725 bytes) 000070 1788581675.211943 punch from 0x001932 to 0x00439b (0x2a6a bytes) 000072 1788581675.223700 trunc from 0x00b736 to 0x00cf60 (0x182b bytes) 000073 1788581675.236077 write 0x022bf1 thru 0x02bb75 (0x8f85 bytes) 000074 1788581675.272654 trunc from 0x00e973 to 0x01c4c2 (0xdb50 bytes) 000076 1788581675.288155 mapwrite 0x033d8c thru 0x0361c0 (0x2435 bytes) 000077 1788581675.361027 punch from 0x00a1e0 to 0x01985f (0xf680 bytes) 000078 1788581675.372551 read 0x0230f7 thru 0x02e022 (0xaf2c bytes) 000080 1788581675.378701 mapread 0x00d655 thru 0x013773 (0x611f bytes) 000083 1788581675.414040 punch from 0x005c1f to 0x00f50e (0x98f0 bytes) 000084 1788581675.427855 read 0x028c06 thru 0x036324 (0xd71f bytes) 000085 1788581675.429156 trunc from 0x010898 to 0x020643 (0xfdac bytes) 000086 1788581675.462034 mapread 0x01d491 thru 0x021280 (0x3df0 bytes) 000087 1788581675.475163 punch from 0x024d8c to 0x02d747 (0x89bc bytes) 000088 1788581675.487846 trunc from 0x009012 to 0x011b4b (0x8b3a bytes) 000089 1788581675.508318 read 0x02c97c thru 0x034a8f (0x8114 bytes) 000091 1788581675.532992 write 0x015fb5 thru 0x020bde (0xac2a bytes) 000092 1788581675.534618 trunc from 0x036325 to 0x00f3a2 (0x26f82 bytes) 000094 1788581675.604262 fallocate 0x02133b thru 0x02220b (0xed1 bytes) 000095 1788581675.617260 trunc from 0x00707d to 0x00f3a2 (0x8326 bytes) 000096 1788581675.633165 write 0x03c2ab thru 0x03ffff (0x3d55 bytes) 000097 1788581675.634545 trunc from 0x000cee to 0x007412 (0x6725 bytes) 000098 1788581675.661764 trunc from 0x040000 to 0x01b494 (0x24b6b bytes) 000099 1788581675.723181 read 0x00ee91 thru 0x010316 (0x1486 bytes) 000100 1788581675.751104 mapread 0x010826 thru 0x01b494 (0xac6f bytes) 000101 1788581675.755169 mapwrite 0x01a30d thru 0x0238e0 (0x95d4 bytes) 000102 1788581675.805520 trunc from 0x001d06 to 0x00fd27 (0xe022 bytes) 000103 1788581675.815684 MIRROR_EXTEND to 2 mirrors 000104 1788581676.360673 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000105 1788581676.452617 punch from 0x011a4e to 0x013fef (0x25a2 bytes) 000106 1788581676.464076 fallocate 0x02e1c7 thru 0x03204b (0x3e85 bytes) 000107 1788581676.468139 punch from 0x01204c to 0x017fb4 (0x5f69 bytes) 000108 1788581676.472612 punch from 0x00a8fe to 0x00e075 (0x3778 bytes) 000109 1788581676.477049 mapwrite 0x03646d thru 0x036b18 (0x6ac bytes) 000110 1788581676.508731 trunc from 0x01fc44 to 0x024d6e (0x512b bytes) 000111 1788581676.514375 trunc from 0x005518 to 0x00ef5a (0x9a43 bytes) 000112 1788581676.518390 punch from 0x02f7ce to 0x036b18 (0x734b bytes) 000113 1788581676.523055 punch from 0x008fd2 to 0x014ce0 (0xbd0f bytes) 000114 1788581676.526706 read 0x0053ac thru 0x00b912 (0x6567 bytes) 000115 1788581676.533008 fallocate 0x039287 thru 0x03e286 (0x5000 bytes) 000116 1788581676.537083 read 0x010831 thru 0x01dc22 (0xd3f2 bytes) 000117 1788581676.547610 mapread 0x0028c4 thru 0x00a77b (0x7eb8 bytes) 000118 1788581676.548538 mapread 0x0132da thru 0x022cc6 (0xf9ed bytes) 000119 1788581676.549458 trunc from 0x03e287 to 0x00a1b2 (0x340d4 bytes) 000121 1788581676.559018 trunc from 0x00a1b3 to 0x03fa79 (0x358c7 bytes) 000124 1788581676.573982 mapwrite 0x025c0a thru 0x032b0a (0xcf01 bytes) 000125 1788581676.709741 read 0x03cb1e thru 0x03fa79 (0x2f5c bytes) 000126 1788581676.749286 read 0x00c3a1 thru 0x00e5be (0x221e bytes) 000127 1788581676.749968 read 0x0346c6 thru 0x03fa79 (0xb3b4 bytes) 000129 1788581676.752039 trunc from 0x009c91 to 0x00a4ad (0x81d bytes) 000130 1788581676.764377 fallocate 0x03304c thru 0x034ef1 (0x1ea6 bytes) 000131 1788581676.773833 trunc from 0x02800f to 0x037f7e (0xff70 bytes) 000132 1788581676.786122 punch from 0x01054b to 0x01ef11 (0xe9c7 bytes) 000133 1788581676.792440 punch from 0x03898b to 0x03ec3d (0x62b3 bytes) 000135 1788581676.798116 read 0x01a828 thru 0x01c397 (0x1b70 bytes) 000137 1788581676.810836 mapread 0x00c308 thru 0x017ca9 (0xb9a2 bytes) 000138 1788581676.812139 punch from 0x00e4db to 0x01a01a (0xbb40 bytes) 000139 1788581676.823735 trunc from 0x03fa7a to 0x00c730 (0x33349 bytes) 000140 1788581676.844604 read 0x00aeda thru 0x00c730 (0x1857 bytes) 000141 1788581676.845212 write 0x0388c7 thru 0x03ffff (0x7739 bytes) 000142 1788581676.846584 mapread 0x00a802 thru 0x010bc8 (0x63c7 bytes) 000144 1788581676.862142 trunc from 0x040000 to 0x010264 (0x2fd9b bytes) 000145 1788581676.899831 MIRROR_EXTEND to 2 mirrors 000146 1788581677.648514 read 0x000750 thru 0x0012d6 (0xb87 bytes) 000147 1788581677.662128 trunc from 0x00afed to 0x010264 (0x5278 bytes) 000148 1788581677.713653 mapread 0x00fce2 thru 0x010264 (0x583 bytes) 000149 1788581677.723657 punch from 0x00f566 to 0x010264 (0xcff bytes) 000150 1788581677.729346 trunc from 0x00b50e to 0x00cd79 (0x186c bytes) 000151 1788581677.733638 trunc from 0x010265 to 0x039f2b (0x29cc7 bytes) 000152 1788581677.790103 mapread 0x015d4f thru 0x020980 (0xac32 bytes) 000153 1788581677.818440 fallocate 0x01ef73 thru 0x02913f (0xa1cd bytes) 000154 1788581677.823507 punch from 0x02fc1b to 0x0358d9 (0x5cbf bytes) 000156 1788581677.829512 mapread 0x0323bc thru 0x0395f9 (0x723e bytes) 000157 1788581677.842266 punch from 0x034cd4 to 0x039f2b (0x5258 bytes) 000158 1788581677.848222 write 0x015e65 thru 0x025c19 (0xfdb5 bytes) 000159 1788581677.851462 trunc from 0x039f2c to 0x01d95d (0x1c5ce bytes) 000160 1788581677.870116 trunc from 0x01d95e to 0x0063ae (0x175af bytes) 000161 1788581677.892956 write 0x006848 thru 0x00efae (0x8767 bytes) 000162 1788581677.900323 mapwrite 0x0126ad thru 0x0208ec (0xe240 bytes) 000163 1788581677.971233 mapwrite 0x004b63 thru 0x011373 (0xc811 bytes) 000164 1788581678.004132 trunc from 0x015ec0 to 0x01709b (0x11dc bytes) 000165 1788581678.010910 mapread 0x008b29 thru 0x01210a (0x95e2 bytes) 000166 1788581678.015403 punch from 0x01decb to 0x0208ec (0x2a22 bytes) 000167 1788581678.023600 trunc from 0x0208ed to 0x009f2b (0x169c1 bytes) 000168 1788581678.040784 fallocate 0x00299d thru 0x00f717 (0xcd7b bytes) 000169 1788581678.045648 mapwrite 0x0242ab thru 0x031060 (0xcdb6 bytes) 000170 1788581678.104760 mapread 0x006970 thru 0x008618 (0x1ca9 bytes) 000171 1788581678.120860 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000172 1788581678.314678 mapwrite 0x033d58 thru 0x03b44c (0x76f5 bytes) 000173 1788581678.363323 trunc from 0x022d3d to 0x02cdab (0xa06f bytes) 000174 1788581678.369570 MIRROR_EXTEND to 2 mirrors 000177 1788581678.999712 read 0x01ecd2 thru 0x02aa13 (0xbd42 bytes) 000178 1788581679.011673 write 0x023a61 thru 0x027fa4 (0x4544 bytes) 000179 1788581679.075353 fallocate 0x006eec thru 0x00c3e0 (0x54f5 bytes) 000180 1788581679.085874 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b44d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b44d): Mirror 2: 0x5ce5ea51 (stale) CRC-32 checksum value for chunk [0, 0x3b44d): Mirror 1: 0xd6858fcf Mirror 3: 0xd6858fcf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b44d: skipped 000181 1788581679.905136 fallocate 0x0298ec thru 0x030a92 (0x71a7 bytes) 000182 1788581679.964788 trunc from 0x01e933 to 0x022b24 (0x41f2 bytes) 000183 1788581679.971228 mapread 0x030f1c thru 0x03a8dc (0x99c1 bytes) 000184 1788581679.990711 trunc from 0x03b44d to 0x025af9 (0x15953 bytes) 000185 1788581680.026555 read 0x01a1ae thru 0x01b275 (0x10c8 bytes) 000186 1788581680.031819 fallocate 0x00bd98 thru 0x01301d (0x7286 bytes) 000187 1788581680.039262 mapread 0x004be6 thru 0x005384 (0x79f bytes) 000189 1788581680.047225 read 0x0166b0 thru 0x016ab2 (0x403 bytes) 000190 1788581680.054933 punch from 0x00e68d to 0x01536c (0x6ce0 bytes) 000191 1788581680.058367 punch from 0x01128a to 0x01c634 (0xb3ab bytes) 000192 1788581680.061260 trunc from 0x025afa to 0x00cb84 (0x18f75 bytes) 000194 1788581680.075019 punch from 0x000c4a to 0x004d5b (0x4112 bytes) 000195 1788581680.079144 fallocate 0x009eef thru 0x00a274 (0x386 bytes) 000196 1788581680.087947 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcb85): Mirror 3: 0x73350e29 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcb85): Mirror 3: 0x73350e29 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcb85: skipped 000197 1788581680.294196 trunc from 0x00cb85 to 0x02c95b (0x1fdd7 bytes) 000198 1788581680.320571 punch from 0x007a12 to 0x00e65b (0x6c4a bytes) 000199 1788581680.328029 MIRROR_RESYNC 2 mirrors 000200 1788581680.678804 trunc from 0x02c95c to 0x022372 (0xa5e9 bytes) 000201 1788581680.766851 mapwrite 0x0335a6 thru 0x03cc21 (0x967c bytes) 000202 1788581680.863848 read 0x027629 thru 0x032eca (0xb8a2 bytes) 000204 1788581680.877084 trunc from 0x03cc22 to 0x00be97 (0x30d8a bytes) 000205 1788581680.894575 write 0x000be9 thru 0x007bdc (0x6ff4 bytes) 000206 1788581680.901666 trunc from 0x001f34 to 0x006217 (0x42e4 bytes) 000207 1788581680.914505 write 0x0074cb thru 0x00d515 (0x604b bytes) 000208 1788581680.915677 trunc from 0x00d516 to 0x0038d7 (0x9c3e bytes) 000209 1788581680.933192 punch from 0x0003b5 to 0x0038d7 (0x3523 bytes) 000210 1788581680.938006 mapread 0x002af9 thru 0x0038d7 (0xddf bytes) 000211 1788581680.947081 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38d8): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d8): Mirror 3: 0x36060351 (stale) CRC-32 checksum value for chunk [0, 0x38d8): Mirror 1: 0x36060351 Mirror 4: 0x36060351 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d8: skipped 000212 1788581682.001334 mapwrite 0x013af3 thru 0x01c3ff (0x890d bytes) 000213 1788581682.148807 trunc from 0x01c400 to 0x022774 (0x6375 bytes) 000214 1788581682.168808 fallocate 0x019f17 thru 0x01e8f0 (0x49da bytes) 000215 1788581682.175995 fallocate 0x03cf3d thru 0x03ffff (0x30c3 bytes) 000217 1788581682.182390 mapwrite 0x02d4bb thru 0x0304ef (0x3035 bytes) 000218 1788581682.222242 punch from 0x02acda to 0x02edb5 (0x40dc bytes) 000219 1788581682.229894 punch from 0x008f70 to 0x018691 (0xf722 bytes) 000220 1788581682.235064 mapwrite 0x0066c4 thru 0x00fd80 (0x96bd bytes) 000221 1788581682.265851 fallocate 0x01b6e3 thru 0x029431 (0xdd4f bytes) 000222 1788581682.270391 punch from 0x02ce14 to 0x0304ef (0x36dc bytes) 000223 1788581682.275877 read 0x009ca2 thru 0x0106e2 (0x6a41 bytes) 000224 1788581682.276576 read 0x0132c3 thru 0x015962 (0x26a0 bytes) 000225 1788581682.290075 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x304f0): Mirror 4: 0xfc96f2ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x304f0): Mirror 4: 0xfc96f2ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x304f0: skipped 000226 1788581682.551087 mapread 0x00500e thru 0x011b09 (0xcafc bytes) 000227 1788581682.580359 read 0x00eafb thru 0x01d89f (0xeda5 bytes) 000228 1788581682.591207 trunc from 0x015169 to 0x0238fa (0xe792 bytes) 000229 1788581682.597944 fallocate 0x026866 thru 0x027007 (0x7a2 bytes) 000230 1788581682.602183 mapwrite 0x03f1f0 thru 0x03ffff (0xe10 bytes) 000231 1788581682.653162 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x97901b46 Mirror 5: 0x97901b46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000232 1788581683.788601 punch from 0x001b16 to 0x005b61 (0x404c bytes) 000233 1788581683.889825 trunc from 0x007d4c to 0x017a90 (0xfd45 bytes) 000234 1788581683.895945 mapread 0x02a1de thru 0x02b201 (0x1024 bytes) 000235 1788581683.905161 punch from 0x015cb0 to 0x015d50 (0xa1 bytes) 000236 1788581683.915797 fallocate 0x0290e1 thru 0x029107 (0x27 bytes) 000237 1788581683.920872 trunc from 0x040000 to 0x039849 (0x67b6 bytes) 000238 1788581683.946457 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3984a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3984a): Mirror 4: 0x6eba2b5c (stale) Mirror 5: 0xf835f4a0 (stale) CRC-32 checksum value for chunk [0, 0x3984a): Mirror 1: 0xda88965e Mirror 6: 0xda88965e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3984a: skipped 000239 1788581684.970205 write 0x0309ea thru 0x039317 (0x892e bytes) 000240 1788581685.013983 mapread 0x00168c thru 0x0100bc (0xea31 bytes) 000241 1788581685.038671 write 0x0128af thru 0x018f4e (0x66a0 bytes) 000242 1788581685.047829 mapwrite 0x00e0d7 thru 0x01dc3d (0xfb67 bytes) 000243 1788581685.089532 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3984a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3984a): Mirror 4: 0x6eba2b5c (stale) Mirror 5: 0xf835f4a0 (stale) Mirror 6: 0xda88965e (stale) CRC-32 checksum value for chunk [0, 0x3984a): Mirror 1: 0x2dbe7e59 Mirror 7: 0x2dbe7e59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3984a: skipped 000244 1788581685.944923 mapread 0x001452 thru 0x007ba9 (0x6758 bytes) 000245 1788581685.968021 MIRROR_RESYNC 5 mirrors 000246 1788581686.711810 fallocate 0x01e830 thru 0x02b2bf (0xca90 bytes) 000247 1788581686.735946 fallocate 0x037a98 thru 0x03ffff (0x8568 bytes) 000248 1788581686.742800 trunc from 0x03579d to 0x03bcb5 (0x6519 bytes) 000249 1788581686.747107 punch from 0x026468 to 0x02e8bb (0x8454 bytes) 000250 1788581686.750039 mapread 0x03020a thru 0x035a90 (0x5887 bytes) 000251 1788581686.764764 mapread 0x01bb59 thru 0x0240e0 (0x8588 bytes) 000252 1788581686.783637 punch from 0x02a331 to 0x038b8b (0xe85b bytes) 000253 1788581686.788195 mapwrite 0x02b02d thru 0x03707a (0xc04e bytes) 000254 1788581686.818755 read 0x03df87 thru 0x03ffff (0x2079 bytes) 000255 1788581686.823772 read 0x0171b2 thru 0x021891 (0xa6e0 bytes) 000256 1788581686.824355 write 0x03343f thru 0x03bc1d (0x87df bytes) 000257 1788581686.829961 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6e29eaa8 (stale) Mirror 6: 0x6e29eaa8 (stale) Mirror 7: 0x6e29eaa8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6e29eaa8 (stale) Mirror 6: 0x6e29eaa8 (stale) Mirror 7: 0x6e29eaa8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000258 1788581687.213724 fallocate 0x03680d thru 0x0395fe (0x2df2 bytes) 000260 1788581687.219670 read 0x0337d9 thru 0x0342bc (0xae4 bytes) 000261 1788581687.225583 read 0x03ac75 thru 0x03ffff (0x538b bytes) 000262 1788581687.254864 trunc from 0x040000 to 0x0104a7 (0x2fb58 bytes) 000263 1788581687.288854 trunc from 0x00cc92 to 0x00fc45 (0x2fb4 bytes) 000264 1788581687.292028 punch from 0x00df13 to 0x0104a7 (0x2595 bytes) 000265 1788581687.295819 write 0x00545d thru 0x009ea2 (0x4a46 bytes) 000266 1788581687.296714 fallocate 0x03d69c thru 0x03ffff (0x2964 bytes) 000267 1788581687.299786 punch from 0x004446 to 0x00f140 (0xacfb bytes) 000268 1788581687.325767 punch from 0x00baa8 to 0x0104a7 (0x4a00 bytes) 000269 1788581687.336538 punch from 0x00e60a to 0x0104a7 (0x1e9e bytes) 000270 1788581687.349730 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x104a8): Mirror 6: 0xd20625b7 (stale) Mirror 7: 0xd20625b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x104a8): Mirror 6: 0xd20625b7 (stale) Mirror 7: 0xd20625b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x104a8: skipped 000271 1788581687.641010 mapread 0x0074fd thru 0x0104a7 (0x8fab bytes) 000272 1788581687.658669 mapwrite 0x0106d3 thru 0x017ec9 (0x77f7 bytes) 000273 1788581687.714735 mapread 0x016f06 thru 0x017ec9 (0xfc4 bytes) 000274 1788581687.716839 trunc from 0x009f5a to 0x00b298 (0x133f bytes) 000275 1788581687.723847 trunc from 0x017eca to 0x0003fa (0x17acf bytes) 000276 1788581687.742097 trunc from 0x0003fb to 0x00b7d6 (0xb3dc bytes) 000277 1788581687.763777 trunc from 0x00b7d7 to 0x0289ce (0x1d1f8 bytes) 000278 1788581687.784882 trunc from 0x00a5ab to 0x00f157 (0x4bad bytes) 000279 1788581687.799657 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x289cf): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x289cf): Mirror 6: 0x9bbfa8c6 (stale) Mirror 7: 0x9bbfa8c6 (stale) CRC-32 checksum value for chunk [0, 0x289cf): Mirror 1: 0xc9574777 Mirror 8: 0xc9574777 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x289cf: skipped 000280 1788581688.442402 mapwrite 0x0380f9 thru 0x03ffff (0x7f07 bytes) 000281 1788581688.519798 mapread 0x01b27b thru 0x023f37 (0x8cbd bytes) 000283 1788581688.534363 write 0x035fd3 thru 0x03db50 (0x7b7e bytes) 000284 1788581688.535444 mapwrite 0x017e25 thru 0x01a166 (0x2342 bytes) 000285 1788581688.549957 trunc from 0x040000 to 0x00ccbc (0x33343 bytes) 000286 1788581688.566888 MIRROR_RESYNC 4 mirrors 000287 1788581689.180911 read 0x00c41e thru 0x00ccbc (0x89f bytes) 000288 1788581689.185923 write 0x0106f6 thru 0x01509a (0x49a5 bytes) 000289 1788581689.216841 mapwrite 0x00fecf thru 0x01909a (0x91cc bytes) 000290 1788581689.275021 trunc from 0x01909b to 0x039313 (0x20279 bytes) 000291 1788581689.301731 read 0x02a450 thru 0x02e1f6 (0x3da7 bytes) 000292 1788581689.322363 mapwrite 0x009825 thru 0x0127b4 (0x8f90 bytes) 000293 1788581689.360743 mapwrite 0x001f07 thru 0x00983b (0x7935 bytes) 000295 1788581689.384359 trunc from 0x039314 to 0x0374b0 (0x1e63 bytes) 000296 1788581689.410102 punch from 0x02954c to 0x036639 (0xd0ee bytes) 000297 1788581689.416291 write 0x0102c8 thru 0x016ad4 (0x680d bytes) 000298 1788581689.417577 read 0x013a94 thru 0x01e77b (0xace8 bytes) 000300 1788581689.421297 fallocate 0x012c67 thru 0x0189ae (0x5d48 bytes) 000301 1788581689.434780 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x374b1): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374b1): Mirror 6: 0xb969d374 (stale) Mirror 7: 0xb969d374 (stale) Mirror 8: 0xb969d374 (stale) CRC-32 checksum value for chunk [0, 0x374b1): Mirror 1: 0xe9b9e027 Mirror 9: 0xe9b9e027 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374b1: skipped 000302 1788581690.447890 fallocate 0x03043c thru 0x0373ba (0x6f7f bytes) 000304 1788581690.539332 mapread 0x001a99 thru 0x001f18 (0x480 bytes) 000305 1788581690.554078 trunc from 0x016eb8 to 0x025f41 (0xf08a bytes) 000306 1788581690.560131 fallocate 0x01f542 thru 0x0249b4 (0x5473 bytes) 000308 1788581690.576088 MIRROR_RESYNC 5 mirrors 000309 1788581691.542518 mapwrite 0x03a2ff thru 0x03cd23 (0x2a25 bytes) 000310 1788581691.611513 trunc from 0x034833 to 0x03522c (0x9fa bytes) 000311 1788581691.617346 write 0x02c6ae thru 0x037274 (0xabc7 bytes) 000312 1788581691.627197 read 0x01d8fa thru 0x01eb03 (0x120a bytes) 000313 1788581691.638277 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd24): Mirror 6: 0x964424b0 (stale) Mirror 8: 0x964424b0 (stale) Mirror 9: 0x964424b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd24): Mirror 6: 0x964424b0 (stale) Mirror 8: 0x964424b0 (stale) Mirror 9: 0x964424b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd24: skipped 000315 1788581692.084333 read 0x0263cd thru 0x026766 (0x39a bytes) 000316 1788581692.109879 write 0x01583a thru 0x0205ef (0xadb6 bytes) 000317 1788581692.142805 read 0x014b1d thru 0x019997 (0x4e7b bytes) 000318 1788581692.170079 write 0x0387fb thru 0x03ffff (0x7805 bytes) 000320 1788581692.173731 write 0x029a9d thru 0x02ae21 (0x1385 bytes) 000321 1788581692.175631 trunc from 0x010de2 to 0x0148b0 (0x3acf bytes) 000322 1788581692.184917 fallocate 0x0366b3 thru 0x03ffff (0x994d bytes) 000323 1788581692.193338 write 0x037224 thru 0x038e9a (0x1c77 bytes) 000324 1788581692.196062 trunc from 0x040000 to 0x03831f (0x7ce0 bytes) 000326 1788581692.217412 read 0x003c52 thru 0x004013 (0x3c2 bytes) 000327 1788581692.218369 read 0x0040a6 thru 0x012252 (0xe1ad bytes) 000328 1788581692.234788 mapwrite 0x039e02 thru 0x03ffff (0x61fe bytes) 000329 1788581692.309001 trunc from 0x015914 to 0x018f64 (0x3651 bytes) 000330 1788581692.315842 trunc from 0x040000 to 0x035f31 (0xa0ce bytes) 000331 1788581692.344342 read 0x03537f thru 0x035f31 (0xbb3 bytes) 000332 1788581692.345278 trunc from 0x035f32 to 0x00d3e2 (0x28b4f bytes) 000333 1788581692.370982 punch from 0x0015d6 to 0x00689f (0x52ca bytes) 000334 1788581692.378286 mapread 0x007fbc thru 0x00d3e2 (0x5427 bytes) 000335 1788581692.379247 write 0x0145a6 thru 0x0222e4 (0xdd3f bytes) 000337 1788581692.383217 mapwrite 0x022fcc thru 0x025930 (0x2965 bytes) 000338 1788581692.456080 trunc from 0x01bcb6 to 0x02198c (0x5cd7 bytes) 000339 1788581692.463239 fallocate 0x006b76 thru 0x00cdf5 (0x6280 bytes) 000340 1788581692.467840 write 0x02acfb thru 0x02ef56 (0x425c bytes) 000341 1788581692.468934 mapwrite 0x00aa6e thru 0x0106a2 (0x5c35 bytes) 000342 1788581692.492691 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ef57): Mirror 8: 0x487df48b (stale) Mirror 9: 0x487df48b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef57): Mirror 8: 0x487df48b (stale) Mirror 9: 0x487df48b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef57: skipped 000343 1788581692.831859 fallocate 0x0157ab thru 0x018e9f (0x36f5 bytes) 000344 1788581692.842107 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ef57): Mirror 8: 0x487df48b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef57): Mirror 8: 0x487df48b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef57: skipped 000345 1788581693.359711 write 0x018cef thru 0x01ea80 (0x5d92 bytes) 000346 1788581693.404192 mapwrite 0x0350cf thru 0x03ffff (0xaf31 bytes) 000347 1788581693.530598 mapread 0x01d4e4 thru 0x01da14 (0x531 bytes) 000348 1788581693.531484 mapread 0x012f6c thru 0x01d8d2 (0xa967 bytes) 000349 1788581693.580882 mapread 0x039e82 thru 0x03ffff (0x617e bytes) 000350 1788581693.581741 mapwrite 0x03337b thru 0x03c391 (0x9017 bytes) 000351 1788581693.623564 read 0x02f391 thru 0x032b63 (0x37d3 bytes) 000353 1788581693.633049 trunc from 0x040000 to 0x03fe89 (0x176 bytes) 000354 1788581693.657620 mapread 0x00f19a thru 0x01089d (0x1704 bytes) 000355 1788581693.663700 trunc from 0x01dd82 to 0x0249b2 (0x6c31 bytes) 000357 1788581693.674229 mapread 0x00657b thru 0x013f1d (0xd9a3 bytes) 000358 1788581693.691135 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000359 1788581693.958479 trunc from 0x03fe8a to 0x00408b (0x3bdfe bytes) 000360 1788581693.999001 fallocate 0x01656b thru 0x01dea2 (0x7938 bytes) 000361 1788581694.005379 write 0x033e12 thru 0x03b4b9 (0x76a8 bytes) 000362 1788581694.010799 write 0x007bba thru 0x016104 (0xe54b bytes) 000364 1788581694.025704 punch from 0x00012d to 0x004e00 (0x4cd4 bytes) 000365 1788581694.031778 read 0x02dfe8 thru 0x03a14c (0xc165 bytes) 000366 1788581694.044581 punch from 0x02299f to 0x031071 (0xe6d3 bytes) 000367 1788581694.049738 trunc from 0x03b4ba to 0x037f7e (0x353b bytes) 000369 1788581694.070411 write 0x035e88 thru 0x03dc1c (0x7d95 bytes) 000370 1788581694.071711 mapread 0x024a1e thru 0x02744e (0x2a31 bytes) 000371 1788581694.096319 punch from 0x03c594 to 0x03dc1c (0x1689 bytes) 000372 1788581694.112872 punch from 0x030601 to 0x032fc4 (0x29c4 bytes) 000373 1788581694.126019 MIRROR_EXTEND to 2 mirrors 000374 1788581695.141017 trunc from 0x02768c to 0x029fa7 (0x291c bytes) 000375 1788581695.212956 read 0x008c8f thru 0x0185a4 (0xf916 bytes) 000376 1788581695.223412 read 0x020412 thru 0x02f8eb (0xf4da bytes) 000377 1788581695.236329 trunc from 0x00c7db to 0x0132a8 (0x6ace bytes) 000378 1788581695.242316 read 0x02d6f6 thru 0x033bdb (0x64e6 bytes) 000379 1788581695.243008 trunc from 0x03dc1d to 0x00d91f (0x302fd bytes) 000380 1788581695.326524 trunc from 0x00d920 to 0x0261f8 (0x188d9 bytes) 000381 1788581695.349642 punch from 0x023715 to 0x0261f8 (0x2ae4 bytes) 000382 1788581695.357468 punch from 0x00b95a to 0x0109fe (0x50a5 bytes) 000383 1788581695.367353 write 0x0347fe thru 0x036393 (0x1b96 bytes) 000384 1788581695.369650 read 0x006600 thru 0x00fc12 (0x9613 bytes) 000385 1788581695.380746 punch from 0x013457 to 0x0211dc (0xdd86 bytes) 000386 1788581695.386243 read 0x01fb51 thru 0x028ccb (0x917b bytes) 000388 1788581695.396794 fallocate 0x013fc0 thru 0x018058 (0x4099 bytes) 000389 1788581695.402744 mapwrite 0x01b276 thru 0x029dd7 (0xeb62 bytes) 000390 1788581695.427490 trunc from 0x01fc16 to 0x02bfe6 (0xc3d1 bytes) 000391 1788581695.434141 mapread 0x02d5c3 thru 0x030980 (0x33be bytes) 000392 1788581695.435019 trunc from 0x036394 to 0x01a8f4 (0x1ba9f bytes) 000393 1788581695.455035 write 0x02b89e thru 0x034bd7 (0x933a bytes) 000394 1788581695.456547 punch from 0x00f9ec to 0x01c677 (0xcc8c bytes) 000395 1788581695.462526 trunc from 0x034bd8 to 0x010566 (0x24671 bytes) 000396 1788581695.490974 MIRROR_RESYNC 2 mirrors 000398 1788581696.249686 fallocate 0x00ad95 thru 0x0118fc (0x6b68 bytes) 000399 1788581696.312470 trunc from 0x0118fd to 0x020bb7 (0xf2bb bytes) 000400 1788581696.387760 MIRROR_RESYNC 2 mirrors 000401 1788581697.284512 trunc from 0x020bb8 to 0x0266b1 (0x5afa bytes) 000402 1788581697.395013 trunc from 0x01ba79 to 0x01bc38 (0x1c0 bytes) 000403 1788581697.403618 trunc from 0x01b2e5 to 0x0266b1 (0xb3cd bytes) 000404 1788581697.413638 mapread 0x02605c thru 0x0266b1 (0x656 bytes) 000405 1788581697.427760 write 0x012445 thru 0x0185b3 (0x616f bytes) 000406 1788581697.451990 mapread 0x007285 thru 0x00f580 (0x82fc bytes) 000407 1788581697.496203 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000408 1788581697.794202 fallocate 0x002841 thru 0x00b6f3 (0x8eb3 bytes) 000409 1788581697.798376 fallocate 0x03ed1b thru 0x03ffff (0x12e5 bytes) 000410 1788581697.809002 mapread 0x01e2aa thru 0x0266b1 (0x8408 bytes) 000411 1788581697.852718 write 0x0103b9 thru 0x0105bb (0x203 bytes) 000412 1788581697.877525 read 0x019e5b thru 0x01b03a (0x11e0 bytes) 000413 1788581697.878104 read 0x000b31 thru 0x009a6f (0x8f3f bytes) 000416 1788581697.887455 trunc from 0x021fcb to 0x0266b1 (0x46e7 bytes) 000417 1788581697.899207 read 0x01b743 thru 0x023e4f (0x870d bytes) 000418 1788581697.922357 mapread 0x0121c7 thru 0x0155d4 (0x340e bytes) 000421 1788581697.938180 MIRROR_EXTEND to 2 mirrors 000422 1788581698.598726 fallocate 0x037cff thru 0x03c09e (0x43a0 bytes) 000423 1788581698.638614 trunc from 0x0266b2 to 0x00f39a (0x17317 bytes) 000424 1788581698.668121 write 0x01dfc0 thru 0x02c08a (0xe0cb bytes) 000425 1788581698.671524 write 0x018c18 thru 0x02360a (0xa9f3 bytes) 000426 1788581698.677183 punch from 0x014fce to 0x018707 (0x373a bytes) 000427 1788581698.694155 punch from 0x02570d to 0x02c08a (0x697e bytes) 000428 1788581698.699412 read 0x0148e2 thru 0x016313 (0x1a32 bytes) 000429 1788581698.707090 trunc from 0x02137f to 0x02679a (0x541c bytes) 000430 1788581698.713751 punch from 0x027a0f to 0x02c08a (0x467c bytes) 000431 1788581698.719410 mapwrite 0x00fcbb thru 0x0118be (0x1c04 bytes) 000432 1788581698.755147 trunc from 0x021e87 to 0x0299d3 (0x7b4d bytes) 000433 1788581698.762357 trunc from 0x02321c to 0x027a02 (0x47e7 bytes) 000434 1788581698.772760 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000436 1788581698.908118 trunc from 0x02c08b to 0x03a64a (0xe5c0 bytes) 000437 1788581698.942953 mapread 0x00bf51 thru 0x00d0cb (0x117b bytes) 000438 1788581698.958681 trunc from 0x021d33 to 0x02c5bf (0xa88d bytes) 000439 1788581698.962954 trunc from 0x033816 to 0x03a64a (0x6e35 bytes) 000440 1788581698.967073 trunc from 0x03a64b to 0x039b9f (0xaab bytes) 000442 1788581698.983838 write 0x015f86 thru 0x0222cf (0xc34a bytes) 000443 1788581698.993584 punch from 0x013882 to 0x013d71 (0x4f0 bytes) 000445 1788581698.998413 fallocate 0x001da8 thru 0x0108ee (0xeb47 bytes) 000446 1788581699.003106 read 0x021df8 thru 0x0228fc (0xb05 bytes) 000447 1788581699.004020 fallocate 0x000421 thru 0x009e74 (0x9a54 bytes) 000448 1788581699.008128 trunc from 0x027412 to 0x033135 (0xbd24 bytes) 000449 1788581699.012017 punch from 0x02f5b2 to 0x039b9f (0xa5ee bytes) 000450 1788581699.016959 write 0x01e557 thru 0x02c2f3 (0xdd9d bytes) 000451 1788581699.023251 write 0x02439a thru 0x02e104 (0x9d6b bytes) 000452 1788581699.032942 MIRROR_EXTEND to 2 mirrors 000453 1788581699.913591 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000454 1788581700.154198 fallocate 0x035ddd thru 0x03ffff (0xa223 bytes) 000455 1788581700.178807 mapwrite 0x02c06a thru 0x033b09 (0x7aa0 bytes) 000456 1788581700.280866 mapread 0x00eee7 thru 0x018359 (0x9473 bytes) 000459 1788581700.355322 trunc from 0x021fca to 0x022d33 (0xd6a bytes) 000460 1788581700.361198 trunc from 0x039ba0 to 0x03beaa (0x230b bytes) 000461 1788581700.422357 trunc from 0x01bab9 to 0x02b973 (0xfebb bytes) 000462 1788581700.426363 trunc from 0x013a3e to 0x01a1c6 (0x6789 bytes) 000463 1788581700.437094 trunc from 0x022102 to 0x024bc5 (0x2ac4 bytes) 000464 1788581700.447892 mapwrite 0x03cb28 thru 0x03ffff (0x34d8 bytes) 000465 1788581700.514662 mapwrite 0x03f52d thru 0x03ffff (0xad3 bytes) 000466 1788581700.528080 read 0x009a6d thru 0x00d64c (0x3be0 bytes) 000467 1788581700.528959 read 0x01c9c9 thru 0x02c3bf (0xf9f7 bytes) 000468 1788581700.540268 read 0x021c23 thru 0x0255ef (0x39cd bytes) 000469 1788581700.541024 trunc from 0x040000 to 0x01c0d4 (0x23f2b bytes) 000470 1788581700.553723 trunc from 0x01c0d5 to 0x026924 (0xa850 bytes) 000471 1788581700.579603 write 0x01ee75 thru 0x01f46f (0x5fb bytes) 000473 1788581700.602313 fallocate 0x0116b3 thru 0x012571 (0xebf bytes) 000474 1788581700.623288 punch from 0x025145 to 0x026924 (0x17e0 bytes) 000475 1788581700.629742 mapwrite 0x011ab1 thru 0x0213ba (0xf90a bytes) 000476 1788581700.680699 fallocate 0x03844b thru 0x03ffff (0x7bb5 bytes) 000479 1788581700.706992 punch from 0x01e736 to 0x026753 (0x801e bytes) 000480 1788581700.721026 fallocate 0x019cce thru 0x0265fa (0xc92d bytes) 000482 1788581700.727780 write 0x03e7ff thru 0x03ffff (0x1801 bytes) 000483 1788581700.730612 read 0x0163dc thru 0x0187a8 (0x23cd bytes) 000484 1788581700.731309 mapread 0x00e681 thru 0x014dd3 (0x6753 bytes) 000485 1788581700.735665 write 0x0398e8 thru 0x03ffff (0x6718 bytes) 000487 1788581700.793281 read 0x011fe3 thru 0x01b1a8 (0x91c6 bytes) 000489 1788581700.795038 write 0x029a07 thru 0x0356ef (0xbce9 bytes) 000490 1788581700.799253 trunc from 0x00d10a to 0x014732 (0x7629 bytes) 000491 1788581700.804648 punch from 0x030e28 to 0x039221 (0x83fa bytes) 000492 1788581700.824574 MIRROR_EXTEND to 2 mirrors 000493 1788581702.354155 read 0x01ee7b thru 0x02c7a6 (0xd92c bytes) 000494 1788581702.372468 MIRROR_EXTEND to 3 mirrors 000495 1788581703.328042 read 0x038803 thru 0x03ffff (0x77fd bytes) 000496 1788581703.344794 read 0x033b0f thru 0x03a494 (0x6986 bytes) 000498 1788581703.372926 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000499 1788581703.712342 fallocate 0x0362e2 thru 0x039c37 (0x3956 bytes) 000500 1788581703.771504 trunc from 0x040000 to 0x03086a (0xf795 bytes) 000501 1788581703.802871 trunc from 0x018857 to 0x018b18 (0x2c2 bytes) 000502 1788581703.812052 trunc from 0x03086b to 0x02ac22 (0x5c48 bytes) 000503 1788581703.846214 trunc from 0x02ac23 to 0x033aba (0x8e98 bytes) 000504 1788581703.881119 read 0x02517f thru 0x0301b1 (0xb033 bytes) 000505 1788581703.903277 read 0x02a85b thru 0x02d0d2 (0x2878 bytes) 000507 1788581703.907756 read 0x032c51 thru 0x033aba (0xe6a bytes) 000508 1788581703.942613 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000510 1788581704.162364 trunc from 0x033abb to 0x016087 (0x1da33 bytes) 000511 1788581704.188032 MIRROR_EXTEND to 2 mirrors 000512 1788581705.221375 trunc from 0x00dd73 to 0x0135f7 (0x5885 bytes) 000513 1788581705.267761 MIRROR_RESYNC 2 mirrors 000514 1788581706.240786 write 0x0093a1 thru 0x00f07a (0x5cda bytes) 000515 1788581706.295514 trunc from 0x00ec32 to 0x016087 (0x7456 bytes) 000516 1788581706.319653 write 0x0021aa thru 0x004905 (0x275c bytes) 000517 1788581706.330656 fallocate 0x018add thru 0x01cc59 (0x417d bytes) 000518 1788581706.346120 trunc from 0x01cc5a to 0x00b68d (0x115cc bytes) 000520 1788581706.379323 punch from 0x0057c6 to 0x006874 (0x10af bytes) 000521 1788581706.385735 punch from 0x003981 to 0x009f27 (0x65a7 bytes) 000522 1788581706.402412 write 0x00bb63 thru 0x00eb6d (0x300b bytes) 000523 1788581706.404018 fallocate 0x02f024 thru 0x03afe9 (0xbfc6 bytes) 000524 1788581706.410179 mapwrite 0x03cccd thru 0x03ffff (0x3333 bytes) 000525 1788581706.461940 punch from 0x01138d to 0x0129ed (0x1661 bytes) 000526 1788581706.467764 write 0x0172e4 thru 0x02199a (0xa6b7 bytes) 000527 1788581706.478397 mapwrite 0x01aa15 thru 0x02473e (0x9d2a bytes) 000528 1788581706.505196 trunc from 0x01bb2f to 0x028262 (0xc734 bytes) 000529 1788581706.515823 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4374735c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1230983d Mirror 3: 0x1230983d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000530 1788581708.313001 read 0x031abc thru 0x0375f1 (0x5b36 bytes) 000531 1788581708.345369 mapwrite 0x00c4bb thru 0x018291 (0xbdd7 bytes) 000532 1788581708.587455 fallocate 0x0131f8 thru 0x01b66d (0x8476 bytes) 000533 1788581708.595271 trunc from 0x00d9b6 to 0x018d9a (0xb3e5 bytes) 000534 1788581708.608821 mapwrite 0x020db4 thru 0x029509 (0x8756 bytes) 000535 1788581708.713069 fallocate 0x032916 thru 0x03ffff (0xd6ea bytes) 000536 1788581708.732455 punch from 0x02364d to 0x0307fd (0xd1b1 bytes) 000537 1788581708.741800 punch from 0x01dc30 to 0x01f35b (0x172c bytes) 000538 1788581708.751388 read 0x0177e2 thru 0x0252fe (0xdb1d bytes) 000539 1788581708.786733 fallocate 0x02186b thru 0x02dcc3 (0xc459 bytes) 000540 1788581708.799814 write 0x004179 thru 0x0050e4 (0xf6c bytes) 000541 1788581708.819574 write 0x039385 thru 0x03ffff (0x6c7b bytes) 000543 1788581708.823763 punch from 0x00d593 to 0x019df3 (0xc861 bytes) 000544 1788581708.830096 trunc from 0x02af23 to 0x0394e8 (0xe5c6 bytes) 000545 1788581708.871880 punch from 0x02a466 to 0x031e18 (0x79b3 bytes) 000546 1788581708.889824 punch from 0x0051f3 to 0x014bfc (0xfa0a bytes) 000547 1788581708.910007 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1230983d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1230983d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000548 1788581709.249217 trunc from 0x040000 to 0x02ccb4 (0x1334b bytes) 000549 1788581709.271449 punch from 0x015b49 to 0x022065 (0xc51d bytes) 000550 1788581709.277114 trunc from 0x02ccb5 to 0x02184f (0xb465 bytes) 000551 1788581709.297183 fallocate 0x0219ce thru 0x028e6f (0x74a2 bytes) 000552 1788581709.309501 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000553 1788581709.436605 read 0x005647 thru 0x012e03 (0xd7bd bytes) 000554 1788581709.446343 mapwrite 0x030ccc thru 0x03ffff (0xf334 bytes) 000555 1788581709.519841 mapwrite 0x024745 thru 0x031bff (0xd4bb bytes) 000556 1788581709.547910 trunc from 0x040000 to 0x006ad1 (0x3952e bytes) 000557 1788581709.562988 fallocate 0x01adc9 thru 0x024305 (0x953d bytes) 000558 1788581709.567823 trunc from 0x006ad2 to 0x0143a8 (0xd8d7 bytes) 000559 1788581709.578699 trunc from 0x0143a9 to 0x0336ff (0x1f357 bytes) 000560 1788581709.591581 mapread 0x01135a thru 0x01471a (0x33c1 bytes) 000561 1788581709.602155 trunc from 0x033700 to 0x014854 (0x1eeab bytes) 000562 1788581709.617744 fallocate 0x00c6e9 thru 0x00ea33 (0x234b bytes) 000563 1788581709.621834 fallocate 0x02e9e3 thru 0x0344ad (0x5acb bytes) 000565 1788581709.627764 trunc from 0x0090eb to 0x00dd99 (0x4caf bytes) 000566 1788581709.631401 trunc from 0x014855 to 0x018e10 (0x45bc bytes) 000567 1788581709.645064 punch from 0x005856 to 0x00e46a (0x8c15 bytes) 000570 1788581709.651718 mapwrite 0x0051d7 thru 0x00b6cb (0x64f5 bytes) 000571 1788581709.673804 mapread 0x004afa thru 0x00f8a0 (0xada7 bytes) 000572 1788581709.674761 read 0x014255 thru 0x017281 (0x302d bytes) 000573 1788581709.681171 trunc from 0x018e11 to 0x00e7ef (0xa621 bytes) 000574 1788581709.693546 mapwrite 0x024216 thru 0x02d6c0 (0x94ab bytes) 000576 1788581709.736484 trunc from 0x011da4 to 0x0195f4 (0x7851 bytes) 000577 1788581709.741498 mapread 0x01d968 thru 0x0250e5 (0x777e bytes) 000578 1788581709.742570 punch from 0x00a138 to 0x014a16 (0xa8df bytes) 000579 1788581709.748144 punch from 0x02bd8d to 0x02d6c0 (0x1934 bytes) 000580 1788581709.756032 read 0x00d5ba thru 0x00ddc1 (0x808 bytes) 000582 1788581709.771778 write 0x01c91e thru 0x020309 (0x39ec bytes) 000584 1788581709.774166 punch from 0x008923 to 0x015174 (0xc852 bytes) 000585 1788581709.780921 write 0x00e03d thru 0x00e9d0 (0x994 bytes) 000586 1788581709.786082 trunc from 0x01aad7 to 0x021403 (0x692d bytes) 000587 1788581709.799389 mapwrite 0x01d33a thru 0x01e43a (0x1101 bytes) 000588 1788581709.823373 read 0x015685 thru 0x01a118 (0x4a94 bytes) 000589 1788581709.834484 mapwrite 0x02f71a thru 0x037de6 (0x86cd bytes) 000590 1788581709.877119 write 0x0080e4 thru 0x010648 (0x8565 bytes) 000591 1788581709.878975 write 0x0153f0 thru 0x01b754 (0x6365 bytes) 000592 1788581709.882036 punch from 0x011c7a to 0x016206 (0x458d bytes) 000593 1788581709.904131 mapread 0x0282ef thru 0x029812 (0x1524 bytes) 000594 1788581709.905494 mapwrite 0x02281a thru 0x023f8d (0x1774 bytes) 000596 1788581709.922404 punch from 0x0325cb to 0x037de6 (0x581c bytes) 000597 1788581709.927103 write 0x002c73 thru 0x006ad1 (0x3e5f bytes) 000598 1788581709.928930 mapread 0x005d1f thru 0x00fa5c (0x9d3e bytes) 000599 1788581709.929913 mapwrite 0x01a95e thru 0x028995 (0xe038 bytes) 000600 1788581709.949009 write 0x005117 thru 0x005f7f (0xe69 bytes) 000601 1788581709.949976 trunc from 0x037de7 to 0x03f5e6 (0x7800 bytes) 000602 1788581709.965057 mapread 0x031717 thru 0x03710b (0x59f5 bytes) 000603 1788581709.992167 write 0x02d9d7 thru 0x03bf11 (0xe53b bytes) 000604 1788581709.993595 write 0x033655 thru 0x03ffff (0xc9ab bytes) 000606 1788581709.996110 write 0x001c76 thru 0x00f618 (0xd9a3 bytes) 000607 1788581709.998549 fallocate 0x02ea82 thru 0x036c6a (0x81e9 bytes) 000608 1788581710.003048 mapwrite 0x01862b thru 0x01dc6c (0x5642 bytes) 000609 1788581710.020546 trunc from 0x01095c to 0x01f4fe (0xeba3 bytes) 000611 1788581710.026996 mapread 0x0369de thru 0x03ffff (0x9622 bytes) 000612 1788581710.028508 trunc from 0x040000 to 0x017213 (0x28dec bytes) 000613 1788581710.043998 mapwrite 0x012bd2 thru 0x02153b (0xe96a bytes) 000614 1788581710.177278 mapwrite 0x00eda1 thru 0x0157fd (0x6a5d bytes) 000615 1788581710.252131 mapwrite 0x0314a9 thru 0x03e676 (0xd1ce bytes) 000616 1788581710.396242 fallocate 0x03c8ac thru 0x03ffff (0x3754 bytes) 000617 1788581710.406869 mapwrite 0x03ca2b thru 0x03ffff (0x35d5 bytes) 000618 1788581710.469537 fallocate 0x00ca5e thru 0x016ab2 (0xa055 bytes) 000619 1788581710.483111 punch from 0x02a691 to 0x0351d7 (0xab47 bytes) 000620 1788581710.498599 MIRROR_EXTEND to 2 mirrors 000621 1788581711.391630 punch from 0x035362 to 0x0367ec (0x148b bytes) 000622 1788581711.446439 read 0x012c5e thru 0x021b60 (0xef03 bytes) 000623 1788581711.458707 write 0x026033 thru 0x0291d1 (0x319f bytes) 000626 1788581711.472186 write 0x03c7e0 thru 0x03ffff (0x3820 bytes) 000627 1788581711.475756 mapread 0x022ed6 thru 0x02913f (0x626a bytes) 000628 1788581711.489989 punch from 0x00fae3 to 0x01802b (0x8549 bytes) 000629 1788581711.493630 trunc from 0x02f3de to 0x03141c (0x203f bytes) 000630 1788581711.497967 fallocate 0x01a611 thru 0x0251cb (0xabbb bytes) 000631 1788581711.500953 mapwrite 0x00d8ef thru 0x01cb85 (0xf297 bytes) 000632 1788581711.534913 trunc from 0x040000 to 0x00cb24 (0x334db bytes) 000633 1788581711.551933 punch from 0x000bfd to 0x00afcc (0xa3d0 bytes) 000634 1788581711.557110 trunc from 0x00cb25 to 0x00eff9 (0x24d5 bytes) 000635 1788581711.574051 trunc from 0x00effa to 0x01b3fa (0xc401 bytes) 000636 1788581711.594907 write 0x01fb89 thru 0x02f6dc (0xfb54 bytes) 000637 1788581711.596738 read 0x0187a7 thru 0x0236a7 (0xaf01 bytes) 000638 1788581711.613539 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f6dd): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f6dd): Mirror 2: 0xa499a4c6 (stale) CRC-32 checksum value for chunk [0, 0x2f6dd): Mirror 1: 0xbca404f Mirror 3: 0xbca404f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f6dd: skipped 000639 1788581712.350241 fallocate 0x018252 thru 0x01e6c9 (0x6478 bytes) 000640 1788581712.377630 read 0x024644 thru 0x02f6dc (0xb099 bytes) 000641 1788581712.382500 punch from 0x02f2ed to 0x02f6dc (0x3f0 bytes) 000642 1788581712.385842 write 0x013d6d thru 0x020963 (0xcbf7 bytes) 000644 1788581712.394704 read 0x00e658 thru 0x01c12a (0xdad3 bytes) 000645 1788581712.400357 read 0x023f0e thru 0x02658f (0x2682 bytes) 000646 1788581712.401297 mapread 0x02ad64 thru 0x02c5b4 (0x1851 bytes) 000647 1788581712.402750 read 0x0114d5 thru 0x01c3cc (0xaef8 bytes) 000648 1788581712.403527 read 0x02332e thru 0x02c846 (0x9519 bytes) 000650 1788581712.404886 mapwrite 0x036d1c thru 0x03ffff (0x92e4 bytes) 000651 1788581712.495271 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa2dba4f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa2dba4f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000652 1788581712.742240 mapwrite 0x0242bb thru 0x033c2b (0xf971 bytes) 000654 1788581712.788358 mapread 0x008e2e thru 0x015e56 (0xd029 bytes) 000655 1788581712.818778 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000656 1788581713.034839 trunc from 0x00129c to 0x008c69 (0x79ce bytes) 000657 1788581713.040011 trunc from 0x040000 to 0x0053c9 (0x3ac36 bytes) 000659 1788581713.068058 write 0x01d9e4 thru 0x0293aa (0xb9c7 bytes) 000660 1788581713.070925 fallocate 0x006d57 thru 0x010ec5 (0xa16f bytes) 000661 1788581713.078003 punch from 0x00f11a to 0x010e80 (0x1d67 bytes) 000662 1788581713.081555 trunc from 0x0293ab to 0x0160fa (0x132b0 bytes) 000665 1788581713.111096 trunc from 0x00db31 to 0x01576e (0x7c3e bytes) 000666 1788581713.118932 mapread 0x004d1f thru 0x010ef3 (0xc1d5 bytes) 000667 1788581713.138877 read 0x00d682 thru 0x0160fa (0x8a79 bytes) 000669 1788581713.147995 read 0x00cf02 thru 0x0128c2 (0x59c1 bytes) 000670 1788581713.149278 mapwrite 0x027583 thru 0x02d0cc (0x5b4a bytes) 000673 1788581713.230488 write 0x00d476 thru 0x01a0a3 (0xcc2e bytes) 000674 1788581713.233784 trunc from 0x02d0cd to 0x00639a (0x26d32 bytes) 000675 1788581713.282946 read 0x005f7f thru 0x00639a (0x41c bytes) 000676 1788581713.285073 trunc from 0x0045bb to 0x00639a (0x1de0 bytes) 000677 1788581713.291210 mapwrite 0x004266 thru 0x010516 (0xc2b1 bytes) 000678 1788581713.349022 write 0x0103fe thru 0x011f7a (0x1b7d bytes) 000679 1788581713.351386 trunc from 0x011f7b to 0x0064d4 (0xbaa6 bytes) 000681 1788581713.369297 mapread 0x002db0 thru 0x0034c6 (0x717 bytes) 000682 1788581713.370294 trunc from 0x0064d5 to 0x01bf47 (0x15a73 bytes) 000683 1788581713.386099 punch from 0x01498c to 0x01bf47 (0x75bc bytes) 000684 1788581713.389114 mapread 0x01817e thru 0x01bf47 (0x3dca bytes) 000685 1788581713.394899 mapread 0x004b54 thru 0x004c6a (0x117 bytes) 000686 1788581713.395394 fallocate 0x013cca thru 0x01847f (0x47b6 bytes) 000687 1788581713.400031 trunc from 0x009fca to 0x00e6bf (0x46f6 bytes) 000688 1788581713.404588 trunc from 0x00feb1 to 0x015233 (0x5383 bytes) 000689 1788581713.409408 mapread 0x00b66c thru 0x00ffcd (0x4962 bytes) 000690 1788581713.433079 mapwrite 0x03dfba thru 0x03ffff (0x2046 bytes) 000691 1788581713.468754 trunc from 0x040000 to 0x031583 (0xea7c bytes) 000692 1788581713.479737 read 0x00289a thru 0x00cdac (0xa513 bytes) 000693 1788581713.487395 trunc from 0x0096f8 to 0x01409a (0xa9a3 bytes) 000695 1788581713.492708 write 0x007a76 thru 0x01187d (0x9e08 bytes) 000696 1788581713.497973 trunc from 0x01a7b7 to 0x026dda (0xc624 bytes) 000697 1788581713.502598 mapread 0x01f174 thru 0x026397 (0x7224 bytes) 000698 1788581713.553972 trunc from 0x031584 to 0x018ccf (0x188b4 bytes) 000699 1788581713.575071 trunc from 0x018cd0 to 0x02bc9c (0x12fcd bytes) 000700 1788581713.595043 read 0x026563 thru 0x02bc9c (0x573a bytes) 000701 1788581713.608914 mapread 0x026297 thru 0x02bc9c (0x5a06 bytes) 000702 1788581713.609943 write 0x0214df thru 0x02c811 (0xb333 bytes) 000703 1788581713.612749 punch from 0x013207 to 0x016876 (0x3670 bytes) 000704 1788581713.617090 mapread 0x004350 thru 0x007aec (0x379d bytes) 000706 1788581713.619144 trunc from 0x0206db to 0x022754 (0x207a bytes) 000707 1788581713.665362 mapwrite 0x027487 thru 0x03602c (0xeba6 bytes) 000710 1788581713.704545 trunc from 0x017ba9 to 0x01a94c (0x2da4 bytes) 000711 1788581713.708995 read 0x02abea thru 0x03325e (0x8675 bytes) 000712 1788581713.709696 mapwrite 0x03e1ec thru 0x03ffff (0x1e14 bytes) 000713 1788581713.761278 punch from 0x00c718 to 0x00e28b (0x1b74 bytes) 000715 1788581713.770879 trunc from 0x01d790 to 0x029e26 (0xc697 bytes) 000716 1788581713.783820 MIRROR_EXTEND to 2 mirrors 000717 1788581714.972039 mapwrite 0x03e1ec thru 0x03ffff (0x1e14 bytes) 000718 1788581715.054351 trunc from 0x040000 to 0x011f89 (0x2e076 bytes) 000719 1788581715.086198 read 0x00a4ab thru 0x011f89 (0x7adf bytes) 000720 1788581715.096182 write 0x01d0ac thru 0x028ca8 (0xbbfd bytes) 000721 1788581715.102660 MIRROR_RESYNC 2 mirrors 000722 1788581716.124392 trunc from 0x028ca9 to 0x039b82 (0x10eda bytes) 000723 1788581716.242901 write 0x02da55 thru 0x030b20 (0x30cc bytes) 000724 1788581716.260323 punch from 0x02931e to 0x034a21 (0xb704 bytes) 000725 1788581716.290489 mapread 0x012bcf thru 0x02028b (0xd6bd bytes) 000726 1788581716.353370 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000728 1788581716.545018 write 0x006173 thru 0x014042 (0xded0 bytes) 000729 1788581716.561577 trunc from 0x039b83 to 0x0142aa (0x258d8 bytes) 000730 1788581716.583169 read 0x0063ff thru 0x0142aa (0xdeac bytes) 000731 1788581716.583889 mapwrite 0x00abe3 thru 0x011534 (0x6952 bytes) 000732 1788581716.613146 trunc from 0x0142ab to 0x0237fc (0xf552 bytes) 000733 1788581716.633008 read 0x012389 thru 0x020c13 (0xe88b bytes) 000734 1788581716.641677 read 0x0165e3 thru 0x019acd (0x34eb bytes) 000735 1788581716.642210 mapwrite 0x00aeed thru 0x01a66e (0xf782 bytes) 000736 1788581716.680900 read 0x00029c thru 0x00ee90 (0xebf5 bytes) 000737 1788581716.681906 fallocate 0x01e221 thru 0x02b2da (0xd0ba bytes) 000739 1788581716.687112 write 0x01ba86 thru 0x01fcf6 (0x4271 bytes) 000740 1788581716.689719 mapwrite 0x01b920 thru 0x021257 (0x5938 bytes) 000741 1788581716.710565 punch from 0x008eb9 to 0x00a468 (0x15b0 bytes) 000742 1788581716.716644 trunc from 0x02b2db to 0x01835d (0x12f7d bytes) 000743 1788581716.736261 punch from 0x010a93 to 0x01835d (0x78cb bytes) 000744 1788581716.741921 write 0x01540d thru 0x01dfda (0x8bce bytes) 000745 1788581716.751978 write 0x005c6d thru 0x00d357 (0x76eb bytes) 000746 1788581716.753308 mapread 0x017e30 thru 0x018539 (0x70a bytes) 000747 1788581716.754819 mapwrite 0x01d4b0 thru 0x02cad1 (0xf622 bytes) 000748 1788581716.800053 punch from 0x011d3e to 0x01ddcb (0xc08e bytes) 000749 1788581716.806313 fallocate 0x00ca20 thru 0x0144c5 (0x7aa6 bytes) 000750 1788581716.817847 MIRROR_EXTEND to 2 mirrors 000751 1788581717.705879 fallocate 0x02d9e7 thru 0x02e90c (0xf26 bytes) 000752 1788581717.760152 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) 000754 1788581717.923382 read 0x01bee1 thru 0x01fae2 (0x3c02 bytes) 000755 1788581717.934694 read 0x02b841 thru 0x02cad1 (0x1291 bytes) 000756 1788581717.961031 fallocate 0x014d6f thru 0x017f9d (0x322f bytes) 000759 1788581717.967611 mapread 0x0219af thru 0x02cad1 (0xb123 bytes) 000760 1788581717.969265 read 0x02c619 thru 0x02cad1 (0x4b9 bytes) 000763 1788581717.971469 read 0x000ab7 thru 0x00a045 (0x958f bytes) 000765 1788581717.974282 mapwrite 0x03f4c1 thru 0x03ffff (0xb3f bytes) 000766 1788581718.015880 trunc from 0x00ae3c to 0x00e79e (0x3963 bytes) 000767 1788581718.022939 trunc from 0x040000 to 0x017666 (0x28999 bytes) 000768 1788581718.041834 mapread 0x003c2f thru 0x0055fd (0x19cf bytes) 000769 1788581718.043066 fallocate 0x0063a6 thru 0x01243b (0xc096 bytes) 000770 1788581718.048651 fallocate 0x00e91b thru 0x01e4dd (0xfbc3 bytes) 000771 1788581718.055185 trunc from 0x01e4de to 0x0158a1 (0x8c3c bytes) 000773 1788581718.069929 read 0x005fac thru 0x00b61a (0x566f bytes) 000774 1788581718.077682 trunc from 0x0158a2 to 0x01c4a5 (0x6c04 bytes) 000775 1788581718.091687 write 0x0122d2 thru 0x01ee02 (0xcb31 bytes) 000776 1788581718.094662 read 0x0186b6 thru 0x01e336 (0x5c81 bytes) 000777 1788581718.095920 mapwrite 0x02fe66 thru 0x03eee3 (0xf07e bytes) 000778 1788581718.210484 read 0x02e109 thru 0x03b51c (0xd414 bytes) 000780 1788581718.215792 write 0x016341 thru 0x025b60 (0xf820 bytes) 000781 1788581718.220879 mapread 0x03e9f3 thru 0x03ee7a (0x488 bytes) 000782 1788581718.231011 write 0x01500c thru 0x024f97 (0xff8c bytes) 000783 1788581718.232686 mapwrite 0x00891a thru 0x012477 (0x9b5e bytes) 000784 1788581718.324438 fallocate 0x0375aa thru 0x03dc09 (0x6660 bytes) 000785 1788581718.349372 MIRROR_EXTEND to 2 mirrors 000786 1788581719.459618 write 0x03c25b thru 0x03ffff (0x3da5 bytes) 000787 1788581719.557560 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbad53eb2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd6e2e9d Mirror 3: 0xbd6e2e9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000789 1788581720.596017 trunc from 0x040000 to 0x0099cf (0x36630 bytes) 000791 1788581720.654840 fallocate 0x016a71 thru 0x01ecdc (0x826c bytes) 000792 1788581720.659756 trunc from 0x007ef5 to 0x0099cf (0x1adb bytes) 000793 1788581720.665707 mapread 0x0056cf thru 0x0099cf (0x4301 bytes) 000794 1788581720.688629 read 0x001b90 thru 0x008fae (0x741f bytes) 000795 1788581720.689602 mapread 0x0077df thru 0x0099cf (0x21f1 bytes) 000796 1788581720.706304 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x99d0): Mirror 2: 0x22b2be10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x99d0): Mirror 2: 0x22b2be10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x99d0: skipped 000797 1788581720.984017 mapread 0x004d4c thru 0x0099cf (0x4c84 bytes) 000798 1788581721.011021 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x99d0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x99d0): Mirror 2: 0x22b2be10 (stale) CRC-32 checksum value for chunk [0, 0x99d0): Mirror 1: 0x7d7a9c6a Mirror 3: 0x7d7a9c6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x99d0: skipped 000799 1788581722.161259 trunc from 0x0099d0 to 0x007b71 (0x1e5e bytes) 000800 1788581722.221963 trunc from 0x007b72 to 0x02b755 (0x23be4 bytes) 000802 1788581722.238057 read 0x013932 thru 0x01fb41 (0xc210 bytes) 000803 1788581722.248951 fallocate 0x01db13 thru 0x025baf (0x809d bytes) 000804 1788581722.253209 trunc from 0x02b756 to 0x01c9df (0xed76 bytes) 000805 1788581722.263853 read 0x00f57e thru 0x015cc7 (0x674a bytes) 000807 1788581722.271567 trunc from 0x00f72d to 0x017652 (0x7f26 bytes) 000809 1788581722.276678 mapwrite 0x03070d thru 0x0327ea (0x20de bytes) 000810 1788581722.313568 MIRROR_RESYNC 3 mirrors 000811 1788581723.045741 mapwrite 0x01f6f6 thru 0x02a619 (0xaf24 bytes) 000812 1788581723.146713 trunc from 0x0327eb to 0x01105c (0x2178e bytes) 000813 1788581723.191143 trunc from 0x01105d to 0x008c63 (0x83f9 bytes) 000814 1788581723.210079 mapread 0x004df9 thru 0x008c63 (0x3e6b bytes) 000815 1788581723.220401 write 0x03dc22 thru 0x03ffff (0x23de bytes) 000816 1788581723.221991 trunc from 0x040000 to 0x02dbc8 (0x12437 bytes) 000817 1788581723.241235 MIRROR_RESYNC 3 mirrors 000818 1788581723.841480 fallocate 0x006309 thru 0x00a4a6 (0x419e bytes) 000819 1788581723.868497 trunc from 0x02dbc9 to 0x00bb3b (0x2208d bytes) 000820 1788581723.894292 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xbb3c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbb3c): Mirror 2: 0x2dfc1ae2 (stale) Mirror 3: 0x2dfc1ae2 (stale) CRC-32 checksum value for chunk [0, 0xbb3c): Mirror 1: 0x2dfc1ae2 Mirror 4: 0x2dfc1ae2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbb3c: skipped 000821 1788581724.733641 mapwrite 0x03ee6a thru 0x03ffff (0x1196 bytes) 000822 1788581724.809199 trunc from 0x03c50f to 0x03fd54 (0x3846 bytes) 000823 1788581724.814903 trunc from 0x006caf to 0x00d58c (0x68de bytes) 000824 1788581724.821189 write 0x02c3ca thru 0x037ef8 (0xbb2f bytes) 000825 1788581724.831193 trunc from 0x038089 to 0x03da84 (0x59fc bytes) 000826 1788581724.836007 fallocate 0x033a6e thru 0x034d3a (0x12cd bytes) 000827 1788581724.841576 trunc from 0x040000 to 0x02a236 (0x15dc9 bytes) 000828 1788581724.861568 punch from 0x007d83 to 0x008281 (0x4ff bytes) 000829 1788581724.866403 mapwrite 0x018aa6 thru 0x01959a (0xaf5 bytes) 000830 1788581724.889986 read 0x013fc7 thru 0x0147ba (0x7f4 bytes) 000831 1788581724.890711 mapwrite 0x004ae6 thru 0x00feff (0xb41a bytes) 000832 1788581724.919268 mapwrite 0x032dee thru 0x03d299 (0xa4ac bytes) 000833 1788581724.965293 mapread 0x01f21a thru 0x023f02 (0x4ce9 bytes) 000834 1788581724.977807 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d29a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d29a): Mirror 2: 0x411eb79b (stale) Mirror 3: 0x411eb79b (stale) Mirror 4: 0x411eb79b (stale) CRC-32 checksum value for chunk [0, 0x3d29a): Mirror 1: 0x79adf801 Mirror 5: 0x79adf801 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d29a: skipped 000835 1788581725.797447 fallocate 0x001ec9 thru 0x003631 (0x1769 bytes) 000836 1788581725.843820 fallocate 0x01ab1e thru 0x023da7 (0x928a bytes) 000837 1788581725.849727 punch from 0x009741 to 0x01658f (0xce4f bytes) 000838 1788581725.856083 mapread 0x02cdeb thru 0x033758 (0x696e bytes) 000839 1788581725.883410 fallocate 0x001fda thru 0x00c932 (0xa959 bytes) 000840 1788581725.891870 write 0x008d98 thru 0x016c0d (0xde76 bytes) 000841 1788581725.911798 trunc from 0x01399a to 0x0221c9 (0xe830 bytes) 000842 1788581725.932595 trunc from 0x03d29a to 0x03f023 (0x1d8a bytes) 000843 1788581725.951744 mapwrite 0x015263 thru 0x01f93c (0xa6da bytes) 000844 1788581725.987111 read 0x000eb3 thru 0x0034d0 (0x261e bytes) 000846 1788581725.993505 fallocate 0x023fa6 thru 0x02ccb6 (0x8d11 bytes) 000847 1788581725.998814 write 0x001bf2 thru 0x00ae5e (0x926d bytes) 000848 1788581726.001010 read 0x038a9d thru 0x03f023 (0x6587 bytes) 000850 1788581726.008039 punch from 0x023023 to 0x0308d6 (0xd8b4 bytes) 000851 1788581726.012304 fallocate 0x02eef5 thru 0x03094c (0x1a58 bytes) 000852 1788581726.016638 mapread 0x031d17 thru 0x03d8ad (0xbb97 bytes) 000853 1788581726.018216 write 0x0055ec thru 0x00de36 (0x884b bytes) 000855 1788581726.021007 write 0x00a981 thru 0x00f4b7 (0x4b37 bytes) 000856 1788581726.022563 trunc from 0x03064b to 0x03d565 (0xcf1b bytes) 000857 1788581726.026718 read 0x03d287 thru 0x03f023 (0x1d9d bytes) 000858 1788581726.045728 trunc from 0x024967 to 0x032ce9 (0xe383 bytes) 000859 1788581726.050686 trunc from 0x03f024 to 0x033c16 (0xb40d bytes) 000860 1788581726.062981 trunc from 0x0098df to 0x00cda5 (0x34c7 bytes) 000861 1788581726.076376 mapwrite 0x02203b thru 0x02c5cc (0xa592 bytes) 000862 1788581726.126653 punch from 0x01ed2a to 0x02ce9d (0xe174 bytes) 000863 1788581726.132017 read 0x0253ea thru 0x02a1ab (0x4dc2 bytes) 000865 1788581726.140062 punch from 0x027a58 to 0x033c16 (0xc1bf bytes) 000866 1788581726.144743 mapread 0x011826 thru 0x020348 (0xeb23 bytes) 000867 1788581726.145859 read 0x031a43 thru 0x033c16 (0x21d4 bytes) 000868 1788581726.154598 read 0x032beb thru 0x033c16 (0x102c bytes) 000869 1788581726.155293 mapread 0x01af93 thru 0x02940d (0xe47b bytes) 000870 1788581726.156693 mapread 0x0169c1 thru 0x018457 (0x1a97 bytes) 000871 1788581726.158056 fallocate 0x00c372 thru 0x01bab0 (0xf73f bytes) 000872 1788581726.162384 punch from 0x004afe to 0x0130f4 (0xe5f7 bytes) 000873 1788581726.167853 trunc from 0x033c17 to 0x018913 (0x1b303 bytes) 000874 1788581726.181990 write 0x0130f9 thru 0x0193e3 (0x62eb bytes) 000875 1788581726.189752 read 0x00cb69 thru 0x014fc7 (0x845f bytes) 000877 1788581726.190942 read 0x0034f9 thru 0x00f355 (0xbe5d bytes) 000878 1788581726.192079 punch from 0x0018c9 to 0x008f4f (0x7687 bytes) 000879 1788581726.196898 mapwrite 0x02b5ab thru 0x03a3ef (0xee45 bytes) 000880 1788581726.241252 punch from 0x024bd9 to 0x024e28 (0x250 bytes) 000881 1788581726.246264 read 0x037b13 thru 0x03818f (0x67d bytes) 000882 1788581726.247217 trunc from 0x037b85 to 0x03a3ef (0x286b bytes) 000883 1788581726.251815 punch from 0x0159f5 to 0x01ec55 (0x9261 bytes) 000884 1788581726.256283 mapread 0x01d384 thru 0x0246b2 (0x732f bytes) 000885 1788581726.265258 fallocate 0x02f521 thru 0x03e534 (0xf014 bytes) 000886 1788581726.270057 mapread 0x00d1b9 thru 0x019d71 (0xcbb9 bytes) 000887 1788581726.272040 mapread 0x038d20 thru 0x03a3ef (0x16d0 bytes) 000888 1788581726.277000 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a3f0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3f0): Mirror 2: 0xa38b2173 (stale) Mirror 3: 0xa38b2173 (stale) Mirror 4: 0xa38b2173 (stale) Mirror 5: 0x15278ba7 (stale) CRC-32 checksum value for chunk [0, 0x3a3f0): Mirror 1: 0x55db95ec Mirror 6: 0x55db95ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3f0: skipped 000889 1788581727.020370 trunc from 0x03a3f0 to 0x032524 (0x7ecb bytes) 000890 1788581727.089355 mapread 0x010dcd thru 0x01a03d (0x9271 bytes) 000891 1788581727.108850 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32525): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32525): Mirror 2: 0xcb209c67 (stale) Mirror 3: 0xcb209c67 (stale) Mirror 4: 0xcb209c67 (stale) Mirror 5: 0x48707818 (stale) Mirror 6: 0x675b7a92 (stale) CRC-32 checksum value for chunk [0, 0x32525): Mirror 1: 0x675b7a92 Mirror 7: 0x675b7a92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32525: skipped 000892 1788581728.113625 MIRROR_RESYNC 7 mirrors 000893 1788581729.599143 MIRROR_RESYNC 7 mirrors 000895 1788581730.066970 trunc from 0x0276c4 to 0x02a7ab (0x30e8 bytes) 000896 1788581730.099324 punch from 0x02af7d to 0x02be37 (0xebb bytes) 000897 1788581730.107193 mapwrite 0x025d6a thru 0x03181f (0xbab6 bytes) 000898 1788581730.164374 trunc from 0x032525 to 0x02c309 (0x621b bytes) 000900 1788581730.216413 punch from 0x00d2c8 to 0x016e9c (0x9bd5 bytes) 000901 1788581730.220290 mapread 0x022fe0 thru 0x026324 (0x3345 bytes) 000903 1788581730.221812 trunc from 0x0024a0 to 0x0047fd (0x235e bytes) 000904 1788581730.225129 mapwrite 0x00f455 thru 0x01a8f7 (0xb4a3 bytes) 000905 1788581730.269851 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2c30a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c30a): Mirror 2: 0xe916b38f (stale) Mirror 3: 0xe916b38f (stale) Mirror 4: 0xe916b38f (stale) Mirror 5: 0xe916b38f (stale) Mirror 6: 0xe916b38f (stale) Mirror 7: 0xe916b38f (stale) CRC-32 checksum value for chunk [0, 0x2c30a): Mirror 1: 0x6e8ad0df Mirror 8: 0x6e8ad0df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c30a: skipped 000906 1788581731.162896 fallocate 0x03d202 thru 0x03ffff (0x2dfe bytes) 000907 1788581731.255172 mapread 0x02118e thru 0x02c309 (0xb17c bytes) 000908 1788581731.297252 mapwrite 0x014dbe thru 0x0169d8 (0x1c1b bytes) 000909 1788581731.348502 trunc from 0x02c30a to 0x039b71 (0xd868 bytes) 000910 1788581731.423526 mapwrite 0x017954 thru 0x01cc34 (0x52e1 bytes) 000911 1788581731.446590 trunc from 0x002cfa to 0x012926 (0xfc2d bytes) 000913 1788581731.458790 mapread 0x01acb1 thru 0x02932c (0xe67c bytes) 000914 1788581731.465039 MIRROR_RESYNC 8 mirrors 000915 1788581733.880340 write 0x02d8fd thru 0x033618 (0x5d1c bytes) 000916 1788581733.930241 mapwrite 0x0215a3 thru 0x02f585 (0xdfe3 bytes) 000918 1788581734.055217 trunc from 0x01da14 to 0x0298c4 (0xbeb1 bytes) 000919 1788581734.063489 mapread 0x022671 thru 0x02c7b8 (0xa148 bytes) 000921 1788581734.091706 write 0x01e9cf thru 0x029a81 (0xb0b3 bytes) 000922 1788581734.092987 write 0x030579 thru 0x0382f0 (0x7d78 bytes) 000923 1788581734.103191 mapread 0x004c1d thru 0x00e81f (0x9c03 bytes) 000924 1788581734.128544 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x39b72): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b72): Mirror 2: 0x98b0a5de (stale) Mirror 3: 0x98b0a5de (stale) Mirror 4: 0x98b0a5de (stale) Mirror 5: 0x98b0a5de (stale) Mirror 6: 0x98b0a5de (stale) Mirror 7: 0x98b0a5de (stale) Mirror 8: 0x98b0a5de (stale) CRC-32 checksum value for chunk [0, 0x39b72): Mirror 1: 0xc841227a Mirror 9: 0xc841227a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b72: skipped 000925 1788581735.092368 mapwrite 0x0006b1 thru 0x00aad0 (0xa420 bytes) 000926 1788581735.263001 mapwrite 0x029acf thru 0x033c9d (0xa1cf bytes) 000927 1788581735.356164 mapwrite 0x0249c7 thru 0x02e08c (0x96c6 bytes) 000928 1788581735.389465 mapread 0x009fca thru 0x015a7c (0xbab3 bytes) 000930 1788581735.430608 fallocate 0x0223f3 thru 0x02d73f (0xb34d bytes) 000931 1788581735.437932 read 0x00c749 thru 0x00d0e3 (0x99b bytes) 000932 1788581735.438616 trunc from 0x009053 to 0x011f7c (0x8f2a bytes) 000933 1788581735.445241 fallocate 0x00bc44 thru 0x012df1 (0x71ae bytes) 000934 1788581735.453343 read 0x00a07c thru 0x012743 (0x86c8 bytes) 000935 1788581735.459101 punch from 0x0323ed to 0x039b71 (0x7785 bytes) 000936 1788581735.466255 fallocate 0x011083 thru 0x01cd10 (0xbc8e bytes) 000937 1788581735.473836 MIRROR_RESYNC 9 mirrors 000940 1788581737.919732 trunc from 0x039b72 to 0x023dc3 (0x15dae bytes) 000941 1788581737.996251 mapread 0x022069 thru 0x023dc3 (0x1d5b bytes) 000942 1788581738.007088 trunc from 0x023dc4 to 0x023316 (0xaad bytes) 000943 1788581738.028914 mapread 0x003c8a thru 0x0052a8 (0x161f bytes) 000944 1788581738.055098 read 0x0209fb thru 0x023316 (0x291c bytes) 000945 1788581738.061864 fallocate 0x039907 thru 0x03fdd2 (0x64cc bytes) 000947 1788581738.069005 mapwrite 0x027565 thru 0x02e949 (0x73e5 bytes) 000948 1788581738.168476 write 0x00f8cf thru 0x01acbe (0xb3f0 bytes) 000949 1788581738.191329 punch from 0x00c1c6 to 0x00c885 (0x6c0 bytes) 000950 1788581738.194836 mapread 0x000212 thru 0x00a628 (0xa417 bytes) 000951 1788581738.216736 MIRROR_RESYNC 9 mirrors 000952 1788581740.425981 write 0x03f323 thru 0x03ffff (0xcdd bytes) 000953 1788581740.492392 write 0x00e8f7 thru 0x01c83d (0xdf47 bytes) 000954 1788581740.503964 fallocate 0x0345b8 thru 0x03fff9 (0xba42 bytes) 000955 1788581740.533284 MIRROR_RESYNC 9 mirrors 000956 1788581743.628686 MIRROR_EXTEND to 10 mirrors 000957 1788581744.680035 mapwrite 0x03fa1b thru 0x03ffff (0x5e5 bytes) 000958 1788581744.800869 trunc from 0x040000 to 0x01b1ad (0x24e52 bytes) 000959 1788581744.831773 fallocate 0x01be6a thru 0x0295b3 (0xd74a bytes) 000960 1788581744.837387 mapread 0x014976 thru 0x01b1ad (0x6838 bytes) 000961 1788581744.850949 mapread 0x015c15 thru 0x01b1ad (0x5599 bytes) 000962 1788581744.852234 punch from 0x007aa3 to 0x0155d7 (0xdb35 bytes) 000964 1788581744.863854 write 0x0080a4 thru 0x0089bb (0x918 bytes) 000965 1788581744.883368 trunc from 0x01b1ae to 0x03f54e (0x243a1 bytes) 000966 1788581744.901066 punch from 0x00b481 to 0x015fd1 (0xab51 bytes) 000967 1788581744.913528 trunc from 0x023592 to 0x029c4a (0x66b9 bytes) 000968 1788581744.919480 punch from 0x02adc8 to 0x036a4d (0xbc86 bytes) 000969 1788581744.926722 fallocate 0x01f18c thru 0x0252b6 (0x612b bytes) 000970 1788581744.932528 punch from 0x0260dc to 0x02db03 (0x7a28 bytes) 000971 1788581744.938137 fallocate 0x02b2d5 thru 0x02f2d1 (0x3ffd bytes) 000973 1788581744.948217 punch from 0x039e3f to 0x03f54e (0x5710 bytes) 000975 1788581744.965646 mapwrite 0x0346c7 thru 0x03ffff (0xb939 bytes) 000976 1788581745.077082 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe861d642 (stale) Mirror 3: 0xe861d642 (stale) Mirror 4: 0xe861d642 (stale) Mirror 5: 0xe861d642 (stale) Mirror 6: 0xe861d642 (stale) Mirror 7: 0xe861d642 (stale) Mirror 8: 0xe861d642 (stale) Mirror 9: 0xe861d642 (stale) Mirror 10: 0xe861d642 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f2c56b9 Mirror 11: 0x9f2c56b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000977 1788581746.599734 trunc from 0x040000 to 0x01ab34 (0x254cb bytes) 000978 1788581746.689484 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ab35): Mirror 2: 0x3dec536b (stale) Mirror 4: 0x3dec536b (stale) Mirror 5: 0x3dec536b (stale) Mirror 6: 0x3dec536b (stale) Mirror 7: 0x3dec536b (stale) Mirror 8: 0x3dec536b (stale) Mirror 9: 0x3dec536b (stale) Mirror 10: 0x3dec536b (stale) Mirror 11: 0xf6a98673 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ab35): Mirror 2: 0x3dec536b (stale) Mirror 4: 0x3dec536b (stale) Mirror 5: 0x3dec536b (stale) Mirror 6: 0x3dec536b (stale) Mirror 7: 0x3dec536b (stale) Mirror 8: 0x3dec536b (stale) Mirror 9: 0x3dec536b (stale) Mirror 10: 0x3dec536b (stale) Mirror 11: 0xf6a98673 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ab35: skipped 000979 1788581747.322748 trunc from 0x01ab35 to 0x01ee5a (0x4326 bytes) 000980 1788581747.349908 write 0x02bbd6 thru 0x033d35 (0x8160 bytes) 000981 1788581747.356178 trunc from 0x033d36 to 0x0120b6 (0x21c7f bytes) 000982 1788581747.380497 trunc from 0x004d42 to 0x011221 (0xc4e0 bytes) 000983 1788581747.386145 mapread 0x00e4ec thru 0x0120b6 (0x3bcb bytes) 000984 1788581747.403119 read 0x003750 thru 0x005f4b (0x27fc bytes) 000985 1788581747.407901 read 0x0081c1 thru 0x00af92 (0x2dd2 bytes) 000986 1788581747.457050 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x120b7): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x120b7): Mirror 2: 0x719e813a (stale) Mirror 4: 0x719e813a (stale) Mirror 5: 0x719e813a (stale) Mirror 6: 0x719e813a (stale) Mirror 7: 0x719e813a (stale) Mirror 8: 0x719e813a (stale) Mirror 9: 0x719e813a (stale) Mirror 10: 0x719e813a (stale) Mirror 11: 0xdb7d83c7 (stale) CRC-32 checksum value for chunk [0, 0x120b7): Mirror 1: 0xa8edd296 Mirror 12: 0xa8edd296 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x120b7: skipped 000987 1788581748.654735 mapwrite 0x02433a thru 0x026a56 (0x271d bytes) 000988 1788581748.765414 mapread 0x021dab thru 0x026a56 (0x4cac bytes) 000989 1788581748.767067 trunc from 0x026a57 to 0x024f14 (0x1b42 bytes) 000990 1788581748.789856 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x52:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24f15): Mirror 2: 0x43d688c2 (stale) Mirror 4: 0x43d688c2 (stale) Mirror 5: 0x43d688c2 (stale) Mirror 7: 0x43d688c2 (stale) Mirror 8: 0x43d688c2 (stale) Mirror 9: 0x43d688c2 (stale) Mirror 10: 0x43d688c2 (stale) Mirror 11: 0xe209b611 (stale) Mirror 12: 0x9651e444 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f15): Mirror 2: 0x43d688c2 (stale) Mirror 4: 0x43d688c2 (stale) Mirror 5: 0x43d688c2 (stale) Mirror 7: 0x43d688c2 (stale) Mirror 8: 0x43d688c2 (stale) Mirror 9: 0x43d688c2 (stale) Mirror 10: 0x43d688c2 (stale) Mirror 11: 0xe209b611 (stale) Mirror 12: 0x9651e444 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f15: skipped 000991 1788581749.624565 trunc from 0x018a8b to 0x01bf90 (0x3506 bytes) 000992 1788581749.629846 trunc from 0x024f15 to 0x021586 (0x398e bytes) 000993 1788581749.650660 read 0x01885a thru 0x01b00b (0x27b2 bytes) 000994 1788581749.657400 mapwrite 0x00c872 thru 0x014c64 (0x83f3 bytes) 000995 1788581749.688150 trunc from 0x021587 to 0x00cd77 (0x1480f bytes) 000996 1788581749.701662 trunc from 0x00cd78 to 0x0367be (0x29a47 bytes) 000997 1788581749.719629 trunc from 0x0367bf to 0x00311f (0x3369f bytes) 000998 1788581749.742057 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3120): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3120): Mirror 2: 0x8e48e893 (stale) Mirror 4: 0x8e48e893 (stale) Mirror 5: 0x8e48e893 (stale) Mirror 7: 0x8e48e893 (stale) Mirror 8: 0x8e48e893 (stale) Mirror 9: 0x8e48e893 (stale) Mirror 10: 0x8e48e893 (stale) Mirror 11: 0x8e48e893 (stale) Mirror 12: 0x8e48e893 (stale) CRC-32 checksum value for chunk [0, 0x3120): Mirror 1: 0x8e48e893 Mirror 13: 0x8e48e893 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3120: skipped 000999 1788581750.473882 mapwrite 0x026b6c thru 0x02a1ae (0x3643 bytes) 001000 1788581750.590105 MIRROR_RESYNC 11 mirrors All operations completed A-OK!