== sanity-flr test 70a: flr mode fsx test ================ 10:05:59 (1782223559) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 3562 skipping zero length zero range 000002 1782223562.446530 MIRROR_EXTEND to 2 mirrors skipping zero length punch hole skipping zero length zero range skipping zero length zero range 000006 1782223562.968438 MIRROR_EXTEND to 3 mirrors fallocating to largest ever: 0x371bc 000007 1782223563.479110 fallocate 0x027c90 thru 0x0371bb (0xf52c bytes) 000008 1782223563.511930 mapwrite 0x01b7e7 thru 0x01f6bf (0x3ed9 bytes) 000009 1782223563.580249 MIRROR_RESYNC 3 mirrors 000010 1782223564.669148 mapread 0x00eba2 thru 0x0137de (0x4c3d bytes) 000011 1782223564.698650 punch from 0x0207c5 to 0x0301c5 (0xfa01 bytes) 000012 1782223564.754475 mapwrite 0x03c152 thru 0x03ffff (0x3eae bytes) 000013 1782223564.837160 fallocate 0x019245 thru 0x022e19 (0x9bd5 bytes) 000014 1782223564.852408 punch from 0x012434 to 0x0148c8 (0x2495 bytes) 000015 1782223564.867096 mapwrite 0x00bb5c thru 0x012892 (0x6d37 bytes) 000016 1782223564.951229 trunc from 0x040000 to 0x01b712 (0x248ed bytes) 000017 1782223564.975374 mapread 0x008fd2 thru 0x0125ba (0x95e9 bytes) 000018 1782223564.977502 punch from 0x00a5bb to 0x0129f3 (0x8439 bytes) 000019 1782223564.985726 mapwrite 0x021e41 thru 0x025b45 (0x3d05 bytes) 000020 1782223565.060088 read 0x01dbc8 thru 0x025b45 (0x7f7e bytes) 000021 1782223565.061188 punch from 0x000c02 to 0x00a143 (0x9542 bytes) 000022 1782223565.067261 punch from 0x0036b3 to 0x00de00 (0xa74e bytes) 000023 1782223565.075936 trunc from 0x025b46 to 0x0309e5 (0xaea0 bytes) 000024 1782223565.107289 fallocate 0x01e72f thru 0x02017d (0x1a4f bytes) 000025 1782223565.116110 mapread 0x014b3e thru 0x02148e (0xc951 bytes) 000026 1782223565.131996 mapwrite 0x020551 thru 0x02f85b (0xf30b bytes) 000027 1782223565.186406 MIRROR_RESYNC 3 mirrors 000028 1782223566.723019 punch from 0x01abe4 to 0x0281fd (0xd61a bytes) 000030 1782223566.834529 write 0x03e9d8 thru 0x03ffff (0x1628 bytes) 000031 1782223566.850522 MIRROR_RESYNC 3 mirrors 000032 1782223567.878310 fallocate 0x02a466 thru 0x02d8a9 (0x3444 bytes) 000033 1782223567.955993 mapwrite 0x0168a7 thru 0x01eb61 (0x82bb bytes) 000035 1782223568.051270 mapread 0x029022 thru 0x0326e4 (0x96c3 bytes) zero_range to largest ever: 0x3816e 000036 1782223568.096467 trunc from 0x028673 to 0x03816d (0xfafb bytes) 000037 1782223568.107483 mapread 0x0047a0 thru 0x005647 (0xea8 bytes) 000038 1782223568.134157 read 0x035f76 thru 0x03ffff (0xa08a bytes) fallocating to largest ever: 0x3cdf2 000039 1782223568.163635 fallocate 0x030575 thru 0x03cdf1 (0xc87d bytes) 000040 1782223568.175487 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7903d59d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7903d59d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000041 1782223568.564780 mapwrite 0x0264be thru 0x0332be (0xce01 bytes) 000042 1782223568.644722 read 0x004454 thru 0x00fb99 (0xb746 bytes) 000043 1782223568.656635 write 0x00a825 thru 0x014ccf (0xa4ab bytes) 000044 1782223568.674272 MIRROR_RESYNC 2 mirrors 000046 1782223569.798107 MIRROR_RESYNC 2 mirrors 000047 1782223570.617565 mapwrite 0x03260f thru 0x03593e (0x3330 bytes) 000048 1782223570.811259 mapwrite 0x02cf86 thru 0x035b39 (0x8bb4 bytes) 000049 1782223570.874313 trunc from 0x01c7ec to 0x0237ff (0x7014 bytes) 000050 1782223570.892243 trunc from 0x03ccb2 to 0x03ffff (0x334e bytes) 000051 1782223570.922553 trunc from 0x008984 to 0x0131c1 (0xa83e bytes) 000052 1782223570.941421 read 0x001790 thru 0x0037fe (0x206f bytes) 000053 1782223570.972983 MIRROR_RESYNC 2 mirrors 000054 1782223572.077497 trunc from 0x040000 to 0x01bd0a (0x242f5 bytes) 000055 1782223572.188966 mapwrite 0x034d50 thru 0x03d47b (0x872c bytes) 000056 1782223572.329324 punch from 0x00ac67 to 0x0165d3 (0xb96d bytes) 000057 1782223572.357406 read 0x019c8c thru 0x019e52 (0x1c7 bytes) 000058 1782223572.375357 punch from 0x024ba3 to 0x033204 (0xe662 bytes) 000059 1782223572.386988 read 0x03d2e3 thru 0x03d47b (0x199 bytes) 000060 1782223572.392732 punch from 0x03babe to 0x03d47b (0x19be bytes) 000061 1782223572.417683 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d47c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d47c): Mirror 3: 0xc11fb3fa (stale) CRC-32 checksum value for chunk [0, 0x3d47c): Mirror 1: 0x5d457f38 Mirror 4: 0x5d457f38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d47c: skipped 000062 1782223573.613419 read 0x0358f0 thru 0x03d47b (0x7b8c bytes) 000063 1782223573.631365 mapwrite 0x00aca8 thru 0x00ce4d (0x21a6 bytes) 000064 1782223573.776839 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d47c): Mirror 4: 0x5d457f38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d47c): Mirror 4: 0x5d457f38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d47c: skipped 000065 1782223574.168064 punch from 0x02a315 to 0x02e95e (0x464a bytes) 000066 1782223574.175155 trunc from 0x0186aa to 0x01df52 (0x58a9 bytes) 000067 1782223574.181078 write 0x0173e7 thru 0x01b6c7 (0x42e1 bytes) 000068 1782223574.202053 read 0x00e144 thru 0x017484 (0x9341 bytes) 000069 1782223574.239315 trunc from 0x00edf8 to 0x01d18a (0xe393 bytes) 000070 1782223574.264313 fallocate 0x0120c9 thru 0x018811 (0x6749 bytes) 000071 1782223574.274116 trunc from 0x03d47c to 0x00ee31 (0x2e64a bytes) 000072 1782223574.324779 trunc from 0x00b2cc to 0x00ee31 (0x3b66 bytes) 000073 1782223574.358827 mapwrite 0x016a78 thru 0x01e0e3 (0x766c bytes) 000074 1782223574.479321 trunc from 0x01e0e4 to 0x02c0a6 (0xdfc3 bytes) 000075 1782223574.508245 trunc from 0x0145c2 to 0x014d27 (0x766 bytes) 000076 1782223574.515878 punch from 0x006fe2 to 0x00ad3d (0x3d5c bytes) 000077 1782223574.537292 write 0x02d8df thru 0x039249 (0xb96b bytes) 000078 1782223574.545355 mapread 0x0138d9 thru 0x01f19d (0xb8c5 bytes) 000079 1782223574.614294 punch from 0x02cae8 to 0x02fbb4 (0x30cd bytes) 000080 1782223574.639351 punch from 0x002824 to 0x003cb9 (0x1496 bytes) 000081 1782223574.653907 trunc from 0x03924a to 0x028944 (0x10905 bytes) 000082 1782223574.694007 mapwrite 0x033256 thru 0x0399b0 (0x675b bytes) 000083 1782223574.773587 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x399b1): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399b1): Mirror 4: 0x346690f1 (stale) CRC-32 checksum value for chunk [0, 0x399b1): Mirror 1: 0x3276a210 Mirror 5: 0x3276a210 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399b1: skipped 000084 1782223576.108781 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x399b1): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399b1): Mirror 4: 0x346690f1 (stale) CRC-32 checksum value for chunk [0, 0x399b1): Mirror 1: 0x3276a210 Mirror 5: 0x3276a210 Mirror 6: 0x3276a210 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399b1: skipped 000085 1782223577.525112 write 0x0156ad thru 0x020d05 (0xb659 bytes) 000086 1782223577.595070 punch from 0x00f753 to 0x011c81 (0x252f bytes) 000087 1782223577.620972 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x399b1): Mirror 5: 0x3276a210 (stale) Mirror 6: 0x3276a210 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399b1): Mirror 5: 0x3276a210 (stale) Mirror 6: 0x3276a210 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399b1: skipped 000088 1782223578.128433 trunc from 0x0399b1 to 0x033259 (0x6757 bytes) 000089 1782223578.153382 trunc from 0x00db36 to 0x00df8e (0x459 bytes) 000090 1782223578.159173 mapread 0x02f2ad thru 0x033259 (0x3fad bytes) 000091 1782223578.188200 punch from 0x00f3ae to 0x013e58 (0x4aab bytes) 000092 1782223578.198508 write 0x03f3dc thru 0x03ffff (0xc24 bytes) 000093 1782223578.210842 MIRROR_RESYNC 3 mirrors 000094 1782223579.759402 trunc from 0x031e23 to 0x03b51f (0x96fd bytes) 000095 1782223579.837775 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa3363fe2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa3363fe2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000096 1782223580.280337 mapwrite 0x00a333 thru 0x00d8a7 (0x3575 bytes) 000097 1782223580.383688 fallocate 0x015601 thru 0x02386d (0xe26d bytes) 000098 1782223580.395825 read 0x01e124 thru 0x022153 (0x4030 bytes) 000099 1782223580.416749 punch from 0x009b83 to 0x013650 (0x9ace bytes) 000100 1782223580.427881 mapread 0x01c540 thru 0x020a26 (0x44e7 bytes) 000101 1782223580.479985 trunc from 0x01f657 to 0x024d2a (0x56d4 bytes) 000102 1782223580.504199 read 0x008e86 thru 0x009965 (0xae0 bytes) 000103 1782223580.530587 trunc from 0x007e7c to 0x00d48f (0x5614 bytes) 000104 1782223580.553958 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) 000105 1782223580.821890 punch from 0x0045be to 0x010235 (0xbc78 bytes) 000106 1782223580.835124 write 0x0381fb thru 0x03b3f8 (0x31fe bytes) 000107 1782223580.860992 mapwrite 0x030348 thru 0x03fee4 (0xfb9d bytes) 000109 1782223580.956049 MIRROR_EXTEND to 2 mirrors 000110 1782223581.986876 write 0x03ac8d thru 0x03ffff (0x5373 bytes) 000111 1782223582.058090 fallocate 0x02d30a thru 0x02fc55 (0x294c bytes) 000112 1782223582.065876 punch from 0x00d0f5 to 0x00e976 (0x1882 bytes) 000113 1782223582.072360 write 0x0003ad thru 0x00631b (0x5f6f bytes) 000115 1782223582.088288 trunc from 0x040000 to 0x02d9de (0x12621 bytes) 000116 1782223582.140967 fallocate 0x0311d4 thru 0x03a08b (0x8eb8 bytes) 000117 1782223582.172675 MIRROR_RESYNC 2 mirrors 000118 1782223583.222310 mapwrite 0x004bdf thru 0x00c367 (0x7789 bytes) 000119 1782223583.392290 mapread 0x00a5e6 thru 0x015d6c (0xb787 bytes) 000121 1782223583.409342 punch from 0x0233ee to 0x02c245 (0x8e58 bytes) 000122 1782223583.423683 trunc from 0x00c372 to 0x00c7c3 (0x452 bytes) 000123 1782223583.444875 read 0x0258ab thru 0x028272 (0x29c8 bytes) 000124 1782223583.458237 trunc from 0x01df20 to 0x01f265 (0x1346 bytes) 000125 1782223583.486266 MIRROR_RESYNC 2 mirrors 000126 1782223584.259719 MIRROR_EXTEND to 3 mirrors 000127 1782223585.253180 trunc from 0x0151af to 0x023c6c (0xeabe bytes) 000128 1782223585.307284 trunc from 0x00e8ab to 0x0193c1 (0xab17 bytes) 000129 1782223585.319388 fallocate 0x01802a thru 0x025aa6 (0xda7d bytes) 000130 1782223585.331192 MIRROR_RESYNC 3 mirrors 000131 1782223586.445185 mapwrite 0x0012b1 thru 0x00405c (0x2dac bytes) 000133 1782223586.553367 read 0x0048a7 thru 0x00c70c (0x7e66 bytes) fallocating to largest ever: 0x3d2ba 000134 1782223586.554132 fallocate 0x03c475 thru 0x03d2b9 (0xe45 bytes) 000135 1782223586.561929 mapwrite 0x02ea6a thru 0x039a54 (0xafeb bytes) 000136 1782223586.628592 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39a55): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a55): Mirror 2: 0x798ddda2 (stale) Mirror 3: 0x798ddda2 (stale) CRC-32 checksum value for chunk [0, 0x39a55): Mirror 1: 0x92d2f53 Mirror 4: 0x92d2f53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a55: skipped 000139 1782223588.080159 mapwrite 0x028234 thru 0x02e0a7 (0x5e74 bytes) 000140 1782223588.219188 read 0x033ae3 thru 0x039a54 (0x5f72 bytes) 000141 1782223588.234108 mapread 0x02deb9 thru 0x032a67 (0x4baf bytes) 000142 1782223588.252120 read 0x034557 thru 0x039a54 (0x54fe bytes) 000143 1782223588.267538 MIRROR_RESYNC 4 mirrors 000145 1782223589.234512 trunc from 0x02f78f to 0x030f2f (0x17a1 bytes) 000146 1782223589.317675 read 0x01753d thru 0x026080 (0xeb44 bytes) 000147 1782223589.338303 fallocate 0x02978a thru 0x036f27 (0xd79e bytes) 000148 1782223589.345309 mapread 0x01428b thru 0x01fc52 (0xb9c8 bytes) 000149 1782223589.373262 trunc from 0x039a55 to 0x034cf6 (0x4d5e bytes) 000151 1782223589.414184 trunc from 0x034cf7 to 0x02902b (0xbccb bytes) 000152 1782223589.438439 read 0x019223 thru 0x01b43f (0x221d bytes) 000153 1782223589.440020 fallocate 0x007d7c thru 0x011b9b (0x9e20 bytes) 000154 1782223589.449158 write 0x032f65 thru 0x03831d (0x53b9 bytes) 000155 1782223589.452085 trunc from 0x03831e to 0x01893d (0x1f9e0 bytes) 000156 1782223589.480763 mapwrite 0x01e9c4 thru 0x02d6d0 (0xed0d bytes) 000157 1782223589.560347 fallocate 0x02b434 thru 0x02ba6f (0x63c bytes) 000158 1782223589.573827 mapread 0x02945e thru 0x02d6d0 (0x4273 bytes) 000159 1782223589.580206 punch from 0x01c9f7 to 0x02b838 (0xee42 bytes) 000160 1782223589.596956 punch from 0x02348b to 0x02d6d0 (0xa246 bytes) 000161 1782223589.617208 write 0x02f104 thru 0x033e8c (0x4d89 bytes) 000163 1782223589.626824 mapwrite 0x026e57 thru 0x02d6e5 (0x688f bytes) 000164 1782223589.759239 mapwrite 0x02bfbc thru 0x03446a (0x84af bytes) 000165 1782223589.830167 read 0x022508 thru 0x028745 (0x623e bytes) 000167 1782223589.841149 fallocate 0x018d2f thru 0x023564 (0xa836 bytes) 000168 1782223589.846491 fallocate 0x00f2f2 thru 0x01c07b (0xcd8a bytes) 000169 1782223589.852653 mapwrite 0x036bb7 thru 0x03c479 (0x58c3 bytes) 000170 1782223589.957666 punch from 0x02116b to 0x021cf0 (0xb86 bytes) 000171 1782223589.962480 mapread 0x01a87a thru 0x022511 (0x7c98 bytes) 000172 1782223589.975629 fallocate 0x02c140 thru 0x03b12d (0xefee bytes) 000173 1782223589.981328 mapwrite 0x003862 thru 0x006fae (0x374d bytes) 000174 1782223589.995099 mapwrite 0x03a73f thru 0x03ffff (0x58c1 bytes) 000175 1782223590.056821 mapwrite 0x03b104 thru 0x03e31c (0x3219 bytes) 000176 1782223590.082953 trunc from 0x005b97 to 0x015a0f (0xfe79 bytes) 000177 1782223590.101868 fallocate 0x01cab5 thru 0x02b702 (0xec4e bytes) 000179 1782223590.118450 mapwrite 0x00659b thru 0x00a75e (0x41c4 bytes) fallocating to largest ever: 0x40000 000180 1782223590.192208 fallocate 0x0342b0 thru 0x03ffff (0xbd50 bytes) 000181 1782223590.205122 punch from 0x028a14 to 0x033038 (0xa625 bytes) 000182 1782223590.216067 fallocate 0x0170fd thru 0x017172 (0x76 bytes) 000183 1782223590.221837 fallocate 0x014d4f thru 0x01ceb9 (0x816b bytes) 000184 1782223590.227725 write 0x034de2 thru 0x03ffff (0xb21e bytes) 000185 1782223590.229897 mapwrite 0x034b7c thru 0x03a8d7 (0x5d5c bytes) 000186 1782223590.249800 trunc from 0x040000 to 0x021aa1 (0x1e55e bytes) 000187 1782223590.270912 read 0x010205 thru 0x014334 (0x4130 bytes) 000188 1782223590.287081 mapwrite 0x03e372 thru 0x03ffff (0x1c8e bytes) 000189 1782223590.349191 mapread 0x0105a7 thru 0x01bf29 (0xb983 bytes) 000190 1782223590.350993 mapwrite 0x01a270 thru 0x02825e (0xdfef bytes) 000191 1782223590.377584 mapread 0x030140 thru 0x03df56 (0xde17 bytes) 000192 1782223590.380763 fallocate 0x0188c8 thru 0x020e93 (0x85cc bytes) 000193 1782223590.386574 read 0x03f8fb thru 0x03ffff (0x705 bytes) 000194 1782223590.388160 mapread 0x020ce9 thru 0x02261a (0x1932 bytes) 000195 1782223590.390259 fallocate 0x02cb2b thru 0x038144 (0xb61a bytes) 000196 1782223590.398831 trunc from 0x040000 to 0x028379 (0x17c86 bytes) 000197 1782223590.418678 mapread 0x024722 thru 0x028379 (0x3c58 bytes) 000198 1782223590.420952 punch from 0x0109f8 to 0x018dfa (0x8403 bytes) 000199 1782223590.429937 trunc from 0x02837a to 0x031c72 (0x98f9 bytes) 000200 1782223590.448896 fallocate 0x01766f thru 0x01c70f (0x50a1 bytes) 000201 1782223590.458584 mapwrite 0x00180c thru 0x00b21b (0x9a10 bytes) 000202 1782223590.488766 punch from 0x000de3 to 0x00cee1 (0xc0ff bytes) 000203 1782223590.496013 mapwrite 0x015101 thru 0x01bd2e (0x6c2e bytes) 000204 1782223590.528505 punch from 0x0016c3 to 0x011343 (0xfc81 bytes) 000205 1782223590.534747 read 0x0248c2 thru 0x02fd6a (0xb4a9 bytes) 000206 1782223590.536651 trunc from 0x031c73 to 0x0047cd (0x2d4a5 bytes) 000207 1782223590.559987 write 0x003b3b thru 0x00b7e3 (0x7ca9 bytes) 000208 1782223590.572333 punch from 0x007247 to 0x00b7e3 (0x459d bytes) 000209 1782223590.594110 punch from 0x002d6b to 0x0080c1 (0x5357 bytes) 000211 1782223590.600281 write 0x015eeb thru 0x023b58 (0xdc6e bytes) 000212 1782223590.610550 trunc from 0x023b59 to 0x018322 (0xb836 bytes) 000214 1782223590.650908 mapwrite 0x00ec39 thru 0x013626 (0x49ee bytes) 000215 1782223590.730496 write 0x0228ca thru 0x02d3e2 (0xab19 bytes) 000217 1782223590.735780 mapread 0x027670 thru 0x028ad9 (0x146a bytes) 000218 1782223590.740149 trunc from 0x02d3e3 to 0x018f0d (0x144d5 bytes) 000220 1782223590.762842 trunc from 0x018f0e to 0x01aa86 (0x1b79 bytes) 000221 1782223590.786437 fallocate 0x038109 thru 0x03c42b (0x4323 bytes) 000222 1782223590.801547 mapwrite 0x02950d thru 0x030847 (0x733b bytes) 000223 1782223590.887964 MIRROR_RESYNC 4 mirrors 000225 1782223592.691551 trunc from 0x030848 to 0x0373a3 (0x6b5c bytes) 000226 1782223592.730994 punch from 0x015a59 to 0x0191e2 (0x378a bytes) 000227 1782223592.738021 fallocate 0x00e76f thru 0x01d31f (0xebb1 bytes) 000228 1782223592.744359 fallocate 0x0354f8 thru 0x03ed07 (0x9810 bytes) 000229 1782223592.750357 write 0x038306 thru 0x03ffff (0x7cfa bytes) 000230 1782223592.754418 read 0x003a3e thru 0x00da48 (0xa00b bytes) 000231 1782223592.768075 mapwrite 0x00892c thru 0x00f370 (0x6a45 bytes) 000232 1782223592.799851 trunc from 0x040000 to 0x01e0cf (0x21f30 bytes) 000233 1782223592.819812 mapwrite 0x010de2 thru 0x01268a (0x18a9 bytes) 000234 1782223592.845204 trunc from 0x01e0d0 to 0x01c3fa (0x1cd5 bytes) 000235 1782223592.865040 mapwrite 0x02e4f7 thru 0x03bf2d (0xda37 bytes) 000236 1782223592.920491 fallocate 0x02e44a thru 0x03b860 (0xd417 bytes) 000237 1782223592.927944 fallocate 0x036aab thru 0x03ffff (0x9555 bytes) 000238 1782223592.934727 read 0x012879 thru 0x01a28a (0x7a12 bytes) 000239 1782223592.947704 read 0x00169d thru 0x00b1ac (0x9b10 bytes) 000240 1782223592.950881 mapread 0x039f2b thru 0x03ffff (0x60d5 bytes) 000241 1782223592.952343 mapwrite 0x02a9a0 thru 0x02ceb1 (0x2512 bytes) 000242 1782223592.969509 trunc from 0x040000 to 0x038f22 (0x70dd bytes) 000243 1782223592.998582 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38f23): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f23): Mirror 2: 0xb538043b (stale) Mirror 3: 0xb538043b (stale) Mirror 4: 0xb538043b (stale) CRC-32 checksum value for chunk [0, 0x38f23): Mirror 1: 0x2935eebf Mirror 5: 0x2935eebf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f23: skipped 000244 1782223594.504272 fallocate 0x03bb41 thru 0x03ffff (0x44bf bytes) 000246 1782223594.554808 fallocate 0x03a4f9 thru 0x03ffff (0x5b07 bytes) 000247 1782223594.570286 MIRROR_RESYNC 5 mirrors 000248 1782223596.539760 fallocate 0x025c09 thru 0x034e06 (0xf1fe bytes) 000249 1782223596.599558 punch from 0x016cf9 to 0x01db5d (0x6e65 bytes) 000250 1782223596.610822 mapwrite 0x027500 thru 0x0363a5 (0xeea6 bytes) 000251 1782223596.713500 punch from 0x03edde to 0x03ffff (0x1222 bytes) 000252 1782223596.720207 fallocate 0x011fac thru 0x01ec80 (0xccd5 bytes) 000253 1782223596.732812 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x39e801e7 (stale) Mirror 3: 0x39e801e7 (stale) Mirror 4: 0x39e801e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x39e801e7 (stale) Mirror 3: 0x39e801e7 (stale) Mirror 4: 0x39e801e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000254 1782223597.290916 trunc from 0x034325 to 0x03a6d3 (0x63af bytes) 000255 1782223597.310458 fallocate 0x0149ea thru 0x01e034 (0x964b bytes) 000256 1782223597.324477 mapread 0x028a4a thru 0x02d856 (0x4e0d bytes) 000257 1782223597.366842 mapwrite 0x00518f thru 0x00d4fa (0x836c bytes) 000258 1782223597.445282 mapwrite 0x003f3a thru 0x011c1d (0xdce4 bytes) 000259 1782223597.523913 mapwrite 0x010872 thru 0x01922c (0x89bb bytes) 000260 1782223597.557248 trunc from 0x0018ca to 0x0074a2 (0x5bd9 bytes) 000261 1782223597.565436 fallocate 0x003ae8 thru 0x004437 (0x950 bytes) 000262 1782223597.572925 read 0x00f003 thru 0x018371 (0x936f bytes) 000264 1782223597.581804 MIRROR_RESYNC 4 mirrors 000265 1782223599.020000 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) 000266 1782223599.525288 fallocate 0x02f36d thru 0x02f7a5 (0x439 bytes) 000267 1782223599.609182 trunc from 0x021c92 to 0x027110 (0x547f bytes) 000268 1782223599.620938 mapread 0x03b53e thru 0x03ffff (0x4ac2 bytes) 000269 1782223599.673324 write 0x026175 thru 0x035914 (0xf7a0 bytes) 000270 1782223599.703538 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x141ce766 (stale) Mirror 4: 0x141ce766 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6405d885 Mirror 5: 0x6405d885 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000271 1782223601.021707 write 0x038aee thru 0x03b8a2 (0x2db5 bytes) 000272 1782223601.084960 trunc from 0x040000 to 0x037a11 (0x85ee bytes) 000273 1782223601.109635 punch from 0x01b8b6 to 0x0221a1 (0x68ec bytes) 000274 1782223601.115781 trunc from 0x02247d to 0x02ebbc (0xc740 bytes) 000275 1782223601.121710 trunc from 0x03270e to 0x037a11 (0x5304 bytes) 000276 1782223601.127198 write 0x01e900 thru 0x02d5ef (0xecf0 bytes) 000277 1782223601.138801 trunc from 0x00600e to 0x008bdd (0x2bd0 bytes) 000278 1782223601.145171 mapwrite 0x023ecb thru 0x02a4bf (0x65f5 bytes) 000279 1782223601.169189 fallocate 0x028a6d thru 0x033f68 (0xb4fc bytes) 000280 1782223601.178310 MIRROR_RESYNC 4 mirrors 000281 1782223602.643919 read 0x034087 thru 0x037a11 (0x398b bytes) 000282 1782223602.654117 read 0x028e9d thru 0x035c3e (0xcda2 bytes) 000283 1782223602.685326 punch from 0x003811 to 0x00f05e (0xb84e bytes) 000284 1782223602.715588 read 0x030ef5 thru 0x037a11 (0x6b1d bytes) 000285 1782223602.742671 trunc from 0x024d12 to 0x030bf3 (0xbee2 bytes) 000286 1782223602.751264 punch from 0x00403a to 0x00d7f7 (0x97be bytes) 000287 1782223602.761756 punch from 0x02be29 to 0x02cab3 (0xc8b bytes) 000288 1782223602.768441 trunc from 0x005d18 to 0x00d068 (0x7351 bytes) 000289 1782223602.773815 trunc from 0x020397 to 0x02ae19 (0xaa83 bytes) 000290 1782223602.780768 write 0x019702 thru 0x022336 (0x8c35 bytes) 000291 1782223602.787345 punch from 0x00d114 to 0x01776f (0xa65c bytes) 000292 1782223602.792880 trunc from 0x037a12 to 0x01f1fe (0x18813 bytes) 000293 1782223602.843862 write 0x02c9db thru 0x02d0f4 (0x71a bytes) 000294 1782223602.849917 fallocate 0x02e34e thru 0x038cf6 (0xa9a9 bytes) 000295 1782223602.856657 punch from 0x00b13f to 0x01505c (0x9f1e bytes) 000296 1782223602.862455 punch from 0x006147 to 0x00a08f (0x3f49 bytes) 000297 1782223602.868403 trunc from 0x029efc to 0x02d0f4 (0x31f9 bytes) 000298 1782223602.885462 trunc from 0x026360 to 0x02d0f4 (0x6d95 bytes) 000299 1782223602.896194 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d0f5): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d0f5): Mirror 2: 0xe485af6f (stale) Mirror 4: 0xe485af6f (stale) Mirror 5: 0xe485af6f (stale) CRC-32 checksum value for chunk [0, 0x2d0f5): Mirror 1: 0x458fd5f9 Mirror 6: 0x458fd5f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d0f5: skipped 000300 1782223603.984568 punch from 0x027bf6 to 0x02d0f4 (0x54ff bytes) 000301 1782223604.042224 mapwrite 0x027b67 thru 0x02be3e (0x42d8 bytes) 000302 1782223604.129880 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d0f5): Mirror 2: 0xe485af6f (stale) Mirror 4: 0xe485af6f (stale) Mirror 5: 0xe485af6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d0f5): Mirror 2: 0xe485af6f (stale) Mirror 4: 0xe485af6f (stale) Mirror 5: 0xe485af6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d0f5: skipped 000303 1782223604.671140 read 0x01cc0c thru 0x02c4d9 (0xf8ce bytes) 000304 1782223604.679737 fallocate 0x00b5c3 thru 0x00d48f (0x1ecd bytes) 000305 1782223604.689125 write 0x012ad1 thru 0x014b3a (0x206a bytes) 000306 1782223604.713857 mapwrite 0x01976b thru 0x022487 (0x8d1d bytes) 000307 1782223604.783312 mapwrite 0x022490 thru 0x02dd28 (0xb899 bytes) 000308 1782223604.828714 read 0x007482 thru 0x00ebb9 (0x7738 bytes) 000309 1782223604.844726 write 0x03053e thru 0x03112a (0xbed bytes) 000310 1782223604.845957 write 0x00cef9 thru 0x0122e3 (0x53eb bytes) 000311 1782223604.848580 fallocate 0x024961 thru 0x027ed0 (0x3570 bytes) 000312 1782223604.861309 MIRROR_RESYNC 4 mirrors 000313 1782223606.337004 write 0x025973 thru 0x0306a8 (0xad36 bytes) 000314 1782223606.375452 fallocate 0x037558 thru 0x03df2e (0x69d7 bytes) 000315 1782223606.380818 mapwrite 0x028fd2 thru 0x0311a4 (0x81d3 bytes) 000316 1782223606.436770 punch from 0x002003 to 0x006ebf (0x4ebd bytes) 000317 1782223606.447909 write 0x0391bc thru 0x03ffff (0x6e44 bytes) 000318 1782223606.449520 trunc from 0x00073d to 0x000dfc (0x6c0 bytes) 000321 1782223606.464082 trunc from 0x040000 to 0x0048b2 (0x3b74d bytes) 000322 1782223606.505789 punch from 0x00275d to 0x0048b2 (0x2156 bytes) 000323 1782223606.512262 read 0x0015ca thru 0x0048b2 (0x32e9 bytes) 000325 1782223606.521251 read 0x0033a5 thru 0x0048b2 (0x150e bytes) 000326 1782223606.522096 trunc from 0x0009ef to 0x0048b2 (0x3ec4 bytes) 000327 1782223606.528455 read 0x000f6f thru 0x002b0e (0x1ba0 bytes) 000328 1782223606.537550 punch from 0x003179 to 0x0048b2 (0x173a bytes) 000329 1782223606.542314 write 0x00f6f2 thru 0x011816 (0x2125 bytes) 000330 1782223606.544284 punch from 0x0014c2 to 0x007d16 (0x6855 bytes) 000331 1782223606.553065 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x11817): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11817): Mirror 2: 0x2c3de7e2 (stale) Mirror 4: 0x2c3de7e2 (stale) Mirror 5: 0x2c3de7e2 (stale) CRC-32 checksum value for chunk [0, 0x11817): Mirror 1: 0xc9e2456c Mirror 6: 0xc9e2456c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11817: skipped 000332 1782223607.807539 trunc from 0x00c1f2 to 0x011816 (0x5625 bytes) 000333 1782223607.880053 punch from 0x005c99 to 0x00efac (0x9314 bytes) 000334 1782223607.891226 mapwrite 0x02475e thru 0x02d949 (0x91ec bytes) 000335 1782223608.004435 punch from 0x002182 to 0x006d06 (0x4b85 bytes) 000336 1782223608.011545 punch from 0x00bbdd to 0x011035 (0x5459 bytes) 000337 1782223608.017746 punch from 0x0292c1 to 0x02cfba (0x3cfa bytes) 000339 1782223608.026483 mapwrite 0x01395c thru 0x01ec0f (0xb2b4 bytes) 000340 1782223608.090317 trunc from 0x020a1a to 0x02d949 (0xcf30 bytes) 000342 1782223608.102370 fallocate 0x017262 thru 0x017ccb (0xa6a bytes) 000343 1782223608.108226 trunc from 0x02d94a to 0x02d9d2 (0x89 bytes) 000344 1782223608.133198 punch from 0x0154c4 to 0x01b967 (0x64a4 bytes) 000345 1782223608.145541 MIRROR_RESYNC 5 mirrors 000347 1782223610.205774 trunc from 0x02d9d3 to 0x01d877 (0x1015b bytes) 000348 1782223610.256275 read 0x01d14b thru 0x01d877 (0x72d bytes) 000349 1782223610.270184 fallocate 0x00537b thru 0x0151f7 (0xfe7d bytes) 000350 1782223610.275753 read 0x0092fc thru 0x00ae2d (0x1b32 bytes) 000351 1782223610.287905 fallocate 0x024a04 thru 0x02ec07 (0xa204 bytes) 000352 1782223610.293792 mapread 0x00c55b thru 0x00f1de (0x2c84 bytes) 000353 1782223610.300585 trunc from 0x01d878 to 0x01a538 (0x333f bytes) 000354 1782223610.360276 write 0x0067c3 thru 0x009ce1 (0x351f bytes) 000355 1782223610.365541 punch from 0x0011fe to 0x00a183 (0x8f86 bytes) 000356 1782223610.386357 mapwrite 0x00d3c9 thru 0x01cc5b (0xf893 bytes) 000357 1782223610.526507 mapread 0x01ca83 thru 0x01cc5b (0x1d9 bytes) 000358 1782223610.528439 fallocate 0x0016b5 thru 0x011235 (0xfb81 bytes) 000359 1782223610.546352 write 0x00ffdd thru 0x010a73 (0xa97 bytes) 000361 1782223610.559130 punch from 0x01420e to 0x01cc5b (0x8a4e bytes) 000362 1782223610.576573 trunc from 0x01583f to 0x01cc5b (0x741d bytes) 000363 1782223610.587376 read 0x00a4ea thru 0x00a50c (0x23 bytes) 000365 1782223610.623966 trunc from 0x01cc5c to 0x003e3b (0x18e20 bytes) 000366 1782223610.662420 mapread 0x00034a thru 0x003e3b (0x3af2 bytes) 000367 1782223610.682355 MIRROR_RESYNC 5 mirrors 000368 1782223612.060521 MIRROR_EXTEND to 6 mirrors 000369 1782223612.863663 trunc from 0x003e3c to 0x013045 (0xf20a bytes) 000370 1782223612.917578 trunc from 0x012b59 to 0x013045 (0x4ed bytes) 000371 1782223612.928404 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13046): Mirror 4: 0x7d5b633b (stale) Mirror 5: 0x7d5b633b (stale) Mirror 6: 0x7d5b633b (stale) Mirror 7: 0x7d5b633b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13046): Mirror 4: 0x7d5b633b (stale) Mirror 5: 0x7d5b633b (stale) Mirror 6: 0x7d5b633b (stale) Mirror 7: 0x7d5b633b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13046: skipped 000372 1782223613.507327 fallocate 0x028a60 thru 0x036771 (0xdd12 bytes) 000373 1782223613.525510 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13046): Mirror 4: 0x7d5b633b (stale) Mirror 6: 0x7d5b633b (stale) Mirror 7: 0x7d5b633b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13046): Mirror 4: 0x7d5b633b (stale) Mirror 6: 0x7d5b633b (stale) Mirror 7: 0x7d5b633b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13046: skipped 000374 1782223613.904095 punch from 0x007605 to 0x011cd8 (0xa6d4 bytes) 000375 1782223613.914989 mapwrite 0x001868 thru 0x0049c3 (0x315c bytes) 000376 1782223613.968434 punch from 0x012196 to 0x013045 (0xeb0 bytes) 000377 1782223613.977406 mapread 0x002ebf thru 0x0040a0 (0x11e2 bytes) 000378 1782223613.979338 punch from 0x00f338 to 0x013045 (0x3d0e bytes) 000379 1782223613.984690 write 0x0097d9 thru 0x00af76 (0x179e bytes) 000380 1782223613.995631 punch from 0x002b27 to 0x00401c (0x14f6 bytes) 000381 1782223614.002562 write 0x0228d1 thru 0x02314d (0x87d bytes) 000382 1782223614.004293 mapread 0x01af9f thru 0x02314d (0x81af bytes) 000383 1782223614.018898 write 0x0299e5 thru 0x03671f (0xcd3b bytes) 000384 1782223614.023645 write 0x0030e0 thru 0x009702 (0x6623 bytes) 000385 1782223614.051521 write 0x03118c thru 0x03e41a (0xd28f bytes) 000386 1782223614.064541 read 0x006731 thru 0x0083b8 (0x1c88 bytes) 000387 1782223614.072534 read 0x00d898 thru 0x00e95e (0x10c7 bytes) 000388 1782223614.074412 mapwrite 0x0088ed thru 0x00e567 (0x5c7b bytes) 000389 1782223614.092441 write 0x02d702 thru 0x03270f (0x500e bytes) 000390 1782223614.096465 read 0x003db7 thru 0x006025 (0x226f bytes) 000392 1782223614.098095 write 0x00d7d8 thru 0x012dd4 (0x55fd bytes) 000393 1782223614.109567 punch from 0x00e3ec to 0x01ce52 (0xea67 bytes) 000394 1782223614.124264 write 0x0161d7 thru 0x01e6d5 (0x84ff bytes) 000395 1782223614.140879 write 0x0073c8 thru 0x00d2f2 (0x5f2b bytes) 000396 1782223614.143478 trunc from 0x027806 to 0x0330d8 (0xb8d3 bytes) 000397 1782223614.150586 read 0x03e3e9 thru 0x03e41a (0x32 bytes) 000398 1782223614.154443 write 0x00ed47 thru 0x0107ba (0x1a74 bytes) 000399 1782223614.179114 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e41b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e41b): Mirror 4: 0xe86ddd4 (stale) Mirror 6: 0xe86ddd4 (stale) Mirror 7: 0xe86ddd4 (stale) CRC-32 checksum value for chunk [0, 0x3e41b): Mirror 1: 0xb9034444 Mirror 8: 0xb9034444 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e41b: skipped 000400 1782223615.427443 punch from 0x028170 to 0x02a13f (0x1fd0 bytes) 000401 1782223615.480179 fallocate 0x00ff1e thru 0x01ccaf (0xcd92 bytes) 000402 1782223615.488235 trunc from 0x03e41b to 0x038be7 (0x5833 bytes) 000403 1782223615.540183 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38be8): Mirror 6: 0xaf4c1ccf (stale) Mirror 7: 0xaf4c1ccf (stale) Mirror 8: 0xe72ba0cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38be8): Mirror 6: 0xaf4c1ccf (stale) Mirror 7: 0xaf4c1ccf (stale) Mirror 8: 0xe72ba0cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38be8: skipped 000404 1782223616.127230 mapread 0x016aa2 thru 0x01b93e (0x4e9d bytes) 000405 1782223616.162592 write 0x018175 thru 0x01bfe9 (0x3e75 bytes) 000406 1782223616.174928 trunc from 0x038be8 to 0x02113f (0x17aa8 bytes) 000407 1782223616.213306 fallocate 0x005361 thru 0x0109b9 (0xb659 bytes) 000408 1782223616.224267 fallocate 0x027a71 thru 0x02852b (0xabb bytes) 000409 1782223616.231499 trunc from 0x009b64 to 0x01488b (0xad28 bytes) 000410 1782223616.238137 read 0x01c7af thru 0x02513c (0x898e bytes) 000411 1782223616.251578 mapread 0x00a0bf thru 0x0135fd (0x953f bytes) 000412 1782223616.283085 trunc from 0x02852c to 0x0332f1 (0xadc6 bytes) 000413 1782223616.314847 mapread 0x024a3f thru 0x02d07c (0x863e bytes) 000414 1782223616.327163 trunc from 0x005c8f to 0x011951 (0xbcc3 bytes) 000415 1782223616.334467 read 0x00f8d5 thru 0x00fa28 (0x154 bytes) 000417 1782223616.354813 write 0x0399fe thru 0x03ffff (0x6602 bytes) 000418 1782223616.367119 fallocate 0x02a24f thru 0x030408 (0x61ba bytes) 000419 1782223616.377587 mapwrite 0x0017de thru 0x00b5f9 (0x9e1c bytes) 000420 1782223616.412452 mapwrite 0x03b100 thru 0x03ebe0 (0x3ae1 bytes) 000421 1782223616.432177 fallocate 0x0260a4 thru 0x031adf (0xba3c bytes) 000422 1782223616.437690 punch from 0x02726b to 0x029fd9 (0x2d6f bytes) 000423 1782223616.444335 read 0x03f002 thru 0x03ffff (0xffe bytes) 000424 1782223616.445577 write 0x00dc62 thru 0x01cbcc (0xef6b bytes) 000425 1782223616.448530 punch from 0x037204 to 0x03ffff (0x8dfc bytes) 000426 1782223616.455406 write 0x0146ae thru 0x01ffaf (0xb902 bytes) 000427 1782223616.459160 mapwrite 0x00f446 thru 0x01d9ee (0xe5a9 bytes) 000428 1782223616.493174 mapread 0x01c065 thru 0x021bfe (0x5b9a bytes) 000429 1782223616.495439 read 0x00bdc6 thru 0x013bb3 (0x7dee bytes) 000430 1782223616.496396 mapwrite 0x038336 thru 0x03ecf9 (0x69c4 bytes) 000431 1782223616.534373 trunc from 0x040000 to 0x03e6c7 (0x1938 bytes) 000432 1782223616.559485 read 0x016ce4 thru 0x01cde3 (0x6100 bytes) 000433 1782223616.561218 read 0x039e6d thru 0x03c381 (0x2515 bytes) 000434 1782223616.562932 write 0x000ac8 thru 0x007c28 (0x7161 bytes) 000435 1782223616.564988 write 0x025795 thru 0x02c3e3 (0x6c4f bytes) 000436 1782223616.566274 punch from 0x03403e to 0x03e6c7 (0xa68a bytes) 000437 1782223616.577378 read 0x02e584 thru 0x03db04 (0xf581 bytes) 000438 1782223616.591233 mapread 0x021e3b thru 0x02af8f (0x9155 bytes) 000439 1782223616.593553 trunc from 0x02a0d8 to 0x030bd6 (0x6aff bytes) 000440 1782223616.632068 trunc from 0x03e6c8 to 0x001da3 (0x3c924 bytes) 000441 1782223616.673590 punch from 0x000759 to 0x000ec1 (0x769 bytes) 000442 1782223616.684798 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1da4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1da4): Mirror 6: 0x889a191d (stale) Mirror 7: 0x889a191d (stale) Mirror 8: 0xb3fc07e3 (stale) CRC-32 checksum value for chunk [0, 0x1da4): Mirror 1: 0x9783987d Mirror 9: 0x9783987d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1da4: skipped 000443 1782223617.591883 punch from 0x001358 to 0x001da3 (0xa4c bytes) 000444 1782223617.663308 fallocate 0x0247bf thru 0x02d5be (0x8e00 bytes) 000445 1782223617.672324 trunc from 0x02d5bf to 0x03d1c7 (0xfc09 bytes) 000446 1782223617.786283 mapwrite 0x033fe3 thru 0x035d96 (0x1db4 bytes) 000447 1782223617.836903 write 0x026a2b thru 0x02df7d (0x7553 bytes) 000448 1782223617.852463 trunc from 0x015284 to 0x015565 (0x2e2 bytes) 000449 1782223617.864371 punch from 0x02e84f to 0x03d1c7 (0xe979 bytes) 000450 1782223617.877436 mapwrite 0x029dbd thru 0x02c6f7 (0x293b bytes) 000452 1782223617.911229 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d1c8): Mirror 6: 0xbfa059b1 (stale) Mirror 7: 0xbfa059b1 (stale) Mirror 9: 0xaa963287 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1c8): Mirror 6: 0xbfa059b1 (stale) Mirror 7: 0xbfa059b1 (stale) Mirror 9: 0xaa963287 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1c8: skipped 000453 1782223618.489789 punch from 0x00e71d to 0x014d6e (0x6652 bytes) 000454 1782223618.498463 read 0x02ee67 thru 0x03a2eb (0xb485 bytes) 000456 1782223618.512837 mapread 0x008572 thru 0x008f0f (0x99e bytes) 000457 1782223618.524996 punch from 0x0197bb to 0x020b61 (0x73a7 bytes) 000458 1782223618.531590 fallocate 0x035802 thru 0x03703f (0x183e bytes) 000459 1782223618.537969 punch from 0x01980a to 0x025ac0 (0xc2b7 bytes) 000460 1782223618.545091 read 0x02c433 thru 0x036406 (0x9fd4 bytes) 000461 1782223618.565264 trunc from 0x01dd75 to 0x02242a (0x46b6 bytes) 000462 1782223618.574215 punch from 0x00adf9 to 0x016f49 (0xc151 bytes) 000463 1782223618.581378 trunc from 0x03d1c8 to 0x02f80c (0xd9bb bytes) 000464 1782223618.606379 write 0x034b57 thru 0x03ffff (0xb4a9 bytes) 000465 1782223618.608138 read 0x00a89f thru 0x00bb38 (0x129a bytes) 000466 1782223618.618709 write 0x01467c thru 0x0218a5 (0xd22a bytes) 000467 1782223618.620316 write 0x01d79b thru 0x02afae (0xd814 bytes) 000468 1782223618.622503 write 0x02ebba thru 0x03c01f (0xd466 bytes) 000469 1782223618.625948 trunc from 0x001d49 to 0x00b47c (0x9734 bytes) 000470 1782223618.636212 mapwrite 0x016d60 thru 0x022394 (0xb635 bytes) 000471 1782223618.663495 read 0x0018e6 thru 0x004b26 (0x3241 bytes) 000472 1782223618.673312 punch from 0x0345c3 to 0x034cb8 (0x6f6 bytes) 000473 1782223618.679122 punch from 0x024535 to 0x028073 (0x3b3f bytes) 000474 1782223618.685516 read 0x037aea thru 0x03aa7c (0x2f93 bytes) 000476 1782223618.688845 trunc from 0x027b37 to 0x02be85 (0x434f bytes) 000477 1782223618.696248 fallocate 0x02d75a thru 0x03a3cd (0xcc74 bytes) 000478 1782223618.709240 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7259ef70 (stale) Mirror 7: 0x7259ef70 (stale) Mirror 9: 0x9227f4c5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7ac22e2d Mirror 10: 0x7ac22e2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1782223620.041920 read 0x024013 thru 0x02b5d7 (0x75c5 bytes) 000480 1782223620.060269 punch from 0x038887 to 0x03ffff (0x7779 bytes) 000481 1782223620.102471 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7259ef70 (stale) Mirror 9: 0x9227f4c5 (stale) Mirror 10: 0x7ac22e2d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7259ef70 (stale) Mirror 9: 0x9227f4c5 (stale) Mirror 10: 0x7ac22e2d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000482 1782223620.393125 mapwrite 0x019cb4 thru 0x020c8d (0x6fda bytes) 000483 1782223620.443706 write 0x025e74 thru 0x035b76 (0xfd03 bytes) 000484 1782223620.472126 mapwrite 0x038cee thru 0x03ce4a (0x415d bytes) 000485 1782223620.539134 write 0x01e248 thru 0x0295c3 (0xb37c bytes) 000486 1782223620.543507 mapread 0x029d7b thru 0x02ce77 (0x30fd bytes) 000487 1782223620.547977 read 0x010794 thru 0x01fb29 (0xf396 bytes) 000488 1782223620.560150 write 0x0119f4 thru 0x01acc6 (0x92d3 bytes) 000490 1782223620.563289 mapread 0x012d6e thru 0x01f60e (0xc8a1 bytes) 000491 1782223620.565289 trunc from 0x040000 to 0x01fcf9 (0x20306 bytes) 000492 1782223620.586035 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1fcfa): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fcfa): Mirror 6: 0xe316f186 (stale) Mirror 9: 0xdbee0ee0 (stale) Mirror 10: 0x65b472f7 (stale) CRC-32 checksum value for chunk [0, 0x1fcfa): Mirror 1: 0x159987e2 Mirror 11: 0x159987e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fcfa: skipped 000493 1782223621.338576 trunc from 0x01fcfa to 0x01e305 (0x19f4 bytes) 000495 1782223621.416143 write 0x035a65 thru 0x03d80d (0x7da9 bytes) 000496 1782223621.419185 fallocate 0x0286be thru 0x031a3e (0x9381 bytes) 000497 1782223621.425927 write 0x03f922 thru 0x03ffff (0x6de bytes) 000498 1782223621.429027 trunc from 0x040000 to 0x0312ac (0xed53 bytes) 000499 1782223621.452578 mapwrite 0x03d5f0 thru 0x03ffff (0x2a10 bytes) 000500 1782223621.536005 read 0x01bb7e thru 0x026382 (0xa805 bytes) 000501 1782223621.566372 mapwrite 0x00a1c2 thru 0x00bf52 (0x1d91 bytes) 000502 1782223621.616555 mapwrite 0x01e656 thru 0x01e793 (0x13e bytes) 000503 1782223621.641294 fallocate 0x00a4ac thru 0x018b8a (0xe6df bytes) 000504 1782223621.652693 write 0x006f27 thru 0x00b0a9 (0x4183 bytes) 000505 1782223621.669340 fallocate 0x01ee95 thru 0x023db4 (0x4f20 bytes) 000506 1782223621.689880 trunc from 0x0087c9 to 0x00fe17 (0x764f bytes) 000507 1782223621.716334 write 0x0387e9 thru 0x03ffff (0x7817 bytes) 000509 1782223621.737148 read 0x03e0cf thru 0x03ffff (0x1f31 bytes) 000510 1782223621.744338 mapwrite 0x03d271 thru 0x03e843 (0x15d3 bytes) 000511 1782223621.777923 trunc from 0x040000 to 0x025e61 (0x1a19e bytes) 000512 1782223621.793335 read 0x01f2de thru 0x02546e (0x6191 bytes) 000513 1782223621.794889 mapread 0x011d9c thru 0x01f55d (0xd7c2 bytes) 000514 1782223621.806536 read 0x00e26f thru 0x0194a5 (0xb237 bytes) 000515 1782223621.807672 write 0x02e711 thru 0x033df3 (0x56e3 bytes) 000516 1782223621.809533 punch from 0x011533 to 0x0151f1 (0x3cbf bytes) 000517 1782223621.816379 read 0x01c733 thru 0x024766 (0x8034 bytes) 000518 1782223621.817311 trunc from 0x00982d to 0x011bbf (0x8393 bytes) 000519 1782223621.823019 trunc from 0x007d4f to 0x00de2f (0x60e1 bytes) 000520 1782223621.828510 write 0x01c2bd thru 0x024cf1 (0x8a35 bytes) 000521 1782223621.835114 trunc from 0x019c93 to 0x029967 (0xfcd5 bytes) 000522 1782223621.850327 mapread 0x0175a8 thru 0x01b7ee (0x4247 bytes) 000524 1782223621.866294 punch from 0x008837 to 0x00f939 (0x7103 bytes) 000525 1782223621.872178 mapwrite 0x02c5e8 thru 0x02daf5 (0x150e bytes) 000527 1782223621.886266 trunc from 0x033df4 to 0x003e4b (0x2ffa8 bytes) 000528 1782223621.907376 read 0x000614 thru 0x003e4b (0x3838 bytes) 000529 1782223621.909001 trunc from 0x000e68 to 0x003e4b (0x2fe4 bytes) 000533 1782223621.924856 MIRROR_RESYNC 5 mirrors 000534 1782223623.082113 read 0x002421 thru 0x003e4b (0x1a2b bytes) 000536 1782223623.088232 punch from 0x0031b5 to 0x003e4b (0xc97 bytes) 000537 1782223623.130195 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e4c): Mirror 6: 0x6e744d18 (stale) Mirror 9: 0x6e744d18 (stale) Mirror 11: 0x6e744d18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4c): Mirror 6: 0x6e744d18 (stale) Mirror 9: 0x6e744d18 (stale) Mirror 11: 0x6e744d18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4c: skipped 000538 1782223623.433862 mapread 0x003100 thru 0x003e4b (0xd4c bytes) 000539 1782223623.441758 punch from 0x000dee to 0x003d5d (0x2f70 bytes) 000540 1782223623.447200 read 0x0003bb thru 0x003e4b (0x3a91 bytes) 000541 1782223623.453929 fallocate 0x015932 thru 0x01e0fb (0x87ca bytes) 000542 1782223623.459956 trunc from 0x002246 to 0x003e4b (0x1c06 bytes) 000543 1782223623.474026 read 0x001cc3 thru 0x003e4b (0x2189 bytes) 000544 1782223623.483217 fallocate 0x02ceb2 thru 0x036da2 (0x9ef1 bytes) 000546 1782223623.496051 read 0x0033ad thru 0x003e4b (0xa9f bytes) 000547 1782223623.505124 MIRROR_RESYNC 4 mirrors 000548 1782223624.592287 fallocate 0x030cd3 thru 0x03fb17 (0xee45 bytes) 000549 1782223624.652634 write 0x035e8f thru 0x039c72 (0x3de4 bytes) 000550 1782223624.682347 trunc from 0x03fb18 to 0x00a1c6 (0x35951 bytes) 000551 1782223624.711998 punch from 0x004c09 to 0x005ef2 (0x12ea bytes) 000552 1782223624.718404 mapread 0x003aab thru 0x006f01 (0x3457 bytes) 000553 1782223624.747061 mapwrite 0x031cf3 thru 0x038767 (0x6a75 bytes) 000554 1782223624.793104 trunc from 0x005c20 to 0x00ad57 (0x5138 bytes) 000555 1782223624.799656 write 0x03fa1f thru 0x03ffff (0x5e1 bytes) 000557 1782223624.801333 mapread 0x02384e thru 0x030bc5 (0xd378 bytes) 000558 1782223624.818195 mapread 0x0064ff thru 0x00d430 (0x6f32 bytes) 000559 1782223624.834242 read 0x034933 thru 0x037510 (0x2bde bytes) 000560 1782223624.839447 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7259ef70 (stale) Mirror 9: 0x7259ef70 (stale) Mirror 11: 0x7259ef70 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b9f997e Mirror 12: 0x9b9f997e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000561 1782223626.181012 read 0x01b287 thru 0x027a01 (0xc77b bytes) 000563 1782223626.232729 trunc from 0x040000 to 0x0236fa (0x1c905 bytes) 000564 1782223626.306128 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x236fb): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x236fb): Mirror 6: 0xd79824ff (stale) Mirror 9: 0xd79824ff (stale) Mirror 11: 0xd79824ff (stale) Mirror 12: 0xd79824ff (stale) CRC-32 checksum value for chunk [0, 0x236fb): Mirror 1: 0xd79824ff Mirror 13: 0xd79824ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x236fb: skipped 000565 1782223627.295200 mapwrite 0x03cb96 thru 0x03d9fd (0xe68 bytes) 000566 1782223627.388176 MIRROR_RESYNC 6 mirrors 000567 1782223628.867829 trunc from 0x03d9fe to 0x00b59c (0x32461 bytes) 000568 1782223628.913171 trunc from 0x005404 to 0x009afa (0x46f7 bytes) 000569 1782223628.926200 read 0x002e1b thru 0x004125 (0x130b bytes) 000571 1782223628.939910 write 0x002010 thru 0x0091f3 (0x71e4 bytes) 000572 1782223628.948417 mapread 0x00b0a4 thru 0x00b59c (0x4f9 bytes) 000573 1782223628.960209 write 0x039619 thru 0x03ffff (0x69e7 bytes) 000574 1782223628.961903 fallocate 0x01a5dd thru 0x02507a (0xaa9e bytes) 000575 1782223628.970095 trunc from 0x02d11a to 0x03a89f (0xd786 bytes) 000576 1782223628.994149 mapwrite 0x005a0b thru 0x00c0bc (0x66b2 bytes) 000577 1782223629.043374 MIRROR_RESYNC 6 mirrors 000578 1782223630.814199 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) 000579 1782223631.290169 trunc from 0x040000 to 0x02c680 (0x1397f bytes) 000580 1782223631.350850 punch from 0x00afaa to 0x019d7a (0xedd1 bytes) 000581 1782223631.362684 MIRROR_RESYNC 5 mirrors 000583 1782223632.810535 mapwrite 0x013c8f thru 0x0221e6 (0xe558 bytes) 000584 1782223632.994021 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c681): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c681): Mirror 6: 0x3874fbc1 (stale) Mirror 9: 0x3874fbc1 (stale) Mirror 12: 0x3874fbc1 (stale) Mirror 13: 0x3874fbc1 (stale) CRC-32 checksum value for chunk [0, 0x2c681): Mirror 1: 0xb5d1a33e Mirror 14: 0xb5d1a33e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c681: skipped 000585 1782223634.248195 mapread 0x01e16d thru 0x02351b (0x53af bytes) 000586 1782223634.321776 mapwrite 0x02b3f2 thru 0x039e15 (0xea24 bytes) 000588 1782223634.418222 punch from 0x020f3a to 0x0211b8 (0x27f bytes) 000589 1782223634.426573 mapread 0x013105 thru 0x01f752 (0xc64e bytes) 000591 1782223634.448688 punch from 0x00f0e4 to 0x015b0d (0x6a2a bytes) 000592 1782223634.458815 MIRROR_RESYNC 6 mirrors 000593 1782223636.199088 read 0x0187f0 thru 0x0279f7 (0xf208 bytes) 000594 1782223636.211861 trunc from 0x039e16 to 0x011de0 (0x28035 bytes) 000595 1782223636.258080 read 0x00cbe7 thru 0x00d090 (0x4aa bytes) 000596 1782223636.271852 write 0x00644f thru 0x01456c (0xe11e bytes) 000597 1782223636.274234 trunc from 0x01456d to 0x022f40 (0xe9d4 bytes) 000598 1782223636.303057 mapwrite 0x02a74d thru 0x032b47 (0x83fb bytes) 000599 1782223636.378095 trunc from 0x032b48 to 0x009dc5 (0x28d82 bytes) 000600 1782223636.417575 write 0x018c80 thru 0x02770d (0xea8e bytes) 000601 1782223636.420407 punch from 0x02181e to 0x02770d (0x5ef0 bytes) 000603 1782223636.448662 punch from 0x006c77 to 0x00b855 (0x4bdf bytes) 000604 1782223636.457515 fallocate 0x00180e thru 0x001cdb (0x4ce bytes) 000605 1782223636.466060 read 0x019f69 thru 0x02770d (0xd7a5 bytes) 000608 1782223636.479110 punch from 0x025725 to 0x02770d (0x1fe9 bytes) 000609 1782223636.484739 punch from 0x010d82 to 0x01acd6 (0x9f55 bytes) 000611 1782223636.492816 trunc from 0x02770e to 0x012455 (0x152b8 bytes) 000612 1782223636.508019 trunc from 0x00031a to 0x00488e (0x4575 bytes) 000614 1782223636.515910 write 0x03623f thru 0x03ffff (0x9dc1 bytes) 000615 1782223636.518834 punch from 0x003637 to 0x007e50 (0x481a bytes) 000616 1782223636.529730 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ede03e7 (stale) Mirror 12: 0x6ede03e7 (stale) Mirror 13: 0x6ede03e7 (stale) Mirror 14: 0x6ede03e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ede03e7 (stale) Mirror 12: 0x6ede03e7 (stale) Mirror 13: 0x6ede03e7 (stale) Mirror 14: 0x6ede03e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000617 1782223637.121775 mapread 0x0024e0 thru 0x0103be (0xdedf bytes) 000618 1782223637.150895 mapread 0x008909 thru 0x014cfb (0xc3f3 bytes) 000619 1782223637.170937 write 0x0187ee thru 0x0238d5 (0xb0e8 bytes) 000622 1782223637.191162 mapwrite 0x01553f thru 0x024f50 (0xfa12 bytes) 000623 1782223637.239587 fallocate 0x00e58a thru 0x019601 (0xb078 bytes) 000624 1782223637.249067 punch from 0x007078 to 0x00edb2 (0x7d3b bytes) 000625 1782223637.254746 read 0x00d1ae thru 0x01b6a1 (0xe4f4 bytes) 000626 1782223637.262196 punch from 0x026662 to 0x031882 (0xb221 bytes) 000627 1782223637.274098 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x6ede03e7 (stale) Mirror 12: 0x6ede03e7 (stale) Mirror 13: 0x6ede03e7 (stale) Mirror 14: 0x6ede03e7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa40784dd Mirror 15: 0xa40784dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000628 1782223638.452644 mapwrite 0x027216 thru 0x02ac2d (0x3a18 bytes) 000629 1782223638.610897 read 0x000a93 thru 0x004fa2 (0x4510 bytes) 000630 1782223638.623755 read 0x0178bd thru 0x01baf1 (0x4235 bytes) 000631 1782223638.635864 punch from 0x00afd2 to 0x0134c8 (0x84f7 bytes) 000632 1782223638.641639 trunc from 0x040000 to 0x00f7d9 (0x30826 bytes) 000633 1782223638.703977 trunc from 0x004856 to 0x006c50 (0x23fb bytes) 000634 1782223638.719137 mapread 0x005cc7 thru 0x00f7d9 (0x9b13 bytes) 000635 1782223638.765706 write 0x032d22 thru 0x0393a6 (0x6685 bytes) 000636 1782223638.767316 fallocate 0x028e7e thru 0x033ae6 (0xac69 bytes) 000637 1782223638.773044 punch from 0x010433 to 0x0181d1 (0x7d9f bytes) 000638 1782223638.779059 trunc from 0x0393a7 to 0x01c101 (0x1d2a5 bytes) 000639 1782223638.799395 trunc from 0x01c102 to 0x01245f (0x9ca2 bytes) 000640 1782223638.820869 read 0x00568f thru 0x0084e3 (0x2e55 bytes) 000641 1782223638.825083 trunc from 0x008a47 to 0x01245f (0x9a19 bytes) 000642 1782223638.839869 write 0x00b8a6 thru 0x014381 (0x8adc bytes) 000643 1782223638.879666 MIRROR_RESYNC 6 mirrors 000644 1782223640.417805 punch from 0x0046aa to 0x0071d7 (0x2b2e bytes) 000646 1782223640.456510 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x14382): Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14382): Mirror 9: 0x1e715415 (stale) Mirror 12: 0x1e715415 (stale) Mirror 13: 0x1e715415 (stale) Mirror 14: 0x1e715415 (stale) Mirror 15: 0x1e715415 (stale) CRC-32 checksum value for chunk [0, 0x14382): Mirror 1: 0x1e715415 Mirror 16: 0x1e715415 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14382: skipped 000647 1782223641.413154 fallocate 0x00ee49 thru 0x018a8c (0x9c44 bytes) 000648 1782223641.483235 mapread 0x00bcaa thru 0x010546 (0x489d bytes) 000649 1782223641.519646 mapread 0x003c41 thru 0x008bca (0x4f8a bytes) 000650 1782223641.530966 read 0x00a8d9 thru 0x00c7a1 (0x1ec9 bytes) 000651 1782223641.532740 fallocate 0x00f5b8 thru 0x0150db (0x5b24 bytes) 000652 1782223641.538921 read 0x015fdf thru 0x018a8c (0x2aae bytes) 000653 1782223641.557849 MIRROR_RESYNC 7 mirrors 000654 1782223643.366989 write 0x00391b thru 0x0053c9 (0x1aaf bytes) 000655 1782223643.405129 mapread 0x004eed thru 0x00cfbd (0x80d1 bytes) 000656 1782223643.425775 trunc from 0x009124 to 0x018373 (0xf250 bytes) 000657 1782223643.431056 fallocate 0x02cc2b thru 0x037dfe (0xb1d4 bytes) 000659 1782223643.438960 trunc from 0x0365cb to 0x037dfe (0x1834 bytes) 000660 1782223643.445692 fallocate 0x01effb thru 0x0222a1 (0x32a7 bytes) 000661 1782223643.454480 punch from 0x01ee7a to 0x02d15b (0xe2e2 bytes) 000662 1782223643.469337 punch from 0x015e41 to 0x018200 (0x23c0 bytes) 000663 1782223643.480964 trunc from 0x037dff to 0x0044fe (0x33900 bytes) 000664 1782223643.518114 mapread 0x000cd1 thru 0x002e41 (0x2171 bytes) 000665 1782223643.528473 read 0x001336 thru 0x0044fe (0x31c9 bytes) 000666 1782223643.529533 punch from 0x0008b2 to 0x0044fe (0x3c4d bytes) 000667 1782223643.563338 MIRROR_RESYNC 7 mirrors 000668 1782223645.341471 trunc from 0x0044ff to 0x0357b7 (0x312b9 bytes) 000669 1782223645.376220 fallocate 0x03e3de thru 0x03ffff (0x1c22 bytes) 000670 1782223645.389453 trunc from 0x0357b8 to 0x0354de (0x2d9 bytes) 000671 1782223645.442910 MIRROR_RESYNC 7 mirrors 000672 1782223647.437385 fallocate 0x014d2b thru 0x01fdc8 (0xb09e bytes) 000673 1782223647.503563 fallocate 0x01e224 thru 0x02da25 (0xf802 bytes) 000674 1782223647.527560 mapread 0x027455 thru 0x02d718 (0x62c4 bytes) 000675 1782223647.569859 write 0x01bdb7 thru 0x01dc68 (0x1eb2 bytes) 000676 1782223647.587933 read 0x011ecf thru 0x0149dc (0x2b0e bytes) 000678 1782223647.618574 read 0x031721 thru 0x0354de (0x3dbe bytes) 000679 1782223647.643406 trunc from 0x0287ad to 0x02f688 (0x6edc bytes) 000680 1782223647.656954 punch from 0x01d7a0 to 0x021b45 (0x43a6 bytes) 000681 1782223647.695108 trunc from 0x0354df to 0x01668e (0x1ee50 bytes) 000682 1782223647.755255 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1668f): Mirror 12: 0x28ce7d72 (stale) Mirror 13: 0x28ce7d72 (stale) Mirror 14: 0x28ce7d72 (stale) Mirror 15: 0x28ce7d72 (stale) Mirror 16: 0x28ce7d72 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1668f): Mirror 12: 0x28ce7d72 (stale) Mirror 13: 0x28ce7d72 (stale) Mirror 14: 0x28ce7d72 (stale) Mirror 15: 0x28ce7d72 (stale) Mirror 16: 0x28ce7d72 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1668f: skipped 000684 1782223648.296391 write 0x0299e4 thru 0x02c281 (0x289e bytes) 000685 1782223648.302936 fallocate 0x0183a9 thru 0x01e2f8 (0x5f50 bytes) 000687 1782223648.316076 punch from 0x0001a5 to 0x006b51 (0x69ad bytes) 000688 1782223648.331085 read 0x00ee59 thru 0x013f74 (0x511c bytes) 000689 1782223648.350867 read 0x022343 thru 0x028931 (0x65ef bytes) 000691 1782223648.377015 fallocate 0x01ea82 thru 0x01ec39 (0x1b8 bytes) 000692 1782223648.383684 read 0x009e2b thru 0x0173c9 (0xd59f bytes) 000693 1782223648.384815 mapread 0x023d76 thru 0x0249de (0xc69 bytes) 000694 1782223648.386543 fallocate 0x00a99e thru 0x011205 (0x6868 bytes) 000695 1782223648.400451 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c282): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c282): Mirror 12: 0x3139e846 (stale) Mirror 13: 0x3139e846 (stale) Mirror 14: 0x3139e846 (stale) Mirror 15: 0x3139e846 (stale) Mirror 16: 0x3139e846 (stale) CRC-32 checksum value for chunk [0, 0x2c282): Mirror 1: 0x2fb5162f Mirror 17: 0x2fb5162f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c282: skipped 000696 1782223649.814867 mapwrite 0x024057 thru 0x02c8aa (0x8854 bytes) 000697 1782223650.078219 read 0x00fed8 thru 0x01e147 (0xe270 bytes) 000698 1782223650.092710 trunc from 0x02c8ab to 0x01f648 (0xd262 bytes) 000699 1782223650.133504 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f649): Mirror 12: 0x68cc5830 (stale) Mirror 13: 0x68cc5830 (stale) Mirror 14: 0x68cc5830 (stale) Mirror 16: 0x68cc5830 (stale) Mirror 17: 0x68cc5830 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f649): Mirror 12: 0x68cc5830 (stale) Mirror 13: 0x68cc5830 (stale) Mirror 14: 0x68cc5830 (stale) Mirror 16: 0x68cc5830 (stale) Mirror 17: 0x68cc5830 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f649: skipped 000700 1782223650.622881 trunc from 0x01f649 to 0x0005e3 (0x1f065 bytes) 000701 1782223650.656325 read 0x000582 thru 0x0005e3 (0x62 bytes) 000702 1782223650.663730 fallocate 0x02b398 thru 0x02de1f (0x2a88 bytes) 000703 1782223650.671267 fallocate 0x01f28c thru 0x0212d2 (0x2047 bytes) 000704 1782223650.677795 mapread 0x026fc1 thru 0x02de1f (0x6e5f bytes) 000705 1782223650.700289 fallocate 0x0063ce thru 0x012e14 (0xca47 bytes) 000706 1782223650.705811 mapread 0x00adc9 thru 0x00b6f6 (0x92e bytes) 000707 1782223650.725164 punch from 0x02601e to 0x02de1f (0x7e02 bytes) 000708 1782223650.741442 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2de20): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de20): Mirror 12: 0xd7851a2a (stale) Mirror 13: 0xd7851a2a (stale) Mirror 14: 0xd7851a2a (stale) Mirror 16: 0xd7851a2a (stale) Mirror 17: 0x7d952a2d (stale) CRC-32 checksum value for chunk [0, 0x2de20): Mirror 1: 0xd7851a2a Mirror 18: 0xd7851a2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de20: skipped 000709 1782223652.343507 write 0x011ca1 thru 0x018ade (0x6e3e bytes) 000710 1782223652.458526 punch from 0x02906e to 0x02de1f (0x4db2 bytes) 000711 1782223652.466916 mapwrite 0x029d8f thru 0x02d3e7 (0x3659 bytes) 000714 1782223652.540003 mapwrite 0x01481a thru 0x01c41f (0x7c06 bytes) 000716 1782223652.616364 fallocate 0x022cdb thru 0x023679 (0x99f bytes) 000717 1782223652.634354 fallocate 0x006476 thru 0x014acd (0xe658 bytes) 000718 1782223652.648528 write 0x02d822 thru 0x02dc40 (0x41f bytes) 000719 1782223652.650926 trunc from 0x01f043 to 0x0228ac (0x386a bytes) 000721 1782223652.666516 punch from 0x02cc2f to 0x02de1f (0x11f1 bytes) 000722 1782223652.691652 mapwrite 0x01e8b1 thru 0x022522 (0x3c72 bytes) 000723 1782223652.730200 read 0x01adac thru 0x02846e (0xd6c3 bytes) 000724 1782223652.734741 punch from 0x00cea9 to 0x00e1b0 (0x1308 bytes) 000725 1782223652.748416 read 0x02bc95 thru 0x02de1f (0x218b bytes) 000726 1782223652.769851 punch from 0x0215cf to 0x029130 (0x7b62 bytes) 000727 1782223652.788448 MIRROR_RESYNC 7 mirrors 000728 1782223655.537551 trunc from 0x02de20 to 0x0306a3 (0x2884 bytes) 000729 1782223655.597173 mapwrite 0x014913 thru 0x01c2ae (0x799c bytes) 000730 1782223655.650361 trunc from 0x02af5a to 0x0306a3 (0x574a bytes) 000731 1782223655.660901 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x306a4): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306a4): Mirror 12: 0x1f423c5c (stale) Mirror 13: 0x1f423c5c (stale) Mirror 14: 0x1f423c5c (stale) Mirror 16: 0x1f423c5c (stale) Mirror 17: 0x1f423c5c (stale) Mirror 18: 0x1f423c5c (stale) CRC-32 checksum value for chunk [0, 0x306a4): Mirror 1: 0x429dc052 Mirror 19: 0x429dc052 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306a4: skipped 000733 1782223657.610852 punch from 0x01ec36 to 0x027300 (0x86cb bytes) 000734 1782223657.698204 write 0x037e1f thru 0x03cf39 (0x511b bytes) 000735 1782223657.725446 trunc from 0x00bd1a to 0x0140d4 (0x83bb bytes) 000736 1782223657.734652 punch from 0x028117 to 0x0311be (0x90a8 bytes) 000737 1782223657.761312 trunc from 0x02734d to 0x033003 (0xbcb7 bytes) 000739 1782223657.773804 punch from 0x01984d to 0x01b5e8 (0x1d9c bytes) 000740 1782223657.801708 trunc from 0x03cf3a to 0x006a3b (0x364fe bytes) 000741 1782223657.864989 MIRROR_RESYNC 8 mirrors 000742 1782223659.646900 write 0x03fe41 thru 0x03ffff (0x1bf bytes) 000743 1782223659.677203 trunc from 0x040000 to 0x03eeff (0x1100 bytes) 000744 1782223659.705800 mapread 0x0215ab thru 0x0247df (0x3235 bytes) 000745 1782223659.732198 trunc from 0x03ef00 to 0x03d4f2 (0x1a0d bytes) 000746 1782223659.756806 mapwrite 0x002877 thru 0x01106f (0xe7f9 bytes) 000747 1782223659.823539 punch from 0x028cf1 to 0x02b2e9 (0x25f9 bytes) 000748 1782223659.843681 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d4f3): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4f3): Mirror 12: 0x287c0e96 (stale) Mirror 13: 0x287c0e96 (stale) Mirror 14: 0x287c0e96 (stale) Mirror 16: 0x287c0e96 (stale) Mirror 17: 0x287c0e96 (stale) Mirror 18: 0x287c0e96 (stale) Mirror 19: 0x287c0e96 (stale) CRC-32 checksum value for chunk [0, 0x3d4f3): Mirror 1: 0x7bed8672 Mirror 20: 0x7bed8672 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4f3: skipped 000749 1782223661.329846 read 0x024ae6 thru 0x028d8b (0x42a6 bytes) 000750 1782223661.369996 write 0x03ed8e thru 0x03ffff (0x1272 bytes) 000751 1782223661.474226 read 0x0283e4 thru 0x028fd1 (0xbee bytes) 000752 1782223661.523832 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0x6c78408 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0x6c78408 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000753 1782223662.360182 read 0x0252f2 thru 0x027aac (0x27bb bytes) 000755 1782223662.380160 mapwrite 0x034de8 thru 0x03ffff (0xb218 bytes) 000756 1782223662.456381 write 0x02705a thru 0x029bf3 (0x2b9a bytes) 000757 1782223662.497300 fallocate 0x010aa2 thru 0x01cf26 (0xc485 bytes) 000758 1782223662.507159 read 0x036e82 thru 0x03ffff (0x917e bytes) 000759 1782223662.511437 mapwrite 0x0139ab thru 0x01bdcf (0x8425 bytes) 000760 1782223662.582318 trunc from 0x02ada8 to 0x0323e2 (0x763b bytes) 000761 1782223662.592817 trunc from 0x040000 to 0x012a5f (0x2d5a0 bytes) 000762 1782223662.634100 trunc from 0x012a60 to 0x02d335 (0x1a8d6 bytes) 000763 1782223662.656867 fallocate 0x004807 thru 0x005982 (0x117c bytes) 000764 1782223662.665394 write 0x01dff4 thru 0x0270b1 (0x90be bytes) 000765 1782223662.685756 trunc from 0x02240f to 0x02d335 (0xaf27 bytes) 000766 1782223662.709261 trunc from 0x0109c1 to 0x01e0f6 (0xd736 bytes) 000767 1782223662.718896 mapwrite 0x00d5c8 thru 0x00ecc5 (0x16fe bytes) 000768 1782223662.740223 trunc from 0x02d336 to 0x03b1e5 (0xdeb0 bytes) 000769 1782223662.766351 trunc from 0x0376aa to 0x03a04b (0x29a2 bytes) 000770 1782223662.773722 mapwrite 0x01029a thru 0x01e457 (0xe1be bytes) 000771 1782223662.987954 trunc from 0x03b1e6 to 0x0070c6 (0x3411f bytes) 000772 1782223663.010096 punch from 0x001932 to 0x005023 (0x36f2 bytes) 000773 1782223663.016435 read 0x002311 thru 0x0070c6 (0x4db6 bytes) 000774 1782223663.026061 punch from 0x004faf to 0x0070c6 (0x2118 bytes) 000775 1782223663.031245 trunc from 0x0070c7 to 0x00e2a9 (0x71e3 bytes) 000776 1782223663.050512 MIRROR_RESYNC 8 mirrors 000777 1782223664.784420 fallocate 0x037e9b thru 0x03ffff (0x8165 bytes) 000778 1782223664.817440 mapread 0x00b957 thru 0x00e2a9 (0x2953 bytes) 000779 1782223664.839660 read 0x004431 thru 0x00c359 (0x7f29 bytes) 000780 1782223664.851555 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xe2aa): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe2aa): Mirror 13: 0x820cc447 (stale) Mirror 14: 0x820cc447 (stale) Mirror 16: 0x820cc447 (stale) Mirror 17: 0x820cc447 (stale) Mirror 18: 0x820cc447 (stale) Mirror 19: 0x820cc447 (stale) Mirror 20: 0x820cc447 (stale) CRC-32 checksum value for chunk [0, 0xe2aa): Mirror 1: 0x820cc447 Mirror 21: 0x820cc447 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe2aa: skipped 000781 1782223666.189558 mapwrite 0x00c064 thru 0x017fd0 (0xbf6d bytes) 000782 1782223666.414059 mapwrite 0x016fab thru 0x0188a5 (0x18fb bytes) 000783 1782223666.509739 mapwrite 0x00c6fe thru 0x017ae0 (0xb3e3 bytes) 000784 1782223666.606317 read 0x0170cb thru 0x0188a5 (0x17db bytes) 000785 1782223666.631790 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x188a6): Mirror 13: 0xb5e6178f (stale) Mirror 14: 0xb5e6178f (stale) Mirror 16: 0xb5e6178f (stale) Mirror 17: 0xb5e6178f (stale) Mirror 18: 0xb5e6178f (stale) Mirror 19: 0xb5e6178f (stale) Mirror 21: 0xb5e6178f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x188a6): Mirror 13: 0xb5e6178f (stale) Mirror 14: 0xb5e6178f (stale) Mirror 16: 0xb5e6178f (stale) Mirror 17: 0xb5e6178f (stale) Mirror 18: 0xb5e6178f (stale) Mirror 19: 0xb5e6178f (stale) Mirror 21: 0xb5e6178f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x188a6: skipped 000786 1782223667.369155 read 0x000e90 thru 0x0028b1 (0x1a22 bytes) 000787 1782223667.377006 fallocate 0x012976 thru 0x01f801 (0xce8c bytes) 000788 1782223667.385186 punch from 0x00f127 to 0x0188a5 (0x977f bytes) 000789 1782223667.394673 write 0x022164 thru 0x02fa91 (0xd92e bytes) 000790 1782223667.402967 trunc from 0x02fa92 to 0x016b78 (0x18f19 bytes) 000791 1782223667.430187 mapwrite 0x019051 thru 0x026ff5 (0xdfa5 bytes) 000792 1782223667.527469 read 0x00d46e thru 0x01c7af (0xf342 bytes) 000793 1782223667.539970 trunc from 0x026ff6 to 0x022a47 (0x45ae bytes) 000795 1782223667.564142 trunc from 0x022a48 to 0x01fd09 (0x2d3e bytes) 000796 1782223667.588410 fallocate 0x02442b thru 0x026137 (0x1d0d bytes) 000797 1782223667.595862 fallocate 0x010747 thru 0x013531 (0x2deb bytes) 000798 1782223667.606967 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x26138): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26138): Mirror 13: 0x617ce4ea (stale) Mirror 14: 0x617ce4ea (stale) Mirror 16: 0x617ce4ea (stale) Mirror 17: 0x617ce4ea (stale) Mirror 18: 0x617ce4ea (stale) Mirror 19: 0x617ce4ea (stale) Mirror 21: 0x617ce4ea (stale) CRC-32 checksum value for chunk [0, 0x26138): Mirror 1: 0x1f3b844d Mirror 22: 0x1f3b844d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26138: skipped 000799 1782223668.959571 MIRROR_RESYNC 9 mirrors 000800 1782223672.410998 fallocate 0x022639 thru 0x02c60b (0x9fd3 bytes) 000801 1782223672.460350 trunc from 0x02c60c to 0x007491 (0x2517a bytes) 000802 1782223672.489185 fallocate 0x034ad9 thru 0x03b04b (0x6573 bytes) 000804 1782223672.498332 mapread 0x006851 thru 0x007491 (0xc41 bytes) 000805 1782223672.513796 trunc from 0x007492 to 0x000392 (0x70ff bytes) 000806 1782223672.544314 punch from 0x000118 to 0x000392 (0x27b bytes) 000807 1782223672.553240 trunc from 0x000256 to 0x000392 (0x13d bytes) 000808 1782223672.566652 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x393): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393): Mirror 13: 0x82b0a9bc (stale) Mirror 14: 0x82b0a9bc (stale) Mirror 16: 0x82b0a9bc (stale) Mirror 17: 0x82b0a9bc (stale) Mirror 18: 0x82b0a9bc (stale) Mirror 19: 0x82b0a9bc (stale) Mirror 21: 0x82b0a9bc (stale) Mirror 22: 0x82b0a9bc (stale) CRC-32 checksum value for chunk [0, 0x393): Mirror 1: 0x82b0a9bc Mirror 23: 0x82b0a9bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393: skipped 000810 1782223673.684388 trunc from 0x000393 to 0x0280fb (0x27d69 bytes) 000812 1782223673.750343 write 0x02b982 thru 0x02e571 (0x2bf0 bytes) 000813 1782223673.760323 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2e572): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e572): Mirror 13: 0xda9816ad (stale) Mirror 14: 0xda9816ad (stale) Mirror 16: 0xda9816ad (stale) Mirror 17: 0xda9816ad (stale) Mirror 18: 0xda9816ad (stale) Mirror 19: 0xda9816ad (stale) Mirror 21: 0xda9816ad (stale) Mirror 22: 0xda9816ad (stale) Mirror 23: 0x45866de7 (stale) CRC-32 checksum value for chunk [0, 0x2e572): Mirror 1: 0x974871ff Mirror 24: 0x974871ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e572: skipped 000815 1782223675.089543 mapwrite 0x015c32 thru 0x0191ce (0x359d bytes) 000816 1782223675.252277 fallocate 0x004c49 thru 0x007837 (0x2bef bytes) 000817 1782223675.261538 fallocate 0x01773c thru 0x021ba6 (0xa46b bytes) 000818 1782223675.276217 read 0x00bfe4 thru 0x011c45 (0x5c62 bytes) 000819 1782223675.290289 mapwrite 0x00ccee thru 0x01520e (0x8521 bytes) 000820 1782223675.333070 MIRROR_RESYNC 11 mirrors 000821 1782223678.321289 fallocate 0x02c69d thru 0x035b26 (0x948a bytes) 000822 1782223678.366487 mapread 0x007ab6 thru 0x00efbe (0x7509 bytes) 000823 1782223678.408116 trunc from 0x035b27 to 0x0312ce (0x4858 bytes) 000824 1782223678.450799 trunc from 0x0312cf to 0x00319e (0x2e130 bytes) 000825 1782223678.486658 punch from 0x000415 to 0x00319e (0x2d8a bytes) 000827 1782223678.513942 MIRROR_RESYNC 11 mirrors 000828 1782223680.230715 mapwrite 0x03e2de thru 0x03f1eb (0xf0e bytes) 000829 1782223680.348223 mapread 0x020b98 thru 0x02df85 (0xd3ee bytes) 000830 1782223680.374878 trunc from 0x0070e4 to 0x00720e (0x12b bytes) 000831 1782223680.381707 mapwrite 0x032d40 thru 0x03a613 (0x78d4 bytes) 000832 1782223680.416143 trunc from 0x03f1ec to 0x0131da (0x2c011 bytes) 000833 1782223680.462089 trunc from 0x0131db to 0x022504 (0xf32a bytes) 000834 1782223680.488879 fallocate 0x0017d3 thru 0x007c04 (0x6432 bytes) 000836 1782223680.508346 mapwrite 0x0095be thru 0x00dd60 (0x47a3 bytes) 000837 1782223680.536950 mapread 0x00880d thru 0x018079 (0xf86d bytes) 000838 1782223680.547342 mapwrite 0x02aa54 thru 0x02b35d (0x90a bytes) 000839 1782223680.605325 write 0x02c1c2 thru 0x02fc87 (0x3ac6 bytes) 000840 1782223680.609713 punch from 0x004c8d to 0x00f03e (0xa3b2 bytes) 000841 1782223680.618069 fallocate 0x00c271 thru 0x0193c7 (0xd157 bytes) 000842 1782223680.628184 fallocate 0x018938 thru 0x01ff6c (0x7635 bytes) 000843 1782223680.634513 punch from 0x008ebd to 0x013ec6 (0xb00a bytes) 000844 1782223680.642991 read 0x01e207 thru 0x01fe7a (0x1c74 bytes) 000845 1782223680.651184 read 0x01f947 thru 0x02577e (0x5e38 bytes) 000846 1782223680.664019 write 0x03915d thru 0x03d1f3 (0x4097 bytes) 000847 1782223680.669361 trunc from 0x03d1f4 to 0x0275f9 (0x15bfa bytes) 000848 1782223680.700465 mapread 0x018653 thru 0x0257c7 (0xd175 bytes) 000849 1782223680.704183 read 0x0124c6 thru 0x019e03 (0x793e bytes) 000850 1782223680.705138 trunc from 0x0275fa to 0x016ea2 (0x10757 bytes) 000851 1782223680.725346 trunc from 0x00516b to 0x005307 (0x19d bytes) 000852 1782223680.745365 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16ea3): Mirror 13: 0x9abf197a (stale) Mirror 16: 0x9abf197a (stale) Mirror 17: 0x9abf197a (stale) Mirror 18: 0x9abf197a (stale) Mirror 19: 0x9abf197a (stale) Mirror 21: 0x9abf197a (stale) Mirror 22: 0x9abf197a (stale) Mirror 23: 0x9abf197a (stale) Mirror 24: 0x9abf197a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16ea3): Mirror 13: 0x9abf197a (stale) Mirror 16: 0x9abf197a (stale) Mirror 17: 0x9abf197a (stale) Mirror 18: 0x9abf197a (stale) Mirror 19: 0x9abf197a (stale) Mirror 21: 0x9abf197a (stale) Mirror 22: 0x9abf197a (stale) Mirror 23: 0x9abf197a (stale) Mirror 24: 0x9abf197a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16ea3: skipped 000853 1782223681.591486 fallocate 0x01372d thru 0x01e14d (0xaa21 bytes) 000854 1782223681.599951 mapwrite 0x02656f thru 0x02fcf9 (0x978b bytes) 000855 1782223681.697128 punch from 0x012378 to 0x01e2ae (0xbf37 bytes) 000856 1782223681.701904 trunc from 0x00caac to 0x00d628 (0xb7d bytes) 000857 1782223681.714743 mapwrite 0x00cc59 thru 0x01bb87 (0xef2f bytes) 000858 1782223681.786381 read 0x00f2c5 thru 0x013e86 (0x4bc2 bytes) 000860 1782223681.789764 trunc from 0x02fcfa to 0x00ae5b (0x24e9e bytes) 000861 1782223681.818165 write 0x0313e3 thru 0x033f0c (0x2b2a bytes) 000863 1782223681.824103 trunc from 0x00073e to 0x00ff16 (0xf7d9 bytes) 000864 1782223681.837553 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33f0d): Mirror 13: 0x6d10dd5 (stale) Mirror 17: 0x6d10dd5 (stale) Mirror 18: 0x6d10dd5 (stale) Mirror 19: 0x6d10dd5 (stale) Mirror 21: 0x6d10dd5 (stale) Mirror 22: 0x6d10dd5 (stale) Mirror 23: 0x6d10dd5 (stale) Mirror 24: 0x6d10dd5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f0d): Mirror 13: 0x6d10dd5 (stale) Mirror 17: 0x6d10dd5 (stale) Mirror 18: 0x6d10dd5 (stale) Mirror 19: 0x6d10dd5 (stale) Mirror 21: 0x6d10dd5 (stale) Mirror 22: 0x6d10dd5 (stale) Mirror 23: 0x6d10dd5 (stale) Mirror 24: 0x6d10dd5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f0d: skipped 000865 1782223682.463077 read 0x01b2f0 thru 0x01c4e4 (0x11f5 bytes) 000866 1782223682.470064 read 0x00c1d3 thru 0x014d54 (0x8b82 bytes) 000868 1782223682.491356 MIRROR_RESYNC 9 mirrors 000869 1782223684.059967 read 0x02b832 thru 0x02bcf9 (0x4c8 bytes) 000870 1782223684.065252 write 0x03fad0 thru 0x03ffff (0x530 bytes) 000871 1782223684.115210 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x7656e9c0 (stale) Mirror 17: 0x7656e9c0 (stale) Mirror 18: 0x7656e9c0 (stale) Mirror 19: 0x7656e9c0 (stale) Mirror 21: 0x7656e9c0 (stale) Mirror 22: 0x7656e9c0 (stale) Mirror 24: 0x7656e9c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x7656e9c0 (stale) Mirror 17: 0x7656e9c0 (stale) Mirror 18: 0x7656e9c0 (stale) Mirror 19: 0x7656e9c0 (stale) Mirror 21: 0x7656e9c0 (stale) Mirror 22: 0x7656e9c0 (stale) Mirror 24: 0x7656e9c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000872 1782223684.946386 mapread 0x02857b thru 0x02fae0 (0x7566 bytes) 000873 1782223685.015181 write 0x033a7b thru 0x03f282 (0xb808 bytes) 000874 1782223685.044039 mapwrite 0x018b30 thru 0x0287d6 (0xfca7 bytes) 000875 1782223685.129548 trunc from 0x02542d to 0x033f31 (0xeb05 bytes) 000876 1782223685.134973 trunc from 0x010c03 to 0x018129 (0x7527 bytes) 000877 1782223685.143958 read 0x0039e4 thru 0x00c198 (0x87b5 bytes) 000878 1782223685.165203 trunc from 0x03ac1a to 0x03acb7 (0x9e bytes) 000879 1782223685.175067 mapread 0x010109 thru 0x018f76 (0x8e6e bytes) 000880 1782223685.193825 write 0x03a50d thru 0x03ffff (0x5af3 bytes) 000881 1782223685.201822 read 0x01dea9 thru 0x02ac28 (0xcd80 bytes) 000882 1782223685.244225 mapread 0x00071d thru 0x00ad11 (0xa5f5 bytes) 000883 1782223685.245516 mapwrite 0x006dae thru 0x00c684 (0x58d7 bytes) 000884 1782223685.325004 trunc from 0x01c60f to 0x022779 (0x616b bytes) 000886 1782223685.338182 mapread 0x004633 thru 0x00a58e (0x5f5c bytes) 000887 1782223685.344571 trunc from 0x034aac to 0x03ffff (0xb554 bytes) 000888 1782223685.355143 trunc from 0x02f8b3 to 0x0302c1 (0xa0f bytes) 000889 1782223685.369572 read 0x0388e8 thru 0x039dd7 (0x14f0 bytes) 000890 1782223685.395283 punch from 0x03e0c3 to 0x03ffff (0x1f3d bytes) 000891 1782223685.404330 fallocate 0x0200b5 thru 0x027051 (0x6f9d bytes) 000892 1782223685.412788 read 0x011ec0 thru 0x0136ab (0x17ec bytes) 000893 1782223685.415192 trunc from 0x0132ce to 0x01fe62 (0xcb95 bytes) 000894 1782223685.422268 mapread 0x02cb41 thru 0x02cc88 (0x148 bytes) 000895 1782223685.426217 trunc from 0x002900 to 0x00ad6b (0x846c bytes) 000896 1782223685.441299 trunc from 0x0359fe to 0x03eda7 (0x93aa bytes) 000897 1782223685.448176 read 0x030d47 thru 0x03cbb7 (0xbe71 bytes) 000898 1782223685.494479 punch from 0x028e81 to 0x02a844 (0x19c4 bytes) 000899 1782223685.520332 mapwrite 0x005ca0 thru 0x0079cb (0x1d2c bytes) 000900 1782223685.562505 punch from 0x016c04 to 0x024fe6 (0xe3e3 bytes) 000901 1782223685.573959 trunc from 0x0112b8 to 0x01a90e (0x9657 bytes) 000902 1782223685.589337 trunc from 0x040000 to 0x01ee40 (0x211bf bytes) 000903 1782223685.626868 read 0x017d38 thru 0x01cf1a (0x51e3 bytes) 000905 1782223685.646433 write 0x0281ee thru 0x0316bf (0x94d2 bytes) 000906 1782223685.648734 trunc from 0x0316c0 to 0x0254fd (0xc1c2 bytes) 000907 1782223685.681355 write 0x007244 thru 0x0078c8 (0x685 bytes) 000908 1782223685.683272 punch from 0x020e53 to 0x02393d (0x2aeb bytes) 000909 1782223685.718989 MIRROR_RESYNC 8 mirrors 000910 1782223687.848068 read 0x02039f thru 0x0254fd (0x515f bytes) 000911 1782223687.861101 trunc from 0x0254fe to 0x03fbec (0x1a6ef bytes) 000912 1782223687.906995 read 0x01e7a6 thru 0x0289bc (0xa217 bytes) 000913 1782223687.925222 write 0x02e0fb thru 0x03c566 (0xe46c bytes) 000914 1782223687.927137 mapwrite 0x00f2c0 thru 0x0151d0 (0x5f11 bytes) 000915 1782223687.950538 trunc from 0x03fbed to 0x02be3c (0x13db0 bytes) 000916 1782223687.993618 trunc from 0x010b72 to 0x013c8a (0x3119 bytes) 000917 1782223688.002581 trunc from 0x02be3d to 0x006887 (0x255b5 bytes) 000918 1782223688.056733 write 0x032cc7 thru 0x037f45 (0x527f bytes) 000920 1782223688.063585 punch from 0x012092 to 0x01eb1a (0xca89 bytes) 000921 1782223688.083819 mapread 0x01b2e7 thru 0x01e686 (0x33a0 bytes) 000923 1782223688.130762 mapread 0x02201c thru 0x025afb (0x3ae0 bytes) 000924 1782223688.167220 mapread 0x017681 thru 0x0177bd (0x13d bytes) 000925 1782223688.186370 trunc from 0x037f46 to 0x03b692 (0x374d bytes) 000926 1782223688.244264 trunc from 0x03b693 to 0x0018d4 (0x39dbe bytes) 000928 1782223688.322849 MIRROR_RESYNC 8 mirrors 000929 1782223689.976517 punch from 0x000333 to 0x00115f (0xe2d bytes) 000930 1782223690.068205 trunc from 0x0018d5 to 0x02eb7d (0x2d2a9 bytes) 000931 1782223690.124794 trunc from 0x02eb7e to 0x005783 (0x293fa bytes) 000932 1782223690.178001 fallocate 0x00f0ae thru 0x01bd3a (0xcc8d bytes) 000934 1782223690.196063 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x5784): Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5784): Mirror 13: 0xc4929f30 (stale) Mirror 17: 0xc4929f30 (stale) Mirror 18: 0xc4929f30 (stale) Mirror 19: 0xc4929f30 (stale) Mirror 21: 0xc4929f30 (stale) Mirror 22: 0xc4929f30 (stale) Mirror 24: 0xc4929f30 (stale) CRC-32 checksum value for chunk [0, 0x5784): Mirror 1: 0xc4929f30 Mirror 25: 0xc4929f30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5784: skipped 000935 1782223691.309578 read 0x003443 thru 0x005783 (0x2341 bytes) 000936 1782223691.338895 mapwrite 0x0348a0 thru 0x03f55d (0xacbe bytes) 000937 1782223691.545811 mapread 0x029349 thru 0x02db11 (0x47c9 bytes) 000938 1782223691.583328 MIRROR_RESYNC 9 mirrors 000939 1782223693.488744 write 0x036d27 thru 0x03ffff (0x92d9 bytes) 000940 1782223693.537968 MIRROR_RESYNC 9 mirrors 000941 1782223695.396128 trunc from 0x040000 to 0x027907 (0x186f8 bytes) 000942 1782223695.476348 mapwrite 0x02bac5 thru 0x03a750 (0xec8c bytes) 000943 1782223695.674934 punch from 0x012795 to 0x01e51e (0xbd8a bytes) 000945 1782223695.718567 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a751): Mirror 13: 0x58fc9ef1 (stale) Mirror 17: 0x58fc9ef1 (stale) Mirror 18: 0x58fc9ef1 (stale) Mirror 19: 0x58fc9ef1 (stale) Mirror 22: 0x58fc9ef1 (stale) Mirror 24: 0x58fc9ef1 (stale) Mirror 25: 0x58fc9ef1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a751): Mirror 13: 0x58fc9ef1 (stale) Mirror 17: 0x58fc9ef1 (stale) Mirror 18: 0x58fc9ef1 (stale) Mirror 19: 0x58fc9ef1 (stale) Mirror 22: 0x58fc9ef1 (stale) Mirror 24: 0x58fc9ef1 (stale) Mirror 25: 0x58fc9ef1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a751: skipped 000946 1782223696.514525 mapwrite 0x022f31 thru 0x023a06 (0xad6 bytes) 000947 1782223696.567878 read 0x0038b8 thru 0x00a436 (0x6b7f bytes) 000948 1782223696.580332 trunc from 0x008570 to 0x0117eb (0x927c bytes) 000949 1782223696.602568 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3a751): Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a751): Mirror 13: 0x58fc9ef1 (stale) Mirror 17: 0x58fc9ef1 (stale) Mirror 18: 0x58fc9ef1 (stale) Mirror 19: 0x58fc9ef1 (stale) Mirror 22: 0x58fc9ef1 (stale) Mirror 24: 0x58fc9ef1 (stale) Mirror 25: 0x58fc9ef1 (stale) CRC-32 checksum value for chunk [0, 0x3a751): Mirror 1: 0xfe6112fd Mirror 26: 0xfe6112fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a751: skipped 000950 1782223698.050788 mapwrite 0x0337f6 thru 0x03e925 (0xb130 bytes) 000951 1782223698.280866 read 0x0337ec thru 0x03e925 (0xb13a bytes) 000953 1782223698.303821 trunc from 0x02598a to 0x02f8d9 (0x9f50 bytes) 000954 1782223698.315376 fallocate 0x0272f9 thru 0x02fd6c (0x8a74 bytes) 000955 1782223698.333235 punch from 0x01f31d to 0x02c266 (0xcf4a bytes) 000956 1782223698.343489 punch from 0x01d7bb to 0x02aa15 (0xd25b bytes) 000957 1782223698.359213 fallocate 0x01a3dc thru 0x02713f (0xcd64 bytes) 000958 1782223698.387096 fallocate 0x00c711 thru 0x016c60 (0xa550 bytes) 000960 1782223698.396214 trunc from 0x03e926 to 0x0135aa (0x2b37b bytes) 000961 1782223698.426314 mapread 0x002f2c thru 0x00b687 (0x875c bytes) 000962 1782223698.454923 fallocate 0x03cbc5 thru 0x03fb1f (0x2f5b bytes) 000963 1782223698.475006 mapread 0x00dbfd thru 0x011b74 (0x3f78 bytes) 000964 1782223698.494497 fallocate 0x0123b7 thru 0x020e04 (0xea4e bytes) 000965 1782223698.507272 trunc from 0x020e05 to 0x024809 (0x3a05 bytes) 000966 1782223698.531663 write 0x0054b1 thru 0x00831c (0x2e6c bytes) 000967 1782223698.534649 mapwrite 0x013a53 thru 0x01ad27 (0x72d5 bytes) 000968 1782223698.586025 read 0x00190b thru 0x008122 (0x6818 bytes) 000969 1782223698.586905 trunc from 0x02480a to 0x0068bf (0x1df4a bytes) 000970 1782223698.618554 trunc from 0x002f40 to 0x0068bf (0x3980 bytes) 000971 1782223698.632324 punch from 0x0062b1 to 0x0068bf (0x60f bytes) 000972 1782223698.638950 read 0x00547d thru 0x0068bf (0x1443 bytes) 000973 1782223698.663279 punch from 0x0013a8 to 0x0068bf (0x5518 bytes) 000974 1782223698.677259 write 0x027263 thru 0x02b16e (0x3f0c bytes) 000975 1782223698.681564 punch from 0x01c910 to 0x024236 (0x7927 bytes) 000976 1782223698.687722 trunc from 0x01ae18 to 0x0282fc (0xd4e5 bytes) 000978 1782223698.717730 write 0x00df36 thru 0x01131e (0x33e9 bytes) 000979 1782223698.751215 trunc from 0x02b16f to 0x03c41f (0x112b1 bytes) 000980 1782223698.773422 trunc from 0x01b6ee to 0x026f07 (0xb81a bytes) 000981 1782223698.786365 mapwrite 0x003ac2 thru 0x00a836 (0x6d75 bytes) 000984 1782223698.877864 MIRROR_RESYNC 9 mirrors 000985 1782223702.139803 punch from 0x02f01d to 0x03483e (0x5822 bytes) 000986 1782223702.204533 trunc from 0x03c420 to 0x02ee1c (0xd603 bytes) 000987 1782223702.269417 trunc from 0x02ee1d to 0x00a5e1 (0x2483b bytes) 000988 1782223702.301817 punch from 0x001d30 to 0x005097 (0x3368 bytes) 000989 1782223702.313826 mapread 0x00044e thru 0x008164 (0x7d17 bytes) 000990 1782223702.361261 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa5e2): Mirror 13: 0x88e89557 (stale) Mirror 17: 0x88e89557 (stale) Mirror 18: 0x88e89557 (stale) Mirror 19: 0x88e89557 (stale) Mirror 22: 0x88e89557 (stale) Mirror 25: 0x88e89557 (stale) Mirror 26: 0x88e89557 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa5e2): Mirror 13: 0x88e89557 (stale) Mirror 17: 0x88e89557 (stale) Mirror 18: 0x88e89557 (stale) Mirror 19: 0x88e89557 (stale) Mirror 22: 0x88e89557 (stale) Mirror 25: 0x88e89557 (stale) Mirror 26: 0x88e89557 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa5e2: skipped 000991 1782223703.000862 trunc from 0x00a5e2 to 0x011e6a (0x7889 bytes) 000992 1782223703.030922 punch from 0x00cb70 to 0x011e6a (0x52fb bytes) 000993 1782223703.039499 trunc from 0x0075bf to 0x011e6a (0xa8ac bytes) 000994 1782223703.048362 trunc from 0x008132 to 0x008f95 (0xe64 bytes) 000995 1782223703.058764 write 0x02b5e1 thru 0x03b397 (0xfdb7 bytes) 000996 1782223703.063506 trunc from 0x00518b to 0x00c488 (0x72fe bytes) 000998 1782223703.071333 mapwrite 0x024e26 thru 0x032cd0 (0xdeab bytes) 000999 1782223703.141693 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b398): Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b398): Mirror 13: 0x9a897821 (stale) Mirror 17: 0x9a897821 (stale) Mirror 18: 0x9a897821 (stale) Mirror 19: 0x9a897821 (stale) Mirror 22: 0x9a897821 (stale) Mirror 25: 0x9a897821 (stale) Mirror 26: 0x9a897821 (stale) CRC-32 checksum value for chunk [0, 0x3b398): Mirror 1: 0x209e79f0 Mirror 27: 0x209e79f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b398: skipped 001000 1782223704.529305 mapwrite 0x013f94 thru 0x01ac1c (0x6c89 bytes) All operations completed A-OK!