== sanity-flr test 70a: flr mode fsx test ================ 12:41:43 (1780332103) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 2104 skipping zero size read skipping zero size read 000004 1780332105.138590 mapwrite 0x01c1ef thru 0x01ddc0 (0x1bd2 bytes) 000007 1780332105.183811 mapwrite 0x01520c thru 0x01cd18 (0x7b0d bytes) 000008 1780332105.208433 mapread 0x007e15 thru 0x0167d9 (0xe9c5 bytes) 000009 1780332105.217693 mapread 0x00dcb5 thru 0x00e933 (0xc7f bytes) 000010 1780332105.218706 mapwrite 0x012dec thru 0x01e182 (0xb397 bytes) 000011 1780332105.260032 MIRROR_EXTEND to 2 mirrors 000012 1780332105.835889 read 0x0158c0 thru 0x016e78 (0x15b9 bytes) 000013 1780332105.846919 write 0x00005e thru 0x00f43c (0xf3df bytes) zero_range to largest ever: 0x11d7a 000014 1780332105.919848 trunc from 0x003d94 to 0x011d79 (0xdfe6 bytes) 000015 1780332105.939139 punch from 0x01d164 to 0x01e182 (0x101f bytes) 000016 1780332105.944212 punch from 0x0114e3 to 0x0177ca (0x62e8 bytes) 000017 1780332105.950705 punch from 0x017528 to 0x01e182 (0x6c5b bytes) 000019 1780332105.957215 trunc from 0x00ec2c to 0x0194e4 (0xa8b9 bytes) fallocating to largest ever: 0x23e54 000020 1780332105.961648 fallocate 0x021bf2 thru 0x023e53 (0x2262 bytes) 000021 1780332105.972139 MIRROR_RESYNC 2 mirrors 000022 1780332106.571351 mapwrite 0x00e3d3 thru 0x0158ef (0x751d bytes) 000023 1780332106.687840 punch from 0x0151f0 to 0x01e182 (0x8f93 bytes) 000025 1780332106.702812 fallocate 0x008593 thru 0x015eed (0xd95b bytes) 000026 1780332106.711572 trunc from 0x000cb9 to 0x00c565 (0xb8ad bytes) 000027 1780332106.718516 trunc from 0x018f81 to 0x01a5ce (0x164e bytes) 000028 1780332106.730486 punch from 0x00ae8f to 0x01779d (0xc90f bytes) 000029 1780332106.740644 trunc from 0x01cfc8 to 0x01d5b9 (0x5f2 bytes) truncating to largest ever: 0x314d4 000030 1780332106.751136 trunc from 0x01e183 to 0x0314d3 (0x13351 bytes) 000031 1780332106.800733 trunc from 0x02ff6f to 0x0314d3 (0x1565 bytes) truncating to largest ever: 0x3fe4f 000032 1780332106.809159 trunc from 0x0314d4 to 0x03fe4e (0xe97b bytes) 000033 1780332106.840622 punch from 0x019df0 to 0x026e98 (0xd0a9 bytes) 000034 1780332106.850383 trunc from 0x011552 to 0x019ae8 (0x8597 bytes) 000035 1780332106.856305 trunc from 0x03fe4f to 0x02f511 (0x1093d bytes) 000036 1780332106.878862 fallocate 0x034a40 thru 0x03e3ba (0x997b bytes) 000038 1780332106.886822 fallocate 0x024712 thru 0x032454 (0xdd43 bytes) 000039 1780332106.892142 trunc from 0x02f512 to 0x013a02 (0x1bb0f bytes) 000040 1780332106.913713 punch from 0x00acdf to 0x013a02 (0x8d24 bytes) 000041 1780332106.918293 punch from 0x000507 to 0x00b70d (0xb207 bytes) 000042 1780332106.924482 mapwrite 0x0348ba thru 0x03b3d2 (0x6b19 bytes) 000043 1780332106.963041 punch from 0x01e2c5 to 0x01f2e6 (0x1022 bytes) 000044 1780332106.972799 mapwrite 0x024510 thru 0x02d2f0 (0x8de1 bytes) 000045 1780332107.006676 fallocate 0x011aca thru 0x012f8f (0x14c6 bytes) 000046 1780332107.012749 trunc from 0x03b3d3 to 0x023b28 (0x178aa bytes) 000047 1780332107.027845 mapread 0x007eb7 thru 0x01715f (0xf2a9 bytes) 000048 1780332107.049537 mapread 0x01b3e7 thru 0x01caf9 (0x1713 bytes) 000049 1780332107.057806 fallocate 0x018491 thru 0x021309 (0x8e79 bytes) 000050 1780332107.064844 write 0x008fa5 thru 0x00f98c (0x69e8 bytes) 000051 1780332107.072597 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000052 1780332107.235400 trunc from 0x023b29 to 0x023f49 (0x421 bytes) 000053 1780332107.269923 read 0x00c008 thru 0x010ccc (0x4cc5 bytes) 000054 1780332107.277463 mapwrite 0x027798 thru 0x02a41b (0x2c84 bytes) 000055 1780332107.342209 trunc from 0x00b96f to 0x0177d0 (0xbe62 bytes) 000056 1780332107.349226 mapwrite 0x02d1c6 thru 0x03a12f (0xcf6a bytes) 000057 1780332107.435518 mapwrite 0x0389d5 thru 0x03ffff (0x762b bytes) 000058 1780332107.483504 mapread 0x02fd3b thru 0x035385 (0x564b bytes) 000059 1780332107.485624 fallocate 0x03510d thru 0x03d436 (0x832a bytes) 000060 1780332107.490480 fallocate 0x01e97e thru 0x02b8be (0xcf41 bytes) 000061 1780332107.495273 write 0x0231d2 thru 0x024598 (0x13c7 bytes) 000062 1780332107.496836 mapread 0x02f8ae thru 0x037529 (0x7c7c bytes) 000063 1780332107.498713 read 0x01a0d8 thru 0x01af63 (0xe8c bytes) 000064 1780332107.508009 mapread 0x03d5b1 thru 0x03ffff (0x2a4f bytes) 000065 1780332107.509487 punch from 0x03851d to 0x03ffff (0x7ae3 bytes) 000066 1780332107.515979 mapread 0x016b10 thru 0x025867 (0xed58 bytes) 000067 1780332107.518617 trunc from 0x040000 to 0x01f1b7 (0x20e48 bytes) 000068 1780332107.532438 fallocate 0x015d04 thru 0x0247ff (0xeafc bytes) 000069 1780332107.543691 MIRROR_EXTEND to 2 mirrors 000070 1780332108.329036 mapread 0x006652 thru 0x00c36c (0x5d1b bytes) 000072 1780332108.371093 punch from 0x004308 to 0x00f78f (0xb488 bytes) 000073 1780332108.422438 trunc from 0x00de11 to 0x00f46c (0x165c bytes) 000075 1780332108.431177 mapwrite 0x021997 thru 0x02e58d (0xcbf7 bytes) 000076 1780332108.599851 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000078 1780332108.740203 mapread 0x00749e thru 0x0137be (0xc321 bytes) 000079 1780332108.776818 read 0x01cd3f thru 0x025778 (0x8a3a bytes) 000081 1780332108.784944 trunc from 0x00202b to 0x003a9c (0x1a72 bytes) 000082 1780332108.790232 fallocate 0x019295 thru 0x02601d (0xcd89 bytes) 000083 1780332108.795245 write 0x03957b thru 0x03ffff (0x6a85 bytes) 000084 1780332108.802763 trunc from 0x039eff to 0x03ffff (0x6101 bytes) 000086 1780332108.822838 trunc from 0x040000 to 0x006407 (0x39bf8 bytes) 000087 1780332108.838410 read 0x0010a4 thru 0x005447 (0x43a4 bytes) 000089 1780332108.854699 trunc from 0x006408 to 0x014e7d (0xea76 bytes) 000090 1780332108.869613 trunc from 0x014e7e to 0x035400 (0x20583 bytes) 000092 1780332108.885193 mapwrite 0x009ed5 thru 0x014ddf (0xaf0b bytes) 000093 1780332108.916361 mapread 0x027475 thru 0x02df90 (0x6b1c bytes) 000094 1780332108.917476 trunc from 0x018341 to 0x01ada6 (0x2a66 bytes) 000095 1780332108.925380 mapwrite 0x000d31 thru 0x009653 (0x8923 bytes) 000096 1780332108.961569 trunc from 0x035401 to 0x03d4d1 (0x80d1 bytes) 000097 1780332108.997530 fallocate 0x02ed13 thru 0x03db57 (0xee45 bytes) 000098 1780332109.033633 MIRROR_EXTEND to 2 mirrors 000099 1780332109.666830 punch from 0x01fc55 to 0x028583 (0x892f bytes) 000100 1780332109.711737 read 0x025e72 thru 0x033a94 (0xdc23 bytes) 000101 1780332109.728535 mapwrite 0x028e1e thru 0x03439e (0xb581 bytes) 000102 1780332109.776640 mapread 0x01b353 thru 0x0245e6 (0x9294 bytes) 000103 1780332109.798016 read 0x03d51a thru 0x03db57 (0x63e bytes) 000104 1780332109.814575 read 0x02af87 thru 0x03a58f (0xf609 bytes) 000105 1780332109.815648 mapwrite 0x03acf7 thru 0x03ffff (0x5309 bytes) 000106 1780332109.879581 trunc from 0x040000 to 0x0135fc (0x2ca03 bytes) 000108 1780332109.899287 punch from 0x00a69b to 0x00f61f (0x4f85 bytes) 000109 1780332109.907859 read 0x004203 thru 0x0101e0 (0xbfde bytes) 000110 1780332109.918510 read 0x011212 thru 0x0135fc (0x23eb bytes) 000111 1780332109.919520 write 0x03e898 thru 0x03f888 (0xff1 bytes) 000112 1780332109.921672 fallocate 0x026e51 thru 0x02d072 (0x6222 bytes) 000113 1780332109.941169 punch from 0x0005ae to 0x00f47b (0xeece bytes) 000114 1780332109.955685 trunc from 0x03f889 to 0x0236c8 (0x1c1c0 bytes) 000115 1780332109.977918 read 0x001054 thru 0x005e39 (0x4de6 bytes) 000117 1780332109.987526 punch from 0x006c86 to 0x008a65 (0x1de0 bytes) 000118 1780332109.993244 fallocate 0x00c97d thru 0x014bf1 (0x8275 bytes) 000119 1780332109.998374 punch from 0x018f48 to 0x0236c8 (0xa781 bytes) 000120 1780332110.003058 write 0x013e9b thru 0x01bc46 (0x7dac bytes) 000121 1780332110.013218 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x236c9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x236c9): Mirror 2: 0xc678691b (stale) CRC-32 checksum value for chunk [0, 0x236c9): Mirror 1: 0x50da36e4 Mirror 3: 0x50da36e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x236c9: skipped 000122 1780332110.818848 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x236c9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x236c9): Mirror 2: 0xc678691b (stale) CRC-32 checksum value for chunk [0, 0x236c9): Mirror 1: 0x50da36e4 Mirror 3: 0x50da36e4 Mirror 4: 0x50da36e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x236c9: skipped 000123 1780332111.728308 trunc from 0x001182 to 0x00fab0 (0xe92f bytes) 000124 1780332111.772216 trunc from 0x018123 to 0x0236c8 (0xb5a6 bytes) 000125 1780332111.777773 trunc from 0x00b857 to 0x013f6e (0x8718 bytes) 000126 1780332111.782288 read 0x013b98 thru 0x02134a (0xd7b3 bytes) 000127 1780332111.808762 read 0x00b84a thru 0x00e38c (0x2b43 bytes) 000128 1780332111.820494 write 0x033b78 thru 0x03ccb8 (0x9141 bytes) 000129 1780332111.826236 write 0x003508 thru 0x00d3c4 (0x9ebd bytes) 000130 1780332111.828247 trunc from 0x02a324 to 0x02fb5e (0x583b bytes) 000131 1780332111.833474 mapread 0x01403d thru 0x0158de (0x18a2 bytes) 000132 1780332111.834714 write 0x013909 thru 0x0153d7 (0x1acf bytes) 000133 1780332111.836092 write 0x03ce03 thru 0x03ffff (0x31fd bytes) 000134 1780332111.837489 mapwrite 0x03a492 thru 0x03ffff (0x5b6e bytes) 000135 1780332111.869258 read 0x034909 thru 0x03928a (0x4982 bytes) 000136 1780332111.870295 read 0x03f56a thru 0x03ffff (0xa96 bytes) 000137 1780332111.880967 trunc from 0x040000 to 0x034166 (0xbe99 bytes) 000138 1780332111.919168 mapread 0x0172f4 thru 0x01c7fd (0x550a bytes) 000141 1780332111.921400 write 0x00566f thru 0x0063ea (0xd7c bytes) 000142 1780332111.930072 trunc from 0x034167 to 0x00b73c (0x28a2a bytes) 000143 1780332111.953027 trunc from 0x00b73d to 0x0046c1 (0x707b bytes) 000144 1780332111.989042 write 0x03fa64 thru 0x03ffff (0x59c bytes) 000145 1780332111.991691 read 0x006aec thru 0x0102f5 (0x980a bytes) 000147 1780332112.002343 trunc from 0x040000 to 0x039f96 (0x6069 bytes) 000148 1780332112.027256 punch from 0x01e301 to 0x024b65 (0x6865 bytes) 000149 1780332112.034543 write 0x0374a8 thru 0x03981c (0x2375 bytes) 000150 1780332112.036592 write 0x02f78e thru 0x03b532 (0xbda5 bytes) 000151 1780332112.039364 trunc from 0x0214cf to 0x02c6bd (0xb1ef bytes) 000152 1780332112.044256 mapread 0x02a9cf thru 0x03727b (0xc8ad bytes) 000153 1780332112.061344 trunc from 0x002f01 to 0x0087d3 (0x58d3 bytes) 000154 1780332112.069453 fallocate 0x01efa6 thru 0x0248d4 (0x592f bytes) 000156 1780332112.075627 punch from 0x02bdb5 to 0x02e653 (0x289f bytes) 000157 1780332112.085196 trunc from 0x003c37 to 0x010c56 (0xd020 bytes) 000158 1780332112.096734 mapwrite 0x0333c9 thru 0x03ffff (0xcc37 bytes) 000159 1780332112.153739 trunc from 0x02f0fb to 0x031092 (0x1f98 bytes) 000160 1780332112.158654 mapwrite 0x02cafe thru 0x02d5d4 (0xad7 bytes) 000161 1780332112.178602 trunc from 0x040000 to 0x0247c8 (0x1b837 bytes) 000162 1780332112.195700 trunc from 0x006f2d to 0x009566 (0x263a bytes) 000163 1780332112.204691 MIRROR_RESYNC 4 mirrors 000164 1780332112.920061 trunc from 0x004f1b to 0x005203 (0x2e9 bytes) 000165 1780332112.959354 mapwrite 0x012bb0 thru 0x01f0a3 (0xc4f4 bytes) 000166 1780332113.035700 punch from 0x024678 to 0x0247c8 (0x151 bytes) 000167 1780332113.045093 write 0x008d47 thru 0x01765a (0xe914 bytes) 000168 1780332113.064741 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x247c9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x247c9): Mirror 2: 0xa750abc7 (stale) Mirror 3: 0xa750abc7 (stale) Mirror 4: 0xa750abc7 (stale) CRC-32 checksum value for chunk [0, 0x247c9): Mirror 1: 0x7705769b Mirror 5: 0x7705769b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x247c9: skipped 000169 1780332113.991544 write 0x00e4b3 thru 0x01b614 (0xd162 bytes) 000170 1780332114.075977 MIRROR_RESYNC 5 mirrors 000171 1780332115.341736 trunc from 0x012040 to 0x0202ef (0xe2b0 bytes) 000173 1780332115.422625 trunc from 0x0247c9 to 0x02d5b6 (0x8dee bytes) 000174 1780332115.474002 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d5b7): Mirror 2: 0x52ca144a (stale) Mirror 3: 0x52ca144a (stale) Mirror 4: 0x52ca144a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d5b7): Mirror 2: 0x52ca144a (stale) Mirror 3: 0x52ca144a (stale) Mirror 4: 0x52ca144a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d5b7: skipped 000175 1780332115.858395 fallocate 0x014bd0 thru 0x01ab80 (0x5fb1 bytes) 000176 1780332115.872144 punch from 0x01ea1d to 0x028f31 (0xa515 bytes) 000177 1780332115.886985 fallocate 0x037a4f thru 0x03936d (0x191f bytes) 000178 1780332115.892720 write 0x03bc93 thru 0x03df6d (0x22db bytes) 000179 1780332115.901357 punch from 0x01cbcc to 0x025fc0 (0x93f5 bytes) 000180 1780332115.909589 trunc from 0x01bfa0 to 0x02ad86 (0xede7 bytes) 000181 1780332115.916691 fallocate 0x00e25e thru 0x010cfb (0x2a9e bytes) 000182 1780332115.923277 fallocate 0x010e9c thru 0x01692f (0x5a94 bytes) 000183 1780332115.934947 MIRROR_RESYNC 4 mirrors 000184 1780332117.028685 mapread 0x02379e thru 0x0259cc (0x222f bytes) 000185 1780332117.059940 punch from 0x004049 to 0x00ba79 (0x7a31 bytes) 000186 1780332117.129713 fallocate 0x02d34c thru 0x03135b (0x4010 bytes) 000187 1780332117.142938 write 0x03f9f2 thru 0x03ffff (0x60e bytes) 000188 1780332117.151930 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xf593b67b (stale) Mirror 4: 0xf593b67b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xf593b67b (stale) Mirror 4: 0xf593b67b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000189 1780332117.518593 trunc from 0x002635 to 0x00c5bb (0x9f87 bytes) 000190 1780332117.525388 punch from 0x0395e2 to 0x039fc0 (0x9df bytes) 000191 1780332117.530926 trunc from 0x040000 to 0x00a658 (0x359a7 bytes) 000192 1780332117.558472 mapread 0x008ecb thru 0x00a658 (0x178e bytes) 000193 1780332117.586895 trunc from 0x00a659 to 0x005f1d (0x473b bytes) 000194 1780332117.616853 mapwrite 0x032831 thru 0x03b37a (0x8b4a bytes) 000195 1780332117.688049 mapwrite 0x007a42 thru 0x013d51 (0xc310 bytes) 000196 1780332117.723397 mapread 0x015e6e thru 0x01b74d (0x58e0 bytes) 000197 1780332117.733538 read 0x02c304 thru 0x033703 (0x7400 bytes) 000198 1780332117.734517 trunc from 0x02db7c to 0x032660 (0x4ae5 bytes) 000199 1780332117.739720 fallocate 0x013aae thru 0x0162d3 (0x2826 bytes) 000200 1780332117.744477 mapwrite 0x00bece thru 0x016f0d (0xb040 bytes) 000201 1780332117.761187 mapwrite 0x00750b thru 0x010a47 (0x953d bytes) 000203 1780332117.779530 fallocate 0x002a67 thru 0x009ac5 (0x705f bytes) 000204 1780332117.784279 mapwrite 0x02883b thru 0x0290ab (0x871 bytes) 000205 1780332117.806961 trunc from 0x027af5 to 0x032897 (0xada3 bytes) 000206 1780332117.825149 write 0x00d802 thru 0x01cdee (0xf5ed bytes) 000207 1780332117.828693 trunc from 0x03720e to 0x03b37a (0x416d bytes) 000208 1780332117.849635 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b37b): Mirror 4: 0xe69996a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b37b): Mirror 4: 0xe69996a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b37b: skipped 000209 1780332118.178218 fallocate 0x0225a2 thru 0x026263 (0x3cc2 bytes) 000210 1780332118.187811 read 0x003f4a thru 0x012b9f (0xec56 bytes) 000211 1780332118.199717 trunc from 0x00dade to 0x019f89 (0xc4ac bytes) 000212 1780332118.210906 read 0x0226f1 thru 0x02bff6 (0x9906 bytes) 000213 1780332118.238179 punch from 0x00b8e5 to 0x0181c0 (0xc8dc bytes) 000214 1780332118.248626 trunc from 0x03b37b to 0x03fd07 (0x498d bytes) 000215 1780332118.288512 mapread 0x00a969 thru 0x00d9cc (0x3064 bytes) 000216 1780332118.322619 punch from 0x0243ea to 0x030f65 (0xcb7c bytes) 000218 1780332118.335223 fallocate 0x004c3e thru 0x01466d (0xfa30 bytes) 000219 1780332118.343428 trunc from 0x03fd08 to 0x017c72 (0x28095 bytes) 000220 1780332118.382610 punch from 0x00d72f to 0x012328 (0x4bfa bytes) 000221 1780332118.393374 punch from 0x014ea2 to 0x017c72 (0x2dd1 bytes) 000222 1780332118.405158 fallocate 0x01a17c thru 0x0236e3 (0x9568 bytes) 000223 1780332118.409684 mapread 0x00554f thru 0x005965 (0x417 bytes) 000224 1780332118.411137 punch from 0x003cd1 to 0x008566 (0x4896 bytes) 000226 1780332118.417901 fallocate 0x005ecc thru 0x00d8d9 (0x7a0e bytes) 000227 1780332118.422831 read 0x012332 thru 0x017c72 (0x5941 bytes) 000228 1780332118.433703 punch from 0x00cfe5 to 0x017c72 (0xac8e bytes) 000229 1780332118.438996 write 0x02ff7c thru 0x03f6ee (0xf773 bytes) 000231 1780332118.442203 punch from 0x01f0d8 to 0x027089 (0x7fb2 bytes) 000232 1780332118.446761 write 0x013386 thru 0x018f75 (0x5bf0 bytes) 000233 1780332118.454088 mapread 0x020d58 thru 0x02436c (0x3615 bytes) 000234 1780332118.455142 fallocate 0x0162a5 thru 0x022576 (0xc2d2 bytes) 000235 1780332118.461272 read 0x03da62 thru 0x03f6ee (0x1c8d bytes) 000236 1780332118.462243 mapwrite 0x03e2ef thru 0x03ffff (0x1d11 bytes) 000237 1780332118.494268 trunc from 0x01de8c to 0x01e23b (0x3b0 bytes) 000238 1780332118.500658 fallocate 0x005b16 thru 0x0111ae (0xb699 bytes) 000239 1780332118.505494 fallocate 0x017ee7 thru 0x020484 (0x859e bytes) 000240 1780332118.510580 read 0x01cc51 thru 0x02b8ff (0xecaf bytes) 000241 1780332118.519998 read 0x01eb60 thru 0x023f02 (0x53a3 bytes) 000242 1780332118.520899 fallocate 0x00e245 thru 0x01b5ac (0xd368 bytes) 000243 1780332118.529397 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000244 1780332118.681817 MIRROR_EXTEND to 2 mirrors 000245 1780332119.458916 trunc from 0x01615c to 0x024b72 (0xea17 bytes) 000246 1780332119.529349 MIRROR_RESYNC 2 mirrors 000247 1780332120.325455 read 0x025d9b thru 0x028719 (0x297f bytes) 000248 1780332120.331167 trunc from 0x0287be to 0x037cf0 (0xf533 bytes) 000249 1780332120.398720 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000250 1780332120.563331 punch from 0x01c4bf to 0x02964c (0xd18e bytes) 000251 1780332120.570431 trunc from 0x026fc0 to 0x027dbf (0xe00 bytes) 000252 1780332120.575449 punch from 0x0313b0 to 0x032dbd (0x1a0e bytes) 000253 1780332120.587062 mapread 0x03f72b thru 0x03ffff (0x8d5 bytes) 000255 1780332120.602848 punch from 0x000dea to 0x003d57 (0x2f6e bytes) 000257 1780332120.617873 trunc from 0x040000 to 0x0102fe (0x2fd01 bytes) 000258 1780332120.649346 write 0x033843 thru 0x03ffff (0xc7bd bytes) 000259 1780332120.651020 read 0x03c209 thru 0x03ffff (0x3df7 bytes) 000260 1780332120.655548 trunc from 0x040000 to 0x031eff (0xe100 bytes) 000261 1780332120.677084 read 0x0033c7 thru 0x003ae4 (0x71e bytes) 000262 1780332120.691467 fallocate 0x02eb44 thru 0x0337ed (0x4caa bytes) 000263 1780332120.700443 write 0x000fb6 thru 0x0095b4 (0x85ff bytes) 000265 1780332120.706716 read 0x0296b4 thru 0x031eff (0x884c bytes) 000266 1780332120.707545 write 0x005b2f thru 0x0102dd (0xa7af bytes) 000267 1780332120.708931 trunc from 0x031f00 to 0x03d25b (0xb35c bytes) 000268 1780332120.737375 trunc from 0x0134c2 to 0x01fcfb (0xc83a bytes) 000270 1780332120.748421 punch from 0x0203a5 to 0x0214a9 (0x1105 bytes) 000271 1780332120.756501 mapread 0x023f35 thru 0x032c14 (0xece0 bytes) 000272 1780332120.779027 mapwrite 0x03cba4 thru 0x03ffff (0x345c bytes) 000273 1780332120.826407 mapwrite 0x024901 thru 0x02cbd8 (0x82d8 bytes) 000274 1780332120.857745 trunc from 0x034153 to 0x034bf7 (0xaa5 bytes) 000275 1780332120.868715 read 0x02a102 thru 0x0314a5 (0x73a4 bytes) 000276 1780332120.869667 read 0x0266be thru 0x0289ab (0x22ee bytes) 000277 1780332120.871840 trunc from 0x040000 to 0x03d403 (0x2bfc bytes) 000278 1780332120.895820 fallocate 0x0236b5 thru 0x02fb3e (0xc48a bytes) 000279 1780332120.905217 trunc from 0x03d404 to 0x031a5e (0xb9a5 bytes) 000280 1780332120.927702 write 0x0285ee thru 0x02d4e6 (0x4ef9 bytes) 000281 1780332120.931091 trunc from 0x031a5f to 0x0021a3 (0x2f8bb bytes) 000282 1780332120.951480 write 0x00d684 thru 0x01bc32 (0xe5af bytes) 000284 1780332120.958655 trunc from 0x01bc33 to 0x01aa0f (0x1223 bytes) 000285 1780332120.977688 trunc from 0x01aa10 to 0x000901 (0x1a10e bytes) 000286 1780332120.993956 write 0x023a87 thru 0x025ea0 (0x241a bytes) 000287 1780332120.999002 punch from 0x018c54 to 0x020b1e (0x7ecb bytes) 000289 1780332121.007470 trunc from 0x025ea1 to 0x008977 (0x1d529 bytes) 000290 1780332121.022953 mapwrite 0x03aea5 thru 0x03ffff (0x515b bytes) 000291 1780332121.100843 fallocate 0x02abac thru 0x02f9f9 (0x4e4e bytes) 000292 1780332121.107368 read 0x015705 thru 0x016373 (0xc6f bytes) 000293 1780332121.109023 mapread 0x01e11e thru 0x020a51 (0x2934 bytes) 000294 1780332121.112180 mapwrite 0x036a97 thru 0x03e975 (0x7edf bytes) 000295 1780332121.138888 write 0x0379d9 thru 0x039705 (0x1d2d bytes) 000296 1780332121.140218 trunc from 0x03d82a to 0x03ffff (0x27d6 bytes) 000297 1780332121.146541 punch from 0x00d05c to 0x0159a2 (0x8947 bytes) 000298 1780332121.151580 read 0x037945 thru 0x03ffff (0x86bb bytes) 000299 1780332121.161418 write 0x02a3a8 thru 0x02b547 (0x11a0 bytes) 000300 1780332121.162936 punch from 0x03e742 to 0x03ffff (0x18be bytes) 000302 1780332121.169345 punch from 0x01c9c2 to 0x020c7f (0x42be bytes) 000303 1780332121.174297 mapwrite 0x028b76 thru 0x035f04 (0xd38f bytes) 000305 1780332121.197691 trunc from 0x027c5c to 0x02c8a7 (0x4c4c bytes) 000306 1780332121.203638 trunc from 0x01dc69 to 0x027c04 (0x9f9c bytes) 000307 1780332121.208806 punch from 0x013b8b to 0x01ce45 (0x92bb bytes) 000308 1780332121.213069 read 0x02be22 thru 0x02e87c (0x2a5b bytes) 000309 1780332121.221676 fallocate 0x02d941 thru 0x031a09 (0x40c9 bytes) 000311 1780332121.227674 punch from 0x0254e5 to 0x02e9ce (0x94ea bytes) 000312 1780332121.233686 read 0x00bcb0 thru 0x00ccdf (0x1030 bytes) 000313 1780332121.236365 read 0x039a97 thru 0x03e930 (0x4e9a bytes) 000314 1780332121.237549 mapread 0x0173bb thru 0x01f3b9 (0x7fff bytes) 000315 1780332121.238974 write 0x01fc1c thru 0x020696 (0xa7b bytes) 000316 1780332121.243071 punch from 0x012079 to 0x01d80c (0xb794 bytes) 000317 1780332121.248507 mapread 0x01ea0a thru 0x01ee98 (0x48f bytes) 000318 1780332121.249945 write 0x01424c thru 0x020c04 (0xc9b9 bytes) 000319 1780332121.259726 mapwrite 0x024533 thru 0x033306 (0xedd4 bytes) 000320 1780332121.276160 mapwrite 0x035ddd thru 0x0366e5 (0x909 bytes) 000321 1780332121.288725 punch from 0x00d56a to 0x01b8a1 (0xe338 bytes) 000322 1780332121.293899 write 0x007702 thru 0x0134a3 (0xbda2 bytes) 000323 1780332121.300499 mapwrite 0x02fc51 thru 0x03517d (0x552d bytes) 000324 1780332121.320568 write 0x003b47 thru 0x00a3bb (0x6875 bytes) 000325 1780332121.322980 mapread 0x015118 thru 0x01fa5a (0xa943 bytes) 000326 1780332121.360513 mapwrite 0x02d11a thru 0x037338 (0xa21f bytes) 000328 1780332121.380451 trunc from 0x00a58e to 0x0190a6 (0xeb19 bytes) 000330 1780332121.386527 punch from 0x03f13c to 0x03ffff (0xec4 bytes) fallocating to largest ever: 0x40000 000331 1780332121.391393 fallocate 0x03091b thru 0x03ffff (0xf6e5 bytes) 000332 1780332121.396838 mapread 0x00d2e8 thru 0x01089b (0x35b4 bytes) 000333 1780332121.417834 punch from 0x00ebc0 to 0x00f52a (0x96b bytes) 000334 1780332121.422904 trunc from 0x040000 to 0x0044b5 (0x3bb4a bytes) 000335 1780332121.444510 mapwrite 0x0064c3 thru 0x006fe9 (0xb27 bytes) 000336 1780332121.515491 fallocate 0x018b46 thru 0x01be92 (0x334d bytes) 000337 1780332121.521849 mapread 0x0108d9 thru 0x013be9 (0x3311 bytes) 000339 1780332121.547346 mapwrite 0x006e3a thru 0x00af81 (0x4148 bytes) 000340 1780332121.599626 write 0x035e55 thru 0x03ffff (0xa1ab bytes) 000341 1780332121.607477 mapread 0x03422d thru 0x038412 (0x41e6 bytes) 000342 1780332121.615626 trunc from 0x040000 to 0x00d642 (0x329bd bytes) 000346 1780332121.639846 trunc from 0x004480 to 0x00b747 (0x72c8 bytes) 000347 1780332121.646731 trunc from 0x00763a to 0x00d642 (0x6009 bytes) 000348 1780332121.655088 fallocate 0x017281 thru 0x01b22c (0x3fac bytes) 000349 1780332121.660503 mapread 0x003f51 thru 0x00d642 (0x96f2 bytes) 000350 1780332121.739555 read 0x000e7d thru 0x0036ee (0x2872 bytes) 000352 1780332121.749968 MIRROR_EXTEND to 2 mirrors 000353 1780332122.353371 mapwrite 0x01eda0 thru 0x01fb79 (0xdda bytes) 000354 1780332122.422330 MIRROR_RESYNC 2 mirrors 000355 1780332122.953957 mapwrite 0x002cdd thru 0x0070b4 (0x43d8 bytes) 000356 1780332123.058785 mapwrite 0x028ca7 thru 0x035ae1 (0xce3b bytes) 000357 1780332123.165505 fallocate 0x0257b0 thru 0x02bcb8 (0x6509 bytes) 000358 1780332123.174037 punch from 0x01085d to 0x019820 (0x8fc4 bytes) 000359 1780332123.182026 mapread 0x02e7f5 thru 0x030c0a (0x2416 bytes) 000360 1780332123.186485 mapwrite 0x015c6e thru 0x021c63 (0xbff6 bytes) 000361 1780332123.225020 write 0x00b797 thru 0x01975c (0xdfc6 bytes) 000362 1780332123.228613 trunc from 0x035ae2 to 0x014e08 (0x20cd9 bytes) 000363 1780332123.250336 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000364 1780332123.363495 read 0x00ec7e thru 0x014e08 (0x618b bytes) 000365 1780332123.370356 trunc from 0x014e09 to 0x024313 (0xf50b bytes) 000366 1780332123.391223 trunc from 0x024314 to 0x03e364 (0x1a051 bytes) 000367 1780332123.413887 fallocate 0x01f037 thru 0x02c714 (0xd6de bytes) 000369 1780332123.422867 write 0x007b77 thru 0x0124dd (0xa967 bytes) 000370 1780332123.431782 fallocate 0x01d54a thru 0x02086b (0x3322 bytes) 000371 1780332123.440312 trunc from 0x03e365 to 0x007a0e (0x36956 bytes) 000373 1780332123.463670 fallocate 0x01fbfa thru 0x0270a9 (0x74b0 bytes) 000374 1780332123.470479 fallocate 0x02095d thru 0x02bafc (0xb1a0 bytes) 000375 1780332123.479501 trunc from 0x0270aa to 0x02daa2 (0x69f9 bytes) 000376 1780332123.492374 punch from 0x0032ec to 0x00a509 (0x721e bytes) 000377 1780332123.501935 punch from 0x012051 to 0x017f75 (0x5f25 bytes) 000378 1780332123.507080 mapwrite 0x03f519 thru 0x03ffff (0xae7 bytes) 000379 1780332123.535637 trunc from 0x021dfd to 0x026508 (0x470c bytes) 000380 1780332123.544069 write 0x01aa9c thru 0x02a55d (0xfac2 bytes) 000381 1780332123.572057 trunc from 0x02685a to 0x029496 (0x2c3d bytes) 000382 1780332123.585608 fallocate 0x03ee41 thru 0x03ffff (0x11bf bytes) 000385 1780332123.592405 fallocate 0x008d28 thru 0x00e683 (0x595c bytes) 000386 1780332123.601717 MIRROR_EXTEND to 2 mirrors 000387 1780332124.419413 write 0x028322 thru 0x028b59 (0x838 bytes) 000388 1780332124.456023 read 0x00fe07 thru 0x01665f (0x6859 bytes) 000389 1780332124.467374 mapread 0x039364 thru 0x03ffff (0x6c9c bytes) 000390 1780332124.484420 punch from 0x0013ab to 0x0089e3 (0x7639 bytes) 000391 1780332124.489746 mapread 0x00724c thru 0x010168 (0x8f1d bytes) 000392 1780332124.502293 fallocate 0x00431e thru 0x005ea7 (0x1b8a bytes) 000394 1780332124.509447 trunc from 0x040000 to 0x02f819 (0x107e6 bytes) 000395 1780332124.533619 write 0x019f66 thru 0x024672 (0xa70d bytes) 000396 1780332124.546565 fallocate 0x018f98 thru 0x01cbc7 (0x3c30 bytes) 000397 1780332124.557907 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f81a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f81a): Mirror 2: 0xf58395a4 (stale) CRC-32 checksum value for chunk [0, 0x2f81a): Mirror 1: 0x5eb5323 Mirror 3: 0x5eb5323 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f81a: skipped 000399 1780332125.422959 fallocate 0x02fb47 thru 0x0340f8 (0x45b2 bytes) 000400 1780332125.482392 trunc from 0x02f81a to 0x01811b (0x176fe bytes) 000401 1780332125.540913 write 0x02ba5e thru 0x03813a (0xc6dd bytes) 000402 1780332125.552344 mapread 0x00a621 thru 0x015542 (0xaf22 bytes) 000403 1780332125.591977 trunc from 0x031946 to 0x03634f (0x4a0a bytes) 000405 1780332125.620602 trunc from 0x006624 to 0x0150bd (0xea9a bytes) 000406 1780332125.636419 trunc from 0x03813b to 0x007c95 (0x304a5 bytes) 000407 1780332125.671433 trunc from 0x007c96 to 0x01ad59 (0x130c4 bytes) 000408 1780332125.698339 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: 0xdfdaa3fa (stale) Mirror 3: 0x31c7189 (stale) CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 1: 0x278f1bff Mirror 4: 0x278f1bff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad5a: skipped 000409 1780332126.721150 read 0x000867 thru 0x00cc21 (0xc3bb bytes) 000410 1780332126.744538 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: 0xdfdaa3fa (stale) Mirror 3: 0x31c7189 (stale) CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 1: 0x278f1bff Mirror 4: 0x278f1bff Mirror 5: 0x278f1bff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad5a: skipped 000411 1780332127.522407 punch from 0x015fb4 to 0x01ad59 (0x4da6 bytes) 000412 1780332127.568058 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: 0xdfdaa3fa (stale) Mirror 3: 0x31c7189 (stale) Mirror 4: 0x278f1bff (stale) Mirror 5: 0x278f1bff (stale) CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 1: 0x278f1bff Mirror 6: 0x278f1bff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad5a: skipped 000413 1780332128.405555 punch from 0x014b2f to 0x0199c0 (0x4e92 bytes) 000414 1780332128.471053 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: 0xdfdaa3fa (stale) Mirror 4: 0x278f1bff (stale) Mirror 5: 0x278f1bff (stale) Mirror 6: 0x278f1bff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad5a): Mirror 2: 0xdfdaa3fa (stale) Mirror 4: 0x278f1bff (stale) Mirror 5: 0x278f1bff (stale) Mirror 6: 0x278f1bff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad5a: skipped 000415 1780332128.942063 fallocate 0x012e01 thru 0x01c5df (0x97df bytes) 000416 1780332128.949198 punch from 0x0032b0 to 0x00a6a4 (0x73f5 bytes) 000417 1780332128.954741 punch from 0x00cd9e to 0x016bae (0x9e11 bytes) 000418 1780332128.959430 read 0x01635d thru 0x01ad59 (0x49fd bytes) 000420 1780332128.968706 punch from 0x000853 to 0x00c735 (0xbee3 bytes) 000421 1780332128.974927 read 0x010d5f thru 0x01ad59 (0x9ffb bytes) 000422 1780332128.989397 fallocate 0x036a2c thru 0x036d19 (0x2ee bytes) 000423 1780332128.994277 punch from 0x0003a8 to 0x001aec (0x1745 bytes) 000424 1780332129.001303 trunc from 0x01ad5a to 0x02bdd3 (0x1107a bytes) 000425 1780332129.037912 read 0x007f58 thru 0x01682e (0xe8d7 bytes) 000426 1780332129.039051 trunc from 0x012a27 to 0x01ddb5 (0xb38f bytes) 000427 1780332129.047129 write 0x0140d3 thru 0x01ca81 (0x89af bytes) 000428 1780332129.081920 MIRROR_RESYNC 5 mirrors 000429 1780332130.455043 trunc from 0x02bdd4 to 0x01c83a (0xf599 bytes) 000430 1780332130.520458 trunc from 0x01c83b to 0x02b0d5 (0xe89b bytes) 000431 1780332130.571981 mapread 0x0153fb thru 0x0218ec (0xc4f2 bytes) 000432 1780332130.612716 trunc from 0x01c0a4 to 0x0228ff (0x685c bytes) 000433 1780332130.623783 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2b0d6): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0d6): Mirror 2: 0xcb795323 (stale) Mirror 4: 0xcb795323 (stale) Mirror 5: 0xcb795323 (stale) Mirror 6: 0xcb795323 (stale) CRC-32 checksum value for chunk [0, 0x2b0d6): Mirror 1: 0x81fbb876 Mirror 7: 0x81fbb876 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0d6: skipped 000434 1780332131.492582 trunc from 0x00191f to 0x00aceb (0x93cd bytes) 000436 1780332131.582816 mapwrite 0x017b92 thru 0x0269df (0xee4e bytes) 000437 1780332131.641431 punch from 0x022308 to 0x02b0d5 (0x8dce bytes) 000438 1780332131.650855 trunc from 0x02b0d6 to 0x007c78 (0x2345d bytes) 000439 1780332131.693386 fallocate 0x03af58 thru 0x03ffff (0x50a8 bytes) 000441 1780332131.699497 mapwrite 0x03446d thru 0x038080 (0x3c14 bytes) 000442 1780332131.741195 mapwrite 0x00f23b thru 0x0151be (0x5f84 bytes) 000443 1780332131.781850 trunc from 0x030953 to 0x038080 (0x772e bytes) 000444 1780332131.798093 trunc from 0x0256aa to 0x028164 (0x2abb bytes) 000445 1780332131.803344 mapwrite 0x00677d thru 0x015836 (0xf0ba bytes) 000446 1780332131.831511 trunc from 0x0249f0 to 0x033d65 (0xf376 bytes) 000447 1780332131.837810 trunc from 0x01bbe4 to 0x024da1 (0x91be bytes) 000448 1780332131.843631 trunc from 0x038081 to 0x025405 (0x12c7b bytes) 000449 1780332131.859476 mapwrite 0x006225 thru 0x0079d5 (0x17b1 bytes) 000450 1780332131.876079 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x25406): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25406): Mirror 2: 0xdb3273a8 (stale) Mirror 4: 0xdb3273a8 (stale) Mirror 5: 0xdb3273a8 (stale) Mirror 6: 0xdb3273a8 (stale) Mirror 7: 0x3f574940 (stale) CRC-32 checksum value for chunk [0, 0x25406): Mirror 1: 0xd0ffe316 Mirror 8: 0xd0ffe316 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25406: skipped 000451 1780332132.937350 mapread 0x01a655 thru 0x02529c (0xac48 bytes) 000452 1780332132.964928 punch from 0x014105 to 0x02375e (0xf65a bytes) 000453 1780332133.012044 fallocate 0x009982 thru 0x00fe0e (0x648d bytes) 000454 1780332133.020313 mapwrite 0x02ea16 thru 0x0368ee (0x7ed9 bytes) 000455 1780332133.103897 fallocate 0x0007cb thru 0x00f1c4 (0xe9fa bytes) 000456 1780332133.112714 read 0x00f0df thru 0x01b46d (0xc38f bytes) 000457 1780332133.131233 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x368ef): Mirror 4: 0xb6f80f28 (stale) Mirror 5: 0xb6f80f28 (stale) Mirror 6: 0xb6f80f28 (stale) Mirror 7: 0x2fcc485c (stale) Mirror 8: 0x7d641d3e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368ef): Mirror 4: 0xb6f80f28 (stale) Mirror 5: 0xb6f80f28 (stale) Mirror 6: 0xb6f80f28 (stale) Mirror 7: 0x2fcc485c (stale) Mirror 8: 0x7d641d3e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368ef: skipped 000458 1780332133.590343 fallocate 0x02194d thru 0x02c455 (0xab09 bytes) 000459 1780332133.602529 punch from 0x02629e to 0x0276fd (0x1460 bytes) 000460 1780332133.606707 punch from 0x026a4b to 0x02b365 (0x491b bytes) 000461 1780332133.611514 trunc from 0x02ae46 to 0x034681 (0x983c bytes) 000462 1780332133.624923 MIRROR_RESYNC 6 mirrors 000463 1780332135.186629 trunc from 0x035f71 to 0x0368ee (0x97e bytes) 000464 1780332135.237411 trunc from 0x00826f to 0x00f08e (0x6e20 bytes) 000465 1780332135.243355 trunc from 0x0368ef to 0x02b771 (0xb17d bytes) 000466 1780332135.268043 read 0x012541 thru 0x01ee21 (0xc8e1 bytes) 000467 1780332135.278357 trunc from 0x02b772 to 0x012eff (0x18872 bytes) 000468 1780332135.296801 punch from 0x0096c4 to 0x012088 (0x89c5 bytes) 000469 1780332135.302807 trunc from 0x012f00 to 0x018904 (0x5a05 bytes) 000470 1780332135.338129 punch from 0x00839a to 0x012ba0 (0xa807 bytes) 000471 1780332135.355220 trunc from 0x004a3c to 0x009e97 (0x545c bytes) 000472 1780332135.363667 punch from 0x0139a1 to 0x018904 (0x4f64 bytes) 000473 1780332135.369436 fallocate 0x0173df thru 0x0235fe (0xc220 bytes) 000474 1780332135.379539 mapread 0x00e11d thru 0x0112a2 (0x3186 bytes) 000475 1780332135.422695 trunc from 0x018905 to 0x02e5d9 (0x15cd5 bytes) 000476 1780332135.439647 write 0x027cd9 thru 0x02d119 (0x5441 bytes) 000477 1780332135.450427 mapread 0x0280a9 thru 0x02e5d9 (0x6531 bytes) 000478 1780332135.452481 punch from 0x02cce0 to 0x02e5d9 (0x18fa bytes) 000479 1780332135.471446 punch from 0x014025 to 0x022302 (0xe2de bytes) 000480 1780332135.484274 mapread 0x009e83 thru 0x00f64e (0x57cc bytes) 000481 1780332135.485486 mapread 0x009cca thru 0x00f541 (0x5878 bytes) 000482 1780332135.486906 fallocate 0x01ee14 thru 0x02582a (0x6a17 bytes) 000483 1780332135.496887 write 0x012cde thru 0x01a137 (0x745a bytes) 000484 1780332135.508502 punch from 0x008a8b to 0x013db2 (0xb328 bytes) 000485 1780332135.526850 read 0x00dc7f thru 0x015740 (0x7ac2 bytes) 000486 1780332135.542378 punch from 0x00eee0 to 0x01d1cc (0xe2ed bytes) 000489 1780332135.553733 mapwrite 0x00d378 thru 0x019e0d (0xca96 bytes) 000490 1780332135.669383 fallocate 0x00dc9b thru 0x00e872 (0xbd8 bytes) 000492 1780332135.679797 read 0x016044 thru 0x01dea5 (0x7e62 bytes) 000493 1780332135.697325 mapwrite 0x0112b0 thru 0x0167d9 (0x552a bytes) 000494 1780332135.722666 write 0x036663 thru 0x03bea9 (0x5847 bytes) 000495 1780332135.724479 mapread 0x01056a thru 0x0143c5 (0x3e5c bytes) 000496 1780332135.727981 punch from 0x02d89f to 0x037e01 (0xa563 bytes) 000497 1780332135.749327 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3beaa): Mirror 4: 0xbe53b0c6 (stale) Mirror 5: 0xbe53b0c6 (stale) Mirror 6: 0xbe53b0c6 (stale) Mirror 7: 0xbe53b0c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beaa): Mirror 4: 0xbe53b0c6 (stale) Mirror 5: 0xbe53b0c6 (stale) Mirror 6: 0xbe53b0c6 (stale) Mirror 7: 0xbe53b0c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beaa: skipped 000498 1780332136.131420 write 0x028ae8 thru 0x02fe03 (0x731c bytes) 000499 1780332136.150328 punch from 0x01ffb1 to 0x02c620 (0xc670 bytes) 000500 1780332136.169828 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3beaa): Mirror 5: 0xbe53b0c6 (stale) Mirror 6: 0xbe53b0c6 (stale) Mirror 7: 0xbe53b0c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beaa): Mirror 5: 0xbe53b0c6 (stale) Mirror 6: 0xbe53b0c6 (stale) Mirror 7: 0xbe53b0c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beaa: skipped 000501 1780332136.503434 fallocate 0x002306 thru 0x00a9e2 (0x86dd bytes) 000502 1780332136.516415 trunc from 0x03beaa to 0x00959d (0x3290c bytes) 000503 1780332136.544203 mapwrite 0x020ceb thru 0x02107a (0x390 bytes) 000504 1780332136.591395 mapread 0x0109c9 thru 0x01954e (0x8b86 bytes) 000505 1780332136.609012 fallocate 0x01b6c1 thru 0x024b9c (0x94dc bytes) 000506 1780332136.614248 mapread 0x014ed8 thru 0x02107a (0xc1a3 bytes) 000507 1780332136.616969 fallocate 0x00340b thru 0x00344c (0x42 bytes) 000508 1780332136.622210 trunc from 0x02107b to 0x032944 (0x118ca bytes) 000509 1780332136.637172 write 0x0395f1 thru 0x03fafc (0x650c bytes) 000511 1780332136.640284 punch from 0x02e248 to 0x032549 (0x4302 bytes) 000512 1780332136.646192 read 0x03eed2 thru 0x03fafc (0xc2b bytes) 000513 1780332136.646892 read 0x001744 thru 0x011088 (0xf945 bytes) 000514 1780332136.657458 mapwrite 0x011590 thru 0x01c86d (0xb2de bytes) 000515 1780332136.681323 write 0x0261a7 thru 0x02646c (0x2c6 bytes) 000516 1780332136.682494 fallocate 0x028ea8 thru 0x02a4e5 (0x163e bytes) 000517 1780332136.695845 mapwrite 0x004275 thru 0x00af2d (0x6cb9 bytes) 000518 1780332136.738690 fallocate 0x0337b8 thru 0x036f36 (0x377f bytes) 000519 1780332136.745400 mapread 0x010a90 thru 0x019d20 (0x9291 bytes) 000520 1780332136.753255 punch from 0x025f3b to 0x02ee33 (0x8ef9 bytes) 000521 1780332136.763411 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fafd): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fafd): Mirror 5: 0xe075b3d6 (stale) Mirror 6: 0xe075b3d6 (stale) Mirror 7: 0xe075b3d6 (stale) CRC-32 checksum value for chunk [0, 0x3fafd): Mirror 1: 0x16c85b27 Mirror 8: 0x16c85b27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fafd: skipped 000522 1780332138.007895 mapwrite 0x02d62a thru 0x0376a5 (0xa07c bytes) 000523 1780332138.140925 write 0x02804e thru 0x0291f3 (0x11a6 bytes) 000524 1780332138.147279 mapwrite 0x009814 thru 0x00c466 (0x2c53 bytes) 000525 1780332138.179769 trunc from 0x02b563 to 0x034a9f (0x953d bytes) 000527 1780332138.186751 mapwrite 0x039993 thru 0x03ffff (0x666d bytes) 000528 1780332138.227289 write 0x0155bc thru 0x01e8d9 (0x931e bytes) 000529 1780332138.247953 fallocate 0x010833 thru 0x014c1a (0x43e8 bytes) 000530 1780332138.255849 mapread 0x023d72 thru 0x033132 (0xf3c1 bytes) 000531 1780332138.291204 MIRROR_RESYNC 5 mirrors 000532 1780332140.203905 read 0x03debe thru 0x03ffff (0x2142 bytes) 000533 1780332140.215785 mapwrite 0x0210ff thru 0x02f8a6 (0xe7a8 bytes) 000534 1780332140.343372 write 0x0292da thru 0x02ea1f (0x5746 bytes) 000535 1780332140.346093 fallocate 0x00aaeb thru 0x01008f (0x55a5 bytes) 000536 1780332140.352343 mapwrite 0x01d04e thru 0x02b2db (0xe28e bytes) 000537 1780332140.377569 read 0x00ef5b thru 0x0105fb (0x16a1 bytes) 000538 1780332140.395717 MIRROR_RESYNC 5 mirrors 000539 1780332141.960380 punch from 0x0093e8 to 0x00b49b (0x20b4 bytes) 000540 1780332142.032864 mapread 0x00c63d thru 0x015cb0 (0x9674 bytes) 000541 1780332142.061209 read 0x02a145 thru 0x02c9ee (0x28aa bytes) 000542 1780332142.069726 trunc from 0x040000 to 0x0106fb (0x2f904 bytes) 000543 1780332142.097393 fallocate 0x008064 thru 0x011e1e (0x9dbb bytes) 000544 1780332142.103205 mapread 0x010ee7 thru 0x011e1e (0xf38 bytes) 000545 1780332142.110887 trunc from 0x0047ae to 0x00810b (0x395e bytes) 000546 1780332142.117403 mapread 0x00044a thru 0x00debe (0xda75 bytes) 000547 1780332142.142164 punch from 0x007ebc to 0x0109bf (0x8b04 bytes) 000548 1780332142.148792 mapwrite 0x01548b thru 0x0177e1 (0x2357 bytes) 000549 1780332142.194230 write 0x023fd4 thru 0x02445d (0x48a bytes) 000550 1780332142.197828 trunc from 0x02445e to 0x012b2b (0x11932 bytes) 000551 1780332142.221052 mapread 0x011cbe thru 0x012b2b (0xe6e bytes) 000552 1780332142.223042 punch from 0x005374 to 0x012b2b (0xd7b8 bytes) 000553 1780332142.235089 trunc from 0x009b74 to 0x00c644 (0x2ad1 bytes) 000554 1780332142.241066 fallocate 0x003876 thru 0x009f8b (0x6716 bytes) 000555 1780332142.249255 write 0x014ce4 thru 0x021018 (0xc335 bytes) 000556 1780332142.251583 trunc from 0x021019 to 0x020791 (0x887 bytes) 000557 1780332142.279258 mapwrite 0x03eff8 thru 0x03ffff (0x1008 bytes) 000558 1780332142.355876 write 0x00eea2 thru 0x00fb40 (0xc9f bytes) 000560 1780332142.370946 trunc from 0x040000 to 0x01d19d (0x22e62 bytes) 000561 1780332142.408665 trunc from 0x01d19e to 0x002b8b (0x1a612 bytes) 000562 1780332142.433480 write 0x03889e thru 0x03ffff (0x7762 bytes) 000563 1780332142.442919 mapread 0x024745 thru 0x02830d (0x3bc9 bytes) 000564 1780332142.461176 punch from 0x00f315 to 0x0125cf (0x32bb bytes) 000565 1780332142.483158 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8277849 (stale) Mirror 6: 0x8277849 (stale) Mirror 7: 0x8277849 (stale) Mirror 8: 0x8277849 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb8e7dc45 Mirror 9: 0xb8e7dc45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000566 1780332143.595477 read 0x01fdd4 thru 0x02718c (0x73b9 bytes) 000567 1780332143.610384 mapwrite 0x03a020 thru 0x03ffff (0x5fe0 bytes) 000568 1780332143.728043 MIRROR_RESYNC 6 mirrors 000569 1780332145.233320 trunc from 0x040000 to 0x01c69f (0x23960 bytes) 000570 1780332145.329303 fallocate 0x032542 thru 0x034f59 (0x2a18 bytes) 000571 1780332145.337671 trunc from 0x02b165 to 0x0343c7 (0x9263 bytes) 000572 1780332145.344538 mapwrite 0x023341 thru 0x02be72 (0x8b32 bytes) 000573 1780332145.409850 write 0x001674 thru 0x006f33 (0x58c0 bytes) 000575 1780332145.430429 trunc from 0x034f5a to 0x034c39 (0x320 bytes) 000576 1780332145.485460 punch from 0x001c93 to 0x0035da (0x1948 bytes) 000577 1780332145.516136 trunc from 0x01507f to 0x01b7f7 (0x6779 bytes) 000578 1780332145.561891 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34c3a): Mirror 6: 0x96f1fe84 (stale) Mirror 7: 0x96f1fe84 (stale) Mirror 8: 0x96f1fe84 (stale) Mirror 9: 0x96f1fe84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c3a): Mirror 6: 0x96f1fe84 (stale) Mirror 7: 0x96f1fe84 (stale) Mirror 8: 0x96f1fe84 (stale) Mirror 9: 0x96f1fe84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c3a: skipped 000579 1780332146.184796 mapwrite 0x030c4f thru 0x0337be (0x2b70 bytes) 000580 1780332146.248447 trunc from 0x034c3a to 0x02fa9a (0x519f bytes) 000581 1780332146.304728 read 0x02f578 thru 0x02fa9a (0x523 bytes) 000582 1780332146.306394 punch from 0x001a1a to 0x00504c (0x3633 bytes) 000583 1780332146.324707 write 0x002967 thru 0x010ff1 (0xe68b bytes) 000584 1780332146.357872 fallocate 0x022d62 thru 0x02d246 (0xa4e5 bytes) 000585 1780332146.364935 mapwrite 0x027486 thru 0x02ac11 (0x378c bytes) 000586 1780332146.426057 punch from 0x020a89 to 0x022d42 (0x22ba bytes) 000587 1780332146.440781 trunc from 0x02fa9b to 0x016291 (0x19809 bytes) 000588 1780332146.488500 trunc from 0x005f83 to 0x00d905 (0x7983 bytes) 000589 1780332146.504966 trunc from 0x006240 to 0x007eb7 (0x1c78 bytes) 000591 1780332146.523845 trunc from 0x016292 to 0x0100cc (0x61c5 bytes) 000592 1780332146.549164 mapwrite 0x0101f8 thru 0x011476 (0x127f bytes) 000593 1780332146.620949 fallocate 0x02ecb4 thru 0x03e8d0 (0xfc1d bytes) 000594 1780332146.633826 mapread 0x00b7af thru 0x00f9cb (0x421d bytes) 000595 1780332146.634898 fallocate 0x019c95 thru 0x025681 (0xb9ed bytes) 000596 1780332146.645944 mapwrite 0x01614c thru 0x0198a7 (0x375c bytes) 000597 1780332146.690467 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x25682): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25682): Mirror 6: 0x355c99c2 (stale) Mirror 7: 0x355c99c2 (stale) Mirror 8: 0x355c99c2 (stale) Mirror 9: 0x355c99c2 (stale) CRC-32 checksum value for chunk [0, 0x25682): Mirror 1: 0x3157f928 Mirror 10: 0x3157f928 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25682: skipped 000598 1780332147.884139 punch from 0x01c5df to 0x02441a (0x7e3c bytes) 000599 1780332147.944832 mapread 0x011b83 thru 0x01963e (0x7abc bytes) 000600 1780332148.014694 fallocate 0x02c0ee thru 0x033b76 (0x7a89 bytes) 000601 1780332148.024986 mapread 0x014045 thru 0x01bac3 (0x7a7f bytes) 000602 1780332148.026886 read 0x0002b2 thru 0x001999 (0x16e8 bytes) 000603 1780332148.053549 MIRROR_RESYNC 6 mirrors 000604 1780332150.008760 trunc from 0x025682 to 0x031eed (0xc86c bytes) 000607 1780332150.050729 trunc from 0x031eee to 0x00f4c7 (0x22a26 bytes) 000608 1780332150.079835 trunc from 0x00b0e5 to 0x00f4c7 (0x43e3 bytes) 000609 1780332150.086620 mapwrite 0x019171 thru 0x025bda (0xca6a bytes) 000610 1780332150.178144 mapread 0x0111dd thru 0x019883 (0x86a7 bytes) 000611 1780332150.196974 mapread 0x0182b6 thru 0x025bda (0xd925 bytes) 000612 1780332150.199832 mapread 0x006fe5 thru 0x008457 (0x1473 bytes) 000615 1780332150.234628 mapwrite 0x014319 thru 0x015c0d (0x18f5 bytes) 000616 1780332150.264557 trunc from 0x019894 to 0x0241d1 (0xa93e bytes) 000618 1780332150.276171 write 0x02ddaa thru 0x0389a4 (0xabfb bytes) 000619 1780332150.279122 read 0x010e81 thru 0x011594 (0x714 bytes) 000620 1780332150.280039 mapread 0x01bb92 thru 0x022263 (0x66d2 bytes) 000621 1780332150.294265 punch from 0x024c4e to 0x02e079 (0x942c bytes) 000624 1780332150.308204 write 0x01bc2e thru 0x025265 (0x9638 bytes) 000625 1780332150.314803 trunc from 0x01333a to 0x01d597 (0xa25e bytes) 000626 1780332150.328481 trunc from 0x025c30 to 0x031fb8 (0xc389 bytes) 000627 1780332150.342121 read 0x0031fb thru 0x00fe78 (0xcc7e bytes) 000628 1780332150.343274 write 0x01215b thru 0x014932 (0x27d8 bytes) 000629 1780332150.356643 write 0x004b67 thru 0x00b6aa (0x6b44 bytes) 000630 1780332150.358615 mapread 0x003ea5 thru 0x00cc13 (0x8d6f bytes) 000631 1780332150.359989 mapwrite 0x00e116 thru 0x00fabd (0x19a8 bytes) 000632 1780332150.378270 mapwrite 0x0183c4 thru 0x022719 (0xa356 bytes) 000633 1780332150.404906 MIRROR_RESYNC 6 mirrors 000634 1780332152.290392 mapread 0x02e51f thru 0x03273c (0x421e bytes) 000635 1780332152.330788 read 0x016768 thru 0x020865 (0xa0fe bytes) 000636 1780332152.344533 punch from 0x021029 to 0x02d84d (0xc825 bytes) 000637 1780332152.393917 fallocate 0x008746 thru 0x00a978 (0x2233 bytes) 000638 1780332152.409578 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x389a5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389a5): Mirror 6: 0x30fd1584 (stale) Mirror 7: 0x30fd1584 (stale) Mirror 8: 0x30fd1584 (stale) Mirror 9: 0x30fd1584 (stale) Mirror 10: 0x30fd1584 (stale) CRC-32 checksum value for chunk [0, 0x389a5): Mirror 1: 0x24d8ca40 Mirror 11: 0x24d8ca40 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389a5: skipped 000639 1780332153.637559 write 0x016429 thru 0x0191ec (0x2dc4 bytes) 000640 1780332153.707502 mapwrite 0x02b604 thru 0x02ce10 (0x180d bytes) 000641 1780332153.745009 fallocate 0x01093d thru 0x0207ef (0xfeb3 bytes) 000643 1780332153.760184 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x389a5): Mirror 6: 0x30fd1584 (stale) Mirror 7: 0x30fd1584 (stale) Mirror 9: 0x30fd1584 (stale) Mirror 10: 0x30fd1584 (stale) Mirror 11: 0x24d8ca40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389a5): Mirror 6: 0x30fd1584 (stale) Mirror 7: 0x30fd1584 (stale) Mirror 9: 0x30fd1584 (stale) Mirror 10: 0x30fd1584 (stale) Mirror 11: 0x24d8ca40 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389a5: skipped 000644 1780332154.416756 trunc from 0x0389a5 to 0x007bc9 (0x30ddb bytes) 000645 1780332154.459086 mapwrite 0x03da7c thru 0x03ffff (0x2584 bytes) 000646 1780332154.540511 fallocate 0x01dac9 thru 0x026e57 (0x938f bytes) 000648 1780332154.549739 fallocate 0x00697f thru 0x00f826 (0x8ea8 bytes) 000649 1780332154.561764 MIRROR_RESYNC 6 mirrors 000650 1780332155.653801 punch from 0x021992 to 0x02ab88 (0x91f7 bytes) 000651 1780332155.699075 punch from 0x0312f6 to 0x032f4e (0x1c59 bytes) 000652 1780332155.712007 write 0x028291 thru 0x02afec (0x2d5c bytes) 000653 1780332155.730748 mapread 0x01b145 thru 0x01dffd (0x2eb9 bytes) 000654 1780332155.745066 fallocate 0x01bf3f thru 0x0274d9 (0xb59b bytes) 000655 1780332155.758924 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa0c5335f (stale) Mirror 7: 0xa0c5335f (stale) Mirror 10: 0xa0c5335f (stale) Mirror 11: 0xa0c5335f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa0c5335f (stale) Mirror 7: 0xa0c5335f (stale) Mirror 10: 0xa0c5335f (stale) Mirror 11: 0xa0c5335f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000656 1780332156.195450 write 0x02fb6b thru 0x03de68 (0xe2fe bytes) 000657 1780332156.216466 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa0c5335f (stale) Mirror 7: 0xa0c5335f (stale) Mirror 10: 0xa0c5335f (stale) Mirror 11: 0xa0c5335f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7b15626 Mirror 12: 0x7b15626 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000658 1780332157.229474 mapwrite 0x01ffe0 thru 0x029196 (0x91b7 bytes) 000659 1780332157.367627 mapread 0x026b1d thru 0x02bd7a (0x525e bytes) 000660 1780332157.370217 read 0x0263b0 thru 0x033575 (0xd1c6 bytes) 000661 1780332157.381777 mapwrite 0x03275d thru 0x03393b (0x11df bytes) 000662 1780332157.400959 trunc from 0x031a5f to 0x03c79f (0xad41 bytes) 000663 1780332157.408538 mapread 0x027866 thru 0x02794d (0xe8 bytes) 000664 1780332157.409719 trunc from 0x040000 to 0x03c1d1 (0x3e2e bytes) 000666 1780332157.464636 mapwrite 0x012142 thru 0x0198ee (0x77ad bytes) 000667 1780332157.524558 punch from 0x0251cc to 0x0336e1 (0xe516 bytes) 000668 1780332157.543367 mapread 0x0282b2 thru 0x0376a0 (0xf3ef bytes) 000669 1780332157.591050 mapread 0x01710e thru 0x024f8e (0xde81 bytes) 000670 1780332157.596662 punch from 0x0344eb to 0x036855 (0x236b bytes) 000671 1780332157.626366 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c1d2): Mirror 6: 0xe983a228 (stale) Mirror 7: 0xe983a228 (stale) Mirror 11: 0xe983a228 (stale) Mirror 12: 0xd7661605 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1d2): Mirror 6: 0xe983a228 (stale) Mirror 7: 0xe983a228 (stale) Mirror 11: 0xe983a228 (stale) Mirror 12: 0xd7661605 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1d2: skipped 000672 1780332158.092400 trunc from 0x03c1d2 to 0x00f975 (0x2c85c bytes) 000673 1780332158.115786 write 0x020927 thru 0x02156f (0xc49 bytes) 000674 1780332158.118644 trunc from 0x021570 to 0x012c8f (0xe8e0 bytes) 000676 1780332158.136682 fallocate 0x015cf3 thru 0x0207ed (0xaafb bytes) 000677 1780332158.155093 MIRROR_RESYNC 5 mirrors 000678 1780332159.107735 write 0x029f28 thru 0x039aa7 (0xfb80 bytes) 000679 1780332159.148394 trunc from 0x039aa8 to 0x006899 (0x3320e bytes) 000680 1780332159.176628 fallocate 0x032980 thru 0x03ffff (0xd680 bytes) 000681 1780332159.183517 trunc from 0x0362ad to 0x03a04a (0x3d9e bytes) 000682 1780332159.188436 trunc from 0x02f955 to 0x039be1 (0xa28d bytes) 000683 1780332159.192883 fallocate 0x0370c8 thru 0x03f15f (0x8098 bytes) 000684 1780332159.197170 mapread 0x009272 thru 0x012341 (0x90d0 bytes) 000685 1780332159.224727 read 0x02ea44 thru 0x032223 (0x37e0 bytes) 000686 1780332159.245995 trunc from 0x02ed35 to 0x02f41b (0x6e7 bytes) 000687 1780332159.264534 punch from 0x030ee3 to 0x035601 (0x471f bytes) 000688 1780332159.273818 trunc from 0x040000 to 0x018f8b (0x27074 bytes) 000689 1780332159.305858 punch from 0x016d2e to 0x018f8b (0x225e bytes) 000690 1780332159.317620 write 0x03eede thru 0x03ffff (0x1122 bytes) 000691 1780332159.318940 mapread 0x028246 thru 0x035446 (0xd201 bytes) 000692 1780332159.359930 read 0x0398c3 thru 0x03ffff (0x673d bytes) 000693 1780332159.380202 mapwrite 0x0221aa thru 0x02cc00 (0xaa57 bytes) 000694 1780332159.440581 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x660698a2 (stale) Mirror 7: 0x660698a2 (stale) Mirror 11: 0x660698a2 (stale) Mirror 12: 0x660698a2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9bb67af5 Mirror 13: 0x9bb67af5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000695 1780332160.304709 punch from 0x016597 to 0x01ec14 (0x867e bytes) 000696 1780332160.340510 trunc from 0x040000 to 0x01b86d (0x24792 bytes) 000699 1780332160.386478 mapread 0x018f70 thru 0x01b86d (0x28fe bytes) 000700 1780332160.416518 read 0x00578b thru 0x01427c (0xeaf2 bytes) 000701 1780332160.424014 punch from 0x010f5d to 0x01b86d (0xa911 bytes) 000702 1780332160.429282 fallocate 0x01eac3 thru 0x02d691 (0xebcf bytes) 000703 1780332160.437970 trunc from 0x02d692 to 0x020bae (0xcae3 bytes) 000704 1780332160.472197 fallocate 0x03117a thru 0x035300 (0x4187 bytes) 000705 1780332160.481175 write 0x018036 thru 0x021436 (0x9401 bytes) 000706 1780332160.510402 punch from 0x019dd4 to 0x01b948 (0x1b75 bytes) 000707 1780332160.525567 trunc from 0x035301 to 0x03e6e7 (0x93e7 bytes) 000708 1780332160.542628 punch from 0x019ea6 to 0x01e771 (0x48cc bytes) 000709 1780332160.554600 MIRROR_RESYNC 6 mirrors 000710 1780332162.192085 trunc from 0x0171d8 to 0x021da8 (0xabd1 bytes) 000711 1780332162.227519 read 0x038bfc thru 0x03e410 (0x5815 bytes) 000713 1780332162.237845 trunc from 0x03e6e8 to 0x020898 (0x1de4f bytes) 000714 1780332162.273774 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20899): Mirror 6: 0x7a47cafe (stale) Mirror 7: 0x7a47cafe (stale) Mirror 11: 0x7a47cafe (stale) Mirror 13: 0x7a47cafe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20899): Mirror 6: 0x7a47cafe (stale) Mirror 7: 0x7a47cafe (stale) Mirror 11: 0x7a47cafe (stale) Mirror 13: 0x7a47cafe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20899: skipped 000715 1780332162.738481 trunc from 0x020899 to 0x023b5a (0x32c2 bytes) 000716 1780332162.774189 mapread 0x00389b thru 0x012510 (0xec76 bytes) 000717 1780332162.844944 punch from 0x00d7d9 to 0x0134fb (0x5d23 bytes) 000718 1780332162.851833 fallocate 0x03488c thru 0x03eecc (0xa641 bytes) 000719 1780332162.860989 write 0x0293ae thru 0x02eefe (0x5b51 bytes) 000721 1780332162.880898 punch from 0x0376d4 to 0x03c350 (0x4c7d bytes) 000722 1780332162.885914 fallocate 0x01f033 thru 0x0241d2 (0x51a0 bytes) 000723 1780332162.896636 fallocate 0x01aa8b thru 0x01d3c8 (0x293e bytes) 000725 1780332162.904859 read 0x01716c thru 0x01ceb0 (0x5d45 bytes) 000726 1780332162.910788 fallocate 0x0147f0 thru 0x01a246 (0x5a57 bytes) 000727 1780332162.931579 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3eecd): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eecd): Mirror 6: 0xd136217a (stale) Mirror 7: 0xd136217a (stale) Mirror 11: 0xd136217a (stale) Mirror 13: 0xd136217a (stale) CRC-32 checksum value for chunk [0, 0x3eecd): Mirror 1: 0xdd5c46ca Mirror 14: 0xdd5c46ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eecd: skipped 000729 1780332163.992271 mapread 0x005697 thru 0x00cba6 (0x7510 bytes) 000730 1780332164.018927 mapread 0x021084 thru 0x025e72 (0x4def bytes) 000731 1780332164.032910 punch from 0x01d7eb to 0x029cb9 (0xc4cf bytes) 000732 1780332164.073191 MIRROR_RESYNC 6 mirrors 000733 1780332165.419140 mapwrite 0x004dfb thru 0x0112d7 (0xc4dd bytes) 000734 1780332165.581429 MIRROR_RESYNC 6 mirrors 000735 1780332166.836555 mapread 0x000b09 thru 0x0085ea (0x7ae2 bytes) 000736 1780332166.867215 mapwrite 0x01e6c7 thru 0x02b6ad (0xcfe7 bytes) 000737 1780332167.056551 MIRROR_RESYNC 6 mirrors 000738 1780332168.603208 punch from 0x012415 to 0x01e3d8 (0xbfc4 bytes) 000739 1780332168.644979 write 0x02d3c1 thru 0x032c81 (0x58c1 bytes) 000740 1780332168.662311 write 0x03cb31 thru 0x03ff4c (0x341c bytes) 000741 1780332168.670827 fallocate 0x012955 thru 0x01fe1c (0xd4c8 bytes) 000742 1780332168.676355 trunc from 0x01d52e to 0x02a8f5 (0xd3c8 bytes) 000743 1780332168.681436 write 0x011c4c thru 0x015f48 (0x42fd bytes) 000744 1780332168.690662 fallocate 0x011a96 thru 0x01ab52 (0x90bd bytes) 000745 1780332168.694828 write 0x039405 thru 0x03abd5 (0x17d1 bytes) 000746 1780332168.695873 fallocate 0x03e314 thru 0x03ffff (0x1cec bytes) 000747 1780332168.704249 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ff4d): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ff4d): Mirror 6: 0x14d1707 (stale) Mirror 7: 0x14d1707 (stale) Mirror 11: 0x14d1707 (stale) Mirror 13: 0x14d1707 (stale) Mirror 14: 0x14d1707 (stale) CRC-32 checksum value for chunk [0, 0x3ff4d): Mirror 1: 0xfb9b49ab Mirror 15: 0xfb9b49ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ff4d: skipped 000748 1780332169.779537 mapwrite 0x03bedd thru 0x03ffff (0x4123 bytes) 000750 1780332169.892462 fallocate 0x039a8e thru 0x03d611 (0x3b84 bytes) 000751 1780332169.898021 punch from 0x03b7ce to 0x03ffff (0x4832 bytes) 000752 1780332169.911356 fallocate 0x003906 thru 0x010f65 (0xd660 bytes) 000753 1780332169.921852 read 0x01ee1d thru 0x02aa5f (0xbc43 bytes) 000754 1780332169.939615 trunc from 0x0214c4 to 0x02dbd0 (0xc70d bytes) 000755 1780332169.946317 punch from 0x03b555 to 0x03ffff (0x4aab bytes) 000756 1780332169.952370 trunc from 0x040000 to 0x017494 (0x28b6b bytes) 000757 1780332169.975367 mapread 0x016d9d thru 0x017494 (0x6f8 bytes) 000758 1780332169.985400 punch from 0x005d0e to 0x0148ed (0xebe0 bytes) 000759 1780332169.990796 mapread 0x0051f9 thru 0x00eca7 (0x9aaf bytes) 000760 1780332170.005023 punch from 0x0143a5 to 0x01644f (0x20ab bytes) 000761 1780332170.011967 mapwrite 0x0196f6 thru 0x02590e (0xc219 bytes) 000762 1780332170.092320 mapwrite 0x03a124 thru 0x03ffff (0x5edc bytes) 000763 1780332170.156666 mapwrite 0x00061a thru 0x001ebb (0x18a2 bytes) 000764 1780332170.176001 mapwrite 0x008956 thru 0x0131a0 (0xa84b bytes) 000765 1780332170.202254 mapread 0x03f686 thru 0x03ffff (0x97a bytes) 000766 1780332170.203553 trunc from 0x040000 to 0x03e2ce (0x1d31 bytes) 000768 1780332170.225260 punch from 0x00429d to 0x011a13 (0xd777 bytes) 000769 1780332170.230470 mapwrite 0x0289ee thru 0x02a34b (0x195e bytes) 000770 1780332170.253648 trunc from 0x03e2cf to 0x033cf0 (0xa5de bytes) 000771 1780332170.269369 write 0x037c60 thru 0x03bbe3 (0x3f84 bytes) 000772 1780332170.270805 trunc from 0x000147 to 0x004cf4 (0x4bae bytes) 000773 1780332170.282654 MIRROR_RESYNC 7 mirrors 000775 1780332172.586942 write 0x02a95d thru 0x02f576 (0x4c1a bytes) 000776 1780332172.627452 mapread 0x01f9bd thru 0x028549 (0x8b8d bytes) 000777 1780332172.649832 mapwrite 0x024b42 thru 0x02da04 (0x8ec3 bytes) 000778 1780332172.674506 trunc from 0x019cca to 0x01ff42 (0x6279 bytes) 000779 1780332172.685511 MIRROR_RESYNC 7 mirrors 000780 1780332175.398303 trunc from 0x03bbe4 to 0x0361a8 (0x5a3b bytes) 000781 1780332175.439534 trunc from 0x02d8c1 to 0x0361a8 (0x88e8 bytes) 000782 1780332175.448473 fallocate 0x01579a thru 0x01fe19 (0xa680 bytes) 000783 1780332175.455564 write 0x030a69 thru 0x038da6 (0x833e bytes) 000784 1780332175.461981 punch from 0x0160c7 to 0x02069b (0xa5d5 bytes) 000785 1780332175.469090 punch from 0x036062 to 0x0361cc (0x16b bytes) 000786 1780332175.489559 trunc from 0x038da7 to 0x014333 (0x24a73 bytes) 000787 1780332175.517210 trunc from 0x006777 to 0x014333 (0xdbbd bytes) 000788 1780332175.536170 trunc from 0x014334 to 0x022f9b (0xec68 bytes) 000789 1780332175.566425 read 0x019b4f thru 0x022f9b (0x944d bytes) 000791 1780332175.578865 trunc from 0x014a92 to 0x01b203 (0x6772 bytes) 000792 1780332175.584796 read 0x0165b6 thru 0x022065 (0xbab0 bytes) 000793 1780332175.613168 write 0x0308a9 thru 0x036244 (0x599c bytes) 000794 1780332175.619805 mapwrite 0x031ec1 thru 0x03a883 (0x89c3 bytes) 000795 1780332175.713081 mapread 0x0228c4 thru 0x02a1a9 (0x78e6 bytes) 000796 1780332175.714865 write 0x032b1b thru 0x03ff63 (0xd449 bytes) 000798 1780332175.718899 fallocate 0x00fa40 thru 0x0148a8 (0x4e69 bytes) 000799 1780332175.725402 fallocate 0x02e368 thru 0x0369b7 (0x8650 bytes) 000800 1780332175.733017 trunc from 0x03ff64 to 0x02fdf7 (0x1016c bytes) 000801 1780332175.759412 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2fdf8): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fdf8): Mirror 6: 0xebb55235 (stale) Mirror 7: 0xebb55235 (stale) Mirror 11: 0xebb55235 (stale) Mirror 13: 0xebb55235 (stale) Mirror 14: 0xebb55235 (stale) Mirror 15: 0xebb55235 (stale) CRC-32 checksum value for chunk [0, 0x2fdf8): Mirror 1: 0x4cc93a7b Mirror 16: 0x4cc93a7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fdf8: skipped 000802 1780332176.991867 punch from 0x01e62d to 0x02836f (0x9d43 bytes) 000803 1780332177.077083 fallocate 0x031dad thru 0x03fb3b (0xdd8f bytes) 000804 1780332177.091185 mapread 0x00b21b thru 0x014d11 (0x9af7 bytes) 000805 1780332177.145038 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3fb3c): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb3c): Mirror 6: 0x2074c6e6 (stale) Mirror 7: 0x2074c6e6 (stale) Mirror 11: 0x2074c6e6 (stale) Mirror 13: 0x2074c6e6 (stale) Mirror 14: 0x2074c6e6 (stale) Mirror 15: 0x2074c6e6 (stale) Mirror 16: 0xca8d77d1 (stale) CRC-32 checksum value for chunk [0, 0x3fb3c): Mirror 1: 0xca8d77d1 Mirror 17: 0xca8d77d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb3c: skipped 000806 1780332178.182499 MIRROR_RESYNC 9 mirrors 000808 1780332180.352416 MIRROR_RESYNC 9 mirrors 000809 1780332180.901377 read 0x01462e thru 0x01777b (0x314e bytes) 000810 1780332180.913409 trunc from 0x000381 to 0x0056ce (0x534e bytes) 000811 1780332180.961569 MIRROR_RESYNC 9 mirrors 000812 1780332182.651592 fallocate 0x0245e0 thru 0x02c9fe (0x841f bytes) 000814 1780332182.705315 punch from 0x03f85d to 0x03fb3b (0x2df bytes) 000815 1780332182.712090 write 0x0295be thru 0x02a9cc (0x140f bytes) 000817 1780332182.726659 trunc from 0x03fb3c to 0x01d46c (0x226cf bytes) 000818 1780332182.753241 write 0x00bedf thru 0x016716 (0xa838 bytes) 000819 1780332182.786781 punch from 0x00a4f9 to 0x01009b (0x5ba3 bytes) 000820 1780332182.804732 trunc from 0x01d46d to 0x004541 (0x18f2b bytes) 000821 1780332182.851052 mapread 0x00045b thru 0x000cbf (0x865 bytes) 000822 1780332182.861261 write 0x011da6 thru 0x01b10c (0x9367 bytes) 000823 1780332182.862913 fallocate 0x016e60 thru 0x023f69 (0xd10a bytes) 000824 1780332182.881724 trunc from 0x01ff52 to 0x023f69 (0x4018 bytes) 000825 1780332182.895306 fallocate 0x012c8b thru 0x013669 (0x9df bytes) 000826 1780332182.908317 mapread 0x006b0d thru 0x015891 (0xed85 bytes) 000827 1780332182.936611 read 0x00f11e thru 0x01ab9c (0xba7f bytes) 000828 1780332182.937484 mapwrite 0x02f23e thru 0x03605d (0x6e20 bytes) 000829 1780332183.068405 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3605e): Mirror 6: 0x713c6239 (stale) Mirror 7: 0x713c6239 (stale) Mirror 11: 0x713c6239 (stale) Mirror 13: 0x713c6239 (stale) Mirror 14: 0x713c6239 (stale) Mirror 15: 0x713c6239 (stale) Mirror 16: 0x713c6239 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3605e): Mirror 6: 0x713c6239 (stale) Mirror 7: 0x713c6239 (stale) Mirror 11: 0x713c6239 (stale) Mirror 13: 0x713c6239 (stale) Mirror 14: 0x713c6239 (stale) Mirror 15: 0x713c6239 (stale) Mirror 16: 0x713c6239 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3605e: skipped 000830 1780332183.783496 fallocate 0x02dfc2 thru 0x03bedc (0xdf1b bytes) 000831 1780332183.811762 MIRROR_RESYNC 8 mirrors 000832 1780332185.804350 trunc from 0x03bedd to 0x01f292 (0x1cc4a bytes) 000833 1780332185.872771 trunc from 0x015dfe to 0x0167b7 (0x9ba bytes) 000834 1780332185.882582 mapread 0x01c91a thru 0x01f292 (0x2979 bytes) 000835 1780332185.909240 write 0x024820 thru 0x029f98 (0x5779 bytes) 000836 1780332185.912260 trunc from 0x01e444 to 0x025ae1 (0x769e bytes) 000837 1780332185.937245 fallocate 0x03cd83 thru 0x03ffff (0x327d bytes) 000838 1780332185.942600 punch from 0x014252 to 0x0197f7 (0x55a6 bytes) 000839 1780332185.951526 mapwrite 0x03f4b8 thru 0x03ffff (0xb48 bytes) 000844 1780332186.034302 trunc from 0x040000 to 0x026d9b (0x19264 bytes) 000845 1780332186.083915 mapwrite 0x0060a1 thru 0x014709 (0xe669 bytes) 000846 1780332186.161866 trunc from 0x00c98a to 0x018305 (0xb97c bytes) 000847 1780332186.173456 write 0x00d022 thru 0x0117af (0x478e bytes) 000848 1780332186.199883 mapread 0x014537 thru 0x020dc1 (0xc88b bytes) 000849 1780332186.232684 write 0x035407 thru 0x03b05b (0x5c55 bytes) 000851 1780332186.238083 write 0x02a07b thru 0x02b4ad (0x1433 bytes) 000852 1780332186.249965 trunc from 0x03b05c to 0x005e94 (0x351c7 bytes) 000853 1780332186.277321 mapread 0x00472b thru 0x005e94 (0x176a bytes) 000854 1780332186.283887 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x5e95): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5e95): Mirror 6: 0x5180fd57 (stale) Mirror 7: 0x5180fd57 (stale) Mirror 11: 0x5180fd57 (stale) Mirror 13: 0x5180fd57 (stale) Mirror 14: 0x5180fd57 (stale) Mirror 15: 0x5180fd57 (stale) Mirror 16: 0x5180fd57 (stale) CRC-32 checksum value for chunk [0, 0x5e95): Mirror 1: 0x5180fd57 Mirror 17: 0x5180fd57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5e95: skipped 000855 1780332187.410176 MIRROR_RESYNC 9 mirrors 000856 1780332188.944624 mapread 0x000bfa thru 0x005e94 (0x529b bytes) 000857 1780332189.008502 trunc from 0x0055e4 to 0x005e94 (0x8b1 bytes) 000858 1780332189.086387 read 0x005d4b thru 0x005e94 (0x14a bytes) 000859 1780332189.095719 mapwrite 0x02757c thru 0x033052 (0xbad7 bytes) 000860 1780332189.231673 mapread 0x008d43 thru 0x01115c (0x841a bytes) 000861 1780332189.270711 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33053): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33053): Mirror 6: 0xf5ad9079 (stale) Mirror 7: 0xf5ad9079 (stale) Mirror 11: 0xf5ad9079 (stale) Mirror 13: 0xf5ad9079 (stale) Mirror 14: 0xf5ad9079 (stale) Mirror 15: 0xf5ad9079 (stale) Mirror 16: 0xf5ad9079 (stale) Mirror 17: 0xf5ad9079 (stale) CRC-32 checksum value for chunk [0, 0x33053): Mirror 1: 0x6fe6534d Mirror 18: 0x6fe6534d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33053: skipped 000862 1780332190.570442 MIRROR_RESYNC 10 mirrors 000863 1780332192.248922 mapread 0x023423 thru 0x029ba6 (0x6784 bytes) 000864 1780332192.283683 mapwrite 0x02ebf7 thru 0x0337ff (0x4c09 bytes) 000865 1780332192.459725 trunc from 0x01719a to 0x01bd62 (0x4bc9 bytes) 000867 1780332192.474496 punch from 0x02f1ac to 0x0337ff (0x4654 bytes) 000868 1780332192.489150 read 0x029a51 thru 0x02d2e5 (0x3895 bytes) 000869 1780332192.492015 punch from 0x00c211 to 0x01aa8b (0xe87b bytes) 000870 1780332192.517473 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x33800): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33800): Mirror 6: 0x5c97455d (stale) Mirror 7: 0x5c97455d (stale) Mirror 11: 0x5c97455d (stale) Mirror 13: 0x5c97455d (stale) Mirror 14: 0x5c97455d (stale) Mirror 15: 0x5c97455d (stale) Mirror 16: 0x5c97455d (stale) Mirror 17: 0x5c97455d (stale) Mirror 18: 0x5c97455d (stale) CRC-32 checksum value for chunk [0, 0x33800): Mirror 1: 0x766b5449 Mirror 19: 0x766b5449 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33800: skipped 000871 1780332193.531638 write 0x01883e thru 0x023e35 (0xb5f8 bytes) 000872 1780332193.604467 fallocate 0x035f3a thru 0x03ffff (0xa0c6 bytes) 000873 1780332193.611273 trunc from 0x015a2a to 0x01c385 (0x695c bytes) 000874 1780332193.637582 punch from 0x02b961 to 0x0337ff (0x7e9f bytes) 000875 1780332193.655628 read 0x0226e6 thru 0x02b144 (0x8a5f bytes) 000876 1780332193.670466 mapwrite 0x033768 thru 0x03626b (0x2b04 bytes) 000877 1780332193.732881 trunc from 0x004f7a to 0x00e981 (0x9a08 bytes) 000878 1780332193.739285 trunc from 0x03626c to 0x03e6df (0x8474 bytes) 000879 1780332193.796464 MIRROR_RESYNC 11 mirrors 000880 1780332197.015216 trunc from 0x03e6e0 to 0x0176fc (0x26fe3 bytes) 000881 1780332197.070595 fallocate 0x015d56 thru 0x01ebac (0x8e57 bytes) 000882 1780332197.077558 read 0x00d52b thru 0x01244e (0x4f24 bytes) 000883 1780332197.088822 mapread 0x017539 thru 0x0176fc (0x1c4 bytes) 000884 1780332197.104907 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x176fd): Mirror 6: 0x1a64eae0 (stale) Mirror 7: 0x1a64eae0 (stale) Mirror 11: 0x1a64eae0 (stale) Mirror 13: 0x1a64eae0 (stale) Mirror 15: 0x1a64eae0 (stale) Mirror 16: 0x1a64eae0 (stale) Mirror 17: 0x1a64eae0 (stale) Mirror 18: 0x1a64eae0 (stale) Mirror 19: 0x1a64eae0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x176fd): Mirror 6: 0x1a64eae0 (stale) Mirror 7: 0x1a64eae0 (stale) Mirror 11: 0x1a64eae0 (stale) Mirror 13: 0x1a64eae0 (stale) Mirror 15: 0x1a64eae0 (stale) Mirror 16: 0x1a64eae0 (stale) Mirror 17: 0x1a64eae0 (stale) Mirror 18: 0x1a64eae0 (stale) Mirror 19: 0x1a64eae0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x176fd: skipped 000885 1780332197.709694 trunc from 0x0176fd to 0x026550 (0xee54 bytes) 000886 1780332197.738344 trunc from 0x026551 to 0x0241eb (0x2365 bytes) 000887 1780332197.778893 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x241ec): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x241ec): Mirror 6: 0x8b29dd49 (stale) Mirror 7: 0x8b29dd49 (stale) Mirror 11: 0x8b29dd49 (stale) Mirror 13: 0x8b29dd49 (stale) Mirror 15: 0x8b29dd49 (stale) Mirror 16: 0x8b29dd49 (stale) Mirror 17: 0x8b29dd49 (stale) Mirror 18: 0x8b29dd49 (stale) Mirror 19: 0x8b29dd49 (stale) CRC-32 checksum value for chunk [0, 0x241ec): Mirror 1: 0x6862bea6 Mirror 20: 0x6862bea6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x241ec: skipped 000888 1780332198.807748 trunc from 0x01338e to 0x0138c2 (0x535 bytes) 000889 1780332198.856943 mapwrite 0x0317ee thru 0x038a32 (0x7245 bytes) 000890 1780332198.915478 trunc from 0x032e87 to 0x038a32 (0x5bac bytes) 000891 1780332198.921243 read 0x01cbe6 thru 0x027383 (0xa79e bytes) 000892 1780332198.930368 fallocate 0x00276d thru 0x00e265 (0xbaf9 bytes) 000894 1780332198.936464 write 0x01f9a8 thru 0x02cf59 (0xd5b2 bytes) 000895 1780332198.938523 read 0x0244eb thru 0x031347 (0xce5d bytes) 000897 1780332198.940460 trunc from 0x00d9fc to 0x0114e3 (0x3ae8 bytes) 000898 1780332198.949385 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x38a33): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a33): Mirror 6: 0xe3e77b28 (stale) Mirror 7: 0xe3e77b28 (stale) Mirror 11: 0xe3e77b28 (stale) Mirror 13: 0xe3e77b28 (stale) Mirror 15: 0xe3e77b28 (stale) Mirror 16: 0xe3e77b28 (stale) Mirror 17: 0xe3e77b28 (stale) Mirror 18: 0xe3e77b28 (stale) Mirror 19: 0xe3e77b28 (stale) Mirror 20: 0x80caf65a (stale) CRC-32 checksum value for chunk [0, 0x38a33): Mirror 1: 0x78fd75d Mirror 21: 0x78fd75d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a33: skipped 000899 1780332200.203495 MIRROR_RESYNC 12 mirrors 000900 1780332202.989926 trunc from 0x003783 to 0x0125af (0xee2d bytes) 000901 1780332203.042975 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x38a33): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a33): Mirror 6: 0x78fd75d (stale) Mirror 7: 0x78fd75d (stale) Mirror 11: 0x78fd75d (stale) Mirror 13: 0x78fd75d (stale) Mirror 15: 0x78fd75d (stale) Mirror 16: 0x78fd75d (stale) Mirror 17: 0x78fd75d (stale) Mirror 18: 0x78fd75d (stale) Mirror 19: 0x78fd75d (stale) Mirror 20: 0x78fd75d (stale) Mirror 21: 0x78fd75d (stale) CRC-32 checksum value for chunk [0, 0x38a33): Mirror 1: 0x78fd75d Mirror 22: 0x78fd75d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a33: skipped 000902 1780332204.243460 fallocate 0x03a68d thru 0x03ffff (0x5973 bytes) 000903 1780332204.335221 write 0x03ca36 thru 0x03ffff (0x35ca bytes) 000904 1780332204.346660 trunc from 0x040000 to 0x015a76 (0x2a589 bytes) 000905 1780332204.389757 mapread 0x00a758 thru 0x015a76 (0xb31f bytes) 000906 1780332204.417978 mapwrite 0x011c0e thru 0x019e8c (0x827f bytes) 000907 1780332204.466026 write 0x0272b1 thru 0x027564 (0x2b4 bytes) 000908 1780332204.468403 mapread 0x023a42 thru 0x027564 (0x3b23 bytes) 000909 1780332204.482774 MIRROR_RESYNC 13 mirrors 000910 1780332207.273820 fallocate 0x023c31 thru 0x02d1b0 (0x9580 bytes) 000911 1780332207.320859 mapread 0x01e83b thru 0x026b3a (0x8300 bytes) 000912 1780332207.355996 fallocate 0x02cef4 thru 0x035022 (0x812f bytes) 000913 1780332207.364228 mapwrite 0x03f0b2 thru 0x03ffff (0xf4e bytes) 000914 1780332207.420919 read 0x03e4da thru 0x03ffff (0x1b26 bytes) 000916 1780332207.423334 punch from 0x0242a2 to 0x03004e (0xbdad bytes) 000917 1780332207.429997 read 0x0148a5 thru 0x01ea71 (0xa1cd bytes) 000918 1780332207.445363 mapread 0x011d26 thru 0x020e49 (0xf124 bytes) 000919 1780332207.451600 MIRROR_RESYNC 13 mirrors 000920 1780332209.809358 trunc from 0x00fd96 to 0x018395 (0x8600 bytes) 000921 1780332209.861380 trunc from 0x040000 to 0x011752 (0x2e8ad bytes) 000922 1780332209.891251 write 0x02bf69 thru 0x0351d5 (0x926d bytes) 000923 1780332209.901741 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x351d6): Mirror 7: 0x7117d67e (stale) Mirror 11: 0x7117d67e (stale) Mirror 13: 0x7117d67e (stale) Mirror 15: 0x7117d67e (stale) Mirror 16: 0x7117d67e (stale) Mirror 17: 0x7117d67e (stale) Mirror 18: 0x7117d67e (stale) Mirror 19: 0x7117d67e (stale) Mirror 20: 0x7117d67e (stale) Mirror 21: 0x7117d67e (stale) Mirror 22: 0x7117d67e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351d6): Mirror 7: 0x7117d67e (stale) Mirror 11: 0x7117d67e (stale) Mirror 13: 0x7117d67e (stale) Mirror 15: 0x7117d67e (stale) Mirror 16: 0x7117d67e (stale) Mirror 17: 0x7117d67e (stale) Mirror 18: 0x7117d67e (stale) Mirror 19: 0x7117d67e (stale) Mirror 20: 0x7117d67e (stale) Mirror 21: 0x7117d67e (stale) Mirror 22: 0x7117d67e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351d6: skipped 000924 1780332210.578705 punch from 0x009be3 to 0x0193bf (0xf7dd bytes) 000925 1780332210.584821 mapwrite 0x0152a8 thru 0x01abe5 (0x593e bytes) 000927 1780332210.628404 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x351d6): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351d6): Mirror 7: 0x7117d67e (stale) Mirror 11: 0x7117d67e (stale) Mirror 13: 0x7117d67e (stale) Mirror 15: 0x7117d67e (stale) Mirror 16: 0x7117d67e (stale) Mirror 17: 0x7117d67e (stale) Mirror 18: 0x7117d67e (stale) Mirror 19: 0x7117d67e (stale) Mirror 20: 0x7117d67e (stale) Mirror 21: 0x7117d67e (stale) Mirror 22: 0x7117d67e (stale) CRC-32 checksum value for chunk [0, 0x351d6): Mirror 1: 0xe3239008 Mirror 23: 0xe3239008 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351d6: skipped 000928 1780332211.787454 trunc from 0x033ced to 0x0351d5 (0x14e9 bytes) 000929 1780332211.841841 punch from 0x023718 to 0x02c456 (0x8d3f bytes) 000930 1780332211.850903 fallocate 0x0044d0 thru 0x004ac4 (0x5f5 bytes) 000931 1780332211.862206 mapread 0x02c46f thru 0x02fb18 (0x36aa bytes) 000932 1780332211.901735 read 0x017fb8 thru 0x01f842 (0x788b bytes) 000933 1780332211.914433 read 0x022390 thru 0x02e5a1 (0xc212 bytes) 000934 1780332211.922609 trunc from 0x0351d6 to 0x016e8a (0x1e34b bytes) 000935 1780332211.946689 fallocate 0x01e721 thru 0x0223b8 (0x3c98 bytes) 000936 1780332211.954653 mapwrite 0x018d01 thru 0x022353 (0x9653 bytes) 000937 1780332212.086527 read 0x01d6af thru 0x0223b8 (0x4d0a bytes) 000938 1780332212.094213 read 0x021339 thru 0x0223b8 (0x1080 bytes) 000940 1780332212.107413 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x223b9): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x223b9): Mirror 7: 0xb840e147 (stale) Mirror 11: 0xb840e147 (stale) Mirror 13: 0xb840e147 (stale) Mirror 15: 0xb840e147 (stale) Mirror 16: 0xb840e147 (stale) Mirror 17: 0xb840e147 (stale) Mirror 18: 0xb840e147 (stale) Mirror 19: 0xb840e147 (stale) Mirror 20: 0xb840e147 (stale) Mirror 21: 0xb840e147 (stale) Mirror 22: 0xb840e147 (stale) Mirror 23: 0x5cc8ec10 (stale) CRC-32 checksum value for chunk [0, 0x223b9): Mirror 1: 0x6e53ea61 Mirror 24: 0x6e53ea61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x223b9: skipped 000941 1780332213.036304 read 0x014f39 thru 0x0223b8 (0xd480 bytes) 000942 1780332213.048325 MIRROR_RESYNC 14 mirrors 000943 1780332215.497580 read 0x00527a thru 0x00b956 (0x66dd bytes) 000945 1780332215.514633 write 0x0381b4 thru 0x03be5a (0x3ca7 bytes) 000946 1780332215.556312 fallocate 0x0093f2 thru 0x016a72 (0xd681 bytes) 000947 1780332215.560678 trunc from 0x03be5b to 0x01778b (0x246cf bytes) 000948 1780332215.576623 mapwrite 0x008b98 thru 0x0121c1 (0x962a bytes) 000949 1780332215.636268 fallocate 0x0353b2 thru 0x03ffff (0xac4e bytes) 000950 1780332215.645503 mapread 0x013929 thru 0x01778b (0x3e63 bytes) 000951 1780332215.667654 write 0x00b526 thru 0x00cc2e (0x1709 bytes) 000952 1780332215.668657 trunc from 0x00cf5c to 0x01778b (0xa830 bytes) 000953 1780332215.679806 read 0x002b43 thru 0x0058ef (0x2dad bytes) 000955 1780332215.689078 read 0x00d12f thru 0x01778b (0xa65d bytes) 000956 1780332215.689877 write 0x0049bc thru 0x005359 (0x99e bytes) 000957 1780332215.691583 mapwrite 0x020184 thru 0x025c48 (0x5ac5 bytes) 000958 1780332215.739195 punch from 0x00ea60 to 0x017783 (0x8d24 bytes) 000959 1780332215.743986 read 0x006888 thru 0x01340f (0xcb88 bytes) 000960 1780332215.751344 mapwrite 0x03b322 thru 0x03c62a (0x1309 bytes) 000961 1780332215.803752 trunc from 0x02f303 to 0x032fc5 (0x3cc3 bytes) 000962 1780332215.814470 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c62b): Mirror 7: 0x2f6dc96 (stale) Mirror 11: 0x2f6dc96 (stale) Mirror 13: 0x2f6dc96 (stale) Mirror 15: 0x2f6dc96 (stale) Mirror 16: 0x2f6dc96 (stale) Mirror 17: 0x2f6dc96 (stale) Mirror 18: 0x2f6dc96 (stale) Mirror 20: 0x2f6dc96 (stale) Mirror 21: 0x2f6dc96 (stale) Mirror 22: 0x2f6dc96 (stale) Mirror 23: 0x2f6dc96 (stale) Mirror 24: 0x2f6dc96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c62b): Mirror 7: 0x2f6dc96 (stale) Mirror 11: 0x2f6dc96 (stale) Mirror 13: 0x2f6dc96 (stale) Mirror 15: 0x2f6dc96 (stale) Mirror 16: 0x2f6dc96 (stale) Mirror 17: 0x2f6dc96 (stale) Mirror 18: 0x2f6dc96 (stale) Mirror 20: 0x2f6dc96 (stale) Mirror 21: 0x2f6dc96 (stale) Mirror 22: 0x2f6dc96 (stale) Mirror 23: 0x2f6dc96 (stale) Mirror 24: 0x2f6dc96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c62b: skipped 000963 1780332216.625596 mapread 0x01d58e thru 0x02ce1b (0xf88e bytes) 000964 1780332216.657866 trunc from 0x03c62b to 0x00cbc8 (0x2fa62 bytes) 000965 1780332216.681726 trunc from 0x006032 to 0x00cbc8 (0x6b97 bytes) 000966 1780332216.686470 mapread 0x002fc0 thru 0x00bb13 (0x8b54 bytes) 000968 1780332216.701662 punch from 0x00aad8 to 0x00cbc8 (0x20f1 bytes) 000970 1780332216.709386 mapwrite 0x0349d1 thru 0x03de1f (0x944f bytes) 000971 1780332216.793839 read 0x01a652 thru 0x01b9fa (0x13a9 bytes) 000972 1780332216.799784 read 0x03c691 thru 0x03de1f (0x178f bytes) 000973 1780332216.801058 write 0x00a12b thru 0x00ef11 (0x4de7 bytes) 000974 1780332216.812297 write 0x0180b7 thru 0x025bf4 (0xdb3e bytes) 000975 1780332216.816831 trunc from 0x017653 to 0x01889d (0x124b bytes) 000976 1780332216.832675 read 0x00061c thru 0x001fbe (0x19a3 bytes) 000977 1780332216.833345 trunc from 0x0060c0 to 0x00a0c1 (0x4002 bytes) 000978 1780332216.837808 read 0x0272eb thru 0x029adc (0x27f2 bytes) 000979 1780332216.838633 read 0x00805e thru 0x0139d2 (0xb975 bytes) 000980 1780332216.850050 punch from 0x037dd0 to 0x03de1f (0x6050 bytes) 000981 1780332216.854781 mapwrite 0x0078fe thru 0x01361c (0xbd1f bytes) 000982 1780332216.874764 trunc from 0x02bb31 to 0x03b21a (0xf6ea bytes) 000983 1780332216.880439 write 0x02ee19 thru 0x03681f (0x7a07 bytes) 000984 1780332216.894068 fallocate 0x028241 thru 0x02a8f7 (0x26b7 bytes) 000985 1780332216.900675 mapwrite 0x0195a5 thru 0x02743b (0xde97 bytes) 000986 1780332216.934374 mapread 0x01cb04 thru 0x0258d1 (0x8dce bytes) 000987 1780332216.935554 fallocate 0x03c2d6 thru 0x03ffff (0x3d2a bytes) 000988 1780332216.941438 trunc from 0x040000 to 0x033f6f (0xc090 bytes) 000989 1780332216.960716 write 0x011dec thru 0x01b2ea (0x94ff bytes) 000990 1780332216.962821 punch from 0x025adb to 0x02c815 (0x6d3b bytes) 000991 1780332216.967746 read 0x032cd9 thru 0x033f6f (0x1297 bytes) 000992 1780332216.968530 fallocate 0x005a34 thru 0x00d642 (0x7c0f bytes) 000994 1780332216.973995 mapwrite 0x02cd96 thru 0x031dd2 (0x503d bytes) 000995 1780332217.000684 trunc from 0x033f70 to 0x03a18b (0x621c bytes) 000996 1780332217.019041 read 0x003755 thru 0x007d91 (0x463d bytes) 000997 1780332217.019812 write 0x012c2e thru 0x017628 (0x49fb bytes) 000998 1780332217.020959 trunc from 0x01a0db to 0x026624 (0xc54a bytes) 000999 1780332217.032461 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3a18c): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a18c): Mirror 7: 0x927d7e48 (stale) Mirror 11: 0x927d7e48 (stale) Mirror 13: 0x927d7e48 (stale) Mirror 15: 0x927d7e48 (stale) Mirror 16: 0x927d7e48 (stale) Mirror 17: 0x927d7e48 (stale) Mirror 18: 0x927d7e48 (stale) Mirror 20: 0x927d7e48 (stale) Mirror 21: 0x927d7e48 (stale) Mirror 22: 0x927d7e48 (stale) Mirror 23: 0x927d7e48 (stale) Mirror 24: 0x927d7e48 (stale) CRC-32 checksum value for chunk [0, 0x3a18c): Mirror 1: 0xf0b5e069 Mirror 25: 0xf0b5e069 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a18c: skipped 001000 1780332218.305472 read 0x002297 thru 0x00d733 (0xb49d bytes) All operations completed A-OK!