== sanity-flr test 70a: flr mode fsx test ================ 21:39:51 (1789177191) Seed set to 7193 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read truncating to largest ever: 0x22e17 000015 1789177193.913525 trunc from 00000000 to 0x022e16 (0x22e17 bytes) 000017 1789177193.935098 trunc from 0x022e17 to 0x01f683 (0x3793 bytes) 000020 1789177193.954673 punch from 0x001580 to 0x007ee4 (0x6965 bytes) 000022 1789177193.961245 mapwrite 0x03a222 thru 0x03f6a6 (0x5485 bytes) 000026 1789177194.115477 write 0x03a012 thru 0x03b2e2 (0x12d1 bytes) 000027 1789177194.122686 read 0x0322ea thru 0x0325cf (0x2e6 bytes) 000029 1789177194.132350 mapread 0x026829 thru 0x03323a (0xca12 bytes) 000030 1789177194.150276 punch from 0x01716b to 0x026535 (0xf3cb bytes) truncating to largest ever: 0x36ac1 000032 1789177194.163618 trunc from 0x03f6a7 to 0x036ac0 (0x8be6 bytes) 000033 1789177194.177752 mapread 0x0333e4 thru 0x036ac0 (0x36dd bytes) 000034 1789177194.180007 trunc from 0x036ac1 to 0x026542 (0x1057e bytes) 000035 1789177194.211281 trunc from 0x026543 to 0x0035a2 (0x22fa0 bytes) 000036 1789177194.231120 punch from 0x001dec to 0x002503 (0x718 bytes) 000037 1789177194.237482 mapwrite 0x020ce3 thru 0x02c0e9 (0xb407 bytes) 000038 1789177194.345372 mapread 0x00d950 thru 0x01adfa (0xd4ab bytes) 000039 1789177194.360981 read 0x00a4d2 thru 0x0153c7 (0xaef6 bytes) 000040 1789177194.362339 mapread 0x00deb6 thru 0x016d96 (0x8ee1 bytes) 000041 1789177194.364027 mapwrite 0x03a0c0 thru 0x03bd82 (0x1cc3 bytes) 000042 1789177194.447158 punch from 0x0333e0 to 0x03bd82 (0x89a3 bytes) 000047 1789177194.455269 mapread 0x00729d thru 0x01649c (0xf200 bytes) 000048 1789177194.456923 mapread 0x011a88 thru 0x01c9c0 (0xaf39 bytes) 000050 1789177194.459736 read 0x010519 thru 0x019327 (0x8e0f bytes) 000051 1789177194.460904 write 0x00f896 thru 0x0115d2 (0x1d3d bytes) 000053 1789177194.462448 mapwrite 0x01f74d thru 0x026d2b (0x75df bytes) 000054 1789177194.505220 read 0x01c2b5 thru 0x0278b8 (0xb604 bytes) 000055 1789177194.506320 write 0x02051f thru 0x024b78 (0x465a bytes) 000056 1789177194.507634 trunc from 0x03bd83 to 0x02d64f (0xe733 bytes) 000057 1789177194.532611 MIRROR_EXTEND to 2 mirrors 000058 1789177195.840270 MIRROR_EXTEND to 3 mirrors 000062 1789177197.279416 read 0x004bd8 thru 0x00f4c8 (0xa8f1 bytes) 000063 1789177197.313196 trunc from 0x02d650 to 0x00618f (0x274c0 bytes) 000064 1789177197.424066 mapwrite 0x0201f0 thru 0x02c184 (0xbf95 bytes) 000065 1789177197.586760 punch from 0x0055ed to 0x0146a1 (0xf0b5 bytes) 000066 1789177197.595142 write 0x036f52 thru 0x03dc47 (0x6cf6 bytes) 000067 1789177197.599473 write 0x0015f5 thru 0x0077af (0x61bb bytes) 000069 1789177197.614663 mapwrite 0x00d52a thru 0x00e98c (0x1463 bytes) 000070 1789177197.701253 write 0x02dd92 thru 0x0310b5 (0x3324 bytes) 000072 1789177197.725240 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc48): Mirror 3: 0xca1c9419 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc48): Mirror 3: 0xca1c9419 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc48: skipped 000073 1789177198.149271 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) 000079 1789177198.322640 punch from 0x003f84 to 0x01235e (0xe3db bytes) 000080 1789177198.328954 mapread 0x01f00a thru 0x01fa32 (0xa29 bytes) 000081 1789177198.334885 punch from 0x02576a to 0x02e314 (0x8bab bytes) 000083 1789177198.340297 mapread 0x033bfd thru 0x03876d (0x4b71 bytes) 000084 1789177198.369376 trunc from 0x03dc48 to 0x033744 (0xa503 bytes) 000086 1789177198.397076 mapread 0x01c753 thru 0x02b7cb (0xf079 bytes) 000087 1789177198.420381 write 0x02fa90 thru 0x034237 (0x47a8 bytes) 000089 1789177198.422416 write 0x0046b9 thru 0x00997f (0x52c7 bytes) 000090 1789177198.434183 mapwrite 0x028f86 thru 0x02c4ef (0x356a bytes) 000092 1789177198.507280 trunc from 0x034238 to 0x023dbe (0x10479 bytes) 000094 1789177198.538242 read 0x004e61 thru 0x011e6c (0xd00c bytes) 000095 1789177198.557491 write 0x026508 thru 0x031e26 (0xb91f bytes) 000096 1789177198.560897 write 0x002a50 thru 0x011343 (0xe8f4 bytes) 000097 1789177198.567603 punch from 0x0195a6 to 0x025297 (0xbcf2 bytes) 000098 1789177198.598631 mapwrite 0x028342 thru 0x03712d (0xedec bytes) 000099 1789177198.776227 mapread 0x006e9e thru 0x00a05a (0x31bd bytes) 000102 1789177198.784318 write 0x00b2ae thru 0x0193d4 (0xe127 bytes) 000104 1789177198.814751 read 0x001453 thru 0x005d2d (0x48db bytes) 000105 1789177198.830249 mapread 0x011da8 thru 0x018de5 (0x703e bytes) 000106 1789177198.832536 write 0x0184d5 thru 0x01a1cd (0x1cf9 bytes) 000107 1789177198.836535 write 0x02aa74 thru 0x02c220 (0x17ad bytes) 000110 1789177198.840374 mapwrite 0x01229c thru 0x014d7c (0x2ae1 bytes) 000114 1789177198.969801 trunc from 0x03712e to 0x02088d (0x168a0 bytes) 000117 1789177198.996299 mapread 0x00c8bc thru 0x017ff4 (0xb739 bytes) 000118 1789177198.998232 write 0x00f918 thru 0x0161a4 (0x688d bytes) 000121 1789177199.014255 MIRROR_EXTEND to 2 mirrors 000123 1789177199.970426 mapwrite 0x02d1a8 thru 0x0306b8 (0x3511 bytes) 000125 1789177200.193827 mapread 0x01a76d thru 0x01f7ae (0x5042 bytes) 000126 1789177200.207731 punch from 0x00f711 to 0x014593 (0x4e83 bytes) 000127 1789177200.215575 write 0x03c5d9 thru 0x03f043 (0x2a6b bytes) 000128 1789177200.218730 write 0x01a4fe thru 0x0242f4 (0x9df7 bytes) 000129 1789177200.226373 mapread 0x011e19 thru 0x02060c (0xe7f4 bytes) 000130 1789177200.243402 MIRROR_RESYNC 2 mirrors 000131 1789177201.594216 trunc from 0x03f044 to 0x03479d (0xa8a6 bytes) 000132 1789177201.679527 read 0x023dac thru 0x02f57c (0xb7d1 bytes) 000134 1789177201.693428 mapread 0x03382a thru 0x033d05 (0x4dc bytes) 000135 1789177201.701430 mapwrite 0x001a48 thru 0x008646 (0x6bff bytes) 000137 1789177201.783764 trunc from 0x03479e to 0x03185a (0x2f43 bytes) 000139 1789177201.804900 write 0x039280 thru 0x03ffff (0x6d80 bytes) 000140 1789177201.806024 read 0x0161a2 thru 0x018019 (0x1e78 bytes) 000143 1789177201.824492 trunc from 0x040000 to 0x002251 (0x3ddae bytes) 000146 1789177201.872368 punch from 0x00151f to 0x002251 (0xd33 bytes) 000147 1789177201.888454 read 0x00166f thru 0x002251 (0xbe3 bytes) 000148 1789177201.907820 mapwrite 0x00bbc4 thru 0x00f5b0 (0x39ed bytes) 000150 1789177202.035481 write 0x000414 thru 0x00bc35 (0xb822 bytes) 000151 1789177202.043127 write 0x0121a9 thru 0x01f536 (0xd38e bytes) 000152 1789177202.056275 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1f537): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f537): Mirror 2: 0x1a36d465 (stale) CRC-32 checksum value for chunk [0, 0x1f537): Mirror 1: 0xbab65a3e Mirror 3: 0xbab65a3e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f537: skipped 000153 1789177203.291847 trunc from 0x01f537 to 0x031071 (0x11b3b bytes) 000154 1789177203.381265 read 0x01f678 thru 0x021de1 (0x276a bytes) 000155 1789177203.386654 mapwrite 0x021042 thru 0x02e49a (0xd459 bytes) 000156 1789177203.468345 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31072): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31072): Mirror 2: 0xc450ef99 (stale) Mirror 3: 0xf031dbea (stale) CRC-32 checksum value for chunk [0, 0x31072): Mirror 1: 0x9186f5b2 Mirror 4: 0x9186f5b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31072: skipped 000157 1789177205.120245 punch from 0x0307d9 to 0x031071 (0x899 bytes) 000159 1789177205.201655 trunc from 0x031072 to 0x0026d8 (0x2e999 bytes) 000162 1789177205.245926 mapread 0x0021bc thru 0x0026d8 (0x51d bytes) 000165 1789177205.254661 trunc from 0x0026d9 to 0x0269d7 (0x242ff bytes) 000166 1789177205.281529 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x269d8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x269d8): Mirror 2: 0x4ff99069 (stale) Mirror 3: 0xe60a7210 (stale) Mirror 4: 0x22be (stale) CRC-32 checksum value for chunk [0, 0x269d8): Mirror 1: 0x8656a096 Mirror 5: 0x8656a096 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x269d8: skipped 000167 1789177206.681515 write 0x01d29f thru 0x023e88 (0x6bea bytes) 000168 1789177206.839046 trunc from 0x0269d8 to 0x00a1fb (0x1c7dc bytes) 000169 1789177206.867980 mapwrite 0x03a6e9 thru 0x03ffff (0x5917 bytes) 000170 1789177206.964635 read 0x03348f thru 0x033996 (0x508 bytes) 000171 1789177206.971891 write 0x03b9d6 thru 0x03daff (0x212a bytes) 000173 1789177206.973806 mapread 0x038060 thru 0x03ffff (0x7fa0 bytes) 000174 1789177206.979650 MIRROR_RESYNC 5 mirrors 000179 1789177208.436604 punch from 0x010272 to 0x014fbc (0x4d4b bytes) 000180 1789177208.509932 punch from 0x00ac9a to 0x00be53 (0x11ba bytes) 000181 1789177208.525238 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1643015e (stale) Mirror 3: 0x1643015e (stale) Mirror 4: 0x1643015e (stale) Mirror 5: 0x1643015e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1643015e Mirror 6: 0x1643015e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000183 1789177209.907116 write 0x03a5a6 thru 0x03ffff (0x5a5a bytes) 000184 1789177209.994461 punch from 0x01be87 to 0x029f79 (0xe0f3 bytes) 000185 1789177210.021315 read 0x02091e thru 0x0302c2 (0xf9a5 bytes) 000186 1789177210.037401 mapread 0x010944 thru 0x0165ac (0x5c69 bytes) 000187 1789177210.058795 mapwrite 0x025b0a thru 0x02acbf (0x51b6 bytes) 000188 1789177210.127617 mapwrite 0x03316a thru 0x03368a (0x521 bytes) 000189 1789177210.188822 mapread 0x01a653 thru 0x02832e (0xdcdc bytes) 000190 1789177210.200033 write 0x028ef3 thru 0x02dc4b (0x4d59 bytes) 000191 1789177210.201040 punch from 0x03625b to 0x03ffff (0x9da5 bytes) 000192 1789177210.216371 mapread 0x01d8e5 thru 0x02d7a8 (0xfec4 bytes) 000194 1789177210.217822 read 0x030ac5 thru 0x031223 (0x75f bytes) 000195 1789177210.218370 punch from 0x01191c to 0x01279e (0xe83 bytes) 000199 1789177210.226255 mapread 0x009f79 thru 0x00f1ed (0x5275 bytes) 000200 1789177210.237262 mapread 0x0132f9 thru 0x020fb6 (0xdcbe bytes) 000201 1789177210.238195 write 0x00e869 thru 0x00f1c6 (0x95e bytes) 000202 1789177210.239054 read 0x008186 thru 0x00a055 (0x1ed0 bytes) 000203 1789177210.239565 trunc from 0x040000 to 0x00883c (0x377c3 bytes) 000204 1789177210.270544 mapread 0x004b05 thru 0x00883c (0x3d38 bytes) 000206 1789177210.271890 trunc from 0x00883d to 0x035413 (0x2cbd7 bytes) 000207 1789177210.290205 punch from 0x001803 to 0x006502 (0x4d00 bytes) 000208 1789177210.296345 read 0x02c623 thru 0x033f60 (0x793e bytes) 000209 1789177210.312406 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35414): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35414): Mirror 2: 0x36f24a0b (stale) Mirror 3: 0x36f24a0b (stale) Mirror 4: 0x36f24a0b (stale) Mirror 5: 0x36f24a0b (stale) Mirror 6: 0x36f24a0b (stale) CRC-32 checksum value for chunk [0, 0x35414): Mirror 1: 0x8fc8e418 Mirror 7: 0x8fc8e418 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35414: skipped 000211 1789177211.541424 punch from 0x0219dd to 0x0230d5 (0x16f9 bytes) 000212 1789177211.623628 mapwrite 0x03dff8 thru 0x03ffff (0x2008 bytes) 000213 1789177211.737999 read 0x004769 thru 0x00dea7 (0x973f bytes) truncating to largest ever: 0x3f332 000214 1789177211.746182 trunc from 0x040000 to 0x03f331 (0xcce bytes) 000215 1789177211.776105 mapwrite 0x022983 thru 0x026770 (0x3dee bytes) 000216 1789177211.823659 MIRROR_RESYNC 7 mirrors 000219 1789177214.344620 write 0x038c11 thru 0x03ffff (0x73ef bytes) 000221 1789177214.423863 write 0x02a6d4 thru 0x03748f (0xcdbc bytes) 000222 1789177214.436069 mapwrite 0x0148a2 thru 0x01d631 (0x8d90 bytes) 000223 1789177214.567063 trunc from 0x040000 to 0x02f8fc (0x10703 bytes) 000225 1789177214.597451 MIRROR_RESYNC 7 mirrors 000226 1789177218.345803 mapread 0x00167f thru 0x01014a (0xeacc bytes) 000227 1789177218.380747 mapread 0x010b5e thru 0x01810c (0x75af bytes) 000228 1789177218.407196 mapwrite 0x01a3dc thru 0x01e2c6 (0x3eeb bytes) 000229 1789177218.584162 mapwrite 0x01667e thru 0x02023c (0x9bbf bytes) 000230 1789177218.665891 mapread 0x020121 thru 0x02e644 (0xe524 bytes) 000231 1789177218.691048 punch from 0x0289c1 to 0x02f8fc (0x6f3c bytes) 000232 1789177218.696882 mapread 0x00bfa0 thru 0x00e878 (0x28d9 bytes) 000233 1789177218.706957 read 0x02d7f5 thru 0x02effb (0x1807 bytes) 000238 1789177218.716182 read 0x000b38 thru 0x000d9f (0x268 bytes) 000240 1789177218.726003 mapread 0x014435 thru 0x017e15 (0x39e1 bytes) 000241 1789177218.734869 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f8fd): Mirror 3: 0x6a1a882f (stale) Mirror 4: 0x6a1a882f (stale) Mirror 5: 0x6a1a882f (stale) Mirror 6: 0x6a1a882f (stale) Mirror 7: 0x6a1a882f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f8fd): Mirror 3: 0x6a1a882f (stale) Mirror 4: 0x6a1a882f (stale) Mirror 5: 0x6a1a882f (stale) Mirror 6: 0x6a1a882f (stale) Mirror 7: 0x6a1a882f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f8fd: skipped 000242 1789177219.421909 write 0x02af39 thru 0x02ea6b (0x3b33 bytes) 000243 1789177219.433725 trunc from 0x02f8fd to 0x00668d (0x2926f bytes) 000244 1789177219.453605 mapread 0x0064b8 thru 0x00668d (0x1d6 bytes) 000246 1789177219.462527 mapwrite 0x01d9b3 thru 0x01f467 (0x1ab5 bytes) 000249 1789177219.549497 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1f468): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f468): Mirror 3: 0x3d3454c (stale) Mirror 4: 0x3d3454c (stale) Mirror 5: 0x3d3454c (stale) Mirror 6: 0x3d3454c (stale) Mirror 7: 0x3d3454c (stale) CRC-32 checksum value for chunk [0, 0x1f468): Mirror 1: 0xfaf9be2b Mirror 8: 0xfaf9be2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f468: skipped 000251 1789177220.800672 trunc from 0x01f468 to 0x02567f (0x6218 bytes) 000252 1789177220.927585 read 0x016114 thru 0x0208fd (0xa7ea bytes) 000253 1789177220.940029 MIRROR_RESYNC 7 mirrors 000256 1789177223.383259 mapread 0x00023b thru 0x0046fb (0x44c1 bytes) 000257 1789177223.436314 read 0x0109b6 thru 0x012b98 (0x21e3 bytes) 000259 1789177223.452424 mapwrite 0x0130e3 thru 0x013b4d (0xa6b bytes) 000260 1789177223.669669 read 0x0112a7 thru 0x0176b3 (0x640d bytes) 000262 1789177223.674328 mapread 0x01bdcf thru 0x0222b4 (0x64e6 bytes) 000263 1789177223.689839 mapread 0x0230c3 thru 0x02567f (0x25bd bytes) 000264 1789177223.694508 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x25680): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25680): Mirror 3: 0xd6aacee8 (stale) Mirror 4: 0xd6aacee8 (stale) Mirror 5: 0xd6aacee8 (stale) Mirror 6: 0xd6aacee8 (stale) Mirror 7: 0xd6aacee8 (stale) Mirror 8: 0xd6aacee8 (stale) CRC-32 checksum value for chunk [0, 0x25680): Mirror 1: 0xbd68ea23 Mirror 9: 0xbd68ea23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25680: skipped 000265 1789177225.483006 punch from 0x011dfe to 0x018c13 (0x6e16 bytes) 000267 1789177225.602097 write 0x00ee5b thru 0x01ced2 (0xe078 bytes) 000268 1789177225.615759 mapwrite 0x0207a6 thru 0x02a324 (0x9b7f bytes) 000269 1789177225.741485 read 0x001f24 thru 0x0064a9 (0x4586 bytes) 000270 1789177225.752120 trunc from 0x02a325 to 0x001f84 (0x283a0 bytes) 000271 1789177225.779408 mapwrite 0x00bde8 thru 0x017946 (0xbb5f bytes) 000274 1789177225.849623 punch from 0x007754 to 0x007fb1 (0x85e bytes) 000276 1789177225.861835 trunc from 0x017947 to 0x013991 (0x3fb5 bytes) 000277 1789177225.881276 mapread 0x005b1a thru 0x009165 (0x364c bytes) 000278 1789177225.890637 trunc from 0x013992 to 0x015119 (0x1788 bytes) 000280 1789177225.917965 mapwrite 0x00b38d thru 0x010af4 (0x5768 bytes) 000281 1789177225.964889 mapwrite 0x03a1ce thru 0x03ffff (0x5e32 bytes) 000282 1789177226.032843 punch from 0x032c74 to 0x03933e (0x66cb bytes) 000283 1789177226.038513 write 0x007348 thru 0x010a68 (0x9721 bytes) 000285 1789177226.041102 trunc from 0x040000 to 0x01ea2e (0x215d1 bytes) 000288 1789177226.056402 mapread 0x012d75 thru 0x0174a8 (0x4734 bytes) 000290 1789177226.065522 write 0x0169ca thru 0x018477 (0x1aae bytes) 000291 1789177226.066844 mapwrite 0x02b347 thru 0x0342fd (0x8fb7 bytes) 000292 1789177226.167103 write 0x0114c3 thru 0x0143a4 (0x2ee2 bytes) 000293 1789177226.168114 read 0x0043a2 thru 0x013dab (0xfa0a bytes) 000294 1789177226.174201 MIRROR_RESYNC 8 mirrors 000295 1789177229.970358 write 0x00316d thru 0x00a589 (0x741d bytes) 000296 1789177230.115772 trunc from 0x0342fe to 0x029003 (0xb2fa bytes) 000297 1789177230.134996 read 0x02132a thru 0x021ece (0xba5 bytes) 000299 1789177230.138504 mapread 0x00b47a thru 0x017eb8 (0xca3f bytes) 000301 1789177230.160316 trunc from 0x029004 to 0x009405 (0x1fbfe bytes) 000302 1789177230.171469 read 0x0035e7 thru 0x009405 (0x5e1f bytes) 000303 1789177230.175734 MIRROR_RESYNC 8 mirrors 000304 1789177232.283206 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) 000305 1789177232.690092 punch from 0x000276 to 0x009405 (0x9190 bytes) 000307 1789177232.819499 trunc from 0x009406 to 0x00ce7d (0x3a78 bytes) 000308 1789177232.843167 mapwrite 0x003ff4 thru 0x0096bb (0x56c8 bytes) 000309 1789177232.919994 trunc from 0x00ce7e to 0x014d2d (0x7eb0 bytes) 000310 1789177232.945218 mapread 0x00b618 thru 0x014d2d (0x9716 bytes) 000311 1789177232.952520 write 0x003d4d thru 0x009054 (0x5308 bytes) 000312 1789177232.954420 read 0x000374 thru 0x00852c (0x81b9 bytes) 000313 1789177232.959445 read 0x00f029 thru 0x011ec2 (0x2e9a bytes) 000314 1789177232.960038 punch from 0x011d6f to 0x014d2d (0x2fbf bytes) 000315 1789177232.976263 write 0x019176 thru 0x01a91b (0x17a6 bytes) 000317 1789177232.978982 write 0x033eee thru 0x03bae6 (0x7bf9 bytes) 000319 1789177232.983919 punch from 0x035441 to 0x03779d (0x235d bytes) 000321 1789177233.015783 write 0x00677e thru 0x00dd65 (0x75e8 bytes) 000323 1789177233.017222 read 0x000114 thru 0x00eb1f (0xea0c bytes) 000324 1789177233.024738 mapwrite 0x002a73 thru 0x00d071 (0xa5ff bytes) 000326 1789177233.120177 write 0x03a4d3 thru 0x03ffff (0x5b2d bytes) 000327 1789177233.149815 MIRROR_RESYNC 7 mirrors 000329 1789177236.461661 mapwrite 0x03e149 thru 0x03ffff (0x1eb7 bytes) 000330 1789177236.676598 write 0x006ce5 thru 0x00edc5 (0x80e1 bytes) 000331 1789177236.703377 punch from 0x021223 to 0x02dd8f (0xcb6d bytes) 000332 1789177236.731632 mapwrite 0x00305c thru 0x0031f4 (0x199 bytes) 000334 1789177236.803252 mapread 0x01f120 thru 0x020749 (0x162a bytes) 000339 1789177236.825102 trunc from 0x040000 to 0x02f16e (0x10e91 bytes) 000340 1789177236.848017 read 0x02622a thru 0x02c878 (0x664f bytes) 000343 1789177236.868191 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f16f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f16f): Mirror 3: 0xda1f42b1 (stale) Mirror 4: 0xda1f42b1 (stale) Mirror 6: 0xda1f42b1 (stale) Mirror 7: 0xda1f42b1 (stale) Mirror 8: 0xda1f42b1 (stale) Mirror 9: 0xda1f42b1 (stale) CRC-32 checksum value for chunk [0, 0x2f16f): Mirror 1: 0x8a5e429c Mirror 10: 0x8a5e429c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f16f: skipped 000345 1789177238.709633 mapread 0x00648b thru 0x00d73d (0x72b3 bytes) 000346 1789177238.738392 write 0x03c712 thru 0x03ee23 (0x2712 bytes) 000347 1789177238.842794 mapwrite 0x01e0f7 thru 0x02574e (0x7658 bytes) 000350 1789177238.948603 mapwrite 0x0252ef thru 0x02c94c (0x765e bytes) 000351 1789177239.043275 punch from 0x01411e to 0x017630 (0x3513 bytes) 000352 1789177239.050597 write 0x0366de thru 0x03fd65 (0x9688 bytes) 000353 1789177239.058022 mapread 0x033fff thru 0x037d3a (0x3d3c bytes) 000355 1789177239.073179 trunc from 0x03fd66 to 0x022b6f (0x1d1f6 bytes) 000356 1789177239.112130 mapwrite 0x016a7d thru 0x01e00e (0x7592 bytes) 000357 1789177239.193306 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x22b70): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22b70): Mirror 3: 0xd4d53ce5 (stale) Mirror 4: 0xd4d53ce5 (stale) Mirror 6: 0xd4d53ce5 (stale) Mirror 7: 0xd4d53ce5 (stale) Mirror 8: 0xd4d53ce5 (stale) Mirror 9: 0xd4d53ce5 (stale) Mirror 10: 0x81f2037e (stale) CRC-32 checksum value for chunk [0, 0x22b70): Mirror 1: 0x12f530b2 Mirror 11: 0x12f530b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22b70: skipped 000359 1789177240.740783 trunc from 0x022b70 to 0x000441 (0x2272e bytes) 000360 1789177240.986135 trunc from 0x000442 to 0x025e55 (0x25a14 bytes) 000361 1789177241.042190 MIRROR_RESYNC 9 mirrors 000363 1789177243.063384 punch from 0x0226cc to 0x025e55 (0x378a bytes) 000364 1789177243.134392 write 0x011d57 thru 0x0208fd (0xeba7 bytes) 000365 1789177243.147773 write 0x02c93b thru 0x0329ed (0x60b3 bytes) 000366 1789177243.148921 write 0x0006cb thru 0x00a2a7 (0x9bdd bytes) 000368 1789177243.165167 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x329ee): Mirror 3: 0x685614f6 (stale) Mirror 4: 0x685614f6 (stale) Mirror 6: 0x685614f6 (stale) Mirror 7: 0x685614f6 (stale) Mirror 8: 0x685614f6 (stale) Mirror 10: 0x685614f6 (stale) Mirror 11: 0x685614f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329ee): Mirror 3: 0x685614f6 (stale) Mirror 4: 0x685614f6 (stale) Mirror 6: 0x685614f6 (stale) Mirror 7: 0x685614f6 (stale) Mirror 8: 0x685614f6 (stale) Mirror 10: 0x685614f6 (stale) Mirror 11: 0x685614f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329ee: skipped 000370 1789177243.745234 punch from 0x02d368 to 0x032263 (0x4efc bytes) 000372 1789177243.752360 read 0x02ba8b thru 0x0329ed (0x6f63 bytes) 000373 1789177243.761254 trunc from 0x0329ee to 0x00cbe2 (0x25e0b bytes) 000376 1789177243.779081 write 0x001418 thru 0x0070a9 (0x5c92 bytes) 000378 1789177243.789329 mapread 0x00bc5e thru 0x00cbe2 (0xf85 bytes) 000379 1789177243.801994 punch from 0x001722 to 0x00cbe2 (0xb4c1 bytes) 000381 1789177243.825246 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xcbe3): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcbe3): Mirror 3: 0x266082d (stale) Mirror 4: 0x266082d (stale) Mirror 6: 0x266082d (stale) Mirror 7: 0x266082d (stale) Mirror 8: 0x266082d (stale) Mirror 10: 0x266082d (stale) Mirror 11: 0x266082d (stale) CRC-32 checksum value for chunk [0, 0xcbe3): Mirror 1: 0x5d406532 Mirror 12: 0x5d406532 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcbe3: skipped 000382 1789177245.409510 punch from 0x000caa to 0x004cfd (0x4054 bytes) 000383 1789177245.518239 mapwrite 0x00eb94 thru 0x015d01 (0x716e bytes) 000385 1789177245.640288 read 0x008d27 thru 0x014eb1 (0xc18b bytes) 000386 1789177245.646036 trunc from 0x015d02 to 0x023b29 (0xde28 bytes) 000387 1789177245.664159 read 0x00fca6 thru 0x0103ee (0x749 bytes) 000388 1789177245.672158 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x23b2a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23b2a): Mirror 3: 0xa37c879d (stale) Mirror 4: 0xa37c879d (stale) Mirror 6: 0xa37c879d (stale) Mirror 7: 0xa37c879d (stale) Mirror 8: 0xa37c879d (stale) Mirror 10: 0xa37c879d (stale) Mirror 11: 0xa37c879d (stale) Mirror 12: 0x1f8a8ded (stale) CRC-32 checksum value for chunk [0, 0x23b2a): Mirror 1: 0x69396f3b Mirror 13: 0x69396f3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23b2a: skipped 000389 1789177246.915914 read 0x008800 thru 0x016bdf (0xe3e0 bytes) 000390 1789177246.943419 read 0x01f68c thru 0x0228df (0x3254 bytes) 000391 1789177246.979170 write 0x01d472 thru 0x02375e (0x62ed bytes) 000393 1789177247.090165 write 0x000ce6 thru 0x00d5b2 (0xc8cd bytes) 000394 1789177247.106541 trunc from 0x023b2a to 0x00220d (0x2191c bytes) 000395 1789177247.130123 read 0x00077f thru 0x00220d (0x1a8f bytes) 000398 1789177247.131818 read 0x000ce8 thru 0x00220d (0x1526 bytes) 000399 1789177247.134849 mapread 0x0007a8 thru 0x00220d (0x1a66 bytes) 000400 1789177247.143096 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x220e): Mirror 3: 0x3cd6cd00 (stale) Mirror 4: 0x3cd6cd00 (stale) Mirror 6: 0x3cd6cd00 (stale) Mirror 7: 0x3cd6cd00 (stale) Mirror 8: 0x3cd6cd00 (stale) Mirror 10: 0x3cd6cd00 (stale) Mirror 12: 0x2e5682cd (stale) Mirror 13: 0xe7dd96d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x220e): Mirror 3: 0x3cd6cd00 (stale) Mirror 4: 0x3cd6cd00 (stale) Mirror 6: 0x3cd6cd00 (stale) Mirror 7: 0x3cd6cd00 (stale) Mirror 8: 0x3cd6cd00 (stale) Mirror 10: 0x3cd6cd00 (stale) Mirror 12: 0x2e5682cd (stale) Mirror 13: 0xe7dd96d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x220e: skipped 000401 1789177247.628116 mapread 0x00175e thru 0x00220d (0xab0 bytes) 000402 1789177247.655003 mapwrite 0x00c393 thru 0x0143e8 (0x8056 bytes) 000403 1789177247.768085 mapwrite 0x02359d thru 0x02e2ce (0xad32 bytes) 000404 1789177247.858404 mapread 0x016d7f thru 0x021f6a (0xb1ec bytes) 000405 1789177247.871920 read 0x01c826 thru 0x028889 (0xc064 bytes) 000406 1789177247.872937 trunc from 0x02e2cf to 0x0070f6 (0x271d8 bytes) 000408 1789177247.894246 trunc from 0x0070f7 to 0x03dfd6 (0x36ee0 bytes) 000409 1789177247.916301 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 3: 0xc982d376 (stale) Mirror 4: 0xc982d376 (stale) Mirror 6: 0xc982d376 (stale) Mirror 7: 0xc982d376 (stale) Mirror 8: 0xc982d376 (stale) Mirror 10: 0xc982d376 (stale) Mirror 12: 0x93cce4ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 3: 0xc982d376 (stale) Mirror 4: 0xc982d376 (stale) Mirror 6: 0xc982d376 (stale) Mirror 7: 0xc982d376 (stale) Mirror 8: 0xc982d376 (stale) Mirror 10: 0xc982d376 (stale) Mirror 12: 0x93cce4ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfd7: skipped 000410 1789177248.404305 mapwrite 0x034359 thru 0x03ccbb (0x8963 bytes) 000411 1789177248.476467 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 3: 0xc982d376 (stale) Mirror 4: 0xc982d376 (stale) Mirror 6: 0xc982d376 (stale) Mirror 7: 0xc982d376 (stale) Mirror 8: 0xc982d376 (stale) Mirror 10: 0xc982d376 (stale) Mirror 12: 0x93cce4ef (stale) CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 1: 0x1fc31f9b Mirror 13: 0x1fc31f9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfd7: skipped 000412 1789177249.706287 MIRROR_RESYNC 9 mirrors 000413 1789177252.456156 read 0x028dc4 thru 0x0318f4 (0x8b31 bytes) 000414 1789177252.483898 mapwrite 0x02929f thru 0x035990 (0xc6f2 bytes) 000416 1789177252.976109 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 3: 0x1fc31f9b (stale) Mirror 4: 0x1fc31f9b (stale) Mirror 6: 0x1fc31f9b (stale) Mirror 7: 0x1fc31f9b (stale) Mirror 8: 0x1fc31f9b (stale) Mirror 10: 0x1fc31f9b (stale) Mirror 12: 0x1fc31f9b (stale) Mirror 13: 0x1fc31f9b (stale) CRC-32 checksum value for chunk [0, 0x3dfd7): Mirror 1: 0x850b852d Mirror 14: 0x850b852d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfd7: skipped 000417 1789177254.803335 mapwrite 0x00d20b thru 0x018c23 (0xba19 bytes) 000418 1789177254.985710 punch from 0x038591 to 0x03dfd6 (0x5a46 bytes) 000419 1789177254.992800 write 0x0023d8 thru 0x00bc6b (0x9894 bytes) 000420 1789177254.997733 read 0x0158f4 thru 0x015dac (0x4b9 bytes) 000421 1789177254.998205 write 0x01f31e thru 0x020e05 (0x1ae8 bytes) 000422 1789177255.007211 MIRROR_RESYNC 10 mirrors 000423 1789177259.855787 write 0x0167ec thru 0x019244 (0x2a59 bytes) 000425 1789177260.040156 mapread 0x0093ea thru 0x010415 (0x702c bytes) 000427 1789177260.107396 trunc from 0x03dfd7 to 0x01b89c (0x2273a bytes) 000429 1789177260.155589 read 0x0104f7 thru 0x018381 (0x7e8b bytes) 000431 1789177260.168024 mapwrite 0x034730 thru 0x03e2b3 (0x9b84 bytes) 000432 1789177260.353122 mapwrite 0x03ea3c thru 0x03ffff (0x15c4 bytes) 000433 1789177260.525464 write 0x0035a7 thru 0x01142e (0xde88 bytes) 000434 1789177260.541810 write 0x007cd3 thru 0x01158a (0x98b8 bytes) 000435 1789177260.551617 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb030340 (stale) Mirror 4: 0xcb030340 (stale) Mirror 6: 0xcb030340 (stale) Mirror 7: 0xcb030340 (stale) Mirror 8: 0xcb030340 (stale) Mirror 10: 0xcb030340 (stale) Mirror 12: 0xcb030340 (stale) Mirror 13: 0xcb030340 (stale) Mirror 14: 0xcb030340 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x616d5173 Mirror 15: 0x616d5173 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000438 1789177262.163210 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb030340 (stale) Mirror 4: 0xcb030340 (stale) Mirror 6: 0xcb030340 (stale) Mirror 7: 0xcb030340 (stale) Mirror 10: 0xcb030340 (stale) Mirror 12: 0xcb030340 (stale) Mirror 13: 0xcb030340 (stale) Mirror 14: 0xcb030340 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb030340 (stale) Mirror 4: 0xcb030340 (stale) Mirror 6: 0xcb030340 (stale) Mirror 7: 0xcb030340 (stale) Mirror 10: 0xcb030340 (stale) Mirror 12: 0xcb030340 (stale) Mirror 13: 0xcb030340 (stale) Mirror 14: 0xcb030340 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x616d5173 Mirror 15: 0x616d5173 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000439 1789177263.324451 read 0x001af6 thru 0x009399 (0x78a4 bytes) 000441 1789177263.413143 punch from 0x028725 to 0x0287ab (0x87 bytes) 000442 1789177263.629419 mapwrite 0x0309af thru 0x032ee7 (0x2539 bytes) 000443 1789177263.742856 read 0x00445d thru 0x009d06 (0x58aa bytes) 000444 1789177263.769420 MIRROR_RESYNC 10 mirrors 000446 1789177267.529042 mapread 0x008a1c thru 0x00bc91 (0x3276 bytes) 000449 1789177267.552408 mapwrite 0x001ef0 thru 0x00562c (0x373d bytes) 000450 1789177267.823460 punch from 0x021633 to 0x0283ba (0x6d88 bytes) 000453 1789177267.849458 punch from 0x006a46 to 0x009755 (0x2d10 bytes) 000454 1789177267.861666 write 0x0389b9 thru 0x03e952 (0x5f9a bytes) 000456 1789177267.876768 mapread 0x02bb53 thru 0x02f0b7 (0x3565 bytes) 000457 1789177267.901191 mapwrite 0x00dcf6 thru 0x01a92b (0xcc36 bytes) 000458 1789177267.958397 mapread 0x0240ca thru 0x02a4b5 (0x63ec bytes) 000459 1789177267.959387 mapwrite 0x0339bf thru 0x03fdf0 (0xc432 bytes) 000460 1789177268.030429 mapwrite 0x01db44 thru 0x02aa3e (0xcefb bytes) 000461 1789177268.085029 write 0x029ca6 thru 0x02cb50 (0x2eab bytes) 000462 1789177268.086165 mapwrite 0x005388 thru 0x0122da (0xcf53 bytes) 000463 1789177268.145440 punch from 0x036d3e to 0x039fb0 (0x3273 bytes) 000464 1789177268.151092 trunc from 0x040000 to 0x012fea (0x2d015 bytes) 000466 1789177268.173046 write 0x0038a5 thru 0x0120c9 (0xe825 bytes) 000468 1789177268.177005 mapread 0x0078a3 thru 0x0124a2 (0xac00 bytes) 000470 1789177268.179395 write 0x014466 thru 0x018efe (0x4a99 bytes) 000471 1789177268.180929 mapread 0x006070 thru 0x010d66 (0xacf7 bytes) 000473 1789177268.183731 read 0x006e1d thru 0x00f48e (0x8672 bytes) 000474 1789177268.184605 mapwrite 0x0297f1 thru 0x02c4c5 (0x2cd5 bytes) 000475 1789177268.275663 trunc from 0x02c4c6 to 0x00b5db (0x20eea bytes) 000476 1789177268.298042 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb5dc): Mirror 3: 0xe24a9f60 (stale) Mirror 4: 0xe24a9f60 (stale) Mirror 6: 0xe24a9f60 (stale) Mirror 7: 0xe24a9f60 (stale) Mirror 10: 0xe24a9f60 (stale) Mirror 13: 0xe24a9f60 (stale) Mirror 14: 0xe24a9f60 (stale) Mirror 15: 0xe24a9f60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb5dc): Mirror 3: 0xe24a9f60 (stale) Mirror 4: 0xe24a9f60 (stale) Mirror 6: 0xe24a9f60 (stale) Mirror 7: 0xe24a9f60 (stale) Mirror 10: 0xe24a9f60 (stale) Mirror 13: 0xe24a9f60 (stale) Mirror 14: 0xe24a9f60 (stale) Mirror 15: 0xe24a9f60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb5dc: skipped 000477 1789177268.758476 punch from 0x001833 to 0x00b5db (0x9da9 bytes) 000478 1789177268.762279 write 0x01575e thru 0x01e478 (0x8d1b bytes) 000479 1789177268.763853 mapread 0x000f12 thru 0x006c0d (0x5cfc bytes) 000480 1789177268.790848 mapwrite 0x00e545 thru 0x0157fd (0x72b9 bytes) 000481 1789177268.853177 read 0x011790 thru 0x01cad7 (0xb348 bytes) 000482 1789177268.853863 write 0x016ece thru 0x018904 (0x1a37 bytes) 000483 1789177268.854680 mapwrite 0x011e76 thru 0x017a5e (0x5be9 bytes) 000484 1789177268.881455 punch from 0x00f0db to 0x011361 (0x2287 bytes) 000485 1789177268.889514 mapread 0x00f9c6 thru 0x01794b (0x7f86 bytes) 000486 1789177268.897472 mapwrite 0x01ff74 thru 0x028a17 (0x8aa4 bytes) 000487 1789177269.047455 punch from 0x005fdb to 0x0127ce (0xc7f4 bytes) 000488 1789177269.054918 mapread 0x0277bf thru 0x028a17 (0x1259 bytes) 000490 1789177269.057240 trunc from 0x028a18 to 0x01cd88 (0xbc8f bytes) 000491 1789177269.077547 punch from 0x001a5e to 0x00e932 (0xced5 bytes) 000492 1789177269.086859 read 0x00dc8d thru 0x018960 (0xacd4 bytes) 000493 1789177269.096949 write 0x0181d8 thru 0x022086 (0x9eaf bytes) 000495 1789177269.099315 read 0x008226 thru 0x00d632 (0x540d bytes) 000496 1789177269.100119 read 0x001fd5 thru 0x00c18c (0xa1b8 bytes) 000498 1789177269.101247 read 0x008d35 thru 0x0141e9 (0xb4b5 bytes) 000499 1789177269.104096 write 0x02f73f thru 0x03cc2d (0xd4ef bytes) 000500 1789177269.106165 write 0x028b70 thru 0x036ff3 (0xe484 bytes) 000501 1789177269.118930 trunc from 0x03cc2e to 0x0378bd (0x5370 bytes) 000502 1789177269.163741 MIRROR_RESYNC 9 mirrors 000504 1789177273.088932 MIRROR_RESYNC 9 mirrors 000505 1789177273.753093 write 0x037ba9 thru 0x0386d4 (0xb2c bytes) 000506 1789177273.868652 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x386d5): Mirror 3: 0xc6634e5f (stale) Mirror 6: 0xc6634e5f (stale) Mirror 7: 0xc6634e5f (stale) Mirror 10: 0xc6634e5f (stale) Mirror 13: 0xc6634e5f (stale) Mirror 14: 0xc6634e5f (stale) Mirror 15: 0xc6634e5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x386d5): Mirror 3: 0xc6634e5f (stale) Mirror 6: 0xc6634e5f (stale) Mirror 7: 0xc6634e5f (stale) Mirror 10: 0xc6634e5f (stale) Mirror 13: 0xc6634e5f (stale) Mirror 14: 0xc6634e5f (stale) Mirror 15: 0xc6634e5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x386d5: skipped 000508 1789177274.577076 read 0x00d6eb thru 0x00e733 (0x1049 bytes) 000510 1789177274.587657 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x386d5): Mirror 3: 0xc6634e5f (stale) Mirror 7: 0xc6634e5f (stale) Mirror 10: 0xc6634e5f (stale) Mirror 13: 0xc6634e5f (stale) Mirror 14: 0xc6634e5f (stale) Mirror 15: 0xc6634e5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x386d5): Mirror 3: 0xc6634e5f (stale) Mirror 7: 0xc6634e5f (stale) Mirror 10: 0xc6634e5f (stale) Mirror 13: 0xc6634e5f (stale) Mirror 14: 0xc6634e5f (stale) Mirror 15: 0xc6634e5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x386d5: skipped 000511 1789177275.154094 punch from 0x028528 to 0x02a918 (0x23f1 bytes) 000512 1789177275.173065 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x386d5): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x386d5): Mirror 3: 0xc6634e5f (stale) Mirror 7: 0xc6634e5f (stale) Mirror 10: 0xc6634e5f (stale) Mirror 13: 0xc6634e5f (stale) Mirror 14: 0xc6634e5f (stale) Mirror 15: 0xc6634e5f (stale) CRC-32 checksum value for chunk [0, 0x386d5): Mirror 1: 0x24295642 Mirror 16: 0x24295642 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x386d5: skipped 000513 1789177276.951462 read 0x029e1a thru 0x02e204 (0x43eb bytes) 000514 1789177276.974564 punch from 0x005b39 to 0x0143db (0xe8a3 bytes) 000515 1789177277.133411 trunc from 0x0386d5 to 0x01329d (0x25437 bytes) 000516 1789177277.184665 punch from 0x00e5c9 to 0x010be3 (0x261b bytes) 000517 1789177277.192510 trunc from 0x01329e to 0x003834 (0xfa69 bytes) 000518 1789177277.241928 write 0x00ec4f thru 0x01d9f0 (0xeda2 bytes) 000520 1789177277.258965 write 0x039c4a thru 0x039ee6 (0x29d bytes) 000521 1789177277.262497 read 0x003b37 thru 0x00beec (0x83b6 bytes) 000524 1789177277.294902 MIRROR_RESYNC 8 mirrors 000525 1789177280.707898 trunc from 0x039ee7 to 0x03b17c (0x1296 bytes) 000526 1789177280.875933 mapread 0x026a45 thru 0x027971 (0xf2d bytes) 000527 1789177280.890945 punch from 0x02ef66 to 0x033d96 (0x4e31 bytes) 000528 1789177280.903464 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b17d): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b17d): Mirror 3: 0x6b09bae (stale) Mirror 7: 0x6b09bae (stale) Mirror 10: 0x6b09bae (stale) Mirror 13: 0x6b09bae (stale) Mirror 14: 0x6b09bae (stale) Mirror 15: 0x6b09bae (stale) Mirror 16: 0x6b09bae (stale) CRC-32 checksum value for chunk [0, 0x3b17d): Mirror 1: 0x6b09bae Mirror 17: 0x6b09bae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b17d: skipped 000532 1789177282.319274 mapwrite 0x010188 thru 0x013bbc (0x3a35 bytes) 000533 1789177282.540998 read 0x032475 thru 0x03b17c (0x8d08 bytes) 000534 1789177282.555836 read 0x002932 thru 0x00e6b0 (0xbd7f bytes) 000535 1789177282.572427 mapwrite 0x01f627 thru 0x02c405 (0xcddf bytes) 000542 1789177282.634234 read 0x0238b1 thru 0x030f63 (0xd6b3 bytes) 000543 1789177282.640130 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b17d): Mirror 3: 0x6b09bae (stale) Mirror 7: 0x6b09bae (stale) Mirror 10: 0x6b09bae (stale) Mirror 13: 0x6b09bae (stale) Mirror 14: 0x6b09bae (stale) Mirror 16: 0x6b09bae (stale) Mirror 17: 0x6b09bae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b17d): Mirror 3: 0x6b09bae (stale) Mirror 7: 0x6b09bae (stale) Mirror 10: 0x6b09bae (stale) Mirror 13: 0x6b09bae (stale) Mirror 14: 0x6b09bae (stale) Mirror 16: 0x6b09bae (stale) Mirror 17: 0x6b09bae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b17d: skipped 000546 1789177283.377132 punch from 0x004fba to 0x013f85 (0xefcc bytes) 000547 1789177283.387428 write 0x03ed61 thru 0x03ffff (0x129f bytes) 000549 1789177283.393637 mapwrite 0x015ef3 thru 0x0170a0 (0x11ae bytes) 000550 1789177283.484778 write 0x03b610 thru 0x03ffff (0x49f0 bytes) 000551 1789177283.493936 write 0x02bdd2 thru 0x02e8ec (0x2b1b bytes) 000552 1789177283.504630 trunc from 0x040000 to 0x0292e1 (0x16d1e bytes) 000553 1789177283.523771 write 0x03f197 thru 0x03ffff (0xe69 bytes) 000554 1789177283.525934 punch from 0x02bdd8 to 0x0365bb (0xa7e4 bytes) 000555 1789177283.536922 trunc from 0x040000 to 0x032046 (0xdfb9 bytes) 000556 1789177283.561261 read 0x017dde thru 0x017fdb (0x1fe bytes) 000557 1789177283.562174 mapwrite 0x001f9b thru 0x0077aa (0x5810 bytes) 000559 1789177283.645462 mapread 0x01fcfd thru 0x02c3d4 (0xc6d8 bytes) 000560 1789177283.675109 write 0x01ab36 thru 0x01d248 (0x2713 bytes) 000562 1789177283.677933 punch from 0x01c7bc to 0x02855c (0xbda1 bytes) 000563 1789177283.689987 write 0x02c3d6 thru 0x02e29e (0x1ec9 bytes) 000564 1789177283.692606 write 0x034a0a thru 0x03a9df (0x5fd6 bytes) 000565 1789177283.696538 mapread 0x005a16 thru 0x010e20 (0xb40b bytes) 000567 1789177283.700134 write 0x03ef34 thru 0x03ffff (0x10cc bytes) 000568 1789177283.703579 trunc from 0x040000 to 0x02bd25 (0x142da bytes) 000569 1789177283.747307 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bd26): Mirror 3: 0x471f7556 (stale) Mirror 7: 0x471f7556 (stale) Mirror 10: 0x471f7556 (stale) Mirror 13: 0x471f7556 (stale) Mirror 14: 0x471f7556 (stale) Mirror 16: 0x471f7556 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bd26): Mirror 3: 0x471f7556 (stale) Mirror 7: 0x471f7556 (stale) Mirror 10: 0x471f7556 (stale) Mirror 13: 0x471f7556 (stale) Mirror 14: 0x471f7556 (stale) Mirror 16: 0x471f7556 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bd26: skipped 000573 1789177284.331245 punch from 0x00d44e to 0x010bf6 (0x37a9 bytes) 000574 1789177284.337124 trunc from 0x02bd26 to 0x00e197 (0x1db8e bytes) 000575 1789177284.354227 read 0x00c5af thru 0x00e197 (0x1be9 bytes) 000576 1789177284.360609 read 0x00ad19 thru 0x00e197 (0x347f bytes) 000577 1789177284.371144 mapread 0x001099 thru 0x00e197 (0xd0ff bytes) 000578 1789177284.372972 punch from 0x00c3ae to 0x00e197 (0x1dea bytes) 000579 1789177284.377957 punch from 0x00758d to 0x00e197 (0x6c0b bytes) 000580 1789177284.384214 read 0x00cb03 thru 0x00e197 (0x1695 bytes) 000581 1789177284.404670 mapread 0x00bdbc thru 0x00e197 (0x23dc bytes) 000582 1789177284.405994 trunc from 0x00e198 to 0x010a05 (0x286e bytes) 000584 1789177284.430436 write 0x0231e3 thru 0x02f16f (0xbf8d bytes) 000585 1789177284.433937 write 0x02dfe1 thru 0x02e008 (0x28 bytes) 000587 1789177284.436389 write 0x02cdb3 thru 0x02df2f (0x117d bytes) 000588 1789177284.438331 punch from 0x003632 to 0x0046a8 (0x1077 bytes) 000591 1789177284.459687 write 0x020f13 thru 0x0278f6 (0x69e4 bytes) 000592 1789177284.476019 mapread 0x029cfb thru 0x02bc86 (0x1f8c bytes) 000593 1789177284.479802 punch from 0x023d7f to 0x02cfc4 (0x9246 bytes) 000594 1789177284.492304 mapread 0x02adc4 thru 0x02e3b2 (0x35ef bytes) 000596 1789177284.517844 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f170): Mirror 7: 0x278147f (stale) Mirror 10: 0x278147f (stale) Mirror 13: 0x278147f (stale) Mirror 14: 0x278147f (stale) Mirror 16: 0x278147f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f170): Mirror 7: 0x278147f (stale) Mirror 10: 0x278147f (stale) Mirror 13: 0x278147f (stale) Mirror 14: 0x278147f (stale) Mirror 16: 0x278147f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f170: skipped 000597 1789177285.096830 punch from 0x00369b to 0x0057ce (0x2134 bytes) 000599 1789177285.104299 mapread 0x0178d5 thru 0x020c13 (0x933f bytes) 000600 1789177285.129437 read 0x00b3bb thru 0x00f968 (0x45ae bytes) 000603 1789177285.138099 write 0x03525b thru 0x03eff2 (0x9d98 bytes) 000604 1789177285.139823 mapwrite 0x01ab46 thru 0x023f33 (0x93ee bytes) 000606 1789177285.197531 trunc from 0x03eff3 to 0x030b63 (0xe48f bytes) 000607 1789177285.221125 mapwrite 0x002ed6 thru 0x007c34 (0x4d5f bytes) 000611 1789177285.319333 punch from 0x02daf9 to 0x030b63 (0x306b bytes) 000612 1789177285.330872 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30b64): Mirror 10: 0x6bc2be32 (stale) Mirror 13: 0x6bc2be32 (stale) Mirror 14: 0x6bc2be32 (stale) Mirror 16: 0x6bc2be32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b64): Mirror 10: 0x6bc2be32 (stale) Mirror 13: 0x6bc2be32 (stale) Mirror 14: 0x6bc2be32 (stale) Mirror 16: 0x6bc2be32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b64: skipped 000613 1789177285.802380 MIRROR_RESYNC 5 mirrors 000614 1789177287.962425 write 0x03d948 thru 0x03e03e (0x6f7 bytes) 000615 1789177288.041001 MIRROR_RESYNC 5 mirrors 000616 1789177290.442011 trunc from 0x03e03f to 0x004ced (0x39351 bytes) 000617 1789177290.527381 mapwrite 0x033ebf thru 0x03ffff (0xc141 bytes) 000618 1789177290.635528 punch from 0x026b27 to 0x0324b2 (0xb98c bytes) 000619 1789177290.641588 read 0x02149f thru 0x0297e2 (0x8344 bytes) 000620 1789177290.651509 mapwrite 0x00ca36 thru 0x01b642 (0xec0d bytes) 000621 1789177290.719889 trunc from 0x040000 to 0x00ee3e (0x311c1 bytes) 000622 1789177290.737093 read 0x00b41f thru 0x00ee3e (0x3a20 bytes) 000623 1789177290.738559 mapwrite 0x010421 thru 0x01848a (0x806a bytes) 000624 1789177290.874726 write 0x03bbeb thru 0x03ffff (0x4415 bytes) 000625 1789177290.880061 write 0x023c01 thru 0x023ea0 (0x2a0 bytes) 000626 1789177290.903827 read 0x02d75f thru 0x03ad7e (0xd620 bytes) 000627 1789177290.904554 read 0x004fdb thru 0x00eed8 (0x9efe bytes) 000628 1789177290.905113 write 0x025655 thru 0x029cd7 (0x4683 bytes) 000631 1789177290.914856 mapwrite 0x03f2a4 thru 0x03ffff (0xd5c bytes) 000633 1789177290.989759 write 0x01e6bf thru 0x02034f (0x1c91 bytes) 000636 1789177290.996435 mapwrite 0x00ad00 thru 0x00ebdf (0x3ee0 bytes) 000637 1789177291.062088 read 0x02e8bb thru 0x03d5f2 (0xed38 bytes) 000639 1789177291.065982 trunc from 0x040000 to 0x000146 (0x3feb9 bytes) 000640 1789177291.088884 mapwrite 0x02556a thru 0x034938 (0xf3cf bytes) 000641 1789177291.187614 punch from 0x016be1 to 0x02240a (0xb82a bytes) 000642 1789177291.193278 punch from 0x02ac2c to 0x0332a3 (0x8678 bytes) 000643 1789177291.204830 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x34939): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34939): Mirror 10: 0xf2952eec (stale) Mirror 13: 0xf2952eec (stale) Mirror 14: 0xf2952eec (stale) Mirror 16: 0xf2952eec (stale) CRC-32 checksum value for chunk [0, 0x34939): Mirror 1: 0x8071ea57 Mirror 17: 0x8071ea57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34939: skipped 000646 1789177292.456074 trunc from 0x034939 to 0x00fdd8 (0x24b60 bytes) 000647 1789177292.595679 mapwrite 0x027060 thru 0x02ac6a (0x3c0b bytes) 000648 1789177292.716877 trunc from 0x02ac6b to 0x02cd32 (0x20c8 bytes) 000649 1789177292.740581 MIRROR_RESYNC 6 mirrors 000651 1789177294.690050 punch from 0x00082e to 0x01009c (0xf86f bytes) 000652 1789177294.757487 mapread 0x013903 thru 0x01e8d6 (0xafd4 bytes) 000653 1789177294.812521 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cd33): Mirror 10: 0xfeb0f172 (stale) Mirror 13: 0xfeb0f172 (stale) Mirror 14: 0xfeb0f172 (stale) Mirror 17: 0xfeb0f172 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cd33): Mirror 10: 0xfeb0f172 (stale) Mirror 13: 0xfeb0f172 (stale) Mirror 14: 0xfeb0f172 (stale) Mirror 17: 0xfeb0f172 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cd33: skipped 000654 1789177295.347620 trunc from 0x02cd33 to 0x018535 (0x147fd bytes) 000656 1789177295.371918 read 0x016aa8 thru 0x018535 (0x1a8e bytes) 000657 1789177295.386832 punch from 0x0182d4 to 0x018535 (0x262 bytes) 000658 1789177295.396281 mapread 0x00a334 thru 0x0174ad (0xd17a bytes) 000659 1789177295.458842 punch from 0x00bdc9 to 0x01722a (0xb462 bytes) 000660 1789177295.478854 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18536): Mirror 10: 0xb90c09e3 (stale) Mirror 13: 0xb90c09e3 (stale) Mirror 17: 0xb90c09e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18536): Mirror 10: 0xb90c09e3 (stale) Mirror 13: 0xb90c09e3 (stale) Mirror 17: 0xb90c09e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18536: skipped 000662 1789177295.934344 trunc from 0x018536 to 0x003cd4 (0x14861 bytes) 000664 1789177295.949223 mapwrite 0x014350 thru 0x01d7a0 (0x9451 bytes) 000665 1789177296.034623 mapwrite 0x0125f9 thru 0x01889e (0x62a6 bytes) 000666 1789177296.129674 mapread 0x00e478 thru 0x012885 (0x440e bytes) 000667 1789177296.142112 mapwrite 0x02a5ba thru 0x035dc1 (0xb808 bytes) 000669 1789177296.252653 write 0x001c22 thru 0x0106d5 (0xeab4 bytes) 000670 1789177296.260775 mapread 0x007a93 thru 0x00b9d0 (0x3f3e bytes) 000672 1789177296.262407 punch from 0x008338 to 0x011492 (0x915b bytes) 000673 1789177296.282054 mapread 0x035276 thru 0x035dbf (0xb4a bytes) 000674 1789177296.283394 read 0x0207f8 thru 0x02ad21 (0xa52a bytes) 000677 1789177296.299175 write 0x011d8a thru 0x01bd43 (0x9fba bytes) 000678 1789177296.315785 MIRROR_RESYNC 4 mirrors 000679 1789177298.067065 mapwrite 0x029514 thru 0x0353dd (0xbeca bytes) 000682 1789177298.335274 mapwrite 0x01ac2a thru 0x01f20f (0x45e6 bytes) 000683 1789177298.448654 write 0x02bd7e thru 0x02c2d0 (0x553 bytes) 000684 1789177298.449797 punch from 0x00840a to 0x00a08c (0x1c83 bytes) 000686 1789177298.473384 punch from 0x0288d9 to 0x02ff59 (0x7681 bytes) 000688 1789177298.486825 trunc from 0x035dc2 to 0x0371e3 (0x1422 bytes) 000689 1789177298.519555 punch from 0x012ffb to 0x0185bf (0x55c5 bytes) 000692 1789177298.525354 write 0x01b7bf thru 0x02aec0 (0xf702 bytes) 000694 1789177298.533415 trunc from 0x0371e4 to 0x023739 (0x13aaa bytes) 000696 1789177298.552209 mapwrite 0x0298e4 thru 0x02f007 (0x5724 bytes) 000697 1789177298.670588 write 0x03bdbb thru 0x03eeff (0x3145 bytes) 000698 1789177298.681594 read 0x01688f thru 0x025e2c (0xf59e bytes) 000699 1789177298.694617 punch from 0x009460 to 0x0170ad (0xdc4e bytes) 000700 1789177298.713486 mapread 0x01e490 thru 0x02592b (0x749c bytes) 000704 1789177298.721350 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ef00): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef00): Mirror 10: 0x300c8abd (stale) Mirror 13: 0x300c8abd (stale) Mirror 17: 0x300c8abd (stale) CRC-32 checksum value for chunk [0, 0x3ef00): Mirror 1: 0xb6131e11 Mirror 18: 0xb6131e11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef00: skipped 000706 1789177300.523015 MIRROR_RESYNC 5 mirrors 000707 1789177302.654514 trunc from 0x03ef00 to 0x02d640 (0x118bf bytes) 000708 1789177302.826744 trunc from 0x02d641 to 0x03d991 (0x10351 bytes) 000709 1789177302.884558 mapread 0x02ad86 thru 0x033d67 (0x8fe2 bytes) 000712 1789177302.943225 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d992): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d992): Mirror 10: 0xfbd8197f (stale) Mirror 13: 0xfbd8197f (stale) Mirror 17: 0xfbd8197f (stale) Mirror 18: 0xfbd8197f (stale) CRC-32 checksum value for chunk [0, 0x3d992): Mirror 1: 0x98131d72 Mirror 19: 0x98131d72 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d992: skipped 000713 1789177304.674894 write 0x01819a thru 0x01e239 (0x60a0 bytes) 000714 1789177304.806211 read 0x02d8f9 thru 0x03285b (0x4f63 bytes) 000715 1789177304.829948 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d992): Mirror 10: 0xfbd8197f (stale) Mirror 13: 0xfbd8197f (stale) Mirror 17: 0xfbd8197f (stale) Mirror 18: 0xfbd8197f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d992): Mirror 10: 0xfbd8197f (stale) Mirror 13: 0xfbd8197f (stale) Mirror 17: 0xfbd8197f (stale) Mirror 18: 0xfbd8197f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d992: skipped 000716 1789177305.445596 read 0x0134cf thru 0x015b64 (0x2696 bytes) 000718 1789177305.453987 read 0x01ba94 thru 0x026a6e (0xafdb bytes) 000720 1789177305.467106 mapwrite 0x00d729 thru 0x012d19 (0x55f1 bytes) 000722 1789177305.542734 mapread 0x000683 thru 0x007e0c (0x778a bytes) 000723 1789177305.545953 mapread 0x00c60c thru 0x01041b (0x3e10 bytes) 000724 1789177305.547056 mapread 0x008681 thru 0x01240c (0x9d8c bytes) 000725 1789177305.549019 punch from 0x006451 to 0x00e74c (0x82fc bytes) 000730 1789177305.573814 trunc from 0x03d992 to 0x01b338 (0x22659 bytes) 000731 1789177305.602281 mapwrite 0x027e81 thru 0x033a6e (0xbbee bytes) 000732 1789177305.889880 punch from 0x028449 to 0x033a6e (0xb626 bytes) 000733 1789177305.895278 write 0x03c240 thru 0x03ffff (0x3dc0 bytes) 000734 1789177305.898477 trunc from 0x040000 to 0x00db15 (0x324ea bytes) 000735 1789177305.921408 punch from 0x00633b to 0x00db15 (0x77db bytes) 000737 1789177305.934866 MIRROR_RESYNC 5 mirrors 000740 1789177307.116112 punch from 0x009743 to 0x00db15 (0x43d3 bytes) 000741 1789177307.178242 mapwrite 0x03993b thru 0x03ffff (0x66c5 bytes) 000742 1789177307.268672 mapread 0x02f83d thru 0x0388dd (0x90a1 bytes) 000744 1789177307.278668 mapread 0x03e07d thru 0x03ffff (0x1f83 bytes) 000746 1789177307.280149 mapwrite 0x00661d thru 0x014b10 (0xe4f4 bytes) 000747 1789177307.351285 mapwrite 0x00fa0c thru 0x010ddd (0x13d2 bytes) 000749 1789177307.385281 read 0x0074ea thru 0x015ac0 (0xe5d7 bytes) 000750 1789177307.386233 write 0x00a723 thru 0x014101 (0x99df bytes) 000751 1789177307.388275 mapwrite 0x009edb thru 0x013cd4 (0x9dfa bytes) 000755 1789177307.446126 write 0x0169a1 thru 0x017575 (0xbd5 bytes) 000756 1789177307.452221 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x383e73e3 (stale) Mirror 17: 0x383e73e3 (stale) Mirror 18: 0x383e73e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x383e73e3 (stale) Mirror 17: 0x383e73e3 (stale) Mirror 18: 0x383e73e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000758 1789177307.914450 mapwrite 0x02857f thru 0x02e7c1 (0x6243 bytes) 000761 1789177307.993508 punch from 0x01dff9 to 0x01e6fb (0x703 bytes) 000764 1789177308.004401 punch from 0x021d02 to 0x02ce3f (0xb13e bytes) 000765 1789177308.009617 write 0x02237c thru 0x03096a (0xe5ef bytes) 000767 1789177308.017290 trunc from 0x040000 to 0x0056d7 (0x3a928 bytes) 000769 1789177308.036605 punch from 0x003423 to 0x0056d7 (0x22b5 bytes) 000770 1789177308.043548 write 0x010e72 thru 0x018c49 (0x7dd8 bytes) 000771 1789177308.047256 read 0x00e591 thru 0x014bc6 (0x6636 bytes) 000772 1789177308.053592 mapwrite 0x00f642 thru 0x01b203 (0xbbc2 bytes) 000773 1789177308.132895 read 0x0069d8 thru 0x01244e (0xba77 bytes) 000774 1789177308.148055 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1b204): Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b204): Mirror 13: 0x6c8346e4 (stale) Mirror 17: 0x6c8346e4 (stale) Mirror 18: 0x6c8346e4 (stale) CRC-32 checksum value for chunk [0, 0x1b204): Mirror 1: 0x86321675 Mirror 19: 0x86321675 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b204: skipped 000776 1789177309.080337 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b204): Mirror 13: 0x6c8346e4 (stale) Mirror 18: 0x6c8346e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b204): Mirror 13: 0x6c8346e4 (stale) Mirror 18: 0x6c8346e4 (stale) CRC-32 checksum value for chunk [0, 0x1b204): Mirror 1: 0x86321675 Mirror 19: 0x86321675 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b204: skipped 000777 1789177309.605215 write 0x01ea98 thru 0x02a200 (0xb769 bytes) 000779 1789177309.703543 mapwrite 0x01b9fa thru 0x028492 (0xca99 bytes) 000780 1789177309.811961 mapread 0x01dcf0 thru 0x02a200 (0xc511 bytes) 000781 1789177309.813538 punch from 0x018bc1 to 0x01d267 (0x46a7 bytes) 000782 1789177309.820174 mapwrite 0x01baec thru 0x0293be (0xd8d3 bytes) 000783 1789177309.878546 mapread 0x028b9e thru 0x02a200 (0x1663 bytes) 000784 1789177309.879979 punch from 0x01b196 to 0x02a13b (0xefa6 bytes) 000785 1789177309.888515 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2a201): Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a201): Mirror 13: 0xa075cec1 (stale) Mirror 18: 0xa075cec1 (stale) Mirror 19: 0xb16f5a80 (stale) CRC-32 checksum value for chunk [0, 0x2a201): Mirror 1: 0x7c8adb46 Mirror 20: 0x7c8adb46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a201: skipped 000789 1789177311.060752 MIRROR_RESYNC 5 mirrors 000790 1789177313.243748 trunc from 0x02a201 to 0x004413 (0x25ded bytes) 000792 1789177313.325820 mapwrite 0x007713 thru 0x016108 (0xe9f6 bytes) 000794 1789177313.442341 write 0x02ccdb thru 0x034276 (0x759c bytes) 000795 1789177313.443588 mapread 0x02ce1e thru 0x034276 (0x7459 bytes) 000797 1789177313.447130 write 0x009c6f thru 0x00b9d9 (0x1d6b bytes) 000798 1789177313.448571 read 0x01658f thru 0x0230fa (0xcb6c bytes) 000800 1789177313.460611 punch from 0x025746 to 0x034276 (0xeb31 bytes) 000801 1789177313.475062 punch from 0x01cc33 to 0x01fa86 (0x2e54 bytes) 000802 1789177313.484622 MIRROR_RESYNC 5 mirrors 000803 1789177315.380353 MIRROR_RESYNC 5 mirrors 000804 1789177315.889335 punch from 0x0168b4 to 0x01bce5 (0x5432 bytes) 000805 1789177315.970988 trunc from 0x034277 to 0x02ad6d (0x9509 bytes) 000806 1789177316.001358 write 0x0022ea thru 0x0075f7 (0x530e bytes) 000807 1789177316.020800 trunc from 0x02ad6e to 0x02c948 (0x1bdb bytes) 000809 1789177316.051504 punch from 0x019766 to 0x0242fe (0xab99 bytes) 000814 1789177316.076496 write 0x012c0b thru 0x01953e (0x6934 bytes) 000815 1789177316.089121 mapwrite 0x008b03 thru 0x013759 (0xac57 bytes) 000817 1789177316.174572 trunc from 0x02c949 to 0x029b71 (0x2dd7 bytes) 000820 1789177316.199461 read 0x001adf thru 0x01126b (0xf78d bytes) 000821 1789177316.206864 punch from 0x01bd03 to 0x021667 (0x5965 bytes) 000824 1789177316.214533 mapread 0x014f12 thru 0x017ade (0x2bcd bytes) 000827 1789177316.222506 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29b72): Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b72): Mirror 13: 0x789b84f7 (stale) Mirror 18: 0x789b84f7 (stale) Mirror 19: 0x789b84f7 (stale) Mirror 20: 0x789b84f7 (stale) CRC-32 checksum value for chunk [0, 0x29b72): Mirror 1: 0xb1f52554 Mirror 21: 0xb1f52554 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b72: skipped 000829 1789177317.613622 mapwrite 0x024379 thru 0x02674e (0x23d6 bytes) 000830 1789177317.818308 read 0x01b846 thru 0x02037e (0x4b39 bytes) 000831 1789177317.826658 read 0x00c851 thru 0x0109f4 (0x41a4 bytes) 000832 1789177317.838075 mapwrite 0x011653 thru 0x014458 (0x2e06 bytes) 000833 1789177317.890405 trunc from 0x029b72 to 0x003815 (0x2635c bytes) 000834 1789177317.995339 read 0x0001bb thru 0x003815 (0x365b bytes) 000836 1789177318.004105 MIRROR_RESYNC 6 mirrors 000837 1789177319.291125 trunc from 0x003816 to 0x03a14b (0x36936 bytes) 000839 1789177319.406304 mapwrite 0x03b0af thru 0x03ffff (0x4f51 bytes) 000841 1789177319.517100 mapread 0x02f263 thru 0x037f90 (0x8d2e bytes) 000842 1789177319.540635 write 0x032255 thru 0x03262e (0x3da bytes) 000843 1789177319.550868 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xa64dd643 (stale) Mirror 18: 0xa64dd643 (stale) Mirror 19: 0xa64dd643 (stale) Mirror 20: 0xa64dd643 (stale) Mirror 21: 0xa64dd643 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x64db01d9 Mirror 22: 0x64db01d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000845 1789177321.035042 punch from 0x021185 to 0x021cd6 (0xb52 bytes) 000846 1789177321.194891 punch from 0x014117 to 0x014f38 (0xe22 bytes) 000847 1789177321.203093 mapwrite 0x037a7b thru 0x03ffff (0x8585 bytes) 000851 1789177321.358774 mapwrite 0x022e58 thru 0x03131e (0xe4c7 bytes) 000853 1789177321.505534 mapread 0x00f821 thru 0x01f34b (0xfb2b bytes) 000854 1789177321.556658 MIRROR_RESYNC 7 mirrors 000855 1789177324.342263 MIRROR_EXTEND to 8 mirrors 000856 1789177325.657386 write 0x00f568 thru 0x01e1d1 (0xec6a bytes) 000857 1789177325.791025 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xc6fcfaab (stale) Mirror 19: 0xc6fcfaab (stale) Mirror 20: 0xc6fcfaab (stale) Mirror 21: 0xc6fcfaab (stale) Mirror 22: 0xc6fcfaab (stale) Mirror 23: 0xc6fcfaab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xc6fcfaab (stale) Mirror 19: 0xc6fcfaab (stale) Mirror 20: 0xc6fcfaab (stale) Mirror 21: 0xc6fcfaab (stale) Mirror 22: 0xc6fcfaab (stale) Mirror 23: 0xc6fcfaab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000858 1789177326.491861 MIRROR_RESYNC 7 mirrors 000859 1789177330.347162 punch from 0x03a0f4 to 0x03ffff (0x5f0c bytes) 000860 1789177330.482390 mapread 0x01bc51 thru 0x024d39 (0x90e9 bytes) 000862 1789177330.506960 mapread 0x0111ab thru 0x01be82 (0xacd8 bytes) 000863 1789177330.519813 mapread 0x030f6f thru 0x031978 (0xa0a bytes) 000864 1789177330.533347 read 0x03c488 thru 0x03ffff (0x3b78 bytes) 000865 1789177330.548314 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x7f31000e (stale) Mirror 19: 0x7f31000e (stale) Mirror 20: 0x7f31000e (stale) Mirror 21: 0x7f31000e (stale) Mirror 22: 0x7f31000e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x7f31000e (stale) Mirror 19: 0x7f31000e (stale) Mirror 20: 0x7f31000e (stale) Mirror 21: 0x7f31000e (stale) Mirror 22: 0x7f31000e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000866 1789177331.238437 mapread 0x01d83d thru 0x02bb6a (0xe32e bytes) 000867 1789177331.271281 mapwrite 0x03e49d thru 0x03ffff (0x1b63 bytes) 000869 1789177331.330238 trunc from 0x040000 to 0x0152b1 (0x2ad4e bytes) 000871 1789177331.354646 mapwrite 0x0329a2 thru 0x0341cc (0x182b bytes) 000875 1789177331.426510 punch from 0x02a3a7 to 0x02ff8f (0x5be9 bytes) 000876 1789177331.433491 write 0x020e5a thru 0x0308e3 (0xfa8a bytes) 000877 1789177331.439568 read 0x012141 thru 0x015ec8 (0x3d88 bytes) 000878 1789177331.445594 mapwrite 0x017260 thru 0x0256fc (0xe49d bytes) 000881 1789177331.538624 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x341cd): Mirror 19: 0xdefddaf2 (stale) Mirror 20: 0xdefddaf2 (stale) Mirror 21: 0xdefddaf2 (stale) Mirror 22: 0xdefddaf2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341cd): Mirror 19: 0xdefddaf2 (stale) Mirror 20: 0xdefddaf2 (stale) Mirror 21: 0xdefddaf2 (stale) Mirror 22: 0xdefddaf2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341cd: skipped 000882 1789177332.024119 mapread 0x01ceb5 thru 0x029710 (0xc85c bytes) 000883 1789177332.086603 mapread 0x024196 thru 0x024319 (0x184 bytes) 000884 1789177332.088528 mapread 0x0210f8 thru 0x025542 (0x444b bytes) 000885 1789177332.092107 trunc from 0x0341cd to 0x02de54 (0x6378 bytes) 000886 1789177332.133322 write 0x01e50d thru 0x026a97 (0x858b bytes) 000891 1789177332.149543 read 0x0256e2 thru 0x02de54 (0x8773 bytes) 000893 1789177332.170790 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2de55): Mirror 19: 0xf0aee7cd (stale) Mirror 21: 0xf0aee7cd (stale) Mirror 22: 0xf0aee7cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de55): Mirror 19: 0xf0aee7cd (stale) Mirror 21: 0xf0aee7cd (stale) Mirror 22: 0xf0aee7cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de55: skipped 000894 1789177332.658427 mapwrite 0x00e597 thru 0x019015 (0xaa7f bytes) 000895 1789177332.850732 punch from 0x0295eb to 0x02de54 (0x486a bytes) 000897 1789177332.855016 mapread 0x014074 thru 0x014f06 (0xe93 bytes) 000899 1789177332.856340 punch from 0x00cf9b to 0x019ac2 (0xcb28 bytes) 000900 1789177332.861473 read 0x025870 thru 0x02bdd6 (0x6567 bytes) 000901 1789177332.877462 trunc from 0x02de55 to 0x026127 (0x7d2d bytes) 000902 1789177332.898465 write 0x010059 thru 0x01fdc3 (0xfd6b bytes) 000903 1789177332.909467 trunc from 0x026128 to 0x01cea6 (0x9281 bytes) 000904 1789177332.935630 mapread 0x00cd57 thru 0x018763 (0xba0d bytes) 000906 1789177332.957015 write 0x03e7fe thru 0x03ffff (0x1802 bytes) 000907 1789177332.960017 mapread 0x0337b4 thru 0x03ffff (0xc84c bytes) 000908 1789177332.980971 write 0x0211a2 thru 0x022e0a (0x1c69 bytes) 000910 1789177333.010432 mapread 0x00da8d thru 0x014790 (0x6d04 bytes) 000911 1789177333.012041 write 0x0051e6 thru 0x00f34d (0xa168 bytes) 000913 1789177333.014514 read 0x02f9ed thru 0x03afa9 (0xb5bd bytes) 000914 1789177333.015503 punch from 0x02cbc5 to 0x03512e (0x856a bytes) 000917 1789177333.052609 read 0x033814 thru 0x03feb1 (0xc69e bytes) 000918 1789177333.064214 trunc from 0x040000 to 0x00a2ad (0x35d52 bytes) 000919 1789177333.086477 write 0x013db7 thru 0x018358 (0x45a2 bytes) 000921 1789177333.089745 punch from 0x00a6dc to 0x010836 (0x615b bytes) 000923 1789177333.115683 MIRROR_RESYNC 4 mirrors 000924 1789177335.207929 mapwrite 0x02388d thru 0x02cf3d (0x96b1 bytes) 000928 1789177335.517380 read 0x01d489 thru 0x02b282 (0xddfa bytes) 000931 1789177335.533578 write 0x01838c thru 0x024974 (0xc5e9 bytes) 000932 1789177335.544592 mapread 0x008927 thru 0x0101cb (0x78a5 bytes) 000933 1789177335.563758 punch from 0x006356 to 0x00bd21 (0x59cc bytes) 000934 1789177335.588026 trunc from 0x02cf3e to 0x032f36 (0x5ff9 bytes) 000935 1789177335.613956 mapwrite 0x014418 thru 0x019651 (0x523a bytes) 000939 1789177335.730934 write 0x01c8b4 thru 0x028a0d (0xc15a bytes) 000941 1789177335.735419 mapread 0x025cf5 thru 0x02f309 (0x9615 bytes) 000942 1789177335.749522 trunc from 0x032f37 to 0x0193b3 (0x19b83 bytes) 000943 1789177335.773492 punch from 0x018c13 to 0x0193b3 (0x7a1 bytes) 000946 1789177335.783720 mapread 0x015446 thru 0x0193b3 (0x3f6e bytes) 000948 1789177335.797744 mapwrite 0x01561d thru 0x01e98c (0x9370 bytes) 000949 1789177335.947811 read 0x00c515 thru 0x017f2c (0xba18 bytes) 000950 1789177335.948477 mapwrite 0x02da04 thru 0x0337a8 (0x5da5 bytes) 000951 1789177336.078527 trunc from 0x0337a9 to 0x001b44 (0x31c64 bytes) 000952 1789177336.105486 MIRROR_RESYNC 4 mirrors 000955 1789177337.246501 mapwrite 0x0322f1 thru 0x037934 (0x5644 bytes) 000956 1789177337.391454 write 0x030101 thru 0x0380ce (0x7fce bytes) 000957 1789177337.392595 read 0x035aa1 thru 0x0380ce (0x262e bytes) 000960 1789177337.395212 trunc from 0x0380cf to 0x01b3f0 (0x1ccde bytes) 000961 1789177337.420199 read 0x006f8d thru 0x013177 (0xc1eb bytes) 000963 1789177337.436518 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x191:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b3f1): Mirror 19: 0x1bdeede0 (stale) Mirror 21: 0x1bdeede0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b3f1): Mirror 19: 0x1bdeede0 (stale) Mirror 21: 0x1bdeede0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b3f1: skipped 000965 1789177337.838433 punch from 0x00eba5 to 0x010e6f (0x22cb bytes) 000966 1789177337.870304 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1b3f1): Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b3f1): Mirror 19: 0x1bdeede0 (stale) Mirror 21: 0x1bdeede0 (stale) CRC-32 checksum value for chunk [0, 0x1b3f1): Mirror 1: 0x1bdeede0 Mirror 22: 0x1bdeede0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b3f1: skipped 000967 1789177339.164751 trunc from 0x01b3f1 to 0x001371 (0x1a07f bytes) 000968 1789177339.266575 trunc from 0x001372 to 0x006560 (0x51ef bytes) 000969 1789177339.299396 MIRROR_RESYNC 4 mirrors 000970 1789177340.493115 mapwrite 0x004fec thru 0x00c8da (0x78ef bytes) 000971 1789177340.685204 punch from 0x00a34f to 0x00c8da (0x258c bytes) 000972 1789177340.693877 mapread 0x005ff3 thru 0x007c83 (0x1c91 bytes) 000973 1789177340.695753 read 0x00b49d thru 0x00c8da (0x143e bytes) 000974 1789177340.702129 punch from 0x009250 to 0x0092ca (0x7b bytes) 000975 1789177340.713043 MIRROR_RESYNC 4 mirrors 000977 1789177342.077783 write 0x029290 thru 0x0360e2 (0xce53 bytes) 000978 1789177342.211396 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x360e3): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360e3): Mirror 19: 0xf4668fc (stale) Mirror 21: 0xf4668fc (stale) Mirror 22: 0xf4668fc (stale) CRC-32 checksum value for chunk [0, 0x360e3): Mirror 1: 0xf0a153f5 Mirror 23: 0xf0a153f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360e3: skipped 000979 1789177344.062468 trunc from 0x0360e3 to 0x00ea8b (0x27657 bytes) 000980 1789177344.264556 read 0x00c8ff thru 0x00ea8b (0x218d bytes) 000981 1789177344.289400 mapwrite 0x0170a3 thru 0x0222b0 (0xb20e bytes) 000982 1789177344.483079 mapread 0x02050c thru 0x0222b0 (0x1da5 bytes) 000983 1789177344.483937 trunc from 0x0222b1 to 0x03286b (0x105bb bytes) 000984 1789177344.532581 write 0x02f0ce thru 0x03df5d (0xee90 bytes) 000991 1789177344.548642 mapwrite 0x03e50b thru 0x03ffff (0x1af5 bytes) 000994 1789177344.634678 write 0x002151 thru 0x0063b6 (0x4266 bytes) 000996 1789177344.647236 punch from 0x016951 to 0x016dee (0x49e bytes) 000998 1789177344.659865 read 0x02b1b4 thru 0x02e261 (0x30ae bytes) 000999 1789177344.668460 write 0x000161 thru 0x00199c (0x183c bytes) 001000 1789177344.673148 MIRROR_RESYNC 5 mirrors All operations completed A-OK!