== sanity-flr test 70a: flr mode fsx test ================ 10:41:16 (1789051276) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1279 skipping zero length punch hole fallocating to largest ever: 0x2576b 000003 1789051279.341746 fallocate 0x01bb1c thru 0x02576a (0x9c4f bytes) 000004 1789051279.353378 mapwrite 0x007430 thru 0x007903 (0x4d4 bytes) 000005 1789051279.392342 punch from 0x0062eb to 0x00c273 (0x5f89 bytes) 000006 1789051279.405672 mapwrite 0x03b04a thru 0x03ffff (0x4fb6 bytes) 000007 1789051279.540367 MIRROR_EXTEND to 2 mirrors 000008 1789051280.727184 punch from 0x03c9f0 to 0x03ee34 (0x2445 bytes) 000009 1789051280.814254 mapwrite 0x018f40 thru 0x01fa42 (0x6b03 bytes) 000010 1789051280.873997 fallocate 0x0072b0 thru 0x009314 (0x2065 bytes) 000011 1789051280.892802 write 0x03acac thru 0x03e0a1 (0x33f6 bytes) 000012 1789051280.923363 punch from 0x00dfeb to 0x012279 (0x428f bytes) 000013 1789051280.931391 mapread 0x03d330 thru 0x03f4c8 (0x2199 bytes) 000014 1789051280.955216 punch from 0x01beed to 0x01d114 (0x1228 bytes) 000015 1789051280.968052 write 0x032437 thru 0x03a66c (0x8236 bytes) 000016 1789051280.979232 trunc from 0x040000 to 0x006e17 (0x391e8 bytes) truncating to largest ever: 0x2d657 000017 1789051281.046911 trunc from 0x006e18 to 0x02d656 (0x2683f bytes) 000018 1789051281.118836 read 0x003e58 thru 0x012a25 (0xebce bytes) 000019 1789051281.148319 fallocate 0x023409 thru 0x029cf2 (0x68ea bytes) truncating to largest ever: 0x3fda7 000020 1789051281.157528 trunc from 0x02d657 to 0x03fda6 (0x12750 bytes) 000021 1789051281.176151 trunc from 0x004858 to 0x0088b5 (0x405e bytes) 000022 1789051281.183455 read 0x02dce2 thru 0x034ed8 (0x71f7 bytes) 000023 1789051281.211645 fallocate 0x034b3a thru 0x0376c1 (0x2b88 bytes) 000024 1789051281.220301 trunc from 0x012a72 to 0x01aa8b (0x801a bytes) 000026 1789051281.240388 trunc from 0x02f4b6 to 0x0322a3 (0x2dee bytes) 000027 1789051281.255199 mapread 0x0157f5 thru 0x01957a (0x3d86 bytes) 000028 1789051281.332226 MIRROR_RESYNC 2 mirrors 000029 1789051281.861606 trunc from 0x03fda7 to 0x027c2f (0x18177 bytes) 000030 1789051281.913175 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27c30): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27c30): Mirror 2: 0x82f772be (stale) CRC-32 checksum value for chunk [0, 0x27c30): Mirror 1: 0x82f772be Mirror 3: 0x82f772be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27c30: skipped 000031 1789051282.790896 punch from 0x007d8c to 0x0122cd (0xa542 bytes) 000033 1789051282.868623 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x27c30): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27c30): Mirror 2: 0x82f772be (stale) Mirror 3: 0x82f772be (stale) CRC-32 checksum value for chunk [0, 0x27c30): Mirror 1: 0x82f772be Mirror 4: 0x82f772be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27c30: skipped fallocating to largest ever: 0x40000 000034 1789051283.867683 fallocate 0x038e67 thru 0x03ffff (0x7199 bytes) 000035 1789051283.925656 read 0x01953d thru 0x01c5a5 (0x3069 bytes) 000036 1789051283.935752 read 0x01787b thru 0x01956e (0x1cf4 bytes) 000037 1789051283.971164 trunc from 0x0265d0 to 0x027c2f (0x1660 bytes) 000038 1789051283.981936 MIRROR_RESYNC 4 mirrors 000039 1789051284.770640 punch from 0x01f312 to 0x024e17 (0x5b06 bytes) 000040 1789051284.807940 trunc from 0x027c30 to 0x010665 (0x175ca bytes) 000041 1789051284.831315 mapwrite 0x036964 thru 0x03ffff (0x969c bytes) 000042 1789051284.903592 fallocate 0x03e16d thru 0x03f69a (0x152e bytes) 000043 1789051284.910714 mapwrite 0x01c968 thru 0x02810a (0xb7a3 bytes) 000044 1789051284.961312 mapwrite 0x004e69 thru 0x014d08 (0xfea0 bytes) 000045 1789051285.015856 trunc from 0x02cf6b to 0x036bda (0x9c70 bytes) 000046 1789051285.026600 write 0x03e152 thru 0x03ffff (0x1eae bytes) 000047 1789051285.029250 trunc from 0x040000 to 0x0339c7 (0xc638 bytes) 000048 1789051285.057903 write 0x005d58 thru 0x00ad96 (0x503f bytes) 000049 1789051285.060065 punch from 0x0140f4 to 0x023aa6 (0xf9b3 bytes) 000050 1789051285.068338 punch from 0x00ecc6 to 0x01b236 (0xc571 bytes) 000051 1789051285.081102 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x339c8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x339c8): Mirror 2: 0x55431e8f (stale) Mirror 3: 0x55431e8f (stale) Mirror 4: 0x55431e8f (stale) CRC-32 checksum value for chunk [0, 0x339c8): Mirror 1: 0xcadf421b Mirror 5: 0xcadf421b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x339c8: skipped 000052 1789051286.326795 mapread 0x028089 thru 0x0339c7 (0xb93f bytes) 000053 1789051286.372787 mapwrite 0x033166 thru 0x037855 (0x46f0 bytes) 000054 1789051286.460219 mapread 0x03433b thru 0x037855 (0x351b bytes) 000056 1789051286.464623 mapwrite 0x022a04 thru 0x02e298 (0xb895 bytes) 000057 1789051286.541379 mapread 0x011768 thru 0x018849 (0x70e2 bytes) 000058 1789051286.574732 read 0x0273b2 thru 0x02874c (0x139b bytes) 000059 1789051286.578787 trunc from 0x004f6d to 0x0128c5 (0xd959 bytes) 000060 1789051286.589344 write 0x0354f2 thru 0x039a8d (0x459c bytes) 000061 1789051286.597828 trunc from 0x016404 to 0x01fb09 (0x9706 bytes) 000062 1789051286.606662 mapread 0x0039a5 thru 0x00f527 (0xbb83 bytes) 000063 1789051286.632837 fallocate 0x01b2e6 thru 0x0250f8 (0x9e13 bytes) 000064 1789051286.644900 mapwrite 0x004193 thru 0x006600 (0x246e bytes) 000065 1789051286.685105 read 0x002eff thru 0x00851b (0x561d bytes) 000066 1789051286.695574 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 2: 0xb554fbc3 (stale) Mirror 3: 0xb554fbc3 (stale) Mirror 4: 0xb554fbc3 (stale) Mirror 5: 0xf8191d76 (stale) CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 1: 0x27b06b08 Mirror 6: 0x27b06b08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a8e: skipped 000067 1789051287.970436 punch from 0x008cbb to 0x00dc68 (0x4fae bytes) 000068 1789051288.042117 punch from 0x0323d6 to 0x034dac (0x29d7 bytes) 000069 1789051288.067103 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 2: 0xb554fbc3 (stale) Mirror 3: 0xb554fbc3 (stale) Mirror 4: 0xb554fbc3 (stale) Mirror 5: 0xf8191d76 (stale) Mirror 6: 0x27b06b08 (stale) CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 1: 0xdf3bf393 Mirror 7: 0xdf3bf393 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a8e: skipped 000070 1789051289.604563 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 2: 0xb554fbc3 (stale) Mirror 3: 0xb554fbc3 (stale) Mirror 5: 0xf8191d76 (stale) Mirror 6: 0x27b06b08 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 2: 0xb554fbc3 (stale) Mirror 3: 0xb554fbc3 (stale) Mirror 5: 0xf8191d76 (stale) Mirror 6: 0x27b06b08 (stale) CRC-32 checksum value for chunk [0, 0x39a8e): Mirror 1: 0xdf3bf393 Mirror 7: 0xdf3bf393 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a8e: skipped 000071 1789051290.875556 trunc from 0x008ab5 to 0x00ad74 (0x22c0 bytes) 000073 1789051290.942095 trunc from 0x039a8e to 0x029b42 (0xff4b bytes) 000074 1789051290.977693 mapwrite 0x006b7f thru 0x012e42 (0xc2c4 bytes) 000075 1789051291.043681 trunc from 0x0220dd to 0x029b42 (0x7a66 bytes) 000076 1789051291.050516 mapread 0x0029a1 thru 0x0077ae (0x4e0e bytes) 000078 1789051291.053159 write 0x02a365 thru 0x03044f (0x60eb bytes) 000079 1789051291.055240 write 0x03ebf4 thru 0x03ffff (0x140c bytes) 000080 1789051291.057752 write 0x00c3b7 thru 0x017a49 (0xb693 bytes) 000082 1789051291.062188 trunc from 0x0238d0 to 0x027387 (0x3ab8 bytes) 000083 1789051291.068513 read 0x02e940 thru 0x031f17 (0x35d8 bytes) 000084 1789051291.074776 punch from 0x031827 to 0x03824e (0x6a28 bytes) 000085 1789051291.081189 write 0x034bf1 thru 0x03f9cc (0xaddc bytes) 000086 1789051291.091160 read 0x004964 thru 0x013a7c (0xf119 bytes) 000087 1789051291.092259 trunc from 0x024027 to 0x02dc11 (0x9beb bytes) 000088 1789051291.117115 punch from 0x0198c9 to 0x02358e (0x9cc6 bytes) 000089 1789051291.123819 punch from 0x035bf9 to 0x0366da (0xae2 bytes) 000090 1789051291.128841 read 0x005981 thru 0x0109e3 (0xb063 bytes) 000091 1789051291.134804 MIRROR_RESYNC 6 mirrors 000092 1789051292.847907 fallocate 0x036ac5 thru 0x03f404 (0x8940 bytes) 000093 1789051292.903318 write 0x003bb0 thru 0x00bd4a (0x819b bytes) 000094 1789051292.932843 trunc from 0x040000 to 0x018ff5 (0x2700a bytes) 000095 1789051292.980651 trunc from 0x012cf1 to 0x018ff5 (0x6305 bytes) 000096 1789051292.991153 mapwrite 0x03508d thru 0x03ffff (0xaf73 bytes) 000097 1789051293.095697 mapwrite 0x03dbb5 thru 0x03ffff (0x244b bytes) 000099 1789051293.123391 trunc from 0x016f1e to 0x0186f8 (0x17db bytes) 000100 1789051293.133352 trunc from 0x032993 to 0x03e48b (0xbaf9 bytes) 000101 1789051293.140845 trunc from 0x040000 to 0x032d24 (0xd2db bytes) 000102 1789051293.167513 mapwrite 0x036bd1 thru 0x03903b (0x246b bytes) 000103 1789051293.236141 read 0x01656b thru 0x0258e4 (0xf37a bytes) 000104 1789051293.247384 mapwrite 0x000081 thru 0x00f47e (0xf3fe bytes) 000105 1789051293.348507 trunc from 0x03903c to 0x038a86 (0x5b5 bytes) 000106 1789051293.375122 mapwrite 0x0340a9 thru 0x03b3c2 (0x731a bytes) 000107 1789051293.421780 mapwrite 0x0077d1 thru 0x010a9b (0x92cb bytes) 000108 1789051293.447072 write 0x00abdf thru 0x01990f (0xed31 bytes) 000109 1789051293.448523 mapread 0x00e55f thru 0x018e0c (0xa8ae bytes) 000110 1789051293.450788 trunc from 0x03b3c3 to 0x03c789 (0x13c7 bytes) 000111 1789051293.475056 trunc from 0x023f79 to 0x031ef8 (0xdf80 bytes) 000112 1789051293.480233 write 0x02bbd9 thru 0x038373 (0xc79b bytes) 000113 1789051293.491508 fallocate 0x01456e thru 0x01d269 (0x8cfc bytes) 000114 1789051293.534136 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c78a): Mirror 3: 0xcefdd45e (stale) Mirror 5: 0xcefdd45e (stale) Mirror 6: 0xcefdd45e (stale) Mirror 7: 0xcefdd45e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c78a): Mirror 3: 0xcefdd45e (stale) Mirror 5: 0xcefdd45e (stale) Mirror 6: 0xcefdd45e (stale) Mirror 7: 0xcefdd45e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c78a: skipped 000115 1789051293.998948 read 0x037fb7 thru 0x03aa95 (0x2adf bytes) 000116 1789051294.005269 mapread 0x0386ff thru 0x03c789 (0x408b bytes) 000118 1789051294.021009 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c78a): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c78a): Mirror 3: 0xcefdd45e (stale) Mirror 5: 0xcefdd45e (stale) Mirror 6: 0xcefdd45e (stale) Mirror 7: 0xcefdd45e (stale) CRC-32 checksum value for chunk [0, 0x3c78a): Mirror 1: 0x81214270 Mirror 8: 0x81214270 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c78a: skipped 000119 1789051295.262707 trunc from 0x03c78a to 0x019197 (0x235f2 bytes) 000120 1789051295.359532 write 0x0258c1 thru 0x031655 (0xbd95 bytes) 000121 1789051295.363021 mapwrite 0x005165 thru 0x014ee5 (0xfd81 bytes) 000125 1789051295.439762 mapwrite 0x00bb83 thru 0x01381c (0x7c9a bytes) 000126 1789051295.466481 trunc from 0x00301b to 0x00dfbc (0xafa2 bytes) 000127 1789051295.472534 mapwrite 0x03bd49 thru 0x03cb6a (0xe22 bytes) 000128 1789051295.529503 trunc from 0x03855b to 0x03cb6a (0x4610 bytes) 000129 1789051295.536034 write 0x0017b2 thru 0x001b03 (0x352 bytes) 000130 1789051295.537697 fallocate 0x033daf thru 0x034fef (0x1241 bytes) 000131 1789051295.544127 write 0x02a61d thru 0x0372d0 (0xccb4 bytes) 000132 1789051295.546517 punch from 0x0349c3 to 0x03cb6a (0x81a8 bytes) 000133 1789051295.564793 write 0x01f8dc thru 0x029e8b (0xa5b0 bytes) 000134 1789051295.572707 trunc from 0x008beb to 0x010226 (0x763c bytes) 000135 1789051295.579607 punch from 0x0138a6 to 0x01781c (0x3f77 bytes) 000137 1789051295.587170 punch from 0x01ce42 to 0x02650c (0x96cb bytes) 000139 1789051295.605625 punch from 0x034296 to 0x03cb6a (0x88d5 bytes) 000142 1789051295.614052 read 0x030c1e thru 0x03cb6a (0xbf4d bytes) 000143 1789051295.627945 read 0x022f90 thru 0x024e95 (0x1f06 bytes) 000144 1789051295.639408 mapwrite 0x02f629 thru 0x03a09c (0xaa74 bytes) 000145 1789051295.662533 mapwrite 0x003ba4 thru 0x004e95 (0x12f2 bytes) 000146 1789051295.680356 write 0x00524c thru 0x01397f (0xe734 bytes) 000148 1789051295.682324 fallocate 0x00021d thru 0x00deb0 (0xdc94 bytes) 000149 1789051295.686125 write 0x039c00 thru 0x03df02 (0x4303 bytes) 000150 1789051295.686951 write 0x03f92c thru 0x03ffff (0x6d4 bytes) 000151 1789051295.687659 write 0x03d474 thru 0x03ffff (0x2b8c bytes) 000152 1789051295.688747 trunc from 0x040000 to 0x03becb (0x4134 bytes) 000153 1789051295.704268 read 0x02c98c thru 0x0373ca (0xaa3f bytes) 000154 1789051295.705438 read 0x03321b thru 0x03becb (0x8cb1 bytes) 000155 1789051295.706146 fallocate 0x003af7 thru 0x00b73b (0x7c45 bytes) 000156 1789051295.712004 punch from 0x02c4f2 to 0x034a1a (0x8529 bytes) 000157 1789051295.717201 write 0x03dbce thru 0x03ffff (0x2432 bytes) 000158 1789051295.718720 trunc from 0x040000 to 0x02b95c (0x146a3 bytes) 000159 1789051295.734035 fallocate 0x03fb57 thru 0x03ffff (0x4a9 bytes) 000160 1789051295.739477 trunc from 0x038ffd to 0x03febe (0x6ec2 bytes) 000161 1789051295.744364 fallocate 0x01ff6a thru 0x027b1d (0x7bb4 bytes) 000162 1789051295.749452 mapwrite 0x036469 thru 0x03f47d (0x9015 bytes) 000163 1789051295.795495 write 0x03878d thru 0x038a13 (0x287 bytes) 000164 1789051295.796546 mapread 0x00b24a thru 0x018072 (0xce29 bytes) 000165 1789051295.798732 write 0x02550d thru 0x0345ff (0xf0f3 bytes) 000166 1789051295.800580 mapwrite 0x0350d1 thru 0x03a24c (0x517c bytes) 000167 1789051295.830218 read 0x03db0f thru 0x03ffff (0x24f1 bytes) 000168 1789051295.830900 trunc from 0x0005a7 to 0x004f29 (0x4983 bytes) 000169 1789051295.836283 punch from 0x007b35 to 0x015ce4 (0xe1b0 bytes) 000170 1789051295.845570 write 0x03ae0a thru 0x03ffff (0x51f6 bytes) 000171 1789051295.847806 mapwrite 0x03381e thru 0x03f5b6 (0xbd99 bytes) 000172 1789051295.873189 trunc from 0x00c5ff to 0x011f9b (0x599d bytes) 000173 1789051295.877807 mapwrite 0x023416 thru 0x02b7ed (0x83d8 bytes) 000174 1789051295.896022 trunc from 0x02db92 to 0x03ba0c (0xde7b bytes) 000175 1789051295.905554 read 0x014d77 thru 0x01d422 (0x86ac bytes) 000176 1789051295.938635 trunc from 0x0394b9 to 0x03ffff (0x6b47 bytes) 000177 1789051295.943155 mapwrite 0x019548 thru 0x01c339 (0x2df2 bytes) 000178 1789051295.958835 mapwrite 0x03e00e thru 0x03ffff (0x1ff2 bytes) 000180 1789051295.979202 trunc from 0x033ef4 to 0x035430 (0x153d bytes) 000181 1789051295.984054 read 0x02cedb thru 0x03a281 (0xd3a7 bytes) 000183 1789051295.993261 punch from 0x029587 to 0x036799 (0xd213 bytes) 000184 1789051295.999242 read 0x019c6b thru 0x026937 (0xcccd bytes) 000185 1789051295.999963 trunc from 0x040000 to 0x014dac (0x2b253 bytes) 000186 1789051296.026080 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x14dad): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14dad): Mirror 3: 0xfc8bf761 (stale) Mirror 5: 0xfc8bf761 (stale) Mirror 6: 0xfc8bf761 (stale) Mirror 7: 0xfc8bf761 (stale) Mirror 8: 0xc8b3b507 (stale) CRC-32 checksum value for chunk [0, 0x14dad): Mirror 1: 0x3497ffff Mirror 9: 0x3497ffff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14dad: skipped 000188 1789051297.271471 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14dad): Mirror 3: 0xfc8bf761 (stale) Mirror 5: 0xfc8bf761 (stale) Mirror 6: 0xfc8bf761 (stale) Mirror 8: 0xc8b3b507 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14dad): Mirror 3: 0xfc8bf761 (stale) Mirror 5: 0xfc8bf761 (stale) Mirror 6: 0xfc8bf761 (stale) Mirror 8: 0xc8b3b507 (stale) CRC-32 checksum value for chunk [0, 0x14dad): Mirror 1: 0x3497ffff Mirror 9: 0x3497ffff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14dad: skipped 000189 1789051298.025081 mapread 0x00d69a thru 0x014cde (0x7645 bytes) 000190 1789051298.071437 write 0x03b2c0 thru 0x03c0ca (0xe0b bytes) 000191 1789051298.131131 mapread 0x023c67 thru 0x026cf7 (0x3091 bytes) 000192 1789051298.146098 read 0x01f0c3 thru 0x02643a (0x7378 bytes) 000193 1789051298.147578 trunc from 0x02a613 to 0x0381aa (0xdb98 bytes) 000194 1789051298.155966 mapwrite 0x02b004 thru 0x031b6a (0x6b67 bytes) 000195 1789051298.209958 mapread 0x0287b7 thru 0x0324a7 (0x9cf1 bytes) 000196 1789051298.210829 trunc from 0x03c0cb to 0x029ae2 (0x125e8 bytes) 000197 1789051298.238314 trunc from 0x029ae3 to 0x02b23b (0x1759 bytes) 000198 1789051298.262240 mapread 0x009697 thru 0x016a96 (0xd400 bytes) 000201 1789051298.312241 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2b23c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b23c): Mirror 3: 0x9e582eb7 (stale) Mirror 5: 0x9e582eb7 (stale) Mirror 6: 0x9e582eb7 (stale) Mirror 8: 0x765d3212 (stale) Mirror 9: 0xe6c8d5b2 (stale) CRC-32 checksum value for chunk [0, 0x2b23c): Mirror 1: 0xe6c8d5b2 Mirror 10: 0xe6c8d5b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b23c: skipped 000202 1789051299.918109 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2b23c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b23c): Mirror 3: 0x9e582eb7 (stale) Mirror 5: 0x9e582eb7 (stale) Mirror 6: 0x9e582eb7 (stale) Mirror 8: 0x765d3212 (stale) Mirror 9: 0xe6c8d5b2 (stale) CRC-32 checksum value for chunk [0, 0x2b23c): Mirror 1: 0xe6c8d5b2 Mirror 10: 0xe6c8d5b2 Mirror 11: 0xe6c8d5b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b23c: skipped 000203 1789051301.235431 fallocate 0x01620a thru 0x02460b (0xe402 bytes) 000204 1789051301.273304 fallocate 0x03f92a thru 0x03ffff (0x6d6 bytes) 000206 1789051301.294754 MIRROR_RESYNC 8 mirrors 000207 1789051303.410011 mapwrite 0x00c3ff thru 0x01b727 (0xf329 bytes) 000208 1789051303.597539 write 0x021036 thru 0x028c2a (0x7bf5 bytes) 000209 1789051303.617030 write 0x007463 thru 0x00c82f (0x53cd bytes) 000211 1789051303.618675 fallocate 0x0009f4 thru 0x0022d1 (0x18de bytes) 000212 1789051303.635066 mapwrite 0x00b510 thru 0x01a1ce (0xecbf bytes) 000213 1789051303.672311 read 0x03efb9 thru 0x03ffff (0x1047 bytes) 000214 1789051303.682377 fallocate 0x012283 thru 0x016a6c (0x47ea bytes) 000215 1789051303.691167 mapread 0x03c6a6 thru 0x03ffff (0x395a bytes) 000216 1789051303.719102 trunc from 0x040000 to 0x035d75 (0xa28a bytes) 000217 1789051303.770177 trunc from 0x022c05 to 0x02be80 (0x927c bytes) 000218 1789051303.777160 mapwrite 0x007a6b thru 0x00b9bf (0x3f55 bytes) 000219 1789051303.816124 trunc from 0x035d76 to 0x037c44 (0x1ecf bytes) 000220 1789051303.839656 write 0x01ea84 thru 0x026cd5 (0x8252 bytes) 000221 1789051303.850841 punch from 0x00fade to 0x01d361 (0xd884 bytes) 000222 1789051303.859132 mapwrite 0x03bf3d thru 0x03c810 (0x8d4 bytes) 000223 1789051303.932914 trunc from 0x02634b to 0x033c86 (0xd93c bytes) 000224 1789051303.945923 punch from 0x007180 to 0x016a3d (0xf8be bytes) 000225 1789051303.955132 trunc from 0x03c811 to 0x002119 (0x3a6f7 bytes) 000226 1789051303.979441 fallocate 0x004ac8 thru 0x00912f (0x4668 bytes) 000227 1789051303.986240 write 0x039927 thru 0x03ffff (0x66d9 bytes) 000228 1789051303.989144 trunc from 0x040000 to 0x02bf16 (0x140e9 bytes) 000229 1789051304.016006 MIRROR_RESYNC 8 mirrors 000230 1789051305.707248 punch from 0x019d74 to 0x028ff8 (0xf285 bytes) 000231 1789051305.740782 punch from 0x00510d to 0x011cd1 (0xcbc5 bytes) 000232 1789051305.753483 mapwrite 0x02a157 thru 0x039d35 (0xfbdf bytes) 000233 1789051305.852082 mapwrite 0x013f63 thru 0x0238f3 (0xf991 bytes) 000234 1789051305.916110 trunc from 0x039d36 to 0x03b8f8 (0x1bc3 bytes) 000235 1789051305.949386 trunc from 0x028ff5 to 0x032275 (0x9281 bytes) 000236 1789051305.967064 mapread 0x026143 thru 0x029f96 (0x3e54 bytes) 000237 1789051305.989237 punch from 0x022ba7 to 0x02f791 (0xcbeb bytes) 000238 1789051306.005457 write 0x005389 thru 0x01273f (0xd3b7 bytes) 000239 1789051306.013945 punch from 0x02a3f9 to 0x02cb6e (0x2776 bytes) 000240 1789051306.023220 read 0x02492b thru 0x02b566 (0x6c3c bytes) 000241 1789051306.048373 mapread 0x038b8e thru 0x03b7d9 (0x2c4c bytes) 000242 1789051306.060216 read 0x03b2fe thru 0x03b8f8 (0x5fb bytes) 000243 1789051306.060853 mapread 0x036f8e thru 0x03b8f8 (0x496b bytes) 000244 1789051306.061750 write 0x01c9a3 thru 0x022537 (0x5b95 bytes) 000245 1789051306.073399 mapread 0x00dcad thru 0x01af1c (0xd270 bytes) 000246 1789051306.079626 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b8f9): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8f9): Mirror 3: 0x223a832b (stale) Mirror 5: 0x223a832b (stale) Mirror 6: 0x223a832b (stale) Mirror 8: 0x223a832b (stale) Mirror 9: 0x223a832b (stale) Mirror 10: 0x223a832b (stale) Mirror 11: 0x223a832b (stale) CRC-32 checksum value for chunk [0, 0x3b8f9): Mirror 1: 0xce53e372 Mirror 12: 0xce53e372 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8f9: skipped 000247 1789051307.471299 read 0x028a59 thru 0x030dfd (0x83a5 bytes) 000249 1789051307.506730 punch from 0x006538 to 0x013da7 (0xd870 bytes) 000250 1789051307.562225 mapread 0x00b3d1 thru 0x00d9ff (0x262f bytes) 000251 1789051307.587709 trunc from 0x03b8f9 to 0x029f30 (0x119c8 bytes) 000252 1789051307.611449 punch from 0x01a475 to 0x020338 (0x5ec4 bytes) 000255 1789051307.622640 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29f31): Mirror 3: 0x6ed21976 (stale) Mirror 5: 0x6ed21976 (stale) Mirror 8: 0x6ed21976 (stale) Mirror 9: 0x6ed21976 (stale) Mirror 10: 0x6ed21976 (stale) Mirror 11: 0x6ed21976 (stale) Mirror 12: 0xeaa37e1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f31): Mirror 3: 0x6ed21976 (stale) Mirror 5: 0x6ed21976 (stale) Mirror 8: 0x6ed21976 (stale) Mirror 9: 0x6ed21976 (stale) Mirror 10: 0x6ed21976 (stale) Mirror 11: 0x6ed21976 (stale) Mirror 12: 0xeaa37e1e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f31: skipped 000256 1789051308.246489 trunc from 0x005a49 to 0x013f94 (0xe54c bytes) 000257 1789051308.253978 trunc from 0x029f31 to 0x033008 (0x90d8 bytes) 000258 1789051308.273470 trunc from 0x02d73e to 0x02e553 (0xe16 bytes) 000259 1789051308.278697 read 0x01bdc6 thru 0x01d87c (0x1ab7 bytes) 000260 1789051308.284594 fallocate 0x030966 thru 0x038187 (0x7822 bytes) 000261 1789051308.289807 fallocate 0x01f45f thru 0x024c18 (0x57ba bytes) 000263 1789051308.296101 read 0x01b62b thru 0x02a300 (0xecd6 bytes) 000264 1789051308.306932 fallocate 0x006c5c thru 0x00caba (0x5e5f bytes) 000265 1789051308.311698 mapread 0x027ee8 thru 0x029801 (0x191a bytes) 000266 1789051308.312935 mapwrite 0x03d197 thru 0x03ffff (0x2e69 bytes) 000267 1789051308.352647 write 0x02e266 thru 0x03d6a8 (0xf443 bytes) 000268 1789051308.354392 mapread 0x01be68 thru 0x02ba69 (0xfc02 bytes) 000269 1789051308.356858 fallocate 0x03ebd5 thru 0x03ffff (0x142b bytes) 000270 1789051308.362216 mapwrite 0x036f52 thru 0x03ffff (0x90ae bytes) 000271 1789051308.380446 fallocate 0x025966 thru 0x02aa37 (0x50d2 bytes) 000272 1789051308.388339 mapread 0x01a1a2 thru 0x01d6e9 (0x3548 bytes) 000273 1789051308.390282 read 0x00038e thru 0x010089 (0xfcfc bytes) 000274 1789051308.392637 mapread 0x01827d thru 0x01f4cf (0x7253 bytes) 000275 1789051308.394377 trunc from 0x0201e5 to 0x02bf10 (0xbd2c bytes) 000276 1789051308.400671 trunc from 0x040000 to 0x0345dd (0xba22 bytes) 000277 1789051308.417489 read 0x008d29 thru 0x00d1ae (0x4486 bytes) 000278 1789051308.419087 fallocate 0x03db85 thru 0x03f902 (0x1d7e bytes) 000279 1789051308.424200 punch from 0x030cbd to 0x0345dd (0x3921 bytes) 000280 1789051308.429830 mapread 0x019a00 thru 0x0235df (0x9be0 bytes) 000281 1789051308.438821 trunc from 0x01fdc1 to 0x02b36c (0xb5ac bytes) 000282 1789051308.448317 trunc from 0x01fcc6 to 0x02e44d (0xe788 bytes) 000283 1789051308.455323 read 0x026ea4 thru 0x032031 (0xb18e bytes) 000285 1789051308.471171 mapread 0x008f38 thru 0x00f056 (0x611f bytes) 000286 1789051308.474126 fallocate 0x035e2f thru 0x03f18a (0x935c bytes) 000287 1789051308.480193 mapwrite 0x01f63d thru 0x02a239 (0xabfd bytes) 000288 1789051308.512600 mapread 0x0146af thru 0x01b256 (0x6ba8 bytes) 000291 1789051308.514585 punch from 0x03b4d6 to 0x03f18a (0x3cb5 bytes) 000292 1789051308.522331 mapwrite 0x0363ab thru 0x039ded (0x3a43 bytes) 000293 1789051308.555814 mapwrite 0x02abf7 thru 0x02c49d (0x18a7 bytes) 000294 1789051308.572694 mapread 0x03d32e thru 0x03e50b (0x11de bytes) 000295 1789051308.574101 punch from 0x01b894 to 0x0207b6 (0x4f23 bytes) 000296 1789051308.585209 trunc from 0x03a24e to 0x03f18a (0x4f3d bytes) 000297 1789051308.591138 mapwrite 0x019722 thru 0x01dc68 (0x4547 bytes) 000298 1789051308.622498 fallocate 0x0398e0 thru 0x03ffff (0x6720 bytes) 000299 1789051308.627935 write 0x017923 thru 0x021ba8 (0xa286 bytes) 000300 1789051308.629584 trunc from 0x040000 to 0x03007e (0xff81 bytes) 000301 1789051308.647144 read 0x02b4fc thru 0x02d576 (0x207b bytes) 000302 1789051308.648060 fallocate 0x0293c7 thru 0x034d9d (0xb9d7 bytes) 000303 1789051308.654501 trunc from 0x028654 to 0x03007e (0x7a2b bytes) 000304 1789051308.664683 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3007f): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3007f): Mirror 3: 0x148abc43 (stale) Mirror 5: 0x148abc43 (stale) Mirror 8: 0x148abc43 (stale) Mirror 9: 0x148abc43 (stale) Mirror 10: 0x148abc43 (stale) Mirror 11: 0x148abc43 (stale) Mirror 12: 0x5a682382 (stale) CRC-32 checksum value for chunk [0, 0x3007f): Mirror 1: 0x6886734b Mirror 13: 0x6886734b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3007f: skipped 000305 1789051309.726051 trunc from 0x03007f to 0x031f18 (0x1e9a bytes) 000306 1789051309.812124 punch from 0x02f695 to 0x031f18 (0x2884 bytes) 000307 1789051309.823077 fallocate 0x0004e8 thru 0x00d197 (0xccb0 bytes) 000308 1789051309.831916 fallocate 0x031ee8 thru 0x03b426 (0x953f bytes) 000309 1789051309.839302 trunc from 0x020ef8 to 0x02b79b (0xa8a4 bytes) 000310 1789051309.844990 fallocate 0x002bc8 thru 0x005ea0 (0x32d9 bytes) 000311 1789051309.851160 read 0x0084f8 thru 0x013bc2 (0xb6cb bytes) 000312 1789051309.867050 MIRROR_RESYNC 9 mirrors 000313 1789051312.039948 write 0x02f4c0 thru 0x03d501 (0xe042 bytes) 000314 1789051312.078324 mapread 0x025107 thru 0x028fa3 (0x3e9d bytes) 000315 1789051312.098452 trunc from 0x03d502 to 0x0095e7 (0x33f1a bytes) 000316 1789051312.121343 read 0x001a2f thru 0x0095e7 (0x7bb9 bytes) 000317 1789051312.130645 trunc from 0x0095e8 to 0x010e0b (0x7824 bytes) 000318 1789051312.152950 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10e0c): Mirror 5: 0xd7f772 (stale) Mirror 8: 0xd7f772 (stale) Mirror 9: 0xd7f772 (stale) Mirror 10: 0xd7f772 (stale) Mirror 11: 0xd7f772 (stale) Mirror 12: 0xd7f772 (stale) Mirror 13: 0xd7f772 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10e0c): Mirror 5: 0xd7f772 (stale) Mirror 8: 0xd7f772 (stale) Mirror 9: 0xd7f772 (stale) Mirror 10: 0xd7f772 (stale) Mirror 11: 0xd7f772 (stale) Mirror 12: 0xd7f772 (stale) Mirror 13: 0xd7f772 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10e0c: skipped 000319 1789051312.656560 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10e0c): Mirror 8: 0xd7f772 (stale) Mirror 9: 0xd7f772 (stale) Mirror 10: 0xd7f772 (stale) Mirror 11: 0xd7f772 (stale) Mirror 12: 0xd7f772 (stale) Mirror 13: 0xd7f772 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10e0c): Mirror 8: 0xd7f772 (stale) Mirror 9: 0xd7f772 (stale) Mirror 10: 0xd7f772 (stale) Mirror 11: 0xd7f772 (stale) Mirror 12: 0xd7f772 (stale) Mirror 13: 0xd7f772 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10e0c: skipped 000320 1789051313.059494 write 0x02200a thru 0x026d9e (0x4d95 bytes) 000321 1789051313.068337 fallocate 0x0156b8 thru 0x01d482 (0x7dcb bytes) 000322 1789051313.074973 mapwrite 0x03829f thru 0x03ffff (0x7d61 bytes) 000323 1789051313.130440 fallocate 0x02ae77 thru 0x02d7d2 (0x295c bytes) 000324 1789051313.136378 read 0x001230 thru 0x00f5be (0xe38f bytes) 000325 1789051313.147088 mapwrite 0x015385 thru 0x0218f3 (0xc56f bytes) 000326 1789051313.181246 fallocate 0x03445c thru 0x03c4be (0x8063 bytes) 000327 1789051313.187129 fallocate 0x01d06a thru 0x028d3e (0xbcd5 bytes) 000328 1789051313.192615 fallocate 0x01b177 thru 0x01ce3b (0x1cc5 bytes) 000329 1789051313.197532 read 0x029da1 thru 0x03884a (0xeaaa bytes) 000330 1789051313.212682 MIRROR_RESYNC 7 mirrors 000331 1789051315.113619 punch from 0x01f4fe to 0x024caa (0x57ad bytes) 000332 1789051315.148383 mapread 0x021539 thru 0x0227a7 (0x126f bytes) 000333 1789051315.159221 read 0x004aee thru 0x00fa4c (0xaf5f bytes) 000334 1789051315.170961 mapread 0x016aaa thru 0x020eae (0xa405 bytes) 000335 1789051315.189476 write 0x02ebc1 thru 0x03dc46 (0xf086 bytes) 000336 1789051315.204500 MIRROR_RESYNC 7 mirrors 000337 1789051317.548810 MIRROR_RESYNC 7 mirrors 000338 1789051318.044986 mapread 0x019439 thru 0x01dd75 (0x493d bytes) 000339 1789051318.064718 mapread 0x0048c7 thru 0x00cce5 (0x841f bytes) 000340 1789051318.079957 MIRROR_RESYNC 7 mirrors 000341 1789051318.759033 trunc from 0x040000 to 0x00727e (0x38d81 bytes) 000342 1789051318.802294 trunc from 0x00225d to 0x00727e (0x5022 bytes) 000343 1789051318.810608 mapwrite 0x021ffc thru 0x02bd45 (0x9d4a bytes) 000345 1789051318.883338 punch from 0x01c519 to 0x0255b4 (0x909c bytes) 000346 1789051318.889496 mapwrite 0x030440 thru 0x030a36 (0x5f7 bytes) 000347 1789051318.936782 trunc from 0x02a598 to 0x030a36 (0x649f bytes) 000349 1789051318.945497 trunc from 0x030a37 to 0x00bcca (0x24d6c bytes) 000350 1789051318.965506 fallocate 0x020f65 thru 0x030eec (0xff88 bytes) 000351 1789051318.974339 read 0x02d54c thru 0x030eec (0x39a1 bytes) 000352 1789051318.992554 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30eed): Mirror 8: 0x25885feb (stale) Mirror 9: 0x25885feb (stale) Mirror 11: 0x25885feb (stale) Mirror 12: 0x25885feb (stale) Mirror 13: 0x25885feb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30eed): Mirror 8: 0x25885feb (stale) Mirror 9: 0x25885feb (stale) Mirror 11: 0x25885feb (stale) Mirror 12: 0x25885feb (stale) Mirror 13: 0x25885feb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30eed: skipped 000353 1789051319.634283 mapwrite 0x01738d thru 0x025c5c (0xe8d0 bytes) 000354 1789051319.741485 trunc from 0x019028 to 0x01ed82 (0x5d5b bytes) 000355 1789051319.748064 read 0x027a20 thru 0x030eec (0x94cd bytes) 000356 1789051319.757682 mapread 0x0136f8 thru 0x01f9e1 (0xc2ea bytes) 000357 1789051319.767502 mapwrite 0x01a867 thru 0x01e5a6 (0x3d40 bytes) 000359 1789051319.800342 trunc from 0x02ace5 to 0x0301d3 (0x54ef bytes) 000360 1789051319.809727 trunc from 0x01f8cb to 0x028ec7 (0x95fd bytes) 000361 1789051319.826140 mapread 0x01301a thru 0x02070b (0xd6f2 bytes) 000362 1789051319.883238 fallocate 0x03a69b thru 0x03ffff (0x5965 bytes) 000363 1789051319.901820 trunc from 0x028e5f to 0x030eec (0x808e bytes) 000364 1789051319.909902 punch from 0x0200f8 to 0x02b509 (0xb412 bytes) 000365 1789051319.919150 fallocate 0x029802 thru 0x0327a5 (0x8fa4 bytes) 000366 1789051319.926510 mapread 0x027c67 thru 0x02cc95 (0x502f bytes) 000367 1789051319.943397 read 0x0120d2 thru 0x0207b4 (0xe6e3 bytes) 000368 1789051319.948738 punch from 0x0210a3 to 0x02e74d (0xd6ab bytes) 000369 1789051319.961366 mapread 0x02b9ed thru 0x0327a5 (0x6db9 bytes) 000370 1789051319.984107 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x327a6): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x327a6): Mirror 8: 0x32092d49 (stale) Mirror 9: 0x32092d49 (stale) Mirror 11: 0x32092d49 (stale) Mirror 12: 0x32092d49 (stale) Mirror 13: 0x32092d49 (stale) CRC-32 checksum value for chunk [0, 0x327a6): Mirror 1: 0x5c35d2d2 Mirror 14: 0x5c35d2d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x327a6: skipped 000371 1789051321.084259 punch from 0x01f362 to 0x02f0ba (0xfd59 bytes) 000372 1789051321.136510 write 0x020f5c thru 0x02f09e (0xe143 bytes) 000373 1789051321.146777 trunc from 0x023112 to 0x026e18 (0x3d07 bytes) 000374 1789051321.161778 write 0x03a8eb thru 0x03ffff (0x5715 bytes) 000375 1789051321.162811 read 0x0373ae thru 0x03ffff (0x8c52 bytes) 000377 1789051321.166603 fallocate 0x004c10 thru 0x006a2c (0x1e1d bytes) 000379 1789051321.173831 trunc from 0x040000 to 0x010974 (0x2f68b bytes) 000380 1789051321.190454 punch from 0x00f11a to 0x010974 (0x185b bytes) 000381 1789051321.195334 mapwrite 0x039e7b thru 0x03ffff (0x6185 bytes) 000382 1789051321.251953 trunc from 0x01a9a9 to 0x023980 (0x8fd8 bytes) 000383 1789051321.257661 fallocate 0x00ed65 thru 0x01c286 (0xd522 bytes) 000384 1789051321.262843 trunc from 0x040000 to 0x03dc43 (0x23bc bytes) 000385 1789051321.276528 mapwrite 0x01a7a9 thru 0x020486 (0x5cde bytes) 000386 1789051321.301095 trunc from 0x038f83 to 0x03ba16 (0x2a94 bytes) 000387 1789051321.310079 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc44): Mirror 8: 0xe9a001e4 (stale) Mirror 11: 0xe9a001e4 (stale) Mirror 12: 0xe9a001e4 (stale) Mirror 13: 0xe9a001e4 (stale) Mirror 14: 0xcac476ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc44): Mirror 8: 0xe9a001e4 (stale) Mirror 11: 0xe9a001e4 (stale) Mirror 12: 0xe9a001e4 (stale) Mirror 13: 0xe9a001e4 (stale) Mirror 14: 0xcac476ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc44: skipped 000388 1789051321.676047 mapwrite 0x031ca2 thru 0x03c51b (0xa87a bytes) 000389 1789051321.729787 fallocate 0x022d2f thru 0x02c63b (0x990d bytes) 000390 1789051321.737952 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3dc44): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc44): Mirror 8: 0xe9a001e4 (stale) Mirror 11: 0xe9a001e4 (stale) Mirror 12: 0xe9a001e4 (stale) Mirror 13: 0xe9a001e4 (stale) Mirror 14: 0xcac476ac (stale) CRC-32 checksum value for chunk [0, 0x3dc44): Mirror 1: 0x6ff5d51e Mirror 15: 0x6ff5d51e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc44: skipped 000391 1789051322.966942 trunc from 0x019436 to 0x024e84 (0xba4f bytes) 000392 1789051323.061074 trunc from 0x00979b to 0x012f98 (0x97fe bytes) 000393 1789051323.066754 trunc from 0x017573 to 0x01b8fe (0x438c bytes) 000395 1789051323.074522 mapwrite 0x0070a5 thru 0x0160fb (0xf057 bytes) 000396 1789051323.147241 trunc from 0x03dc44 to 0x00ab62 (0x330e1 bytes) 000398 1789051323.213717 mapwrite 0x02ef94 thru 0x03c367 (0xd3d4 bytes) 000399 1789051323.315561 punch from 0x01f342 to 0x025e7f (0x6b3e bytes) 000400 1789051323.324368 write 0x00e91b thru 0x01633d (0x7a23 bytes) 000401 1789051323.336405 mapwrite 0x004879 thru 0x01276a (0xdef2 bytes) 000402 1789051323.384067 mapwrite 0x005263 thru 0x01519e (0xff3c bytes) 000403 1789051323.418190 trunc from 0x038d2c to 0x03c367 (0x363c bytes) 000404 1789051323.424932 write 0x02d891 thru 0x03d313 (0xfa83 bytes) 000405 1789051323.441540 MIRROR_RESYNC 7 mirrors 000406 1789051325.478803 trunc from 0x03d314 to 0x00dddf (0x2f534 bytes) 000407 1789051325.554915 mapwrite 0x014477 thru 0x01fe75 (0xb9ff bytes) 000408 1789051325.708639 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fe76): Mirror 11: 0xb30540c6 (stale) Mirror 12: 0xb30540c6 (stale) Mirror 13: 0xb30540c6 (stale) Mirror 14: 0xb30540c6 (stale) Mirror 15: 0xb30540c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fe76): Mirror 11: 0xb30540c6 (stale) Mirror 12: 0xb30540c6 (stale) Mirror 13: 0xb30540c6 (stale) Mirror 14: 0xb30540c6 (stale) Mirror 15: 0xb30540c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fe76: skipped 000409 1789051326.325378 punch from 0x005668 to 0x00a4bf (0x4e58 bytes) 000410 1789051326.336980 fallocate 0x03378e thru 0x0340e0 (0x953 bytes) 000411 1789051326.343009 mapread 0x01a5da thru 0x01e18b (0x3bb2 bytes) 000412 1789051326.379339 write 0x0161ff thru 0x02520a (0xf00c bytes) 000413 1789051326.388016 read 0x002a65 thru 0x009808 (0x6da4 bytes) 000414 1789051326.404328 write 0x00fefb thru 0x019d7a (0x9e80 bytes) 000415 1789051326.411804 mapread 0x01831e thru 0x0248aa (0xc58d bytes) 000416 1789051326.414165 mapread 0x013d46 thru 0x0236f4 (0xf9af bytes) 000417 1789051326.415252 mapwrite 0x00635a thru 0x00c392 (0x6039 bytes) 000418 1789051326.444815 write 0x00fb8d thru 0x0150df (0x5553 bytes) 000419 1789051326.446331 fallocate 0x029b90 thru 0x02ef84 (0x53f5 bytes) 000420 1789051326.450715 trunc from 0x00cffd to 0x019fad (0xcfb1 bytes) 000421 1789051326.464214 mapwrite 0x01e084 thru 0x021c39 (0x3bb6 bytes) 000422 1789051326.487318 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ef85): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef85): Mirror 11: 0x5b24136c (stale) Mirror 12: 0x5b24136c (stale) Mirror 13: 0x5b24136c (stale) Mirror 14: 0x5b24136c (stale) Mirror 15: 0x5b24136c (stale) CRC-32 checksum value for chunk [0, 0x2ef85): Mirror 1: 0x36e4d8aa Mirror 16: 0x36e4d8aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef85: skipped 000423 1789051327.967901 punch from 0x00f797 to 0x01a877 (0xb0e1 bytes) 000424 1789051328.021181 trunc from 0x029fa5 to 0x02ef84 (0x4fe0 bytes) 000425 1789051328.032527 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2ef85): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef85): Mirror 11: 0x5b24136c (stale) Mirror 12: 0x5b24136c (stale) Mirror 13: 0x5b24136c (stale) Mirror 14: 0x5b24136c (stale) Mirror 15: 0x5b24136c (stale) Mirror 16: 0x36e4d8aa (stale) CRC-32 checksum value for chunk [0, 0x2ef85): Mirror 1: 0xe90a404f Mirror 17: 0xe90a404f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef85: skipped 000426 1789051329.324063 mapwrite 0x00a9c4 thru 0x00ea19 (0x4056 bytes) 000428 1789051329.448412 write 0x021ee1 thru 0x02adfc (0x8f1c bytes) 000429 1789051329.467509 read 0x02c435 thru 0x02ef84 (0x2b50 bytes) 000430 1789051329.475358 trunc from 0x02ef85 to 0x0019f9 (0x2d58b bytes) 000431 1789051329.500400 mapwrite 0x036155 thru 0x03cabd (0x6969 bytes) 000432 1789051329.559110 mapwrite 0x027efc thru 0x028f24 (0x1029 bytes) 000433 1789051329.585167 MIRROR_RESYNC 8 mirrors 000434 1789051331.346729 mapwrite 0x037785 thru 0x03cc23 (0x549f bytes) 000435 1789051331.425636 write 0x01c1e8 thru 0x01e61d (0x2436 bytes) 000436 1789051331.436788 write 0x02030a thru 0x02a28d (0x9f84 bytes) 000437 1789051331.454580 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc24): Mirror 11: 0x8106ec6a (stale) Mirror 12: 0x8106ec6a (stale) Mirror 13: 0x8106ec6a (stale) Mirror 14: 0x8106ec6a (stale) Mirror 15: 0x8106ec6a (stale) Mirror 17: 0x8106ec6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc24): Mirror 11: 0x8106ec6a (stale) Mirror 12: 0x8106ec6a (stale) Mirror 13: 0x8106ec6a (stale) Mirror 14: 0x8106ec6a (stale) Mirror 15: 0x8106ec6a (stale) Mirror 17: 0x8106ec6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc24: skipped 000439 1789051332.269599 punch from 0x012ed5 to 0x01cd32 (0x9e5e bytes) 000440 1789051332.277985 mapread 0x024c2e thru 0x02fa89 (0xae5c bytes) 000441 1789051332.311739 mapwrite 0x025298 thru 0x03208e (0xcdf7 bytes) 000442 1789051332.343700 trunc from 0x03cc24 to 0x016977 (0x262ac bytes) 000443 1789051332.378098 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x16978): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16978): Mirror 11: 0x54a866a (stale) Mirror 12: 0x54a866a (stale) Mirror 13: 0x54a866a (stale) Mirror 14: 0x54a866a (stale) Mirror 15: 0x54a866a (stale) Mirror 17: 0x54a866a (stale) CRC-32 checksum value for chunk [0, 0x16978): Mirror 1: 0x54a866a Mirror 18: 0x54a866a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16978: skipped 000444 1789051333.634699 trunc from 0x002141 to 0x005410 (0x32d0 bytes) 000445 1789051333.697079 trunc from 0x005756 to 0x013121 (0xd9cc bytes) 000446 1789051333.703449 mapread 0x008437 thru 0x00c639 (0x4203 bytes) 000447 1789051333.739133 trunc from 0x00f7e6 to 0x010cb8 (0x14d3 bytes) 000449 1789051333.746451 mapread 0x01232a thru 0x0136f2 (0x13c9 bytes) 000451 1789051333.755769 write 0x00413e thru 0x009672 (0x5535 bytes) 000452 1789051333.760470 write 0x013a31 thru 0x01684e (0x2e1e bytes) 000453 1789051333.761433 write 0x007406 thru 0x015ff8 (0xebf3 bytes) 000454 1789051333.762543 punch from 0x00b637 to 0x00ef4d (0x3917 bytes) 000455 1789051333.772689 fallocate 0x0187e7 thru 0x027aed (0xf307 bytes) 000456 1789051333.776068 mapwrite 0x001bf5 thru 0x01147a (0xf886 bytes) 000457 1789051333.793939 trunc from 0x027aee to 0x0158ca (0x12223 bytes) 000458 1789051333.807206 write 0x03d217 thru 0x03ffa6 (0x2d90 bytes) 000459 1789051333.808406 trunc from 0x03ffa7 to 0x013e5a (0x2c14c bytes) 000460 1789051333.819667 trunc from 0x012f2c to 0x013e5a (0xf2f bytes) 000461 1789051333.824077 fallocate 0x004370 thru 0x009adf (0x5770 bytes) 000462 1789051333.830742 MIRROR_RESYNC 8 mirrors 000463 1789051334.622904 mapread 0x009054 thru 0x013ada (0xaa87 bytes) 000464 1789051334.640345 trunc from 0x013e5b to 0x01f941 (0xbae7 bytes) 000465 1789051334.679563 fallocate 0x02683c thru 0x02800c (0x17d1 bytes) 000466 1789051334.686224 mapwrite 0x0332a4 thru 0x034b5d (0x18ba bytes) 000468 1789051334.731768 mapwrite 0x01748d thru 0x020b9f (0x9713 bytes) 000469 1789051334.776702 write 0x0143b0 thru 0x0152a8 (0xef9 bytes) 000470 1789051334.778719 fallocate 0x003dda thru 0x0074c3 (0x36ea bytes) 000471 1789051334.789149 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x34b5e): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b5e): Mirror 11: 0x7fa9af5c (stale) Mirror 12: 0x7fa9af5c (stale) Mirror 13: 0x7fa9af5c (stale) Mirror 14: 0x7fa9af5c (stale) Mirror 15: 0x7fa9af5c (stale) Mirror 17: 0x7fa9af5c (stale) Mirror 18: 0x7fa9af5c (stale) CRC-32 checksum value for chunk [0, 0x34b5e): Mirror 1: 0x8f36e96b Mirror 19: 0x8f36e96b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b5e: skipped 000472 1789051335.927104 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x34b5e): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b5e): Mirror 11: 0x7fa9af5c (stale) Mirror 12: 0x7fa9af5c (stale) Mirror 13: 0x7fa9af5c (stale) Mirror 14: 0x7fa9af5c (stale) Mirror 15: 0x7fa9af5c (stale) Mirror 17: 0x7fa9af5c (stale) Mirror 18: 0x7fa9af5c (stale) CRC-32 checksum value for chunk [0, 0x34b5e): Mirror 1: 0x8f36e96b Mirror 19: 0x8f36e96b Mirror 20: 0x8f36e96b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b5e: skipped 000473 1789051337.204163 mapread 0x004027 thru 0x00e6da (0xa6b4 bytes) 000474 1789051337.240535 trunc from 0x011e8d to 0x015208 (0x337c bytes) 000475 1789051337.304614 read 0x02e935 thru 0x034b5d (0x6229 bytes) 000477 1789051337.324280 mapread 0x01a7bf thru 0x01c162 (0x19a4 bytes) 000478 1789051337.351663 mapwrite 0x031382 thru 0x0375d3 (0x6252 bytes) 000479 1789051337.437533 trunc from 0x0375d4 to 0x0372c6 (0x30d bytes) 000480 1789051337.463807 trunc from 0x03431e to 0x0372c6 (0x2fa9 bytes) 000481 1789051337.478528 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x372c7): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x372c7): Mirror 11: 0xd3234ccb (stale) Mirror 12: 0xd3234ccb (stale) Mirror 13: 0xd3234ccb (stale) Mirror 14: 0xd3234ccb (stale) Mirror 15: 0xd3234ccb (stale) Mirror 17: 0xd3234ccb (stale) Mirror 18: 0xd3234ccb (stale) Mirror 19: 0x1b53def4 (stale) Mirror 20: 0x1b53def4 (stale) CRC-32 checksum value for chunk [0, 0x372c7): Mirror 1: 0xa3e8bcb Mirror 21: 0xa3e8bcb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x372c7: skipped 000482 1789051338.823222 trunc from 0x01fc64 to 0x01feaa (0x247 bytes) 000483 1789051338.866434 punch from 0x013b3f to 0x015d79 (0x223b bytes) 000484 1789051338.871982 mapread 0x00a833 thru 0x012f4b (0x8719 bytes) 000485 1789051338.912301 trunc from 0x00a48b to 0x00c427 (0x1f9d bytes) 000486 1789051338.920519 read 0x02db14 thru 0x0353ac (0x7899 bytes) 000487 1789051338.934544 fallocate 0x03e646 thru 0x03ffff (0x19ba bytes) 000488 1789051338.949172 trunc from 0x00ec4b to 0x01bcd0 (0xd086 bytes) 000489 1789051338.959072 punch from 0x01a799 to 0x01f30d (0x4b75 bytes) 000492 1789051338.974560 trunc from 0x0372c7 to 0x01037e (0x26f48 bytes) 000493 1789051339.031173 mapread 0x000bd4 thru 0x00c02b (0xb458 bytes) 000494 1789051339.061558 trunc from 0x01037f to 0x00238b (0xdff3 bytes) 000495 1789051339.084171 MIRROR_RESYNC 11 mirrors 000496 1789051340.223177 write 0x0289fc thru 0x033e93 (0xb498 bytes) 000497 1789051340.273153 fallocate 0x0269b6 thru 0x033c01 (0xd24c bytes) 000498 1789051340.282236 trunc from 0x033e94 to 0x03b5bb (0x7728 bytes) 000499 1789051340.332974 fallocate 0x016145 thru 0x020a83 (0xa93f bytes) 000500 1789051340.342018 fallocate 0x00bd7c thru 0x017b73 (0xbdf8 bytes) 000501 1789051340.354546 mapwrite 0x026b34 thru 0x02b5a0 (0x4a6d bytes) 000502 1789051340.403587 MIRROR_RESYNC 11 mirrors 000503 1789051342.959987 punch from 0x01f464 to 0x028b45 (0x96e2 bytes) 000504 1789051343.059352 mapread 0x032d80 thru 0x03a266 (0x74e7 bytes) 000505 1789051343.106643 write 0x0008cc thru 0x003aa0 (0x31d5 bytes) 000506 1789051343.150326 mapwrite 0x02db14 thru 0x037d7e (0xa26b bytes) 000507 1789051343.224128 fallocate 0x018366 thru 0x01bd87 (0x3a22 bytes) 000508 1789051343.239946 trunc from 0x021995 to 0x030cfd (0xf369 bytes) 000510 1789051343.249822 fallocate 0x0162e6 thru 0x019edc (0x3bf7 bytes) 000511 1789051343.279461 MIRROR_RESYNC 11 mirrors 000512 1789051345.904200 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) 000514 1789051346.406846 MIRROR_EXTEND to 11 mirrors 000515 1789051347.183487 fallocate 0x0120e6 thru 0x01d72d (0xb648 bytes) 000516 1789051347.237780 read 0x027d13 thru 0x03149c (0x978a bytes) 000517 1789051347.249100 mapread 0x0088c6 thru 0x015283 (0xc9be bytes) 000518 1789051347.291599 punch from 0x0060f1 to 0x008cea (0x2bfa bytes) 000519 1789051347.297650 trunc from 0x01dc10 to 0x022757 (0x4b48 bytes) 000520 1789051347.304907 mapwrite 0x008a11 thru 0x011a19 (0x9009 bytes) 000521 1789051347.345489 mapwrite 0x03944c thru 0x03dca5 (0x485a bytes) 000522 1789051347.407639 punch from 0x02f934 to 0x039fdc (0xa6a9 bytes) 000523 1789051347.420085 trunc from 0x038739 to 0x03dca5 (0x556d bytes) 000526 1789051347.428147 write 0x0054e0 thru 0x00bed3 (0x69f4 bytes) 000527 1789051347.430652 punch from 0x01b91b to 0x026cd9 (0xb3bf bytes) 000528 1789051347.436528 fallocate 0x0031f0 thru 0x00561c (0x242d bytes) 000529 1789051347.442169 mapwrite 0x03ea97 thru 0x03ffff (0x1569 bytes) 000530 1789051347.488984 write 0x00950e thru 0x01765e (0xe151 bytes) 000532 1789051347.492726 read 0x0243f6 thru 0x02e0c6 (0x9cd1 bytes) 000533 1789051347.506698 fallocate 0x035fa9 thru 0x03ffff (0xa057 bytes) 000534 1789051347.512047 fallocate 0x03a91d thru 0x03ffff (0x56e3 bytes) 000535 1789051347.520607 trunc from 0x040000 to 0x01f54c (0x20ab3 bytes) 000536 1789051347.536082 trunc from 0x004f9e to 0x005ef5 (0xf58 bytes) 000537 1789051347.541823 read 0x00ad44 thru 0x016a0a (0xbcc7 bytes) 000538 1789051347.542784 trunc from 0x01f54d to 0x013533 (0xc019 bytes) 000539 1789051347.562146 trunc from 0x003d75 to 0x00435d (0x5e9 bytes) 000540 1789051347.568466 mapwrite 0x02ae33 thru 0x03a071 (0xf23f bytes) 000541 1789051347.618907 trunc from 0x03a072 to 0x023317 (0x16d5a bytes) 000542 1789051347.640120 trunc from 0x023318 to 0x00c9a8 (0x1696f bytes) 000544 1789051347.655011 read 0x000fe4 thru 0x00c9a8 (0xb9c5 bytes) 000545 1789051347.656135 fallocate 0x025230 thru 0x033a30 (0xe801 bytes) 000546 1789051347.662300 fallocate 0x0360db thru 0x03739e (0x12c4 bytes) 000547 1789051347.667335 mapread 0x014938 thru 0x01a51e (0x5be7 bytes) 000548 1789051347.677699 fallocate 0x004d8c thru 0x006d31 (0x1fa6 bytes) 000549 1789051347.686139 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x33a31): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33a31): Mirror 11: 0x8e69294 (stale) Mirror 12: 0x8e69294 (stale) Mirror 13: 0x8e69294 (stale) Mirror 14: 0x8e69294 (stale) Mirror 15: 0x8e69294 (stale) Mirror 17: 0x8e69294 (stale) Mirror 18: 0x8e69294 (stale) Mirror 19: 0x8e69294 (stale) Mirror 21: 0x8e69294 (stale) Mirror 22: 0x8e69294 (stale) CRC-32 checksum value for chunk [0, 0x33a31): Mirror 1: 0xe691602c Mirror 23: 0xe691602c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33a31: skipped 000550 1789051349.186321 mapwrite 0x01eec4 thru 0x0281a4 (0x92e1 bytes) 000551 1789051349.444906 punch from 0x0212fb to 0x030e98 (0xfb9e bytes) 000552 1789051349.454285 trunc from 0x029a3a to 0x02a6ab (0xc72 bytes) 000553 1789051349.460618 mapwrite 0x0244ba thru 0x0324f0 (0xe037 bytes) 000554 1789051349.520919 trunc from 0x009d4e to 0x0180e8 (0xe39b bytes) 000555 1789051349.534237 write 0x02b577 thru 0x035670 (0xa0fa bytes) 000556 1789051349.555596 punch from 0x02cc25 to 0x035670 (0x8a4c bytes) 000557 1789051349.597624 read 0x00589c thru 0x007b9d (0x2302 bytes) 000558 1789051349.604737 mapread 0x0159a9 thru 0x017444 (0x1a9c bytes) 000559 1789051349.642920 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x35671): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35671): Mirror 11: 0x28b82c68 (stale) Mirror 12: 0x28b82c68 (stale) Mirror 13: 0x28b82c68 (stale) Mirror 14: 0x28b82c68 (stale) Mirror 15: 0x28b82c68 (stale) Mirror 17: 0x28b82c68 (stale) Mirror 18: 0x28b82c68 (stale) Mirror 19: 0x28b82c68 (stale) Mirror 21: 0x28b82c68 (stale) Mirror 22: 0x28b82c68 (stale) Mirror 23: 0xf2618938 (stale) CRC-32 checksum value for chunk [0, 0x35671): Mirror 1: 0xb99b0e1f Mirror 24: 0xb99b0e1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35671: skipped 000560 1789051351.364678 trunc from 0x02a39d to 0x035670 (0xb2d4 bytes) 000561 1789051351.426633 trunc from 0x035671 to 0x03ac1d (0x55ad bytes) 000562 1789051351.454016 read 0x029298 thru 0x032975 (0x96de bytes) 000563 1789051351.468413 fallocate 0x002187 thru 0x010c7f (0xeaf9 bytes) 000564 1789051351.477252 mapread 0x0389ee thru 0x03ac1d (0x2230 bytes) 000566 1789051351.504263 fallocate 0x025786 thru 0x02e9dd (0x9258 bytes) 000567 1789051351.514420 trunc from 0x03ac1e to 0x0097b4 (0x31469 bytes) 000568 1789051351.558181 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x97b5): Mirror 11: 0x493e18db (stale) Mirror 13: 0x493e18db (stale) Mirror 14: 0x493e18db (stale) Mirror 15: 0x493e18db (stale) Mirror 17: 0x493e18db (stale) Mirror 18: 0x493e18db (stale) Mirror 19: 0x493e18db (stale) Mirror 21: 0x493e18db (stale) Mirror 22: 0x493e18db (stale) Mirror 23: 0xc92173b4 (stale) Mirror 24: 0xc92173b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x97b5): Mirror 11: 0x493e18db (stale) Mirror 13: 0x493e18db (stale) Mirror 14: 0x493e18db (stale) Mirror 15: 0x493e18db (stale) Mirror 17: 0x493e18db (stale) Mirror 18: 0x493e18db (stale) Mirror 19: 0x493e18db (stale) Mirror 21: 0x493e18db (stale) Mirror 22: 0x493e18db (stale) Mirror 23: 0xc92173b4 (stale) Mirror 24: 0xc92173b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x97b5: skipped 000569 1789051352.390329 MIRROR_RESYNC 12 mirrors 000570 1789051354.422654 read 0x003c1f thru 0x0097b4 (0x5b96 bytes) 000571 1789051354.431468 mapread 0x00706a thru 0x0097b4 (0x274b bytes) 000572 1789051354.433124 write 0x015131 thru 0x01aa31 (0x5901 bytes) 000573 1789051354.469360 punch from 0x005053 to 0x005437 (0x3e5 bytes) 000574 1789051354.475268 trunc from 0x01aa32 to 0x01de2e (0x33fd bytes) 000575 1789051354.501219 punch from 0x019674 to 0x01de2e (0x47bb bytes) 000576 1789051354.516377 trunc from 0x01de2f to 0x029a9c (0xbc6e bytes) 000577 1789051354.534017 read 0x010de4 thru 0x016f3c (0x6159 bytes) 000578 1789051354.551448 trunc from 0x029a9d to 0x00ffad (0x19aef bytes) 000580 1789051354.573591 trunc from 0x00ce3c to 0x00ffad (0x3172 bytes) 000581 1789051354.580209 mapread 0x006d17 thru 0x00ffad (0x9297 bytes) 000582 1789051354.601942 fallocate 0x03becf thru 0x03ffff (0x4131 bytes) 000583 1789051354.610976 MIRROR_RESYNC 12 mirrors 000584 1789051356.779092 trunc from 0x00ffae to 0x01ce77 (0xceca bytes) 000585 1789051356.824144 fallocate 0x02950b thru 0x02d053 (0x3b49 bytes) 000586 1789051356.829812 trunc from 0x00da94 to 0x013807 (0x5d74 bytes) 000587 1789051356.836043 read 0x002c4d thru 0x004082 (0x1436 bytes) 000588 1789051356.842753 mapwrite 0x024e33 thru 0x027d48 (0x2f16 bytes) 000589 1789051356.908980 mapwrite 0x00f0ee thru 0x01e798 (0xf6ab bytes) 000590 1789051356.956362 trunc from 0x027d49 to 0x02fd52 (0x800a bytes) 000591 1789051356.974612 trunc from 0x02fd53 to 0x00e0dc (0x21c76 bytes) 000592 1789051357.009329 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe0dd): Mirror 11: 0x6d37388d (stale) Mirror 13: 0x6d37388d (stale) Mirror 14: 0x6d37388d (stale) Mirror 15: 0x6d37388d (stale) Mirror 17: 0x6d37388d (stale) Mirror 18: 0x6d37388d (stale) Mirror 19: 0x6d37388d (stale) Mirror 22: 0x6d37388d (stale) Mirror 23: 0x6d37388d (stale) Mirror 24: 0x6d37388d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe0dd): Mirror 11: 0x6d37388d (stale) Mirror 13: 0x6d37388d (stale) Mirror 14: 0x6d37388d (stale) Mirror 15: 0x6d37388d (stale) Mirror 17: 0x6d37388d (stale) Mirror 18: 0x6d37388d (stale) Mirror 19: 0x6d37388d (stale) Mirror 22: 0x6d37388d (stale) Mirror 23: 0x6d37388d (stale) Mirror 24: 0x6d37388d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe0dd: skipped 000593 1789051357.730938 fallocate 0x03b868 thru 0x03ffff (0x4798 bytes) 000594 1789051357.739126 read 0x037f00 thru 0x03ffff (0x8100 bytes) 000595 1789051357.749397 fallocate 0x01ad73 thru 0x020239 (0x54c7 bytes) 000596 1789051357.758705 fallocate 0x019de2 thru 0x01f01a (0x5239 bytes) 000597 1789051357.773033 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xc0fbfe3f (stale) Mirror 13: 0xc0fbfe3f (stale) Mirror 14: 0xc0fbfe3f (stale) Mirror 17: 0xc0fbfe3f (stale) Mirror 18: 0xc0fbfe3f (stale) Mirror 19: 0xc0fbfe3f (stale) Mirror 22: 0xc0fbfe3f (stale) Mirror 23: 0xc0fbfe3f (stale) Mirror 24: 0xc0fbfe3f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xc0fbfe3f (stale) Mirror 13: 0xc0fbfe3f (stale) Mirror 14: 0xc0fbfe3f (stale) Mirror 17: 0xc0fbfe3f (stale) Mirror 18: 0xc0fbfe3f (stale) Mirror 19: 0xc0fbfe3f (stale) Mirror 22: 0xc0fbfe3f (stale) Mirror 23: 0xc0fbfe3f (stale) Mirror 24: 0xc0fbfe3f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000598 1789051358.292564 trunc from 0x00cc54 to 0x00ea3e (0x1deb bytes) 000599 1789051358.298240 punch from 0x01693c to 0x023306 (0xc9cb bytes) 000600 1789051358.304072 write 0x00f319 thru 0x0109cc (0x16b4 bytes) 000601 1789051358.330597 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xc0fbfe3f (stale) Mirror 13: 0xc0fbfe3f (stale) Mirror 14: 0xc0fbfe3f (stale) Mirror 17: 0xc0fbfe3f (stale) Mirror 18: 0xc0fbfe3f (stale) Mirror 19: 0xc0fbfe3f (stale) Mirror 22: 0xc0fbfe3f (stale) Mirror 23: 0xc0fbfe3f (stale) Mirror 24: 0xc0fbfe3f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa3f54d19 Mirror 25: 0xa3f54d19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000602 1789051359.608082 punch from 0x003818 to 0x0137d7 (0xffc0 bytes) 000603 1789051359.671276 fallocate 0x03cdef thru 0x03ffff (0x3211 bytes) 000604 1789051359.677107 fallocate 0x029d92 thru 0x0316b3 (0x7922 bytes) 000605 1789051359.684164 trunc from 0x040000 to 0x00ade2 (0x3521d bytes) 000606 1789051359.728310 trunc from 0x00ade3 to 0x010864 (0x5a82 bytes) 000608 1789051359.764423 trunc from 0x00c68f to 0x0102d4 (0x3c46 bytes) 000609 1789051359.778490 mapwrite 0x00376b thru 0x0103b3 (0xcc49 bytes) 000610 1789051359.904580 punch from 0x001201 to 0x00253d (0x133d bytes) 000612 1789051359.932116 mapread 0x0030ae thru 0x010864 (0xd7b7 bytes) 000613 1789051359.945969 write 0x029ecd thru 0x034763 (0xa897 bytes) 000614 1789051359.959400 trunc from 0x0000c3 to 0x007184 (0x70c2 bytes) 000615 1789051359.982335 mapwrite 0x00d2fa thru 0x0163ad (0x90b4 bytes) 000617 1789051360.055493 read 0x00faec thru 0x01ca41 (0xcf56 bytes) 000618 1789051360.074219 trunc from 0x034764 to 0x000612 (0x34151 bytes) 000619 1789051360.093597 fallocate 0x02afe7 thru 0x033e34 (0x8e4e bytes) 000620 1789051360.107600 mapwrite 0x03dbfb thru 0x03ffff (0x2405 bytes) 000621 1789051360.239302 fallocate 0x01285c thru 0x01a0ef (0x7894 bytes) 000622 1789051360.261336 trunc from 0x040000 to 0x0041da (0x3be25 bytes) 000624 1789051360.305999 punch from 0x00083e to 0x0041da (0x399d bytes) 000625 1789051360.319654 write 0x03f60c thru 0x03ffff (0x9f4 bytes) 000626 1789051360.325224 punch from 0x03dcd9 to 0x03ffff (0x2327 bytes) 000627 1789051360.362567 trunc from 0x0008ef to 0x0043df (0x3af1 bytes) 000628 1789051360.385061 write 0x0120d0 thru 0x01f190 (0xd0c1 bytes) 000629 1789051360.411420 mapread 0x009a65 thru 0x016c52 (0xd1ee bytes) 000630 1789051360.425916 read 0x02025f thru 0x02367c (0x341e bytes) 000631 1789051360.496582 trunc from 0x040000 to 0x002ce4 (0x3d31b bytes) 000632 1789051360.522372 mapwrite 0x00e6ef thru 0x015ec8 (0x77da bytes) 000633 1789051360.611008 trunc from 0x00bb1f to 0x014bca (0x90ac bytes) 000634 1789051360.619348 trunc from 0x002076 to 0x010ba5 (0xeb30 bytes) 000635 1789051360.629049 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x15ec9): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15ec9): Mirror 11: 0x8a20bae (stale) Mirror 13: 0x8a20bae (stale) Mirror 14: 0x8a20bae (stale) Mirror 17: 0x8a20bae (stale) Mirror 18: 0x8a20bae (stale) Mirror 19: 0x8a20bae (stale) Mirror 22: 0x8a20bae (stale) Mirror 23: 0x8a20bae (stale) Mirror 24: 0x8a20bae (stale) Mirror 25: 0x5f961d4e (stale) CRC-32 checksum value for chunk [0, 0x15ec9): Mirror 1: 0x67658c11 Mirror 26: 0x67658c11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15ec9: skipped 000636 1789051361.553346 trunc from 0x015ec9 to 0x02e5dd (0x18715 bytes) 000637 1789051361.614139 mapread 0x01ed2d thru 0x02581d (0x6af1 bytes) 000638 1789051361.633109 mapwrite 0x00ffce thru 0x0190ce (0x9101 bytes) 000639 1789051361.671360 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e5de): Mirror 11: 0xa12f064f (stale) Mirror 13: 0xa12f064f (stale) Mirror 14: 0xa12f064f (stale) Mirror 17: 0xa12f064f (stale) Mirror 18: 0xa12f064f (stale) Mirror 22: 0xa12f064f (stale) Mirror 23: 0xa12f064f (stale) Mirror 24: 0xa12f064f (stale) Mirror 25: 0xb55e395a (stale) Mirror 26: 0x4cad0bf5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e5de): Mirror 11: 0xa12f064f (stale) Mirror 13: 0xa12f064f (stale) Mirror 14: 0xa12f064f (stale) Mirror 17: 0xa12f064f (stale) Mirror 18: 0xa12f064f (stale) Mirror 22: 0xa12f064f (stale) Mirror 23: 0xa12f064f (stale) Mirror 24: 0xa12f064f (stale) Mirror 25: 0xb55e395a (stale) Mirror 26: 0x4cad0bf5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e5de: skipped 000640 1789051362.416404 read 0x0144a9 thru 0x02280f (0xe367 bytes) 000641 1789051362.428169 trunc from 0x02e5de to 0x000da9 (0x2d834 bytes) 000642 1789051362.452820 mapwrite 0x022126 thru 0x023c2e (0x1b09 bytes) 000643 1789051362.539086 trunc from 0x0198b2 to 0x022e75 (0x95c4 bytes) 000644 1789051362.545532 punch from 0x01a9a0 to 0x023c2e (0x928f bytes) 000645 1789051362.553839 mapread 0x016942 thru 0x01c012 (0x56d1 bytes) 000646 1789051362.580741 fallocate 0x0071a5 thru 0x00c9c5 (0x5821 bytes) 000647 1789051362.597294 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23c2f): Mirror 11: 0x9d09759c (stale) Mirror 13: 0x9d09759c (stale) Mirror 14: 0x9d09759c (stale) Mirror 17: 0x9d09759c (stale) Mirror 22: 0x9d09759c (stale) Mirror 23: 0x9d09759c (stale) Mirror 24: 0x9d09759c (stale) Mirror 25: 0x80c20286 (stale) Mirror 26: 0x77e688aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23c2f): Mirror 11: 0x9d09759c (stale) Mirror 13: 0x9d09759c (stale) Mirror 14: 0x9d09759c (stale) Mirror 17: 0x9d09759c (stale) Mirror 22: 0x9d09759c (stale) Mirror 23: 0x9d09759c (stale) Mirror 24: 0x9d09759c (stale) Mirror 25: 0x80c20286 (stale) Mirror 26: 0x77e688aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23c2f: skipped 000649 1789051363.404697 write 0x015bd8 thru 0x022866 (0xcc8f bytes) 000650 1789051363.420964 read 0x0098ee thru 0x016c33 (0xd346 bytes) 000651 1789051363.431183 trunc from 0x023c2f to 0x02b7ab (0x7b7d bytes) 000653 1789051363.446498 read 0x025741 thru 0x027345 (0x1c05 bytes) 000654 1789051363.455566 punch from 0x00a251 to 0x00e026 (0x3dd6 bytes) 000655 1789051363.460069 trunc from 0x02b7ac to 0x00b790 (0x2001b bytes) 000656 1789051363.477630 punch from 0x002e47 to 0x00628a (0x3444 bytes) 000657 1789051363.483031 trunc from 0x00ad50 to 0x00b790 (0xa41 bytes) 000658 1789051363.487814 trunc from 0x00b791 to 0x02dcf2 (0x22562 bytes) 000659 1789051363.512380 MIRROR_RESYNC 10 mirrors 000660 1789051365.281430 write 0x01b0a6 thru 0x026537 (0xb492 bytes) 000661 1789051365.340909 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dcf3): Mirror 11: 0xc5d9f24d (stale) Mirror 13: 0xc5d9f24d (stale) Mirror 14: 0xc5d9f24d (stale) Mirror 17: 0xc5d9f24d (stale) Mirror 22: 0xc5d9f24d (stale) Mirror 23: 0xc5d9f24d (stale) Mirror 24: 0xc5d9f24d (stale) Mirror 26: 0xc5d9f24d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dcf3): Mirror 11: 0xc5d9f24d (stale) Mirror 13: 0xc5d9f24d (stale) Mirror 14: 0xc5d9f24d (stale) Mirror 17: 0xc5d9f24d (stale) Mirror 22: 0xc5d9f24d (stale) Mirror 23: 0xc5d9f24d (stale) Mirror 24: 0xc5d9f24d (stale) Mirror 26: 0xc5d9f24d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dcf3: skipped 000662 1789051365.979077 fallocate 0x03158a thru 0x03ffff (0xea76 bytes) 000663 1789051365.992884 fallocate 0x03148c thru 0x037881 (0x63f6 bytes) 000664 1789051366.002519 write 0x026144 thru 0x02af29 (0x4de6 bytes) 000665 1789051366.026973 trunc from 0x02dcf3 to 0x0179ad (0x16345 bytes) 000666 1789051366.044061 read 0x000ac0 thru 0x0078d4 (0x6e15 bytes) 000667 1789051366.068115 mapread 0x0176c8 thru 0x0179ad (0x2e6 bytes) 000668 1789051366.076555 punch from 0x0174a6 to 0x0179ad (0x508 bytes) 000669 1789051366.083359 fallocate 0x00d642 thru 0x011858 (0x4217 bytes) 000670 1789051366.094994 write 0x00a018 thru 0x012b2f (0x8b18 bytes) 000671 1789051366.106680 mapwrite 0x010daf thru 0x0140b1 (0x3303 bytes) 000672 1789051366.136297 trunc from 0x0179ae to 0x01d58c (0x5bdf bytes) 000673 1789051366.157628 mapread 0x01364b thru 0x01d58c (0x9f42 bytes) 000674 1789051366.180713 MIRROR_RESYNC 9 mirrors 000676 1789051368.450669 trunc from 0x01b798 to 0x01d58c (0x1df5 bytes) 000678 1789051368.532285 read 0x00310c thru 0x00ed87 (0xbc7c bytes) 000679 1789051368.540944 punch from 0x00fc2b to 0x01d58c (0xd962 bytes) 000680 1789051368.549810 write 0x030c95 thru 0x03d81a (0xcb86 bytes) 000681 1789051368.551583 read 0x02c8b3 thru 0x033147 (0x6895 bytes) 000682 1789051368.586116 trunc from 0x039d4e to 0x03a017 (0x2ca bytes) 000683 1789051368.603340 read 0x008356 thru 0x00897a (0x625 bytes) 000684 1789051368.605138 write 0x03715f thru 0x03bfc2 (0x4e64 bytes) 000685 1789051368.606991 punch from 0x02be7f to 0x033bf9 (0x7d7b bytes) 000686 1789051368.625223 trunc from 0x03d81b to 0x01b01b (0x227ff bytes) 000687 1789051368.680178 write 0x0013ed thru 0x004352 (0x2f66 bytes) 000688 1789051368.706096 MIRROR_RESYNC 9 mirrors 000689 1789051371.580691 MIRROR_RESYNC 9 mirrors 000690 1789051372.140217 write 0x00a8b6 thru 0x010373 (0x5abe bytes) 000691 1789051372.194613 punch from 0x00a2a5 to 0x010282 (0x5fde bytes) 000692 1789051372.221854 punch from 0x0174d4 to 0x01b01b (0x3b48 bytes) 000693 1789051372.231117 trunc from 0x003936 to 0x00fe33 (0xc4fe bytes) 000694 1789051372.239094 mapread 0x01ac5a thru 0x01b01b (0x3c2 bytes) 000695 1789051372.255972 punch from 0x01a88c to 0x01b01b (0x790 bytes) 000696 1789051372.261608 fallocate 0x00975d thru 0x010590 (0x6e34 bytes) 000697 1789051372.283788 MIRROR_RESYNC 9 mirrors 000698 1789051374.425797 punch from 0x010c97 to 0x014d2c (0x4096 bytes) 000699 1789051374.479508 write 0x00ec41 thru 0x01e29a (0xf65a bytes) 000700 1789051374.491634 read 0x006189 thru 0x00e86f (0x86e7 bytes) 000701 1789051374.512595 read 0x00a532 thru 0x018c99 (0xe768 bytes) 000702 1789051374.513758 mapwrite 0x039b48 thru 0x03fce1 (0x619a bytes) 000703 1789051374.631042 mapwrite 0x013a4f thru 0x01f56c (0xbb1e bytes) 000704 1789051374.668470 write 0x03dfde thru 0x03ffff (0x2022 bytes) 000705 1789051374.677407 read 0x008214 thru 0x012ce9 (0xaad6 bytes) 000706 1789051374.680276 trunc from 0x0039e2 to 0x011da5 (0xe3c4 bytes) 000707 1789051374.695250 write 0x006054 thru 0x013797 (0xd744 bytes) 000708 1789051374.712837 mapwrite 0x00682e thru 0x01030d (0x9ae0 bytes) 000709 1789051374.747034 punch from 0x034a01 to 0x0361b5 (0x17b5 bytes) 000710 1789051374.753822 write 0x00b00d thru 0x0115d1 (0x65c5 bytes) 000711 1789051374.755961 trunc from 0x0322e7 to 0x0386c6 (0x63e0 bytes) 000712 1789051374.765012 mapwrite 0x0315ce thru 0x03520e (0x3c41 bytes) 000713 1789051374.818299 mapread 0x0086d7 thru 0x00b278 (0x2ba2 bytes) 000714 1789051374.820692 read 0x0258c5 thru 0x027a15 (0x2151 bytes) 000715 1789051374.822937 trunc from 0x040000 to 0x02ce37 (0x131c8 bytes) 000716 1789051374.842946 punch from 0x005a97 to 0x00bf09 (0x6473 bytes) 000717 1789051374.852578 fallocate 0x00f8c7 thru 0x01dd1a (0xe454 bytes) 000718 1789051374.859785 trunc from 0x004333 to 0x0092ab (0x4f79 bytes) 000719 1789051374.869102 fallocate 0x0345f8 thru 0x03b32b (0x6d34 bytes) 000720 1789051374.877243 read 0x0143b9 thru 0x016d7b (0x29c3 bytes) 000721 1789051374.878102 write 0x0331bb thru 0x03bbc0 (0x8a06 bytes) 000722 1789051374.896050 trunc from 0x00311d to 0x00b173 (0x8057 bytes) 000724 1789051374.907313 punch from 0x02e92b to 0x0365bb (0x7c91 bytes) 000725 1789051374.929304 trunc from 0x015ef9 to 0x022a37 (0xcb3f bytes) 000726 1789051374.937972 mapread 0x008049 thru 0x00a939 (0x28f1 bytes) 000727 1789051374.957036 punch from 0x0189cf to 0x018e75 (0x4a7 bytes) 000728 1789051374.969398 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bbc1): Mirror 11: 0x6a058741 (stale) Mirror 13: 0x6a058741 (stale) Mirror 14: 0x6a058741 (stale) Mirror 17: 0x6a058741 (stale) Mirror 22: 0x6a058741 (stale) Mirror 23: 0x6a058741 (stale) Mirror 26: 0x6a058741 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bbc1): Mirror 11: 0x6a058741 (stale) Mirror 13: 0x6a058741 (stale) Mirror 14: 0x6a058741 (stale) Mirror 17: 0x6a058741 (stale) Mirror 22: 0x6a058741 (stale) Mirror 23: 0x6a058741 (stale) Mirror 26: 0x6a058741 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bbc1: skipped 000729 1789051375.664940 mapwrite 0x03c648 thru 0x03fddb (0x3794 bytes) 000730 1789051375.735999 fallocate 0x023c20 thru 0x032ef6 (0xf2d7 bytes) 000732 1789051375.751943 trunc from 0x00ccca to 0x00f632 (0x2969 bytes) 000733 1789051375.765566 trunc from 0x007b9e to 0x007ef9 (0x35c bytes) 000734 1789051375.782997 mapwrite 0x01fd48 thru 0x02e16b (0xe424 bytes) 000735 1789051375.901377 punch from 0x00d6f4 to 0x015565 (0x7e72 bytes) 000736 1789051375.907385 fallocate 0x03e9be thru 0x03ffff (0x1642 bytes) 000737 1789051375.934284 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xdd411e5a (stale) Mirror 13: 0xdd411e5a (stale) Mirror 14: 0xdd411e5a (stale) Mirror 22: 0xdd411e5a (stale) Mirror 23: 0xdd411e5a (stale) Mirror 26: 0xdd411e5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xdd411e5a (stale) Mirror 13: 0xdd411e5a (stale) Mirror 14: 0xdd411e5a (stale) Mirror 22: 0xdd411e5a (stale) Mirror 23: 0xdd411e5a (stale) Mirror 26: 0xdd411e5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000740 1789051376.606015 mapread 0x006a05 thru 0x015842 (0xee3e bytes) 000741 1789051376.665605 punch from 0x007725 to 0x012b61 (0xb43d bytes) 000742 1789051376.681369 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xdd411e5a (stale) Mirror 13: 0xdd411e5a (stale) Mirror 14: 0xdd411e5a (stale) Mirror 22: 0xdd411e5a (stale) Mirror 23: 0xdd411e5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xdd411e5a (stale) Mirror 13: 0xdd411e5a (stale) Mirror 14: 0xdd411e5a (stale) Mirror 22: 0xdd411e5a (stale) Mirror 23: 0xdd411e5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000743 1789051377.430259 punch from 0x016779 to 0x024f2f (0xe7b7 bytes) 000744 1789051377.456997 MIRROR_RESYNC 6 mirrors 000745 1789051379.822622 punch from 0x00f7a3 to 0x012767 (0x2fc5 bytes) 000746 1789051379.889585 write 0x025cb1 thru 0x02a06d (0x43bd bytes) 000747 1789051379.921080 trunc from 0x040000 to 0x03e978 (0x1687 bytes) 000748 1789051379.986122 write 0x037788 thru 0x03eb1e (0x7397 bytes) 000749 1789051380.029769 trunc from 0x026228 to 0x031301 (0xb0da bytes) 000751 1789051380.060924 write 0x00115f thru 0x0035bd (0x245f bytes) 000752 1789051380.073626 read 0x002c6a thru 0x006373 (0x370a bytes) 000753 1789051380.084067 mapread 0x01d4d6 thru 0x024cbf (0x77ea bytes) 000754 1789051380.135846 fallocate 0x02b05b thru 0x02df6d (0x2f13 bytes) 000755 1789051380.159228 mapread 0x016255 thru 0x01ad47 (0x4af3 bytes) 000756 1789051380.179814 write 0x029235 thru 0x032a42 (0x980e bytes) 000757 1789051380.222731 fallocate 0x036ccd thru 0x03ffff (0x9333 bytes) 000758 1789051380.253419 punch from 0x007fe4 to 0x017fdf (0xfffc bytes) 000760 1789051380.265332 punch from 0x015791 to 0x01a8f7 (0x5167 bytes) 000761 1789051380.282213 read 0x011053 thru 0x01738a (0x6338 bytes) 000762 1789051380.296941 trunc from 0x03a699 to 0x03b3bd (0xd25 bytes) 000763 1789051380.313308 fallocate 0x002e10 thru 0x00312b (0x31c bytes) 000764 1789051380.319249 trunc from 0x040000 to 0x02f03f (0x10fc0 bytes) 000766 1789051380.365390 read 0x02b596 thru 0x02f03f (0x3aaa bytes) 000767 1789051380.366774 trunc from 0x027bf1 to 0x02f03f (0x744f bytes) 000768 1789051380.412995 fallocate 0x00380d thru 0x00db8c (0xa380 bytes) 000770 1789051380.432913 punch from 0x01ba04 to 0x01c0fa (0x6f7 bytes) 000771 1789051380.440814 fallocate 0x006490 thru 0x0150a8 (0xec19 bytes) 000772 1789051380.448777 mapread 0x01a669 thru 0x0220b2 (0x7a4a bytes) 000773 1789051380.468793 read 0x01ffa2 thru 0x02f03f (0xf09e bytes) 000774 1789051380.472791 mapwrite 0x03189a thru 0x03e646 (0xcdad bytes) 000775 1789051380.605518 read 0x037472 thru 0x03cca2 (0x5831 bytes) 000776 1789051380.607369 trunc from 0x017ce5 to 0x025aff (0xde1b bytes) 000778 1789051380.638902 mapread 0x0168b1 thru 0x01e934 (0x8084 bytes) 000779 1789051380.674849 write 0x019294 thru 0x0278a9 (0xe616 bytes) 000780 1789051380.678531 write 0x01f560 thru 0x023d31 (0x47d2 bytes) 000781 1789051380.680015 trunc from 0x03e647 to 0x02465d (0x19fe9 bytes) 000782 1789051380.709117 write 0x038404 thru 0x03ffff (0x7bfc bytes) 000783 1789051380.711329 mapwrite 0x03a445 thru 0x03a6ea (0x2a6 bytes) 000784 1789051380.738656 punch from 0x02b0f6 to 0x02cd57 (0x1c62 bytes) 000785 1789051380.747055 trunc from 0x040000 to 0x025eb5 (0x1a14a bytes) 000786 1789051380.772032 fallocate 0x018a91 thru 0x027148 (0xe6b8 bytes) 000787 1789051380.781963 fallocate 0x01c6b6 thru 0x01f316 (0x2c61 bytes) 000788 1789051380.797362 trunc from 0x027149 to 0x007997 (0x1f7b1 bytes) 000789 1789051380.835314 mapread 0x0007c3 thru 0x00347f (0x2cbd bytes) 000790 1789051380.840448 mapwrite 0x021853 thru 0x02458d (0x2d3b bytes) 000792 1789051380.999818 mapread 0x01f91a thru 0x02458d (0x4c74 bytes) 000793 1789051381.023318 read 0x01f79c thru 0x02458d (0x4df2 bytes) 000794 1789051381.024962 punch from 0x00d560 to 0x019008 (0xbaa9 bytes) 000795 1789051381.042849 fallocate 0x0136d2 thru 0x01f2b1 (0xbbe0 bytes) 000796 1789051381.070806 fallocate 0x03345a thru 0x03c63c (0x91e3 bytes) 000798 1789051381.090525 punch from 0x01c316 to 0x02458d (0x8278 bytes) 000799 1789051381.103284 write 0x02be55 thru 0x03454e (0x86fa bytes) 000801 1789051381.109155 write 0x009135 thru 0x00dfce (0x4e9a bytes) 000802 1789051381.151797 write 0x03c5c8 thru 0x03ffff (0x3a38 bytes) 000803 1789051381.162233 mapread 0x024e87 thru 0x03086d (0xb9e7 bytes) 000804 1789051381.170231 write 0x00d3a1 thru 0x00d3f9 (0x59 bytes) 000805 1789051381.172936 fallocate 0x02155e thru 0x02b045 (0x9ae8 bytes) 000806 1789051381.188846 trunc from 0x040000 to 0x02115d (0x1eea2 bytes) 000807 1789051381.239803 punch from 0x017cf4 to 0x02115d (0x946a bytes) 000808 1789051381.268279 trunc from 0x02115e to 0x02b73a (0xa5dd bytes) 000809 1789051381.297900 read 0x00d5f0 thru 0x019fd4 (0xc9e5 bytes) 000810 1789051381.320419 write 0x023b33 thru 0x02b54b (0x7a19 bytes) 000811 1789051381.323260 mapread 0x02939f thru 0x02b73a (0x239c bytes) 000812 1789051381.326629 fallocate 0x03f8ab thru 0x03ffff (0x755 bytes) 000813 1789051381.332929 punch from 0x01476b to 0x0161b0 (0x1a46 bytes) 000814 1789051381.339152 punch from 0x02b094 to 0x033675 (0x85e2 bytes) 000815 1789051381.354838 mapwrite 0x017fc2 thru 0x01b9de (0x3a1d bytes) 000816 1789051381.372077 write 0x015d6a thru 0x01c478 (0x670f bytes) 000817 1789051381.384952 fallocate 0x024cbd thru 0x0301f2 (0xb536 bytes) 000818 1789051381.390168 punch from 0x035162 to 0x035dda (0xc79 bytes) 000819 1789051381.396854 read 0x03f84d thru 0x03ffff (0x7b3 bytes) 000820 1789051381.398154 trunc from 0x040000 to 0x0139b6 (0x2c649 bytes) 000821 1789051381.420378 read 0x00c425 thru 0x00f537 (0x3113 bytes) 000823 1789051381.422201 trunc from 0x010466 to 0x012574 (0x210f bytes) 000824 1789051381.434851 write 0x01d956 thru 0x02a03d (0xc6e8 bytes) 000825 1789051381.439507 fallocate 0x01e5cf thru 0x02383c (0x526e bytes) 000826 1789051381.446308 mapwrite 0x010fd1 thru 0x01e92e (0xd95e bytes) 000827 1789051381.488789 trunc from 0x01003d to 0x01d250 (0xd214 bytes) 000828 1789051381.500289 write 0x01dcca thru 0x02711b (0x9452 bytes) 000829 1789051381.511027 trunc from 0x02a03e to 0x020906 (0x9737 bytes) 000830 1789051381.551161 mapwrite 0x028712 thru 0x02c64e (0x3f3d bytes) 000831 1789051381.608837 trunc from 0x00a7f3 to 0x01a2c2 (0xfad0 bytes) 000832 1789051381.615443 fallocate 0x00a74a thru 0x018560 (0xde17 bytes) 000833 1789051381.620327 mapwrite 0x013187 thru 0x017a31 (0x48ab bytes) 000834 1789051381.677720 read 0x0072dd thru 0x00ac1b (0x393f bytes) 000835 1789051381.692827 fallocate 0x004909 thru 0x0085e4 (0x3cdc bytes) 000836 1789051381.703976 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c64f): Mirror 11: 0xf98bad34 (stale) Mirror 13: 0xf98bad34 (stale) Mirror 22: 0xf98bad34 (stale) Mirror 23: 0xf98bad34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c64f): Mirror 11: 0xf98bad34 (stale) Mirror 13: 0xf98bad34 (stale) Mirror 22: 0xf98bad34 (stale) Mirror 23: 0xf98bad34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c64f: skipped 000837 1789051382.113050 read 0x00f143 thru 0x012f62 (0x3e20 bytes) 000838 1789051382.126290 MIRROR_RESYNC 5 mirrors 000839 1789051383.871923 trunc from 0x00e845 to 0x01c006 (0xd7c2 bytes) 000840 1789051383.909415 MIRROR_RESYNC 5 mirrors 000842 1789051385.397966 punch from 0x00ac08 to 0x0102d7 (0x56d0 bytes) 000843 1789051385.429495 fallocate 0x008310 thru 0x00e7a1 (0x6492 bytes) 000844 1789051385.435204 punch from 0x018291 to 0x01eb3d (0x68ad bytes) 000845 1789051385.440015 trunc from 0x008ab6 to 0x01378f (0xacda bytes) 000846 1789051385.445309 fallocate 0x006467 thru 0x00669b (0x235 bytes) 000847 1789051385.450278 fallocate 0x0037fe thru 0x00ae3c (0x763f bytes) 000848 1789051385.455356 trunc from 0x02c64f to 0x03cdb4 (0x10766 bytes) 000849 1789051385.476802 trunc from 0x03cdb5 to 0x0091c8 (0x33bec bytes) 000850 1789051385.491420 punch from 0x005e90 to 0x006da1 (0xf12 bytes) 000851 1789051385.496284 trunc from 0x00548f to 0x0091c8 (0x3d3a bytes) 000852 1789051385.500589 punch from 0x007291 to 0x0091c8 (0x1f38 bytes) 000853 1789051385.505854 punch from 0x005087 to 0x005116 (0x90 bytes) 000854 1789051385.510779 trunc from 0x006023 to 0x0091c8 (0x31a6 bytes) 000855 1789051385.518191 mapread 0x00819b thru 0x0091c8 (0x102e bytes) 000856 1789051385.530091 punch from 0x001b96 to 0x0091c8 (0x7633 bytes) 000857 1789051385.535486 fallocate 0x0107d2 thru 0x016178 (0x59a7 bytes) 000858 1789051385.545821 punch from 0x00837c to 0x0091c8 (0xe4d bytes) 000859 1789051385.568834 MIRROR_RESYNC 5 mirrors 000860 1789051386.553984 read 0x001fb6 thru 0x0083e9 (0x6434 bytes) 000861 1789051386.574249 write 0x01923e thru 0x01bfa8 (0x2d6b bytes) 000862 1789051386.665444 mapwrite 0x00c00a thru 0x01b0e8 (0xf0df bytes) 000863 1789051386.723787 read 0x012f24 thru 0x01bfa8 (0x9085 bytes) 000864 1789051386.724636 trunc from 0x002538 to 0x005a20 (0x34e9 bytes) 000865 1789051386.728849 mapwrite 0x00766a thru 0x010cca (0x9661 bytes) 000866 1789051386.743779 punch from 0x00ff63 to 0x0130f6 (0x3194 bytes) 000867 1789051386.747806 write 0x010f29 thru 0x0198a6 (0x897e bytes) 000868 1789051386.757109 mapwrite 0x0373cd thru 0x038873 (0x14a7 bytes) 000869 1789051386.832585 fallocate 0x02f68f thru 0x03208e (0x2a00 bytes) 000870 1789051386.838469 trunc from 0x00ca77 to 0x010fde (0x4568 bytes) 000871 1789051386.844901 trunc from 0x01f93c to 0x02a079 (0xa73e bytes) 000872 1789051386.850286 punch from 0x002cb4 to 0x0059d2 (0x2d1f bytes) 000873 1789051386.855892 mapwrite 0x003f7a thru 0x00fd10 (0xbd97 bytes) 000874 1789051386.924323 trunc from 0x00eaba to 0x01749a (0x89e1 bytes) 000875 1789051386.931297 mapread 0x026b28 thru 0x02be32 (0x530b bytes) 000876 1789051386.966135 write 0x01d9a9 thru 0x0225c7 (0x4c1f bytes) 000877 1789051386.984448 mapread 0x02442c thru 0x024f02 (0xad7 bytes) 000878 1789051387.003242 trunc from 0x037b5b to 0x038873 (0xd19 bytes) 000879 1789051387.049826 mapread 0x001116 thru 0x003b0c (0x29f7 bytes) 000880 1789051387.063423 trunc from 0x035444 to 0x038873 (0x3430 bytes) 000881 1789051387.077279 punch from 0x027dd2 to 0x032eff (0xb12e bytes) 000882 1789051387.100623 trunc from 0x01bea8 to 0x020b54 (0x4cad bytes) 000883 1789051387.157337 MIRROR_RESYNC 5 mirrors 000884 1789051389.210776 trunc from 0x038874 to 0x019c3d (0x1ec36 bytes) 000885 1789051389.247831 read 0x0015a9 thru 0x006d67 (0x57bf bytes) 000886 1789051389.257704 read 0x0134fa thru 0x019c3d (0x6744 bytes) 000887 1789051389.273739 fallocate 0x03e52e thru 0x03ffff (0x1ad2 bytes) 000888 1789051389.279104 trunc from 0x0097ca to 0x00fa0d (0x6244 bytes) 000889 1789051389.284440 trunc from 0x019c3e to 0x00863a (0x11603 bytes) 000890 1789051389.303924 write 0x0133cb thru 0x01519f (0x1dd5 bytes) 000891 1789051389.306155 trunc from 0x0151a0 to 0x00e2ce (0x6ed1 bytes) 000892 1789051389.320997 fallocate 0x02442a thru 0x02460e (0x1e5 bytes) 000893 1789051389.327128 write 0x03bcda thru 0x03ffff (0x4326 bytes) 000894 1789051389.330404 trunc from 0x040000 to 0x000eb5 (0x3f14a bytes) 000895 1789051389.348005 mapread 0x000003 thru 0x000eb5 (0xeb3 bytes) 000896 1789051389.351684 trunc from 0x000eb6 to 0x035e5a (0x34fa5 bytes) 000897 1789051389.364686 mapwrite 0x019c8e thru 0x0291e6 (0xf559 bytes) 000898 1789051389.423258 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 11: 0x80647ae1 (stale) Mirror 22: 0x80647ae1 (stale) Mirror 23: 0x80647ae1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 11: 0x80647ae1 (stale) Mirror 22: 0x80647ae1 (stale) Mirror 23: 0x80647ae1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e5b: skipped 000899 1789051389.813362 mapread 0x027be2 thru 0x032d5a (0xb179 bytes) 000900 1789051389.843545 MIRROR_RESYNC 4 mirrors 000901 1789051390.758848 mapwrite 0x00a28d thru 0x013109 (0x8e7d bytes) 000904 1789051390.825319 mapread 0x0349fc thru 0x035e5a (0x145f bytes) 000905 1789051390.836687 fallocate 0x033e4f thru 0x03e3da (0xa58c bytes) 000906 1789051390.840704 mapwrite 0x012132 thru 0x021906 (0xf7d5 bytes) 000907 1789051390.874718 punch from 0x02896d to 0x035e5a (0xd4ee bytes) 000908 1789051390.878634 mapwrite 0x007f0e thru 0x00ca42 (0x4b35 bytes) 000909 1789051390.891271 trunc from 0x029f87 to 0x035a02 (0xba7c bytes) 000911 1789051390.895159 punch from 0x003b75 to 0x011c57 (0xe0e3 bytes) 000912 1789051390.899165 read 0x007830 thru 0x011dcc (0xa59d bytes) 000913 1789051390.909546 read 0x0229ce thru 0x026cea (0x431d bytes) 000914 1789051390.949967 fallocate 0x03dfb6 thru 0x03ffff (0x204a bytes) 000915 1789051390.958826 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 22: 0xb9b364e5 (stale) Mirror 23: 0xb9b364e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 22: 0xb9b364e5 (stale) Mirror 23: 0xb9b364e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e5b: skipped 000916 1789051391.322163 read 0x003259 thru 0x00e4d9 (0xb281 bytes) 000917 1789051391.341611 fallocate 0x024071 thru 0x02ac39 (0x6bc9 bytes) 000918 1789051391.347144 punch from 0x014dc8 to 0x021648 (0xc881 bytes) 000919 1789051391.359790 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 22: 0xb9b364e5 (stale) Mirror 23: 0xb9b364e5 (stale) CRC-32 checksum value for chunk [0, 0x35e5b): Mirror 1: 0x485ccecf Mirror 24: 0x485ccecf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e5b: skipped 000920 1789051392.271728 fallocate 0x003072 thru 0x00b1e2 (0x8171 bytes) 000921 1789051392.315236 fallocate 0x01292d thru 0x01d318 (0xa9ec bytes) 000923 1789051392.321684 trunc from 0x00f5fd to 0x01d5dd (0xdfe1 bytes) 000924 1789051392.326526 mapwrite 0x0057de thru 0x009027 (0x384a bytes) 000925 1789051392.362306 trunc from 0x035e5b to 0x003ccc (0x3218e bytes) 000927 1789051392.388526 fallocate 0x03b580 thru 0x03ffff (0x4a80 bytes) 000928 1789051392.394369 read 0x001afa thru 0x003bf7 (0x20fe bytes) 000929 1789051392.395352 trunc from 0x003ccd to 0x016235 (0x12569 bytes) 000930 1789051392.411401 mapread 0x0083ce thru 0x00d350 (0x4f83 bytes) 000931 1789051392.423021 write 0x002ec6 thru 0x00f193 (0xc2ce bytes) 000932 1789051392.424819 mapread 0x009783 thru 0x0134cb (0x9d49 bytes) 000933 1789051392.435598 fallocate 0x008af2 thru 0x01542e (0xc93d bytes) 000935 1789051392.441174 fallocate 0x0061ba thru 0x012dc8 (0xcc0f bytes) 000936 1789051392.446274 trunc from 0x0074e4 to 0x00c720 (0x523d bytes) 000937 1789051392.460752 fallocate 0x01e74d thru 0x0284d1 (0x9d85 bytes) 000938 1789051392.466359 punch from 0x0136ab to 0x016e89 (0x37df bytes) 000939 1789051392.472826 read 0x028487 thru 0x0284d1 (0x4b bytes) 000940 1789051392.484366 mapread 0x0114a1 thru 0x01e3d0 (0xcf30 bytes) 000941 1789051392.486310 trunc from 0x013e3e to 0x01ac56 (0x6e19 bytes) 000942 1789051392.492068 trunc from 0x0284d2 to 0x039bdd (0x1170c bytes) 000943 1789051392.510172 punch from 0x010424 to 0x01323c (0x2e19 bytes) 000944 1789051392.516209 fallocate 0x0271f3 thru 0x02f473 (0x8281 bytes) 000945 1789051392.522285 punch from 0x03523d to 0x0371a4 (0x1f68 bytes) 000946 1789051392.528025 punch from 0x022a52 to 0x02f015 (0xc5c4 bytes) 000947 1789051392.537176 MIRROR_RESYNC 4 mirrors 000948 1789051394.467020 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) 000949 1789051395.011081 punch from 0x022919 to 0x03138f (0xea77 bytes) 000950 1789051395.070619 read 0x00aa18 thru 0x00b6c3 (0xcac bytes) 000952 1789051395.086223 trunc from 0x011023 to 0x01efce (0xdfac bytes) 000953 1789051395.097385 trunc from 0x039bde to 0x015801 (0x243dc bytes) 000954 1789051395.143792 read 0x00eb94 thru 0x015801 (0x6c6e bytes) 000955 1789051395.181570 read 0x003351 thru 0x00c411 (0x90c1 bytes) 000956 1789051395.182782 read 0x009b9f thru 0x015801 (0xbc63 bytes) 000957 1789051395.187793 read 0x00c3ca thru 0x015801 (0x9438 bytes) 000958 1789051395.190012 trunc from 0x015802 to 0x02150a (0xbd09 bytes) 000959 1789051395.213910 trunc from 0x02150b to 0x018cd5 (0x8835 bytes) 000960 1789051395.251792 mapwrite 0x038c0f thru 0x03ba27 (0x2e19 bytes) 000961 1789051395.350630 write 0x03c43f thru 0x03ffff (0x3bc1 bytes) 000962 1789051395.355195 write 0x01eacd thru 0x01ebb8 (0xec bytes) 000963 1789051395.358599 mapread 0x00a8cb thru 0x010164 (0x589a bytes) 000964 1789051395.361143 trunc from 0x040000 to 0x009884 (0x3677b bytes) 000965 1789051395.400313 trunc from 0x00488c to 0x009884 (0x4ff9 bytes) 000966 1789051395.413081 read 0x0079f0 thru 0x009884 (0x1e95 bytes) 000967 1789051395.436313 read 0x005eda thru 0x009884 (0x39ab bytes) 000968 1789051395.437587 mapwrite 0x02f66d thru 0x030b20 (0x14b4 bytes) 000969 1789051395.551970 fallocate 0x03abcd thru 0x03ffff (0x5433 bytes) 000970 1789051395.563852 mapwrite 0x03a5ae thru 0x03ea6a (0x44bd bytes) 000972 1789051395.688640 punch from 0x03d079 to 0x03ea6a (0x19f2 bytes) 000973 1789051395.712720 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea6b): Mirror 24: 0x9fcd158a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea6b): Mirror 24: 0x9fcd158a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea6b: skipped 000974 1789051396.023265 trunc from 0x03ea6b to 0x017c1f (0x26e4b bytes) 000975 1789051396.047389 read 0x00b954 thru 0x016040 (0xa6ed bytes) 000976 1789051396.063038 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1aa:0x0]: Invalid argument (22) 000977 1789051396.229589 punch from 0x00728a to 0x00f058 (0x7dcf bytes) 000978 1789051396.236645 read 0x00f013 thru 0x017c1f (0x8c0d bytes) 000979 1789051396.248780 fallocate 0x008bde thru 0x01742c (0xe84f bytes) 000980 1789051396.253839 trunc from 0x00dc0c to 0x00ee12 (0x1207 bytes) 000981 1789051396.258501 fallocate 0x010f55 thru 0x020e4b (0xfef7 bytes) 000983 1789051396.264825 read 0x019b40 thru 0x01dc46 (0x4107 bytes) 000984 1789051396.282074 mapread 0x020b26 thru 0x020e4b (0x326 bytes) 000985 1789051396.283063 trunc from 0x01e30c to 0x020e4b (0x2b40 bytes) 000986 1789051396.287948 write 0x039598 thru 0x03c70a (0x3173 bytes) 000987 1789051396.295017 mapwrite 0x03babf thru 0x03ffff (0x4541 bytes) 000988 1789051396.337823 mapread 0x006ff7 thru 0x0155ef (0xe5f9 bytes) 000990 1789051396.341236 fallocate 0x023a75 thru 0x02cb65 (0x90f1 bytes) 000991 1789051396.347680 mapwrite 0x035007 thru 0x03ffff (0xaff9 bytes) 000993 1789051396.371156 write 0x02adec thru 0x02d16d (0x2382 bytes) 000995 1789051396.373744 trunc from 0x03deb5 to 0x03ffff (0x214b bytes) 000996 1789051396.379694 trunc from 0x02fbbe to 0x0313a3 (0x17e6 bytes) 000997 1789051396.394583 MIRROR_EXTEND to 2 mirrors 000999 1789051397.662574 trunc from 0x01d32b to 0x02912c (0xbe02 bytes) 001000 1789051397.721074 read 0x029095 thru 0x038910 (0xf87c bytes) All operations completed A-OK!