== sanity-flr test 70a: flr mode fsx test ================ 00:02:20 (1788753740) Seed set to 3741 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002 1788753742.025049 mapwrite 0x020afb thru 0x02a680 (0x9b86 bytes) 000003 1788753742.109107 mapwrite 0x013bc0 thru 0x01f630 (0xba71 bytes) 000005 1788753742.159037 mapwrite 0x03759c thru 0x03e249 (0x6cae bytes) 000006 1788753742.267792 read 0x01a794 thru 0x01ee6d (0x46da bytes) 000007 1788753742.268542 punch from 0x0344bc to 0x03e249 (0x9d8e bytes) 000009 1788753742.272967 punch from 0x02adb0 to 0x02c02d (0x127e bytes) truncating to largest ever: 0x18c80 000010 1788753742.276610 trunc from 0x03e24a to 0x018c7f (0x255ca bytes) 000011 1788753742.293583 write 0x02c6cc thru 0x032502 (0x5e37 bytes) 000013 1788753742.304416 MIRROR_EXTEND to 2 mirrors 000014 1788753743.327325 read 0x02cafc thru 0x032502 (0x5a07 bytes) 000015 1788753743.334597 write 0x02c773 thru 0x02d120 (0x9ae bytes) 000017 1788753743.422336 MIRROR_RESYNC 2 mirrors 000018 1788753744.455423 read 0x01e191 thru 0x022eb1 (0x4d21 bytes) 000019 1788753744.468646 punch from 0x008679 to 0x0103ef (0x7d77 bytes) 000020 1788753744.596512 trunc from 0x032503 to 0x0135e2 (0x1ef20 bytes) 000022 1788753744.647751 mapread 0x002ae2 thru 0x01265c (0xfb7b bytes) 000023 1788753744.683573 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000024 1788753744.916699 write 0x03febb thru 0x03ffff (0x145 bytes) 000026 1788753744.918093 mapread 0x039786 thru 0x03f1ac (0x5a27 bytes) 000031 1788753744.937045 read 0x00fce0 thru 0x015a20 (0x5d41 bytes) 000032 1788753744.944762 write 0x015a4d thru 0x01ff16 (0xa4ca bytes) 000033 1788753744.950346 read 0x02a7cc thru 0x02f4f3 (0x4d28 bytes) truncating to largest ever: 0x2deea 000034 1788753744.958938 trunc from 0x040000 to 0x02dee9 (0x12116 bytes) 000035 1788753744.978794 mapwrite 0x0383d1 thru 0x03ffff (0x7c2f bytes) 000036 1788753745.098217 MIRROR_EXTEND to 2 mirrors 000037 1788753745.774366 write 0x01a249 thru 0x02156b (0x7323 bytes) 000038 1788753745.882022 trunc from 0x040000 to 0x026271 (0x19d8e bytes) 000040 1788753745.939689 mapwrite 0x002b7c thru 0x011105 (0xe58a bytes) 000041 1788753746.032183 read 0x01467a thru 0x017c59 (0x35e0 bytes) 000042 1788753746.032734 write 0x027bf5 thru 0x02a378 (0x2784 bytes) 000043 1788753746.034344 mapread 0x021664 thru 0x02a26c (0x8c09 bytes) 000045 1788753746.041637 mapread 0x01673d thru 0x0244d8 (0xdd9c bytes) 000046 1788753746.042624 trunc from 0x02a379 to 0x023975 (0x6a03 bytes) 000047 1788753746.059961 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23976): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23976): Mirror 2: 0x321db232 (stale) CRC-32 checksum value for chunk [0, 0x23976): Mirror 1: 0x81c5dabb Mirror 3: 0x81c5dabb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23976: skipped 000048 1788753747.214665 mapwrite 0x038b31 thru 0x03ffff (0x74cf bytes) truncating to largest ever: 0x2fcce 000049 1788753747.471315 trunc from 0x040000 to 0x02fccd (0x10332 bytes) 000050 1788753747.514645 trunc from 0x02fcce to 0x00395c (0x2c371 bytes) 000051 1788753747.540015 read 0x003803 thru 0x00395c (0x15a bytes) 000052 1788753747.547318 mapread 0x00004c thru 0x00395c (0x3911 bytes) 000057 1788753747.558318 write 0x01720c thru 0x01d8e2 (0x66d7 bytes) 000058 1788753747.559506 mapread 0x00c9ad thru 0x01548a (0x8ade bytes) 000059 1788753747.573367 mapread 0x00470c thru 0x00e2d5 (0x9bca bytes) 000062 1788753747.583739 write 0x034eb8 thru 0x03b2ad (0x63f6 bytes) 000063 1788753747.586387 mapwrite 0x012778 thru 0x017d8e (0x5617 bytes) 000065 1788753747.667101 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b2ae): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2ae): Mirror 2: 0xe2d9aec4 (stale) Mirror 3: 0xc86963b1 (stale) CRC-32 checksum value for chunk [0, 0x3b2ae): Mirror 1: 0xd25b2bc7 Mirror 4: 0xd25b2bc7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2ae: skipped 000067 1788753748.679699 mapread 0x019b5f thru 0x023736 (0x9bd8 bytes) 000068 1788753748.696109 trunc from 0x03b2ae to 0x01805d (0x23250 bytes) 000069 1788753748.783648 mapread 0x0142c3 thru 0x01805d (0x3d9b bytes) 000072 1788753748.795382 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1805e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1805e): Mirror 2: 0xd5057fd2 (stale) Mirror 3: 0x3eaa68d7 (stale) Mirror 4: 0x9add69a (stale) CRC-32 checksum value for chunk [0, 0x1805e): Mirror 1: 0x9add69a Mirror 5: 0x9add69a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1805e: skipped 000073 1788753750.001912 mapwrite 0x0194b7 thru 0x01e66c (0x51b6 bytes) 000074 1788753750.218459 trunc from 0x01e66d to 0x00ecaf (0xf9bd bytes) 000077 1788753750.241126 write 0x0061e0 thru 0x00ba1f (0x5840 bytes) 000078 1788753750.253575 read 0x00c06a thru 0x00ecaf (0x2c46 bytes) 000079 1788753750.260575 read 0x0037a1 thru 0x00ecaf (0xb50f bytes) 000080 1788753750.267187 mapread 0x00a8c3 thru 0x00c7a3 (0x1ee1 bytes) 000082 1788753750.273352 MIRROR_RESYNC 5 mirrors 000083 1788753751.989729 MIRROR_EXTEND to 6 mirrors 000085 1788753752.969694 write 0x00a628 thru 0x00ef26 (0x48ff bytes) 000087 1788753753.075566 mapwrite 0x023ca7 thru 0x027231 (0x358b bytes) 000088 1788753753.238466 write 0x03ada9 thru 0x03ffff (0x5257 bytes) 000090 1788753753.240090 trunc from 0x040000 to 0x01fc75 (0x2038a bytes) 000092 1788753753.261028 punch from 0x01eb2a to 0x01fc75 (0x114c bytes) 000093 1788753753.265389 read 0x015ced thru 0x018231 (0x2545 bytes) 000095 1788753753.278345 mapwrite 0x0082ba thru 0x00a160 (0x1ea7 bytes) 000096 1788753753.405055 mapread 0x00cda9 thru 0x010a60 (0x3cb8 bytes) 000098 1788753753.407057 read 0x00d9b8 thru 0x012b4e (0x5197 bytes) 000099 1788753753.424309 mapread 0x01600d thru 0x01fc75 (0x9c69 bytes) 000100 1788753753.425286 trunc from 0x01fc76 to 0x02b737 (0xbac2 bytes) 000102 1788753753.442421 mapwrite 0x024ad6 thru 0x027554 (0x2a7f bytes) 000104 1788753753.525583 write 0x025bf9 thru 0x026abd (0xec5 bytes) 000105 1788753753.526532 write 0x01ef3a thru 0x021681 (0x2748 bytes) 000107 1788753753.529256 write 0x0310ca thru 0x032ae1 (0x1a18 bytes) 000108 1788753753.530581 mapwrite 0x001dac thru 0x0078a2 (0x5af7 bytes) 000109 1788753753.574169 write 0x03ea4c thru 0x03ffff (0x15b4 bytes) 000110 1788753753.575533 mapread 0x0151f6 thru 0x01dd92 (0x8b9d bytes) 000111 1788753753.576914 read 0x03e4f4 thru 0x03ffff (0x1b0c bytes) 000112 1788753753.577871 trunc from 0x040000 to 0x02653f (0x19ac0 bytes) 000113 1788753753.593640 mapwrite 0x010b56 thru 0x012bf4 (0x209f bytes) 000114 1788753753.639116 write 0x004abe thru 0x012af3 (0xe036 bytes) 000115 1788753753.641671 read 0x003e34 thru 0x00bed9 (0x80a6 bytes) 000116 1788753753.643357 mapread 0x01764e thru 0x01aa65 (0x3418 bytes) truncating to largest ever: 0x3fc2b 000117 1788753753.645115 trunc from 0x026540 to 0x03fc2a (0x196eb bytes) 000119 1788753753.658751 write 0x027fb6 thru 0x0310cd (0x9118 bytes) 000121 1788753753.675533 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fc2b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc2b): Mirror 2: 0x4067d578 (stale) Mirror 3: 0x4067d578 (stale) Mirror 4: 0x4067d578 (stale) Mirror 5: 0x4067d578 (stale) Mirror 6: 0x4067d578 (stale) CRC-32 checksum value for chunk [0, 0x3fc2b): Mirror 1: 0xa8faa7b0 Mirror 7: 0xa8faa7b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc2b: skipped 000122 1788753755.028575 write 0x022ddc thru 0x02cc38 (0x9e5d bytes) 000123 1788753755.103327 read 0x00fc3e thru 0x01ab1b (0xaede bytes) 000124 1788753755.111146 trunc from 0x03fc2b to 0x02dc73 (0x11fb7 bytes) 000125 1788753755.133015 mapread 0x0002bc thru 0x007617 (0x735c bytes) 000128 1788753755.160676 mapread 0x0224f2 thru 0x02bba4 (0x96b3 bytes) 000129 1788753755.161549 mapwrite 0x016fb3 thru 0x01c853 (0x58a1 bytes) 000133 1788753755.221676 mapwrite 0x00c661 thru 0x01b431 (0xedd1 bytes) 000134 1788753755.275593 read 0x01ce5d thru 0x01f807 (0x29ab bytes) 000135 1788753755.276387 trunc from 0x02dc74 to 0x03a187 (0xc514 bytes) 000137 1788753755.320056 mapwrite 0x02c365 thru 0x034d4e (0x89ea bytes) 000138 1788753755.421720 MIRROR_RESYNC 7 mirrors 000139 1788753757.635536 mapread 0x01e96d thru 0x01fd73 (0x1407 bytes) 000142 1788753757.656904 trunc from 0x03a188 to 0x02a2be (0xfec9 bytes) 000143 1788753757.784073 read 0x012262 thru 0x016cf0 (0x4a8f bytes) 000145 1788753757.800564 read 0x029f93 thru 0x02a2be (0x32c bytes) 000147 1788753757.821681 write 0x0060f3 thru 0x0117a4 (0xb6b2 bytes) 000149 1788753757.825610 mapread 0x016cab thru 0x021626 (0xa97c bytes) 000151 1788753757.832064 mapread 0x01e0aa thru 0x01edd2 (0xd29 bytes) 000154 1788753757.835792 write 0x03d288 thru 0x03ffff (0x2d78 bytes) 000155 1788753757.840686 mapread 0x01a710 thru 0x01c84a (0x213b bytes) 000156 1788753757.842423 read 0x00b35f thru 0x0152e8 (0x9f8a bytes) 000157 1788753757.844130 mapread 0x03e7d3 thru 0x03ffff (0x182d bytes) 000158 1788753757.846200 read 0x0078db thru 0x00cc20 (0x5346 bytes) 000159 1788753757.850275 punch from 0x01ec68 to 0x0293e6 (0xa77f bytes) 000160 1788753757.897371 punch from 0x01abc1 to 0x01cebe (0x22fe bytes) 000162 1788753757.903283 trunc from 0x040000 to 0x018f8f (0x27070 bytes) 000163 1788753757.946323 write 0x038bce thru 0x03d354 (0x4787 bytes) 000164 1788753757.950444 trunc from 0x03d355 to 0x007975 (0x359df bytes) 000166 1788753757.978769 MIRROR_RESYNC 7 mirrors 000167 1788753759.308106 mapread 0x001c91 thru 0x007975 (0x5ce5 bytes) 000170 1788753759.340694 mapwrite 0x023416 thru 0x02ecc6 (0xb8b1 bytes) 000171 1788753759.512161 mapwrite 0x02defd thru 0x0300df (0x21e3 bytes) 000173 1788753759.581912 mapread 0x00c4e0 thru 0x010640 (0x4161 bytes) 000174 1788753759.597652 punch from 0x021ac9 to 0x02bab1 (0x9fe9 bytes) 000175 1788753759.602937 write 0x014887 thru 0x01a587 (0x5d01 bytes) 000176 1788753759.609662 write 0x03e76f thru 0x03ffff (0x1891 bytes) 000177 1788753759.611030 mapwrite 0x01004d thru 0x0187ea (0x879e bytes) 000178 1788753759.678917 punch from 0x018f29 to 0x026cc7 (0xdd9f bytes) 000179 1788753759.690354 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc559f56d (stale) Mirror 4: 0xc559f56d (stale) Mirror 5: 0xc559f56d (stale) Mirror 6: 0xc559f56d (stale) Mirror 7: 0xc559f56d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc559f56d (stale) Mirror 4: 0xc559f56d (stale) Mirror 5: 0xc559f56d (stale) Mirror 6: 0xc559f56d (stale) Mirror 7: 0xc559f56d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000180 1788753760.139235 read 0x0243ae thru 0x0297cc (0x541f bytes) 000181 1788753760.152089 punch from 0x00412a to 0x01173b (0xd612 bytes) 000182 1788753760.156933 trunc from 0x040000 to 0x00f3f1 (0x30c0e bytes) 000183 1788753760.190530 MIRROR_RESYNC 6 mirrors 000185 1788753761.697293 trunc from 0x00f3f2 to 0x03aaf1 (0x2b700 bytes) 000186 1788753761.783696 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3aaf2): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aaf2): Mirror 2: 0x69a972f4 (stale) Mirror 4: 0x69a972f4 (stale) Mirror 5: 0x69a972f4 (stale) Mirror 6: 0x69a972f4 (stale) Mirror 7: 0x69a972f4 (stale) CRC-32 checksum value for chunk [0, 0x3aaf2): Mirror 1: 0x69a972f4 Mirror 8: 0x69a972f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aaf2: skipped 000187 1788753762.883528 read 0x012863 thru 0x01f67e (0xce1c bytes) 000188 1788753762.898905 mapwrite 0x00e77b thru 0x01d04f (0xe8d5 bytes) 000189 1788753763.144128 punch from 0x016cdc to 0x025faf (0xf2d4 bytes) 000190 1788753763.159636 read 0x0194fb thru 0x01f3d2 (0x5ed8 bytes) 000192 1788753763.176638 write 0x025201 thru 0x02bf98 (0x6d98 bytes) 000193 1788753763.177753 write 0x006848 thru 0x0163f0 (0xfba9 bytes) 000194 1788753763.179838 punch from 0x007be1 to 0x00b7ee (0x3c0e bytes) 000195 1788753763.203953 mapwrite 0x03ae34 thru 0x03ffff (0x51cc bytes) 000196 1788753763.342798 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7f7d34e8 (stale) Mirror 4: 0x7f7d34e8 (stale) Mirror 5: 0x7f7d34e8 (stale) Mirror 6: 0x7f7d34e8 (stale) Mirror 7: 0x7f7d34e8 (stale) Mirror 8: 0x7f7d34e8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x56e7ed36 Mirror 9: 0x56e7ed36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000197 1788753764.313471 MIRROR_RESYNC 8 mirrors 000198 1788753767.573809 write 0x0075d4 thru 0x013a4e (0xc47b bytes) 000199 1788753767.707267 read 0x02dbba thru 0x03125b (0x36a2 bytes) 000200 1788753767.714785 punch from 0x03c243 to 0x03ffff (0x3dbd bytes) 000201 1788753767.730994 mapwrite 0x001b05 thru 0x00763c (0x5b38 bytes) 000203 1788753767.838730 read 0x0095a8 thru 0x00c561 (0x2fba bytes) 000206 1788753767.840108 punch from 0x03b8b5 to 0x03ffff (0x474b bytes) 000208 1788753767.847757 punch from 0x005daf to 0x012e08 (0xd05a bytes) 000209 1788753767.870746 MIRROR_RESYNC 8 mirrors 000210 1788753771.213404 punch from 0x00d3a2 to 0x01177e (0x43dd bytes) 000212 1788753771.306361 mapread 0x017b9a thru 0x018699 (0xb00 bytes) 000214 1788753771.322476 mapread 0x009587 thru 0x009b42 (0x5bc bytes) 000218 1788753771.337380 mapwrite 0x039255 thru 0x03ffff (0x6dab bytes) 000219 1788753771.395563 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbafaf8c2 (stale) Mirror 4: 0xbafaf8c2 (stale) Mirror 6: 0xbafaf8c2 (stale) Mirror 7: 0xbafaf8c2 (stale) Mirror 8: 0xbafaf8c2 (stale) Mirror 9: 0xbafaf8c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbafaf8c2 (stale) Mirror 4: 0xbafaf8c2 (stale) Mirror 6: 0xbafaf8c2 (stale) Mirror 7: 0xbafaf8c2 (stale) Mirror 8: 0xbafaf8c2 (stale) Mirror 9: 0xbafaf8c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000220 1788753771.828364 trunc from 0x040000 to 0x000eac (0x3f153 bytes) 000221 1788753771.846420 trunc from 0x000ead to 0x023482 (0x225d6 bytes) 000222 1788753771.864138 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23483): Mirror 2: 0x9b1f0324 (stale) Mirror 4: 0x9b1f0324 (stale) Mirror 6: 0x9b1f0324 (stale) Mirror 7: 0x9b1f0324 (stale) Mirror 8: 0x9b1f0324 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23483): Mirror 2: 0x9b1f0324 (stale) Mirror 4: 0x9b1f0324 (stale) Mirror 6: 0x9b1f0324 (stale) Mirror 7: 0x9b1f0324 (stale) Mirror 8: 0x9b1f0324 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23483: skipped 000224 1788753772.220240 write 0x015048 thru 0x018238 (0x31f1 bytes) 000226 1788753772.237059 trunc from 0x023483 to 0x030ea4 (0xda22 bytes) 000229 1788753772.254679 punch from 0x000d21 to 0x00765b (0x693b bytes) 000230 1788753772.271755 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30ea5): Mirror 2: 0x75acf899 (stale) Mirror 4: 0x75acf899 (stale) Mirror 7: 0x75acf899 (stale) Mirror 8: 0x75acf899 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ea5): Mirror 2: 0x75acf899 (stale) Mirror 4: 0x75acf899 (stale) Mirror 7: 0x75acf899 (stale) Mirror 8: 0x75acf899 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ea5: skipped 000231 1788753772.661143 punch from 0x010bb6 to 0x01d735 (0xcb80 bytes) 000233 1788753772.672320 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30ea5): Mirror 4: 0x75acf899 (stale) Mirror 7: 0x75acf899 (stale) Mirror 8: 0x75acf899 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ea5): Mirror 4: 0x75acf899 (stale) Mirror 7: 0x75acf899 (stale) Mirror 8: 0x75acf899 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ea5: skipped 000234 1788753772.996911 read 0x00d5bd thru 0x00d837 (0x27b bytes) 000235 1788753773.005353 mapread 0x02071e thru 0x0236e8 (0x2fcb bytes) 000238 1788753773.029888 mapread 0x00cc74 thru 0x01b547 (0xe8d4 bytes) 000239 1788753773.058467 read 0x00f444 thru 0x01ec14 (0xf7d1 bytes) 000240 1788753773.059176 read 0x0214bd thru 0x02e8dc (0xd420 bytes) 000241 1788753773.067156 read 0x012822 thru 0x01be49 (0x9628 bytes) 000244 1788753773.069357 mapread 0x00be81 thru 0x015584 (0x9704 bytes) 000245 1788753773.070439 trunc from 0x030ea5 to 0x039366 (0x84c2 bytes) 000246 1788753773.093566 write 0x02f5dc thru 0x038185 (0x8baa bytes) 000247 1788753773.100039 read 0x013f72 thru 0x01dfea (0xa079 bytes) 000248 1788753773.100914 write 0x021cf9 thru 0x02650c (0x4814 bytes) 000250 1788753773.103003 trunc from 0x039367 to 0x03ece7 (0x5981 bytes) 000251 1788753773.121998 read 0x02e864 thru 0x03d7ad (0xef4a bytes) 000253 1788753773.137502 mapwrite 0x02df17 thru 0x0384a7 (0xa591 bytes) 000254 1788753773.201980 MIRROR_RESYNC 4 mirrors 000255 1788753774.489632 mapwrite 0x03edb0 thru 0x03ffff (0x1250 bytes) 000256 1788753774.621864 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfea7ad3b (stale) Mirror 8: 0xfea7ad3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfea7ad3b (stale) Mirror 8: 0xfea7ad3b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000257 1788753774.967454 trunc from 0x040000 to 0x001f7b (0x3e084 bytes) 000259 1788753774.981081 trunc from 0x001f7c to 0x03be76 (0x39efb bytes) 000261 1788753774.995243 mapread 0x03b7ef thru 0x03be76 (0x688 bytes) 000264 1788753775.001919 mapread 0x0281b3 thru 0x02d301 (0x514f bytes) 000266 1788753775.015553 mapwrite 0x03b495 thru 0x03ffff (0x4b6b bytes) 000267 1788753775.080408 mapwrite 0x02f656 thru 0x03e901 (0xf2ac bytes) 000268 1788753775.147890 mapwrite 0x00fd7d thru 0x018897 (0x8b1b bytes) 000269 1788753775.285741 read 0x03c36b thru 0x03ffff (0x3c95 bytes) 000270 1788753775.289110 mapread 0x03e2a2 thru 0x03ffff (0x1d5e bytes) 000271 1788753775.290412 mapread 0x030684 thru 0x0339bb (0x3338 bytes) 000272 1788753775.291425 write 0x03571b thru 0x03ffff (0xa8e5 bytes) 000273 1788753775.297087 MIRROR_RESYNC 3 mirrors 000274 1788753776.246158 trunc from 0x040000 to 0x01a250 (0x25daf bytes) 000275 1788753776.365179 punch from 0x003251 to 0x004480 (0x1230 bytes) 000276 1788753776.373162 read 0x01765b thru 0x01a250 (0x2bf6 bytes) 000278 1788753776.382482 read 0x013532 thru 0x01a250 (0x6d1f bytes) 000280 1788753776.396992 mapwrite 0x0287b3 thru 0x032c3b (0xa489 bytes) 000282 1788753776.504671 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32c3c): Mirror 4: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32c3c): Mirror 4: 0xfe9ccbea (stale) Mirror 8: 0xfe9ccbea (stale) CRC-32 checksum value for chunk [0, 0x32c3c): Mirror 1: 0xfec33606 Mirror 9: 0xfec33606 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32c3c: skipped 000283 1788753777.491066 mapwrite 0x00c3a3 thru 0x017008 (0xac66 bytes) 000284 1788753777.770618 read 0x01c521 thru 0x01fc16 (0x36f6 bytes) 000285 1788753777.776287 mapwrite 0x0249c3 thru 0x033564 (0xeba2 bytes) 000286 1788753777.869646 punch from 0x023365 to 0x02343b (0xd7 bytes) 000288 1788753777.875006 read 0x01816b thru 0x01b7fb (0x3691 bytes) 000289 1788753777.875970 read 0x02d617 thru 0x033564 (0x5f4e bytes) 000291 1788753777.878128 punch from 0x00b078 to 0x018db0 (0xdd39 bytes) 000292 1788753777.882012 write 0x0142ca thru 0x018082 (0x3db9 bytes) 000293 1788753777.893981 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33565): Mirror 8: 0xd09b26f4 (stale) Mirror 9: 0x43ea2f40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33565): Mirror 8: 0xd09b26f4 (stale) Mirror 9: 0x43ea2f40 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33565: skipped 000294 1788753778.196146 read 0x01e094 thru 0x0298f6 (0xb863 bytes) 000296 1788753778.209677 mapwrite 0x02f5c6 thru 0x039d66 (0xa7a1 bytes) 000297 1788753778.281702 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39d67): Mirror 8: 0xeab47ebb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d67): Mirror 8: 0xeab47ebb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d67: skipped 000298 1788753778.587717 trunc from 0x039d67 to 0x01ea3b (0x1b32b bytes) 000299 1788753778.618741 MIRROR_RESYNC 2 mirrors 000301 1788753779.320550 read 0x018631 thru 0x01d49e (0x4e6e bytes) 000302 1788753779.332134 MIRROR_RESYNC 2 mirrors 000304 1788753779.632332 write 0x00bde6 thru 0x0111bb (0x53d6 bytes) 000305 1788753779.709503 write 0x03e036 thru 0x03ffff (0x1fca bytes) 000306 1788753779.710525 trunc from 0x040000 to 0x03667a (0x9985 bytes) 000307 1788753779.750626 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000308 1788753779.871097 punch from 0x008b07 to 0x00b4e3 (0x29dd bytes) 000310 1788753779.879348 read 0x01e00d thru 0x0266e6 (0x86da bytes) 000311 1788753779.888539 read 0x000d98 thru 0x0061bd (0x5426 bytes) 000313 1788753779.911679 punch from 0x024c17 to 0x02fa28 (0xae12 bytes) 000314 1788753779.918213 mapwrite 0x01eefa thru 0x02b991 (0xca98 bytes) 000317 1788753780.011662 mapwrite 0x03eeca thru 0x03ffff (0x1136 bytes) 000318 1788753780.089109 mapread 0x016bf5 thru 0x01eeb9 (0x82c5 bytes) 000319 1788753780.090055 write 0x0244fc thru 0x024b4c (0x651 bytes) 000320 1788753780.090895 punch from 0x015f5c to 0x01c062 (0x6107 bytes) 000323 1788753780.103232 trunc from 0x040000 to 0x01a6af (0x25950 bytes) 000324 1788753780.125492 mapread 0x00d016 thru 0x00f4b2 (0x249d bytes) 000325 1788753780.127315 mapwrite 0x0148a5 thru 0x021604 (0xcd60 bytes) 000326 1788753780.257769 trunc from 0x021605 to 0x030b46 (0xf542 bytes) 000327 1788753780.281216 mapwrite 0x02935a thru 0x02e721 (0x53c8 bytes) 000328 1788753780.419347 trunc from 0x030b47 to 0x019a57 (0x170ef bytes) 000329 1788753780.443959 read 0x00342c thru 0x012673 (0xf248 bytes) 000330 1788753780.445258 write 0x03efaa thru 0x03ffff (0x1056 bytes) 000331 1788753780.447323 trunc from 0x040000 to 0x00049d (0x3fb62 bytes) 000336 1788753780.468142 write 0x038f4a thru 0x03fa99 (0x6b50 bytes) 000337 1788753780.469553 mapread 0x0229c3 thru 0x029658 (0x6c96 bytes) 000339 1788753780.479717 read 0x0292e1 thru 0x033c05 (0xa925 bytes) 000340 1788753780.481372 read 0x01e652 thru 0x0286cf (0xa07e bytes) 000342 1788753780.483482 write 0x02f889 thru 0x03dbfe (0xe376 bytes) 000345 1788753780.486498 write 0x01c852 thru 0x021189 (0x4938 bytes) 000347 1788753780.489258 punch from 0x02b3ea to 0x02faf0 (0x4707 bytes) 000350 1788753780.507953 punch from 0x02a37d to 0x035d68 (0xb9ec bytes) 000355 1788753780.516792 mapwrite 0x0142a2 thru 0x01ca82 (0x87e1 bytes) 000356 1788753780.589046 punch from 0x0295db to 0x0383a1 (0xedc7 bytes) 000357 1788753780.593943 read 0x01e7a0 thru 0x01fe1b (0x167c bytes) 000359 1788753780.595503 write 0x008b69 thru 0x016e66 (0xe2fe bytes) 000360 1788753780.598001 trunc from 0x03fa9a to 0x031b8d (0xdf0c bytes) 000361 1788753780.617233 mapwrite 0x028b6c thru 0x03582c (0xccc1 bytes) 000362 1788753780.703989 punch from 0x027e7c to 0x03003b (0x81c0 bytes) 000364 1788753780.714893 MIRROR_EXTEND to 2 mirrors 000366 1788753781.649258 mapread 0x035771 thru 0x03582c (0xbc bytes) 000367 1788753781.654224 mapwrite 0x00b322 thru 0x0121d8 (0x6eb7 bytes) 000368 1788753781.881390 mapwrite 0x000014 thru 0x0005f2 (0x5df bytes) 000369 1788753782.002514 trunc from 0x03582d to 0x00f458 (0x263d4 bytes) 000370 1788753782.028362 mapread 0x00e038 thru 0x00f458 (0x1421 bytes) 000371 1788753782.029344 read 0x001d37 thru 0x00da0b (0xbcd5 bytes) 000372 1788753782.032422 mapread 0x009226 thru 0x00f458 (0x6233 bytes) 000373 1788753782.034294 write 0x0235b8 thru 0x0289d6 (0x541f bytes) 000374 1788753782.038174 read 0x01e46f thru 0x01e516 (0xa8 bytes) 000375 1788753782.045677 punch from 0x0036f6 to 0x00c40f (0x8d1a bytes) 000376 1788753782.059893 mapread 0x01c9d6 thru 0x0289d6 (0xc001 bytes) 000377 1788753782.061436 mapwrite 0x03dfde thru 0x03ffff (0x2022 bytes) 000381 1788753782.143426 MIRROR_RESYNC 2 mirrors 000382 1788753782.964554 mapread 0x00067b thru 0x00d6e5 (0xd06b bytes) 000383 1788753782.992969 mapwrite 0x011ea6 thru 0x01576c (0x38c7 bytes) 000384 1788753783.148210 read 0x021264 thru 0x026e0a (0x5ba7 bytes) 000385 1788753783.161249 MIRROR_RESYNC 2 mirrors 000386 1788753784.226305 punch from 0x03761a to 0x03f06c (0x7a53 bytes) 000387 1788753784.295253 mapread 0x01d86c thru 0x0254e1 (0x7c76 bytes) 000388 1788753784.314569 punch from 0x02d850 to 0x02eea7 (0x1658 bytes) 000389 1788753784.322694 mapread 0x03e03e thru 0x03ffff (0x1fc2 bytes) 000391 1788753784.333459 read 0x0311d6 thru 0x03b868 (0xa693 bytes) 000392 1788753784.350094 MIRROR_RESYNC 2 mirrors 000393 1788753785.438761 trunc from 0x040000 to 0x0054f9 (0x3ab06 bytes) 000394 1788753785.507421 mapwrite 0x01d4bb thru 0x01f138 (0x1c7e bytes) 000395 1788753785.583696 trunc from 0x01f139 to 0x033bf9 (0x14ac1 bytes) 000396 1788753785.615809 punch from 0x02fdb9 to 0x033bf9 (0x3e41 bytes) 000397 1788753785.629877 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33bfa): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33bfa): Mirror 2: 0xaa100be7 (stale) CRC-32 checksum value for chunk [0, 0x33bfa): Mirror 1: 0x6f097d5c Mirror 3: 0x6f097d5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33bfa: skipped 000398 1788753786.720727 mapread 0x01c5e4 thru 0x0251d1 (0x8bee bytes) 000399 1788753786.752532 write 0x0021e5 thru 0x00b0ac (0x8ec8 bytes) 000400 1788753786.851916 write 0x026ebf thru 0x029184 (0x22c6 bytes) 000402 1788753786.860773 mapwrite 0x03c49c thru 0x03ffff (0x3b64 bytes) 000403 1788753786.926246 trunc from 0x040000 to 0x0014f9 (0x3eb06 bytes) 000404 1788753786.942986 mapwrite 0x020de0 thru 0x02df6e (0xd18f bytes) 000405 1788753787.035559 mapwrite 0x01ce3e thru 0x02974d (0xc910 bytes) 000406 1788753787.133531 write 0x033671 thru 0x03ffff (0xc98f bytes) 000407 1788753787.139552 mapwrite 0x017d05 thru 0x01c52e (0x482a bytes) 000408 1788753787.249384 mapwrite 0x020bd5 thru 0x02d306 (0xc732 bytes) 000410 1788753787.325963 read 0x029f34 thru 0x0305cc (0x6699 bytes) 000413 1788753787.337614 read 0x02b5ca thru 0x03af03 (0xf93a bytes) 000415 1788753787.354536 MIRROR_RESYNC 3 mirrors 000416 1788753788.502043 trunc from 0x040000 to 0x00ec22 (0x313dd bytes) 000417 1788753788.596199 read 0x009a8e thru 0x00a91e (0xe91 bytes) 000418 1788753788.607098 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xec23): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xec23): Mirror 2: 0xe303e848 (stale) Mirror 3: 0xe303e848 (stale) CRC-32 checksum value for chunk [0, 0xec23): Mirror 1: 0xe303e848 Mirror 4: 0xe303e848 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xec23: skipped 000419 1788753789.609311 read 0x007d28 thru 0x008310 (0x5e9 bytes) 000420 1788753789.616915 mapread 0x00b5e2 thru 0x00ec22 (0x3641 bytes) 000422 1788753789.637362 MIRROR_RESYNC 4 mirrors 000425 1788753790.563326 mapread 0x0047b6 thru 0x00e862 (0xa0ad bytes) 000426 1788753790.587338 mapwrite 0x024155 thru 0x0325a6 (0xe452 bytes) 000427 1788753790.786356 read 0x000cb4 thru 0x00cf61 (0xc2ae bytes) 000428 1788753790.817748 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x325a7): Mirror 2: 0x1207d7c3 (stale) Mirror 4: 0x1207d7c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x325a7): Mirror 2: 0x1207d7c3 (stale) Mirror 4: 0x1207d7c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x325a7: skipped 000430 1788753791.267633 trunc from 0x0325a7 to 0x0141cf (0x1e3d7 bytes) 000431 1788753791.286666 mapread 0x005d54 thru 0x012372 (0xc61f bytes) 000432 1788753791.315257 write 0x02edcd thru 0x036a9d (0x7cd1 bytes) 000433 1788753791.316461 punch from 0x00c929 to 0x00d34b (0xa23 bytes) 000434 1788753791.332783 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36a9e): Mirror 2: 0x9020c722 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36a9e): Mirror 2: 0x9020c722 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36a9e: skipped 000436 1788753791.677008 trunc from 0x036a9e to 0x025058 (0x11a45 bytes) 000437 1788753791.707484 read 0x0051cc thru 0x008fd3 (0x3e08 bytes) 000438 1788753791.718700 mapwrite 0x031b27 thru 0x038f45 (0x741f bytes) 000440 1788753791.863861 mapwrite 0x0150d0 thru 0x01940d (0x433e bytes) 000443 1788753791.927006 trunc from 0x038f46 to 0x036cb5 (0x2290 bytes) 000444 1788753791.950882 write 0x01539b thru 0x018aea (0x3750 bytes) 000445 1788753791.952637 mapread 0x001298 thru 0x00c072 (0xaddb bytes) 000446 1788753791.961710 mapread 0x0352de thru 0x036cb5 (0x19d8 bytes) 000449 1788753791.965217 trunc from 0x036cb6 to 0x02fd75 (0x6f40 bytes) 000450 1788753791.996802 mapwrite 0x019aa9 thru 0x027259 (0xd7b1 bytes) 000454 1788753792.109440 mapread 0x019a56 thru 0x021b96 (0x8141 bytes) 000455 1788753792.112208 read 0x00ce1d thru 0x00e3c8 (0x15ac bytes) 000456 1788753792.113525 mapwrite 0x001780 thru 0x00c7b9 (0xb03a bytes) 000457 1788753792.187103 write 0x021148 thru 0x02633d (0x51f6 bytes) 000459 1788753792.189486 write 0x03f5ea thru 0x03ffff (0xa16 bytes) 000460 1788753792.192120 mapwrite 0x0100ec thru 0x01425d (0x4172 bytes) 000461 1788753792.251242 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd8d526f4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdf130d1c Mirror 3: 0xdf130d1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000464 1788753793.475583 punch from 0x023765 to 0x027871 (0x410d bytes) 000466 1788753793.593465 punch from 0x035fd0 to 0x03ac1f (0x4c50 bytes) 000467 1788753793.599539 mapwrite 0x0140af thru 0x01b1a7 (0x70f9 bytes) 000468 1788753793.688595 mapread 0x02f41c thru 0x03f122 (0xfd07 bytes) 000470 1788753793.724256 MIRROR_RESYNC 3 mirrors 000471 1788753795.296263 mapread 0x01fc8d thru 0x02db33 (0xdea7 bytes) 000472 1788753795.362286 trunc from 0x040000 to 0x03a1ad (0x5e52 bytes) 000473 1788753795.477609 punch from 0x032c6d to 0x03a1ad (0x7541 bytes) 000474 1788753795.509304 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a1ae): Mirror 2: 0x905be0bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a1ae): Mirror 2: 0x905be0bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a1ae: skipped 000475 1788753795.915648 punch from 0x0352de to 0x035a63 (0x786 bytes) 000478 1788753795.929378 mapread 0x01fa8b thru 0x026530 (0x6aa6 bytes) 000479 1788753795.964226 trunc from 0x03a1ae to 0x0230a8 (0x17105 bytes) 000480 1788753795.988702 mapread 0x01e015 thru 0x02179f (0x378b bytes) 000482 1788753795.990746 write 0x03c478 thru 0x03ffff (0x3b88 bytes) 000483 1788753795.992252 write 0x00c44c thru 0x016c9a (0xa84f bytes) 000484 1788753796.007235 mapread 0x0097c5 thru 0x009f61 (0x79d bytes) 000485 1788753796.017127 write 0x008ced thru 0x01297b (0x9c8f bytes) 000486 1788753796.019082 trunc from 0x040000 to 0x00cce4 (0x3331b bytes) 000487 1788753796.036680 punch from 0x004281 to 0x00b113 (0x6e93 bytes) 000488 1788753796.063178 MIRROR_RESYNC 2 mirrors 000489 1788753797.044363 mapwrite 0x035391 thru 0x039c5c (0x48cc bytes) 000491 1788753797.263207 mapwrite 0x005570 thru 0x00eae4 (0x9575 bytes) 000494 1788753797.329243 read 0x026028 thru 0x02989d (0x3876 bytes) 000495 1788753797.341042 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39c5d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c5d): Mirror 2: 0x1ea4813d (stale) CRC-32 checksum value for chunk [0, 0x39c5d): Mirror 1: 0x36f47b33 Mirror 3: 0x36f47b33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c5d: skipped 000498 1788753798.269527 read 0x00fce3 thru 0x01cae0 (0xcdfe bytes) 000499 1788753798.284394 MIRROR_RESYNC 3 mirrors 000500 1788753799.077526 punch from 0x01621f to 0x022662 (0xc444 bytes) 000501 1788753799.157961 mapread 0x035e0c thru 0x039c5c (0x3e51 bytes) 000503 1788753799.182994 read 0x00c51f thru 0x00e955 (0x2437 bytes) 000504 1788753799.187531 mapwrite 0x034d33 thru 0x03ffff (0xb2cd bytes) 000505 1788753799.310006 trunc from 0x040000 to 0x021e01 (0x1e1fe bytes) 000506 1788753799.333213 write 0x023877 thru 0x02b8d2 (0x805c bytes) 000507 1788753799.348193 MIRROR_RESYNC 3 mirrors 000508 1788753800.137183 write 0x01fc04 thru 0x021b2e (0x1f2b bytes) 000509 1788753800.210201 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b8d3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8d3): Mirror 2: 0x2dd2bdc3 (stale) Mirror 3: 0x2dd2bdc3 (stale) CRC-32 checksum value for chunk [0, 0x2b8d3): Mirror 1: 0x53bbe007 Mirror 4: 0x53bbe007 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8d3: skipped 000511 1788753801.349795 mapread 0x01eeff thru 0x02aec3 (0xbfc5 bytes) 000512 1788753801.374754 mapread 0x0073b9 thru 0x0158d8 (0xe520 bytes) 000516 1788753801.396639 read 0x0199bc thru 0x019b8d (0x1d2 bytes) 000518 1788753801.412754 MIRROR_RESYNC 4 mirrors 000519 1788753802.611748 write 0x0357b3 thru 0x03ffff (0xa84d bytes) 000521 1788753802.671687 mapwrite 0x03156d thru 0x037e03 (0x6897 bytes) 000523 1788753802.775063 read 0x019d04 thru 0x01d081 (0x337e bytes) 000524 1788753802.786041 trunc from 0x040000 to 0x039820 (0x67df bytes) 000525 1788753802.828215 write 0x01c746 thru 0x02967e (0xcf39 bytes) 000527 1788753802.838256 mapwrite 0x0281df thru 0x0284c2 (0x2e4 bytes) 000529 1788753802.911437 mapread 0x00dacc thru 0x01a66e (0xcba3 bytes) 000530 1788753802.942147 MIRROR_RESYNC 4 mirrors 000531 1788753804.568312 write 0x038bbc thru 0x03ffff (0x7444 bytes) 000535 1788753804.652560 write 0x006752 thru 0x006a90 (0x33f bytes) 000538 1788753804.661734 write 0x03b4cb thru 0x03ffff (0x4b35 bytes) 000540 1788753804.664215 mapwrite 0x009a3d thru 0x00d15f (0x3723 bytes) 000542 1788753804.730110 mapread 0x01d9ff thru 0x023c60 (0x6262 bytes) 000544 1788753804.739286 punch from 0x017fe7 to 0x01ea23 (0x6a3d bytes) 000546 1788753804.743795 mapwrite 0x01a109 thru 0x0299dd (0xf8d5 bytes) 000547 1788753804.813322 MIRROR_RESYNC 4 mirrors 000548 1788753806.701682 MIRROR_RESYNC 4 mirrors 000549 1788753807.089399 punch from 0x03df27 to 0x03ffff (0x20d9 bytes) 000550 1788753807.205664 mapread 0x0235d1 thru 0x032fe6 (0xfa16 bytes) 000551 1788753807.231228 read 0x0083ef thru 0x011623 (0x9235 bytes) 000552 1788753807.264761 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba7e6fd1 (stale) Mirror 3: 0xba7e6fd1 (stale) Mirror 4: 0xba7e6fd1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdf81c085 Mirror 5: 0xdf81c085 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000555 1788753808.597739 mapread 0x0383b2 thru 0x03fa9f (0x76ee bytes) 000556 1788753808.660049 read 0x03fef7 thru 0x03ffff (0x109 bytes) 000558 1788753808.697187 mapwrite 0x0186aa thru 0x01e200 (0x5b57 bytes) 000560 1788753808.947951 mapread 0x00cab6 thru 0x00e4e9 (0x1a34 bytes) 000561 1788753808.955176 write 0x02a0f5 thru 0x035370 (0xb27c bytes) 000563 1788753808.970118 trunc from 0x040000 to 0x01547d (0x2ab82 bytes) 000564 1788753809.012444 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1547e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1547e): Mirror 2: 0x9f9e586b (stale) Mirror 3: 0x9f9e586b (stale) Mirror 4: 0x9f9e586b (stale) Mirror 5: 0x9f9e586b (stale) CRC-32 checksum value for chunk [0, 0x1547e): Mirror 1: 0x9f9e586b Mirror 6: 0x9f9e586b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1547e: skipped 000565 1788753809.993698 mapwrite 0x01d737 thru 0x020c6f (0x3539 bytes) 000569 1788753810.209023 mapread 0x008bc5 thru 0x017daf (0xf1eb bytes) 000570 1788753810.247449 write 0x0360bf thru 0x0392fb (0x323d bytes) 000572 1788753810.252095 mapread 0x012f56 thru 0x01824d (0x52f8 bytes) 000573 1788753810.253147 write 0x009aeb thru 0x00e05d (0x4573 bytes) 000574 1788753810.255226 read 0x020dfc thru 0x03061d (0xf822 bytes) 000575 1788753810.265796 trunc from 0x0392fc to 0x02ca87 (0xc874 bytes) 000576 1788753810.297242 write 0x03ec0c thru 0x03ffff (0x13f4 bytes) 000577 1788753810.299250 read 0x03d29c thru 0x03ffff (0x2d64 bytes) 000578 1788753810.308746 punch from 0x00aa1f to 0x00df9b (0x357d bytes) 000581 1788753810.329863 read 0x00b766 thru 0x00d642 (0x1edd bytes) 000583 1788753810.338771 read 0x03cd4b thru 0x03ffff (0x32b5 bytes) 000584 1788753810.339752 punch from 0x0091ef to 0x0132e4 (0xa0f6 bytes) 000585 1788753810.345712 mapread 0x017766 thru 0x023d61 (0xc5fc bytes) 000586 1788753810.352296 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba7e6fd1 (stale) Mirror 3: 0xba7e6fd1 (stale) Mirror 4: 0xba7e6fd1 (stale) Mirror 5: 0xdf81c085 (stale) Mirror 6: 0x51d93e35 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a42edac Mirror 7: 0x6a42edac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000589 1788753811.571093 trunc from 0x040000 to 0x0013a2 (0x3ec5d bytes) 000590 1788753811.666962 punch from 0x000d0e to 0x0013a2 (0x695 bytes) 000591 1788753811.685592 mapread 0x000824 thru 0x0013a2 (0xb7f bytes) 000593 1788753811.695791 read 0x000a32 thru 0x0013a2 (0x971 bytes) 000594 1788753811.701566 write 0x036143 thru 0x03eeb0 (0x8d6e bytes) 000595 1788753811.705654 write 0x0163dc thru 0x0167ca (0x3ef bytes) 000596 1788753811.713012 mapwrite 0x0101c6 thru 0x01aecf (0xad0a bytes) 000598 1788753811.822509 trunc from 0x03eeb1 to 0x02a905 (0x145ab bytes) 000599 1788753811.847482 MIRROR_RESYNC 7 mirrors 000600 1788753813.551596 mapwrite 0x00fdaf thru 0x01aee7 (0xb139 bytes) 000601 1788753813.743677 write 0x0267c0 thru 0x02d89c (0x70dd bytes) 000602 1788753813.758910 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d89d): Mirror 3: 0xba5ed233 (stale) Mirror 4: 0xba5ed233 (stale) Mirror 5: 0xba5ed233 (stale) Mirror 6: 0xba5ed233 (stale) Mirror 7: 0xba5ed233 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d89d): Mirror 3: 0xba5ed233 (stale) Mirror 4: 0xba5ed233 (stale) Mirror 5: 0xba5ed233 (stale) Mirror 6: 0xba5ed233 (stale) Mirror 7: 0xba5ed233 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d89d: skipped 000604 1788753814.280255 mapread 0x0087e5 thru 0x01212a (0x9946 bytes) 000606 1788753814.314146 mapread 0x011e51 thru 0x01442d (0x25dd bytes) 000611 1788753814.325895 mapread 0x001174 thru 0x00315f (0x1fec bytes) 000614 1788753814.337157 mapread 0x020462 thru 0x023c09 (0x37a8 bytes) 000615 1788753814.353224 write 0x031208 thru 0x03cc69 (0xba62 bytes) 000617 1788753814.355757 trunc from 0x03cc6a to 0x0129d3 (0x2a296 bytes) 000618 1788753814.374451 mapread 0x0037bd thru 0x0039c6 (0x20a bytes) 000621 1788753814.376208 mapread 0x00c70a thru 0x0129d3 (0x62ca bytes) 000623 1788753814.378962 mapread 0x008800 thru 0x0089ca (0x1cb bytes) 000624 1788753814.380104 write 0x001e6b thru 0x00838f (0x6525 bytes) 000625 1788753814.381880 mapwrite 0x026d2e thru 0x02ea87 (0x7d5a bytes) 000626 1788753814.486012 write 0x012f58 thru 0x019e9b (0x6f44 bytes) 000627 1788753814.496111 write 0x0312de thru 0x034248 (0x2f6b bytes) 000628 1788753814.504242 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34249): Mirror 3: 0xd93ba625 (stale) Mirror 4: 0xd93ba625 (stale) Mirror 5: 0xd93ba625 (stale) Mirror 6: 0xd93ba625 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34249): Mirror 3: 0xd93ba625 (stale) Mirror 4: 0xd93ba625 (stale) Mirror 5: 0xd93ba625 (stale) Mirror 6: 0xd93ba625 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34249: skipped 000631 1788753814.902318 mapwrite 0x0386c3 thru 0x03ffff (0x793d bytes) 000632 1788753815.044669 write 0x009979 thru 0x01002f (0x66b7 bytes) 000633 1788753815.052122 write 0x00ba19 thru 0x016e9a (0xb482 bytes) 000635 1788753815.058188 mapread 0x0348f6 thru 0x038242 (0x394d bytes) 000637 1788753815.059590 mapwrite 0x004210 thru 0x009b87 (0x5978 bytes) 000638 1788753815.106963 read 0x0069ad thru 0x010377 (0x99cb bytes) 000640 1788753815.108570 mapwrite 0x034bb3 thru 0x036535 (0x1983 bytes) 000642 1788753815.150506 punch from 0x00b362 to 0x011d85 (0x6a24 bytes) 000643 1788753815.158878 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9bef235e (stale) Mirror 4: 0x9bef235e (stale) Mirror 6: 0x9bef235e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9bef235e (stale) Mirror 4: 0x9bef235e (stale) Mirror 6: 0x9bef235e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000646 1788753815.465504 write 0x029492 thru 0x02dd3f (0x48ae bytes) 000648 1788753815.474328 mapwrite 0x03744a thru 0x03ffff (0x8bb6 bytes) 000649 1788753815.544459 trunc from 0x040000 to 0x0082c4 (0x37d3b bytes) 000650 1788753815.561160 read 0x00669f thru 0x0082c4 (0x1c26 bytes) 000652 1788753815.570164 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x82c5): Mirror 3: 0xc62af61 (stale) Mirror 6: 0xc62af61 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x82c5): Mirror 3: 0xc62af61 (stale) Mirror 6: 0xc62af61 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x82c5: skipped 000653 1788753815.867177 trunc from 0x0082c5 to 0x0348a8 (0x2c5e4 bytes) 000654 1788753815.880202 mapread 0x00b619 thru 0x00d264 (0x1c4c bytes) 000655 1788753815.896699 read 0x01c2cc thru 0x01d7dd (0x1512 bytes) 000657 1788753815.906455 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x348a9): Mirror 3: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348a9): Mirror 3: 0x50b1edeb (stale) Mirror 6: 0x50b1edeb (stale) CRC-32 checksum value for chunk [0, 0x348a9): Mirror 1: 0x5fe08785 Mirror 7: 0x5fe08785 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348a9: skipped 000658 1788753817.054645 write 0x025e74 thru 0x02c780 (0x690d bytes) 000659 1788753817.152349 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x348a9): Mirror 3: 0x50b1edeb (stale) Mirror 6: 0x50b1edeb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348a9): Mirror 3: 0x50b1edeb (stale) Mirror 6: 0x50b1edeb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348a9: skipped 000660 1788753817.472109 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x348a9): Mirror 6: 0x50b1edeb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348a9): Mirror 6: 0x50b1edeb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348a9: skipped 000663 1788753817.840008 write 0x0085d5 thru 0x011f8b (0x99b7 bytes) 000664 1788753817.855388 write 0x03655a thru 0x03ffff (0x9aa6 bytes) 000665 1788753817.861950 MIRROR_RESYNC 2 mirrors 000666 1788753818.666262 mapwrite 0x03cb90 thru 0x03ffff (0x3470 bytes) 000668 1788753818.799729 mapread 0x018e62 thru 0x01f76f (0x690e bytes) 000669 1788753818.812191 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000671 1788753818.931781 mapread 0x00a354 thru 0x00ef9d (0x4c4a bytes) 000672 1788753818.949798 mapwrite 0x03452f thru 0x03ffff (0xbad1 bytes) 000673 1788753819.024688 read 0x03166b thru 0x033fd6 (0x296c bytes) 000674 1788753819.025697 trunc from 0x040000 to 0x014844 (0x2b7bb bytes) 000675 1788753819.049252 mapread 0x011f14 thru 0x0125c4 (0x6b1 bytes) 000679 1788753819.058030 punch from 0x00995a to 0x00e596 (0x4c3d bytes) 000684 1788753819.069500 mapread 0x00a054 thru 0x014844 (0xa7f1 bytes) 000685 1788753819.078541 read 0x010a2a thru 0x012d1e (0x22f5 bytes) 000686 1788753819.079416 write 0x026942 thru 0x027edf (0x159e bytes) 000687 1788753819.081706 mapwrite 0x0343e2 thru 0x03ffff (0xbc1e bytes) 000688 1788753819.191340 mapwrite 0x01281d thru 0x01bdc6 (0x95aa bytes) 000689 1788753819.233556 read 0x00704a thru 0x00af9b (0x3f52 bytes) 000690 1788753819.234504 read 0x01c4da thru 0x01f487 (0x2fae bytes) 000691 1788753819.235158 punch from 0x03b9e2 to 0x03f73c (0x3d5b bytes) 000692 1788753819.240045 mapwrite 0x00d267 thru 0x0179b2 (0xa74c bytes) 000694 1788753819.285696 punch from 0x00e523 to 0x00ed9c (0x87a bytes) 000695 1788753819.290257 write 0x00c495 thru 0x00c72e (0x29a bytes) 000696 1788753819.291464 mapwrite 0x00f47d thru 0x014c93 (0x5817 bytes) 000697 1788753819.333178 punch from 0x03322d to 0x03d537 (0xa30b bytes) 000700 1788753819.339133 mapwrite 0x02cda2 thru 0x02e409 (0x1668 bytes) 000701 1788753819.384013 mapread 0x036b26 thru 0x03ffff (0x94da bytes) 000702 1788753819.394949 trunc from 0x040000 to 0x0045da (0x3ba25 bytes) 000704 1788753819.417732 read 0x002994 thru 0x0045da (0x1c47 bytes) 000705 1788753819.419876 read 0x002a5b thru 0x0045da (0x1b80 bytes) 000707 1788753819.421916 read 0x0021b4 thru 0x0045da (0x2427 bytes) 000710 1788753819.424707 trunc from 0x0045db to 0x00ff40 (0xb966 bytes) 000711 1788753819.448313 mapwrite 0x03f618 thru 0x03fac6 (0x4af bytes) 000713 1788753819.608529 read 0x005979 thru 0x00e8dc (0x8f64 bytes) 000714 1788753819.611500 trunc from 0x03fac7 to 0x001ef2 (0x3dbd4 bytes) 000715 1788753819.645531 mapread 0x000c24 thru 0x001ef2 (0x12cf bytes) 000716 1788753819.647250 trunc from 0x001ef3 to 0x004bee (0x2cfc bytes) 000717 1788753819.672645 trunc from 0x004bef to 0x023750 (0x1eb62 bytes) 000718 1788753819.706027 trunc from 0x023751 to 0x0267b5 (0x3065 bytes) 000719 1788753819.721221 write 0x02a5b8 thru 0x03a1f9 (0xfc42 bytes) 000722 1788753819.726194 trunc from 0x03a1fa to 0x0078f9 (0x32900 bytes) 000723 1788753819.748210 mapread 0x0018fc thru 0x006c05 (0x530a bytes) 000724 1788753819.763563 write 0x003821 thru 0x008fcd (0x57ad bytes) 000726 1788753819.773696 read 0x003cf4 thru 0x008c9a (0x4fa7 bytes) 000727 1788753819.776652 mapread 0x006354 thru 0x008fcd (0x2c7a bytes) 000728 1788753819.778598 mapread 0x006cc6 thru 0x008fcd (0x2308 bytes) 000730 1788753819.783576 write 0x02ebd9 thru 0x0365d7 (0x79ff bytes) 000732 1788753819.788175 punch from 0x026de6 to 0x036550 (0xf76b bytes) 000733 1788753819.840451 mapread 0x016c4a thru 0x022afd (0xbeb4 bytes) 000734 1788753819.864419 read 0x0147f1 thru 0x0214ee (0xccfe bytes) 000735 1788753819.865085 trunc from 0x0365d8 to 0x01bdb4 (0x1a823 bytes) 000736 1788753819.898009 mapwrite 0x032366 thru 0x03ddfa (0xba95 bytes) 000737 1788753820.044390 read 0x016bb3 thru 0x01ac87 (0x40d5 bytes) 000741 1788753820.051698 mapread 0x031fa7 thru 0x038aad (0x6b07 bytes) 000742 1788753820.053515 mapwrite 0x0096ca thru 0x00d3ea (0x3d21 bytes) 000743 1788753820.124008 trunc from 0x03ddfb to 0x0208b2 (0x1d548 bytes) 000745 1788753820.138509 write 0x01eeda thru 0x020bdc (0x1d03 bytes) 000746 1788753820.139415 mapread 0x020824 thru 0x020bdc (0x3b9 bytes) 000748 1788753820.141449 mapwrite 0x0360d7 thru 0x0371d3 (0x10fd bytes) 000749 1788753820.229053 punch from 0x033174 to 0x03320c (0x99 bytes) 000751 1788753820.235123 mapwrite 0x008c31 thru 0x00b2e3 (0x26b3 bytes) 000753 1788753820.272106 write 0x00257c thru 0x00d697 (0xb11c bytes) 000754 1788753820.274173 trunc from 0x0371d4 to 0x027f05 (0xf2ce bytes) 000755 1788753820.298952 mapread 0x006eac thru 0x00c16b (0x52c0 bytes) 000756 1788753820.304671 MIRROR_EXTEND to 2 mirrors 000757 1788753821.687552 write 0x02137f thru 0x0239ce (0x2650 bytes) 000759 1788753821.763236 mapread 0x017636 thru 0x01884a (0x1215 bytes) 000761 1788753821.772664 punch from 0x0150a3 to 0x01ae95 (0x5df3 bytes) 000762 1788753821.779252 mapread 0x01ec78 thru 0x0218ab (0x2c34 bytes) 000763 1788753821.786400 read 0x01ef76 thru 0x01fd5c (0xde7 bytes) 000765 1788753821.787633 mapwrite 0x03486d thru 0x03ffff (0xb793 bytes) 000766 1788753821.880946 write 0x02c2c5 thru 0x034d27 (0x8a63 bytes) 000767 1788753821.888660 read 0x00f43d thru 0x0176cc (0x8290 bytes) 000768 1788753821.901203 read 0x0379b5 thru 0x03ffff (0x864b bytes) 000769 1788753821.901736 mapwrite 0x00854d thru 0x01596a (0xd41e bytes) 000771 1788753821.969291 read 0x015377 thru 0x01d786 (0x8410 bytes) 000772 1788753821.969908 mapread 0x01f837 thru 0x02e1c6 (0xe990 bytes) 000773 1788753821.970799 mapwrite 0x02585c thru 0x025cf1 (0x496 bytes) 000774 1788753822.011129 mapread 0x03bc2e thru 0x03c893 (0xc66 bytes) 000776 1788753822.013139 trunc from 0x040000 to 0x009923 (0x366dc bytes) 000777 1788753822.027711 punch from 0x00973e to 0x009923 (0x1e6 bytes) 000780 1788753822.034160 mapwrite 0x01c45f thru 0x025ece (0x9a70 bytes) 000781 1788753822.095910 read 0x0065b9 thru 0x013bc8 (0xd610 bytes) 000782 1788753822.096993 read 0x00ba95 thru 0x01b18c (0xf6f8 bytes) 000785 1788753822.103493 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25ecf): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ecf): Mirror 2: 0xfb7fd4d7 (stale) CRC-32 checksum value for chunk [0, 0x25ecf): Mirror 1: 0x3528480f Mirror 3: 0x3528480f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ecf: skipped 000786 1788753822.847855 mapread 0x024fe7 thru 0x025ece (0xee8 bytes) 000787 1788753822.875648 mapwrite 0x0094a1 thru 0x00f81d (0x637d bytes) 000788 1788753823.124682 trunc from 0x025ecf to 0x03abda (0x14d0c bytes) 000789 1788753823.191101 punch from 0x01e155 to 0x02122c (0x30d8 bytes) 000792 1788753823.202609 MIRROR_RESYNC 3 mirrors 000793 1788753824.510549 MIRROR_EXTEND to 4 mirrors 000794 1788753825.379884 punch from 0x02e2c9 to 0x037f45 (0x9c7d bytes) 000798 1788753825.473018 trunc from 0x03abdb to 0x0016b5 (0x39525 bytes) 000803 1788753825.520448 write 0x00ec62 thru 0x018233 (0x95d2 bytes) 000804 1788753825.521894 trunc from 0x018234 to 0x014feb (0x3248 bytes) 000806 1788753825.549138 mapread 0x00cebd thru 0x014feb (0x812f bytes) 000810 1788753825.577909 write 0x023559 thru 0x02a15f (0x6c07 bytes) 000811 1788753825.579675 punch from 0x026659 to 0x02a15f (0x3b07 bytes) 000812 1788753825.613278 trunc from 0x02a160 to 0x00d938 (0x1c827 bytes) 000813 1788753825.639983 mapwrite 0x02395d thru 0x028e8a (0x552e bytes) 000816 1788753825.787024 write 0x01d42e thru 0x02052c (0x30ff bytes) 000817 1788753825.788003 write 0x016c53 thru 0x02267b (0xba29 bytes) 000819 1788753825.795590 write 0x00636e thru 0x00c9ee (0x6681 bytes) 000820 1788753825.802553 trunc from 0x028e8b to 0x0301cb (0x7341 bytes) 000822 1788753825.827439 mapwrite 0x01d64d thru 0x023d67 (0x671b bytes) 000823 1788753825.951389 punch from 0x02f026 to 0x0301cb (0x11a6 bytes) 000826 1788753825.975779 write 0x02161d thru 0x022830 (0x1214 bytes) 000828 1788753825.977664 mapread 0x006056 thru 0x006172 (0x11d bytes) 000829 1788753825.979060 trunc from 0x0301cc to 0x03edfc (0xec31 bytes) 000830 1788753826.004115 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0x7ab786b0 (stale) Mirror 4: 0x7ab786b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0x7ab786b0 (stale) Mirror 4: 0x7ab786b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edfd: skipped 000834 1788753826.441997 read 0x006e72 thru 0x00d5c8 (0x6757 bytes) 000836 1788753826.473875 punch from 0x00ddfa to 0x01a212 (0xc419 bytes) 000838 1788753826.490036 mapwrite 0x02ff40 thru 0x0388c0 (0x8981 bytes) 000839 1788753826.686567 mapwrite 0x028c32 thru 0x0342bf (0xb68e bytes) 000840 1788753826.763110 mapwrite 0x01a8cd thru 0x01e055 (0x3789 bytes) 000842 1788753826.805442 write 0x02fe20 thru 0x033757 (0x3938 bytes) 000843 1788753826.806670 write 0x02b202 thru 0x033247 (0x8046 bytes) 000845 1788753826.825178 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0x7ab786b0 (stale) Mirror 4: 0x7ab786b0 (stale) CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 1: 0xc947a61c Mirror 5: 0xc947a61c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edfd: skipped 000846 1788753828.070565 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0x7ab786b0 (stale) Mirror 4: 0x7ab786b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0x7ab786b0 (stale) Mirror 4: 0x7ab786b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edfd: skipped 000847 1788753828.559614 read 0x02f948 thru 0x0383ae (0x8a67 bytes) 000848 1788753828.569549 mapread 0x00a014 thru 0x019766 (0xf753 bytes) 000850 1788753828.602692 write 0x01b13b thru 0x02717a (0xc040 bytes) 000851 1788753828.624894 mapread 0x039d81 thru 0x03edfc (0x507c bytes) 000852 1788753828.639180 MIRROR_RESYNC 3 mirrors 000853 1788753830.241429 write 0x0271fc thru 0x02a724 (0x3529 bytes) 000854 1788753830.307605 punch from 0x02a58c to 0x03a13b (0xfbb0 bytes) 000856 1788753830.317087 punch from 0x01973d to 0x01fb4e (0x6412 bytes) 000857 1788753830.321498 mapread 0x01ade0 thru 0x029f31 (0xf152 bytes) 000858 1788753830.348487 read 0x037320 thru 0x038b2a (0x180b bytes) 000859 1788753830.358780 MIRROR_RESYNC 3 mirrors 000860 1788753831.767169 mapwrite 0x0182ab thru 0x01bd5c (0x3ab2 bytes) 000864 1788753832.099140 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0xa4ac516d (stale) Mirror 4: 0xa4ac516d (stale) CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 1: 0x3afd8823 Mirror 5: 0x3afd8823 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edfd: skipped 000865 1788753833.424268 mapread 0x02edfd thru 0x0340d7 (0x52db bytes) 000866 1788753833.442890 mapwrite 0x027219 thru 0x02ffeb (0x8dd3 bytes) 000867 1788753833.655287 read 0x00738a thru 0x00e37b (0x6ff2 bytes) 000868 1788753833.664745 punch from 0x02354b to 0x02fdcb (0xc881 bytes) 000871 1788753833.674924 write 0x023c9b thru 0x031370 (0xd6d6 bytes) 000874 1788753833.690025 read 0x00c151 thru 0x01551c (0x93cc bytes) 000875 1788753833.714053 mapwrite 0x001f3e thru 0x00e6b8 (0xc77b bytes) 000877 1788753833.820751 write 0x00441d thru 0x00ecfb (0xa8df bytes) 000878 1788753833.823726 mapwrite 0x01ac0d thru 0x027024 (0xc418 bytes) 000880 1788753833.887613 write 0x01971b thru 0x01ee13 (0x56f9 bytes) 000881 1788753833.889122 mapwrite 0x0257fe thru 0x02cd96 (0x7599 bytes) 000882 1788753833.968056 mapwrite 0x02f74e thru 0x031cd9 (0x258c bytes) 000883 1788753834.020889 write 0x020613 thru 0x030024 (0xfa12 bytes) 000885 1788753834.026208 mapwrite 0x004a75 thru 0x00a17d (0x5709 bytes) 000886 1788753834.083897 write 0x016e9a thru 0x01c322 (0x5489 bytes) 000887 1788753834.090529 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0xa4ac516d (stale) Mirror 4: 0xa4ac516d (stale) Mirror 5: 0x3afd8823 (stale) CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 1: 0x12eb7eef Mirror 6: 0x12eb7eef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edfd: skipped 000890 1788753835.296535 punch from 0x01ee31 to 0x02a022 (0xb1f2 bytes) 000891 1788753835.407649 mapread 0x01df8c thru 0x022fba (0x502f bytes) 000892 1788753835.455770 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 3: 0xa4ac516d (stale) Mirror 4: 0xa4ac516d (stale) Mirror 5: 0x3afd8823 (stale) Mirror 6: 0x12eb7eef (stale) CRC-32 checksum value for chunk [0, 0x3edfd): Mirror 1: 0xf4c30646 Mirror 7: 0xf4c30646 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edfd: skipped 000893 1788753836.706602 trunc from 0x03edfd to 0x000ade (0x3e31e bytes) 000894 1788753836.836526 write 0x001653 thru 0x006101 (0x4aaf bytes) 000895 1788753836.840864 MIRROR_RESYNC 6 mirrors 000896 1788753838.052357 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000897 1788753838.411221 punch from 0x00481b to 0x004ead (0x693 bytes) 000898 1788753838.480730 mapwrite 0x02eb8b thru 0x03b3b6 (0xc82c bytes) 000899 1788753838.584773 read 0x0261d3 thru 0x03455f (0xe38d bytes) 000900 1788753838.590793 read 0x01bd92 thru 0x01e84b (0x2aba bytes) 000902 1788753838.602099 write 0x023bd6 thru 0x02a16e (0x6599 bytes) 000903 1788753838.604032 trunc from 0x03b3b7 to 0x025502 (0x15eb4 bytes) 000905 1788753838.623312 mapwrite 0x0335f1 thru 0x03fec9 (0xc8d9 bytes) 000906 1788753838.829383 trunc from 0x03feca to 0x02f376 (0x10b53 bytes) 000910 1788753838.847205 read 0x0167c9 thru 0x01d656 (0x6e8e bytes) 000911 1788753838.847799 mapwrite 0x0379b3 thru 0x03ffff (0x864d bytes) 000912 1788753838.911565 mapread 0x021c6a thru 0x02e43b (0xc7d2 bytes) 000913 1788753838.917361 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8a8a88ee (stale) Mirror 6: 0x8a8a88ee (stale) Mirror 7: 0x8a8a88ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8a8a88ee (stale) Mirror 6: 0x8a8a88ee (stale) Mirror 7: 0x8a8a88ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000914 1788753839.264870 mapwrite 0x0051e9 thru 0x00d020 (0x7e38 bytes) 000918 1788753839.346903 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8a8a88ee (stale) Mirror 6: 0x8a8a88ee (stale) Mirror 7: 0x8a8a88ee (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65be873f Mirror 8: 0x65be873f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000919 1788753840.230995 mapread 0x0282ad thru 0x031189 (0x8edd bytes) 000921 1788753840.273760 trunc from 0x040000 to 0x00a6cd (0x35932 bytes) 000924 1788753840.463469 punch from 0x00a57f to 0x00a6cd (0x14f bytes) 000925 1788753840.472909 read 0x000152 thru 0x002038 (0x1ee7 bytes) 000926 1788753840.485348 punch from 0x000b69 to 0x0081b3 (0x764b bytes) 000928 1788753840.499682 mapread 0x0038bd thru 0x007e11 (0x4555 bytes) 000929 1788753840.515756 mapwrite 0x0305ea thru 0x03c2f9 (0xbd10 bytes) 000930 1788753840.608558 mapread 0x030aa1 thru 0x03c2f9 (0xb859 bytes) 000931 1788753840.610307 trunc from 0x03c2fa to 0x03cf13 (0xc1a bytes) 000932 1788753840.632354 mapread 0x020987 thru 0x030142 (0xf7bc bytes) 000933 1788753840.650623 read 0x00c8af thru 0x0175d7 (0xad29 bytes) 000934 1788753840.666431 mapread 0x001c81 thru 0x003d1a (0x209a bytes) 000935 1788753840.667932 mapread 0x00c72a thru 0x00cdea (0x6c1 bytes) 000937 1788753840.677202 trunc from 0x03cf14 to 0x00169f (0x3b874 bytes) 000940 1788753840.719947 mapread 0x000094 thru 0x00169f (0x160c bytes) 000942 1788753840.728039 write 0x01aef0 thru 0x027b33 (0xcc44 bytes) 000943 1788753840.733897 read 0x014e8f thru 0x022cc2 (0xde34 bytes) 000944 1788753840.750236 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27b34): Mirror 3: 0x577de658 (stale) Mirror 6: 0x577de658 (stale) Mirror 8: 0x1348c85b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b34): Mirror 3: 0x577de658 (stale) Mirror 6: 0x577de658 (stale) Mirror 8: 0x1348c85b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b34: skipped 000945 1788753841.069582 trunc from 0x027b34 to 0x02d379 (0x5846 bytes) 000946 1788753841.097966 mapread 0x00fe2d thru 0x018b1b (0x8cef bytes) 000950 1788753841.132343 mapread 0x0032f8 thru 0x006c43 (0x394c bytes) 000952 1788753841.151805 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d37a): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d37a): Mirror 3: 0x8c13cf96 (stale) Mirror 6: 0x8c13cf96 (stale) Mirror 8: 0xc881c1d6 (stale) CRC-32 checksum value for chunk [0, 0x2d37a): Mirror 1: 0x5165ed9d Mirror 9: 0x5165ed9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d37a: skipped 000953 1788753842.318382 mapread 0x017fce thru 0x01d4af (0x54e2 bytes) 000954 1788753842.362514 write 0x02747d thru 0x02c42f (0x4fb3 bytes) 000955 1788753842.450246 write 0x0335d8 thru 0x03f4ad (0xbed6 bytes) 000956 1788753842.451952 mapwrite 0x03c383 thru 0x03d63e (0x12bc bytes) 000957 1788753842.516257 mapwrite 0x00ebc3 thru 0x0105d7 (0x1a15 bytes) 000958 1788753842.567432 punch from 0x014e06 to 0x023e2a (0xf025 bytes) 000959 1788753842.572348 punch from 0x004f55 to 0x0056af (0x75b bytes) 000962 1788753842.587568 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f4ae): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f4ae): Mirror 3: 0x6fa3d197 (stale) Mirror 6: 0x6fa3d197 (stale) Mirror 8: 0x4da67f52 (stale) Mirror 9: 0x1f832806 (stale) CRC-32 checksum value for chunk [0, 0x3f4ae): Mirror 1: 0x5bd08bb3 Mirror 10: 0x5bd08bb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f4ae: skipped 000963 1788753844.285172 trunc from 0x03f4ae to 0x030479 (0xf034 bytes) 000965 1788753844.430992 read 0x0087c9 thru 0x00e4cc (0x5d04 bytes) 000967 1788753844.446248 read 0x01726d thru 0x0256b8 (0xe44c bytes) 000969 1788753844.464129 punch from 0x02de0f to 0x030479 (0x266b bytes) 000971 1788753844.472886 write 0x036b02 thru 0x03ffff (0x94fe bytes) 000972 1788753844.476638 trunc from 0x040000 to 0x00d82f (0x327d0 bytes) 000973 1788753844.504656 punch from 0x00b31d to 0x00d82f (0x2513 bytes) 000974 1788753844.510127 read 0x003e1b thru 0x00765d (0x3843 bytes) 000976 1788753844.511417 write 0x014d74 thru 0x0185f6 (0x3883 bytes) 000977 1788753844.513219 mapwrite 0x032496 thru 0x03ffff (0xdb6a bytes) 000978 1788753844.604391 write 0x024a67 thru 0x02d120 (0x86ba bytes) 000979 1788753844.606495 mapread 0x01a487 thru 0x0261a7 (0xbd21 bytes) 000980 1788753844.608228 mapwrite 0x0080cb thru 0x00917b (0x10b1 bytes) 000981 1788753844.749546 trunc from 0x040000 to 0x00349e (0x3cb61 bytes) 000982 1788753844.787049 read 0x00016f thru 0x00349e (0x3330 bytes) 000983 1788753844.787705 mapwrite 0x028806 thru 0x02ea9e (0x6299 bytes) 000984 1788753844.948674 read 0x0102c3 thru 0x01ca60 (0xc79e bytes) 000986 1788753844.949900 mapwrite 0x03c7b2 thru 0x03ffff (0x384e bytes) 000987 1788753845.076451 write 0x003b17 thru 0x00805e (0x4548 bytes) 000988 1788753845.077595 mapwrite 0x03c848 thru 0x03df9e (0x1757 bytes) 000989 1788753845.112348 read 0x02835e thru 0x032c8b (0xa92e bytes) 000990 1788753845.113262 trunc from 0x040000 to 0x026ed0 (0x1912f bytes) 000991 1788753845.137096 trunc from 0x026ed1 to 0x0361f9 (0xf329 bytes) 000993 1788753845.154391 punch from 0x001495 to 0x00aebd (0x9a29 bytes) 000994 1788753845.159547 read 0x026e37 thru 0x02fedb (0x90a5 bytes) 000995 1788753845.170335 mapread 0x006ec8 thru 0x00e2c5 (0x73fe bytes) 000997 1788753845.171870 read 0x00068c thru 0x0054aa (0x4e1f bytes) 000998 1788753845.172403 mapwrite 0x020029 thru 0x024d99 (0x4d71 bytes) All operations completed A-OK!