== sanity-flr test 70a: flr mode fsx test ================ 21:46:17 (1776995177) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 5180 skipping zero length punch hole skipping zero length punch hole 000003 1776995180.856984 MIRROR_EXTEND to 2 mirrors 000004 1776995181.403143 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) skipping zero length punch hole skipping zero size read 000008 1776995181.678151 write 0x02e40b thru 0x02ed74 (0x96a bytes) truncating to largest ever: 0x19dc6 000009 1776995181.693148 trunc from 0x02ed75 to 0x019dc5 (0x14faf bytes) 000011 1776995181.721934 read 0x00f82a thru 0x019dc5 (0xa59c bytes) 000012 1776995181.731280 read 0x000c66 thru 0x00a18a (0x9525 bytes) 000013 1776995181.743110 mapread 0x007d12 thru 0x0155a9 (0xd898 bytes) 000015 1776995181.745156 write 0x0187b7 thru 0x019347 (0xb91 bytes) 000016 1776995181.747262 write 0x01ba3a thru 0x026bbe (0xb185 bytes) 000017 1776995181.749371 mapwrite 0x017247 thru 0x02224c (0xb006 bytes) 000018 1776995181.797483 trunc from 0x0013de to 0x00d38f (0xbfb2 bytes) 000019 1776995181.808899 trunc from 0x00750c to 0x01385b (0xc350 bytes) truncating to largest ever: 0x297c8 000020 1776995181.821495 trunc from 0x026bbf to 0x0297c7 (0x2c09 bytes) 000022 1776995181.857430 write 0x02e49f thru 0x035800 (0x7362 bytes) 000023 1776995181.873468 mapwrite 0x029d45 thru 0x031029 (0x72e5 bytes) 000024 1776995181.916452 read 0x003a0f thru 0x004384 (0x976 bytes) 000025 1776995181.944887 MIRROR_EXTEND to 2 mirrors 000026 1776995183.004643 MIRROR_RESYNC 2 mirrors 000028 1776995183.572999 trunc from 0x005811 to 0x006593 (0xd83 bytes) truncating to largest ever: 0x301d2 000029 1776995183.665490 trunc from 0x035801 to 0x0301d1 (0x562f bytes) 000030 1776995183.760236 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000031 1776995184.084797 read 0x001dfa thru 0x005847 (0x3a4e bytes) 000033 1776995184.107109 mapwrite 0x000ed2 thru 0x00dffd (0xd12c bytes) 000034 1776995184.234118 mapread 0x0277b6 thru 0x02e1ea (0x6a35 bytes) 000035 1776995184.281517 punch from 0x024d89 to 0x025c2d (0xea5 bytes) 000036 1776995184.291551 trunc from 0x026050 to 0x027fa2 (0x1f53 bytes) 000037 1776995184.305428 mapwrite 0x03d9c8 thru 0x03ffff (0x2638 bytes) truncating to largest ever: 0x33180 000038 1776995184.463713 trunc from 0x040000 to 0x03317f (0xce80 bytes) 000039 1776995184.518945 read 0x00f4b8 thru 0x01a8af (0xb3f8 bytes) 000040 1776995184.541130 trunc from 0x033180 to 0x008368 (0x2ae17 bytes) 000044 1776995184.570570 mapread 0x001978 thru 0x007d33 (0x63bc bytes) 000046 1776995184.572908 trunc from 0x001017 to 0x004b31 (0x3b1b bytes) 000047 1776995184.583061 fallocate 0x020cbf thru 0x02b0a4 (0xa3e6 bytes) 000048 1776995184.597434 punch from 0x0039e4 to 0x008368 (0x4985 bytes) 000049 1776995184.610301 read 0x005229 thru 0x005e05 (0xbdd bytes) 000050 1776995184.644871 read 0x006d23 thru 0x008368 (0x1646 bytes) fallocating to largest ever: 0x35928 000051 1776995184.646356 fallocate 0x02ca62 thru 0x035927 (0x8ec6 bytes) 000052 1776995184.657376 punch from 0x0174c5 to 0x01b521 (0x405d bytes) 000053 1776995184.664449 punch from 0x02b37e to 0x035927 (0xa5aa bytes) 000054 1776995184.673860 write 0x016471 thru 0x0204ef (0xa07f bytes) 000055 1776995184.691149 read 0x02d5ed thru 0x035927 (0x833b bytes) 000056 1776995184.692377 trunc from 0x035928 to 0x031b7d (0x3daa bytes) 000057 1776995184.715500 trunc from 0x031b7e to 0x01a4bd (0x176c0 bytes) 000058 1776995184.734476 punch from 0x0070fa to 0x008639 (0x1540 bytes) 000059 1776995184.740977 mapwrite 0x03bc48 thru 0x03ffff (0x43b8 bytes) 000060 1776995184.795528 read 0x01733e thru 0x018204 (0xec7 bytes) 000062 1776995184.799379 trunc from 0x0041c5 to 0x00ef98 (0xadd4 bytes) 000064 1776995184.807362 write 0x00483d thru 0x0086e3 (0x3ea7 bytes) 000065 1776995184.821676 trunc from 0x01d4c4 to 0x023751 (0x628e bytes) 000066 1776995184.827142 write 0x00a5bc thru 0x00b189 (0xbce bytes) 000067 1776995184.830424 mapwrite 0x00679b thru 0x010e6b (0xa6d1 bytes) 000068 1776995184.851345 fallocate 0x00c931 thru 0x00ec30 (0x2300 bytes) 000069 1776995184.857206 mapwrite 0x02e44a thru 0x034198 (0x5d4f bytes) 000070 1776995184.884541 write 0x0196eb thru 0x020068 (0x697e bytes) 000071 1776995184.896442 punch from 0x0282d0 to 0x03764c (0xf37d bytes) 000072 1776995184.903504 fallocate 0x006e37 thru 0x00b613 (0x47dd bytes) 000073 1776995184.909385 mapread 0x0046da thru 0x013f28 (0xf84f bytes) 000074 1776995184.910804 fallocate 0x025307 thru 0x02d61f (0x8319 bytes) 000075 1776995184.919181 mapwrite 0x0145d5 thru 0x0166d7 (0x2103 bytes) 000077 1776995184.954250 read 0x00b8f9 thru 0x0126f6 (0x6dfe bytes) 000078 1776995184.956671 mapread 0x03b0bb thru 0x03ffff (0x4f45 bytes) 000079 1776995184.959468 write 0x006176 thru 0x0121cc (0xc057 bytes) 000080 1776995184.967128 read 0x03cc10 thru 0x03f86b (0x2c5c bytes) 000084 1776995185.002576 MIRROR_EXTEND to 2 mirrors 000085 1776995186.662889 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000086 1776995186.890817 mapread 0x000f4b thru 0x006741 (0x57f7 bytes) 000087 1776995186.931391 write 0x02e161 thru 0x036b52 (0x89f2 bytes) 000088 1776995186.959467 trunc from 0x00126e to 0x00aee2 (0x9c75 bytes) 000089 1776995186.965343 punch from 0x03a954 to 0x03ffff (0x56ac bytes) 000090 1776995186.971694 write 0x021fe6 thru 0x02d6ab (0xb6c6 bytes) 000091 1776995186.982948 read 0x001718 thru 0x010514 (0xedfd bytes) 000092 1776995187.000452 write 0x00bc4d thru 0x017137 (0xb4eb bytes) 000094 1776995187.022017 trunc from 0x023376 to 0x02be7c (0x8b07 bytes) 000095 1776995187.061805 mapread 0x00389c thru 0x0072ec (0x3a51 bytes) 000096 1776995187.064528 trunc from 0x040000 to 0x01ebc5 (0x2143a bytes) 000097 1776995187.115700 mapwrite 0x02c07a thru 0x02ef08 (0x2e8f bytes) 000099 1776995187.213450 mapwrite 0x01dfd8 thru 0x01e18a (0x1b3 bytes) 000101 1776995187.235440 mapwrite 0x02c12a thru 0x02d7bf (0x1696 bytes) 000102 1776995187.254935 MIRROR_EXTEND to 2 mirrors 000103 1776995188.370115 mapread 0x01b99d thru 0x02a18f (0xe7f3 bytes) 000104 1776995188.440264 trunc from 0x027de7 to 0x02918a (0x13a4 bytes) 000105 1776995188.499151 mapwrite 0x017e25 thru 0x0205b8 (0x8794 bytes) 000106 1776995188.586333 mapread 0x007e67 thru 0x0092b8 (0x1452 bytes) 000107 1776995188.605782 mapread 0x02df43 thru 0x02ef08 (0xfc6 bytes) 000108 1776995188.620932 mapread 0x00062c thru 0x008eee (0x88c3 bytes) 000109 1776995188.633344 punch from 0x00ee98 to 0x019d03 (0xae6c bytes) 000110 1776995188.648464 mapwrite 0x02bfb9 thru 0x035e2b (0x9e73 bytes) 000111 1776995188.798850 trunc from 0x016e5c to 0x01d5d8 (0x677d bytes) 000112 1776995188.825323 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35e2c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e2c): Mirror 2: 0x83e888a5 (stale) CRC-32 checksum value for chunk [0, 0x35e2c): Mirror 1: 0xd2e08dd5 Mirror 3: 0xd2e08dd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e2c: skipped 000113 1776995190.377023 trunc from 0x035e2c to 0x02cc52 (0x91d9 bytes) 000114 1776995190.534164 fallocate 0x027c2b thru 0x02e340 (0x6716 bytes) 000115 1776995190.556594 mapread 0x01f155 thru 0x01f4d6 (0x382 bytes) 000116 1776995190.569761 fallocate 0x0290a3 thru 0x02cd94 (0x3cf2 bytes) 000119 1776995190.585013 punch from 0x007f9a to 0x015526 (0xd58d bytes) 000120 1776995190.619605 mapwrite 0x020b87 thru 0x023ff4 (0x346e bytes) 000121 1776995190.718929 mapread 0x01129a thru 0x01b96a (0xa6d1 bytes) 000122 1776995190.737785 mapwrite 0x01a2c0 thru 0x021199 (0x6eda bytes) 000123 1776995190.768824 mapwrite 0x036f61 thru 0x03e76a (0x780a bytes) 000124 1776995190.842708 punch from 0x030552 to 0x03bec8 (0xb977 bytes) 000125 1776995190.852873 trunc from 0x03e76b to 0x01adc4 (0x239a6 bytes) 000126 1776995190.888344 write 0x00a4df thru 0x017ebf (0xd9e1 bytes) 000127 1776995190.896327 punch from 0x0079bb to 0x00b471 (0x3ab7 bytes) 000128 1776995190.945277 MIRROR_RESYNC 3 mirrors 000129 1776995192.255913 trunc from 0x01adc5 to 0x006bff (0x141c5 bytes) 000131 1776995192.317976 punch from 0x000fdb to 0x005c17 (0x4c3d bytes) 000132 1776995192.323713 trunc from 0x001e9c to 0x006bff (0x4d64 bytes) 000133 1776995192.328303 fallocate 0x0125d6 thru 0x01e6a4 (0xc0cf bytes) 000134 1776995192.334533 write 0x02459f thru 0x02afd1 (0x6a33 bytes) 000135 1776995192.344586 read 0x00ae8d thru 0x01613b (0xb2af bytes) 000136 1776995192.372218 mapread 0x0228f6 thru 0x025208 (0x2913 bytes) 000137 1776995192.384450 trunc from 0x02afd2 to 0x02886e (0x2763 bytes) 000138 1776995192.413859 trunc from 0x0180e6 to 0x022871 (0xa78c bytes) 000139 1776995192.424721 punch from 0x0275d6 to 0x028093 (0xabe bytes) 000140 1776995192.440849 mapread 0x01e348 thru 0x026dea (0x8aa3 bytes) 000141 1776995192.455462 punch from 0x011ee6 to 0x017eb2 (0x5fcd bytes) 000142 1776995192.463021 punch from 0x0133a5 to 0x01dbbd (0xa819 bytes) 000143 1776995192.469322 trunc from 0x00b938 to 0x01427c (0x8945 bytes) 000144 1776995192.474172 read 0x01d6d8 thru 0x0219bf (0x42e8 bytes) 000145 1776995192.494371 trunc from 0x018c87 to 0x01b19d (0x2517 bytes) 000146 1776995192.504497 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2886f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2886f): Mirror 2: 0xa0a5bd02 (stale) Mirror 3: 0xa0a5bd02 (stale) CRC-32 checksum value for chunk [0, 0x2886f): Mirror 1: 0xade1cfa6 Mirror 4: 0xade1cfa6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2886f: skipped 000147 1776995193.853900 mapread 0x0215c9 thru 0x02606a (0x4aa2 bytes) 000148 1776995193.928594 punch from 0x0176b1 to 0x0234cb (0xbe1b bytes) 000149 1776995193.994666 fallocate 0x010e4a thru 0x01d339 (0xc4f0 bytes) 000150 1776995194.019664 read 0x025803 thru 0x027566 (0x1d64 bytes) 000151 1776995194.038268 mapwrite 0x02fabb thru 0x032037 (0x257d bytes) 000153 1776995194.177957 trunc from 0x032038 to 0x027b71 (0xa4c6 bytes) 000154 1776995194.208855 mapwrite 0x00ea17 thru 0x016c04 (0x81ee bytes) 000155 1776995194.266090 read 0x01139e thru 0x011f4d (0xbb0 bytes) 000156 1776995194.276547 punch from 0x018a84 to 0x01ef92 (0x650f bytes) 000157 1776995194.288802 trunc from 0x0077da to 0x014e9c (0xd6c3 bytes) 000158 1776995194.301064 mapwrite 0x028d0b thru 0x029374 (0x66a bytes) 000159 1776995194.416231 trunc from 0x00f069 to 0x019b95 (0xab2d bytes) 000160 1776995194.432012 write 0x011993 thru 0x01faab (0xe119 bytes) 000161 1776995194.466924 trunc from 0x01e93e to 0x029374 (0xaa37 bytes) 000162 1776995194.492656 mapread 0x01add1 thru 0x023091 (0x82c1 bytes) 000163 1776995194.550634 read 0x004af0 thru 0x008652 (0x3b63 bytes) 000164 1776995194.551409 trunc from 0x029375 to 0x0214b3 (0x7ec1 bytes) 000165 1776995194.592612 read 0x0056b4 thru 0x006fe0 (0x192d bytes) 000166 1776995194.593395 write 0x01a057 thru 0x01f2dd (0x5287 bytes) 000167 1776995194.594747 fallocate 0x0253e7 thru 0x035337 (0xff51 bytes) 000168 1776995194.615402 fallocate 0x032181 thru 0x033cfe (0x1b7e bytes) 000170 1776995194.628438 punch from 0x025904 to 0x02c160 (0x685d bytes) 000171 1776995194.662479 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33cff): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33cff): Mirror 2: 0xa61fd2a1 (stale) Mirror 3: 0xa61fd2a1 (stale) Mirror 4: 0x914d4a0f (stale) CRC-32 checksum value for chunk [0, 0x33cff): Mirror 1: 0xe6aecd40 Mirror 5: 0xe6aecd40 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33cff: skipped 000172 1776995196.002780 mapwrite 0x03703b thru 0x03c02a (0x4ff0 bytes) 000173 1776995196.265997 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c02b): Mirror 3: 0x9f9df003 (stale) Mirror 4: 0x44093d09 (stale) Mirror 5: 0xf9c47082 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c02b): Mirror 3: 0x9f9df003 (stale) Mirror 4: 0x44093d09 (stale) Mirror 5: 0xf9c47082 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c02b: skipped 000174 1776995196.875838 mapwrite 0x03a739 thru 0x03f154 (0x4a1c bytes) 000175 1776995196.971142 mapwrite 0x01b9ed thru 0x02673b (0xad4f bytes) 000176 1776995197.033627 mapwrite 0x0257b1 thru 0x032bf4 (0xd444 bytes) 000178 1776995197.098411 trunc from 0x028d08 to 0x02ad4d (0x2046 bytes) zero_range to largest ever: 0x37827 000181 1776995197.120581 trunc from 0x02ba87 to 0x037826 (0xbda0 bytes) 000182 1776995197.134279 mapwrite 0x01e682 thru 0x028ed6 (0xa855 bytes) 000183 1776995197.243761 trunc from 0x03f155 to 0x0269e0 (0x18774 bytes) 000185 1776995197.286256 MIRROR_RESYNC 4 mirrors 000186 1776995198.817895 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000187 1776995199.480636 MIRROR_EXTEND to 4 mirrors 000188 1776995200.706547 read 0x01bb4a thru 0x0207f3 (0x4caa bytes) 000189 1776995200.718450 MIRROR_EXTEND to 5 mirrors fallocating to largest ever: 0x40000 000190 1776995201.905027 fallocate 0x03f685 thru 0x03ffff (0x97b bytes) 000191 1776995201.958174 trunc from 0x01ffd0 to 0x0269e0 (0x6a11 bytes) 000192 1776995201.970589 MIRROR_RESYNC 5 mirrors 000193 1776995203.814853 write 0x024e04 thru 0x028534 (0x3731 bytes) 000194 1776995203.908685 punch from 0x014563 to 0x020645 (0xc0e3 bytes) 000195 1776995203.922602 write 0x03711e thru 0x03b6ec (0x45cf bytes) 000196 1776995203.930558 trunc from 0x03b6ed to 0x03aef7 (0x7f5 bytes) 000197 1776995203.972136 mapwrite 0x03ce82 thru 0x03ffff (0x317e bytes) 000199 1776995204.026689 fallocate 0x03e307 thru 0x03ffff (0x1cf9 bytes) 000200 1776995204.036869 read 0x03f432 thru 0x03ffff (0xbce bytes) 000201 1776995204.038606 read 0x023a29 thru 0x0323e8 (0xe9c0 bytes) 000202 1776995204.058501 fallocate 0x015824 thru 0x019ed5 (0x46b2 bytes) 000204 1776995204.067555 mapwrite 0x03ff4b thru 0x03ffff (0xb5 bytes) 000205 1776995204.085517 trunc from 0x040000 to 0x013df4 (0x2c20b bytes) 000207 1776995204.108838 trunc from 0x013df5 to 0x02aad2 (0x16cde bytes) 000208 1776995204.168309 trunc from 0x02aad3 to 0x037d14 (0xd242 bytes) 000209 1776995204.219137 read 0x00eb6a thru 0x010123 (0x15ba bytes) 000210 1776995204.229080 mapread 0x000e3f thru 0x005c53 (0x4e15 bytes) 000211 1776995204.230445 mapwrite 0x021f89 thru 0x0295d9 (0x7651 bytes) 000212 1776995204.324954 write 0x03abd9 thru 0x03ffff (0x5427 bytes) 000213 1776995204.332416 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x91cc7cb8 (stale) Mirror 5: 0x91cc7cb8 (stale) Mirror 6: 0x91cc7cb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x91cc7cb8 (stale) Mirror 5: 0x91cc7cb8 (stale) Mirror 6: 0x91cc7cb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000215 1776995205.134344 read 0x03ae7c thru 0x03ffff (0x5184 bytes) 000216 1776995205.164017 MIRROR_RESYNC 4 mirrors 000217 1776995207.194609 fallocate 0x010c86 thru 0x01d9b6 (0xcd31 bytes) 000218 1776995207.243961 read 0x006f56 thru 0x0083aa (0x1455 bytes) 000219 1776995207.252288 read 0x026ba8 thru 0x02b33c (0x4795 bytes) 000220 1776995207.267647 trunc from 0x0354bf to 0x03dc15 (0x8757 bytes) 000221 1776995207.274685 punch from 0x0266bc to 0x02dc3b (0x7580 bytes) 000222 1776995207.281087 write 0x038ac6 thru 0x03f89b (0x6dd6 bytes) 000223 1776995207.289165 read 0x00d66e thru 0x01284c (0x51df bytes) 000224 1776995207.291078 read 0x00c57c thru 0x011246 (0x4ccb bytes) 000225 1776995207.292631 punch from 0x032137 to 0x0366a1 (0x456b bytes) 000226 1776995207.298893 trunc from 0x000cd5 to 0x007257 (0x6583 bytes) 000227 1776995207.310705 punch from 0x01a623 to 0x02695f (0xc33d bytes) 000228 1776995207.318318 trunc from 0x026269 to 0x03197d (0xb715 bytes) 000229 1776995207.323756 trunc from 0x040000 to 0x00c100 (0x33eff bytes) 000230 1776995207.356204 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xc101): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc101): Mirror 4: 0x9461c3a0 (stale) Mirror 5: 0x9461c3a0 (stale) Mirror 6: 0x9461c3a0 (stale) CRC-32 checksum value for chunk [0, 0xc101): Mirror 1: 0x14ca8fe7 Mirror 7: 0x14ca8fe7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc101: skipped 000231 1776995208.928100 mapread 0x006f26 thru 0x00c100 (0x51db bytes) 000232 1776995208.989621 write 0x01897a thru 0x01dc34 (0x52bb bytes) 000233 1776995209.038080 fallocate 0x01b7af thru 0x0232d8 (0x7b2a bytes) 000234 1776995209.043767 read 0x00a8d9 thru 0x01121a (0x6942 bytes) 000235 1776995209.061106 write 0x007f9d thru 0x0139bc (0xba20 bytes) 000236 1776995209.085311 trunc from 0x00f5a5 to 0x01a768 (0xb1c4 bytes) 000237 1776995209.111676 mapread 0x01a2b7 thru 0x01dc34 (0x397e bytes) 000238 1776995209.137493 mapwrite 0x012fc6 thru 0x01cea7 (0x9ee2 bytes) 000239 1776995209.189532 write 0x010e94 thru 0x011c1b (0xd88 bytes) 000240 1776995209.192402 mapread 0x000c9c thru 0x00f69f (0xea04 bytes) 000241 1776995209.205857 punch from 0x014837 to 0x01dc34 (0x93fe bytes) 000242 1776995209.220416 trunc from 0x01dc35 to 0x01b57b (0x26b9 bytes) 000243 1776995209.356572 trunc from 0x01b57c to 0x013269 (0x8312 bytes) 000245 1776995209.392940 mapread 0x000d11 thru 0x007a63 (0x6d53 bytes) 000246 1776995209.402877 MIRROR_RESYNC 5 mirrors 000247 1776995211.297247 trunc from 0x01326a to 0x012fee (0x27b bytes) 000248 1776995211.348599 trunc from 0x012fef to 0x030d50 (0x1dd62 bytes) 000249 1776995211.394989 write 0x028f50 thru 0x0291bd (0x26e bytes) 000250 1776995211.416828 trunc from 0x0056c5 to 0x010dd5 (0xb711 bytes) 000251 1776995211.423945 fallocate 0x00327e thru 0x00fe15 (0xcb98 bytes) 000252 1776995211.429402 mapwrite 0x036503 thru 0x03770f (0x120d bytes) 000253 1776995211.486697 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37710): Mirror 5: 0xa674a3f8 (stale) Mirror 6: 0xa674a3f8 (stale) Mirror 7: 0xa674a3f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37710): Mirror 5: 0xa674a3f8 (stale) Mirror 6: 0xa674a3f8 (stale) Mirror 7: 0xa674a3f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37710: skipped 000254 1776995212.043440 write 0x036bfe thru 0x03ffff (0x9402 bytes) 000255 1776995212.079567 mapwrite 0x00be5c thru 0x0132b2 (0x7457 bytes) 000256 1776995212.202582 read 0x009665 thru 0x00bd22 (0x26be bytes) 000257 1776995212.203784 read 0x03139c thru 0x033f88 (0x2bed bytes) 000258 1776995212.242898 read 0x01e4e1 thru 0x023eff (0x5a1f bytes) 000259 1776995212.247552 fallocate 0x031b99 thru 0x03b160 (0x95c8 bytes) 000260 1776995212.271230 write 0x0118db thru 0x01d8e7 (0xc00d bytes) 000261 1776995212.276201 fallocate 0x011f83 thru 0x0206b1 (0xe72f bytes) 000262 1776995212.287387 fallocate 0x02099f thru 0x021967 (0xfc9 bytes) 000263 1776995212.300759 trunc from 0x00ee1e to 0x01432f (0x5512 bytes) 000264 1776995212.331126 mapwrite 0x030956 thru 0x03da39 (0xd0e4 bytes) 000265 1776995212.391820 mapwrite 0x02c9d9 thru 0x03b1a2 (0xe7ca bytes) 000266 1776995212.481880 mapwrite 0x005d9a thru 0x00b465 (0x56cc bytes) 000267 1776995212.520566 write 0x013168 thru 0x01c8bd (0x9756 bytes) 000268 1776995212.536965 mapwrite 0x0387ff thru 0x03f434 (0x6c36 bytes) 000269 1776995212.608764 mapread 0x01b904 thru 0x024e7e (0x957b bytes) 000270 1776995212.612159 write 0x02cd62 thru 0x030a89 (0x3d28 bytes) 000271 1776995212.620630 fallocate 0x02dad5 thru 0x032f37 (0x5463 bytes) 000272 1776995212.632117 write 0x00bd29 thru 0x013ea7 (0x817f bytes) 000273 1776995212.634200 fallocate 0x01598a thru 0x01cda1 (0x7418 bytes) 000274 1776995212.642769 write 0x00db60 thru 0x018a49 (0xaeea bytes) 000275 1776995212.648001 trunc from 0x040000 to 0x035d6b (0xa294 bytes) 000277 1776995212.690443 trunc from 0x035d6c to 0x01d63e (0x1872d bytes) 000278 1776995212.712564 trunc from 0x019a22 to 0x01d63e (0x3c1d bytes) 000279 1776995212.731342 punch from 0x006313 to 0x01609f (0xfd8d bytes) 000280 1776995212.774298 trunc from 0x0063cc to 0x00f0bb (0x8cf0 bytes) 000281 1776995212.783413 write 0x02deeb thru 0x03b926 (0xda3c bytes) 000282 1776995212.785221 fallocate 0x034f6a thru 0x036c17 (0x1cae bytes) 000283 1776995212.799289 mapwrite 0x020c85 thru 0x020fb8 (0x334 bytes) 000285 1776995212.841863 read 0x0168de thru 0x016eeb (0x60e bytes) 000286 1776995212.854357 fallocate 0x02056c thru 0x02ba4e (0xb4e3 bytes) 000287 1776995212.866605 fallocate 0x028783 thru 0x035876 (0xd0f4 bytes) 000289 1776995212.883929 fallocate 0x016140 thru 0x01fddd (0x9c9e bytes) 000290 1776995212.890012 fallocate 0x0217aa thru 0x0286b5 (0x6f0c bytes) 000291 1776995212.896822 mapread 0x00a2a9 thru 0x01079f (0x64f7 bytes) 000293 1776995212.900599 mapwrite 0x0149e2 thru 0x01b98d (0x6fac bytes) 000294 1776995212.927145 mapread 0x01104e thru 0x01ecdc (0xdc8f bytes) 000295 1776995212.928766 fallocate 0x02bc8c thru 0x032955 (0x6cca bytes) 000296 1776995212.933511 punch from 0x018e7a to 0x019a94 (0xc1b bytes) 000297 1776995212.937366 mapread 0x01f7ed thru 0x0252ce (0x5ae2 bytes) 000299 1776995212.939805 trunc from 0x03b927 to 0x01952d (0x223f9 bytes) 000300 1776995212.961523 trunc from 0x014da0 to 0x0157fd (0xa5e bytes) 000301 1776995212.968981 trunc from 0x00abb0 to 0x016dff (0xc250 bytes) 000302 1776995212.980797 fallocate 0x01028b thru 0x01bf91 (0xbd07 bytes) 000303 1776995212.985787 mapwrite 0x021e2d thru 0x02ef7a (0xd14e bytes) 000304 1776995213.165403 fallocate 0x037b98 thru 0x03a0ae (0x2517 bytes) 000306 1776995213.177491 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: 0xcb71a32 (stale) Mirror 6: 0xcb71a32 (stale) Mirror 7: 0xcb71a32 (stale) CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 1: 0x86c19b49 Mirror 8: 0x86c19b49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef7b: skipped 000307 1776995214.647533 trunc from 0x0056d9 to 0x00a2d1 (0x4bf9 bytes) 000308 1776995214.755987 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: 0xcb71a32 (stale) Mirror 6: 0xcb71a32 (stale) Mirror 7: 0xcb71a32 (stale) Mirror 8: 0x86c19b49 (stale) CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 1: 0x5b21cb4d Mirror 9: 0x5b21cb4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef7b: skipped 000309 1776995216.641358 mapwrite 0x01c8c2 thru 0x01e8b4 (0x1ff3 bytes) 000310 1776995216.910437 read 0x024fb0 thru 0x02ef7a (0x9fcb bytes) 000311 1776995216.933982 write 0x018450 thru 0x0232c6 (0xae77 bytes) 000312 1776995216.953536 fallocate 0x029704 thru 0x0323ef (0x8cec bytes) 000313 1776995216.972336 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: 0xcb71a32 (stale) Mirror 6: 0xcb71a32 (stale) Mirror 7: 0xcb71a32 (stale) Mirror 8: 0x86c19b49 (stale) Mirror 9: 0x5b21cb4d (stale) CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 1: 0x65cbc012 Mirror 10: 0x65cbc012 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef7b: skipped 000314 1776995219.426943 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: 0xcb71a32 (stale) Mirror 6: 0xcb71a32 (stale) Mirror 7: 0xcb71a32 (stale) Mirror 8: 0x86c19b49 (stale) Mirror 9: 0x5b21cb4d (stale) CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 1: 0x65cbc012 Mirror 10: 0x65cbc012 Mirror 11: 0x65cbc012 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef7b: skipped 000315 1776995221.709662 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 5: 0xcb71a32 (stale) Mirror 6: 0xcb71a32 (stale) Mirror 7: 0xcb71a32 (stale) Mirror 8: 0x86c19b49 (stale) Mirror 9: 0x5b21cb4d (stale) CRC-32 checksum value for chunk [0, 0x2ef7b): Mirror 1: 0x65cbc012 Mirror 10: 0x65cbc012 Mirror 11: 0x65cbc012 Mirror 12: 0x65cbc012 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef7b: skipped 000316 1776995223.908334 fallocate 0x0118be thru 0x01c54e (0xac91 bytes) 000317 1776995223.971890 trunc from 0x02ef7b to 0x008534 (0x26a46 bytes) 000318 1776995224.019658 trunc from 0x008535 to 0x02626a (0x1dd36 bytes) 000319 1776995224.079617 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2626b): Mirror 5: 0xe3c7da64 (stale) Mirror 6: 0xe3c7da64 (stale) Mirror 8: 0x6bd8feb (stale) Mirror 9: 0xd1102562 (stale) Mirror 10: 0x94496dad (stale) Mirror 11: 0x94496dad (stale) Mirror 12: 0x94496dad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2626b): Mirror 5: 0xe3c7da64 (stale) Mirror 6: 0xe3c7da64 (stale) Mirror 8: 0x6bd8feb (stale) Mirror 9: 0xd1102562 (stale) Mirror 10: 0x94496dad (stale) Mirror 11: 0x94496dad (stale) Mirror 12: 0x94496dad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2626b: skipped 000320 1776995225.074940 write 0x02d81f thru 0x03c806 (0xefe8 bytes) 000321 1776995225.101510 trunc from 0x02174d to 0x02500a (0x38be bytes) 000322 1776995225.112596 trunc from 0x01784e to 0x024c0c (0xd3bf bytes) 000323 1776995225.123913 trunc from 0x03c807 to 0x00226c (0x3a59a bytes) 000324 1776995225.171104 write 0x0332d9 thru 0x034163 (0xe8b bytes) 000325 1776995225.172557 fallocate 0x037a8f thru 0x037b0e (0x80 bytes) 000326 1776995225.179544 punch from 0x00b0b8 to 0x0149e3 (0x992c bytes) 000327 1776995225.189557 trunc from 0x030e2f to 0x037b0e (0x6ce0 bytes) 000328 1776995225.225062 fallocate 0x00ce40 thru 0x0123a4 (0x5565 bytes) 000329 1776995225.245101 trunc from 0x037b0f to 0x003182 (0x3498c bytes) 000330 1776995225.291026 mapwrite 0x01e175 thru 0x026792 (0x861e bytes) 000331 1776995225.449584 read 0x022323 thru 0x026792 (0x4470 bytes) 000332 1776995225.452623 trunc from 0x005699 to 0x0091d1 (0x3b39 bytes) 000333 1776995225.460833 punch from 0x024cef to 0x026792 (0x1aa4 bytes) 000334 1776995225.488759 trunc from 0x026793 to 0x037434 (0x10ca2 bytes) 000336 1776995225.541881 MIRROR_RESYNC 8 mirrors 000337 1776995229.138439 fallocate 0x01046f thru 0x01a115 (0x9ca7 bytes) 000338 1776995229.223340 fallocate 0x039b64 thru 0x03ffff (0x649c bytes) 000339 1776995229.253186 mapwrite 0x0384f6 thru 0x03b4a2 (0x2fad bytes) 000340 1776995229.405027 mapwrite 0x01081c thru 0x0178fd (0x70e2 bytes) 000341 1776995229.517779 punch from 0x010c23 to 0x01ad2a (0xa108 bytes) 000342 1776995229.548553 trunc from 0x01df25 to 0x025843 (0x791f bytes) 000343 1776995229.561613 mapread 0x034b27 thru 0x036ca6 (0x2180 bytes) 000345 1776995229.569299 fallocate 0x006f6d thru 0x00af2d (0x3fc1 bytes) 000346 1776995229.586292 trunc from 0x03b4a3 to 0x030cd3 (0xa7cf bytes) 000347 1776995229.644164 mapread 0x002271 thru 0x003af5 (0x1885 bytes) 000348 1776995229.681230 mapwrite 0x02810e thru 0x029910 (0x1803 bytes) 000350 1776995229.748037 mapread 0x01648e thru 0x01a212 (0x3d85 bytes) 000351 1776995229.777825 write 0x01fcee thru 0x02dcaf (0xdfc2 bytes) 000352 1776995229.800554 fallocate 0x00da35 thru 0x0139fd (0x5fc9 bytes) 000353 1776995229.819061 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30cd4): Mirror 5: 0x39a73279 (stale) Mirror 6: 0x39a73279 (stale) Mirror 8: 0x39a73279 (stale) Mirror 9: 0x39a73279 (stale) Mirror 10: 0x39a73279 (stale) Mirror 11: 0x39a73279 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30cd4): Mirror 5: 0x39a73279 (stale) Mirror 6: 0x39a73279 (stale) Mirror 8: 0x39a73279 (stale) Mirror 9: 0x39a73279 (stale) Mirror 10: 0x39a73279 (stale) Mirror 11: 0x39a73279 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30cd4: skipped 000354 1776995230.934784 read 0x02eb82 thru 0x030cd3 (0x2152 bytes) 000355 1776995230.948392 read 0x01243b thru 0x0178ef (0x54b5 bytes) 000356 1776995230.974856 trunc from 0x030cd4 to 0x020209 (0x10aca bytes) 000357 1776995231.022093 punch from 0x019689 to 0x020209 (0x6b81 bytes) 000358 1776995231.041563 trunc from 0x0139b9 to 0x020209 (0xc851 bytes) 000359 1776995231.048819 read 0x0085a3 thru 0x014684 (0xc0e2 bytes) 000360 1776995231.105146 write 0x03472d thru 0x03fd52 (0xb626 bytes) 000362 1776995231.129077 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fd53): Mirror 6: 0xdc7b1f9f (stale) Mirror 8: 0xdc7b1f9f (stale) Mirror 9: 0xdc7b1f9f (stale) Mirror 10: 0xdc7b1f9f (stale) Mirror 11: 0xdc7b1f9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd53): Mirror 6: 0xdc7b1f9f (stale) Mirror 8: 0xdc7b1f9f (stale) Mirror 9: 0xdc7b1f9f (stale) Mirror 10: 0xdc7b1f9f (stale) Mirror 11: 0xdc7b1f9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd53: skipped 000363 1776995232.188569 mapwrite 0x02a182 thru 0x03583a (0xb6b9 bytes) 000364 1776995232.279883 trunc from 0x015108 to 0x01d186 (0x807f bytes) 000366 1776995232.285760 mapwrite 0x0016ca thru 0x0055e7 (0x3f1e bytes) 000367 1776995232.332660 read 0x024b24 thru 0x0310db (0xc5b8 bytes) 000368 1776995232.337844 punch from 0x015e06 to 0x01655e (0x759 bytes) 000369 1776995232.343491 trunc from 0x03fd53 to 0x03d0bf (0x2c93 bytes) 000370 1776995232.378006 fallocate 0x036b03 thru 0x03ffff (0x94fd bytes) 000371 1776995232.386250 write 0x034ad6 thru 0x03d427 (0x8952 bytes) 000372 1776995232.387380 trunc from 0x009fad to 0x019be4 (0xfc38 bytes) 000373 1776995232.407656 write 0x00a8cf thru 0x014540 (0x9c72 bytes) 000374 1776995232.431227 read 0x0383fc thru 0x038f4d (0xb52 bytes) 000375 1776995232.432454 trunc from 0x040000 to 0x021509 (0x1eaf6 bytes) 000376 1776995232.520367 write 0x01f2db thru 0x0224f1 (0x3217 bytes) 000377 1776995232.571687 write 0x02a4e1 thru 0x02d9a4 (0x34c4 bytes) 000378 1776995232.573668 fallocate 0x01d25a thru 0x02466b (0x7412 bytes) 000379 1776995232.590608 trunc from 0x02bff3 to 0x02d9a4 (0x19b2 bytes) 000380 1776995232.628308 mapread 0x00c789 thru 0x0171ae (0xaa26 bytes) 000382 1776995232.637656 trunc from 0x0261ec to 0x027997 (0x17ac bytes) 000383 1776995232.650042 punch from 0x02168e to 0x02400a (0x297d bytes) 000384 1776995232.656129 punch from 0x01ebbd to 0x025973 (0x6db7 bytes) 000385 1776995232.662609 punch from 0x0255c6 to 0x02d9a4 (0x83df bytes) 000386 1776995232.677319 fallocate 0x0079c5 thru 0x017127 (0xf763 bytes) 000387 1776995232.709664 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2d9a5): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d9a5): Mirror 6: 0x467d08fe (stale) Mirror 8: 0x467d08fe (stale) Mirror 9: 0x467d08fe (stale) Mirror 10: 0x467d08fe (stale) Mirror 11: 0x467d08fe (stale) CRC-32 checksum value for chunk [0, 0x2d9a5): Mirror 1: 0x818cdb13 Mirror 12: 0x818cdb13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d9a5: skipped 000388 1776995234.478232 punch from 0x025a42 to 0x02d9a4 (0x7f63 bytes) 000389 1776995234.560706 write 0x008069 thru 0x00a90f (0x28a7 bytes) 000390 1776995234.590365 fallocate 0x035317 thru 0x03635e (0x1048 bytes) 000391 1776995234.617578 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d9a5): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d9a5): Mirror 6: 0x467d08fe (stale) Mirror 8: 0x467d08fe (stale) Mirror 9: 0x467d08fe (stale) Mirror 10: 0x467d08fe (stale) Mirror 11: 0x467d08fe (stale) Mirror 12: 0x818cdb13 (stale) CRC-32 checksum value for chunk [0, 0x2d9a5): Mirror 1: 0x8201c5a4 Mirror 13: 0x8201c5a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d9a5: skipped 000392 1776995236.029034 read 0x0266b2 thru 0x028d0e (0x265d bytes) 000393 1776995236.048157 mapwrite 0x01c417 thru 0x020472 (0x405c bytes) 000394 1776995236.231092 MIRROR_RESYNC 8 mirrors 000395 1776995238.960451 fallocate 0x00c462 thru 0x00fdc1 (0x3960 bytes) 000396 1776995239.017104 mapread 0x00af3a thru 0x00f4de (0x45a5 bytes) 000397 1776995239.050595 trunc from 0x02d9a5 to 0x0081d3 (0x257d1 bytes) 000398 1776995239.105197 trunc from 0x0011e1 to 0x0081d3 (0x6ff3 bytes) 000399 1776995239.139620 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x81d4): Mirror 6: 0xc5878673 (stale) Mirror 8: 0xc5878673 (stale) Mirror 9: 0xc5878673 (stale) Mirror 11: 0xc5878673 (stale) Mirror 12: 0xc5878673 (stale) Mirror 13: 0xc5878673 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x81d4): Mirror 6: 0xc5878673 (stale) Mirror 8: 0xc5878673 (stale) Mirror 9: 0xc5878673 (stale) Mirror 11: 0xc5878673 (stale) Mirror 12: 0xc5878673 (stale) Mirror 13: 0xc5878673 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x81d4: skipped 000400 1776995240.058505 read 0x005232 thru 0x0081d3 (0x2fa2 bytes) 000401 1776995240.099886 trunc from 0x0081d4 to 0x031756 (0x29583 bytes) 000402 1776995240.147281 mapread 0x007719 thru 0x00b7d7 (0x40bf bytes) 000403 1776995240.209918 mapread 0x010dbe thru 0x01f83a (0xea7d bytes) 000404 1776995240.266479 read 0x02fc96 thru 0x031756 (0x1ac1 bytes) 000405 1776995240.291371 write 0x032c9c thru 0x03a8b5 (0x7c1a bytes) 000406 1776995240.296442 read 0x02bfcd thru 0x038f66 (0xcf9a bytes) 000407 1776995240.299773 write 0x01cd23 thru 0x02bb1f (0xedfd bytes) 000408 1776995240.303042 write 0x015cae thru 0x01d2c7 (0x761a bytes) 000410 1776995240.316168 mapread 0x024f1e thru 0x02fd89 (0xae6c bytes) 000411 1776995240.320374 trunc from 0x0276b9 to 0x03410e (0xca56 bytes) 000412 1776995240.390800 mapread 0x0333aa thru 0x03a8b5 (0x750c bytes) 000413 1776995240.479412 MIRROR_RESYNC 7 mirrors 000414 1776995243.762808 punch from 0x031f40 to 0x033603 (0x16c4 bytes) 000415 1776995243.814613 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a8b6): Mirror 6: 0x4e862691 (stale) Mirror 8: 0x4e862691 (stale) Mirror 9: 0x4e862691 (stale) Mirror 12: 0x4e862691 (stale) Mirror 13: 0x4e862691 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8b6): Mirror 6: 0x4e862691 (stale) Mirror 8: 0x4e862691 (stale) Mirror 9: 0x4e862691 (stale) Mirror 12: 0x4e862691 (stale) Mirror 13: 0x4e862691 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8b6: skipped 000416 1776995244.640804 trunc from 0x000ab4 to 0x00df0c (0xd459 bytes) 000417 1776995244.662523 fallocate 0x03b3a0 thru 0x03df9b (0x2bfc bytes) 000419 1776995244.676422 mapwrite 0x0088b1 thru 0x016abb (0xe20b bytes) 000420 1776995244.782491 fallocate 0x003e1b thru 0x0062b1 (0x2497 bytes) 000421 1776995244.796990 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3df9c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df9c): Mirror 6: 0xd1fe5495 (stale) Mirror 8: 0xd1fe5495 (stale) Mirror 9: 0xd1fe5495 (stale) Mirror 12: 0xd1fe5495 (stale) Mirror 13: 0xd1fe5495 (stale) CRC-32 checksum value for chunk [0, 0x3df9c): Mirror 1: 0x19be6889 Mirror 14: 0x19be6889 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df9c: skipped 000422 1776995246.372755 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3df9c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df9c): Mirror 6: 0xd1fe5495 (stale) Mirror 8: 0xd1fe5495 (stale) Mirror 9: 0xd1fe5495 (stale) Mirror 12: 0xd1fe5495 (stale) Mirror 13: 0xd1fe5495 (stale) CRC-32 checksum value for chunk [0, 0x3df9c): Mirror 1: 0x19be6889 Mirror 14: 0x19be6889 Mirror 15: 0x19be6889 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df9c: skipped 000423 1776995248.045075 fallocate 0x0008cf thru 0x006f73 (0x66a5 bytes) 000424 1776995248.180872 trunc from 0x03df9c to 0x002a86 (0x3b515 bytes) 000425 1776995248.244954 trunc from 0x000050 to 0x002a86 (0x2a37 bytes) 000426 1776995248.253442 read 0x001129 thru 0x002a86 (0x195e bytes) 000427 1776995248.265285 trunc from 0x000082 to 0x002a86 (0x2a05 bytes) 000428 1776995248.271492 read 0x00112a thru 0x002a86 (0x195d bytes) 000429 1776995248.279394 trunc from 0x0021ff to 0x002a86 (0x888 bytes) 000430 1776995248.285142 mapread 0x00228a thru 0x002a86 (0x7fd bytes) 000431 1776995248.307092 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a87): Mirror 6: 0x8e0cd72c (stale) Mirror 8: 0x8e0cd72c (stale) Mirror 9: 0x8e0cd72c (stale) Mirror 12: 0x8e0cd72c (stale) Mirror 14: 0x8e0cd72c (stale) Mirror 15: 0x8e0cd72c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a87): Mirror 6: 0x8e0cd72c (stale) Mirror 8: 0x8e0cd72c (stale) Mirror 9: 0x8e0cd72c (stale) Mirror 12: 0x8e0cd72c (stale) Mirror 14: 0x8e0cd72c (stale) Mirror 15: 0x8e0cd72c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a87: skipped 000432 1776995248.908275 punch from 0x000133 to 0x002a86 (0x2954 bytes) 000433 1776995248.918344 trunc from 0x002a87 to 0x02998e (0x26f08 bytes) 000434 1776995248.957682 read 0x02690f thru 0x02998e (0x3080 bytes) 000435 1776995248.983579 MIRROR_RESYNC 7 mirrors 000436 1776995250.883371 fallocate 0x0257ea thru 0x026f9b (0x17b2 bytes) 000437 1776995250.939251 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2998f): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2998f): Mirror 6: 0x2a37aff2 (stale) Mirror 8: 0x2a37aff2 (stale) Mirror 9: 0x2a37aff2 (stale) Mirror 12: 0x2a37aff2 (stale) Mirror 14: 0x2a37aff2 (stale) Mirror 15: 0x2a37aff2 (stale) CRC-32 checksum value for chunk [0, 0x2998f): Mirror 1: 0x2a37aff2 Mirror 16: 0x2a37aff2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2998f: skipped 000438 1776995252.345228 punch from 0x001c8a to 0x004317 (0x268e bytes) 000440 1776995252.401935 read 0x01b6a5 thru 0x01f7de (0x413a bytes) 000441 1776995252.415960 trunc from 0x01922c to 0x021da1 (0x8b76 bytes) 000442 1776995252.423303 write 0x014e48 thru 0x01adad (0x5f66 bytes) 000443 1776995252.441875 read 0x001a09 thru 0x0075d2 (0x5bca bytes) 000444 1776995252.465528 fallocate 0x03c509 thru 0x03ffff (0x3af7 bytes) 000445 1776995252.473432 trunc from 0x02998f to 0x007fe7 (0x219a7 bytes) 000446 1776995252.497502 punch from 0x006a9d to 0x007fe7 (0x154b bytes) 000447 1776995252.507155 write 0x003ecc thru 0x01142f (0xd564 bytes) 000448 1776995252.519337 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x11430): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11430): Mirror 6: 0x5df182da (stale) Mirror 8: 0x5df182da (stale) Mirror 9: 0x5df182da (stale) Mirror 12: 0x5df182da (stale) Mirror 14: 0x5df182da (stale) Mirror 15: 0x5df182da (stale) Mirror 16: 0x5df182da (stale) CRC-32 checksum value for chunk [0, 0x11430): Mirror 1: 0x7d6ea19b Mirror 17: 0x7d6ea19b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11430: skipped 000449 1776995253.799712 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x11430): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11430): Mirror 6: 0x5df182da (stale) Mirror 8: 0x5df182da (stale) Mirror 9: 0x5df182da (stale) Mirror 12: 0x5df182da (stale) Mirror 14: 0x5df182da (stale) Mirror 15: 0x5df182da (stale) Mirror 16: 0x5df182da (stale) CRC-32 checksum value for chunk [0, 0x11430): Mirror 1: 0x7d6ea19b Mirror 17: 0x7d6ea19b Mirror 18: 0x7d6ea19b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11430: skipped 000450 1776995255.178794 write 0x027264 thru 0x034bbb (0xd958 bytes) 000451 1776995255.278902 mapread 0x02b1a1 thru 0x031e19 (0x6c79 bytes) 000452 1776995255.283585 trunc from 0x0124e5 to 0x016713 (0x422f bytes) 000453 1776995255.292648 write 0x022ca2 thru 0x02e8ce (0xbc2d bytes) 000455 1776995255.308330 mapwrite 0x01e5ca thru 0x02c5ce (0xe005 bytes) 000456 1776995255.395536 trunc from 0x00cf66 to 0x01c7ad (0xf848 bytes) 000458 1776995255.423563 read 0x0218c7 thru 0x030aeb (0xf225 bytes) 000459 1776995255.428515 fallocate 0x01cbcb thru 0x027db7 (0xb1ed bytes) 000460 1776995255.455974 punch from 0x0028de to 0x00e82f (0xbf52 bytes) 000461 1776995255.467437 read 0x02d29d thru 0x03155c (0x42c0 bytes) 000462 1776995255.468211 mapread 0x0278b3 thru 0x02ba24 (0x4172 bytes) 000463 1776995255.469993 read 0x006b48 thru 0x00e181 (0x763a bytes) 000464 1776995255.496040 write 0x023c6b thru 0x028520 (0x48b6 bytes) 000465 1776995255.497304 fallocate 0x02d803 thru 0x03ca5a (0xf258 bytes) 000466 1776995255.511042 trunc from 0x005e7c to 0x006d44 (0xec9 bytes) 000467 1776995255.532416 trunc from 0x0016ec to 0x00ad66 (0x967b bytes) 000468 1776995255.547509 read 0x02b7af thru 0x033b71 (0x83c3 bytes) 000469 1776995255.549790 mapwrite 0x024e56 thru 0x02b8ac (0x6a57 bytes) 000470 1776995255.580385 trunc from 0x02bc40 to 0x02c796 (0xb57 bytes) 000471 1776995255.590673 mapread 0x0117cc thru 0x01a299 (0x8ace bytes) 000472 1776995255.602909 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ca5b): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca5b): Mirror 6: 0xe86508b7 (stale) Mirror 8: 0xe86508b7 (stale) Mirror 9: 0xe86508b7 (stale) Mirror 12: 0xe86508b7 (stale) Mirror 14: 0xe86508b7 (stale) Mirror 15: 0xe86508b7 (stale) Mirror 16: 0xe86508b7 (stale) Mirror 17: 0x6752632d (stale) Mirror 18: 0x6752632d (stale) CRC-32 checksum value for chunk [0, 0x3ca5b): Mirror 1: 0x91194d0 Mirror 19: 0x91194d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca5b: skipped 000473 1776995257.378429 trunc from 0x03ca5b to 0x02b370 (0x116ea bytes) 000474 1776995257.445848 fallocate 0x02d782 thru 0x02e2eb (0xb6a bytes) 000475 1776995257.466036 trunc from 0x00b4aa to 0x010ced (0x5844 bytes) 000477 1776995257.491972 read 0x005805 thru 0x006e8a (0x1686 bytes) 000478 1776995257.499963 punch from 0x026c72 to 0x0277ac (0xb3b bytes) 000479 1776995257.512880 punch from 0x0193bc to 0x024927 (0xb56c bytes) 000480 1776995257.532080 MIRROR_RESYNC 11 mirrors 000482 1776995260.968948 punch from 0x01bed3 to 0x01eaa3 (0x2bd1 bytes) 000483 1776995261.003670 mapwrite 0x021610 thru 0x02358d (0x1f7e bytes) 000484 1776995261.077309 write 0x02dde7 thru 0x03b938 (0xdb52 bytes) 000485 1776995261.087758 trunc from 0x03b939 to 0x0076d0 (0x34268 bytes) 000486 1776995261.139712 read 0x003c77 thru 0x0076d0 (0x3a5a bytes) 000487 1776995261.150140 fallocate 0x01274f thru 0x0212cb (0xeb7d bytes) 000488 1776995261.157637 trunc from 0x0076d1 to 0x0034a6 (0x422a bytes) 000490 1776995261.189610 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x34a7): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a7): Mirror 6: 0xbc3b10b2 (stale) Mirror 8: 0xbc3b10b2 (stale) Mirror 9: 0xbc3b10b2 (stale) Mirror 12: 0xbc3b10b2 (stale) Mirror 14: 0xbc3b10b2 (stale) Mirror 15: 0xbc3b10b2 (stale) Mirror 16: 0xbc3b10b2 (stale) Mirror 17: 0xbc3b10b2 (stale) Mirror 18: 0xbc3b10b2 (stale) Mirror 19: 0xbc3b10b2 (stale) CRC-32 checksum value for chunk [0, 0x34a7): Mirror 1: 0xbc3b10b2 Mirror 20: 0xbc3b10b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a7: skipped 000492 1776995262.542481 fallocate 0x01f48f thru 0x024b0f (0x5681 bytes) 000493 1776995262.626774 mapwrite 0x01ac51 thru 0x01ecb2 (0x4062 bytes) 000495 1776995262.684833 trunc from 0x01de17 to 0x022fd7 (0x51c1 bytes) 000496 1776995262.693566 trunc from 0x01f9e2 to 0x024b0f (0x512e bytes) 000497 1776995262.715602 mapwrite 0x00791f thru 0x00a726 (0x2e08 bytes) 000498 1776995262.763589 trunc from 0x024b10 to 0x027263 (0x2754 bytes) 000499 1776995262.830608 punch from 0x025636 to 0x027263 (0x1c2e bytes) 000500 1776995262.839448 punch from 0x0063cc to 0x00d678 (0x72ad bytes) 000501 1776995262.845257 fallocate 0x017cc4 thru 0x01bc88 (0x3fc5 bytes) 000502 1776995262.852633 fallocate 0x0098ca thru 0x0120f4 (0x882b bytes) 000503 1776995262.865667 read 0x009be3 thru 0x0169f1 (0xce0f bytes) 000504 1776995262.903834 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x27264): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27264): Mirror 6: 0xbe33bdb7 (stale) Mirror 8: 0xbe33bdb7 (stale) Mirror 9: 0xbe33bdb7 (stale) Mirror 12: 0xbe33bdb7 (stale) Mirror 14: 0xbe33bdb7 (stale) Mirror 15: 0xbe33bdb7 (stale) Mirror 16: 0xbe33bdb7 (stale) Mirror 17: 0xbe33bdb7 (stale) Mirror 18: 0xbe33bdb7 (stale) Mirror 19: 0xbe33bdb7 (stale) Mirror 20: 0xd27b443 (stale) CRC-32 checksum value for chunk [0, 0x27264): Mirror 1: 0xefeecf8c Mirror 21: 0xefeecf8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27264: skipped 000505 1776995264.579525 mapread 0x01f79b thru 0x023833 (0x4099 bytes) 000506 1776995264.660216 write 0x00cc35 thru 0x016ac8 (0x9e94 bytes) 000507 1776995264.748022 read 0x00e121 thru 0x01a9d3 (0xc8b3 bytes) 000508 1776995264.761208 fallocate 0x0058c2 thru 0x00f495 (0x9bd4 bytes) 000509 1776995264.769903 punch from 0x0156ca to 0x01b337 (0x5c6e bytes) 000510 1776995264.791292 mapread 0x001452 thru 0x004612 (0x31c1 bytes) 000511 1776995264.802688 trunc from 0x00176f to 0x001839 (0xcb bytes) 000512 1776995264.811055 trunc from 0x027264 to 0x013229 (0x1403a bytes) 000513 1776995264.859740 write 0x0330ba thru 0x03eb89 (0xbad0 bytes) 000516 1776995264.865302 trunc from 0x03eb8a to 0x013fcc (0x2abbd bytes) 000517 1776995264.883548 mapread 0x009fe8 thru 0x00a64d (0x666 bytes) 000518 1776995264.889068 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x13fcd): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13fcd): Mirror 6: 0x751463ee (stale) Mirror 8: 0x751463ee (stale) Mirror 9: 0x751463ee (stale) Mirror 12: 0x751463ee (stale) Mirror 14: 0x751463ee (stale) Mirror 15: 0x751463ee (stale) Mirror 16: 0x751463ee (stale) Mirror 17: 0x751463ee (stale) Mirror 18: 0x751463ee (stale) Mirror 19: 0x751463ee (stale) Mirror 20: 0x751463ee (stale) Mirror 21: 0x751463ee (stale) CRC-32 checksum value for chunk [0, 0x13fcd): Mirror 1: 0xc1c3978e Mirror 22: 0xc1c3978e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13fcd: skipped 000519 1776995266.570332 trunc from 0x00d4b7 to 0x013fcc (0x6b16 bytes) 000520 1776995266.627819 trunc from 0x013fcd to 0x025137 (0x1116b bytes) 000521 1776995266.646307 trunc from 0x021e3f to 0x025137 (0x32f9 bytes) 000522 1776995266.658051 MIRROR_RESYNC 14 mirrors 000523 1776995271.399887 write 0x0393b8 thru 0x03ffff (0x6c48 bytes) 000524 1776995271.457200 punch from 0x00d4c3 to 0x011a70 (0x45ae bytes) 000525 1776995271.468174 mapwrite 0x008a12 thru 0x0130ed (0xa6dc bytes) 000526 1776995271.597412 trunc from 0x00ffe9 to 0x017854 (0x786c bytes) 000527 1776995271.621542 read 0x009b65 thru 0x00f08a (0x5526 bytes) 000528 1776995271.645398 read 0x035662 thru 0x03ffff (0xa99e bytes) 000530 1776995271.672492 fallocate 0x0275f1 thru 0x0291ab (0x1bbb bytes) 000531 1776995271.681805 mapwrite 0x0041e2 thru 0x008493 (0x42b2 bytes) 000532 1776995271.718170 write 0x0019ce thru 0x00f670 (0xdca3 bytes) 000533 1776995271.720222 read 0x027414 thru 0x02b842 (0x442f bytes) 000534 1776995271.721628 punch from 0x001c28 to 0x009b8e (0x7f67 bytes) 000535 1776995271.750283 trunc from 0x040000 to 0x00aa15 (0x355ea bytes) 000536 1776995271.783622 fallocate 0x01fb62 thru 0x02eadf (0xef7e bytes) 000537 1776995271.799520 trunc from 0x00a231 to 0x00aa15 (0x7e5 bytes) 000538 1776995271.806914 trunc from 0x004907 to 0x00aa15 (0x610f bytes) 000539 1776995271.814159 trunc from 0x00aa16 to 0x030143 (0x2572e bytes) 000540 1776995271.839285 punch from 0x027ed9 to 0x030143 (0x826b bytes) 000541 1776995271.844875 punch from 0x018300 to 0x024790 (0xc491 bytes) 000542 1776995271.849929 punch from 0x02b325 to 0x030143 (0x4e1f bytes) 000543 1776995271.854761 trunc from 0x030144 to 0x0254a0 (0xaca3 bytes) 000544 1776995271.883165 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x254a1): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x254a1): Mirror 6: 0xe7017c99 (stale) Mirror 8: 0xe7017c99 (stale) Mirror 9: 0xe7017c99 (stale) Mirror 12: 0xe7017c99 (stale) Mirror 14: 0xe7017c99 (stale) Mirror 15: 0xe7017c99 (stale) Mirror 16: 0xe7017c99 (stale) Mirror 17: 0xe7017c99 (stale) Mirror 18: 0xe7017c99 (stale) Mirror 19: 0xe7017c99 (stale) Mirror 20: 0xe7017c99 (stale) Mirror 21: 0xe7017c99 (stale) Mirror 22: 0xe7017c99 (stale) CRC-32 checksum value for chunk [0, 0x254a1): Mirror 1: 0x7fef6ba9 Mirror 23: 0x7fef6ba9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x254a1: skipped 000545 1776995273.609448 trunc from 0x0254a1 to 0x004e1a (0x20686 bytes) 000546 1776995273.726948 write 0x006aa5 thru 0x0162fd (0xf859 bytes) 000547 1776995273.728878 mapread 0x009306 thru 0x0162fd (0xcff8 bytes) 000548 1776995273.742991 MIRROR_RESYNC 15 mirrors 000549 1776995276.988075 trunc from 0x007dcd to 0x0162fd (0xe531 bytes) 000550 1776995277.062449 mapread 0x00c9fe thru 0x0162fd (0x9900 bytes) 000551 1776995277.095487 punch from 0x002984 to 0x007568 (0x4be5 bytes) 000552 1776995277.102306 trunc from 0x003dcd to 0x006b57 (0x2d8b bytes) 000553 1776995277.108609 punch from 0x01337b to 0x0162fd (0x2f83 bytes) 000554 1776995277.122590 mapread 0x00c4a2 thru 0x0162fd (0x9e5c bytes) 000555 1776995277.134567 mapwrite 0x014920 thru 0x014c83 (0x364 bytes) 000556 1776995277.156574 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x162fe): Mirror 6: 0xd8fc73f1 (stale) Mirror 8: 0xd8fc73f1 (stale) Mirror 9: 0xd8fc73f1 (stale) Mirror 12: 0xd8fc73f1 (stale) Mirror 14: 0xd8fc73f1 (stale) Mirror 16: 0xd8fc73f1 (stale) Mirror 17: 0xd8fc73f1 (stale) Mirror 18: 0xd8fc73f1 (stale) Mirror 19: 0xd8fc73f1 (stale) Mirror 20: 0xd8fc73f1 (stale) Mirror 21: 0xd8fc73f1 (stale) Mirror 22: 0xd8fc73f1 (stale) Mirror 23: 0xd8fc73f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x162fe): Mirror 6: 0xd8fc73f1 (stale) Mirror 8: 0xd8fc73f1 (stale) Mirror 9: 0xd8fc73f1 (stale) Mirror 12: 0xd8fc73f1 (stale) Mirror 14: 0xd8fc73f1 (stale) Mirror 16: 0xd8fc73f1 (stale) Mirror 17: 0xd8fc73f1 (stale) Mirror 18: 0xd8fc73f1 (stale) Mirror 19: 0xd8fc73f1 (stale) Mirror 20: 0xd8fc73f1 (stale) Mirror 21: 0xd8fc73f1 (stale) Mirror 22: 0xd8fc73f1 (stale) Mirror 23: 0xd8fc73f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x162fe: skipped 000557 1776995278.218248 punch from 0x007355 to 0x00ebc7 (0x7873 bytes) 000559 1776995278.229297 trunc from 0x0162fe to 0x03c0b5 (0x25db8 bytes) 000560 1776995278.260314 mapread 0x013f57 thru 0x021948 (0xd9f2 bytes) 000561 1776995278.327577 punch from 0x024dde to 0x02f24e (0xa471 bytes) 000562 1776995278.333771 write 0x036479 thru 0x03ffff (0x9b87 bytes) 000563 1776995278.364384 mapwrite 0x025ba9 thru 0x034e9b (0xf2f3 bytes) 000564 1776995278.453721 fallocate 0x0121a1 thru 0x01766f (0x54cf bytes) 000565 1776995278.477868 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb5db1087 (stale) Mirror 8: 0xb5db1087 (stale) Mirror 9: 0xb5db1087 (stale) Mirror 12: 0xb5db1087 (stale) Mirror 14: 0xb5db1087 (stale) Mirror 16: 0xb5db1087 (stale) Mirror 17: 0xb5db1087 (stale) Mirror 18: 0xb5db1087 (stale) Mirror 19: 0xb5db1087 (stale) Mirror 20: 0xb5db1087 (stale) Mirror 21: 0xb5db1087 (stale) Mirror 22: 0xb5db1087 (stale) Mirror 23: 0xb5db1087 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3b9a1ce5 Mirror 24: 0x3b9a1ce5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000566 1776995280.461596 trunc from 0x040000 to 0x039d9b (0x6264 bytes) 000567 1776995280.600917 punch from 0x017fe7 to 0x01aa05 (0x2a1f bytes) 000568 1776995280.610975 fallocate 0x001c55 thru 0x007a0b (0x5db7 bytes) 000569 1776995280.620562 write 0x01f93d thru 0x02c7f2 (0xceb6 bytes) 000570 1776995280.638593 mapread 0x011f65 thru 0x0201f9 (0xe295 bytes) 000571 1776995280.711169 write 0x0306ab thru 0x033ff3 (0x3949 bytes) 000572 1776995280.777028 fallocate 0x012a45 thru 0x015f32 (0x34ee bytes) 000573 1776995280.789627 write 0x01aada thru 0x025a45 (0xaf6c bytes) 000574 1776995280.791265 write 0x0357ed thru 0x0378bb (0x20cf bytes) 000575 1776995280.797054 fallocate 0x01f67c thru 0x029af8 (0xa47d bytes) 000576 1776995280.811790 write 0x02e02c thru 0x02ee10 (0xde5 bytes) 000577 1776995280.812915 trunc from 0x0029d8 to 0x01215f (0xf788 bytes) 000578 1776995280.829278 mapwrite 0x018725 thru 0x020020 (0x78fc bytes) 000579 1776995280.928614 punch from 0x026e1e to 0x029c06 (0x2de9 bytes) 000580 1776995280.950047 read 0x00b0e4 thru 0x01aa46 (0xf963 bytes) 000581 1776995280.995616 mapwrite 0x008d52 thru 0x018197 (0xf446 bytes) 000582 1776995281.082446 fallocate 0x02d069 thru 0x036d22 (0x9cba bytes) 000583 1776995281.096556 trunc from 0x02d583 to 0x03781b (0xa299 bytes) 000584 1776995281.113460 write 0x01c2c0 thru 0x02b224 (0xef65 bytes) 000585 1776995281.117522 punch from 0x020685 to 0x0222dd (0x1c59 bytes) 000586 1776995281.176277 trunc from 0x009442 to 0x017cba (0xe879 bytes) 000587 1776995281.188393 mapwrite 0x01bad6 thru 0x023483 (0x79ae bytes) 000588 1776995281.284163 mapread 0x00865d thru 0x016aea (0xe48e bytes) 000589 1776995281.344324 mapread 0x01dde3 thru 0x02be83 (0xe0a1 bytes) 000590 1776995281.345827 punch from 0x016bd6 to 0x01c375 (0x57a0 bytes) 000591 1776995281.360770 mapwrite 0x029214 thru 0x03406f (0xae5c bytes) 000592 1776995281.423567 punch from 0x020a29 to 0x021f3d (0x1515 bytes) 000593 1776995281.446216 fallocate 0x013d45 thru 0x01c466 (0x8722 bytes) 000594 1776995281.458088 mapwrite 0x01b109 thru 0x01ed08 (0x3c00 bytes) 000595 1776995281.561323 trunc from 0x02917f to 0x02fc95 (0x6b17 bytes) 000597 1776995281.579377 read 0x017a53 thru 0x025ca1 (0xe24f bytes) 000598 1776995281.590249 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x39d9c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d9c): Mirror 6: 0xdca20f39 (stale) Mirror 8: 0xdca20f39 (stale) Mirror 9: 0xdca20f39 (stale) Mirror 12: 0xdca20f39 (stale) Mirror 14: 0xdca20f39 (stale) Mirror 16: 0xdca20f39 (stale) Mirror 17: 0xdca20f39 (stale) Mirror 18: 0xdca20f39 (stale) Mirror 19: 0xdca20f39 (stale) Mirror 20: 0xdca20f39 (stale) Mirror 21: 0xdca20f39 (stale) Mirror 22: 0xdca20f39 (stale) Mirror 23: 0xdca20f39 (stale) Mirror 24: 0xd577e069 (stale) CRC-32 checksum value for chunk [0, 0x39d9c): Mirror 1: 0x73b6eb4f Mirror 25: 0x73b6eb4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d9c: skipped 000599 1776995283.262564 fallocate 0x005b8e thru 0x00994d (0x3dc0 bytes) 000600 1776995283.357400 mapwrite 0x00c7cf thru 0x011031 (0x4863 bytes) 000602 1776995283.460016 MIRROR_RESYNC 16 mirrors 000603 1776995291.361652 mapread 0x026125 thru 0x02764d (0x1529 bytes) 000604 1776995291.387336 mapwrite 0x02e67a thru 0x037513 (0x8e9a bytes) 000605 1776995291.593865 trunc from 0x039d9c to 0x01e27d (0x1bb1e bytes) 000606 1776995291.623619 read 0x0109d9 thru 0x01e27d (0xd8a5 bytes) 000608 1776995291.640615 trunc from 0x011812 to 0x0141ba (0x29a9 bytes) 000609 1776995291.649691 fallocate 0x015196 thru 0x0228ac (0xd717 bytes) 000610 1776995291.658627 fallocate 0x0311a5 thru 0x032283 (0x10df bytes) 000611 1776995291.666584 write 0x001add thru 0x00969e (0x7bc2 bytes) 000612 1776995291.685330 trunc from 0x001a97 to 0x00b135 (0x969f bytes) 000613 1776995291.721390 fallocate 0x023854 thru 0x02e73d (0xaeea bytes) 000614 1776995291.730527 fallocate 0x024c58 thru 0x031057 (0xc400 bytes) 000615 1776995291.748292 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32284): Mirror 6: 0xf1e64986 (stale) Mirror 8: 0xf1e64986 (stale) Mirror 9: 0xf1e64986 (stale) Mirror 12: 0xf1e64986 (stale) Mirror 14: 0xf1e64986 (stale) Mirror 16: 0xf1e64986 (stale) Mirror 17: 0xf1e64986 (stale) Mirror 18: 0xf1e64986 (stale) Mirror 20: 0xf1e64986 (stale) Mirror 21: 0xf1e64986 (stale) Mirror 22: 0xf1e64986 (stale) Mirror 23: 0xf1e64986 (stale) Mirror 24: 0xf1e64986 (stale) Mirror 25: 0xf1e64986 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32284): Mirror 6: 0xf1e64986 (stale) Mirror 8: 0xf1e64986 (stale) Mirror 9: 0xf1e64986 (stale) Mirror 12: 0xf1e64986 (stale) Mirror 14: 0xf1e64986 (stale) Mirror 16: 0xf1e64986 (stale) Mirror 17: 0xf1e64986 (stale) Mirror 18: 0xf1e64986 (stale) Mirror 20: 0xf1e64986 (stale) Mirror 21: 0xf1e64986 (stale) Mirror 22: 0xf1e64986 (stale) Mirror 23: 0xf1e64986 (stale) Mirror 24: 0xf1e64986 (stale) Mirror 25: 0xf1e64986 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32284: skipped 000616 1776995292.813856 write 0x038ff5 thru 0x03ffff (0x700b bytes) 000618 1776995292.837235 mapread 0x02d745 thru 0x03bfd9 (0xe895 bytes) 000619 1776995292.915010 punch from 0x015af2 to 0x01df6a (0x8479 bytes) 000620 1776995292.952818 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x12f50cdb (stale) Mirror 8: 0x12f50cdb (stale) Mirror 9: 0x12f50cdb (stale) Mirror 12: 0x12f50cdb (stale) Mirror 14: 0x12f50cdb (stale) Mirror 16: 0x12f50cdb (stale) Mirror 17: 0x12f50cdb (stale) Mirror 18: 0x12f50cdb (stale) Mirror 20: 0x12f50cdb (stale) Mirror 21: 0x12f50cdb (stale) Mirror 23: 0x12f50cdb (stale) Mirror 24: 0x12f50cdb (stale) Mirror 25: 0x12f50cdb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x12f50cdb (stale) Mirror 8: 0x12f50cdb (stale) Mirror 9: 0x12f50cdb (stale) Mirror 12: 0x12f50cdb (stale) Mirror 14: 0x12f50cdb (stale) Mirror 16: 0x12f50cdb (stale) Mirror 17: 0x12f50cdb (stale) Mirror 18: 0x12f50cdb (stale) Mirror 20: 0x12f50cdb (stale) Mirror 21: 0x12f50cdb (stale) Mirror 23: 0x12f50cdb (stale) Mirror 24: 0x12f50cdb (stale) Mirror 25: 0x12f50cdb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000621 1776995293.884626 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x12f50cdb (stale) Mirror 8: 0x12f50cdb (stale) Mirror 9: 0x12f50cdb (stale) Mirror 12: 0x12f50cdb (stale) Mirror 14: 0x12f50cdb (stale) Mirror 16: 0x12f50cdb (stale) Mirror 18: 0x12f50cdb (stale) Mirror 20: 0x12f50cdb (stale) Mirror 21: 0x12f50cdb (stale) Mirror 23: 0x12f50cdb (stale) Mirror 24: 0x12f50cdb (stale) Mirror 25: 0x12f50cdb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x12f50cdb (stale) Mirror 8: 0x12f50cdb (stale) Mirror 9: 0x12f50cdb (stale) Mirror 12: 0x12f50cdb (stale) Mirror 14: 0x12f50cdb (stale) Mirror 16: 0x12f50cdb (stale) Mirror 18: 0x12f50cdb (stale) Mirror 20: 0x12f50cdb (stale) Mirror 21: 0x12f50cdb (stale) Mirror 23: 0x12f50cdb (stale) Mirror 24: 0x12f50cdb (stale) Mirror 25: 0x12f50cdb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000622 1776995294.835050 write 0x02e876 thru 0x034e82 (0x660d bytes) 000623 1776995294.855471 write 0x01841d thru 0x022b4f (0xa733 bytes) 000624 1776995294.876930 write 0x036836 thru 0x03ffff (0x97ca bytes) 000625 1776995294.895654 trunc from 0x040000 to 0x00127a (0x3ed85 bytes) 000626 1776995294.921321 punch from 0x000725 to 0x00127a (0xb56 bytes) 000627 1776995294.935717 MIRROR_RESYNC 13 mirrors 000628 1776995296.506267 read 0x0009af thru 0x00127a (0x8cc bytes) 000629 1776995296.513451 mapread 0x000b85 thru 0x00127a (0x6f6 bytes) 000630 1776995296.514257 fallocate 0x03550f thru 0x03ffff (0xaaf1 bytes) 000631 1776995296.562341 punch from 0x016f16 to 0x0242d3 (0xd3be bytes) 000632 1776995296.570990 fallocate 0x033a1a thru 0x03a6e6 (0x6ccd bytes) 000633 1776995296.577884 write 0x01c18d thru 0x02af3d (0xedb1 bytes) 000634 1776995296.591514 fallocate 0x01322e thru 0x01c314 (0x90e7 bytes) 000635 1776995296.598081 mapread 0x00aed1 thru 0x00fb59 (0x4c89 bytes) 000636 1776995296.610238 mapread 0x00f7da thru 0x010976 (0x119d bytes) 000637 1776995296.611808 write 0x009c11 thru 0x00fe71 (0x6261 bytes) 000638 1776995296.622975 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000639 1776995297.488352 trunc from 0x040000 to 0x02a5bf (0x15a40 bytes) 000640 1776995297.525148 trunc from 0x02a5c0 to 0x02250b (0x80b4 bytes) 000641 1776995297.554006 mapread 0x01eb03 thru 0x02250b (0x3a09 bytes) 000642 1776995297.622409 trunc from 0x02250c to 0x019cbb (0x8850 bytes) 000643 1776995297.674623 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19cbc): Mirror 6: 0x96a957e5 (stale) Mirror 8: 0x96a957e5 (stale) Mirror 9: 0x96a957e5 (stale) Mirror 14: 0x96a957e5 (stale) Mirror 16: 0x96a957e5 (stale) Mirror 18: 0x96a957e5 (stale) Mirror 20: 0x96a957e5 (stale) Mirror 21: 0x96a957e5 (stale) Mirror 23: 0x96a957e5 (stale) Mirror 25: 0x96a957e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19cbc): Mirror 6: 0x96a957e5 (stale) Mirror 8: 0x96a957e5 (stale) Mirror 9: 0x96a957e5 (stale) Mirror 14: 0x96a957e5 (stale) Mirror 16: 0x96a957e5 (stale) Mirror 18: 0x96a957e5 (stale) Mirror 20: 0x96a957e5 (stale) Mirror 21: 0x96a957e5 (stale) Mirror 23: 0x96a957e5 (stale) Mirror 25: 0x96a957e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19cbc: skipped 000644 1776995298.527174 punch from 0x00b24f to 0x00f385 (0x4137 bytes) 000645 1776995298.553061 MIRROR_RESYNC 11 mirrors 000646 1776995302.487824 mapread 0x018dcb thru 0x019cbb (0xef1 bytes) 000648 1776995302.507920 write 0x006e98 thru 0x00d4fe (0x6667 bytes) 000649 1776995302.562906 read 0x017105 thru 0x01892b (0x1827 bytes) 000650 1776995302.571016 read 0x006d4e thru 0x00ae29 (0x40dc bytes) 000651 1776995302.571923 punch from 0x00b701 to 0x019cbb (0xe5bb bytes) 000652 1776995302.592608 punch from 0x00d704 to 0x00ea04 (0x1301 bytes) 000653 1776995302.599148 mapwrite 0x0360d3 thru 0x03fd13 (0x9c41 bytes) 000654 1776995302.660166 trunc from 0x03fd14 to 0x000ef0 (0x3ee23 bytes) 000655 1776995302.681013 mapread 0x000211 thru 0x000ef0 (0xce0 bytes) 000656 1776995302.682128 read 0x00084c thru 0x000ef0 (0x6a5 bytes) 000657 1776995302.682965 write 0x0364e6 thru 0x03ffff (0x9b1a bytes) 000658 1776995302.684590 punch from 0x0251ca to 0x02ef83 (0x9dba bytes) 000660 1776995302.691446 mapwrite 0x03f19d thru 0x03ffff (0xe63 bytes) 000661 1776995302.712917 punch from 0x02c960 to 0x02d647 (0xce8 bytes) 000662 1776995302.719185 trunc from 0x02fecb to 0x0343a5 (0x44db bytes) 000663 1776995302.724232 trunc from 0x03ea35 to 0x03ffff (0x15cb bytes) 000664 1776995302.730990 read 0x022808 thru 0x0298ec (0x70e5 bytes) 000665 1776995302.765077 fallocate 0x014fd4 thru 0x019dad (0x4dda bytes) 000667 1776995302.772831 write 0x02e6da thru 0x02f286 (0xbad bytes) 000668 1776995302.774651 write 0x0059eb thru 0x00bcfc (0x6312 bytes) 000669 1776995302.776823 mapread 0x023c23 thru 0x02aba9 (0x6f87 bytes) 000670 1776995302.778634 mapwrite 0x03cedc thru 0x03ffff (0x3124 bytes) 000671 1776995302.807979 trunc from 0x040000 to 0x03688a (0x9775 bytes) 000672 1776995302.831896 read 0x010db4 thru 0x01c300 (0xb54d bytes) 000673 1776995302.839109 MIRROR_RESYNC 11 mirrors 000674 1776995306.440031 write 0x018df5 thru 0x019f76 (0x1182 bytes) 000675 1776995306.519364 trunc from 0x03688b to 0x02f698 (0x71f2 bytes) 000676 1776995306.569476 write 0x0074f1 thru 0x00d97a (0x648a bytes) 000677 1776995306.585445 fallocate 0x02ccf3 thru 0x038f91 (0xc29f bytes) 000679 1776995306.597358 trunc from 0x038f92 to 0x025610 (0x13981 bytes) 000680 1776995306.626248 mapread 0x01bb2e thru 0x02229e (0x6771 bytes) 000681 1776995306.691491 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25611): Mirror 6: 0xb8ff330f (stale) Mirror 8: 0xb8ff330f (stale) Mirror 9: 0xb8ff330f (stale) Mirror 14: 0xb8ff330f (stale) Mirror 18: 0xb8ff330f (stale) Mirror 20: 0xb8ff330f (stale) Mirror 21: 0xb8ff330f (stale) Mirror 23: 0xb8ff330f (stale) Mirror 25: 0xb8ff330f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25611): Mirror 6: 0xb8ff330f (stale) Mirror 8: 0xb8ff330f (stale) Mirror 9: 0xb8ff330f (stale) Mirror 14: 0xb8ff330f (stale) Mirror 18: 0xb8ff330f (stale) Mirror 20: 0xb8ff330f (stale) Mirror 21: 0xb8ff330f (stale) Mirror 23: 0xb8ff330f (stale) Mirror 25: 0xb8ff330f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25611: skipped 000682 1776995307.814105 trunc from 0x0254c9 to 0x025610 (0x148 bytes) 000683 1776995307.820277 mapwrite 0x008a80 thru 0x0187e5 (0xfd66 bytes) 000684 1776995307.901655 trunc from 0x025611 to 0x0270ad (0x1a9d bytes) 000685 1776995307.938660 write 0x0018b7 thru 0x00317e (0x18c8 bytes) 000686 1776995307.976925 read 0x00287d thru 0x005637 (0x2dbb bytes) 000687 1776995307.980282 write 0x03b7fc thru 0x03ffff (0x4804 bytes) 000688 1776995307.984056 fallocate 0x00a466 thru 0x00ad11 (0x8ac bytes) 000689 1776995307.991511 fallocate 0x02ede2 thru 0x03d3a2 (0xe5c1 bytes) 000690 1776995307.998033 read 0x00211e thru 0x00f9ad (0xd890 bytes) 000691 1776995307.999315 fallocate 0x02f36d thru 0x03b121 (0xbdb5 bytes) 000692 1776995308.006401 fallocate 0x026852 thru 0x03680a (0xffb9 bytes) 000693 1776995308.013216 punch from 0x01761e to 0x01ca2c (0x540f bytes) 000694 1776995308.027525 read 0x02c76b thru 0x03b144 (0xe9da bytes) 000696 1776995308.048573 punch from 0x028589 to 0x028db0 (0x828 bytes) 000697 1776995308.056372 mapread 0x03adc8 thru 0x03ffff (0x5238 bytes) 000698 1776995308.061379 punch from 0x030a36 to 0x0388d5 (0x7ea0 bytes) 000699 1776995308.090994 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x26db08cc (stale) Mirror 9: 0x26db08cc (stale) Mirror 14: 0x26db08cc (stale) Mirror 18: 0x26db08cc (stale) Mirror 20: 0x26db08cc (stale) Mirror 21: 0x26db08cc (stale) Mirror 23: 0x26db08cc (stale) Mirror 25: 0x26db08cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x26db08cc (stale) Mirror 9: 0x26db08cc (stale) Mirror 14: 0x26db08cc (stale) Mirror 18: 0x26db08cc (stale) Mirror 20: 0x26db08cc (stale) Mirror 21: 0x26db08cc (stale) Mirror 23: 0x26db08cc (stale) Mirror 25: 0x26db08cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000700 1776995309.053021 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x26db08cc (stale) Mirror 14: 0x26db08cc (stale) Mirror 18: 0x26db08cc (stale) Mirror 20: 0x26db08cc (stale) Mirror 21: 0x26db08cc (stale) Mirror 23: 0x26db08cc (stale) Mirror 25: 0x26db08cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x26db08cc (stale) Mirror 14: 0x26db08cc (stale) Mirror 18: 0x26db08cc (stale) Mirror 20: 0x26db08cc (stale) Mirror 21: 0x26db08cc (stale) Mirror 23: 0x26db08cc (stale) Mirror 25: 0x26db08cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000701 1776995309.688442 punch from 0x03ccc2 to 0x03ffff (0x333e bytes) 000702 1776995309.698978 mapwrite 0x01b41a thru 0x028bad (0xd794 bytes) 000703 1776995309.838073 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x26db08cc (stale) Mirror 18: 0x26db08cc (stale) Mirror 20: 0x26db08cc (stale) Mirror 21: 0x26db08cc (stale) Mirror 23: 0x26db08cc (stale) Mirror 25: 0x26db08cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x26db08cc (stale) Mirror 18: 0x26db08cc (stale) Mirror 20: 0x26db08cc (stale) Mirror 21: 0x26db08cc (stale) Mirror 23: 0x26db08cc (stale) Mirror 25: 0x26db08cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000704 1776995310.584662 fallocate 0x028330 thru 0x03753d (0xf20e bytes) 000705 1776995310.608354 mapread 0x012573 thru 0x019e42 (0x78d0 bytes) 000706 1776995310.640425 trunc from 0x040000 to 0x0032e6 (0x3cd19 bytes) 000707 1776995310.671139 mapwrite 0x026ec6 thru 0x0301e7 (0x9322 bytes) 000708 1776995310.736885 read 0x027c16 thru 0x0281ae (0x599 bytes) 000709 1776995310.737592 read 0x013013 thru 0x020320 (0xd30e bytes) 000710 1776995310.754144 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x301e8): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x301e8): Mirror 14: 0x947268c (stale) Mirror 18: 0x947268c (stale) Mirror 20: 0x947268c (stale) Mirror 21: 0x947268c (stale) Mirror 23: 0x947268c (stale) Mirror 25: 0x947268c (stale) CRC-32 checksum value for chunk [0, 0x301e8): Mirror 1: 0x28c09984 Mirror 26: 0x28c09984 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x301e8: skipped 000711 1776995312.011237 trunc from 0x001ff1 to 0x00ac7b (0x8c8b bytes) 000712 1776995312.078750 trunc from 0x024fa3 to 0x02f6f3 (0xa751 bytes) 000713 1776995312.086170 trunc from 0x0301e8 to 0x02c1c3 (0x4024 bytes) 000714 1776995312.153576 punch from 0x012320 to 0x016e4d (0x4b2e bytes) 000715 1776995312.188231 write 0x003d39 thru 0x012751 (0xea19 bytes) 000716 1776995312.221355 trunc from 0x02c1c4 to 0x032a75 (0x68b2 bytes) 000718 1776995312.269821 mapread 0x0233c8 thru 0x030ad4 (0xd70d bytes) 000719 1776995312.315366 write 0x025867 thru 0x032413 (0xcbad bytes) 000720 1776995312.323969 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x32a76): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a76): Mirror 14: 0xd2f1885f (stale) Mirror 18: 0xd2f1885f (stale) Mirror 20: 0xd2f1885f (stale) Mirror 21: 0xd2f1885f (stale) Mirror 23: 0xd2f1885f (stale) Mirror 25: 0xd2f1885f (stale) Mirror 26: 0x6a0f4395 (stale) CRC-32 checksum value for chunk [0, 0x32a76): Mirror 1: 0xdc1bcc68 Mirror 27: 0xdc1bcc68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a76: skipped 000721 1776995314.182773 read 0x02c299 thru 0x02e5f2 (0x235a bytes) 000722 1776995314.217209 trunc from 0x032a76 to 0x01703f (0x1ba36 bytes) 000723 1776995314.313247 mapread 0x009f30 thru 0x00c519 (0x25ea bytes) 000724 1776995314.342248 MIRROR_RESYNC 9 mirrors 000725 1776995317.763010 punch from 0x0039da to 0x00598d (0x1fb4 bytes) 000727 1776995317.839505 mapwrite 0x00d1f4 thru 0x01adfa (0xdc07 bytes) 000728 1776995318.027626 write 0x02163e thru 0x024579 (0x2f3c bytes) 000729 1776995318.055408 mapread 0x0238ac thru 0x02406f (0x7c4 bytes) 000731 1776995318.078659 fallocate 0x0193a5 thru 0x01ba68 (0x26c4 bytes) 000732 1776995318.099231 trunc from 0x02457a to 0x004193 (0x203e6 bytes) 000733 1776995318.134103 mapread 0x003ab5 thru 0x004193 (0x6df bytes) 000734 1776995318.153941 punch from 0x00018b to 0x004193 (0x4009 bytes) 000735 1776995318.166615 punch from 0x001707 to 0x004193 (0x2a8d bytes) 000736 1776995318.177342 write 0x0336db thru 0x03ffff (0xc925 bytes) 000737 1776995318.186812 punch from 0x00c7e5 to 0x01b006 (0xe822 bytes) 000739 1776995318.197843 trunc from 0x040000 to 0x03944a (0x6bb5 bytes) 000740 1776995318.216641 trunc from 0x033af4 to 0x0390d1 (0x55de bytes) 000742 1776995318.247711 write 0x02b0b5 thru 0x039b23 (0xea6f bytes) 000743 1776995318.278229 punch from 0x023587 to 0x0304cb (0xcf45 bytes) 000744 1776995318.318707 write 0x02257a thru 0x027f73 (0x59fa bytes) 000745 1776995318.340070 fallocate 0x001f79 thru 0x002a42 (0xaca bytes) 000746 1776995318.348557 punch from 0x00d589 to 0x012405 (0x4e7d bytes) 000747 1776995318.354329 mapwrite 0x03455e thru 0x03ffff (0xbaa2 bytes) 000748 1776995318.422274 write 0x0095a3 thru 0x010f53 (0x79b1 bytes) 000749 1776995318.435487 trunc from 0x036614 to 0x03f492 (0x8e7f bytes) 000750 1776995318.443006 read 0x01140b thru 0x0167c9 (0x53bf bytes) 000751 1776995318.469142 punch from 0x01e408 to 0x025423 (0x701c bytes) 000752 1776995318.478236 fallocate 0x02a9a9 thru 0x031f9b (0x75f3 bytes) 000753 1776995318.491177 fallocate 0x0048d3 thru 0x00fc2b (0xb359 bytes) 000754 1776995318.501914 mapwrite 0x00860c thru 0x00a0d3 (0x1ac8 bytes) 000755 1776995318.527351 punch from 0x00861b to 0x00de17 (0x57fd bytes) 000756 1776995318.544221 mapwrite 0x01a184 thru 0x01eb3f (0x49bc bytes) 000757 1776995318.620636 punch from 0x02dd03 to 0x02e3cf (0x6cd bytes) 000758 1776995318.628877 read 0x01d192 thru 0x023f9e (0x6e0d bytes) 000759 1776995318.629942 mapwrite 0x013356 thru 0x015b67 (0x2812 bytes) 000760 1776995318.684404 write 0x0068ac thru 0x013a98 (0xd1ed bytes) 000762 1776995318.690917 write 0x0345cd thru 0x03ffff (0xba33 bytes) 000763 1776995318.696831 punch from 0x020aa4 to 0x027d6c (0x72c9 bytes) 000764 1776995318.702548 mapread 0x00adfb thru 0x01a7fb (0xfa01 bytes) 000765 1776995318.710805 write 0x03ce0a thru 0x03ffff (0x31f6 bytes) 000766 1776995318.711928 fallocate 0x038517 thru 0x03ffff (0x7ae9 bytes) 000767 1776995318.718982 mapwrite 0x02d68b thru 0x02e8ca (0x1240 bytes) 000769 1776995318.807715 trunc from 0x040000 to 0x0248bd (0x1b742 bytes) 000770 1776995318.859411 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x248be): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x248be): Mirror 14: 0xf80d40b9 (stale) Mirror 18: 0xf80d40b9 (stale) Mirror 20: 0xf80d40b9 (stale) Mirror 21: 0xf80d40b9 (stale) Mirror 23: 0xf80d40b9 (stale) Mirror 25: 0xf80d40b9 (stale) Mirror 26: 0xf80d40b9 (stale) Mirror 27: 0xf80d40b9 (stale) CRC-32 checksum value for chunk [0, 0x248be): Mirror 1: 0xb01afdbb Mirror 28: 0xb01afdbb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x248be: skipped 000771 1776995320.953052 read 0x02194f thru 0x0248bd (0x2f6f bytes) 000772 1776995320.978141 punch from 0x00ea6b to 0x01413d (0x56d3 bytes) 000773 1776995321.064055 read 0x01162b thru 0x01711e (0x5af4 bytes) 000774 1776995321.082614 write 0x032101 thru 0x03365e (0x155e bytes) 000776 1776995321.096931 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3365f): Mirror 18: 0x7d68ce59 (stale) Mirror 20: 0x7d68ce59 (stale) Mirror 21: 0x7d68ce59 (stale) Mirror 23: 0x7d68ce59 (stale) Mirror 25: 0x7d68ce59 (stale) Mirror 26: 0x7d68ce59 (stale) Mirror 27: 0x7d68ce59 (stale) Mirror 28: 0xc782c287 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3365f): Mirror 18: 0x7d68ce59 (stale) Mirror 20: 0x7d68ce59 (stale) Mirror 21: 0x7d68ce59 (stale) Mirror 23: 0x7d68ce59 (stale) Mirror 25: 0x7d68ce59 (stale) Mirror 26: 0x7d68ce59 (stale) Mirror 27: 0x7d68ce59 (stale) Mirror 28: 0xc782c287 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3365f: skipped 000777 1776995321.798694 punch from 0x02e59d to 0x03365e (0x50c2 bytes) 000778 1776995321.808677 punch from 0x009d70 to 0x00ecc7 (0x4f58 bytes) 000779 1776995321.820712 write 0x01b18b thru 0x029e0c (0xec82 bytes) 000780 1776995321.854542 MIRROR_RESYNC 9 mirrors 000781 1776995326.990545 trunc from 0x03365f to 0x01fbc4 (0x13a9a bytes) 000782 1776995327.071208 trunc from 0x011011 to 0x01eab7 (0xdaa7 bytes) 000783 1776995327.080042 fallocate 0x017402 thru 0x023919 (0xc518 bytes) 000784 1776995327.101687 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2391a): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2391a): Mirror 18: 0x813f04f9 (stale) Mirror 20: 0x813f04f9 (stale) Mirror 21: 0x813f04f9 (stale) Mirror 23: 0x813f04f9 (stale) Mirror 25: 0x813f04f9 (stale) Mirror 26: 0x813f04f9 (stale) Mirror 27: 0x813f04f9 (stale) Mirror 28: 0x813f04f9 (stale) CRC-32 checksum value for chunk [0, 0x2391a): Mirror 1: 0x260166a0 Mirror 29: 0x260166a0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2391a: skipped 000785 1776995329.249882 read 0x000c8b thru 0x008ffd (0x8373 bytes) 000786 1776995329.314422 trunc from 0x01612d to 0x023919 (0xd7ed bytes) 000787 1776995329.401396 trunc from 0x02391a to 0x03a53e (0x16c25 bytes) 000789 1776995329.503476 fallocate 0x0197d0 thru 0x028936 (0xf167 bytes) 000790 1776995329.517537 write 0x033efc thru 0x03f8fa (0xb9ff bytes) 000791 1776995329.537962 mapread 0x016830 thru 0x01e463 (0x7c34 bytes) 000792 1776995329.565369 fallocate 0x004de0 thru 0x01246c (0xd68d bytes) 000793 1776995329.591000 fallocate 0x013f88 thru 0x01af10 (0x6f89 bytes) 000794 1776995329.611034 read 0x01e266 thru 0x02936b (0xb106 bytes) 000796 1776995329.673121 fallocate 0x0333b9 thru 0x0350ef (0x1d37 bytes) 000797 1776995329.710057 read 0x02b153 thru 0x02c457 (0x1305 bytes) 000798 1776995329.732910 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f8fb): Mirror 18: 0xab2317da (stale) Mirror 20: 0xab2317da (stale) Mirror 21: 0xab2317da (stale) Mirror 23: 0xab2317da (stale) Mirror 25: 0xab2317da (stale) Mirror 26: 0xab2317da (stale) Mirror 28: 0xab2317da (stale) Mirror 29: 0x6faaa01d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f8fb): Mirror 18: 0xab2317da (stale) Mirror 20: 0xab2317da (stale) Mirror 21: 0xab2317da (stale) Mirror 23: 0xab2317da (stale) Mirror 25: 0xab2317da (stale) Mirror 26: 0xab2317da (stale) Mirror 28: 0xab2317da (stale) Mirror 29: 0x6faaa01d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f8fb: skipped 000799 1776995330.847893 mapread 0x0211d7 thru 0x021500 (0x32a bytes) 000800 1776995330.860805 mapread 0x003805 thru 0x00c89e (0x909a bytes) 000801 1776995330.893139 read 0x01c14d thru 0x0278ee (0xb7a2 bytes) 000802 1776995330.916223 read 0x00bf66 thru 0x018ff2 (0xd08d bytes) 000803 1776995330.927692 read 0x016f8c thru 0x023a42 (0xcab7 bytes) 000804 1776995330.928407 mapread 0x00932d thru 0x014db2 (0xba86 bytes) 000805 1776995330.933265 mapread 0x004a1d thru 0x00619f (0x1783 bytes) 000806 1776995330.935045 mapwrite 0x009a4e thru 0x00c732 (0x2ce5 bytes) 000807 1776995330.950430 trunc from 0x03f8fb to 0x03d8f0 (0x200a bytes) 000808 1776995330.990576 fallocate 0x02adc0 thru 0x02cda8 (0x1fe9 bytes) 000809 1776995330.996122 write 0x013b2b thru 0x018c81 (0x5157 bytes) 000811 1776995330.997895 write 0x019cd6 thru 0x0231be (0x94e9 bytes) 000812 1776995331.007065 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d8f1): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8f1): Mirror 18: 0x476f45a0 (stale) Mirror 20: 0x476f45a0 (stale) Mirror 21: 0x476f45a0 (stale) Mirror 23: 0x476f45a0 (stale) Mirror 25: 0x476f45a0 (stale) Mirror 26: 0x476f45a0 (stale) Mirror 28: 0x476f45a0 (stale) Mirror 29: 0xa508c082 (stale) CRC-32 checksum value for chunk [0, 0x3d8f1): Mirror 1: 0xbad1f7d Mirror 30: 0xbad1f7d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8f1: skipped 000813 1776995332.410127 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d8f1): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8f1): Mirror 18: 0x476f45a0 (stale) Mirror 20: 0x476f45a0 (stale) Mirror 21: 0x476f45a0 (stale) Mirror 23: 0x476f45a0 (stale) Mirror 25: 0x476f45a0 (stale) Mirror 26: 0x476f45a0 (stale) Mirror 28: 0x476f45a0 (stale) Mirror 29: 0xa508c082 (stale) CRC-32 checksum value for chunk [0, 0x3d8f1): Mirror 1: 0xbad1f7d Mirror 30: 0xbad1f7d Mirror 31: 0xbad1f7d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8f1: skipped 000814 1776995334.121952 punch from 0x0032b0 to 0x00ceec (0x9c3d bytes) 000815 1776995334.216241 trunc from 0x03607e to 0x03d250 (0x71d3 bytes) 000816 1776995334.221913 trunc from 0x03d8f1 to 0x01aa8f (0x22e61 bytes) 000817 1776995334.265831 write 0x003cca thru 0x006f54 (0x328b bytes) 000818 1776995334.296472 mapread 0x008970 thru 0x015f9b (0xd62c bytes) 000820 1776995334.383568 read 0x00ca40 thru 0x00f7a7 (0x2d68 bytes) 000821 1776995334.395362 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1aa90): Mirror 20: 0xb452c333 (stale) Mirror 21: 0xb452c333 (stale) Mirror 23: 0xb452c333 (stale) Mirror 25: 0xb452c333 (stale) Mirror 26: 0xb452c333 (stale) Mirror 28: 0xb452c333 (stale) Mirror 29: 0x4fe12277 (stale) Mirror 30: 0x12e31ca0 (stale) Mirror 31: 0x12e31ca0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1aa90): Mirror 20: 0xb452c333 (stale) Mirror 21: 0xb452c333 (stale) Mirror 23: 0xb452c333 (stale) Mirror 25: 0xb452c333 (stale) Mirror 26: 0xb452c333 (stale) Mirror 28: 0xb452c333 (stale) Mirror 29: 0x4fe12277 (stale) Mirror 30: 0x12e31ca0 (stale) Mirror 31: 0x12e31ca0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1aa90: skipped 000822 1776995335.476964 read 0x019d90 thru 0x01aa8f (0xd00 bytes) 000823 1776995335.485807 punch from 0x0163f0 to 0x0170db (0xcec bytes) 000824 1776995335.499305 MIRROR_RESYNC 10 mirrors 000825 1776995339.417424 read 0x00de1c thru 0x01a73f (0xc924 bytes) 000826 1776995339.437863 read 0x002484 thru 0x00be0a (0x9987 bytes) 000827 1776995339.452049 read 0x01a5f7 thru 0x01aa8f (0x499 bytes) 000829 1776995339.453218 fallocate 0x0381a9 thru 0x038571 (0x3c9 bytes) 000830 1776995339.510147 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x38572): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38572): Mirror 20: 0xef0f811 (stale) Mirror 21: 0xef0f811 (stale) Mirror 23: 0xef0f811 (stale) Mirror 25: 0xef0f811 (stale) Mirror 26: 0xef0f811 (stale) Mirror 28: 0xef0f811 (stale) Mirror 29: 0xef0f811 (stale) Mirror 30: 0xef0f811 (stale) Mirror 31: 0xef0f811 (stale) CRC-32 checksum value for chunk [0, 0x38572): Mirror 1: 0xef0f811 Mirror 32: 0xef0f811 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38572: skipped 000831 1776995341.213322 mapwrite 0x03949e thru 0x03ffff (0x6b62 bytes) 000833 1776995341.391110 punch from 0x013e7f to 0x01459e (0x720 bytes) 000834 1776995341.415848 trunc from 0x040000 to 0x03907f (0x6f80 bytes) 000835 1776995341.451965 trunc from 0x02b102 to 0x02e768 (0x3667 bytes) 000836 1776995341.463822 punch from 0x030558 to 0x03907f (0x8b28 bytes) 000837 1776995341.476993 fallocate 0x017ce3 thru 0x01fdaf (0x80cd bytes) 000839 1776995341.491640 mapwrite 0x00b570 thru 0x00be89 (0x91a bytes) 000840 1776995341.544994 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39080): Mirror 20: 0xfe6ac7c7 (stale) Mirror 21: 0xfe6ac7c7 (stale) Mirror 23: 0xfe6ac7c7 (stale) Mirror 25: 0xfe6ac7c7 (stale) Mirror 26: 0xfe6ac7c7 (stale) Mirror 29: 0xfe6ac7c7 (stale) Mirror 30: 0xfe6ac7c7 (stale) Mirror 31: 0xfe6ac7c7 (stale) Mirror 32: 0xfe6ac7c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39080): Mirror 20: 0xfe6ac7c7 (stale) Mirror 21: 0xfe6ac7c7 (stale) Mirror 23: 0xfe6ac7c7 (stale) Mirror 25: 0xfe6ac7c7 (stale) Mirror 26: 0xfe6ac7c7 (stale) Mirror 29: 0xfe6ac7c7 (stale) Mirror 30: 0xfe6ac7c7 (stale) Mirror 31: 0xfe6ac7c7 (stale) Mirror 32: 0xfe6ac7c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39080: skipped 000841 1776995342.343127 mapwrite 0x03934f thru 0x03ef18 (0x5bca bytes) 000842 1776995342.449449 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef19): Mirror 20: 0xdbcb6b1c (stale) Mirror 21: 0xdbcb6b1c (stale) Mirror 23: 0xdbcb6b1c (stale) Mirror 25: 0xdbcb6b1c (stale) Mirror 26: 0xdbcb6b1c (stale) Mirror 30: 0xdbcb6b1c (stale) Mirror 31: 0xdbcb6b1c (stale) Mirror 32: 0xdbcb6b1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef19): Mirror 20: 0xdbcb6b1c (stale) Mirror 21: 0xdbcb6b1c (stale) Mirror 23: 0xdbcb6b1c (stale) Mirror 25: 0xdbcb6b1c (stale) Mirror 26: 0xdbcb6b1c (stale) Mirror 30: 0xdbcb6b1c (stale) Mirror 31: 0xdbcb6b1c (stale) Mirror 32: 0xdbcb6b1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef19: skipped 000843 1776995343.316251 punch from 0x000054 to 0x00681d (0x67ca bytes) 000844 1776995343.328659 punch from 0x006c4f to 0x01300d (0xc3bf bytes) 000845 1776995343.343100 fallocate 0x01527d thru 0x01b97e (0x6702 bytes) 000846 1776995343.364124 MIRROR_RESYNC 9 mirrors 000847 1776995346.984345 mapwrite 0x01ee80 thru 0x020e14 (0x1f95 bytes) 000848 1776995347.167463 trunc from 0x00c537 to 0x00d876 (0x1340 bytes) 000849 1776995347.174605 read 0x005908 thru 0x007faa (0x26a3 bytes) 000850 1776995347.185119 punch from 0x00fefb to 0x014bd4 (0x4cda bytes) 000851 1776995347.208166 punch from 0x00c2ec to 0x01c25e (0xff73 bytes) 000852 1776995347.228755 write 0x02c1bb thru 0x02d9f7 (0x183d bytes) 000853 1776995347.252293 trunc from 0x026cf5 to 0x03549b (0xe7a7 bytes) 000855 1776995347.287671 mapwrite 0x001dea thru 0x00d7f0 (0xba07 bytes) 000856 1776995347.345554 fallocate 0x00984f thru 0x01949d (0xfc4f bytes) 000857 1776995347.353888 mapwrite 0x027474 thru 0x035117 (0xdca4 bytes) 000858 1776995347.399158 write 0x02b4c9 thru 0x02f2e9 (0x3e21 bytes) 000859 1776995347.405602 fallocate 0x003871 thru 0x00c638 (0x8dc8 bytes) 000860 1776995347.418159 trunc from 0x03ef19 to 0x014780 (0x2a798 bytes) 000861 1776995347.463115 write 0x020bce thru 0x02f2ca (0xe6fd bytes) 000862 1776995347.467522 fallocate 0x015ff5 thru 0x01d412 (0x741e bytes) 000863 1776995347.480381 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f2cb): Mirror 20: 0xb49db3bf (stale) Mirror 21: 0xb49db3bf (stale) Mirror 23: 0xb49db3bf (stale) Mirror 25: 0xb49db3bf (stale) Mirror 30: 0xb49db3bf (stale) Mirror 31: 0xb49db3bf (stale) Mirror 32: 0xb49db3bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f2cb): Mirror 20: 0xb49db3bf (stale) Mirror 21: 0xb49db3bf (stale) Mirror 23: 0xb49db3bf (stale) Mirror 25: 0xb49db3bf (stale) Mirror 30: 0xb49db3bf (stale) Mirror 31: 0xb49db3bf (stale) Mirror 32: 0xb49db3bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f2cb: skipped 000864 1776995348.117645 mapwrite 0x00dfae thru 0x012cc4 (0x4d17 bytes) 000865 1776995348.173116 fallocate 0x011c46 thru 0x01e6b1 (0xca6c bytes) 000866 1776995348.181346 fallocate 0x0368a7 thru 0x03fe0a (0x9564 bytes) 000867 1776995348.191087 read 0x01505e thru 0x01bce2 (0x6c85 bytes) 000868 1776995348.201241 fallocate 0x006b58 thru 0x0089a5 (0x1e4e bytes) 000869 1776995348.217677 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2f2cb): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f2cb): Mirror 20: 0xb49db3bf (stale) Mirror 21: 0xb49db3bf (stale) Mirror 23: 0xb49db3bf (stale) Mirror 25: 0xb49db3bf (stale) Mirror 30: 0xb49db3bf (stale) Mirror 31: 0xb49db3bf (stale) Mirror 32: 0xb49db3bf (stale) CRC-32 checksum value for chunk [0, 0x2f2cb): Mirror 1: 0x5d295d Mirror 33: 0x5d295d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f2cb: skipped 000870 1776995349.504907 trunc from 0x00e10a to 0x013ccf (0x5bc6 bytes) 000871 1776995349.582393 mapread 0x0138dd thru 0x020267 (0xc98b bytes) 000872 1776995349.622019 trunc from 0x0120d5 to 0x0185c3 (0x64ef bytes) 000873 1776995349.630705 write 0x02e95f thru 0x03c471 (0xdb13 bytes) 000874 1776995349.649155 read 0x001bbc thru 0x00c23a (0xa67f bytes) 000875 1776995349.664129 punch from 0x0262e7 to 0x02aba1 (0x48bb bytes) 000877 1776995349.670933 trunc from 0x03c472 to 0x008476 (0x33ffb bytes) 000878 1776995349.719484 trunc from 0x008477 to 0x02ba92 (0x2361c bytes) 000879 1776995349.751817 mapwrite 0x01af38 thru 0x0243ee (0x94b7 bytes) 000880 1776995349.787976 mapwrite 0x03b049 thru 0x03ffff (0x4fb7 bytes) 000881 1776995349.845641 trunc from 0x040000 to 0x00724c (0x38db3 bytes) 000882 1776995349.871190 MIRROR_RESYNC 9 mirrors 000883 1776995351.256024 read 0x0063b2 thru 0x00724c (0xe9b bytes) 000884 1776995351.267251 fallocate 0x018c7c thru 0x023e3b (0xb1c0 bytes) 000885 1776995351.297382 fallocate 0x02748a thru 0x035afa (0xe671 bytes) 000886 1776995351.305886 trunc from 0x0024b3 to 0x00724c (0x4d9a bytes) 000887 1776995351.314857 punch from 0x0066bf to 0x00724c (0xb8e bytes) 000889 1776995351.328544 trunc from 0x0006d4 to 0x004f17 (0x4844 bytes) 000890 1776995351.342755 mapread 0x002c56 thru 0x00724c (0x45f7 bytes) 000891 1776995351.377477 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x724d): Mirror 20: 0x9c34170a (stale) Mirror 21: 0x9c34170a (stale) Mirror 23: 0x9c34170a (stale) Mirror 25: 0x9c34170a (stale) Mirror 30: 0x9c34170a (stale) Mirror 31: 0x9c34170a (stale) Mirror 33: 0x9c34170a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x724d): Mirror 20: 0x9c34170a (stale) Mirror 21: 0x9c34170a (stale) Mirror 23: 0x9c34170a (stale) Mirror 25: 0x9c34170a (stale) Mirror 30: 0x9c34170a (stale) Mirror 31: 0x9c34170a (stale) Mirror 33: 0x9c34170a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x724d: skipped 000892 1776995351.972982 MIRROR_RESYNC 8 mirrors 000894 1776995353.978423 trunc from 0x00724d to 0x02fa10 (0x287c4 bytes) 000895 1776995354.046562 write 0x0385d1 thru 0x03ffff (0x7a2f bytes) 000897 1776995354.057899 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) Mirror 30: 0xe20eea22 (stale) Mirror 31: 0xe20eea22 (stale) Mirror 33: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1d961a4 Mirror 34: 0xc1d961a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1776995356.208892 trunc from 0x040000 to 0x0026df (0x3d920 bytes) 000899 1776995356.272524 mapwrite 0x01774c thru 0x025e62 (0xe717 bytes) 000900 1776995356.410219 punch from 0x014b61 to 0x01f040 (0xa4e0 bytes) 000901 1776995356.420928 read 0x018420 thru 0x01cd8d (0x496e bytes) 000902 1776995356.436000 mapread 0x0115a3 thru 0x014c6b (0x36c9 bytes) 000903 1776995356.455990 write 0x022467 thru 0x026f94 (0x4b2e bytes) 000904 1776995356.463011 mapread 0x01b656 thru 0x01fe64 (0x480f bytes) 000905 1776995356.492092 MIRROR_RESYNC 9 mirrors 000906 1776995358.856500 trunc from 0x014b32 to 0x024466 (0xf935 bytes) 000907 1776995358.901014 trunc from 0x026f95 to 0x013185 (0x13e0f bytes) 000909 1776995358.935273 read 0x0063eb thru 0x00fa4d (0x9663 bytes) 000911 1776995358.952287 trunc from 0x00fd34 to 0x013185 (0x3452 bytes) 000912 1776995358.958060 punch from 0x0073db to 0x00a5ea (0x3210 bytes) 000913 1776995358.963319 trunc from 0x013186 to 0x028339 (0x151b4 bytes) 000914 1776995358.981807 fallocate 0x02dda6 thru 0x03d2f4 (0xf54f bytes) 000915 1776995358.993062 read 0x010501 thru 0x010a4f (0x54f bytes) 000916 1776995359.016321 write 0x031655 thru 0x033c79 (0x2625 bytes) 000917 1776995359.020253 fallocate 0x023650 thru 0x032856 (0xf207 bytes) 000918 1776995359.036484 mapread 0x0206e9 thru 0x02b6a1 (0xafb9 bytes) 000920 1776995359.049805 read 0x015886 thru 0x021fb2 (0xc72d bytes) 000921 1776995359.050599 write 0x02706b thru 0x0270b8 (0x4e bytes) 000924 1776995359.061989 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33c7a): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c7a): Mirror 20: 0xf1c5aad8 (stale) Mirror 21: 0xf1c5aad8 (stale) Mirror 23: 0xf1c5aad8 (stale) Mirror 25: 0xf1c5aad8 (stale) Mirror 30: 0xf1c5aad8 (stale) Mirror 31: 0xf1c5aad8 (stale) Mirror 33: 0xf1c5aad8 (stale) Mirror 34: 0xf1c5aad8 (stale) CRC-32 checksum value for chunk [0, 0x33c7a): Mirror 1: 0x2974f1f8 Mirror 35: 0x2974f1f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c7a: skipped 000925 1776995360.813579 read 0x005b4d thru 0x0064e2 (0x996 bytes) 000926 1776995360.827902 trunc from 0x0264d4 to 0x02b959 (0x5486 bytes) 000928 1776995360.894885 fallocate 0x007e2e thru 0x01649f (0xe672 bytes) 000929 1776995360.905294 trunc from 0x00947b to 0x013cf4 (0xa87a bytes) 000930 1776995360.911029 read 0x02e84c thru 0x033c79 (0x542e bytes) 000931 1776995360.928248 fallocate 0x01bff1 thru 0x02756d (0xb57d bytes) 000933 1776995360.936133 mapread 0x001f8f thru 0x00252b (0x59d bytes) 000934 1776995360.938788 mapread 0x0189f5 thru 0x02056c (0x7b78 bytes) 000935 1776995360.943820 read 0x026cf7 thru 0x0309a1 (0x9cab bytes) 000937 1776995360.953012 read 0x00d05e thru 0x0114be (0x4461 bytes) 000938 1776995360.956874 fallocate 0x026dce thru 0x02a472 (0x36a5 bytes) 000939 1776995360.966465 fallocate 0x0324e3 thru 0x03ffff (0xdb1d bytes) 000940 1776995360.982783 fallocate 0x00bd28 thru 0x01769f (0xb978 bytes) 000941 1776995360.997974 trunc from 0x040000 to 0x02ee15 (0x111ea bytes) 000942 1776995361.082352 trunc from 0x011cbf to 0x0172e9 (0x562b bytes) 000943 1776995361.097938 MIRROR_RESYNC 10 mirrors 000945 1776995363.309437 write 0x02d4f4 thru 0x02d59c (0xa9 bytes) 000946 1776995363.404130 trunc from 0x02ee16 to 0x003da9 (0x2b06c bytes) 000947 1776995363.455985 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3daa): Mirror 21: 0x61401a12 (stale) Mirror 23: 0x61401a12 (stale) Mirror 25: 0x61401a12 (stale) Mirror 30: 0x61401a12 (stale) Mirror 31: 0x61401a12 (stale) Mirror 33: 0x61401a12 (stale) Mirror 34: 0x61401a12 (stale) Mirror 35: 0x61401a12 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3daa): Mirror 21: 0x61401a12 (stale) Mirror 23: 0x61401a12 (stale) Mirror 25: 0x61401a12 (stale) Mirror 30: 0x61401a12 (stale) Mirror 31: 0x61401a12 (stale) Mirror 33: 0x61401a12 (stale) Mirror 34: 0x61401a12 (stale) Mirror 35: 0x61401a12 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3daa: skipped 000948 1776995364.016371 read 0x000dac thru 0x003da9 (0x2ffe bytes) 000949 1776995364.027448 fallocate 0x009009 thru 0x00b581 (0x2579 bytes) 000950 1776995364.033932 mapread 0x0031f4 thru 0x003da9 (0xbb6 bytes) 000951 1776995364.035971 mapwrite 0x02b24c thru 0x02f87a (0x462f bytes) 000952 1776995364.106760 mapread 0x00a95c thru 0x017a5d (0xd102 bytes) 000953 1776995364.143475 read 0x002b05 thru 0x008353 (0x584f bytes) 000954 1776995364.144268 fallocate 0x01f2ed thru 0x021e57 (0x2b6b bytes) 000955 1776995364.160184 MIRROR_RESYNC 9 mirrors 000956 1776995366.127691 MIRROR_RESYNC 9 mirrors 000957 1776995366.974271 fallocate 0x025b28 thru 0x02632c (0x805 bytes) 000958 1776995367.019707 trunc from 0x01a7d2 to 0x0218a8 (0x70d7 bytes) 000959 1776995367.025327 mapread 0x00a173 thru 0x00ecb2 (0x4b40 bytes) 000960 1776995367.047110 mapwrite 0x0183c7 thru 0x0265ed (0xe227 bytes) 000961 1776995367.089540 punch from 0x0286c5 to 0x02e557 (0x5e93 bytes) 000962 1776995367.097268 punch from 0x02602c to 0x02f87a (0x984f bytes) 000963 1776995367.105576 punch from 0x02819f to 0x028b21 (0x983 bytes) 000964 1776995367.121874 fallocate 0x00a2c8 thru 0x011826 (0x755f bytes) 000966 1776995367.129096 mapread 0x012b3c thru 0x020d0d (0xe1d2 bytes) 000967 1776995367.131408 mapwrite 0x02af6d thru 0x03a765 (0xf7f9 bytes) 000969 1776995367.281211 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a766): Mirror 21: 0x43e032fd (stale) Mirror 23: 0x43e032fd (stale) Mirror 25: 0x43e032fd (stale) Mirror 30: 0x43e032fd (stale) Mirror 31: 0x43e032fd (stale) Mirror 33: 0x43e032fd (stale) Mirror 35: 0x43e032fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a766): Mirror 21: 0x43e032fd (stale) Mirror 23: 0x43e032fd (stale) Mirror 25: 0x43e032fd (stale) Mirror 30: 0x43e032fd (stale) Mirror 31: 0x43e032fd (stale) Mirror 33: 0x43e032fd (stale) Mirror 35: 0x43e032fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a766: skipped 000970 1776995367.922673 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a766): Mirror 21: 0x43e032fd (stale) Mirror 25: 0x43e032fd (stale) Mirror 30: 0x43e032fd (stale) Mirror 31: 0x43e032fd (stale) Mirror 33: 0x43e032fd (stale) Mirror 35: 0x43e032fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a766): Mirror 21: 0x43e032fd (stale) Mirror 25: 0x43e032fd (stale) Mirror 30: 0x43e032fd (stale) Mirror 31: 0x43e032fd (stale) Mirror 33: 0x43e032fd (stale) Mirror 35: 0x43e032fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a766: skipped 000971 1776995368.513458 read 0x007b84 thru 0x0172ee (0xf76b bytes) 000972 1776995368.533382 mapwrite 0x03590c thru 0x03ffff (0xa6f4 bytes) 000973 1776995368.675683 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xb0bb5182 (stale) Mirror 30: 0xb0bb5182 (stale) Mirror 31: 0xb0bb5182 (stale) Mirror 33: 0xb0bb5182 (stale) Mirror 35: 0xb0bb5182 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xb0bb5182 (stale) Mirror 30: 0xb0bb5182 (stale) Mirror 31: 0xb0bb5182 (stale) Mirror 33: 0xb0bb5182 (stale) Mirror 35: 0xb0bb5182 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000974 1776995369.327336 trunc from 0x01fb68 to 0x028112 (0x85ab bytes) 000976 1776995369.338854 mapread 0x012d1e thru 0x01cf8d (0xa270 bytes) 000977 1776995369.369598 read 0x03ccd8 thru 0x03ffff (0x3328 bytes) 000978 1776995369.378955 punch from 0x0284fd to 0x036af5 (0xe5f9 bytes) 000979 1776995369.391109 fallocate 0x03cc2b thru 0x03ffff (0x33d5 bytes) 000980 1776995369.420827 MIRROR_RESYNC 6 mirrors 000981 1776995371.292449 mapwrite 0x02169c thru 0x024522 (0x2e87 bytes) 000983 1776995371.422571 punch from 0x01a0fb to 0x02475c (0xa662 bytes) 000984 1776995371.437916 read 0x00f40f thru 0x019b12 (0xa704 bytes) 000985 1776995371.450247 fallocate 0x03810f thru 0x03ffff (0x7ef1 bytes) 000986 1776995371.457457 punch from 0x030e53 to 0x03770d (0x68bb bytes) 000987 1776995371.463694 mapwrite 0x0037aa thru 0x005abb (0x2312 bytes) 000990 1776995371.521013 mapwrite 0x020e74 thru 0x02f4b8 (0xe645 bytes) 000991 1776995371.599827 trunc from 0x040000 to 0x037c47 (0x83b8 bytes) 000992 1776995371.634597 fallocate 0x003807 thru 0x0106c6 (0xcec0 bytes) 000993 1776995371.642992 mapwrite 0x03e2db thru 0x03ffff (0x1d25 bytes) 000994 1776995371.716450 trunc from 0x02624b to 0x0359c0 (0xf776 bytes) 000995 1776995371.724209 trunc from 0x00b27b to 0x00edac (0x3b32 bytes) 000996 1776995371.729945 punch from 0x004b20 to 0x01216f (0xd650 bytes) 000997 1776995371.740723 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x2fd2558d (stale) Mirror 30: 0x2fd2558d (stale) Mirror 31: 0x2fd2558d (stale) Mirror 33: 0x2fd2558d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x2fd2558d (stale) Mirror 30: 0x2fd2558d (stale) Mirror 31: 0x2fd2558d (stale) Mirror 33: 0x2fd2558d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000998 1776995372.256565 trunc from 0x040000 to 0x03f5c6 (0xa39 bytes) 000999 1776995372.287343 punch from 0x03e477 to 0x03f5c6 (0x1150 bytes) 001000 1776995372.294585 write 0x011a2f thru 0x0174b2 (0x5a84 bytes) All operations completed A-OK!