== sanity-flr test 70a: flr mode fsx test ================ 04:41:55 (1789116115) Seed set to 6117 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x2dd0d 000006 1789116117.453202 trunc from 00000000 to 0x02dd0c (0x2dd0d bytes) 000007 1789116117.472832 trunc from 0x02dd0d to 0x008d24 (0x24fe8 bytes) 000008 1789116117.491493 read 0x008501 thru 0x008d24 (0x824 bytes) 000009 1789116117.498016 write 0x0075e0 thru 0x0099b4 (0x23d5 bytes) 000010 1789116117.504718 mapwrite 0x01e844 thru 0x0269f0 (0x81ad bytes) 000013 1789116117.632748 read 0x02283f thru 0x0269f0 (0x41b2 bytes) 000014 1789116117.634421 mapread 0x00013e thru 0x003d38 (0x3bfb bytes) 000015 1789116117.649037 trunc from 0x0269f1 to 0x02339c (0x3654 bytes) 000016 1789116117.677162 mapread 0x011014 thru 0x019e54 (0x8e41 bytes) 000017 1789116117.678300 read 0x0017a2 thru 0x006e09 (0x5668 bytes) 000023 1789116117.682713 trunc from 0x02339d to 0x017cc5 (0xb6d7 bytes) truncating to largest ever: 0x355ec 000025 1789116117.712216 trunc from 0x017cc6 to 0x0355eb (0x1d926 bytes) 000026 1789116117.734575 mapread 0x00ea0b thru 0x01978a (0xad80 bytes) 000027 1789116117.750661 mapread 0x0142ba thru 0x01b2b1 (0x6ff8 bytes) 000030 1789116117.760980 read 0x033590 thru 0x0355eb (0x205c bytes) 000031 1789116117.762117 write 0x00f51e thru 0x019208 (0x9ceb bytes) 000033 1789116117.764072 write 0x010065 thru 0x018147 (0x80e3 bytes) 000034 1789116117.766703 mapwrite 0x001f59 thru 0x0057f3 (0x389b bytes) 000035 1789116117.846983 trunc from 0x0355ec to 0x0092d8 (0x2c313 bytes) 000036 1789116117.875279 read 0x00860c thru 0x0092d8 (0xccd bytes) 000038 1789116117.877415 trunc from 0x0092d9 to 0x0221e3 (0x18f0b bytes) 000039 1789116117.925110 mapread 0x010817 thru 0x016ff6 (0x67e0 bytes) 000040 1789116117.945994 mapread 0x00a156 thru 0x00f5d2 (0x547d bytes) 000041 1789116117.946970 write 0x0287fd thru 0x033133 (0xa937 bytes) 000044 1789116117.956146 read 0x031ad3 thru 0x033133 (0x1661 bytes) 000046 1789116117.963001 trunc from 0x033134 to 0x00ce46 (0x262ed bytes) 000049 1789116118.005532 write 0x030bec thru 0x0330de (0x24f3 bytes) 000050 1789116118.007029 read 0x012bb8 thru 0x0190cd (0x6516 bytes) 000052 1789116118.023894 write 0x010690 thru 0x01f564 (0xeed5 bytes) 000053 1789116118.029891 read 0x019758 thru 0x01c694 (0x2f3d bytes) 000054 1789116118.030554 mapwrite 0x03166b thru 0x034af5 (0x348b bytes) 000059 1789116118.173429 mapread 0x01309b thru 0x01dfb1 (0xaf17 bytes) 000060 1789116118.174494 mapwrite 0x03d679 thru 0x03ffff (0x2987 bytes) 000061 1789116118.315519 mapread 0x01dc44 thru 0x029af7 (0xbeb4 bytes) 000062 1789116118.318459 trunc from 0x040000 to 0x02e7a5 (0x1185a bytes) 000063 1789116118.364841 write 0x00e201 thru 0x0178a3 (0x96a3 bytes) 000068 1789116118.370394 mapread 0x01ac52 thru 0x027bda (0xcf89 bytes) 000071 1789116118.374725 mapwrite 0x02baf1 thru 0x0381e0 (0xc6f0 bytes) 000075 1789116118.697916 trunc from 0x0381e1 to 0x025041 (0x1319f bytes) 000078 1789116118.740666 trunc from 0x025042 to 0x0024e0 (0x22b61 bytes) 000083 1789116118.773465 mapread 0x001d13 thru 0x0024e0 (0x7ce bytes) 000084 1789116118.775974 read 0x001294 thru 0x0024e0 (0x124d bytes) 000085 1789116118.777171 trunc from 0x0024e1 to 0x00b6dc (0x91fc bytes) 000089 1789116118.802609 trunc from 0x00b6dd to 0x01e15e (0x12a82 bytes) 000090 1789116118.842690 trunc from 0x01e15f to 0x011b60 (0xc5fe bytes) 000092 1789116118.875239 write 0x01637b thru 0x0252b2 (0xef38 bytes) 000093 1789116118.882061 write 0x0398e1 thru 0x03ffff (0x671f bytes) 000094 1789116118.884818 mapwrite 0x02cacf thru 0x02e3e2 (0x1914 bytes) 000095 1789116118.970022 mapread 0x0273db thru 0x02a688 (0x32ae bytes) 000096 1789116118.973105 trunc from 0x040000 to 0x023416 (0x1cbe9 bytes) 000097 1789116118.993028 trunc from 0x023417 to 0x01d8b2 (0x5b64 bytes) 000100 1789116119.019770 mapread 0x01a9e3 thru 0x01d8b2 (0x2ed0 bytes) 000105 1789116119.029667 MIRROR_EXTEND to 2 mirrors 000107 1789116119.790088 MIRROR_RESYNC 2 mirrors 000109 1789116120.183268 mapread 0x01776b thru 0x01d8b2 (0x6148 bytes) 000110 1789116120.212990 trunc from 0x01d8b3 to 0x01e26f (0x9bd bytes) 000111 1789116120.340256 write 0x03a80a thru 0x03ffff (0x57f6 bytes) 000112 1789116120.342751 mapwrite 0x03c19b thru 0x03ffff (0x3e65 bytes) 000113 1789116120.426062 mapwrite 0x029590 thru 0x038d72 (0xf7e3 bytes) 000114 1789116120.514552 write 0x01f2ae thru 0x02c5e6 (0xd339 bytes) 000116 1789116120.521969 mapwrite 0x02d2ea thru 0x035f33 (0x8c4a bytes) 000118 1789116120.573712 mapwrite 0x01e4fc thru 0x0256f3 (0x71f8 bytes) 000119 1789116120.693094 trunc from 0x040000 to 0x0228c9 (0x1d736 bytes) 000120 1789116120.740556 read 0x02061d thru 0x0228c9 (0x22ad bytes) 000123 1789116120.747837 mapread 0x01310f thru 0x014ed8 (0x1dca bytes) 000125 1789116120.774499 read 0x022235 thru 0x0228c9 (0x695 bytes) 000127 1789116120.779054 mapread 0x0022e6 thru 0x00a3fe (0x8119 bytes) 000128 1789116120.790020 mapread 0x01cfdc thru 0x01e562 (0x1587 bytes) 000129 1789116120.791876 read 0x00d110 thru 0x0174b8 (0xa3a9 bytes) 000130 1789116120.793313 mapread 0x00b8de thru 0x012b08 (0x722b bytes) 000131 1789116120.795134 write 0x037255 thru 0x03dcee (0x6a9a bytes) 000133 1789116120.798841 mapread 0x02c662 thru 0x03773e (0xb0dd bytes) 000134 1789116120.815091 mapwrite 0x02b2ef thru 0x038cfb (0xda0d bytes) 000135 1789116120.854211 write 0x01704e thru 0x021f02 (0xaeb5 bytes) 000137 1789116120.858218 mapread 0x03ca85 thru 0x03ccd7 (0x253 bytes) 000139 1789116120.869035 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) 000142 1789116121.186936 write 0x01f098 thru 0x02bdf2 (0xcd5b bytes) 000143 1789116121.201120 write 0x02ae3c thru 0x02c480 (0x1645 bytes) 000147 1789116121.208913 read 0x007847 thru 0x00d019 (0x57d3 bytes) 000148 1789116121.226485 mapwrite 0x007e32 thru 0x00b1aa (0x3379 bytes) 000149 1789116121.298681 trunc from 0x03dcef to 0x01418e (0x29b60 bytes) 000156 1789116121.343989 trunc from 0x01418f to 0x02a73c (0x165ae bytes) 000159 1789116121.378418 mapwrite 0x03e795 thru 0x03ffff (0x186b bytes) 000160 1789116121.485769 trunc from 0x040000 to 0x013a9c (0x2c563 bytes) 000161 1789116121.516845 write 0x033c84 thru 0x03ffff (0xc37c bytes) 000162 1789116121.518942 mapwrite 0x007541 thru 0x013567 (0xc027 bytes) 000164 1789116121.582785 write 0x02727e thru 0x02fd4f (0x8ad2 bytes) 000166 1789116121.597285 mapwrite 0x00e5ad thru 0x016d78 (0x87cc bytes) 000167 1789116121.681270 mapread 0x0394f5 thru 0x03ffff (0x6b0b bytes) 000170 1789116121.682977 read 0x03e652 thru 0x03ffff (0x19ae bytes) 000171 1789116121.685012 mapwrite 0x03d9bc thru 0x03ffff (0x2644 bytes) 000173 1789116121.751096 MIRROR_EXTEND to 2 mirrors 000174 1789116122.631397 mapread 0x023437 thru 0x026edf (0x3aa9 bytes) 000175 1789116122.684840 trunc from 0x040000 to 0x004074 (0x3bf8b bytes) 000176 1789116122.805866 trunc from 0x004075 to 0x000315 (0x3d5f bytes) 000177 1789116122.836460 trunc from 0x000316 to 0x022cc1 (0x229ac bytes) 000178 1789116122.856433 trunc from 0x022cc2 to 0x0338c6 (0x10c05 bytes) 000181 1789116122.878098 trunc from 0x0338c7 to 0x013b6a (0x1fd5c bytes) 000184 1789116122.906698 mapwrite 0x037512 thru 0x0386b5 (0x11a4 bytes) 000185 1789116123.026788 trunc from 0x0386b6 to 0x007100 (0x315b5 bytes) 000186 1789116123.047521 trunc from 0x007101 to 0x011607 (0xa507 bytes) 000187 1789116123.074225 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x11608): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11608): Mirror 2: 0x519f0afd (stale) CRC-32 checksum value for chunk [0, 0x11608): Mirror 1: 0x1d0d39c9 Mirror 3: 0x1d0d39c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11608: skipped 000188 1789116124.401610 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11608): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11608): Mirror 2: 0x519f0afd (stale) CRC-32 checksum value for chunk [0, 0x11608): Mirror 1: 0x1d0d39c9 Mirror 3: 0x1d0d39c9 Mirror 4: 0x1d0d39c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11608: skipped 000189 1789116125.525706 read 0x008a3d thru 0x011607 (0x8bcb bytes) 000190 1789116125.534438 write 0x013b4c thru 0x021b00 (0xdfb5 bytes) 000192 1789116125.617273 write 0x00ddce thru 0x01be58 (0xe08b bytes) 000194 1789116125.624625 write 0x022858 thru 0x023f13 (0x16bc bytes) 000195 1789116125.629652 MIRROR_RESYNC 4 mirrors 000196 1789116126.801569 read 0x014a9a thru 0x016007 (0x156e bytes) 000197 1789116126.808093 read 0x01938c thru 0x01f5c8 (0x623d bytes) 000198 1789116126.833050 MIRROR_RESYNC 4 mirrors 000199 1789116127.289231 write 0x001db9 thru 0x006818 (0x4a60 bytes) 000200 1789116127.452465 MIRROR_RESYNC 4 mirrors 000201 1789116128.523070 write 0x004e86 thru 0x00bb68 (0x6ce3 bytes) 000202 1789116128.605567 mapwrite 0x02dd95 thru 0x038ab3 (0xad1f bytes) 000204 1789116128.714086 write 0x02d4b2 thru 0x03ba92 (0xe5e1 bytes) 000206 1789116128.717184 read 0x02b0a1 thru 0x02d1cd (0x212d bytes) 000209 1789116128.719089 mapwrite 0x039e40 thru 0x03fa0a (0x5bcb bytes) 000210 1789116128.794181 write 0x03f4ff thru 0x03fe12 (0x914 bytes) 000213 1789116128.796793 mapread 0x03aa0f thru 0x03fe12 (0x5404 bytes) 000216 1789116128.803813 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe13): Mirror 2: 0xbbeb3513 (stale) Mirror 4: 0xbbeb3513 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe13): Mirror 2: 0xbbeb3513 (stale) Mirror 4: 0xbbeb3513 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe13: skipped 000218 1789116129.297966 MIRROR_RESYNC 3 mirrors 000219 1789116130.209202 mapread 0x037fcb thru 0x03fe12 (0x7e48 bytes) 000221 1789116130.228967 mapread 0x006292 thru 0x00e304 (0x8073 bytes) 000222 1789116130.238853 write 0x01486e thru 0x016aad (0x2240 bytes) 000226 1789116130.318047 mapwrite 0x00091b thru 0x004696 (0x3d7c bytes) 000227 1789116130.373587 write 0x033c2c thru 0x034cb7 (0x108c bytes) 000229 1789116130.386823 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3fe13): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe13): Mirror 2: 0x4c811821 (stale) Mirror 4: 0x4c811821 (stale) CRC-32 checksum value for chunk [0, 0x3fe13): Mirror 1: 0xc87e566d Mirror 5: 0xc87e566d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe13: skipped 000230 1789116131.209755 mapwrite 0x02e8a8 thru 0x02fe52 (0x15ab bytes) 000231 1789116131.391149 trunc from 0x03fe13 to 0x0092ea (0x36b28 bytes) 000233 1789116131.454809 read 0x005907 thru 0x0092ea (0x39e4 bytes) 000234 1789116131.464721 write 0x039d9e thru 0x03ffff (0x6262 bytes) 000237 1789116131.466874 read 0x001f10 thru 0x00dcb5 (0xbda6 bytes) 000239 1789116131.479288 mapwrite 0x02e65f thru 0x02ec04 (0x5a6 bytes) 000241 1789116131.513918 write 0x008223 thru 0x00cbd1 (0x49af bytes) 000243 1789116131.515772 mapwrite 0x034aa5 thru 0x039779 (0x4cd5 bytes) 000244 1789116131.611602 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000245 1789116131.984047 mapwrite 0x00b682 thru 0x00c1b5 (0xb34 bytes) 000249 1789116132.054007 read 0x01d183 thru 0x01ebda (0x1a58 bytes) 000250 1789116132.060910 mapread 0x00112f thru 0x005d28 (0x4bfa bytes) 000252 1789116132.074004 mapread 0x0082cb thru 0x0091b1 (0xee7 bytes) 000255 1789116132.082077 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd23fa034 Mirror 5: 0xd23fa034 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000256 1789116133.271741 mapwrite 0x0319f5 thru 0x03b3f1 (0x99fd bytes) 000258 1789116133.502613 mapread 0x02c38a thru 0x03a41c (0xe093 bytes) 000259 1789116133.517924 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) Mirror 5: 0xd23fa034 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe7642ff Mirror 6: 0xe7642ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000260 1789116135.195188 read 0x02fc5c thru 0x0383dd (0x8782 bytes) 000261 1789116135.213641 read 0x00d14b thru 0x0122ba (0x5170 bytes) 000262 1789116135.250225 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) Mirror 5: 0xd23fa034 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) Mirror 5: 0xd23fa034 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000266 1789116135.789815 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa22e7dcb (stale) Mirror 4: 0xa22e7dcb (stale) Mirror 5: 0xd23fa034 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe7642ff Mirror 6: 0xe7642ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000267 1789116137.442782 write 0x0050bd thru 0x0128a6 (0xd7ea bytes) 000270 1789116137.545269 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa22e7dcb (stale) Mirror 5: 0xd23fa034 (stale) Mirror 6: 0xe7642ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa22e7dcb (stale) Mirror 5: 0xd23fa034 (stale) Mirror 6: 0xe7642ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000271 1789116138.091102 read 0x037a64 thru 0x03ffff (0x859c bytes) 000272 1789116138.109956 trunc from 0x040000 to 0x0162bf (0x29d40 bytes) 000273 1789116138.131116 read 0x007c75 thru 0x01552f (0xd8bb bytes) 000278 1789116138.147734 write 0x02fc2b thru 0x038236 (0x860c bytes) 000279 1789116138.149965 read 0x020a22 thru 0x028d15 (0x82f4 bytes) 000280 1789116138.158112 write 0x0376f2 thru 0x03ffff (0x890e bytes) 000281 1789116138.160964 read 0x0073a9 thru 0x016fe2 (0xfc3a bytes) 000282 1789116138.161936 mapwrite 0x025547 thru 0x02f2c6 (0x9d80 bytes) 000283 1789116138.229999 mapread 0x0032b2 thru 0x01178f (0xe4de bytes) 000284 1789116138.236788 MIRROR_RESYNC 4 mirrors 000286 1789116139.221710 write 0x005c44 thru 0x01462b (0xe9e8 bytes) 000288 1789116139.388687 read 0x02c785 thru 0x035538 (0x8db4 bytes) 000289 1789116139.401842 write 0x032ecd thru 0x03fae1 (0xcc15 bytes) 000291 1789116139.413919 trunc from 0x040000 to 0x033ffb (0xc004 bytes) 000294 1789116139.467799 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33ffc): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ffc): Mirror 4: 0x668d08d (stale) Mirror 5: 0x668d08d (stale) Mirror 6: 0x668d08d (stale) CRC-32 checksum value for chunk [0, 0x33ffc): Mirror 1: 0x532246d0 Mirror 7: 0x532246d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ffc: skipped 000296 1789116140.307932 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33ffc): Mirror 4: 0x668d08d (stale) Mirror 6: 0x668d08d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ffc): Mirror 4: 0x668d08d (stale) Mirror 6: 0x668d08d (stale) CRC-32 checksum value for chunk [0, 0x33ffc): Mirror 1: 0x532246d0 Mirror 7: 0x532246d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ffc: skipped 000297 1789116140.913794 mapwrite 0x035f86 thru 0x0394c8 (0x3543 bytes) 000298 1789116141.220165 mapread 0x01c2e1 thru 0x029dfa (0xdb1a bytes) 000299 1789116141.258591 read 0x00f56e thru 0x015bf2 (0x6685 bytes) 000301 1789116141.273293 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x394c9): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394c9): Mirror 4: 0x229aff10 (stale) Mirror 6: 0x229aff10 (stale) Mirror 7: 0x46100672 (stale) CRC-32 checksum value for chunk [0, 0x394c9): Mirror 1: 0xb9db8e53 Mirror 8: 0xb9db8e53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394c9: skipped 000302 1789116142.252313 write 0x004ce8 thru 0x008580 (0x3899 bytes) 000303 1789116142.324005 mapwrite 0x00a067 thru 0x00c8f1 (0x288b bytes) 000305 1789116142.383879 read 0x0042d7 thru 0x011f89 (0xdcb3 bytes) 000306 1789116142.384528 read 0x036b03 thru 0x0394c8 (0x29c6 bytes) 000308 1789116142.395432 mapwrite 0x03f898 thru 0x03ffff (0x768 bytes) 000309 1789116142.557132 mapwrite 0x03b451 thru 0x03ffff (0x4baf bytes) 000311 1789116142.600027 mapwrite 0x034395 thru 0x03e91f (0xa58b bytes) 000312 1789116142.655043 mapread 0x02d767 thru 0x02d9cf (0x269 bytes) 000316 1789116142.659486 trunc from 0x040000 to 0x01b50f (0x24af0 bytes) 000317 1789116142.704044 mapwrite 0x00e9cc thru 0x010161 (0x1796 bytes) 000318 1789116142.806987 mapwrite 0x018ec5 thru 0x01f694 (0x67d0 bytes) 000319 1789116142.899505 write 0x02ff6d thru 0x03bf05 (0xbf99 bytes) 000320 1789116142.900988 mapread 0x01d9de thru 0x02273f (0x4d62 bytes) 000322 1789116142.918520 mapread 0x0175f4 thru 0x01d5c5 (0x5fd2 bytes) 000323 1789116142.919285 mapwrite 0x027f51 thru 0x033bfe (0xbcae bytes) 000324 1789116143.059418 MIRROR_RESYNC 5 mirrors 000325 1789116144.283247 mapwrite 0x00b1d7 thru 0x00ba2a (0x854 bytes) 000327 1789116144.504308 trunc from 0x03bf06 to 0x02e201 (0xdd04 bytes) 000328 1789116144.531592 mapwrite 0x02dfca thru 0x03ba6b (0xdaa2 bytes) 000329 1789116144.649830 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ba6c): Mirror 4: 0x948cb3fc (stale) Mirror 6: 0x948cb3fc (stale) Mirror 7: 0x948cb3fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba6c): Mirror 4: 0x948cb3fc (stale) Mirror 6: 0x948cb3fc (stale) Mirror 7: 0x948cb3fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba6c: skipped 000331 1789116145.125532 mapread 0x014bbc thru 0x01d2d4 (0x8719 bytes) 000333 1789116145.153080 trunc from 0x03ba6c to 0x01bc77 (0x1fdf4 bytes) 000335 1789116145.170300 mapwrite 0x01040c thru 0x019fdc (0x9bd1 bytes) 000336 1789116145.232496 write 0x028a4e thru 0x0291cc (0x77f bytes) 000337 1789116145.233811 trunc from 0x0291cd to 0x007180 (0x2204c bytes) 000338 1789116145.253766 write 0x01e6e2 thru 0x02e63f (0xff5e bytes) 000339 1789116145.256800 mapwrite 0x0057ab thru 0x00f07b (0x98d1 bytes) 000340 1789116145.364312 mapread 0x015609 thru 0x01e446 (0x8e3e bytes) 000341 1789116145.375774 read 0x02cc40 thru 0x02e63f (0x1a00 bytes) 000342 1789116145.376583 mapwrite 0x019028 thru 0x019523 (0x4fc bytes) 000346 1789116145.440978 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e640): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e640): Mirror 4: 0x5a9d58ae (stale) Mirror 6: 0x5a9d58ae (stale) Mirror 7: 0x5a9d58ae (stale) CRC-32 checksum value for chunk [0, 0x2e640): Mirror 1: 0x5d9edea0 Mirror 8: 0x5d9edea0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e640: skipped 000348 1789116146.346581 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e640): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e640): Mirror 4: 0x5a9d58ae (stale) Mirror 6: 0x5a9d58ae (stale) Mirror 7: 0x5a9d58ae (stale) CRC-32 checksum value for chunk [0, 0x2e640): Mirror 1: 0x5d9edea0 Mirror 8: 0x5d9edea0 Mirror 9: 0x5d9edea0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e640: skipped 000351 1789116147.476994 trunc from 0x02e640 to 0x01979c (0x14ea3 bytes) 000354 1789116147.614834 mapwrite 0x0155e6 thru 0x0207b1 (0xb1cc bytes) 000355 1789116147.773250 mapwrite 0x000ea2 thru 0x005643 (0x47a2 bytes) 000358 1789116147.883464 mapwrite 0x020d36 thru 0x02f9eb (0xecb6 bytes) 000359 1789116147.989974 trunc from 0x02f9ec to 0x034543 (0x4b58 bytes) 000361 1789116148.012524 write 0x0099cd thru 0x0111c1 (0x77f5 bytes) 000363 1789116148.014724 trunc from 0x034544 to 0x00f46b (0x250d8 bytes) 000364 1789116148.037205 mapread 0x00a582 thru 0x00f46b (0x4eea bytes) 000365 1789116148.042518 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xf46c): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf46c): Mirror 4: 0x72749518 (stale) Mirror 6: 0x72749518 (stale) Mirror 7: 0x72749518 (stale) Mirror 8: 0xa9ec75cc (stale) Mirror 9: 0xa9ec75cc (stale) CRC-32 checksum value for chunk [0, 0xf46c): Mirror 1: 0xb2e92ed1 Mirror 10: 0xb2e92ed1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf46c: skipped 000367 1789116149.055827 MIRROR_RESYNC 7 mirrors 000369 1789116150.434097 MIRROR_EXTEND to 8 mirrors 000370 1789116151.481665 mapwrite 0x01919f thru 0x01f83f (0x66a1 bytes) 000376 1789116151.806834 mapwrite 0x00a6ef thru 0x00c5d1 (0x1ee3 bytes) 000378 1789116151.896662 mapwrite 0x021615 thru 0x023b29 (0x2515 bytes) 000380 1789116151.960092 trunc from 0x023b2a to 0x0330c9 (0xf5a0 bytes) 000381 1789116151.974652 read 0x0074f6 thru 0x00d412 (0x5f1d bytes) 000383 1789116151.976802 read 0x0110ee thru 0x020f0a (0xfe1d bytes) 000389 1789116152.000526 trunc from 0x0330ca to 0x018382 (0x1ad47 bytes) 000390 1789116152.022052 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18383): Mirror 4: 0xc2aa968d (stale) Mirror 6: 0xc2aa968d (stale) Mirror 7: 0xc2aa968d (stale) Mirror 8: 0xc2aa968d (stale) Mirror 9: 0xc2aa968d (stale) Mirror 10: 0xc2aa968d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18383): Mirror 4: 0xc2aa968d (stale) Mirror 6: 0xc2aa968d (stale) Mirror 7: 0xc2aa968d (stale) Mirror 8: 0xc2aa968d (stale) Mirror 9: 0xc2aa968d (stale) Mirror 10: 0xc2aa968d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18383: skipped 000391 1789116152.462795 mapwrite 0x00717e thru 0x0160ae (0xef31 bytes) 000392 1789116152.568532 read 0x0110ce thru 0x018382 (0x72b5 bytes) 000394 1789116152.569644 write 0x021b4b thru 0x027c61 (0x6117 bytes) 000395 1789116152.579795 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x27c62): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27c62): Mirror 4: 0x7bff330e (stale) Mirror 6: 0x7bff330e (stale) Mirror 7: 0x7bff330e (stale) Mirror 8: 0x7bff330e (stale) Mirror 9: 0x7bff330e (stale) Mirror 10: 0x7bff330e (stale) CRC-32 checksum value for chunk [0, 0x27c62): Mirror 1: 0x62daffc2 Mirror 11: 0x62daffc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27c62: skipped 000398 1789116153.368251 mapread 0x01332a thru 0x01e371 (0xb048 bytes) 000401 1789116153.400082 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27c62): Mirror 4: 0x7bff330e (stale) Mirror 6: 0x7bff330e (stale) Mirror 7: 0x7bff330e (stale) Mirror 8: 0x7bff330e (stale) Mirror 9: 0x7bff330e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27c62): Mirror 4: 0x7bff330e (stale) Mirror 6: 0x7bff330e (stale) Mirror 7: 0x7bff330e (stale) Mirror 8: 0x7bff330e (stale) Mirror 9: 0x7bff330e (stale) CRC-32 checksum value for chunk [0, 0x27c62): Mirror 1: 0x62daffc2 Mirror 11: 0x62daffc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27c62: skipped 000402 1789116154.233980 mapread 0x00f487 thru 0x00f5b3 (0x12d bytes) 000407 1789116154.251799 MIRROR_RESYNC 7 mirrors 000411 1789116156.221232 mapwrite 0x00f6a0 thru 0x0164db (0x6e3c bytes) 000413 1789116156.580403 mapwrite 0x02bc7c thru 0x03a36b (0xe6f0 bytes) 000414 1789116156.690871 mapwrite 0x01cc41 thru 0x0282bd (0xb67d bytes) 000417 1789116156.752557 read 0x02742f thru 0x0310dd (0x9caf bytes) 000421 1789116156.755642 mapread 0x00f604 thru 0x01efe6 (0xf9e3 bytes) 000423 1789116156.757706 mapwrite 0x005e39 thru 0x0085ad (0x2775 bytes) 000425 1789116156.807391 write 0x009678 thru 0x010852 (0x71db bytes) 000427 1789116156.810112 mapread 0x009674 thru 0x0139f3 (0xa380 bytes) 000428 1789116156.811154 read 0x028cea thru 0x02ced7 (0x41ee bytes) 000430 1789116156.812837 write 0x025145 thru 0x027a79 (0x2935 bytes) 000431 1789116156.818136 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a36c): Mirror 6: 0xf01b2de7 (stale) Mirror 7: 0xf01b2de7 (stale) Mirror 8: 0xf01b2de7 (stale) Mirror 9: 0xf01b2de7 (stale) Mirror 11: 0xf01b2de7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a36c): Mirror 6: 0xf01b2de7 (stale) Mirror 7: 0xf01b2de7 (stale) Mirror 8: 0xf01b2de7 (stale) Mirror 9: 0xf01b2de7 (stale) Mirror 11: 0xf01b2de7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a36c: skipped 000432 1789116157.469108 mapread 0x01c8fd thru 0x0223fc (0x5b00 bytes) 000433 1789116157.519460 trunc from 0x03a36c to 0x009ba7 (0x307c4 bytes) 000434 1789116157.555266 mapwrite 0x02cc4a thru 0x033205 (0x65bc bytes) 000437 1789116157.635085 mapwrite 0x014fc9 thru 0x01671a (0x1752 bytes) 000438 1789116157.694219 read 0x0216a3 thru 0x02ae5d (0x97bb bytes) 000439 1789116157.702019 mapread 0x014108 thru 0x0233d1 (0xf2ca bytes) 000442 1789116157.708496 read 0x008aa6 thru 0x00cbbb (0x4116 bytes) 000443 1789116157.735754 mapread 0x000f8f thru 0x00e1f5 (0xd267 bytes) 000444 1789116157.739880 read 0x02e164 thru 0x033205 (0x50a2 bytes) 000445 1789116157.747863 MIRROR_RESYNC 6 mirrors 000446 1789116159.422396 read 0x02872b thru 0x02ef82 (0x6858 bytes) truncating to largest ever: 0x3e3b7 000447 1789116159.439904 trunc from 0x033206 to 0x03e3b6 (0xb1b1 bytes) 000448 1789116159.535180 read 0x001ad1 thru 0x00e2fd (0xc82d bytes) 000449 1789116159.549175 mapwrite 0x0092f0 thru 0x012172 (0x8e83 bytes) 000451 1789116159.610200 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e3b7): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3b7): Mirror 6: 0xe2f0521 (stale) Mirror 7: 0xe2f0521 (stale) Mirror 8: 0xe2f0521 (stale) Mirror 9: 0xe2f0521 (stale) Mirror 11: 0xe2f0521 (stale) CRC-32 checksum value for chunk [0, 0x3e3b7): Mirror 1: 0xb3a6e293 Mirror 12: 0xb3a6e293 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3b7: skipped 000454 1789116160.944871 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e3b7): Mirror 6: 0xe2f0521 (stale) Mirror 8: 0xe2f0521 (stale) Mirror 9: 0xe2f0521 (stale) Mirror 11: 0xe2f0521 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3b7): Mirror 6: 0xe2f0521 (stale) Mirror 8: 0xe2f0521 (stale) Mirror 9: 0xe2f0521 (stale) Mirror 11: 0xe2f0521 (stale) CRC-32 checksum value for chunk [0, 0x3e3b7): Mirror 1: 0xb3a6e293 Mirror 12: 0xb3a6e293 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3b7: skipped 000457 1789116161.786161 mapread 0x02654d thru 0x0335ab (0xd05f bytes) 000458 1789116161.847140 write 0x02eca8 thru 0x033a30 (0x4d89 bytes) 000461 1789116161.998079 write 0x02e2b8 thru 0x031ec7 (0x3c10 bytes) 000462 1789116162.001028 write 0x03687a thru 0x0385fd (0x1d84 bytes) 000463 1789116162.011826 mapread 0x01f4a9 thru 0x02958b (0xa0e3 bytes) 000464 1789116162.033011 mapread 0x037988 thru 0x03a6de (0x2d57 bytes) 000465 1789116162.044077 mapwrite 0x034673 thru 0x03f214 (0xaba2 bytes) 000466 1789116162.138827 MIRROR_RESYNC 6 mirrors 000467 1789116163.346530 read 0x01de23 thru 0x02b6e6 (0xd8c4 bytes) 000468 1789116163.374178 read 0x021ccc thru 0x02502b (0x3360 bytes) 000469 1789116163.374602 read 0x0057dd thru 0x00698e (0x11b2 bytes) 000472 1789116163.408793 MIRROR_EXTEND to 7 mirrors 000475 1789116164.540823 write 0x01fc03 thru 0x0275b6 (0x79b4 bytes) 000476 1789116164.629858 MIRROR_RESYNC 7 mirrors 000477 1789116166.433518 trunc from 0x03f215 to 0x036c0b (0x8609 bytes) 000478 1789116166.691020 read 0x01d281 thru 0x02aa85 (0xd805 bytes) 000479 1789116166.722819 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36c0c): Mirror 6: 0xaa4dfda6 (stale) Mirror 8: 0xaa4dfda6 (stale) Mirror 11: 0xaa4dfda6 (stale) Mirror 12: 0xaa4dfda6 (stale) Mirror 13: 0xaa4dfda6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36c0c): Mirror 6: 0xaa4dfda6 (stale) Mirror 8: 0xaa4dfda6 (stale) Mirror 11: 0xaa4dfda6 (stale) Mirror 12: 0xaa4dfda6 (stale) Mirror 13: 0xaa4dfda6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36c0c: skipped 000481 1789116167.366116 MIRROR_RESYNC 6 mirrors 000482 1789116169.087915 write 0x03ff23 thru 0x03ffff (0xdd bytes) 000483 1789116169.288669 trunc from 0x040000 to 0x0370ca (0x8f35 bytes) 000484 1789116169.321863 write 0x005166 thru 0x00a597 (0x5432 bytes) 000486 1789116169.345595 read 0x00c629 thru 0x019f2e (0xd906 bytes) 000488 1789116169.371032 read 0x01e499 thru 0x028d47 (0xa8af bytes) 000490 1789116169.396017 mapread 0x01c9c1 thru 0x021f16 (0x5556 bytes) 000491 1789116169.410755 MIRROR_RESYNC 6 mirrors 000492 1789116171.017935 read 0x011cad thru 0x01b398 (0x96ec bytes) truncating to largest ever: 0x3e6fb 000493 1789116171.029598 trunc from 0x0370cb to 0x03e6fa (0x7630 bytes) 000496 1789116171.122793 trunc from 0x03e6fb to 0x003599 (0x3b161 bytes) 000497 1789116171.153709 MIRROR_RESYNC 6 mirrors 000498 1789116172.609139 mapwrite 0x00e568 thru 0x011615 (0x30ae bytes) 000499 1789116172.772695 trunc from 0x011616 to 0x0378b1 (0x2629c bytes) 000501 1789116172.800697 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x378b2): Mirror 6: 0xb09ba1d1 (stale) Mirror 8: 0xb09ba1d1 (stale) Mirror 11: 0xb09ba1d1 (stale) Mirror 13: 0xb09ba1d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x378b2): Mirror 6: 0xb09ba1d1 (stale) Mirror 8: 0xb09ba1d1 (stale) Mirror 11: 0xb09ba1d1 (stale) Mirror 13: 0xb09ba1d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x378b2: skipped 000502 1789116173.184411 read 0x026712 thru 0x027892 (0x1181 bytes) 000503 1789116173.193297 write 0x026f06 thru 0x030a45 (0x9b40 bytes) 000504 1789116173.207839 read 0x02254d thru 0x02daaf (0xb563 bytes) 000505 1789116173.227539 trunc from 0x0378b2 to 0x00c261 (0x2b650 bytes) 000507 1789116173.251931 write 0x023e5c thru 0x027958 (0x3afd bytes) 000508 1789116173.255529 mapwrite 0x03bf85 thru 0x03ffff (0x407b bytes) truncating to largest ever: 0x3fdf5 000510 1789116173.355928 trunc from 0x040000 to 0x03fdf4 (0x20b bytes) 000512 1789116173.388309 read 0x030760 thru 0x03fdf4 (0xf695 bytes) 000513 1789116173.402993 write 0x02ac7b thru 0x02f7f7 (0x4b7d bytes) 000515 1789116173.409185 trunc from 0x03fdf5 to 0x0382ac (0x7b48 bytes) 000520 1789116173.453740 write 0x038124 thru 0x03cda6 (0x4c83 bytes) 000522 1789116173.456546 mapread 0x02a652 thru 0x033712 (0x90c1 bytes) 000523 1789116173.457574 trunc from 0x03cda7 to 0x02b0ea (0x11cbc bytes) 000524 1789116173.512100 mapread 0x0167e8 thru 0x01e6d5 (0x7eee bytes) 000526 1789116173.520940 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2b0eb): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0eb): Mirror 6: 0xf20857d9 (stale) Mirror 8: 0xf20857d9 (stale) Mirror 11: 0xf20857d9 (stale) Mirror 13: 0xf20857d9 (stale) CRC-32 checksum value for chunk [0, 0x2b0eb): Mirror 1: 0xd6505c56 Mirror 14: 0xd6505c56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0eb: skipped 000527 1789116175.026926 mapread 0x010031 thru 0x01ef05 (0xeed5 bytes) 000528 1789116175.070076 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b0eb): Mirror 6: 0xf20857d9 (stale) Mirror 8: 0xf20857d9 (stale) Mirror 13: 0xf20857d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0eb): Mirror 6: 0xf20857d9 (stale) Mirror 8: 0xf20857d9 (stale) Mirror 13: 0xf20857d9 (stale) CRC-32 checksum value for chunk [0, 0x2b0eb): Mirror 1: 0xd6505c56 Mirror 14: 0xd6505c56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0eb: skipped 000529 1789116175.625682 MIRROR_RESYNC 5 mirrors 000531 1789116177.052712 trunc from 0x02b0eb to 0x018749 (0x129a1 bytes) 000532 1789116177.176925 mapread 0x00fc30 thru 0x01658d (0x695e bytes) 000533 1789116177.202592 read 0x002aa3 thru 0x004c03 (0x2161 bytes) 000534 1789116177.207676 read 0x004eea thru 0x00f13c (0xa253 bytes) 000535 1789116177.221606 mapwrite 0x019684 thru 0x028902 (0xf27f bytes) 000536 1789116177.343526 read 0x006b8a thru 0x00bea5 (0x531c bytes) 000537 1789116177.344271 mapwrite 0x03fcbd thru 0x03ffff (0x343 bytes) 000538 1789116177.423491 mapwrite 0x026217 thru 0x0341f2 (0xdfdc bytes) 000543 1789116177.517587 trunc from 0x040000 to 0x026ba0 (0x1945f bytes) 000546 1789116177.568335 read 0x00f61a thru 0x013fa6 (0x498d bytes) 000547 1789116177.568946 mapread 0x0055c7 thru 0x00914d (0x3b87 bytes) 000548 1789116177.577794 mapwrite 0x001841 thru 0x00d9bf (0xc17f bytes) 000549 1789116177.755691 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26ba1): Mirror 6: 0x3da7b268 (stale) Mirror 8: 0x3da7b268 (stale) Mirror 14: 0x3da7b268 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ba1): Mirror 6: 0x3da7b268 (stale) Mirror 8: 0x3da7b268 (stale) Mirror 14: 0x3da7b268 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ba1: skipped 000551 1789116178.244107 mapwrite 0x01c1e3 thru 0x0293ed (0xd20b bytes) 000552 1789116178.458726 write 0x015f3f thru 0x022d77 (0xce39 bytes) 000553 1789116178.465753 read 0x00fff7 thru 0x01003c (0x46 bytes) 000554 1789116178.470819 write 0x00c5bf thru 0x011bcb (0x560d bytes) 000556 1789116178.485635 MIRROR_RESYNC 4 mirrors 000557 1789116179.757860 read 0x00a684 thru 0x00dde6 (0x3763 bytes) 000558 1789116179.769304 write 0x03cc9e thru 0x03d07a (0x3dd bytes) 000559 1789116179.947605 trunc from 0x03d07b to 0x0353fa (0x7c80 bytes) 000560 1789116179.997711 mapread 0x01ca36 thru 0x021f14 (0x54df bytes) 000561 1789116180.041722 write 0x014d9b thru 0x01d19a (0x8400 bytes) 000562 1789116180.054187 mapread 0x03523f thru 0x0353fa (0x1bc bytes) 000563 1789116180.063870 read 0x00d443 thru 0x01052d (0x30eb bytes) 000565 1789116180.079980 write 0x016ed5 thru 0x0242a2 (0xd3ce bytes) 000566 1789116180.093969 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x353fb): Mirror 8: 0x7bc72152 (stale) Mirror 14: 0x7bc72152 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353fb): Mirror 8: 0x7bc72152 (stale) Mirror 14: 0x7bc72152 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353fb: skipped 000567 1789116180.503817 read 0x00b5e8 thru 0x01946e (0xde87 bytes) 000568 1789116180.521830 mapread 0x034e0d thru 0x0353fa (0x5ee bytes) 000571 1789116180.548777 mapread 0x030595 thru 0x0353fa (0x4e66 bytes) 000573 1789116180.573550 read 0x0226a9 thru 0x024193 (0x1aeb bytes) 000574 1789116180.590509 read 0x02ad41 thru 0x0353fa (0xa6ba bytes) 000575 1789116180.591345 mapwrite 0x00eca2 thru 0x01836f (0x96ce bytes) 000576 1789116180.708472 mapwrite 0x030054 thru 0x036601 (0x65ae bytes) 000577 1789116180.821928 read 0x00395b thru 0x00f6a4 (0xbd4a bytes) truncating to largest ever: 0x3ff76 000579 1789116180.827991 trunc from 0x036602 to 0x03ff75 (0x9974 bytes) 000580 1789116180.855689 mapwrite 0x03c73f thru 0x03ffff (0x38c1 bytes) 000581 1789116180.978862 write 0x01a989 thru 0x01e143 (0x37bb bytes) 000582 1789116180.989774 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9b3bb7eb (stale) Mirror 14: 0x9b3bb7eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x234eaac3 Mirror 15: 0x234eaac3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000583 1789116182.197956 mapwrite 0x01554d thru 0x01cec3 (0x7977 bytes) 000584 1789116182.492487 write 0x0296c9 thru 0x0308aa (0x71e2 bytes) 000586 1789116182.525689 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9b3bb7eb (stale) Mirror 14: 0x9b3bb7eb (stale) Mirror 15: 0x234eaac3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2704b8b Mirror 16: 0xc2704b8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000587 1789116183.493546 write 0x03939e thru 0x03ec8e (0x58f1 bytes) 000588 1789116183.622916 mapwrite 0x01ac34 thru 0x01c5f0 (0x19bd bytes) 000589 1789116183.748583 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9b3bb7eb (stale) Mirror 14: 0x9b3bb7eb (stale) Mirror 15: 0x234eaac3 (stale) Mirror 16: 0xc2704b8b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9331d197 Mirror 17: 0x9331d197 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000590 1789116185.034995 trunc from 0x040000 to 0x018ab3 (0x2754c bytes) 000591 1789116185.193631 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x18ab4): Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18ab4): Mirror 8: 0xf0caada3 (stale) Mirror 14: 0xf0caada3 (stale) Mirror 15: 0xc62acb26 (stale) Mirror 16: 0x5e7ddd49 (stale) Mirror 17: 0x5e7ddd49 (stale) CRC-32 checksum value for chunk [0, 0x18ab4): Mirror 1: 0x5e7ddd49 Mirror 18: 0x5e7ddd49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18ab4: skipped 000592 1789116186.889615 MIRROR_RESYNC 7 mirrors 000593 1789116188.605610 MIRROR_EXTEND to 8 mirrors 000594 1789116189.610237 read 0x013d87 thru 0x018ab3 (0x4d2d bytes) 000595 1789116189.630860 trunc from 0x018ab4 to 0x01c0cf (0x361c bytes) 000597 1789116189.797955 trunc from 0x01c0d0 to 0x0398ab (0x1d7dc bytes) 000598 1789116189.837942 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x398ac): Mirror 8: 0xa30d81fa (stale) Mirror 14: 0xa30d81fa (stale) Mirror 16: 0xa30d81fa (stale) Mirror 17: 0xa30d81fa (stale) Mirror 18: 0xa30d81fa (stale) Mirror 19: 0xa30d81fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x398ac): Mirror 8: 0xa30d81fa (stale) Mirror 14: 0xa30d81fa (stale) Mirror 16: 0xa30d81fa (stale) Mirror 17: 0xa30d81fa (stale) Mirror 18: 0xa30d81fa (stale) Mirror 19: 0xa30d81fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x398ac: skipped 000599 1789116190.645857 write 0x0376e8 thru 0x0379c0 (0x2d9 bytes) 000600 1789116190.663472 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x398ac): Mirror 8: 0xa30d81fa (stale) Mirror 16: 0xa30d81fa (stale) Mirror 17: 0xa30d81fa (stale) Mirror 18: 0xa30d81fa (stale) Mirror 19: 0xa30d81fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x398ac): Mirror 8: 0xa30d81fa (stale) Mirror 16: 0xa30d81fa (stale) Mirror 17: 0xa30d81fa (stale) Mirror 18: 0xa30d81fa (stale) Mirror 19: 0xa30d81fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x398ac: skipped 000601 1789116191.510807 mapread 0x0047a0 thru 0x013823 (0xf084 bytes) 000603 1789116191.565950 mapread 0x009c18 thru 0x018f37 (0xf320 bytes) 000606 1789116191.571933 mapread 0x023f86 thru 0x0288f3 (0x496e bytes) 000610 1789116191.588502 trunc from 0x0398ac to 0x021d5e (0x17b4d bytes) 000612 1789116191.658697 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x21d5f): Mirror 8: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21d5f): Mirror 8: 0xfdb1a02b (stale) Mirror 16: 0xfdb1a02b (stale) Mirror 17: 0xfdb1a02b (stale) Mirror 18: 0xfdb1a02b (stale) Mirror 19: 0xfdb1a02b (stale) CRC-32 checksum value for chunk [0, 0x21d5f): Mirror 1: 0xfdb1a02b Mirror 20: 0xfdb1a02b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21d5f: skipped 000613 1789116193.419338 read 0x011b9e thru 0x015660 (0x3ac3 bytes) 000614 1789116193.429645 mapread 0x012ec8 thru 0x01339e (0x4d7 bytes) 000616 1789116193.430765 trunc from 0x021d5f to 0x017a2f (0xa32f bytes) 000617 1789116193.554630 mapwrite 0x0236aa thru 0x02d6da (0xa031 bytes) 000618 1789116193.658336 read 0x00b7b9 thru 0x01b351 (0xfb99 bytes) 000621 1789116193.679975 MIRROR_RESYNC 7 mirrors 000623 1789116195.622524 write 0x032870 thru 0x038030 (0x57c1 bytes) 000624 1789116195.707188 mapwrite 0x02a459 thru 0x036a45 (0xc5ed bytes) 000626 1789116195.801820 mapwrite 0x016fb0 thru 0x026c09 (0xfc5a bytes) 000627 1789116195.897632 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38031): Mirror 16: 0x4e95cb3a (stale) Mirror 17: 0x4e95cb3a (stale) Mirror 18: 0x4e95cb3a (stale) Mirror 19: 0x4e95cb3a (stale) Mirror 20: 0x4e95cb3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38031): Mirror 16: 0x4e95cb3a (stale) Mirror 17: 0x4e95cb3a (stale) Mirror 18: 0x4e95cb3a (stale) Mirror 19: 0x4e95cb3a (stale) Mirror 20: 0x4e95cb3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38031: skipped 000628 1789116196.620517 write 0x01c52b thru 0x029c4a (0xd720 bytes) 000629 1789116196.646499 read 0x006205 thru 0x0153db (0xf1d7 bytes) 000630 1789116196.669300 read 0x033fd5 thru 0x035a2e (0x1a5a bytes) 000634 1789116196.688899 mapwrite 0x01a58f thru 0x0247d6 (0xa248 bytes) 000635 1789116196.746231 mapwrite 0x0066d9 thru 0x012c25 (0xc54d bytes) 000636 1789116196.829674 mapwrite 0x03b9de thru 0x03ffff (0x4622 bytes) 000638 1789116196.925191 mapread 0x035da1 thru 0x03ac9b (0x4efb bytes) 000639 1789116196.935857 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xabc8c343 (stale) Mirror 17: 0xabc8c343 (stale) Mirror 19: 0xabc8c343 (stale) Mirror 20: 0xabc8c343 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xabc8c343 (stale) Mirror 17: 0xabc8c343 (stale) Mirror 19: 0xabc8c343 (stale) Mirror 20: 0xabc8c343 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000640 1789116197.382900 mapread 0x02f93f thru 0x038792 (0x8e54 bytes) 000645 1789116197.425825 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xabc8c343 (stale) Mirror 19: 0xabc8c343 (stale) Mirror 20: 0xabc8c343 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xabc8c343 (stale) Mirror 19: 0xabc8c343 (stale) Mirror 20: 0xabc8c343 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000646 1789116197.936779 write 0x034022 thru 0x03546d (0x144c bytes) 000647 1789116197.946143 mapwrite 0x0122e3 thru 0x0147ed (0x250b bytes) 000648 1789116197.999915 read 0x025d4e thru 0x0352e0 (0xf593 bytes) 000649 1789116198.009868 mapread 0x03db59 thru 0x03ffff (0x24a7 bytes) 000650 1789116198.023199 mapread 0x0369a3 thru 0x03cc9f (0x62fd bytes) 000651 1789116198.024214 mapwrite 0x02ccda thru 0x03a368 (0xd68f bytes) 000654 1789116198.089926 trunc from 0x040000 to 0x030bdc (0xf423 bytes) 000655 1789116198.113381 trunc from 0x030bdd to 0x00e8a0 (0x2233c bytes) 000656 1789116198.156642 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xe8a1): Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe8a1): Mirror 16: 0xbbc3671 (stale) Mirror 19: 0xbbc3671 (stale) Mirror 20: 0xbbc3671 (stale) CRC-32 checksum value for chunk [0, 0xe8a1): Mirror 1: 0x1c424406 Mirror 21: 0x1c424406 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe8a1: skipped 000657 1789116199.269925 mapwrite 0x00aeba thru 0x0127f3 (0x793a bytes) 000660 1789116199.522874 read 0x0117ef thru 0x0127f3 (0x1005 bytes) 000661 1789116199.523530 trunc from 0x0127f4 to 0x029f1d (0x1772a bytes) 000662 1789116199.575785 read 0x027f8e thru 0x029f1d (0x1f90 bytes) 000663 1789116199.591085 mapread 0x000fc2 thru 0x00189f (0x8de bytes) 000666 1789116199.593003 write 0x022b97 thru 0x0280f5 (0x555f bytes) 000667 1789116199.600154 mapwrite 0x01f4aa thru 0x01fb8a (0x6e1 bytes) 000668 1789116199.687961 trunc from 0x029f1e to 0x03654e (0xc631 bytes) 000670 1789116199.743115 MIRROR_RESYNC 5 mirrors 000672 1789116201.275809 read 0x014d69 thru 0x0232c4 (0xe55c bytes) 000673 1789116201.303612 MIRROR_RESYNC 5 mirrors 000675 1789116201.876952 mapread 0x00be2f thru 0x01573b (0x990d bytes) 000676 1789116201.914106 trunc from 0x03654f to 0x032c4f (0x38ff bytes) 000679 1789116202.024578 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32c50): Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32c50): Mirror 16: 0x902eb615 (stale) Mirror 19: 0x902eb615 (stale) Mirror 20: 0x902eb615 (stale) Mirror 21: 0x902eb615 (stale) CRC-32 checksum value for chunk [0, 0x32c50): Mirror 1: 0x902eb615 Mirror 22: 0x902eb615 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32c50: skipped 000680 1789116203.522676 write 0x03b67b thru 0x03c99b (0x1321 bytes) 000682 1789116203.584570 mapread 0x030ca4 thru 0x03c99b (0xbcf8 bytes) 000683 1789116203.605300 mapwrite 0x035738 thru 0x03976e (0x4037 bytes) 000684 1789116203.652034 mapread 0x03152e thru 0x03c99b (0xb46e bytes) 000689 1789116203.660508 mapwrite 0x014330 thru 0x01ebfb (0xa8cc bytes) 000690 1789116203.823093 mapread 0x01efcf thru 0x02e06a (0xf09c bytes) 000692 1789116203.853215 write 0x03cef2 thru 0x03ffff (0x310e bytes) 000693 1789116203.855629 read 0x027213 thru 0x031933 (0xa721 bytes) 000695 1789116203.857410 mapread 0x01b804 thru 0x021fc7 (0x67c4 bytes) 000699 1789116203.861805 write 0x0153bd thru 0x01a488 (0x50cc bytes) 000702 1789116203.865236 write 0x03bb07 thru 0x03ffff (0x44f9 bytes) 000703 1789116203.867239 read 0x019a97 thru 0x020019 (0x6583 bytes) 000704 1789116203.873381 mapread 0x01ad51 thru 0x02657b (0xb82b bytes) 000708 1789116203.879059 write 0x00c581 thru 0x01481c (0x829c bytes) 000712 1789116203.932436 MIRROR_RESYNC 6 mirrors 000714 1789116205.845323 read 0x0010d1 thru 0x0060b4 (0x4fe4 bytes) 000715 1789116205.865034 MIRROR_RESYNC 6 mirrors 000717 1789116206.665790 trunc from 0x040000 to 0x038b22 (0x74dd bytes) 000719 1789116206.784009 mapwrite 0x02bc90 thru 0x02d408 (0x1779 bytes) 000721 1789116206.891243 read 0x0179cc thru 0x01cf6c (0x55a1 bytes) 000722 1789116206.914650 read 0x0291f4 thru 0x037d59 (0xeb66 bytes) 000723 1789116206.936951 trunc from 0x038b23 to 0x03329c (0x5886 bytes) 000724 1789116206.974135 trunc from 0x03329d to 0x011c25 (0x21677 bytes) 000725 1789116207.011160 write 0x01f639 thru 0x02157c (0x1f44 bytes) 000726 1789116207.030528 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2157d): Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2157d): Mirror 16: 0x7a886f9f (stale) Mirror 19: 0x7a886f9f (stale) Mirror 20: 0x7a886f9f (stale) Mirror 21: 0x7a886f9f (stale) Mirror 22: 0x7a886f9f (stale) CRC-32 checksum value for chunk [0, 0x2157d): Mirror 1: 0x91beee4a Mirror 23: 0x91beee4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2157d: skipped 000727 1789116208.355056 mapread 0x01b263 thru 0x01d674 (0x2412 bytes) 000728 1789116208.391493 MIRROR_RESYNC 7 mirrors 000730 1789116209.878734 write 0x029f17 thru 0x0317b7 (0x78a1 bytes) 000731 1789116210.004757 trunc from 0x0317b8 to 0x007859 (0x29f5e bytes) 000732 1789116210.087172 MIRROR_RESYNC 7 mirrors 000733 1789116211.752487 trunc from 0x00785a to 0x03d05c (0x35803 bytes) 000734 1789116211.868908 mapread 0x03cd94 thru 0x03d05c (0x2c9 bytes) 000736 1789116211.885033 write 0x03fcf8 thru 0x03ffff (0x308 bytes) 000737 1789116211.893107 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x75112e5e (stale) Mirror 19: 0x75112e5e (stale) Mirror 20: 0x75112e5e (stale) Mirror 21: 0x75112e5e (stale) Mirror 22: 0x75112e5e (stale) Mirror 23: 0x75112e5e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8700abde Mirror 24: 0x8700abde lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000739 1789116213.425108 read 0x0010a3 thru 0x00dcb6 (0xcc14 bytes) 000740 1789116213.438894 mapwrite 0x008795 thru 0x0174c6 (0xed32 bytes) 000741 1789116213.760578 mapread 0x01cb14 thru 0x026c17 (0xa104 bytes) 000742 1789116213.781538 write 0x01d9da thru 0x023ad3 (0x60fa bytes) 000745 1789116213.789247 MIRROR_RESYNC 8 mirrors 000746 1789116215.233656 mapread 0x02aec4 thru 0x03286b (0x79a8 bytes) 000747 1789116215.263721 write 0x01bd0a thru 0x02afbb (0xf2b2 bytes) 000748 1789116215.421698 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 19: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 22: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) Mirror 24: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000749 1789116216.642875 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 19: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 22: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 19: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 22: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000753 1789116217.382542 mapread 0x035800 thru 0x0373da (0x1bdb bytes) 000755 1789116217.425044 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 22: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 22: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000756 1789116218.224800 mapread 0x034925 thru 0x03dd53 (0x942f bytes) 000758 1789116218.250541 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 22: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 Mirror 26: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000761 1789116219.464882 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 Mirror 26: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000762 1789116220.230630 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 Mirror 26: 0xea83c09 Mirror 27: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000766 1789116221.326640 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x42431973 (stale) Mirror 20: 0x42431973 (stale) Mirror 21: 0x42431973 (stale) Mirror 23: 0x42431973 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xea83c09 Mirror 25: 0xea83c09 Mirror 26: 0xea83c09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000768 1789116222.170110 write 0x006448 thru 0x0127e6 (0xc39f bytes) 000770 1789116222.300256 mapread 0x00a4d0 thru 0x0153ac (0xaedd bytes) 000772 1789116222.321430 trunc from 0x040000 to 0x00a898 (0x35767 bytes) 000774 1789116222.351328 trunc from 0x00a899 to 0x02aa54 (0x201bc bytes) 000775 1789116222.388314 trunc from 0x02aa55 to 0x0377e6 (0xcd92 bytes) 000776 1789116222.403066 trunc from 0x0377e7 to 0x02159c (0x1624a bytes) 000778 1789116222.420171 write 0x01cc88 thru 0x0205a0 (0x3919 bytes) 000779 1789116222.440213 MIRROR_RESYNC 7 mirrors 000780 1789116223.961596 read 0x0116fd thru 0x01cb37 (0xb43b bytes) 000781 1789116223.974539 read 0x00566f thru 0x008c18 (0x35aa bytes) 000784 1789116223.990092 mapread 0x00d43c thru 0x0124ae (0x5073 bytes) 000785 1789116223.990806 mapwrite 0x030051 thru 0x03b21e (0xb1ce bytes) 000787 1789116224.216610 mapwrite 0x006954 thru 0x01069f (0x9d4c bytes) 000788 1789116224.467463 mapwrite 0x028d58 thru 0x032d0d (0x9fb6 bytes) 000792 1789116224.531729 mapwrite 0x00a67a thru 0x0120a7 (0x7a2e bytes) 000794 1789116224.651033 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b21f): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b21f): Mirror 16: 0xc81a2f7f (stale) Mirror 20: 0xc81a2f7f (stale) Mirror 21: 0xc81a2f7f (stale) Mirror 23: 0xc81a2f7f (stale) Mirror 25: 0xc81a2f7f (stale) Mirror 26: 0xc81a2f7f (stale) CRC-32 checksum value for chunk [0, 0x3b21f): Mirror 1: 0x8f10356b Mirror 27: 0x8f10356b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b21f: skipped 000797 1789116225.723466 write 0x02cfeb thru 0x03a6ec (0xd702 bytes) 000798 1789116225.809069 mapwrite 0x0342c6 thru 0x03e6f8 (0xa433 bytes) 000799 1789116225.916467 trunc from 0x03e6f9 to 0x02ce48 (0x118b0 bytes) 000800 1789116225.940246 write 0x01a76d thru 0x027794 (0xd028 bytes) 000802 1789116225.957287 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ce49): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce49): Mirror 16: 0x322f3387 (stale) Mirror 20: 0x322f3387 (stale) Mirror 21: 0x322f3387 (stale) Mirror 23: 0x322f3387 (stale) Mirror 25: 0x322f3387 (stale) Mirror 26: 0x322f3387 (stale) Mirror 27: 0x7af51d35 (stale) CRC-32 checksum value for chunk [0, 0x2ce49): Mirror 1: 0x9b7f8f51 Mirror 28: 0x9b7f8f51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce49: skipped 000803 1789116227.323283 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2ce49): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce49): Mirror 16: 0x322f3387 (stale) Mirror 20: 0x322f3387 (stale) Mirror 21: 0x322f3387 (stale) Mirror 23: 0x322f3387 (stale) Mirror 25: 0x322f3387 (stale) Mirror 26: 0x322f3387 (stale) Mirror 27: 0x7af51d35 (stale) CRC-32 checksum value for chunk [0, 0x2ce49): Mirror 1: 0x9b7f8f51 Mirror 28: 0x9b7f8f51 Mirror 29: 0x9b7f8f51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce49: skipped 000804 1789116228.771622 trunc from 0x02ce49 to 0x011dd7 (0x1b071 bytes) 000805 1789116228.859120 read 0x00b942 thru 0x011dd7 (0x6496 bytes) 000806 1789116228.868338 mapwrite 0x008830 thru 0x01639b (0xdb6c bytes) 000808 1789116228.985125 mapread 0x0035e6 thru 0x0123a8 (0xedc3 bytes) 000809 1789116228.993158 MIRROR_RESYNC 10 mirrors 000811 1789116230.753524 write 0x01d4cf thru 0x022b69 (0x569b bytes) 000813 1789116230.823146 mapwrite 0x03a416 thru 0x03e696 (0x4281 bytes) 000814 1789116230.921972 trunc from 0x03e697 to 0x036bdc (0x7aba bytes) 000815 1789116230.949510 trunc from 0x036bdd to 0x03f4bf (0x88e3 bytes) 000819 1789116230.971192 trunc from 0x03f4c0 to 0x002f38 (0x3c587 bytes) 000821 1789116230.997296 mapwrite 0x01e8a3 thru 0x01ee33 (0x591 bytes) 000822 1789116231.112025 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ee34): Mirror 16: 0x525cd7a4 (stale) Mirror 20: 0x525cd7a4 (stale) Mirror 21: 0x525cd7a4 (stale) Mirror 25: 0x525cd7a4 (stale) Mirror 26: 0x525cd7a4 (stale) Mirror 27: 0x525cd7a4 (stale) Mirror 28: 0x525cd7a4 (stale) Mirror 29: 0x525cd7a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ee34): Mirror 16: 0x525cd7a4 (stale) Mirror 20: 0x525cd7a4 (stale) Mirror 21: 0x525cd7a4 (stale) Mirror 25: 0x525cd7a4 (stale) Mirror 26: 0x525cd7a4 (stale) Mirror 27: 0x525cd7a4 (stale) Mirror 28: 0x525cd7a4 (stale) Mirror 29: 0x525cd7a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ee34: skipped 000825 1789116231.685034 MIRROR_RESYNC 9 mirrors 000826 1789116233.142043 trunc from 0x01ee34 to 0x03a28c (0x1b459 bytes) 000828 1789116233.233600 mapread 0x02518e thru 0x029c86 (0x4af9 bytes) 000830 1789116233.264211 read 0x030630 thru 0x03a28c (0x9c5d bytes) 000831 1789116233.285821 mapread 0x0316be thru 0x0331f7 (0x1b3a bytes) 000832 1789116233.292569 MIRROR_RESYNC 9 mirrors 000833 1789116235.220414 MIRROR_EXTEND to 10 mirrors 000834 1789116236.360859 trunc from 0x03a28d to 0x02f802 (0xaa8a bytes) 000836 1789116236.483915 write 0x03ad98 thru 0x03ffff (0x5268 bytes) 000837 1789116236.500100 MIRROR_RESYNC 10 mirrors 000839 1789116239.239880 write 0x03bdf3 thru 0x03f57b (0x3789 bytes) 000840 1789116239.334377 read 0x0137a5 thru 0x01f170 (0xb9cc bytes) 000841 1789116239.352271 read 0x00f7ac thru 0x01e915 (0xf16a bytes) 000842 1789116239.371324 trunc from 0x040000 to 0x014aa9 (0x2b556 bytes) 000844 1789116239.411903 mapread 0x001b19 thru 0x00eb8b (0xd073 bytes) 000845 1789116239.412977 trunc from 0x014aaa to 0x01f698 (0xabef bytes) 000847 1789116239.451040 mapwrite 0x01a05b thru 0x028dd2 (0xed78 bytes) 000848 1789116239.696215 mapread 0x01b44d thru 0x01c676 (0x122a bytes) 000850 1789116239.713285 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x28dd3): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28dd3): Mirror 16: 0x7d17a1c4 (stale) Mirror 20: 0x7d17a1c4 (stale) Mirror 21: 0x7d17a1c4 (stale) Mirror 25: 0x7d17a1c4 (stale) Mirror 26: 0x7d17a1c4 (stale) Mirror 27: 0x7d17a1c4 (stale) Mirror 28: 0x7d17a1c4 (stale) Mirror 29: 0x7d17a1c4 (stale) Mirror 30: 0x7d17a1c4 (stale) CRC-32 checksum value for chunk [0, 0x28dd3): Mirror 1: 0x5ff24463 Mirror 31: 0x5ff24463 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28dd3: skipped 000855 1789116240.736641 write 0x002aa2 thru 0x004b1b (0x207a bytes) 000856 1789116240.902543 mapwrite 0x01f91a thru 0x02b8a2 (0xbf89 bytes) 000857 1789116241.066784 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b8a3): Mirror 16: 0x765d9672 (stale) Mirror 20: 0x765d9672 (stale) Mirror 25: 0x765d9672 (stale) Mirror 26: 0x765d9672 (stale) Mirror 27: 0x765d9672 (stale) Mirror 28: 0x765d9672 (stale) Mirror 29: 0x765d9672 (stale) Mirror 30: 0x765d9672 (stale) Mirror 31: 0xc425a04c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8a3): Mirror 16: 0x765d9672 (stale) Mirror 20: 0x765d9672 (stale) Mirror 25: 0x765d9672 (stale) Mirror 26: 0x765d9672 (stale) Mirror 27: 0x765d9672 (stale) Mirror 28: 0x765d9672 (stale) Mirror 29: 0x765d9672 (stale) Mirror 30: 0x765d9672 (stale) Mirror 31: 0xc425a04c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8a3: skipped 000860 1789116241.839131 mapread 0x019e03 thru 0x01e892 (0x4a90 bytes) 000862 1789116241.880570 mapread 0x02719b thru 0x02b8a2 (0x4708 bytes) 000867 1789116241.896465 trunc from 0x02b8a3 to 0x01b9eb (0xfeb7 bytes) 000868 1789116241.926993 mapwrite 0x023781 thru 0x02863e (0x4ebe bytes) 000872 1789116242.034998 mapread 0x006382 thru 0x01345c (0xd0db bytes) 000873 1789116242.053436 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2863f): Mirror 16: 0xd0337633 (stale) Mirror 20: 0xd0337633 (stale) Mirror 25: 0xd0337633 (stale) Mirror 27: 0xd0337633 (stale) Mirror 28: 0xd0337633 (stale) Mirror 29: 0xd0337633 (stale) Mirror 30: 0xd0337633 (stale) Mirror 31: 0x1fea091c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2863f): Mirror 16: 0xd0337633 (stale) Mirror 20: 0xd0337633 (stale) Mirror 25: 0xd0337633 (stale) Mirror 27: 0xd0337633 (stale) Mirror 28: 0xd0337633 (stale) Mirror 29: 0xd0337633 (stale) Mirror 30: 0xd0337633 (stale) Mirror 31: 0x1fea091c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2863f: skipped 000874 1789116242.709616 mapread 0x010039 thru 0x010a56 (0xa1e bytes) 000875 1789116242.716193 mapread 0x003f01 thru 0x0079de (0x3ade bytes) 000877 1789116242.750638 mapwrite 0x0007ae thru 0x001569 (0xdbc bytes) 000878 1789116242.811476 mapread 0x02617a thru 0x02863e (0x24c5 bytes) 000880 1789116242.826302 mapwrite 0x01c17c thru 0x01c74d (0x5d2 bytes) 000882 1789116242.924661 mapread 0x007c10 thru 0x007eda (0x2cb bytes) 000883 1789116242.926519 write 0x011114 thru 0x01b6e4 (0xa5d1 bytes) 000885 1789116242.945975 mapread 0x019f7f thru 0x01c89b (0x291d bytes) 000888 1789116242.947901 trunc from 0x02863f to 0x006c6a (0x219d4 bytes) 000890 1789116242.996427 write 0x03b41f thru 0x03ffff (0x4be1 bytes) 000891 1789116243.000075 write 0x011ac5 thru 0x015f79 (0x44b5 bytes) 000893 1789116243.015602 trunc from 0x040000 to 0x031739 (0xe8c6 bytes) 000894 1789116243.048555 mapwrite 0x025dbd thru 0x0336b0 (0xd8f4 bytes) 000895 1789116243.175515 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x336b1): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x336b1): Mirror 16: 0x50c551a0 (stale) Mirror 20: 0x50c551a0 (stale) Mirror 25: 0x50c551a0 (stale) Mirror 27: 0x50c551a0 (stale) Mirror 28: 0x50c551a0 (stale) Mirror 29: 0x50c551a0 (stale) Mirror 30: 0x50c551a0 (stale) Mirror 31: 0xa01476f6 (stale) CRC-32 checksum value for chunk [0, 0x336b1): Mirror 1: 0xea5955b1 Mirror 32: 0xea5955b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x336b1: skipped 000896 1789116244.057104 MIRROR_RESYNC 10 mirrors 000897 1789116245.924744 write 0x0388fb thru 0x03ac1c (0x2322 bytes) 000898 1789116246.005028 trunc from 0x03ac1d to 0x018c4f (0x21fcd bytes) 000899 1789116246.029044 mapwrite 0x028811 thru 0x02a781 (0x1f71 bytes) 000901 1789116246.140418 mapwrite 0x03456d thru 0x038afd (0x4591 bytes) 000902 1789116246.222560 mapread 0x03057d thru 0x0338c6 (0x334a bytes) 000903 1789116246.227704 mapread 0x00b876 thru 0x01200f (0x679a bytes) 000904 1789116246.235978 trunc from 0x038afe to 0x016394 (0x22769 bytes) 000908 1789116246.264819 trunc from 0x016395 to 0x020f78 (0xabe4 bytes) 000909 1789116246.280245 mapread 0x002c25 thru 0x008fd8 (0x63b4 bytes) 000911 1789116246.288960 mapread 0x018dc7 thru 0x01ebe2 (0x5e1c bytes) 000912 1789116246.297251 write 0x01c36b thru 0x024feb (0x8c81 bytes) 000913 1789116246.298667 trunc from 0x024fec to 0x02124d (0x3d9e bytes) 000915 1789116246.341199 mapread 0x01888d thru 0x01b3ed (0x2b61 bytes) 000917 1789116246.350773 MIRROR_RESYNC 10 mirrors 000918 1789116248.223734 read 0x013dc6 thru 0x01db09 (0x9d44 bytes) 000919 1789116248.237152 write 0x03e692 thru 0x03ffff (0x196e bytes) 000920 1789116248.373185 trunc from 0x040000 to 0x024e6b (0x1b194 bytes) 000921 1789116248.410917 write 0x03c78d thru 0x03ffff (0x3873 bytes) 000923 1789116248.416033 write 0x03e7f0 thru 0x03ffff (0x1810 bytes) 000926 1789116248.432549 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xa0a0306e (stale) Mirror 20: 0xa0a0306e (stale) Mirror 25: 0xa0a0306e (stale) Mirror 27: 0xa0a0306e (stale) Mirror 28: 0xa0a0306e (stale) Mirror 29: 0xa0a0306e (stale) Mirror 30: 0xa0a0306e (stale) Mirror 31: 0xa0a0306e (stale) Mirror 32: 0xa0a0306e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1704996b Mirror 33: 0x1704996b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000927 1789116249.770775 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xa0a0306e (stale) Mirror 20: 0xa0a0306e (stale) Mirror 25: 0xa0a0306e (stale) Mirror 27: 0xa0a0306e (stale) Mirror 28: 0xa0a0306e (stale) Mirror 29: 0xa0a0306e (stale) Mirror 31: 0xa0a0306e (stale) Mirror 32: 0xa0a0306e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xa0a0306e (stale) Mirror 20: 0xa0a0306e (stale) Mirror 25: 0xa0a0306e (stale) Mirror 27: 0xa0a0306e (stale) Mirror 28: 0xa0a0306e (stale) Mirror 29: 0xa0a0306e (stale) Mirror 31: 0xa0a0306e (stale) Mirror 32: 0xa0a0306e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1704996b Mirror 33: 0x1704996b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000929 1789116250.601422 read 0x0266f3 thru 0x028d58 (0x2666 bytes) 000930 1789116250.608398 mapwrite 0x004c2d thru 0x012651 (0xda25 bytes) 000932 1789116250.807844 write 0x0025b0 thru 0x00b131 (0x8b82 bytes) 000935 1789116250.815828 trunc from 0x040000 to 0x020000 (0x1ffff bytes) 000937 1789116250.858010 trunc from 0x020001 to 0x03d132 (0x1d132 bytes) 000938 1789116250.874181 trunc from 0x03d133 to 0x00d348 (0x2fdea bytes) 000939 1789116250.897064 read 0x00651c thru 0x00ced8 (0x69bd bytes) 000943 1789116250.900526 mapwrite 0x033821 thru 0x03bc2a (0x840a bytes) 000944 1789116250.984568 read 0x023cbe thru 0x02a604 (0x6947 bytes) 000945 1789116250.990265 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc2b): Mirror 16: 0x726de87 (stale) Mirror 20: 0x726de87 (stale) Mirror 25: 0x726de87 (stale) Mirror 28: 0x726de87 (stale) Mirror 29: 0x726de87 (stale) Mirror 31: 0x726de87 (stale) Mirror 32: 0x726de87 (stale) Mirror 33: 0x726de87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc2b): Mirror 16: 0x726de87 (stale) Mirror 20: 0x726de87 (stale) Mirror 25: 0x726de87 (stale) Mirror 28: 0x726de87 (stale) Mirror 29: 0x726de87 (stale) Mirror 31: 0x726de87 (stale) Mirror 32: 0x726de87 (stale) Mirror 33: 0x726de87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc2b: skipped 000946 1789116251.569103 write 0x00a2ee thru 0x019783 (0xf496 bytes) 000947 1789116251.581001 mapwrite 0x01ceb6 thru 0x02b186 (0xe2d1 bytes) 000948 1789116251.660241 trunc from 0x03bc2b to 0x02e7fc (0xd42e bytes) 000950 1789116251.680345 read 0x021ccc thru 0x0294af (0x77e4 bytes) 000951 1789116251.685275 MIRROR_RESYNC 9 mirrors 000954 1789116253.201956 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x199:0x0]: Invalid argument (22) 000955 1789116253.718924 mapread 0x0018c3 thru 0x00ea4b (0xd189 bytes) 000957 1789116253.761195 mapread 0x0243ec thru 0x0249f3 (0x608 bytes) 000958 1789116253.772821 mapread 0x022481 thru 0x02e7fc (0xc37c bytes) 000959 1789116253.782080 trunc from 0x02e7fd to 0x0381d7 (0x99db bytes) 000961 1789116253.985539 mapread 0x02f434 thru 0x031309 (0x1ed6 bytes) 000962 1789116254.004867 read 0x00e336 thru 0x015fb8 (0x7c83 bytes) 000963 1789116254.015194 trunc from 0x0381d8 to 0x023f74 (0x14263 bytes) 000964 1789116254.069096 read 0x01dab1 thru 0x023f74 (0x64c4 bytes) 000965 1789116254.085566 mapread 0x005981 thru 0x00e905 (0x8f85 bytes) 000967 1789116254.089184 mapread 0x00c7a0 thru 0x01c5bd (0xfe1e bytes) 000969 1789116254.091688 mapread 0x00f285 thru 0x01a0eb (0xae67 bytes) 000970 1789116254.093422 mapread 0x014c45 thru 0x016a18 (0x1dd4 bytes) 000972 1789116254.102294 read 0x0150d9 thru 0x018467 (0x338f bytes) 000973 1789116254.102966 mapread 0x00f898 thru 0x01c4d9 (0xcc42 bytes) 000974 1789116254.103845 write 0x03d924 thru 0x03ffff (0x26dc bytes) 000976 1789116254.126438 MIRROR_RESYNC 8 mirrors 000980 1789116255.425410 write 0x0046fc thru 0x00e06e (0x9973 bytes) 000982 1789116255.519063 read 0x022824 thru 0x02aef2 (0x86cf bytes) 000985 1789116255.529147 mapwrite 0x03fd8e thru 0x03ffff (0x272 bytes) 000986 1789116255.578120 mapwrite 0x010862 thru 0x01f83f (0xefde bytes) 000987 1789116255.734295 write 0x025231 thru 0x02d92f (0x86ff bytes) 000989 1789116255.740335 write 0x00f562 thru 0x01d351 (0xddf0 bytes) 000990 1789116255.743048 read 0x0226fb thru 0x02ed6e (0xc674 bytes) 000991 1789116255.753207 write 0x01e984 thru 0x0294f3 (0xab70 bytes) 000992 1789116255.756105 mapread 0x024e43 thru 0x03219f (0xd35d bytes) 000993 1789116255.757180 trunc from 0x040000 to 0x0206ac (0x1f953 bytes) 000994 1789116255.872254 read 0x017496 thru 0x01af35 (0x3aa0 bytes) 000996 1789116255.886227 MIRROR_RESYNC 8 mirrors 000998 1789116257.894051 write 0x007088 thru 0x00cf61 (0x5eda bytes) All operations completed A-OK!