== sanity-flr test 70a: flr mode fsx test ================ 02:09:20 (1768547360) Seed set to 7361 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x3b4c6 000002 1768547361.861845 trunc from 00000000 to 0x03b4c5 (0x3b4c6 bytes) 000004 1768547361.875325 read 0x031013 thru 0x03b4c5 (0xa4b3 bytes) 000006 1768547361.883467 trunc from 0x03b4c6 to 0x039649 (0x1e7c bytes) 000008 1768547361.911619 trunc from 0x03964a to 0x023635 (0x16014 bytes) 000009 1768547361.933852 read 0x003f74 thru 0x00dcdb (0x9d68 bytes) 000012 1768547361.949614 write 0x03c1f5 thru 0x03ffff (0x3e0b bytes) 000014 1768547361.951715 write 0x03e409 thru 0x03ffff (0x1bf7 bytes) 000015 1768547361.952527 write 0x01f95b thru 0x02207d (0x2723 bytes) 000018 1768547361.954186 mapread 0x03ca69 thru 0x03fad3 (0x306b bytes) 000023 1768547361.957464 mapwrite 0x003611 thru 0x0070fe (0x3aee bytes) 000024 1768547362.019618 mapwrite 0x00ffb4 thru 0x01e982 (0xe9cf bytes) 000025 1768547362.060817 write 0x01fc83 thru 0x02c449 (0xc7c7 bytes) 000027 1768547362.065637 mapwrite 0x03c982 thru 0x03ffff (0x367e bytes) 000028 1768547362.111200 write 0x03ce69 thru 0x03ffff (0x3197 bytes) 000029 1768547362.113086 write 0x01c50d thru 0x01f958 (0x344c bytes) 000031 1768547362.115147 read 0x00a1c5 thru 0x015944 (0xb780 bytes) 000034 1768547362.117276 read 0x03c9be thru 0x03ffff (0x3642 bytes) 000035 1768547362.120934 read 0x00bbe8 thru 0x0195d6 (0xd9ef bytes) 000039 1768547362.123068 write 0x00060a thru 0x00126b (0xc62 bytes) 000041 1768547362.124673 write 0x011cd9 thru 0x018fbd (0x72e5 bytes) 000042 1768547362.125797 mapwrite 0x020e9a thru 0x02aba6 (0x9d0d bytes) 000050 1768547362.182894 read 0x009a36 thru 0x01921a (0xf7e5 bytes) 000052 1768547362.184447 mapwrite 0x0097dd thru 0x00b674 (0x1e98 bytes) 000054 1768547362.235850 mapread 0x02fdb9 thru 0x03485d (0x4aa5 bytes) 000056 1768547362.248956 write 0x00a519 thru 0x01a0a3 (0xfb8b bytes) 000057 1768547362.250172 trunc from 0x040000 to 0x00fb87 (0x30478 bytes) 000058 1768547362.275392 trunc from 0x00fb88 to 0x01ff06 (0x1037f bytes) 000059 1768547362.295346 write 0x0316a8 thru 0x034811 (0x316a bytes) 000060 1768547362.296198 read 0x01079e thru 0x016c81 (0x64e4 bytes) 000061 1768547362.306881 MIRROR_EXTEND to 2 mirrors 000062 1768547362.669984 write 0x03d112 thru 0x03ffff (0x2eee bytes) 000064 1768547362.737377 trunc from 0x040000 to 0x0360fe (0x9f01 bytes) 000066 1768547362.782291 mapread 0x01c1b0 thru 0x0222b6 (0x6107 bytes) 000067 1768547362.797638 trunc from 0x0360ff to 0x02565c (0x10aa2 bytes) 000073 1768547362.814596 mapread 0x0064c7 thru 0x0155ad (0xf0e7 bytes) 000074 1768547362.833110 mapwrite 0x0367ed thru 0x036ca6 (0x4ba bytes) 000076 1768547362.881260 mapwrite 0x03b8e8 thru 0x03e206 (0x291f bytes) 000079 1768547362.922349 write 0x037c04 thru 0x03ec6a (0x7067 bytes) 000081 1768547362.923755 mapread 0x010f89 thru 0x011b9b (0xc13 bytes) 000085 1768547362.931061 write 0x033655 thru 0x03538e (0x1d3a bytes) 000086 1768547362.931786 write 0x0190af thru 0x01adf4 (0x1d46 bytes) 000089 1768547362.934102 mapwrite 0x01cf25 thru 0x0249a4 (0x7a80 bytes) 000090 1768547362.970653 read 0x00bf40 thru 0x01a23e (0xe2ff bytes) 000091 1768547362.974668 MIRROR_RESYNC 2 mirrors 000092 1768547363.404887 write 0x03040e thru 0x031ae9 (0x16dc bytes) 000095 1768547363.453724 read 0x03175a thru 0x0393a1 (0x7c48 bytes) 000096 1768547363.466381 MIRROR_RESYNC 2 mirrors 000098 1768547363.864991 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x3b866 000099 1768547364.133398 trunc from 0x03ec6b to 0x03b865 (0x3405 bytes) 000100 1768547364.229905 trunc from 0x03b866 to 0x024acd (0x16d98 bytes) 000102 1768547364.243264 read 0x012193 thru 0x0123bf (0x22d bytes) 000103 1768547364.247453 mapread 0x007fb4 thru 0x0175af (0xf5fc bytes) 000104 1768547364.271302 trunc from 0x024ace to 0x00eae4 (0x15fe9 bytes) 000106 1768547364.302027 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xeae5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeae5): Mirror 2: 0x2b426909 (stale) CRC-32 checksum value for chunk [0, 0xeae5): Mirror 1: 0x2b426909 Mirror 3: 0x2b426909 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeae5: skipped 000108 1768547364.847286 write 0x021c5e thru 0x029d90 (0x8133 bytes) 000109 1768547364.884582 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29d91): Mirror 3: 0xf922b675 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d91): Mirror 3: 0xf922b675 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d91: skipped 000110 1768547365.099745 mapwrite 0x00259a thru 0x010d0f (0xe776 bytes) 000111 1768547365.169282 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29d91): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d91): Mirror 3: 0xf922b675 (stale) CRC-32 checksum value for chunk [0, 0x29d91): Mirror 1: 0x9c1d494c Mirror 4: 0x9c1d494c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d91: skipped 000112 1768547365.683325 write 0x0029e4 thru 0x012845 (0xfe62 bytes) 000114 1768547365.728761 trunc from 0x029d91 to 0x00b87d (0x1e513 bytes) 000116 1768547365.762925 mapwrite 0x014b91 thru 0x01a1c3 (0x5633 bytes) 000117 1768547365.847120 mapread 0x0099d2 thru 0x018905 (0xef34 bytes) 000119 1768547365.857490 trunc from 0x01a1c4 to 0x008a4a (0x11779 bytes) 000122 1768547365.886445 write 0x03bb84 thru 0x03ffff (0x447c bytes) 000123 1768547365.890747 mapread 0x033bf8 thru 0x03fe1d (0xc226 bytes) 000124 1768547365.901852 write 0x01e780 thru 0x02c875 (0xe0f6 bytes) 000126 1768547365.916923 trunc from 0x040000 to 0x009e27 (0x361d8 bytes) 000127 1768547365.938173 mapwrite 0x032f44 thru 0x03d64b (0xa708 bytes) 000130 1768547366.052308 read 0x031b3f thru 0x03d64b (0xbb0d bytes) 000131 1768547366.061367 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d64c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d64c): Mirror 3: 0xb658e96f (stale) Mirror 4: 0x56c54ec1 (stale) CRC-32 checksum value for chunk [0, 0x3d64c): Mirror 1: 0x212d3f83 Mirror 5: 0x212d3f83 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d64c: skipped 000133 1768547366.804930 MIRROR_RESYNC 4 mirrors 000134 1768547367.276339 mapread 0x00705e thru 0x010d4e (0x9cf1 bytes) 000139 1768547367.289089 trunc from 0x03d64c to 0x010e3a (0x2c811 bytes) 000141 1768547367.325359 trunc from 0x010e3b to 0x0109a3 (0x497 bytes) 000144 1768547367.342645 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x109a4): Mirror 4: 0x3b8efb0c (stale) Mirror 5: 0x3b8efb0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x109a4): Mirror 4: 0x3b8efb0c (stale) Mirror 5: 0x3b8efb0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x109a4: skipped 000145 1768547367.546344 read 0x00f987 thru 0x0109a3 (0x101d bytes) 000146 1768547367.551176 mapwrite 0x0349c9 thru 0x037629 (0x2c61 bytes) 000149 1768547367.642857 mapread 0x018c4b thru 0x028b45 (0xfefb bytes) 000150 1768547367.660657 trunc from 0x03762a to 0x004272 (0x333b7 bytes) 000151 1768547367.675242 write 0x02d8c2 thru 0x03be68 (0xe5a7 bytes) 000152 1768547367.678282 trunc from 0x03be69 to 0x0019b9 (0x3a4af bytes) 000154 1768547367.698295 mapread 0x000d72 thru 0x0019b9 (0xc48 bytes) 000155 1768547367.703147 mapread 0x0012c7 thru 0x0019b9 (0x6f3 bytes) 000156 1768547367.704079 mapwrite 0x02f05f thru 0x034500 (0x54a2 bytes) 000157 1768547367.784967 trunc from 0x034501 to 0x036f39 (0x2a39 bytes) 000158 1768547367.797496 trunc from 0x036f3a to 0x0360a0 (0xe99 bytes) 000159 1768547367.808294 read 0x00e1a0 thru 0x018c92 (0xaaf3 bytes) 000162 1768547367.820947 mapwrite 0x03b69b thru 0x03ffff (0x4965 bytes) 000164 1768547367.868788 trunc from 0x040000 to 0x035ed4 (0xa12b bytes) 000165 1768547367.877129 mapread 0x0301bf thru 0x035ed4 (0x5d16 bytes) 000166 1768547367.877860 read 0x033ecf thru 0x035ed4 (0x2006 bytes) 000168 1768547367.878789 mapread 0x02af68 thru 0x02ec25 (0x3cbe bytes) 000169 1768547367.879781 trunc from 0x035ed5 to 0x019c6d (0x1c267 bytes) 000170 1768547367.893938 mapread 0x00b1e7 thru 0x00cd0e (0x1b28 bytes) 000171 1768547367.894547 read 0x01458a thru 0x018f3a (0x49b1 bytes) 000175 1768547367.895902 mapread 0x008fab thru 0x0126fe (0x9754 bytes) 000176 1768547367.896899 mapread 0x015290 thru 0x019c6d (0x49de bytes) 000177 1768547367.897650 trunc from 0x019c6e to 0x025c14 (0xbfa7 bytes) 000178 1768547367.907499 mapwrite 0x0179d4 thru 0x020d84 (0x93b1 bytes) 000179 1768547367.949103 write 0x007dac thru 0x00e3fd (0x6652 bytes) 000180 1768547367.949893 write 0x00db1f thru 0x018b5e (0xb040 bytes) 000181 1768547367.953458 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25c15): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c15): Mirror 4: 0xc0a5bc1d (stale) Mirror 5: 0xc0a5bc1d (stale) CRC-32 checksum value for chunk [0, 0x25c15): Mirror 1: 0x93b09076 Mirror 6: 0x93b09076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c15: skipped 000182 1768547368.440412 mapread 0x01883d thru 0x021d5f (0x9523 bytes) 000183 1768547368.485597 read 0x02084e thru 0x025c14 (0x53c7 bytes) 000184 1768547368.503059 read 0x007427 thru 0x0076d0 (0x2aa bytes) 000189 1768547368.538244 mapread 0x00d472 thru 0x01ba53 (0xe5e2 bytes) 000190 1768547368.554665 mapread 0x018bea thru 0x01f598 (0x69af bytes) 000192 1768547368.592264 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25c15): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c15): Mirror 4: 0xc0a5bc1d (stale) Mirror 5: 0xc0a5bc1d (stale) CRC-32 checksum value for chunk [0, 0x25c15): Mirror 1: 0x93b09076 Mirror 6: 0x93b09076 Mirror 7: 0x93b09076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c15: skipped 000193 1768547369.373354 mapread 0x00ea51 thru 0x018939 (0x9ee9 bytes) 000194 1768547369.395443 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25c15): Mirror 5: 0xc0a5bc1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c15): Mirror 5: 0xc0a5bc1d (stale) CRC-32 checksum value for chunk [0, 0x25c15): Mirror 1: 0x93b09076 Mirror 6: 0x93b09076 Mirror 7: 0x93b09076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c15: skipped 000195 1768547370.131343 write 0x038d4d thru 0x03ca65 (0x3d19 bytes) 000196 1768547370.227808 mapread 0x0292eb thru 0x02f62e (0x6344 bytes) 000198 1768547370.250256 mapread 0x0158a1 thru 0x02075a (0xaeba bytes) 000199 1768547370.282643 mapread 0x003595 thru 0x007b4b (0x45b7 bytes) 000200 1768547370.292221 write 0x006ded thru 0x00a428 (0x363c bytes) 000201 1768547370.293241 mapwrite 0x03c48f thru 0x03ffff (0x3b71 bytes) 000203 1768547370.373340 read 0x01be52 thru 0x02007a (0x4229 bytes) 000205 1768547370.377525 MIRROR_RESYNC 4 mirrors 000208 1768547371.218457 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) 000209 1768547371.475793 write 0x026c62 thru 0x02e368 (0x7707 bytes) 000210 1768547371.628973 mapwrite 0x02ab4b thru 0x02bac0 (0xf76 bytes) 000211 1768547371.792883 write 0x03cd5d thru 0x03ffff (0x32a3 bytes) 000212 1768547371.821432 mapread 0x02dd0c thru 0x032816 (0x4b0b bytes) 000213 1768547371.842825 mapread 0x0115e4 thru 0x01e96b (0xd388 bytes) 000214 1768547371.886422 write 0x004bee thru 0x007c4d (0x3060 bytes) 000216 1768547371.917417 write 0x009b38 thru 0x00d31a (0x37e3 bytes) 000218 1768547371.931028 mapread 0x02c2bd thru 0x031035 (0x4d79 bytes) 000220 1768547371.936637 trunc from 0x040000 to 0x007401 (0x38bfe bytes) 000221 1768547372.040512 write 0x00457d thru 0x0057ac (0x1230 bytes) 000222 1768547372.041521 trunc from 0x007402 to 0x036a25 (0x2f624 bytes) 000223 1768547372.062877 mapwrite 0x034a7e thru 0x03ffff (0xb582 bytes) 000226 1768547372.145504 read 0x01a48b thru 0x01d5f4 (0x316a bytes) 000228 1768547372.152611 mapread 0x035832 thru 0x037f4c (0x271b bytes) 000230 1768547372.153921 mapwrite 0x002f03 thru 0x00bffe (0x90fc bytes) 000231 1768547372.217357 read 0x00851d thru 0x00d052 (0x4b36 bytes) 000232 1768547372.227872 MIRROR_RESYNC 3 mirrors 000233 1768547373.058236 trunc from 0x040000 to 0x02de52 (0x121ad bytes) 000234 1768547373.226069 MIRROR_RESYNC 3 mirrors 000237 1768547375.915321 mapread 0x0106bc thru 0x01ae1b (0xa760 bytes) 000238 1768547375.939323 read 0x01d28b thru 0x0206f0 (0x3466 bytes) 000239 1768547375.950001 MIRROR_EXTEND to 4 mirrors 000240 1768547376.850697 mapwrite 0x00f485 thru 0x0116e9 (0x2265 bytes) 000244 1768547377.319931 mapwrite 0x011e16 thru 0x019e44 (0x802f bytes) 000245 1768547377.589417 mapwrite 0x03060c thru 0x0321d4 (0x1bc9 bytes) 000247 1768547377.744401 trunc from 0x0321d5 to 0x019d15 (0x184bf bytes) 000248 1768547377.794599 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x19d16): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19d16): Mirror 5: 0xa4a0e4e9 (stale) Mirror 6: 0xa4a0e4e9 (stale) Mirror 7: 0xa4a0e4e9 (stale) CRC-32 checksum value for chunk [0, 0x19d16): Mirror 1: 0x745ba5c0 Mirror 8: 0x745ba5c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19d16: skipped 000249 1768547379.834834 trunc from 0x019d16 to 0x00d809 (0xc50c bytes) 000250 1768547380.153111 mapwrite 0x01afa2 thru 0x021041 (0x60a0 bytes) 000251 1768547380.360915 read 0x008b33 thru 0x017a5c (0xef2a bytes) 000252 1768547380.379925 write 0x003121 thru 0x00e6c4 (0xb5a4 bytes) 000253 1768547380.400899 read 0x0169dd thru 0x01e148 (0x776c bytes) 000254 1768547380.401507 trunc from 0x021042 to 0x034fdd (0x13f9c bytes) 000257 1768547380.421286 read 0x02dee2 thru 0x034fdd (0x70fc bytes) 000260 1768547380.448396 write 0x01679f thru 0x0225b9 (0xbe1b bytes) 000263 1768547380.463190 mapread 0x02e94a thru 0x034fdd (0x6694 bytes) 000264 1768547380.467103 write 0x0212f0 thru 0x02321d (0x1f2e bytes) 000265 1768547380.469977 mapread 0x00da4c thru 0x01b5e2 (0xdb97 bytes) 000267 1768547380.483927 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34fde): Mirror 5: 0xcf768327 (stale) Mirror 6: 0xcf768327 (stale) Mirror 8: 0xcc39efda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34fde): Mirror 5: 0xcf768327 (stale) Mirror 6: 0xcf768327 (stale) Mirror 8: 0xcc39efda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34fde: skipped 000270 1768547381.811356 trunc from 0x034fde to 0x038604 (0x3627 bytes) 000271 1768547381.833032 MIRROR_RESYNC 4 mirrors 000272 1768547383.305843 MIRROR_RESYNC 4 mirrors 000273 1768547384.178297 mapwrite 0x0064ac thru 0x01481f (0xe374 bytes) 000274 1768547384.373333 read 0x02dedb thru 0x035ad2 (0x7bf8 bytes) 000275 1768547384.386544 read 0x024fd6 thru 0x02c5ea (0x7615 bytes) 000276 1768547384.400326 write 0x00b1d9 thru 0x0194d5 (0xe2fd bytes) 000277 1768547384.404982 mapwrite 0x021d34 thru 0x02ee46 (0xd113 bytes) 000278 1768547384.576832 read 0x026249 thru 0x02996f (0x3727 bytes) 000280 1768547384.579277 trunc from 0x038605 to 0x02d854 (0xadb0 bytes) 000281 1768547384.670351 read 0x01980d thru 0x024713 (0xaf07 bytes) 000282 1768547384.686991 MIRROR_RESYNC 4 mirrors 000283 1768547386.957521 MIRROR_EXTEND to 5 mirrors 000284 1768547387.576463 trunc from 0x02d855 to 0x015451 (0x18403 bytes) 000285 1768547387.744955 MIRROR_RESYNC 5 mirrors 000287 1768547388.928098 mapread 0x013312 thru 0x015451 (0x2140 bytes) 000288 1768547388.943790 mapread 0x005666 thru 0x00bd0e (0x66a9 bytes) 000289 1768547388.961003 trunc from 0x015452 to 0x03a5ee (0x2519d bytes) 000290 1768547389.150233 read 0x021bd1 thru 0x02203b (0x46b bytes) 000291 1768547389.158700 trunc from 0x03a5ef to 0x01e7e0 (0x1be0e bytes) 000293 1768547389.196097 MIRROR_RESYNC 5 mirrors 000295 1768547390.274476 mapwrite 0x032846 thru 0x03ffff (0xd7ba bytes) 000296 1768547390.733829 write 0x012e5c thru 0x012f77 (0x11c bytes) 000300 1768547390.752013 read 0x0297f7 thru 0x0352e8 (0xbaf2 bytes) 000301 1768547390.758385 trunc from 0x040000 to 0x01aa8b (0x25574 bytes) 000302 1768547390.806084 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1aa8c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1aa8c): Mirror 5: 0x9ab85985 (stale) Mirror 6: 0x9ab85985 (stale) Mirror 8: 0x9ab85985 (stale) Mirror 9: 0x9ab85985 (stale) CRC-32 checksum value for chunk [0, 0x1aa8c): Mirror 1: 0x5517fe75 Mirror 10: 0x5517fe75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1aa8c: skipped 000303 1768547391.791774 mapwrite 0x034f37 thru 0x0393b0 (0x447a bytes) 000304 1768547392.105042 mapwrite 0x037436 thru 0x03ffff (0x8bca bytes) 000307 1768547392.210286 trunc from 0x040000 to 0x015803 (0x2a7fc bytes) 000308 1768547392.242499 read 0x0022a6 thru 0x00c00b (0x9d66 bytes) 000311 1768547392.270099 write 0x0398c2 thru 0x03ffff (0x673e bytes) 000312 1768547392.273829 read 0x01abea thru 0x020762 (0x5b79 bytes) 000313 1768547392.295225 mapread 0x00b7e4 thru 0x0162a7 (0xaac4 bytes) 000314 1768547392.296147 read 0x023490 thru 0x028b20 (0x5691 bytes) 000316 1768547392.297118 mapread 0x00bd56 thru 0x0158f3 (0x9b9e bytes) 000318 1768547392.304817 write 0x03a478 thru 0x03ffff (0x5b88 bytes) 000319 1768547392.308520 mapread 0x017d23 thru 0x01e9e0 (0x6cbe bytes) 000323 1768547392.316840 write 0x03fad7 thru 0x03ffff (0x529 bytes) 000324 1768547392.320753 trunc from 0x040000 to 0x00af79 (0x35086 bytes) 000325 1768547392.363831 write 0x03c2a7 thru 0x03ffff (0x3d59 bytes) 000326 1768547392.371367 trunc from 0x040000 to 0x039d03 (0x62fc bytes) 000327 1768547392.468750 mapread 0x016a4f thru 0x01faf6 (0x90a8 bytes) 000330 1768547392.499769 trunc from 0x039d04 to 0x014ede (0x24e25 bytes) 000332 1768547392.523728 write 0x03a57b thru 0x03e38b (0x3e11 bytes) 000333 1768547392.526925 mapwrite 0x039ab3 thru 0x03c121 (0x266f bytes) 000335 1768547392.838026 MIRROR_RESYNC 6 mirrors 000340 1768547394.548716 mapread 0x02abd8 thru 0x02b196 (0x5bf bytes) 000341 1768547394.566160 mapwrite 0x039582 thru 0x03ffff (0x6a7e bytes) 000344 1768547394.934433 mapwrite 0x02a618 thru 0x02a8ba (0x2a3 bytes) 000345 1768547394.976192 trunc from 0x040000 to 0x025207 (0x1adf8 bytes) 000347 1768547394.998868 trunc from 0x025208 to 0x021f00 (0x3307 bytes) 000348 1768547395.022992 read 0x008b5e thru 0x00dc99 (0x513c bytes) 000352 1768547395.033357 mapwrite 0x02b4ce thru 0x03b0da (0xfc0d bytes) 000353 1768547395.138850 write 0x01a362 thru 0x025c82 (0xb921 bytes) 000354 1768547395.153292 trunc from 0x03b0db to 0x00f821 (0x2b8b9 bytes) 000355 1768547395.171145 write 0x0337e8 thru 0x03b575 (0x7d8e bytes) 000356 1768547395.173298 mapwrite 0x018b1b thru 0x02577f (0xcc65 bytes) 000357 1768547395.339540 trunc from 0x03b576 to 0x00337a (0x381fb bytes) 000358 1768547395.356951 write 0x0319cf thru 0x03439a (0x29cc bytes) 000359 1768547395.359436 mapwrite 0x033c74 thru 0x03959e (0x592b bytes) 000360 1768547395.444221 write 0x020438 thru 0x02d949 (0xd512 bytes) 000361 1768547395.467308 mapwrite 0x026f4a thru 0x02ee90 (0x7f47 bytes) 000362 1768547395.523684 read 0x003af9 thru 0x0104ae (0xc9b6 bytes) 000363 1768547395.534651 write 0x027002 thru 0x02cb9d (0x5b9c bytes) 000365 1768547395.537962 read 0x01345e thru 0x0141f5 (0xd98 bytes) 000366 1768547395.538886 mapread 0x0216b8 thru 0x02a4b7 (0x8e00 bytes) 000369 1768547395.541861 read 0x0295b9 thru 0x03654a (0xcf92 bytes) 000370 1768547395.543118 trunc from 0x03959f to 0x01a2c5 (0x1f2d9 bytes) 000372 1768547395.804926 read 0x00b0e2 thru 0x00dc5f (0x2b7e bytes) 000373 1768547395.810751 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1a2c6): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a2c6): Mirror 5: 0xab4e958 (stale) Mirror 6: 0xab4e958 (stale) Mirror 8: 0xab4e958 (stale) Mirror 9: 0xab4e958 (stale) Mirror 10: 0xab4e958 (stale) CRC-32 checksum value for chunk [0, 0x1a2c6): Mirror 1: 0xed8f97f5 Mirror 11: 0xed8f97f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a2c6: skipped 000374 1768547397.223142 write 0x0249d8 thru 0x033db7 (0xf3e0 bytes) 000375 1768547397.293270 write 0x01f5fa thru 0x02f500 (0xff07 bytes) 000376 1768547397.298912 mapwrite 0x008e9e thru 0x01347b (0xa5de bytes) 000378 1768547397.373062 write 0x03d67a thru 0x03ffff (0x2986 bytes) 000379 1768547397.373942 read 0x02ba9f thru 0x033ffd (0x855f bytes) 000380 1768547397.374920 mapwrite 0x03c442 thru 0x03ffff (0x3bbe bytes) 000381 1768547397.520231 mapread 0x01404b thru 0x01eb0d (0xaac3 bytes) 000382 1768547397.527741 read 0x03eea8 thru 0x03ffff (0x1158 bytes) 000384 1768547397.535754 read 0x02ae58 thru 0x02cc16 (0x1dbf bytes) 000385 1768547397.538006 mapwrite 0x027b4f thru 0x027d45 (0x1f7 bytes) 000386 1768547397.713180 write 0x00646f thru 0x0163e0 (0xff72 bytes) 000387 1768547397.715097 mapread 0x0116c7 thru 0x019e36 (0x8770 bytes) 000391 1768547397.735397 MIRROR_RESYNC 7 mirrors 000392 1768547399.902786 mapwrite 0x0280af thru 0x02f905 (0x7857 bytes) 000393 1768547400.189268 read 0x00112b thru 0x00ccb5 (0xbb8b bytes) 000396 1768547400.209259 write 0x01d86d thru 0x02406d (0x6801 bytes) 000397 1768547400.223753 write 0x034117 thru 0x0386f4 (0x45de bytes) 000399 1768547400.243699 write 0x035499 thru 0x03a57d (0x50e5 bytes) 000402 1768547400.245519 read 0x0072a6 thru 0x010824 (0x957f bytes) 000403 1768547400.261791 read 0x025dd7 thru 0x03085f (0xaa89 bytes) 000404 1768547400.262812 trunc from 0x040000 to 0x02ff11 (0x100ee bytes) 000405 1768547400.299923 write 0x02b6e3 thru 0x02db37 (0x2455 bytes) 000406 1768547400.300840 read 0x013d97 thru 0x021c91 (0xdefb bytes) 000407 1768547400.301402 mapwrite 0x00398f thru 0x005650 (0x1cc2 bytes) 000409 1768547400.428729 mapwrite 0x037105 thru 0x03ffff (0x8efb bytes) 000410 1768547400.696747 read 0x02f619 thru 0x037d68 (0x8750 bytes) 000414 1768547400.698706 read 0x01211e thru 0x01f751 (0xd634 bytes) 000416 1768547400.701712 read 0x00f530 thru 0x00fde8 (0x8b9 bytes) 000418 1768547400.703378 read 0x0114e5 thru 0x0176da (0x61f6 bytes) 000421 1768547400.706065 mapwrite 0x02b0fd thru 0x033e35 (0x8d39 bytes) 000422 1768547400.751342 write 0x03fd8c thru 0x03ffff (0x274 bytes) 000423 1768547400.752767 trunc from 0x040000 to 0x02f928 (0x106d7 bytes) 000424 1768547400.783741 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f929): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f929): Mirror 5: 0x967907e0 (stale) Mirror 6: 0x967907e0 (stale) Mirror 8: 0x967907e0 (stale) Mirror 9: 0x967907e0 (stale) Mirror 10: 0x967907e0 (stale) Mirror 11: 0x967907e0 (stale) CRC-32 checksum value for chunk [0, 0x2f929): Mirror 1: 0x9cacaa3c Mirror 12: 0x9cacaa3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f929: skipped 000425 1768547402.274887 mapread 0x01400a thru 0x01771d (0x3714 bytes) 000426 1768547402.338941 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2f929): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f929): Mirror 5: 0x967907e0 (stale) Mirror 6: 0x967907e0 (stale) Mirror 8: 0x967907e0 (stale) Mirror 9: 0x967907e0 (stale) Mirror 10: 0x967907e0 (stale) Mirror 11: 0x967907e0 (stale) CRC-32 checksum value for chunk [0, 0x2f929): Mirror 1: 0x9cacaa3c Mirror 12: 0x9cacaa3c Mirror 13: 0x9cacaa3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f929: skipped 000427 1768547403.404477 write 0x00f6c8 thru 0x01f459 (0xfd92 bytes) 000428 1768547403.499660 trunc from 0x02f929 to 0x02356a (0xc3be bytes) 000430 1768547403.517248 read 0x01d38d thru 0x02356a (0x61de bytes) 000432 1768547403.527433 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2356b): Mirror 5: 0x6ab010c0 (stale) Mirror 6: 0x6ab010c0 (stale) Mirror 8: 0x6ab010c0 (stale) Mirror 9: 0x6ab010c0 (stale) Mirror 10: 0x6ab010c0 (stale) Mirror 12: 0xcdc75261 (stale) Mirror 13: 0xcdc75261 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2356b): Mirror 5: 0x6ab010c0 (stale) Mirror 6: 0x6ab010c0 (stale) Mirror 8: 0x6ab010c0 (stale) Mirror 9: 0x6ab010c0 (stale) Mirror 10: 0x6ab010c0 (stale) Mirror 12: 0xcdc75261 (stale) Mirror 13: 0xcdc75261 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2356b: skipped 000433 1768547404.367575 read 0x010404 thru 0x01e587 (0xe184 bytes) 000435 1768547404.381238 mapwrite 0x015213 thru 0x01cfc9 (0x7db7 bytes) 000437 1768547404.466218 MIRROR_RESYNC 8 mirrors 000438 1768547406.009765 mapread 0x0111c8 thru 0x0155df (0x4418 bytes) 000440 1768547406.024869 trunc from 0x02356b to 0x016fd4 (0xc596 bytes) 000441 1768547406.264247 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x16fd5): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16fd5): Mirror 5: 0x8baf837a (stale) Mirror 6: 0x8baf837a (stale) Mirror 8: 0x8baf837a (stale) Mirror 9: 0x8baf837a (stale) Mirror 10: 0x8baf837a (stale) Mirror 12: 0x8baf837a (stale) Mirror 13: 0x8baf837a (stale) CRC-32 checksum value for chunk [0, 0x16fd5): Mirror 1: 0x8baf837a Mirror 14: 0x8baf837a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16fd5: skipped 000445 1768547407.244809 trunc from 0x016fd5 to 0x01affb (0x4027 bytes) 000446 1768547407.330849 read 0x007820 thru 0x00abb4 (0x3395 bytes) 000448 1768547407.343888 mapread 0x00ad8f thru 0x0136bf (0x8931 bytes) 000449 1768547407.358696 write 0x01b253 thru 0x01b5e8 (0x396 bytes) 000450 1768547407.359720 write 0x000403 thru 0x002e56 (0x2a54 bytes) 000451 1768547407.366281 trunc from 0x01b5e9 to 0x02867d (0xd095 bytes) 000452 1768547407.382821 read 0x001d4a thru 0x01192e (0xfbe5 bytes) 000454 1768547407.388179 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2867e): Mirror 5: 0x28adc9d7 (stale) Mirror 6: 0x28adc9d7 (stale) Mirror 8: 0x28adc9d7 (stale) Mirror 9: 0x28adc9d7 (stale) Mirror 10: 0x28adc9d7 (stale) Mirror 13: 0x28adc9d7 (stale) Mirror 14: 0x86483c25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2867e): Mirror 5: 0x28adc9d7 (stale) Mirror 6: 0x28adc9d7 (stale) Mirror 8: 0x28adc9d7 (stale) Mirror 9: 0x28adc9d7 (stale) Mirror 10: 0x28adc9d7 (stale) Mirror 13: 0x28adc9d7 (stale) Mirror 14: 0x86483c25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2867e: skipped 000455 1768547407.874252 mapread 0x008d35 thru 0x01710e (0xe3da bytes) 000457 1768547407.900826 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2867e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2867e): Mirror 5: 0x28adc9d7 (stale) Mirror 6: 0x28adc9d7 (stale) Mirror 8: 0x28adc9d7 (stale) Mirror 9: 0x28adc9d7 (stale) Mirror 10: 0x28adc9d7 (stale) Mirror 13: 0x28adc9d7 (stale) Mirror 14: 0x86483c25 (stale) CRC-32 checksum value for chunk [0, 0x2867e): Mirror 1: 0xbfdc76e0 Mirror 15: 0xbfdc76e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2867e: skipped 000458 1768547408.811023 mapread 0x01ca8d thru 0x02494d (0x7ec1 bytes) 000463 1768547408.878100 write 0x01c872 thru 0x01ed6f (0x24fe bytes) 000464 1768547408.966734 mapread 0x02752a thru 0x02867d (0x1154 bytes) 000467 1768547408.978682 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2867e): Mirror 5: 0x28adc9d7 (stale) Mirror 6: 0x28adc9d7 (stale) Mirror 8: 0x28adc9d7 (stale) Mirror 9: 0x28adc9d7 (stale) Mirror 13: 0x28adc9d7 (stale) Mirror 14: 0x86483c25 (stale) Mirror 15: 0xbfdc76e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2867e): Mirror 5: 0x28adc9d7 (stale) Mirror 6: 0x28adc9d7 (stale) Mirror 8: 0x28adc9d7 (stale) Mirror 9: 0x28adc9d7 (stale) Mirror 13: 0x28adc9d7 (stale) Mirror 14: 0x86483c25 (stale) Mirror 15: 0xbfdc76e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2867e: skipped 000468 1768547409.400690 write 0x03bcbc thru 0x03ffff (0x4344 bytes) 000469 1768547409.404286 mapread 0x0317b5 thru 0x0352ff (0x3b4b bytes) 000472 1768547409.421498 read 0x005604 thru 0x011e01 (0xc7fe bytes) 000474 1768547409.433729 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa15b89d2 (stale) Mirror 6: 0xa15b89d2 (stale) Mirror 8: 0xa15b89d2 (stale) Mirror 9: 0xa15b89d2 (stale) Mirror 13: 0xa15b89d2 (stale) Mirror 14: 0x8fe79501 (stale) Mirror 15: 0xf4f79df2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1edc4c2 Mirror 16: 0xc1edc4c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000477 1768547410.223162 write 0x018814 thru 0x0280da (0xf8c7 bytes) 000480 1768547410.302811 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa15b89d2 (stale) Mirror 6: 0xa15b89d2 (stale) Mirror 8: 0xa15b89d2 (stale) Mirror 9: 0xa15b89d2 (stale) Mirror 13: 0xa15b89d2 (stale) Mirror 14: 0x8fe79501 (stale) Mirror 15: 0xf4f79df2 (stale) Mirror 16: 0xc1edc4c2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd6c8dfb9 Mirror 17: 0xd6c8dfb9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000484 1768547411.383816 read 0x012cb3 thru 0x021d8d (0xf0db bytes) 000485 1768547411.398033 write 0x0335df thru 0x033af2 (0x514 bytes) 000487 1768547411.480264 mapwrite 0x00cf0c thru 0x012759 (0x584e bytes) 000488 1768547411.536501 write 0x009630 thru 0x0098cc (0x29d bytes) 000489 1768547411.537683 read 0x0294c5 thru 0x02cc95 (0x37d1 bytes) 000490 1768547411.640472 read 0x027c42 thru 0x02900a (0x13c9 bytes) 000491 1768547411.659531 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa15b89d2 (stale) Mirror 8: 0xa15b89d2 (stale) Mirror 9: 0xa15b89d2 (stale) Mirror 13: 0xa15b89d2 (stale) Mirror 14: 0x8fe79501 (stale) Mirror 15: 0xf4f79df2 (stale) Mirror 16: 0xc1edc4c2 (stale) Mirror 17: 0xd6c8dfb9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa15b89d2 (stale) Mirror 8: 0xa15b89d2 (stale) Mirror 9: 0xa15b89d2 (stale) Mirror 13: 0xa15b89d2 (stale) Mirror 14: 0x8fe79501 (stale) Mirror 15: 0xf4f79df2 (stale) Mirror 16: 0xc1edc4c2 (stale) Mirror 17: 0xd6c8dfb9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000493 1768547412.941011 mapwrite 0x034be5 thru 0x0354c2 (0x8de bytes) 000495 1768547413.182385 read 0x005402 thru 0x01307b (0xdc7a bytes) 000498 1768547413.229066 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa15b89d2 (stale) Mirror 8: 0xa15b89d2 (stale) Mirror 9: 0xa15b89d2 (stale) Mirror 13: 0xa15b89d2 (stale) Mirror 14: 0x8fe79501 (stale) Mirror 15: 0xf4f79df2 (stale) Mirror 16: 0xc1edc4c2 (stale) Mirror 17: 0xd6c8dfb9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3598930d Mirror 18: 0x3598930d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000499 1768547415.017537 write 0x000ef2 thru 0x007af7 (0x6c06 bytes) 000501 1768547415.132111 trunc from 0x040000 to 0x034ce5 (0xb31a bytes) 000502 1768547415.155257 write 0x016958 thru 0x0185dd (0x1c86 bytes) 000504 1768547415.169218 write 0x03248c thru 0x03ba31 (0x95a6 bytes) 000505 1768547415.187012 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ba32): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba32): Mirror 6: 0x9099982c (stale) Mirror 8: 0x9099982c (stale) Mirror 9: 0x9099982c (stale) Mirror 13: 0x9099982c (stale) Mirror 14: 0x27323d43 (stale) Mirror 15: 0x9d3e0a90 (stale) Mirror 16: 0x86282b51 (stale) Mirror 17: 0x2ccc1a44 (stale) Mirror 18: 0x14b85e6 (stale) CRC-32 checksum value for chunk [0, 0x3ba32): Mirror 1: 0xa91a573c Mirror 19: 0xa91a573c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba32: skipped 000506 1768547416.349961 mapwrite 0x009658 thru 0x00cf1a (0x38c3 bytes) 000508 1768547416.493634 mapwrite 0x003289 thru 0x00e858 (0xb5d0 bytes) 000510 1768547416.559527 write 0x016bad thru 0x02014b (0x959f bytes) 000511 1768547416.569872 read 0x01fbe1 thru 0x02f2b5 (0xf6d5 bytes) 000512 1768547416.578708 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3ba32): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba32): Mirror 6: 0x9099982c (stale) Mirror 8: 0x9099982c (stale) Mirror 9: 0x9099982c (stale) Mirror 13: 0x9099982c (stale) Mirror 14: 0x27323d43 (stale) Mirror 15: 0x9d3e0a90 (stale) Mirror 16: 0x86282b51 (stale) Mirror 17: 0x2ccc1a44 (stale) Mirror 18: 0x14b85e6 (stale) Mirror 19: 0xa91a573c (stale) CRC-32 checksum value for chunk [0, 0x3ba32): Mirror 1: 0x5c11dfba Mirror 20: 0x5c11dfba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba32: skipped 000513 1768547417.985728 read 0x020ddb thru 0x030972 (0xfb98 bytes) 000514 1768547418.010753 mapread 0x02fbd5 thru 0x036c11 (0x703d bytes) 000515 1768547418.089971 write 0x02da16 thru 0x02e551 (0xb3c bytes) 000516 1768547418.294242 write 0x033f90 thru 0x03672f (0x27a0 bytes) 000517 1768547418.310006 write 0x038900 thru 0x03ffff (0x7700 bytes) 000520 1768547418.344514 read 0x014152 thru 0x01604d (0x1efc bytes) 000521 1768547418.363027 write 0x00dbcd thru 0x01c698 (0xeacc bytes) 000522 1768547418.371312 mapwrite 0x0166f3 thru 0x01e08b (0x7999 bytes) 000524 1768547418.549875 mapwrite 0x01ba6a thru 0x02916c (0xd703 bytes) 000525 1768547418.771357 trunc from 0x040000 to 0x00c057 (0x33fa8 bytes) 000526 1768547418.925163 read 0x0026c3 thru 0x00b4f0 (0x8e2e bytes) 000528 1768547418.931960 mapread 0x00ba15 thru 0x00c057 (0x643 bytes) 000529 1768547418.934009 mapwrite 0x01ebf6 thru 0x026c71 (0x807c bytes) 000533 1768547419.061538 mapread 0x00b5d7 thru 0x0194a6 (0xded0 bytes) 000534 1768547419.062477 write 0x037d87 thru 0x03ffff (0x8279 bytes) 000536 1768547419.073005 mapwrite 0x0117c1 thru 0x018ae0 (0x7320 bytes) 000538 1768547419.325934 MIRROR_RESYNC 12 mirrors 000539 1768547422.360635 MIRROR_RESYNC 12 mirrors 000541 1768547424.426148 mapwrite 0x0188f1 thru 0x01d8c3 (0x4fd3 bytes) 000543 1768547424.913894 write 0x0076e7 thru 0x007865 (0x17f bytes) 000544 1768547424.944603 write 0x00edbd thru 0x01509b (0x62df bytes) 000545 1768547424.977782 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2a206acb (stale) Mirror 8: 0x2a206acb (stale) Mirror 9: 0x2a206acb (stale) Mirror 13: 0x2a206acb (stale) Mirror 14: 0x2a206acb (stale) Mirror 15: 0x2a206acb (stale) Mirror 16: 0x2a206acb (stale) Mirror 17: 0x2a206acb (stale) Mirror 18: 0x2a206acb (stale) Mirror 19: 0x2a206acb (stale) Mirror 20: 0x2a206acb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x686e69ea Mirror 21: 0x686e69ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000547 1768547428.652447 trunc from 0x040000 to 0x00abc5 (0x3543a bytes) 000548 1768547428.981888 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xabc6): Mirror 6: 0xae761fcb (stale) Mirror 8: 0xae761fcb (stale) Mirror 9: 0xae761fcb (stale) Mirror 13: 0xae761fcb (stale) Mirror 14: 0xae761fcb (stale) Mirror 15: 0xae761fcb (stale) Mirror 16: 0xae761fcb (stale) Mirror 18: 0xae761fcb (stale) Mirror 19: 0xae761fcb (stale) Mirror 20: 0xae761fcb (stale) Mirror 21: 0xc14c15a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xabc6): Mirror 6: 0xae761fcb (stale) Mirror 8: 0xae761fcb (stale) Mirror 9: 0xae761fcb (stale) Mirror 13: 0xae761fcb (stale) Mirror 14: 0xae761fcb (stale) Mirror 15: 0xae761fcb (stale) Mirror 16: 0xae761fcb (stale) Mirror 18: 0xae761fcb (stale) Mirror 19: 0xae761fcb (stale) Mirror 20: 0xae761fcb (stale) Mirror 21: 0xc14c15a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xabc6: skipped 000550 1768547430.433993 mapwrite 0x008376 thru 0x00df31 (0x5bbc bytes) 000551 1768547430.696514 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xdf32): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdf32): Mirror 6: 0x9574237 (stale) Mirror 8: 0x9574237 (stale) Mirror 9: 0x9574237 (stale) Mirror 13: 0x9574237 (stale) Mirror 14: 0x9574237 (stale) Mirror 15: 0x9574237 (stale) Mirror 16: 0x9574237 (stale) Mirror 18: 0x9574237 (stale) Mirror 19: 0x9574237 (stale) Mirror 20: 0x9574237 (stale) Mirror 21: 0x81c39a23 (stale) CRC-32 checksum value for chunk [0, 0xdf32): Mirror 1: 0xb1e6be60 Mirror 22: 0xb1e6be60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdf32: skipped 000556 1768547433.440882 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0xdf32): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdf32): Mirror 6: 0x9574237 (stale) Mirror 8: 0x9574237 (stale) Mirror 9: 0x9574237 (stale) Mirror 13: 0x9574237 (stale) Mirror 14: 0x9574237 (stale) Mirror 15: 0x9574237 (stale) Mirror 16: 0x9574237 (stale) Mirror 18: 0x9574237 (stale) Mirror 19: 0x9574237 (stale) Mirror 20: 0x9574237 (stale) Mirror 21: 0x81c39a23 (stale) CRC-32 checksum value for chunk [0, 0xdf32): Mirror 1: 0xb1e6be60 Mirror 22: 0xb1e6be60 Mirror 23: 0xb1e6be60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdf32: skipped 000557 1768547435.833813 trunc from 0x00df32 to 0x026283 (0x18352 bytes) 000558 1768547436.080258 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26284): Mirror 6: 0x153d12ba (stale) Mirror 8: 0x153d12ba (stale) Mirror 9: 0x153d12ba (stale) Mirror 13: 0x153d12ba (stale) Mirror 14: 0x153d12ba (stale) Mirror 15: 0x153d12ba (stale) Mirror 16: 0x153d12ba (stale) Mirror 18: 0x153d12ba (stale) Mirror 19: 0x153d12ba (stale) Mirror 20: 0x153d12ba (stale) Mirror 21: 0x9878bbd6 (stale) Mirror 23: 0x62796eaa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26284): Mirror 6: 0x153d12ba (stale) Mirror 8: 0x153d12ba (stale) Mirror 9: 0x153d12ba (stale) Mirror 13: 0x153d12ba (stale) Mirror 14: 0x153d12ba (stale) Mirror 15: 0x153d12ba (stale) Mirror 16: 0x153d12ba (stale) Mirror 18: 0x153d12ba (stale) Mirror 19: 0x153d12ba (stale) Mirror 20: 0x153d12ba (stale) Mirror 21: 0x9878bbd6 (stale) Mirror 23: 0x62796eaa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26284: skipped 000559 1768547437.680783 trunc from 0x026284 to 0x02c098 (0x5e15 bytes) 000560 1768547437.741028 read 0x02b27a thru 0x02c098 (0xe1f bytes) 000562 1768547437.772877 read 0x00e2d3 thru 0x00fe73 (0x1ba1 bytes) 000563 1768547437.810504 mapread 0x0109d4 thru 0x0113c0 (0x9ed bytes) 000564 1768547437.816761 read 0x01e34d thru 0x025005 (0x6cb9 bytes) 000566 1768547437.827769 mapwrite 0x00c74a thru 0x00fc07 (0x34be bytes) 000569 1768547437.973709 trunc from 0x02c099 to 0x017579 (0x14b1f bytes) 000570 1768547438.045892 read 0x00002c thru 0x006879 (0x684e bytes) 000577 1768547438.065809 mapwrite 0x00a2fd thru 0x013d94 (0x9a98 bytes) 000581 1768547438.397218 mapread 0x015446 thru 0x017579 (0x2134 bytes) 000583 1768547438.398495 mapread 0x012919 thru 0x017579 (0x4c61 bytes) 000584 1768547438.417013 mapread 0x003a9b thru 0x013703 (0xfc69 bytes) 000586 1768547438.418379 trunc from 0x01757a to 0x0194a3 (0x1f2a bytes) 000588 1768547438.469317 mapread 0x01014b thru 0x014bf9 (0x4aaf bytes) 000589 1768547438.470167 trunc from 0x0194a4 to 0x026d20 (0xd87d bytes) 000590 1768547438.507502 write 0x0324e6 thru 0x032f98 (0xab3 bytes) 000592 1768547438.520097 mapread 0x0287e1 thru 0x032f98 (0xa7b8 bytes) 000593 1768547438.564373 read 0x03141b thru 0x032f98 (0x1b7e bytes) 000598 1768547438.566654 trunc from 0x032f99 to 0x039f81 (0x6fe9 bytes) 000600 1768547438.605528 read 0x000871 thru 0x00a214 (0x99a4 bytes) 000601 1768547438.606186 mapread 0x014970 thru 0x01db1f (0x91b0 bytes) 000602 1768547438.607174 write 0x01886c thru 0x01a4d0 (0x1c65 bytes) 000603 1768547438.633144 read 0x01ad31 thru 0x024e32 (0xa102 bytes) 000604 1768547438.633901 write 0x02fad0 thru 0x03e12a (0xe65b bytes) 000605 1768547438.674924 MIRROR_RESYNC 13 mirrors 000606 1768547443.513446 read 0x026b46 thru 0x026bd0 (0x8b bytes) 000608 1768547443.521651 write 0x01538c thru 0x01c965 (0x75da bytes) 000609 1768547443.789481 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e12b): Mirror 6: 0x74e3599f (stale) Mirror 8: 0x74e3599f (stale) Mirror 9: 0x74e3599f (stale) Mirror 13: 0x74e3599f (stale) Mirror 15: 0x74e3599f (stale) Mirror 16: 0x74e3599f (stale) Mirror 18: 0x74e3599f (stale) Mirror 19: 0x74e3599f (stale) Mirror 20: 0x74e3599f (stale) Mirror 21: 0x74e3599f (stale) Mirror 23: 0x74e3599f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e12b): Mirror 6: 0x74e3599f (stale) Mirror 8: 0x74e3599f (stale) Mirror 9: 0x74e3599f (stale) Mirror 13: 0x74e3599f (stale) Mirror 15: 0x74e3599f (stale) Mirror 16: 0x74e3599f (stale) Mirror 18: 0x74e3599f (stale) Mirror 19: 0x74e3599f (stale) Mirror 20: 0x74e3599f (stale) Mirror 21: 0x74e3599f (stale) Mirror 23: 0x74e3599f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e12b: skipped 000610 1768547445.172857 trunc from 0x03e12b to 0x03abd6 (0x3554 bytes) 000611 1768547445.205260 read 0x030118 thru 0x03abd6 (0xaabf bytes) 000612 1768547445.219892 read 0x0134eb thru 0x01832c (0x4e42 bytes) 000613 1768547445.253468 write 0x029734 thru 0x0322ce (0x8b9b bytes) 000614 1768547445.256804 trunc from 0x03abd7 to 0x035dcc (0x4e0a bytes) 000615 1768547445.323981 read 0x02d79e thru 0x035cfe (0x8561 bytes) 000618 1768547445.325449 mapread 0x0009fc thru 0x009304 (0x8909 bytes) 000619 1768547445.326319 write 0x00be3f thru 0x0193fa (0xd5bc bytes) 000621 1768547445.357246 write 0x003d2e thru 0x00e797 (0xaa6a bytes) 000622 1768547445.359919 write 0x03ce8b thru 0x03ffff (0x3175 bytes) 000623 1768547445.378253 mapwrite 0x013503 thru 0x01fa8e (0xc58c bytes) 000624 1768547445.844026 mapwrite 0x035245 thru 0x03d716 (0x84d2 bytes) 000625 1768547446.114725 trunc from 0x040000 to 0x0236a2 (0x1c95d bytes) 000626 1768547446.147742 trunc from 0x0236a3 to 0x025de7 (0x2745 bytes) 000627 1768547446.231914 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x25de8): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25de8): Mirror 6: 0xb51417f0 (stale) Mirror 8: 0xb51417f0 (stale) Mirror 9: 0xb51417f0 (stale) Mirror 13: 0xb51417f0 (stale) Mirror 15: 0xb51417f0 (stale) Mirror 16: 0xb51417f0 (stale) Mirror 18: 0xb51417f0 (stale) Mirror 19: 0xb51417f0 (stale) Mirror 20: 0xb51417f0 (stale) Mirror 21: 0xb51417f0 (stale) Mirror 23: 0xb51417f0 (stale) CRC-32 checksum value for chunk [0, 0x25de8): Mirror 1: 0x47165f5d Mirror 24: 0x47165f5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25de8: skipped 000629 1768547449.038157 read 0x01ff08 thru 0x025de7 (0x5ee0 bytes) 000630 1768547449.052032 read 0x00446c thru 0x00fb44 (0xb6d9 bytes) 000631 1768547449.081820 mapread 0x01db89 thru 0x0223ca (0x4842 bytes) 000632 1768547449.095732 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x25de8): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25de8): Mirror 6: 0xb51417f0 (stale) Mirror 8: 0xb51417f0 (stale) Mirror 9: 0xb51417f0 (stale) Mirror 13: 0xb51417f0 (stale) Mirror 15: 0xb51417f0 (stale) Mirror 16: 0xb51417f0 (stale) Mirror 18: 0xb51417f0 (stale) Mirror 19: 0xb51417f0 (stale) Mirror 20: 0xb51417f0 (stale) Mirror 21: 0xb51417f0 (stale) Mirror 23: 0xb51417f0 (stale) CRC-32 checksum value for chunk [0, 0x25de8): Mirror 1: 0x47165f5d Mirror 24: 0x47165f5d Mirror 25: 0x47165f5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25de8: skipped 000634 1768547451.976778 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25de8): Mirror 6: 0xb51417f0 (stale) Mirror 8: 0xb51417f0 (stale) Mirror 9: 0xb51417f0 (stale) Mirror 13: 0xb51417f0 (stale) Mirror 15: 0xb51417f0 (stale) Mirror 16: 0xb51417f0 (stale) Mirror 18: 0xb51417f0 (stale) Mirror 19: 0xb51417f0 (stale) Mirror 21: 0xb51417f0 (stale) Mirror 23: 0xb51417f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25de8): Mirror 6: 0xb51417f0 (stale) Mirror 8: 0xb51417f0 (stale) Mirror 9: 0xb51417f0 (stale) Mirror 13: 0xb51417f0 (stale) Mirror 15: 0xb51417f0 (stale) Mirror 16: 0xb51417f0 (stale) Mirror 18: 0xb51417f0 (stale) Mirror 19: 0xb51417f0 (stale) Mirror 21: 0xb51417f0 (stale) Mirror 23: 0xb51417f0 (stale) CRC-32 checksum value for chunk [0, 0x25de8): Mirror 1: 0x47165f5d Mirror 24: 0x47165f5d Mirror 25: 0x47165f5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25de8: skipped 000637 1768547453.741743 read 0x00bd60 thru 0x014c5c (0x8efd bytes) 000638 1768547453.779868 mapread 0x00802d thru 0x016609 (0xe5dd bytes) 000639 1768547453.890819 write 0x003724 thru 0x00ddc2 (0xa69f bytes) 000643 1768547454.208010 write 0x03083c thru 0x03a07a (0x983f bytes) 000646 1768547454.229616 trunc from 0x03a07b to 0x01c68a (0x1d9f0 bytes) 000647 1768547454.332205 write 0x035d7c thru 0x03ffff (0xa284 bytes) 000652 1768547454.353216 read 0x03987c thru 0x03c7eb (0x2f70 bytes) 000653 1768547454.384689 MIRROR_RESYNC 13 mirrors 000658 1768547457.922008 trunc from 0x040000 to 0x015367 (0x2ac98 bytes) 000659 1768547457.996337 MIRROR_RESYNC 13 mirrors 000660 1768547460.501794 mapwrite 0x02d7fa thru 0x037c16 (0xa41d bytes) 000661 1768547460.859526 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x37c17): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c17): Mirror 6: 0xd3244905 (stale) Mirror 8: 0xd3244905 (stale) Mirror 9: 0xd3244905 (stale) Mirror 13: 0xd3244905 (stale) Mirror 15: 0xd3244905 (stale) Mirror 16: 0xd3244905 (stale) Mirror 18: 0xd3244905 (stale) Mirror 19: 0xd3244905 (stale) Mirror 21: 0xd3244905 (stale) Mirror 23: 0xd3244905 (stale) Mirror 24: 0xd3244905 (stale) Mirror 25: 0xd3244905 (stale) CRC-32 checksum value for chunk [0, 0x37c17): Mirror 1: 0xecbee76c Mirror 26: 0xecbee76c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c17: skipped 000663 1768547462.123454 read 0x018191 thru 0x01c358 (0x41c8 bytes) 000664 1768547462.139346 read 0x01e088 thru 0x02891c (0xa895 bytes) 000665 1768547462.164643 mapwrite 0x0128ed thru 0x0181c8 (0x58dc bytes) 000666 1768547462.472104 trunc from 0x037c17 to 0x00547a (0x3279c bytes) 000667 1768547462.495812 trunc from 0x00547b to 0x02bdb3 (0x26939 bytes) 000668 1768547462.516264 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2bdb4): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bdb4): Mirror 6: 0x98530d03 (stale) Mirror 8: 0x98530d03 (stale) Mirror 9: 0x98530d03 (stale) Mirror 13: 0x98530d03 (stale) Mirror 15: 0x98530d03 (stale) Mirror 16: 0x98530d03 (stale) Mirror 18: 0x98530d03 (stale) Mirror 19: 0x98530d03 (stale) Mirror 21: 0x98530d03 (stale) Mirror 23: 0x98530d03 (stale) Mirror 24: 0x98530d03 (stale) Mirror 25: 0x98530d03 (stale) Mirror 26: 0x98530d03 (stale) CRC-32 checksum value for chunk [0, 0x2bdb4): Mirror 1: 0xa34e3926 Mirror 27: 0xa34e3926 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bdb4: skipped 000669 1768547463.894936 trunc from 0x02bdb4 to 0x026eef (0x4ec4 bytes) 000672 1768547464.068650 mapwrite 0x0034ec thru 0x006df1 (0x3906 bytes) 000673 1768547464.222923 mapread 0x01ca2c thru 0x026eef (0xa4c4 bytes) 000675 1768547464.255934 mapread 0x026630 thru 0x026eef (0x8c0 bytes) 000676 1768547464.256774 write 0x0249d8 thru 0x02ecdd (0xa306 bytes) 000677 1768547464.259799 read 0x01bf83 thru 0x02abfb (0xec79 bytes) 000678 1768547464.260439 read 0x006bf6 thru 0x008ec0 (0x22cb bytes) 000680 1768547464.261466 read 0x01fcb6 thru 0x02049b (0x7e6 bytes) 000682 1768547464.272353 mapwrite 0x02d703 thru 0x02ebf6 (0x14f4 bytes) 000683 1768547464.351632 mapwrite 0x016e43 thru 0x01d72f (0x68ed bytes) 000684 1768547464.469108 read 0x00fb17 thru 0x0122bf (0x27a9 bytes) 000685 1768547464.482596 mapwrite 0x028186 thru 0x02d5b0 (0x542b bytes) 000686 1768547464.623291 mapwrite 0x01b726 thru 0x029a01 (0xe2dc bytes) 000687 1768547464.786320 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2ecde): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ecde): Mirror 6: 0x1e93008e (stale) Mirror 8: 0x1e93008e (stale) Mirror 9: 0x1e93008e (stale) Mirror 13: 0x1e93008e (stale) Mirror 15: 0x1e93008e (stale) Mirror 16: 0x1e93008e (stale) Mirror 18: 0x1e93008e (stale) Mirror 19: 0x1e93008e (stale) Mirror 21: 0x1e93008e (stale) Mirror 23: 0x1e93008e (stale) Mirror 24: 0x1e93008e (stale) Mirror 25: 0x1e93008e (stale) Mirror 26: 0x27a5bafa (stale) Mirror 27: 0x59424fc6 (stale) CRC-32 checksum value for chunk [0, 0x2ecde): Mirror 1: 0xfd6e0ca7 Mirror 28: 0xfd6e0ca7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ecde: skipped 000689 1768547467.101846 mapread 0x00c8c7 thru 0x010551 (0x3c8b bytes) 000691 1768547467.199757 trunc from 0x02ecde to 0x037f6b (0x928e bytes) 000694 1768547467.378428 trunc from 0x037f6c to 0x03967c (0x1711 bytes) 000695 1768547467.408376 mapread 0x037760 thru 0x03967c (0x1f1d bytes) 000696 1768547467.419087 mapwrite 0x0205cb thru 0x021e72 (0x18a8 bytes) 000697 1768547467.468650 read 0x018956 thru 0x023ca1 (0xb34c bytes) 000698 1768547467.475542 mapread 0x02b2cc thru 0x033807 (0x853c bytes) 000700 1768547467.485497 write 0x00c21a thru 0x011be8 (0x59cf bytes) 000701 1768547467.497403 mapread 0x019bff thru 0x02902d (0xf42f bytes) 000702 1768547467.498295 write 0x019878 thru 0x022f7d (0x9706 bytes) 000703 1768547467.524778 write 0x01bd4d thru 0x020682 (0x4936 bytes) 000705 1768547467.526613 write 0x03ca10 thru 0x03ffff (0x35f0 bytes) 000708 1768547467.534833 mapwrite 0x039be6 thru 0x03ffff (0x641a bytes) 000709 1768547467.641494 read 0x007beb thru 0x016940 (0xed56 bytes) 000711 1768547467.652948 trunc from 0x040000 to 0x024901 (0x1b6fe bytes) 000712 1768547467.679024 read 0x01b0e8 thru 0x024901 (0x981a bytes) 000714 1768547467.681052 trunc from 0x024902 to 0x01f9de (0x4f23 bytes) 000716 1768547467.691072 mapwrite 0x00fa94 thru 0x01f924 (0xfe91 bytes) 000721 1768547467.728680 mapread 0x000831 thru 0x00b930 (0xb100 bytes) 000722 1768547467.729774 mapwrite 0x00d8fe thru 0x0101f4 (0x28f7 bytes) 000726 1768547467.776451 mapwrite 0x0224df thru 0x02ee55 (0xc977 bytes) 000730 1768547467.841098 mapwrite 0x01b92d thru 0x01cd35 (0x1409 bytes) 000733 1768547467.867509 write 0x014a08 thru 0x022707 (0xdd00 bytes) 000734 1768547467.869293 mapwrite 0x013238 thru 0x01b0ae (0x7e77 bytes) 000735 1768547467.910735 MIRROR_RESYNC 16 mirrors 000737 1768547471.647016 mapread 0x02950e thru 0x02ee55 (0x5948 bytes) 000738 1768547471.665002 mapwrite 0x020a1e thru 0x024d0d (0x42f0 bytes) 000742 1768547471.832972 mapwrite 0x02a39f thru 0x02adc5 (0xa27 bytes) 000743 1768547471.906385 read 0x02de9b thru 0x02ee55 (0xfbb bytes) 000745 1768547471.908440 read 0x006358 thru 0x00d889 (0x7532 bytes) 000750 1768547471.922761 trunc from 0x02ee56 to 0x035997 (0x6b42 bytes) 000751 1768547471.948399 trunc from 0x035998 to 0x014250 (0x21747 bytes) 000754 1768547471.971000 trunc from 0x014251 to 0x031cbe (0x1da6e bytes) 000755 1768547471.994923 mapread 0x010e6e thru 0x01f4dc (0xe66f bytes) 000756 1768547472.089760 write 0x0306e1 thru 0x030c72 (0x592 bytes) 000758 1768547472.091073 read 0x0116bf thru 0x01e0f6 (0xca38 bytes) 000760 1768547472.092322 read 0x001159 thru 0x004a5b (0x3903 bytes) 000762 1768547472.093073 read 0x02f917 thru 0x031cbe (0x23a8 bytes) 000763 1768547472.098410 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31cbf): Mirror 6: 0xf184eb99 (stale) Mirror 9: 0xf184eb99 (stale) Mirror 13: 0xf184eb99 (stale) Mirror 15: 0xf184eb99 (stale) Mirror 16: 0xf184eb99 (stale) Mirror 18: 0xf184eb99 (stale) Mirror 19: 0xf184eb99 (stale) Mirror 21: 0xf184eb99 (stale) Mirror 23: 0xf184eb99 (stale) Mirror 24: 0xf184eb99 (stale) Mirror 25: 0xf184eb99 (stale) Mirror 26: 0xf184eb99 (stale) Mirror 27: 0xf184eb99 (stale) Mirror 28: 0xf184eb99 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31cbf): Mirror 6: 0xf184eb99 (stale) Mirror 9: 0xf184eb99 (stale) Mirror 13: 0xf184eb99 (stale) Mirror 15: 0xf184eb99 (stale) Mirror 16: 0xf184eb99 (stale) Mirror 18: 0xf184eb99 (stale) Mirror 19: 0xf184eb99 (stale) Mirror 21: 0xf184eb99 (stale) Mirror 23: 0xf184eb99 (stale) Mirror 24: 0xf184eb99 (stale) Mirror 25: 0xf184eb99 (stale) Mirror 26: 0xf184eb99 (stale) Mirror 27: 0xf184eb99 (stale) Mirror 28: 0xf184eb99 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31cbf: skipped 000764 1768547472.977445 write 0x000c0d thru 0x008661 (0x7a55 bytes) 000765 1768547472.991179 trunc from 0x031cbf to 0x0014c1 (0x307fd bytes) 000766 1768547473.013718 mapwrite 0x022cad thru 0x027590 (0x48e4 bytes) 000767 1768547473.132261 mapwrite 0x029642 thru 0x02d2ad (0x3c6c bytes) 000769 1768547473.260015 MIRROR_RESYNC 15 mirrors 000770 1768547476.029725 read 0x00ec3e thru 0x0158e6 (0x6ca9 bytes) 000771 1768547476.037066 read 0x02772b thru 0x02d2ad (0x5b83 bytes) 000774 1768547476.045664 mapwrite 0x01ab10 thru 0x02aa72 (0xff63 bytes) 000775 1768547476.237171 trunc from 0x02d2ae to 0x031cea (0x4a3d bytes) 000777 1768547476.249591 trunc from 0x031ceb to 0x027e27 (0x9ec3 bytes) 000778 1768547476.261150 mapread 0x0103d5 thru 0x01bade (0xb70a bytes) 000779 1768547476.291686 trunc from 0x027e28 to 0x006065 (0x21dc2 bytes) 000780 1768547476.301704 mapread 0x00325d thru 0x0038dc (0x680 bytes) 000784 1768547476.314843 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x6066): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6066): Mirror 6: 0xf8ce1ca8 (stale) Mirror 9: 0xf8ce1ca8 (stale) Mirror 13: 0xf8ce1ca8 (stale) Mirror 15: 0xf8ce1ca8 (stale) Mirror 16: 0xf8ce1ca8 (stale) Mirror 18: 0xf8ce1ca8 (stale) Mirror 19: 0xf8ce1ca8 (stale) Mirror 21: 0xf8ce1ca8 (stale) Mirror 23: 0xf8ce1ca8 (stale) Mirror 24: 0xf8ce1ca8 (stale) Mirror 25: 0xf8ce1ca8 (stale) Mirror 26: 0xf8ce1ca8 (stale) Mirror 27: 0xf8ce1ca8 (stale) Mirror 28: 0xf8ce1ca8 (stale) CRC-32 checksum value for chunk [0, 0x6066): Mirror 1: 0xf8ce1ca8 Mirror 29: 0xf8ce1ca8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6066: skipped 000786 1768547477.036183 mapread 0x004347 thru 0x006065 (0x1d1f bytes) 000787 1768547477.051521 mapwrite 0x035708 thru 0x03e32b (0x8c24 bytes) 000788 1768547477.173010 mapwrite 0x037539 thru 0x03ffff (0x8ac7 bytes) 000789 1768547477.278085 mapread 0x035288 thru 0x036ff9 (0x1d72 bytes) 000790 1768547477.278861 mapread 0x0090fe thru 0x00db7b (0x4a7e bytes) 000791 1768547477.284461 mapwrite 0x033285 thru 0x039be5 (0x6961 bytes) 000793 1768547477.310024 read 0x02a1e1 thru 0x03716b (0xcf8b bytes) 000794 1768547477.313886 mapwrite 0x02e707 thru 0x02e792 (0x8c bytes) 000795 1768547477.344349 mapread 0x033589 thru 0x039c29 (0x66a1 bytes) 000796 1768547477.345335 write 0x013c2f thru 0x01eb73 (0xaf45 bytes) 000798 1768547477.364238 mapwrite 0x0111b4 thru 0x0190a8 (0x7ef5 bytes) 000800 1768547477.463543 mapread 0x00292a thru 0x004dc6 (0x249d bytes) 000803 1768547477.468389 write 0x002216 thru 0x00dd46 (0xbb31 bytes) 000804 1768547477.471145 mapwrite 0x031fb2 thru 0x0371f4 (0x5243 bytes) 000805 1768547477.523595 mapread 0x03b4e6 thru 0x03df65 (0x2a80 bytes) 000807 1768547477.525360 mapwrite 0x03744f thru 0x03ac31 (0x37e3 bytes) 000808 1768547477.589521 read 0x006c77 thru 0x0070c6 (0x450 bytes) 000812 1768547477.591424 write 0x01720e thru 0x018405 (0x11f8 bytes) 000814 1768547477.597353 read 0x014447 thru 0x02337a (0xef34 bytes) 000816 1768547477.615278 write 0x029790 thru 0x032def (0x9660 bytes) 000819 1768547477.618588 read 0x0177a7 thru 0x020cb8 (0x9512 bytes) 000821 1768547477.620249 mapwrite 0x001ff3 thru 0x00b167 (0x9175 bytes) 000823 1768547477.753211 mapread 0x024a35 thru 0x02dfe1 (0x95ad bytes) 000824 1768547477.762973 MIRROR_RESYNC 16 mirrors 000825 1768547479.852237 mapread 0x015b2b thru 0x020574 (0xaa4a bytes) 000827 1768547479.893709 write 0x01bde6 thru 0x02b936 (0xfb51 bytes) 000830 1768547480.009524 write 0x02a3c5 thru 0x0339f8 (0x9634 bytes) 000833 1768547480.017877 write 0x03b927 thru 0x03ffff (0x46d9 bytes) 000834 1768547480.028246 write 0x032dbd thru 0x038359 (0x559d bytes) 000837 1768547480.035756 MIRROR_RESYNC 16 mirrors 000838 1768547482.063724 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) 000839 1768547482.578090 read 0x00b2ac thru 0x00d786 (0x24db bytes) 000841 1768547482.593038 MIRROR_RESYNC 15 mirrors 000844 1768547483.628195 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) 000845 1768547484.211643 mapread 0x00c52b thru 0x011054 (0x4b2a bytes) 000847 1768547484.267480 mapwrite 0x02532f thru 0x03500b (0xfcdd bytes) 000849 1768547484.522144 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3108ecaf (stale) Mirror 15: 0x3108ecaf (stale) Mirror 16: 0x3108ecaf (stale) Mirror 18: 0x3108ecaf (stale) Mirror 19: 0x3108ecaf (stale) Mirror 21: 0x3108ecaf (stale) Mirror 23: 0x3108ecaf (stale) Mirror 24: 0x3108ecaf (stale) Mirror 25: 0x3108ecaf (stale) Mirror 26: 0x3108ecaf (stale) Mirror 28: 0x3108ecaf (stale) Mirror 29: 0x3108ecaf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3108ecaf (stale) Mirror 15: 0x3108ecaf (stale) Mirror 16: 0x3108ecaf (stale) Mirror 18: 0x3108ecaf (stale) Mirror 19: 0x3108ecaf (stale) Mirror 21: 0x3108ecaf (stale) Mirror 23: 0x3108ecaf (stale) Mirror 24: 0x3108ecaf (stale) Mirror 25: 0x3108ecaf (stale) Mirror 26: 0x3108ecaf (stale) Mirror 28: 0x3108ecaf (stale) Mirror 29: 0x3108ecaf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000851 1768547485.199601 mapread 0x02c181 thru 0x02d98b (0x180b bytes) 000852 1768547485.210167 write 0x0272ba thru 0x02e7d0 (0x7517 bytes) 000853 1768547485.219136 write 0x02afd1 thru 0x02f3e1 (0x4411 bytes) 000854 1768547485.220368 trunc from 0x040000 to 0x033a9d (0xc562 bytes) 000855 1768547485.238266 mapwrite 0x0049b2 thru 0x00e766 (0x9db5 bytes) 000856 1768547485.306990 mapwrite 0x036f94 thru 0x03799a (0xa07 bytes) 000857 1768547485.372089 mapwrite 0x027107 thru 0x02c842 (0x573c bytes) 000858 1768547485.423404 mapread 0x0032b5 thru 0x00b248 (0x7f94 bytes) 000859 1768547485.424927 mapwrite 0x0226b3 thru 0x025a20 (0x336e bytes) 000861 1768547485.473091 read 0x0112a6 thru 0x0127a6 (0x1501 bytes) 000863 1768547485.478540 trunc from 0x03799b to 0x022288 (0x15712 bytes) 000865 1768547485.497193 read 0x019e8c thru 0x022288 (0x83fd bytes) 000869 1768547485.507362 trunc from 0x022289 to 0x02de08 (0xbb80 bytes) 000872 1768547485.527012 mapwrite 0x019c0a thru 0x01cb34 (0x2f2b bytes) 000873 1768547485.567895 write 0x03fed0 thru 0x03ffff (0x130 bytes) 000874 1768547485.569200 read 0x01211a thru 0x01b36a (0x9251 bytes) 000875 1768547485.570095 trunc from 0x040000 to 0x01bb30 (0x244cf bytes) 000876 1768547485.594177 read 0x01806a thru 0x01bb30 (0x3ac7 bytes) 000877 1768547485.597632 trunc from 0x01bb31 to 0x030bd1 (0x150a1 bytes) 000880 1768547485.619892 trunc from 0x030bd2 to 0x003389 (0x2d848 bytes) 000881 1768547485.654597 mapwrite 0x00df8e thru 0x00fd78 (0x1deb bytes) 000882 1768547485.753392 write 0x01be51 thru 0x020fd0 (0x5180 bytes) 000884 1768547485.762454 MIRROR_RESYNC 13 mirrors 000885 1768547487.556798 mapread 0x0116a9 thru 0x0188d3 (0x722b bytes) 000886 1768547487.569389 read 0x01f740 thru 0x020fd0 (0x1891 bytes) 000887 1768547487.574517 trunc from 0x020fd1 to 0x01a5de (0x69f2 bytes) 000888 1768547487.674998 read 0x00dd7a thru 0x00ea00 (0xc87 bytes) 000889 1768547487.683094 mapread 0x001ec3 thru 0x00fc3c (0xdd7a bytes) 000890 1768547487.684064 mapwrite 0x01930e thru 0x01ad53 (0x1a46 bytes) 000891 1768547487.757145 write 0x02ea1d thru 0x031353 (0x2937 bytes) 000893 1768547487.762497 trunc from 0x031354 to 0x03b1e4 (0x9e91 bytes) 000895 1768547487.782458 MIRROR_RESYNC 13 mirrors 000897 1768547489.909713 read 0x00cb9f thru 0x0134f2 (0x6954 bytes) 000900 1768547489.918288 write 0x0050b7 thru 0x00dae5 (0x8a2f bytes) 000903 1768547490.141771 write 0x02a9d6 thru 0x039fc7 (0xf5f2 bytes) 000905 1768547490.172080 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3b1e5): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b1e5): Mirror 13: 0x83fce167 (stale) Mirror 15: 0x83fce167 (stale) Mirror 16: 0x83fce167 (stale) Mirror 18: 0x83fce167 (stale) Mirror 19: 0x83fce167 (stale) Mirror 21: 0x83fce167 (stale) Mirror 23: 0x83fce167 (stale) Mirror 24: 0x83fce167 (stale) Mirror 25: 0x83fce167 (stale) Mirror 26: 0x83fce167 (stale) Mirror 28: 0x83fce167 (stale) Mirror 29: 0x83fce167 (stale) CRC-32 checksum value for chunk [0, 0x3b1e5): Mirror 1: 0xe2544c9 Mirror 30: 0xe2544c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b1e5: skipped 000907 1768547491.522493 mapread 0x034940 thru 0x03b1e4 (0x68a5 bytes) 000909 1768547491.577322 read 0x023da3 thru 0x02d04c (0x92aa bytes) 000911 1768547491.605744 mapread 0x01d77c thru 0x01ea74 (0x12f9 bytes) 000912 1768547491.636538 mapwrite 0x023a2b thru 0x025362 (0x1938 bytes) 000913 1768547491.880408 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b1e5): Mirror 13: 0x83fce167 (stale) Mirror 15: 0x83fce167 (stale) Mirror 16: 0x83fce167 (stale) Mirror 18: 0x83fce167 (stale) Mirror 19: 0x83fce167 (stale) Mirror 23: 0x83fce167 (stale) Mirror 24: 0x83fce167 (stale) Mirror 25: 0x83fce167 (stale) Mirror 26: 0x83fce167 (stale) Mirror 28: 0x83fce167 (stale) Mirror 29: 0x83fce167 (stale) Mirror 30: 0xe2544c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b1e5): Mirror 13: 0x83fce167 (stale) Mirror 15: 0x83fce167 (stale) Mirror 16: 0x83fce167 (stale) Mirror 18: 0x83fce167 (stale) Mirror 19: 0x83fce167 (stale) Mirror 23: 0x83fce167 (stale) Mirror 24: 0x83fce167 (stale) Mirror 25: 0x83fce167 (stale) Mirror 26: 0x83fce167 (stale) Mirror 28: 0x83fce167 (stale) Mirror 29: 0x83fce167 (stale) Mirror 30: 0xe2544c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b1e5: skipped 000915 1768547492.629267 read 0x026146 thru 0x02846f (0x232a bytes) 000916 1768547492.636531 write 0x02b06a thru 0x0332e2 (0x8279 bytes) 000917 1768547492.652082 mapwrite 0x027cc8 thru 0x028d01 (0x103a bytes) 000918 1768547492.728900 MIRROR_RESYNC 13 mirrors 000920 1768547495.179041 mapread 0x0192ea thru 0x025e43 (0xcb5a bytes) 000922 1768547495.222279 mapwrite 0x01884d thru 0x0266e6 (0xde9a bytes) 000925 1768547495.478152 mapwrite 0x03acd6 thru 0x03b0ca (0x3f5 bytes) 000926 1768547495.515295 trunc from 0x03b1e5 to 0x028e74 (0x12370 bytes) 000927 1768547495.528113 read 0x024fdc thru 0x028e74 (0x3e99 bytes) 000929 1768547495.529718 mapread 0x00d181 thru 0x00f99f (0x281f bytes) 000930 1768547495.540312 write 0x035246 thru 0x03ffff (0xadba bytes) 000932 1768547495.543085 mapwrite 0x023abd thru 0x031b3b (0xe07f bytes) 000933 1768547495.631885 trunc from 0x040000 to 0x010d54 (0x2f2ab bytes) 000934 1768547495.662436 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x10d55): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10d55): Mirror 13: 0x447aa975 (stale) Mirror 15: 0x447aa975 (stale) Mirror 16: 0x447aa975 (stale) Mirror 18: 0x447aa975 (stale) Mirror 19: 0x447aa975 (stale) Mirror 23: 0x447aa975 (stale) Mirror 24: 0x447aa975 (stale) Mirror 25: 0x447aa975 (stale) Mirror 26: 0x447aa975 (stale) Mirror 28: 0x447aa975 (stale) Mirror 29: 0x447aa975 (stale) Mirror 30: 0x447aa975 (stale) CRC-32 checksum value for chunk [0, 0x10d55): Mirror 1: 0x447aa975 Mirror 31: 0x447aa975 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10d55: skipped 000935 1768547496.635540 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x10d55): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10d55): Mirror 13: 0x447aa975 (stale) Mirror 15: 0x447aa975 (stale) Mirror 16: 0x447aa975 (stale) Mirror 18: 0x447aa975 (stale) Mirror 19: 0x447aa975 (stale) Mirror 23: 0x447aa975 (stale) Mirror 24: 0x447aa975 (stale) Mirror 25: 0x447aa975 (stale) Mirror 26: 0x447aa975 (stale) Mirror 28: 0x447aa975 (stale) Mirror 29: 0x447aa975 (stale) Mirror 30: 0x447aa975 (stale) CRC-32 checksum value for chunk [0, 0x10d55): Mirror 1: 0x447aa975 Mirror 31: 0x447aa975 Mirror 32: 0x447aa975 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10d55: skipped 000937 1768547497.922934 mapwrite 0x0180d4 thru 0x020c29 (0x8b56 bytes) 000939 1768547498.142237 mapwrite 0x0026ea thru 0x01217b (0xfa92 bytes) 000942 1768547498.238261 read 0x0129fc thru 0x01e646 (0xbc4b bytes) 000943 1768547498.238833 trunc from 0x020c2a to 0x02bbc1 (0xaf98 bytes) 000944 1768547498.278016 mapwrite 0x02af4e thru 0x02f5d7 (0x468a bytes) 000949 1768547498.392207 trunc from 0x02f5d8 to 0x027fcd (0x760a bytes) 000950 1768547498.413446 mapwrite 0x01ef3b thru 0x023af2 (0x4bb8 bytes) 000951 1768547498.474385 write 0x0122ad thru 0x0158ff (0x3653 bytes) 000952 1768547498.475992 trunc from 0x027fce to 0x02c73c (0x476f bytes) 000954 1768547498.503445 MIRROR_RESYNC 15 mirrors 000955 1768547500.560829 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) 000957 1768547501.061948 mapread 0x0200f7 thru 0x02788e (0x7798 bytes) 000959 1768547501.081192 mapwrite 0x03f9c8 thru 0x03ffff (0x638 bytes) 000960 1768547501.324803 mapread 0x01aad2 thru 0x028533 (0xda62 bytes) 000961 1768547501.385741 mapwrite 0x02bf2d thru 0x037c22 (0xbcf6 bytes) 000963 1768547501.522924 read 0x0226c5 thru 0x02e824 (0xc160 bytes) 000964 1768547501.523618 mapread 0x020f9e thru 0x02d719 (0xc77c bytes) 000965 1768547501.524492 mapread 0x02d510 thru 0x03add6 (0xd8c7 bytes) 000967 1768547501.533525 trunc from 0x040000 to 0x00f70e (0x308f1 bytes) 000968 1768547501.593168 write 0x02c1d9 thru 0x035144 (0x8f6c bytes) 000970 1768547501.605452 mapwrite 0x01d54f thru 0x02b940 (0xe3f2 bytes) 000971 1768547501.792403 read 0x011840 thru 0x019bb7 (0x8378 bytes) 000972 1768547501.864632 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x2da:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35145): Mirror 13: 0x5771a9fc (stale) Mirror 15: 0x5771a9fc (stale) Mirror 16: 0x5771a9fc (stale) Mirror 19: 0x5771a9fc (stale) Mirror 23: 0x5771a9fc (stale) Mirror 24: 0x5771a9fc (stale) Mirror 25: 0x5771a9fc (stale) Mirror 26: 0x5771a9fc (stale) Mirror 29: 0x5771a9fc (stale) Mirror 30: 0x5771a9fc (stale) Mirror 31: 0x5771a9fc (stale) Mirror 32: 0x5771a9fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35145): Mirror 13: 0x5771a9fc (stale) Mirror 15: 0x5771a9fc (stale) Mirror 16: 0x5771a9fc (stale) Mirror 19: 0x5771a9fc (stale) Mirror 23: 0x5771a9fc (stale) Mirror 24: 0x5771a9fc (stale) Mirror 25: 0x5771a9fc (stale) Mirror 26: 0x5771a9fc (stale) Mirror 29: 0x5771a9fc (stale) Mirror 30: 0x5771a9fc (stale) Mirror 31: 0x5771a9fc (stale) Mirror 32: 0x5771a9fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35145: skipped 000974 1768547502.941755 MIRROR_RESYNC 13 mirrors 000976 1768547505.035640 mapwrite 0x037084 thru 0x03ffff (0x8f7c bytes) 000977 1768547505.201174 read 0x000bf4 thru 0x003001 (0x240e bytes) 000979 1768547505.208373 write 0x023b79 thru 0x031787 (0xdc0f bytes) 000982 1768547505.225083 mapwrite 0x01ba02 thru 0x024113 (0x8712 bytes) 000984 1768547505.277008 trunc from 0x040000 to 0x022e1e (0x1d1e1 bytes) 000985 1768547505.295009 read 0x000e2f thru 0x002ee3 (0x20b5 bytes) 000986 1768547505.297629 mapwrite 0x02810b thru 0x02b816 (0x370c bytes) 000987 1768547505.400450 mapread 0x0127ec thru 0x017a02 (0x5217 bytes) 000988 1768547505.402012 mapread 0x015ff4 thru 0x01c4fc (0x6509 bytes) 000990 1768547505.410213 mapwrite 0x009bc5 thru 0x016de1 (0xd21d bytes) 000994 1768547505.534814 mapread 0x0185b2 thru 0x0239ea (0xb439 bytes) 000995 1768547505.538299 write 0x03dce2 thru 0x03ffff (0x231e bytes) 000997 1768547505.541803 mapwrite 0x038f72 thru 0x03ffff (0x708e bytes) 000998 1768547505.659759 mapread 0x011892 thru 0x01ca00 (0xb16f bytes) 000999 1768547505.664421 mapwrite 0x02a352 thru 0x037c77 (0xd926 bytes) All operations completed A-OK!