== sanity-flr test 70a: flr mode fsx test ================ 03:46:34 (1780991194) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 1197 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000006 1780991197.427031 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x6921 000007 1780991198.016523 trunc from 00000000 to 0x006920 (0x6921 bytes) 000010 1780991198.131533 mapwrite 0x0154d9 thru 0x01dce1 (0x8809 bytes) 000013 1780991198.273978 write 0x020209 thru 0x02840d (0x8205 bytes) truncating to largest ever: 0xdad3 000016 1780991198.279286 trunc from 0x02840e to 0x00dad2 (0x1a93b bytes) 000017 1780991198.318145 mapread 0x004174 thru 0x00dad2 (0x995f bytes) 000018 1780991198.337584 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) 000019 1780991198.551147 mapwrite 0x02c2bf thru 0x033d9c (0x7ade bytes) 000021 1780991198.732858 mapwrite 0x02e8b0 thru 0x037625 (0x8d76 bytes) 000022 1780991198.894230 mapread 0x00d536 thru 0x01979b (0xc266 bytes) 000026 1780991198.930309 mapwrite 0x036287 thru 0x039404 (0x317e bytes) 000027 1780991199.086098 mapread 0x01b7f0 thru 0x0276c5 (0xbed6 bytes) truncating to largest ever: 0x1568a 000031 1780991199.123197 trunc from 0x039405 to 0x015689 (0x23d7b bytes) 000034 1780991199.169150 read 0x009ef1 thru 0x015689 (0xb799 bytes) 000036 1780991199.171312 mapread 0x003553 thru 0x00a5b3 (0x7061 bytes) 000038 1780991199.203187 mapwrite 0x023402 thru 0x02dc4b (0xa84a bytes) 000041 1780991199.411854 write 0x03f758 thru 0x03ffff (0x8a8 bytes) 000044 1780991199.420970 write 0x02ad4c thru 0x037e60 (0xd115 bytes) 000047 1780991199.438198 read 0x02ed84 thru 0x0375b4 (0x8831 bytes) 000049 1780991199.446122 write 0x0251a9 thru 0x026578 (0x13d0 bytes) 000050 1780991199.457517 read 0x019b23 thru 0x019bba (0x98 bytes) 000053 1780991199.486193 write 0x012735 thru 0x016013 (0x38df bytes) 000054 1780991199.500344 mapwrite 0x0098fb thru 0x00f2d7 (0x59dd bytes) 000055 1780991199.622167 mapread 0x01a75b thru 0x01ce93 (0x2739 bytes) 000056 1780991199.623734 read 0x035f66 thru 0x03cc9f (0x6d3a bytes) truncating to largest ever: 0x257c7 000057 1780991199.628674 trunc from 0x040000 to 0x0257c6 (0x1a839 bytes) 000058 1780991199.670108 trunc from 0x0257c7 to 0x01514e (0x10678 bytes) 000062 1780991199.706610 trunc from 0x01514f to 0x01f65f (0xa511 bytes) 000063 1780991199.772839 mapread 0x0030da thru 0x00daff (0xaa26 bytes) 000066 1780991199.787359 write 0x021a42 thru 0x0249c5 (0x2f84 bytes) 000068 1780991199.796163 read 0x01f574 thru 0x0249c5 (0x5452 bytes) 000070 1780991199.817340 read 0x00b8b3 thru 0x015e49 (0xa597 bytes) 000072 1780991199.847543 MIRROR_EXTEND to 2 mirrors 000073 1780991200.877775 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) 000074 1780991201.157861 mapread 0x016dc0 thru 0x01bba8 (0x4de9 bytes) 000075 1780991201.198039 read 0x003c33 thru 0x008a90 (0x4e5e bytes) 000076 1780991201.227806 mapread 0x023bdd thru 0x0249c5 (0xde9 bytes) truncating to largest ever: 0x36b8b 000077 1780991201.244108 trunc from 0x0249c6 to 0x036b8a (0x121c5 bytes) 000079 1780991201.298331 read 0x026776 thru 0x02852b (0x1db6 bytes) 000080 1780991201.320393 mapread 0x00745e thru 0x0075c1 (0x164 bytes) 000083 1780991201.329431 trunc from 0x036b8b to 0x01f33f (0x1784b bytes) 000084 1780991201.363196 mapread 0x018f2a thru 0x01f33f (0x6416 bytes) 000088 1780991201.376466 write 0x0340e5 thru 0x03fe17 (0xbd33 bytes) 000090 1780991201.381385 write 0x03dbdf thru 0x03ffff (0x2421 bytes) 000091 1780991201.384671 mapread 0x003053 thru 0x00bab0 (0x8a5e bytes) 000092 1780991201.390811 trunc from 0x040000 to 0x02fc8b (0x10374 bytes) 000095 1780991201.475118 MIRROR_EXTEND to 2 mirrors 000097 1780991202.715409 mapwrite 0x03eb15 thru 0x03ffff (0x14eb bytes) 000099 1780991203.060198 read 0x00721a thru 0x0171da (0xffc1 bytes) 000101 1780991203.108264 read 0x025260 thru 0x029841 (0x45e2 bytes) 000103 1780991203.143809 mapread 0x03a110 thru 0x03ffff (0x5ef0 bytes) 000105 1780991203.154455 write 0x03d782 thru 0x03ffff (0x287e bytes) 000108 1780991203.160183 trunc from 0x040000 to 0x0239c4 (0x1c63b bytes) 000109 1780991203.225942 write 0x0387b5 thru 0x03ffff (0x784b bytes) 000110 1780991203.229957 mapwrite 0x00403d thru 0x013912 (0xf8d6 bytes) 000111 1780991203.402175 trunc from 0x040000 to 0x0210e8 (0x1ef17 bytes) 000112 1780991203.435923 write 0x0213d0 thru 0x0281c7 (0x6df8 bytes) 000113 1780991203.442555 write 0x0211c2 thru 0x0278cd (0x670c bytes) 000115 1780991203.444618 read 0x018369 thru 0x01958c (0x1224 bytes) 000116 1780991203.447379 write 0x01973f thru 0x020aba (0x737c bytes) 000119 1780991203.453155 mapread 0x011b33 thru 0x017948 (0x5e16 bytes) 000121 1780991203.455741 mapwrite 0x01cbfb thru 0x028172 (0xb578 bytes) 000123 1780991203.562659 read 0x02757a thru 0x0281c7 (0xc4e bytes) 000124 1780991203.563311 mapread 0x01df03 thru 0x01f060 (0x115e bytes) 000125 1780991203.564405 write 0x03686e thru 0x03ffff (0x9792 bytes) 000126 1780991203.573230 mapread 0x018499 thru 0x0210b0 (0x8c18 bytes) 000131 1780991203.580358 read 0x01f8fd thru 0x02380d (0x3f11 bytes) 000133 1780991203.588586 read 0x00825a thru 0x00a1ba (0x1f61 bytes) 000137 1780991203.592558 read 0x016867 thru 0x019748 (0x2ee2 bytes) 000138 1780991203.594066 mapread 0x02e9ad thru 0x03cf9c (0xe5f0 bytes) 000141 1780991203.604673 trunc from 0x040000 to 0x013600 (0x2c9ff bytes) 000143 1780991203.640028 write 0x03f988 thru 0x03ffff (0x678 bytes) 000144 1780991203.641143 write 0x024568 thru 0x02b629 (0x70c2 bytes) 000145 1780991203.688194 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb01b6ff6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe5d12497 Mirror 3: 0xe5d12497 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000148 1780991204.789054 mapwrite 0x0040f9 thru 0x00b503 (0x740b bytes) truncating to largest ever: 0x3b20a 000153 1780991205.044229 trunc from 0x040000 to 0x03b209 (0x4df6 bytes) 000156 1780991205.092196 mapwrite 0x015fb9 thru 0x01b81e (0x5866 bytes) 000158 1780991205.158395 read 0x036f6b thru 0x03b209 (0x429f bytes) 000159 1780991205.179236 MIRROR_RESYNC 3 mirrors 000160 1780991206.208592 MIRROR_RESYNC 3 mirrors 000162 1780991206.971388 mapwrite 0x02e1f5 thru 0x03a9a9 (0xc7b5 bytes) 000163 1780991207.319806 trunc from 0x03b20a to 0x011b85 (0x29684 bytes) 000164 1780991207.413255 read 0x001171 thru 0x0053a9 (0x4239 bytes) 000166 1780991207.445336 read 0x0055cf thru 0x011b85 (0xc5b7 bytes) 000169 1780991207.492039 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11b86): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11b86): Mirror 2: 0x335886c (stale) Mirror 3: 0x335886c (stale) CRC-32 checksum value for chunk [0, 0x11b86): Mirror 1: 0x335886c Mirror 4: 0x335886c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11b86: skipped 000171 1780991208.874608 mapread 0x000470 thru 0x00b1a4 (0xad35 bytes) 000174 1780991208.993604 read 0x00a3ea thru 0x010c06 (0x681d bytes) 000175 1780991209.014959 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11b86): Mirror 3: 0x335886c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11b86): Mirror 3: 0x335886c (stale) CRC-32 checksum value for chunk [0, 0x11b86): Mirror 1: 0x335886c Mirror 4: 0x335886c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11b86: skipped truncating to largest ever: 0x3c001 000176 1780991209.861288 trunc from 0x011b86 to 0x03c000 (0x2a47b bytes) 000177 1780991209.968838 write 0x001e15 thru 0x00ee00 (0xcfec bytes) 000178 1780991209.988928 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c001): Mirror 3: 0x6ed667bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c001): Mirror 3: 0x6ed667bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c001: skipped 000179 1780991210.414759 trunc from 0x03c001 to 0x01b148 (0x20eb8 bytes) 000181 1780991210.441599 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) 000183 1780991210.655381 read 0x0194f2 thru 0x01b148 (0x1c57 bytes) 000185 1780991210.672640 write 0x01e3ce thru 0x02286f (0x44a2 bytes) 000186 1780991210.675200 write 0x02952d thru 0x031997 (0x846b bytes) 000187 1780991210.676631 write 0x03cd94 thru 0x03ffff (0x326c bytes) 000188 1780991210.678532 write 0x02e33e thru 0x03c51c (0xe1df bytes) 000191 1780991210.684366 trunc from 0x040000 to 0x009beb (0x36414 bytes) 000193 1780991210.726886 trunc from 0x009bec to 0x015a11 (0xbe26 bytes) 000196 1780991210.772127 trunc from 0x015a12 to 0x017bf4 (0x21e3 bytes) 000198 1780991210.805315 trunc from 0x017bf5 to 0x03291c (0x1ad28 bytes) 000200 1780991210.829807 write 0x00cf9f thru 0x016e12 (0x9e74 bytes) 000202 1780991210.844372 mapwrite 0x03f9d7 thru 0x03ffff (0x629 bytes) 000205 1780991211.004203 write 0x010950 thru 0x0194f9 (0x8baa bytes) 000211 1780991211.032429 trunc from 0x040000 to 0x0297d8 (0x16827 bytes) 000213 1780991211.100164 trunc from 0x0297d9 to 0x037ef2 (0xe71a bytes) 000217 1780991211.133862 MIRROR_EXTEND to 2 mirrors 000219 1780991212.002251 MIRROR_EXTEND to 3 mirrors 000220 1780991212.915627 mapwrite 0x02d053 thru 0x02f959 (0x2907 bytes) 000222 1780991213.324418 read 0x0316aa thru 0x034840 (0x3197 bytes) truncating to largest ever: 0x3c09a 000223 1780991213.325544 trunc from 0x037ef3 to 0x03c099 (0x41a7 bytes) 000225 1780991213.350969 mapread 0x0232f2 thru 0x02b5ab (0x82ba bytes) 000226 1780991213.363284 trunc from 0x03c09a to 0x02daa1 (0xe5f8 bytes) 000227 1780991213.386580 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2daa2): Mirror 3: 0x14f3239c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2daa2): Mirror 3: 0x14f3239c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2daa2: skipped 000232 1780991213.744915 mapread 0x00a0e4 thru 0x010e90 (0x6dad bytes) 000233 1780991213.807727 write 0x038447 thru 0x0385e0 (0x19a bytes) 000234 1780991213.809041 read 0x0322d5 thru 0x03769e (0x53ca bytes) 000235 1780991213.822339 mapwrite 0x037563 thru 0x03ffff (0x8a9d bytes) 000236 1780991213.949539 mapwrite 0x00921c thru 0x00daa5 (0x488a bytes) 000237 1780991214.013569 mapwrite 0x03f463 thru 0x03ffff (0xb9d bytes) 000240 1780991214.069656 trunc from 0x040000 to 0x02a4c8 (0x15b37 bytes) 000241 1780991214.097225 mapwrite 0x00d159 thru 0x0144e0 (0x7388 bytes) 000243 1780991214.181066 mapwrite 0x010839 thru 0x01af5e (0xa726 bytes) 000244 1780991214.344535 read 0x00dfc4 thru 0x0160f1 (0x812e bytes) 000246 1780991214.346966 mapread 0x002dab thru 0x00adca (0x8020 bytes) 000247 1780991214.369874 mapwrite 0x032368 thru 0x03a454 (0x80ed bytes) 000248 1780991214.618115 mapread 0x029fb4 thru 0x032aad (0x8afa bytes) 000249 1780991214.619646 read 0x029567 thru 0x02ce8a (0x3924 bytes) 000250 1780991214.623342 trunc from 0x03a455 to 0x001800 (0x38c54 bytes) 000251 1780991214.656222 trunc from 0x001801 to 0x0077e1 (0x5fe1 bytes) 000255 1780991214.693881 write 0x01c532 thru 0x020207 (0x3cd6 bytes) 000256 1780991214.703317 read 0x013953 thru 0x01f2e7 (0xb995 bytes) 000257 1780991214.716083 read 0x00e81b thru 0x01a800 (0xbfe6 bytes) 000259 1780991214.717359 write 0x030b0b thru 0x03abcd (0xa0c3 bytes) 000263 1780991214.723377 mapread 0x023a07 thru 0x031638 (0xdc32 bytes) 000264 1780991214.737403 read 0x0173a4 thru 0x01e8c6 (0x7523 bytes) 000269 1780991214.741330 read 0x01fe2a thru 0x02309a (0x3271 bytes) truncating to largest ever: 0x3e97c 000270 1780991214.742282 trunc from 0x03abce to 0x03e97b (0x3dae bytes) 000272 1780991214.782783 mapread 0x033122 thru 0x034c2e (0x1b0d bytes) 000274 1780991214.786824 mapwrite 0x0168ab thru 0x018d20 (0x2476 bytes) 000275 1780991214.912339 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) 000276 1780991215.090113 write 0x03c7f4 thru 0x03ffff (0x380c bytes) 000277 1780991215.102624 read 0x003a78 thru 0x01365d (0xfbe6 bytes) 000278 1780991215.119926 read 0x00fe26 thru 0x012dd8 (0x2fb3 bytes) 000279 1780991215.120634 mapread 0x015dd6 thru 0x025889 (0xfab4 bytes) 000280 1780991215.141211 trunc from 0x040000 to 0x00d5ed (0x32a12 bytes) 000281 1780991215.169248 trunc from 0x00d5ee to 0x02e8ba (0x212cd bytes) 000283 1780991215.197014 mapread 0x016402 thru 0x024c1a (0xe819 bytes) 000285 1780991215.338080 mapread 0x0249bb thru 0x02c46e (0x7ab4 bytes) 000286 1780991215.385911 mapwrite 0x03161a thru 0x0368a2 (0x5289 bytes) 000289 1780991215.535078 mapwrite 0x013142 thru 0x018726 (0x55e5 bytes) 000291 1780991215.633001 MIRROR_EXTEND to 2 mirrors 000292 1780991216.606183 MIRROR_RESYNC 2 mirrors 000293 1780991217.070048 read 0x005469 thru 0x014da2 (0xf93a bytes) 000294 1780991217.099150 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) 000297 1780991217.266016 write 0x01344d thru 0x01888b (0x543f bytes) 000300 1780991217.318702 mapwrite 0x0385cd thru 0x03ffff (0x7a33 bytes) 000301 1780991217.452828 mapread 0x00bc1e thru 0x00e7c6 (0x2ba9 bytes) 000303 1780991217.469304 write 0x010857 thru 0x01eb1c (0xe2c6 bytes) 000304 1780991217.484700 mapread 0x00f976 thru 0x010a2c (0x10b7 bytes) 000306 1780991217.489951 mapwrite 0x0202d5 thru 0x026db7 (0x6ae3 bytes) 000310 1780991217.597403 trunc from 0x040000 to 0x008f13 (0x370ec bytes) 000311 1780991217.614114 write 0x02b1b9 thru 0x02ec8c (0x3ad4 bytes) 000313 1780991217.617920 read 0x02a6cf thru 0x02af9c (0x8ce bytes) 000314 1780991217.622442 write 0x03efa2 thru 0x03ffff (0x105e bytes) 000316 1780991217.624632 mapwrite 0x017be0 thru 0x01af66 (0x3387 bytes) 000318 1780991217.713459 mapread 0x026ff9 thru 0x02d3f0 (0x63f8 bytes) 000321 1780991217.740407 read 0x00ade1 thru 0x013233 (0x8453 bytes) 000324 1780991217.788995 mapwrite 0x033766 thru 0x03aeac (0x7747 bytes) 000326 1780991217.927693 read 0x0250f8 thru 0x0280f4 (0x2ffd bytes) 000327 1780991217.930890 read 0x02f0c3 thru 0x039bf6 (0xab34 bytes) 000328 1780991217.941145 trunc from 0x040000 to 0x036aaf (0x9550 bytes) 000329 1780991217.977579 MIRROR_EXTEND to 2 mirrors 000331 1780991219.018941 read 0x021cb5 thru 0x031a92 (0xfdde bytes) 000332 1780991219.062921 read 0x00f18f thru 0x01e6ac (0xf51e bytes) 000333 1780991219.097794 trunc from 0x036ab0 to 0x00edda (0x27cd5 bytes) 000335 1780991219.281316 mapread 0x001325 thru 0x005ca1 (0x497d bytes) 000337 1780991219.317456 read 0x009dbe thru 0x00edda (0x501d bytes) 000339 1780991219.332056 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xeddb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeddb): Mirror 2: 0xd400e1b0 (stale) CRC-32 checksum value for chunk [0, 0xeddb): Mirror 1: 0xd400e1b0 Mirror 3: 0xd400e1b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeddb: skipped 000340 1780991220.382447 write 0x02cb44 thru 0x03187b (0x4d38 bytes) 000341 1780991220.553304 trunc from 0x03187c to 0x03e145 (0xc8ca bytes) 000342 1780991220.602388 mapwrite 0x01f6b4 thru 0x028da3 (0x96f0 bytes) 000343 1780991220.769997 write 0x01f62a thru 0x01f6c9 (0xa0 bytes) 000345 1780991220.771999 read 0x030422 thru 0x0325fb (0x21da bytes) 000346 1780991220.794386 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e146): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e146): Mirror 2: 0xd8b94f44 (stale) Mirror 3: 0xc1e3e5d1 (stale) CRC-32 checksum value for chunk [0, 0x3e146): Mirror 1: 0x9c9536b0 Mirror 4: 0x9c9536b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e146: skipped 000351 1780991222.259086 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e146): Mirror 3: 0xc1e3e5d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e146): Mirror 3: 0xc1e3e5d1 (stale) CRC-32 checksum value for chunk [0, 0x3e146): Mirror 1: 0x9c9536b0 Mirror 4: 0x9c9536b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e146: skipped 000352 1780991223.022406 mapread 0x016b98 thru 0x0181e0 (0x1649 bytes) 000353 1780991223.066967 trunc from 0x03e146 to 0x01955c (0x24be9 bytes) 000354 1780991223.204943 write 0x0373c3 thru 0x03ffff (0x8c3d bytes) 000355 1780991223.209414 mapread 0x01255e thru 0x01a4bf (0x7f62 bytes) 000357 1780991223.226152 write 0x02325e thru 0x028e69 (0x5c0c bytes) 000358 1780991223.238287 mapread 0x00621d thru 0x009d96 (0x3b7a bytes) 000359 1780991223.248526 write 0x03936d thru 0x03c02b (0x2cbf bytes) 000360 1780991223.249755 mapread 0x001b0c thru 0x00afcf (0x94c4 bytes) 000361 1780991223.252331 write 0x006148 thru 0x015e59 (0xfd12 bytes) 000362 1780991223.255264 mapread 0x03c7c7 thru 0x03d717 (0xf51 bytes) 000363 1780991223.257140 mapwrite 0x03ad1c thru 0x03ffff (0x52e4 bytes) 000365 1780991223.336158 read 0x008f3d thru 0x018a54 (0xfb18 bytes) 000366 1780991223.337075 mapread 0x015d34 thru 0x01bb21 (0x5dee bytes) 000367 1780991223.356946 MIRROR_RESYNC 3 mirrors 000368 1780991224.713707 mapread 0x03ff23 thru 0x03ffff (0xdd bytes) 000369 1780991224.776264 MIRROR_RESYNC 3 mirrors 000370 1780991225.504272 MIRROR_EXTEND to 4 mirrors 000371 1780991226.586536 trunc from 0x040000 to 0x020f3d (0x1f0c2 bytes) 000372 1780991226.707240 mapwrite 0x03f897 thru 0x03ffff (0x769 bytes) 000374 1780991226.791693 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x36464690 (stale) Mirror 4: 0x36464690 (stale) Mirror 5: 0x36464690 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x484a1dd5 Mirror 6: 0x484a1dd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000375 1780991228.260433 write 0x00ede2 thru 0x010e9c (0x20bb bytes) 000379 1780991228.412393 mapwrite 0x00c21f thru 0x0141b5 (0x7f97 bytes) 000381 1780991228.555145 mapwrite 0x01d619 thru 0x022a37 (0x541f bytes) 000382 1780991228.722741 write 0x00a6cd thru 0x0191f6 (0xeb2a bytes) 000384 1780991228.751314 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x36464690 (stale) Mirror 4: 0x36464690 (stale) Mirror 6: 0x484a1dd5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x36464690 (stale) Mirror 4: 0x36464690 (stale) Mirror 6: 0x484a1dd5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000385 1780991229.590962 MIRROR_RESYNC 4 mirrors 000387 1780991231.013847 trunc from 0x040000 to 0x0197d2 (0x2682d bytes) 000389 1780991231.158306 read 0x0031f5 thru 0x005ec8 (0x2cd4 bytes) 000391 1780991231.165715 read 0x015bf6 thru 0x0197d2 (0x3bdd bytes) 000393 1780991231.197089 mapwrite 0x025608 thru 0x029577 (0x3f70 bytes) 000394 1780991231.341707 read 0x009cd9 thru 0x0174fb (0xd823 bytes) 000395 1780991231.342937 write 0x007426 thru 0x00945b (0x2036 bytes) 000396 1780991231.349897 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29578): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29578): Mirror 3: 0xde6ba10 (stale) Mirror 4: 0xde6ba10 (stale) Mirror 6: 0xde6ba10 (stale) CRC-32 checksum value for chunk [0, 0x29578): Mirror 1: 0xdccc560b Mirror 7: 0xdccc560b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29578: skipped 000397 1780991232.583798 read 0x0246bd thru 0x029577 (0x4ebb bytes) 000398 1780991232.602168 mapwrite 0x011916 thru 0x01aca5 (0x9390 bytes) 000399 1780991232.913313 read 0x01e7b8 thru 0x029577 (0xadc0 bytes) 000400 1780991232.928265 write 0x00bbe2 thru 0x00f256 (0x3675 bytes) 000403 1780991232.936981 mapwrite 0x03efe8 thru 0x03ffff (0x1018 bytes) 000405 1780991233.096743 mapread 0x033005 thru 0x03ffff (0xcffb bytes) 000406 1780991233.100173 mapread 0x0233db thru 0x029398 (0x5fbe bytes) truncating to largest ever: 0x3efde 000407 1780991233.102870 trunc from 0x040000 to 0x03efdd (0x1022 bytes) 000408 1780991233.119402 write 0x006fdd thru 0x007e56 (0xe7a bytes) 000409 1780991233.127355 MIRROR_RESYNC 5 mirrors 000411 1780991234.743029 mapwrite 0x01bda0 thru 0x01d0a9 (0x130a bytes) 000412 1780991234.962141 MIRROR_RESYNC 5 mirrors 000413 1780991236.175990 mapwrite 0x03b3f7 thru 0x03ffff (0x4c09 bytes) 000415 1780991236.371743 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe45c2519 (stale) Mirror 4: 0xe45c2519 (stale) Mirror 6: 0xe45c2519 (stale) Mirror 7: 0xe45c2519 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xabd2ff26 Mirror 8: 0xabd2ff26 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000418 1780991237.658246 trunc from 0x040000 to 0x014377 (0x2bc88 bytes) 000422 1780991237.790089 write 0x02211e thru 0x0222c9 (0x1ac bytes) 000423 1780991237.793014 trunc from 0x0222ca to 0x003274 (0x1f055 bytes) 000424 1780991237.819070 trunc from 0x003275 to 0x0112c6 (0xe052 bytes) 000425 1780991237.838945 trunc from 0x0112c7 to 0x0054a5 (0xbe21 bytes) 000427 1780991237.860335 mapread 0x001361 thru 0x0054a5 (0x4145 bytes) 000428 1780991237.876949 write 0x01028f thru 0x01dd33 (0xdaa5 bytes) 000430 1780991237.881822 read 0x00ddb8 thru 0x015254 (0x749d bytes) 000431 1780991237.893298 MIRROR_RESYNC 6 mirrors 000432 1780991239.552315 mapread 0x01576f thru 0x01dd33 (0x85c5 bytes) 000433 1780991239.588294 mapwrite 0x034e3f thru 0x03ffff (0xb1c1 bytes) 000435 1780991239.871069 trunc from 0x040000 to 0x02eb50 (0x114af bytes) 000436 1780991239.905615 mapwrite 0x00b05f thru 0x00d55e (0x2500 bytes) 000437 1780991240.000106 read 0x002e98 thru 0x0039e1 (0xb4a bytes) 000438 1780991240.009024 read 0x01c1b2 thru 0x02b1d2 (0xf021 bytes) 000439 1780991240.038843 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eb51): Mirror 3: 0x51eb9f7d (stale) Mirror 4: 0x51eb9f7d (stale) Mirror 7: 0x51eb9f7d (stale) Mirror 8: 0x51eb9f7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eb51): Mirror 3: 0x51eb9f7d (stale) Mirror 4: 0x51eb9f7d (stale) Mirror 7: 0x51eb9f7d (stale) Mirror 8: 0x51eb9f7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eb51: skipped 000440 1780991240.552398 MIRROR_RESYNC 5 mirrors 000441 1780991242.141247 mapread 0x01a985 thru 0x0252ec (0xa968 bytes) 000442 1780991242.183141 mapread 0x02662d thru 0x02e45b (0x7e2f bytes) 000443 1780991242.192728 write 0x018ab6 thru 0x020575 (0x7ac0 bytes) 000445 1780991242.314385 mapread 0x01144f thru 0x01e26c (0xce1e bytes) 000447 1780991242.319090 mapread 0x013ef5 thru 0x020df8 (0xcf04 bytes) 000448 1780991242.320441 read 0x001b48 thru 0x00f6a8 (0xdb61 bytes) 000450 1780991242.348609 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2eb51): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eb51): Mirror 3: 0x1fd3a2c3 (stale) Mirror 4: 0x1fd3a2c3 (stale) Mirror 7: 0x1fd3a2c3 (stale) Mirror 8: 0x1fd3a2c3 (stale) CRC-32 checksum value for chunk [0, 0x2eb51): Mirror 1: 0x682d3b79 Mirror 9: 0x682d3b79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eb51: skipped 000452 1780991243.438934 mapwrite 0x02117c thru 0x024276 (0x30fb bytes) 000454 1780991243.767271 trunc from 0x02eb51 to 0x01453c (0x1a614 bytes) 000455 1780991243.826719 mapread 0x0119d6 thru 0x01453c (0x2b67 bytes) 000456 1780991243.841129 mapread 0x0049ab thru 0x00a682 (0x5cd8 bytes) 000460 1780991243.852631 mapwrite 0x03ccea thru 0x03ffff (0x3316 bytes) 000462 1780991243.938149 mapwrite 0x02f742 thru 0x035fd0 (0x688f bytes) 000463 1780991244.017263 trunc from 0x040000 to 0x0018bb (0x3e744 bytes) 000465 1780991244.045054 read 0x000b9c thru 0x0018bb (0xd20 bytes) 000466 1780991244.057391 write 0x00c651 thru 0x01b43a (0xedea bytes) 000469 1780991244.066970 MIRROR_RESYNC 6 mirrors 000470 1780991245.565225 mapwrite 0x030576 thru 0x039a44 (0x94cf bytes) 000471 1780991245.794141 read 0x01d69b thru 0x025081 (0x79e7 bytes) 000472 1780991245.807898 mapwrite 0x033c89 thru 0x0392b1 (0x5629 bytes) 000473 1780991245.889911 mapread 0x00480f thru 0x00f4ec (0xacde bytes) 000477 1780991245.926382 mapread 0x02728f thru 0x0290be (0x1e30 bytes) 000478 1780991245.942095 write 0x039786 thru 0x03ffff (0x687a bytes) 000479 1780991245.943391 mapread 0x001696 thru 0x011369 (0xfcd4 bytes) 000480 1780991245.954288 mapwrite 0x002258 thru 0x00d3e6 (0xb18f bytes) 000481 1780991246.035766 trunc from 0x040000 to 0x02dff1 (0x1200e bytes) 000482 1780991246.073136 mapwrite 0x00181b thru 0x00ad94 (0x957a bytes) 000483 1780991246.173560 write 0x01b687 thru 0x026f6d (0xb8e7 bytes) 000484 1780991246.185686 mapwrite 0x01475d thru 0x01852a (0x3dce bytes) 000486 1780991246.280868 write 0x037667 thru 0x038676 (0x1010 bytes) 000487 1780991246.295375 MIRROR_RESYNC 6 mirrors 000488 1780991247.741222 write 0x00b646 thru 0x01668f (0xb04a bytes) 000490 1780991247.895708 trunc from 0x038677 to 0x03d8af (0x5239 bytes) 000492 1780991247.935015 MIRROR_RESYNC 6 mirrors 000494 1780991249.493514 write 0x00ce05 thru 0x012a07 (0x5c03 bytes) 000496 1780991249.574212 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3d8b0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8b0): Mirror 3: 0x25441dc4 (stale) Mirror 4: 0x25441dc4 (stale) Mirror 7: 0x25441dc4 (stale) Mirror 8: 0x25441dc4 (stale) Mirror 9: 0x25441dc4 (stale) CRC-32 checksum value for chunk [0, 0x3d8b0): Mirror 1: 0x315b4119 Mirror 10: 0x315b4119 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8b0: skipped 000497 1780991250.998555 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d8b0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8b0): Mirror 3: 0x25441dc4 (stale) Mirror 4: 0x25441dc4 (stale) Mirror 7: 0x25441dc4 (stale) Mirror 8: 0x25441dc4 (stale) Mirror 9: 0x25441dc4 (stale) CRC-32 checksum value for chunk [0, 0x3d8b0): Mirror 1: 0x315b4119 Mirror 10: 0x315b4119 Mirror 11: 0x315b4119 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8b0: skipped 000499 1780991252.461912 read 0x03587a thru 0x0379f1 (0x2178 bytes) 000500 1780991252.478747 trunc from 0x03d8b0 to 0x03929e (0x4611 bytes) 000501 1780991252.640431 mapread 0x024383 thru 0x02d147 (0x8dc5 bytes) 000503 1780991252.691329 mapread 0x00ae01 thru 0x018c47 (0xde47 bytes) 000505 1780991252.717808 mapwrite 0x004234 thru 0x00be9c (0x7c69 bytes) 000510 1780991252.806254 mapread 0x025a68 thru 0x03120e (0xb7a7 bytes) 000512 1780991252.828905 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3929f): Mirror 4: 0xec27c6bd (stale) Mirror 7: 0xec27c6bd (stale) Mirror 8: 0xec27c6bd (stale) Mirror 9: 0xec27c6bd (stale) Mirror 10: 0xffc7fd74 (stale) Mirror 11: 0xffc7fd74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3929f): Mirror 4: 0xec27c6bd (stale) Mirror 7: 0xec27c6bd (stale) Mirror 8: 0xec27c6bd (stale) Mirror 9: 0xec27c6bd (stale) Mirror 10: 0xffc7fd74 (stale) Mirror 11: 0xffc7fd74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3929f: skipped 000514 1780991253.792817 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3929f): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3929f): Mirror 4: 0xec27c6bd (stale) Mirror 7: 0xec27c6bd (stale) Mirror 8: 0xec27c6bd (stale) Mirror 9: 0xec27c6bd (stale) Mirror 10: 0xffc7fd74 (stale) Mirror 11: 0xffc7fd74 (stale) CRC-32 checksum value for chunk [0, 0x3929f): Mirror 1: 0x8ad90005 Mirror 12: 0x8ad90005 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3929f: skipped 000517 1780991255.381063 write 0x023651 thru 0x02fc23 (0xc5d3 bytes) 000518 1780991255.542721 trunc from 0x03929f to 0x034f84 (0x431a bytes) 000520 1780991255.603578 write 0x01256a thru 0x01b1e7 (0x8c7e bytes) 000521 1780991255.623791 mapwrite 0x036838 thru 0x03ffff (0x97c8 bytes) 000522 1780991255.818696 write 0x01a44e thru 0x028a86 (0xe639 bytes) 000524 1780991255.826134 mapread 0x03b7b8 thru 0x03f2d0 (0x3b19 bytes) 000525 1780991255.829863 read 0x0144a7 thru 0x01e2e2 (0x9e3c bytes) 000527 1780991255.831421 mapread 0x02aec2 thru 0x030cc8 (0x5e07 bytes) 000529 1780991255.837251 write 0x02bfb3 thru 0x02ff54 (0x3fa2 bytes) 000530 1780991255.841008 write 0x01646a thru 0x01ee4b (0x89e2 bytes) 000534 1780991255.847986 mapread 0x0208c1 thru 0x02fbfc (0xf33c bytes) 000535 1780991255.852365 read 0x028d86 thru 0x02a6e2 (0x195d bytes) 000537 1780991255.859252 trunc from 0x040000 to 0x0231ac (0x1ce53 bytes) 000539 1780991255.935196 mapread 0x02314a thru 0x0231ac (0x63 bytes) 000540 1780991255.936199 read 0x00d098 thru 0x00df84 (0xeed bytes) 000541 1780991255.941873 write 0x026cd2 thru 0x034e22 (0xe151 bytes) 000542 1780991255.957978 MIRROR_RESYNC 8 mirrors 000543 1780991258.479759 mapwrite 0x0307af thru 0x036df4 (0x6646 bytes) 000544 1780991258.869071 mapwrite 0x010bef thru 0x01c5e9 (0xb9fb bytes) 000545 1780991259.041668 mapwrite 0x020ce7 thru 0x024d45 (0x405f bytes) 000547 1780991259.117276 write 0x03bcb1 thru 0x03ffff (0x434f bytes) 000548 1780991259.119865 mapread 0x02cb2a thru 0x0364e0 (0x99b7 bytes) 000549 1780991259.128400 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcfb05d98 (stale) Mirror 7: 0xcfb05d98 (stale) Mirror 8: 0xcfb05d98 (stale) Mirror 9: 0xcfb05d98 (stale) Mirror 10: 0xcfb05d98 (stale) Mirror 11: 0xcfb05d98 (stale) Mirror 12: 0xcfb05d98 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd6ad3de Mirror 13: 0xd6ad3de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000550 1780991260.574096 mapread 0x03487d thru 0x038d17 (0x449b bytes) 000551 1780991260.614758 read 0x027f5e thru 0x028987 (0xa2a bytes) 000552 1780991260.625793 write 0x03c090 thru 0x03ffff (0x3f70 bytes) 000553 1780991260.723909 trunc from 0x040000 to 0x008590 (0x37a6f bytes) 000554 1780991260.789726 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8591): Mirror 4: 0xb4cde262 (stale) Mirror 7: 0xb4cde262 (stale) Mirror 8: 0xb4cde262 (stale) Mirror 10: 0xb4cde262 (stale) Mirror 11: 0xb4cde262 (stale) Mirror 12: 0xb4cde262 (stale) Mirror 13: 0xb4cde262 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8591): Mirror 4: 0xb4cde262 (stale) Mirror 7: 0xb4cde262 (stale) Mirror 8: 0xb4cde262 (stale) Mirror 10: 0xb4cde262 (stale) Mirror 11: 0xb4cde262 (stale) Mirror 12: 0xb4cde262 (stale) Mirror 13: 0xb4cde262 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8591: skipped 000556 1780991261.516870 mapwrite 0x022210 thru 0x03067d (0xe46e bytes) 000557 1780991261.724080 read 0x010835 thru 0x01524c (0x4a18 bytes) 000559 1780991261.749406 mapread 0x00c17e thru 0x013fd5 (0x7e58 bytes) 000560 1780991261.769917 read 0x01ff7f thru 0x023955 (0x39d7 bytes) 000561 1780991261.772128 mapread 0x02f5d1 thru 0x03067d (0x10ad bytes) 000563 1780991261.777238 write 0x02a062 thru 0x02e271 (0x4210 bytes) 000566 1780991261.797385 trunc from 0x03067e to 0x03e73c (0xe0bf bytes) 000567 1780991261.851322 read 0x02af55 thru 0x02c698 (0x1744 bytes) 000569 1780991261.859497 mapwrite 0x00fb4a thru 0x0186a4 (0x8b5b bytes) 000570 1780991262.038312 mapread 0x006768 thru 0x014e1a (0xe6b3 bytes) 000571 1780991262.040092 mapread 0x0358e2 thru 0x03e73c (0x8e5b bytes) 000573 1780991262.060704 read 0x0179c2 thru 0x019016 (0x1655 bytes) 000574 1780991262.062190 trunc from 0x03e73d to 0x02d05d (0x116df bytes) 000575 1780991262.142085 write 0x0288a6 thru 0x034eea (0xc645 bytes) 000578 1780991262.195553 MIRROR_RESYNC 8 mirrors 000579 1780991264.545988 read 0x01ee1e thru 0x02b53b (0xc71e bytes) 000582 1780991264.557389 write 0x00ba2f thru 0x0109c6 (0x4f98 bytes) 000586 1780991264.755300 mapwrite 0x027c5c thru 0x030559 (0x88fe bytes) 000587 1780991264.990232 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34eeb): Mirror 4: 0xecd8373c (stale) Mirror 7: 0xecd8373c (stale) Mirror 8: 0xecd8373c (stale) Mirror 10: 0xecd8373c (stale) Mirror 11: 0xecd8373c (stale) Mirror 13: 0xecd8373c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34eeb): Mirror 4: 0xecd8373c (stale) Mirror 7: 0xecd8373c (stale) Mirror 8: 0xecd8373c (stale) Mirror 10: 0xecd8373c (stale) Mirror 11: 0xecd8373c (stale) Mirror 13: 0xecd8373c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34eeb: skipped 000591 1780991265.998640 MIRROR_RESYNC 7 mirrors 000592 1780991268.383867 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) 000593 1780991268.953245 trunc from 0x034eeb to 0x028e20 (0xc0ca bytes) 000594 1780991269.081554 mapwrite 0x014cc8 thru 0x01c79f (0x7ad8 bytes) 000595 1780991269.285555 trunc from 0x028e21 to 0x02de06 (0x4fe6 bytes) 000597 1780991269.361561 MIRROR_RESYNC 6 mirrors 000599 1780991270.832100 write 0x02802d thru 0x02e410 (0x63e4 bytes) 000600 1780991270.911732 mapread 0x028dd5 thru 0x029c79 (0xea5 bytes) 000601 1780991270.918607 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e411): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e411): Mirror 7: 0xee10caad (stale) Mirror 8: 0xee10caad (stale) Mirror 10: 0xee10caad (stale) Mirror 11: 0xee10caad (stale) Mirror 13: 0xee10caad (stale) CRC-32 checksum value for chunk [0, 0x2e411): Mirror 1: 0x78dd37a6 Mirror 14: 0x78dd37a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e411: skipped 000602 1780991272.149943 trunc from 0x02e411 to 0x009451 (0x24fbf bytes) 000603 1780991272.272846 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x9452): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9452): Mirror 7: 0x4c5eee75 (stale) Mirror 8: 0x4c5eee75 (stale) Mirror 10: 0x4c5eee75 (stale) Mirror 11: 0x4c5eee75 (stale) Mirror 13: 0x4c5eee75 (stale) Mirror 14: 0x4c5eee75 (stale) CRC-32 checksum value for chunk [0, 0x9452): Mirror 1: 0x4c5eee75 Mirror 15: 0x4c5eee75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9452: skipped 000605 1780991273.630462 mapwrite 0x033a68 thru 0x0355eb (0x1b84 bytes) 000606 1780991273.777009 trunc from 0x0355ec to 0x03a15c (0x4b71 bytes) 000607 1780991273.805447 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a15d): Mirror 8: 0xdaa33073 (stale) Mirror 10: 0xdaa33073 (stale) Mirror 11: 0xdaa33073 (stale) Mirror 13: 0xdaa33073 (stale) Mirror 14: 0xc6b59c69 (stale) Mirror 15: 0x92c0c8a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a15d): Mirror 8: 0xdaa33073 (stale) Mirror 10: 0xdaa33073 (stale) Mirror 11: 0xdaa33073 (stale) Mirror 13: 0xdaa33073 (stale) Mirror 14: 0xc6b59c69 (stale) Mirror 15: 0x92c0c8a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a15d: skipped 000608 1780991274.328336 trunc from 0x03a15d to 0x02e610 (0xbb4c bytes) 000609 1780991274.342994 write 0x036749 thru 0x037a8d (0x1345 bytes) 000610 1780991274.344326 trunc from 0x037a8e to 0x03ed15 (0x7288 bytes) 000611 1780991274.367675 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ed16): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed16): Mirror 8: 0xe562f9fd (stale) Mirror 10: 0xe562f9fd (stale) Mirror 11: 0xe562f9fd (stale) Mirror 13: 0xe562f9fd (stale) Mirror 14: 0xec5be3eb (stale) Mirror 15: 0x8c58bcd3 (stale) CRC-32 checksum value for chunk [0, 0x3ed16): Mirror 1: 0x65862b6 Mirror 16: 0x65862b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed16: skipped 000613 1780991275.712102 write 0x005ee2 thru 0x00d1a5 (0x72c4 bytes) 000614 1780991275.848393 mapwrite 0x030ed2 thru 0x03f15d (0xe28c bytes) 000615 1780991275.988878 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f15e): Mirror 8: 0x1e416cb (stale) Mirror 10: 0x1e416cb (stale) Mirror 11: 0x1e416cb (stale) Mirror 14: 0xeb169087 (stale) Mirror 15: 0x31e4e758 (stale) Mirror 16: 0xa89d9424 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f15e): Mirror 8: 0x1e416cb (stale) Mirror 10: 0x1e416cb (stale) Mirror 11: 0x1e416cb (stale) Mirror 14: 0xeb169087 (stale) Mirror 15: 0x31e4e758 (stale) Mirror 16: 0xa89d9424 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f15e: skipped 000617 1780991276.514912 mapread 0x0217e6 thru 0x021f09 (0x724 bytes) 000619 1780991276.533018 read 0x012685 thru 0x01e7b3 (0xc12f bytes) 000621 1780991276.555031 trunc from 0x03f15e to 0x019bae (0x255af bytes) 000622 1780991276.598892 trunc from 0x019baf to 0x00ad2b (0xee83 bytes) 000623 1780991276.642091 write 0x020b93 thru 0x02d76f (0xcbdd bytes) 000625 1780991276.665913 read 0x0113a4 thru 0x01bc71 (0xa8ce bytes) 000626 1780991276.707936 trunc from 0x02d770 to 0x02a27c (0x34f3 bytes) 000630 1780991276.742857 trunc from 0x02a27d to 0x022f25 (0x7357 bytes) 000631 1780991276.792202 mapread 0x01203c thru 0x01fb77 (0xdb3c bytes) 000632 1780991276.806021 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22f26): Mirror 8: 0x3480863 (stale) Mirror 10: 0x3480863 (stale) Mirror 11: 0x3480863 (stale) Mirror 14: 0x3480863 (stale) Mirror 15: 0xe2196759 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22f26): Mirror 8: 0x3480863 (stale) Mirror 10: 0x3480863 (stale) Mirror 11: 0x3480863 (stale) Mirror 14: 0x3480863 (stale) Mirror 15: 0xe2196759 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22f26: skipped 000633 1780991277.541336 mapread 0x00e4ef thru 0x012910 (0x4422 bytes) 000634 1780991277.582869 read 0x00b6a2 thru 0x00b898 (0x1f7 bytes) 000635 1780991277.584774 trunc from 0x022f26 to 0x0079e9 (0x1b53c bytes) 000636 1780991277.612459 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x79ea): Mirror 8: 0x2c0f0b30 (stale) Mirror 10: 0x2c0f0b30 (stale) Mirror 14: 0x2c0f0b30 (stale) Mirror 15: 0x2c0f0b30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x79ea): Mirror 8: 0x2c0f0b30 (stale) Mirror 10: 0x2c0f0b30 (stale) Mirror 14: 0x2c0f0b30 (stale) Mirror 15: 0x2c0f0b30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x79ea: skipped 000637 1780991278.256403 write 0x02e23a thru 0x0332ab (0x5072 bytes) 000638 1780991278.257953 mapwrite 0x031391 thru 0x03f035 (0xdca5 bytes) 000640 1780991278.424895 mapwrite 0x00ce8f thru 0x00f279 (0x23eb bytes) 000641 1780991278.578785 mapwrite 0x035c7d thru 0x0390f7 (0x347b bytes) 000643 1780991278.702623 mapwrite 0x035a48 thru 0x03fffa (0xa5b3 bytes) 000646 1780991278.840505 mapwrite 0x03a0a7 thru 0x03ffff (0x5f59 bytes) 000647 1780991278.922117 mapwrite 0x013bfd thru 0x019411 (0x5815 bytes) 000648 1780991279.051632 trunc from 0x040000 to 0x03317a (0xce85 bytes) 000649 1780991279.087476 write 0x03e220 thru 0x03ecaf (0xa90 bytes) 000650 1780991279.091331 mapread 0x029d0c thru 0x03259b (0x8890 bytes) 000652 1780991279.109613 trunc from 0x03ecb0 to 0x00db61 (0x3114e bytes) 000653 1780991279.139243 write 0x02903f thru 0x037d9c (0xed5e bytes) 000654 1780991279.141861 mapwrite 0x01068f thru 0x013da4 (0x3716 bytes) 000655 1780991279.292806 mapwrite 0x0283d9 thru 0x034f96 (0xcbbe bytes) 000656 1780991279.410448 MIRROR_RESYNC 5 mirrors 000657 1780991280.899086 read 0x013e43 thru 0x01ff04 (0xc0c2 bytes) 000659 1780991280.914119 trunc from 0x037d9d to 0x02ab5f (0xd23d bytes) 000661 1780991281.082076 mapwrite 0x0367da thru 0x03ffff (0x9826 bytes) 000662 1780991281.181586 mapwrite 0x003e03 thru 0x00f1a5 (0xb3a3 bytes) 000664 1780991281.286362 MIRROR_RESYNC 5 mirrors 000666 1780991282.527018 write 0x03a922 thru 0x03ffff (0x56de bytes) 000667 1780991282.601647 trunc from 0x040000 to 0x02bde8 (0x14217 bytes) 000668 1780991282.631313 read 0x02b383 thru 0x02bde8 (0xa66 bytes) 000672 1780991282.641129 write 0x01e929 thru 0x01f0ef (0x7c7 bytes) 000674 1780991282.662790 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2bde9): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bde9): Mirror 8: 0x66b54369 (stale) Mirror 10: 0x66b54369 (stale) Mirror 14: 0x66b54369 (stale) Mirror 15: 0x66b54369 (stale) CRC-32 checksum value for chunk [0, 0x2bde9): Mirror 1: 0xce87b90b Mirror 16: 0xce87b90b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bde9: skipped 000675 1780991283.541798 mapread 0x008e2e thru 0x00df3e (0x5111 bytes) 000676 1780991283.593467 mapwrite 0x033e84 thru 0x034c68 (0xde5 bytes) 000677 1780991283.924627 MIRROR_RESYNC 6 mirrors 000680 1780991285.435632 mapwrite 0x00ec9d thru 0x01c225 (0xd589 bytes) 000681 1780991285.703818 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x34c69): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c69): Mirror 8: 0x31401833 (stale) Mirror 10: 0x31401833 (stale) Mirror 14: 0x31401833 (stale) Mirror 15: 0x31401833 (stale) Mirror 16: 0x31401833 (stale) CRC-32 checksum value for chunk [0, 0x34c69): Mirror 1: 0xb9a5cad3 Mirror 17: 0xb9a5cad3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c69: skipped 000685 1780991287.324264 mapwrite 0x03b347 thru 0x03ffff (0x4cb9 bytes) 000686 1780991287.508980 trunc from 0x040000 to 0x021036 (0x1efc9 bytes) 000687 1780991287.549947 mapread 0x007506 thru 0x0127f5 (0xb2f0 bytes) 000689 1780991287.585855 MIRROR_RESYNC 7 mirrors 000690 1780991289.163955 trunc from 0x021037 to 0x012abe (0xe578 bytes) 000691 1780991289.260727 read 0x01038c thru 0x0108fe (0x573 bytes) 000695 1780991289.269538 read 0x010ef3 thru 0x01264a (0x1758 bytes) 000696 1780991289.284331 MIRROR_RESYNC 7 mirrors 000697 1780991290.584370 write 0x00d50d thru 0x0180e3 (0xabd7 bytes) 000699 1780991290.790154 read 0x010591 thru 0x0180e3 (0x7b53 bytes) 000700 1780991290.794923 trunc from 0x0180e4 to 0x010cc7 (0x741c bytes) 000701 1780991290.903564 read 0x001c59 thru 0x00c38d (0xa735 bytes) 000702 1780991290.926990 read 0x00d28a thru 0x010cc7 (0x3a3e bytes) 000703 1780991290.937695 mapread 0x0092b1 thru 0x010cc7 (0x7a17 bytes) 000707 1780991290.943971 mapread 0x0073c6 thru 0x00a5fb (0x3236 bytes) 000708 1780991290.946890 mapread 0x002967 thru 0x00eaa8 (0xc142 bytes) 000709 1780991290.950348 write 0x01a8b6 thru 0x01e1c7 (0x3912 bytes) 000710 1780991290.970258 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e1c8): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e1c8): Mirror 8: 0x6f230cbc (stale) Mirror 10: 0x6f230cbc (stale) Mirror 14: 0x6f230cbc (stale) Mirror 15: 0x6f230cbc (stale) Mirror 16: 0x6f230cbc (stale) Mirror 17: 0x6f230cbc (stale) CRC-32 checksum value for chunk [0, 0x1e1c8): Mirror 1: 0x866598a7 Mirror 18: 0x866598a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e1c8: skipped 000711 1780991292.207426 read 0x0174b6 thru 0x01aac3 (0x360e bytes) 000712 1780991292.226199 mapread 0x0035d8 thru 0x003766 (0x18f bytes) 000713 1780991292.252125 read 0x01e0ee thru 0x01e1c7 (0xda bytes) 000714 1780991292.296861 mapwrite 0x035db2 thru 0x03ffff (0xa24e bytes) 000715 1780991292.715652 MIRROR_RESYNC 8 mirrors 000716 1780991294.384435 mapread 0x001775 thru 0x009114 (0x79a0 bytes) 000718 1780991294.407883 trunc from 0x040000 to 0x037fa7 (0x8058 bytes) 000719 1780991294.485903 mapwrite 0x02d7a0 thru 0x0363a6 (0x8c07 bytes) 000721 1780991294.611916 trunc from 0x037fa8 to 0x00dbb1 (0x2a3f6 bytes) 000723 1780991294.649753 write 0x003bba thru 0x0092c1 (0x5708 bytes) 000724 1780991294.675193 MIRROR_RESYNC 8 mirrors 000725 1780991296.670177 MIRROR_RESYNC 8 mirrors 000727 1780991297.546270 trunc from 0x00dbb2 to 0x03288e (0x24cdd bytes) 000728 1780991297.660082 MIRROR_RESYNC 8 mirrors 000730 1780991300.031945 write 0x02ff6a thru 0x03881d (0x88b4 bytes) 000731 1780991300.145026 write 0x0235cb thru 0x027b35 (0x456b bytes) 000732 1780991300.166723 read 0x012547 thru 0x0136ed (0x11a7 bytes) 000733 1780991300.179762 mapwrite 0x01def9 thru 0x02ad58 (0xce60 bytes) 000734 1780991300.298021 write 0x0140f6 thru 0x01c926 (0x8831 bytes) 000735 1780991300.337711 MIRROR_RESYNC 8 mirrors 000736 1780991302.192852 trunc from 0x03881e to 0x012916 (0x25f07 bytes) 000738 1780991302.398059 MIRROR_RESYNC 8 mirrors 000740 1780991304.290693 write 0x03e4b3 thru 0x03ffff (0x1b4d bytes) 000741 1780991304.458012 write 0x0372b9 thru 0x03ffff (0x8d47 bytes) 000742 1780991304.475809 trunc from 0x040000 to 0x005ad7 (0x3a528 bytes) 000743 1780991304.511051 trunc from 0x005ad8 to 0x02b68a (0x25bb3 bytes) 000745 1780991304.555742 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b68b): Mirror 8: 0xd11f7336 (stale) Mirror 10: 0xd11f7336 (stale) Mirror 14: 0xd11f7336 (stale) Mirror 15: 0xd11f7336 (stale) Mirror 16: 0xd11f7336 (stale) Mirror 17: 0xd11f7336 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b68b): Mirror 8: 0xd11f7336 (stale) Mirror 10: 0xd11f7336 (stale) Mirror 14: 0xd11f7336 (stale) Mirror 15: 0xd11f7336 (stale) Mirror 16: 0xd11f7336 (stale) Mirror 17: 0xd11f7336 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b68b: skipped 000746 1780991305.053525 write 0x02a584 thru 0x037a40 (0xd4bd bytes) 000747 1780991305.059769 read 0x03703a thru 0x037a40 (0xa07 bytes) 000748 1780991305.060400 write 0x013553 thru 0x01b386 (0x7e34 bytes) 000751 1780991305.076339 write 0x00405e thru 0x01363d (0xf5e0 bytes) 000752 1780991305.108184 mapread 0x0029eb thru 0x007567 (0x4b7d bytes) 000754 1780991305.109828 trunc from 0x037a41 to 0x012d3f (0x24d01 bytes) 000756 1780991305.172892 MIRROR_RESYNC 7 mirrors 000757 1780991307.038674 write 0x0309ec thru 0x03ccad (0xc2c2 bytes) 000758 1780991307.113660 write 0x023a76 thru 0x02b41b (0x79a6 bytes) 000759 1780991307.127852 mapread 0x029a80 thru 0x032429 (0x89aa bytes) 000760 1780991307.134704 write 0x035fe1 thru 0x036ea8 (0xec8 bytes) 000761 1780991307.136003 read 0x01ac3a thru 0x01cdea (0x21b1 bytes) 000762 1780991307.144766 read 0x022527 thru 0x029e80 (0x795a bytes) 000763 1780991307.161314 mapwrite 0x039182 thru 0x03ffff (0x6e7e bytes) 000764 1780991307.282687 write 0x016cdd thru 0x01804c (0x1370 bytes) 000766 1780991307.287541 write 0x0030ba thru 0x00a0de (0x7025 bytes) 000767 1780991307.293725 trunc from 0x040000 to 0x0246d3 (0x1b92c bytes) 000768 1780991307.312006 mapread 0x012095 thru 0x02163f (0xf5ab bytes) 000770 1780991307.317397 write 0x0243e8 thru 0x024c60 (0x879 bytes) 000771 1780991307.319030 read 0x01b7eb thru 0x01ffa8 (0x47be bytes) 000772 1780991307.321736 trunc from 0x024c61 to 0x014191 (0x10acf bytes) 000776 1780991307.345710 mapwrite 0x015203 thru 0x01c512 (0x7310 bytes) 000777 1780991307.425527 mapread 0x0050ee thru 0x006825 (0x1738 bytes) 000779 1780991307.433364 MIRROR_RESYNC 7 mirrors 000782 1780991309.642692 write 0x0251ec thru 0x03306b (0xde80 bytes) 000787 1780991309.750900 trunc from 0x03306c to 0x01c64e (0x16a1d bytes) 000789 1780991309.777018 mapread 0x017bb6 thru 0x01c64e (0x4a99 bytes) 000791 1780991309.799874 mapread 0x0025ad thru 0x00e157 (0xbbab bytes) 000794 1780991309.822262 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1c64f): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c64f): Mirror 8: 0xd3b77b7e (stale) Mirror 10: 0xd3b77b7e (stale) Mirror 14: 0xd3b77b7e (stale) Mirror 15: 0xd3b77b7e (stale) Mirror 16: 0xd3b77b7e (stale) Mirror 17: 0xd3b77b7e (stale) CRC-32 checksum value for chunk [0, 0x1c64f): Mirror 1: 0xd3b77b7e Mirror 18: 0xd3b77b7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c64f: skipped 000795 1780991311.622953 read 0x007e57 thru 0x010e10 (0x8fba bytes) 000800 1780991311.747987 mapread 0x01c055 thru 0x01c64e (0x5fa bytes) 000801 1780991311.813775 MIRROR_RESYNC 8 mirrors 000803 1780991313.584922 mapread 0x015b40 thru 0x01948e (0x394f bytes) 000804 1780991313.639718 mapwrite 0x000108 thru 0x00c3e0 (0xc2d9 bytes) 000805 1780991313.977102 read 0x0010bb thru 0x00bb21 (0xaa67 bytes) 000806 1780991313.977801 mapwrite 0x0232d4 thru 0x024aa6 (0x17d3 bytes) 000807 1780991314.222435 mapread 0x00df39 thru 0x013c52 (0x5d1a bytes) 000808 1780991314.254400 mapwrite 0x00944a thru 0x00c430 (0x2fe7 bytes) 000809 1780991314.385597 mapwrite 0x0019b1 thru 0x0050e6 (0x3736 bytes) 000812 1780991314.444537 read 0x01ac76 thru 0x01d50c (0x2897 bytes) 000813 1780991314.455298 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24aa7): Mirror 8: 0x4157e78e (stale) Mirror 10: 0x4157e78e (stale) Mirror 14: 0x4157e78e (stale) Mirror 15: 0x4157e78e (stale) Mirror 16: 0x4157e78e (stale) Mirror 18: 0x4157e78e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24aa7): Mirror 8: 0x4157e78e (stale) Mirror 10: 0x4157e78e (stale) Mirror 14: 0x4157e78e (stale) Mirror 15: 0x4157e78e (stale) Mirror 16: 0x4157e78e (stale) Mirror 18: 0x4157e78e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24aa7: skipped 000814 1780991315.251966 read 0x016512 thru 0x023a5a (0xd549 bytes) 000815 1780991315.293939 trunc from 0x024aa7 to 0x02a14e (0x56a8 bytes) 000816 1780991315.343029 trunc from 0x02a14f to 0x03aa2e (0x108e0 bytes) 000817 1780991315.394763 mapread 0x00cddd thru 0x019140 (0xc364 bytes) 000819 1780991315.436210 read 0x02fe7e thru 0x03aa2e (0xabb1 bytes) 000821 1780991315.467977 write 0x02b13c thru 0x030114 (0x4fd9 bytes) 000823 1780991315.470929 mapread 0x00e9cb thru 0x014ef4 (0x652a bytes) 000824 1780991315.480818 MIRROR_RESYNC 7 mirrors 000825 1780991317.000764 mapwrite 0x030742 thru 0x0319ba (0x1279 bytes) 000826 1780991317.283868 trunc from 0x03aa2f to 0x0253ed (0x15641 bytes) 000827 1780991317.338190 mapwrite 0x003082 thru 0x00d552 (0xa4d1 bytes) 000831 1780991317.461224 mapread 0x017559 thru 0x0189f3 (0x149b bytes) 000832 1780991317.476325 trunc from 0x0253ee to 0x024101 (0x12ec bytes) 000833 1780991317.499685 trunc from 0x024102 to 0x01a9d8 (0x9729 bytes) 000834 1780991317.531525 trunc from 0x01a9d9 to 0x01e22d (0x3855 bytes) 000835 1780991317.551015 read 0x00af51 thru 0x00fd09 (0x4db9 bytes) 000836 1780991317.551753 mapwrite 0x02922e thru 0x02ebb0 (0x5983 bytes) 000837 1780991317.683869 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ebb1): Mirror 8: 0x64456ec5 (stale) Mirror 10: 0x64456ec5 (stale) Mirror 14: 0x64456ec5 (stale) Mirror 15: 0x64456ec5 (stale) Mirror 16: 0x64456ec5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebb1): Mirror 8: 0x64456ec5 (stale) Mirror 10: 0x64456ec5 (stale) Mirror 14: 0x64456ec5 (stale) Mirror 15: 0x64456ec5 (stale) Mirror 16: 0x64456ec5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebb1: skipped 000838 1780991318.385784 read 0x021810 thru 0x02ebb0 (0xd3a1 bytes) 000839 1780991318.400666 trunc from 0x02ebb1 to 0x02ec04 (0x54 bytes) 000840 1780991318.431694 mapwrite 0x027c44 thru 0x0303c4 (0x8781 bytes) 000841 1780991318.629319 trunc from 0x0303c5 to 0x014778 (0x1bc4c bytes) 000842 1780991318.677128 trunc from 0x014779 to 0x02bfef (0x17877 bytes) 000843 1780991318.721840 MIRROR_RESYNC 6 mirrors 000844 1780991320.189364 write 0x005502 thru 0x00c0d4 (0x6bd3 bytes) 000846 1780991320.286797 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2bff0): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bff0): Mirror 8: 0x1c8b638a (stale) Mirror 10: 0x1c8b638a (stale) Mirror 14: 0x1c8b638a (stale) Mirror 15: 0x1c8b638a (stale) Mirror 16: 0x1c8b638a (stale) CRC-32 checksum value for chunk [0, 0x2bff0): Mirror 1: 0x52589ede Mirror 17: 0x52589ede lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bff0: skipped 000848 1780991321.394194 trunc from 0x02bff0 to 0x012e74 (0x1917b bytes) 000849 1780991321.640054 mapwrite 0x02cd07 thru 0x02fd61 (0x305b bytes) 000852 1780991321.857883 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2fd62): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd62): Mirror 8: 0xc0c4610d (stale) Mirror 10: 0xc0c4610d (stale) Mirror 14: 0xc0c4610d (stale) Mirror 15: 0xc0c4610d (stale) Mirror 16: 0xc0c4610d (stale) Mirror 17: 0x9172b58 (stale) CRC-32 checksum value for chunk [0, 0x2fd62): Mirror 1: 0x3bf713b9 Mirror 18: 0x3bf713b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd62: skipped 000855 1780991323.383895 trunc from 0x02fd62 to 0x001c3c (0x2e125 bytes) 000857 1780991323.528661 trunc from 0x001c3d to 0x012e7a (0x1123e bytes) 000858 1780991323.582519 read 0x000f09 thru 0x00b8ce (0xa9c6 bytes) 000860 1780991323.596989 trunc from 0x012e7b to 0x001366 (0x11b14 bytes) 000861 1780991323.643132 read 0x0002e4 thru 0x001366 (0x1083 bytes) 000863 1780991323.671020 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1367): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1367): Mirror 8: 0xd2f48d7e (stale) Mirror 10: 0xd2f48d7e (stale) Mirror 14: 0xd2f48d7e (stale) Mirror 15: 0xd2f48d7e (stale) Mirror 16: 0xd2f48d7e (stale) Mirror 17: 0xd2f48d7e (stale) Mirror 18: 0xd2f48d7e (stale) CRC-32 checksum value for chunk [0, 0x1367): Mirror 1: 0xd2f48d7e Mirror 19: 0xd2f48d7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1367: skipped 000864 1780991325.201920 mapwrite 0x025907 thru 0x0269ac (0x10a6 bytes) 000865 1780991325.476208 MIRROR_RESYNC 9 mirrors 000866 1780991327.519648 read 0x0255e3 thru 0x0269ac (0x13ca bytes) 000870 1780991327.533313 MIRROR_RESYNC 9 mirrors 000871 1780991328.259602 mapread 0x00d570 thru 0x015a02 (0x8493 bytes) 000874 1780991328.285811 mapwrite 0x009a4a thru 0x00e091 (0x4648 bytes) 000876 1780991328.508533 trunc from 0x0269ad to 0x02eb74 (0x81c8 bytes) 000878 1780991328.548965 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2eb75): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eb75): Mirror 8: 0x3a205c3c (stale) Mirror 10: 0x3a205c3c (stale) Mirror 14: 0x3a205c3c (stale) Mirror 15: 0x3a205c3c (stale) Mirror 16: 0x3a205c3c (stale) Mirror 17: 0x3a205c3c (stale) Mirror 18: 0x3a205c3c (stale) Mirror 19: 0x3a205c3c (stale) CRC-32 checksum value for chunk [0, 0x2eb75): Mirror 1: 0xc1f83663 Mirror 20: 0xc1f83663 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eb75: skipped 000880 1780991329.875313 read 0x020dff thru 0x02dae0 (0xcce2 bytes) 000881 1780991329.904671 write 0x014fd1 thru 0x018e65 (0x3e95 bytes) 000882 1780991330.066954 mapwrite 0x03b268 thru 0x03ffff (0x4d98 bytes) 000884 1780991330.278587 MIRROR_RESYNC 10 mirrors 000887 1780991332.320342 read 0x020227 thru 0x020fa4 (0xd7e bytes) 000888 1780991332.327798 write 0x006f84 thru 0x00cb2b (0x5ba8 bytes) 000890 1780991332.435574 mapread 0x000203 thru 0x0019f4 (0x17f2 bytes) 000892 1780991332.447080 write 0x00cf61 thru 0x01cb7c (0xfc1c bytes) 000896 1780991332.458873 trunc from 0x040000 to 0x028758 (0x178a7 bytes) 000897 1780991332.484629 read 0x026685 thru 0x028758 (0x20d4 bytes) 000899 1780991332.497594 write 0x0114e4 thru 0x011cad (0x7ca bytes) 000901 1780991332.498824 write 0x00cd30 thru 0x019ed7 (0xd1a8 bytes) 000902 1780991332.501426 mapread 0x028028 thru 0x028758 (0x731 bytes) 000907 1780991332.505582 mapread 0x00b4e3 thru 0x01b208 (0xfd26 bytes) 000908 1780991332.508342 mapwrite 0x008c94 thru 0x015b7c (0xcee9 bytes) 000910 1780991332.596925 mapread 0x00ec66 thru 0x01903e (0xa3d9 bytes) 000912 1780991332.598675 write 0x025fcf thru 0x02753c (0x156e bytes) 000913 1780991332.604133 mapread 0x0066c4 thru 0x0094a2 (0x2ddf bytes) 000914 1780991332.610627 trunc from 0x028759 to 0x00f1df (0x19579 bytes) 000915 1780991332.642963 trunc from 0x00f1e0 to 0x0028e1 (0xc8fe bytes) 000916 1780991332.668860 write 0x0093ca thru 0x00a76e (0x13a5 bytes) 000918 1780991332.670584 mapwrite 0x024c9b thru 0x032ab7 (0xde1d bytes) 000920 1780991332.843135 trunc from 0x032ab8 to 0x03adb2 (0x82fb bytes) 000921 1780991332.887179 read 0x035396 thru 0x03adb2 (0x5a1d bytes) 000922 1780991332.905685 mapwrite 0x0097d5 thru 0x018524 (0xed50 bytes) 000923 1780991333.078021 MIRROR_RESYNC 10 mirrors 000927 1780991335.077132 mapread 0x004547 thru 0x012cd0 (0xe78a bytes) 000928 1780991335.104383 trunc from 0x03adb3 to 0x03895b (0x2457 bytes) 000930 1780991335.225843 write 0x00e106 thru 0x01918d (0xb088 bytes) 000932 1780991335.303216 write 0x02c54d thru 0x03176d (0x5221 bytes) 000933 1780991335.336643 write 0x001776 thru 0x00efb0 (0xd83b bytes) 000936 1780991335.373108 read 0x017e7e thru 0x01b98e (0x3b11 bytes) 000940 1780991335.393667 read 0x038155 thru 0x03895b (0x807 bytes) 000944 1780991335.411126 read 0x0221bd thru 0x030f0d (0xed51 bytes) 000945 1780991335.425917 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0xfea31cf4 (stale) Mirror 10: 0xfea31cf4 (stale) Mirror 14: 0xfea31cf4 (stale) Mirror 15: 0xfea31cf4 (stale) Mirror 16: 0xfea31cf4 (stale) Mirror 18: 0xfea31cf4 (stale) Mirror 19: 0xfea31cf4 (stale) Mirror 20: 0xfea31cf4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0xfea31cf4 (stale) Mirror 10: 0xfea31cf4 (stale) Mirror 14: 0xfea31cf4 (stale) Mirror 15: 0xfea31cf4 (stale) Mirror 16: 0xfea31cf4 (stale) Mirror 18: 0xfea31cf4 (stale) Mirror 19: 0xfea31cf4 (stale) Mirror 20: 0xfea31cf4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3895c: skipped 000948 1780991336.300594 read 0x013fc0 thru 0x01fa36 (0xba77 bytes) 000949 1780991336.315597 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0xfea31cf4 (stale) Mirror 10: 0xfea31cf4 (stale) Mirror 14: 0xfea31cf4 (stale) Mirror 15: 0xfea31cf4 (stale) Mirror 16: 0xfea31cf4 (stale) Mirror 18: 0xfea31cf4 (stale) Mirror 19: 0xfea31cf4 (stale) Mirror 20: 0xfea31cf4 (stale) CRC-32 checksum value for chunk [0, 0x3895c): Mirror 1: 0x10476494 Mirror 21: 0x10476494 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3895c: skipped 000952 1780991337.777132 mapread 0x0297dd thru 0x034bda (0xb3fe bytes) 000954 1780991337.847313 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0xfea31cf4 (stale) Mirror 10: 0xfea31cf4 (stale) Mirror 14: 0xfea31cf4 (stale) Mirror 15: 0xfea31cf4 (stale) Mirror 16: 0xfea31cf4 (stale) Mirror 18: 0xfea31cf4 (stale) Mirror 19: 0xfea31cf4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0xfea31cf4 (stale) Mirror 10: 0xfea31cf4 (stale) Mirror 14: 0xfea31cf4 (stale) Mirror 15: 0xfea31cf4 (stale) Mirror 16: 0xfea31cf4 (stale) Mirror 18: 0xfea31cf4 (stale) Mirror 19: 0xfea31cf4 (stale) CRC-32 checksum value for chunk [0, 0x3895c): Mirror 1: 0x10476494 Mirror 21: 0x10476494 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3895c: skipped 000955 1780991339.038067 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0xfea31cf4 (stale) Mirror 10: 0xfea31cf4 (stale) Mirror 14: 0xfea31cf4 (stale) Mirror 15: 0xfea31cf4 (stale) Mirror 16: 0xfea31cf4 (stale) Mirror 18: 0xfea31cf4 (stale) Mirror 19: 0xfea31cf4 (stale) CRC-32 checksum value for chunk [0, 0x3895c): Mirror 1: 0x10476494 Mirror 21: 0x10476494 Mirror 22: 0x10476494 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3895c: skipped 000957 1780991340.381247 mapwrite 0x0304e8 thru 0x033cb4 (0x37cd bytes) 000959 1780991340.628730 MIRROR_RESYNC 10 mirrors 000962 1780991342.721385 mapread 0x03594f thru 0x03895b (0x300d bytes) 000966 1780991342.759142 write 0x02a20a thru 0x02efde (0x4dd5 bytes) 000968 1780991342.878107 mapwrite 0x0177e7 thru 0x021587 (0x9da1 bytes) 000970 1780991342.969410 write 0x008ce8 thru 0x00e4b1 (0x57ca bytes) 000971 1780991342.983643 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3895c): Mirror 8: 0x17bf966 (stale) Mirror 10: 0x17bf966 (stale) Mirror 14: 0x17bf966 (stale) Mirror 15: 0x17bf966 (stale) Mirror 16: 0x17bf966 (stale) Mirror 18: 0x17bf966 (stale) Mirror 19: 0x17bf966 (stale) Mirror 21: 0x17bf966 (stale) Mirror 22: 0x17bf966 (stale) CRC-32 checksum value for chunk [0, 0x3895c): Mirror 1: 0x546fe9cb Mirror 23: 0x546fe9cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3895c: skipped 000973 1780991344.057243 write 0x00ed0e thru 0x013e2d (0x5120 bytes) 000974 1780991344.253792 write 0x03b60d thru 0x03ffff (0x49f3 bytes) 000975 1780991344.262556 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x424e9c8a (stale) Mirror 14: 0x424e9c8a (stale) Mirror 15: 0x424e9c8a (stale) Mirror 16: 0x424e9c8a (stale) Mirror 18: 0x424e9c8a (stale) Mirror 19: 0x424e9c8a (stale) Mirror 21: 0x424e9c8a (stale) Mirror 22: 0x424e9c8a (stale) Mirror 23: 0x8a5ce120 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x424e9c8a (stale) Mirror 14: 0x424e9c8a (stale) Mirror 15: 0x424e9c8a (stale) Mirror 16: 0x424e9c8a (stale) Mirror 18: 0x424e9c8a (stale) Mirror 19: 0x424e9c8a (stale) Mirror 21: 0x424e9c8a (stale) Mirror 22: 0x424e9c8a (stale) Mirror 23: 0x8a5ce120 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000976 1780991345.050549 mapwrite 0x033283 thru 0x039186 (0x5f04 bytes) 000977 1780991345.242394 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x424e9c8a (stale) Mirror 14: 0x424e9c8a (stale) Mirror 15: 0x424e9c8a (stale) Mirror 16: 0x424e9c8a (stale) Mirror 18: 0x424e9c8a (stale) Mirror 19: 0x424e9c8a (stale) Mirror 21: 0x424e9c8a (stale) Mirror 22: 0x424e9c8a (stale) Mirror 23: 0x8a5ce120 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c0b21d Mirror 24: 0x1c0b21d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000978 1780991346.392777 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x424e9c8a (stale) Mirror 14: 0x424e9c8a (stale) Mirror 15: 0x424e9c8a (stale) Mirror 16: 0x424e9c8a (stale) Mirror 18: 0x424e9c8a (stale) Mirror 19: 0x424e9c8a (stale) Mirror 21: 0x424e9c8a (stale) Mirror 22: 0x424e9c8a (stale) Mirror 23: 0x8a5ce120 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c0b21d Mirror 24: 0x1c0b21d Mirror 25: 0x1c0b21d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000979 1780991347.672200 mapread 0x02f602 thru 0x03e5a1 (0xefa0 bytes) 000980 1780991347.710838 write 0x015047 thru 0x015be2 (0xb9c bytes) 000983 1780991347.835769 mapwrite 0x020bc0 thru 0x0238cc (0x2d0d bytes) 000984 1780991347.941562 mapwrite 0x021de6 thru 0x026692 (0x48ad bytes) 000985 1780991347.989635 trunc from 0x040000 to 0x02da3f (0x125c0 bytes) 000986 1780991348.042832 mapread 0x01de98 thru 0x027953 (0x9abc bytes) 000987 1780991348.044192 read 0x022c45 thru 0x023cc4 (0x1080 bytes) 000988 1780991348.044844 write 0x03307a thru 0x03c531 (0x94b8 bytes) 000989 1780991348.052606 mapread 0x02ac3c thru 0x035763 (0xab28 bytes) 000991 1780991348.065008 write 0x025500 thru 0x032060 (0xcb61 bytes) 000995 1780991348.091257 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x109:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c532): Mirror 10: 0x70931d9d (stale) Mirror 14: 0x70931d9d (stale) Mirror 15: 0x70931d9d (stale) Mirror 16: 0x70931d9d (stale) Mirror 18: 0x70931d9d (stale) Mirror 19: 0x70931d9d (stale) Mirror 21: 0x70931d9d (stale) Mirror 22: 0x70931d9d (stale) Mirror 24: 0xe1ed5179 (stale) Mirror 25: 0xe1ed5179 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c532): Mirror 10: 0x70931d9d (stale) Mirror 14: 0x70931d9d (stale) Mirror 15: 0x70931d9d (stale) Mirror 16: 0x70931d9d (stale) Mirror 18: 0x70931d9d (stale) Mirror 19: 0x70931d9d (stale) Mirror 21: 0x70931d9d (stale) Mirror 22: 0x70931d9d (stale) Mirror 24: 0xe1ed5179 (stale) Mirror 25: 0xe1ed5179 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c532: skipped 000997 1780991348.735423 mapwrite 0x03955d thru 0x03ae2c (0x18d0 bytes) 000998 1780991348.832586 trunc from 0x03c532 to 0x017ce4 (0x2484d bytes) 000999 1780991348.856213 write 0x03af0a thru 0x03ffff (0x50f6 bytes) 001000 1780991348.857425 read 0x008481 thru 0x01710a (0xec8a bytes) All operations completed A-OK!