== sanity-flr test 70a: flr mode fsx test ================ 10:41:00 (1788360060) Seed set to 61 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x13821 000001 1788360062.137698 trunc from 00000000 to 0x013820 (0x13821 bytes) 000003 1788360062.156280 mapwrite 0x00840d thru 0x012839 (0xa42d bytes) 000004 1788360062.214062 mapwrite 0x00840b thru 0x010cd5 (0x88cb bytes) 000010 1788360062.251605 mapwrite 0x02200c thru 0x0235a5 (0x159a bytes) 000011 1788360062.322240 write 0x02d40a thru 0x034b3c (0x7733 bytes) 000012 1788360062.323571 mapwrite 0x0300fd thru 0x03dbad (0xdab1 bytes) 000013 1788360062.399126 mapwrite 0x012f69 thru 0x016f8c (0x4024 bytes) truncating to largest ever: 0x386aa 000014 1788360062.475108 trunc from 0x03dbae to 0x0386a9 (0x5504 bytes) 000016 1788360062.508941 read 0x02ac37 thru 0x033f04 (0x92ce bytes) 000017 1788360062.517810 write 0x03294d thru 0x03e027 (0xb6db bytes) 000020 1788360062.536676 read 0x0163b2 thru 0x018cf8 (0x2947 bytes) 000022 1788360062.539218 trunc from 0x03e028 to 0x025a0e (0x18619 bytes) 000025 1788360062.571530 mapread 0x0232a3 thru 0x025a0e (0x276c bytes) 000027 1788360062.597227 read 0x00d396 thru 0x00db84 (0x7ef bytes) 000032 1788360062.608241 mapread 0x0005a3 thru 0x009e00 (0x985e bytes) 000034 1788360062.612154 write 0x03b509 thru 0x03ffff (0x4af7 bytes) 000036 1788360062.614309 mapwrite 0x006c26 thru 0x00d859 (0x6c34 bytes) 000040 1788360062.674213 write 0x01a1e6 thru 0x01f557 (0x5372 bytes) 000041 1788360062.675618 trunc from 0x040000 to 0x02c801 (0x137fe bytes) 000042 1788360062.694315 trunc from 0x02c802 to 0x035e67 (0x9666 bytes) 000043 1788360062.711019 write 0x017dbd thru 0x0267d4 (0xea18 bytes) truncating to largest ever: 0x3ce2f 000044 1788360062.717365 trunc from 0x035e68 to 0x03ce2e (0x6fc7 bytes) 000049 1788360062.735368 write 0x0017b7 thru 0x003034 (0x187e bytes) 000051 1788360062.737988 mapwrite 0x0388f2 thru 0x03ffff (0x770e bytes) 000053 1788360062.823902 MIRROR_EXTEND to 2 mirrors 000055 1788360063.290956 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) 000056 1788360063.438158 mapread 0x01d20d thru 0x02089a (0x368e bytes) 000059 1788360063.466447 write 0x010bc5 thru 0x01d752 (0xcb8e bytes) 000061 1788360063.490032 read 0x036968 thru 0x03c721 (0x5dba bytes) 000062 1788360063.499633 mapread 0x001b83 thru 0x005369 (0x37e7 bytes) 000063 1788360063.509686 mapwrite 0x017ef3 thru 0x027af9 (0xfc07 bytes) 000064 1788360063.574534 mapread 0x028e99 thru 0x0314f2 (0x865a bytes) 000065 1788360063.585065 trunc from 0x040000 to 0x02ec4d (0x113b2 bytes) 000067 1788360063.604973 mapwrite 0x012713 thru 0x01a75b (0x8049 bytes) 000070 1788360063.686567 trunc from 0x02ec4e to 0x02f2cc (0x67f bytes) 000072 1788360063.720522 mapread 0x003fce thru 0x010f7d (0xcfb0 bytes) 000076 1788360063.731237 read 0x006c62 thru 0x012258 (0xb5f7 bytes) 000078 1788360063.734996 write 0x03a91a thru 0x03ffff (0x56e6 bytes) 000079 1788360063.741467 trunc from 0x040000 to 0x010b97 (0x2f468 bytes) 000080 1788360063.758265 trunc from 0x010b98 to 0x023646 (0x12aaf bytes) 000081 1788360063.798505 write 0x027034 thru 0x02846c (0x1439 bytes) 000084 1788360063.801654 read 0x0266a7 thru 0x02846c (0x1dc6 bytes) 000085 1788360063.828912 mapwrite 0x005271 thru 0x00926a (0x3ffa bytes) 000091 1788360063.910499 read 0x001beb thru 0x003460 (0x1876 bytes) 000093 1788360063.911932 read 0x018acb thru 0x0224ee (0x9a24 bytes) 000098 1788360063.925202 mapwrite 0x0385a3 thru 0x03ffff (0x7a5d bytes) 000100 1788360064.029297 mapwrite 0x01c5d2 thru 0x01edaf (0x27de bytes) 000101 1788360064.091575 MIRROR_EXTEND to 2 mirrors 000103 1788360064.583059 MIRROR_EXTEND to 3 mirrors 000107 1788360065.069066 mapread 0x03e03a thru 0x03ffff (0x1fc6 bytes) 000110 1788360065.093911 write 0x0093c2 thru 0x012708 (0x9347 bytes) 000111 1788360065.171304 read 0x024f83 thru 0x029545 (0x45c3 bytes) 000112 1788360065.188424 mapwrite 0x02ff01 thru 0x033eb4 (0x3fb4 bytes) 000115 1788360065.245666 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd338cc45 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd338cc45 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000116 1788360065.500125 mapread 0x0119d3 thru 0x01e932 (0xcf60 bytes) 000117 1788360065.524882 read 0x03f4ae thru 0x03ffff (0xb52 bytes) 000118 1788360065.533865 MIRROR_RESYNC 2 mirrors 000119 1788360066.429246 mapread 0x015edd thru 0x020581 (0xa6a5 bytes) 000120 1788360066.486237 trunc from 0x040000 to 0x036416 (0x9be9 bytes) 000122 1788360066.579049 read 0x019c94 thru 0x02397c (0x9ce9 bytes) 000124 1788360066.588118 write 0x03f5cb thru 0x03ffff (0xa35 bytes) 000125 1788360066.592826 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) 000126 1788360066.733368 mapread 0x0353d2 thru 0x035d97 (0x9c6 bytes) 000130 1788360066.744110 write 0x00879e thru 0x014c23 (0xc486 bytes) 000138 1788360066.761723 mapread 0x015440 thru 0x01d000 (0x7bc1 bytes) 000140 1788360066.780041 write 0x018ea2 thru 0x021622 (0x8781 bytes) 000141 1788360066.789896 mapread 0x0322f0 thru 0x0379c6 (0x56d7 bytes) 000142 1788360066.798002 mapread 0x01c04d thru 0x022ff0 (0x6fa4 bytes) 000145 1788360066.813206 MIRROR_EXTEND to 2 mirrors 000147 1788360067.360301 read 0x02a96c thru 0x02f285 (0x491a bytes) 000148 1788360067.375961 read 0x018137 thru 0x01c858 (0x4722 bytes) 000151 1788360067.389011 read 0x02d575 thru 0x0379d3 (0xa45f bytes) 000152 1788360067.391791 trunc from 0x040000 to 0x024fb3 (0x1b04c bytes) 000153 1788360067.438156 read 0x01fc60 thru 0x021980 (0x1d21 bytes) 000154 1788360067.443880 mapwrite 0x032841 thru 0x0338ab (0x106b bytes) 000155 1788360067.490603 read 0x02f318 thru 0x0320ab (0x2d94 bytes) 000156 1788360067.491099 read 0x016bbf thru 0x01d0ab (0x64ed bytes) 000158 1788360067.491997 write 0x020067 thru 0x02ded8 (0xde72 bytes) 000160 1788360067.493691 write 0x03f321 thru 0x03ffff (0xcdf bytes) 000162 1788360067.495199 mapread 0x00dc82 thru 0x014826 (0x6ba5 bytes) 000165 1788360067.496594 read 0x005102 thru 0x010ef4 (0xbdf3 bytes) 000166 1788360067.497116 mapwrite 0x029b49 thru 0x032781 (0x8c39 bytes) 000169 1788360067.545199 trunc from 0x040000 to 0x01cfe1 (0x2301e bytes) 000170 1788360067.559538 trunc from 0x01cfe2 to 0x0169f3 (0x65ee bytes) 000172 1788360067.571742 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x169f4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x169f4): Mirror 2: 0x1eb1a4d8 (stale) CRC-32 checksum value for chunk [0, 0x169f4): Mirror 1: 0x1eb1a4d8 Mirror 3: 0x1eb1a4d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x169f4: skipped 000173 1788360068.176252 trunc from 0x0169f4 to 0x030b6b (0x1a178 bytes) 000177 1788360068.303834 mapread 0x017c0c thru 0x026c1a (0xf00f bytes) 000178 1788360068.339191 mapread 0x0265cc thru 0x030610 (0xa045 bytes) 000180 1788360068.350157 write 0x028c1e thru 0x03177b (0x8b5e bytes) 000183 1788360068.354701 trunc from 0x03177c to 0x031e60 (0x6e5 bytes) 000185 1788360068.377270 read 0x005ec4 thru 0x00660f (0x74c bytes) 000186 1788360068.383397 mapread 0x01760f thru 0x020872 (0x9264 bytes) 000188 1788360068.385116 mapwrite 0x00a2b5 thru 0x018d05 (0xea51 bytes) 000190 1788360068.443675 trunc from 0x031e61 to 0x00bf6f (0x25ef1 bytes) 000193 1788360068.458168 trunc from 0x00bf70 to 0x00c767 (0x7f8 bytes) 000194 1788360068.469342 mapread 0x0002ac thru 0x00783d (0x7592 bytes) 000195 1788360068.475795 mapwrite 0x00c90d thru 0x00f767 (0x2e5b bytes) 000197 1788360068.524940 write 0x03d232 thru 0x03edb1 (0x1b80 bytes) 000198 1788360068.526275 read 0x005e5e thru 0x011e12 (0xbfb5 bytes) 000199 1788360068.533515 write 0x01e7a1 thru 0x02ad41 (0xc5a1 bytes) 000200 1788360068.534906 trunc from 0x03edb2 to 0x03ab44 (0x426d bytes) 000201 1788360068.551551 read 0x037a57 thru 0x038eb1 (0x145b bytes) 000202 1788360068.552279 trunc from 0x03ab45 to 0x004d94 (0x35db0 bytes) 000203 1788360068.570230 write 0x02e469 thru 0x032126 (0x3cbe bytes) 000204 1788360068.573146 read 0x03112d thru 0x032126 (0xffa bytes) 000207 1788360068.576026 write 0x02ad21 thru 0x02b84b (0xb2b bytes) 000208 1788360068.588331 read 0x0192e4 thru 0x0267ee (0xd50b bytes) 000211 1788360068.593169 read 0x02a224 thru 0x02fb0b (0x58e8 bytes) 000212 1788360068.598644 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32127): Mirror 3: 0x39c86f9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32127): Mirror 3: 0x39c86f9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32127: skipped 000213 1788360068.918366 MIRROR_RESYNC 2 mirrors 000217 1788360069.579457 mapwrite 0x01d719 thru 0x022b8c (0x5474 bytes) 000219 1788360069.690928 trunc from 0x032127 to 0x006732 (0x2b9f4 bytes) 000222 1788360069.705448 mapread 0x00345a thru 0x006732 (0x32d9 bytes) 000223 1788360069.713620 mapwrite 0x0396ca thru 0x03ffff (0x6936 bytes) 000224 1788360069.786795 write 0x006595 thru 0x008d01 (0x276d bytes) 000227 1788360069.798322 MIRROR_RESYNC 2 mirrors 000228 1788360070.392112 write 0x023fb7 thru 0x0337d0 (0xf81a bytes) 000229 1788360070.451834 trunc from 0x040000 to 0x007993 (0x3866c bytes) 000233 1788360070.479244 mapwrite 0x007f75 thru 0x0128d1 (0xa95d bytes) 000236 1788360070.572679 trunc from 0x0128d2 to 0x012b19 (0x248 bytes) 000238 1788360070.588941 trunc from 0x012b1a to 0x0330d6 (0x205bd bytes) 000239 1788360070.604658 read 0x00de46 thru 0x013e21 (0x5fdc bytes) 000244 1788360070.622102 mapread 0x022eb4 thru 0x029254 (0x63a1 bytes) 000245 1788360070.633664 write 0x023de7 thru 0x026bb2 (0x2dcc bytes) 000248 1788360070.636112 mapwrite 0x00b90e thru 0x017808 (0xbefb bytes) 000249 1788360070.685857 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x330d7): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x330d7): Mirror 3: 0x7c4abcf9 (stale) CRC-32 checksum value for chunk [0, 0x330d7): Mirror 1: 0x14063b9b Mirror 4: 0x14063b9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x330d7: skipped 000250 1788360071.408745 write 0x025f66 thru 0x028426 (0x24c1 bytes) 000252 1788360071.490184 mapwrite 0x00b201 thru 0x00be90 (0xc90 bytes) 000253 1788360071.524534 mapread 0x02e237 thru 0x0330d6 (0x4ea0 bytes) 000254 1788360071.533837 mapwrite 0x03c026 thru 0x03ffff (0x3fda bytes) 000255 1788360071.599343 mapread 0x015115 thru 0x020c4c (0xbb38 bytes) 000256 1788360071.626077 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4fc5547d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4fc5547d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000258 1788360071.804943 mapread 0x02aedd thru 0x036bc4 (0xbce8 bytes) 000259 1788360071.848317 mapwrite 0x024b21 thru 0x02d88c (0x8d6c bytes) 000262 1788360071.918046 read 0x02ff1e thru 0x034496 (0x4579 bytes) 000263 1788360071.919506 read 0x0354e3 thru 0x03830d (0x2e2b bytes) 000266 1788360071.921467 mapwrite 0x001261 thru 0x007127 (0x5ec7 bytes) 000268 1788360071.979743 mapwrite 0x0229aa thru 0x02dd40 (0xb397 bytes) 000269 1788360072.040980 mapwrite 0x03168c thru 0x03271b (0x1090 bytes) 000272 1788360072.077808 mapwrite 0x02eb52 thru 0x035295 (0x6744 bytes) 000274 1788360072.117635 mapread 0x01a595 thru 0x01b083 (0xaef bytes) 000276 1788360072.119131 mapread 0x014bba thru 0x0175a9 (0x29f0 bytes) 000279 1788360072.122335 write 0x03bd25 thru 0x03ffff (0x42db bytes) 000280 1788360072.123827 mapwrite 0x01c9cd thru 0x01efdf (0x2613 bytes) 000281 1788360072.178748 trunc from 0x040000 to 0x02aa6b (0x15594 bytes) 000283 1788360072.190230 mapread 0x0230a5 thru 0x02aa6b (0x79c7 bytes) 000284 1788360072.191829 mapread 0x01a13a thru 0x01cf02 (0x2dc9 bytes) 000285 1788360072.193062 mapwrite 0x01f6bc thru 0x02495a (0x529f bytes) 000286 1788360072.229788 trunc from 0x02aa6c to 0x008f73 (0x21af8 bytes) 000291 1788360072.252070 mapwrite 0x01362e thru 0x01b213 (0x7be6 bytes) 000292 1788360072.346528 write 0x00d6c7 thru 0x011a28 (0x4362 bytes) 000294 1788360072.358288 trunc from 0x01b214 to 0x03735f (0x1c14c bytes) 000295 1788360072.371613 mapwrite 0x0108f1 thru 0x01bc55 (0xb365 bytes) 000296 1788360072.415121 write 0x021d59 thru 0x02738b (0x5633 bytes) 000297 1788360072.422433 trunc from 0x037360 to 0x03c5ad (0x524e bytes) 000299 1788360072.444960 MIRROR_RESYNC 2 mirrors 000301 1788360073.059926 write 0x00e262 thru 0x01b6b9 (0xd458 bytes) 000302 1788360073.108716 mapwrite 0x02d34b thru 0x03a3de (0xd094 bytes) 000305 1788360073.172351 mapwrite 0x00dcc3 thru 0x0183c1 (0xa6ff bytes) 000307 1788360073.205320 read 0x03b49c thru 0x03b697 (0x1fc bytes) 000308 1788360073.206682 trunc from 0x03c5ae to 0x02ba33 (0x10b7a bytes) 000309 1788360073.224502 mapread 0x01c9e1 thru 0x02b9cf (0xefef bytes) 000312 1788360073.243101 trunc from 0x02ba34 to 0x010c71 (0x1adc2 bytes) 000314 1788360073.260093 mapwrite 0x035d45 thru 0x03f217 (0x94d3 bytes) 000315 1788360073.325136 read 0x003b0f thru 0x00a544 (0x6a36 bytes) 000325 1788360073.343957 write 0x00819c thru 0x016e6e (0xecd3 bytes) 000326 1788360073.348413 MIRROR_RESYNC 2 mirrors 000328 1788360073.878377 trunc from 0x03f218 to 0x023a4e (0x1b7c9 bytes) 000331 1788360073.940683 read 0x01ca33 thru 0x0203f9 (0x39c7 bytes) 000332 1788360073.947432 read 0x00deed thru 0x00e45f (0x573 bytes) 000334 1788360073.954392 trunc from 0x023a4f to 0x026c60 (0x3212 bytes) 000335 1788360073.964746 write 0x02fd34 thru 0x035093 (0x5360 bytes) 000339 1788360073.970725 write 0x024941 thru 0x027e5c (0x351c bytes) 000340 1788360073.975667 mapread 0x00ddc9 thru 0x01d1d5 (0xf40d bytes) 000342 1788360073.976981 mapread 0x02427e thru 0x028696 (0x4419 bytes) 000345 1788360073.979349 write 0x0026ef thru 0x00726c (0x4b7e bytes) 000346 1788360073.980272 trunc from 0x035094 to 0x0117c0 (0x238d3 bytes) 000348 1788360073.993037 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) 000349 1788360074.086723 mapread 0x000bc3 thru 0x00932e (0x876c bytes) 000350 1788360074.106812 trunc from 0x0117c1 to 0x00c651 (0x516f bytes) 000351 1788360074.118276 mapread 0x006525 thru 0x00c651 (0x612d bytes) 000352 1788360074.119333 mapwrite 0x02b3b0 thru 0x036f28 (0xbb79 bytes) 000354 1788360074.162870 write 0x03590b thru 0x0359c3 (0xb9 bytes) 000358 1788360074.165097 mapwrite 0x009f08 thru 0x017a82 (0xdb7b bytes) 000360 1788360074.214861 MIRROR_EXTEND to 2 mirrors 000361 1788360074.628381 read 0x030b4c thru 0x036f28 (0x63dd bytes) 000362 1788360074.637711 MIRROR_EXTEND to 3 mirrors 000363 1788360075.084054 mapread 0x00112b thru 0x00707a (0x5f50 bytes) 000365 1788360075.115350 mapread 0x00faee thru 0x018e27 (0x933a bytes) 000370 1788360075.152341 MIRROR_RESYNC 3 mirrors 000371 1788360075.420230 mapread 0x0183be thru 0x01ad94 (0x29d7 bytes) 000372 1788360075.435409 MIRROR_EXTEND to 4 mirrors 000373 1788360076.030495 read 0x02c17c thru 0x032186 (0x600b bytes) 000374 1788360076.043625 mapread 0x0085e7 thru 0x0178b4 (0xf2ce bytes) 000375 1788360076.080718 mapread 0x01f37e thru 0x025f24 (0x6ba7 bytes) 000376 1788360076.092713 mapread 0x0056c9 thru 0x0127bb (0xd0f3 bytes) 000378 1788360076.094754 write 0x02a41c thru 0x02fb53 (0x5738 bytes) 000380 1788360076.168657 trunc from 0x036f29 to 0x009cd4 (0x2d254 bytes) 000381 1788360076.206380 MIRROR_RESYNC 4 mirrors 000382 1788360076.908908 mapread 0x00588b thru 0x009cd4 (0x444a bytes) 000383 1788360076.924869 write 0x034f2a thru 0x03884d (0x3924 bytes) 000385 1788360076.976130 mapread 0x030853 thru 0x036c4d (0x63fb bytes) 000387 1788360076.985710 MIRROR_RESYNC 4 mirrors 000388 1788360077.833748 mapwrite 0x019c14 thru 0x01f869 (0x5c56 bytes) 000389 1788360077.966041 mapread 0x00e029 thru 0x0187ec (0xa7c4 bytes) 000391 1788360077.982059 trunc from 0x03884e to 0x0223ee (0x1645f bytes) 000393 1788360078.011825 mapwrite 0x019c90 thru 0x01dc56 (0x3fc7 bytes) 000396 1788360078.041038 write 0x02875f thru 0x033615 (0xaeb7 bytes) 000397 1788360078.042170 mapread 0x020b56 thru 0x023de4 (0x328f bytes) 000398 1788360078.052374 mapwrite 0x0285d6 thru 0x028d8f (0x7ba bytes) 000399 1788360078.098576 mapwrite 0x021245 thru 0x02acc8 (0x9a84 bytes) 000401 1788360078.137372 read 0x030856 thru 0x033615 (0x2dc0 bytes) 000402 1788360078.138107 mapread 0x0108fe thru 0x01587b (0x4f7e bytes) 000404 1788360078.140961 mapread 0x00679e thru 0x012a95 (0xc2f8 bytes) 000405 1788360078.153578 mapwrite 0x03a84f thru 0x03da59 (0x320b bytes) 000408 1788360078.219906 trunc from 0x03da5a to 0x02bbb6 (0x11ea3 bytes) 000409 1788360078.238720 MIRROR_RESYNC 4 mirrors 000411 1788360079.034028 write 0x008a81 thru 0x0129d9 (0x9f59 bytes) 000412 1788360079.090534 mapwrite 0x02b0da thru 0x034a1a (0x9941 bytes) 000413 1788360079.170524 mapread 0x00e15b thru 0x018f14 (0xadba bytes) 000415 1788360079.183016 mapwrite 0x021e44 thru 0x030f2b (0xf0e8 bytes) 000417 1788360079.241667 mapread 0x0256c4 thru 0x02730d (0x1c4a bytes) 000418 1788360079.243061 write 0x03d478 thru 0x03ffff (0x2b88 bytes) 000419 1788360079.244038 read 0x03241d thru 0x03f07a (0xcc5e bytes) 000420 1788360079.250609 read 0x02adc9 thru 0x02de29 (0x3061 bytes) 000421 1788360079.251185 read 0x01dccc thru 0x0200d5 (0x240a bytes) 000424 1788360079.252750 read 0x0316fa thru 0x0325b2 (0xeb9 bytes) 000426 1788360079.256329 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb6748e57 (stale) Mirror 3: 0xb6748e57 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb6748e57 (stale) Mirror 3: 0xb6748e57 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000427 1788360079.474887 read 0x01a3b6 thru 0x01e061 (0x3cac bytes) 000429 1788360079.481033 mapread 0x03acf4 thru 0x03ffff (0x530c bytes) 000431 1788360079.502031 read 0x037624 thru 0x03ffff (0x89dc bytes) 000432 1788360079.503400 trunc from 0x040000 to 0x018723 (0x278dc bytes) 000434 1788360079.520438 mapwrite 0x02862a thru 0x02c887 (0x425e bytes) 000435 1788360079.612088 MIRROR_RESYNC 3 mirrors 000437 1788360080.205320 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) 000439 1788360080.484594 trunc from 0x02c888 to 0x02ce91 (0x60a bytes) 000440 1788360080.567976 trunc from 0x02ce92 to 0x0060b6 (0x26ddb bytes) 000441 1788360080.590549 mapread 0x004534 thru 0x0060b6 (0x1b83 bytes) 000442 1788360080.612371 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x60b7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x60b7): Mirror 2: 0x7d0e6864 (stale) CRC-32 checksum value for chunk [0, 0x60b7): Mirror 1: 0x7d0e6864 Mirror 3: 0x7d0e6864 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x60b7: skipped 000443 1788360081.167140 trunc from 0x0060b7 to 0x016606 (0x10550 bytes) truncating to largest ever: 0x3e5d9 000444 1788360081.278815 trunc from 0x016607 to 0x03e5d8 (0x27fd2 bytes) 000450 1788360081.299122 write 0x02bc02 thru 0x03ab9d (0xef9c bytes) 000454 1788360081.319118 read 0x02d9b4 thru 0x0336ca (0x5d17 bytes) 000455 1788360081.320631 trunc from 0x03e5d9 to 0x0008a2 (0x3dd36 bytes) 000457 1788360081.354020 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x8a3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8a3): Mirror 2: 0x1179b321 (stale) Mirror 3: 0x1179b321 (stale) CRC-32 checksum value for chunk [0, 0x8a3): Mirror 1: 0x1179b321 Mirror 4: 0x1179b321 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8a3: skipped 000458 1788360081.974669 mapread 0x0005a6 thru 0x0008a2 (0x2fd bytes) 000459 1788360081.979831 read 0x000402 thru 0x0008a2 (0x4a1 bytes) 000462 1788360081.980927 mapread 0x0004d9 thru 0x0008a2 (0x3ca bytes) 000463 1788360081.981591 write 0x0289f7 thru 0x030ef5 (0x84ff bytes) 000464 1788360082.049017 write 0x02a95b thru 0x02e7c3 (0x3e69 bytes) 000465 1788360082.050351 mapwrite 0x0260c1 thru 0x02dee0 (0x7e20 bytes) 000466 1788360082.106069 read 0x01348e thru 0x01468a (0x11fd bytes) 000468 1788360082.121833 mapread 0x01db6c thru 0x02db27 (0xffbc bytes) 000469 1788360082.123870 write 0x0203a1 thru 0x02a050 (0x9cb0 bytes) 000470 1788360082.125507 write 0x007fc6 thru 0x015034 (0xd06f bytes) 000474 1788360082.129617 write 0x02c2ad thru 0x02e1aa (0x1efe bytes) 000477 1788360082.132580 mapwrite 0x03636c thru 0x03ffff (0x9c94 bytes) 000478 1788360082.214559 mapwrite 0x030800 thru 0x031787 (0xf88 bytes) 000479 1788360082.255105 mapwrite 0x032fc3 thru 0x03f1e0 (0xc21e bytes) 000480 1788360082.291559 mapwrite 0x038dc5 thru 0x03ffff (0x723b bytes) 000482 1788360082.318475 read 0x01be90 thru 0x01dd42 (0x1eb3 bytes) 000483 1788360082.318921 write 0x02ed1f thru 0x03621d (0x74ff bytes) 000484 1788360082.320180 write 0x015768 thru 0x022c1e (0xd4b7 bytes) 000486 1788360082.321560 mapwrite 0x00b5fe thru 0x00e71a (0x311d bytes) 000489 1788360082.360563 write 0x016d92 thru 0x01a7e5 (0x3a54 bytes) 000490 1788360082.362494 read 0x012277 thru 0x0200ec (0xde76 bytes) 000491 1788360082.366578 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x41ac003 (stale) Mirror 3: 0x66dc53f0 (stale) Mirror 4: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3a232b24 Mirror 5: 0x3a232b24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000493 1788360083.034887 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x41ac003 (stale) Mirror 3: 0x66dc53f0 (stale) Mirror 4: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3a232b24 Mirror 5: 0x3a232b24 Mirror 6: 0x3a232b24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000494 1788360083.734543 mapwrite 0x029458 thru 0x038848 (0xf3f1 bytes) 000495 1788360083.893545 read 0x02ccb5 thru 0x037e37 (0xb183 bytes) 000496 1788360083.894452 mapread 0x02e43f thru 0x0311db (0x2d9d bytes) 000498 1788360083.896525 write 0x023600 thru 0x02fd5f (0xc760 bytes) 000499 1788360083.901548 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x41ac003 (stale) Mirror 3: 0x66dc53f0 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0x3a232b24 (stale) Mirror 6: 0x3a232b24 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd57ce14 Mirror 7: 0xbd57ce14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000500 1788360084.611367 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x41ac003 (stale) Mirror 3: 0x66dc53f0 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0x3a232b24 (stale) Mirror 6: 0x3a232b24 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd57ce14 Mirror 7: 0xbd57ce14 Mirror 8: 0xbd57ce14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000501 1788360085.231066 mapread 0x00e880 thru 0x01e6fe (0xfe7f bytes) 000502 1788360085.251012 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x41ac003 (stale) Mirror 3: 0x66dc53f0 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 6: 0x3a232b24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x41ac003 (stale) Mirror 3: 0x66dc53f0 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 6: 0x3a232b24 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd57ce14 Mirror 7: 0xbd57ce14 Mirror 8: 0xbd57ce14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000503 1788360085.680918 mapwrite 0x00f736 thru 0x01dfb9 (0xe884 bytes) 000504 1788360085.823512 write 0x021f68 thru 0x0305f6 (0xe68f bytes) 000505 1788360085.829917 trunc from 0x040000 to 0x00f798 (0x30867 bytes) 000506 1788360085.849115 read 0x0091b4 thru 0x00d274 (0x40c1 bytes) 000508 1788360085.851621 mapread 0x00db5c thru 0x00f798 (0x1c3d bytes) 000511 1788360085.854102 write 0x031917 thru 0x03c54c (0xac36 bytes) 000512 1788360085.856310 mapwrite 0x012523 thru 0x0171f3 (0x4cd1 bytes) 000513 1788360085.902863 trunc from 0x03c54d to 0x001229 (0x3b323 bytes) 000515 1788360085.914722 mapread 0x000017 thru 0x001229 (0x1213 bytes) 000516 1788360085.921373 mapwrite 0x037410 thru 0x0387e4 (0x13d5 bytes) 000518 1788360086.013901 mapread 0x017766 thru 0x01f4d6 (0x7d71 bytes) 000520 1788360086.032111 MIRROR_RESYNC 7 mirrors 000523 1788360087.554041 read 0x008a17 thru 0x01650b (0xdaf5 bytes) 000524 1788360087.561689 read 0x00553d thru 0x00f0b0 (0x9b74 bytes) 000525 1788360087.571508 read 0x009685 thru 0x0141a7 (0xab23 bytes) 000526 1788360087.574947 MIRROR_EXTEND to 8 mirrors 000527 1788360088.033183 read 0x0158d3 thru 0x01647c (0xbaa bytes) 000529 1788360088.036696 read 0x00f940 thru 0x010043 (0x704 bytes) 000530 1788360088.044352 read 0x02e480 thru 0x0387e4 (0xa365 bytes) 000532 1788360088.047215 MIRROR_EXTEND to 9 mirrors 000534 1788360088.557947 trunc from 0x0387e5 to 0x039826 (0x1042 bytes) 000537 1788360088.625662 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x39827): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39827): Mirror 2: 0x1fb9b539 (stale) Mirror 3: 0x1fb9b539 (stale) Mirror 4: 0x1fb9b539 (stale) Mirror 6: 0x1fb9b539 (stale) Mirror 7: 0x1fb9b539 (stale) Mirror 8: 0x1fb9b539 (stale) Mirror 9: 0x1fb9b539 (stale) Mirror 10: 0x1fb9b539 (stale) CRC-32 checksum value for chunk [0, 0x39827): Mirror 1: 0x1fb9b539 Mirror 11: 0x1fb9b539 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39827: skipped 000538 1788360089.547017 mapread 0x00ebe6 thru 0x01d733 (0xeb4e bytes) 000539 1788360089.577229 write 0x01fcf5 thru 0x024508 (0x4814 bytes) 000542 1788360089.664087 mapwrite 0x028dc6 thru 0x038b12 (0xfd4d bytes) 000543 1788360089.782458 write 0x0041f2 thru 0x0140d7 (0xfee6 bytes) 000545 1788360089.795346 write 0x03d031 thru 0x03ffff (0x2fcf bytes) 000546 1788360089.796706 mapread 0x030f88 thru 0x036a69 (0x5ae2 bytes) 000547 1788360089.798492 mapwrite 0x00b832 thru 0x019b1d (0xe2ec bytes) 000549 1788360089.867686 mapwrite 0x03ebbb thru 0x03ffff (0x1445 bytes) 000550 1788360089.907156 mapread 0x020ec3 thru 0x02f758 (0xe896 bytes) 000552 1788360089.908919 mapread 0x01ca16 thru 0x026ada (0xa0c5 bytes) truncating to largest ever: 0x3fadb 000554 1788360089.914675 trunc from 0x040000 to 0x03fada (0x525 bytes) 000555 1788360089.934294 write 0x01426b thru 0x01616b (0x1f01 bytes) 000557 1788360089.936023 trunc from 0x03fadb to 0x00dba7 (0x31f33 bytes) 000558 1788360089.959330 read 0x009823 thru 0x00dba7 (0x4385 bytes) 000560 1788360089.960785 read 0x0010b2 thru 0x002c3e (0x1b8d bytes) 000564 1788360089.968937 mapwrite 0x00c7fb thru 0x01505d (0x8863 bytes) 000566 1788360090.040863 mapwrite 0x00a205 thru 0x00d6aa (0x34a6 bytes) 000568 1788360090.096839 MIRROR_RESYNC 10 mirrors 000569 1788360091.437609 mapwrite 0x006be9 thru 0x0080a9 (0x14c1 bytes) 000570 1788360091.593550 write 0x030383 thru 0x0320e3 (0x1d61 bytes) 000571 1788360091.597050 trunc from 0x0320e4 to 0x02138d (0x10d56 bytes) 000572 1788360091.625300 mapread 0x00009d thru 0x00a14b (0xa0af bytes) 000574 1788360091.631376 write 0x029b2d thru 0x02f2f7 (0x57cb bytes) 000576 1788360091.635555 mapread 0x0160f9 thru 0x01b128 (0x5030 bytes) 000577 1788360091.645930 mapread 0x00d206 thru 0x01294f (0x574a bytes) 000579 1788360091.647400 read 0x00b4f5 thru 0x012b73 (0x767f bytes) 000580 1788360091.648826 mapwrite 0x0360c3 thru 0x03ffff (0x9f3d bytes) 000581 1788360091.749668 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3e5ee0c6 (stale) Mirror 3: 0x3e5ee0c6 (stale) Mirror 4: 0x3e5ee0c6 (stale) Mirror 6: 0x3e5ee0c6 (stale) Mirror 7: 0x3e5ee0c6 (stale) Mirror 8: 0x3e5ee0c6 (stale) Mirror 9: 0x3e5ee0c6 (stale) Mirror 11: 0x3e5ee0c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3e5ee0c6 (stale) Mirror 3: 0x3e5ee0c6 (stale) Mirror 4: 0x3e5ee0c6 (stale) Mirror 6: 0x3e5ee0c6 (stale) Mirror 7: 0x3e5ee0c6 (stale) Mirror 8: 0x3e5ee0c6 (stale) Mirror 9: 0x3e5ee0c6 (stale) Mirror 11: 0x3e5ee0c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000582 1788360092.193948 MIRROR_RESYNC 9 mirrors 000583 1788360093.317270 mapwrite 0x00b37a thru 0x01165d (0x62e4 bytes) 000584 1788360093.430257 trunc from 0x040000 to 0x0365e5 (0x9a1a bytes) 000585 1788360093.455167 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x365e6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x365e6): Mirror 2: 0x7e91571e (stale) Mirror 3: 0x7e91571e (stale) Mirror 4: 0x7e91571e (stale) Mirror 6: 0x7e91571e (stale) Mirror 7: 0x7e91571e (stale) Mirror 8: 0x7e91571e (stale) Mirror 9: 0x7e91571e (stale) Mirror 11: 0x7e91571e (stale) CRC-32 checksum value for chunk [0, 0x365e6): Mirror 1: 0x5d3c191d Mirror 12: 0x5d3c191d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x365e6: skipped 000586 1788360094.335005 MIRROR_RESYNC 10 mirrors 000587 1788360095.558252 MIRROR_EXTEND to 11 mirrors 000588 1788360096.163646 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) 000589 1788360096.508416 read 0x00424f thru 0x00bd47 (0x7af9 bytes) 000591 1788360096.520530 mapwrite 0x02b3a7 thru 0x031f71 (0x6bcb bytes) 000592 1788360096.692068 trunc from 0x0365e6 to 0x0014d1 (0x35114 bytes) 000593 1788360096.709667 read 0x000a87 thru 0x0014d1 (0xa4b bytes) 000596 1788360096.717286 write 0x03ab53 thru 0x03ffff (0x54ad bytes) 000597 1788360096.719028 mapread 0x02ead1 thru 0x03192e (0x2e5e bytes) 000600 1788360096.729013 write 0x0012b6 thru 0x00a766 (0x94b1 bytes) 000601 1788360096.730860 read 0x03d44c thru 0x03ffff (0x2bb4 bytes) 000607 1788360096.735396 mapread 0x026bff thru 0x036aac (0xfeae bytes) 000610 1788360096.738051 trunc from 0x040000 to 0x00ba19 (0x345e6 bytes) 000611 1788360096.753272 write 0x0291ab thru 0x02c26b (0x30c1 bytes) 000613 1788360096.755035 read 0x012b09 thru 0x0170e3 (0x45db bytes) 000614 1788360096.760253 mapread 0x010a51 thru 0x01ed09 (0xe2b9 bytes) 000615 1788360096.761284 write 0x03a585 thru 0x03ffff (0x5a7b bytes) 000617 1788360096.762637 read 0x034093 thru 0x03c70a (0x8678 bytes) 000619 1788360096.769039 write 0x010b16 thru 0x0154b0 (0x499b bytes) 000620 1788360096.772181 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3338eb1a (stale) Mirror 3: 0x3338eb1a (stale) Mirror 6: 0x3338eb1a (stale) Mirror 7: 0x3338eb1a (stale) Mirror 8: 0x3338eb1a (stale) Mirror 9: 0x3338eb1a (stale) Mirror 11: 0x3338eb1a (stale) Mirror 12: 0x3338eb1a (stale) Mirror 13: 0x3338eb1a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a96b04c Mirror 14: 0x2a96b04c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000621 1788360097.643640 read 0x002c1a thru 0x01204d (0xf434 bytes) 000624 1788360097.672296 mapread 0x0344d2 thru 0x0370db (0x2c0a bytes) 000625 1788360097.700849 read 0x02cc4d thru 0x0346ee (0x7aa2 bytes) 000629 1788360097.736515 read 0x0368c9 thru 0x03bcd7 (0x540f bytes) 000630 1788360097.743237 write 0x02ca4f thru 0x031fd8 (0x558a bytes) 000631 1788360097.830614 mapread 0x038bce thru 0x038d97 (0x1ca bytes) 000633 1788360097.832292 trunc from 0x040000 to 0x01df90 (0x2206f bytes) 000634 1788360097.866434 mapread 0x01c5ff thru 0x01df90 (0x1992 bytes) 000635 1788360097.870974 trunc from 0x01df91 to 0x01ad52 (0x323e bytes) 000636 1788360097.909220 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ad53): Mirror 2: 0xcdf65817 (stale) Mirror 3: 0xcdf65817 (stale) Mirror 6: 0xcdf65817 (stale) Mirror 7: 0xcdf65817 (stale) Mirror 8: 0xcdf65817 (stale) Mirror 9: 0xcdf65817 (stale) Mirror 11: 0xcdf65817 (stale) Mirror 12: 0xcdf65817 (stale) Mirror 13: 0xcdf65817 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad53): Mirror 2: 0xcdf65817 (stale) Mirror 3: 0xcdf65817 (stale) Mirror 6: 0xcdf65817 (stale) Mirror 7: 0xcdf65817 (stale) Mirror 8: 0xcdf65817 (stale) Mirror 9: 0xcdf65817 (stale) Mirror 11: 0xcdf65817 (stale) Mirror 12: 0xcdf65817 (stale) Mirror 13: 0xcdf65817 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad53: skipped 000637 1788360098.311750 trunc from 0x01ad53 to 0x00f191 (0xbbc1 bytes) 000638 1788360098.324690 mapwrite 0x0159fe thru 0x01c015 (0x6618 bytes) 000639 1788360098.404789 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1c016): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c016): Mirror 2: 0xa9a2ae10 (stale) Mirror 3: 0xa9a2ae10 (stale) Mirror 6: 0xa9a2ae10 (stale) Mirror 7: 0xa9a2ae10 (stale) Mirror 8: 0xa9a2ae10 (stale) Mirror 9: 0xa9a2ae10 (stale) Mirror 11: 0xa9a2ae10 (stale) Mirror 12: 0xa9a2ae10 (stale) Mirror 13: 0xa9a2ae10 (stale) CRC-32 checksum value for chunk [0, 0x1c016): Mirror 1: 0xd8f9d929 Mirror 14: 0xd8f9d929 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c016: skipped 000641 1788360099.140147 mapread 0x00ed06 thru 0x01c015 (0xd310 bytes) 000642 1788360099.170200 mapread 0x012e7d thru 0x01c015 (0x9199 bytes) 000644 1788360099.181226 trunc from 0x01c016 to 0x02e769 (0x12754 bytes) 000645 1788360099.260669 trunc from 0x02e76a to 0x0283c8 (0x63a1 bytes) 000647 1788360099.274141 mapread 0x00c39d thru 0x015247 (0x8eab bytes) 000648 1788360099.291368 write 0x0046b8 thru 0x00ee24 (0xa76d bytes) 000651 1788360099.297466 mapread 0x00f073 thru 0x01ab32 (0xbac0 bytes) 000654 1788360099.300553 trunc from 0x0283c9 to 0x024ebd (0x350b bytes) 000655 1788360099.316148 trunc from 0x024ebe to 0x0325e5 (0xd728 bytes) 000657 1788360099.332172 read 0x0037b0 thru 0x012cd4 (0xf525 bytes) 000659 1788360099.342257 MIRROR_RESYNC 11 mirrors 000662 1788360101.094135 trunc from 0x0325e6 to 0x010ebf (0x21726 bytes) 000665 1788360101.164646 mapread 0x001504 thru 0x0040fb (0x2bf8 bytes) 000666 1788360101.181508 read 0x00630e thru 0x010ebf (0xabb2 bytes) 000669 1788360101.184293 mapwrite 0x0195a4 thru 0x01e442 (0x4e9f bytes) 000671 1788360101.256542 trunc from 0x01e443 to 0x0227f8 (0x43b6 bytes) 000672 1788360101.279013 MIRROR_RESYNC 11 mirrors 000673 1788360102.850721 read 0x000a11 thru 0x009c8e (0x927e bytes) 000675 1788360102.860102 mapwrite 0x03df2d thru 0x03ffff (0x20d3 bytes) 000677 1788360102.990546 mapwrite 0x01b379 thru 0x022827 (0x74af bytes) 000680 1788360103.056503 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd339f971 (stale) Mirror 3: 0xd339f971 (stale) Mirror 6: 0xd339f971 (stale) Mirror 7: 0xd339f971 (stale) Mirror 8: 0xd339f971 (stale) Mirror 9: 0xd339f971 (stale) Mirror 11: 0xd339f971 (stale) Mirror 12: 0xd339f971 (stale) Mirror 13: 0xd339f971 (stale) Mirror 14: 0xd339f971 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcb2dd9e4 Mirror 15: 0xcb2dd9e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000681 1788360103.794305 read 0x00290b thru 0x010766 (0xde5c bytes) 000683 1788360103.818495 read 0x02ace7 thru 0x036b29 (0xbe43 bytes) 000684 1788360103.834976 trunc from 0x040000 to 0x01f9fd (0x20602 bytes) 000687 1788360103.949347 mapread 0x01abf5 thru 0x01f9fd (0x4e09 bytes) 000688 1788360103.994029 write 0x024c38 thru 0x03320e (0xe5d7 bytes) 000689 1788360103.995747 read 0x025fb6 thru 0x026fe1 (0x102c bytes) 000691 1788360103.999329 trunc from 0x03320f to 0x01ba9d (0x17771 bytes) 000692 1788360104.030703 mapread 0x0170b7 thru 0x01a583 (0x34cd bytes) 000693 1788360104.049395 read 0x00df10 thru 0x016925 (0x8a16 bytes) 000695 1788360104.050712 write 0x0128d6 thru 0x015866 (0x2f91 bytes) 000696 1788360104.056742 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1ba9e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba9e): Mirror 2: 0x5fab4593 (stale) Mirror 3: 0x5fab4593 (stale) Mirror 6: 0x5fab4593 (stale) Mirror 7: 0x5fab4593 (stale) Mirror 8: 0x5fab4593 (stale) Mirror 9: 0x5fab4593 (stale) Mirror 11: 0x5fab4593 (stale) Mirror 12: 0x5fab4593 (stale) Mirror 13: 0x5fab4593 (stale) Mirror 14: 0x5fab4593 (stale) Mirror 15: 0x642e6ecc (stale) CRC-32 checksum value for chunk [0, 0x1ba9e): Mirror 1: 0xe09cecc Mirror 16: 0xe09cecc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba9e: skipped 000698 1788360104.801648 trunc from 0x01ba9e to 0x025e4d (0xa3b0 bytes) 000703 1788360104.912491 write 0x01ed71 thru 0x026a1c (0x7cac bytes) 000704 1788360104.923918 MIRROR_RESYNC 13 mirrors 000706 1788360106.256113 mapread 0x012112 thru 0x01fefd (0xddec bytes) 000707 1788360106.286013 mapwrite 0x030805 thru 0x03b8d9 (0xb0d5 bytes) 000708 1788360106.415021 trunc from 0x03b8da to 0x01322c (0x286ad bytes) 000710 1788360106.437677 mapread 0x0122ef thru 0x01322c (0xf3e bytes) 000711 1788360106.450367 read 0x00c2c6 thru 0x010d52 (0x4a8d bytes) 000712 1788360106.451258 mapread 0x00ad27 thru 0x0120f1 (0x73cb bytes) 000713 1788360106.459276 read 0x011efc thru 0x01322c (0x1331 bytes) 000714 1788360106.460041 mapwrite 0x011257 thru 0x0145f0 (0x339a bytes) 000715 1788360106.515647 mapwrite 0x01c186 thru 0x0228f4 (0x676f bytes) 000716 1788360106.586209 write 0x0092a8 thru 0x00cdd9 (0x3b32 bytes) 000717 1788360106.591328 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x228f5): Mirror 3: 0x1e2b5f8c (stale) Mirror 6: 0x1e2b5f8c (stale) Mirror 7: 0x1e2b5f8c (stale) Mirror 8: 0x1e2b5f8c (stale) Mirror 9: 0x1e2b5f8c (stale) Mirror 11: 0x1e2b5f8c (stale) Mirror 12: 0x1e2b5f8c (stale) Mirror 13: 0x1e2b5f8c (stale) Mirror 14: 0x1e2b5f8c (stale) Mirror 15: 0x1e2b5f8c (stale) Mirror 16: 0x1e2b5f8c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x228f5): Mirror 3: 0x1e2b5f8c (stale) Mirror 6: 0x1e2b5f8c (stale) Mirror 7: 0x1e2b5f8c (stale) Mirror 8: 0x1e2b5f8c (stale) Mirror 9: 0x1e2b5f8c (stale) Mirror 11: 0x1e2b5f8c (stale) Mirror 12: 0x1e2b5f8c (stale) Mirror 13: 0x1e2b5f8c (stale) Mirror 14: 0x1e2b5f8c (stale) Mirror 15: 0x1e2b5f8c (stale) Mirror 16: 0x1e2b5f8c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x228f5: skipped 000719 1788360107.214581 mapread 0x01c9c2 thru 0x020c04 (0x4243 bytes) 000720 1788360107.234631 read 0x00917f thru 0x014b05 (0xb987 bytes) 000721 1788360107.241479 mapread 0x019b8d thru 0x020572 (0x69e6 bytes) 000724 1788360107.243261 write 0x02c409 thru 0x02dfa4 (0x1b9c bytes) 000725 1788360107.247499 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2dfa5): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dfa5): Mirror 3: 0x4dbf6dd3 (stale) Mirror 6: 0x4dbf6dd3 (stale) Mirror 7: 0x4dbf6dd3 (stale) Mirror 8: 0x4dbf6dd3 (stale) Mirror 9: 0x4dbf6dd3 (stale) Mirror 11: 0x4dbf6dd3 (stale) Mirror 12: 0x4dbf6dd3 (stale) Mirror 13: 0x4dbf6dd3 (stale) Mirror 14: 0x4dbf6dd3 (stale) Mirror 15: 0x4dbf6dd3 (stale) Mirror 16: 0x4dbf6dd3 (stale) CRC-32 checksum value for chunk [0, 0x2dfa5): Mirror 1: 0xd89400d Mirror 17: 0xd89400d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dfa5: skipped 000726 1788360107.930736 mapwrite 0x01ff2d thru 0x02c2c9 (0xc39d bytes) 000729 1788360108.113852 mapwrite 0x019d26 thru 0x019ef1 (0x1cc bytes) 000730 1788360108.147283 trunc from 0x02dfa5 to 0x03267e (0x46da bytes) 000733 1788360108.179337 mapread 0x011a15 thru 0x017838 (0x5e24 bytes) 000736 1788360108.193873 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3267f): Mirror 3: 0xa531904d (stale) Mirror 6: 0xa531904d (stale) Mirror 7: 0xa531904d (stale) Mirror 8: 0xa531904d (stale) Mirror 9: 0xa531904d (stale) Mirror 11: 0xa531904d (stale) Mirror 13: 0xa531904d (stale) Mirror 14: 0xa531904d (stale) Mirror 15: 0xa531904d (stale) Mirror 16: 0xa531904d (stale) Mirror 17: 0xdbeef695 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3267f): Mirror 3: 0xa531904d (stale) Mirror 6: 0xa531904d (stale) Mirror 7: 0xa531904d (stale) Mirror 8: 0xa531904d (stale) Mirror 9: 0xa531904d (stale) Mirror 11: 0xa531904d (stale) Mirror 13: 0xa531904d (stale) Mirror 14: 0xa531904d (stale) Mirror 15: 0xa531904d (stale) Mirror 16: 0xa531904d (stale) Mirror 17: 0xdbeef695 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3267f: skipped 000738 1788360108.727392 trunc from 0x03267f to 0x02f793 (0x2eeb bytes) 000739 1788360108.742226 write 0x02a4fd thru 0x02a8b4 (0x3b8 bytes) 000740 1788360108.753225 trunc from 0x02f794 to 0x034e09 (0x5676 bytes) 000743 1788360108.773586 mapread 0x003040 thru 0x0095c5 (0x6586 bytes) 000746 1788360108.813422 mapread 0x023e3f thru 0x027b8f (0x3d51 bytes) 000749 1788360108.827161 trunc from 0x034e0a to 0x002aaa (0x3235f bytes) 000751 1788360108.849602 mapwrite 0x01447e thru 0x022eb3 (0xea36 bytes) 000752 1788360108.961675 mapread 0x004626 thru 0x010428 (0xbe03 bytes) 000754 1788360108.970118 mapread 0x0045f2 thru 0x00c193 (0x7ba2 bytes) 000756 1788360108.974153 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22eb4): Mirror 3: 0xdf4a416d (stale) Mirror 6: 0xdf4a416d (stale) Mirror 7: 0xdf4a416d (stale) Mirror 8: 0xdf4a416d (stale) Mirror 9: 0xdf4a416d (stale) Mirror 13: 0xdf4a416d (stale) Mirror 14: 0xdf4a416d (stale) Mirror 15: 0xdf4a416d (stale) Mirror 16: 0xdf4a416d (stale) Mirror 17: 0xe4bbdb34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22eb4): Mirror 3: 0xdf4a416d (stale) Mirror 6: 0xdf4a416d (stale) Mirror 7: 0xdf4a416d (stale) Mirror 8: 0xdf4a416d (stale) Mirror 9: 0xdf4a416d (stale) Mirror 13: 0xdf4a416d (stale) Mirror 14: 0xdf4a416d (stale) Mirror 15: 0xdf4a416d (stale) Mirror 16: 0xdf4a416d (stale) Mirror 17: 0xe4bbdb34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22eb4: skipped 000758 1788360109.575810 mapread 0x00aac0 thru 0x0118ea (0x6e2b bytes) 000760 1788360109.587366 mapread 0x0117fd thru 0x019642 (0x7e46 bytes) 000762 1788360109.597667 mapwrite 0x005a4a thru 0x00fb37 (0xa0ee bytes) 000763 1788360109.626388 mapread 0x02080a thru 0x022eb3 (0x26aa bytes) 000764 1788360109.632135 mapwrite 0x0005b6 thru 0x00c28c (0xbcd7 bytes) 000767 1788360109.678579 read 0x01640d thru 0x019752 (0x3346 bytes) 000768 1788360109.679183 mapread 0x01c400 thru 0x01dcb1 (0x18b2 bytes) 000769 1788360109.679855 mapread 0x01fd00 thru 0x022eb3 (0x31b4 bytes) 000770 1788360109.680419 trunc from 0x022eb4 to 0x00b158 (0x17d5b bytes) 000771 1788360109.698623 read 0x002a6d thru 0x00b158 (0x86ec bytes) 000773 1788360109.699541 write 0x0030b4 thru 0x003c3b (0xb88 bytes) 000775 1788360109.701248 trunc from 0x00b159 to 0x0337d5 (0x2867d bytes) 000776 1788360109.714188 read 0x000652 thru 0x00b97e (0xb32d bytes) 000778 1788360109.720614 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x337d6): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337d6): Mirror 3: 0x35fb7f32 (stale) Mirror 6: 0x35fb7f32 (stale) Mirror 7: 0x35fb7f32 (stale) Mirror 8: 0x35fb7f32 (stale) Mirror 9: 0x35fb7f32 (stale) Mirror 13: 0x35fb7f32 (stale) Mirror 14: 0x35fb7f32 (stale) Mirror 15: 0x35fb7f32 (stale) Mirror 16: 0x35fb7f32 (stale) Mirror 17: 0x6c333f6 (stale) CRC-32 checksum value for chunk [0, 0x337d6): Mirror 1: 0x9e040eb5 Mirror 18: 0x9e040eb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337d6: skipped 000780 1788360110.794626 trunc from 0x0337d6 to 0x031072 (0x2763 bytes) 000782 1788360110.873257 read 0x0075c7 thru 0x013099 (0xbad3 bytes) 000786 1788360110.882269 trunc from 0x031073 to 0x023c20 (0xd452 bytes) 000787 1788360110.913505 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x23c21): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23c21): Mirror 3: 0xe057d6f4 (stale) Mirror 6: 0xe057d6f4 (stale) Mirror 7: 0xe057d6f4 (stale) Mirror 8: 0xe057d6f4 (stale) Mirror 9: 0xe057d6f4 (stale) Mirror 13: 0xe057d6f4 (stale) Mirror 14: 0xe057d6f4 (stale) Mirror 15: 0xe057d6f4 (stale) Mirror 16: 0xe057d6f4 (stale) Mirror 17: 0x3aa15723 (stale) Mirror 18: 0x978ca8b8 (stale) CRC-32 checksum value for chunk [0, 0x23c21): Mirror 1: 0x978ca8b8 Mirror 19: 0x978ca8b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23c21: skipped 000788 1788360111.964012 write 0x03cbdb thru 0x03ffff (0x3425 bytes) 000791 1788360112.014592 mapread 0x022115 thru 0x02a530 (0x841c bytes) 000792 1788360112.031191 read 0x014f1b thru 0x0153ad (0x493 bytes) 000793 1788360112.034828 read 0x024485 thru 0x027e72 (0x39ee bytes) 000794 1788360112.035592 write 0x01fb54 thru 0x022bd5 (0x3082 bytes) 000796 1788360112.040446 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdaafa345 (stale) Mirror 6: 0xdaafa345 (stale) Mirror 7: 0xdaafa345 (stale) Mirror 8: 0xdaafa345 (stale) Mirror 9: 0xdaafa345 (stale) Mirror 13: 0xdaafa345 (stale) Mirror 14: 0xdaafa345 (stale) Mirror 15: 0xdaafa345 (stale) Mirror 16: 0xdaafa345 (stale) Mirror 17: 0x38ce49bd (stale) Mirror 18: 0x9a0f29d1 (stale) Mirror 19: 0x9a0f29d1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5d07f67 Mirror 20: 0x5d07f67 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000798 1788360112.949563 mapwrite 0x02b6e6 thru 0x038154 (0xca6f bytes) 000799 1788360113.118698 mapread 0x0294d2 thru 0x02a675 (0x11a4 bytes) 000800 1788360113.119829 read 0x01ae7c thru 0x022d1f (0x7ea4 bytes) 000802 1788360113.134349 mapread 0x0342ca thru 0x034582 (0x2b9 bytes) 000803 1788360113.135256 write 0x009778 thru 0x017e4d (0xe6d6 bytes) 000804 1788360113.145932 read 0x01b89c thru 0x029691 (0xddf6 bytes) 000806 1788360113.163095 write 0x010870 thru 0x0162e4 (0x5a75 bytes) 000807 1788360113.164472 mapwrite 0x02138a thru 0x029305 (0x7f7c bytes) 000809 1788360113.205793 mapread 0x013467 thru 0x01b9b7 (0x8551 bytes) 000810 1788360113.207386 read 0x03a0a2 thru 0x03a8f5 (0x854 bytes) 000812 1788360113.208548 write 0x0249bc thru 0x029b63 (0x51a8 bytes) 000813 1788360113.209365 mapread 0x014c6a thru 0x01d325 (0x86bc bytes) 000815 1788360113.210512 mapread 0x037907 thru 0x03ffff (0x86f9 bytes) 000816 1788360113.221173 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdaafa345 (stale) Mirror 7: 0xdaafa345 (stale) Mirror 8: 0xdaafa345 (stale) Mirror 9: 0xdaafa345 (stale) Mirror 13: 0xdaafa345 (stale) Mirror 14: 0xdaafa345 (stale) Mirror 15: 0xdaafa345 (stale) Mirror 16: 0xdaafa345 (stale) Mirror 17: 0x38ce49bd (stale) Mirror 18: 0x9a0f29d1 (stale) Mirror 19: 0x9a0f29d1 (stale) Mirror 20: 0x5d07f67 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdaafa345 (stale) Mirror 7: 0xdaafa345 (stale) Mirror 8: 0xdaafa345 (stale) Mirror 9: 0xdaafa345 (stale) Mirror 13: 0xdaafa345 (stale) Mirror 14: 0xdaafa345 (stale) Mirror 15: 0xdaafa345 (stale) Mirror 16: 0xdaafa345 (stale) Mirror 17: 0x38ce49bd (stale) Mirror 18: 0x9a0f29d1 (stale) Mirror 19: 0x9a0f29d1 (stale) Mirror 20: 0x5d07f67 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000817 1788360113.828012 write 0x03fa7e thru 0x03ffff (0x582 bytes) 000819 1788360113.833469 write 0x02a983 thru 0x039107 (0xe785 bytes) 000820 1788360113.852151 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdaafa345 (stale) Mirror 7: 0xdaafa345 (stale) Mirror 8: 0xdaafa345 (stale) Mirror 9: 0xdaafa345 (stale) Mirror 13: 0xdaafa345 (stale) Mirror 14: 0xdaafa345 (stale) Mirror 15: 0xdaafa345 (stale) Mirror 16: 0xdaafa345 (stale) Mirror 17: 0x38ce49bd (stale) Mirror 18: 0x9a0f29d1 (stale) Mirror 19: 0x9a0f29d1 (stale) Mirror 20: 0x5d07f67 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2eaee6a1 Mirror 21: 0x2eaee6a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000822 1788360114.660544 write 0x037e0f thru 0x03dafc (0x5cee bytes) 000823 1788360114.737390 trunc from 0x040000 to 0x021d8a (0x1e275 bytes) 000829 1788360114.784228 trunc from 0x021d8b to 0x015f7b (0xbe0f bytes) 000830 1788360114.822351 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x15f7c): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15f7c): Mirror 6: 0xcaa26dc0 (stale) Mirror 7: 0xcaa26dc0 (stale) Mirror 8: 0xcaa26dc0 (stale) Mirror 9: 0xcaa26dc0 (stale) Mirror 13: 0xcaa26dc0 (stale) Mirror 14: 0xcaa26dc0 (stale) Mirror 15: 0xcaa26dc0 (stale) Mirror 16: 0xcaa26dc0 (stale) Mirror 17: 0xb91a38bf (stale) Mirror 18: 0x321c2153 (stale) Mirror 19: 0x321c2153 (stale) Mirror 20: 0x321c2153 (stale) Mirror 21: 0xe4b13c1 (stale) CRC-32 checksum value for chunk [0, 0x15f7c): Mirror 1: 0xe4b13c1 Mirror 22: 0xe4b13c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15f7c: skipped 000831 1788360115.686985 read 0x00452d thru 0x00568e (0x1162 bytes) 000832 1788360115.697650 write 0x02aa4b thru 0x032b17 (0x80cd bytes) 000833 1788360115.758112 MIRROR_SPLIT mirror 3 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32b18): Mirror 6: 0x8d2748e2 (stale) Mirror 7: 0x8d2748e2 (stale) Mirror 9: 0x8d2748e2 (stale) Mirror 13: 0x8d2748e2 (stale) Mirror 14: 0x8d2748e2 (stale) Mirror 15: 0x8d2748e2 (stale) Mirror 16: 0x8d2748e2 (stale) Mirror 17: 0xa91bb7fc (stale) Mirror 18: 0x40ecea15 (stale) Mirror 19: 0x40ecea15 (stale) Mirror 20: 0x651ef5ed (stale) Mirror 21: 0x9eeb5b58 (stale) Mirror 22: 0x5935b401 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32b18): Mirror 6: 0x8d2748e2 (stale) Mirror 7: 0x8d2748e2 (stale) Mirror 9: 0x8d2748e2 (stale) Mirror 13: 0x8d2748e2 (stale) Mirror 14: 0x8d2748e2 (stale) Mirror 15: 0x8d2748e2 (stale) Mirror 16: 0x8d2748e2 (stale) Mirror 17: 0xa91bb7fc (stale) Mirror 18: 0x40ecea15 (stale) Mirror 19: 0x40ecea15 (stale) Mirror 20: 0x651ef5ed (stale) Mirror 21: 0x9eeb5b58 (stale) Mirror 22: 0x5935b401 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32b18: skipped 000837 1788360116.403013 trunc from 0x032b18 to 0x00cad3 (0x26044 bytes) 000838 1788360116.426719 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcad4): Mirror 6: 0x3c1d2cc3 (stale) Mirror 7: 0x3c1d2cc3 (stale) Mirror 9: 0x3c1d2cc3 (stale) Mirror 13: 0x3c1d2cc3 (stale) Mirror 14: 0x3c1d2cc3 (stale) Mirror 15: 0x3c1d2cc3 (stale) Mirror 16: 0x3c1d2cc3 (stale) Mirror 17: 0xd954cc80 (stale) Mirror 18: 0xc116d2d1 (stale) Mirror 20: 0xc116d2d1 (stale) Mirror 21: 0xf8163efa (stale) Mirror 22: 0xf8163efa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcad4): Mirror 6: 0x3c1d2cc3 (stale) Mirror 7: 0x3c1d2cc3 (stale) Mirror 9: 0x3c1d2cc3 (stale) Mirror 13: 0x3c1d2cc3 (stale) Mirror 14: 0x3c1d2cc3 (stale) Mirror 15: 0x3c1d2cc3 (stale) Mirror 16: 0x3c1d2cc3 (stale) Mirror 17: 0xd954cc80 (stale) Mirror 18: 0xc116d2d1 (stale) Mirror 20: 0xc116d2d1 (stale) Mirror 21: 0xf8163efa (stale) Mirror 22: 0xf8163efa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcad4: skipped 000841 1788360116.940669 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0xcad4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcad4): Mirror 6: 0x3c1d2cc3 (stale) Mirror 7: 0x3c1d2cc3 (stale) Mirror 9: 0x3c1d2cc3 (stale) Mirror 13: 0x3c1d2cc3 (stale) Mirror 14: 0x3c1d2cc3 (stale) Mirror 15: 0x3c1d2cc3 (stale) Mirror 16: 0x3c1d2cc3 (stale) Mirror 17: 0xd954cc80 (stale) Mirror 18: 0xc116d2d1 (stale) Mirror 20: 0xc116d2d1 (stale) Mirror 21: 0xf8163efa (stale) Mirror 22: 0xf8163efa (stale) CRC-32 checksum value for chunk [0, 0xcad4): Mirror 1: 0xf8163efa Mirror 23: 0xf8163efa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcad4: skipped 000842 1788360117.758211 mapwrite 0x03dd16 thru 0x03ffff (0x22ea bytes) 000844 1788360117.895079 read 0x02f7e6 thru 0x032a7c (0x3297 bytes) 000846 1788360117.900498 mapwrite 0x0224ef thru 0x025dc6 (0x38d8 bytes) 000848 1788360117.931696 read 0x032164 thru 0x03b28f (0x912c bytes) 000851 1788360117.947839 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdaafa345 (stale) Mirror 7: 0xdaafa345 (stale) Mirror 9: 0xdaafa345 (stale) Mirror 13: 0xdaafa345 (stale) Mirror 14: 0xdaafa345 (stale) Mirror 15: 0xdaafa345 (stale) Mirror 16: 0xdaafa345 (stale) Mirror 17: 0x38ce49bd (stale) Mirror 18: 0x9a0f29d1 (stale) Mirror 20: 0x5d07f67 (stale) Mirror 21: 0x2eaee6a1 (stale) Mirror 22: 0xe6305db2 (stale) Mirror 23: 0xc4c1df8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x717eaaea Mirror 24: 0x717eaaea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000852 1788360118.923624 read 0x013525 thru 0x018f95 (0x5a71 bytes) 000853 1788360118.936086 write 0x0038e0 thru 0x011c0b (0xe32c bytes) 000854 1788360119.002862 write 0x006243 thru 0x00672b (0x4e9 bytes) 000855 1788360119.004020 mapread 0x00675d thru 0x013c0d (0xd4b1 bytes) 000856 1788360119.011537 mapwrite 0x013c2d thru 0x01d7e9 (0x9bbd bytes) 000857 1788360119.066930 read 0x00793e thru 0x015317 (0xd9da bytes) 000859 1788360119.068612 mapread 0x017ab0 thru 0x0253fd (0xd94e bytes) 000860 1788360119.073707 MIRROR_RESYNC 15 mirrors 000862 1788360120.791324 mapread 0x015c0d thru 0x0184f7 (0x28eb bytes) 000863 1788360120.819396 read 0x03c7b9 thru 0x03ffff (0x3847 bytes) 000864 1788360120.825525 read 0x00356f thru 0x00f089 (0xbb1b bytes) 000867 1788360120.835116 mapwrite 0x027886 thru 0x02d784 (0x5eff bytes) 000869 1788360121.039088 read 0x037718 thru 0x037f0f (0x7f8 bytes) 000870 1788360121.050841 mapread 0x017bab thru 0x018141 (0x597 bytes) 000873 1788360121.053637 mapwrite 0x036b7a thru 0x03ffff (0x9486 bytes) 000874 1788360121.091424 mapwrite 0x035989 thru 0x03ffff (0xa677 bytes) 000878 1788360121.138447 mapread 0x037607 thru 0x037f86 (0x980 bytes) 000879 1788360121.142133 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x589b745 (stale) Mirror 7: 0x589b745 (stale) Mirror 9: 0x589b745 (stale) Mirror 13: 0x589b745 (stale) Mirror 14: 0x589b745 (stale) Mirror 15: 0x589b745 (stale) Mirror 16: 0x589b745 (stale) Mirror 17: 0x589b745 (stale) Mirror 18: 0x589b745 (stale) Mirror 20: 0x589b745 (stale) Mirror 21: 0x589b745 (stale) Mirror 22: 0x589b745 (stale) Mirror 23: 0x589b745 (stale) Mirror 24: 0x589b745 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xec0d675c Mirror 25: 0xec0d675c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000880 1788360122.009628 trunc from 0x040000 to 0x02bed4 (0x1412b bytes) 000881 1788360122.110936 write 0x037dac thru 0x03de07 (0x605c bytes) 000882 1788360122.112075 trunc from 0x03de08 to 0x0302d1 (0xdb36 bytes) 000883 1788360122.124489 mapwrite 0x02bf8a thru 0x0331dd (0x7254 bytes) 000884 1788360122.175050 read 0x001f6b thru 0x004e61 (0x2ef7 bytes) 000885 1788360122.179341 trunc from 0x0331de to 0x02eab4 (0x4729 bytes) 000888 1788360122.193835 MIRROR_RESYNC 16 mirrors 000890 1788360123.810416 write 0x002546 thru 0x00d369 (0xae24 bytes) 000892 1788360123.876121 trunc from 0x02eab5 to 0x020140 (0xe974 bytes) 000893 1788360123.892135 read 0x001c09 thru 0x007e77 (0x626f bytes) 000894 1788360123.897285 trunc from 0x020141 to 0x011d65 (0xe3db bytes) 000895 1788360123.907518 mapwrite 0x019af1 thru 0x01a842 (0xd52 bytes) 000898 1788360123.986542 read 0x003151 thru 0x00eb38 (0xb9e8 bytes) 000900 1788360123.998077 trunc from 0x01a843 to 0x00b40a (0xf438 bytes) 000901 1788360124.014223 write 0x003a2e thru 0x012931 (0xef04 bytes) 000903 1788360124.018791 trunc from 0x012932 to 0x03da70 (0x2b13f bytes) 000904 1788360124.038975 trunc from 0x03da71 to 0x021d5c (0x1bd14 bytes) 000905 1788360124.065544 mapread 0x01d1a2 thru 0x021d5c (0x4bbb bytes) 000906 1788360124.074101 read 0x008789 thru 0x00e551 (0x5dc9 bytes) 000910 1788360124.077382 trunc from 0x021d5d to 0x00210b (0x1fc51 bytes) 000911 1788360124.091910 read 0x000398 thru 0x00210b (0x1d74 bytes) 000912 1788360124.093030 mapread 0x001bfb thru 0x00210b (0x511 bytes) 000914 1788360124.100015 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x285:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x210c): Mirror 6: 0x1de164c0 (stale) Mirror 9: 0x1de164c0 (stale) Mirror 13: 0x1de164c0 (stale) Mirror 14: 0x1de164c0 (stale) Mirror 15: 0x1de164c0 (stale) Mirror 16: 0x1de164c0 (stale) Mirror 17: 0x1de164c0 (stale) Mirror 18: 0x1de164c0 (stale) Mirror 20: 0x1de164c0 (stale) Mirror 21: 0x1de164c0 (stale) Mirror 22: 0x1de164c0 (stale) Mirror 23: 0x1de164c0 (stale) Mirror 24: 0x1de164c0 (stale) Mirror 25: 0x1de164c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x210c): Mirror 6: 0x1de164c0 (stale) Mirror 9: 0x1de164c0 (stale) Mirror 13: 0x1de164c0 (stale) Mirror 14: 0x1de164c0 (stale) Mirror 15: 0x1de164c0 (stale) Mirror 16: 0x1de164c0 (stale) Mirror 17: 0x1de164c0 (stale) Mirror 18: 0x1de164c0 (stale) Mirror 20: 0x1de164c0 (stale) Mirror 21: 0x1de164c0 (stale) Mirror 22: 0x1de164c0 (stale) Mirror 23: 0x1de164c0 (stale) Mirror 24: 0x1de164c0 (stale) Mirror 25: 0x1de164c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x210c: skipped 000915 1788360124.444638 mapwrite 0x026449 thru 0x029a51 (0x3609 bytes) 000917 1788360124.510916 MIRROR_RESYNC 15 mirrors 000920 1788360126.652554 write 0x00a24f thru 0x01075c (0x650e bytes) 000921 1788360126.726464 read 0x021ae0 thru 0x029a51 (0x7f72 bytes) 000922 1788360126.742878 mapwrite 0x00feff thru 0x0157e3 (0x58e5 bytes) 000923 1788360126.817320 MIRROR_RESYNC 15 mirrors 000925 1788360128.240882 MIRROR_EXTEND to 16 mirrors 000926 1788360128.875634 mapwrite 0x0104e7 thru 0x01bded (0xb907 bytes) 000927 1788360129.078805 mapwrite 0x03b1f4 thru 0x03d350 (0x215d bytes) 000928 1788360129.157925 write 0x009d5a thru 0x01817c (0xe423 bytes) 000933 1788360129.166667 trunc from 0x03d351 to 0x03a708 (0x2c48 bytes) 000935 1788360129.180511 read 0x01acc2 thru 0x028256 (0xd595 bytes) 000938 1788360129.188689 mapwrite 0x00fe35 thru 0x01e396 (0xe562 bytes) 000939 1788360129.241412 trunc from 0x03a709 to 0x022064 (0x186a4 bytes) 000940 1788360129.256029 mapread 0x01e339 thru 0x022064 (0x3d2c bytes) 000942 1788360129.258476 read 0x010aa6 thru 0x018008 (0x7563 bytes) 000944 1788360129.264998 MIRROR_RESYNC 16 mirrors 000945 1788360130.841835 mapwrite 0x024ae4 thru 0x029782 (0x4c9f bytes) 000946 1788360130.946058 mapwrite 0x012ae8 thru 0x013e94 (0x13ad bytes) 000950 1788360130.983464 trunc from 0x029783 to 0x0316d6 (0x7f54 bytes) 000951 1788360131.000635 write 0x02c1ae thru 0x02fe5d (0x3cb0 bytes) 000953 1788360131.008334 mapwrite 0x03b777 thru 0x03bbd3 (0x45d bytes) 000954 1788360131.071071 write 0x038c1c thru 0x03d697 (0x4a7c bytes) 000956 1788360131.073432 mapwrite 0x00132e thru 0x00d2c1 (0xbf94 bytes) 000960 1788360131.126584 MIRROR_RESYNC 16 mirrors 000964 1788360132.716349 write 0x01abcb thru 0x026740 (0xbb76 bytes) 000966 1788360132.764171 mapwrite 0x00af63 thru 0x012eca (0x7f68 bytes) 000968 1788360132.840891 mapwrite 0x028c00 thru 0x0363e5 (0xd7e6 bytes) 000969 1788360132.893985 read 0x004805 thru 0x00c4d2 (0x7cce bytes) 000970 1788360132.908229 MIRROR_RESYNC 16 mirrors 000971 1788360134.507971 mapread 0x019051 thru 0x0215a6 (0x8556 bytes) 000972 1788360134.531205 MIRROR_RESYNC 16 mirrors 000973 1788360135.083047 trunc from 0x03d698 to 0x024ed9 (0x187be bytes) 000975 1788360135.150356 MIRROR_RESYNC 16 mirrors 000976 1788360136.646969 write 0x03e340 thru 0x03ffff (0x1cc0 bytes) 000977 1788360136.705675 mapread 0x00ab50 thru 0x016425 (0xb8d6 bytes) 000980 1788360136.730343 trunc from 0x040000 to 0x01c84c (0x237b3 bytes) 000983 1788360136.748992 mapwrite 0x01169a thru 0x01c08c (0xa9f3 bytes) 000988 1788360136.802331 mapread 0x00d58b thru 0x017631 (0xa0a7 bytes) 000991 1788360136.804199 read 0x006f22 thru 0x00ed16 (0x7df5 bytes) 000992 1788360136.804733 mapwrite 0x01423f thru 0x023df4 (0xfbb6 bytes) 000993 1788360136.864619 write 0x004ce8 thru 0x0062c8 (0x15e1 bytes) 000994 1788360136.868800 write 0x012fa6 thru 0x022535 (0xf590 bytes) 000995 1788360136.870201 mapwrite 0x02f616 thru 0x033902 (0x42ed bytes) 000998 1788360136.937003 read 0x02df72 thru 0x033902 (0x5991 bytes) All operations completed A-OK!