== sanity-flr test 70a: flr mode fsx test ================ 22:32:48 (1784341968) Seed set to 1969 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1784341969.230176 write 0x0176bc thru 0x01abad (0x34f2 bytes) 000003 1784341969.243211 read 0x013ce6 thru 0x017424 (0x373f bytes) 000005 1784341969.247056 write 0x0137e1 thru 0x01548d (0x1cad bytes) 000006 1784341969.247871 mapwrite 0x01c0b6 thru 0x025fb1 (0x9efc bytes) 000007 1784341969.318394 write 0x0081f8 thru 0x00ac35 (0x2a3e bytes) 000009 1784341969.327081 mapwrite 0x03803b thru 0x03fe41 (0x7e07 bytes) 000011 1784341969.359507 mapwrite 0x02e086 thru 0x033188 (0x5103 bytes) 000013 1784341969.389617 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x28e90 000014 1784341969.669244 trunc from 0x03fe42 to 0x028e8f (0x16fb2 bytes) truncating to largest ever: 0x298cf 000015 1784341969.718515 trunc from 0x028e90 to 0x0298ce (0xa3f bytes) 000017 1784341969.735225 mapwrite 0x03d418 thru 0x03f637 (0x2220 bytes) 000019 1784341969.778600 trunc from 0x03f638 to 0x01f705 (0x1ff32 bytes) 000020 1784341969.784178 mapwrite 0x027164 thru 0x030075 (0x8f12 bytes) 000021 1784341969.824634 write 0x02ac5c thru 0x03022f (0x55d4 bytes) 000023 1784341969.826202 mapwrite 0x035860 thru 0x03ffff (0xa7a0 bytes) 000025 1784341969.868473 mapwrite 0x01d852 thru 0x01e8a8 (0x1057 bytes) 000026 1784341969.896942 read 0x02ff59 thru 0x03fb52 (0xfbfa bytes) 000028 1784341969.898164 write 0x01f5bf thru 0x01fc1e (0x660 bytes) 000029 1784341969.899033 read 0x0121eb thru 0x02216f (0xff85 bytes) 000030 1784341969.903648 read 0x03c411 thru 0x03ffff (0x3bef bytes) 000032 1784341969.904471 mapread 0x008b4c thru 0x0098f2 (0xda7 bytes) 000033 1784341969.905273 read 0x008b78 thru 0x017f2d (0xf3b6 bytes) 000034 1784341969.905798 mapwrite 0x006796 thru 0x008210 (0x1a7b bytes) truncating to largest ever: 0x39298 000035 1784341969.927309 trunc from 0x040000 to 0x039297 (0x6d68 bytes) 000039 1784341969.935506 read 0x01c698 thru 0x0226fa (0x6063 bytes) 000041 1784341969.936655 read 0x01ad55 thru 0x02756c (0xc818 bytes) 000044 1784341969.937900 read 0x017214 thru 0x0221c1 (0xafae bytes) 000046 1784341969.938844 trunc from 0x039298 to 0x022f59 (0x1633e bytes) 000048 1784341969.945355 read 0x00f896 thru 0x0185b0 (0x8d1b bytes) 000049 1784341969.945762 read 0x01d992 thru 0x022f59 (0x55c8 bytes) 000050 1784341969.946186 mapread 0x008701 thru 0x015db9 (0xd6b9 bytes) 000051 1784341969.946927 mapread 0x01be79 thru 0x022f59 (0x70e1 bytes) 000052 1784341969.947596 mapread 0x01795c thru 0x01a0ae (0x2753 bytes) 000054 1784341969.952194 MIRROR_RESYNC 2 mirrors 000055 1784341970.298273 mapwrite 0x00914c thru 0x00de02 (0x4cb7 bytes) 000057 1784341970.403945 read 0x004482 thru 0x00d9bb (0x953a bytes) 000058 1784341970.404454 mapread 0x0190b7 thru 0x022f59 (0x9ea3 bytes) 000060 1784341970.418847 trunc from 0x022f5a to 0x0158eb (0xd66e bytes) 000062 1784341970.445754 read 0x0034f3 thru 0x00775e (0x426c bytes) 000064 1784341970.451702 MIRROR_RESYNC 2 mirrors 000067 1784341970.774633 mapwrite 0x033a96 thru 0x03e68d (0xabf8 bytes) 000068 1784341970.881840 mapwrite 0x00c5e7 thru 0x013dcb (0x77e5 bytes) 000069 1784341970.922159 write 0x006e25 thru 0x016a56 (0xfc32 bytes) 000072 1784341970.925785 write 0x03864d thru 0x03ffff (0x79b3 bytes) 000073 1784341970.926561 write 0x0092b6 thru 0x0118d6 (0x8621 bytes) 000074 1784341970.928054 read 0x03d6c1 thru 0x03ffff (0x293f bytes) 000076 1784341970.928785 mapwrite 0x03a143 thru 0x03ffff (0x5ebd bytes) 000078 1784341970.954245 mapwrite 0x017389 thru 0x01e77c (0x73f4 bytes) 000079 1784341970.991938 trunc from 0x040000 to 0x0350d8 (0xaf27 bytes) 000081 1784341971.010652 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x350d9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x350d9): Mirror 2: 0x584ca0c5 (stale) CRC-32 checksum value for chunk [0, 0x350d9): Mirror 1: 0xbaf24cc7 Mirror 3: 0xbaf24cc7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x350d9: skipped 000082 1784341971.422062 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x350d9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x350d9): Mirror 2: 0x584ca0c5 (stale) CRC-32 checksum value for chunk [0, 0x350d9): Mirror 1: 0xbaf24cc7 Mirror 3: 0xbaf24cc7 Mirror 4: 0xbaf24cc7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x350d9: skipped 000083 1784341971.851728 mapwrite 0x02f95c thru 0x03c8a4 (0xcf49 bytes) 000085 1784341971.960767 read 0x00b73f thru 0x0138b2 (0x8174 bytes) 000086 1784341971.964462 trunc from 0x03c8a5 to 0x00cb70 (0x2fd34 bytes) 000087 1784341971.985603 MIRROR_RESYNC 4 mirrors 000088 1784341972.339809 trunc from 0x00cb71 to 0x018e55 (0xc2e5 bytes) truncating to largest ever: 0x3eb9c 000090 1784341972.389407 trunc from 0x018e56 to 0x03eb9b (0x25d46 bytes) 000091 1784341972.408753 MIRROR_RESYNC 4 mirrors 000092 1784341972.749192 mapread 0x022311 thru 0x031e2a (0xfb1a bytes) 000094 1784341972.762614 trunc from 0x03eb9c to 0x00f867 (0x2f334 bytes) 000096 1784341972.791394 read 0x0008cd thru 0x001d26 (0x145a bytes) 000097 1784341972.795214 trunc from 0x00f868 to 0x023b41 (0x142da bytes) 000100 1784341972.808860 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23b42): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23b42): Mirror 2: 0x9909afa (stale) Mirror 3: 0x9909afa (stale) Mirror 4: 0x9909afa (stale) CRC-32 checksum value for chunk [0, 0x23b42): Mirror 1: 0x9909afa Mirror 5: 0x9909afa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23b42: skipped 000102 1784341973.188282 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x23b42): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23b42): Mirror 2: 0x9909afa (stale) Mirror 3: 0x9909afa (stale) Mirror 4: 0x9909afa (stale) CRC-32 checksum value for chunk [0, 0x23b42): Mirror 1: 0x9909afa Mirror 5: 0x9909afa Mirror 6: 0x9909afa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23b42: skipped 000103 1784341973.559513 read 0x00a63d thru 0x0124ae (0x7e72 bytes) 000104 1784341973.567376 write 0x028378 thru 0x02b970 (0x35f9 bytes) 000105 1784341973.612414 write 0x0016f4 thru 0x00ae3f (0x974c bytes) 000106 1784341973.617173 write 0x00f453 thru 0x01d48d (0xe03b bytes) 000107 1784341973.622297 write 0x025e4a thru 0x02f097 (0x924e bytes) 000109 1784341973.625715 write 0x0311e8 thru 0x033001 (0x1e1a bytes) 000110 1784341973.626662 write 0x00df0c thru 0x0146a9 (0x679e bytes) 000112 1784341973.631783 trunc from 0x033002 to 0x00019e (0x32e63 bytes) 000114 1784341973.660588 read 0x00003f thru 0x00019e (0x160 bytes) 000116 1784341973.664630 read 0x000177 thru 0x00019e (0x28 bytes) 000117 1784341973.665295 trunc from 0x00019f to 0x00f695 (0xf4f7 bytes) 000119 1784341973.678157 MIRROR_RESYNC 6 mirrors 000120 1784341974.074209 MIRROR_EXTEND to 7 mirrors 000121 1784341974.399839 mapwrite 0x03ffe0 thru 0x03ffff (0x20 bytes) 000122 1784341974.478996 MIRROR_RESYNC 7 mirrors 000123 1784341974.973175 MIRROR_EXTEND to 8 mirrors 000125 1784341975.352960 read 0x025ca2 thru 0x026f0b (0x126a bytes) 000129 1784341975.367795 trunc from 0x040000 to 0x01978c (0x26873 bytes) 000130 1784341975.407353 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1978d): Mirror 2: 0xfa65610a (stale) Mirror 3: 0xfa65610a (stale) Mirror 4: 0xfa65610a (stale) Mirror 6: 0xfa65610a (stale) Mirror 7: 0xfa65610a (stale) Mirror 8: 0xfa65610a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1978d): Mirror 2: 0xfa65610a (stale) Mirror 3: 0xfa65610a (stale) Mirror 4: 0xfa65610a (stale) Mirror 6: 0xfa65610a (stale) Mirror 7: 0xfa65610a (stale) Mirror 8: 0xfa65610a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1978d: skipped 000131 1784341975.613066 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1978d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1978d): Mirror 2: 0xfa65610a (stale) Mirror 3: 0xfa65610a (stale) Mirror 4: 0xfa65610a (stale) Mirror 6: 0xfa65610a (stale) Mirror 7: 0xfa65610a (stale) Mirror 8: 0xfa65610a (stale) CRC-32 checksum value for chunk [0, 0x1978d): Mirror 1: 0xfa65610a Mirror 9: 0xfa65610a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1978d: skipped 000134 1784341976.056597 mapwrite 0x020a5d thru 0x027ca6 (0x724a bytes) 000137 1784341976.147671 write 0x01e700 thru 0x020632 (0x1f33 bytes) 000140 1784341976.150603 read 0x024e54 thru 0x027ca6 (0x2e53 bytes) 000142 1784341976.151358 write 0x026fc2 thru 0x02b91f (0x495e bytes) 000146 1784341976.153385 trunc from 0x02b920 to 0x013280 (0x1869f bytes) 000147 1784341976.168109 trunc from 0x013281 to 0x02014e (0xcece bytes) 000149 1784341976.176383 write 0x01a02c thru 0x029743 (0xf718 bytes) 000150 1784341976.181736 mapwrite 0x0351e0 thru 0x0359ff (0x820 bytes) 000151 1784341976.225961 write 0x03397c thru 0x03ffff (0xc684 bytes) 000153 1784341976.227815 mapwrite 0x02f145 thru 0x037519 (0x83d5 bytes) 000155 1784341976.256782 MIRROR_RESYNC 8 mirrors 000158 1784341976.867303 trunc from 0x040000 to 0x014752 (0x2b8ad bytes) 000159 1784341976.918595 MIRROR_RESYNC 8 mirrors 000161 1784341977.438166 read 0x0016d6 thru 0x001cf8 (0x623 bytes) 000162 1784341977.442096 MIRROR_EXTEND to 9 mirrors 000165 1784341977.785117 mapwrite 0x010e94 thru 0x018749 (0x78b6 bytes) 000168 1784341977.892659 read 0x011ab8 thru 0x017be3 (0x612c bytes) 000169 1784341977.895506 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1874a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1874a): Mirror 2: 0x8aa95f1e (stale) Mirror 3: 0x8aa95f1e (stale) Mirror 4: 0x8aa95f1e (stale) Mirror 6: 0x8aa95f1e (stale) Mirror 7: 0x8aa95f1e (stale) Mirror 8: 0x8aa95f1e (stale) Mirror 9: 0x8aa95f1e (stale) Mirror 10: 0x8aa95f1e (stale) CRC-32 checksum value for chunk [0, 0x1874a): Mirror 1: 0x82cc9bd8 Mirror 11: 0x82cc9bd8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1874a: skipped 000171 1784341978.317383 mapwrite 0x0288c5 thru 0x02b3c6 (0x2b02 bytes) 000172 1784341978.411235 mapwrite 0x005f3a thru 0x015617 (0xf6de bytes) 000173 1784341978.450246 trunc from 0x02b3c7 to 0x02f4b4 (0x40ee bytes) 000174 1784341978.460422 mapread 0x01745d thru 0x01e084 (0x6c28 bytes) 000175 1784341978.468602 read 0x01864a thru 0x0262b1 (0xdc68 bytes) 000177 1784341978.472286 trunc from 0x02f4b5 to 0x00adaa (0x2470a bytes) 000178 1784341978.488367 mapread 0x0018be thru 0x00adaa (0x94ed bytes) 000180 1784341978.490165 read 0x00a496 thru 0x00adaa (0x915 bytes) 000182 1784341978.491778 read 0x00a667 thru 0x00adaa (0x744 bytes) 000183 1784341978.492472 write 0x0001ba thru 0x006ff5 (0x6e3c bytes) 000184 1784341978.497734 MIRROR_RESYNC 10 mirrors 000186 1784341979.005267 mapread 0x007cb1 thru 0x00adaa (0x30fa bytes) 000187 1784341979.014102 mapwrite 0x03cfce thru 0x03ffff (0x3032 bytes) 000188 1784341979.093044 read 0x035137 thru 0x03bc65 (0x6b2f bytes) 000189 1784341979.097024 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37c62785 (stale) Mirror 3: 0x37c62785 (stale) Mirror 4: 0x37c62785 (stale) Mirror 6: 0x37c62785 (stale) Mirror 7: 0x37c62785 (stale) Mirror 8: 0x37c62785 (stale) Mirror 9: 0x37c62785 (stale) Mirror 10: 0x37c62785 (stale) Mirror 11: 0x37c62785 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5400f3d3 Mirror 12: 0x5400f3d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000190 1784341979.478888 mapwrite 0x026e85 thru 0x034ead (0xe029 bytes) 000194 1784341979.600254 write 0x0319d4 thru 0x0378b8 (0x5ee5 bytes) 000200 1784341979.607459 write 0x01a9bf thru 0x01ce36 (0x2478 bytes) 000201 1784341979.618400 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37c62785 (stale) Mirror 3: 0x37c62785 (stale) Mirror 4: 0x37c62785 (stale) Mirror 6: 0x37c62785 (stale) Mirror 7: 0x37c62785 (stale) Mirror 8: 0x37c62785 (stale) Mirror 9: 0x37c62785 (stale) Mirror 10: 0x37c62785 (stale) Mirror 12: 0x5400f3d3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37c62785 (stale) Mirror 3: 0x37c62785 (stale) Mirror 4: 0x37c62785 (stale) Mirror 6: 0x37c62785 (stale) Mirror 7: 0x37c62785 (stale) Mirror 8: 0x37c62785 (stale) Mirror 9: 0x37c62785 (stale) Mirror 10: 0x37c62785 (stale) Mirror 12: 0x5400f3d3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000203 1784341979.899016 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37c62785 (stale) Mirror 3: 0x37c62785 (stale) Mirror 4: 0x37c62785 (stale) Mirror 6: 0x37c62785 (stale) Mirror 7: 0x37c62785 (stale) Mirror 8: 0x37c62785 (stale) Mirror 9: 0x37c62785 (stale) Mirror 10: 0x37c62785 (stale) Mirror 12: 0x5400f3d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf8fa0d57 Mirror 13: 0xf8fa0d57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000204 1784341980.338343 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37c62785 (stale) Mirror 3: 0x37c62785 (stale) Mirror 4: 0x37c62785 (stale) Mirror 6: 0x37c62785 (stale) Mirror 8: 0x37c62785 (stale) Mirror 9: 0x37c62785 (stale) Mirror 10: 0x37c62785 (stale) Mirror 12: 0x5400f3d3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x37c62785 (stale) Mirror 3: 0x37c62785 (stale) Mirror 4: 0x37c62785 (stale) Mirror 6: 0x37c62785 (stale) Mirror 8: 0x37c62785 (stale) Mirror 9: 0x37c62785 (stale) Mirror 10: 0x37c62785 (stale) Mirror 12: 0x5400f3d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf8fa0d57 Mirror 13: 0xf8fa0d57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000209 1784341980.784203 trunc from 0x040000 to 0x03013f (0xfec0 bytes) 000213 1784341980.825804 trunc from 0x030140 to 0x00f4e5 (0x20c5a bytes) 000219 1784341980.837141 read 0x00551b thru 0x00a8e6 (0x53cc bytes) 000222 1784341980.844881 mapwrite 0x03a333 thru 0x03ffff (0x5ccd bytes) 000223 1784341980.908260 trunc from 0x040000 to 0x0218ed (0x1e712 bytes) 000224 1784341980.918322 mapread 0x01e36f thru 0x0218ed (0x357f bytes) 000225 1784341980.929395 mapwrite 0x029041 thru 0x0294ba (0x47a bytes) 000228 1784341980.975980 write 0x01794e thru 0x02440a (0xcabd bytes) 000230 1784341980.977506 trunc from 0x0294bb to 0x028f5e (0x55c bytes) 000231 1784341980.986398 write 0x00da9a thru 0x0199d0 (0xbf37 bytes) 000233 1784341980.994075 mapwrite 0x023a68 thru 0x0335bb (0xfb54 bytes) 000234 1784341981.039761 mapwrite 0x02c6a9 thru 0x03bba7 (0xf4ff bytes) 000235 1784341981.086475 mapwrite 0x02ac7a thru 0x02c00a (0x1391 bytes) 000237 1784341981.114397 trunc from 0x03bba8 to 0x000376 (0x3b831 bytes) 000239 1784341981.129518 mapwrite 0x0248ba thru 0x02d6a9 (0x8df0 bytes) 000241 1784341981.178202 read 0x01d851 thru 0x0241d1 (0x6981 bytes) 000242 1784341981.179203 write 0x016c68 thru 0x019111 (0x24aa bytes) 000243 1784341981.186441 trunc from 0x02d6aa to 0x0375b3 (0x9f0a bytes) 000245 1784341981.197036 read 0x010fc9 thru 0x01beca (0xaf02 bytes) 000246 1784341981.197769 mapwrite 0x0399f7 thru 0x03ffff (0x6609 bytes) 000247 1784341981.239353 mapread 0x023bfe thru 0x026c44 (0x3047 bytes) 000248 1784341981.240326 mapwrite 0x03a7aa thru 0x03ffff (0x5856 bytes) 000250 1784341981.272951 mapread 0x0221e9 thru 0x031443 (0xf25b bytes) 000251 1784341981.274298 trunc from 0x040000 to 0x0069b7 (0x39648 bytes) 000252 1784341981.284522 mapwrite 0x0134b2 thru 0x01fd6f (0xc8be bytes) 000253 1784341981.365762 MIRROR_RESYNC 10 mirrors 000254 1784341982.169819 mapwrite 0x0269c8 thru 0x0283cf (0x1a08 bytes) 000256 1784341982.241785 read 0x009ab6 thru 0x00d9e5 (0x3f30 bytes) 000257 1784341982.245357 read 0x000385 thru 0x000caa (0x926 bytes) 000258 1784341982.249538 mapread 0x008226 thru 0x00ad7a (0x2b55 bytes) 000260 1784341982.250538 mapwrite 0x0335f9 thru 0x03bdb4 (0x87bc bytes) 000261 1784341982.283048 trunc from 0x03bdb5 to 0x02d18a (0xec2a bytes) 000262 1784341982.290353 write 0x039c81 thru 0x03c62e (0x29ae bytes) 000263 1784341982.291175 mapread 0x000a47 thru 0x003e18 (0x33d2 bytes) 000264 1784341982.293779 MIRROR_RESYNC 10 mirrors 000266 1784341982.943134 write 0x015cc6 thru 0x022b9d (0xced8 bytes) 000267 1784341982.983223 mapread 0x033b7d thru 0x03c62e (0x8ab2 bytes) 000268 1784341982.995675 MIRROR_RESYNC 10 mirrors 000270 1784341983.697629 MIRROR_RESYNC 10 mirrors 000271 1784341983.936212 write 0x02b57c thru 0x03833e (0xcdc3 bytes) 000272 1784341983.973662 trunc from 0x03c62f to 0x02fa82 (0xcbac bytes) 000278 1784341983.985719 mapread 0x00d3b6 thru 0x00fdea (0x2a35 bytes) 000279 1784341983.999332 read 0x01cf6f thru 0x01f18a (0x221c bytes) 000280 1784341984.003395 write 0x00e3bb thru 0x0105d8 (0x221e bytes) 000281 1784341984.004130 read 0x00f1d9 thru 0x00fb72 (0x99a bytes) 000282 1784341984.006796 MIRROR_RESYNC 10 mirrors 000283 1784341984.714035 trunc from 0x02fa83 to 0x03b4c3 (0xba41 bytes) 000284 1784341984.765308 mapread 0x01248a thru 0x01c025 (0x9b9c bytes) 000286 1784341984.774885 mapwrite 0x01122d thru 0x01ddaa (0xcb7e bytes) 000287 1784341984.820654 read 0x030a08 thru 0x03b4c3 (0xaabc bytes) 000288 1784341984.825243 mapwrite 0x01bc17 thru 0x01c9f6 (0xde0 bytes) 000290 1784341984.858945 mapread 0x020a87 thru 0x026a65 (0x5fdf bytes) 000291 1784341984.868118 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b4c4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4c4): Mirror 2: 0x3bf0c978 (stale) Mirror 3: 0x3bf0c978 (stale) Mirror 4: 0x3bf0c978 (stale) Mirror 6: 0x3bf0c978 (stale) Mirror 8: 0x3bf0c978 (stale) Mirror 9: 0x3bf0c978 (stale) Mirror 10: 0x3bf0c978 (stale) Mirror 12: 0x3bf0c978 (stale) Mirror 13: 0x3bf0c978 (stale) CRC-32 checksum value for chunk [0, 0x3b4c4): Mirror 1: 0x6be33481 Mirror 14: 0x6be33481 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4c4: skipped 000293 1784341985.404232 write 0x02a1f2 thru 0x037f79 (0xdd88 bytes) 000294 1784341985.443665 trunc from 0x03b4c4 to 0x02d149 (0xe37a bytes) 000297 1784341985.458464 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d14a): Mirror 2: 0xfc5bef70 (stale) Mirror 3: 0xfc5bef70 (stale) Mirror 4: 0xfc5bef70 (stale) Mirror 6: 0xfc5bef70 (stale) Mirror 8: 0xfc5bef70 (stale) Mirror 9: 0xfc5bef70 (stale) Mirror 10: 0xfc5bef70 (stale) Mirror 12: 0xfc5bef70 (stale) Mirror 13: 0xfc5bef70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d14a): Mirror 2: 0xfc5bef70 (stale) Mirror 3: 0xfc5bef70 (stale) Mirror 4: 0xfc5bef70 (stale) Mirror 6: 0xfc5bef70 (stale) Mirror 8: 0xfc5bef70 (stale) Mirror 9: 0xfc5bef70 (stale) Mirror 10: 0xfc5bef70 (stale) Mirror 12: 0xfc5bef70 (stale) Mirror 13: 0xfc5bef70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d14a: skipped 000298 1784341985.786608 trunc from 0x02d14a to 0x004f49 (0x28200 bytes) 000301 1784341985.803384 write 0x028442 thru 0x02d9a7 (0x5566 bytes) 000302 1784341985.805312 trunc from 0x02d9a8 to 0x00e6d7 (0x1f2d0 bytes) 000303 1784341985.815313 trunc from 0x00e6d8 to 0x0047ee (0x9ee9 bytes) 000306 1784341985.830192 mapread 0x001d01 thru 0x0047ee (0x2aee bytes) 000307 1784341985.841979 mapwrite 0x0084d7 thru 0x00e334 (0x5e5e bytes) 000309 1784341985.915552 trunc from 0x00e335 to 0x017932 (0x95fe bytes) 000310 1784341985.931511 MIRROR_RESYNC 10 mirrors 000311 1784341986.706605 trunc from 0x017933 to 0x031e4f (0x1a51d bytes) 000312 1784341986.747819 read 0x014749 thru 0x01f355 (0xac0d bytes) 000313 1784341986.754009 trunc from 0x031e50 to 0x006c91 (0x2b1be bytes) 000315 1784341986.766385 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x6c92): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6c92): Mirror 2: 0xae1b60a4 (stale) Mirror 3: 0xae1b60a4 (stale) Mirror 4: 0xae1b60a4 (stale) Mirror 6: 0xae1b60a4 (stale) Mirror 8: 0xae1b60a4 (stale) Mirror 9: 0xae1b60a4 (stale) Mirror 10: 0xae1b60a4 (stale) Mirror 12: 0xae1b60a4 (stale) Mirror 13: 0xae1b60a4 (stale) CRC-32 checksum value for chunk [0, 0x6c92): Mirror 1: 0xae1b60a4 Mirror 14: 0xae1b60a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6c92: skipped 000316 1784341987.231556 mapread 0x002688 thru 0x006c91 (0x460a bytes) 000317 1784341987.249779 read 0x000672 thru 0x006c91 (0x6620 bytes) 000318 1784341987.255405 read 0x000bf4 thru 0x006c91 (0x609e bytes) 000319 1784341987.258431 read 0x0042d7 thru 0x006c91 (0x29bb bytes) 000320 1784341987.260956 mapwrite 0x010cfb thru 0x01dd6e (0xd074 bytes) 000321 1784341987.395501 read 0x00bb10 thru 0x012428 (0x6919 bytes) 000322 1784341987.396246 mapwrite 0x00cb45 thru 0x010c07 (0x40c3 bytes) 000323 1784341987.432769 mapwrite 0x01d69b thru 0x022cd2 (0x5638 bytes) 000324 1784341987.503193 mapread 0x010b82 thru 0x018384 (0x7803 bytes) 000325 1784341987.504378 mapread 0x01b4d5 thru 0x022cd2 (0x77fe bytes) 000326 1784341987.508525 MIRROR_RESYNC 11 mirrors 000327 1784341988.316715 mapwrite 0x01b7cd thru 0x02590f (0xa143 bytes) 000331 1784341988.419737 write 0x010eb3 thru 0x0111fa (0x348 bytes) 000332 1784341988.425219 read 0x00ab48 thru 0x012a46 (0x7eff bytes) 000333 1784341988.429161 trunc from 0x025910 to 0x006c56 (0x1ecb9 bytes) 000337 1784341988.453781 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x6c57): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6c57): Mirror 2: 0xf590d684 (stale) Mirror 3: 0xf590d684 (stale) Mirror 4: 0xf590d684 (stale) Mirror 6: 0xf590d684 (stale) Mirror 8: 0xf590d684 (stale) Mirror 9: 0xf590d684 (stale) Mirror 10: 0xf590d684 (stale) Mirror 12: 0xf590d684 (stale) Mirror 13: 0xf590d684 (stale) Mirror 14: 0xf590d684 (stale) CRC-32 checksum value for chunk [0, 0x6c57): Mirror 1: 0xf590d684 Mirror 15: 0xf590d684 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6c57: skipped 000338 1784341988.860880 trunc from 0x006c57 to 0x010be8 (0x9f92 bytes) 000339 1784341988.927495 MIRROR_RESYNC 12 mirrors 000341 1784341989.702881 trunc from 0x010be9 to 0x00d43c (0x37ac bytes) 000344 1784341989.739151 read 0x00bbb8 thru 0x00d43c (0x1885 bytes) 000347 1784341989.744833 trunc from 0x00d43d to 0x016aec (0x96b0 bytes) 000349 1784341989.753879 mapwrite 0x01459f thru 0x01751a (0x2f7c bytes) 000350 1784341989.809735 read 0x013afa thru 0x01751a (0x3a21 bytes) 000351 1784341989.810748 mapread 0x00dd17 thru 0x012915 (0x4bff bytes) 000352 1784341989.820989 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1751b): Mirror 2: 0xa286397e (stale) Mirror 4: 0xa286397e (stale) Mirror 6: 0xa286397e (stale) Mirror 8: 0xa286397e (stale) Mirror 9: 0xa286397e (stale) Mirror 10: 0xa286397e (stale) Mirror 12: 0xa286397e (stale) Mirror 13: 0xa286397e (stale) Mirror 14: 0xa286397e (stale) Mirror 15: 0xa286397e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1751b): Mirror 2: 0xa286397e (stale) Mirror 4: 0xa286397e (stale) Mirror 6: 0xa286397e (stale) Mirror 8: 0xa286397e (stale) Mirror 9: 0xa286397e (stale) Mirror 10: 0xa286397e (stale) Mirror 12: 0xa286397e (stale) Mirror 13: 0xa286397e (stale) Mirror 14: 0xa286397e (stale) Mirror 15: 0xa286397e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1751b: skipped 000353 1784341990.035807 mapwrite 0x01d3e1 thru 0x029f21 (0xcb41 bytes) 000355 1784341990.102652 write 0x02b386 thru 0x030b57 (0x57d2 bytes) 000356 1784341990.103889 write 0x01b627 thru 0x025b8b (0xa565 bytes) 000357 1784341990.105605 mapwrite 0x02e985 thru 0x02eeab (0x527 bytes) 000358 1784341990.143235 MIRROR_RESYNC 11 mirrors 000359 1784341990.910677 write 0x024558 thru 0x02fb92 (0xb63b bytes) 000362 1784341990.962727 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x30b58): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b58): Mirror 2: 0x931ee969 (stale) Mirror 4: 0x931ee969 (stale) Mirror 6: 0x931ee969 (stale) Mirror 8: 0x931ee969 (stale) Mirror 9: 0x931ee969 (stale) Mirror 10: 0x931ee969 (stale) Mirror 12: 0x931ee969 (stale) Mirror 13: 0x931ee969 (stale) Mirror 14: 0x931ee969 (stale) Mirror 15: 0x931ee969 (stale) CRC-32 checksum value for chunk [0, 0x30b58): Mirror 1: 0x3e561489 Mirror 16: 0x3e561489 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b58: skipped 000363 1784341991.377052 mapwrite 0x006692 thru 0x00b9ee (0x535d bytes) 000364 1784341991.483764 mapwrite 0x00cf97 thru 0x0187f6 (0xb860 bytes) 000365 1784341991.513438 read 0x013478 thru 0x01ae43 (0x79cc bytes) 000366 1784341991.523605 mapwrite 0x01acc8 thru 0x028688 (0xd9c1 bytes) 000367 1784341991.568678 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x30b58): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b58): Mirror 2: 0x931ee969 (stale) Mirror 4: 0x931ee969 (stale) Mirror 6: 0x931ee969 (stale) Mirror 8: 0x931ee969 (stale) Mirror 9: 0x931ee969 (stale) Mirror 10: 0x931ee969 (stale) Mirror 12: 0x931ee969 (stale) Mirror 13: 0x931ee969 (stale) Mirror 14: 0x931ee969 (stale) Mirror 15: 0x931ee969 (stale) Mirror 16: 0x3e561489 (stale) CRC-32 checksum value for chunk [0, 0x30b58): Mirror 1: 0xfcd694a Mirror 17: 0xfcd694a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b58: skipped 000368 1784341992.034420 write 0x02971d thru 0x030c61 (0x7545 bytes) 000369 1784341992.083051 write 0x03a94f thru 0x03ffff (0x56b1 bytes) 000370 1784341992.087754 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbd2c6ab3 (stale) Mirror 4: 0xbd2c6ab3 (stale) Mirror 6: 0xbd2c6ab3 (stale) Mirror 8: 0xbd2c6ab3 (stale) Mirror 9: 0xbd2c6ab3 (stale) Mirror 10: 0xbd2c6ab3 (stale) Mirror 12: 0xbd2c6ab3 (stale) Mirror 13: 0xbd2c6ab3 (stale) Mirror 14: 0xbd2c6ab3 (stale) Mirror 15: 0xbd2c6ab3 (stale) Mirror 16: 0x167ec5a7 (stale) Mirror 17: 0x5614ce5c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1e2a469 Mirror 18: 0xc1e2a469 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000371 1784341992.686043 trunc from 0x040000 to 0x02b540 (0x14abf bytes) 000374 1784341992.742407 mapread 0x013f03 thru 0x01ede5 (0xaee3 bytes) 000379 1784341992.761815 write 0x00f364 thru 0x019468 (0xa105 bytes) 000384 1784341992.764508 mapread 0x001607 thru 0x00db50 (0xc54a bytes) 000388 1784341992.772877 write 0x02f4d5 thru 0x03575d (0x6289 bytes) 000389 1784341992.774029 trunc from 0x03575e to 0x01734f (0x1e40e bytes) 000392 1784341992.785343 mapwrite 0x012414 thru 0x016732 (0x431f bytes) 000394 1784341992.806702 mapwrite 0x00c112 thru 0x0147e1 (0x86d0 bytes) 000395 1784341992.828525 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17350): Mirror 2: 0x906dcff0 (stale) Mirror 4: 0x906dcff0 (stale) Mirror 8: 0x906dcff0 (stale) Mirror 9: 0x906dcff0 (stale) Mirror 10: 0x906dcff0 (stale) Mirror 12: 0x906dcff0 (stale) Mirror 13: 0x906dcff0 (stale) Mirror 14: 0x906dcff0 (stale) Mirror 15: 0x906dcff0 (stale) Mirror 16: 0x906dcff0 (stale) Mirror 17: 0xa945fb31 (stale) Mirror 18: 0xa945fb31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17350): Mirror 2: 0x906dcff0 (stale) Mirror 4: 0x906dcff0 (stale) Mirror 8: 0x906dcff0 (stale) Mirror 9: 0x906dcff0 (stale) Mirror 10: 0x906dcff0 (stale) Mirror 12: 0x906dcff0 (stale) Mirror 13: 0x906dcff0 (stale) Mirror 14: 0x906dcff0 (stale) Mirror 15: 0x906dcff0 (stale) Mirror 16: 0x906dcff0 (stale) Mirror 17: 0xa945fb31 (stale) Mirror 18: 0xa945fb31 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17350: skipped 000396 1784341993.105759 read 0x00a5f5 thru 0x01734f (0xcd5b bytes) 000398 1784341993.110680 read 0x00e980 thru 0x01734f (0x89d0 bytes) 000399 1784341993.111410 trunc from 0x017350 to 0x01c06a (0x4d1b bytes) 000402 1784341993.118770 trunc from 0x01c06b to 0x0259dc (0x9972 bytes) 000404 1784341993.126834 mapwrite 0x0104d5 thru 0x01692f (0x645b bytes) 000405 1784341993.147450 mapread 0x011c5c thru 0x01da20 (0xbdc5 bytes) 000407 1784341993.154082 mapread 0x00e86a thru 0x01525d (0x69f4 bytes) 000408 1784341993.154955 read 0x009d5b thru 0x013e30 (0xa0d6 bytes) 000409 1784341993.155473 read 0x0255a0 thru 0x0259dc (0x43d bytes) 000410 1784341993.156129 write 0x0052a7 thru 0x012952 (0xd6ac bytes) 000412 1784341993.157512 read 0x023606 thru 0x0259dc (0x23d7 bytes) 000413 1784341993.160760 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x259dd): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x259dd): Mirror 2: 0xa27f6f66 (stale) Mirror 4: 0xa27f6f66 (stale) Mirror 8: 0xa27f6f66 (stale) Mirror 9: 0xa27f6f66 (stale) Mirror 10: 0xa27f6f66 (stale) Mirror 12: 0xa27f6f66 (stale) Mirror 13: 0xa27f6f66 (stale) Mirror 14: 0xa27f6f66 (stale) Mirror 15: 0xa27f6f66 (stale) Mirror 16: 0x823c061a (stale) Mirror 17: 0x38c97254 (stale) Mirror 18: 0x38c97254 (stale) CRC-32 checksum value for chunk [0, 0x259dd): Mirror 1: 0x3a5b9eec Mirror 19: 0x3a5b9eec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x259dd: skipped 000414 1784341993.645471 write 0x03f97d thru 0x03ffff (0x683 bytes) 000415 1784341993.703336 trunc from 0x040000 to 0x01e33b (0x21cc4 bytes) 000416 1784341993.725164 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1e33c): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e33c): Mirror 2: 0xa5fb11cd (stale) Mirror 4: 0xa5fb11cd (stale) Mirror 8: 0xa5fb11cd (stale) Mirror 9: 0xa5fb11cd (stale) Mirror 10: 0xa5fb11cd (stale) Mirror 12: 0xa5fb11cd (stale) Mirror 13: 0xa5fb11cd (stale) Mirror 14: 0xa5fb11cd (stale) Mirror 15: 0xa5fb11cd (stale) Mirror 16: 0xa5fb11cd (stale) Mirror 17: 0x67bacee (stale) Mirror 18: 0x67bacee (stale) Mirror 19: 0xd7c5b0b9 (stale) CRC-32 checksum value for chunk [0, 0x1e33c): Mirror 1: 0xd7c5b0b9 Mirror 20: 0xd7c5b0b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e33c: skipped 000417 1784341994.190654 write 0x028b48 thru 0x02b622 (0x2adb bytes) 000419 1784341994.254995 mapread 0x00b831 thru 0x018afe (0xd2ce bytes) 000420 1784341994.277300 mapread 0x01d3f5 thru 0x02923f (0xbe4b bytes) 000421 1784341994.286998 mapread 0x01b997 thru 0x02729d (0xb907 bytes) 000422 1784341994.288237 mapwrite 0x00392b thru 0x007060 (0x3736 bytes) 000423 1784341994.321748 mapwrite 0x039c27 thru 0x03b385 (0x175f bytes) 000426 1784341994.384689 mapread 0x02a973 thru 0x033256 (0x88e4 bytes) 000428 1784341994.392478 write 0x030b9c thru 0x03ba96 (0xaefb bytes) 000429 1784341994.396344 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ba97): Mirror 2: 0xa93f4661 (stale) Mirror 4: 0xa93f4661 (stale) Mirror 8: 0xa93f4661 (stale) Mirror 9: 0xa93f4661 (stale) Mirror 10: 0xa93f4661 (stale) Mirror 12: 0xa93f4661 (stale) Mirror 13: 0xa93f4661 (stale) Mirror 15: 0xa93f4661 (stale) Mirror 16: 0xe7e7d76e (stale) Mirror 17: 0x5d5aa601 (stale) Mirror 18: 0x76aa0c8f (stale) Mirror 19: 0x21fceac4 (stale) Mirror 20: 0x21fceac4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba97): Mirror 2: 0xa93f4661 (stale) Mirror 4: 0xa93f4661 (stale) Mirror 8: 0xa93f4661 (stale) Mirror 9: 0xa93f4661 (stale) Mirror 10: 0xa93f4661 (stale) Mirror 12: 0xa93f4661 (stale) Mirror 13: 0xa93f4661 (stale) Mirror 15: 0xa93f4661 (stale) Mirror 16: 0xe7e7d76e (stale) Mirror 17: 0x5d5aa601 (stale) Mirror 18: 0x76aa0c8f (stale) Mirror 19: 0x21fceac4 (stale) Mirror 20: 0x21fceac4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba97: skipped 000430 1784341994.743612 write 0x01ccd6 thru 0x02178b (0x4ab6 bytes) 000432 1784341994.749029 trunc from 0x03ba97 to 0x035d79 (0x5d1d bytes) 000434 1784341994.756323 write 0x036499 thru 0x03b253 (0x4dbb bytes) 000436 1784341994.757750 mapread 0x02170e thru 0x0226d0 (0xfc3 bytes) 000439 1784341994.763077 mapread 0x01be8f thru 0x02b326 (0xf498 bytes) 000440 1784341994.770937 read 0x01c381 thru 0x026732 (0xa3b2 bytes) 000441 1784341994.771477 read 0x02a60f thru 0x0372b0 (0xcca2 bytes) 000443 1784341994.781363 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b254): Mirror 2: 0x847c41c5 (stale) Mirror 4: 0x847c41c5 (stale) Mirror 8: 0x847c41c5 (stale) Mirror 9: 0x847c41c5 (stale) Mirror 10: 0x847c41c5 (stale) Mirror 12: 0x847c41c5 (stale) Mirror 15: 0x847c41c5 (stale) Mirror 16: 0xd00368aa (stale) Mirror 17: 0x2d8c27fa (stale) Mirror 18: 0xf4698550 (stale) Mirror 19: 0xd5170dbb (stale) Mirror 20: 0xd5170dbb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b254): Mirror 2: 0x847c41c5 (stale) Mirror 4: 0x847c41c5 (stale) Mirror 8: 0x847c41c5 (stale) Mirror 9: 0x847c41c5 (stale) Mirror 10: 0x847c41c5 (stale) Mirror 12: 0x847c41c5 (stale) Mirror 15: 0x847c41c5 (stale) Mirror 16: 0xd00368aa (stale) Mirror 17: 0x2d8c27fa (stale) Mirror 18: 0xf4698550 (stale) Mirror 19: 0xd5170dbb (stale) Mirror 20: 0xd5170dbb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b254: skipped 000444 1784341995.169381 trunc from 0x03b254 to 0x02bcee (0xf565 bytes) 000445 1784341995.180864 write 0x00ab42 thru 0x012582 (0x7a41 bytes) 000446 1784341995.188653 mapread 0x0123f5 thru 0x01ae67 (0x8a73 bytes) 000448 1784341995.195999 mapread 0x02b506 thru 0x02bcee (0x7e9 bytes) 000449 1784341995.211233 MIRROR_RESYNC 13 mirrors 000453 1784341996.033537 read 0x00df8b thru 0x014269 (0x62df bytes) 000454 1784341996.036788 read 0x02059b thru 0x02b6dd (0xb143 bytes) 000455 1784341996.042254 read 0x017c20 thru 0x020e03 (0x91e4 bytes) 000456 1784341996.046434 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) 000457 1784341996.259394 read 0x00cd67 thru 0x019321 (0xc5bb bytes) 000458 1784341996.273821 mapwrite 0x028019 thru 0x034582 (0xc56a bytes) 000459 1784341996.378609 mapread 0x033d37 thru 0x034582 (0x84c bytes) 000461 1784341996.380166 trunc from 0x034583 to 0x03c199 (0x7c17 bytes) 000464 1784341996.395027 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3c19a): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c19a): Mirror 2: 0xa5c3ab4c (stale) Mirror 8: 0xa5c3ab4c (stale) Mirror 9: 0xa5c3ab4c (stale) Mirror 10: 0xa5c3ab4c (stale) Mirror 12: 0xa5c3ab4c (stale) Mirror 15: 0xa5c3ab4c (stale) Mirror 16: 0xa5c3ab4c (stale) Mirror 17: 0xa5c3ab4c (stale) Mirror 18: 0xa5c3ab4c (stale) Mirror 19: 0xa5c3ab4c (stale) Mirror 20: 0xa5c3ab4c (stale) CRC-32 checksum value for chunk [0, 0x3c19a): Mirror 1: 0xfe8e12eb Mirror 21: 0xfe8e12eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c19a: skipped 000465 1784341996.928274 trunc from 0x03c19a to 0x024610 (0x17b89 bytes) 000468 1784341996.968294 mapread 0x002d50 thru 0x0054d1 (0x2782 bytes) 000469 1784341996.976803 trunc from 0x024611 to 0x0379c7 (0x133b7 bytes) 000471 1784341996.989299 MIRROR_RESYNC 13 mirrors 000472 1784341997.828626 mapwrite 0x00b1e7 thru 0x0136aa (0x84c4 bytes) 000473 1784341997.931976 mapread 0x01e42b thru 0x02c31b (0xdef1 bytes) 000476 1784341997.949950 read 0x0076b8 thru 0x00bc13 (0x455c bytes) 000478 1784341997.955758 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x379c8): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379c8): Mirror 2: 0xc386b5ee (stale) Mirror 8: 0xc386b5ee (stale) Mirror 9: 0xc386b5ee (stale) Mirror 10: 0xc386b5ee (stale) Mirror 12: 0xc386b5ee (stale) Mirror 15: 0xc386b5ee (stale) Mirror 16: 0xc386b5ee (stale) Mirror 17: 0xc386b5ee (stale) Mirror 18: 0xc386b5ee (stale) Mirror 19: 0xc386b5ee (stale) Mirror 20: 0xc386b5ee (stale) Mirror 21: 0xc386b5ee (stale) CRC-32 checksum value for chunk [0, 0x379c8): Mirror 1: 0x2e1c6fc7 Mirror 22: 0x2e1c6fc7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379c8: skipped 000479 1784341998.550734 mapwrite 0x00105b thru 0x00b524 (0xa4ca bytes) 000482 1784341998.659021 read 0x013338 thru 0x022136 (0xedff bytes) 000483 1784341998.667794 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x379c8): Mirror 2: 0xc386b5ee (stale) Mirror 8: 0xc386b5ee (stale) Mirror 9: 0xc386b5ee (stale) Mirror 10: 0xc386b5ee (stale) Mirror 12: 0xc386b5ee (stale) Mirror 15: 0xc386b5ee (stale) Mirror 16: 0xc386b5ee (stale) Mirror 17: 0xc386b5ee (stale) Mirror 18: 0xc386b5ee (stale) Mirror 20: 0xc386b5ee (stale) Mirror 21: 0xc386b5ee (stale) Mirror 22: 0x2e1c6fc7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379c8): Mirror 2: 0xc386b5ee (stale) Mirror 8: 0xc386b5ee (stale) Mirror 9: 0xc386b5ee (stale) Mirror 10: 0xc386b5ee (stale) Mirror 12: 0xc386b5ee (stale) Mirror 15: 0xc386b5ee (stale) Mirror 16: 0xc386b5ee (stale) Mirror 17: 0xc386b5ee (stale) Mirror 18: 0xc386b5ee (stale) Mirror 20: 0xc386b5ee (stale) Mirror 21: 0xc386b5ee (stale) Mirror 22: 0x2e1c6fc7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379c8: skipped 000485 1784341999.070406 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x379c8): Mirror 2: 0xc386b5ee (stale) Mirror 8: 0xc386b5ee (stale) Mirror 9: 0xc386b5ee (stale) Mirror 10: 0xc386b5ee (stale) Mirror 12: 0xc386b5ee (stale) Mirror 15: 0xc386b5ee (stale) Mirror 16: 0xc386b5ee (stale) Mirror 17: 0xc386b5ee (stale) Mirror 20: 0xc386b5ee (stale) Mirror 21: 0xc386b5ee (stale) Mirror 22: 0x2e1c6fc7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379c8): Mirror 2: 0xc386b5ee (stale) Mirror 8: 0xc386b5ee (stale) Mirror 9: 0xc386b5ee (stale) Mirror 10: 0xc386b5ee (stale) Mirror 12: 0xc386b5ee (stale) Mirror 15: 0xc386b5ee (stale) Mirror 16: 0xc386b5ee (stale) Mirror 17: 0xc386b5ee (stale) Mirror 20: 0xc386b5ee (stale) Mirror 21: 0xc386b5ee (stale) Mirror 22: 0x2e1c6fc7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379c8: skipped 000486 1784341999.430108 mapread 0x028cad thru 0x02ac2b (0x1f7f bytes) 000490 1784341999.444864 write 0x017b97 thru 0x023a79 (0xbee3 bytes) 000493 1784341999.456679 read 0x028c98 thru 0x02ece5 (0x604e bytes) 000494 1784341999.457341 read 0x0205bd thru 0x025305 (0x4d49 bytes) 000495 1784341999.458279 trunc from 0x0379c8 to 0x0353c1 (0x2606 bytes) 000496 1784341999.466831 mapread 0x02f623 thru 0x0353c1 (0x5d9f bytes) 000497 1784341999.471666 write 0x01172c thru 0x0188a6 (0x717b bytes) 000498 1784341999.472791 mapwrite 0x02c1c4 thru 0x032acd (0x690a bytes) 000499 1784341999.516843 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x353c2): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353c2): Mirror 2: 0x96fd5fc5 (stale) Mirror 8: 0x96fd5fc5 (stale) Mirror 9: 0x96fd5fc5 (stale) Mirror 10: 0x96fd5fc5 (stale) Mirror 12: 0x96fd5fc5 (stale) Mirror 15: 0x96fd5fc5 (stale) Mirror 16: 0x96fd5fc5 (stale) Mirror 17: 0x96fd5fc5 (stale) Mirror 20: 0x96fd5fc5 (stale) Mirror 21: 0x96fd5fc5 (stale) Mirror 22: 0x42a8811e (stale) CRC-32 checksum value for chunk [0, 0x353c2): Mirror 1: 0x1fd01078 Mirror 23: 0x1fd01078 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353c2: skipped 000501 1784341999.947778 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x353c2): Mirror 2: 0x96fd5fc5 (stale) Mirror 8: 0x96fd5fc5 (stale) Mirror 9: 0x96fd5fc5 (stale) Mirror 10: 0x96fd5fc5 (stale) Mirror 12: 0x96fd5fc5 (stale) Mirror 15: 0x96fd5fc5 (stale) Mirror 16: 0x96fd5fc5 (stale) Mirror 17: 0x96fd5fc5 (stale) Mirror 20: 0x96fd5fc5 (stale) Mirror 21: 0x96fd5fc5 (stale) Mirror 22: 0x42a8811e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353c2): Mirror 2: 0x96fd5fc5 (stale) Mirror 8: 0x96fd5fc5 (stale) Mirror 9: 0x96fd5fc5 (stale) Mirror 10: 0x96fd5fc5 (stale) Mirror 12: 0x96fd5fc5 (stale) Mirror 15: 0x96fd5fc5 (stale) Mirror 16: 0x96fd5fc5 (stale) Mirror 17: 0x96fd5fc5 (stale) Mirror 20: 0x96fd5fc5 (stale) Mirror 21: 0x96fd5fc5 (stale) Mirror 22: 0x42a8811e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353c2: skipped 000502 1784342000.268794 trunc from 0x0353c2 to 0x037c24 (0x2863 bytes) 000504 1784342000.289275 trunc from 0x037c25 to 0x005185 (0x32a9f bytes) 000506 1784342000.296094 write 0x02ea21 thru 0x036474 (0x7a54 bytes) 000507 1784342000.297484 read 0x033df6 thru 0x036474 (0x267f bytes) 000512 1784342000.301109 write 0x032041 thru 0x03ca39 (0xa9f9 bytes) 000513 1784342000.302553 read 0x004790 thru 0x011130 (0xc9a1 bytes) 000514 1784342000.308225 write 0x0378e6 thru 0x03855e (0xc79 bytes) 000517 1784342000.310275 read 0x02df67 thru 0x02f09b (0x1135 bytes) 000520 1784342000.312018 read 0x02e244 thru 0x03b1ff (0xcfbc bytes) 000527 1784342000.314848 read 0x00a3ec thru 0x0170ab (0xccc0 bytes) 000529 1784342000.315967 write 0x01029b thru 0x01dee0 (0xdc46 bytes) 000531 1784342000.317666 mapwrite 0x02cf01 thru 0x038e45 (0xbf45 bytes) 000532 1784342000.357413 mapread 0x038740 thru 0x03bfa6 (0x3867 bytes) 000533 1784342000.358153 read 0x037a84 thru 0x03ca39 (0x4fb6 bytes) 000534 1784342000.358749 trunc from 0x03ca3a to 0x029689 (0x133b0 bytes) 000535 1784342000.365960 read 0x0172b5 thru 0x026cb4 (0xfa00 bytes) 000538 1784342000.367186 read 0x01bca0 thru 0x023b00 (0x7e61 bytes) 000539 1784342000.368208 mapwrite 0x0220ee thru 0x02fbd7 (0xdaea bytes) 000540 1784342000.422333 mapwrite 0x03fdf4 thru 0x03ffff (0x20c bytes) 000541 1784342000.456765 write 0x00dca6 thru 0x01034d (0x26a8 bytes) 000543 1784342000.457775 write 0x031ccb thru 0x03371c (0x1a52 bytes) 000544 1784342000.458327 write 0x00a9b0 thru 0x00c3e2 (0x1a33 bytes) 000546 1784342000.459211 mapwrite 0x037137 thru 0x03b637 (0x4501 bytes) 000551 1784342000.479623 mapread 0x0214a5 thru 0x02294c (0x14a8 bytes) 000553 1784342000.481134 trunc from 0x040000 to 0x03035a (0xfca5 bytes) 000554 1784342000.488564 write 0x00f452 thru 0x013af4 (0x46a3 bytes) 000555 1784342000.489506 write 0x028cff thru 0x02dacd (0x4dcf bytes) 000556 1784342000.492087 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3035b): Mirror 2: 0xbf7ae316 (stale) Mirror 8: 0xbf7ae316 (stale) Mirror 9: 0xbf7ae316 (stale) Mirror 12: 0xbf7ae316 (stale) Mirror 15: 0xbf7ae316 (stale) Mirror 16: 0xbf7ae316 (stale) Mirror 17: 0xbf7ae316 (stale) Mirror 20: 0xbf7ae316 (stale) Mirror 21: 0xbf7ae316 (stale) Mirror 22: 0xfc9a56d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3035b): Mirror 2: 0xbf7ae316 (stale) Mirror 8: 0xbf7ae316 (stale) Mirror 9: 0xbf7ae316 (stale) Mirror 12: 0xbf7ae316 (stale) Mirror 15: 0xbf7ae316 (stale) Mirror 16: 0xbf7ae316 (stale) Mirror 17: 0xbf7ae316 (stale) Mirror 20: 0xbf7ae316 (stale) Mirror 21: 0xbf7ae316 (stale) Mirror 22: 0xfc9a56d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3035b: skipped 000559 1784342000.782797 read 0x004a0b thru 0x01347f (0xea75 bytes) 000560 1784342000.794028 mapread 0x0129a9 thru 0x0130de (0x736 bytes) 000562 1784342000.795576 mapread 0x01e393 thru 0x02165a (0x32c8 bytes) 000564 1784342000.807283 read 0x025059 thru 0x02626d (0x1215 bytes) 000565 1784342000.809148 read 0x02a976 thru 0x02b097 (0x722 bytes) 000566 1784342000.816791 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3035b): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3035b): Mirror 2: 0xbf7ae316 (stale) Mirror 8: 0xbf7ae316 (stale) Mirror 9: 0xbf7ae316 (stale) Mirror 12: 0xbf7ae316 (stale) Mirror 15: 0xbf7ae316 (stale) Mirror 16: 0xbf7ae316 (stale) Mirror 17: 0xbf7ae316 (stale) Mirror 20: 0xbf7ae316 (stale) Mirror 21: 0xbf7ae316 (stale) Mirror 22: 0xfc9a56d0 (stale) CRC-32 checksum value for chunk [0, 0x3035b): Mirror 1: 0x5b396d2b Mirror 23: 0x5b396d2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3035b: skipped 000569 1784342001.184196 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3035b): Mirror 2: 0xbf7ae316 (stale) Mirror 8: 0xbf7ae316 (stale) Mirror 9: 0xbf7ae316 (stale) Mirror 12: 0xbf7ae316 (stale) Mirror 15: 0xbf7ae316 (stale) Mirror 17: 0xbf7ae316 (stale) Mirror 20: 0xbf7ae316 (stale) Mirror 21: 0xbf7ae316 (stale) Mirror 22: 0xfc9a56d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3035b): Mirror 2: 0xbf7ae316 (stale) Mirror 8: 0xbf7ae316 (stale) Mirror 9: 0xbf7ae316 (stale) Mirror 12: 0xbf7ae316 (stale) Mirror 15: 0xbf7ae316 (stale) Mirror 17: 0xbf7ae316 (stale) Mirror 20: 0xbf7ae316 (stale) Mirror 21: 0xbf7ae316 (stale) Mirror 22: 0xfc9a56d0 (stale) CRC-32 checksum value for chunk [0, 0x3035b): Mirror 1: 0x5b396d2b Mirror 23: 0x5b396d2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3035b: skipped 000570 1784342001.638672 mapread 0x0299fd thru 0x02a5cb (0xbcf bytes) 000574 1784342001.662420 trunc from 0x03035b to 0x0312fc (0xfa2 bytes) 000578 1784342001.724023 mapread 0x02b3dc thru 0x0312fc (0x5f21 bytes) 000579 1784342001.729555 write 0x01d29e thru 0x02bc71 (0xe9d4 bytes) 000584 1784342001.743827 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x312fd): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x312fd): Mirror 2: 0xfd5edbfd (stale) Mirror 8: 0xfd5edbfd (stale) Mirror 9: 0xfd5edbfd (stale) Mirror 12: 0xfd5edbfd (stale) Mirror 15: 0xfd5edbfd (stale) Mirror 17: 0xfd5edbfd (stale) Mirror 20: 0xfd5edbfd (stale) Mirror 21: 0xfd5edbfd (stale) Mirror 22: 0x9cc46d57 (stale) Mirror 23: 0x1031348e (stale) CRC-32 checksum value for chunk [0, 0x312fd): Mirror 1: 0x4ad5f011 Mirror 24: 0x4ad5f011 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x312fd: skipped 000586 1784342002.188284 write 0x00b4dc thru 0x01a060 (0xeb85 bytes) 000587 1784342002.241791 write 0x0212c2 thru 0x021e78 (0xbb7 bytes) 000588 1784342002.253141 MIRROR_RESYNC 12 mirrors 000589 1784342003.154192 write 0x01258e thru 0x012da6 (0x819 bytes) 000591 1784342003.194676 mapwrite 0x0174ab thru 0x02656b (0xf0c1 bytes) 000593 1784342003.248209 mapwrite 0x01b897 thru 0x020e9d (0x5607 bytes) 000594 1784342003.277660 trunc from 0x0312fd to 0x01befb (0x15401 bytes) 000595 1784342003.288793 mapread 0x0187a8 thru 0x01befb (0x3754 bytes) 000597 1784342003.290021 mapread 0x00dcc7 thru 0x01392d (0x5c67 bytes) 000598 1784342003.297051 trunc from 0x01befc to 0x000b2f (0x1b3cc bytes) 000600 1784342003.307593 read 0x00067f thru 0x000b2f (0x4b1 bytes) 000603 1784342003.319013 MIRROR_RESYNC 12 mirrors 000604 1784342004.035523 trunc from 0x000b30 to 0x02bd2e (0x2b1ff bytes) 000605 1784342004.082396 write 0x002de3 thru 0x00e671 (0xb88f bytes) 000607 1784342004.088174 write 0x02ed2a thru 0x02ffcd (0x12a4 bytes) 000610 1784342004.089819 mapwrite 0x02d623 thru 0x039e42 (0xc820 bytes) 000611 1784342004.135122 read 0x007ab5 thru 0x016621 (0xeb6d bytes) 000612 1784342004.139488 trunc from 0x039e43 to 0x03b2fb (0x14b9 bytes) 000613 1784342004.146458 read 0x02a7b8 thru 0x03075d (0x5fa6 bytes) 000614 1784342004.146988 write 0x00f81a thru 0x01b4f9 (0xbce0 bytes) 000615 1784342004.151053 write 0x00ad6c thru 0x014575 (0x980a bytes) 000616 1784342004.151998 mapread 0x027468 thru 0x02d9e1 (0x657a bytes) 000618 1784342004.157306 read 0x0398b3 thru 0x03b2fb (0x1a49 bytes) 000619 1784342004.157974 mapwrite 0x00ddcd thru 0x00f95d (0x1b91 bytes) 000620 1784342004.175709 mapwrite 0x003867 thru 0x0086be (0x4e58 bytes) 000622 1784342004.196339 mapwrite 0x036111 thru 0x03ffff (0x9eef bytes) 000623 1784342004.224216 mapwrite 0x028224 thru 0x03022e (0x800b bytes) 000626 1784342004.243797 mapread 0x0225af thru 0x0260ed (0x3b3f bytes) 000627 1784342004.244502 trunc from 0x040000 to 0x007695 (0x3896a bytes) 000628 1784342004.252580 mapwrite 0x01276f thru 0x01495c (0x21ee bytes) 000629 1784342004.308499 write 0x012c40 thru 0x01d776 (0xab37 bytes) 000630 1784342004.309843 trunc from 0x01d777 to 0x00474b (0x1902b bytes) 000634 1784342004.322776 read 0x003e17 thru 0x00474b (0x935 bytes) 000635 1784342004.323250 read 0x001287 thru 0x0020d3 (0xe4d bytes) 000636 1784342004.323631 mapread 0x0002e8 thru 0x00474b (0x4464 bytes) 000638 1784342004.324995 read 0x002cca thru 0x00474b (0x1a82 bytes) 000640 1784342004.326002 read 0x004255 thru 0x00474b (0x4f7 bytes) 000643 1784342004.327450 trunc from 0x00474c to 0x02f911 (0x2b1c6 bytes) 000645 1784342004.342285 mapread 0x016af8 thru 0x019f91 (0x349a bytes) 000646 1784342004.350112 mapread 0x0056d8 thru 0x00bc7c (0x65a5 bytes) 000648 1784342004.351252 read 0x02db71 thru 0x02f911 (0x1da1 bytes) 000651 1784342004.352401 write 0x014621 thru 0x0212a6 (0xcc86 bytes) 000653 1784342004.356332 write 0x036f0e thru 0x03ffff (0x90f2 bytes) 000656 1784342004.359772 mapread 0x0171fb thru 0x02089b (0x96a1 bytes) 000657 1784342004.360734 trunc from 0x040000 to 0x039919 (0x66e6 bytes) 000658 1784342004.377834 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3991a): Mirror 2: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3991a): Mirror 2: 0x31297c01 (stale) Mirror 8: 0x31297c01 (stale) Mirror 9: 0x31297c01 (stale) Mirror 12: 0x31297c01 (stale) Mirror 15: 0x31297c01 (stale) Mirror 17: 0x31297c01 (stale) Mirror 20: 0x31297c01 (stale) Mirror 21: 0x31297c01 (stale) Mirror 22: 0x31297c01 (stale) Mirror 23: 0x31297c01 (stale) Mirror 24: 0x31297c01 (stale) CRC-32 checksum value for chunk [0, 0x3991a): Mirror 1: 0x5baa6d1d Mirror 25: 0x5baa6d1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3991a: skipped 000659 1784342004.850608 write 0x00e35d thru 0x01377a (0x541e bytes) 000660 1784342004.917077 mapwrite 0x009ebb thru 0x0170cd (0xd213 bytes) 000661 1784342004.974166 read 0x01222b thru 0x019391 (0x7167 bytes) 000663 1784342004.975327 mapwrite 0x0135e3 thru 0x018bb9 (0x55d7 bytes) 000664 1784342005.009153 write 0x0194c0 thru 0x01c20c (0x2d4d bytes) 000665 1784342005.009976 mapread 0x02c5f6 thru 0x02f5c4 (0x2fcf bytes) 000667 1784342005.020418 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3991a): Mirror 8: 0x31297c01 (stale) Mirror 9: 0x31297c01 (stale) Mirror 12: 0x31297c01 (stale) Mirror 15: 0x31297c01 (stale) Mirror 17: 0x31297c01 (stale) Mirror 20: 0x31297c01 (stale) Mirror 21: 0x31297c01 (stale) Mirror 22: 0x31297c01 (stale) Mirror 23: 0x31297c01 (stale) Mirror 24: 0x31297c01 (stale) Mirror 25: 0x5baa6d1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3991a): Mirror 8: 0x31297c01 (stale) Mirror 9: 0x31297c01 (stale) Mirror 12: 0x31297c01 (stale) Mirror 15: 0x31297c01 (stale) Mirror 17: 0x31297c01 (stale) Mirror 20: 0x31297c01 (stale) Mirror 21: 0x31297c01 (stale) Mirror 22: 0x31297c01 (stale) Mirror 23: 0x31297c01 (stale) Mirror 24: 0x31297c01 (stale) Mirror 25: 0x5baa6d1d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3991a: skipped 000668 1784342005.355149 trunc from 0x03991a to 0x03bd97 (0x247e bytes) 000670 1784342005.374390 mapwrite 0x02d916 thru 0x02e2f4 (0x9df bytes) 000671 1784342005.416765 trunc from 0x03bd98 to 0x014d94 (0x27003 bytes) 000672 1784342005.431988 read 0x006ed1 thru 0x013ddb (0xcf0b bytes) 000673 1784342005.437368 mapread 0x00caae thru 0x014d94 (0x82e7 bytes) 000674 1784342005.441497 write 0x02f6cc thru 0x030915 (0x124a bytes) 000675 1784342005.442429 trunc from 0x030916 to 0x0225b1 (0xe364 bytes) 000676 1784342005.457548 mapread 0x01dad3 thru 0x0205af (0x2add bytes) 000677 1784342005.465360 mapread 0x012517 thru 0x015610 (0x30fa bytes) 000678 1784342005.469730 trunc from 0x0225b2 to 0x01e655 (0x3f5c bytes) 000679 1784342005.487545 MIRROR_RESYNC 12 mirrors 000680 1784342006.176703 trunc from 0x01e656 to 0x010d0d (0xd948 bytes) 000682 1784342006.241228 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x10d0e): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10d0e): Mirror 8: 0x39bed84c (stale) Mirror 9: 0x39bed84c (stale) Mirror 12: 0x39bed84c (stale) Mirror 15: 0x39bed84c (stale) Mirror 17: 0x39bed84c (stale) Mirror 20: 0x39bed84c (stale) Mirror 21: 0x39bed84c (stale) Mirror 22: 0x39bed84c (stale) Mirror 23: 0x39bed84c (stale) Mirror 24: 0x39bed84c (stale) Mirror 25: 0x39bed84c (stale) CRC-32 checksum value for chunk [0, 0x10d0e): Mirror 1: 0x39bed84c Mirror 26: 0x39bed84c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10d0e: skipped 000687 1784342006.778208 trunc from 0x010d0e to 0x014c35 (0x3f28 bytes) 000690 1784342006.845657 trunc from 0x014c36 to 0x00a466 (0xa7cf bytes) 000691 1784342006.860519 mapread 0x002c92 thru 0x00a466 (0x77d5 bytes) 000695 1784342006.876672 MIRROR_RESYNC 13 mirrors 000697 1784342007.606727 mapwrite 0x00af25 thru 0x00fb21 (0x4bfd bytes) 000698 1784342007.687128 write 0x00258d thru 0x00e7b8 (0xc22c bytes) 000700 1784342007.692279 trunc from 0x00fb22 to 0x01a758 (0xac37 bytes) 000701 1784342007.701980 write 0x013028 thru 0x01ba47 (0x8a20 bytes) 000703 1784342007.708652 write 0x00288f thru 0x00b0ff (0x8871 bytes) 000704 1784342007.709953 read 0x01853a thru 0x018cab (0x772 bytes) 000707 1784342007.711831 mapread 0x003dad thru 0x008fe6 (0x523a bytes) 000708 1784342007.712848 write 0x005844 thru 0x009564 (0x3d21 bytes) 000710 1784342007.716660 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ba48): Mirror 8: 0xebb21887 (stale) Mirror 9: 0xebb21887 (stale) Mirror 12: 0xebb21887 (stale) Mirror 15: 0xebb21887 (stale) Mirror 17: 0xebb21887 (stale) Mirror 20: 0xebb21887 (stale) Mirror 21: 0xebb21887 (stale) Mirror 22: 0xebb21887 (stale) Mirror 23: 0xebb21887 (stale) Mirror 24: 0xebb21887 (stale) Mirror 26: 0xebb21887 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba48): Mirror 8: 0xebb21887 (stale) Mirror 9: 0xebb21887 (stale) Mirror 12: 0xebb21887 (stale) Mirror 15: 0xebb21887 (stale) Mirror 17: 0xebb21887 (stale) Mirror 20: 0xebb21887 (stale) Mirror 21: 0xebb21887 (stale) Mirror 22: 0xebb21887 (stale) Mirror 23: 0xebb21887 (stale) Mirror 24: 0xebb21887 (stale) Mirror 26: 0xebb21887 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba48: skipped 000712 1784342008.006004 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1ba48): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba48): Mirror 8: 0xebb21887 (stale) Mirror 9: 0xebb21887 (stale) Mirror 12: 0xebb21887 (stale) Mirror 15: 0xebb21887 (stale) Mirror 17: 0xebb21887 (stale) Mirror 20: 0xebb21887 (stale) Mirror 21: 0xebb21887 (stale) Mirror 22: 0xebb21887 (stale) Mirror 23: 0xebb21887 (stale) Mirror 24: 0xebb21887 (stale) Mirror 26: 0xebb21887 (stale) CRC-32 checksum value for chunk [0, 0x1ba48): Mirror 1: 0x57904a75 Mirror 27: 0x57904a75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba48: skipped 000713 1784342008.464623 mapwrite 0x018b1c thru 0x025c67 (0xd14c bytes) 000714 1784342008.557606 write 0x0367b4 thru 0x03ffff (0x984c bytes) 000715 1784342008.558991 trunc from 0x040000 to 0x01c57a (0x23a85 bytes) 000716 1784342008.570429 mapread 0x017bfa thru 0x01c57a (0x4981 bytes) 000718 1784342008.571842 trunc from 0x01c57b to 0x013530 (0x904a bytes) 000719 1784342008.579289 write 0x031898 thru 0x034841 (0x2faa bytes) 000720 1784342008.585683 MIRROR_RESYNC 13 mirrors 000722 1784342009.572278 mapwrite 0x0131ea thru 0x01d3c3 (0xa1da bytes) 000723 1784342009.685649 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34842): Mirror 8: 0xa5d75a5a (stale) Mirror 9: 0xa5d75a5a (stale) Mirror 12: 0xa5d75a5a (stale) Mirror 15: 0xa5d75a5a (stale) Mirror 17: 0xa5d75a5a (stale) Mirror 21: 0xa5d75a5a (stale) Mirror 22: 0xa5d75a5a (stale) Mirror 23: 0xa5d75a5a (stale) Mirror 24: 0xa5d75a5a (stale) Mirror 26: 0xa5d75a5a (stale) Mirror 27: 0xa5d75a5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34842): Mirror 8: 0xa5d75a5a (stale) Mirror 9: 0xa5d75a5a (stale) Mirror 12: 0xa5d75a5a (stale) Mirror 15: 0xa5d75a5a (stale) Mirror 17: 0xa5d75a5a (stale) Mirror 21: 0xa5d75a5a (stale) Mirror 22: 0xa5d75a5a (stale) Mirror 23: 0xa5d75a5a (stale) Mirror 24: 0xa5d75a5a (stale) Mirror 26: 0xa5d75a5a (stale) Mirror 27: 0xa5d75a5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34842: skipped 000725 1784342010.041487 write 0x0293e4 thru 0x032506 (0x9123 bytes) 000726 1784342010.054382 read 0x031d91 thru 0x032fd6 (0x1246 bytes) 000727 1784342010.055096 mapwrite 0x00b8e8 thru 0x010967 (0x5080 bytes) 000728 1784342010.094257 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34842): Mirror 9: 0xa5d75a5a (stale) Mirror 12: 0xa5d75a5a (stale) Mirror 15: 0xa5d75a5a (stale) Mirror 17: 0xa5d75a5a (stale) Mirror 21: 0xa5d75a5a (stale) Mirror 22: 0xa5d75a5a (stale) Mirror 23: 0xa5d75a5a (stale) Mirror 24: 0xa5d75a5a (stale) Mirror 26: 0xa5d75a5a (stale) Mirror 27: 0xa5d75a5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34842): Mirror 9: 0xa5d75a5a (stale) Mirror 12: 0xa5d75a5a (stale) Mirror 15: 0xa5d75a5a (stale) Mirror 17: 0xa5d75a5a (stale) Mirror 21: 0xa5d75a5a (stale) Mirror 22: 0xa5d75a5a (stale) Mirror 23: 0xa5d75a5a (stale) Mirror 24: 0xa5d75a5a (stale) Mirror 26: 0xa5d75a5a (stale) Mirror 27: 0xa5d75a5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34842: skipped 000730 1784342010.415622 read 0x011f73 thru 0x01d48c (0xb51a bytes) 000732 1784342010.425799 write 0x02bc47 thru 0x030ccf (0x5089 bytes) 000733 1784342010.443829 mapread 0x02f270 thru 0x034841 (0x55d2 bytes) 000734 1784342010.465304 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34842): Mirror 12: 0xa5d75a5a (stale) Mirror 15: 0xa5d75a5a (stale) Mirror 17: 0xa5d75a5a (stale) Mirror 21: 0xa5d75a5a (stale) Mirror 22: 0xa5d75a5a (stale) Mirror 23: 0xa5d75a5a (stale) Mirror 24: 0xa5d75a5a (stale) Mirror 26: 0xa5d75a5a (stale) Mirror 27: 0xa5d75a5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34842): Mirror 12: 0xa5d75a5a (stale) Mirror 15: 0xa5d75a5a (stale) Mirror 17: 0xa5d75a5a (stale) Mirror 21: 0xa5d75a5a (stale) Mirror 22: 0xa5d75a5a (stale) Mirror 23: 0xa5d75a5a (stale) Mirror 24: 0xa5d75a5a (stale) Mirror 26: 0xa5d75a5a (stale) Mirror 27: 0xa5d75a5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34842: skipped 000735 1784342010.874700 mapread 0x00d115 thru 0x01420b (0x70f7 bytes) 000736 1784342010.887111 mapwrite 0x033318 thru 0x03aef5 (0x7bde bytes) 000737 1784342010.945052 mapwrite 0x01a598 thru 0x01da49 (0x34b2 bytes) 000738 1784342010.988960 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aef6): Mirror 12: 0xcea1a9bc (stale) Mirror 15: 0xcea1a9bc (stale) Mirror 17: 0xcea1a9bc (stale) Mirror 22: 0xcea1a9bc (stale) Mirror 23: 0xcea1a9bc (stale) Mirror 24: 0xcea1a9bc (stale) Mirror 26: 0xcea1a9bc (stale) Mirror 27: 0xcea1a9bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aef6): Mirror 12: 0xcea1a9bc (stale) Mirror 15: 0xcea1a9bc (stale) Mirror 17: 0xcea1a9bc (stale) Mirror 22: 0xcea1a9bc (stale) Mirror 23: 0xcea1a9bc (stale) Mirror 24: 0xcea1a9bc (stale) Mirror 26: 0xcea1a9bc (stale) Mirror 27: 0xcea1a9bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aef6: skipped 000741 1784342011.237240 trunc from 0x03aef6 to 0x00d84b (0x2d6aa bytes) 000748 1784342011.256614 trunc from 0x00d84c to 0x028a50 (0x1b205 bytes) 000749 1784342011.266079 mapwrite 0x02b77e thru 0x02dfba (0x283d bytes) 000751 1784342011.307155 read 0x013baf thru 0x01e6c1 (0xab13 bytes) 000752 1784342011.311341 trunc from 0x02dfbb to 0x0064ba (0x27b00 bytes) 000755 1784342011.318383 mapread 0x000126 thru 0x003511 (0x33ec bytes) 000757 1784342011.330650 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x64bb): Mirror 12: 0xc31ff2f7 (stale) Mirror 15: 0xc31ff2f7 (stale) Mirror 17: 0xc31ff2f7 (stale) Mirror 22: 0xc31ff2f7 (stale) Mirror 23: 0xc31ff2f7 (stale) Mirror 24: 0xc31ff2f7 (stale) Mirror 27: 0xc31ff2f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x64bb): Mirror 12: 0xc31ff2f7 (stale) Mirror 15: 0xc31ff2f7 (stale) Mirror 17: 0xc31ff2f7 (stale) Mirror 22: 0xc31ff2f7 (stale) Mirror 23: 0xc31ff2f7 (stale) Mirror 24: 0xc31ff2f7 (stale) Mirror 27: 0xc31ff2f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x64bb: skipped 000761 1784342011.562017 read 0x0061ef thru 0x0064ba (0x2cc bytes) truncating to largest ever: 0x3ecc4 000763 1784342011.566564 trunc from 0x0064bb to 0x03ecc3 (0x38809 bytes) 000764 1784342011.574983 read 0x0263bf thru 0x02747b (0x10bd bytes) 000770 1784342011.586079 mapread 0x024393 thru 0x028dd6 (0x4a44 bytes) 000771 1784342011.587820 write 0x02a203 thru 0x02ce53 (0x2c51 bytes) 000775 1784342011.590580 write 0x02ad13 thru 0x039553 (0xe841 bytes) 000777 1784342011.592608 trunc from 0x03ecc4 to 0x02b164 (0x13b5f bytes) 000779 1784342011.616049 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2b165): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b165): Mirror 12: 0x740eabb8 (stale) Mirror 15: 0x740eabb8 (stale) Mirror 17: 0x740eabb8 (stale) Mirror 22: 0x740eabb8 (stale) Mirror 23: 0x740eabb8 (stale) Mirror 24: 0x740eabb8 (stale) Mirror 27: 0x740eabb8 (stale) CRC-32 checksum value for chunk [0, 0x2b165): Mirror 1: 0x905ed2e5 Mirror 28: 0x905ed2e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b165: skipped 000781 1784342012.107225 mapwrite 0x02e33c thru 0x0325cb (0x4290 bytes) 000782 1784342012.221821 trunc from 0x0325cc to 0x02464b (0xdf80 bytes) 000783 1784342012.229040 write 0x03b95c thru 0x03f7d0 (0x3e75 bytes) 000784 1784342012.230021 trunc from 0x03f7d1 to 0x0195f9 (0x261d7 bytes) 000789 1784342012.239966 mapwrite 0x00a5fa thru 0x0107e3 (0x61ea bytes) 000790 1784342012.274009 trunc from 0x0195fa to 0x02f957 (0x1635e bytes) 000792 1784342012.289186 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2f958): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f958): Mirror 12: 0x57e80048 (stale) Mirror 15: 0x57e80048 (stale) Mirror 17: 0x57e80048 (stale) Mirror 22: 0x57e80048 (stale) Mirror 23: 0x57e80048 (stale) Mirror 24: 0x57e80048 (stale) Mirror 27: 0x57e80048 (stale) Mirror 28: 0xfbf7b23f (stale) CRC-32 checksum value for chunk [0, 0x2f958): Mirror 1: 0x5fa8ad32 Mirror 29: 0x5fa8ad32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f958: skipped 000793 1784342012.782402 write 0x03183a thru 0x03a480 (0x8c47 bytes) 000794 1784342012.833437 mapread 0x031683 thru 0x031b33 (0x4b1 bytes) 000795 1784342012.836448 mapwrite 0x03e75d thru 0x03ffff (0x18a3 bytes) 000796 1784342012.870309 trunc from 0x040000 to 0x015df9 (0x2a206 bytes) 000798 1784342012.881940 mapwrite 0x0082ff thru 0x0181a4 (0xfea6 bytes) 000800 1784342012.931379 trunc from 0x0181a5 to 0x02bffb (0x13e57 bytes) 000801 1784342012.939288 mapwrite 0x00e5da thru 0x0120a8 (0x3acf bytes) 000802 1784342012.973031 write 0x0029ce thru 0x00bdac (0x93df bytes) 000803 1784342012.974336 mapwrite 0x00dce7 thru 0x013433 (0x574d bytes) 000804 1784342013.012328 trunc from 0x02bffc to 0x015dc1 (0x1623a bytes) 000805 1784342013.019517 mapread 0x000657 thru 0x007caf (0x7659 bytes) 000806 1784342013.022639 trunc from 0x015dc2 to 0x02800f (0x1224e bytes) 000807 1784342013.029304 mapwrite 0x0385fc thru 0x03f167 (0x6b6c bytes) 000809 1784342013.084029 mapwrite 0x01b6b7 thru 0x027b7a (0xc4c4 bytes) 000810 1784342013.127834 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f168): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f168): Mirror 12: 0xd16bd0ce (stale) Mirror 15: 0xd16bd0ce (stale) Mirror 17: 0xd16bd0ce (stale) Mirror 22: 0xd16bd0ce (stale) Mirror 23: 0xd16bd0ce (stale) Mirror 24: 0xd16bd0ce (stale) Mirror 27: 0xd16bd0ce (stale) Mirror 28: 0x271d940f (stale) Mirror 29: 0x18ac9c09 (stale) CRC-32 checksum value for chunk [0, 0x3f168): Mirror 1: 0xa58dcfb4 Mirror 30: 0xa58dcfb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f168: skipped 000811 1784342013.527253 trunc from 0x03f168 to 0x001c9d (0x3d4ca bytes) 000812 1784342013.581965 mapwrite 0x02eb07 thru 0x034e69 (0x6363 bytes) 000814 1784342013.643022 write 0x0385a0 thru 0x039ef5 (0x1956 bytes) 000816 1784342013.644588 trunc from 0x039ef6 to 0x00b9ba (0x2e53b bytes) 000817 1784342013.653053 read 0x0090a3 thru 0x00b9ba (0x2918 bytes) 000820 1784342013.657797 mapwrite 0x013c84 thru 0x014634 (0x9b1 bytes) 000821 1784342013.694429 trunc from 0x014635 to 0x0141f1 (0x443 bytes) 000822 1784342013.703664 mapwrite 0x01a825 thru 0x01c060 (0x183c bytes) 000823 1784342013.746205 read 0x00b593 thru 0x00b87d (0x2eb bytes) 000826 1784342013.747477 trunc from 0x01c061 to 0x034c1a (0x18bba bytes) 000828 1784342013.756829 read 0x02ad99 thru 0x0342af (0x9517 bytes) 000830 1784342013.761448 read 0x01b327 thru 0x01f359 (0x4033 bytes) 000831 1784342013.761905 write 0x0279fc thru 0x02d39f (0x59a4 bytes) 000836 1784342013.764557 write 0x0121c7 thru 0x012fbc (0xdf6 bytes) 000837 1784342013.765234 mapread 0x01a3ac thru 0x01d162 (0x2db7 bytes) 000838 1784342013.766201 write 0x01ca26 thru 0x027e87 (0xb462 bytes) 000839 1784342013.769654 MIRROR_RESYNC 11 mirrors 000842 1784342014.506352 trunc from 0x034c1b to 0x01daa4 (0x17176 bytes) 000845 1784342014.566185 mapwrite 0x0364bb thru 0x03ffff (0x9b45 bytes) 000846 1784342014.624547 read 0x0172f9 thru 0x017c13 (0x91b bytes) 000847 1784342014.628410 read 0x03b767 thru 0x03ffff (0x4899 bytes) 000848 1784342014.628989 read 0x01bd02 thru 0x024a03 (0x8d02 bytes) 000850 1784342014.636656 write 0x01b13a thru 0x01be0c (0xcd3 bytes) 000851 1784342014.637255 write 0x03180d thru 0x037580 (0x5d74 bytes) 000852 1784342014.637895 mapread 0x02920b thru 0x02fa19 (0x680f bytes) 000854 1784342014.639347 mapread 0x02c0b9 thru 0x03b092 (0xefda bytes) 000858 1784342014.642377 read 0x031d59 thru 0x03b71b (0x99c3 bytes) 000861 1784342014.643770 mapwrite 0x03c9cf thru 0x03d459 (0xa8b bytes) 000862 1784342014.681589 trunc from 0x040000 to 0x00a5a7 (0x35a58 bytes) 000866 1784342014.694435 mapwrite 0x01ae0d thru 0x029e61 (0xf055 bytes) 000867 1784342014.745494 mapread 0x01599b thru 0x01c98d (0x6ff3 bytes) 000869 1784342014.747115 write 0x0115b6 thru 0x017887 (0x62d2 bytes) 000870 1784342014.748134 trunc from 0x029e62 to 0x03592f (0xbace bytes) 000871 1784342014.759750 trunc from 0x035930 to 0x01fa15 (0x15f1a bytes) 000877 1784342014.772006 write 0x03a888 thru 0x03ffff (0x5778 bytes) 000878 1784342014.773447 mapread 0x0215b8 thru 0x030314 (0xed5d bytes) 000879 1784342014.801691 read 0x02fdf9 thru 0x031be7 (0x1def bytes) 000880 1784342014.802320 mapwrite 0x034f7d thru 0x03ac08 (0x5c8c bytes) 000884 1784342014.837708 read 0x028e03 thru 0x02a650 (0x184e bytes) 000885 1784342014.839197 mapread 0x01af2f thru 0x029291 (0xe363 bytes) 000887 1784342014.847143 write 0x0334fb thru 0x03ece6 (0xb7ec bytes) 000889 1784342014.849507 write 0x01a283 thru 0x023681 (0x93ff bytes) 000890 1784342014.850818 mapwrite 0x003c3f thru 0x0073b1 (0x3773 bytes) 000891 1784342014.881374 write 0x004cd5 thru 0x00ba02 (0x6d2e bytes) 000892 1784342014.885960 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x3df90500 (stale) Mirror 15: 0x3df90500 (stale) Mirror 17: 0x3df90500 (stale) Mirror 22: 0x3df90500 (stale) Mirror 23: 0x3df90500 (stale) Mirror 24: 0x3df90500 (stale) Mirror 27: 0x3df90500 (stale) Mirror 28: 0x3df90500 (stale) Mirror 29: 0x3df90500 (stale) Mirror 30: 0x3df90500 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x26625eb8 Mirror 31: 0x26625eb8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000896 1784342015.376771 trunc from 0x040000 to 0x02ea17 (0x115e8 bytes) 000898 1784342015.415658 write 0x01d853 thru 0x0295aa (0xbd58 bytes) 000899 1784342015.421052 mapwrite 0x00eba9 thru 0x01a003 (0xb45b bytes) 000900 1784342015.459776 mapread 0x009107 thru 0x0119b3 (0x88ad bytes) 000901 1784342015.460972 trunc from 0x02ea18 to 0x032742 (0x3d2b bytes) 000903 1784342015.472157 mapread 0x0141fa thru 0x022af6 (0xe8fd bytes) 000904 1784342015.473272 write 0x034f2a thru 0x039c32 (0x4d09 bytes) 000907 1784342015.475058 read 0x02f6cb thru 0x0301dd (0xb13 bytes) 000908 1784342015.478192 read 0x021831 thru 0x024e51 (0x3621 bytes) 000909 1784342015.478648 write 0x00a02c thru 0x00dd1d (0x3cf2 bytes) 000910 1784342015.479280 trunc from 0x039c33 to 0x0125d0 (0x27662 bytes) 000911 1784342015.486334 write 0x0340ea thru 0x037c08 (0x3b1f bytes) 000913 1784342015.488082 write 0x00540b thru 0x00c2b6 (0x6eac bytes) 000914 1784342015.493021 trunc from 0x037c09 to 0x004819 (0x333ef bytes) 000915 1784342015.501713 mapwrite 0x0223c7 thru 0x02526a (0x2ea4 bytes) 000917 1784342015.543775 trunc from 0x02526b to 0x02331f (0x1f4b bytes) 000918 1784342015.550997 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x23320): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23320): Mirror 12: 0x5bfa694b (stale) Mirror 15: 0x5bfa694b (stale) Mirror 17: 0x5bfa694b (stale) Mirror 22: 0x5bfa694b (stale) Mirror 23: 0x5bfa694b (stale) Mirror 24: 0x5bfa694b (stale) Mirror 27: 0x5bfa694b (stale) Mirror 28: 0x5bfa694b (stale) Mirror 29: 0x5bfa694b (stale) Mirror 30: 0x5bfa694b (stale) Mirror 31: 0x4a08b3c7 (stale) CRC-32 checksum value for chunk [0, 0x23320): Mirror 1: 0xeb309c6e Mirror 32: 0xeb309c6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23320: skipped 000920 1784342015.956466 read 0x00acac thru 0x013d47 (0x909c bytes) 000921 1784342015.963076 trunc from 0x023320 to 0x031a00 (0xe6e1 bytes) 000922 1784342016.007706 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31a01): Mirror 12: 0xb3a915b8 (stale) Mirror 15: 0xb3a915b8 (stale) Mirror 17: 0xb3a915b8 (stale) Mirror 22: 0xb3a915b8 (stale) Mirror 23: 0xb3a915b8 (stale) Mirror 24: 0xb3a915b8 (stale) Mirror 27: 0xb3a915b8 (stale) Mirror 28: 0xb3a915b8 (stale) Mirror 29: 0xb3a915b8 (stale) Mirror 30: 0xb3a915b8 (stale) Mirror 32: 0xd14b4cba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a01): Mirror 12: 0xb3a915b8 (stale) Mirror 15: 0xb3a915b8 (stale) Mirror 17: 0xb3a915b8 (stale) Mirror 22: 0xb3a915b8 (stale) Mirror 23: 0xb3a915b8 (stale) Mirror 24: 0xb3a915b8 (stale) Mirror 27: 0xb3a915b8 (stale) Mirror 28: 0xb3a915b8 (stale) Mirror 29: 0xb3a915b8 (stale) Mirror 30: 0xb3a915b8 (stale) Mirror 32: 0xd14b4cba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a01: skipped 000923 1784342016.285578 trunc from 0x031a01 to 0x01c188 (0x15878 bytes) 000924 1784342016.296359 mapwrite 0x016c23 thru 0x01f1f3 (0x85d1 bytes) 000925 1784342016.350583 mapread 0x0014d7 thru 0x00309d (0x1bc7 bytes) 000927 1784342016.355845 mapwrite 0x020680 thru 0x023b56 (0x34d7 bytes) 000928 1784342016.394045 trunc from 0x023b57 to 0x03c1fa (0x186a4 bytes) 000930 1784342016.406432 read 0x034106 thru 0x03752f (0x342a bytes) 000931 1784342016.410198 write 0x03afd4 thru 0x03ffff (0x502c bytes) 000932 1784342016.415193 read 0x00491a thru 0x010a31 (0xc118 bytes) 000933 1784342016.421243 mapread 0x018844 thru 0x01eb11 (0x62ce bytes) 000934 1784342016.422457 write 0x0002c3 thru 0x006320 (0x605e bytes) 000935 1784342016.423687 read 0x01fad5 thru 0x025220 (0x574c bytes) 000938 1784342016.425557 read 0x01ecb4 thru 0x029e69 (0xb1b6 bytes) 000939 1784342016.428681 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x3df90500 (stale) Mirror 15: 0x3df90500 (stale) Mirror 17: 0x3df90500 (stale) Mirror 22: 0x3df90500 (stale) Mirror 23: 0x3df90500 (stale) Mirror 24: 0x3df90500 (stale) Mirror 27: 0x3df90500 (stale) Mirror 28: 0x3df90500 (stale) Mirror 30: 0x3df90500 (stale) Mirror 32: 0xd9779bee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x3df90500 (stale) Mirror 15: 0x3df90500 (stale) Mirror 17: 0x3df90500 (stale) Mirror 22: 0x3df90500 (stale) Mirror 23: 0x3df90500 (stale) Mirror 24: 0x3df90500 (stale) Mirror 27: 0x3df90500 (stale) Mirror 28: 0x3df90500 (stale) Mirror 30: 0x3df90500 (stale) Mirror 32: 0xd9779bee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000941 1784342016.663225 trunc from 0x040000 to 0x01dc53 (0x223ac bytes) 000943 1784342016.673344 read 0x00582d thru 0x006246 (0xa1a bytes) 000944 1784342016.676696 mapread 0x019e3d thru 0x01a3cb (0x58f bytes) 000946 1784342016.683935 trunc from 0x01dc54 to 0x02fe4a (0x121f7 bytes) 000947 1784342016.692242 mapread 0x02a16f thru 0x02fe4a (0x5cdc bytes) 000948 1784342016.697224 trunc from 0x02fe4b to 0x00e166 (0x21ce4 bytes) 000950 1784342016.707189 trunc from 0x00e167 to 0x019fe7 (0xbe81 bytes) 000952 1784342016.716673 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x19fe8): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19fe8): Mirror 12: 0x389e1479 (stale) Mirror 15: 0x389e1479 (stale) Mirror 17: 0x389e1479 (stale) Mirror 22: 0x389e1479 (stale) Mirror 23: 0x389e1479 (stale) Mirror 24: 0x389e1479 (stale) Mirror 27: 0x389e1479 (stale) Mirror 28: 0x389e1479 (stale) Mirror 30: 0x389e1479 (stale) Mirror 32: 0xe150b272 (stale) CRC-32 checksum value for chunk [0, 0x19fe8): Mirror 1: 0x112fbdd7 Mirror 33: 0x112fbdd7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19fe8: skipped 000953 1784342017.071417 trunc from 0x019fe8 to 0x00451e (0x15ac9 bytes) 000954 1784342017.138439 write 0x019e3f thru 0x0232de (0x94a0 bytes) 000956 1784342017.141190 mapread 0x0124d3 thru 0x019c5a (0x7788 bytes) 000957 1784342017.150689 mapwrite 0x03e566 thru 0x03ffff (0x1a9a bytes) 000958 1784342017.204375 mapwrite 0x03cd16 thru 0x03ffff (0x32ea bytes) 000959 1784342017.222445 write 0x0242bc thru 0x02e120 (0x9e65 bytes) 000961 1784342017.227633 trunc from 0x040000 to 0x02cf18 (0x130e7 bytes) 000962 1784342017.233976 write 0x003322 thru 0x010fb6 (0xdc95 bytes) 000964 1784342017.238511 mapread 0x005ea0 thru 0x011aec (0xbc4d bytes) 000966 1784342017.240805 read 0x0075d8 thru 0x010a0e (0x9437 bytes) 000968 1784342017.242051 trunc from 0x02cf19 to 0x02dde3 (0xecb bytes) 000969 1784342017.253681 read 0x01e91c thru 0x022855 (0x3f3a bytes) 000971 1784342017.254980 mapread 0x00faee thru 0x01d7df (0xdcf2 bytes) 000973 1784342017.256929 mapwrite 0x004849 thru 0x009651 (0x4e09 bytes) 000974 1784342017.284026 trunc from 0x02dde4 to 0x030599 (0x27b6 bytes) 000975 1784342017.291386 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3059a): Mirror 12: 0x57ebbfe2 (stale) Mirror 15: 0x57ebbfe2 (stale) Mirror 17: 0x57ebbfe2 (stale) Mirror 22: 0x57ebbfe2 (stale) Mirror 23: 0x57ebbfe2 (stale) Mirror 24: 0x57ebbfe2 (stale) Mirror 28: 0x57ebbfe2 (stale) Mirror 30: 0x57ebbfe2 (stale) Mirror 32: 0x299a04d6 (stale) Mirror 33: 0x259a40a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3059a): Mirror 12: 0x57ebbfe2 (stale) Mirror 15: 0x57ebbfe2 (stale) Mirror 17: 0x57ebbfe2 (stale) Mirror 22: 0x57ebbfe2 (stale) Mirror 23: 0x57ebbfe2 (stale) Mirror 24: 0x57ebbfe2 (stale) Mirror 28: 0x57ebbfe2 (stale) Mirror 30: 0x57ebbfe2 (stale) Mirror 32: 0x299a04d6 (stale) Mirror 33: 0x259a40a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3059a: skipped 000979 1784342017.542536 mapwrite 0x03d049 thru 0x03ffff (0x2fb7 bytes) 000981 1784342017.602006 write 0x0156f0 thru 0x02180f (0xc120 bytes) 000982 1784342017.617364 write 0x017bbb thru 0x018e2f (0x1275 bytes) 000983 1784342017.625612 MIRROR_RESYNC 11 mirrors 000985 1784342018.289710 read 0x02eafb thru 0x0392e2 (0xa7e8 bytes) 000989 1784342018.295487 mapwrite 0x001c85 thru 0x00465d (0x29d9 bytes) 000992 1784342018.369148 mapwrite 0x018b2c thru 0x024ff8 (0xc4cd bytes) 000993 1784342018.411287 write 0x02d2a8 thru 0x030bb8 (0x3911 bytes) 000994 1784342018.421168 trunc from 0x040000 to 0x00b765 (0x3489a bytes) 000995 1784342018.436393 MIRROR_RESYNC 11 mirrors 000996 1784342019.155621 read 0x00565f thru 0x00b765 (0x6107 bytes) 000997 1784342019.162252 trunc from 0x00b766 to 0x00ac7a (0xaeb bytes) 000998 1784342019.222059 mapwrite 0x02ced7 thru 0x0337cd (0x68f7 bytes) 000999 1784342019.278770 read 0x0119ec thru 0x01c8a1 (0xaeb6 bytes) 001000 1784342019.290615 write 0x0176bb thru 0x0269c1 (0xf307 bytes) All operations completed A-OK!